2024-04-25T08:46:32.241 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T08:46:32.241 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_neesingh@teuthology --archive /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999 --description fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} --verbose --name neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi -- /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999/orig.config.yaml 2024-04-25T08:46:32.285 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T08:46:32.376 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999 branch: wip-neesingh-testing-240416 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} email: neesingh@redhat.com first_in_suite: false job_id: '7672999' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-neesingh-testing-240416 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec kclient: syntax: v1 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-62537 sha1: 5787d42d10024ba410e822a8aba474331cb9af02 owner: scheduled_neesingh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5869 sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec sleep_before_teardown: 0 suite: fs:functional suite_branch: wip-62537 suite_path: /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa suite_relpath: qa suite_repo: https://github.com/neesingh-rh/ceph suite_sha1: 5787d42d10024ba410e822a8aba474331cb9af02 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ18lgoUTLcL2STvs7Ne/uCk/yaGEwQi63rqBbaz0Q5+CnxjK5uGU1z4KXTMnvUttKVZ3kRsPmUA3NJhNhs657E= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDTPTfVkn2rOPbBJ3PM0t7TzCvujRObL9+qv3EMh1EJA26H6jfS1Su1Iy9PDmP5YUrj5SR5ArdunTT5En3iU9T4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_08:15:18 tube: smithi user: neesingh verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T08:46:32.376 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa; will attempt to use it 2024-04-25T08:46:32.377 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa/tasks 2024-04-25T08:46:32.377 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T08:46:32.378 INFO:teuthology.task.internal:Checking packages... 2024-04-25T08:46:32.400 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec' 2024-04-25T08:46:32.401 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T08:46:32.401 INFO:teuthology.packaging:ref: None 2024-04-25T08:46:32.401 INFO:teuthology.packaging:tag: None 2024-04-25T08:46:32.401 INFO:teuthology.packaging:branch: wip-neesingh-testing-240416 2024-04-25T08:46:32.401 INFO:teuthology.packaging:sha1: 97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:46:32.401 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-neesingh-testing-240416 2024-04-25T08:46:32.542 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T08:46:32.543 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T08:46:32.550 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T08:46:32.550 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T08:46:32.564 INFO:teuthology.task.internal:Saving configuration 2024-04-25T08:46:32.580 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T08:46:32.585 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T08:46:32.611 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:40:29.974610', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIF7mQBum4I5J7TMknupyFcGO7GCF7eRzzPa+meI0pBbc'} 2024-04-25T08:46:32.628 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 08:40:29.973428', 'locked_by': 'scheduled_neesingh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJt/hWZaeOy/z8FVYomWkMXeLsH/D8qYPSGl19IZIQqK'} 2024-04-25T08:46:32.628 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T08:46:32.634 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-25T08:46:32.634 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-25T08:46:32.634 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T08:46:32.700 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f49381e70d0>, signals=[15]) 2024-04-25T08:46:32.701 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T08:46:32.707 INFO:teuthology.task.internal:Opening connections... 2024-04-25T08:46:32.707 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T08:46:32.709 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:46:32.792 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T08:46:32.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:46:32.866 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T08:46:32.873 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2024-04-25T08:46:32.879 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2024-04-25T08:46:32.879 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2024-04-25T08:46:32.925 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T08:46:32.925 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Ubuntu" 2024-04-25T08:46:32.925 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="22.04" 2024-04-25T08:46:32.925 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T08:46:32.925 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_CODENAME=jammy 2024-04-25T08:46:32.925 INFO:teuthology.orchestra.run.smithi059.stdout:ID=ubuntu 2024-04-25T08:46:32.925 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE=debian 2024-04-25T08:46:32.925 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T08:46:32.925 INFO:teuthology.orchestra.run.smithi059.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T08:46:32.925 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T08:46:32.925 INFO:teuthology.orchestra.run.smithi059.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T08:46:32.925 INFO:teuthology.orchestra.run.smithi059.stdout:UBUNTU_CODENAME=jammy 2024-04-25T08:46:32.926 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2024-04-25T08:46:32.950 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-04-25T08:46:32.955 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-04-25T08:46:32.955 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-04-25T08:46:32.999 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T08:46:32.999 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Ubuntu" 2024-04-25T08:46:32.999 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="22.04" 2024-04-25T08:46:32.999 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T08:46:32.999 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_CODENAME=jammy 2024-04-25T08:46:33.000 INFO:teuthology.orchestra.run.smithi178.stdout:ID=ubuntu 2024-04-25T08:46:33.000 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE=debian 2024-04-25T08:46:33.000 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T08:46:33.000 INFO:teuthology.orchestra.run.smithi178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T08:46:33.000 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T08:46:33.000 INFO:teuthology.orchestra.run.smithi178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T08:46:33.000 INFO:teuthology.orchestra.run.smithi178.stdout:UBUNTU_CODENAME=jammy 2024-04-25T08:46:33.000 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-04-25T08:46:33.017 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T08:46:33.026 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T08:46:33.032 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T08:46:33.032 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2024-04-25T08:46:33.035 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2024-04-25T08:46:33.043 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T08:46:33.049 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T08:46:33.050 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2024-04-25T08:46:33.082 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2024-04-25T08:46:33.097 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T08:46:33.150 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T08:46:33.164 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T08:46:33.164 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-04-25T08:46:33.164 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-04-25T08:46:33.164 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T08:46:33.165 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T08:46:33.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:46:33.169 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-25T08:46:33.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T08:46:33.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-04-25T08:46:33.351 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:46:33.351 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T08:46:33.351 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-04-25T08:46:33.356 INFO:teuthology.orchestra.run.smithi178.stdout:5.15.0-56-generic 2024-04-25T08:46:33.356 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:46:33.356 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T08:46:33.357 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-04-25T08:46:33.357 DEBUG:teuthology.orchestra.run.smithi178:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-25T08:46:33.361 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:46:33.361 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-04-25T08:46:33.361 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-04-25T08:46:33.367 INFO:teuthology.orchestra.run.smithi059.stdout:5.15.0-56-generic 2024-04-25T08:46:33.367 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:46:33.367 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-25T08:46:33.367 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-04-25T08:46:33.367 DEBUG:teuthology.orchestra.run.smithi059:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-25T08:46:33.415 INFO:teuthology.orchestra.run.smithi178.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-25T08:46:33.432 INFO:teuthology.orchestra.run.smithi059.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-25T08:46:33.563 INFO:teuthology.orchestra.run.smithi178.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-25T08:46:33.563 INFO:teuthology.orchestra.run.smithi178.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-25T08:46:33.563 INFO:teuthology.orchestra.run.smithi178.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-25T08:46:33.563 INFO:teuthology.orchestra.run.smithi178.stderr:hint: 2024-04-25T08:46:33.563 INFO:teuthology.orchestra.run.smithi178.stderr:hint: git config --global init.defaultBranch 2024-04-25T08:46:33.563 INFO:teuthology.orchestra.run.smithi178.stderr:hint: 2024-04-25T08:46:33.563 INFO:teuthology.orchestra.run.smithi178.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-25T08:46:33.564 INFO:teuthology.orchestra.run.smithi178.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-25T08:46:33.564 INFO:teuthology.orchestra.run.smithi178.stderr:hint: 2024-04-25T08:46:33.564 INFO:teuthology.orchestra.run.smithi178.stderr:hint: git branch -m 2024-04-25T08:46:33.564 INFO:teuthology.orchestra.run.smithi178.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-25T08:46:33.566 DEBUG:teuthology.orchestra.run.smithi178:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-25T08:46:33.575 INFO:teuthology.orchestra.run.smithi059.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-25T08:46:33.575 INFO:teuthology.orchestra.run.smithi059.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-25T08:46:33.575 INFO:teuthology.orchestra.run.smithi059.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-25T08:46:33.575 INFO:teuthology.orchestra.run.smithi059.stderr:hint: 2024-04-25T08:46:33.575 INFO:teuthology.orchestra.run.smithi059.stderr:hint: git config --global init.defaultBranch 2024-04-25T08:46:33.575 INFO:teuthology.orchestra.run.smithi059.stderr:hint: 2024-04-25T08:46:33.575 INFO:teuthology.orchestra.run.smithi059.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-25T08:46:33.575 INFO:teuthology.orchestra.run.smithi059.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-25T08:46:33.576 INFO:teuthology.orchestra.run.smithi059.stderr:hint: 2024-04-25T08:46:33.576 INFO:teuthology.orchestra.run.smithi059.stderr:hint: git branch -m 2024-04-25T08:46:33.576 INFO:teuthology.orchestra.run.smithi059.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-25T08:46:33.578 DEBUG:teuthology.orchestra.run.smithi059:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-25T08:46:33.632 DEBUG:teuthology.orchestra.run.smithi178:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-25T08:46:33.645 DEBUG:teuthology.orchestra.run.smithi059:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-25T08:46:33.689 DEBUG:teuthology.orchestra.run.smithi178:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-25T08:46:33.707 DEBUG:teuthology.orchestra.run.smithi059:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-25T08:47:07.207 INFO:teuthology.orchestra.run.smithi059.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-25T08:47:07.207 INFO:teuthology.orchestra.run.smithi059.stderr: * [new branch] main -> origin/main 2024-04-25T08:47:07.242 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190312 -> 20190312 2024-04-25T08:47:07.242 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190416 -> 20190416 2024-04-25T08:47:07.242 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190514 -> 20190514 2024-04-25T08:47:07.242 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190618 -> 20190618 2024-04-25T08:47:07.242 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190717 -> 20190717 2024-04-25T08:47:07.242 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190815 -> 20190815 2024-04-25T08:47:07.242 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20190923 -> 20190923 2024-04-25T08:47:07.243 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20191022 -> 20191022 2024-04-25T08:47:07.243 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20191215 -> 20191215 2024-04-25T08:47:07.243 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200122 -> 20200122 2024-04-25T08:47:07.243 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200316 -> 20200316 2024-04-25T08:47:07.244 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200421 -> 20200421 2024-04-25T08:47:07.244 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200519 -> 20200519 2024-04-25T08:47:07.244 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200619 -> 20200619 2024-04-25T08:47:07.244 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200721 -> 20200721 2024-04-25T08:47:07.244 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200817 -> 20200817 2024-04-25T08:47:07.245 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20200918 -> 20200918 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20201022 -> 20201022 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20201118 -> 20201118 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20201218 -> 20201218 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20210208 -> 20210208 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20210315 -> 20210315 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20210511 -> 20210511 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20210716 -> 20210716 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20210818 -> 20210818 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20210919 -> 20210919 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20211027 -> 20211027 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20211216 -> 20211216 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220209 -> 20220209 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220310 -> 20220310 2024-04-25T08:47:07.246 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220411 -> 20220411 2024-04-25T08:47:07.247 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220509 -> 20220509 2024-04-25T08:47:07.249 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220610 -> 20220610 2024-04-25T08:47:07.249 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220708 -> 20220708 2024-04-25T08:47:07.249 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220815 -> 20220815 2024-04-25T08:47:07.249 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20220913 -> 20220913 2024-04-25T08:47:07.249 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20221012 -> 20221012 2024-04-25T08:47:07.249 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20221109 -> 20221109 2024-04-25T08:47:07.249 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20221214 -> 20221214 2024-04-25T08:47:07.249 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230117 -> 20230117 2024-04-25T08:47:07.249 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230210 -> 20230210 2024-04-25T08:47:07.249 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230310 -> 20230310 2024-04-25T08:47:07.249 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230404 -> 20230404 2024-04-25T08:47:07.250 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230515 -> 20230515 2024-04-25T08:47:07.250 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230625 -> 20230625 2024-04-25T08:47:07.250 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230804 -> 20230804 2024-04-25T08:47:07.250 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20230919 -> 20230919 2024-04-25T08:47:07.250 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20231030 -> 20231030 2024-04-25T08:47:07.250 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20231111 -> 20231111 2024-04-25T08:47:07.250 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20231211 -> 20231211 2024-04-25T08:47:07.250 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20240115 -> 20240115 2024-04-25T08:47:07.250 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20240220 -> 20240220 2024-04-25T08:47:07.250 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20240312 -> 20240312 2024-04-25T08:47:07.250 INFO:teuthology.orchestra.run.smithi059.stderr: * [new tag] 20240410 -> 20240410 2024-04-25T08:47:07.326 INFO:teuthology.orchestra.run.smithi178.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-25T08:47:07.326 INFO:teuthology.orchestra.run.smithi178.stderr: * [new branch] main -> origin/main 2024-04-25T08:47:07.359 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190312 -> 20190312 2024-04-25T08:47:07.360 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190416 -> 20190416 2024-04-25T08:47:07.360 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190514 -> 20190514 2024-04-25T08:47:07.360 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190618 -> 20190618 2024-04-25T08:47:07.360 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190717 -> 20190717 2024-04-25T08:47:07.360 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190815 -> 20190815 2024-04-25T08:47:07.361 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20190923 -> 20190923 2024-04-25T08:47:07.361 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20191022 -> 20191022 2024-04-25T08:47:07.361 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20191215 -> 20191215 2024-04-25T08:47:07.361 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200122 -> 20200122 2024-04-25T08:47:07.362 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200316 -> 20200316 2024-04-25T08:47:07.362 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200421 -> 20200421 2024-04-25T08:47:07.362 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200519 -> 20200519 2024-04-25T08:47:07.363 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200619 -> 20200619 2024-04-25T08:47:07.363 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200721 -> 20200721 2024-04-25T08:47:07.363 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200817 -> 20200817 2024-04-25T08:47:07.363 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20200918 -> 20200918 2024-04-25T08:47:07.363 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20201022 -> 20201022 2024-04-25T08:47:07.364 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20201118 -> 20201118 2024-04-25T08:47:07.364 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20201218 -> 20201218 2024-04-25T08:47:07.364 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210208 -> 20210208 2024-04-25T08:47:07.364 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210315 -> 20210315 2024-04-25T08:47:07.364 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210511 -> 20210511 2024-04-25T08:47:07.364 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210716 -> 20210716 2024-04-25T08:47:07.365 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210818 -> 20210818 2024-04-25T08:47:07.365 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20210919 -> 20210919 2024-04-25T08:47:07.365 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20211027 -> 20211027 2024-04-25T08:47:07.365 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20211216 -> 20211216 2024-04-25T08:47:07.366 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220209 -> 20220209 2024-04-25T08:47:07.366 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220310 -> 20220310 2024-04-25T08:47:07.366 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220411 -> 20220411 2024-04-25T08:47:07.366 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220509 -> 20220509 2024-04-25T08:47:07.366 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220610 -> 20220610 2024-04-25T08:47:07.366 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220708 -> 20220708 2024-04-25T08:47:07.367 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220815 -> 20220815 2024-04-25T08:47:07.367 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20220913 -> 20220913 2024-04-25T08:47:07.367 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20221012 -> 20221012 2024-04-25T08:47:07.367 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20221109 -> 20221109 2024-04-25T08:47:07.367 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20221214 -> 20221214 2024-04-25T08:47:07.367 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230117 -> 20230117 2024-04-25T08:47:07.368 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230210 -> 20230210 2024-04-25T08:47:07.368 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230310 -> 20230310 2024-04-25T08:47:07.368 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230404 -> 20230404 2024-04-25T08:47:07.368 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230515 -> 20230515 2024-04-25T08:47:07.368 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230625 -> 20230625 2024-04-25T08:47:07.369 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230804 -> 20230804 2024-04-25T08:47:07.369 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20230919 -> 20230919 2024-04-25T08:47:07.369 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20231030 -> 20231030 2024-04-25T08:47:07.369 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20231111 -> 20231111 2024-04-25T08:47:07.369 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20231211 -> 20231211 2024-04-25T08:47:07.370 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240115 -> 20240115 2024-04-25T08:47:07.370 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240220 -> 20240220 2024-04-25T08:47:07.370 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240312 -> 20240312 2024-04-25T08:47:07.370 INFO:teuthology.orchestra.run.smithi178.stderr: * [new tag] 20240410 -> 20240410 2024-04-25T08:47:11.651 INFO:teuthology.orchestra.run.smithi178.stderr:Updating files: 44% (1515/3381) Updating files: 45% (1522/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 59% (1995/3381) Updating files: 59% (2005/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 69% (2333/3381) Updating files: 69% (2362/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 83% (2807/3381) Updating files: 83% (2809/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-25T08:47:11.656 INFO:teuthology.orchestra.run.smithi178.stdout:HEAD is now at 63a66b66 Merge branch 'robot/pr-0-1713990671' into 'main' 2024-04-25T08:47:11.677 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T08:47:11.678 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:47:11.750 INFO:teuthology.orchestra.run.smithi059.stderr:Updating files: 44% (1495/3381) Updating files: 45% (1522/3381) Updating files: 46% (1556/3381) Updating files: 47% (1590/3381) Updating files: 48% (1623/3381) Updating files: 49% (1657/3381) Updating files: 50% (1691/3381) Updating files: 51% (1725/3381) Updating files: 52% (1759/3381) Updating files: 53% (1792/3381) Updating files: 54% (1826/3381) Updating files: 55% (1860/3381) Updating files: 56% (1894/3381) Updating files: 57% (1928/3381) Updating files: 58% (1961/3381) Updating files: 58% (1977/3381) Updating files: 59% (1995/3381) Updating files: 60% (2029/3381) Updating files: 61% (2063/3381) Updating files: 62% (2097/3381) Updating files: 63% (2131/3381) Updating files: 64% (2164/3381) Updating files: 65% (2198/3381) Updating files: 66% (2232/3381) Updating files: 67% (2266/3381) Updating files: 68% (2300/3381) Updating files: 68% (2332/3381) Updating files: 69% (2333/3381) Updating files: 70% (2367/3381) Updating files: 71% (2401/3381) Updating files: 72% (2435/3381) Updating files: 73% (2469/3381) Updating files: 74% (2502/3381) Updating files: 75% (2536/3381) Updating files: 76% (2570/3381) Updating files: 77% (2604/3381) Updating files: 78% (2638/3381) Updating files: 79% (2671/3381) Updating files: 80% (2705/3381) Updating files: 81% (2739/3381) Updating files: 82% (2773/3381) Updating files: 82% (2783/3381) Updating files: 83% (2807/3381) Updating files: 84% (2841/3381) Updating files: 85% (2874/3381) Updating files: 86% (2908/3381) Updating files: 87% (2942/3381) Updating files: 88% (2976/3381) Updating files: 89% (3010/3381) Updating files: 90% (3043/3381) Updating files: 91% (3077/3381) Updating files: 92% (3111/3381) Updating files: 93% (3145/3381) Updating files: 94% (3179/3381) Updating files: 95% (3212/3381) Updating files: 96% (3246/3381) Updating files: 97% (3280/3381) Updating files: 98% (3314/3381) Updating files: 99% (3348/3381) Updating files: 100% (3381/3381) Updating files: 100% (3381/3381), done. 2024-04-25T08:47:11.755 INFO:teuthology.orchestra.run.smithi059.stdout:HEAD is now at 63a66b66 Merge branch 'robot/pr-0-1713990671' into 'main' 2024-04-25T08:47:11.777 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T08:47:11.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-04-25T08:47:11.823 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:47:11.824 DEBUG:teuthology.orchestra.run.smithi178:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-25T08:47:11.826 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi178.front.sepia.ceph.com to complete... 2024-04-25T08:47:11.943 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:47:11.943 DEBUG:teuthology.orchestra.run.smithi059:> rm -f /tmp/linux-image.deb && echo linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/ --input-file=- 2024-04-25T08:47:11.946 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi059.front.sepia.ceph.com to complete... 2024-04-25T08:47:13.799 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25 08:47:13 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-25T08:47:13.799 INFO:teuthology.orchestra.run.smithi178.stderr:FINISHED --2024-04-25 08:47:13-- 2024-04-25T08:47:13.799 INFO:teuthology.orchestra.run.smithi178.stderr:Total wall clock time: 1.9s 2024-04-25T08:47:13.799 INFO:teuthology.orchestra.run.smithi178.stderr:Downloaded: 1 files, 43M in 1.8s (23.5 MB/s) 2024-04-25T08:47:13.803 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-04-25T08:47:13.804 DEBUG:teuthology.orchestra.run.smithi178:> sudo dpkg -i /tmp/linux-image.deb 2024-04-25T08:47:14.032 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-25T08:47:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25 08:47:14 URL:https://2.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/ubuntu/jammy/flavors/default/pool/main/l/linux-6.9.0-rc3-g806ec36b2112/linux-image-6.9.0-rc3-g806ec36b2112_6.9.0-rc3-g806ec36b2112-1_amd64.deb [44805284/44805284] -> "/tmp/linux-image.deb" [1] 2024-04-25T08:47:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:FINISHED --2024-04-25 08:47:14-- 2024-04-25T08:47:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:Total wall clock time: 3.1s 2024-04-25T08:47:15.062 INFO:teuthology.orchestra.run.smithi059.stderr:Downloaded: 1 files, 43M in 3.0s (14.4 MB/s) 2024-04-25T08:47:15.066 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-04-25T08:47:15.066 DEBUG:teuthology.orchestra.run.smithi059:> sudo dpkg -i /tmp/linux-image.deb 2024-04-25T08:47:15.350 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package linux-image-6.9.0-rc3-g806ec36b2112. 2024-04-25T08:47:16.096 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-25T08:47:16.100 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-25T08:47:16.307 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T08:47:17.342 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-25T08:47:17.346 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-25T08:47:17.613 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T08:47:20.615 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T08:47:20.717 INFO:teuthology.orchestra.run.smithi178.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:21.326 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up linux-image-6.9.0-rc3-g806ec36b2112 (6.9.0-rc3-g806ec36b2112-1) ... 2024-04-25T08:47:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:update-initramfs: Generating /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:43.818 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub' 2024-04-25T08:47:43.833 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T08:47:43.866 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2024-04-25T08:47:44.181 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:44.198 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:44.415 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub' 2024-04-25T08:47:44.431 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T08:47:44.454 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2024-04-25T08:47:44.505 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T08:47:44.512 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T08:47:44.583 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T08:47:44.588 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T08:47:44.762 INFO:teuthology.orchestra.run.smithi178.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T08:47:44.762 INFO:teuthology.orchestra.run.smithi178.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T08:47:44.763 INFO:teuthology.orchestra.run.smithi178.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T08:47:44.780 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:44.793 INFO:teuthology.orchestra.run.smithi178.stderr:done 2024-04-25T08:47:44.807 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:45.003 DEBUG:teuthology.orchestra.run.smithi178:> dpkg-deb -c /tmp/linux-image.deb 2024-04-25T08:47:45.055 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-25T08:47:45.055 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-25T08:47:45.055 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:45.072 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:45.072 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:45.094 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-25T08:47:45.094 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-25T08:47:45.094 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-25T08:47:45.094 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-25T08:47:45.094 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-25T08:47:45.094 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-25T08:47:45.094 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T08:47:45.095 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T08:47:45.097 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T08:47:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-25T08:47:45.099 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-25T08:47:45.099 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-25T08:47:45.099 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T08:47:45.099 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-25T08:47:45.099 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-25T08:47:45.099 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-25T08:47:45.099 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T08:47:45.099 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T08:47:45.099 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T08:47:45.120 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-25T08:47:45.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-25T08:47:45.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-25T08:47:45.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-25T08:47:45.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T08:47:45.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T08:47:45.120 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T08:47:45.121 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T08:47:45.122 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T08:47:45.123 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-25T08:47:45.124 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-25T08:47:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T08:47:45.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T08:47:45.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T08:47:45.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T08:47:45.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T08:47:45.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T08:47:45.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T08:47:45.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T08:47:45.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T08:47:45.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T08:47:45.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T08:47:45.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T08:47:45.126 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T08:47:45.127 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T08:47:45.128 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T08:47:45.129 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-25T08:47:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T08:47:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-25T08:47:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-25T08:47:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T08:47:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-25T08:47:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T08:47:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T08:47:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-25T08:47:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T08:47:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T08:47:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-25T08:47:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T08:47:45.131 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-25T08:47:45.132 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-25T08:47:45.133 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-25T08:47:45.134 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T08:47:45.155 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T08:47:45.162 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T08:47:45.188 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-25T08:47:45.188 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T08:47:45.188 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T08:47:45.188 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T08:47:45.188 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-25T08:47:45.188 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T08:47:45.188 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T08:47:45.189 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-25T08:47:45.190 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-25T08:47:45.191 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-25T08:47:45.192 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T08:47:45.193 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T08:47:45.194 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T08:47:45.195 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T08:47:45.196 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T08:47:45.197 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T08:47:45.198 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-25T08:47:45.199 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T08:47:45.200 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T08:47:45.201 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T08:47:45.202 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T08:47:45.203 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T08:47:45.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T08:47:45.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T08:47:45.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-25T08:47:45.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T08:47:45.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T08:47:45.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T08:47:45.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T08:47:45.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T08:47:45.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T08:47:45.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T08:47:45.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T08:47:45.204 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T08:47:45.205 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-25T08:47:45.206 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T08:47:45.207 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T08:47:45.208 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T08:47:45.209 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-25T08:47:45.210 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T08:47:45.211 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-25T08:47:45.212 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T08:47:45.213 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T08:47:45.214 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T08:47:45.215 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T08:47:45.216 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-25T08:47:45.217 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T08:47:45.218 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-25T08:47:45.219 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-25T08:47:45.220 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T08:47:45.221 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T08:47:45.222 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T08:47:45.223 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T08:47:45.224 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T08:47:45.225 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-25T08:47:45.226 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-25T08:47:45.227 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-25T08:47:45.228 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-25T08:47:45.229 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T08:47:45.230 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T08:47:45.231 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-25T08:47:45.232 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T08:47:45.233 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T08:47:45.234 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-25T08:47:45.234 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T08:47:45.234 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T08:47:45.234 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-25T08:47:45.234 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-25T08:47:45.234 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T08:47:45.234 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-25T08:47:45.234 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-25T08:47:45.234 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T08:47:45.234 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-25T08:47:45.234 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T08:47:45.235 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T08:47:45.235 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T08:47:45.270 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T08:47:45.271 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T08:47:45.272 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-25T08:47:45.273 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T08:47:45.274 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T08:47:45.275 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-25T08:47:45.276 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-25T08:47:45.277 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-25T08:47:45.278 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T08:47:45.279 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T08:47:45.280 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T08:47:45.281 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T08:47:45.282 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-25T08:47:45.283 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T08:47:45.284 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-25T08:47:45.285 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-25T08:47:45.286 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-25T08:47:45.287 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T08:47:45.288 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-25T08:47:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T08:47:45.290 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-25T08:47:45.291 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-25T08:47:45.292 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T08:47:45.293 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T08:47:45.294 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T08:47:45.295 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T08:47:45.296 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T08:47:45.297 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-25T08:47:45.298 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T08:47:45.299 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T08:47:45.300 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T08:47:45.301 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T08:47:45.302 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-25T08:47:45.303 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T08:47:45.304 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T08:47:45.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T08:47:45.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-25T08:47:45.305 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-25T08:47:45.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T08:47:45.305 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-25T08:47:45.305 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-25T08:47:45.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T08:47:45.305 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-25T08:47:45.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T08:47:45.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T08:47:45.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T08:47:45.305 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T08:47:45.340 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T08:47:45.341 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T08:47:45.342 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-25T08:47:45.343 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-25T08:47:45.344 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-25T08:47:45.345 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-25T08:47:45.346 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-25T08:47:45.347 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-25T08:47:45.348 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-25T08:47:45.349 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T08:47:45.350 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-25T08:47:45.351 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T08:47:45.352 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T08:47:45.353 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T08:47:45.354 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-25T08:47:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T08:47:45.356 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T08:47:45.357 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T08:47:45.358 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-25T08:47:45.358 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T08:47:45.358 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T08:47:45.358 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T08:47:45.358 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T08:47:45.358 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-25T08:47:45.358 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-25T08:47:45.358 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-25T08:47:45.358 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-25T08:47:45.358 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-25T08:47:45.358 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-25T08:47:45.358 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-25T08:47:45.359 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T08:47:45.360 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T08:47:45.361 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T08:47:45.362 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T08:47:45.363 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-25T08:47:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-25T08:47:45.365 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T08:47:45.366 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-25T08:47:45.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-25T08:47:45.366 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-25T08:47:45.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T08:47:45.366 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-25T08:47:45.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-25T08:47:45.366 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-25T08:47:45.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-25T08:47:45.366 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-25T08:47:45.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T08:47:45.366 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-25T08:47:45.366 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-25T08:47:45.367 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-25T08:47:45.368 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-25T08:47:45.369 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T08:47:45.370 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-25T08:47:45.370 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-25T08:47:45.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T08:47:45.370 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-25T08:47:45.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T08:47:45.370 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-25T08:47:45.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T08:47:45.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T08:47:45.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-25T08:47:45.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T08:47:45.370 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T08:47:45.370 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T08:47:45.371 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T08:47:45.372 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T08:47:45.373 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T08:47:45.374 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T08:47:45.375 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-25T08:47:45.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-25T08:47:45.376 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-25T08:47:45.376 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T08:47:45.396 INFO:teuthology.orchestra.run.smithi059.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T08:47:45.396 INFO:teuthology.orchestra.run.smithi059.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T08:47:45.396 INFO:teuthology.orchestra.run.smithi059.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T08:47:45.413 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-25T08:47:45.413 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T08:47:45.413 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-25T08:47:45.413 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-25T08:47:45.413 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-25T08:47:45.413 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-25T08:47:45.413 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T08:47:45.414 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-25T08:47:45.415 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-25T08:47:45.416 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-25T08:47:45.417 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T08:47:45.418 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-25T08:47:45.419 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T08:47:45.420 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T08:47:45.421 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T08:47:45.422 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T08:47:45.423 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T08:47:45.424 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T08:47:45.425 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T08:47:45.426 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-25T08:47:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T08:47:45.428 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T08:47:45.429 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T08:47:45.430 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-25T08:47:45.431 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T08:47:45.432 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T08:47:45.433 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T08:47:45.434 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T08:47:45.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T08:47:45.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T08:47:45.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T08:47:45.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T08:47:45.438 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T08:47:45.439 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-25T08:47:45.440 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T08:47:45.441 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T08:47:45.442 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T08:47:45.443 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T08:47:45.444 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T08:47:45.445 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-25T08:47:45.446 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-25T08:47:45.447 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T08:47:45.448 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T08:47:45.449 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T08:47:45.450 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T08:47:45.451 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T08:47:45.452 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T08:47:45.453 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-25T08:47:45.454 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-25T08:47:45.454 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-25T08:47:45.454 INFO:teuthology.orchestra.run.smithi178.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:47:45.454 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-25T08:47:45.454 INFO:teuthology.orchestra.run.smithi178.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-25T08:47:45.459 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:45.459 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:45.460 DEBUG:teuthology.orchestra.run.smithi178:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-25T08:47:45.460 INFO:teuthology.orchestra.run.smithi059.stderr:done 2024-04-25T08:47:45.466 INFO:teuthology.orchestra.run.smithi178.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:47:45.467 INFO:teuthology.orchestra.run.smithi178.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:47:45.467 INFO:teuthology.orchestra.run.smithi178.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:47:45.467 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-25T08:47:45.467 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:45.467 DEBUG:teuthology.orchestra.run.smithi178:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-25T08:47:45.513 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi178.front.sepia.ceph.com to complete... 2024-04-25T08:47:45.608 DEBUG:teuthology.orchestra.run.smithi059:> dpkg-deb -c /tmp/linux-image.deb 2024-04-25T08:47:45.617 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./ 2024-04-25T08:47:45.617 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./boot/ 2024-04-25T08:47:45.617 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7002012 2024-04-19 08:55 ./boot/System.map-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:45.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 172073 2024-04-19 08:55 ./boot/config-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:45.632 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13120512 2024-04-19 08:55 ./boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:45.651 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/ 2024-04-25T08:47:45.651 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/ 2024-04-25T08:47:45.651 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postinst.d/ 2024-04-25T08:47:45.651 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/postrm.d/ 2024-04-25T08:47:45.651 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/preinst.d/ 2024-04-25T08:47:45.651 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./etc/kernel/prerm.d/ 2024-04-25T08:47:45.652 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/ 2024-04-25T08:47:45.652 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/ 2024-04-25T08:47:45.652 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:47:45.652 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/ 2024-04-25T08:47:45.652 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/ 2024-04-25T08:47:45.652 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/ 2024-04-25T08:47:45.652 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ 2024-04-25T08:47:45.652 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 507569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-25T08:47:45.655 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-25T08:47:45.655 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-25T08:47:45.655 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-25T08:47:45.655 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-25T08:47:45.655 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 109905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-25T08:47:45.655 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 155249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-25T08:47:45.655 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-25T08:47:45.655 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-25T08:47:45.655 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 87009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-25T08:47:45.655 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/ 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/ 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/ 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpuid.ko 2024-04-25T08:47:45.656 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/msr.ko 2024-04-25T08:47:45.657 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/ 2024-04-25T08:47:45.657 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 444425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-25T08:47:45.657 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1035881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-25T08:47:45.657 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 2849609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/af_alg.ko 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_hash.ko 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/algif_skcipher.ko 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/ 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/ 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-04-25T08:47:45.732 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cryptd.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-04-25T08:47:45.733 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_simd.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lrw.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-04-25T08:47:45.734 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 169065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xts.ko 2024-04-25T08:47:45.735 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_extlog.ko 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/ 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/apei/einj.ko 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 119033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-04-25T08:47:45.736 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 96825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 107737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-04-25T08:47:45.737 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_legacy.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-04-25T08:47:45.738 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_radisys.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rz1000.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-04-25T08:47:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 102121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-04-25T08:47:45.740 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/ 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 163969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/ 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/ 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 140865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/ 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1241657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 203289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/ 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 115265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-25T08:47:45.741 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 143433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/ 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 126617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 119873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 313217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/ 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 117233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/ 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/applicom.ko 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/ 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-25T08:47:45.742 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 186921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 179561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/ 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 103409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/nvram.ko 2024-04-25T08:47:45.743 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/ 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/ 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-25T08:47:45.744 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/ 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-palmas.ko 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-si5351.ko 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-twl6040.ko 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/clk/clk-wm831x.ko 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/ 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 89257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 333657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/ 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/ 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-25T08:47:45.745 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 751713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-25T08:47:45.746 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-25T08:47:45.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-25T08:47:45.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-04-25T08:47:45.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-04-25T08:47:45.746 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/ 2024-04-25T08:47:45.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-25T08:47:45.746 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/ 2024-04-25T08:47:45.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-04-25T08:47:45.746 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ 2024-04-25T08:47:45.746 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/ 2024-04-25T08:47:45.746 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 146769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 96145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 51105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 64161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-04-25T08:47:45.747 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 68697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/ 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-gpio.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max14577.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max77693.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-max8997.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-palmas.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/ 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/ 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-25T08:47:45.748 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/ 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-arizona.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9052.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-da9055.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-dln2.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 81073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-generic.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-kempld.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max7300.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max730x.ko 2024-04-25T08:47:45.749 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-max732x.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-vx855.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-25T08:47:45.750 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/ 2024-04-25T08:47:45.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-a4tech.ko 2024-04-25T08:47:45.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-apple.ko 2024-04-25T08:47:45.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-04-25T08:47:45.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-04-25T08:47:45.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-04-25T08:47:45.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-belkin.ko 2024-04-25T08:47:45.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cherry.ko 2024-04-25T08:47:45.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-chicony.ko 2024-04-25T08:47:45.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 74393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cp2112.ko 2024-04-25T08:47:45.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-cypress.ko 2024-04-25T08:47:45.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-04-25T08:47:45.751 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ezkey.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-generic.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kensington.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-04-25T08:47:45.752 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lg-g15.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 68081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 121369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 97953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-magicmouse.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-microsoft.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-monterey.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ntrig.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-04-25T08:47:45.753 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-25T08:47:45.754 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-04-25T08:47:45.755 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 81113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 184745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 319921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/ 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 153633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 261945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/ 2024-04-25T08:47:45.756 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 75065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 110681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 382033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 77153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 115057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-04-25T08:47:45.757 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 89025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 81473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 68865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-25T08:47:45.758 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 113201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc2103.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 108961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-04-25T08:47:45.759 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hih6130.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 156465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/jc42.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-04-25T08:47:45.760 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 86497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 131505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-04-25T08:47:45.761 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-04-25T08:47:45.762 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 141353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 72737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 97777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-25T08:47:45.763 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 101233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-04-25T08:47:45.764 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-25T08:47:45.765 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-04-25T08:47:45.765 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-04-25T08:47:45.765 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-04-25T08:47:45.765 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-04-25T08:47:45.765 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-04-25T08:47:45.765 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-04-25T08:47:45.765 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-04-25T08:47:45.765 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-04-25T08:47:45.765 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-04-25T08:47:45.765 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-04-25T08:47:45.765 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-04-25T08:47:45.765 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-04-25T08:47:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-04-25T08:47:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-04-25T08:47:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-04-25T08:47:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-04-25T08:47:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 71169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-04-25T08:47:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 96577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-04-25T08:47:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-04-25T08:47:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 75129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-04-25T08:47:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 83425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-04-25T08:47:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 116777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-04-25T08:47:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 134441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-04-25T08:47:45.766 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/ 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/ 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/ 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-25T08:47:45.767 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 64233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 76969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-25T08:47:45.768 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-25T08:47:45.769 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-25T08:47:45.770 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-25T08:47:45.770 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-25T08:47:45.770 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-25T08:47:45.770 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-25T08:47:45.770 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-25T08:47:45.770 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-25T08:47:45.770 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-04-25T08:47:45.770 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-04-25T08:47:45.770 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-04-25T08:47:45.770 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/ 2024-04-25T08:47:45.770 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 329697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1119913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 83905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 408433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 120921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 347217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 84945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ 2024-04-25T08:47:45.771 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 590929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/ 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 514641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/ 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 911665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 375545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 197121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/ 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 212553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 334401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ 2024-04-25T08:47:45.772 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 120673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 132585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 157937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 156673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/evbug.ko 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/ff-memless.ko 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/ 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/ 2024-04-25T08:47:45.773 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8323.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/lm8333.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt1070.ko 2024-04-25T08:47:45.774 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/qt2160.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/stowaway.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/matrix-keymap.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/ 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 160017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 114273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 428185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/psmouse.ko 2024-04-25T08:47:45.775 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-04-25T08:47:45.776 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-25T08:47:45.776 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-25T08:47:45.776 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-25T08:47:45.776 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/ 2024-04-25T08:47:45.776 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 140969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-25T08:47:45.776 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ 2024-04-25T08:47:45.776 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-04-25T08:47:45.776 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-04-25T08:47:45.776 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ct82c710.ko 2024-04-25T08:47:45.776 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-25T08:47:45.776 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/parkbd.ko 2024-04-25T08:47:45.776 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/pcips2.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/ps2mult.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serport.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/ 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-88pm860x.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-adp5520.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 77265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-bd2802.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da903x.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-da9052.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-gpio.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-04-25T08:47:45.777 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3533.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm355x.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3642.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp8788.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-max8997.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-mc13783.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca9532.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca955x.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-pca963x.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-tca6507.ko 2024-04-25T08:47:45.778 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-wm8350.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/ 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/ 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 790753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 116825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bufio.ko 2024-04-25T08:47:45.779 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 58281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 199041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 134945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-era.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-mirror.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 97209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-region-hash.ko 2024-04-25T08:47:45.780 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-snapshot.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 234457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-zero.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/ 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 264329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 125009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 157681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 444665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/ 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/ 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 214841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-04-25T08:47:45.781 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 77985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 150761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 97281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 63873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/ 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm800.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm805.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/88pm80x.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona-i2c.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 148633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/arizona.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/bcm590xx.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/dln2.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/janz-cmodio.ko 2024-04-25T08:47:45.782 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/kempld-core.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-core.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lp3943.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/max8907.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/menf21bmc.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/pcf50633.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/retu-mfd.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 99425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/si476x-core.ko 2024-04-25T08:47:45.783 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 58057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps65010.ko 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/tps6507x.ko 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wm8994.ko 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 64265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ad525x_dpot.ko 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/ 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-04-25T08:47:45.784 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 58633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/ 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/c2port/core.ko 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/ 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ds1682.ko 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/dummy-irq.ko 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/ 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/echo/echo.ko 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/ 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-25T08:47:45.785 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/ 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 191649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hmc6352.ko 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 92345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ics932s401.ko 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/ 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-25T08:47:45.786 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/ 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 154169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 389033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/phantom.ko 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/ 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/ 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 234905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/ 2024-04-25T08:47:45.787 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 620961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/ 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/ 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 139817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 587065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/ 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 158649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-25T08:47:45.788 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 109521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/ 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 64705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/ 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 84329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/ 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/ 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-25T08:47:45.789 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/ 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 115881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/ 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 124497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 128409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 110345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 101857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-25T08:47:45.790 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 88953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-25T08:47:45.791 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/ 2024-04-25T08:47:45.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 105633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-25T08:47:45.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 228985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-25T08:47:45.791 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-25T08:47:45.791 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1733353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-25T08:47:45.857 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 167185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-25T08:47:45.857 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-25T08:47:45.857 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 161417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-25T08:47:45.857 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 440625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-25T08:47:45.857 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/ 2024-04-25T08:47:45.857 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-25T08:47:45.857 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 432201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-25T08:47:45.857 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/ 2024-04-25T08:47:45.857 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-25T08:47:45.857 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 257201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-25T08:47:45.857 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 446177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1311433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 206689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/ 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 269313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/ 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 77457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-25T08:47:45.858 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 169089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 76209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/ 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 75945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/ 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 356377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 63185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/ 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 51513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-25T08:47:45.859 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 115569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 366217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 755793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 324577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1196297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 362593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/ 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 671801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-25T08:47:45.860 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 121537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 966705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 193585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 108633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/ 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 126881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 150777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/ 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 905033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-25T08:47:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 344145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1412417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 117353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/ 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 131425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ 2024-04-25T08:47:45.862 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/ 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 181081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/ 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 171417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/ 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 58249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/ 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 300817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 105689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-25T08:47:45.863 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 885129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/ 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/ 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 81641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 100689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 264161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/ 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 142449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/ 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1350385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-25T08:47:45.864 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/ 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/ 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 80065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/ 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 74289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 79457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 100785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 83441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/ 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 644537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-25T08:47:45.865 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/ 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 128497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 207993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 82633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/ 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/ 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 110729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/ 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 98689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 102513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/ 2024-04-25T08:47:45.866 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/ 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/ 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/defxx.ko 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/ 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 275801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/ 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 290441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/ 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-04-25T08:47:45.867 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 108329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/ 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/ 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-25T08:47:45.868 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 103377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 96025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-04-25T08:47:45.869 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 121105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/ 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/plip/plip.ko 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-25T08:47:45.870 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sb1000.ko 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/ 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 80161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/ 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 137321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-25T08:47:45.871 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 108089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/ 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 176497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/ 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 383593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/ 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 175537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/ 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/ 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 335857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 126553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-04-25T08:47:45.872 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/ 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 168145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 103889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/ 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/ 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pci-stub.ko 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/ 2024-04-25T08:47:45.873 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 179961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia.ko 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 133753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/ 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/ 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/ 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/ 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/ 2024-04-25T08:47:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/ 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/ 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 87481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-25T08:47:45.875 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 73865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 164769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 51881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/ 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-04-25T08:47:45.876 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/ 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-25T08:47:45.877 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 68833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 73073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9030_battery.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/da9052-battery.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/gpio-charger.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max14577_charger.ko 2024-04-25T08:47:45.878 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max17042_battery.ko 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8903_charger.ko 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/max8925_power.ko 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/sbs-battery.ko 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/test_power.ko 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm831x_power.ko 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/power/supply/wm8350_power.ko 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/ 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 73297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/ 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/ 2024-04-25T08:47:45.879 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/ 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/ 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/ 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/ 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-25T08:47:45.880 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9052.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9055.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-da9063.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 82225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-25T08:47:45.881 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8907.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8925.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8997.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max8998.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-palmas.ko 2024-04-25T08:47:45.882 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-25T08:47:45.883 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 164569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/ 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 340721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 120337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/ 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 468081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 380673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-25T08:47:45.884 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/ 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 243705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/ 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 135617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/ 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 304993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/ 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1527113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/ 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 297801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/ 2024-04-25T08:47:45.885 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 144401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-25T08:47:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-04-25T08:47:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/ 2024-04-25T08:47:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 390713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-25T08:47:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/ 2024-04-25T08:47:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-25T08:47:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 88881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-25T08:47:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-25T08:47:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 117481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-25T08:47:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 173017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-25T08:47:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-04-25T08:47:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-04-25T08:47:45.886 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/ 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 267577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/ 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 95329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 194017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fdomain.ko 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/ 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 366529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 251505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/imm.ko 2024-04-25T08:47:45.887 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 327841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 129785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/ 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 397785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 63121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/ 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 386849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 178177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 64809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/ 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 274009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-04-25T08:47:45.888 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/ 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 2736001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/ 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 88529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 389177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 104769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/ 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 836945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/ 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 158729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 96537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/ 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 101625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-25T08:47:45.889 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-25T08:47:45.890 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-25T08:47:45.890 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-25T08:47:45.890 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/ 2024-04-25T08:47:45.890 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 443745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-25T08:47:45.890 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 152033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-04-25T08:47:45.890 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ppa.ko 2024-04-25T08:47:45.890 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-04-25T08:47:45.890 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/ 2024-04-25T08:47:45.890 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 2324809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-25T08:47:45.890 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 103601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-25T08:47:45.890 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/ 2024-04-25T08:47:45.890 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 697337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-25T08:47:45.891 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qlogicfas408.ko 2024-04-25T08:47:45.891 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-04-25T08:47:45.891 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 322865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-04-25T08:47:45.891 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 219857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-25T08:47:45.891 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 357153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-25T08:47:45.891 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 121185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-25T08:47:45.891 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 93481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-25T08:47:45.891 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-25T08:47:45.891 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-04-25T08:47:45.891 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 138121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-04-25T08:47:45.891 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 57401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-04-25T08:47:45.891 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 205025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/xen-scsifront.ko 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 174913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/ 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/ 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 920169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/ 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-25T08:47:45.892 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1170033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 51897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 149721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/ 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/ 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/ 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-25T08:47:45.893 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-25T08:47:45.894 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 99313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/moxa.ko 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/mxser.ko 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 134401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/ 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/ 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/altera_uart.ko 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-04-25T08:47:45.895 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/ 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 120577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/rp2.ko 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/ 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 693081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/ 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-04-25T08:47:45.896 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_mf624.ko 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_netx.ko 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/ 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/ 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 189209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-25T08:47:45.897 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/ 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 101545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 63073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 107417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/common/ulpi.ko 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/ 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/ 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 574593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/ 2024-04-25T08:47:45.898 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/ 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 72249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 131345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 146617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 101249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-25T08:47:45.899 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 71257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 84937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/ 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-25T08:47:45.900 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 204049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/ 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 182561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 94841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-25T08:47:45.901 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 87465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 95441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 195969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 108321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 104377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 102273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811_cs.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/ 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ 2024-04-25T08:47:45.902 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/cytherm.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ehset.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/lvstest.ko 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/ 2024-04-25T08:47:45.903 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 84265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbtest.ko 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/ 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 91529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/mon/usbmon.ko 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/ 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 396209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/ 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-04-25T08:47:45.904 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 58329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/f81232.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 188609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-25T08:47:45.905 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 152305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 142833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 69217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 122329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/metro-usb.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 79681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 89969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-04-25T08:47:45.906 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mxuport.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 193857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70497 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-25T08:47:45.907 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 151137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usbserial.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 64049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-25T08:47:45.908 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 201193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/ 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 76041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 122321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/ 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/ 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 206921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 134265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-04-25T08:47:45.909 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 93673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/ 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 138721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 71281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 107905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/ 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/ 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 51745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-04-25T08:47:45.910 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/bd6107.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/ 2024-04-25T08:47:45.911 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ 2024-04-25T08:47:45.912 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-04-25T08:47:45.912 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-04-25T08:47:45.912 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-25T08:47:45.912 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-25T08:47:45.912 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/ 2024-04-25T08:47:45.912 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-25T08:47:45.912 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-25T08:47:45.912 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-25T08:47:45.912 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-25T08:47:45.912 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-25T08:47:45.912 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-25T08:47:45.912 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 129433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/acquirewdt.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/advantechwdt.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-25T08:47:45.913 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/dw_wdt.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-04-25T08:47:45.914 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/retu_wdt.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-25T08:47:45.915 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/ 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-04-25T08:47:45.916 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/ 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 213913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-scsiback.ko 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/ 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/ 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 192617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/ 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 78153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/adfs/adfs.ko 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/ 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 197849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/ 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1261113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/afs/kafs.ko 2024-04-25T08:47:45.917 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/ 2024-04-25T08:47:45.918 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 127377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/autofs/autofs4.ko 2024-04-25T08:47:45.918 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/ 2024-04-25T08:47:45.918 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 80521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-04-25T08:47:45.918 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/ 2024-04-25T08:47:45.918 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/bfs/bfs.ko 2024-04-25T08:47:45.918 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-04-25T08:47:45.918 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/ 2024-04-25T08:47:45.918 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 4489593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-04-25T08:47:45.963 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/ 2024-04-25T08:47:45.963 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 376857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-04-25T08:47:45.963 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ 2024-04-25T08:47:45.963 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1586065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/ 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 130073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/ 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 139081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/configfs/configfs.ko 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/ 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/ 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 813225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/ 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/efs/efs.ko 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/ 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1906817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/ 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-04-25T08:47:45.964 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/ 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/freevxfs/freevxfs.ko 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/ 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/ 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1486521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/ 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 183305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/ 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 282097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/ 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 249009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hpfs/hpfs.ko 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/ 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 93033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/ 2024-04-25T08:47:45.965 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 533073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/ 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 361369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/ 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 112609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/ 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 591585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/ 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/ 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 102561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/ 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 74353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/ 2024-04-25T08:47:45.966 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 147689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1320249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 82105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv2.ko 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 151641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 2518505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/ 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/ 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 2024049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/ 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 734025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/ 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-04-25T08:47:45.967 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ascii.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-04-25T08:47:45.968 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-04-25T08:47:45.969 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 95625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 144209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 167137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 119513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-04-25T08:47:45.970 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 302073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 548169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 3245617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-04-25T08:47:45.971 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 22113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/ 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/omfs/omfs.ko 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/ 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 462873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 67977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/ 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx4/qnx4.ko 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/ 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 56097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/qnx6/qnx6.ko 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/ 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_tree.ko 2024-04-25T08:47:45.972 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v1.ko 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/quota/quota_v2.ko 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/ 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 684841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/ 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/ 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/ 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 3319041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/ 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/ 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 164185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/ 2024-04-25T08:47:45.973 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 115977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/ 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 310017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 198233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/ 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 5192705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/ 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/ 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 97625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/locking/locktorture.ko 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/ 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/time/test_udelay.ko 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 72665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-04-25T08:47:45.974 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc7.ko 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/ 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/interval_tree_test.ko 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/ 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-04-25T08:47:45.975 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/ 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7281 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/memory-notifier-error-inject.ko 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/notifier-error-inject.ko 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/percpu_test.ko 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/pm-notifier-error-inject.ko 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/ 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 152025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/rbtree_test.ko 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/ 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test-kstrtox.ko 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 4912441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_bpf.ko 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 61169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_firmware.ko 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7121 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_module.ko 2024-04-25T08:47:45.976 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/test_user_copy.ko 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/ 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/xz/xz_dec_test.ko 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/ 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/ 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-25T08:47:45.977 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/ 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13537 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/ 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 106793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/ 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 236793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-04-25T08:47:45.978 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/ 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 879697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/ 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 84761 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1030873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-25T08:47:45.979 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9569 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70529 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-04-25T08:47:45.980 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/ 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1243505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/ 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 153801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/ 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 244889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 71033 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 74993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/ 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 507705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-04-25T08:47:45.981 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/ 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 128873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/hsr/hsr.ko 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 357425 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 59393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-04-25T08:47:45.982 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 75489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 77721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50169 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-25T08:47:45.983 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-25T08:47:45.984 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11665 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11737 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-04-25T08:47:45.985 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 54441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 47433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 103177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_gre.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 118881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 71089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/mip6.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-25T08:47:45.986 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-25T08:47:45.987 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 29817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 94089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 30297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/ 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 106369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/ 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 153217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-25T08:47:45.988 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 66241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/ 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 63345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/lapb/lapb.ko 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/ 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 332889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc2.ko 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/ 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 388873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/ 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ 2024-04-25T08:47:45.989 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 147745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 124041 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 124345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 126681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 126473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 137833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 72353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 133681 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 139073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 138265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-25T08:47:45.990 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 136177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 139897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 534113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20953 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24577 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12649 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-25T08:47:45.991 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15977 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12809 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 55217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 496817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 134377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24513 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 140801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-25T08:47:45.992 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 79873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 117201 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 46105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 118369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14185 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13345 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 807985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-04-25T08:47:45.993 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53049 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 65145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 50657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11081 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-04-25T08:47:45.994 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17921 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16473 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13945 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_osf.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15057 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 24993 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_synproxy.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17641 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tproxy.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 108393 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/x_tables.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-04-25T08:47:45.995 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 21865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15745 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45217 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15937 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13017 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10857 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15361 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-25T08:47:45.996 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23089 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16689 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18985 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20697 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15289 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16633 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11961 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-04-25T08:47:45.997 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14209 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10257 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12657 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 52817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-04-25T08:47:45.998 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19193 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9137 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11521 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 16161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11561 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13553 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 11881 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9273 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-04-25T08:47:45.999 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36489 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 19777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10753 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10849 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18449 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpudp.ko 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12441 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/ 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 17233 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-04-25T08:47:46.000 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/ 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 14073 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/ 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 488825 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12009 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 10873 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/ 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15929 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/ 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 142025 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/phonet.ko 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 68817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/phonet/pn_pep.ko 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/ 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 318617 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 202305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-04-25T08:47:46.001 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 85105 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/ 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1027897 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rxrpc/rxrpc.ko 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/ 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39001 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 28721 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 27593 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 53465 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38705 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23969 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43417 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 45673 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-04-25T08:47:46.002 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32129 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 41457 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23225 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_cgroup.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 37305 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39601 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 49321 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 79145 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8713 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 15385 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 48785 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9241 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13369 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 8377 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 25097 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43481 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-04-25T08:47:46.003 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 43153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 39177 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq_codel.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 42889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 62817 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26585 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 81833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33545 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 36625 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12297 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33065 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 44793 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 32833 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 13505 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 31801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 60249 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 40889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-04-25T08:47:46.004 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 33433 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 38329 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 35777 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 34161 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/ 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1187313 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23913 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/ 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/ 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 432409 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70113 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1940889 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/ 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 890729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-25T08:47:46.005 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/ 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 1122337 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12153 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/ 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 18801 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/ 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 105609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 90265 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 123769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 12905 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 20401 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/ 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 165841 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/x25/x25.ko 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/ 2024-04-25T08:47:46.006 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 26729 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_algo.ko 2024-04-25T08:47:46.007 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23353 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-25T08:47:46.007 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 131865 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_user.ko 2024-04-25T08:47:46.007 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 644769 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-04-25T08:47:46.008 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub' 2024-04-25T08:47:46.008 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T08:47:46.008 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2024-04-25T08:47:46.009 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 628542 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 7706 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 23609 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 9941 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 70990 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 146959 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 232835 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 210 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 72602 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 879 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 258450 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 313019 2024-04-19 08:55 ./lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/ 2024-04-25T08:47:46.010 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/ 2024-04-25T08:47:46.011 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/ 2024-04-25T08:47:46.011 INFO:teuthology.orchestra.run.smithi059.stdout:drwxr-xr-x root/root 0 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/ 2024-04-25T08:47:46.011 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 172 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/changelog.Debian.gz 2024-04-25T08:47:46.011 INFO:teuthology.orchestra.run.smithi059.stdout:-rw-r--r-- root/root 691 2024-04-19 08:55 ./usr/share/doc/linux-image-6.9.0-rc3-g806ec36b2112/copyright 2024-04-25T08:47:46.015 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:46.015 INFO:teuthology.task.kernel:searching for kernel 6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:46.015 DEBUG:teuthology.orchestra.run.smithi059:> egrep '(submenu|menuentry.*6.9.0-rc3-g806ec36b2112).*{' /boot/grub/grub.cfg 2024-04-25T08:47:46.057 INFO:teuthology.orchestra.run.smithi059.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:47:46.057 INFO:teuthology.orchestra.run.smithi059.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:47:46.058 INFO:teuthology.orchestra.run.smithi059.stdout: menuentry 'Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.9.0-rc3-g806ec36b2112-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-25T08:47:46.058 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-25T08:47:46.058 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:46.058 DEBUG:teuthology.orchestra.run.smithi059:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-25T08:47:46.101 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi059.front.sepia.ceph.com to complete... 2024-04-25T08:47:46.223 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:46.230 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:46.446 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T08:47:46.451 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T08:47:46.491 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T08:47:46.496 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T08:47:46.530 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub' 2024-04-25T08:47:46.532 INFO:teuthology.orchestra.run.smithi059.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T08:47:46.538 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2024-04-25T08:47:46.649 INFO:teuthology.orchestra.run.smithi178.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T08:47:46.649 INFO:teuthology.orchestra.run.smithi178.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T08:47:46.649 INFO:teuthology.orchestra.run.smithi178.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T08:47:46.661 INFO:teuthology.orchestra.run.smithi178.stderr:done 2024-04-25T08:47:46.712 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-6.9.0-rc3-g806ec36b2112 2024-04-25T08:47:46.964 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T08:47:46.970 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T08:47:47.010 INFO:teuthology.orchestra.run.smithi059.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T08:47:47.015 INFO:teuthology.orchestra.run.smithi059.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T08:47:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T08:47:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T08:47:47.180 INFO:teuthology.orchestra.run.smithi059.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T08:47:47.191 INFO:teuthology.orchestra.run.smithi059.stderr:done 2024-04-25T08:48:17.826 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-25T08:48:17.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-25T08:48:17.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:48:18.337 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T08:48:18.338 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-25T08:48:18.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:48:36.895 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-25T08:48:45.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-25T08:48:45.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:48:48.958 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.59 2024-04-25T08:48:52.510 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-25T08:49:00.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-25T08:49:00.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:49:01.512 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-25T08:49:01.513 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:49:04.578 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-04-25T08:49:16.590 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-25T08:49:16.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:49:32.894 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-04-25T08:49:33.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-25T08:49:33.877 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T08:49:33.877 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2024-04-25T08:49:33.931 INFO:teuthology.orchestra.run.smithi059.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T08:49:33.931 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T08:49:33.931 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T08:49:33.931 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T08:49:34.932 DEBUG:teuthology.parallel:result is None 2024-04-25T08:49:48.327 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-04-25T08:49:48.914 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-25T08:49:48.915 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-04-25T08:49:48.915 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-04-25T08:49:48.964 INFO:teuthology.orchestra.run.smithi178.stdout:6.9.0-rc3-g806ec36b2112 2024-04-25T08:49:48.964 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-04-25T08:49:48.964 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T08:49:48.964 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T08:49:49.966 DEBUG:teuthology.parallel:result is None 2024-04-25T08:49:49.966 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T08:49:49.974 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T08:49:49.974 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T08:49:49.978 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T08:49:49.986 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T08:49:50.000 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T08:49:50.012 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T08:49:50.012 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T08:49:50.030 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T08:49:50.057 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T08:49:50.066 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T08:49:50.066 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T08:49:50.099 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T08:49:50.170 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:49:50.187 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:49:50.194 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:49:50.209 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T08:49:50.212 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T08:49:50.220 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T08:49:50.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T08:49:50.224 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T08:49:50.245 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T08:49:50.256 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T08:49:50.256 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T08:49:50.290 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T08:49:50.301 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:49:50.352 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:49:50.404 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T08:49:50.404 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T08:49:50.475 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T08:49:50.484 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T08:49:50.537 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T08:49:50.537 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T08:49:50.618 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2024-04-25T08:49:50.621 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2024-04-25T08:49:50.763 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T08:49:50.771 INFO:teuthology.task.internal:Starting timer... 2024-04-25T08:49:50.772 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T08:49:50.788 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T08:49:50.801 DEBUG:teuthology.task.selinux:Excluding smithi059: OS 'ubuntu' does not support SELinux 2024-04-25T08:49:50.801 DEBUG:teuthology.task.selinux:Excluding smithi178: OS 'ubuntu' does not support SELinux 2024-04-25T08:49:50.801 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T08:49:50.801 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T08:49:50.801 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T08:49:50.801 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T08:49:50.814 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T08:49:50.820 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T08:49:50.932 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T08:49:50.947 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T08:49:50.948 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi059.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T08:57:34.001 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi059.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2024-04-25T08:57:34.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-25T08:57:34.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:57:34.093 DEBUG:teuthology.orchestra.run.smithi059:> true 2024-04-25T08:57:34.205 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2024-04-25T08:57:34.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-25T08:57:34.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T08:57:34.286 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-04-25T08:57:34.413 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-04-25T08:57:34.414 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T08:57:34.425 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T08:57:34.425 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T08:57:34.426 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T08:57:34.429 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T08:57:34.429 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T08:57:34.466 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T08:57:34.466 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: Command line: ntpd -gq 2024-04-25T08:57:34.466 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: ---------------------------------------------------- 2024-04-25T08:57:34.466 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T08:57:34.466 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T08:57:34.466 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: corporation. Support and training for ntp-4 are 2024-04-25T08:57:34.466 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: available at https://www.nwtime.org/support 2024-04-25T08:57:34.466 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: ---------------------------------------------------- 2024-04-25T08:57:34.467 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: proto: precision = 0.044 usec (-24) 2024-04-25T08:57:34.467 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: basedate set to 2022-02-04 2024-04-25T08:57:34.467 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: gps base set to 2022-02-06 (week 2196) 2024-04-25T08:57:34.467 INFO:teuthology.orchestra.run.smithi059.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T08:57:34.468 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T08:57:34.468 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T08:57:34.468 INFO:teuthology.orchestra.run.smithi059.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T08:57:34.469 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T08:57:34.469 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T08:57:34.470 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T08:57:34.470 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: Listen normally on 3 ens1f0 172.21.15.59:123 2024-04-25T08:57:34.470 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: Listen normally on 4 lo [::1]:123 2024-04-25T08:57:34.470 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:192a%4]:123 2024-04-25T08:57:34.470 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:34 ntpd[17120]: Listening on routing socket on fd #22 for interface updates 2024-04-25T08:57:34.493 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T08:57:34.493 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: Command line: ntpd -gq 2024-04-25T08:57:34.493 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: ---------------------------------------------------- 2024-04-25T08:57:34.493 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T08:57:34.493 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T08:57:34.493 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: corporation. Support and training for ntp-4 are 2024-04-25T08:57:34.493 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: available at https://www.nwtime.org/support 2024-04-25T08:57:34.494 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: ---------------------------------------------------- 2024-04-25T08:57:34.494 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: proto: precision = 0.044 usec (-24) 2024-04-25T08:57:34.494 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: basedate set to 2022-02-04 2024-04-25T08:57:34.494 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: gps base set to 2022-02-06 (week 2196) 2024-04-25T08:57:34.495 INFO:teuthology.orchestra.run.smithi178.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T08:57:34.495 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T08:57:34.496 INFO:teuthology.orchestra.run.smithi178.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T08:57:34.497 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T08:57:34.497 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T08:57:34.497 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T08:57:34.497 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T08:57:34.497 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: Listen normally on 3 enp3s0f1 172.21.15.178:123 2024-04-25T08:57:34.497 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: Listen normally on 4 lo [::1]:123 2024-04-25T08:57:34.497 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ef9%5]:123 2024-04-25T08:57:34.497 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:34 ntpd[17250]: Listening on routing socket on fd #22 for interface updates 2024-04-25T08:57:35.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:35 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:35.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:35 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:35.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:35 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:35.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:35 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:35.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:35 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:35.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:35 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:35.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:35 ntpd[17120]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:35.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:35 ntpd[17120]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:35.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:35 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:35.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:35 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:35.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:35 ntpd[17120]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:35.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:35 ntpd[17120]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:35.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:35.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:35 ntpd[17250]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:36 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:36 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:36 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:36 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:36 ntpd[17120]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:36 ntpd[17120]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:37.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:37.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:37 ntpd[17120]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:37.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:37 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:37.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:37 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:37.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:37 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:37.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:37 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:37.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:37 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:37.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:37 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:37.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:37 ntpd[17250]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:37.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:37 ntpd[17250]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:37.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:37 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:37.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:37 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:37.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:37 ntpd[17250]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:37.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:37 ntpd[17250]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:38 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:38 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:38 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:38 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:38 ntpd[17120]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:38.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:38 ntpd[17120]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:38.493 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:38 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:38 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:38 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:38 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:38 ntpd[17250]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:38.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:38 ntpd[17250]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:39.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:39 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:39.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:39 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:39.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:39 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:39.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:39 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:39.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:39 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:39.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:39 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:39.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:39 ntpd[17120]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:39.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:39 ntpd[17120]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:39.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:39 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:39.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:39 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:39.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:39 ntpd[17120]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:39.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:39 ntpd[17120]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:39.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:39 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:39.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:39 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:39.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:39 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:39.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:39 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:39.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:39 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:39.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:39 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:39.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:39 ntpd[17250]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:39.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:39 ntpd[17250]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:39.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:39 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:39.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:39 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:39.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:39 ntpd[17250]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:39.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:39 ntpd[17250]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:40 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:40 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:40 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:40 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:40 ntpd[17120]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:40.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:40 ntpd[17120]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:40.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:40 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:40.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:40 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:40.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:40 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:40.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:40 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:40.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:40 ntpd[17250]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:40.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:40 ntpd[17250]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:41 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:41 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:41 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:41 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:41 ntpd[17120]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:41 ntpd[17120]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:41 ntpd[17120]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:41.467 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:41 ntpd[17120]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:41.468 INFO:teuthology.orchestra.run.smithi059.stdout:25 Apr 08:57:41 ntpd[17120]: ntpd: time slew -0.001023 s 2024-04-25T08:57:41.468 INFO:teuthology.orchestra.run.smithi059.stdout:ntpd: time slew -0.001023s 2024-04-25T08:57:41.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:41 ntpd[17120]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T08:57:41.468 INFO:teuthology.orchestra.run.smithi059.stderr:25 Apr 08:57:41 ntpd[17120]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T08:57:41.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:41 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:41.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:41 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:41.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:41 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:41.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:41 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:41.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:41 ntpd[17250]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T08:57:41.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:41 ntpd[17250]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T08:57:41.494 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:41 ntpd[17250]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T08:57:41.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:41 ntpd[17250]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T08:57:41.495 INFO:teuthology.orchestra.run.smithi178.stdout:25 Apr 08:57:41 ntpd[17250]: ntpd: time slew -0.001024 s 2024-04-25T08:57:41.495 INFO:teuthology.orchestra.run.smithi178.stdout:ntpd: time slew -0.001024s 2024-04-25T08:57:41.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:41 ntpd[17250]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T08:57:41.495 INFO:teuthology.orchestra.run.smithi178.stderr:25 Apr 08:57:41 ntpd[17250]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T08:57:41.573 INFO:teuthology.orchestra.run.smithi059.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T08:57:41.573 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================== 2024-04-25T08:57:41.573 INFO:teuthology.orchestra.run.smithi059.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:57:41.573 INFO:teuthology.orchestra.run.smithi059.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:57:41.573 INFO:teuthology.orchestra.run.smithi059.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:57:41.574 INFO:teuthology.orchestra.run.smithi059.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:57:41.602 INFO:teuthology.orchestra.run.smithi178.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T08:57:41.602 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================== 2024-04-25T08:57:41.602 INFO:teuthology.orchestra.run.smithi178.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:57:41.602 INFO:teuthology.orchestra.run.smithi178.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:57:41.602 INFO:teuthology.orchestra.run.smithi178.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:57:41.602 INFO:teuthology.orchestra.run.smithi178.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T08:57:41.603 INFO:teuthology.run_tasks:Running task install... 2024-04-25T08:57:41.612 DEBUG:teuthology.task.install:project ceph 2024-04-25T08:57:41.612 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}} 2024-04-25T08:57:41.612 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'} 2024-04-25T08:57:41.612 INFO:teuthology.task.install:Using flavor: default 2024-04-25T08:57:41.618 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T08:57:41.618 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T08:57:41.619 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-key list | grep Ceph 2024-04-25T08:57:41.619 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-key list | grep Ceph 2024-04-25T08:57:41.728 INFO:teuthology.orchestra.run.smithi059.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T08:57:41.751 INFO:teuthology.orchestra.run.smithi178.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T08:57:41.780 INFO:teuthology.orchestra.run.smithi059.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T08:57:41.780 INFO:teuthology.orchestra.run.smithi059.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T08:57:41.781 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T08:57:41.781 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T08:57:41.782 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:57:41.802 INFO:teuthology.orchestra.run.smithi178.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T08:57:41.802 INFO:teuthology.orchestra.run.smithi178.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T08:57:41.804 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T08:57:41.804 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T08:57:41.804 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T08:57:41.939 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default/ 2024-04-25T08:57:41.939 INFO:teuthology.task.install.deb:Package version is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T08:57:41.974 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default/ 2024-04-25T08:57:41.974 INFO:teuthology.task.install.deb:Package version is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T08:57:42.063 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T08:57:42.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T08:57:42.083 DEBUG:teuthology.orchestra.run.smithi059:> sudo apt-get update 2024-04-25T08:57:42.095 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T08:57:42.095 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T08:57:42.114 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get update 2024-04-25T08:57:42.305 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T08:57:42.306 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T08:57:42.316 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T08:57:42.321 INFO:teuthology.orchestra.run.smithi059.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T08:57:42.337 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T08:57:42.342 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T08:57:42.360 INFO:teuthology.orchestra.run.smithi178.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T08:57:42.364 INFO:teuthology.orchestra.run.smithi059.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T08:57:42.383 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T08:57:42.385 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,398 B] 2024-04-25T08:57:42.406 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T08:57:42.408 INFO:teuthology.orchestra.run.smithi178.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T08:57:42.413 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T08:57:42.427 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-25T08:57:42.433 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-25T08:57:42.467 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,398 B] 2024-04-25T08:57:42.471 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T08:57:42.553 INFO:teuthology.orchestra.run.smithi059.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T08:57:42.890 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 28.9 kB in 1s (52.2 kB/s) 2024-04-25T08:57:43.013 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 28.9 kB in 1s (41.2 kB/s) 2024-04-25T08:57:43.878 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-04-25T08:57:43.893 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1628-g97ae6cc9-1jammy cephadm=19.0.0-1628-g97ae6cc9-1jammy ceph-mds=19.0.0-1628-g97ae6cc9-1jammy ceph-mgr=19.0.0-1628-g97ae6cc9-1jammy ceph-common=19.0.0-1628-g97ae6cc9-1jammy ceph-fuse=19.0.0-1628-g97ae6cc9-1jammy ceph-test=19.0.0-1628-g97ae6cc9-1jammy ceph-volume=19.0.0-1628-g97ae6cc9-1jammy radosgw=19.0.0-1628-g97ae6cc9-1jammy python3-rados=19.0.0-1628-g97ae6cc9-1jammy python3-rgw=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy python3-rbd=19.0.0-1628-g97ae6cc9-1jammy libcephfs2=19.0.0-1628-g97ae6cc9-1jammy libcephfs-dev=19.0.0-1628-g97ae6cc9-1jammy librados2=19.0.0-1628-g97ae6cc9-1jammy librbd1=19.0.0-1628-g97ae6cc9-1jammy rbd-fuse=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy cephfs-shell=19.0.0-1628-g97ae6cc9-1jammy cephfs-top=19.0.0-1628-g97ae6cc9-1jammy cephfs-mirror=19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T08:57:43.967 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-04-25T08:57:44.032 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-04-25T08:57:44.047 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1628-g97ae6cc9-1jammy cephadm=19.0.0-1628-g97ae6cc9-1jammy ceph-mds=19.0.0-1628-g97ae6cc9-1jammy ceph-mgr=19.0.0-1628-g97ae6cc9-1jammy ceph-common=19.0.0-1628-g97ae6cc9-1jammy ceph-fuse=19.0.0-1628-g97ae6cc9-1jammy ceph-test=19.0.0-1628-g97ae6cc9-1jammy ceph-volume=19.0.0-1628-g97ae6cc9-1jammy radosgw=19.0.0-1628-g97ae6cc9-1jammy python3-rados=19.0.0-1628-g97ae6cc9-1jammy python3-rgw=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy python3-rbd=19.0.0-1628-g97ae6cc9-1jammy libcephfs2=19.0.0-1628-g97ae6cc9-1jammy libcephfs-dev=19.0.0-1628-g97ae6cc9-1jammy librados2=19.0.0-1628-g97ae6cc9-1jammy librbd1=19.0.0-1628-g97ae6cc9-1jammy rbd-fuse=19.0.0-1628-g97ae6cc9-1jammy python3-cephfs=19.0.0-1628-g97ae6cc9-1jammy cephfs-shell=19.0.0-1628-g97ae6cc9-1jammy cephfs-top=19.0.0-1628-g97ae6cc9-1jammy cephfs-mirror=19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T08:57:44.124 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-04-25T08:57:44.143 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2024-04-25T08:57:44.144 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2024-04-25T08:57:44.302 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2024-04-25T08:57:44.302 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2024-04-25T08:57:44.319 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T08:57:44.319 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T08:57:44.319 INFO:teuthology.orchestra.run.smithi178.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T08:57:44.319 INFO:teuthology.orchestra.run.smithi178.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T08:57:44.320 INFO:teuthology.orchestra.run.smithi178.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T08:57:44.320 INFO:teuthology.orchestra.run.smithi178.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T08:57:44.320 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T08:57:44.320 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2024-04-25T08:57:44.320 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T08:57:44.322 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T08:57:44.322 INFO:teuthology.orchestra.run.smithi178.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T08:57:44.322 INFO:teuthology.orchestra.run.smithi178.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T08:57:44.322 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T08:57:44.322 INFO:teuthology.orchestra.run.smithi178.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T08:57:44.323 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T08:57:44.324 INFO:teuthology.orchestra.run.smithi178.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T08:57:44.324 INFO:teuthology.orchestra.run.smithi178.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T08:57:44.324 INFO:teuthology.orchestra.run.smithi178.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T08:57:44.324 INFO:teuthology.orchestra.run.smithi178.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T08:57:44.324 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2024-04-25T08:57:44.324 INFO:teuthology.orchestra.run.smithi178.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T08:57:44.324 INFO:teuthology.orchestra.run.smithi178.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T08:57:44.324 INFO:teuthology.orchestra.run.smithi178.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T08:57:44.324 INFO:teuthology.orchestra.run.smithi178.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T08:57:44.324 INFO:teuthology.orchestra.run.smithi178.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T08:57:44.325 INFO:teuthology.orchestra.run.smithi178.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T08:57:44.325 INFO:teuthology.orchestra.run.smithi178.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T08:57:44.325 INFO:teuthology.orchestra.run.smithi178.stdout:Recommended packages: 2024-04-25T08:57:44.325 INFO:teuthology.orchestra.run.smithi178.stdout: btrfs-tools 2024-04-25T08:57:44.474 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2024-04-25T08:57:44.475 INFO:teuthology.orchestra.run.smithi178.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T08:57:44.475 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T08:57:44.475 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T08:57:44.475 INFO:teuthology.orchestra.run.smithi178.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T08:57:44.475 INFO:teuthology.orchestra.run.smithi178.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T08:57:44.475 INFO:teuthology.orchestra.run.smithi178.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T08:57:44.475 INFO:teuthology.orchestra.run.smithi178.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T08:57:44.476 INFO:teuthology.orchestra.run.smithi178.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T08:57:44.477 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T08:57:44.478 INFO:teuthology.orchestra.run.smithi178.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T08:57:44.478 INFO:teuthology.orchestra.run.smithi178.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T08:57:44.478 INFO:teuthology.orchestra.run.smithi178.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T08:57:44.478 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T08:57:44.478 INFO:teuthology.orchestra.run.smithi178.stdout: socat unzip xmlstarlet zip 2024-04-25T08:57:44.484 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T08:57:44.484 INFO:teuthology.orchestra.run.smithi059.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T08:57:44.484 INFO:teuthology.orchestra.run.smithi059.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T08:57:44.484 INFO:teuthology.orchestra.run.smithi059.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T08:57:44.484 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T08:57:44.485 INFO:teuthology.orchestra.run.smithi059.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T08:57:44.485 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T08:57:44.485 INFO:teuthology.orchestra.run.smithi059.stdout:The following additional packages will be installed: 2024-04-25T08:57:44.485 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T08:57:44.485 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T08:57:44.486 INFO:teuthology.orchestra.run.smithi059.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T08:57:44.486 INFO:teuthology.orchestra.run.smithi059.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T08:57:44.487 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T08:57:44.487 INFO:teuthology.orchestra.run.smithi059.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T08:57:44.487 INFO:teuthology.orchestra.run.smithi059.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T08:57:44.487 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T08:57:44.487 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T08:57:44.487 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T08:57:44.488 INFO:teuthology.orchestra.run.smithi059.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-25T08:57:44.489 INFO:teuthology.orchestra.run.smithi059.stdout:Suggested packages: 2024-04-25T08:57:44.489 INFO:teuthology.orchestra.run.smithi059.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T08:57:44.489 INFO:teuthology.orchestra.run.smithi059.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T08:57:44.489 INFO:teuthology.orchestra.run.smithi059.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T08:57:44.489 INFO:teuthology.orchestra.run.smithi059.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T08:57:44.489 INFO:teuthology.orchestra.run.smithi059.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T08:57:44.489 INFO:teuthology.orchestra.run.smithi059.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T08:57:44.489 INFO:teuthology.orchestra.run.smithi059.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T08:57:44.489 INFO:teuthology.orchestra.run.smithi059.stdout:Recommended packages: 2024-04-25T08:57:44.489 INFO:teuthology.orchestra.run.smithi059.stdout: btrfs-tools 2024-04-25T08:57:44.624 INFO:teuthology.orchestra.run.smithi178.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-25T08:57:44.625 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 176 MB of archives. 2024-04-25T08:57:44.625 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 732 MB of additional disk space will be used. 2024-04-25T08:57:44.625 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,533 kB] 2024-04-25T08:57:44.647 INFO:teuthology.orchestra.run.smithi059.stdout:The following NEW packages will be installed: 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T08:57:44.648 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-25T08:57:44.649 INFO:teuthology.orchestra.run.smithi059.stdout: socat unzip xmlstarlet zip 2024-04-25T08:57:44.672 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T08:57:44.756 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T08:57:44.802 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T08:57:44.809 INFO:teuthology.orchestra.run.smithi059.stdout:0 upgraded, 124 newly installed, 0 to remove and 305 not upgraded. 2024-04-25T08:57:44.809 INFO:teuthology.orchestra.run.smithi059.stdout:Need to get 176 MB of archives. 2024-04-25T08:57:44.809 INFO:teuthology.orchestra.run.smithi059.stdout:After this operation, 732 MB of additional disk space will be used. 2024-04-25T08:57:44.809 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,533 kB] 2024-04-25T08:57:44.846 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T08:57:44.934 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T08:57:44.934 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,217 kB] 2024-04-25T08:57:44.982 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T08:57:45.005 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T08:57:45.093 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1628-g97ae6cc9-1jammy [709 kB] 2024-04-25T08:57:45.098 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T08:57:45.112 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T08:57:45.130 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1628-g97ae6cc9-1jammy [356 kB] 2024-04-25T08:57:45.146 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1628-g97ae6cc9-1jammy [32.8 kB] 2024-04-25T08:57:45.148 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1628-g97ae6cc9-1jammy [180 kB] 2024-04-25T08:57:45.160 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1628-g97ae6cc9-1jammy [64.8 kB] 2024-04-25T08:57:45.162 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1628-g97ae6cc9-1jammy [330 kB] 2024-04-25T08:57:45.169 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T08:57:45.173 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1628-g97ae6cc9-1jammy [6,575 kB] 2024-04-25T08:57:45.182 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T08:57:45.189 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1628-g97ae6cc9-1jammy [3,217 kB] 2024-04-25T08:57:45.275 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T08:57:45.290 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T08:57:45.340 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T08:57:45.355 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T08:57:45.364 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T08:57:45.392 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T08:57:45.400 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T08:57:45.455 INFO:teuthology.orchestra.run.smithi059.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1628-g97ae6cc9-1jammy [709 kB] 2024-04-25T08:57:45.512 INFO:teuthology.orchestra.run.smithi059.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1628-g97ae6cc9-1jammy [356 kB] 2024-04-25T08:57:45.516 INFO:teuthology.orchestra.run.smithi059.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T08:57:45.524 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1628-g97ae6cc9-1jammy [112 kB] 2024-04-25T08:57:45.525 INFO:teuthology.orchestra.run.smithi059.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T08:57:45.526 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1628-g97ae6cc9-1jammy [467 kB] 2024-04-25T08:57:45.548 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1628-g97ae6cc9-1jammy [24.1 MB] 2024-04-25T08:57:45.550 INFO:teuthology.orchestra.run.smithi059.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1628-g97ae6cc9-1jammy [32.8 kB] 2024-04-25T08:57:45.552 INFO:teuthology.orchestra.run.smithi059.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T08:57:45.552 INFO:teuthology.orchestra.run.smithi059.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1628-g97ae6cc9-1jammy [180 kB] 2024-04-25T08:57:45.560 INFO:teuthology.orchestra.run.smithi059.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T08:57:45.562 INFO:teuthology.orchestra.run.smithi059.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1628-g97ae6cc9-1jammy [64.8 kB] 2024-04-25T08:57:45.566 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T08:57:45.567 INFO:teuthology.orchestra.run.smithi059.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1628-g97ae6cc9-1jammy [330 kB] 2024-04-25T08:57:45.604 INFO:teuthology.orchestra.run.smithi059.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1628-g97ae6cc9-1jammy [6,575 kB] 2024-04-25T08:57:45.726 INFO:teuthology.orchestra.run.smithi059.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T08:57:46.153 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T08:57:46.168 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T08:57:46.170 INFO:teuthology.orchestra.run.smithi059.stdout:Get:22 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1628-g97ae6cc9-1jammy [112 kB] 2024-04-25T08:57:46.177 INFO:teuthology.orchestra.run.smithi059.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1628-g97ae6cc9-1jammy [467 kB] 2024-04-25T08:57:46.184 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T08:57:46.193 INFO:teuthology.orchestra.run.smithi178.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T08:57:46.194 INFO:teuthology.orchestra.run.smithi178.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T08:57:46.213 INFO:teuthology.orchestra.run.smithi178.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T08:57:46.247 INFO:teuthology.orchestra.run.smithi178.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T08:57:46.261 INFO:teuthology.orchestra.run.smithi178.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T08:57:46.265 INFO:teuthology.orchestra.run.smithi178.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T08:57:46.266 INFO:teuthology.orchestra.run.smithi178.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T08:57:46.278 INFO:teuthology.orchestra.run.smithi059.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1628-g97ae6cc9-1jammy [24.1 MB] 2024-04-25T08:57:46.437 INFO:teuthology.orchestra.run.smithi178.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T08:57:46.439 INFO:teuthology.orchestra.run.smithi059.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T08:57:46.469 INFO:teuthology.orchestra.run.smithi059.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T08:57:46.499 INFO:teuthology.orchestra.run.smithi059.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T08:57:46.517 INFO:teuthology.orchestra.run.smithi059.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T08:57:46.517 INFO:teuthology.orchestra.run.smithi059.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T08:57:46.520 INFO:teuthology.orchestra.run.smithi178.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T08:57:46.526 INFO:teuthology.orchestra.run.smithi178.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T08:57:46.576 INFO:teuthology.orchestra.run.smithi059.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T08:57:46.601 INFO:teuthology.orchestra.run.smithi178.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T08:57:46.619 INFO:teuthology.orchestra.run.smithi059.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T08:57:46.628 INFO:teuthology.orchestra.run.smithi178.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T08:57:46.638 INFO:teuthology.orchestra.run.smithi059.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T08:57:46.641 INFO:teuthology.orchestra.run.smithi059.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T08:57:46.643 INFO:teuthology.orchestra.run.smithi059.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T08:57:46.643 INFO:teuthology.orchestra.run.smithi178.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T08:57:46.686 INFO:teuthology.orchestra.run.smithi178.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T08:57:46.817 INFO:teuthology.orchestra.run.smithi059.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T08:57:46.854 INFO:teuthology.orchestra.run.smithi178.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T08:57:46.859 INFO:teuthology.orchestra.run.smithi178.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1628-g97ae6cc9-1jammy [5,076 kB] 2024-04-25T08:57:46.869 INFO:teuthology.orchestra.run.smithi178.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T08:57:46.875 INFO:teuthology.orchestra.run.smithi178.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T08:57:46.881 INFO:teuthology.orchestra.run.smithi178.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T08:57:46.900 INFO:teuthology.orchestra.run.smithi059.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T08:57:46.923 INFO:teuthology.orchestra.run.smithi059.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T08:57:46.982 INFO:teuthology.orchestra.run.smithi059.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T08:57:47.029 INFO:teuthology.orchestra.run.smithi059.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T08:57:47.050 INFO:teuthology.orchestra.run.smithi059.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T08:57:47.064 INFO:teuthology.orchestra.run.smithi178.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T08:57:47.072 INFO:teuthology.orchestra.run.smithi059.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T08:57:47.128 INFO:teuthology.orchestra.run.smithi178.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1628-g97ae6cc9-1jammy [243 kB] 2024-04-25T08:57:47.137 INFO:teuthology.orchestra.run.smithi178.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [124 kB] 2024-04-25T08:57:47.142 INFO:teuthology.orchestra.run.smithi178.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1628-g97ae6cc9-1jammy [1,520 kB] 2024-04-25T08:57:47.149 INFO:teuthology.orchestra.run.smithi178.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T08:57:47.162 INFO:teuthology.orchestra.run.smithi178.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T08:57:47.221 INFO:teuthology.orchestra.run.smithi178.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1628-g97ae6cc9-1jammy [6,237 kB] 2024-04-25T08:57:47.246 INFO:teuthology.orchestra.run.smithi059.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T08:57:47.262 INFO:teuthology.orchestra.run.smithi059.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T08:57:47.269 INFO:teuthology.orchestra.run.smithi059.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T08:57:47.274 INFO:teuthology.orchestra.run.smithi059.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T08:57:47.347 INFO:teuthology.orchestra.run.smithi178.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T08:57:47.397 INFO:teuthology.orchestra.run.smithi178.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T08:57:47.410 INFO:teuthology.orchestra.run.smithi178.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T08:57:47.458 INFO:teuthology.orchestra.run.smithi059.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T08:57:47.545 INFO:teuthology.orchestra.run.smithi059.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T08:57:47.562 INFO:teuthology.orchestra.run.smithi059.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T08:57:47.566 INFO:teuthology.orchestra.run.smithi178.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1628-g97ae6cc9-1jammy [22.7 MB] 2024-04-25T08:57:47.572 INFO:teuthology.orchestra.run.smithi178.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T08:57:47.573 INFO:teuthology.orchestra.run.smithi178.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T08:57:47.578 INFO:teuthology.orchestra.run.smithi178.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T08:57:47.583 INFO:teuthology.orchestra.run.smithi178.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T08:57:47.597 INFO:teuthology.orchestra.run.smithi178.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T08:57:47.748 INFO:teuthology.orchestra.run.smithi059.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T08:57:47.783 INFO:teuthology.orchestra.run.smithi178.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T08:57:47.799 INFO:teuthology.orchestra.run.smithi059.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T08:57:47.812 INFO:teuthology.orchestra.run.smithi059.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T08:57:47.969 INFO:teuthology.orchestra.run.smithi059.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T08:57:47.970 INFO:teuthology.orchestra.run.smithi059.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T08:57:47.975 INFO:teuthology.orchestra.run.smithi059.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T08:57:47.980 INFO:teuthology.orchestra.run.smithi059.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T08:57:47.994 INFO:teuthology.orchestra.run.smithi059.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T08:57:48.047 INFO:teuthology.orchestra.run.smithi178.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T08:57:48.179 INFO:teuthology.orchestra.run.smithi059.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T08:57:48.182 INFO:teuthology.orchestra.run.smithi178.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T08:57:48.219 INFO:teuthology.orchestra.run.smithi059.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1628-g97ae6cc9-1jammy [5,076 kB] 2024-04-25T08:57:48.224 INFO:teuthology.orchestra.run.smithi178.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T08:57:48.314 INFO:teuthology.orchestra.run.smithi178.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T08:57:48.324 INFO:teuthology.orchestra.run.smithi178.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T08:57:48.337 INFO:teuthology.orchestra.run.smithi178.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T08:57:48.380 INFO:teuthology.orchestra.run.smithi178.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T08:57:48.442 INFO:teuthology.orchestra.run.smithi059.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T08:57:48.577 INFO:teuthology.orchestra.run.smithi059.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T08:57:48.619 INFO:teuthology.orchestra.run.smithi059.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T08:57:48.638 INFO:teuthology.orchestra.run.smithi059.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1628-g97ae6cc9-1jammy [243 kB] 2024-04-25T08:57:48.649 INFO:teuthology.orchestra.run.smithi178.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T08:57:48.650 INFO:teuthology.orchestra.run.smithi178.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T08:57:48.651 INFO:teuthology.orchestra.run.smithi178.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T08:57:48.653 INFO:teuthology.orchestra.run.smithi059.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [124 kB] 2024-04-25T08:57:48.662 INFO:teuthology.orchestra.run.smithi059.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1628-g97ae6cc9-1jammy [1,520 kB] 2024-04-25T08:57:48.709 INFO:teuthology.orchestra.run.smithi059.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T08:57:48.719 INFO:teuthology.orchestra.run.smithi059.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T08:57:48.731 INFO:teuthology.orchestra.run.smithi059.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T08:57:48.774 INFO:teuthology.orchestra.run.smithi059.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T08:57:48.793 INFO:teuthology.orchestra.run.smithi059.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1628-g97ae6cc9-1jammy [6,237 kB] 2024-04-25T08:57:48.802 INFO:teuthology.orchestra.run.smithi178.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [14.0 kB] 2024-04-25T08:57:48.803 INFO:teuthology.orchestra.run.smithi178.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [866 kB] 2024-04-25T08:57:48.815 INFO:teuthology.orchestra.run.smithi178.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T08:57:48.840 INFO:teuthology.orchestra.run.smithi178.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1628-g97ae6cc9-1jammy [2,191 kB] 2024-04-25T08:57:48.965 INFO:teuthology.orchestra.run.smithi178.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1628-g97ae6cc9-1jammy [776 kB] 2024-04-25T08:57:49.000 INFO:teuthology.orchestra.run.smithi178.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1628-g97ae6cc9-1jammy [144 kB] 2024-04-25T08:57:49.009 INFO:teuthology.orchestra.run.smithi178.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1628-g97ae6cc9-1jammy [1,921 kB] 2024-04-25T08:57:49.040 INFO:teuthology.orchestra.run.smithi059.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T08:57:49.041 INFO:teuthology.orchestra.run.smithi059.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T08:57:49.042 INFO:teuthology.orchestra.run.smithi059.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T08:57:49.118 INFO:teuthology.orchestra.run.smithi178.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1628-g97ae6cc9-1jammy [8,625 kB] 2024-04-25T08:57:49.159 INFO:teuthology.orchestra.run.smithi178.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T08:57:49.207 INFO:teuthology.orchestra.run.smithi059.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T08:57:49.318 INFO:teuthology.orchestra.run.smithi059.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1628-g97ae6cc9-1jammy [22.7 MB] 2024-04-25T08:57:49.554 INFO:teuthology.orchestra.run.smithi059.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T08:57:49.561 INFO:teuthology.orchestra.run.smithi178.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T08:57:49.571 INFO:teuthology.orchestra.run.smithi178.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T08:57:49.572 INFO:teuthology.orchestra.run.smithi178.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T08:57:49.586 INFO:teuthology.orchestra.run.smithi178.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1628-g97ae6cc9-1jammy [14.2 kB] 2024-04-25T08:57:49.586 INFO:teuthology.orchestra.run.smithi178.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1628-g97ae6cc9-1jammy [49.9 MB] 2024-04-25T08:57:49.642 INFO:teuthology.orchestra.run.smithi178.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T08:57:49.642 INFO:teuthology.orchestra.run.smithi178.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T08:57:49.643 INFO:teuthology.orchestra.run.smithi178.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T08:57:49.644 INFO:teuthology.orchestra.run.smithi178.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T08:57:49.644 INFO:teuthology.orchestra.run.smithi178.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T08:57:49.645 INFO:teuthology.orchestra.run.smithi178.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T08:57:49.810 INFO:teuthology.orchestra.run.smithi178.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T08:57:49.962 INFO:teuthology.orchestra.run.smithi059.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T08:57:49.971 INFO:teuthology.orchestra.run.smithi059.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T08:57:49.973 INFO:teuthology.orchestra.run.smithi059.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T08:57:50.013 INFO:teuthology.orchestra.run.smithi178.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T08:57:50.042 INFO:teuthology.orchestra.run.smithi059.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T08:57:50.043 INFO:teuthology.orchestra.run.smithi059.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T08:57:50.043 INFO:teuthology.orchestra.run.smithi059.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T08:57:50.045 INFO:teuthology.orchestra.run.smithi059.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T08:57:50.045 INFO:teuthology.orchestra.run.smithi059.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T08:57:50.046 INFO:teuthology.orchestra.run.smithi059.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T08:57:50.210 INFO:teuthology.orchestra.run.smithi059.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T08:57:50.334 INFO:teuthology.orchestra.run.smithi178.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T08:57:50.380 INFO:teuthology.orchestra.run.smithi178.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T08:57:50.408 INFO:teuthology.orchestra.run.smithi178.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T08:57:50.417 INFO:teuthology.orchestra.run.smithi178.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T08:57:50.430 INFO:teuthology.orchestra.run.smithi059.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T08:57:50.463 INFO:teuthology.orchestra.run.smithi178.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T08:57:50.488 INFO:teuthology.orchestra.run.smithi178.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T08:57:50.489 INFO:teuthology.orchestra.run.smithi178.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T08:57:50.497 INFO:teuthology.orchestra.run.smithi178.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T08:57:50.500 INFO:teuthology.orchestra.run.smithi178.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T08:57:50.698 INFO:teuthology.orchestra.run.smithi178.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T08:57:50.760 INFO:teuthology.orchestra.run.smithi059.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T08:57:50.807 INFO:teuthology.orchestra.run.smithi059.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T08:57:50.832 INFO:teuthology.orchestra.run.smithi059.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T08:57:50.842 INFO:teuthology.orchestra.run.smithi059.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T08:57:50.888 INFO:teuthology.orchestra.run.smithi059.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T08:57:50.913 INFO:teuthology.orchestra.run.smithi059.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T08:57:50.915 INFO:teuthology.orchestra.run.smithi059.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T08:57:50.922 INFO:teuthology.orchestra.run.smithi059.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T08:57:50.925 INFO:teuthology.orchestra.run.smithi059.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T08:57:50.955 INFO:teuthology.orchestra.run.smithi178.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T08:57:51.066 INFO:teuthology.orchestra.run.smithi059.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1628-g97ae6cc9-1jammy [14.0 kB] 2024-04-25T08:57:51.067 INFO:teuthology.orchestra.run.smithi059.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [866 kB] 2024-04-25T08:57:51.121 INFO:teuthology.orchestra.run.smithi059.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1628-g97ae6cc9-1jammy [2,191 kB] 2024-04-25T08:57:51.121 INFO:teuthology.orchestra.run.smithi059.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T08:57:51.224 INFO:teuthology.orchestra.run.smithi178.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T08:57:51.226 INFO:teuthology.orchestra.run.smithi178.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T08:57:51.242 INFO:teuthology.orchestra.run.smithi178.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T08:57:51.248 INFO:teuthology.orchestra.run.smithi178.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T08:57:51.274 INFO:teuthology.orchestra.run.smithi059.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1628-g97ae6cc9-1jammy [776 kB] 2024-04-25T08:57:51.287 INFO:teuthology.orchestra.run.smithi178.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T08:57:51.302 INFO:teuthology.orchestra.run.smithi178.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T08:57:51.329 INFO:teuthology.orchestra.run.smithi059.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1628-g97ae6cc9-1jammy [144 kB] 2024-04-25T08:57:51.339 INFO:teuthology.orchestra.run.smithi059.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1628-g97ae6cc9-1jammy [1,921 kB] 2024-04-25T08:57:51.392 INFO:teuthology.orchestra.run.smithi059.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T08:57:51.400 INFO:teuthology.orchestra.run.smithi178.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T08:57:51.401 INFO:teuthology.orchestra.run.smithi178.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T08:57:51.403 INFO:teuthology.orchestra.run.smithi178.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T08:57:51.474 INFO:teuthology.orchestra.run.smithi059.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1628-g97ae6cc9-1jammy [8,625 kB] 2024-04-25T08:57:51.582 INFO:teuthology.orchestra.run.smithi178.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T08:57:51.672 INFO:teuthology.orchestra.run.smithi059.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T08:57:51.675 INFO:teuthology.orchestra.run.smithi059.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T08:57:51.697 INFO:teuthology.orchestra.run.smithi059.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T08:57:51.705 INFO:teuthology.orchestra.run.smithi059.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T08:57:51.748 INFO:teuthology.orchestra.run.smithi059.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T08:57:51.761 INFO:teuthology.orchestra.run.smithi059.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T08:57:51.855 INFO:teuthology.orchestra.run.smithi178.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T08:57:51.967 INFO:teuthology.orchestra.run.smithi059.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T08:57:51.969 INFO:teuthology.orchestra.run.smithi059.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T08:57:51.970 INFO:teuthology.orchestra.run.smithi059.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T08:57:52.089 INFO:teuthology.orchestra.run.smithi059.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1628-g97ae6cc9-1jammy [14.2 kB] 2024-04-25T08:57:52.090 INFO:teuthology.orchestra.run.smithi059.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1628-g97ae6cc9-1jammy [49.9 MB] 2024-04-25T08:57:52.154 INFO:teuthology.orchestra.run.smithi059.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T08:57:52.481 INFO:teuthology.orchestra.run.smithi059.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T08:57:52.535 INFO:teuthology.orchestra.run.smithi178.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1628-g97ae6cc9-1jammy [121 kB] 2024-04-25T08:57:52.536 INFO:teuthology.orchestra.run.smithi178.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1628-g97ae6cc9-1jammy [228 kB] 2024-04-25T08:57:52.538 INFO:teuthology.orchestra.run.smithi178.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1628-g97ae6cc9-1jammy [34.0 kB] 2024-04-25T08:57:52.538 INFO:teuthology.orchestra.run.smithi178.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1628-g97ae6cc9-1jammy [23.4 kB] 2024-04-25T08:57:52.540 INFO:teuthology.orchestra.run.smithi178.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1628-g97ae6cc9-1jammy [38.4 kB] 2024-04-25T08:57:52.547 INFO:teuthology.orchestra.run.smithi178.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1628-g97ae6cc9-1jammy [13.0 MB] 2024-04-25T08:57:53.331 INFO:teuthology.orchestra.run.smithi178.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [91.5 kB] 2024-04-25T08:57:53.976 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 176 MB in 9s (19.9 MB/s) 2024-04-25T08:57:54.084 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T08:57:54.151 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-25T08:57:54.155 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T08:57:54.183 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T08:57:54.486 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T08:57:54.499 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T08:57:54.544 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T08:57:54.570 INFO:teuthology.orchestra.run.smithi059.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1628-g97ae6cc9-1jammy [121 kB] 2024-04-25T08:57:54.571 INFO:teuthology.orchestra.run.smithi059.stdout:Get:119 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-1628-g97ae6cc9-1jammy [228 kB] 2024-04-25T08:57:54.573 INFO:teuthology.orchestra.run.smithi059.stdout:Get:120 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-1628-g97ae6cc9-1jammy [34.0 kB] 2024-04-25T08:57:54.573 INFO:teuthology.orchestra.run.smithi059.stdout:Get:121 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-1628-g97ae6cc9-1jammy [23.4 kB] 2024-04-25T08:57:54.574 INFO:teuthology.orchestra.run.smithi059.stdout:Get:122 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1628-g97ae6cc9-1jammy [38.4 kB] 2024-04-25T08:57:54.574 INFO:teuthology.orchestra.run.smithi059.stdout:Get:123 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1628-g97ae6cc9-1jammy [13.0 MB] 2024-04-25T08:57:54.889 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T08:57:54.902 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T08:57:54.947 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T08:57:54.998 INFO:teuthology.orchestra.run.smithi059.stdout:Get:124 https://2.chacra.ceph.com/r/ceph/wip-neesingh-testing-240416/97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1628-g97ae6cc9-1jammy [91.5 kB] 2024-04-25T08:57:55.292 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T08:57:55.305 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T08:57:55.392 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T08:57:55.655 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 176 MB in 10s (17.1 MB/s) 2024-04-25T08:57:55.729 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T08:57:55.744 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T08:57:55.787 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T08:57:55.804 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T08:57:55.874 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132922 files and directories currently installed.) 2024-04-25T08:57:55.877 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T08:57:55.919 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T08:57:56.098 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T08:57:56.113 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T08:57:56.190 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T08:57:56.255 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T08:57:56.270 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T08:57:56.314 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T08:57:56.583 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T08:57:56.598 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T08:57:56.633 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T08:57:56.827 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T08:57:56.842 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T08:57:56.918 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:57:56.935 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T08:57:56.950 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T08:57:57.019 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T08:57:57.330 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T08:57:57.345 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T08:57:57.380 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:57:57.498 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T08:57:57.513 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T08:57:57.548 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T08:57:57.716 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T08:57:57.731 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T08:57:57.774 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:57:57.876 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T08:57:57.891 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T08:57:57.934 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T08:57:58.127 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T08:57:58.142 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T08:57:58.186 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T08:57:58.404 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T08:57:58.420 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T08:57:58.462 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:57:58.505 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librados2. 2024-04-25T08:57:58.520 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../010-librados2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:57:58.555 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:57:58.782 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T08:57:58.797 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T08:57:58.832 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:57:58.933 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librbd1. 2024-04-25T08:57:58.948 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../011-librbd1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:57:58.991 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:57:59.193 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T08:57:59.208 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T08:57:59.251 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:57:59.436 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T08:57:59.449 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:57:59.494 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:57:59.596 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T08:57:59.611 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T08:57:59.654 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T08:57:59.773 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rados. 2024-04-25T08:57:59.785 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:57:59.855 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:57:59.923 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librados2. 2024-04-25T08:57:59.939 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../010-librados2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:57:59.973 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:00.149 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T08:58:00.163 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:00.207 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:00.401 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librbd1. 2024-04-25T08:58:00.415 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../011-librbd1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:00.426 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T08:58:00.441 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:00.459 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:00.484 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:00.787 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T08:58:00.802 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:00.837 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:00.870 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T08:58:00.885 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:00.928 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:01.132 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T08:58:01.147 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T08:58:01.190 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T08:58:01.197 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rados. 2024-04-25T08:58:01.213 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../013-python3-rados_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:01.255 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:01.476 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T08:58:01.491 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:01.550 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T08:58:01.565 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:01.701 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:01.818 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T08:58:01.834 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:01.869 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:02.198 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T08:58:02.214 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:02.256 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:02.405 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T08:58:02.420 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T08:58:02.463 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T08:58:02.732 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T08:58:02.747 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T08:58:02.782 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T08:58:02.810 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T08:58:02.825 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T08:58:02.860 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T08:58:03.068 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T08:58:03.079 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T08:58:03.083 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T08:58:03.094 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:03.126 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T08:58:03.129 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:03.463 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua5.1. 2024-04-25T08:58:03.478 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T08:58:03.482 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T08:58:03.497 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T08:58:03.521 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T08:58:03.540 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T08:58:03.809 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T08:58:03.825 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T08:58:03.832 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua-any. 2024-04-25T08:58:03.847 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T08:58:03.870 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T08:58:03.890 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T08:58:04.110 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package zip. 2024-04-25T08:58:04.125 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T08:58:04.168 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T08:58:04.170 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T08:58:04.186 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T08:58:04.229 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T08:58:04.513 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package unzip. 2024-04-25T08:58:04.528 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T08:58:04.540 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua5.1. 2024-04-25T08:58:04.556 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T08:58:04.571 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T08:58:04.590 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T08:58:04.893 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua-any. 2024-04-25T08:58:04.909 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T08:58:04.951 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T08:58:04.958 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package luarocks. 2024-04-25T08:58:04.973 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T08:58:05.041 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T08:58:05.237 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package zip. 2024-04-25T08:58:05.253 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T08:58:05.299 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T08:58:05.441 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librgw2. 2024-04-25T08:58:05.455 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../027-librgw2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:05.499 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:05.599 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package unzip. 2024-04-25T08:58:05.614 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T08:58:05.649 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T08:58:05.968 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T08:58:05.982 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:06.018 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:06.043 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package luarocks. 2024-04-25T08:58:06.043 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T08:58:06.077 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T08:58:06.296 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T08:58:06.311 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T08:58:06.363 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T08:58:06.468 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package librgw2. 2024-04-25T08:58:06.483 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../027-librgw2_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:06.530 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:06.682 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T08:58:06.697 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:06.740 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:07.013 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T08:58:07.028 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:07.071 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:07.160 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-common. 2024-04-25T08:58:07.175 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:07.253 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:07.415 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T08:58:07.431 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T08:58:07.695 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T08:58:08.002 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T08:58:08.017 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:08.076 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:08.249 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-base. 2024-04-25T08:58:08.263 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:08.316 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:08.480 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-common. 2024-04-25T08:58:08.495 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../031-ceph-common_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:08.538 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:08.877 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T08:58:08.891 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T08:58:08.935 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T08:58:09.247 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T08:58:09.261 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T08:58:09.305 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T08:58:09.585 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-base. 2024-04-25T08:58:09.601 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../032-ceph-base_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:09.650 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T08:58:09.652 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:09.664 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T08:58:09.708 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T08:58:09.969 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T08:58:09.985 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T08:58:10.019 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T08:58:10.239 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T08:58:10.254 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T08:58:10.297 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T08:58:10.314 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T08:58:10.329 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T08:58:10.372 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T08:58:10.550 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T08:58:10.565 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T08:58:10.608 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T08:58:10.658 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T08:58:10.673 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T08:58:10.716 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T08:58:10.928 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T08:58:10.944 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T08:58:10.986 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T08:58:11.044 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-portend. 2024-04-25T08:58:11.059 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T08:58:11.102 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T08:58:11.289 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T08:58:11.305 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T08:58:11.347 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T08:58:11.422 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T08:58:11.437 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T08:58:11.480 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T08:58:11.650 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T08:58:11.666 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T08:58:11.700 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T08:58:11.775 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T08:58:11.789 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T08:58:11.824 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T08:58:11.978 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T08:58:11.994 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T08:58:12.036 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T08:58:12.161 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T08:58:12.176 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T08:58:12.219 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T08:58:12.348 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-portend. 2024-04-25T08:58:12.363 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T08:58:12.406 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T08:58:12.726 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T08:58:12.741 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T08:58:12.764 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T08:58:12.779 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T08:58:12.783 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T08:58:12.814 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T08:58:13.087 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T08:58:13.092 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T08:58:13.102 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T08:58:13.107 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T08:58:13.137 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T08:58:13.150 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T08:58:13.437 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-mako. 2024-04-25T08:58:13.451 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T08:58:13.481 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T08:58:13.486 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T08:58:13.497 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T08:58:13.540 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T08:58:13.765 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T08:58:13.780 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T08:58:13.814 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T08:58:13.826 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T08:58:13.842 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T08:58:13.876 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T08:58:14.117 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T08:58:14.132 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T08:58:14.162 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T08:58:14.175 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T08:58:14.178 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T08:58:14.220 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T08:58:14.478 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webob. 2024-04-25T08:58:14.493 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T08:58:14.523 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-mako. 2024-04-25T08:58:14.536 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T08:58:14.539 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T08:58:14.582 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T08:58:14.910 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T08:58:14.923 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T08:58:14.926 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T08:58:14.938 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T08:58:14.968 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T08:58:14.984 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T08:58:15.259 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T08:58:15.273 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T08:58:15.304 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T08:58:15.308 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T08:58:15.320 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T08:58:15.354 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T08:58:15.553 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-paste. 2024-04-25T08:58:15.567 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T08:58:15.607 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-webob. 2024-04-25T08:58:15.623 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T08:58:15.628 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T08:58:15.665 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T08:58:15.940 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T08:58:15.954 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T08:58:15.960 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T08:58:15.976 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T08:58:15.998 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T08:58:16.012 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T08:58:16.296 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T08:58:16.312 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T08:58:16.326 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T08:58:16.341 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T08:58:16.354 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T08:58:16.384 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T08:58:16.670 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T08:58:16.674 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-paste. 2024-04-25T08:58:16.685 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T08:58:16.690 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T08:58:16.728 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T08:58:16.732 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T08:58:17.027 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T08:58:17.042 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T08:58:17.065 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T08:58:17.077 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T08:58:17.080 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T08:58:17.123 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T08:58:17.405 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T08:58:17.420 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T08:58:17.990 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T08:58:18.161 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T08:58:18.177 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T08:58:18.219 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T08:58:18.531 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-idna. 2024-04-25T08:58:18.546 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T08:58:18.589 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T08:58:18.683 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T08:58:18.699 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T08:58:18.741 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T08:58:18.875 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T08:58:18.890 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T08:58:18.933 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T08:58:18.986 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T08:58:19.001 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T08:58:19.035 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T08:58:19.203 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-requests. 2024-04-25T08:58:19.218 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T08:58:19.253 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T08:58:19.399 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T08:58:19.414 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T08:58:19.482 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T08:58:19.608 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T08:58:19.623 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T08:58:19.666 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T08:58:19.810 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-idna. 2024-04-25T08:58:19.826 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T08:58:19.859 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T08:58:19.961 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T08:58:19.976 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:20.019 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:20.121 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T08:58:20.137 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T08:58:20.171 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T08:58:20.391 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T08:58:20.405 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:20.441 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:20.466 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-requests. 2024-04-25T08:58:20.481 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T08:58:20.532 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T08:58:20.752 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T08:58:20.767 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T08:58:20.810 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T08:58:20.827 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T08:58:20.843 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T08:58:20.885 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T08:58:21.138 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T08:58:21.154 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T08:58:21.154 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T08:58:21.170 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:21.196 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T08:58:21.213 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:21.484 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T08:58:21.499 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:21.533 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:21.634 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T08:58:21.650 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:21.684 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:21.903 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T08:58:21.918 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:21.945 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T08:58:21.961 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T08:58:21.961 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:21.995 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T08:58:22.298 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T08:58:22.314 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T08:58:22.356 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T08:58:22.548 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T08:58:22.563 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:22.607 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:22.701 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T08:58:22.717 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:22.759 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:23.087 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T08:58:23.103 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:23.145 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:23.527 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph. 2024-04-25T08:58:23.542 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../068-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:23.577 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:23.674 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T08:58:23.690 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:23.724 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:23.904 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T08:58:23.920 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:23.962 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:24.333 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T08:58:24.348 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:24.391 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:24.485 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph. 2024-04-25T08:58:24.500 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../068-ceph_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:24.544 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:24.744 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephadm. 2024-04-25T08:58:24.760 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../071-cephadm_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:24.794 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:24.888 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T08:58:24.904 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:24.946 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:25.089 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T08:58:25.104 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T08:58:25.147 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T08:58:25.282 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T08:58:25.298 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:25.341 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:25.450 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T08:58:25.465 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T08:58:25.508 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T08:58:25.644 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package cephadm. 2024-04-25T08:58:25.660 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../071-cephadm_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:25.702 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:26.046 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T08:58:26.062 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T08:58:26.104 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T08:58:26.399 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T08:58:26.414 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T08:58:26.457 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T08:58:26.505 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-babel. 2024-04-25T08:58:26.519 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T08:58:26.563 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T08:58:26.900 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T08:58:26.914 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T08:58:26.958 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T08:58:27.303 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T08:58:27.317 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:27.353 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:27.421 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-babel. 2024-04-25T08:58:27.436 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T08:58:27.470 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T08:58:27.706 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T08:58:27.721 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T08:58:27.756 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T08:58:27.757 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T08:58:27.771 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T08:58:27.806 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T08:58:28.076 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-routes. 2024-04-25T08:58:28.091 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T08:58:28.134 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T08:58:28.168 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T08:58:28.184 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:28.226 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:28.479 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T08:58:28.495 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:28.537 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:28.546 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T08:58:28.562 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T08:58:28.596 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T08:58:28.898 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-routes. 2024-04-25T08:58:28.915 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T08:58:28.924 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T08:58:28.939 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T08:58:28.975 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T08:58:28.982 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T08:58:29.294 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T08:58:29.310 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:29.352 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:29.494 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T08:58:29.509 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T08:58:29.553 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T08:58:29.763 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T08:58:29.779 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T08:58:29.821 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T08:58:29.881 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T08:58:29.896 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T08:58:30.017 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T08:58:30.320 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T08:58:30.336 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T08:58:30.341 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T08:58:30.357 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T08:58:30.378 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T08:58:30.400 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T08:58:30.762 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T08:58:30.778 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T08:58:30.897 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T08:58:31.038 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T08:58:31.046 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:31.088 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:31.208 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T08:58:31.224 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T08:58:31.258 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T08:58:31.917 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T08:58:31.932 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:31.967 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:32.041 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T08:58:32.056 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T08:58:32.099 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T08:58:32.394 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T08:58:32.408 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T08:58:32.444 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T08:58:32.764 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T08:58:32.779 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T08:58:32.822 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T08:58:32.845 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T08:58:32.861 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T08:58:32.903 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T08:58:33.126 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T08:58:33.141 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T08:58:33.184 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T08:58:33.206 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T08:58:33.222 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T08:58:33.281 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T08:58:33.530 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T08:58:33.543 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T08:58:33.588 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T08:58:33.826 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T08:58:33.843 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T08:58:33.885 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T08:58:33.908 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T08:58:33.922 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T08:58:33.966 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T08:58:34.179 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T08:58:34.195 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T08:58:34.237 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T08:58:34.270 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T08:58:34.283 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T08:58:34.328 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T08:58:34.558 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T08:58:34.574 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T08:58:34.608 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T08:58:34.648 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T08:58:34.661 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T08:58:34.706 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T08:58:34.902 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T08:58:34.918 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T08:58:34.960 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T08:58:35.255 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T08:58:35.271 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T08:58:35.313 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T08:58:35.429 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T08:58:35.441 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:35.478 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:35.642 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T08:58:35.658 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T08:58:35.699 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T08:58:35.831 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T08:58:35.844 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T08:58:35.882 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T08:58:36.193 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T08:58:36.206 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T08:58:36.235 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T08:58:36.364 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T08:58:36.378 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:36.430 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:36.521 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package jq. 2024-04-25T08:58:36.534 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T08:58:36.571 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T08:58:36.749 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T08:58:36.764 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T08:58:36.807 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T08:58:36.824 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package socat. 2024-04-25T08:58:36.838 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T08:58:36.890 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T08:58:37.121 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T08:58:37.137 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T08:58:37.179 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T08:58:37.211 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T08:58:37.224 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T08:58:37.268 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T08:58:37.424 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package jq. 2024-04-25T08:58:37.439 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T08:58:37.490 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T08:58:37.615 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-test. 2024-04-25T08:58:37.627 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:37.664 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:37.709 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package socat. 2024-04-25T08:58:37.725 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T08:58:37.767 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T08:58:38.063 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T08:58:38.077 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T08:58:38.121 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T08:58:38.466 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-test. 2024-04-25T08:58:38.481 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../099-ceph-test_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:38.550 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:39.786 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T08:58:39.800 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:39.844 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:40.222 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T08:58:40.235 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:40.281 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:40.429 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T08:58:40.445 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:40.479 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:40.593 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T08:58:40.607 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T08:58:40.651 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T08:58:40.808 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T08:58:40.823 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:40.858 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:40.912 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T08:58:40.926 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:40.995 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:41.177 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T08:58:41.193 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T08:58:41.223 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T08:58:41.235 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T08:58:41.235 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:41.264 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:41.492 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T08:58:41.503 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:41.505 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T08:58:41.520 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:41.534 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:41.563 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:41.841 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T08:58:41.853 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T08:58:41.856 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-1628-g97ae6cc9-1jammy_all.deb ... 2024-04-25T08:58:41.864 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T08:58:41.899 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:41.903 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T08:58:42.118 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T08:58:42.133 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:42.167 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:42.233 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T08:58:42.244 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T08:58:42.283 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T08:58:42.462 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T08:58:42.478 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T08:58:42.520 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T08:58:42.662 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T08:58:42.673 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T08:58:42.712 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T08:58:42.883 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T08:58:42.899 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T08:58:42.941 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T08:58:43.134 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package pkg-config. 2024-04-25T08:58:43.144 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T08:58:43.218 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T08:58:43.295 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T08:58:43.311 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T08:58:43.353 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T08:58:43.521 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T08:58:43.531 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T08:58:43.562 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T08:58:43.717 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package pkg-config. 2024-04-25T08:58:43.732 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T08:58:43.775 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T08:58:43.990 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T08:58:44.001 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T08:58:44.057 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T08:58:44.061 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T08:58:44.077 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T08:58:44.119 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T08:58:44.343 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T08:58:44.354 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T08:58:44.393 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T08:58:44.531 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T08:58:44.550 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T08:58:44.589 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T08:58:44.747 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T08:58:44.757 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T08:58:44.797 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T08:58:44.875 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T08:58:44.891 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T08:58:44.933 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T08:58:45.125 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T08:58:45.135 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T08:58:45.175 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T08:58:45.303 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T08:58:45.320 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T08:58:45.361 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T08:58:45.528 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-py. 2024-04-25T08:58:45.539 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T08:58:45.577 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T08:58:45.681 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T08:58:45.698 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T08:58:45.739 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T08:58:45.906 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T08:58:45.917 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T08:58:45.956 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T08:58:46.093 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-py. 2024-04-25T08:58:46.108 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T08:58:46.150 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T08:58:46.394 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T08:58:46.403 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T08:58:46.435 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T08:58:46.479 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T08:58:46.495 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T08:58:46.528 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T08:58:46.738 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-toml. 2024-04-25T08:58:46.748 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T08:58:46.788 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T08:58:46.924 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T08:58:46.940 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T08:58:46.974 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T08:58:47.116 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T08:58:47.127 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T08:58:47.166 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T08:58:47.302 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-toml. 2024-04-25T08:58:47.318 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T08:58:47.360 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T08:58:47.486 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T08:58:47.497 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T08:58:47.536 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T08:58:47.638 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T08:58:47.653 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T08:58:47.687 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T08:58:47.831 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T08:58:47.841 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T08:58:47.881 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T08:58:48.033 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T08:58:48.050 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T08:58:48.091 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T08:58:48.377 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T08:58:48.392 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T08:58:48.435 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T08:58:48.602 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package radosgw. 2024-04-25T08:58:48.611 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../122-radosgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:48.651 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:49.164 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package radosgw. 2024-04-25T08:58:49.179 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../122-radosgw_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:49.247 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:49.263 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T08:58:49.273 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:49.304 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:49.604 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T08:58:49.833 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T08:58:49.848 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-1628-g97ae6cc9-1jammy_amd64.deb ... 2024-04-25T08:58:49.877 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T08:58:49.883 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:49.986 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T08:58:50.154 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T08:58:50.221 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T08:58:50.463 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T08:58:50.606 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T08:58:50.649 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T08:58:50.878 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T08:58:51.275 INFO:teuthology.orchestra.run.smithi178.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T08:58:51.288 INFO:teuthology.orchestra.run.smithi178.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-25T08:58:51.294 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T08:58:51.354 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:51.913 INFO:teuthology.orchestra.run.smithi059.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T08:58:51.925 INFO:teuthology.orchestra.run.smithi178.stdout:Adding system user cephadm....done 2024-04-25T08:58:51.947 INFO:teuthology.orchestra.run.smithi059.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-25T08:58:51.991 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:52.112 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T08:58:52.493 INFO:teuthology.orchestra.run.smithi059.stdout:Adding system user cephadm....done 2024-04-25T08:58:52.647 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T08:58:52.750 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T08:58:52.940 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T08:58:53.024 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T08:58:53.150 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T08:58:53.216 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T08:58:53.367 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T08:58:53.409 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T08:58:53.668 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T08:58:53.702 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T08:58:53.828 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T08:58:53.928 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T08:58:54.062 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T08:58:54.130 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T08:58:54.381 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T08:58:54.566 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T08:58:54.783 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T08:58:54.842 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T08:58:55.067 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T08:58:55.135 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T08:58:55.351 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T08:58:55.420 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T08:58:55.619 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T08:58:55.721 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T08:58:55.863 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T08:58:55.981 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T08:58:56.239 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T08:58:56.249 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T08:58:56.532 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T08:58:56.542 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:56.809 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T08:58:56.841 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-ceph-argparse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:58:56.919 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T08:58:57.020 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T08:58:57.134 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T08:58:57.271 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T08:58:57.284 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T08:58:57.389 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T08:58:57.436 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T08:58:57.648 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T08:58:57.729 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T08:58:57.863 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T08:58:58.106 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T08:58:58.147 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T08:58:58.154 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T08:58:58.218 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T08:58:58.344 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T08:58:58.533 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T08:58:58.562 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T08:58:58.634 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T08:58:58.721 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T08:58:58.818 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T08:58:58.830 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T08:58:59.106 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T08:58:59.228 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T08:58:59.362 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T08:58:59.393 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T08:58:59.639 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T08:58:59.702 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T08:58:59.811 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T08:58:59.923 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T08:59:00.274 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T08:59:00.400 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T08:59:00.497 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T08:59:00.764 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T08:59:00.915 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T08:59:01.041 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T08:59:01.135 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T08:59:01.367 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T08:59:01.430 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T08:59:01.562 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T08:59:01.688 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T08:59:01.777 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T08:59:02.014 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T08:59:02.028 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T08:59:02.405 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T08:59:02.441 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T08:59:02.706 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T08:59:02.708 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T08:59:03.057 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T08:59:03.110 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T08:59:03.403 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T08:59:03.417 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T08:59:03.678 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T08:59:03.721 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T08:59:03.835 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:04.089 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T08:59:04.137 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T08:59:04.462 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T08:59:04.690 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T08:59:04.807 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:05.125 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T08:59:05.460 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T08:59:05.885 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T08:59:06.137 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:59:06.271 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T08:59:06.542 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T08:59:06.665 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T08:59:06.741 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T08:59:06.824 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T08:59:06.984 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:59:07.102 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T08:59:07.126 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T08:59:07.378 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T08:59:07.393 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T08:59:07.495 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T08:59:07.621 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T08:59:07.669 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:59:07.778 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T08:59:07.939 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T08:59:08.080 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T08:59:08.241 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T08:59:08.372 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T08:59:08.491 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:59:08.592 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T08:59:08.640 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T08:59:08.902 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T08:59:08.931 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T08:59:09.170 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T08:59:09.201 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T08:59:09.477 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T08:59:09.479 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T08:59:09.578 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T08:59:09.747 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T08:59:10.018 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T08:59:10.162 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T08:59:10.288 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T08:59:10.291 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T08:59:10.442 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T08:59:10.589 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T08:59:10.735 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T08:59:10.860 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T08:59:10.899 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T08:59:11.170 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T08:59:11.224 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T08:59:11.359 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T08:59:11.485 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T08:59:11.488 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T08:59:11.557 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T08:59:11.764 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T08:59:11.795 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T08:59:11.889 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T08:59:11.954 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T08:59:11.999 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T08:59:12.071 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T08:59:12.317 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T08:59:12.347 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T08:59:12.443 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T08:59:12.615 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T08:59:12.774 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T08:59:12.853 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T08:59:13.034 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:59:13.137 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T08:59:13.159 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T08:59:13.264 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T08:59:13.469 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T08:59:13.540 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T08:59:13.649 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T08:59:13.770 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T08:59:13.967 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T08:59:14.046 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T08:59:14.268 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T08:59:14.291 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T08:59:14.561 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T08:59:14.567 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T08:59:14.756 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T08:59:14.835 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T08:59:15.040 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T08:59:15.111 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T08:59:15.300 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T08:59:15.480 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T08:59:15.551 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T08:59:15.773 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T08:59:15.969 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T08:59:16.134 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T08:59:16.259 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:16.279 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T08:59:16.419 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:16.520 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T08:59:16.672 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T08:59:16.799 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librados2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:16.856 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:16.925 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:16.982 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:17.026 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T08:59:17.141 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T08:59:17.338 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libcephfs2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:17.443 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:17.472 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libradosstriper1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:17.561 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:17.598 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T08:59:17.670 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:17.872 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T08:59:17.872 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T08:59:17.891 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librbd1 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:17.992 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-modules-core (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:18.110 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:18.328 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T08:59:18.328 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T08:59:18.571 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:18.697 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:18.825 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:18.949 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:18.986 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libcephfs-dev (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:19.075 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T08:59:19.112 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rados (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:19.238 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up librgw2 (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:19.364 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up cephfs-top (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:19.498 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T08:59:20.354 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:20.479 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:20.606 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:20.731 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:20.827 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rbd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:20.882 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:20.986 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up rbd-fuse (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:21.000 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:21.121 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-rgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:21.246 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up python3-cephfs (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:21.372 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up cephfs-shell (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:21.499 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-common (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:21.545 INFO:teuthology.orchestra.run.smithi178.stdout:Adding group ceph....done 2024-04-25T08:59:21.837 INFO:teuthology.orchestra.run.smithi178.stdout:Adding system user ceph....done 2024-04-25T08:59:22.002 INFO:teuthology.orchestra.run.smithi059.stdout:Adding group ceph....done 2024-04-25T08:59:22.006 INFO:teuthology.orchestra.run.smithi178.stdout:Setting system user ceph properties....done 2024-04-25T08:59:22.022 INFO:teuthology.orchestra.run.smithi178.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T08:59:22.166 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T08:59:22.336 INFO:teuthology.orchestra.run.smithi059.stdout:Adding system user ceph....done 2024-04-25T08:59:22.506 INFO:teuthology.orchestra.run.smithi059.stdout:Setting system user ceph properties....done 2024-04-25T08:59:22.525 INFO:teuthology.orchestra.run.smithi059.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T08:59:22.572 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T08:59:22.676 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T08:59:23.079 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T08:59:23.276 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:23.483 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:59:23.483 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:59:23.766 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up cephfs-mirror (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:23.966 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:59:23.966 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T08:59:24.110 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:24.236 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:24.788 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:59:24.788 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:59:24.814 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-test (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:24.940 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up radosgw (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:25.405 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:25.483 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:59:25.483 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T08:59:25.766 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T08:59:26.084 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-base (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:26.440 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:26.455 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T08:59:26.663 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T08:59:26.663 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T08:59:27.119 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mds (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:27.283 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:27.373 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T08:59:27.373 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T08:59:27.534 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T08:59:27.534 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T08:59:27.998 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:28.160 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:28.216 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T08:59:28.216 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T08:59:28.451 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T08:59:28.451 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T08:59:28.999 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-osd (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:29.094 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:29.221 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:29.324 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T08:59:29.324 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T08:59:29.363 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:29.571 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T08:59:29.572 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T08:59:29.942 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:30.043 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:30.169 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mon (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:30.231 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:30.385 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T08:59:30.386 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T08:59:30.408 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:30.517 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:30.643 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:30.995 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T08:59:31.028 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-cephadm (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:31.121 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T08:59:31.171 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:31.273 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T08:59:31.305 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-mgr-dashboard (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:31.473 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ceph-volume (19.0.0-1628-g97ae6cc9-1jammy) ... 2024-04-25T08:59:31.842 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T08:59:31.934 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T08:59:32.078 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T08:59:32.357 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T08:59:33.079 INFO:teuthology.orchestra.run.smithi178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T08:59:33.083 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T08:59:33.157 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-04-25T08:59:33.254 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T08:59:33.332 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2024-04-25T08:59:33.333 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2024-04-25T08:59:33.502 INFO:teuthology.orchestra.run.smithi178.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T08:59:33.502 INFO:teuthology.orchestra.run.smithi178.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T08:59:33.502 INFO:teuthology.orchestra.run.smithi178.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T08:59:33.503 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T08:59:33.503 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T08:59:33.503 INFO:teuthology.orchestra.run.smithi178.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T08:59:33.503 INFO:teuthology.orchestra.run.smithi178.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T08:59:33.503 INFO:teuthology.orchestra.run.smithi178.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T08:59:33.504 INFO:teuthology.orchestra.run.smithi178.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T08:59:33.504 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T08:59:33.504 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2024-04-25T08:59:33.504 INFO:teuthology.orchestra.run.smithi178.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T08:59:33.504 INFO:teuthology.orchestra.run.smithi178.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T08:59:33.505 INFO:teuthology.orchestra.run.smithi178.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T08:59:33.505 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T08:59:33.505 INFO:teuthology.orchestra.run.smithi178.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T08:59:33.506 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2024-04-25T08:59:33.506 INFO:teuthology.orchestra.run.smithi178.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T08:59:33.506 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T08:59:33.506 INFO:teuthology.orchestra.run.smithi178.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T08:59:33.560 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2024-04-25T08:59:33.561 INFO:teuthology.orchestra.run.smithi178.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T08:59:33.561 INFO:teuthology.orchestra.run.smithi178.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T08:59:33.562 INFO:teuthology.orchestra.run.smithi178.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T08:59:33.562 INFO:teuthology.orchestra.run.smithi178.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T08:59:33.562 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T08:59:33.562 INFO:teuthology.orchestra.run.smithi178.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T08:59:33.562 INFO:teuthology.orchestra.run.smithi178.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T08:59:33.563 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages will be upgraded: 2024-04-25T08:59:33.564 INFO:teuthology.orchestra.run.smithi178.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T08:59:33.628 INFO:teuthology.orchestra.run.smithi178.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-25T08:59:33.628 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 55.7 MB of archives. 2024-04-25T08:59:33.628 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T08:59:33.628 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T08:59:33.808 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T08:59:33.815 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T08:59:33.857 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T08:59:33.858 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T08:59:33.858 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T08:59:33.867 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T08:59:33.868 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T08:59:33.869 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T08:59:33.870 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T08:59:33.871 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T08:59:33.872 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T08:59:33.879 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T08:59:33.894 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T08:59:33.894 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T08:59:33.895 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T08:59:33.964 INFO:teuthology.orchestra.run.smithi059.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T08:59:33.968 DEBUG:teuthology.orchestra.run.smithi059:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T08:59:34.045 INFO:teuthology.orchestra.run.smithi059.stdout:Reading package lists... 2024-04-25T08:59:34.168 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T08:59:34.170 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T08:59:34.170 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T08:59:34.173 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T08:59:34.173 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T08:59:34.178 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T08:59:34.179 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T08:59:34.187 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T08:59:34.187 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T08:59:34.209 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T08:59:34.209 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T08:59:34.221 INFO:teuthology.orchestra.run.smithi178.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T08:59:34.224 INFO:teuthology.orchestra.run.smithi059.stdout:Building dependency tree... 2024-04-25T08:59:34.225 INFO:teuthology.orchestra.run.smithi059.stdout:Reading state information... 2024-04-25T08:59:34.241 INFO:teuthology.orchestra.run.smithi178.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T08:59:34.245 INFO:teuthology.orchestra.run.smithi178.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T08:59:34.245 INFO:teuthology.orchestra.run.smithi178.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T08:59:34.246 INFO:teuthology.orchestra.run.smithi178.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T08:59:34.247 INFO:teuthology.orchestra.run.smithi178.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T08:59:34.259 INFO:teuthology.orchestra.run.smithi178.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T08:59:34.260 INFO:teuthology.orchestra.run.smithi178.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T08:59:34.403 INFO:teuthology.orchestra.run.smithi059.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T08:59:34.403 INFO:teuthology.orchestra.run.smithi059.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T08:59:34.403 INFO:teuthology.orchestra.run.smithi059.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T08:59:34.403 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T08:59:34.403 INFO:teuthology.orchestra.run.smithi059.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T08:59:34.403 INFO:teuthology.orchestra.run.smithi059.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T08:59:34.403 INFO:teuthology.orchestra.run.smithi059.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T08:59:34.403 INFO:teuthology.orchestra.run.smithi059.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T08:59:34.403 INFO:teuthology.orchestra.run.smithi059.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T08:59:34.404 INFO:teuthology.orchestra.run.smithi059.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T08:59:34.404 INFO:teuthology.orchestra.run.smithi059.stdout:The following additional packages will be installed: 2024-04-25T08:59:34.405 INFO:teuthology.orchestra.run.smithi059.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T08:59:34.405 INFO:teuthology.orchestra.run.smithi059.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T08:59:34.405 INFO:teuthology.orchestra.run.smithi059.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T08:59:34.405 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T08:59:34.405 INFO:teuthology.orchestra.run.smithi059.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T08:59:34.406 INFO:teuthology.orchestra.run.smithi059.stdout:Suggested packages: 2024-04-25T08:59:34.406 INFO:teuthology.orchestra.run.smithi059.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T08:59:34.406 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T08:59:34.406 INFO:teuthology.orchestra.run.smithi059.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T08:59:34.410 INFO:teuthology.orchestra.run.smithi178.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T08:59:34.410 INFO:teuthology.orchestra.run.smithi178.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T08:59:34.410 INFO:teuthology.orchestra.run.smithi178.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T08:59:34.411 INFO:teuthology.orchestra.run.smithi178.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T08:59:34.411 INFO:teuthology.orchestra.run.smithi178.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T08:59:34.411 INFO:teuthology.orchestra.run.smithi178.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T08:59:34.425 INFO:teuthology.orchestra.run.smithi178.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T08:59:34.425 INFO:teuthology.orchestra.run.smithi178.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T08:59:34.461 INFO:teuthology.orchestra.run.smithi059.stdout:The following NEW packages will be installed: 2024-04-25T08:59:34.462 INFO:teuthology.orchestra.run.smithi059.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T08:59:34.462 INFO:teuthology.orchestra.run.smithi059.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T08:59:34.463 INFO:teuthology.orchestra.run.smithi059.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T08:59:34.463 INFO:teuthology.orchestra.run.smithi059.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T08:59:34.463 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T08:59:34.463 INFO:teuthology.orchestra.run.smithi059.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T08:59:34.463 INFO:teuthology.orchestra.run.smithi059.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T08:59:34.465 INFO:teuthology.orchestra.run.smithi059.stdout:The following packages will be upgraded: 2024-04-25T08:59:34.465 INFO:teuthology.orchestra.run.smithi059.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T08:59:34.799 INFO:teuthology.orchestra.run.smithi178.stdout:Preconfiguring packages ... 2024-04-25T08:59:34.946 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 55.7 MB in 1s (65.3 MB/s) 2024-04-25T08:59:35.028 INFO:teuthology.orchestra.run.smithi059.stdout:4 upgraded, 39 newly installed, 0 to remove and 301 not upgraded. 2024-04-25T08:59:35.029 INFO:teuthology.orchestra.run.smithi059.stdout:Need to get 55.7 MB of archives. 2024-04-25T08:59:35.029 INFO:teuthology.orchestra.run.smithi059.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T08:59:35.029 INFO:teuthology.orchestra.run.smithi059.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T08:59:35.194 INFO:teuthology.orchestra.run.smithi059.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T08:59:35.198 INFO:teuthology.orchestra.run.smithi059.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T08:59:35.204 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T08:59:35.207 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T08:59:35.242 INFO:teuthology.orchestra.run.smithi059.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T08:59:35.242 INFO:teuthology.orchestra.run.smithi059.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T08:59:35.243 INFO:teuthology.orchestra.run.smithi059.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T08:59:35.251 INFO:teuthology.orchestra.run.smithi059.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T08:59:35.252 INFO:teuthology.orchestra.run.smithi059.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T08:59:35.254 INFO:teuthology.orchestra.run.smithi059.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T08:59:35.255 INFO:teuthology.orchestra.run.smithi059.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T08:59:35.255 INFO:teuthology.orchestra.run.smithi059.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T08:59:35.256 INFO:teuthology.orchestra.run.smithi059.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T08:59:35.266 INFO:teuthology.orchestra.run.smithi059.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T08:59:35.267 INFO:teuthology.orchestra.run.smithi059.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T08:59:35.287 INFO:teuthology.orchestra.run.smithi059.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T08:59:35.288 INFO:teuthology.orchestra.run.smithi059.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T08:59:35.464 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T08:59:35.551 INFO:teuthology.orchestra.run.smithi059.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T08:59:35.553 INFO:teuthology.orchestra.run.smithi059.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T08:59:35.553 INFO:teuthology.orchestra.run.smithi059.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T08:59:35.556 INFO:teuthology.orchestra.run.smithi059.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T08:59:35.556 INFO:teuthology.orchestra.run.smithi059.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T08:59:35.561 INFO:teuthology.orchestra.run.smithi059.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T08:59:35.563 INFO:teuthology.orchestra.run.smithi059.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T08:59:35.572 INFO:teuthology.orchestra.run.smithi059.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T08:59:35.572 INFO:teuthology.orchestra.run.smithi059.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T08:59:35.594 INFO:teuthology.orchestra.run.smithi059.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T08:59:35.597 INFO:teuthology.orchestra.run.smithi059.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T08:59:35.607 INFO:teuthology.orchestra.run.smithi059.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T08:59:35.631 INFO:teuthology.orchestra.run.smithi059.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T08:59:35.634 INFO:teuthology.orchestra.run.smithi059.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T08:59:35.635 INFO:teuthology.orchestra.run.smithi059.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T08:59:35.636 INFO:teuthology.orchestra.run.smithi059.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T08:59:35.636 INFO:teuthology.orchestra.run.smithi059.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T08:59:35.650 INFO:teuthology.orchestra.run.smithi059.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T08:59:35.652 INFO:teuthology.orchestra.run.smithi059.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T08:59:35.834 INFO:teuthology.orchestra.run.smithi059.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T08:59:35.835 INFO:teuthology.orchestra.run.smithi059.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T08:59:35.835 INFO:teuthology.orchestra.run.smithi059.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T08:59:35.835 INFO:teuthology.orchestra.run.smithi059.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T08:59:35.835 INFO:teuthology.orchestra.run.smithi059.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T08:59:35.835 INFO:teuthology.orchestra.run.smithi059.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T08:59:35.849 INFO:teuthology.orchestra.run.smithi059.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T08:59:35.849 INFO:teuthology.orchestra.run.smithi059.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T08:59:36.080 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T08:59:36.241 INFO:teuthology.orchestra.run.smithi059.stdout:Preconfiguring packages ... 2024-04-25T08:59:36.386 INFO:teuthology.orchestra.run.smithi059.stdout:Fetched 55.7 MB in 1s (40.5 MB/s) 2024-04-25T08:59:36.634 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T08:59:36.637 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T08:59:36.802 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T08:59:37.202 INFO:teuthology.orchestra.run.smithi178.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T08:59:37.367 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T08:59:37.477 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package flex. 2024-04-25T08:59:37.548 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T08:59:37.552 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T08:59:37.592 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T08:59:38.086 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T08:59:38.223 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T08:59:38.483 INFO:teuthology.orchestra.run.smithi059.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T08:59:38.629 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T08:59:38.747 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package flex. 2024-04-25T08:59:38.820 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140582 files and directories currently installed.) 2024-04-25T08:59:38.823 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T08:59:38.895 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T08:59:39.158 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T08:59:39.162 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T08:59:39.288 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T08:59:39.565 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T08:59:39.667 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T08:59:39.709 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T08:59:39.778 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T08:59:40.102 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T08:59:40.117 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T08:59:40.633 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T08:59:40.637 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T08:59:40.767 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T08:59:40.921 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package bison. 2024-04-25T08:59:40.996 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T08:59:41.000 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T08:59:41.048 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T08:59:41.171 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T08:59:41.315 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T08:59:41.424 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T08:59:41.438 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T08:59:41.499 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T08:59:41.631 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T08:59:41.810 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package dump. 2024-04-25T08:59:41.825 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T08:59:41.989 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package bison. 2024-04-25T08:59:42.060 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T08:59:42.070 INFO:teuthology.orchestra.run.smithi059.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140655 files and directories currently installed.) 2024-04-25T08:59:42.074 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T08:59:42.125 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T08:59:42.364 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package indent. 2024-04-25T08:59:42.380 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T08:59:42.422 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T08:59:42.534 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T08:59:42.550 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T08:59:42.592 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T08:59:42.667 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T08:59:42.682 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T08:59:42.725 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T08:59:42.862 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package dump. 2024-04-25T08:59:42.878 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T08:59:42.912 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T08:59:43.079 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T08:59:43.095 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T08:59:43.137 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T08:59:43.232 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package indent. 2024-04-25T08:59:43.249 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T08:59:43.291 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T08:59:43.398 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T08:59:43.414 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T08:59:43.456 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T08:59:43.543 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T08:59:43.559 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T08:59:43.593 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T08:59:43.818 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T08:59:43.833 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T08:59:43.876 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T08:59:43.913 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T08:59:43.929 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T08:59:43.972 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T08:59:44.104 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T08:59:44.119 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T08:59:44.154 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T08:59:44.233 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T08:59:44.249 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T08:59:44.294 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T08:59:44.440 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T08:59:44.455 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T08:59:44.498 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T08:59:44.611 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T08:59:44.627 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T08:59:44.661 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T08:59:44.768 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T08:59:44.783 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T08:59:44.818 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T08:59:44.880 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T08:59:44.896 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T08:59:44.938 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T08:59:45.233 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T08:59:45.249 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T08:59:45.291 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T08:59:45.619 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T08:59:45.635 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T08:59:45.677 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T08:59:46.263 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T08:59:46.279 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T08:59:46.321 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T08:59:46.582 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T08:59:46.598 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T08:59:46.666 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T08:59:46.922 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T08:59:46.938 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T08:59:46.971 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T08:59:46.985 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T08:59:47.001 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T08:59:47.043 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T08:59:47.233 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T08:59:47.249 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T08:59:47.291 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T08:59:47.388 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T08:59:47.404 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T08:59:47.446 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T08:59:47.610 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T08:59:47.627 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T08:59:47.668 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T08:59:47.766 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T08:59:47.782 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T08:59:47.824 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T08:59:47.988 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T08:59:48.004 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T08:59:48.038 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T08:59:48.210 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T08:59:48.226 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T08:59:48.268 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T08:59:48.316 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T08:59:48.332 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T08:59:48.374 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T08:59:48.572 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T08:59:48.587 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T08:59:48.630 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T08:59:48.718 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T08:59:48.735 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T08:59:48.793 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T08:59:48.949 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T08:59:48.965 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T08:59:49.007 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T08:59:49.121 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T08:59:49.138 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T08:59:49.179 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T08:59:49.260 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T08:59:49.276 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T08:59:49.335 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T08:59:49.441 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T08:59:49.457 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T08:59:49.499 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T08:59:49.743 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T08:59:49.759 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T08:59:49.826 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T08:59:49.838 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T08:59:49.854 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T08:59:49.896 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T08:59:50.224 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package modemmanager. 2024-04-25T08:59:50.239 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T08:59:50.288 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T08:59:50.303 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T08:59:50.323 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T08:59:50.337 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T08:59:50.716 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package modemmanager. 2024-04-25T08:59:50.732 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T08:59:50.774 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T08:59:50.941 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package network-manager. 2024-04-25T08:59:50.956 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T08:59:51.007 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T08:59:51.364 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package network-manager. 2024-04-25T08:59:51.380 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T08:59:51.423 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T08:59:51.717 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ppp. 2024-04-25T08:59:51.732 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T08:59:52.063 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package ppp. 2024-04-25T08:59:52.079 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T08:59:52.103 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T08:59:52.413 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T08:59:52.428 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T08:59:52.435 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T08:59:52.463 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T08:59:52.724 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T08:59:52.739 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T08:59:52.743 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T08:59:52.757 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T08:59:52.783 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T08:59:52.801 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T08:59:53.062 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T08:59:53.069 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T08:59:53.077 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T08:59:53.083 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T08:59:53.119 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T08:59:53.120 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T08:59:53.423 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T08:59:53.438 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T08:59:53.447 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T08:59:53.463 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T08:59:53.481 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T08:59:53.506 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T08:59:53.760 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T08:59:53.776 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T08:59:53.818 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T08:59:54.152 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T08:59:54.167 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T08:59:54.220 INFO:teuthology.orchestra.run.smithi178.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T08:59:54.250 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-common (238) ... 2024-04-25T08:59:54.439 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T08:59:54.455 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T08:59:54.517 INFO:teuthology.orchestra.run.smithi059.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T08:59:54.547 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql-common (238) ... 2024-04-25T08:59:54.742 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T08:59:54.757 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T08:59:54.803 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T08:59:55.013 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T08:59:55.029 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T08:59:55.099 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T08:59:55.912 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql. 2024-04-25T08:59:55.927 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T08:59:55.970 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql (14+238) ... 2024-04-25T08:59:56.115 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql. 2024-04-25T08:59:56.131 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T08:59:56.182 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql (14+238) ... 2024-04-25T08:59:56.239 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T08:59:56.254 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T08:59:56.297 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T08:59:56.426 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T08:59:56.441 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T08:59:56.501 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T08:59:56.524 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T08:59:56.539 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T08:59:56.583 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T08:59:56.745 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T08:59:56.761 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T08:59:56.803 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T08:59:56.868 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T08:59:56.883 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T08:59:56.918 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T08:59:57.122 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T08:59:57.138 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T08:59:57.212 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T08:59:57.221 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package tcl. 2024-04-25T08:59:57.236 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T08:59:57.284 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T08:59:57.474 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package tcl. 2024-04-25T08:59:57.491 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T08:59:57.537 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T08:59:57.615 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T08:59:57.631 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T08:59:57.700 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T08:59:57.869 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T08:59:57.885 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T08:59:57.927 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T08:59:58.086 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T08:59:58.102 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T08:59:58.144 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T08:59:58.290 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T08:59:58.306 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T08:59:58.347 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T08:59:58.539 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T08:59:58.555 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T08:59:58.597 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T08:59:58.667 INFO:teuthology.orchestra.run.smithi059.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T08:59:58.684 INFO:teuthology.orchestra.run.smithi059.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T08:59:58.726 INFO:teuthology.orchestra.run.smithi059.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T08:59:58.858 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T08:59:59.020 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T08:59:59.061 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T08:59:59.231 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T08:59:59.238 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T08:59:59.357 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T08:59:59.363 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T08:59:59.458 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T08:59:59.489 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T08:59:59.584 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T08:59:59.590 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T08:59:59.710 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T08:59:59.716 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T08:59:59.836 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:00:00.671 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T09:00:00.772 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T09:00:00.807 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T09:00:00.992 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T09:00:01.125 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T09:00:01.126 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T09:00:01.371 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T09:00:01.371 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T09:00:01.825 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T09:00:01.951 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T09:00:02.069 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T09:00:02.076 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:00:02.195 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T09:00:02.228 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T09:00:02.321 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T09:00:02.354 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T09:00:02.448 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T09:00:02.463 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T09:00:02.564 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T09:00:02.598 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T09:00:02.682 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T09:00:02.724 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T09:00:02.859 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T09:00:02.977 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T09:00:03.370 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T09:00:03.488 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T09:00:03.608 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T09:00:03.615 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T09:00:03.664 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:00:03.716 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T09:00:03.782 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T09:00:03.803 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T09:00:03.868 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:00:03.908 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T09:00:03.993 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T09:00:04.034 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T09:00:04.119 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T09:00:04.160 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T09:00:04.245 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T09:00:04.258 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T09:00:04.353 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T09:00:04.371 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T09:00:04.461 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T09:00:04.462 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T09:00:04.531 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T09:00:04.639 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T09:00:04.682 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T09:00:04.764 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:00:04.825 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T09:00:04.891 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T09:00:04.943 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:00:05.068 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T09:00:05.075 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T09:00:05.201 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T09:00:05.253 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T09:00:05.379 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T09:00:05.799 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:05.799 INFO:teuthology.orchestra.run.smithi178.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T09:00:05.799 INFO:teuthology.orchestra.run.smithi178.stdout:which means they are currently configured by ifupdown: 2024-04-25T09:00:05.799 INFO:teuthology.orchestra.run.smithi178.stdout:- enp3s0f1 2024-04-25T09:00:05.800 INFO:teuthology.orchestra.run.smithi178.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T09:00:05.800 INFO:teuthology.orchestra.run.smithi178.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T09:00:05.800 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:05.931 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T09:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T09:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout:which means they are currently configured by ifupdown: 2024-04-25T09:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout:- ens1f0 2024-04-25T09:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T09:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T09:00:06.261 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:06.341 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T09:00:06.410 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T09:00:06.828 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T09:00:06.834 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T09:00:07.256 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T09:00:07.545 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:00:07.688 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T09:00:07.814 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T09:00:07.940 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-common (238) ... 2024-04-25T09:00:07.965 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T09:00:08.117 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T09:00:08.226 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T09:00:08.335 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql-common (238) ... 2024-04-25T09:00:08.880 INFO:teuthology.orchestra.run.smithi178.stdout:Adding user postgres to group ssl-cert 2024-04-25T09:00:09.172 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:09.172 INFO:teuthology.orchestra.run.smithi178.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T09:00:09.245 INFO:teuthology.orchestra.run.smithi059.stdout:Adding user postgres to group ssl-cert 2024-04-25T09:00:09.428 INFO:teuthology.orchestra.run.smithi178.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T09:00:09.428 INFO:teuthology.orchestra.run.smithi178.stdout:Removing obsolete dictionary files: 2024-04-25T09:00:09.488 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:09.488 INFO:teuthology.orchestra.run.smithi059.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T09:00:09.748 INFO:teuthology.orchestra.run.smithi059.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T09:00:09.748 INFO:teuthology.orchestra.run.smithi059.stdout:Removing obsolete dictionary files: 2024-04-25T09:00:10.116 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T09:00:10.534 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T09:00:10.599 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:00:10.936 INFO:teuthology.orchestra.run.smithi178.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T09:00:10.957 INFO:teuthology.orchestra.run.smithi178.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T09:00:11.005 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T09:00:11.025 INFO:teuthology.orchestra.run.smithi178.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T09:00:11.025 INFO:teuthology.orchestra.run.smithi178.stdout:This user must also own the server process. 2024-04-25T09:00:11.025 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:11.025 INFO:teuthology.orchestra.run.smithi178.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T09:00:11.025 INFO:teuthology.orchestra.run.smithi178.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T09:00:11.025 INFO:teuthology.orchestra.run.smithi178.stdout:The default text search configuration will be set to "english". 2024-04-25T09:00:11.026 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:11.026 INFO:teuthology.orchestra.run.smithi178.stdout:Data page checksums are disabled. 2024-04-25T09:00:11.026 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:11.026 INFO:teuthology.orchestra.run.smithi178.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T09:00:11.026 INFO:teuthology.orchestra.run.smithi178.stdout:creating subdirectories ... ok 2024-04-25T09:00:11.026 INFO:teuthology.orchestra.run.smithi178.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T09:00:11.050 INFO:teuthology.orchestra.run.smithi178.stdout:selecting default max_connections ... 100 2024-04-25T09:00:11.084 INFO:teuthology.orchestra.run.smithi178.stdout:selecting default shared_buffers ... 128MB 2024-04-25T09:00:11.097 INFO:teuthology.orchestra.run.smithi178.stdout:selecting default time zone ... Etc/UTC 2024-04-25T09:00:11.098 INFO:teuthology.orchestra.run.smithi178.stdout:creating configuration files ... ok 2024-04-25T09:00:11.264 INFO:teuthology.orchestra.run.smithi178.stdout:running bootstrap script ... ok 2024-04-25T09:00:11.360 INFO:teuthology.orchestra.run.smithi059.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T09:00:11.404 INFO:teuthology.orchestra.run.smithi059.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T09:00:11.851 INFO:teuthology.orchestra.run.smithi059.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T09:00:11.851 INFO:teuthology.orchestra.run.smithi059.stdout:This user must also own the server process. 2024-04-25T09:00:11.851 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:11.851 INFO:teuthology.orchestra.run.smithi059.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T09:00:11.851 INFO:teuthology.orchestra.run.smithi059.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T09:00:11.852 INFO:teuthology.orchestra.run.smithi059.stdout:The default text search configuration will be set to "english". 2024-04-25T09:00:11.852 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:11.852 INFO:teuthology.orchestra.run.smithi059.stdout:Data page checksums are disabled. 2024-04-25T09:00:11.852 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:11.852 INFO:teuthology.orchestra.run.smithi059.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T09:00:11.852 INFO:teuthology.orchestra.run.smithi059.stdout:creating subdirectories ... ok 2024-04-25T09:00:11.853 INFO:teuthology.orchestra.run.smithi059.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T09:00:11.877 INFO:teuthology.orchestra.run.smithi059.stdout:selecting default max_connections ... 100 2024-04-25T09:00:11.884 INFO:teuthology.orchestra.run.smithi178.stdout:performing post-bootstrap initialization ... ok 2024-04-25T09:00:11.913 INFO:teuthology.orchestra.run.smithi059.stdout:selecting default shared_buffers ... 128MB 2024-04-25T09:00:11.928 INFO:teuthology.orchestra.run.smithi059.stdout:selecting default time zone ... Etc/UTC 2024-04-25T09:00:11.928 INFO:teuthology.orchestra.run.smithi059.stdout:creating configuration files ... ok 2024-04-25T09:00:12.103 INFO:teuthology.orchestra.run.smithi059.stdout:running bootstrap script ... ok 2024-04-25T09:00:12.427 INFO:teuthology.orchestra.run.smithi178.stdout:syncing data to disk ... ok 2024-04-25T09:00:12.911 INFO:teuthology.orchestra.run.smithi059.stdout:performing post-bootstrap initialization ... ok 2024-04-25T09:00:12.950 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T09:00:13.447 INFO:teuthology.orchestra.run.smithi059.stdout:syncing data to disk ... ok 2024-04-25T09:00:13.958 INFO:teuthology.orchestra.run.smithi059.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T09:00:16.340 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:00:16.466 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T09:00:16.592 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up postgresql (14+238) ... 2024-04-25T09:00:16.726 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:00:16.852 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:00:16.934 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:00:17.036 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T09:00:17.088 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T09:00:17.088 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T09:00:17.153 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up postgresql (14+238) ... 2024-04-25T09:00:17.279 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T09:00:17.405 INFO:teuthology.orchestra.run.smithi059.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T09:00:17.698 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T09:00:17.698 INFO:teuthology.orchestra.run.smithi059.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T09:00:17.839 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T09:00:17.930 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T09:00:18.265 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T09:00:18.408 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T09:00:18.465 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T09:00:18.583 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T09:00:18.901 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T09:00:19.036 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T09:00:19.762 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T09:00:19.861 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T09:00:20.137 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T09:00:20.220 INFO:teuthology.orchestra.run.smithi059.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T09:00:20.411 INFO:teuthology.orchestra.run.smithi178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T09:00:20.418 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:20.745 INFO:teuthology.orchestra.run.smithi059.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T09:00:20.751 DEBUG:teuthology.parallel:result is None 2024-04-25T09:00:20.751 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:00:20.933 DEBUG:teuthology.orchestra.run.smithi059:> dpkg-query -W -f '${Version}' ceph 2024-04-25T09:00:20.956 INFO:teuthology.orchestra.run.smithi059.stdout:19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:00:20.956 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:00:20.956 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628-g97ae6cc9-1jammy is installed. 2024-04-25T09:00:20.959 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec 2024-04-25T09:00:21.160 DEBUG:teuthology.orchestra.run.smithi178:> dpkg-query -W -f '${Version}' ceph 2024-04-25T09:00:21.183 INFO:teuthology.orchestra.run.smithi178.stdout:19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:00:21.183 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1628-g97ae6cc9-1jammy 2024-04-25T09:00:21.183 INFO:teuthology.task.install:The correct ceph version 19.0.0-1628-g97ae6cc9-1jammy is installed. 2024-04-25T09:00:21.185 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T09:00:21.185 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:21.186 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T09:00:21.206 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:21.206 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T09:00:21.246 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T09:00:21.247 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:21.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T09:00:21.267 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T09:00:21.331 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:21.331 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T09:00:21.351 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T09:00:21.413 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T09:00:21.413 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:21.414 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T09:00:21.433 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T09:00:21.495 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:21.495 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T09:00:21.515 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T09:00:21.577 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T09:00:21.577 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:21.578 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T09:00:21.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T09:00:21.659 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:21.660 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T09:00:21.680 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T09:00:21.747 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T09:00:21.835 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T09:00:21.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2024-04-25T09:00:21.839 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /var/log/ceph 2024-04-25T09:00:21.859 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T09:00:21.859 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T09:00:21.899 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T09:00:21.926 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T09:00:21.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T09:00:21.959 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T09:00:21.994 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T09:00:21.994 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T09:00:21.994 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T09:00:21.994 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:21.995 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T09:00:22.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T09:00:22.120 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:22.120 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T09:00:22.129 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T09:00:22.228 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T09:00:22.228 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T09:00:22.228 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999', 'branch': 'wip-neesingh-testing-240416', 'description': 'fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/forward-scrub}', 'email': 'neesingh@redhat.com', 'first_in_suite': False, 'job_id': '7672999', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-neesingh-testing-240416'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-62537', 'sha1': '5787d42d10024ba410e822a8aba474331cb9af02'}}, 'owner': 'scheduled_neesingh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5869, 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'sleep_before_teardown': 0, 'suite': 'fs:functional', 'suite_branch': 'wip-62537', 'suite_path': '/home/teuthworker/src/github.com_neesingh-rh_ceph_5787d42d10024ba410e822a8aba474331cb9af02/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/neesingh-rh/ceph', 'suite_sha1': '5787d42d10024ba410e822a8aba474331cb9af02', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ18lgoUTLcL2STvs7Ne/uCk/yaGEwQi63rqBbaz0Q5+CnxjK5uGU1z4KXTMnvUttKVZ3kRsPmUA3NJhNhs657E=', 'smithi178.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDTPTfVkn2rOPbBJ3PM0t7TzCvujRObL9+qv3EMh1EJA26H6jfS1Su1Iy9PDmP5YUrj5SR5ArdunTT5En3iU9T4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': '97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_08:15:18', 'tube': 'smithi', 'user': 'neesingh', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T09:00:22.229 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T09:00:22.232 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T09:00:22.241 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T09:00:22.283 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T09:00:22.306 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:22.306 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T09:00:22.348 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T09:00:22.349 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2024-04-25T09:00:22.401 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T09:00:22.401 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:00:22.401 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 898 Links: 1 2024-04-25T09:00:22.401 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:00:22.401 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-04-25 08:54:04.593675673 +0000 2024-04-25T09:00:22.401 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-25 08:54:04.305678242 +0000 2024-04-25T09:00:22.401 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-25 08:54:04.305678242 +0000 2024-04-25T09:00:22.401 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-04-25 08:54:04.305678242 +0000 2024-04-25T09:00:22.402 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T09:00:22.463 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-04-25T09:00:22.463 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-04-25T09:00:22.463 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000651056 s, 786 kB/s 2024-04-25T09:00:22.465 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T09:00:22.518 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2024-04-25T09:00:22.569 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T09:00:22.569 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:00:22.569 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 913 Links: 1 2024-04-25T09:00:22.569 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:00:22.569 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-04-25 08:54:05.201670249 +0000 2024-04-25T09:00:22.569 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-25 08:54:04.921672747 +0000 2024-04-25T09:00:22.569 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-25 08:54:04.921672747 +0000 2024-04-25T09:00:22.569 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-04-25 08:54:04.921672747 +0000 2024-04-25T09:00:22.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T09:00:22.631 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-04-25T09:00:22.631 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-04-25T09:00:22.631 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000634751 s, 807 kB/s 2024-04-25T09:00:22.633 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T09:00:22.687 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2024-04-25T09:00:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T09:00:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:00:22.737 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 931 Links: 1 2024-04-25T09:00:22.737 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:00:22.737 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-04-25 08:54:05.797664932 +0000 2024-04-25T09:00:22.737 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-25 08:54:05.513667466 +0000 2024-04-25T09:00:22.737 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-25 08:54:05.513667466 +0000 2024-04-25T09:00:22.737 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-04-25 08:54:05.513667466 +0000 2024-04-25T09:00:22.738 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T09:00:22.799 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-04-25T09:00:22.799 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-04-25T09:00:22.799 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000362046 s, 1.4 MB/s 2024-04-25T09:00:22.801 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T09:00:22.855 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2024-04-25T09:00:22.905 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T09:00:22.905 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:00:22.905 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 948 Links: 1 2024-04-25T09:00:22.906 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:00:22.906 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2024-04-25 08:54:06.337660114 +0000 2024-04-25T09:00:22.906 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2024-04-25 08:54:06.081662399 +0000 2024-04-25T09:00:22.906 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2024-04-25 08:54:06.081662399 +0000 2024-04-25T09:00:22.906 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: 2024-04-25 08:54:06.081662399 +0000 2024-04-25T09:00:22.906 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T09:00:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2024-04-25T09:00:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2024-04-25T09:00:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000381818 s, 1.3 MB/s 2024-04-25T09:00:22.970 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T09:00:23.024 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:00:23.024 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:23.024 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T09:00:23.034 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T09:00:23.034 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2024-04-25T09:00:23.082 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T09:00:23.083 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:00:23.083 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 885 Links: 1 2024-04-25T09:00:23.083 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:00:23.083 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-04-25 08:53:59.950487350 +0000 2024-04-25T09:00:23.083 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-04-25 08:53:59.694489638 +0000 2024-04-25T09:00:23.083 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-04-25 08:53:59.694489638 +0000 2024-04-25T09:00:23.083 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-04-25 08:53:59.694489638 +0000 2024-04-25T09:00:23.083 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T09:00:23.148 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-04-25T09:00:23.148 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-04-25T09:00:23.149 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.0002721 s, 1.9 MB/s 2024-04-25T09:00:23.150 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T09:00:23.205 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2024-04-25T09:00:23.255 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T09:00:23.255 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:00:23.255 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 902 Links: 1 2024-04-25T09:00:23.255 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:00:23.255 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-04-25 08:54:00.506482385 +0000 2024-04-25T09:00:23.255 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-04-25 08:54:00.262484564 +0000 2024-04-25T09:00:23.255 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-04-25 08:54:00.262484564 +0000 2024-04-25T09:00:23.255 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-04-25 08:54:00.262484564 +0000 2024-04-25T09:00:23.255 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T09:00:23.316 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-04-25T09:00:23.316 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-04-25T09:00:23.316 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000274163 s, 1.9 MB/s 2024-04-25T09:00:23.318 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T09:00:23.373 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2024-04-25T09:00:23.423 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T09:00:23.423 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:00:23.423 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 920 Links: 1 2024-04-25T09:00:23.423 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:00:23.423 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-04-25 08:54:01.046477562 +0000 2024-04-25T09:00:23.423 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-04-25 08:54:00.778479954 +0000 2024-04-25T09:00:23.423 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-04-25 08:54:00.778479954 +0000 2024-04-25T09:00:23.423 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-04-25 08:54:00.778479954 +0000 2024-04-25T09:00:23.424 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T09:00:23.484 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-04-25T09:00:23.485 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-04-25T09:00:23.485 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.00028161 s, 1.8 MB/s 2024-04-25T09:00:23.487 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T09:00:23.545 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2024-04-25T09:00:23.599 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T09:00:23.599 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T09:00:23.599 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 6h/6d Inode: 937 Links: 1 2024-04-25T09:00:23.599 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T09:00:23.599 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-04-25 08:54:01.586472738 +0000 2024-04-25T09:00:23.599 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-04-25 08:54:01.302475274 +0000 2024-04-25T09:00:23.599 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-04-25 08:54:01.302475274 +0000 2024-04-25T09:00:23.599 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: 2024-04-25 08:54:01.302475274 +0000 2024-04-25T09:00:23.600 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T09:00:23.661 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-04-25T09:00:23.661 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-04-25T09:00:23.661 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000272158 s, 1.9 MB/s 2024-04-25T09:00:23.663 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T09:00:23.716 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:00:23.716 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T09:00:23.717 INFO:tasks.ceph:Generating config... 2024-04-25T09:00:23.718 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T09:00:23.718 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T09:00:23.718 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T09:00:23.718 INFO:tasks.ceph:[client] pid file = 2024-04-25T09:00:23.718 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T09:00:23.718 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T09:00:23.718 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T09:00:23.719 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T09:00:23.720 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T09:00:23.720 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T09:00:23.721 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T09:00:23.768 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T09:00:23.782 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T09:00:23.875 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:00:23.896 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.59'), ('mon.b', '172.21.15.178'), ('mon.c', '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]')] 2024-04-25T09:00:23.896 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.59,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T09:00:23.897 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:23.897 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T09:00:23.944 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.59 --add b 172.21.15.178 --addv c '[v2:172.21.15.178:3301,v1:172.21.15.178:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:24.037 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:24.037 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: generated fsid fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:00:24.037 INFO:teuthology.orchestra.run.smithi059.stdout:setting min_mon_release = quincy 2024-04-25T09:00:24.037 INFO:teuthology.orchestra.run.smithi059.stdout:epoch 0 2024-04-25T09:00:24.037 INFO:teuthology.orchestra.run.smithi059.stdout:fsid fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:00:24.038 INFO:teuthology.orchestra.run.smithi059.stdout:last_changed 2024-04-25T09:00:24.049410+0000 2024-04-25T09:00:24.038 INFO:teuthology.orchestra.run.smithi059.stdout:created 2024-04-25T09:00:24.049410+0000 2024-04-25T09:00:24.038 INFO:teuthology.orchestra.run.smithi059.stdout:min_mon_release 17 (quincy) 2024-04-25T09:00:24.038 INFO:teuthology.orchestra.run.smithi059.stdout:election_strategy: 1 2024-04-25T09:00:24.038 INFO:teuthology.orchestra.run.smithi059.stdout:0: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.a 2024-04-25T09:00:24.038 INFO:teuthology.orchestra.run.smithi059.stdout:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-04-25T09:00:24.038 INFO:teuthology.orchestra.run.smithi059.stdout:2: [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] mon.c 2024-04-25T09:00:24.038 INFO:teuthology.orchestra.run.smithi059.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T09:00:24.040 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T09:00:24.049 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fbbb9dc0-22e4-4685-972c-77e9262d4773... 2024-04-25T09:00:24.050 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:00:24.095 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:00:24.136 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-04-25T09:00:24.136 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2024-04-25T09:00:24.136 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:00:24.136 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2024-04-25T09:00:24.136 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.136 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2024-04-25T09:00:24.136 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.136 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2024-04-25T09:00:24.136 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.136 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2024-04-25T09:00:24.136 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2024-04-25T09:00:24.137 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2024-04-25T09:00:24.138 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.139 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2024-04-25T09:00:24.139 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.139 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2024-04-25T09:00:24.139 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2024-04-25T09:00:24.139 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2024-04-25T09:00:24.139 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-04-25T09:00:24.139 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on skipped message = False 2024-04-25T09:00:24.139 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:00:24.139 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.139 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2024-04-25T09:00:24.139 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2024-04-25T09:00:24.139 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug trim objects = true 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2024-04-25T09:00:24.140 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2024-04-25T09:00:24.141 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2024-04-25T09:00:24.142 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2024-04-25T09:00:24.143 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:00:24.144 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = "" 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2024-04-25T09:00:24.145 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds balancer = 20 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2024-04-25T09:00:24.146 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-04-25T09:00:24.147 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-04-25T09:00:24.147 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-04-25T09:00:24.147 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2024-04-25T09:00:24.147 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2024-04-25T09:00:24.147 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:00:24.147 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2024-04-25T09:00:24.147 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.148 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:00:24.149 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:00:24.149 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.149 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2024-04-25T09:00:24.149 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.149 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2024-04-25T09:00:24.149 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2024-04-25T09:00:24.149 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:00:24.149 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:00:24.149 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2024-04-25T09:00:24.149 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:00:24.149 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2024-04-25T09:00:24.149 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:00:24.150 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:00:24.150 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2024-04-25T09:00:24.150 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.150 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:00:24.150 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.150 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2024-04-25T09:00:24.150 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.150 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2024-04-25T09:00:24.150 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.150 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2024-04-25T09:00:24.150 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2024-04-25T09:00:24.151 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2024-04-25T09:00:24.151 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.59,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-04-25T09:00:24.151 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2024-04-25T09:00:24.151 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:00:24.151 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.151 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2024-04-25T09:00:24.151 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2024-04-25T09:00:24.151 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.151 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2024-04-25T09:00:24.151 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2024-04-25T09:00:24.151 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:00:24.151 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.152 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2024-04-25T09:00:24.152 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2024-04-25T09:00:24.152 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.152 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2024-04-25T09:00:24.152 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2024-04-25T09:00:24.152 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2024-04-25T09:00:24.152 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug trim objects = true 2024-04-25T09:00:24.152 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.152 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2024-04-25T09:00:24.152 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2024-04-25T09:00:24.153 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2024-04-25T09:00:24.154 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2024-04-25T09:00:24.154 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 20 2024-04-25T09:00:24.154 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 20 2024-04-25T09:00:24.154 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:00:24.154 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2024-04-25T09:00:24.154 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 10 2024-04-25T09:00:24.154 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:00:24.154 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2024-04-25T09:00:24.154 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:00:24.154 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:00:24.154 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2024-04-25T09:00:24.154 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2024-04-25T09:00:24.155 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-04-25T09:00:24.156 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2024-04-25T09:00:24.156 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2024-04-25T09:00:24.156 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:00:24.156 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2024-04-25T09:00:24.156 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2024-04-25T09:00:24.156 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:00:24.156 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.156 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:00:24.156 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:00:24.156 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:00:24.156 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.156 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2024-04-25T09:00:24.157 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2024-04-25T09:00:24.158 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:00:24.158 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:00:24.158 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2024-04-25T09:00:24.158 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2024-04-25T09:00:24.158 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:00:24.158 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2024-04-25T09:00:24.158 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-04-25T09:00:24.158 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-04-25T09:00:24.158 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2024-04-25T09:00:24.158 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2024-04-25T09:00:24.158 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2024-04-25T09:00:24.158 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds balancer = 20 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = True 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = True 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-04-25T09:00:24.159 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-04-25T09:00:24.161 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T09:00:24.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T09:00:24.266 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T09:00:24.266 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:24.266 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T09:00:24.275 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:24.275 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T09:00:24.328 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:00:24.328 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:24.329 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T09:00:24.329 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:00:24.404 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:24.405 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:24.456 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T09:00:24.457 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:24.457 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T09:00:24.457 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T09:00:24.492 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:24.492 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:24.546 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T09:00:24.546 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T09:00:24.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T09:00:24.603 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T09:00:24.608 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T09:00:24.669 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T09:00:24.687 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T09:00:24.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T09:00:24.743 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T09:00:24.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T09:00:24.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T09:00:24.862 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T09:00:24.867 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T09:00:24.887 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T09:00:24.946 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T09:00:24.951 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T09:00:24.972 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T09:00:25.068 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T09:00:25.073 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T09:00:25.092 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T09:00:25.093 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T09:00:25.135 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T09:00:25.152 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-25T09:00:25.239 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-25T09:00:25.256 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T09:00:25.298 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T09:00:25.314 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-25T09:00:25.398 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-25T09:00:25.415 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T09:00:25.415 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T09:00:25.415 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T09:00:25.435 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:00:25.435 INFO:tasks.ceph:role: osd.0 2024-04-25T09:00:25.435 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:00:25.435 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T09:00:25.503 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:00:25.503 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:00:25.503 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:00:25.503 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:00:25.503 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:00:25.504 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:00:25.504 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:00:25.504 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:00:25.504 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:00:25.504 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:00:25.900 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-04-25T09:00:25.903 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-04-25T09:00:25.903 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T09:00:26.011 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T09:00:26.028 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:00:26.029 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:00:26.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T09:00:26.096 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:00:26.096 INFO:tasks.ceph:role: osd.1 2024-04-25T09:00:26.096 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:00:26.096 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T09:00:26.164 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:00:26.164 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:00:26.164 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:00:26.164 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:00:26.164 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:00:26.164 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:00:26.164 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:00:26.164 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:00:26.164 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:00:26.164 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:00:26.563 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-04-25T09:00:26.565 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-04-25T09:00:26.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T09:00:26.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T09:00:26.715 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:00:26.716 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:00:26.717 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T09:00:26.781 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:00:26.781 INFO:tasks.ceph:role: osd.2 2024-04-25T09:00:26.781 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:00:26.781 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T09:00:26.856 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:00:26.856 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:00:26.857 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:00:26.857 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:00:26.857 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:00:26.857 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:00:26.857 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:00:26.857 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:00:26.857 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:00:26.857 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:00:27.269 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-04-25T09:00:27.272 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-04-25T09:00:27.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T09:00:27.403 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T09:00:27.421 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:00:27.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:00:27.422 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T09:00:27.489 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T09:00:27.489 INFO:tasks.ceph:role: osd.3 2024-04-25T09:00:27.489 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:00:27.489 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T09:00:27.565 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:00:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:00:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:00:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:00:27.565 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:00:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:00:27.565 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:00:27.565 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:00:27.565 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:00:27.565 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:00:27.929 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2024-04-25T09:00:27.933 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2024-04-25T09:00:27.933 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T09:00:28.014 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T09:00:28.073 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:00:28.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:00:28.074 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:28.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:28.213+0000 7f69250957c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T09:00:28.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:28.217+0000 7f69250957c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T09:00:28.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:28.217+0000 7f69250957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T09:00:28.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:28.217+0000 7f69250957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T09:00:28.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:28.217+0000 7f69250957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T09:00:28.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:28.221+0000 7f69250957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T09:00:31.260 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T09:00:31.282 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:31.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:31.385+0000 7f79f693a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T09:00:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:31.385+0000 7f79f693a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T09:00:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:31.385+0000 7f79f693a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T09:00:31.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:31.385+0000 7f79f693a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T09:00:31.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:31.385+0000 7f79f693a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T09:00:31.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:31.389+0000 7f79f693a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T09:00:34.440 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T09:00:34.463 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:34.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:34.565+0000 7f74874447c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T09:00:34.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:34.565+0000 7f74874447c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T09:00:34.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:34.565+0000 7f74874447c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T09:00:34.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:34.569+0000 7f74874447c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T09:00:34.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:34.569+0000 7f74874447c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T09:00:34.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:34.569+0000 7f74874447c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T09:00:37.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T09:00:37.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:37.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:37.749+0000 7efc297017c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T09:00:37.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:37.749+0000 7efc297017c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T09:00:37.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:37.749+0000 7efc297017c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T09:00:37.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:37.749+0000 7efc297017c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T09:00:37.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:37.749+0000 7efc297017c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T09:00:37.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:37.749+0000 7efc297017c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T09:00:40.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T09:00:40.807 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T09:00:40.829 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:00:40.829 INFO:tasks.ceph:role: osd.4 2024-04-25T09:00:40.829 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T09:00:40.829 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T09:00:40.891 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:00:40.891 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:00:40.891 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:00:40.891 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:00:40.892 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:00:40.892 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:00:40.892 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:00:40.892 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:00:40.892 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:00:40.892 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:00:40.915 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-04-25T09:00:40.918 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-04-25T09:00:40.918 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T09:00:40.986 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T09:00:41.045 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:00:41.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:00:41.046 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T09:00:41.109 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:00:41.109 INFO:tasks.ceph:role: osd.5 2024-04-25T09:00:41.109 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T09:00:41.109 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T09:00:41.172 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:00:41.173 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:00:41.173 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:00:41.173 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:00:41.173 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:00:41.173 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:00:41.173 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:00:41.173 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:00:41.173 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:00:41.174 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:00:41.197 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-04-25T09:00:41.200 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-04-25T09:00:41.200 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T09:00:41.270 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T09:00:41.329 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:00:41.330 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:00:41.330 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T09:00:41.394 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:00:41.394 INFO:tasks.ceph:role: osd.6 2024-04-25T09:00:41.394 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T09:00:41.394 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T09:00:41.460 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:00:41.460 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:00:41.461 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:00:41.461 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:00:41.461 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:00:41.461 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:00:41.461 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:00:41.461 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:00:41.461 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:00:41.461 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:00:41.488 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-04-25T09:00:41.491 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-04-25T09:00:41.491 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T09:00:41.558 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T09:00:41.617 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:00:41.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:00:41.618 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T09:00:41.681 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T09:00:41.682 INFO:tasks.ceph:role: osd.7 2024-04-25T09:00:41.682 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T09:00:41.682 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T09:00:41.744 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T09:00:41.744 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T09:00:41.744 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T09:00:41.744 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T09:00:41.744 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T09:00:41.745 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-04-25T09:00:41.745 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T09:00:41.745 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T09:00:41.745 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T09:00:41.745 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T09:00:41.768 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-04-25T09:00:41.771 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-04-25T09:00:41.771 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T09:00:41.841 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T09:00:41.901 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T09:00:41.902 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:00:41.902 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:42.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:42.037+0000 7fdbeda2c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T09:00:42.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:42.037+0000 7fdbeda2c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T09:00:42.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:42.037+0000 7fdbeda2c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T09:00:42.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:42.037+0000 7fdbeda2c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T09:00:42.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:42.037+0000 7fdbeda2c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T09:00:42.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:42.037+0000 7fdbeda2c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T09:00:45.076 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T09:00:45.097 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:45.194 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:45.201+0000 7f872e8857c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T09:00:45.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:45.201+0000 7f872e8857c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T09:00:45.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:45.201+0000 7f872e8857c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T09:00:45.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:45.201+0000 7f872e8857c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T09:00:45.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:45.201+0000 7f872e8857c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T09:00:45.195 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:45.205+0000 7f872e8857c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T09:00:48.232 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T09:00:48.252 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:48.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:48.357+0000 7fbb07c227c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T09:00:48.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:48.357+0000 7fbb07c227c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T09:00:48.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:48.357+0000 7fbb07c227c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T09:00:48.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:48.357+0000 7fbb07c227c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T09:00:48.348 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:48.357+0000 7fbb07c227c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T09:00:48.349 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:48.357+0000 7fbb07c227c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T09:00:51.368 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T09:00:51.388 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:51.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:51.493+0000 7fed6f13c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T09:00:51.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:51.493+0000 7fed6f13c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T09:00:51.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:51.493+0000 7fed6f13c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T09:00:51.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:51.493+0000 7fed6f13c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T09:00:51.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:51.493+0000 7fed6f13c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T09:00:51.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:00:51.497+0000 7fed6f13c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T09:00:52.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:00:52.234 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:00:54.547 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T09:00:54.567 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T09:00:54.568 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:54.568 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T09:00:54.590 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:54.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T09:00:54.653 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:54.653 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T09:00:54.717 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:54.717 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T09:00:54.781 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:54.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T09:00:54.846 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:54.846 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T09:00:54.909 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:54.909 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T09:00:54.973 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:54.973 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T09:00:54.995 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:54.995 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T09:00:55.058 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:55.058 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T09:00:55.123 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:55.123 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T09:00:55.185 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:55.186 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T09:00:55.249 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:55.249 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T09:00:55.310 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:55.310 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T09:00:55.373 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:55.374 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T09:00:55.383 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:00:55.383 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-25T09:00:55.433 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:55.433 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T09:00:55.442 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:00:55.442 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-25T09:00:55.493 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T09:00:55.494 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T09:00:55.497 DEBUG:teuthology.orchestra.run.smithi178:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T09:00:55.541 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.y] 2024-04-25T09:00:55.541 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCoGypmX2GpJBAA8RvpxNpdPFExISwQzT56fA== 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCoGypmefAMLRAAyOhrYPGN2IYchV7wMDkkTQ== 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCoGypmF3skNBAAcKEUsLnvjEY8fz59SnjWtg== 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCsGypmmikBDRAAcxA0eWyo/w0bALsf4Fb3KQ== 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCvGypm66dNFxAAzl06IBbHoxHorB3FuCFNOQ== 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCyGypmQrwdIhAAyF53f8p7/vnJ6L4ZjXcKhQ== 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQC1GypmtETmLBAAM4p1FOPAiB0aOcdfIcl6vg== 2024-04-25T09:00:55.542 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCoGypmwOe7KBAAIvO6OJiUeb5hRdu9VX11cA== 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCoGypmcZtGORAA9RU5OkQHTCXe5nkpEp77Fw== 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpGypm95/1BBAAsIbA6GBVS4dl7sZ8CoZoLA== 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.4] 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQC6GypmyXGCAhAAKJ2Yh0lezpRfFMPXjN4Asg== 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.5] 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQC9GypmmfZZDBAAzw9IygUbRErERr2lXEfutA== 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.6] 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDAGypmS4KRFRAAXrvA1QNbuWF6+ln+cz6orQ== 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.7] 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQDDGypmruPJHRAAWFONkZiSsYgvsr04uO9J9A== 2024-04-25T09:00:55.543 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-04-25T09:00:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg== 2024-04-25T09:00:55.544 INFO:teuthology.orchestra.run.smithi059.stdout:[client.2] 2024-04-25T09:00:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpGypmdosADxAAxmQqp2O5lT5XenyqxyyMKw== 2024-04-25T09:00:55.544 INFO:teuthology.orchestra.run.smithi059.stdout:[client.1] 2024-04-25T09:00:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpGypm8NCkEhAAEELIQ7EAUFHsANHAa5EnTA== 2024-04-25T09:00:55.544 INFO:teuthology.orchestra.run.smithi059.stdout:[client.3] 2024-04-25T09:00:55.544 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpGypmsqWgGBAAIXaSazGZkKiY2hqcC+WApA== 2024-04-25T09:00:55.556 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.y] 2024-04-25T09:00:55.556 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCoGypmX2GpJBAA8RvpxNpdPFExISwQzT56fA== 2024-04-25T09:00:55.556 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2024-04-25T09:00:55.556 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCoGypmefAMLRAAyOhrYPGN2IYchV7wMDkkTQ== 2024-04-25T09:00:55.556 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2024-04-25T09:00:55.556 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCoGypmF3skNBAAcKEUsLnvjEY8fz59SnjWtg== 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.0] 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCsGypmmikBDRAAcxA0eWyo/w0bALsf4Fb3KQ== 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.1] 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCvGypm66dNFxAAzl06IBbHoxHorB3FuCFNOQ== 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.2] 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCyGypmQrwdIhAAyF53f8p7/vnJ6L4ZjXcKhQ== 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.3] 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQC1GypmtETmLBAAM4p1FOPAiB0aOcdfIcl6vg== 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.x] 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCoGypmwOe7KBAAIvO6OJiUeb5hRdu9VX11cA== 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCoGypmcZtGORAA9RU5OkQHTCXe5nkpEp77Fw== 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCpGypm95/1BBAAsIbA6GBVS4dl7sZ8CoZoLA== 2024-04-25T09:00:55.557 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.4] 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQC6GypmyXGCAhAAKJ2Yh0lezpRfFMPXjN4Asg== 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.5] 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQC9GypmmfZZDBAAzw9IygUbRErERr2lXEfutA== 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.6] 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQDAGypmS4KRFRAAXrvA1QNbuWF6+ln+cz6orQ== 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.7] 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQDDGypmruPJHRAAWFONkZiSsYgvsr04uO9J9A== 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout:[client.0] 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg== 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout:[client.2] 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCpGypmdosADxAAxmQqp2O5lT5XenyqxyyMKw== 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout:[client.1] 2024-04-25T09:00:55.558 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCpGypm8NCkEhAAEELIQ7EAUFHsANHAa5EnTA== 2024-04-25T09:00:55.559 INFO:teuthology.orchestra.run.smithi178.stdout:[client.3] 2024-04-25T09:00:55.559 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCpGypmsqWgGBAAIXaSazGZkKiY2hqcC+WApA== 2024-04-25T09:00:55.560 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:00:55.596 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:00:55.658 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:00:55.661 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:00:55.719 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:00:55.723 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:00:55.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:55.783 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:55.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:55.843 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:55.895 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:55.898 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:55.951 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:55.954 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:56.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:00:56.011 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T09:00:56.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:00:56.068 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:00:56.124 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:00:56.128 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T09:00:56.185 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:56.189 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:56.242 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:56.245 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:56.301 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:56.304 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:56.356 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:56.360 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T09:00:56.413 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:00:56.416 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:00:56.472 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:00:56.476 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:00:56.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:00:56.536 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:00:56.592 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:00:56.596 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T09:00:56.652 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T09:00:56.652 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T09:00:56.672 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:00:56.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T09:00:56.803 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T09:00:56.823 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:00:56.930 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T09:00:56.950 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T09:00:57.016 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T09:00:57.126 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T09:00:57.146 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:57.149 DEBUG:teuthology.orchestra.run.smithi178:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T09:00:57.197 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T09:00:57.198 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T09:00:57.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T09:00:57.202 INFO:tasks.ceph.mon.a:Started 2024-04-25T09:00:57.202 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T09:00:57.203 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T09:00:57.244 INFO:tasks.ceph.mon.b:Started 2024-04-25T09:00:57.245 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T09:00:57.245 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T09:00:57.248 INFO:tasks.ceph.mon.c:Started 2024-04-25T09:00:57.248 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T09:00:57.248 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T09:00:57.248 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T09:00:57.251 INFO:tasks.ceph.mgr.y:Started 2024-04-25T09:00:57.252 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T09:00:57.252 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T09:00:57.254 INFO:tasks.ceph.mgr.x:Started 2024-04-25T09:00:57.255 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T09:00:57.255 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T09:00:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b7d200640 1 Processor -- start 2024-04-25T09:00:57.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b7d200640 1 -- start start 2024-04-25T09:00:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b7d200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b7d200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:00:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b7d200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7815e040 con 0x7f1b7815dc60 2024-04-25T09:00:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b7d200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b780cff80 con 0x7f1b7806bf30 2024-04-25T09:00:57.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b7d200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b780d0260 con 0x7f1b7809a170 2024-04-25T09:00:57.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b76800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b76800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:43608/0 (socket says 172.21.15.59:43608) 2024-04-25T09:00:57.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 learned_addr learned my addr 172.21.15.59:0/24856380 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:00:57.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 msgr2=0x7f1b780cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T09:00:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 msgr2=0x7f1b780cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:00:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:00:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T09:00:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 msgr2=0x7f1b780d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T09:00:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 msgr2=0x7f1b780d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:00:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:00:57.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.409+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T09:00:57.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.613+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.613+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:57.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.613+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 msgr2=0x7f1b780cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T09:00:57.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.613+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 msgr2=0x7f1b780cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:00:57.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.613+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:00:57.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.613+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T09:00:57.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.613+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 msgr2=0x7f1b780d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T09:00:57.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.613+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 msgr2=0x7f1b780d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:00:57.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.613+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:00:57.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:57.613+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T09:00:58.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.017+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.017+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.017+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 msgr2=0x7f1b780cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T09:00:58.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.017+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 msgr2=0x7f1b780cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:00:58.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.017+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:00:58.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.017+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T09:00:58.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.017+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 msgr2=0x7f1b780d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T09:00:58.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.017+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 msgr2=0x7f1b780d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:00:58.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.017+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:00:58.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.017+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T09:00:58.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.821+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.821+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:00:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.821+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 msgr2=0x7f1b780cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T09:00:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.821+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 msgr2=0x7f1b780cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:00:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.821+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:00:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.821+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T09:00:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.821+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 msgr2=0x7f1b780d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T09:00:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.821+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 msgr2=0x7f1b780d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:00:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.821+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:00:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:00:58.821+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T09:01:00.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6f400640 1 -- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 msgr2=0x7f1b780d1020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:01:00.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6f400640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b780d1020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6f400640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 msgr2=0x7f1b780cf8a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:01:00.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6f400640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.178:3300/0 conn(0x7f1b7806bf30 0x7f1b780cf8a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:00.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6f400640 1 -- 172.21.15.59:0/24856380 >> v1:172.21.15.178:6789/0 conn(0x7f1b7815dc60 legacy=0x7f1b78099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:00.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6f400640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:00.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6f400640 1 -- 172.21.15.59:0/24856380 --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b780d0540 con 0x7f1b540036f0 2024-04-25T09:01:00.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6f400640 1 -- 172.21.15.59:0/24856380 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b780cff80 con 0x7f1b54007360 2024-04-25T09:01:00.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:00.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 msgr2=0x7f1b54009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T09:01:00.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 msgr2=0x7f1b54009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:01:00.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:01:00.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.409+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T09:01:00.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.613+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:00.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.613+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 msgr2=0x7f1b54009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T09:01:00.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.613+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 msgr2=0x7f1b54009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:01:00.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.613+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:01:00.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:00.613+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T09:01:01.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:01.016+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:01.016+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 msgr2=0x7f1b54009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T09:01:01.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:01.016+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 msgr2=0x7f1b54009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:01:01.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:01.016+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:01:01.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:01.016+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T09:01:01.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:01.820+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:01.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:01.820+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 msgr2=0x7f1b54009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T09:01:01.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:01.820+0000 7f1b6fe00640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 msgr2=0x7f1b54009820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T09:01:01.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:01.820+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T09:01:01.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:01.820+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T09:01:02.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627374429 0 0) 0x7f1b780d0540 con 0x7f1b540036f0 2024-04-25T09:01:02.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b5c003530 con 0x7f1b540036f0 2024-04-25T09:01:02.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3390094773 0 0) 0x7f1b5c003530 con 0x7f1b540036f0 2024-04-25T09:01:02.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 msgr2=0x7f1b54009820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T09:01:02.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 --2- 172.21.15.59:0/24856380 >> v2:172.21.15.59:3300/0 conn(0x7f1b54007360 0x7f1b54009820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5400af70 con 0x7f1b540036f0 2024-04-25T09:01:02.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f1b68001700 con 0x7f1b540036f0 2024-04-25T09:01:02.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 >> v1:172.21.15.59:6789/0 conn(0x7f1b540036f0 legacy=0x7f1b54005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 reap_dead start 2024-04-25T09:01:02.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c0039c0 0x7f1b5c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b5c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b5c004da0 0x7f1b5c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b780cff80 con 0x7f1b5c004da0 2024-04-25T09:01:02.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c00bc50 con 0x7f1b5c0039c0 2024-04-25T09:01:02.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c00be50 con 0x7f1b7809a170 2024-04-25T09:01:02.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b75e00640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c0039c0 0x7f1b5c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b5c004da0 0x7f1b5c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 msgr2=0x7f1b5c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:02.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b5c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c0039c0 msgr2=0x7f1b5c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:02.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c0039c0 0x7f1b5c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.556+0000 7f1b76800640 1 -- 172.21.15.59:0/24856380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c003530 con 0x7f1b5c004da0 2024-04-25T09:01:02.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.560+0000 7f1b76800640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b5c004da0 0x7f1b5c005220 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1b7806dce0 tx=0x7f1b7001d130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1613f9359a4cc243 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.560+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b700b3070 con 0x7f1b5c004da0 2024-04-25T09:01:02.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.560+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b700ae410 con 0x7f1b5c004da0 2024-04-25T09:01:02.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.560+0000 7f1b75400640 1 -- 172.21.15.59:0/24856380 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70009700 con 0x7f1b5c004da0 2024-04-25T09:01:02.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.560+0000 7f1b7d200640 1 -- 172.21.15.59:0/24856380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b5c004da0 msgr2=0x7f1b5c005220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.560+0000 7f1b7d200640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b5c004da0 0x7f1b5c005220 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1b7806dce0 tx=0x7f1b7001d130 comp rx=0 tx=0).stop 2024-04-25T09:01:02.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.560+0000 7f1b7d200640 1 -- 172.21.15.59:0/24856380 shutdown_connections 2024-04-25T09:01:02.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.560+0000 7f1b7d200640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b5c004da0 0x7f1b5c005220 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.560+0000 7f1b7d200640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b7809a170 0x7f1b5c004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.560+0000 7f1b7d200640 1 --2- 172.21.15.59:0/24856380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c0039c0 0x7f1b5c003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.560+0000 7f1b7d200640 1 -- 172.21.15.59:0/24856380 >> 172.21.15.59:0/24856380 conn(0x7f1b780b3200 msgr2=0x7f1b780b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:02.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.560+0000 7f1b7d200640 1 -- 172.21.15.59:0/24856380 shutdown_connections 2024-04-25T09:01:02.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b7d200640 1 -- 172.21.15.59:0/24856380 wait complete. 2024-04-25T09:01:02.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b7d200640 1 Processor -- start 2024-04-25T09:01:02.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b7d200640 1 -- start start 2024-04-25T09:01:02.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b7d200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b5c0039c0 0x7f1b780c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b7d200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c004da0 0x7f1b7814eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b7d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b7809a170 0x7f1b780b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b7d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7806cfa0 con 0x7f1b7809a170 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b7d200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b780d0b00 con 0x7f1b5c004da0 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b7d200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b780c87e0 con 0x7f1b5c0039c0 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b76800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b7809a170 0x7f1b780b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b76800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b7809a170 0x7f1b780b17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36178/0 (socket says 172.21.15.59:36178) 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b76800640 1 -- 172.21.15.59:0/1041250931 learned_addr learned my addr 172.21.15.59:0/1041250931 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b6fe00640 1 --2- 172.21.15.59:0/1041250931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c004da0 0x7f1b7814eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.564+0000 7f1b75e00640 1 --2- 172.21.15.59:0/1041250931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b5c0039c0 0x7f1b780c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b76800640 1 -- 172.21.15.59:0/1041250931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b5c0039c0 msgr2=0x7f1b780c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b76800640 1 --2- 172.21.15.59:0/1041250931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b5c0039c0 0x7f1b780c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b76800640 1 -- 172.21.15.59:0/1041250931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c004da0 msgr2=0x7f1b7814eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b76800640 1 --2- 172.21.15.59:0/1041250931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c004da0 0x7f1b7814eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b76800640 1 -- 172.21.15.59:0/1041250931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7814f0b0 con 0x7f1b7809a170 2024-04-25T09:01:02.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b76800640 1 --2- 172.21.15.59:0/1041250931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b7809a170 0x7f1b780b17d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1b70002240 tx=0x7f1b70019ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:02.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b6e000640 1 -- 172.21.15.59:0/1041250931 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b700b3040 con 0x7f1b7809a170 2024-04-25T09:01:02.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b6e000640 1 -- 172.21.15.59:0/1041250931 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b700aecc0 con 0x7f1b7809a170 2024-04-25T09:01:02.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b7d200640 1 -- 172.21.15.59:0/1041250931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b780b21b0 con 0x7f1b7809a170 2024-04-25T09:01:02.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b6e000640 1 -- 172.21.15.59:0/1041250931 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70009700 con 0x7f1b7809a170 2024-04-25T09:01:02.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b7d200640 1 -- 172.21.15.59:0/1041250931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b780c8d10 con 0x7f1b7809a170 2024-04-25T09:01:02.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b6e000640 1 -- 172.21.15.59:0/1041250931 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f1b700c0030 con 0x7f1b7809a170 2024-04-25T09:01:02.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b6e000640 1 -- 172.21.15.59:0/1041250931 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1b700c2450 con 0x7f1b7809a170 2024-04-25T09:01:02.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.568+0000 7f1b7d200640 1 -- 172.21.15.59:0/1041250931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b780745d0 con 0x7f1b7809a170 2024-04-25T09:01:02.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.576+0000 7f1b6e000640 1 -- 172.21.15.59:0/1041250931 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f1b700c7020 con 0x7f1b7809a170 2024-04-25T09:01:02.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.644+0000 7f1b7d200640 1 -- 172.21.15.59:0/1041250931 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f1b78066e60 con 0x7f1b7809a170 2024-04-25T09:01:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.644+0000 7f1b6e000640 1 -- 172.21.15.59:0/1041250931 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1b70016e80 con 0x7f1b7809a170 2024-04-25T09:01:02.636 INFO:teuthology.orchestra.run.smithi059.stderr:adjusted tunables profile to default 2024-04-25T09:01:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.648+0000 7f1b7d200640 1 -- 172.21.15.59:0/1041250931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b7809a170 msgr2=0x7f1b780b17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.648+0000 7f1b7d200640 1 --2- 172.21.15.59:0/1041250931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b7809a170 0x7f1b780b17d0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1b70002240 tx=0x7f1b70019ed0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.648+0000 7f1b7d200640 1 -- 172.21.15.59:0/1041250931 shutdown_connections 2024-04-25T09:01:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.648+0000 7f1b7d200640 1 --2- 172.21.15.59:0/1041250931 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b7809a170 0x7f1b780b17d0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.648+0000 7f1b7d200640 1 --2- 172.21.15.59:0/1041250931 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b5c004da0 0x7f1b7814eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.648+0000 7f1b7d200640 1 --2- 172.21.15.59:0/1041250931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b5c0039c0 0x7f1b780c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.648+0000 7f1b7d200640 1 -- 172.21.15.59:0/1041250931 >> 172.21.15.59:0/1041250931 conn(0x7f1b780b3200 msgr2=0x7f1b7809b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:02.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.648+0000 7f1b7d200640 1 -- 172.21.15.59:0/1041250931 shutdown_connections 2024-04-25T09:01:02.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:02.648+0000 7f1b7d200640 1 -- 172.21.15.59:0/1041250931 wait complete. 2024-04-25T09:01:02.656 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T09:01:02.657 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T09:01:02.657 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:01:02.657 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T09:01:02.679 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:01:02.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T09:01:02.743 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:01:02.743 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T09:01:02.752 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:02.761+0000 7f73b7d93180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T09:01:02.807 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:01:02.808 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T09:01:02.868 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:01:02.868 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T09:01:02.887 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:01:02.887 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T09:01:02.949 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:01:02.949 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T09:01:03.013 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:01:03.013 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T09:01:03.077 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 318281b5-e306-4c0f-b89a-7d589389261e 0 2024-04-25T09:01:03.255 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:03.265+0000 7f73b7d93180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T09:01:03.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.265+0000 7f9ca3c00640 1 Processor -- start 2024-04-25T09:01:03.258 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9ca3c00640 1 -- start start 2024-04-25T09:01:03.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9ca3c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c9c15dee0 0x7f9c9c0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9ca3c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9c9c09dcb0 0x7f9c9c0ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9ca3c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9c066b40 con 0x7f9c9c0adcc0 2024-04-25T09:01:03.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9ca3c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c15e2c0 con 0x7f9c9c15dee0 2024-04-25T09:01:03.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9ca3c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0b33f0 con 0x7f9c9c09dcb0 2024-04-25T09:01:03.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9c9be00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9c9c09dcb0 0x7f9c9c0ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9ca1c00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f9c9c0adcc0 0x7f9c9c0cf2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:49300/0 (socket says 172.21.15.178:49300) 2024-04-25T09:01:03.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9ca1c00640 1 -- 172.21.15.178:0/3390544747 learned_addr learned my addr 172.21.15.178:0/3390544747 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-04-25T09:01:03.260 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9ca1200640 1 --2- 172.21.15.178:0/3390544747 >> v2:172.21.15.59:3300/0 conn(0x7f9c9c15dee0 0x7f9c9c0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9c9b400640 1 -- 172.21.15.178:0/3390544747 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183152813 0 0) 0x7f9c9c066b40 con 0x7f9c9c0adcc0 2024-04-25T09:01:03.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9c9b400640 1 -- 172.21.15.178:0/3390544747 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c84003530 con 0x7f9c9c0adcc0 2024-04-25T09:01:03.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9c9be00640 1 -- 172.21.15.178:0/3390544747 >> v2:172.21.15.59:3300/0 conn(0x7f9c9c15dee0 msgr2=0x7f9c9c0ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9c9be00640 1 --2- 172.21.15.178:0/3390544747 >> v2:172.21.15.59:3300/0 conn(0x7f9c9c15dee0 0x7f9c9c0ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9c9be00640 1 -- 172.21.15.178:0/3390544747 >> v1:172.21.15.178:6789/0 conn(0x7f9c9c0adcc0 legacy=0x7f9c9c0cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.261 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.269+0000 7f9c9be00640 1 -- 172.21.15.178:0/3390544747 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c0b47d0 con 0x7f9c9c09dcb0 2024-04-25T09:01:03.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.273+0000 7f9c9be00640 1 --2- 172.21.15.178:0/3390544747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c09dcb0 0x7f9c9c0ced80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c06d810 tx=0x7f9c8801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fbf25b0fd8be0f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.273+0000 7f9c9b400640 1 -- 172.21.15.178:0/3390544747 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c880ab650 con 0x7f9c9c09dcb0 2024-04-25T09:01:03.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.273+0000 7f9c9b400640 1 -- 172.21.15.178:0/3390544747 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c880b0070 con 0x7f9c9c09dcb0 2024-04-25T09:01:03.263 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.273+0000 7f9c9b400640 1 -- 172.21.15.178:0/3390544747 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c880aba10 con 0x7f9c9c09dcb0 2024-04-25T09:01:03.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.273+0000 7f9ca3c00640 1 -- 172.21.15.178:0/3390544747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c09dcb0 msgr2=0x7f9c9c0ced80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.264 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.273+0000 7f9ca3c00640 1 --2- 172.21.15.178:0/3390544747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c09dcb0 0x7f9c9c0ced80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c06d810 tx=0x7f9c8801c450 comp rx=0 tx=0).stop 2024-04-25T09:01:03.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.273+0000 7f9ca3c00640 1 -- 172.21.15.178:0/3390544747 shutdown_connections 2024-04-25T09:01:03.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.273+0000 7f9ca3c00640 1 --2- 172.21.15.178:0/3390544747 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c09dcb0 0x7f9c9c0ced80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.273+0000 7f9ca3c00640 1 --2- 172.21.15.178:0/3390544747 >> v2:172.21.15.59:3300/0 conn(0x7f9c9c15dee0 0x7f9c9c0ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.273+0000 7f9ca3c00640 1 -- 172.21.15.178:0/3390544747 >> 172.21.15.178:0/3390544747 conn(0x7f9c9c0cc830 msgr2=0x7f9c9c0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.273+0000 7f9ca3c00640 1 -- 172.21.15.178:0/3390544747 shutdown_connections 2024-04-25T09:01:03.265 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.273+0000 7f9ca3c00640 1 -- 172.21.15.178:0/3390544747 wait complete. 2024-04-25T09:01:03.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca3c00640 1 Processor -- start 2024-04-25T09:01:03.266 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca3c00640 1 -- start start 2024-04-25T09:01:03.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca3c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c9c09dcb0 0x7f9c9c155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca3c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c0adcc0 0x7f9c9c15c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.267 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca3c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c15dee0 0x7f9c9c156740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca3c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0b4150 con 0x7f9c9c09dcb0 2024-04-25T09:01:03.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca3c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0b3fd0 con 0x7f9c9c15dee0 2024-04-25T09:01:03.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca3c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c0b42d0 con 0x7f9c9c0adcc0 2024-04-25T09:01:03.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca1c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c15dee0 0x7f9c9c156740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9c9be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c0adcc0 0x7f9c9c15c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca1c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c15dee0 0x7f9c9c156740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:42230/0 (socket says 172.21.15.178:42230) 2024-04-25T09:01:03.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca1c00640 1 -- 172.21.15.178:0/2837024791 learned_addr learned my addr 172.21.15.178:0/2837024791 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-25T09:01:03.268 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9c9be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c0adcc0 0x7f9c9c15c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:38940/0 (socket says 172.21.15.178:38940) 2024-04-25T09:01:03.269 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca1200640 1 --2- 172.21.15.178:0/2837024791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c9c09dcb0 0x7f9c9c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca1c00640 1 -- 172.21.15.178:0/2837024791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c0adcc0 msgr2=0x7f9c9c15c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca1c00640 1 --2- 172.21.15.178:0/2837024791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c0adcc0 0x7f9c9c15c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca1c00640 1 -- 172.21.15.178:0/2837024791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c9c09dcb0 msgr2=0x7f9c9c155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca1c00640 1 --2- 172.21.15.178:0/2837024791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c9c09dcb0 0x7f9c9c155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca1c00640 1 -- 172.21.15.178:0/2837024791 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c14de40 con 0x7f9c9c15dee0 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca1200640 1 --2- 172.21.15.178:0/2837024791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c9c09dcb0 0x7f9c9c155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca1c00640 1 --2- 172.21.15.178:0/2837024791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c15dee0 0x7f9c9c156740 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400cb70 tx=0x7f9c9400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9c98c00640 1 -- 172.21.15.178:0/2837024791 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94017070 con 0x7f9c9c15dee0 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9c98c00640 1 -- 172.21.15.178:0/2837024791 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9400ad40 con 0x7f9c9c15dee0 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9c98c00640 1 -- 172.21.15.178:0/2837024791 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94012620 con 0x7f9c9c15dee0 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca3c00640 1 -- 172.21.15.178:0/2837024791 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9c1556a0 con 0x7f9c9c15dee0 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca3c00640 1 -- 172.21.15.178:0/2837024791 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c155c60 con 0x7f9c9c15dee0 2024-04-25T09:01:03.270 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9c98c00640 1 -- 172.21.15.178:0/2837024791 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f9c9401a070 con 0x7f9c9c15dee0 2024-04-25T09:01:03.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9c98c00640 1 -- 172.21.15.178:0/2837024791 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9c940079e0 con 0x7f9c9c15dee0 2024-04-25T09:01:03.271 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.277+0000 7f9ca3c00640 1 -- 172.21.15.178:0/2837024791 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9c0745d0 con 0x7f9c9c15dee0 2024-04-25T09:01:03.274 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.285+0000 7f9c98c00640 1 -- 172.21.15.178:0/2837024791 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f9c94007070 con 0x7f9c9c15dee0 2024-04-25T09:01:03.341 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.349+0000 7f9ca3c00640 1 -- 172.21.15.178:0/2837024791 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "318281b5-e306-4c0f-b89a-7d589389261e", "id": 0} v 0) v1 -- 0x7f9c9c06b670 con 0x7f9c9c15dee0 2024-04-25T09:01:03.345 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.353+0000 7f9c98c00640 1 -- 172.21.15.178:0/2837024791 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "318281b5-e306-4c0f-b89a-7d589389261e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c940127c0 con 0x7f9c9c15dee0 2024-04-25T09:01:03.345 INFO:teuthology.orchestra.run.smithi178.stdout:0 2024-04-25T09:01:03.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.357+0000 7f9ca3c00640 1 -- 172.21.15.178:0/2837024791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c15dee0 msgr2=0x7f9c9c156740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.357+0000 7f9ca3c00640 1 --2- 172.21.15.178:0/2837024791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c15dee0 0x7f9c9c156740 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400cb70 tx=0x7f9c9400a430 comp rx=0 tx=0).stop 2024-04-25T09:01:03.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.357+0000 7f9ca3c00640 1 -- 172.21.15.178:0/2837024791 shutdown_connections 2024-04-25T09:01:03.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.357+0000 7f9ca3c00640 1 --2- 172.21.15.178:0/2837024791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9c9c15dee0 0x7f9c9c156740 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.357+0000 7f9ca3c00640 1 --2- 172.21.15.178:0/2837024791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9c9c0adcc0 0x7f9c9c15c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.346 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.357+0000 7f9ca3c00640 1 --2- 172.21.15.178:0/2837024791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c9c09dcb0 0x7f9c9c155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.357+0000 7f9ca3c00640 1 -- 172.21.15.178:0/2837024791 >> 172.21.15.178:0/2837024791 conn(0x7f9c9c0cc830 msgr2=0x7f9c9c0cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.357+0000 7f9ca3c00640 1 -- 172.21.15.178:0/2837024791 shutdown_connections 2024-04-25T09:01:03.347 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.357+0000 7f9ca3c00640 1 -- 172.21.15.178:0/2837024791 wait complete. 2024-04-25T09:01:03.369 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 3f8b2f03-0f24-4342-a300-c31dc0692cb9 1 2024-04-25T09:01:03.505 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.513+0000 7f616e200640 1 Processor -- start 2024-04-25T09:01:03.506 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.513+0000 7f616e200640 1 -- start start 2024-04-25T09:01:03.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f616e200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f616815dc60 0x7f61680d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f616e200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f616809a170 0x7f61680cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f616e200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616815e040 con 0x7f616806bf30 2024-04-25T09:01:03.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f616e200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61680cff80 con 0x7f616815dc60 2024-04-25T09:01:03.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f616e200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61680d0260 con 0x7f616809a170 2024-04-25T09:01:03.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f6167e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f616809a170 0x7f61680cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f6166a00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f616806bf30 0x7f6168099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:49302/0 (socket says 172.21.15.178:49302) 2024-04-25T09:01:03.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f6166a00640 1 -- 172.21.15.178:0/2921132035 learned_addr learned my addr 172.21.15.178:0/2921132035 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-04-25T09:01:03.507 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f6167400640 1 --2- 172.21.15.178:0/2921132035 >> v2:172.21.15.59:3300/0 conn(0x7f616815dc60 0x7f61680d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f6167e00640 1 -- 172.21.15.178:0/2921132035 >> v2:172.21.15.59:3300/0 conn(0x7f616815dc60 msgr2=0x7f61680d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f6167e00640 1 --2- 172.21.15.178:0/2921132035 >> v2:172.21.15.59:3300/0 conn(0x7f616815dc60 0x7f61680d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f6167e00640 1 -- 172.21.15.178:0/2921132035 >> v1:172.21.15.178:6789/0 conn(0x7f616806bf30 legacy=0x7f6168099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f6167e00640 1 -- 172.21.15.178:0/2921132035 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61680d0540 con 0x7f616809a170 2024-04-25T09:01:03.508 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f6166000640 1 -- 172.21.15.178:0/2921132035 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298730654 0 0) 0x7f616815e040 con 0x7f616806bf30 2024-04-25T09:01:03.509 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:03.517+0000 7f73b7d93180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T09:01:03.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f6167e00640 1 --2- 172.21.15.178:0/2921132035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616809a170 0x7f61680cf8a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6168072a70 tx=0x7f616001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d174620299cf038f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.510 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f6166000640 1 -- 172.21.15.178:0/2921132035 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61600b2070 con 0x7f616809a170 2024-04-25T09:01:03.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f6166000640 1 -- 172.21.15.178:0/2921132035 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61600a5930 con 0x7f616809a170 2024-04-25T09:01:03.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f6166000640 1 -- 172.21.15.178:0/2921132035 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61600a5d00 con 0x7f616809a170 2024-04-25T09:01:03.511 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f616e200640 1 -- 172.21.15.178:0/2921132035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616809a170 msgr2=0x7f61680cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f616e200640 1 --2- 172.21.15.178:0/2921132035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616809a170 0x7f61680cf8a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6168072a70 tx=0x7f616001c870 comp rx=0 tx=0).stop 2024-04-25T09:01:03.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f616e200640 1 -- 172.21.15.178:0/2921132035 shutdown_connections 2024-04-25T09:01:03.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f616e200640 1 --2- 172.21.15.178:0/2921132035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616809a170 0x7f61680cf8a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f616e200640 1 --2- 172.21.15.178:0/2921132035 >> v2:172.21.15.59:3300/0 conn(0x7f616815dc60 0x7f61680d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f616e200640 1 -- 172.21.15.178:0/2921132035 >> 172.21.15.178:0/2921132035 conn(0x7f61680b3200 msgr2=0x7f61680b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f616e200640 1 -- 172.21.15.178:0/2921132035 shutdown_connections 2024-04-25T09:01:03.512 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f616e200640 1 -- 172.21.15.178:0/2921132035 wait complete. 2024-04-25T09:01:03.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f616e200640 1 Processor -- start 2024-04-25T09:01:03.513 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.521+0000 7f616e200640 1 -- start start 2024-04-25T09:01:03.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f616e200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f616806bf30 0x7f61680ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f616e200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616809a170 0x7f616809efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f616e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f616815dc60 0x7f61680ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.515 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f616e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680cc6f0 con 0x7f616815dc60 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f616e200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61680cc570 con 0x7f616809a170 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f616e200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61680cc870 con 0x7f616806bf30 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f6167400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f616806bf30 0x7f61680ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f6166a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616809a170 0x7f616809efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f6167400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f616806bf30 0x7f61680ae440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:38948/0 (socket says 172.21.15.178:38948) 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f6167400640 1 -- 172.21.15.178:0/935369794 learned_addr learned my addr 172.21.15.178:0/935369794 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f6167e00640 1 --2- 172.21.15.178:0/935369794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f616815dc60 0x7f61680ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f6167400640 1 -- 172.21.15.178:0/935369794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616809a170 msgr2=0x7f616809efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f6167400640 1 --2- 172.21.15.178:0/935369794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616809a170 0x7f616809efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f6167400640 1 -- 172.21.15.178:0/935369794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f616815dc60 msgr2=0x7f61680ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f6167400640 1 --2- 172.21.15.178:0/935369794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f616815dc60 0x7f61680ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f6167400640 1 -- 172.21.15.178:0/935369794 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616809d920 con 0x7f616806bf30 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f6167400640 1 --2- 172.21.15.178:0/935369794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f616806bf30 0x7f61680ae440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f615800e8d0 tx=0x7f615800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f615f400640 1 -- 172.21.15.178:0/935369794 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158017070 con 0x7f616806bf30 2024-04-25T09:01:03.516 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f615f400640 1 -- 172.21.15.178:0/935369794 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800c940 con 0x7f616806bf30 2024-04-25T09:01:03.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f615f400640 1 -- 172.21.15.178:0/935369794 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800ccf0 con 0x7f616806bf30 2024-04-25T09:01:03.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f616e200640 1 -- 172.21.15.178:0/935369794 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61680c8a30 con 0x7f616806bf30 2024-04-25T09:01:03.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f616e200640 1 -- 172.21.15.178:0/935369794 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616809d560 con 0x7f616806bf30 2024-04-25T09:01:03.517 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f615f400640 1 -- 172.21.15.178:0/935369794 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f615801a070 con 0x7f616806bf30 2024-04-25T09:01:03.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f615f400640 1 -- 172.21.15.178:0/935369794 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f6158013470 con 0x7f616806bf30 2024-04-25T09:01:03.518 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.525+0000 7f616e200640 1 -- 172.21.15.178:0/935369794 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61680745d0 con 0x7f616806bf30 2024-04-25T09:01:03.528 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.537+0000 7f615f400640 1 -- 172.21.15.178:0/935369794 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f6158006020 con 0x7f616806bf30 2024-04-25T09:01:03.582 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:03.592+0000 7fd3e0ed3180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T09:01:03.595 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.605+0000 7f616e200640 1 -- 172.21.15.178:0/935369794 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3f8b2f03-0f24-4342-a300-c31dc0692cb9", "id": 1} v 0) v1 -- 0x7f61680b7590 con 0x7f616806bf30 2024-04-25T09:01:03.601 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.609+0000 7f615f400640 1 -- 172.21.15.178:0/935369794 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f8b2f03-0f24-4342-a300-c31dc0692cb9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f61580059a0 con 0x7f616806bf30 2024-04-25T09:01:03.602 INFO:teuthology.orchestra.run.smithi178.stdout:1 2024-04-25T09:01:03.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.613+0000 7f616e200640 1 -- 172.21.15.178:0/935369794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f616806bf30 msgr2=0x7f61680ae440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.613+0000 7f616e200640 1 --2- 172.21.15.178:0/935369794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f616806bf30 0x7f61680ae440 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f615800e8d0 tx=0x7f615800ecd0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.613+0000 7f616e200640 1 -- 172.21.15.178:0/935369794 shutdown_connections 2024-04-25T09:01:03.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.613+0000 7f616e200640 1 --2- 172.21.15.178:0/935369794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f616815dc60 0x7f61680ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.613+0000 7f616e200640 1 --2- 172.21.15.178:0/935369794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616809a170 0x7f616809efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.613+0000 7f616e200640 1 --2- 172.21.15.178:0/935369794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f616806bf30 0x7f61680ae440 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.613+0000 7f616e200640 1 -- 172.21.15.178:0/935369794 >> 172.21.15.178:0/935369794 conn(0x7f61680b3200 msgr2=0x7f61680ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.613+0000 7f616e200640 1 -- 172.21.15.178:0/935369794 shutdown_connections 2024-04-25T09:01:03.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.613+0000 7f616e200640 1 -- 172.21.15.178:0/935369794 wait complete. 2024-04-25T09:01:03.621 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new c789b920-67a7-45e8-92ae-e19ae190ef59 2 2024-04-25T09:01:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2eee200640 1 Processor -- start 2024-04-25T09:01:03.755 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2eee200640 1 -- start start 2024-04-25T09:01:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2eee200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ee815b910 0x7f2ee80cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2eee200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 0x7f2ee80cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2eee200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ee80cd370 0x7f2ee8099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2eee200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee80d02a0 con 0x7f2ee80cd370 2024-04-25T09:01:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2eee200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee80cc350 con 0x7f2ee815b910 2024-04-25T09:01:03.757 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2eee200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee80cc630 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2ee7400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ee815b910 0x7f2ee80cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2ee6a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 0x7f2ee80cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2ee7400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ee815b910 0x7f2ee80cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:42252/0 (socket says 172.21.15.178:42252) 2024-04-25T09:01:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2ee7400640 1 -- 172.21.15.178:0/3249424397 learned_addr learned my addr 172.21.15.178:0/3249424397 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-25T09:01:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2ee7e00640 1 --2- 172.21.15.178:0/3249424397 >> v2:172.21.15.59:3300/0 conn(0x7f2ee80cd370 0x7f2ee8099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2ee7400640 1 -- 172.21.15.178:0/3249424397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 msgr2=0x7f2ee80cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2ee7400640 1 --2- 172.21.15.178:0/3249424397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 0x7f2ee80cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2ee7400640 1 -- 172.21.15.178:0/3249424397 >> v2:172.21.15.59:3300/0 conn(0x7f2ee80cd370 msgr2=0x7f2ee8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2ee7400640 1 --2- 172.21.15.178:0/3249424397 >> v2:172.21.15.59:3300/0 conn(0x7f2ee80cd370 0x7f2ee8099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2ee7400640 1 -- 172.21.15.178:0/3249424397 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee80cc910 con 0x7f2ee815b910 2024-04-25T09:01:03.758 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.765+0000 7f2ee6a00640 1 --2- 172.21.15.178:0/3249424397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 0x7f2ee80cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:03.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2ee7400640 1 --2- 172.21.15.178:0/3249424397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee815b910 0x7f2ee80cf9a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8072650 tx=0x7f2ed801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=878aa550a0ae5158 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2ee6000640 1 -- 172.21.15.178:0/3249424397 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80ab5f0 con 0x7f2ee815b910 2024-04-25T09:01:03.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2ee6000640 1 -- 172.21.15.178:0/3249424397 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed80b0070 con 0x7f2ee815b910 2024-04-25T09:01:03.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2ee6000640 1 -- 172.21.15.178:0/3249424397 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80ab9b0 con 0x7f2ee815b910 2024-04-25T09:01:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2eee200640 1 -- 172.21.15.178:0/3249424397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee815b910 msgr2=0x7f2ee80cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2eee200640 1 --2- 172.21.15.178:0/3249424397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee815b910 0x7f2ee80cf9a0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8072650 tx=0x7f2ed801c520 comp rx=0 tx=0).stop 2024-04-25T09:01:03.763 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2eee200640 1 -- 172.21.15.178:0/3249424397 shutdown_connections 2024-04-25T09:01:03.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2eee200640 1 --2- 172.21.15.178:0/3249424397 >> v2:172.21.15.59:3300/0 conn(0x7f2ee80cd370 0x7f2ee8099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2eee200640 1 --2- 172.21.15.178:0/3249424397 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 0x7f2ee80cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2eee200640 1 --2- 172.21.15.178:0/3249424397 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee815b910 0x7f2ee80cf9a0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2eee200640 1 -- 172.21.15.178:0/3249424397 >> 172.21.15.178:0/3249424397 conn(0x7f2ee80b3200 msgr2=0x7f2ee80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2eee200640 1 -- 172.21.15.178:0/3249424397 shutdown_connections 2024-04-25T09:01:03.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.769+0000 7f2eee200640 1 -- 172.21.15.178:0/3249424397 wait complete. 2024-04-25T09:01:03.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2eee200640 1 Processor -- start 2024-04-25T09:01:03.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2eee200640 1 -- start start 2024-04-25T09:01:03.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2eee200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee80cd370 0x7f2ee80c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2eee200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 0x7f2ee809b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2eee200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ee815b910 0x7f2ee815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2eee200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee815f660 con 0x7f2ee815b910 2024-04-25T09:01:03.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2eee200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee809a3b0 con 0x7f2ee80cd370 2024-04-25T09:01:03.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2eee200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee815f7e0 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2ee7400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee80cd370 0x7f2ee80c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2ee6a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 0x7f2ee809b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2ee6a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 0x7f2ee809b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:38968/0 (socket says 172.21.15.178:38968) 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2ee7400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee80cd370 0x7f2ee80c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:42268/0 (socket says 172.21.15.178:42268) 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2ee6a00640 1 -- 172.21.15.178:0/808146842 learned_addr learned my addr 172.21.15.178:0/808146842 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2ee7e00640 1 --2- 172.21.15.178:0/808146842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ee815b910 0x7f2ee815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2ee6a00640 1 -- 172.21.15.178:0/808146842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee80cd370 msgr2=0x7f2ee80c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2ee6a00640 1 --2- 172.21.15.178:0/808146842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee80cd370 0x7f2ee80c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2ee6a00640 1 -- 172.21.15.178:0/808146842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ee815b910 msgr2=0x7f2ee815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2ee6a00640 1 --2- 172.21.15.178:0/808146842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ee815b910 0x7f2ee815a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2ee6a00640 1 -- 172.21.15.178:0/808146842 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee80c90e0 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2ee6a00640 1 --2- 172.21.15.178:0/808146842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 0x7f2ee809b7b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400ea00 tx=0x7f2ed400eec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2edf400640 1 -- 172.21.15.178:0/808146842 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4017070 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2edf400640 1 -- 172.21.15.178:0/808146842 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed400ca60 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2edf400640 1 -- 172.21.15.178:0/808146842 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed400ce50 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2eee200640 1 -- 172.21.15.178:0/808146842 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee80c93c0 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2eee200640 1 -- 172.21.15.178:0/808146842 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee80c9980 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.768 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2edf400640 1 -- 172.21.15.178:0/808146842 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f2ed401a070 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.773+0000 7f2edf400640 1 -- 172.21.15.178:0/808146842 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f2ed4013470 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.777+0000 7f2eee200640 1 -- 172.21.15.178:0/808146842 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee80745d0 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.777+0000 7f2edf400640 1 -- 172.21.15.178:0/808146842 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f2ed4003620 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.835 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.845+0000 7f2eee200640 1 -- 172.21.15.178:0/808146842 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c789b920-67a7-45e8-92ae-e19ae190ef59", "id": 2} v 0) v1 -- 0x7f2ee80cdcd0 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.841 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.849+0000 7f2edf400640 1 -- 172.21.15.178:0/808146842 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c789b920-67a7-45e8-92ae-e19ae190ef59", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2ed4003ba0 con 0x7f2ee80cf3c0 2024-04-25T09:01:03.841 INFO:teuthology.orchestra.run.smithi178.stdout:2 2024-04-25T09:01:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.849+0000 7f2eee200640 1 -- 172.21.15.178:0/808146842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 msgr2=0x7f2ee809b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.849+0000 7f2eee200640 1 --2- 172.21.15.178:0/808146842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 0x7f2ee809b7b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400ea00 tx=0x7f2ed400eec0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.849+0000 7f2eee200640 1 -- 172.21.15.178:0/808146842 shutdown_connections 2024-04-25T09:01:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.849+0000 7f2eee200640 1 --2- 172.21.15.178:0/808146842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ee815b910 0x7f2ee815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.849+0000 7f2eee200640 1 --2- 172.21.15.178:0/808146842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ee80cf3c0 0x7f2ee809b7b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.849+0000 7f2eee200640 1 --2- 172.21.15.178:0/808146842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ee80cd370 0x7f2ee80c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.849+0000 7f2eee200640 1 -- 172.21.15.178:0/808146842 >> 172.21.15.178:0/808146842 conn(0x7f2ee80b3200 msgr2=0x7f2ee80d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.853+0000 7f2eee200640 1 -- 172.21.15.178:0/808146842 shutdown_connections 2024-04-25T09:01:03.842 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:03.853+0000 7f2eee200640 1 -- 172.21.15.178:0/808146842 wait complete. 2024-04-25T09:01:03.860 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 21abdd03-dae8-4933-9679-a1feb524d636 3 2024-04-25T09:01:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cc1a00640 1 Processor -- start 2024-04-25T09:01:03.995 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cc1a00640 1 -- start start 2024-04-25T09:01:03.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cc1a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc15db00 0x7f7cbc0b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cc1a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7cbc0701d0 0x7f7cbc1616a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:03.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cc1a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cbc0af480 con 0x7f7cbc0aec50 2024-04-25T09:01:03.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cc1a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cbc0b4e80 con 0x7f7cbc0701d0 2024-04-25T09:01:03.996 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cc1a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc15dee0 con 0x7f7cbc15db00 2024-04-25T09:01:03.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cbaa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc15db00 0x7f7cbc0b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cba000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7cbc0701d0 0x7f7cbc1616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:03.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cbaa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc15db00 0x7f7cbc0b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:38974/0 (socket says 172.21.15.178:38974) 2024-04-25T09:01:03.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cbaa00640 1 -- 172.21.15.178:0/3140983234 learned_addr learned my addr 172.21.15.178:0/3140983234 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-25T09:01:03.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cbaa00640 1 -- 172.21.15.178:0/3140983234 >> v2:172.21.15.178:3300/0 conn(0x7f7cbc0701d0 msgr2=0x7f7cbc1616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:03.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cbaa00640 1 --2- 172.21.15.178:0/3140983234 >> v2:172.21.15.178:3300/0 conn(0x7f7cbc0701d0 0x7f7cbc1616a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:03.997 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cbaa00640 1 -- 172.21.15.178:0/3140983234 >> v1:172.21.15.59:6789/0 conn(0x7f7cbc0aec50 legacy=0x7f7cbc0acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:03.998 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.005+0000 7f7cbaa00640 1 -- 172.21.15.178:0/3140983234 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc0af1a0 con 0x7f7cbc15db00 2024-04-25T09:01:03.999 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.009+0000 7f7cbaa00640 1 --2- 172.21.15.178:0/3140983234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc15db00 0x7f7cbc0b2e50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009870 tx=0x7f7cac01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad3888828034fc18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.009+0000 7f7cb9600640 1 -- 172.21.15.178:0/3140983234 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac0ab640 con 0x7f7cbc15db00 2024-04-25T09:01:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.009+0000 7f7cb9600640 1 -- 172.21.15.178:0/3140983234 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac0b0070 con 0x7f7cbc15db00 2024-04-25T09:01:04.000 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.009+0000 7f7cb9600640 1 -- 172.21.15.178:0/3140983234 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac0aba00 con 0x7f7cbc15db00 2024-04-25T09:01:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.009+0000 7f7cc1a00640 1 -- 172.21.15.178:0/3140983234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc15db00 msgr2=0x7f7cbc0b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.009+0000 7f7cc1a00640 1 --2- 172.21.15.178:0/3140983234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc15db00 0x7f7cbc0b2e50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7cac009870 tx=0x7f7cac01c530 comp rx=0 tx=0).stop 2024-04-25T09:01:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.009+0000 7f7cc1a00640 1 -- 172.21.15.178:0/3140983234 shutdown_connections 2024-04-25T09:01:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.009+0000 7f7cc1a00640 1 --2- 172.21.15.178:0/3140983234 >> v2:172.21.15.178:3300/0 conn(0x7f7cbc0701d0 0x7f7cbc1616a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.009+0000 7f7cc1a00640 1 --2- 172.21.15.178:0/3140983234 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc15db00 0x7f7cbc0b2e50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.009+0000 7f7cc1a00640 1 -- 172.21.15.178:0/3140983234 >> 172.21.15.178:0/3140983234 conn(0x7f7cbc0cc830 msgr2=0x7f7cbc0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.009+0000 7f7cc1a00640 1 -- 172.21.15.178:0/3140983234 shutdown_connections 2024-04-25T09:01:04.001 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.009+0000 7f7cc1a00640 1 -- 172.21.15.178:0/3140983234 wait complete. 2024-04-25T09:01:04.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cc1a00640 1 Processor -- start 2024-04-25T09:01:04.002 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cc1a00640 1 -- start start 2024-04-25T09:01:04.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cc1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cbc0701d0 0x7f7cbc146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cc1a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc0aec50 0x7f7cbc06f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.004 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cc1a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cbc15db00 0x7f7cbc06f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cc1a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc162550 con 0x7f7cbc0701d0 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cc1a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc161ff0 con 0x7f7cbc15db00 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cc1a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc16b250 con 0x7f7cbc0aec50 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cbb400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cbc15db00 0x7f7cbc06f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cba000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc0aec50 0x7f7cbc06f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cbb400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cbc15db00 0x7f7cbc06f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:42282/0 (socket says 172.21.15.178:42282) 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cbb400640 1 -- 172.21.15.178:0/2725052554 learned_addr learned my addr 172.21.15.178:0/2725052554 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cbaa00640 1 --2- 172.21.15.178:0/2725052554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cbc0701d0 0x7f7cbc146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cbb400640 1 -- 172.21.15.178:0/2725052554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc0aec50 msgr2=0x7f7cbc06f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cbb400640 1 --2- 172.21.15.178:0/2725052554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc0aec50 0x7f7cbc06f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cbb400640 1 -- 172.21.15.178:0/2725052554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cbc0701d0 msgr2=0x7f7cbc146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cbb400640 1 --2- 172.21.15.178:0/2725052554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cbc0701d0 0x7f7cbc146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.005 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cbb400640 1 -- 172.21.15.178:0/2725052554 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc147350 con 0x7f7cbc15db00 2024-04-25T09:01:04.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cba000640 1 --2- 172.21.15.178:0/2725052554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc0aec50 0x7f7cbc06f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:04.006 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cbb400640 1 --2- 172.21.15.178:0/2725052554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cbc15db00 0x7f7cbc06f740 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400c730 tx=0x7f7cb400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cb2a00640 1 -- 172.21.15.178:0/2725052554 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb4003b80 con 0x7f7cbc15db00 2024-04-25T09:01:04.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cb2a00640 1 -- 172.21.15.178:0/2725052554 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb4003d20 con 0x7f7cbc15db00 2024-04-25T09:01:04.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cb2a00640 1 -- 172.21.15.178:0/2725052554 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb400aa30 con 0x7f7cbc15db00 2024-04-25T09:01:04.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cc1a00640 1 -- 172.21.15.178:0/2725052554 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cbc06e960 con 0x7f7cbc15db00 2024-04-25T09:01:04.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cc1a00640 1 -- 172.21.15.178:0/2725052554 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cbc06ef20 con 0x7f7cbc15db00 2024-04-25T09:01:04.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cb2a00640 1 -- 172.21.15.178:0/2725052554 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7cb400abd0 con 0x7f7cbc15db00 2024-04-25T09:01:04.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.013+0000 7f7cb2a00640 1 -- 172.21.15.178:0/2725052554 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f7cb4005560 con 0x7f7cbc15db00 2024-04-25T09:01:04.007 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.017+0000 7f7cc1a00640 1 -- 172.21.15.178:0/2725052554 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cbc0745d0 con 0x7f7cbc15db00 2024-04-25T09:01:04.008 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.017+0000 7f7cb2a00640 1 -- 172.21.15.178:0/2725052554 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7cb40050d0 con 0x7f7cbc15db00 2024-04-25T09:01:04.075 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.085+0000 7f7cc1a00640 1 -- 172.21.15.178:0/2725052554 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "21abdd03-dae8-4933-9679-a1feb524d636", "id": 3} v 0) v1 -- 0x7f7cbc15f340 con 0x7f7cbc15db00 2024-04-25T09:01:04.081 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.089+0000 7f7cb2a00640 1 -- 172.21.15.178:0/2725052554 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "21abdd03-dae8-4933-9679-a1feb524d636", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7cb4005370 con 0x7f7cbc15db00 2024-04-25T09:01:04.081 INFO:teuthology.orchestra.run.smithi178.stdout:3 2024-04-25T09:01:04.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.089+0000 7f7cc1a00640 1 -- 172.21.15.178:0/2725052554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cbc15db00 msgr2=0x7f7cbc06f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.089+0000 7f7cc1a00640 1 --2- 172.21.15.178:0/2725052554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cbc15db00 0x7f7cbc06f740 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400c730 tx=0x7f7cb400cbf0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.089+0000 7f7cc1a00640 1 -- 172.21.15.178:0/2725052554 shutdown_connections 2024-04-25T09:01:04.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.089+0000 7f7cc1a00640 1 --2- 172.21.15.178:0/2725052554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7cbc15db00 0x7f7cbc06f740 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.089+0000 7f7cc1a00640 1 --2- 172.21.15.178:0/2725052554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7cbc0aec50 0x7f7cbc06f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.089+0000 7f7cc1a00640 1 --2- 172.21.15.178:0/2725052554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cbc0701d0 0x7f7cbc146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.089+0000 7f7cc1a00640 1 -- 172.21.15.178:0/2725052554 >> 172.21.15.178:0/2725052554 conn(0x7f7cbc0cc830 msgr2=0x7f7cbc06b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.089+0000 7f7cc1a00640 1 -- 172.21.15.178:0/2725052554 shutdown_connections 2024-04-25T09:01:04.082 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.089+0000 7f7cc1a00640 1 -- 172.21.15.178:0/2725052554 wait complete. 2024-04-25T09:01:04.095 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:04.104+0000 7fd3e0ed3180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T09:01:04.108 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 9da1a78e-132b-44a1-ba14-dea9974196cc 4 2024-04-25T09:01:04.157 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:04.165+0000 7f73b7d93180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T09:01:04.236 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:04.245+0000 7f73b7d93180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T09:01:04.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1367c00640 1 Processor -- start 2024-04-25T09:01:04.242 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1367c00640 1 -- start start 2024-04-25T09:01:04.244 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1367c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f136015db00 0x7f13600b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1367c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1360161db0 0x7f13600acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1367c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13600af480 con 0x7f13600701d0 2024-04-25T09:01:04.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1367c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13600b4e80 con 0x7f1360161db0 2024-04-25T09:01:04.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1367c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136015dee0 con 0x7f136015db00 2024-04-25T09:01:04.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1365200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f136015db00 0x7f13600b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1365200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f136015db00 0x7f13600b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:42288/0 (socket says 172.21.15.178:42288) 2024-04-25T09:01:04.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1365200640 1 -- 172.21.15.178:0/2090137208 learned_addr learned my addr 172.21.15.178:0/2090137208 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-25T09:01:04.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1365c00640 1 --2- 172.21.15.178:0/2090137208 >> v2:172.21.15.59:3300/0 conn(0x7f1360161db0 0x7f13600acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1365200640 1 -- 172.21.15.178:0/2090137208 >> v2:172.21.15.59:3300/0 conn(0x7f1360161db0 msgr2=0x7f13600acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1365200640 1 --2- 172.21.15.178:0/2090137208 >> v2:172.21.15.59:3300/0 conn(0x7f1360161db0 0x7f13600acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1365200640 1 -- 172.21.15.178:0/2090137208 >> v1:172.21.15.59:6789/0 conn(0x7f13600701d0 legacy=0x7f13601616a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.245 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.253+0000 7f1365200640 1 -- 172.21.15.178:0/2090137208 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600af1a0 con 0x7f136015db00 2024-04-25T09:01:04.247 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.257+0000 7f1365200640 1 --2- 172.21.15.178:0/2090137208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f136015db00 0x7f13600b2e50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f136006c7b0 tx=0x7f135401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=742bec558ea3d09f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.257+0000 7f135f400640 1 -- 172.21.15.178:0/2090137208 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540aa650 con 0x7f136015db00 2024-04-25T09:01:04.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.257+0000 7f135f400640 1 -- 172.21.15.178:0/2090137208 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13540af070 con 0x7f136015db00 2024-04-25T09:01:04.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.257+0000 7f135f400640 1 -- 172.21.15.178:0/2090137208 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13540aaa10 con 0x7f136015db00 2024-04-25T09:01:04.248 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.257+0000 7f1367c00640 1 -- 172.21.15.178:0/2090137208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f136015db00 msgr2=0x7f13600b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.257+0000 7f1367c00640 1 --2- 172.21.15.178:0/2090137208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f136015db00 0x7f13600b2e50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f136006c7b0 tx=0x7f135401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.257+0000 7f1367c00640 1 -- 172.21.15.178:0/2090137208 shutdown_connections 2024-04-25T09:01:04.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.257+0000 7f1367c00640 1 --2- 172.21.15.178:0/2090137208 >> v2:172.21.15.59:3300/0 conn(0x7f1360161db0 0x7f13600acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.257+0000 7f1367c00640 1 --2- 172.21.15.178:0/2090137208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f136015db00 0x7f13600b2e50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.257+0000 7f1367c00640 1 -- 172.21.15.178:0/2090137208 >> 172.21.15.178:0/2090137208 conn(0x7f13600cc830 msgr2=0x7f13600ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.257+0000 7f1367c00640 1 -- 172.21.15.178:0/2090137208 shutdown_connections 2024-04-25T09:01:04.249 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.257+0000 7f1367c00640 1 -- 172.21.15.178:0/2090137208 wait complete. 2024-04-25T09:01:04.250 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1367c00640 1 Processor -- start 2024-04-25T09:01:04.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1367c00640 1 -- start start 2024-04-25T09:01:04.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1367c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13600701d0 0x7f1360151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1367c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f136015db00 0x7f1360152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1367c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1360161db0 0x7f1360155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1367c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13600ad6f0 con 0x7f13600701d0 2024-04-25T09:01:04.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1367c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1360162550 con 0x7f1360161db0 2024-04-25T09:01:04.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1367c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13600ad870 con 0x7f136015db00 2024-04-25T09:01:04.253 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1365c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1360161db0 0x7f1360155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f135fe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f136015db00 0x7f1360152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1365c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1360161db0 0x7f1360155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:42296/0 (socket says 172.21.15.178:42296) 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1365c00640 1 -- 172.21.15.178:0/4089222636 learned_addr learned my addr 172.21.15.178:0/4089222636 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1365200640 1 --2- 172.21.15.178:0/4089222636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13600701d0 0x7f1360151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f135fe00640 1 -- 172.21.15.178:0/4089222636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1360161db0 msgr2=0x7f1360155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f135fe00640 1 --2- 172.21.15.178:0/4089222636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1360161db0 0x7f1360155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f135fe00640 1 -- 172.21.15.178:0/4089222636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13600701d0 msgr2=0x7f1360151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f135fe00640 1 --2- 172.21.15.178:0/4089222636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13600701d0 0x7f1360151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f135fe00640 1 -- 172.21.15.178:0/4089222636 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1360152f40 con 0x7f136015db00 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1365c00640 1 --2- 172.21.15.178:0/4089222636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1360161db0 0x7f1360155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1365200640 1 --2- 172.21.15.178:0/4089222636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13600701d0 0x7f1360151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f135fe00640 1 --2- 172.21.15.178:0/4089222636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f136015db00 0x7f1360152510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f134c00c3f0 tx=0x7f134c00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.254 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f135cc00640 1 -- 172.21.15.178:0/4089222636 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c0052d0 con 0x7f136015db00 2024-04-25T09:01:04.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f135cc00640 1 -- 172.21.15.178:0/4089222636 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134c005470 con 0x7f136015db00 2024-04-25T09:01:04.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1367c00640 1 -- 172.21.15.178:0/4089222636 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1360153220 con 0x7f136015db00 2024-04-25T09:01:04.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f135cc00640 1 -- 172.21.15.178:0/4089222636 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134c007260 con 0x7f136015db00 2024-04-25T09:01:04.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1367c00640 1 -- 172.21.15.178:0/4089222636 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13601537e0 con 0x7f136015db00 2024-04-25T09:01:04.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f135cc00640 1 -- 172.21.15.178:0/4089222636 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f134c007400 con 0x7f136015db00 2024-04-25T09:01:04.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f135cc00640 1 -- 172.21.15.178:0/4089222636 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f134c0067e0 con 0x7f136015db00 2024-04-25T09:01:04.255 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.261+0000 7f1367c00640 1 -- 172.21.15.178:0/4089222636 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13600cd6d0 con 0x7f136015db00 2024-04-25T09:01:04.256 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.265+0000 7f135cc00640 1 -- 172.21.15.178:0/4089222636 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f134c006b00 con 0x7f136015db00 2024-04-25T09:01:04.299 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:04.309+0000 7f73b7d93180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T09:01:04.322 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.333+0000 7f1367c00640 1 -- 172.21.15.178:0/4089222636 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9da1a78e-132b-44a1-ba14-dea9974196cc", "id": 4} v 0) v1 -- 0x7f136006ac10 con 0x7f136015db00 2024-04-25T09:01:04.325 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:04.336+0000 7fd3e0ed3180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T09:01:04.326 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.337+0000 7f135cc00640 1 -- 172.21.15.178:0/4089222636 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9da1a78e-132b-44a1-ba14-dea9974196cc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f134c006ce0 con 0x7f136015db00 2024-04-25T09:01:04.327 INFO:teuthology.orchestra.run.smithi178.stdout:4 2024-04-25T09:01:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.337+0000 7f1367c00640 1 -- 172.21.15.178:0/4089222636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f136015db00 msgr2=0x7f1360152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.337+0000 7f1367c00640 1 --2- 172.21.15.178:0/4089222636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f136015db00 0x7f1360152510 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f134c00c3f0 tx=0x7f134c00c8b0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.337+0000 7f1367c00640 1 -- 172.21.15.178:0/4089222636 shutdown_connections 2024-04-25T09:01:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.337+0000 7f1367c00640 1 --2- 172.21.15.178:0/4089222636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1360161db0 0x7f1360155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.337+0000 7f1367c00640 1 --2- 172.21.15.178:0/4089222636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f136015db00 0x7f1360152510 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.337+0000 7f1367c00640 1 --2- 172.21.15.178:0/4089222636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13600701d0 0x7f1360151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.337+0000 7f1367c00640 1 -- 172.21.15.178:0/4089222636 >> 172.21.15.178:0/4089222636 conn(0x7f13600cc830 msgr2=0x7f13600b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.337+0000 7f1367c00640 1 -- 172.21.15.178:0/4089222636 shutdown_connections 2024-04-25T09:01:04.328 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.337+0000 7f1367c00640 1 -- 172.21.15.178:0/4089222636 wait complete. 2024-04-25T09:01:04.346 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 123afa05-f260-480a-9b17-19fe5c5f4e37 5 2024-04-25T09:01:04.392 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:04.401+0000 7f73b7d93180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T09:01:04.454 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:04.465+0000 7f73b7d93180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T09:01:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.489+0000 7f97edc00640 1 Processor -- start 2024-04-25T09:01:04.481 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.489+0000 7f97edc00640 1 -- start start 2024-04-25T09:01:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97edc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f97e809a170 0x7f97e80d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.483 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97edc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97e806bf30 0x7f97e80cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97edc00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e815e040 con 0x7f97e815dc60 2024-04-25T09:01:04.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97edc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e80cff80 con 0x7f97e806bf30 2024-04-25T09:01:04.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97edc00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e80d0260 con 0x7f97e809a170 2024-04-25T09:01:04.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97e6a00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f97e815dc60 0x7f97e8099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:49314/0 (socket says 172.21.15.178:49314) 2024-04-25T09:01:04.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97dfe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f97e809a170 0x7f97e80d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97e6a00640 1 -- 172.21.15.178:0/949818087 learned_addr learned my addr 172.21.15.178:0/949818087 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-04-25T09:01:04.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97e7400640 1 --2- 172.21.15.178:0/949818087 >> v2:172.21.15.59:3300/0 conn(0x7f97e806bf30 0x7f97e80cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97dfe00640 1 -- 172.21.15.178:0/949818087 >> v2:172.21.15.59:3300/0 conn(0x7f97e806bf30 msgr2=0x7f97e80cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97dfe00640 1 --2- 172.21.15.178:0/949818087 >> v2:172.21.15.59:3300/0 conn(0x7f97e806bf30 0x7f97e80cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.484 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97dfe00640 1 -- 172.21.15.178:0/949818087 >> v1:172.21.15.178:6789/0 conn(0x7f97e815dc60 legacy=0x7f97e8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.485 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97dfe00640 1 -- 172.21.15.178:0/949818087 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e80d0540 con 0x7f97e809a170 2024-04-25T09:01:04.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.493+0000 7f97dfe00640 1 --2- 172.21.15.178:0/949818087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e809a170 0x7f97e80d1020 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f97e80d2810 tx=0x7f97d001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bafc3a901ee3ac43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97e6000640 1 -- 172.21.15.178:0/949818087 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d00b0070 con 0x7f97e809a170 2024-04-25T09:01:04.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97e6000640 1 -- 172.21.15.178:0/949818087 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d00ab600 con 0x7f97e809a170 2024-04-25T09:01:04.486 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97e6000640 1 -- 172.21.15.178:0/949818087 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d00ab9d0 con 0x7f97e809a170 2024-04-25T09:01:04.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 -- 172.21.15.178:0/949818087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e809a170 msgr2=0x7f97e80d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 --2- 172.21.15.178:0/949818087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e809a170 0x7f97e80d1020 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f97e80d2810 tx=0x7f97d001c330 comp rx=0 tx=0).stop 2024-04-25T09:01:04.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 -- 172.21.15.178:0/949818087 shutdown_connections 2024-04-25T09:01:04.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 --2- 172.21.15.178:0/949818087 >> v2:172.21.15.59:3300/0 conn(0x7f97e806bf30 0x7f97e80cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 --2- 172.21.15.178:0/949818087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e809a170 0x7f97e80d1020 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 -- 172.21.15.178:0/949818087 >> 172.21.15.178:0/949818087 conn(0x7f97e80b3200 msgr2=0x7f97e80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 -- 172.21.15.178:0/949818087 shutdown_connections 2024-04-25T09:01:04.487 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 -- 172.21.15.178:0/949818087 wait complete. 2024-04-25T09:01:04.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 Processor -- start 2024-04-25T09:01:04.488 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 -- start start 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e806bf30 0x7f97e80cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97e809a170 0x7f97e80c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97e815dc60 0x7f97e8153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80cc6f0 con 0x7f97e815dc60 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80cc570 con 0x7f97e806bf30 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97edc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e80cc870 con 0x7f97e809a170 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97e6a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e806bf30 0x7f97e80cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97dfe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97e809a170 0x7f97e80c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97dfe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97e809a170 0x7f97e80c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:39002/0 (socket says 172.21.15.178:39002) 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97dfe00640 1 -- 172.21.15.178:0/3981128030 learned_addr learned my addr 172.21.15.178:0/3981128030 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.497+0000 7f97e7400640 1 --2- 172.21.15.178:0/3981128030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97e815dc60 0x7f97e8153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.492 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97dfe00640 1 -- 172.21.15.178:0/3981128030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e806bf30 msgr2=0x7f97e80cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97dfe00640 1 --2- 172.21.15.178:0/3981128030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e806bf30 0x7f97e80cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97dfe00640 1 -- 172.21.15.178:0/3981128030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97e815dc60 msgr2=0x7f97e8153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97dfe00640 1 --2- 172.21.15.178:0/3981128030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97e815dc60 0x7f97e8153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97dfe00640 1 -- 172.21.15.178:0/3981128030 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e8154090 con 0x7f97e809a170 2024-04-25T09:01:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97dfe00640 1 --2- 172.21.15.178:0/3981128030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97e809a170 0x7f97e80c87e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f97d00ae040 tx=0x7f97d00190d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97dea00640 1 -- 172.21.15.178:0/3981128030 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d00b8020 con 0x7f97e809a170 2024-04-25T09:01:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97dea00640 1 -- 172.21.15.178:0/3981128030 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d00b4410 con 0x7f97e809a170 2024-04-25T09:01:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97edc00640 1 -- 172.21.15.178:0/3981128030 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e80c8ee0 con 0x7f97e809a170 2024-04-25T09:01:04.493 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97dea00640 1 -- 172.21.15.178:0/3981128030 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d00b0040 con 0x7f97e809a170 2024-04-25T09:01:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97edc00640 1 -- 172.21.15.178:0/3981128030 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e80c94a0 con 0x7f97e809a170 2024-04-25T09:01:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97dea00640 1 -- 172.21.15.178:0/3981128030 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f97d00bb020 con 0x7f97e809a170 2024-04-25T09:01:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97dea00640 1 -- 172.21.15.178:0/3981128030 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f97d00bdde0 con 0x7f97e809a170 2024-04-25T09:01:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.501+0000 7f97edc00640 1 -- 172.21.15.178:0/3981128030 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e80745d0 con 0x7f97e809a170 2024-04-25T09:01:04.494 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.505+0000 7f97dea00640 1 -- 172.21.15.178:0/3981128030 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f97d00c2030 con 0x7f97e809a170 2024-04-25T09:01:04.577 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:04.585+0000 7f73b7d93180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T09:01:04.598 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.609+0000 7f97edc00640 1 -- 172.21.15.178:0/3981128030 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd new", "uuid": "123afa05-f260-480a-9b17-19fe5c5f4e37", "id": 5} v 0) v1 -- 0x7f97e80b7590 con 0x7f97e809a170 2024-04-25T09:01:04.603 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.613+0000 7f97dea00640 1 -- 172.21.15.178:0/3981128030 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "123afa05-f260-480a-9b17-19fe5c5f4e37", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f97d0016070 con 0x7f97e809a170 2024-04-25T09:01:04.603 INFO:teuthology.orchestra.run.smithi178.stdout:5 2024-04-25T09:01:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.613+0000 7f97edc00640 1 -- 172.21.15.178:0/3981128030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97e809a170 msgr2=0x7f97e80c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.613+0000 7f97edc00640 1 --2- 172.21.15.178:0/3981128030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97e809a170 0x7f97e80c87e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f97d00ae040 tx=0x7f97d00190d0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.613+0000 7f97edc00640 1 -- 172.21.15.178:0/3981128030 shutdown_connections 2024-04-25T09:01:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.613+0000 7f97edc00640 1 --2- 172.21.15.178:0/3981128030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97e815dc60 0x7f97e8153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.604 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.613+0000 7f97edc00640 1 --2- 172.21.15.178:0/3981128030 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97e809a170 0x7f97e80c87e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.613+0000 7f97edc00640 1 --2- 172.21.15.178:0/3981128030 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97e806bf30 0x7f97e80cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.613+0000 7f97edc00640 1 -- 172.21.15.178:0/3981128030 >> 172.21.15.178:0/3981128030 conn(0x7f97e80b3200 msgr2=0x7f97e8070340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.613+0000 7f97edc00640 1 -- 172.21.15.178:0/3981128030 shutdown_connections 2024-04-25T09:01:04.605 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.613+0000 7f97edc00640 1 -- 172.21.15.178:0/3981128030 wait complete. 2024-04-25T09:01:04.622 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 763deab5-bcc1-45b7-bbbd-7c5b01333702 6 2024-04-25T09:01:04.643 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:04.649+0000 7f73b7d93180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T09:01:04.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab3400640 1 Processor -- start 2024-04-25T09:01:04.760 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab3400640 1 -- start start 2024-04-25T09:01:04.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab3400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcaac0cf3c0 0x7fcaac0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab3400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcaac0cd370 0x7fcaac099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab3400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac0d02a0 con 0x7fcaac15b910 2024-04-25T09:01:04.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab3400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac0cc350 con 0x7fcaac0cf3c0 2024-04-25T09:01:04.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab3400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac0cc630 con 0x7fcaac0cd370 2024-04-25T09:01:04.761 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab0a00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fcaac15b910 0x7fcaac0cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.178:49330/0 (socket says 172.21.15.178:49330) 2024-04-25T09:01:04.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab0a00640 1 -- 172.21.15.178:0/2749240559 learned_addr learned my addr 172.21.15.178:0/2749240559 (peer_addr_for_me v1:172.21.15.178:0/0) 2024-04-25T09:01:04.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab1400640 1 --2- 172.21.15.178:0/2749240559 >> v2:172.21.15.178:3300/0 conn(0x7fcaac0cd370 0x7fcaac099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcaab400640 1 -- 172.21.15.178:0/2749240559 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394808675 0 0) 0x7fcaac0d02a0 con 0x7fcaac15b910 2024-04-25T09:01:04.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcaab400640 1 -- 172.21.15.178:0/2749240559 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca94003530 con 0x7fcaac15b910 2024-04-25T09:01:04.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab1400640 1 -- 172.21.15.178:0/2749240559 >> v2:172.21.15.59:3300/0 conn(0x7fcaac0cf3c0 msgr2=0x7fcaac0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:04.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab1400640 1 --2- 172.21.15.178:0/2749240559 >> v2:172.21.15.59:3300/0 conn(0x7fcaac0cf3c0 0x7fcaac0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab1400640 1 -- 172.21.15.178:0/2749240559 >> v1:172.21.15.178:6789/0 conn(0x7fcaac15b910 legacy=0x7fcaac0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.762 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.769+0000 7fcab1400640 1 -- 172.21.15.178:0/2749240559 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac0cc910 con 0x7fcaac0cd370 2024-04-25T09:01:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.773+0000 7fcab1400640 1 --2- 172.21.15.178:0/2749240559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaac0cd370 0x7fcaac099a60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcaac09b210 tx=0x7fcaa401c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df53512730a0217c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.773+0000 7fcaab400640 1 -- 172.21.15.178:0/2749240559 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40b2070 con 0x7fcaac0cd370 2024-04-25T09:01:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.773+0000 7fcaab400640 1 -- 172.21.15.178:0/2749240559 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa40a5900 con 0x7fcaac0cd370 2024-04-25T09:01:04.764 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.773+0000 7fcaab400640 1 -- 172.21.15.178:0/2749240559 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40a5cb0 con 0x7fcaac0cd370 2024-04-25T09:01:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.773+0000 7fcab3400640 1 -- 172.21.15.178:0/2749240559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaac0cd370 msgr2=0x7fcaac099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.773+0000 7fcab3400640 1 --2- 172.21.15.178:0/2749240559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaac0cd370 0x7fcaac099a60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcaac09b210 tx=0x7fcaa401c930 comp rx=0 tx=0).stop 2024-04-25T09:01:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.773+0000 7fcab3400640 1 -- 172.21.15.178:0/2749240559 shutdown_connections 2024-04-25T09:01:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.773+0000 7fcab3400640 1 --2- 172.21.15.178:0/2749240559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaac0cd370 0x7fcaac099a60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.773+0000 7fcab3400640 1 --2- 172.21.15.178:0/2749240559 >> v2:172.21.15.59:3300/0 conn(0x7fcaac0cf3c0 0x7fcaac0cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.773+0000 7fcab3400640 1 -- 172.21.15.178:0/2749240559 >> 172.21.15.178:0/2749240559 conn(0x7fcaac0b3200 msgr2=0x7fcaac0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.773+0000 7fcab3400640 1 -- 172.21.15.178:0/2749240559 shutdown_connections 2024-04-25T09:01:04.765 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.773+0000 7fcab3400640 1 -- 172.21.15.178:0/2749240559 wait complete. 2024-04-25T09:01:04.766 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab3400640 1 Processor -- start 2024-04-25T09:01:04.767 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab3400640 1 -- start start 2024-04-25T09:01:04.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaac0cd370 0x7fcaac0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab3400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaac0cf3c0 0x7fcaac0c41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaac15b910 0x7fcaac15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:04.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab3400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac168d30 con 0x7fcaac0cd370 2024-04-25T09:01:04.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab3400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac168bb0 con 0x7fcaac15b910 2024-04-25T09:01:04.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab3400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac168eb0 con 0x7fcaac0cf3c0 2024-04-25T09:01:04.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab1400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaac15b910 0x7fcaac15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcaabe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaac0cf3c0 0x7fcaac0c41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab1400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaac15b910 0x7fcaac15a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:42324/0 (socket says 172.21.15.178:42324) 2024-04-25T09:01:04.769 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab1400640 1 -- 172.21.15.178:0/3953981952 learned_addr learned my addr 172.21.15.178:0/3953981952 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab0a00640 1 --2- 172.21.15.178:0/3953981952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaac0cd370 0x7fcaac0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab1400640 1 -- 172.21.15.178:0/3953981952 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaac0cf3c0 msgr2=0x7fcaac0c41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab1400640 1 --2- 172.21.15.178:0/3953981952 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaac0cf3c0 0x7fcaac0c41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab1400640 1 -- 172.21.15.178:0/3953981952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaac0cd370 msgr2=0x7fcaac0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab1400640 1 --2- 172.21.15.178:0/3953981952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaac0cd370 0x7fcaac0cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab1400640 1 -- 172.21.15.178:0/3953981952 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac153190 con 0x7fcaac15b910 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab0a00640 1 --2- 172.21.15.178:0/3953981952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaac0cd370 0x7fcaac0cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcaabe00640 1 --2- 172.21.15.178:0/3953981952 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaac0cf3c0 0x7fcaac0c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab1400640 1 --2- 172.21.15.178:0/3953981952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaac15b910 0x7fcaac15a140 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40b0040 tx=0x7fcaa40196d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcaa8c00640 1 -- 172.21.15.178:0/3953981952 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40b2050 con 0x7fcaac15b910 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcaa8c00640 1 -- 172.21.15.178:0/3953981952 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa40be070 con 0x7fcaac15b910 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcaa8c00640 1 -- 172.21.15.178:0/3953981952 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40ada70 con 0x7fcaac15b910 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab3400640 1 -- 172.21.15.178:0/3953981952 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac1590a0 con 0x7fcaac15b910 2024-04-25T09:01:04.770 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcab3400640 1 -- 172.21.15.178:0/3953981952 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac159660 con 0x7fcaac15b910 2024-04-25T09:01:04.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcaa8c00640 1 -- 172.21.15.178:0/3953981952 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fcaa40adc10 con 0x7fcaac15b910 2024-04-25T09:01:04.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.777+0000 7fcaa8c00640 1 -- 172.21.15.178:0/3953981952 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fcaa40c3cd0 con 0x7fcaac15b910 2024-04-25T09:01:04.771 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.781+0000 7fcab3400640 1 -- 172.21.15.178:0/3953981952 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac0745d0 con 0x7fcaac15b910 2024-04-25T09:01:04.772 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.781+0000 7fcaa8c00640 1 -- 172.21.15.178:0/3953981952 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fcaac153190 con 0x7fcaac15b910 2024-04-25T09:01:04.815 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:04.825+0000 7f73b7d93180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T09:01:04.839 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.849+0000 7fcab3400640 1 -- 172.21.15.178:0/3953981952 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "763deab5-bcc1-45b7-bbbd-7c5b01333702", "id": 6} v 0) v1 -- 0x7fcaac0b3f70 con 0x7fcaac15b910 2024-04-25T09:01:04.843 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.853+0000 7fcaa8c00640 1 -- 172.21.15.178:0/3953981952 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "763deab5-bcc1-45b7-bbbd-7c5b01333702", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcaa4016520 con 0x7fcaac15b910 2024-04-25T09:01:04.843 INFO:teuthology.orchestra.run.smithi178.stdout:6 2024-04-25T09:01:04.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.853+0000 7fcab3400640 1 -- 172.21.15.178:0/3953981952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaac15b910 msgr2=0x7fcaac15a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:04.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.853+0000 7fcab3400640 1 --2- 172.21.15.178:0/3953981952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaac15b910 0x7fcaac15a140 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40b0040 tx=0x7fcaa40196d0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.853+0000 7fcab3400640 1 -- 172.21.15.178:0/3953981952 shutdown_connections 2024-04-25T09:01:04.844 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.853+0000 7fcab3400640 1 --2- 172.21.15.178:0/3953981952 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaac15b910 0x7fcaac15a140 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.853+0000 7fcab3400640 1 --2- 172.21.15.178:0/3953981952 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaac0cf3c0 0x7fcaac0c41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.853+0000 7fcab3400640 1 --2- 172.21.15.178:0/3953981952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaac0cd370 0x7fcaac0cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:04.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.853+0000 7fcab3400640 1 -- 172.21.15.178:0/3953981952 >> 172.21.15.178:0/3953981952 conn(0x7fcaac0b3200 msgr2=0x7fcaac09a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:04.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.853+0000 7fcab3400640 1 -- 172.21.15.178:0/3953981952 shutdown_connections 2024-04-25T09:01:04.845 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:04.853+0000 7fcab3400640 1 -- 172.21.15.178:0/3953981952 wait complete. 2024-04-25T09:01:04.862 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 69da5016-1cc8-49cc-9ac5-e33bac0e788d 7 2024-04-25T09:01:04.890 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:04.897+0000 7f73b7d93180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T09:01:04.963 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:04.972+0000 7fd3e0ed3180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.033+0000 7f3cdd000640 1 Processor -- start 2024-04-25T09:01:05.025 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.033+0000 7f3cdd000640 1 -- start start 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3cdd000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd80cc400 0x7f3cd80669a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3cdd000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3cd80aef60 0x7f3cd80cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3cdd000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd80cfb90 con 0x7f3cd8070020 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3cdd000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd815cc30 con 0x7f3cd80aef60 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3cdd000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80acfb0 con 0x7f3cd80cc400 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3ccfe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd80cc400 0x7f3cd80669a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3ccfe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd80cc400 0x7f3cd80669a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.178:60606/0 (socket says 172.21.15.178:60606) 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3ccfe00640 1 -- 172.21.15.178:0/3819939257 learned_addr learned my addr 172.21.15.178:0/3819939257 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3cd6800640 1 --2- 172.21.15.178:0/3819939257 >> v2:172.21.15.178:3300/0 conn(0x7f3cd80aef60 0x7f3cd80cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.027 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3ccfe00640 1 -- 172.21.15.178:0/3819939257 >> v2:172.21.15.178:3300/0 conn(0x7f3cd80aef60 msgr2=0x7f3cd80cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3ccfe00640 1 --2- 172.21.15.178:0/3819939257 >> v2:172.21.15.178:3300/0 conn(0x7f3cd80aef60 0x7f3cd80cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3ccfe00640 1 -- 172.21.15.178:0/3819939257 >> v1:172.21.15.59:6789/0 conn(0x7f3cd8070020 legacy=0x7f3cd80ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.028 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3ccfe00640 1 -- 172.21.15.178:0/3819939257 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80cf670 con 0x7f3cd80cc400 2024-04-25T09:01:05.028 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:05.036+0000 7fd3e0ed3180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T09:01:05.029 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.037+0000 7f3ccfe00640 1 --2- 172.21.15.178:0/3819939257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd80cc400 0x7f3cd80669a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009870 tx=0x7f3cc001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79b61af2de6fe855 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cd5400640 1 -- 172.21.15.178:0/3819939257 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00b0070 con 0x7f3cd80cc400 2024-04-25T09:01:05.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cd5400640 1 -- 172.21.15.178:0/3819939257 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc00ab600 con 0x7f3cd80cc400 2024-04-25T09:01:05.030 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cd5400640 1 -- 172.21.15.178:0/3819939257 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00ab9d0 con 0x7f3cd80cc400 2024-04-25T09:01:05.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 -- 172.21.15.178:0/3819939257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd80cc400 msgr2=0x7f3cd80669a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 --2- 172.21.15.178:0/3819939257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd80cc400 0x7f3cd80669a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009870 tx=0x7f3cc001c4d0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 -- 172.21.15.178:0/3819939257 shutdown_connections 2024-04-25T09:01:05.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 --2- 172.21.15.178:0/3819939257 >> v2:172.21.15.178:3300/0 conn(0x7f3cd80aef60 0x7f3cd80cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 --2- 172.21.15.178:0/3819939257 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd80cc400 0x7f3cd80669a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.031 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 -- 172.21.15.178:0/3819939257 >> 172.21.15.178:0/3819939257 conn(0x7f3cd80cc830 msgr2=0x7f3cd80ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 -- 172.21.15.178:0/3819939257 shutdown_connections 2024-04-25T09:01:05.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 -- 172.21.15.178:0/3819939257 wait complete. 2024-04-25T09:01:05.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 Processor -- start 2024-04-25T09:01:05.032 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 -- start start 2024-04-25T09:01:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd8070020 0x7f3cd814f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd80aef60 0x7f3cd8151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd80cc400 0x7f3cd8153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80ceb80 con 0x7f3cd8070020 2024-04-25T09:01:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80cea00 con 0x7f3cd80aef60 2024-04-25T09:01:05.035 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cdd000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80ced00 con 0x7f3cd80cc400 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3ccfe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd80aef60 0x7f3cd8151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3ccfe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd80aef60 0x7f3cd8151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.178:35490/0 (socket says 172.21.15.178:35490) 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3ccfe00640 1 -- 172.21.15.178:0/1683895337 learned_addr learned my addr 172.21.15.178:0/1683895337 (peer_addr_for_me v2:172.21.15.178:0/0) 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cd6800640 1 --2- 172.21.15.178:0/1683895337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd80cc400 0x7f3cd8153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.041+0000 7f3cd5e00640 1 --2- 172.21.15.178:0/1683895337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd8070020 0x7f3cd814f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3ccfe00640 1 -- 172.21.15.178:0/1683895337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd80cc400 msgr2=0x7f3cd8153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3ccfe00640 1 --2- 172.21.15.178:0/1683895337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd80cc400 0x7f3cd8153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3ccfe00640 1 -- 172.21.15.178:0/1683895337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd8070020 msgr2=0x7f3cd814f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3ccfe00640 1 --2- 172.21.15.178:0/1683895337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd8070020 0x7f3cd814f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3ccfe00640 1 -- 172.21.15.178:0/1683895337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd8156460 con 0x7f3cd80aef60 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3ccfe00640 1 --2- 172.21.15.178:0/1683895337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd80aef60 0x7f3cd8151670 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00ae040 tx=0x7f3cc0019270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3cce000640 1 -- 172.21.15.178:0/1683895337 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00b0040 con 0x7f3cd80aef60 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3cce000640 1 -- 172.21.15.178:0/1683895337 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc00ab400 con 0x7f3cd80aef60 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3cdd000640 1 -- 172.21.15.178:0/1683895337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd8151e10 con 0x7f3cd80aef60 2024-04-25T09:01:05.036 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3cce000640 1 -- 172.21.15.178:0/1683895337 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00b4680 con 0x7f3cd80aef60 2024-04-25T09:01:05.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3cdd000640 1 -- 172.21.15.178:0/1683895337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd80b2f60 con 0x7f3cd80aef60 2024-04-25T09:01:05.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3cce000640 1 -- 172.21.15.178:0/1683895337 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3cc00bb020 con 0x7f3cd80aef60 2024-04-25T09:01:05.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3cce000640 1 -- 172.21.15.178:0/1683895337 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f3cc00ab5b0 con 0x7f3cd80aef60 2024-04-25T09:01:05.037 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.045+0000 7f3cdd000640 1 -- 172.21.15.178:0/1683895337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd80745d0 con 0x7f3cd80aef60 2024-04-25T09:01:05.038 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.049+0000 7f3cce000640 1 -- 172.21.15.178:0/1683895337 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3cc00c2020 con 0x7f3cd80aef60 2024-04-25T09:01:05.092 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:05.100+0000 7fd3e0ed3180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T09:01:05.103 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.113+0000 7f3cdd000640 1 -- 172.21.15.178:0/1683895337 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd new", "uuid": "69da5016-1cc8-49cc-9ac5-e33bac0e788d", "id": 7} v 0) v1 -- 0x7f3cd80b5e90 con 0x7f3cd80aef60 2024-04-25T09:01:05.107 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.117+0000 7f3cce000640 1 -- 172.21.15.178:0/1683895337 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "69da5016-1cc8-49cc-9ac5-e33bac0e788d", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3cc0016150 con 0x7f3cd80aef60 2024-04-25T09:01:05.108 INFO:teuthology.orchestra.run.smithi178.stdout:7 2024-04-25T09:01:05.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.117+0000 7f3cdd000640 1 -- 172.21.15.178:0/1683895337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd80aef60 msgr2=0x7f3cd8151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.117+0000 7f3cdd000640 1 --2- 172.21.15.178:0/1683895337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd80aef60 0x7f3cd8151670 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3cc00ae040 tx=0x7f3cc0019270 comp rx=0 tx=0).stop 2024-04-25T09:01:05.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.117+0000 7f3cdd000640 1 -- 172.21.15.178:0/1683895337 shutdown_connections 2024-04-25T09:01:05.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.117+0000 7f3cdd000640 1 --2- 172.21.15.178:0/1683895337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3cd80cc400 0x7f3cd8153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.117+0000 7f3cdd000640 1 --2- 172.21.15.178:0/1683895337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3cd80aef60 0x7f3cd8151670 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.117+0000 7f3cdd000640 1 --2- 172.21.15.178:0/1683895337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3cd8070020 0x7f3cd814f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.117+0000 7f3cdd000640 1 -- 172.21.15.178:0/1683895337 >> 172.21.15.178:0/1683895337 conn(0x7f3cd80cc830 msgr2=0x7f3cd80ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.109 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.117+0000 7f3cdd000640 1 -- 172.21.15.178:0/1683895337 shutdown_connections 2024-04-25T09:01:05.110 INFO:teuthology.orchestra.run.smithi178.stderr:2024-04-25T09:01:05.117+0000 7f3cdd000640 1 -- 172.21.15.178:0/1683895337 wait complete. 2024-04-25T09:01:05.127 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T09:01:05.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T09:01:05.131 INFO:tasks.ceph.osd.0:Started 2024-04-25T09:01:05.131 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T09:01:05.131 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T09:01:05.134 INFO:tasks.ceph.osd.1:Started 2024-04-25T09:01:05.134 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T09:01:05.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T09:01:05.137 INFO:tasks.ceph.osd.2:Started 2024-04-25T09:01:05.137 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T09:01:05.137 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T09:01:05.141 INFO:tasks.ceph.osd.3:Started 2024-04-25T09:01:05.142 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T09:01:05.142 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T09:01:05.145 INFO:tasks.ceph.osd.4:Started 2024-04-25T09:01:05.145 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T09:01:05.145 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T09:01:05.148 INFO:tasks.ceph.osd.5:Started 2024-04-25T09:01:05.148 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T09:01:05.148 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T09:01:05.151 INFO:tasks.ceph.osd.6:Started 2024-04-25T09:01:05.151 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T09:01:05.151 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T09:01:05.158 INFO:tasks.ceph.osd.7:Started 2024-04-25T09:01:05.158 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:05.197 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:05.208+0000 7fd3e0ed3180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T09:01:05.289 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:05.300+0000 7fd3e0ed3180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T09:01:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.336+0000 7f2122e00640 1 Processor -- start 2024-04-25T09:01:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.336+0000 7f2122e00640 1 -- start start 2024-04-25T09:01:05.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f2122e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c15b5a0 0x7f211c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f2122e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f211c0cc440 0x7f211c0d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f2122e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c0ce7f0 con 0x7f211c15b980 2024-04-25T09:01:05.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f2122e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c0cfcd0 con 0x7f211c0cc440 2024-04-25T09:01:05.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f2122e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0cead0 con 0x7f211c15b5a0 2024-04-25T09:01:05.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f211be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c15b5a0 0x7f211c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f2120e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f211c0cc440 0x7f211c0d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f2113e00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f211c15b980 0x7f211c0cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:55734/0 (socket says 172.21.15.59:55734) 2024-04-25T09:01:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f2113e00640 1 -- 172.21.15.59:0/3219638985 learned_addr learned my addr 172.21.15.59:0/3219638985 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f211be00640 1 -- 172.21.15.59:0/3219638985 >> v2:172.21.15.178:3300/0 conn(0x7f211c0cc440 msgr2=0x7f211c0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f211be00640 1 --2- 172.21.15.59:0/3219638985 >> v2:172.21.15.178:3300/0 conn(0x7f211c0cc440 0x7f211c0d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f211be00640 1 -- 172.21.15.59:0/3219638985 >> v1:172.21.15.178:6789/0 conn(0x7f211c15b980 legacy=0x7f211c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.340+0000 7f211be00640 1 -- 172.21.15.59:0/3219638985 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c0cf960 con 0x7f211c15b5a0 2024-04-25T09:01:05.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f211be00640 1 --2- 172.21.15.59:0/3219638985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c15b5a0 0x7f211c0cdea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f210c0097c0 tx=0x7f210c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3ccb223385774fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f211b400640 1 -- 172.21.15.59:0/3219638985 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0aa620 con 0x7f211c15b5a0 2024-04-25T09:01:05.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f211b400640 1 -- 172.21.15.59:0/3219638985 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c0af070 con 0x7f211c15b5a0 2024-04-25T09:01:05.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f211b400640 1 -- 172.21.15.59:0/3219638985 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0aa9e0 con 0x7f211c15b5a0 2024-04-25T09:01:05.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f2122e00640 1 -- 172.21.15.59:0/3219638985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c15b5a0 msgr2=0x7f211c0cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f2122e00640 1 --2- 172.21.15.59:0/3219638985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c15b5a0 0x7f211c0cdea0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f210c0097c0 tx=0x7f210c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f2122e00640 1 -- 172.21.15.59:0/3219638985 shutdown_connections 2024-04-25T09:01:05.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f2122e00640 1 --2- 172.21.15.59:0/3219638985 >> v2:172.21.15.178:3300/0 conn(0x7f211c0cc440 0x7f211c0d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f2122e00640 1 --2- 172.21.15.59:0/3219638985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c15b5a0 0x7f211c0cdea0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f2122e00640 1 -- 172.21.15.59:0/3219638985 >> 172.21.15.59:0/3219638985 conn(0x7f211c0b3390 msgr2=0x7f211c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f2122e00640 1 -- 172.21.15.59:0/3219638985 shutdown_connections 2024-04-25T09:01:05.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f2122e00640 1 -- 172.21.15.59:0/3219638985 wait complete. 2024-04-25T09:01:05.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f2122e00640 1 Processor -- start 2024-04-25T09:01:05.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.344+0000 7f2122e00640 1 -- start start 2024-04-25T09:01:05.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2122e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c0cc440 0x7f211c146170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2122e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f211c15b5a0 0x7f211c149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2122e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f211c15b980 0x7f211c14a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:05.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2122e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0d1240 con 0x7f211c15b5a0 2024-04-25T09:01:05.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2122e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0d10c0 con 0x7f211c15b980 2024-04-25T09:01:05.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2122e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0d13c0 con 0x7f211c0cc440 2024-04-25T09:01:05.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f211be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c0cc440 0x7f211c146170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2113e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f211c15b5a0 0x7f211c149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f211be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c0cc440 0x7f211c146170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:55348/0 (socket says 172.21.15.59:55348) 2024-04-25T09:01:05.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f211be00640 1 -- 172.21.15.59:0/1122982760 learned_addr learned my addr 172.21.15.59:0/1122982760 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:05.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2120e00640 1 --2- 172.21.15.59:0/1122982760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f211c15b980 0x7f211c14a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:05.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f211be00640 1 -- 172.21.15.59:0/1122982760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f211c15b980 msgr2=0x7f211c14a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f211be00640 1 --2- 172.21.15.59:0/1122982760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f211c15b980 0x7f211c14a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f211be00640 1 -- 172.21.15.59:0/1122982760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f211c15b5a0 msgr2=0x7f211c149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f211be00640 1 --2- 172.21.15.59:0/1122982760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f211c15b5a0 0x7f211c149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f211be00640 1 -- 172.21.15.59:0/1122982760 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c1467e0 con 0x7f211c0cc440 2024-04-25T09:01:05.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f211be00640 1 --2- 172.21.15.59:0/1122982760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c0cc440 0x7f211c146170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f210c01a0d0 tx=0x7f210c01ace0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:05.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2118c00640 1 -- 172.21.15.59:0/1122982760 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0aae60 con 0x7f211c0cc440 2024-04-25T09:01:05.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2118c00640 1 -- 172.21.15.59:0/1122982760 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c0be410 con 0x7f211c0cc440 2024-04-25T09:01:05.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2122e00640 1 -- 172.21.15.59:0/1122982760 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c146ac0 con 0x7f211c0cc440 2024-04-25T09:01:05.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2118c00640 1 -- 172.21.15.59:0/1122982760 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0be820 con 0x7f211c0cc440 2024-04-25T09:01:05.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2122e00640 1 -- 172.21.15.59:0/1122982760 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c147080 con 0x7f211c0cc440 2024-04-25T09:01:05.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2118c00640 1 -- 172.21.15.59:0/1122982760 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f210c0bc020 con 0x7f211c0cc440 2024-04-25T09:01:05.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2118c00640 1 -- 172.21.15.59:0/1122982760 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f210c0bed50 con 0x7f211c0cc440 2024-04-25T09:01:05.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.348+0000 7f2122e00640 1 -- 172.21.15.59:0/1122982760 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c0745d0 con 0x7f211c0cc440 2024-04-25T09:01:05.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.352+0000 7f2118c00640 1 -- 172.21.15.59:0/1122982760 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f210c016090 con 0x7f211c0cc440 2024-04-25T09:01:05.385 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:05.396+0000 7fd3e0ed3180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T09:01:05.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.412+0000 7f2122e00640 1 -- 172.21.15.59:0/1122982760 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f211c1476d0 con 0x7f211c0cc440 2024-04-25T09:01:05.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.412+0000 7f2118c00640 1 -- 172.21.15.59:0/1122982760 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f210c0cc020 con 0x7f211c0cc440 2024-04-25T09:01:05.402 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:05.402 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":10,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:05.117086+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.412+0000 7f2122e00640 1 -- 172.21.15.59:0/1122982760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c0cc440 msgr2=0x7f211c146170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.412+0000 7f2122e00640 1 --2- 172.21.15.59:0/1122982760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c0cc440 0x7f211c146170 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f210c01a0d0 tx=0x7f210c01ace0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.412+0000 7f2122e00640 1 -- 172.21.15.59:0/1122982760 shutdown_connections 2024-04-25T09:01:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.412+0000 7f2122e00640 1 --2- 172.21.15.59:0/1122982760 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f211c15b980 0x7f211c14a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.412+0000 7f2122e00640 1 --2- 172.21.15.59:0/1122982760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f211c15b5a0 0x7f211c149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.412+0000 7f2122e00640 1 --2- 172.21.15.59:0/1122982760 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f211c0cc440 0x7f211c146170 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:05.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.412+0000 7f2122e00640 1 -- 172.21.15.59:0/1122982760 >> 172.21.15.59:0/1122982760 conn(0x7f211c0b3390 msgr2=0x7f211c0b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:05.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.412+0000 7f2122e00640 1 -- 172.21.15.59:0/1122982760 shutdown_connections 2024-04-25T09:01:05.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:05.412+0000 7f2122e00640 1 -- 172.21.15.59:0/1122982760 wait complete. 2024-04-25T09:01:05.421 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T09:01:05.422 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T09:01:05.451 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:05.460+0000 7fd3e0ed3180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T09:01:05.535 INFO:tasks.ceph.mgr.x.smithi178.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T09:01:05.535 INFO:tasks.ceph.mgr.x.smithi178.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T09:01:05.535 INFO:tasks.ceph.mgr.x.smithi178.stderr: from numpy import show_config as show_numpy_config 2024-04-25T09:01:05.590 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:05.601+0000 7f73b7d93180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T09:01:05.627 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:05.636+0000 7fd3e0ed3180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T09:01:05.702 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:05.712+0000 7fd3e0ed3180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T09:01:05.737 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:05.745+0000 7f73b7d93180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:01:05.794 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-25T09:01:05.804+0000 7fac316297c0 -1 Falling back to public interface 2024-04-25T09:01:05.806 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-04-25T09:01:05.816+0000 7f43c5ca77c0 -1 Falling back to public interface 2024-04-25T09:01:05.806 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-04-25T09:01:05.816+0000 7f79ceee87c0 -1 Falling back to public interface 2024-04-25T09:01:05.830 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-04-25T09:01:05.840+0000 7f5a9e7da7c0 -1 Falling back to public interface 2024-04-25T09:01:05.835 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-04-25T09:01:05.845+0000 7f2621b137c0 -1 Falling back to public interface 2024-04-25T09:01:05.836 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-04-25T09:01:05.845+0000 7fc7ffc467c0 -1 Falling back to public interface 2024-04-25T09:01:05.836 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-04-25T09:01:05.845+0000 7f7c93c2e7c0 -1 Falling back to public interface 2024-04-25T09:01:05.851 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-04-25T09:01:05.861+0000 7f005930b7c0 -1 Falling back to public interface 2024-04-25T09:01:05.921 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:05.929+0000 7f73b7d93180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T09:01:05.994 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:06.001+0000 7f73b7d93180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T09:01:06.142 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:06.153+0000 7f73b7d93180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:01:06.227 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:06.357 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97f5000640 1 Processor -- start 2024-04-25T09:01:06.357 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97f5000640 1 -- start start 2024-04-25T09:01:06.359 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97f5000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97f015df90 0x7f97f00cb290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.359 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97f5000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f97f00cbee0 0x7f97f00b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.359 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97f5000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97f015e370 con 0x7f97f00b2e10 2024-04-25T09:01:06.359 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97f5000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f00ce180 con 0x7f97f015df90 2024-04-25T09:01:06.359 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97f5000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f00cc6d0 con 0x7f97f00cbee0 2024-04-25T09:01:06.359 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97ede00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97f015df90 0x7f97f00cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.359 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97ede00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97f015df90 0x7f97f00cb290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36252/0 (socket says 172.21.15.59:36252) 2024-04-25T09:01:06.359 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97ede00640 1 -- 172.21.15.59:0/1602997646 learned_addr learned my addr 172.21.15.59:0/1602997646 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:06.359 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97ee800640 1 --2- 172.21.15.59:0/1602997646 >> v2:172.21.15.178:3300/0 conn(0x7f97f00cbee0 0x7f97f00b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.360 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97ede00640 1 -- 172.21.15.59:0/1602997646 >> v2:172.21.15.178:3300/0 conn(0x7f97f00cbee0 msgr2=0x7f97f00b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:06.360 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97ede00640 1 --2- 172.21.15.59:0/1602997646 >> v2:172.21.15.178:3300/0 conn(0x7f97f00cbee0 0x7f97f00b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.360 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97ede00640 1 -- 172.21.15.59:0/1602997646 >> v1:172.21.15.59:6789/0 conn(0x7f97f00b2e10 legacy=0x7f97f00cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.360 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.368+0000 7f97ede00640 1 -- 172.21.15.59:0/1602997646 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00cee00 con 0x7f97f015df90 2024-04-25T09:01:06.362 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97ede00640 1 --2- 172.21.15.59:0/1602997646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f015df90 0x7f97f00cb290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f97f0070ab0 tx=0x7f97e001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1020b1736494cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:06.362 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97ed400640 1 -- 172.21.15.59:0/1602997646 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e00b2070 con 0x7f97f015df90 2024-04-25T09:01:06.362 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97ed400640 1 -- 172.21.15.59:0/1602997646 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e00ad680 con 0x7f97f015df90 2024-04-25T09:01:06.362 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97ed400640 1 -- 172.21.15.59:0/1602997646 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e00ada50 con 0x7f97f015df90 2024-04-25T09:01:06.363 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97f5000640 1 -- 172.21.15.59:0/1602997646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f015df90 msgr2=0x7f97f00cb290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.363 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97f5000640 1 --2- 172.21.15.59:0/1602997646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f015df90 0x7f97f00cb290 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f97f0070ab0 tx=0x7f97e001c490 comp rx=0 tx=0).stop 2024-04-25T09:01:06.363 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97f5000640 1 -- 172.21.15.59:0/1602997646 shutdown_connections 2024-04-25T09:01:06.363 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97f5000640 1 --2- 172.21.15.59:0/1602997646 >> v2:172.21.15.178:3300/0 conn(0x7f97f00cbee0 0x7f97f00b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.363 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97f5000640 1 --2- 172.21.15.59:0/1602997646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f015df90 0x7f97f00cb290 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.363 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97f5000640 1 -- 172.21.15.59:0/1602997646 >> 172.21.15.59:0/1602997646 conn(0x7f97f00b22f0 msgr2=0x7f97f00b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:06.363 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97f5000640 1 -- 172.21.15.59:0/1602997646 shutdown_connections 2024-04-25T09:01:06.364 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97f5000640 1 -- 172.21.15.59:0/1602997646 wait complete. 2024-04-25T09:01:06.364 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.372+0000 7f97f5000640 1 Processor -- start 2024-04-25T09:01:06.364 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97f5000640 1 -- start start 2024-04-25T09:01:06.367 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97f5000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97f00b2e10 0x7f97f00aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.367 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97f5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f00cbee0 0x7f97f00c6270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.367 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97f5000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f015df90 0x7f97f0164660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:06.367 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97f5000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00b1500 con 0x7f97f00cbee0 2024-04-25T09:01:06.367 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97f5000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00cf6a0 con 0x7f97f00b2e10 2024-04-25T09:01:06.367 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97f5000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00b1680 con 0x7f97f015df90 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f00cbee0 0x7f97f00c6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f00cbee0 0x7f97f00c6270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36256/0 (socket says 172.21.15.59:36256) 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e7e00640 1 -- 172.21.15.59:0/3257504752 learned_addr learned my addr 172.21.15.59:0/3257504752 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97ede00640 1 --2- 172.21.15.59:0/3257504752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97f00b2e10 0x7f97f00aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97ee800640 1 --2- 172.21.15.59:0/3257504752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f015df90 0x7f97f0164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e7e00640 1 -- 172.21.15.59:0/3257504752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f015df90 msgr2=0x7f97f0164660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e7e00640 1 --2- 172.21.15.59:0/3257504752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f015df90 0x7f97f0164660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e7e00640 1 -- 172.21.15.59:0/3257504752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97f00b2e10 msgr2=0x7f97f00aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e7e00640 1 --2- 172.21.15.59:0/3257504752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97f00b2e10 0x7f97f00aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e7e00640 1 -- 172.21.15.59:0/3257504752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00c54f0 con 0x7f97f00cbee0 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97ee800640 1 --2- 172.21.15.59:0/3257504752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f015df90 0x7f97f0164660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e7e00640 1 --2- 172.21.15.59:0/3257504752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f00cbee0 0x7f97f00c6270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97d800c450 tx=0x7f97d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e6000640 1 -- 172.21.15.59:0/3257504752 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8016020 con 0x7f97f00cbee0 2024-04-25T09:01:06.368 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e6000640 1 -- 172.21.15.59:0/3257504752 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d80052d0 con 0x7f97f00cbee0 2024-04-25T09:01:06.369 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e6000640 1 -- 172.21.15.59:0/3257504752 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d8007260 con 0x7f97f00cbee0 2024-04-25T09:01:06.369 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97f5000640 1 -- 172.21.15.59:0/3257504752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f00cd8c0 con 0x7f97f00cbee0 2024-04-25T09:01:06.369 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97f5000640 1 -- 172.21.15.59:0/3257504752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f00c5a70 con 0x7f97f00cbee0 2024-04-25T09:01:06.369 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e6000640 1 -- 172.21.15.59:0/3257504752 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f97d80067e0 con 0x7f97f00cbee0 2024-04-25T09:01:06.369 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97e6000640 1 -- 172.21.15.59:0/3257504752 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f97d8003cd0 con 0x7f97f00cbee0 2024-04-25T09:01:06.369 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.376+0000 7f97f5000640 1 -- 172.21.15.59:0/3257504752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f004ef30 con 0x7f97f00cbee0 2024-04-25T09:01:06.370 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.380+0000 7f97e6000640 1 -- 172.21.15.59:0/3257504752 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f97d8020020 con 0x7f97f00cbee0 2024-04-25T09:01:06.378 INFO:tasks.ceph.mgr.y.smithi059.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T09:01:06.378 INFO:tasks.ceph.mgr.y.smithi059.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T09:01:06.378 INFO:tasks.ceph.mgr.y.smithi059.stderr: from numpy import show_config as show_numpy_config 2024-04-25T09:01:06.421 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:06.432+0000 7fd3e0ed3180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T09:01:06.429 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.440+0000 7f97f5000640 1 -- 172.21.15.59:0/3257504752 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97f0155aa0 con 0x7f97f00cbee0 2024-04-25T09:01:06.430 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.440+0000 7f97e6000640 1 -- 172.21.15.59:0/3257504752 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f97d8005480 con 0x7f97f00cbee0 2024-04-25T09:01:06.430 INFO:teuthology.misc.health.smithi059.stdout: 2024-04-25T09:01:06.430 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":10,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:05.117086+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:06.431 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.440+0000 7f97f5000640 1 -- 172.21.15.59:0/3257504752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f00cbee0 msgr2=0x7f97f00c6270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:06.431 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.440+0000 7f97f5000640 1 --2- 172.21.15.59:0/3257504752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f00cbee0 0x7f97f00c6270 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97d800c450 tx=0x7f97d800c910 comp rx=0 tx=0).stop 2024-04-25T09:01:06.431 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.440+0000 7f97f5000640 1 -- 172.21.15.59:0/3257504752 shutdown_connections 2024-04-25T09:01:06.431 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.440+0000 7f97f5000640 1 --2- 172.21.15.59:0/3257504752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97f015df90 0x7f97f0164660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.431 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.440+0000 7f97f5000640 1 --2- 172.21.15.59:0/3257504752 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97f00cbee0 0x7f97f00c6270 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.431 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.440+0000 7f97f5000640 1 --2- 172.21.15.59:0/3257504752 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97f00b2e10 0x7f97f00aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:06.432 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.440+0000 7f97f5000640 1 -- 172.21.15.59:0/3257504752 >> 172.21.15.59:0/3257504752 conn(0x7f97f00b22f0 msgr2=0x7f97f0155fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:06.432 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.440+0000 7f97f5000640 1 -- 172.21.15.59:0/3257504752 shutdown_connections 2024-04-25T09:01:06.432 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:06.440+0000 7f97f5000640 1 -- 172.21.15.59:0/3257504752 wait complete. 2024-04-25T09:01:06.448 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T09:01:06.578 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:06.588+0000 7fd3e0ed3180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:01:06.764 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:06.772+0000 7fd3e0ed3180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T09:01:06.841 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:06.852+0000 7fd3e0ed3180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T09:01:06.844 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:06.853+0000 7f73b7d93180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T09:01:06.931 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:06.941+0000 7f73b7d93180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T09:01:06.997 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:07.008+0000 7fd3e0ed3180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T09:01:07.132 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:07.141+0000 7f73b7d93180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T09:01:07.217 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:07.225+0000 7f73b7d93180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T09:01:07.545 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:07.553+0000 7f73b7d93180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T09:01:07.616 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:07.625+0000 7f73b7d93180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T09:01:07.811 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:07.820+0000 7fd3e0ed3180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T09:01:07.903 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:07.912+0000 7fd3e0ed3180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T09:01:08.114 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:08.124+0000 7fd3e0ed3180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T09:01:08.203 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:08.212+0000 7fd3e0ed3180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T09:01:08.550 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:08.560+0000 7fd3e0ed3180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T09:01:08.626 INFO:tasks.ceph.mgr.y.smithi059.stderr:2024-04-25T09:01:08.636+0000 7fd3e0ed3180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T09:01:08.634 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:08.645+0000 7f735de00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T09:01:08.635 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-04-25T09:01:08.645+0000 7f735de00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T09:01:09.687 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-25T09:01:09.696+0000 7fac316297c0 -1 osd.0 0 log_to_monitors true 2024-04-25T09:01:09.739 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-04-25T09:01:09.753+0000 7f7c93c2e7c0 -1 osd.4 0 log_to_monitors true 2024-04-25T09:01:09.746 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-04-25T09:01:09.756+0000 7f43c5ca77c0 -1 osd.1 0 log_to_monitors true 2024-04-25T09:01:09.798 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-04-25T09:01:09.808+0000 7f5a9e7da7c0 -1 osd.2 0 log_to_monitors true 2024-04-25T09:01:09.833 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-04-25T09:01:09.845+0000 7f2621b137c0 -1 osd.6 0 log_to_monitors true 2024-04-25T09:01:09.852 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-04-25T09:01:09.860+0000 7f79ceee87c0 -1 osd.3 0 log_to_monitors true 2024-04-25T09:01:09.877 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-04-25T09:01:09.889+0000 7fc7ffc467c0 -1 osd.5 0 log_to_monitors true 2024-04-25T09:01:09.888 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-04-25T09:01:09.901+0000 7f005930b7c0 -1 osd.7 0 log_to_monitors true 2024-04-25T09:01:13.255 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:13.322 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-04-25T09:01:13.332+0000 7f7c8e200640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T09:01:13.323 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-04-25T09:01:13.336+0000 7f0054200640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T09:01:13.356 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-04-25T09:01:13.368+0000 7f7c84200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:01:13.356 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-04-25T09:01:13.368+0000 7f004a200640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:01:13.390 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-04-25T09:01:13.400+0000 7fc7fac00640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T09:01:13.410 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-04-25T09:01:13.420+0000 7f261ca00640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T09:01:13.424 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-04-25T09:01:13.436+0000 7fc7f0c00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:01:13.431 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-04-25T09:01:13.444+0000 7f2612a00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:01:13.456 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.464+0000 7fb97e000640 1 Processor -- start 2024-04-25T09:01:13.456 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.464+0000 7fb97e000640 1 -- start start 2024-04-25T09:01:13.458 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb97e000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9780aec10 0x7fb9780cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:13.458 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb97e000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb9780cf010 0x7fb9780cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:13.458 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb97e000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97815c040 con 0x7fb9780712b0 2024-04-25T09:01:13.459 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb97e000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb97815c320 con 0x7fb9780cf010 2024-04-25T09:01:13.459 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb97e000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97815c600 con 0x7fb9780aec10 2024-04-25T09:01:13.460 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb977e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb9780cf010 0x7fb9780cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:13.460 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb977e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb9780cf010 0x7fb9780cfae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:53944/0 (socket says 172.21.15.59:53944) 2024-04-25T09:01:13.460 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb977e00640 1 -- 172.21.15.59:0/3495754083 learned_addr learned my addr 172.21.15.59:0/3495754083 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:13.460 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb977400640 1 --2- 172.21.15.59:0/3495754083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9780aec10 0x7fb9780cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:13.460 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb977400640 1 -- 172.21.15.59:0/3495754083 >> v2:172.21.15.178:3300/0 conn(0x7fb9780cf010 msgr2=0x7fb9780cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:13.460 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb977400640 1 --2- 172.21.15.59:0/3495754083 >> v2:172.21.15.178:3300/0 conn(0x7fb9780cf010 0x7fb9780cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.460 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb977400640 1 -- 172.21.15.59:0/3495754083 >> v1:172.21.15.178:6789/0 conn(0x7fb9780712b0 legacy=0x7fb9780ce900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:13.460 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.468+0000 7fb977400640 1 -- 172.21.15.59:0/3495754083 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97815c8e0 con 0x7fb9780aec10 2024-04-25T09:01:13.468 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.476+0000 7fb977400640 1 --2- 172.21.15.59:0/3495754083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9780aec10 0x7fb9780cf5a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb96000dbe0 tx=0x7fb960024bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b704dcc46462e5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:13.469 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.476+0000 7fb976000640 1 -- 172.21.15.59:0/3495754083 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96000d2d0 con 0x7fb9780aec10 2024-04-25T09:01:13.469 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.480+0000 7fb976000640 1 -- 172.21.15.59:0/3495754083 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9600ad890 con 0x7fb9780aec10 2024-04-25T09:01:13.469 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.480+0000 7fb976000640 1 -- 172.21.15.59:0/3495754083 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600adc60 con 0x7fb9780aec10 2024-04-25T09:01:13.469 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.480+0000 7fb97e000640 1 -- 172.21.15.59:0/3495754083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9780aec10 msgr2=0x7fb9780cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:13.469 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.480+0000 7fb97e000640 1 --2- 172.21.15.59:0/3495754083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9780aec10 0x7fb9780cf5a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb96000dbe0 tx=0x7fb960024bc0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.473 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.484+0000 7fb97e000640 1 -- 172.21.15.59:0/3495754083 shutdown_connections 2024-04-25T09:01:13.473 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.484+0000 7fb97e000640 1 --2- 172.21.15.59:0/3495754083 >> v2:172.21.15.178:3300/0 conn(0x7fb9780cf010 0x7fb9780cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.473 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.484+0000 7fb97e000640 1 --2- 172.21.15.59:0/3495754083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9780aec10 0x7fb9780cf5a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.473 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.484+0000 7fb97e000640 1 -- 172.21.15.59:0/3495754083 >> 172.21.15.59:0/3495754083 conn(0x7fb978067170 msgr2=0x7fb97806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:13.474 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.484+0000 7fb97e000640 1 -- 172.21.15.59:0/3495754083 shutdown_connections 2024-04-25T09:01:13.474 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.484+0000 7fb97e000640 1 -- 172.21.15.59:0/3495754083 wait complete. 2024-04-25T09:01:13.476 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.484+0000 7fb97e000640 1 Processor -- start 2024-04-25T09:01:13.476 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.484+0000 7fb97e000640 1 -- start start 2024-04-25T09:01:13.477 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb97e000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9780712b0 0x7fb9781439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:13.477 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb97e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9780aec10 0x7fb978142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:13.477 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb97e000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9780cf010 0x7fb978153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:13.477 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb97e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9781600f0 con 0x7fb9780aec10 2024-04-25T09:01:13.477 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb97e000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97815ff70 con 0x7fb9780712b0 2024-04-25T09:01:13.478 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb97e000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb978160270 con 0x7fb9780cf010 2024-04-25T09:01:13.478 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb977400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9780712b0 0x7fb9781439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:13.478 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb977400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9780712b0 0x7fb9781439a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:53954/0 (socket says 172.21.15.59:53954) 2024-04-25T09:01:13.478 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb976a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9780aec10 0x7fb978142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:13.478 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb977400640 1 -- 172.21.15.59:0/4151090114 learned_addr learned my addr 172.21.15.59:0/4151090114 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:13.479 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb977e00640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9780cf010 0x7fb978153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:13.479 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb977400640 1 -- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9780cf010 msgr2=0x7fb978153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:13.479 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb977400640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9780cf010 0x7fb978153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.479 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb977400640 1 -- 172.21.15.59:0/4151090114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9780aec10 msgr2=0x7fb978142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:13.479 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb977400640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9780aec10 0x7fb978142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.479 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb977400640 1 -- 172.21.15.59:0/4151090114 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9781549a0 con 0x7fb9780712b0 2024-04-25T09:01:13.479 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb977400640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9780712b0 0x7fb9781439a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb9600b7040 tx=0x7fb960021960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:13.480 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb96f400640 1 -- 172.21.15.59:0/4151090114 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600c4020 con 0x7fb9780712b0 2024-04-25T09:01:13.480 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb96f400640 1 -- 172.21.15.59:0/4151090114 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9600c0690 con 0x7fb9780712b0 2024-04-25T09:01:13.480 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb96f400640 1 -- 172.21.15.59:0/4151090114 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600c0a80 con 0x7fb9780712b0 2024-04-25T09:01:13.480 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb97e000640 1 -- 172.21.15.59:0/4151090114 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb978154c80 con 0x7fb9780712b0 2024-04-25T09:01:13.480 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.488+0000 7fb97e000640 1 -- 172.21.15.59:0/4151090114 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb978155240 con 0x7fb9780712b0 2024-04-25T09:01:13.481 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.492+0000 7fb97e000640 1 -- 172.21.15.59:0/4151090114 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97804ef30 con 0x7fb9780712b0 2024-04-25T09:01:13.482 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.492+0000 7fb96f400640 1 -- 172.21.15.59:0/4151090114 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 4) v1 ==== 86671+0+0 (secure 0 0 0) 0x7fb9600c7020 con 0x7fb9780712b0 2024-04-25T09:01:13.485 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.492+0000 7fb96f400640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb954066f20 0x7fb9540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:13.485 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.496+0000 7fb96f400640 1 -- 172.21.15.59:0/4151090114 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fb9600f6e50 con 0x7fb9780712b0 2024-04-25T09:01:13.485 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.496+0000 7fb976a00640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb954066f20 0x7fb9540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:13.486 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.496+0000 7fb976a00640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb954066f20 0x7fb9540693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb9781534c0 tx=0x7fb968009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:13.491 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.500+0000 7fb96f400640 1 -- 172.21.15.59:0/4151090114 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb9600fde20 con 0x7fb9780712b0 2024-04-25T09:01:13.781 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.788+0000 7fb97e000640 1 -- 172.21.15.59:0/4151090114 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9780cecd0 con 0x7fb9780712b0 2024-04-25T09:01:13.782 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.792+0000 7fb96f400640 1 -- 172.21.15.59:0/4151090114 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7058 (secure 0 0 0) 0x7fb9600ce030 con 0x7fb9780712b0 2024-04-25T09:01:13.786 INFO:teuthology.misc.health.smithi059.stdout: 2024-04-25T09:01:13.786 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":12,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:11.654132+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:13.787 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.796+0000 7fb97e000640 1 -- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb954066f20 msgr2=0x7fb9540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:13.787 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.796+0000 7fb97e000640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb954066f20 0x7fb9540693e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb9781534c0 tx=0x7fb968009040 comp rx=0 tx=0).stop 2024-04-25T09:01:13.787 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.796+0000 7fb97e000640 1 -- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9780712b0 msgr2=0x7fb9781439a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:13.787 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.796+0000 7fb97e000640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9780712b0 0x7fb9781439a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb9600b7040 tx=0x7fb960021960 comp rx=0 tx=0).stop 2024-04-25T09:01:13.787 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.796+0000 7fb97e000640 1 -- 172.21.15.59:0/4151090114 shutdown_connections 2024-04-25T09:01:13.787 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.796+0000 7fb97e000640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb954066f20 0x7fb9540693e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.787 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.796+0000 7fb97e000640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb9780cf010 0x7fb978153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.787 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.796+0000 7fb97e000640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9780aec10 0x7fb978142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.787 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.796+0000 7fb97e000640 1 --2- 172.21.15.59:0/4151090114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9780712b0 0x7fb9781439a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:13.787 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.796+0000 7fb97e000640 1 -- 172.21.15.59:0/4151090114 >> 172.21.15.59:0/4151090114 conn(0x7fb978067170 msgr2=0x7fb9780cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:13.787 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.796+0000 7fb97e000640 1 -- 172.21.15.59:0/4151090114 shutdown_connections 2024-04-25T09:01:13.787 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:13.796+0000 7fb97e000640 1 -- 172.21.15.59:0/4151090114 wait complete. 2024-04-25T09:01:13.814 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T09:01:14.025 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-04-25T09:01:14.032+0000 7f79c9e00640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T09:01:14.059 INFO:tasks.ceph.osd.3.smithi059.stderr:2024-04-25T09:01:14.068+0000 7f79bfe00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:01:14.071 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-04-25T09:01:14.080+0000 7f43c0c00640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T09:01:14.084 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-25T09:01:14.092+0000 7fac2c400640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T09:01:14.104 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-04-25T09:01:14.112+0000 7f5a99600640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T09:01:14.119 INFO:tasks.ceph.osd.1.smithi059.stderr:2024-04-25T09:01:14.128+0000 7f43b6c00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:01:14.127 INFO:tasks.ceph.osd.0.smithi059.stderr:2024-04-25T09:01:14.136+0000 7fac22400640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:01:14.134 INFO:tasks.ceph.osd.2.smithi059.stderr:2024-04-25T09:01:14.144+0000 7f5a8f600640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T09:01:20.621 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:20.763 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.772+0000 7f44c6000640 1 Processor -- start 2024-04-25T09:01:20.763 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.772+0000 7f44c6000640 1 -- start start 2024-04-25T09:01:20.765 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.772+0000 7f44c6000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c015db00 0x7f44c00b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:20.765 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.772+0000 7f44c6000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c00b2d80 con 0x7f44c006d310 2024-04-25T09:01:20.765 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.772+0000 7f44c6000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44c00b3060 con 0x7f44c00b47f0 2024-04-25T09:01:20.765 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.772+0000 7f44c6000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c006f1c0 con 0x7f44c015db00 2024-04-25T09:01:20.765 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44b6a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f44c006d310 0x7f44c00b40e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38632/0 (socket says 172.21.15.59:38632) 2024-04-25T09:01:20.765 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44b6a00640 1 -- 172.21.15.59:0/3653297644 learned_addr learned my addr 172.21.15.59:0/3653297644 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:20.767 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bf400640 1 --2- 172.21.15.59:0/3653297644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c015db00 0x7f44c00b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:20.767 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365102769 0 0) 0x7f44c00b2d80 con 0x7f44c006d310 2024-04-25T09:01:20.767 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44a4003530 con 0x7f44c006d310 2024-04-25T09:01:20.767 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2121481022 0 0) 0x7f44a4003530 con 0x7f44c006d310 2024-04-25T09:01:20.767 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c015db00 msgr2=0x7f44c00b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:20.767 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 --2- 172.21.15.59:0/3653297644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c015db00 0x7f44c00b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:20.767 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 >> v1:172.21.15.178:6789/0 conn(0x7f44c00b47f0 legacy=0x7f44c00cd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c00b3340 con 0x7f44c006d310 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f44a8001680 con 0x7f44c006d310 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 >> v1:172.21.15.59:6789/0 conn(0x7f44c006d310 legacy=0x7f44c00b40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 --2- 172.21.15.59:0/3653297644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a40039f0 0x7f44a4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 --2- 172.21.15.59:0/3653297644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c015db00 0x7f44a4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 --2- 172.21.15.59:0/3653297644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a4004d50 0x7f44a40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c006f1c0 con 0x7f44a40039f0 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a400ba80 con 0x7f44a4004d50 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a400de90 con 0x7f44c015db00 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44b6a00640 1 --2- 172.21.15.59:0/3653297644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c015db00 0x7f44a4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bfe00640 1 --2- 172.21.15.59:0/3653297644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a4004d50 0x7f44a40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44bf400640 1 --2- 172.21.15.59:0/3653297644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a40039f0 0x7f44a4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44b6a00640 1 -- 172.21.15.59:0/3653297644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a4004d50 msgr2=0x7f44a40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44b6a00640 1 --2- 172.21.15.59:0/3653297644 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44a4004d50 0x7f44a40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:20.768 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44b6a00640 1 -- 172.21.15.59:0/3653297644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a40039f0 msgr2=0x7f44a4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:20.769 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44b6a00640 1 --2- 172.21.15.59:0/3653297644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a40039f0 0x7f44a4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:20.769 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.776+0000 7f44b6a00640 1 -- 172.21.15.59:0/3653297644 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a4003530 con 0x7f44c015db00 2024-04-25T09:01:20.770 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44b6a00640 1 --2- 172.21.15.59:0/3653297644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c015db00 0x7f44a4004810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f44a800c190 tx=0x7f44a801cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=118bc9a11a95ff30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:20.770 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8007d00 con 0x7f44c015db00 2024-04-25T09:01:20.770 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a80a9020 con 0x7f44c015db00 2024-04-25T09:01:20.770 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44bea00640 1 -- 172.21.15.59:0/3653297644 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a8005ae0 con 0x7f44c015db00 2024-04-25T09:01:20.771 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44c6000640 1 -- 172.21.15.59:0/3653297644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c015db00 msgr2=0x7f44a4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:20.771 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44c6000640 1 --2- 172.21.15.59:0/3653297644 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c015db00 0x7f44a4004810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f44a800c190 tx=0x7f44a801cc20 comp rx=0 tx=0).stop 2024-04-25T09:01:20.771 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44bfe00640 1 -- 172.21.15.59:0/3653297644 reap_dead start 2024-04-25T09:01:20.771 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44c6000640 1 -- 172.21.15.59:0/3653297644 shutdown_connections 2024-04-25T09:01:20.771 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44c6000640 1 -- 172.21.15.59:0/3653297644 >> 172.21.15.59:0/3653297644 conn(0x7f44c0067170 msgr2=0x7f44c006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:20.771 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44c6000640 1 -- 172.21.15.59:0/3653297644 shutdown_connections 2024-04-25T09:01:20.771 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44c6000640 1 -- 172.21.15.59:0/3653297644 wait complete. 2024-04-25T09:01:20.772 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44c6000640 1 Processor -- start 2024-04-25T09:01:20.772 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.780+0000 7f44c6000640 1 -- start start 2024-04-25T09:01:20.775 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44c6000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44c015db00 0x7f44c0152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:20.775 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44c6000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c0145f40 0x7f44c01598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:20.775 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44c6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c01463c0 0x7f44c0159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:20.775 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44c6000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c015e060 con 0x7f44c01463c0 2024-04-25T09:01:20.775 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44c6000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c015dee0 con 0x7f44c015db00 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44c6000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c00ce530 con 0x7f44c0145f40 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c01463c0 0x7f44c0159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c01463c0 0x7f44c0159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58832/0 (socket says 172.21.15.59:58832) 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44bfe00640 1 -- 172.21.15.59:0/2891703794 learned_addr learned my addr 172.21.15.59:0/2891703794 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44bf400640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44c015db00 0x7f44c0152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44b6a00640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c0145f40 0x7f44c01598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44bfe00640 1 -- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c0145f40 msgr2=0x7f44c01598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44bfe00640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c0145f40 0x7f44c01598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44bfe00640 1 -- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44c015db00 msgr2=0x7f44c0152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44bfe00640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44c015db00 0x7f44c0152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44bfe00640 1 -- 172.21.15.59:0/2891703794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c01561b0 con 0x7f44c01463c0 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44bf400640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44c015db00 0x7f44c0152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44bfe00640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c01463c0 0x7f44c0159df0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f44c00b1370 tx=0x7f44b800fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:20.776 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44b7e00640 1 -- 172.21.15.59:0/2891703794 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b801a070 con 0x7f44c01463c0 2024-04-25T09:01:20.777 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44b7e00640 1 -- 172.21.15.59:0/2891703794 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44b8006d70 con 0x7f44c01463c0 2024-04-25T09:01:20.777 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44c6000640 1 -- 172.21.15.59:0/2891703794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c015a420 con 0x7f44c01463c0 2024-04-25T09:01:20.777 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44b7e00640 1 -- 172.21.15.59:0/2891703794 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44b8003ba0 con 0x7f44c01463c0 2024-04-25T09:01:20.777 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44c6000640 1 -- 172.21.15.59:0/2891703794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c015b360 con 0x7f44c01463c0 2024-04-25T09:01:20.777 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.784+0000 7f44c6000640 1 -- 172.21.15.59:0/2891703794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c004ef30 con 0x7f44c01463c0 2024-04-25T09:01:20.778 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.788+0000 7f44b7e00640 1 -- 172.21.15.59:0/2891703794 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f44b801d070 con 0x7f44c01463c0 2024-04-25T09:01:20.778 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.788+0000 7f44b7e00640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f449c066f60 0x7f449c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:20.778 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.788+0000 7f44b7e00640 1 -- 172.21.15.59:0/2891703794 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f44b80842a0 con 0x7f44c01463c0 2024-04-25T09:01:20.778 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.788+0000 7f44bf400640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f449c066f60 0x7f449c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:20.779 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.788+0000 7f44bf400640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f449c066f60 0x7f449c069420 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009c00 tx=0x7f44b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:20.782 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.792+0000 7f44b7e00640 1 -- 172.21.15.59:0/2891703794 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f44b8054f10 con 0x7f44c01463c0 2024-04-25T09:01:20.945 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 -- 172.21.15.59:0/2891703794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44c00cf4e0 con 0x7f44c01463c0 2024-04-25T09:01:20.946 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44b7e00640 1 -- 172.21.15.59:0/2891703794 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12884 (secure 0 0 0) 0x7f44b8058fb0 con 0x7f44c01463c0 2024-04-25T09:01:20.947 INFO:teuthology.misc.health.smithi059.stdout: 2024-04-25T09:01:20.947 INFO:teuthology.misc.health.smithi059.stdout:{"epoch":16,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:17.720728+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:20.949 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 -- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f449c066f60 msgr2=0x7f449c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:20.949 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f449c066f60 0x7f449c069420 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f44b0009c00 tx=0x7f44b0008040 comp rx=0 tx=0).stop 2024-04-25T09:01:20.949 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 -- 172.21.15.59:0/2891703794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c01463c0 msgr2=0x7f44c0159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:20.949 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c01463c0 0x7f44c0159df0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f44c00b1370 tx=0x7f44b800fcd0 comp rx=0 tx=0).stop 2024-04-25T09:01:20.949 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 -- 172.21.15.59:0/2891703794 shutdown_connections 2024-04-25T09:01:20.949 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f449c066f60 0x7f449c069420 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:20.949 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44c01463c0 0x7f44c0159df0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:20.949 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44c0145f40 0x7f44c01598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:20.949 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 --2- 172.21.15.59:0/2891703794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44c015db00 0x7f44c0152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:20.949 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 -- 172.21.15.59:0/2891703794 >> 172.21.15.59:0/2891703794 conn(0x7f44c0067170 msgr2=0x7f44c00aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:20.949 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 -- 172.21.15.59:0/2891703794 shutdown_connections 2024-04-25T09:01:20.949 INFO:teuthology.misc.health.smithi059.stderr:2024-04-25T09:01:20.956+0000 7f44c6000640 1 -- 172.21.15.59:0/2891703794 wait complete. 2024-04-25T09:01:20.966 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T09:01:20.966 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T09:01:20.967 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:01:20.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:01:20.970 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:01:20.970 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:01:20.970 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:01:20.973 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:01:20.973 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:01:20.973 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:01:20.977 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:01:20.977 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:01:20.977 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:01:20.980 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:01:20.980 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T09:01:20.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:21.074 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T09:01:21.074 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:01:21.117 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-04-25T09:01:21.117 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-04-25T09:01:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.136+0000 7f680b200640 1 Processor -- start 2024-04-25T09:01:21.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.136+0000 7f680b200640 1 -- start start 2024-04-25T09:01:21.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f680b200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f680c09a170 0x7f680c0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f680b200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f680c0cdb70 0x7f680c0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f680b200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f680c0cd6c0 con 0x7f680c15efa0 2024-04-25T09:01:21.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f680b200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f680c0b3fe0 con 0x7f680c09a170 2024-04-25T09:01:21.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f680b200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0cce20 con 0x7f680c0cdb70 2024-04-25T09:01:21.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f680a800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f680c0cdb70 0x7f680c0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f6809e00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f680c15efa0 0x7f680c099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:54818/0 (socket says 172.21.15.59:54818) 2024-04-25T09:01:21.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f6809e00640 1 -- 172.21.15.59:0/2737920427 learned_addr learned my addr 172.21.15.59:0/2737920427 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:21.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f6803e00640 1 --2- 172.21.15.59:0/2737920427 >> v2:172.21.15.178:3300/0 conn(0x7f680c09a170 0x7f680c0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f6809400640 1 -- 172.21.15.59:0/2737920427 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684576012 0 0) 0x7f680c0cd6c0 con 0x7f680c15efa0 2024-04-25T09:01:21.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f6809400640 1 -- 172.21.15.59:0/2737920427 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67f0003530 con 0x7f680c15efa0 2024-04-25T09:01:21.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f680a800640 1 -- 172.21.15.59:0/2737920427 >> v2:172.21.15.178:3300/0 conn(0x7f680c09a170 msgr2=0x7f680c0b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:21.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f680a800640 1 --2- 172.21.15.59:0/2737920427 >> v2:172.21.15.178:3300/0 conn(0x7f680c09a170 0x7f680c0b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f680a800640 1 -- 172.21.15.59:0/2737920427 >> v1:172.21.15.178:6789/0 conn(0x7f680c15efa0 legacy=0x7f680c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f680a800640 1 -- 172.21.15.59:0/2737920427 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c0cd100 con 0x7f680c0cdb70 2024-04-25T09:01:21.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.140+0000 7f6803e00640 1 --2- 172.21.15.59:0/2737920427 >> v2:172.21.15.178:3300/0 conn(0x7f680c09a170 0x7f680c0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:21.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680a800640 1 --2- 172.21.15.59:0/2737920427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f680c0cdb70 0x7f680c0b16e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6804009d90 tx=0x7f680401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e11fa808c626a503 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:21.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f6809400640 1 -- 172.21.15.59:0/2737920427 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68040b2070 con 0x7f680c0cdb70 2024-04-25T09:01:21.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f6809400640 1 -- 172.21.15.59:0/2737920427 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68040a5830 con 0x7f680c0cdb70 2024-04-25T09:01:21.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f6809400640 1 -- 172.21.15.59:0/2737920427 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68040a5c00 con 0x7f680c0cdb70 2024-04-25T09:01:21.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 -- 172.21.15.59:0/2737920427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f680c0cdb70 msgr2=0x7f680c0b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 --2- 172.21.15.59:0/2737920427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f680c0cdb70 0x7f680c0b16e0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6804009d90 tx=0x7f680401c970 comp rx=0 tx=0).stop 2024-04-25T09:01:21.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 -- 172.21.15.59:0/2737920427 shutdown_connections 2024-04-25T09:01:21.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 --2- 172.21.15.59:0/2737920427 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f680c0cdb70 0x7f680c0b16e0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 --2- 172.21.15.59:0/2737920427 >> v2:172.21.15.178:3300/0 conn(0x7f680c09a170 0x7f680c0b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 -- 172.21.15.59:0/2737920427 >> 172.21.15.59:0/2737920427 conn(0x7f680c0b3050 msgr2=0x7f680c0b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:21.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 -- 172.21.15.59:0/2737920427 shutdown_connections 2024-04-25T09:01:21.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 -- 172.21.15.59:0/2737920427 wait complete. 2024-04-25T09:01:21.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 Processor -- start 2024-04-25T09:01:21.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 -- start start 2024-04-25T09:01:21.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f680c09a170 0x7f680c155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f680c0cdb70 0x7f680c0ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f680c15efa0 0x7f680c0ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c1686a0 con 0x7f680c09a170 2024-04-25T09:01:21.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680c0b3dc0 con 0x7f680c0cdb70 2024-04-25T09:01:21.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.144+0000 7f680b200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680c168820 con 0x7f680c15efa0 2024-04-25T09:01:21.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6809e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f680c09a170 0x7f680c155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6809e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f680c09a170 0x7f680c155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58856/0 (socket says 172.21.15.59:58856) 2024-04-25T09:01:21.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6809e00640 1 -- 172.21.15.59:0/784425661 learned_addr learned my addr 172.21.15.59:0/784425661 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:21.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6803e00640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f680c0cdb70 0x7f680c0ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f680a800640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f680c15efa0 0x7f680c0ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6809e00640 1 -- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f680c15efa0 msgr2=0x7f680c0ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6809e00640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f680c15efa0 0x7f680c0ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6809e00640 1 -- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f680c0cdb70 msgr2=0x7f680c0ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6809e00640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f680c0cdb70 0x7f680c0ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6809e00640 1 -- 172.21.15.59:0/784425661 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c156020 con 0x7f680c09a170 2024-04-25T09:01:21.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6809e00640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f680c09a170 0x7f680c155550 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0010f0 tx=0x7f67fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:21.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6802000640 1 -- 172.21.15.59:0/784425661 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc017070 con 0x7f680c09a170 2024-04-25T09:01:21.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6802000640 1 -- 172.21.15.59:0/784425661 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67fc005d10 con 0x7f680c09a170 2024-04-25T09:01:21.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f680b200640 1 -- 172.21.15.59:0/784425661 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f680c165570 con 0x7f680c09a170 2024-04-25T09:01:21.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6802000640 1 -- 172.21.15.59:0/784425661 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67fc007310 con 0x7f680c09a170 2024-04-25T09:01:21.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f680b200640 1 -- 172.21.15.59:0/784425661 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f680c157b60 con 0x7f680c09a170 2024-04-25T09:01:21.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f680b200640 1 -- 172.21.15.59:0/784425661 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f680c04efa0 con 0x7f680c09a170 2024-04-25T09:01:21.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.148+0000 7f6802000640 1 -- 172.21.15.59:0/784425661 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f67fc01a070 con 0x7f680c09a170 2024-04-25T09:01:21.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.152+0000 7f6802000640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f67e8066f60 0x7f67e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.152+0000 7f6802000640 1 -- 172.21.15.59:0/784425661 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f67fc084160 con 0x7f680c09a170 2024-04-25T09:01:21.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.152+0000 7f6803e00640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f67e8066f60 0x7f67e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.152+0000 7f6803e00640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f67e8066f60 0x7f67e8069420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009580 tx=0x7f67f4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:21.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.156+0000 7f6802000640 1 -- 172.21.15.59:0/784425661 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f67fc054dd0 con 0x7f680c09a170 2024-04-25T09:01:21.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 -- 172.21.15.59:0/784425661 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f680c0af900 con 0x7f680c09a170 2024-04-25T09:01:21.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f6802000640 1 -- 172.21.15.59:0/784425661 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12884 (secure 0 0 0) 0x7f67fc058e70 con 0x7f680c09a170 2024-04-25T09:01:21.306 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:21.306 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":16,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:17.720728+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 -- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f67e8066f60 msgr2=0x7f67e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f67e8066f60 0x7f67e8069420 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f67f4009580 tx=0x7f67f4009190 comp rx=0 tx=0).stop 2024-04-25T09:01:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 -- 172.21.15.59:0/784425661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f680c09a170 msgr2=0x7f680c155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f680c09a170 0x7f680c155550 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0010f0 tx=0x7f67fc00c8f0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 -- 172.21.15.59:0/784425661 shutdown_connections 2024-04-25T09:01:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f67e8066f60 0x7f67e8069420 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f680c15efa0 0x7f680c0ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f680c0cdb70 0x7f680c0ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 --2- 172.21.15.59:0/784425661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f680c09a170 0x7f680c155550 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 -- 172.21.15.59:0/784425661 >> 172.21.15.59:0/784425661 conn(0x7f680c0b3050 msgr2=0x7f680c099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:21.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 -- 172.21.15.59:0/784425661 shutdown_connections 2024-04-25T09:01:21.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.316+0000 7f680b200640 1 -- 172.21.15.59:0/784425661 wait complete. 2024-04-25T09:01:21.327 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:01:21.328 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:01:21.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.480+0000 7f7d7d800640 1 Processor -- start 2024-04-25T09:01:21.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.480+0000 7f7d7d800640 1 -- start start 2024-04-25T09:01:21.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d7d800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7d7806c730 0x7f7d7815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d7d800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7815ef90 con 0x7f7d7806cb10 2024-04-25T09:01:21.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d7d800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d781623b0 con 0x7f7d780d0790 2024-04-25T09:01:21.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d7d800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7809a9e0 con 0x7f7d7806c730 2024-04-25T09:01:21.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d6f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7d7806cb10 0x7f7d78161590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38646/0 (socket says 172.21.15.59:38646) 2024-04-25T09:01:21.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d6f400640 1 -- 172.21.15.59:0/4014870865 learned_addr learned my addr 172.21.15.59:0/4014870865 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:21.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d77e00640 1 --2- 172.21.15.59:0/4014870865 >> v2:172.21.15.178:3300/0 conn(0x7f7d7806c730 0x7f7d7815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d77400640 1 -- 172.21.15.59:0/4014870865 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896776434 0 0) 0x7f7d7815ef90 con 0x7f7d7806cb10 2024-04-25T09:01:21.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d77400640 1 -- 172.21.15.59:0/4014870865 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d5c003530 con 0x7f7d7806cb10 2024-04-25T09:01:21.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d77400640 1 -- 172.21.15.59:0/4014870865 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811041673 0 0) 0x7f7d781623b0 con 0x7f7d780d0790 2024-04-25T09:01:21.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d77400640 1 -- 172.21.15.59:0/4014870865 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d7815ef90 con 0x7f7d780d0790 2024-04-25T09:01:21.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d77e00640 1 -- 172.21.15.59:0/4014870865 >> v1:172.21.15.178:6789/0 conn(0x7f7d780d0790 legacy=0x7f7d78161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d77e00640 1 -- 172.21.15.59:0/4014870865 >> v1:172.21.15.59:6789/0 conn(0x7f7d7806cb10 legacy=0x7f7d78161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.484+0000 7f7d77e00640 1 -- 172.21.15.59:0/4014870865 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d78099dd0 con 0x7f7d7806c730 2024-04-25T09:01:21.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d77e00640 1 --2- 172.21.15.59:0/4014870865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7806c730 0x7f7d7815ea50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d680097c0 tx=0x7f7d6801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79bc469a088efba1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:21.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d77400640 1 -- 172.21.15.59:0/4014870865 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680b1070 con 0x7f7d7806c730 2024-04-25T09:01:21.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d77400640 1 -- 172.21.15.59:0/4014870865 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d680ac5f0 con 0x7f7d7806c730 2024-04-25T09:01:21.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d77400640 1 -- 172.21.15.59:0/4014870865 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680ac9c0 con 0x7f7d7806c730 2024-04-25T09:01:21.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d7d800640 1 -- 172.21.15.59:0/4014870865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7806c730 msgr2=0x7f7d7815ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d7d800640 1 --2- 172.21.15.59:0/4014870865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7806c730 0x7f7d7815ea50 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7d680097c0 tx=0x7f7d6801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d7d800640 1 -- 172.21.15.59:0/4014870865 shutdown_connections 2024-04-25T09:01:21.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d7d800640 1 --2- 172.21.15.59:0/4014870865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d7806c730 0x7f7d7815ea50 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d7d800640 1 -- 172.21.15.59:0/4014870865 >> 172.21.15.59:0/4014870865 conn(0x7f7d780b3030 msgr2=0x7f7d780b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d7d800640 1 -- 172.21.15.59:0/4014870865 shutdown_connections 2024-04-25T09:01:21.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d7d800640 1 -- 172.21.15.59:0/4014870865 wait complete. 2024-04-25T09:01:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d7d800640 1 Processor -- start 2024-04-25T09:01:21.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.488+0000 7f7d7d800640 1 -- start start 2024-04-25T09:01:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d7d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7806c730 0x7f7d780b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d7d800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7806cb10 0x7f7d780b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d7d800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d780d0790 0x7f7d7814e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d7d800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d78099a60 con 0x7f7d7806c730 2024-04-25T09:01:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d7d800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7815de20 con 0x7f7d780d0790 2024-04-25T09:01:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d7d800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d780b0720 con 0x7f7d7806cb10 2024-04-25T09:01:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d77e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7806c730 0x7f7d780b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d77e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7806c730 0x7f7d780b4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58868/0 (socket says 172.21.15.59:58868) 2024-04-25T09:01:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d77e00640 1 -- 172.21.15.59:0/18395588 learned_addr learned my addr 172.21.15.59:0/18395588 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d6f400640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7806cb10 0x7f7d780b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d7ce00640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d780d0790 0x7f7d7814e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d77e00640 1 -- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7806cb10 msgr2=0x7f7d780b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d77e00640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7806cb10 0x7f7d780b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d77e00640 1 -- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d780d0790 msgr2=0x7f7d7814e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d77e00640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d780d0790 0x7f7d7814e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d77e00640 1 -- 172.21.15.59:0/18395588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d780b5430 con 0x7f7d7806c730 2024-04-25T09:01:21.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d77e00640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7806c730 0x7f7d780b4e50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7d6801a0d0 tx=0x7f7d6801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:21.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d74c00640 1 -- 172.21.15.59:0/18395588 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d680b1050 con 0x7f7d7806c730 2024-04-25T09:01:21.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d74c00640 1 -- 172.21.15.59:0/18395588 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d680bd070 con 0x7f7d7806c730 2024-04-25T09:01:21.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d74c00640 1 -- 172.21.15.59:0/18395588 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68006e20 con 0x7f7d7806c730 2024-04-25T09:01:21.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d7d800640 1 -- 172.21.15.59:0/18395588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d780b5710 con 0x7f7d7806c730 2024-04-25T09:01:21.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d7d800640 1 -- 172.21.15.59:0/18395588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d780b5cd0 con 0x7f7d7806c730 2024-04-25T09:01:21.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d7d800640 1 -- 172.21.15.59:0/18395588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d780745d0 con 0x7f7d7806c730 2024-04-25T09:01:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.492+0000 7f7d74c00640 1 -- 172.21.15.59:0/18395588 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7d680b6830 con 0x7f7d7806c730 2024-04-25T09:01:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.496+0000 7f7d74c00640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7d54066f60 0x7f7d54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.496+0000 7f7d74c00640 1 -- 172.21.15.59:0/18395588 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7d6811f3d0 con 0x7f7d7806c730 2024-04-25T09:01:21.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.496+0000 7f7d6f400640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7d54066f60 0x7f7d54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.496+0000 7f7d6f400640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7d54066f60 0x7f7d54069420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7d60000f70 tx=0x7f7d60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:21.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.500+0000 7f7d74c00640 1 -- 172.21.15.59:0/18395588 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7d680a9070 con 0x7f7d7806c730 2024-04-25T09:01:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.660+0000 7f7d7d800640 1 -- 172.21.15.59:0/18395588 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7d780d0270 con 0x7f7d7806c730 2024-04-25T09:01:21.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.660+0000 7f7d74c00640 1 -- 172.21.15.59:0/18395588 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7d68016090 con 0x7f7d7806c730 2024-04-25T09:01:21.653 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:01:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.664+0000 7f7d7d800640 1 -- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7d54066f60 msgr2=0x7f7d54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.664+0000 7f7d7d800640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7d54066f60 0x7f7d54069420 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7d60000f70 tx=0x7f7d60009040 comp rx=0 tx=0).stop 2024-04-25T09:01:21.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.664+0000 7f7d7d800640 1 -- 172.21.15.59:0/18395588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7806c730 msgr2=0x7f7d780b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.664+0000 7f7d7d800640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7806c730 0x7f7d780b4e50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7d6801a0d0 tx=0x7f7d6801ace0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.664+0000 7f7d7d800640 1 -- 172.21.15.59:0/18395588 shutdown_connections 2024-04-25T09:01:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.664+0000 7f7d7d800640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7d54066f60 0x7f7d54069420 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.664+0000 7f7d7d800640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d780d0790 0x7f7d7814e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.664+0000 7f7d7d800640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d7806cb10 0x7f7d780b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.664+0000 7f7d7d800640 1 --2- 172.21.15.59:0/18395588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d7806c730 0x7f7d780b4e50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.664+0000 7f7d7d800640 1 -- 172.21.15.59:0/18395588 >> 172.21.15.59:0/18395588 conn(0x7f7d780b3030 msgr2=0x7f7d780cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.664+0000 7f7d7d800640 1 -- 172.21.15.59:0/18395588 shutdown_connections 2024-04-25T09:01:21.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.664+0000 7f7d7d800640 1 -- 172.21.15.59:0/18395588 wait complete. 2024-04-25T09:01:21.673 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:21.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d14e00640 1 Processor -- start 2024-04-25T09:01:21.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d14e00640 1 -- start start 2024-04-25T09:01:21.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d14e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d10144140 0x7f8d100ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d14e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1015ac60 con 0x7f8d1006ead0 2024-04-25T09:01:21.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d14e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d100cf3e0 con 0x7f8d100ced60 2024-04-25T09:01:21.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d14e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1015af20 con 0x7f8d10144140 2024-04-25T09:01:21.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d0e800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8d1006ead0 0x7f8d100b0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38660/0 (socket says 172.21.15.59:38660) 2024-04-25T09:01:21.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d0e800640 1 -- 172.21.15.59:0/2283842140 learned_addr learned my addr 172.21.15.59:0/2283842140 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:21.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d0de00640 1 --2- 172.21.15.59:0/2283842140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d10144140 0x7f8d100ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d0d400640 1 -- 172.21.15.59:0/2283842140 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377859273 0 0) 0x7f8d1015ac60 con 0x7f8d1006ead0 2024-04-25T09:01:21.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d0d400640 1 -- 172.21.15.59:0/2283842140 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cf4005740 con 0x7f8d1006ead0 2024-04-25T09:01:21.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d0d400640 1 -- 172.21.15.59:0/2283842140 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3541840603 0 0) 0x7f8d100cf3e0 con 0x7f8d100ced60 2024-04-25T09:01:21.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.824+0000 7f8d0d400640 1 -- 172.21.15.59:0/2283842140 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d1015ac60 con 0x7f8d100ced60 2024-04-25T09:01:21.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d0d400640 1 -- 172.21.15.59:0/2283842140 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2806359718 0 0) 0x7f8cf4005740 con 0x7f8d1006ead0 2024-04-25T09:01:21.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d0de00640 1 -- 172.21.15.59:0/2283842140 >> v1:172.21.15.178:6789/0 conn(0x7f8d100ced60 legacy=0x7f8d1006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d0de00640 1 -- 172.21.15.59:0/2283842140 >> v1:172.21.15.59:6789/0 conn(0x7f8d1006ead0 legacy=0x7f8d100b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d0de00640 1 -- 172.21.15.59:0/2283842140 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1015b200 con 0x7f8d10144140 2024-04-25T09:01:21.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d0de00640 1 --2- 172.21.15.59:0/2283842140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d10144140 0x7f8d100ce820 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8d000097f0 tx=0x7f8d0001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c60236765e8912d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:21.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d0d400640 1 -- 172.21.15.59:0/2283842140 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d000b0070 con 0x7f8d10144140 2024-04-25T09:01:21.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d0d400640 1 -- 172.21.15.59:0/2283842140 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d000ab400 con 0x7f8d10144140 2024-04-25T09:01:21.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d0d400640 1 -- 172.21.15.59:0/2283842140 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d08001a00 con 0x7f8d10144140 2024-04-25T09:01:21.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d14e00640 1 -- 172.21.15.59:0/2283842140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d10144140 msgr2=0x7f8d100ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d14e00640 1 --2- 172.21.15.59:0/2283842140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d10144140 0x7f8d100ce820 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8d000097f0 tx=0x7f8d0001c400 comp rx=0 tx=0).stop 2024-04-25T09:01:21.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d14e00640 1 -- 172.21.15.59:0/2283842140 shutdown_connections 2024-04-25T09:01:21.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d14e00640 1 --2- 172.21.15.59:0/2283842140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d10144140 0x7f8d100ce820 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d14e00640 1 -- 172.21.15.59:0/2283842140 >> 172.21.15.59:0/2283842140 conn(0x7f8d10066fa0 msgr2=0x7f8d1006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:21.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d14e00640 1 -- 172.21.15.59:0/2283842140 shutdown_connections 2024-04-25T09:01:21.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.828+0000 7f8d14e00640 1 -- 172.21.15.59:0/2283842140 wait complete. 2024-04-25T09:01:21.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d14e00640 1 Processor -- start 2024-04-25T09:01:21.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d14e00640 1 -- start start 2024-04-25T09:01:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d14e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1006ead0 0x7f8d1013cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d14e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d100ced60 0x7f8d1013e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d14e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d10144140 0x7f8d1013c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d14e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1015bb80 con 0x7f8d1006ead0 2024-04-25T09:01:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d14e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1015ba00 con 0x7f8d100ced60 2024-04-25T09:01:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d14e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1006d2b0 con 0x7f8d10144140 2024-04-25T09:01:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d0de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1006ead0 0x7f8d1013cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d0de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1006ead0 0x7f8d1013cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58882/0 (socket says 172.21.15.59:58882) 2024-04-25T09:01:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d0de00640 1 -- 172.21.15.59:0/3802073032 learned_addr learned my addr 172.21.15.59:0/3802073032 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d05400640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d100ced60 0x7f8d1013e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d0e800640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d10144140 0x7f8d1013c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d0de00640 1 -- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d10144140 msgr2=0x7f8d1013c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d0de00640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d10144140 0x7f8d1013c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d0de00640 1 -- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d100ced60 msgr2=0x7f8d1013e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:21.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d0de00640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d100ced60 0x7f8d1013e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:21.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d0de00640 1 -- 172.21.15.59:0/3802073032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1013f870 con 0x7f8d1006ead0 2024-04-25T09:01:21.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d0e800640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d10144140 0x7f8d1013c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:21.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d0de00640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1006ead0 0x7f8d1013cc90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009740 tx=0x7f8d000191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:21.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d06a00640 1 -- 172.21.15.59:0/3802073032 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d000bb070 con 0x7f8d1006ead0 2024-04-25T09:01:21.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d06a00640 1 -- 172.21.15.59:0/3802073032 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00004020 con 0x7f8d1006ead0 2024-04-25T09:01:21.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d14e00640 1 -- 172.21.15.59:0/3802073032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1013fb50 con 0x7f8d1006ead0 2024-04-25T09:01:21.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d06a00640 1 -- 172.21.15.59:0/3802073032 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d000b0040 con 0x7f8d1006ead0 2024-04-25T09:01:21.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.832+0000 7f8d14e00640 1 -- 172.21.15.59:0/3802073032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1013dcc0 con 0x7f8d1006ead0 2024-04-25T09:01:21.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.836+0000 7f8d14e00640 1 -- 172.21.15.59:0/3802073032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d100745d0 con 0x7f8d1006ead0 2024-04-25T09:01:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.836+0000 7f8d06a00640 1 -- 172.21.15.59:0/3802073032 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8d000b3040 con 0x7f8d1006ead0 2024-04-25T09:01:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.836+0000 7f8d06a00640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8cec066f60 0x7f8cec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.836+0000 7f8d06a00640 1 -- 172.21.15.59:0/3802073032 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8d0011ede0 con 0x7f8d1006ead0 2024-04-25T09:01:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.836+0000 7f8d05400640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8cec066f60 0x7f8cec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:21.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.836+0000 7f8d05400640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8cec066f60 0x7f8cec069420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8007fd0 tx=0x7f8cf8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:21.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:21.840+0000 7f8d06a00640 1 -- 172.21.15.59:0/3802073032 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8d00015ff0 con 0x7f8d1006ead0 2024-04-25T09:01:22.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.036+0000 7f8d14e00640 1 -- 172.21.15.59:0/3802073032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d1015eeb0 con 0x7f8d1006ead0 2024-04-25T09:01:22.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.036+0000 7f8d06a00640 1 -- 172.21.15.59:0/3802073032 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f8d000f0250 con 0x7f8d1006ead0 2024-04-25T09:01:22.029 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:22.029 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2167197221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2167197221},{"type":"v1","addr":"172.21.15.59:6834","nonce":2167197221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-04-25T09:01:22.029 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 2 2024-04-25T09:01:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.040+0000 7f8d14e00640 1 -- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8cec066f60 msgr2=0x7f8cec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.040+0000 7f8d14e00640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8cec066f60 0x7f8cec069420 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8007fd0 tx=0x7f8cf8009040 comp rx=0 tx=0).stop 2024-04-25T09:01:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.040+0000 7f8d14e00640 1 -- 172.21.15.59:0/3802073032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1006ead0 msgr2=0x7f8d1013cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.040+0000 7f8d14e00640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1006ead0 0x7f8d1013cc90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8d00009740 tx=0x7f8d000191a0 comp rx=0 tx=0).stop 2024-04-25T09:01:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.040+0000 7f8d14e00640 1 -- 172.21.15.59:0/3802073032 shutdown_connections 2024-04-25T09:01:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.040+0000 7f8d14e00640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8cec066f60 0x7f8cec069420 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.040+0000 7f8d14e00640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d10144140 0x7f8d1013c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.040+0000 7f8d14e00640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d100ced60 0x7f8d1013e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.040+0000 7f8d14e00640 1 --2- 172.21.15.59:0/3802073032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d1006ead0 0x7f8d1013cc90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.040+0000 7f8d14e00640 1 -- 172.21.15.59:0/3802073032 >> 172.21.15.59:0/3802073032 conn(0x7f8d10066fa0 msgr2=0x7f8d10163790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.040+0000 7f8d14e00640 1 -- 172.21.15.59:0/3802073032 shutdown_connections 2024-04-25T09:01:22.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:22.040+0000 7f8d14e00640 1 -- 172.21.15.59:0/3802073032 wait complete. 2024-04-25T09:01:22.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:22.308 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:24.051 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:24.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.212+0000 7f725e800640 1 Processor -- start 2024-04-25T09:01:24.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.212+0000 7f725e800640 1 -- start start 2024-04-25T09:01:24.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.212+0000 7f725e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f725815ee00 0x7f725806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.212+0000 7f725e800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72580cff30 0x7f72580d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.212+0000 7f725e800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f725806c650 con 0x7f7258099a60 2024-04-25T09:01:24.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.212+0000 7f725e800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725806c930 con 0x7f725815ee00 2024-04-25T09:01:24.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.212+0000 7f725e800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725806cc10 con 0x7f72580cff30 2024-04-25T09:01:24.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.212+0000 7f724fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f725815ee00 0x7f725806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.212+0000 7f724fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f725815ee00 0x7f725806bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58892/0 (socket says 172.21.15.59:58892) 2024-04-25T09:01:24.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.212+0000 7f724fe00640 1 -- 172.21.15.59:0/2153270204 learned_addr learned my addr 172.21.15.59:0/2153270204 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:24.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.216+0000 7f7257e00640 1 --2- 172.21.15.59:0/2153270204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72580cff30 0x7f72580d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.216+0000 7f724fe00640 1 -- 172.21.15.59:0/2153270204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72580cff30 msgr2=0x7f72580d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:24.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.216+0000 7f724fe00640 1 --2- 172.21.15.59:0/2153270204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72580cff30 0x7f72580d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.216+0000 7f724fe00640 1 -- 172.21.15.59:0/2153270204 >> v1:172.21.15.178:6789/0 conn(0x7f7258099a60 legacy=0x7f7258099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.216+0000 7f724fe00640 1 -- 172.21.15.59:0/2153270204 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725806cef0 con 0x7f725815ee00 2024-04-25T09:01:24.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.216+0000 7f724fe00640 1 --2- 172.21.15.59:0/2153270204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f725815ee00 0x7f725806bd20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7240009870 tx=0x7f724001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b48081b6ef88ea3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:24.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.216+0000 7f7256a00640 1 -- 172.21.15.59:0/2153270204 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400b2070 con 0x7f725815ee00 2024-04-25T09:01:24.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.216+0000 7f7256a00640 1 -- 172.21.15.59:0/2153270204 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72400a9070 con 0x7f725815ee00 2024-04-25T09:01:24.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.216+0000 7f7256a00640 1 -- 172.21.15.59:0/2153270204 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72400ad880 con 0x7f725815ee00 2024-04-25T09:01:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 -- 172.21.15.59:0/2153270204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f725815ee00 msgr2=0x7f725806bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 --2- 172.21.15.59:0/2153270204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f725815ee00 0x7f725806bd20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7240009870 tx=0x7f724001c560 comp rx=0 tx=0).stop 2024-04-25T09:01:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 -- 172.21.15.59:0/2153270204 shutdown_connections 2024-04-25T09:01:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 --2- 172.21.15.59:0/2153270204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72580cff30 0x7f72580d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 --2- 172.21.15.59:0/2153270204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f725815ee00 0x7f725806bd20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 -- 172.21.15.59:0/2153270204 >> 172.21.15.59:0/2153270204 conn(0x7f72580d17a0 msgr2=0x7f72580d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:24.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 -- 172.21.15.59:0/2153270204 shutdown_connections 2024-04-25T09:01:24.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 -- 172.21.15.59:0/2153270204 wait complete. 2024-04-25T09:01:24.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 Processor -- start 2024-04-25T09:01:24.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 -- start start 2024-04-25T09:01:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7258099a60 0x7f72580c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72580cff30 0x7f7258149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f725815ee00 0x7f72580ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725816ab80 con 0x7f725815ee00 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725816aa00 con 0x7f7258099a60 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f725e800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725816ad00 con 0x7f72580cff30 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f7257e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f725815ee00 0x7f72580ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f7257e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f725815ee00 0x7f72580ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58898/0 (socket says 172.21.15.59:58898) 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f7257e00640 1 -- 172.21.15.59:0/4149593593 learned_addr learned my addr 172.21.15.59:0/4149593593 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f7257400640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7258099a60 0x7f72580c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f724fe00640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72580cff30 0x7f7258149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f7257e00640 1 -- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72580cff30 msgr2=0x7f7258149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f7257e00640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72580cff30 0x7f7258149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f7257e00640 1 -- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7258099a60 msgr2=0x7f72580c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f7257e00640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7258099a60 0x7f72580c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f7257e00640 1 -- 172.21.15.59:0/4149593593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7258159060 con 0x7f725815ee00 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f7257400640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7258099a60 0x7f72580c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.220+0000 7f7257e00640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f725815ee00 0x7f72580ce020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7250007e60 tx=0x7f725000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.224+0000 7f724f400640 1 -- 172.21.15.59:0/4149593593 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250014420 con 0x7f725815ee00 2024-04-25T09:01:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.224+0000 7f724f400640 1 -- 172.21.15.59:0/4149593593 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7250019070 con 0x7f725815ee00 2024-04-25T09:01:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.224+0000 7f724f400640 1 -- 172.21.15.59:0/4149593593 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250014820 con 0x7f725815ee00 2024-04-25T09:01:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.224+0000 7f725e800640 1 -- 172.21.15.59:0/4149593593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72580c8db0 con 0x7f725815ee00 2024-04-25T09:01:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.224+0000 7f725e800640 1 -- 172.21.15.59:0/4149593593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72581595e0 con 0x7f725815ee00 2024-04-25T09:01:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.224+0000 7f725e800640 1 -- 172.21.15.59:0/4149593593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72580745d0 con 0x7f725815ee00 2024-04-25T09:01:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.224+0000 7f724f400640 1 -- 172.21.15.59:0/4149593593 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f72500149c0 con 0x7f725815ee00 2024-04-25T09:01:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.224+0000 7f724f400640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7234066f60 0x7f7234069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.224+0000 7f724f400640 1 -- 172.21.15.59:0/4149593593 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7250085570 con 0x7f725815ee00 2024-04-25T09:01:24.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.224+0000 7f7257400640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7234066f60 0x7f7234069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.228+0000 7f7257400640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7234066f60 0x7f7234069420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7248001670 tx=0x7f7248009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:24.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.228+0000 7f724f400640 1 -- 172.21.15.59:0/4149593593 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7250056830 con 0x7f725815ee00 2024-04-25T09:01:24.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.424+0000 7f725e800640 1 -- 172.21.15.59:0/4149593593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f725809ae10 con 0x7f725815ee00 2024-04-25T09:01:24.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.424+0000 7f724f400640 1 -- 172.21.15.59:0/4149593593 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f7250056130 con 0x7f725815ee00 2024-04-25T09:01:24.415 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:24.415 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2167197221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2167197221},{"type":"v1","addr":"172.21.15.59:6834","nonce":2167197221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2689387181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2689387181},{"type":"v1","addr":"172.21.15.178:6837","nonce":2689387181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1461695991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1461695991},{"type":"v1","addr":"172.21.15.59:6835","nonce":1461695991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3239224017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3239224017},{"type":"v1","addr":"172.21.15.178:6836","nonce":3239224017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-04-25T09:01:24.416 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 3 2024-04-25T09:01:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.428+0000 7f725e800640 1 -- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7234066f60 msgr2=0x7f7234069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.428+0000 7f725e800640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7234066f60 0x7f7234069420 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7248001670 tx=0x7f7248009040 comp rx=0 tx=0).stop 2024-04-25T09:01:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.428+0000 7f725e800640 1 -- 172.21.15.59:0/4149593593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f725815ee00 msgr2=0x7f72580ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.428+0000 7f725e800640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f725815ee00 0x7f72580ce020 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7250007e60 tx=0x7f725000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.428+0000 7f725e800640 1 -- 172.21.15.59:0/4149593593 shutdown_connections 2024-04-25T09:01:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.428+0000 7f725e800640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7234066f60 0x7f7234069420 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.428+0000 7f725e800640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f725815ee00 0x7f72580ce020 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.428+0000 7f725e800640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f72580cff30 0x7f7258149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.428+0000 7f725e800640 1 --2- 172.21.15.59:0/4149593593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7258099a60 0x7f72580c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.428+0000 7f725e800640 1 -- 172.21.15.59:0/4149593593 >> 172.21.15.59:0/4149593593 conn(0x7f72580d17a0 msgr2=0x7f7258154840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.428+0000 7f725e800640 1 -- 172.21.15.59:0/4149593593 shutdown_connections 2024-04-25T09:01:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.428+0000 7f725e800640 1 -- 172.21.15.59:0/4149593593 wait complete. 2024-04-25T09:01:24.437 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:24.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe0a1800640 1 Processor -- start 2024-04-25T09:01:24.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe0a1800640 1 -- start start 2024-04-25T09:01:24.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe0a1800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe09c145020 0x7fe09c072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe0a1800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c06ac10 0x7fe09c06b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe0a1800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c0ce130 con 0x7fe09c145400 2024-04-25T09:01:24.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe0a1800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0cd360 con 0x7fe09c145020 2024-04-25T09:01:24.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe0a1800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c073200 con 0x7fe09c06ac10 2024-04-25T09:01:24.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe09aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe09c145020 0x7fe09c072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe09a000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe09c145400 0x7fe09c06fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38674/0 (socket says 172.21.15.59:38674) 2024-04-25T09:01:24.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe09a000640 1 -- 172.21.15.59:0/3442314277 learned_addr learned my addr 172.21.15.59:0/3442314277 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:24.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe09b400640 1 --2- 172.21.15.59:0/3442314277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c06ac10 0x7fe09c06b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe09aa00640 1 -- 172.21.15.59:0/3442314277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c06ac10 msgr2=0x7fe09c06b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:24.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe09aa00640 1 --2- 172.21.15.59:0/3442314277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c06ac10 0x7fe09c06b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe09aa00640 1 -- 172.21.15.59:0/3442314277 >> v1:172.21.15.59:6789/0 conn(0x7fe09c145400 legacy=0x7fe09c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe09aa00640 1 -- 172.21.15.59:0/3442314277 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0cd5b0 con 0x7fe09c145020 2024-04-25T09:01:24.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.588+0000 7fe099600640 1 -- 172.21.15.59:0/3442314277 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311453095 0 0) 0x7fe09c0ce130 con 0x7fe09c145400 2024-04-25T09:01:24.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.592+0000 7fe09aa00640 1 --2- 172.21.15.59:0/3442314277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c145020 0x7fe09c072cc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0097c0 tx=0x7fe08c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9df807cf95edd2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.592+0000 7fe099600640 1 -- 172.21.15.59:0/3442314277 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0b2070 con 0x7fe09c145020 2024-04-25T09:01:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.592+0000 7fe099600640 1 -- 172.21.15.59:0/3442314277 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c0ad640 con 0x7fe09c145020 2024-04-25T09:01:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.592+0000 7fe099600640 1 -- 172.21.15.59:0/3442314277 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0ada10 con 0x7fe09c145020 2024-04-25T09:01:24.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.592+0000 7fe0a1800640 1 -- 172.21.15.59:0/3442314277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c145020 msgr2=0x7fe09c072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.592+0000 7fe0a1800640 1 --2- 172.21.15.59:0/3442314277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c145020 0x7fe09c072cc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0097c0 tx=0x7fe08c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.592+0000 7fe0a1800640 1 -- 172.21.15.59:0/3442314277 shutdown_connections 2024-04-25T09:01:24.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.592+0000 7fe0a1800640 1 --2- 172.21.15.59:0/3442314277 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c06ac10 0x7fe09c06b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.592+0000 7fe0a1800640 1 --2- 172.21.15.59:0/3442314277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c145020 0x7fe09c072cc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.592+0000 7fe0a1800640 1 -- 172.21.15.59:0/3442314277 >> 172.21.15.59:0/3442314277 conn(0x7fe09c0b2400 msgr2=0x7fe09c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:24.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.592+0000 7fe0a1800640 1 -- 172.21.15.59:0/3442314277 shutdown_connections 2024-04-25T09:01:24.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.592+0000 7fe0a1800640 1 -- 172.21.15.59:0/3442314277 wait complete. 2024-04-25T09:01:24.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe0a1800640 1 Processor -- start 2024-04-25T09:01:24.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe0a1800640 1 -- start start 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe0a1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c06ac10 0x7fe09c0b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe0a1800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c145020 0x7fe09c1408b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe0a1800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe09c145400 0x7fe09c0a9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe0a1800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0d0360 con 0x7fe09c06ac10 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe0a1800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c0d01e0 con 0x7fe09c145400 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe0a1800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c160010 con 0x7fe09c145020 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe09aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c06ac10 0x7fe09c0b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe09aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c06ac10 0x7fe09c0b3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58912/0 (socket says 172.21.15.59:58912) 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe09aa00640 1 -- 172.21.15.59:0/1697958090 learned_addr learned my addr 172.21.15.59:0/1697958090 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe09b400640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe09c145400 0x7fe09c0a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe09a000640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c145020 0x7fe09c1408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe09aa00640 1 -- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c145020 msgr2=0x7fe09c1408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe09aa00640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c145020 0x7fe09c1408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe09aa00640 1 -- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe09c145400 msgr2=0x7fe09c0a9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe09aa00640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe09c145400 0x7fe09c0a9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe09aa00640 1 -- 172.21.15.59:0/1697958090 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0b5830 con 0x7fe09c06ac10 2024-04-25T09:01:24.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe09aa00640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c06ac10 0x7fe09c0b3e90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0b0040 tx=0x7fe08c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:24.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe092a00640 1 -- 172.21.15.59:0/1697958090 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0b2040 con 0x7fe09c06ac10 2024-04-25T09:01:24.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe092a00640 1 -- 172.21.15.59:0/1697958090 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c0bd070 con 0x7fe09c06ac10 2024-04-25T09:01:24.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe0a1800640 1 -- 172.21.15.59:0/1697958090 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c0b4790 con 0x7fe09c06ac10 2024-04-25T09:01:24.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe092a00640 1 -- 172.21.15.59:0/1697958090 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c0b6650 con 0x7fe09c06ac10 2024-04-25T09:01:24.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe0a1800640 1 -- 172.21.15.59:0/1697958090 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c0b4d50 con 0x7fe09c06ac10 2024-04-25T09:01:24.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.596+0000 7fe0a1800640 1 -- 172.21.15.59:0/1697958090 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c0745d0 con 0x7fe09c06ac10 2024-04-25T09:01:24.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.600+0000 7fe092a00640 1 -- 172.21.15.59:0/1697958090 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe08c0b67f0 con 0x7fe09c06ac10 2024-04-25T09:01:24.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.600+0000 7fe092a00640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe07c066f60 0x7fe07c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.600+0000 7fe092a00640 1 -- 172.21.15.59:0/1697958090 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe08c11ee20 con 0x7fe09c06ac10 2024-04-25T09:01:24.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.600+0000 7fe09a000640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe07c066f60 0x7fe07c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.600+0000 7fe09a000640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe07c066f60 0x7fe07c069420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0b3700 tx=0x7fe088007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:24.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.604+0000 7fe092a00640 1 -- 172.21.15.59:0/1697958090 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe09c0b5830 con 0x7fe09c06ac10 2024-04-25T09:01:24.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.768+0000 7fe0a1800640 1 -- 172.21.15.59:0/1697958090 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe09c072550 con 0x7fe09c06ac10 2024-04-25T09:01:24.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.768+0000 7fe092a00640 1 -- 172.21.15.59:0/1697958090 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12884 (secure 0 0 0) 0x7fe08c016090 con 0x7fe09c06ac10 2024-04-25T09:01:24.760 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:24.761 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":16,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:17.720728+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:24.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.772+0000 7fe0a1800640 1 -- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe07c066f60 msgr2=0x7fe07c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.772+0000 7fe0a1800640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe07c066f60 0x7fe07c069420 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0b3700 tx=0x7fe088007c10 comp rx=0 tx=0).stop 2024-04-25T09:01:24.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.772+0000 7fe0a1800640 1 -- 172.21.15.59:0/1697958090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c06ac10 msgr2=0x7fe09c0b3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.772+0000 7fe0a1800640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c06ac10 0x7fe09c0b3e90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0b0040 tx=0x7fe08c019240 comp rx=0 tx=0).stop 2024-04-25T09:01:24.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.772+0000 7fe0a1800640 1 -- 172.21.15.59:0/1697958090 shutdown_connections 2024-04-25T09:01:24.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.772+0000 7fe0a1800640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe07c066f60 0x7fe07c069420 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.772+0000 7fe0a1800640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe09c145400 0x7fe09c0a9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.772+0000 7fe0a1800640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe09c145020 0x7fe09c1408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.772+0000 7fe0a1800640 1 --2- 172.21.15.59:0/1697958090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe09c06ac10 0x7fe09c0b3e90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.772+0000 7fe0a1800640 1 -- 172.21.15.59:0/1697958090 >> 172.21.15.59:0/1697958090 conn(0x7fe09c0b2400 msgr2=0x7fe09c0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:24.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.772+0000 7fe0a1800640 1 -- 172.21.15.59:0/1697958090 shutdown_connections 2024-04-25T09:01:24.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.772+0000 7fe0a1800640 1 -- 172.21.15.59:0/1697958090 wait complete. 2024-04-25T09:01:24.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:01:24.782 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:01:24.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.932+0000 7f32dac00640 1 Processor -- start 2024-04-25T09:01:24.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.932+0000 7f32dac00640 1 -- start start 2024-04-25T09:01:24.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32dac00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f32d415c9b0 0x7f32d406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32dac00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d415fc00 con 0x7f32d4159320 2024-04-25T09:01:24.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32dac00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32d415fee0 con 0x7f32d406e010 2024-04-25T09:01:24.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32dac00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32d406d640 con 0x7f32d415c9b0 2024-04-25T09:01:24.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f32d4159320 0x7f32d415f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38676/0 (socket says 172.21.15.59:38676) 2024-04-25T09:01:24.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3e00640 1 -- 172.21.15.59:0/4116596538 learned_addr learned my addr 172.21.15.59:0/4116596538 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32cbe00640 1 --2- 172.21.15.59:0/4116596538 >> v2:172.21.15.178:3300/0 conn(0x7f32d415c9b0 0x7f32d406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1632826941 0 0) 0x7f32d415fc00 con 0x7f32d4159320 2024-04-25T09:01:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32b8003530 con 0x7f32d4159320 2024-04-25T09:01:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1809265184 0 0) 0x7f32b8003530 con 0x7f32d4159320 2024-04-25T09:01:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 >> v2:172.21.15.178:3300/0 conn(0x7f32d415c9b0 msgr2=0x7f32d406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 --2- 172.21.15.59:0/4116596538 >> v2:172.21.15.178:3300/0 conn(0x7f32d415c9b0 0x7f32d406dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 >> v1:172.21.15.178:6789/0 conn(0x7f32d406e010 legacy=0x7f32d406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d41601c0 con 0x7f32d4159320 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f32c4001680 con 0x7f32d4159320 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 >> v1:172.21.15.59:6789/0 conn(0x7f32d4159320 legacy=0x7f32d415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 --2- 172.21.15.59:0/4116596538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b8003a10 0x7f32b8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 --2- 172.21.15.59:0/4116596538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8004810 0x7f32b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 --2- 172.21.15.59:0/4116596538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b80051d0 0x7f32b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d406d640 con 0x7f32b8004810 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b800c0d0 con 0x7f32b80051d0 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b800c2d0 con 0x7f32b8003a10 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32cbe00640 1 --2- 172.21.15.59:0/4116596538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8004810 0x7f32b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d3e00640 1 --2- 172.21.15.59:0/4116596538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b8003a10 0x7f32b8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d8c00640 1 --2- 172.21.15.59:0/4116596538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b80051d0 0x7f32b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32cbe00640 1 -- 172.21.15.59:0/4116596538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b8003a10 msgr2=0x7f32b8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:24.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32cbe00640 1 --2- 172.21.15.59:0/4116596538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32b8003a10 0x7f32b8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32cbe00640 1 -- 172.21.15.59:0/4116596538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b80051d0 msgr2=0x7f32b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:24.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32cbe00640 1 --2- 172.21.15.59:0/4116596538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b80051d0 0x7f32b800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32d8c00640 1 -- 172.21.15.59:0/4116596538 reap_dead start 2024-04-25T09:01:24.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.936+0000 7f32cbe00640 1 -- 172.21.15.59:0/4116596538 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b8003530 con 0x7f32b8004810 2024-04-25T09:01:24.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.940+0000 7f32cbe00640 1 --2- 172.21.15.59:0/4116596538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8004810 0x7f32b8004c90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009ae0 tx=0x7f32bc01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe389331efb0f95b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.940+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0b2070 con 0x7f32b8004810 2024-04-25T09:01:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.940+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32bc0a5670 con 0x7f32b8004810 2024-04-25T09:01:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.940+0000 7f32d3400640 1 -- 172.21.15.59:0/4116596538 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc0096b0 con 0x7f32b8004810 2024-04-25T09:01:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.940+0000 7f32dac00640 1 -- 172.21.15.59:0/4116596538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8004810 msgr2=0x7f32b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.940+0000 7f32dac00640 1 --2- 172.21.15.59:0/4116596538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8004810 0x7f32b8004c90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009ae0 tx=0x7f32bc01ca20 comp rx=0 tx=0).stop 2024-04-25T09:01:24.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.940+0000 7f32dac00640 1 -- 172.21.15.59:0/4116596538 shutdown_connections 2024-04-25T09:01:24.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.940+0000 7f32dac00640 1 --2- 172.21.15.59:0/4116596538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32b8004810 0x7f32b8004c90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.940+0000 7f32dac00640 1 -- 172.21.15.59:0/4116596538 >> 172.21.15.59:0/4116596538 conn(0x7f32d4067080 msgr2=0x7f32d406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:24.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.940+0000 7f32dac00640 1 -- 172.21.15.59:0/4116596538 shutdown_connections 2024-04-25T09:01:24.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.940+0000 7f32dac00640 1 -- 172.21.15.59:0/4116596538 wait complete. 2024-04-25T09:01:24.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32dac00640 1 Processor -- start 2024-04-25T09:01:24.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32dac00640 1 -- start start 2024-04-25T09:01:24.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32dac00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b8004810 0x7f32d413d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32dac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32d40b2aa0 0x7f32d40b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32dac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d40b1a60 0x7f32d415dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32dac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d406dad0 con 0x7f32d40b1a60 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32dac00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32d4159700 con 0x7f32b8004810 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32dac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d406dc50 con 0x7f32d40b2aa0 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d40b1a60 0x7f32d415dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d40b1a60 0x7f32d415dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58930/0 (socket says 172.21.15.59:58930) 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d8c00640 1 -- 172.21.15.59:0/805702543 learned_addr learned my addr 172.21.15.59:0/805702543 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d3e00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b8004810 0x7f32d413d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32cbe00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32d40b2aa0 0x7f32d40b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d8c00640 1 -- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32d40b2aa0 msgr2=0x7f32d40b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d8c00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32d40b2aa0 0x7f32d40b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d8c00640 1 -- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b8004810 msgr2=0x7f32d413d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d8c00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b8004810 0x7f32d413d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:24.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d8c00640 1 -- 172.21.15.59:0/805702543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40b2f20 con 0x7f32d40b1a60 2024-04-25T09:01:24.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d8c00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d40b1a60 0x7f32d415dce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32d40aeed0 tx=0x7f32cc00e920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:24.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d0c00640 1 -- 172.21.15.59:0/805702543 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc019070 con 0x7f32d40b1a60 2024-04-25T09:01:24.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d0c00640 1 -- 172.21.15.59:0/805702543 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32cc006e30 con 0x7f32d40b1a60 2024-04-25T09:01:24.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32d0c00640 1 -- 172.21.15.59:0/805702543 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32cc003ba0 con 0x7f32d40b1a60 2024-04-25T09:01:24.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32dac00640 1 -- 172.21.15.59:0/805702543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32d40b09c0 con 0x7f32d40b1a60 2024-04-25T09:01:24.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32dac00640 1 -- 172.21.15.59:0/805702543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32d40b0f80 con 0x7f32d40b1a60 2024-04-25T09:01:24.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.944+0000 7f32dac00640 1 -- 172.21.15.59:0/805702543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32d40745d0 con 0x7f32d40b1a60 2024-04-25T09:01:24.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.948+0000 7f32d0c00640 1 -- 172.21.15.59:0/805702543 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f32cc005070 con 0x7f32d40b1a60 2024-04-25T09:01:24.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.948+0000 7f32d0c00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f32b0066f90 0x7f32b0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:24.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.948+0000 7f32d0c00640 1 -- 172.21.15.59:0/805702543 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f32cc084160 con 0x7f32d40b1a60 2024-04-25T09:01:24.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.948+0000 7f32d3e00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f32b0066f90 0x7f32b0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:24.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.948+0000 7f32d3e00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f32b0066f90 0x7f32b0069450 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f32c40017f0 tx=0x7f32c4001480 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:24.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:24.952+0000 7f32d0c00640 1 -- 172.21.15.59:0/805702543 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f32cc054dd0 con 0x7f32d40b1a60 2024-04-25T09:01:25.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 -- 172.21.15.59:0/805702543 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32d40cc920 con 0x7f32d40b1a60 2024-04-25T09:01:25.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32d0c00640 1 -- 172.21.15.59:0/805702543 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32cc058e70 con 0x7f32d40b1a60 2024-04-25T09:01:25.107 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:01:25.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 -- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f32b0066f90 msgr2=0x7f32b0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:25.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f32b0066f90 0x7f32b0069450 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f32c40017f0 tx=0x7f32c4001480 comp rx=0 tx=0).stop 2024-04-25T09:01:25.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 -- 172.21.15.59:0/805702543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d40b1a60 msgr2=0x7f32d415dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:25.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d40b1a60 0x7f32d415dce0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f32d40aeed0 tx=0x7f32cc00e920 comp rx=0 tx=0).stop 2024-04-25T09:01:25.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 -- 172.21.15.59:0/805702543 shutdown_connections 2024-04-25T09:01:25.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f32b0066f90 0x7f32b0069450 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32d40b1a60 0x7f32d415dce0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f32d40b2aa0 0x7f32d40b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 --2- 172.21.15.59:0/805702543 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f32b8004810 0x7f32d413d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 -- 172.21.15.59:0/805702543 >> 172.21.15.59:0/805702543 conn(0x7f32d4067080 msgr2=0x7f32d40cce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:25.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 -- 172.21.15.59:0/805702543 shutdown_connections 2024-04-25T09:01:25.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.116+0000 7f32dac00640 1 -- 172.21.15.59:0/805702543 wait complete. 2024-04-25T09:01:25.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:01:25.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.276+0000 7f2b04000640 1 Processor -- start 2024-04-25T09:01:25.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.276+0000 7f2b04000640 1 -- start start 2024-04-25T09:01:25.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b04000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2afc145270 0x7f2afc15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b04000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2afc0cd4d0 0x7f2afc0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b04000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2afc0b1750 0x7f2afc0b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b04000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2afc0b20e0 con 0x7f2afc0b1750 2024-04-25T09:01:25.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b04000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2afc145650 con 0x7f2afc145270 2024-04-25T09:01:25.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b04000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc0cc4e0 con 0x7f2afc0cd4d0 2024-04-25T09:01:25.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b02000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2afc0b1750 0x7f2afc0b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:25.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b02000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2afc0b1750 0x7f2afc0b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58932/0 (socket says 172.21.15.59:58932) 2024-04-25T09:01:25.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b02000640 1 -- 172.21.15.59:0/2922129678 learned_addr learned my addr 172.21.15.59:0/2922129678 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:25.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b02000640 1 -- 172.21.15.59:0/2922129678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2afc0cd4d0 msgr2=0x7f2afc0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:25.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b02000640 1 --2- 172.21.15.59:0/2922129678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2afc0cd4d0 0x7f2afc0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b02000640 1 -- 172.21.15.59:0/2922129678 >> v2:172.21.15.178:3300/0 conn(0x7f2afc145270 msgr2=0x7f2afc15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:25.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b01600640 1 --2- 172.21.15.59:0/2922129678 >> v2:172.21.15.178:3300/0 conn(0x7f2afc145270 0x7f2afc15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:25.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b02000640 1 --2- 172.21.15.59:0/2922129678 >> v2:172.21.15.178:3300/0 conn(0x7f2afc145270 0x7f2afc15fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b02000640 1 -- 172.21.15.59:0/2922129678 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc0ce040 con 0x7f2afc0b1750 2024-04-25T09:01:25.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b01600640 1 --2- 172.21.15.59:0/2922129678 >> v2:172.21.15.178:3300/0 conn(0x7f2afc145270 0x7f2afc15fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:25.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.280+0000 7f2b02000640 1 --2- 172.21.15.59:0/2922129678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2afc0b1750 0x7f2afc0b1ba0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2afc06f3a0 tx=0x7f2af401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e6ff5013700fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:25.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2afbe00640 1 -- 172.21.15.59:0/2922129678 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40a5760 con 0x7f2afc0b1750 2024-04-25T09:01:25.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2afbe00640 1 -- 172.21.15.59:0/2922129678 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af40a5900 con 0x7f2afc0b1750 2024-04-25T09:01:25.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2afbe00640 1 -- 172.21.15.59:0/2922129678 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40a5cd0 con 0x7f2afc0b1750 2024-04-25T09:01:25.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 -- 172.21.15.59:0/2922129678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2afc0b1750 msgr2=0x7f2afc0b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:25.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 --2- 172.21.15.59:0/2922129678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2afc0b1750 0x7f2afc0b1ba0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2afc06f3a0 tx=0x7f2af401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 -- 172.21.15.59:0/2922129678 shutdown_connections 2024-04-25T09:01:25.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 --2- 172.21.15.59:0/2922129678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2afc0b1750 0x7f2afc0b1ba0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 --2- 172.21.15.59:0/2922129678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2afc0cd4d0 0x7f2afc0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 --2- 172.21.15.59:0/2922129678 >> v2:172.21.15.178:3300/0 conn(0x7f2afc145270 0x7f2afc15fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 -- 172.21.15.59:0/2922129678 >> 172.21.15.59:0/2922129678 conn(0x7f2afc066fa0 msgr2=0x7f2afc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 -- 172.21.15.59:0/2922129678 shutdown_connections 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 -- 172.21.15.59:0/2922129678 wait complete. 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 Processor -- start 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 -- start start 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2afc0b1750 0x7f2afc15ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2afc0cd4d0 0x7f2afc0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2afc145270 0x7f2afc0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc15c590 con 0x7f2afc145270 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc15f930 con 0x7f2afc0cd4d0 2024-04-25T09:01:25.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b04000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2afc15c710 con 0x7f2afc0b1750 2024-04-25T09:01:25.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b02000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2afc145270 0x7f2afc0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:25.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b02000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2afc145270 0x7f2afc0b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58948/0 (socket says 172.21.15.59:58948) 2024-04-25T09:01:25.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b02000640 1 -- 172.21.15.59:0/1757580957 learned_addr learned my addr 172.21.15.59:0/1757580957 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:25.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b01600640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2afc0b1750 0x7f2afc15ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:25.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.284+0000 7f2b00c00640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2afc0cd4d0 0x7f2afc0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:25.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2b02000640 1 -- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2afc0b1750 msgr2=0x7f2afc15ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:25.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2b02000640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2afc0b1750 0x7f2afc15ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2b02000640 1 -- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2afc0cd4d0 msgr2=0x7f2afc0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:25.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2b02000640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2afc0cd4d0 0x7f2afc0b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2b02000640 1 -- 172.21.15.59:0/1757580957 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc15cc30 con 0x7f2afc145270 2024-04-25T09:01:25.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2b02000640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2afc145270 0x7f2afc0b4180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2af40af040 tx=0x7f2af4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2af9600640 1 -- 172.21.15.59:0/1757580957 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40b8670 con 0x7f2afc145270 2024-04-25T09:01:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2af9600640 1 -- 172.21.15.59:0/1757580957 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af40be070 con 0x7f2afc145270 2024-04-25T09:01:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2af9600640 1 -- 172.21.15.59:0/1757580957 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af40b8a70 con 0x7f2afc145270 2024-04-25T09:01:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2b04000640 1 -- 172.21.15.59:0/1757580957 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2afc15cf10 con 0x7f2afc145270 2024-04-25T09:01:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2b04000640 1 -- 172.21.15.59:0/1757580957 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2afc15d4d0 con 0x7f2afc145270 2024-04-25T09:01:25.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2b04000640 1 -- 172.21.15.59:0/1757580957 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2afc15bb70 con 0x7f2afc145270 2024-04-25T09:01:25.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2af9600640 1 -- 172.21.15.59:0/1757580957 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2af40b8c10 con 0x7f2afc145270 2024-04-25T09:01:25.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2af9600640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2adc066f60 0x7f2adc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.288+0000 7f2af9600640 1 -- 172.21.15.59:0/1757580957 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2af411fec0 con 0x7f2afc145270 2024-04-25T09:01:25.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.292+0000 7f2b01600640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2adc066f60 0x7f2adc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:25.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.292+0000 7f2b01600640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2adc066f60 0x7f2adc069420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2af0006fd0 tx=0x7f2af0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:25.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.292+0000 7f2af9600640 1 -- 172.21.15.59:0/1757580957 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2af40165e0 con 0x7f2afc145270 2024-04-25T09:01:25.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.456+0000 7f2b04000640 1 -- 172.21.15.59:0/1757580957 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2afc06b8e0 con 0x7f2afc145270 2024-04-25T09:01:25.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.456+0000 7f2af9600640 1 -- 172.21.15.59:0/1757580957 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2af40f0d10 con 0x7f2afc145270 2024-04-25T09:01:25.447 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:25.447 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T09:01:25.447 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:01:25.447 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-04-25T09:01:25.448 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-04-25T09:01:25.448 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:01:25.448 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T09:01:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.460+0000 7f2b04000640 1 -- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2adc066f60 msgr2=0x7f2adc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.460+0000 7f2b04000640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2adc066f60 0x7f2adc069420 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2af0006fd0 tx=0x7f2af0008040 comp rx=0 tx=0).stop 2024-04-25T09:01:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.460+0000 7f2b04000640 1 -- 172.21.15.59:0/1757580957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2afc145270 msgr2=0x7f2afc0b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.460+0000 7f2b04000640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2afc145270 0x7f2afc0b4180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2af40af040 tx=0x7f2af4019790 comp rx=0 tx=0).stop 2024-04-25T09:01:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.460+0000 7f2b04000640 1 -- 172.21.15.59:0/1757580957 shutdown_connections 2024-04-25T09:01:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.460+0000 7f2b04000640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2adc066f60 0x7f2adc069420 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.460+0000 7f2b04000640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2afc145270 0x7f2afc0b4180 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.460+0000 7f2b04000640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2afc0cd4d0 0x7f2afc0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.460+0000 7f2b04000640 1 --2- 172.21.15.59:0/1757580957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2afc0b1750 0x7f2afc15ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.460+0000 7f2b04000640 1 -- 172.21.15.59:0/1757580957 >> 172.21.15.59:0/1757580957 conn(0x7f2afc066fa0 msgr2=0x7f2afc0acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.460+0000 7f2b04000640 1 -- 172.21.15.59:0/1757580957 shutdown_connections 2024-04-25T09:01:25.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.460+0000 7f2b04000640 1 -- 172.21.15.59:0/1757580957 wait complete. 2024-04-25T09:01:25.468 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:01:25.468 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:01:25.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa044800640 1 Processor -- start 2024-04-25T09:01:25.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa044800640 1 -- start start 2024-04-25T09:01:25.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa044800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c144080 0x7fa03c0ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa044800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa03c06ead0 0x7fa03c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa044800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c0cf490 con 0x7fa03c071e40 2024-04-25T09:01:25.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa044800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa03c0719b0 con 0x7fa03c06ead0 2024-04-25T09:01:25.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa044800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0cf1b0 con 0x7fa03c144080 2024-04-25T09:01:25.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa042800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa03c06ead0 0x7fa03c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:25.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa041e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c144080 0x7fa03c0ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:25.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa041400640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fa03c071e40 0x7fa03c06e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:54860/0 (socket says 172.21.15.59:54860) 2024-04-25T09:01:25.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa041400640 1 -- 172.21.15.59:0/4131162484 learned_addr learned my addr 172.21.15.59:0/4131162484 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:25.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa042800640 1 -- 172.21.15.59:0/4131162484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c144080 msgr2=0x7fa03c0ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:25.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa042800640 1 --2- 172.21.15.59:0/4131162484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c144080 0x7fa03c0ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa042800640 1 -- 172.21.15.59:0/4131162484 >> v1:172.21.15.178:6789/0 conn(0x7fa03c071e40 legacy=0x7fa03c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:25.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.624+0000 7fa042800640 1 -- 172.21.15.59:0/4131162484 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c071360 con 0x7fa03c06ead0 2024-04-25T09:01:25.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.628+0000 7fa042800640 1 --2- 172.21.15.59:0/4131162484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c06ead0 0x7fa03c0ceba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa03c071b30 tx=0x7fa03801c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e0399d424c2a5c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:25.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.628+0000 7fa040a00640 1 -- 172.21.15.59:0/4131162484 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0380b2070 con 0x7fa03c06ead0 2024-04-25T09:01:25.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.628+0000 7fa040a00640 1 -- 172.21.15.59:0/4131162484 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0380a59c0 con 0x7fa03c06ead0 2024-04-25T09:01:25.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.628+0000 7fa040a00640 1 -- 172.21.15.59:0/4131162484 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0380a5d90 con 0x7fa03c06ead0 2024-04-25T09:01:25.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.628+0000 7fa044800640 1 -- 172.21.15.59:0/4131162484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c06ead0 msgr2=0x7fa03c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:25.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.628+0000 7fa044800640 1 --2- 172.21.15.59:0/4131162484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c06ead0 0x7fa03c0ceba0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa03c071b30 tx=0x7fa03801c920 comp rx=0 tx=0).stop 2024-04-25T09:01:25.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.628+0000 7fa044800640 1 -- 172.21.15.59:0/4131162484 shutdown_connections 2024-04-25T09:01:25.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.628+0000 7fa044800640 1 --2- 172.21.15.59:0/4131162484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c06ead0 0x7fa03c0ceba0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.628+0000 7fa044800640 1 --2- 172.21.15.59:0/4131162484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c144080 0x7fa03c0ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.628+0000 7fa044800640 1 -- 172.21.15.59:0/4131162484 >> 172.21.15.59:0/4131162484 conn(0x7fa03c06ac10 msgr2=0x7fa03c06b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:25.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.628+0000 7fa044800640 1 -- 172.21.15.59:0/4131162484 shutdown_connections 2024-04-25T09:01:25.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.628+0000 7fa044800640 1 -- 172.21.15.59:0/4131162484 wait complete. 2024-04-25T09:01:25.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa044800640 1 Processor -- start 2024-04-25T09:01:25.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa044800640 1 -- start start 2024-04-25T09:01:25.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa044800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03c06ead0 0x7fa03c13aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa044800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c071e40 0x7fa03c140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa044800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c144080 0x7fa03c142410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa044800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c15eb90 con 0x7fa03c06ead0 2024-04-25T09:01:25.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa044800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c15ea10 con 0x7fa03c144080 2024-04-25T09:01:25.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa044800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c15ed10 con 0x7fa03c071e40 2024-04-25T09:01:25.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa041e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03c06ead0 0x7fa03c13aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:25.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa041e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03c06ead0 0x7fa03c13aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58954/0 (socket says 172.21.15.59:58954) 2024-04-25T09:01:25.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa041e00640 1 -- 172.21.15.59:0/1065233136 learned_addr learned my addr 172.21.15.59:0/1065233136 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:25.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa041400640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c071e40 0x7fa03c140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:25.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa042800640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c144080 0x7fa03c142410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:25.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa041e00640 1 -- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c071e40 msgr2=0x7fa03c140640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:25.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa041e00640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c071e40 0x7fa03c140640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa041e00640 1 -- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c144080 msgr2=0x7fa03c142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:25.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa041e00640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c144080 0x7fa03c142410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:25.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa041e00640 1 -- 172.21.15.59:0/1065233136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c161690 con 0x7fa03c06ead0 2024-04-25T09:01:25.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa041e00640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03c06ead0 0x7fa03c13aff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa03000e8a0 tx=0x7fa03000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:25.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa036000640 1 -- 172.21.15.59:0/1065233136 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030017070 con 0x7fa03c06ead0 2024-04-25T09:01:25.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa036000640 1 -- 172.21.15.59:0/1065233136 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03000c8e0 con 0x7fa03c06ead0 2024-04-25T09:01:25.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa036000640 1 -- 172.21.15.59:0/1065233136 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03000cc90 con 0x7fa03c06ead0 2024-04-25T09:01:25.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa044800640 1 -- 172.21.15.59:0/1065233136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c161970 con 0x7fa03c06ead0 2024-04-25T09:01:25.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.632+0000 7fa044800640 1 -- 172.21.15.59:0/1065233136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c161f30 con 0x7fa03c06ead0 2024-04-25T09:01:25.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.636+0000 7fa044800640 1 -- 172.21.15.59:0/1065233136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c0745d0 con 0x7fa03c06ead0 2024-04-25T09:01:25.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.636+0000 7fa036000640 1 -- 172.21.15.59:0/1065233136 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa03001a070 con 0x7fa03c06ead0 2024-04-25T09:01:25.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.636+0000 7fa036000640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa020066f60 0x7fa020069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:25.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.636+0000 7fa036000640 1 -- 172.21.15.59:0/1065233136 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa030084a20 con 0x7fa03c06ead0 2024-04-25T09:01:25.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.636+0000 7fa041400640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa020066f60 0x7fa020069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:25.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.636+0000 7fa041400640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa020066f60 0x7fa020069420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa03c162a80 tx=0x7fa02c007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:25.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.640+0000 7fa036000640 1 -- 172.21.15.59:0/1065233136 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa0300557c0 con 0x7fa03c06ead0 2024-04-25T09:01:25.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:25.804+0000 7fa044800640 1 -- 172.21.15.59:0/1065233136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa03c1652d0 con 0x7fa03c06ead0 2024-04-25T09:01:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.760+0000 7fa036000640 1 -- 172.21.15.59:0/1065233136 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa030059860 con 0x7fa03c06ead0 2024-04-25T09:01:26.752 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-04-25T09:01:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.764+0000 7fa044800640 1 -- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa020066f60 msgr2=0x7fa020069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.764+0000 7fa044800640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa020066f60 0x7fa020069420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa03c162a80 tx=0x7fa02c007e90 comp rx=0 tx=0).stop 2024-04-25T09:01:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.764+0000 7fa044800640 1 -- 172.21.15.59:0/1065233136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03c06ead0 msgr2=0x7fa03c13aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.764+0000 7fa044800640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03c06ead0 0x7fa03c13aff0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa03000e8a0 tx=0x7fa03000eca0 comp rx=0 tx=0).stop 2024-04-25T09:01:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.764+0000 7fa044800640 1 -- 172.21.15.59:0/1065233136 shutdown_connections 2024-04-25T09:01:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.764+0000 7fa044800640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa020066f60 0x7fa020069420 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.764+0000 7fa044800640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa03c144080 0x7fa03c142410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.764+0000 7fa044800640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa03c071e40 0x7fa03c140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.764+0000 7fa044800640 1 --2- 172.21.15.59:0/1065233136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03c06ead0 0x7fa03c13aff0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.764+0000 7fa044800640 1 -- 172.21.15.59:0/1065233136 >> 172.21.15.59:0/1065233136 conn(0x7fa03c06ac10 msgr2=0x7fa03c0cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.764+0000 7fa044800640 1 -- 172.21.15.59:0/1065233136 shutdown_connections 2024-04-25T09:01:26.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.764+0000 7fa044800640 1 -- 172.21.15.59:0/1065233136 wait complete. 2024-04-25T09:01:26.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T09:01:26.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.948+0000 7fd4e4200640 1 Processor -- start 2024-04-25T09:01:26.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.948+0000 7fd4e4200640 1 -- start start 2024-04-25T09:01:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.948+0000 7fd4e4200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd4dc15dc60 0x7fd4dc0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.948+0000 7fd4e4200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4dc06bf30 0x7fd4dc0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.948+0000 7fd4e4200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4dc15e040 con 0x7fd4dc099a60 2024-04-25T09:01:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.948+0000 7fd4e4200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4dc0cff80 con 0x7fd4dc06bf30 2024-04-25T09:01:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.948+0000 7fd4e4200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4dc0d0260 con 0x7fd4dc15dc60 2024-04-25T09:01:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.952+0000 7fd4e0e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4dc06bf30 0x7fd4dc0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:26.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.952+0000 7fd4e0e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4dc06bf30 0x7fd4dc0cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58962/0 (socket says 172.21.15.59:58962) 2024-04-25T09:01:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.952+0000 7fd4e0e00640 1 -- 172.21.15.59:0/1785321953 learned_addr learned my addr 172.21.15.59:0/1785321953 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.952+0000 7fd4e1800640 1 --2- 172.21.15.59:0/1785321953 >> v2:172.21.15.178:3300/0 conn(0x7fd4dc15dc60 0x7fd4dc0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.952+0000 7fd4e0e00640 1 -- 172.21.15.59:0/1785321953 >> v2:172.21.15.178:3300/0 conn(0x7fd4dc15dc60 msgr2=0x7fd4dc0d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.952+0000 7fd4e0e00640 1 --2- 172.21.15.59:0/1785321953 >> v2:172.21.15.178:3300/0 conn(0x7fd4dc15dc60 0x7fd4dc0d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.952+0000 7fd4e0e00640 1 -- 172.21.15.59:0/1785321953 >> v1:172.21.15.178:6789/0 conn(0x7fd4dc099a60 legacy=0x7fd4dc0cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:26.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.952+0000 7fd4e0e00640 1 -- 172.21.15.59:0/1785321953 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc0d0540 con 0x7fd4dc06bf30 2024-04-25T09:01:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.952+0000 7fd4e0e00640 1 --2- 172.21.15.59:0/1785321953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4dc06bf30 0x7fd4dc0cf8a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc09a6b0 tx=0x7fd4c801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a38186e28f5319 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.952+0000 7fd4dbe00640 1 -- 172.21.15.59:0/1785321953 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80ab660 con 0x7fd4dc06bf30 2024-04-25T09:01:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.952+0000 7fd4dbe00640 1 -- 172.21.15.59:0/1785321953 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4c80b0070 con 0x7fd4dc06bf30 2024-04-25T09:01:26.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.952+0000 7fd4dbe00640 1 -- 172.21.15.59:0/1785321953 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4c80aba20 con 0x7fd4dc06bf30 2024-04-25T09:01:26.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 -- 172.21.15.59:0/1785321953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4dc06bf30 msgr2=0x7fd4dc0cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:26.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 --2- 172.21.15.59:0/1785321953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4dc06bf30 0x7fd4dc0cf8a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc09a6b0 tx=0x7fd4c801c460 comp rx=0 tx=0).stop 2024-04-25T09:01:26.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 -- 172.21.15.59:0/1785321953 shutdown_connections 2024-04-25T09:01:26.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 --2- 172.21.15.59:0/1785321953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4dc06bf30 0x7fd4dc0cf8a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:26.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 --2- 172.21.15.59:0/1785321953 >> v2:172.21.15.178:3300/0 conn(0x7fd4dc15dc60 0x7fd4dc0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 -- 172.21.15.59:0/1785321953 >> 172.21.15.59:0/1785321953 conn(0x7fd4dc0b3200 msgr2=0x7fd4dc0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 -- 172.21.15.59:0/1785321953 shutdown_connections 2024-04-25T09:01:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 -- 172.21.15.59:0/1785321953 wait complete. 2024-04-25T09:01:26.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 Processor -- start 2024-04-25T09:01:26.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 -- start start 2024-04-25T09:01:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4dc06bf30 0x7fd4dc154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4dc099a60 0x7fd4dc154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4dc15dc60 0x7fd4dc0c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc09a280 con 0x7fd4dc06bf30 2024-04-25T09:01:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc0cc880 con 0x7fd4dc15dc60 2024-04-25T09:01:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e4200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4dc0cadf0 con 0x7fd4dc099a60 2024-04-25T09:01:26.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4dc06bf30 0x7fd4dc154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4dc06bf30 0x7fd4dc154490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58974/0 (socket says 172.21.15.59:58974) 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e1800640 1 -- 172.21.15.59:0/2114839834 learned_addr learned my addr 172.21.15.59:0/2114839834 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e0e00640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4dc099a60 0x7fd4dc154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e2200640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4dc15dc60 0x7fd4dc0c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e1800640 1 -- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4dc099a60 msgr2=0x7fd4dc154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e1800640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4dc099a60 0x7fd4dc154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e1800640 1 -- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4dc15dc60 msgr2=0x7fd4dc0c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e1800640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4dc15dc60 0x7fd4dc0c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.956+0000 7fd4e1800640 1 -- 172.21.15.59:0/2114839834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4dc0cb020 con 0x7fd4dc06bf30 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.960+0000 7fd4e1800640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4dc06bf30 0x7fd4dc154490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000d5f0 tx=0x7fd4d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.960+0000 7fd4d9600640 1 -- 172.21.15.59:0/2114839834 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00125f0 con 0x7fd4dc06bf30 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.960+0000 7fd4d9600640 1 -- 172.21.15.59:0/2114839834 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d0019070 con 0x7fd4dc06bf30 2024-04-25T09:01:26.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.960+0000 7fd4d9600640 1 -- 172.21.15.59:0/2114839834 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00129b0 con 0x7fd4dc06bf30 2024-04-25T09:01:26.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.960+0000 7fd4e4200640 1 -- 172.21.15.59:0/2114839834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4dc0cb300 con 0x7fd4dc06bf30 2024-04-25T09:01:26.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.960+0000 7fd4e4200640 1 -- 172.21.15.59:0/2114839834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4dc152db0 con 0x7fd4dc06bf30 2024-04-25T09:01:26.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.960+0000 7fd4e4200640 1 -- 172.21.15.59:0/2114839834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4dc0745d0 con 0x7fd4dc06bf30 2024-04-25T09:01:26.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.960+0000 7fd4d9600640 1 -- 172.21.15.59:0/2114839834 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd4d0012b50 con 0x7fd4dc06bf30 2024-04-25T09:01:26.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.960+0000 7fd4d9600640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd4bc066f60 0x7fd4bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:26.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.960+0000 7fd4d9600640 1 -- 172.21.15.59:0/2114839834 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd4d00851b0 con 0x7fd4dc06bf30 2024-04-25T09:01:26.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.960+0000 7fd4e0e00640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd4bc066f60 0x7fd4bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:26.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.964+0000 7fd4e0e00640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd4bc066f60 0x7fd4bc069420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80af000 tx=0x7fd4c80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:26.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:26.964+0000 7fd4d9600640 1 -- 172.21.15.59:0/2114839834 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd4d0055cb0 con 0x7fd4dc06bf30 2024-04-25T09:01:27.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.128+0000 7fd4e4200640 1 -- 172.21.15.59:0/2114839834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7fd4dc06d4d0 con 0x7fd4dc06bf30 2024-04-25T09:01:27.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.768+0000 7fd4d9600640 1 -- 172.21.15.59:0/2114839834 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7fd4d0059d50 con 0x7fd4dc06bf30 2024-04-25T09:01:27.758 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-04-25T09:01:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.768+0000 7fd4e4200640 1 -- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd4bc066f60 msgr2=0x7fd4bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.768+0000 7fd4e4200640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd4bc066f60 0x7fd4bc069420 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd4c80af000 tx=0x7fd4c80a7000 comp rx=0 tx=0).stop 2024-04-25T09:01:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.768+0000 7fd4e4200640 1 -- 172.21.15.59:0/2114839834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4dc06bf30 msgr2=0x7fd4dc154490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.768+0000 7fd4e4200640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4dc06bf30 0x7fd4dc154490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000d5f0 tx=0x7fd4d000dab0 comp rx=0 tx=0).stop 2024-04-25T09:01:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.768+0000 7fd4e4200640 1 -- 172.21.15.59:0/2114839834 shutdown_connections 2024-04-25T09:01:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.768+0000 7fd4e4200640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd4bc066f60 0x7fd4bc069420 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.768+0000 7fd4e4200640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd4dc15dc60 0x7fd4dc0c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.768+0000 7fd4e4200640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd4dc099a60 0x7fd4dc154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.768+0000 7fd4e4200640 1 --2- 172.21.15.59:0/2114839834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4dc06bf30 0x7fd4dc154490 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.768+0000 7fd4e4200640 1 -- 172.21.15.59:0/2114839834 >> 172.21.15.59:0/2114839834 conn(0x7fd4dc0b3200 msgr2=0x7fd4dc0ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:27.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.772+0000 7fd4e4200640 1 -- 172.21.15.59:0/2114839834 shutdown_connections 2024-04-25T09:01:27.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.772+0000 7fd4e4200640 1 -- 172.21.15.59:0/2114839834 wait complete. 2024-04-25T09:01:27.804 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:01:27.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.960+0000 7fc17ba00640 1 Processor -- start 2024-04-25T09:01:27.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.960+0000 7fc17ba00640 1 -- start start 2024-04-25T09:01:27.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.960+0000 7fc17ba00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc17415dc60 0x7fc1740d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:27.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.960+0000 7fc17ba00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc17409a170 0x7fc1740cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:27.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.960+0000 7fc17ba00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17415e040 con 0x7fc17406bf30 2024-04-25T09:01:27.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.960+0000 7fc17ba00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740cff80 con 0x7fc17415dc60 2024-04-25T09:01:27.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.960+0000 7fc17ba00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740d0260 con 0x7fc17409a170 2024-04-25T09:01:27.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc16be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc17406bf30 0x7fc174099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38690/0 (socket says 172.21.15.59:38690) 2024-04-25T09:01:27.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc16be00640 1 -- 172.21.15.59:0/2475588339 learned_addr learned my addr 172.21.15.59:0/2475588339 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:27.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc179a00640 1 --2- 172.21.15.59:0/2475588339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc17409a170 0x7fc1740cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:27.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc179000640 1 --2- 172.21.15.59:0/2475588339 >> v2:172.21.15.178:3300/0 conn(0x7fc17415dc60 0x7fc1740d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:27.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc173e00640 1 -- 172.21.15.59:0/2475588339 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322601081 0 0) 0x7fc17415e040 con 0x7fc17406bf30 2024-04-25T09:01:27.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc173e00640 1 -- 172.21.15.59:0/2475588339 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc158003530 con 0x7fc17406bf30 2024-04-25T09:01:27.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc173e00640 1 -- 172.21.15.59:0/2475588339 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 851180844 0 0) 0x7fc158003530 con 0x7fc17406bf30 2024-04-25T09:01:27.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc179000640 1 -- 172.21.15.59:0/2475588339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc17409a170 msgr2=0x7fc1740cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:27.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc179000640 1 --2- 172.21.15.59:0/2475588339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc17409a170 0x7fc1740cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:27.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc179000640 1 -- 172.21.15.59:0/2475588339 >> v1:172.21.15.59:6789/0 conn(0x7fc17406bf30 legacy=0x7fc174099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:27.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc179000640 1 -- 172.21.15.59:0/2475588339 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740d0540 con 0x7fc17415dc60 2024-04-25T09:01:27.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc179a00640 1 --2- 172.21.15.59:0/2475588339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc17409a170 0x7fc1740cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:27.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.964+0000 7fc179000640 1 --2- 172.21.15.59:0/2475588339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17415dc60 0x7fc1740d1020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc1640097c0 tx=0x7fc16401c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45e0e9694a7581a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:27.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc173e00640 1 -- 172.21.15.59:0/2475588339 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1640b0070 con 0x7fc17415dc60 2024-04-25T09:01:27.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc173e00640 1 -- 172.21.15.59:0/2475588339 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1640ab400 con 0x7fc17415dc60 2024-04-25T09:01:27.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc173e00640 1 -- 172.21.15.59:0/2475588339 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c001680 con 0x7fc17415dc60 2024-04-25T09:01:27.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 -- 172.21.15.59:0/2475588339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17415dc60 msgr2=0x7fc1740d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:27.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 --2- 172.21.15.59:0/2475588339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17415dc60 0x7fc1740d1020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc1640097c0 tx=0x7fc16401c300 comp rx=0 tx=0).stop 2024-04-25T09:01:27.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 -- 172.21.15.59:0/2475588339 shutdown_connections 2024-04-25T09:01:27.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 --2- 172.21.15.59:0/2475588339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc17409a170 0x7fc1740cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:27.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 --2- 172.21.15.59:0/2475588339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17415dc60 0x7fc1740d1020 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:27.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 -- 172.21.15.59:0/2475588339 >> 172.21.15.59:0/2475588339 conn(0x7fc1740b3200 msgr2=0x7fc1740b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:27.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 -- 172.21.15.59:0/2475588339 shutdown_connections 2024-04-25T09:01:27.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 -- 172.21.15.59:0/2475588339 wait complete. 2024-04-25T09:01:27.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 Processor -- start 2024-04-25T09:01:27.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 -- start start 2024-04-25T09:01:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17406bf30 0x7fc174154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17409a170 0x7fc1740caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc17415dc60 0x7fc1740cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740cc6f0 con 0x7fc17406bf30 2024-04-25T09:01:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740cc570 con 0x7fc17409a170 2024-04-25T09:01:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc17ba00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740cc870 con 0x7fc17415dc60 2024-04-25T09:01:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc179000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17406bf30 0x7fc174154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc179000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17406bf30 0x7fc174154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58986/0 (socket says 172.21.15.59:58986) 2024-04-25T09:01:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc179000640 1 -- 172.21.15.59:0/1889934509 learned_addr learned my addr 172.21.15.59:0/1889934509 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc179a00640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc17415dc60 0x7fc1740cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:27.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc16be00640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17409a170 0x7fc1740caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc179000640 1 -- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc17415dc60 msgr2=0x7fc1740cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc179000640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc17415dc60 0x7fc1740cafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc179000640 1 -- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17409a170 msgr2=0x7fc1740caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc179000640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17409a170 0x7fc1740caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.968+0000 7fc179000640 1 -- 172.21.15.59:0/1889934509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740c91f0 con 0x7fc17406bf30 2024-04-25T09:01:27.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.972+0000 7fc179000640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17406bf30 0x7fc174154d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc16401a9b0 tx=0x7fc16401ab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:27.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.972+0000 7fc171600640 1 -- 172.21.15.59:0/1889934509 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1640b0050 con 0x7fc17406bf30 2024-04-25T09:01:27.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.972+0000 7fc171600640 1 -- 172.21.15.59:0/1889934509 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1640bc070 con 0x7fc17406bf30 2024-04-25T09:01:27.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.972+0000 7fc171600640 1 -- 172.21.15.59:0/1889934509 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164006e20 con 0x7fc17406bf30 2024-04-25T09:01:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.972+0000 7fc17ba00640 1 -- 172.21.15.59:0/1889934509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1740c94d0 con 0x7fc17406bf30 2024-04-25T09:01:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.972+0000 7fc17ba00640 1 -- 172.21.15.59:0/1889934509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1740c9a90 con 0x7fc17406bf30 2024-04-25T09:01:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.972+0000 7fc17ba00640 1 -- 172.21.15.59:0/1889934509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1740745d0 con 0x7fc17406bf30 2024-04-25T09:01:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.972+0000 7fc171600640 1 -- 172.21.15.59:0/1889934509 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc1640b78b0 con 0x7fc17406bf30 2024-04-25T09:01:27.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.972+0000 7fc171600640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc150066f60 0x7fc150069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.972+0000 7fc171600640 1 -- 172.21.15.59:0/1889934509 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc16411f6a0 con 0x7fc17406bf30 2024-04-25T09:01:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.972+0000 7fc16be00640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc150066f60 0x7fc150069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:27.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.976+0000 7fc16be00640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc150066f60 0x7fc150069420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc15c001330 tx=0x7fc15c0012c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:27.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:27.976+0000 7fc171600640 1 -- 172.21.15.59:0/1889934509 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc164015fb0 con 0x7fc17406bf30 2024-04-25T09:01:28.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.172+0000 7fc17ba00640 1 -- 172.21.15.59:0/1889934509 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc1740b7590 con 0x7fc17406bf30 2024-04-25T09:01:28.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.768+0000 7fc171600640 1 -- 172.21.15.59:0/1889934509 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc1640f0670 con 0x7fc17406bf30 2024-04-25T09:01:28.761 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T09:01:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.772+0000 7fc17ba00640 1 -- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc150066f60 msgr2=0x7fc150069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.772+0000 7fc17ba00640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc150066f60 0x7fc150069420 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc15c001330 tx=0x7fc15c0012c0 comp rx=0 tx=0).stop 2024-04-25T09:01:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.772+0000 7fc17ba00640 1 -- 172.21.15.59:0/1889934509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17406bf30 msgr2=0x7fc174154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.772+0000 7fc17ba00640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17406bf30 0x7fc174154d40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc16401a9b0 tx=0x7fc16401ab40 comp rx=0 tx=0).stop 2024-04-25T09:01:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.772+0000 7fc17ba00640 1 -- 172.21.15.59:0/1889934509 shutdown_connections 2024-04-25T09:01:28.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.772+0000 7fc17ba00640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc150066f60 0x7fc150069420 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.772+0000 7fc17ba00640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc17415dc60 0x7fc1740cafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.772+0000 7fc17ba00640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc17409a170 0x7fc1740caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.772+0000 7fc17ba00640 1 --2- 172.21.15.59:0/1889934509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17406bf30 0x7fc174154d40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.772+0000 7fc17ba00640 1 -- 172.21.15.59:0/1889934509 >> 172.21.15.59:0/1889934509 conn(0x7fc1740b3200 msgr2=0x7fc1740ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:28.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.772+0000 7fc17ba00640 1 -- 172.21.15.59:0/1889934509 shutdown_connections 2024-04-25T09:01:28.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.772+0000 7fc17ba00640 1 -- 172.21.15.59:0/1889934509 wait complete. 2024-04-25T09:01:28.815 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T09:01:28.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T09:01:28.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.972+0000 7f5dc2a00640 1 Processor -- start 2024-04-25T09:01:28.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.972+0000 7f5dc2a00640 1 -- start start 2024-04-25T09:01:28.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.972+0000 7f5dc2a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dbc071250 0x7f5dbc0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:28.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.972+0000 7f5dc2a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5dbc15c4a0 0x7f5dbc15cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:28.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.972+0000 7f5dc2a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dbc15ccc0 con 0x7f5dbc071630 2024-04-25T09:01:28.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.972+0000 7f5dc2a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dbc160200 con 0x7f5dbc15c4a0 2024-04-25T09:01:28.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.972+0000 7f5dc2a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc15c9e0 con 0x7f5dbc071250 2024-04-25T09:01:28.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.972+0000 7f5db3400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5dbc071630 0x7f5dbc15bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38694/0 (socket says 172.21.15.59:38694) 2024-04-25T09:01:28.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5db3400640 1 -- 172.21.15.59:0/943703576 learned_addr learned my addr 172.21.15.59:0/943703576 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:28.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbbe00640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dbc071250 0x7f5dbc0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:28.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dc0a00640 1 --2- 172.21.15.59:0/943703576 >> v2:172.21.15.178:3300/0 conn(0x7f5dbc15c4a0 0x7f5dbc15cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:28.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397694360 0 0) 0x7f5dbc15ccc0 con 0x7f5dbc071630 2024-04-25T09:01:28.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5da0003530 con 0x7f5dbc071630 2024-04-25T09:01:28.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1122903929 0 0) 0x7f5da0003530 con 0x7f5dbc071630 2024-04-25T09:01:28.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dbc071250 msgr2=0x7f5dbc0cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:28.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dbc071250 0x7f5dbc0cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:28.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 >> v2:172.21.15.178:3300/0 conn(0x7f5dbc15c4a0 msgr2=0x7f5dbc15cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:28.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 --2- 172.21.15.59:0/943703576 >> v2:172.21.15.178:3300/0 conn(0x7f5dbc15c4a0 0x7f5dbc15cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:28.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc0cd4b0 con 0x7f5dbc071630 2024-04-25T09:01:28.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f5da4001680 con 0x7f5dbc071630 2024-04-25T09:01:28.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 >> v1:172.21.15.59:6789/0 conn(0x7f5dbc071630 legacy=0x7f5dbc15bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:28.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5da00039c0 0x7f5da0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:28.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da0004810 0x7f5da0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:28.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dbc071250 0x7f5da00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:28.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc160200 con 0x7f5da0004810 2024-04-25T09:01:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc15c9e0 con 0x7f5da00039c0 2024-04-25T09:01:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da000ba50 con 0x7f5dbc071250 2024-04-25T09:01:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dc0a00640 1 --2- 172.21.15.59:0/943703576 >> v2:172.21.15.178:3300/0 conn(0x7f5dbc15c4a0 0x7f5dbc15cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5db3400640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da0004810 0x7f5da0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbbe00640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5da00039c0 0x7f5da0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dc0a00640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dbc071250 0x7f5da00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbbe00640 1 -- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dbc071250 msgr2=0x7f5da00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbbe00640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dbc071250 0x7f5da00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbbe00640 1 -- 172.21.15.59:0/943703576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da0004810 msgr2=0x7f5da0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:28.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbbe00640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5da0004810 0x7f5da0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dbbe00640 1 -- 172.21.15.59:0/943703576 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da0003530 con 0x7f5da00039c0 2024-04-25T09:01:28.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.976+0000 7f5dc0a00640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5dbc071250 0x7f5da00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dbbe00640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5da00039c0 0x7f5da0003de0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009ae0 tx=0x7f5dac01ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1621584c75d303f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0096b0 con 0x7f5da00039c0 2024-04-25T09:01:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac0a6450 con 0x7f5da00039c0 2024-04-25T09:01:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dbb400640 1 -- 172.21.15.59:0/943703576 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0a6840 con 0x7f5da00039c0 2024-04-25T09:01:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 -- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5da00039c0 msgr2=0x7f5da0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 --2- 172.21.15.59:0/943703576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5da00039c0 0x7f5da0003de0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5dac009ae0 tx=0x7f5dac01ca70 comp rx=0 tx=0).stop 2024-04-25T09:01:28.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc0a00640 1 -- 172.21.15.59:0/943703576 reap_dead start 2024-04-25T09:01:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 -- 172.21.15.59:0/943703576 shutdown_connections 2024-04-25T09:01:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 -- 172.21.15.59:0/943703576 >> 172.21.15.59:0/943703576 conn(0x7f5dbc06ac10 msgr2=0x7f5dbc06b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 -- 172.21.15.59:0/943703576 shutdown_connections 2024-04-25T09:01:28.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 -- 172.21.15.59:0/943703576 wait complete. 2024-04-25T09:01:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 Processor -- start 2024-04-25T09:01:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 -- start start 2024-04-25T09:01:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da00039c0 0x7f5dbc146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc0ae720 0x7f5dbc0b2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dbc0b2d50 0x7f5dbc15aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc166610 con 0x7f5dbc0ae720 2024-04-25T09:01:28.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc166490 con 0x7f5dbc0b2d50 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.980+0000 7f5dc2a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc166790 con 0x7f5da00039c0 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc0ae720 0x7f5dbc0b2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc0ae720 0x7f5dbc0b2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59006/0 (socket says 172.21.15.59:59006) 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db3400640 1 -- 172.21.15.59:0/4133694833 learned_addr learned my addr 172.21.15.59:0/4133694833 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5dc0a00640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dbc0b2d50 0x7f5dbc15aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5dbbe00640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da00039c0 0x7f5dbc146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db3400640 1 -- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da00039c0 msgr2=0x7f5dbc146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db3400640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da00039c0 0x7f5dbc146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db3400640 1 -- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dbc0b2d50 msgr2=0x7f5dbc15aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db3400640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dbc0b2d50 0x7f5dbc15aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db3400640 1 -- 172.21.15.59:0/4133694833 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc0acb10 con 0x7f5dbc0ae720 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5dc0a00640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dbc0b2d50 0x7f5dbc15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:28.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db3400640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc0ae720 0x7f5dbc0b2810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5da4004f00 tx=0x7f5da4007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:28.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db8c00640 1 -- 172.21.15.59:0/4133694833 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da400f7b0 con 0x7f5dbc0ae720 2024-04-25T09:01:28.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db8c00640 1 -- 172.21.15.59:0/4133694833 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da4018070 con 0x7f5dbc0ae720 2024-04-25T09:01:28.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db8c00640 1 -- 172.21.15.59:0/4133694833 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da400fb90 con 0x7f5dbc0ae720 2024-04-25T09:01:28.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5dc2a00640 1 -- 172.21.15.59:0/4133694833 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dbc0acdf0 con 0x7f5dbc0ae720 2024-04-25T09:01:28.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5dc2a00640 1 -- 172.21.15.59:0/4133694833 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dbc0ad3b0 con 0x7f5dbc0ae720 2024-04-25T09:01:28.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5dc2a00640 1 -- 172.21.15.59:0/4133694833 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dbc0745d0 con 0x7f5dbc0ae720 2024-04-25T09:01:28.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.984+0000 7f5db8c00640 1 -- 172.21.15.59:0/4133694833 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5da400fd30 con 0x7f5dbc0ae720 2024-04-25T09:01:28.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.988+0000 7f5db8c00640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5d98066f60 0x7f5d98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:28.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.988+0000 7f5db8c00640 1 -- 172.21.15.59:0/4133694833 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5da4084fe0 con 0x7f5dbc0ae720 2024-04-25T09:01:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.988+0000 7f5dbbe00640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5d98066f60 0x7f5d98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:28.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.988+0000 7f5dbbe00640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5d98066f60 0x7f5d98069420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0ad000 tx=0x7f5dac0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:28.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:28.992+0000 7f5db8c00640 1 -- 172.21.15.59:0/4133694833 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5da4055ff0 con 0x7f5dbc0ae720 2024-04-25T09:01:29.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.168+0000 7f5dc2a00640 1 -- 172.21.15.59:0/4133694833 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f5dbc1529a0 con 0x7f5dbc0ae720 2024-04-25T09:01:29.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.784+0000 7f5db8c00640 1 -- 172.21.15.59:0/4133694833 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f5da40558f0 con 0x7f5dbc0ae720 2024-04-25T09:01:29.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.788+0000 7f5dc2a00640 1 -- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5d98066f60 msgr2=0x7f5d98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:29.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.788+0000 7f5dc2a00640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5d98066f60 0x7f5d98069420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5dac0ad000 tx=0x7f5dac0046d0 comp rx=0 tx=0).stop 2024-04-25T09:01:29.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.788+0000 7f5dc2a00640 1 -- 172.21.15.59:0/4133694833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc0ae720 msgr2=0x7f5dbc0b2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:29.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.788+0000 7f5dc2a00640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc0ae720 0x7f5dbc0b2810 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5da4004f00 tx=0x7f5da4007430 comp rx=0 tx=0).stop 2024-04-25T09:01:29.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.788+0000 7f5dc2a00640 1 -- 172.21.15.59:0/4133694833 shutdown_connections 2024-04-25T09:01:29.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.788+0000 7f5dc2a00640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5d98066f60 0x7f5d98069420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:29.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.788+0000 7f5dc2a00640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5dbc0b2d50 0x7f5dbc15aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:29.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.788+0000 7f5dc2a00640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dbc0ae720 0x7f5dbc0b2810 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:29.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.788+0000 7f5dc2a00640 1 --2- 172.21.15.59:0/4133694833 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5da00039c0 0x7f5dbc146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:29.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.788+0000 7f5dc2a00640 1 -- 172.21.15.59:0/4133694833 >> 172.21.15.59:0/4133694833 conn(0x7f5dbc06ac10 msgr2=0x7f5dbc06b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:29.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.788+0000 7f5dc2a00640 1 -- 172.21.15.59:0/4133694833 shutdown_connections 2024-04-25T09:01:29.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.788+0000 7f5dc2a00640 1 -- 172.21.15.59:0/4133694833 wait complete. 2024-04-25T09:01:29.801 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:01:29.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.960+0000 7fdee6200640 1 Processor -- start 2024-04-25T09:01:29.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.960+0000 7fdee6200640 1 -- start start 2024-04-25T09:01:29.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdee6200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee009a8c0 0x7fdee00c5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:29.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdee6200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee00cd510 con 0x7fdee015baf0 2024-04-25T09:01:29.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdee6200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee0099b00 con 0x7fdee00c57a0 2024-04-25T09:01:29.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdee6200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee0099de0 con 0x7fdee009a8c0 2024-04-25T09:01:29.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedf400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdee015baf0 0x7fdee00cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38696/0 (socket says 172.21.15.59:38696) 2024-04-25T09:01:29.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedf400640 1 -- 172.21.15.59:0/30981303 learned_addr learned my addr 172.21.15.59:0/30981303 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:29.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055302486 0 0) 0x7fdee00cd510 con 0x7fdee015baf0 2024-04-25T09:01:29.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec4003530 con 0x7fdee015baf0 2024-04-25T09:01:29.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fded6a00640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee009a8c0 0x7fdee00c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:29.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3878902275 0 0) 0x7fdec4003530 con 0x7fdee015baf0 2024-04-25T09:01:29.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee009a8c0 msgr2=0x7fdee00c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:29.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee009a8c0 0x7fdee00c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:29.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 >> v1:172.21.15.178:6789/0 conn(0x7fdee00c57a0 legacy=0x7fdee015f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:29.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee009a0c0 con 0x7fdee015baf0 2024-04-25T09:01:29.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fded0001680 con 0x7fdee015baf0 2024-04-25T09:01:29.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 >> v1:172.21.15.59:6789/0 conn(0x7fdee015baf0 legacy=0x7fdee00cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:29.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec40039f0 0x7fdec4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee009a8c0 0x7fdec4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdec4004d50 0x7fdec40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee0099de0 con 0x7fdec4004d50 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec400bc80 con 0x7fdec40039f0 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec400be80 con 0x7fdee009a8c0 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedf400640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec40039f0 0x7fdec4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedfe00640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdec4004d50 0x7fdec40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fded6a00640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee009a8c0 0x7fdec4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedfe00640 1 -- 172.21.15.59:0/30981303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee009a8c0 msgr2=0x7fdec4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedfe00640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee009a8c0 0x7fdec4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedfe00640 1 -- 172.21.15.59:0/30981303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec40039f0 msgr2=0x7fdec4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedfe00640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec40039f0 0x7fdec4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:29.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedfe00640 1 -- 172.21.15.59:0/30981303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4003530 con 0x7fdec4004d50 2024-04-25T09:01:29.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.964+0000 7fdedf400640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdec40039f0 0x7fdec4003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:29.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.968+0000 7fdedfe00640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdec4004d50 0x7fdec40051d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fded8001e70 tx=0x7fded801c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd025492141d12b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:29.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.968+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded80af070 con 0x7fdec4004d50 2024-04-25T09:01:29.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.968+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded8003b80 con 0x7fdec4004d50 2024-04-25T09:01:29.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.968+0000 7fdedea00640 1 -- 172.21.15.59:0/30981303 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8001a90 con 0x7fdec4004d50 2024-04-25T09:01:29.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.968+0000 7fdee6200640 1 -- 172.21.15.59:0/30981303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdec4004d50 msgr2=0x7fdec40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:29.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.968+0000 7fdee6200640 1 --2- 172.21.15.59:0/30981303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdec4004d50 0x7fdec40051d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fded8001e70 tx=0x7fded801c780 comp rx=0 tx=0).stop 2024-04-25T09:01:29.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.968+0000 7fdedfe00640 1 -- 172.21.15.59:0/30981303 reap_dead start 2024-04-25T09:01:29.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.968+0000 7fdee6200640 1 -- 172.21.15.59:0/30981303 shutdown_connections 2024-04-25T09:01:29.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.968+0000 7fdee6200640 1 -- 172.21.15.59:0/30981303 >> 172.21.15.59:0/30981303 conn(0x7fdee00b3200 msgr2=0x7fdee00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:29.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.968+0000 7fdee6200640 1 -- 172.21.15.59:0/30981303 shutdown_connections 2024-04-25T09:01:29.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.968+0000 7fdee6200640 1 -- 172.21.15.59:0/30981303 wait complete. 2024-04-25T09:01:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdee6200640 1 Processor -- start 2024-04-25T09:01:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdee6200640 1 -- start start 2024-04-25T09:01:29.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdee6200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdec4004d50 0x7fdee01f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:29.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdee6200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee01f42e0 0x7fdee015bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:29.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdee6200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee015e260 0x7fdee015e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:29.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdee6200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee00c5c10 con 0x7fdec4004d50 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdee6200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee009ad40 con 0x7fdee01f42e0 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdee6200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee00c5d90 con 0x7fdee015e260 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdedf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdec4004d50 0x7fdee01f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdedf400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdec4004d50 0x7fdee01f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59022/0 (socket says 172.21.15.59:59022) 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdedf400640 1 -- 172.21.15.59:0/3607196216 learned_addr learned my addr 172.21.15.59:0/3607196216 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fded6a00640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee01f42e0 0x7fdee015bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdedfe00640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee015e260 0x7fdee015e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdedf400640 1 -- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee015e260 msgr2=0x7fdee015e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdedf400640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee015e260 0x7fdee015e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdedf400640 1 -- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee01f42e0 msgr2=0x7fdee015bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdedf400640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee01f42e0 0x7fdee015bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdedf400640 1 -- 172.21.15.59:0/3607196216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee015c8d0 con 0x7fdec4004d50 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdedfe00640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee015e260 0x7fdee015e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdedf400640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdec4004d50 0x7fdee01f4bc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fded0004880 tx=0x7fded0012900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:29.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fded7e00640 1 -- 172.21.15.59:0/3607196216 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded001c070 con 0x7fdec4004d50 2024-04-25T09:01:29.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fded7e00640 1 -- 172.21.15.59:0/3607196216 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded0014810 con 0x7fdec4004d50 2024-04-25T09:01:29.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fded7e00640 1 -- 172.21.15.59:0/3607196216 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded0014be0 con 0x7fdec4004d50 2024-04-25T09:01:29.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdee6200640 1 -- 172.21.15.59:0/3607196216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee015cbb0 con 0x7fdec4004d50 2024-04-25T09:01:29.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdee6200640 1 -- 172.21.15.59:0/3607196216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee015d170 con 0x7fdec4004d50 2024-04-25T09:01:29.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.972+0000 7fdee6200640 1 -- 172.21.15.59:0/3607196216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee00745d0 con 0x7fdec4004d50 2024-04-25T09:01:29.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.976+0000 7fded7e00640 1 -- 172.21.15.59:0/3607196216 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fded00153e0 con 0x7fdec4004d50 2024-04-25T09:01:29.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.976+0000 7fded7e00640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdebc066f60 0x7fdebc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:29.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.976+0000 7fded7e00640 1 -- 172.21.15.59:0/3607196216 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6007+0+0 (secure 0 0 0) 0x7fded0087d20 con 0x7fdec4004d50 2024-04-25T09:01:29.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.976+0000 7fded6a00640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdebc066f60 0x7fdebc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:29.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.976+0000 7fded6a00640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdebc066f60 0x7fdebc069420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdee00b76d0 tx=0x7fdec8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:29.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:29.980+0000 7fded7e00640 1 -- 172.21.15.59:0/3607196216 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fded0058bf0 con 0x7fdec4004d50 2024-04-25T09:01:30.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:30.140+0000 7fdee6200640 1 -- 172.21.15.59:0/3607196216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdee00cf510 con 0x7fdec4004d50 2024-04-25T09:01:31.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.800+0000 7fded7e00640 1 -- 172.21.15.59:0/3607196216 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7fded00584f0 con 0x7fdec4004d50 2024-04-25T09:01:31.790 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data_ec' created 2024-04-25T09:01:31.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.800+0000 7fdee6200640 1 -- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdebc066f60 msgr2=0x7fdebc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:31.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.800+0000 7fdee6200640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdebc066f60 0x7fdebc069420 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdee00b76d0 tx=0x7fdec8008040 comp rx=0 tx=0).stop 2024-04-25T09:01:31.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.800+0000 7fdee6200640 1 -- 172.21.15.59:0/3607196216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdec4004d50 msgr2=0x7fdee01f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:31.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.800+0000 7fdee6200640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdec4004d50 0x7fdee01f4bc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fded0004880 tx=0x7fded0012900 comp rx=0 tx=0).stop 2024-04-25T09:01:31.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.804+0000 7fdee6200640 1 -- 172.21.15.59:0/3607196216 shutdown_connections 2024-04-25T09:01:31.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.804+0000 7fdee6200640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdebc066f60 0x7fdebc069420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:31.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.804+0000 7fdee6200640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdee015e260 0x7fdee015e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:31.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.804+0000 7fdee6200640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdee01f42e0 0x7fdee015bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:31.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.804+0000 7fdee6200640 1 --2- 172.21.15.59:0/3607196216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdec4004d50 0x7fdee01f4bc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:31.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.804+0000 7fdee6200640 1 -- 172.21.15.59:0/3607196216 >> 172.21.15.59:0/3607196216 conn(0x7fdee00b3200 msgr2=0x7fdee006f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:31.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.804+0000 7fdee6200640 1 -- 172.21.15.59:0/3607196216 shutdown_connections 2024-04-25T09:01:31.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.804+0000 7fdee6200640 1 -- 172.21.15.59:0/3607196216 wait complete. 2024-04-25T09:01:31.828 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T09:01:31.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.984+0000 7f5194c00640 1 Processor -- start 2024-04-25T09:01:31.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.984+0000 7f5194c00640 1 -- start start 2024-04-25T09:01:31.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f5194c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f519015dab0 0x7f51900b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:31.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f5194c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51900713c0 0x7f519006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:31.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f5194c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519015de90 con 0x7f51900b0c00 2024-04-25T09:01:31.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f5194c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5190071a70 con 0x7f519015dab0 2024-04-25T09:01:31.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f5194c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51900b57a0 con 0x7f51900713c0 2024-04-25T09:01:31.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f518de00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f519015dab0 0x7f51900b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:31.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f518e800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51900713c0 0x7f519006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:31.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f518e800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51900713c0 0x7f519006c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:52146/0 (socket says 172.21.15.59:52146) 2024-04-25T09:01:31.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f518e800640 1 -- 172.21.15.59:0/2226784881 learned_addr learned my addr 172.21.15.59:0/2226784881 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:31.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f5187e00640 1 --1- 172.21.15.59:0/2226784881 >> v1:172.21.15.178:6789/0 conn(0x7f51900b0c00 0x7f5190070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:33026/0 (socket says 172.21.15.59:33026) 2024-04-25T09:01:31.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f518e800640 1 -- 172.21.15.59:0/2226784881 >> v2:172.21.15.178:3300/0 conn(0x7f519015dab0 msgr2=0x7f51900b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:31.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f518e800640 1 --2- 172.21.15.59:0/2226784881 >> v2:172.21.15.178:3300/0 conn(0x7f519015dab0 0x7f51900b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:31.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f518e800640 1 -- 172.21.15.59:0/2226784881 >> v1:172.21.15.178:6789/0 conn(0x7f51900b0c00 legacy=0x7f5190070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:31.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f518d400640 1 -- 172.21.15.59:0/2226784881 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901707241 0 0) 0x7f519015de90 con 0x7f51900b0c00 2024-04-25T09:01:31.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.988+0000 7f518e800640 1 -- 172.21.15.59:0/2226784881 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519006bec0 con 0x7f51900713c0 2024-04-25T09:01:31.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f518e800640 1 --2- 172.21.15.59:0/2226784881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51900713c0 0x7f519006c9a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5188009e50 tx=0x7f518801ca00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a477b44f4be141ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:31.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f518d400640 1 -- 172.21.15.59:0/2226784881 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51880a58d0 con 0x7f51900713c0 2024-04-25T09:01:31.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f518d400640 1 -- 172.21.15.59:0/2226784881 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51880a5a70 con 0x7f51900713c0 2024-04-25T09:01:31.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f518d400640 1 -- 172.21.15.59:0/2226784881 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51880a5e40 con 0x7f51900713c0 2024-04-25T09:01:31.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f5194c00640 1 -- 172.21.15.59:0/2226784881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51900713c0 msgr2=0x7f519006c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:31.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f5194c00640 1 --2- 172.21.15.59:0/2226784881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51900713c0 0x7f519006c9a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5188009e50 tx=0x7f518801ca00 comp rx=0 tx=0).stop 2024-04-25T09:01:31.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f5194c00640 1 -- 172.21.15.59:0/2226784881 shutdown_connections 2024-04-25T09:01:31.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f5194c00640 1 --2- 172.21.15.59:0/2226784881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51900713c0 0x7f519006c9a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:31.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f5194c00640 1 --2- 172.21.15.59:0/2226784881 >> v2:172.21.15.178:3300/0 conn(0x7f519015dab0 0x7f51900b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:31.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f5194c00640 1 -- 172.21.15.59:0/2226784881 >> 172.21.15.59:0/2226784881 conn(0x7f519006f510 msgr2=0x7f519006f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:31.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f5194c00640 1 -- 172.21.15.59:0/2226784881 shutdown_connections 2024-04-25T09:01:31.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f5194c00640 1 -- 172.21.15.59:0/2226784881 wait complete. 2024-04-25T09:01:31.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f5194c00640 1 Processor -- start 2024-04-25T09:01:31.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.992+0000 7f5194c00640 1 -- start start 2024-04-25T09:01:31.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5194c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51900713c0 0x7f51901605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:31.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5194c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51900b0c00 0x7f5190152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:31.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5194c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519015dab0 0x7f5190152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:31.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5194c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519006da80 con 0x7f51900713c0 2024-04-25T09:01:31.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5194c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519006d900 con 0x7f519015dab0 2024-04-25T09:01:31.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5194c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519006dc00 con 0x7f51900b0c00 2024-04-25T09:01:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f518de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51900713c0 0x7f51901605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f518de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51900713c0 0x7f51901605d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58092/0 (socket says 172.21.15.59:58092) 2024-04-25T09:01:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f518de00640 1 -- 172.21.15.59:0/2052614443 learned_addr learned my addr 172.21.15.59:0/2052614443 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5187e00640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51900b0c00 0x7f5190152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f518e800640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519015dab0 0x7f5190152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f518de00640 1 -- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51900b0c00 msgr2=0x7f5190152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f518de00640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51900b0c00 0x7f5190152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f518de00640 1 -- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519015dab0 msgr2=0x7f5190152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f518de00640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519015dab0 0x7f5190152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:31.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f518de00640 1 -- 172.21.15.59:0/2052614443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5190154f30 con 0x7f51900713c0 2024-04-25T09:01:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f518de00640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51900713c0 0x7f51901605d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f518000e930 tx=0x7f518000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5186000640 1 -- 172.21.15.59:0/2052614443 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5180017070 con 0x7f51900713c0 2024-04-25T09:01:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5186000640 1 -- 172.21.15.59:0/2052614443 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518000c9a0 con 0x7f51900713c0 2024-04-25T09:01:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5194c00640 1 -- 172.21.15.59:0/2052614443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51901551d0 con 0x7f51900713c0 2024-04-25T09:01:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5186000640 1 -- 172.21.15.59:0/2052614443 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518000cd50 con 0x7f51900713c0 2024-04-25T09:01:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5194c00640 1 -- 172.21.15.59:0/2052614443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5190152100 con 0x7f51900713c0 2024-04-25T09:01:31.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:31.996+0000 7f5194c00640 1 -- 172.21.15.59:0/2052614443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51900745d0 con 0x7f51900713c0 2024-04-25T09:01:31.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.000+0000 7f5186000640 1 -- 172.21.15.59:0/2052614443 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f518001a070 con 0x7f51900713c0 2024-04-25T09:01:31.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.000+0000 7f5186000640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f516c066f90 0x7f516c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:31.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.000+0000 7f5186000640 1 -- 172.21.15.59:0/2052614443 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f5180085ab0 con 0x7f51900713c0 2024-04-25T09:01:31.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.000+0000 7f5187e00640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f516c066f90 0x7f516c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:31.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.000+0000 7f5187e00640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f516c066f90 0x7f516c069450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51900cdc60 tx=0x7f5178007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:31.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.004+0000 7f5186000640 1 -- 172.21.15.59:0/2052614443 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f51800561f0 con 0x7f51900713c0 2024-04-25T09:01:32.093 INFO:tasks.ceph.mds.b.smithi178.stderr:2024-04-25T09:01:32.103+0000 7f9c37200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:01:32.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.164+0000 7f5194c00640 1 -- 172.21.15.59:0/2052614443 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f51900b1150 con 0x7f51900713c0 2024-04-25T09:01:32.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5186000640 1 -- 172.21.15.59:0/2052614443 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f518005c030 con 0x7f51900713c0 2024-04-25T09:01:32.794 INFO:teuthology.orchestra.run.smithi059.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T09:01:32.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5194c00640 1 -- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f516c066f90 msgr2=0x7f516c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:32.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5194c00640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f516c066f90 0x7f516c069450 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51900cdc60 tx=0x7f5178007df0 comp rx=0 tx=0).stop 2024-04-25T09:01:32.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5194c00640 1 -- 172.21.15.59:0/2052614443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51900713c0 msgr2=0x7f51901605d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:32.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5194c00640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51900713c0 0x7f51901605d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f518000e930 tx=0x7f518000edf0 comp rx=0 tx=0).stop 2024-04-25T09:01:32.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5194c00640 1 -- 172.21.15.59:0/2052614443 shutdown_connections 2024-04-25T09:01:32.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5194c00640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f516c066f90 0x7f516c069450 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:32.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5194c00640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f519015dab0 0x7f5190152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:32.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5194c00640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51900b0c00 0x7f5190152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:32.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5194c00640 1 --2- 172.21.15.59:0/2052614443 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51900713c0 0x7f51901605d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:32.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5194c00640 1 -- 172.21.15.59:0/2052614443 >> 172.21.15.59:0/2052614443 conn(0x7f519006f510 msgr2=0x7f519015b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:32.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5194c00640 1 -- 172.21.15.59:0/2052614443 shutdown_connections 2024-04-25T09:01:32.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.804+0000 7f5194c00640 1 -- 172.21.15.59:0/2052614443 wait complete. 2024-04-25T09:01:32.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T09:01:32.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.992+0000 7f1f17e00640 1 Processor -- start 2024-04-25T09:01:32.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.992+0000 7f1f17e00640 1 -- start start 2024-04-25T09:01:32.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f17e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f10144120 0x7f1f1015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:32.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f17e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1015bc40 con 0x7f1f100ccbf0 2024-04-25T09:01:32.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f17e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1015b3a0 con 0x7f1f100b3090 2024-04-25T09:01:32.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f17e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1015e490 con 0x7f1f10144120 2024-04-25T09:01:32.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f14a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1f100ccbf0 0x7f1f1015e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43206/0 (socket says 172.21.15.59:43206) 2024-04-25T09:01:32.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f14a00640 1 -- 172.21.15.59:0/3642787101 learned_addr learned my addr 172.21.15.59:0/3642787101 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f15400640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f10144120 0x7f1f1015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518852805 0 0) 0x7f1f1015bc40 con 0x7f1f100ccbf0 2024-04-25T09:01:32.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef8003530 con 0x7f1f100ccbf0 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3061821659 0 0) 0x7f1ef8003530 con 0x7f1f100ccbf0 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f10144120 msgr2=0x7f1f1015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f10144120 0x7f1f1015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 >> v1:172.21.15.178:6789/0 conn(0x7f1f100b3090 legacy=0x7f1f1006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1015b680 con 0x7f1f100ccbf0 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f1efc001680 con 0x7f1f100ccbf0 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 >> v1:172.21.15.59:6789/0 conn(0x7f1f100ccbf0 legacy=0x7f1f1015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ef80039f0 0x7f1ef8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f10144120 0x7f1ef8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ef8004d50 0x7f1ef80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1015e490 con 0x7f1ef80039f0 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef800ba80 con 0x7f1ef8004d50 2024-04-25T09:01:32.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef800de90 con 0x7f1f10144120 2024-04-25T09:01:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f15400640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ef80039f0 0x7f1ef8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f14a00640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f10144120 0x7f1ef8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f15e00640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ef8004d50 0x7f1ef80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f15400640 1 -- 172.21.15.59:0/3642787101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f10144120 msgr2=0x7f1ef8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f15400640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f10144120 0x7f1ef8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f15400640 1 -- 172.21.15.59:0/3642787101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ef8004d50 msgr2=0x7f1ef80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f15400640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ef8004d50 0x7f1ef80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f15400640 1 -- 172.21.15.59:0/3642787101 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef8003530 con 0x7f1ef80039f0 2024-04-25T09:01:32.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:32.996+0000 7f1f14a00640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1f10144120 0x7f1ef8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.000+0000 7f1f15400640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ef80039f0 0x7f1ef8003dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009ae0 tx=0x7f1f0401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aee322d2c892d86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.000+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040096b0 con 0x7f1ef80039f0 2024-04-25T09:01:32.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.000+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f040a9460 con 0x7f1ef80039f0 2024-04-25T09:01:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.000+0000 7f1f0fe00640 1 -- 172.21.15.59:0/3642787101 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f040a9850 con 0x7f1ef80039f0 2024-04-25T09:01:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.000+0000 7f1f17e00640 1 -- 172.21.15.59:0/3642787101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ef80039f0 msgr2=0x7f1ef8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.000+0000 7f1f17e00640 1 --2- 172.21.15.59:0/3642787101 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ef80039f0 0x7f1ef8003dd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1f04009ae0 tx=0x7f1f0401ca70 comp rx=0 tx=0).stop 2024-04-25T09:01:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.000+0000 7f1f15e00640 1 -- 172.21.15.59:0/3642787101 reap_dead start 2024-04-25T09:01:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.000+0000 7f1f17e00640 1 -- 172.21.15.59:0/3642787101 shutdown_connections 2024-04-25T09:01:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.000+0000 7f1f17e00640 1 -- 172.21.15.59:0/3642787101 >> 172.21.15.59:0/3642787101 conn(0x7f1f10067080 msgr2=0x7f1f1006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.000+0000 7f1f17e00640 1 -- 172.21.15.59:0/3642787101 shutdown_connections 2024-04-25T09:01:32.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.000+0000 7f1f17e00640 1 -- 172.21.15.59:0/3642787101 wait complete. 2024-04-25T09:01:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f17e00640 1 Processor -- start 2024-04-25T09:01:32.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f17e00640 1 -- start start 2024-04-25T09:01:32.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f17e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef80039f0 0x7f1f100c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f17e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f1015a380 0x7f1f1013cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f17e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f1013beb0 0x7f1f1013c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f17e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1006ec70 con 0x7f1f1013beb0 2024-04-25T09:01:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f17e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1006eaf0 con 0x7f1f1015a380 2024-04-25T09:01:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f17e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1015acd0 con 0x7f1ef80039f0 2024-04-25T09:01:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f15400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef80039f0 0x7f1f100c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f14a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f1015a380 0x7f1f1013cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f14a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f1015a380 0x7f1f1013cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:34470/0 (socket says 172.21.15.59:34470) 2024-04-25T09:01:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f14a00640 1 -- 172.21.15.59:0/250385337 learned_addr learned my addr 172.21.15.59:0/250385337 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:32.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f15e00640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f1013beb0 0x7f1f1013c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f15e00640 1 -- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef80039f0 msgr2=0x7f1f100c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f15e00640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef80039f0 0x7f1f100c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f15e00640 1 -- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f1015a380 msgr2=0x7f1f1013cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f15e00640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f1015a380 0x7f1f1013cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:32.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f15e00640 1 -- 172.21.15.59:0/250385337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f100ae130 con 0x7f1f1013beb0 2024-04-25T09:01:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f14a00640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f1015a380 0x7f1f1013cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f15e00640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f1013beb0 0x7f1f1013c330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800e060 tx=0x7f1f0800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f0d600640 1 -- 172.21.15.59:0/250385337 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0800ee50 con 0x7f1f1013beb0 2024-04-25T09:01:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f0d600640 1 -- 172.21.15.59:0/250385337 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f08006d70 con 0x7f1f1013beb0 2024-04-25T09:01:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f17e00640 1 -- 172.21.15.59:0/250385337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1013e6f0 con 0x7f1f1013beb0 2024-04-25T09:01:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f0d600640 1 -- 172.21.15.59:0/250385337 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f08003bc0 con 0x7f1f1013beb0 2024-04-25T09:01:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f17e00640 1 -- 172.21.15.59:0/250385337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1015d330 con 0x7f1f1013beb0 2024-04-25T09:01:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.004+0000 7f1f17e00640 1 -- 172.21.15.59:0/250385337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f100745d0 con 0x7f1f1013beb0 2024-04-25T09:01:32.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.008+0000 7f1f0d600640 1 -- 172.21.15.59:0/250385337 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1f0801b060 con 0x7f1f1013beb0 2024-04-25T09:01:32.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.008+0000 7f1f0d600640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ef0066f90 0x7f1ef0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:32.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.008+0000 7f1f0d600640 1 -- 172.21.15.59:0/250385337 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6500+0+0 (secure 0 0 0) 0x7f1f080847c0 con 0x7f1f1013beb0 2024-04-25T09:01:32.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.008+0000 7f1f15400640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ef0066f90 0x7f1ef0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:33.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.008+0000 7f1f15400640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ef0066f90 0x7f1ef0069450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1f040ae000 tx=0x7f1f040046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:33.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.016+0000 7f1f0d600640 1 -- 172.21.15.59:0/250385337 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1f08054e50 con 0x7f1f1013beb0 2024-04-25T09:01:33.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.212+0000 7f1f17e00640 1 -- 172.21.15.59:0/250385337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f1f100736e0 con 0x7f1f1013beb0 2024-04-25T09:01:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f0d600640 1 -- 172.21.15.59:0/250385337 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f1f08058ef0 con 0x7f1f1013beb0 2024-04-25T09:01:33.814 INFO:teuthology.orchestra.run.smithi059.stderr:added data pool 4 to fsmap 2024-04-25T09:01:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f17e00640 1 -- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ef0066f90 msgr2=0x7f1ef0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f17e00640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ef0066f90 0x7f1ef0069450 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1f040ae000 tx=0x7f1f040046d0 comp rx=0 tx=0).stop 2024-04-25T09:01:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f17e00640 1 -- 172.21.15.59:0/250385337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f1013beb0 msgr2=0x7f1f1013c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f17e00640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f1013beb0 0x7f1f1013c330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1ef800e060 tx=0x7f1f0800ec00 comp rx=0 tx=0).stop 2024-04-25T09:01:33.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f17e00640 1 -- 172.21.15.59:0/250385337 shutdown_connections 2024-04-25T09:01:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f17e00640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ef0066f90 0x7f1ef0069450 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f17e00640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f1013beb0 0x7f1f1013c330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f17e00640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1f1015a380 0x7f1f1013cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f17e00640 1 --2- 172.21.15.59:0/250385337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ef80039f0 0x7f1f100c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f17e00640 1 -- 172.21.15.59:0/250385337 >> 172.21.15.59:0/250385337 conn(0x7f1f10067080 msgr2=0x7f1f1006e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f17e00640 1 -- 172.21.15.59:0/250385337 shutdown_connections 2024-04-25T09:01:33.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.824+0000 7f1f17e00640 1 -- 172.21.15.59:0/250385337 wait complete. 2024-04-25T09:01:33.838 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:33.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.988+0000 7fed6b400640 1 Processor -- start 2024-04-25T09:01:33.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.988+0000 7fed6b400640 1 -- start start 2024-04-25T09:01:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed6b400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed64099a60 0x7fed64099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed6b400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed640cff30 0x7fed640d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed6b400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6409a380 con 0x7fed6415ee00 2024-04-25T09:01:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed6b400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6406c430 con 0x7fed640cff30 2024-04-25T09:01:33.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed6b400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6406c650 con 0x7fed64099a60 2024-04-25T09:01:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed68a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed64099a60 0x7fed64099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed68a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed64099a60 0x7fed64099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:52210/0 (socket says 172.21.15.59:52210) 2024-04-25T09:01:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed68a00640 1 -- 172.21.15.59:0/1759293517 learned_addr learned my addr 172.21.15.59:0/1759293517 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed5be00640 1 --1- 172.21.15.59:0/1759293517 >> v1:172.21.15.178:6789/0 conn(0x7fed6415ee00 0x7fed6406bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:33050/0 (socket says 172.21.15.59:33050) 2024-04-25T09:01:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed69400640 1 --2- 172.21.15.59:0/1759293517 >> v2:172.21.15.178:3300/0 conn(0x7fed640cff30 0x7fed640d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed68a00640 1 -- 172.21.15.59:0/1759293517 >> v2:172.21.15.178:3300/0 conn(0x7fed640cff30 msgr2=0x7fed640d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed68a00640 1 --2- 172.21.15.59:0/1759293517 >> v2:172.21.15.178:3300/0 conn(0x7fed640cff30 0x7fed640d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed63e00640 1 -- 172.21.15.59:0/1759293517 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3786311737 0 0) 0x7fed6409a380 con 0x7fed6415ee00 2024-04-25T09:01:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed68a00640 1 -- 172.21.15.59:0/1759293517 >> v1:172.21.15.178:6789/0 conn(0x7fed6415ee00 legacy=0x7fed6406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:33.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.992+0000 7fed68a00640 1 -- 172.21.15.59:0/1759293517 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6406c930 con 0x7fed64099a60 2024-04-25T09:01:33.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed68a00640 1 --2- 172.21.15.59:0/1759293517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed64099a60 0x7fed64099e40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fed54009870 tx=0x7fed5401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9365e719c0f1240 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:33.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed63e00640 1 -- 172.21.15.59:0/1759293517 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540ab650 con 0x7fed64099a60 2024-04-25T09:01:33.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed63e00640 1 -- 172.21.15.59:0/1759293517 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed540b0070 con 0x7fed64099a60 2024-04-25T09:01:33.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed63e00640 1 -- 172.21.15.59:0/1759293517 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540aba10 con 0x7fed64099a60 2024-04-25T09:01:33.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed6b400640 1 -- 172.21.15.59:0/1759293517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed64099a60 msgr2=0x7fed64099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:33.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed6b400640 1 --2- 172.21.15.59:0/1759293517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed64099a60 0x7fed64099e40 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fed54009870 tx=0x7fed5401c560 comp rx=0 tx=0).stop 2024-04-25T09:01:33.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed6b400640 1 -- 172.21.15.59:0/1759293517 shutdown_connections 2024-04-25T09:01:33.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed6b400640 1 --2- 172.21.15.59:0/1759293517 >> v2:172.21.15.178:3300/0 conn(0x7fed640cff30 0x7fed640d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:33.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed6b400640 1 --2- 172.21.15.59:0/1759293517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed64099a60 0x7fed64099e40 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:33.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed6b400640 1 -- 172.21.15.59:0/1759293517 >> 172.21.15.59:0/1759293517 conn(0x7fed640d17a0 msgr2=0x7fed640d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:33.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed6b400640 1 -- 172.21.15.59:0/1759293517 shutdown_connections 2024-04-25T09:01:33.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed6b400640 1 -- 172.21.15.59:0/1759293517 wait complete. 2024-04-25T09:01:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed6b400640 1 Processor -- start 2024-04-25T09:01:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:33.996+0000 7fed6b400640 1 -- start start 2024-04-25T09:01:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed6b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed64099a60 0x7fed641564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed6b400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed640cff30 0x7fed6415b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed6b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed6415ee00 0x7fed64150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed6b400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6415e000 con 0x7fed64099a60 2024-04-25T09:01:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed6b400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6415de80 con 0x7fed6415ee00 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed6b400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6416aa00 con 0x7fed640cff30 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed68a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed64099a60 0x7fed641564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed68a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed64099a60 0x7fed641564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58106/0 (socket says 172.21.15.59:58106) 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed68a00640 1 -- 172.21.15.59:0/2512434882 learned_addr learned my addr 172.21.15.59:0/2512434882 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed68a00640 1 -- 172.21.15.59:0/2512434882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed640cff30 msgr2=0x7fed6415b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed68a00640 1 --2- 172.21.15.59:0/2512434882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed640cff30 0x7fed6415b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed68a00640 1 -- 172.21.15.59:0/2512434882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed6415ee00 msgr2=0x7fed64150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed68a00640 1 --2- 172.21.15.59:0/2512434882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed6415ee00 0x7fed64150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed68a00640 1 -- 172.21.15.59:0/2512434882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed640caf80 con 0x7fed64099a60 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed68a00640 1 --2- 172.21.15.59:0/2512434882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed64099a60 0x7fed641564f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed540ad040 tx=0x7fed5401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed61600640 1 -- 172.21.15.59:0/2512434882 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540be3f0 con 0x7fed64099a60 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed61600640 1 -- 172.21.15.59:0/2512434882 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed540be590 con 0x7fed64099a60 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed61600640 1 -- 172.21.15.59:0/2512434882 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed540be980 con 0x7fed64099a60 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed6b400640 1 -- 172.21.15.59:0/2512434882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed640cb260 con 0x7fed64099a60 2024-04-25T09:01:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed6b400640 1 -- 172.21.15.59:0/2512434882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed64150ee0 con 0x7fed64099a60 2024-04-25T09:01:33.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed6b400640 1 -- 172.21.15.59:0/2512434882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed640745d0 con 0x7fed64099a60 2024-04-25T09:01:33.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.000+0000 7fed61600640 1 -- 172.21.15.59:0/2512434882 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fed540b43f0 con 0x7fed64099a60 2024-04-25T09:01:33.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.004+0000 7fed61600640 1 --2- 172.21.15.59:0/2512434882 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed40066f60 0x7fed40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:33.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.004+0000 7fed61600640 1 -- 172.21.15.59:0/2512434882 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fed5411f6b0 con 0x7fed64099a60 2024-04-25T09:01:33.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.004+0000 7fed5be00640 1 --2- 172.21.15.59:0/2512434882 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed40066f60 0x7fed40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:33.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.004+0000 7fed5be00640 1 --2- 172.21.15.59:0/2512434882 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed40066f60 0x7fed40069420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0011f0 tx=0x7fed4c007930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:33.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.008+0000 7fed61600640 1 -- 172.21.15.59:0/2512434882 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed54016150 con 0x7fed64099a60 2024-04-25T09:01:34.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 -- 172.21.15.59:0/2512434882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed6409ae10 con 0x7fed64099a60 2024-04-25T09:01:34.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed61600640 1 -- 172.21.15.59:0/2512434882 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4940 (secure 0 0 0) 0x7fed540efd20 con 0x7fed64099a60 2024-04-25T09:01:34.195 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:34.195 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2167197221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2167197221},{"type":"v1","addr":"172.21.15.59:6834","nonce":2167197221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2689387181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2689387181},{"type":"v1","addr":"172.21.15.178:6837","nonce":2689387181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1461695991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1461695991},{"type":"v1","addr":"172.21.15.59:6835","nonce":1461695991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:28.177275+0000","modified":"2024-04-25T09:01:33.216815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/3239224017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3239224017},{"type":"v1","addr":"172.21.15.178:6836","nonce":3239224017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-25T09:01:34.195 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2024-04-25T09:01:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 -- 172.21.15.59:0/2512434882 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed40066f60 msgr2=0x7fed40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 --2- 172.21.15.59:0/2512434882 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed40066f60 0x7fed40069420 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fed4c0011f0 tx=0x7fed4c007930 comp rx=0 tx=0).stop 2024-04-25T09:01:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 -- 172.21.15.59:0/2512434882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed64099a60 msgr2=0x7fed641564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 --2- 172.21.15.59:0/2512434882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed64099a60 0x7fed641564f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fed540ad040 tx=0x7fed5401ada0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 -- 172.21.15.59:0/2512434882 shutdown_connections 2024-04-25T09:01:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 --2- 172.21.15.59:0/2512434882 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed40066f60 0x7fed40069420 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 --2- 172.21.15.59:0/2512434882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed6415ee00 0x7fed64150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 --2- 172.21.15.59:0/2512434882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed640cff30 0x7fed6415b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 --2- 172.21.15.59:0/2512434882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed64099a60 0x7fed641564f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 -- 172.21.15.59:0/2512434882 >> 172.21.15.59:0/2512434882 conn(0x7fed640d17a0 msgr2=0x7fed6415e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 -- 172.21.15.59:0/2512434882 shutdown_connections 2024-04-25T09:01:34.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.204+0000 7fed6b400640 1 -- 172.21.15.59:0/2512434882 wait complete. 2024-04-25T09:01:34.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:34.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f119cc00640 1 Processor -- start 2024-04-25T09:01:34.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f119cc00640 1 -- start start 2024-04-25T09:01:34.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f119cc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119815a680 0x7f119806d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:34.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f119cc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11980725a0 con 0x7f119806c330 2024-04-25T09:01:34.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f119cc00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119815af40 con 0x7f119815aa60 2024-04-25T09:01:34.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f119cc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119815b220 con 0x7f119815a680 2024-04-25T09:01:34.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f1197e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f119806c330 0x7f11980b4330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43216/0 (socket says 172.21.15.59:43216) 2024-04-25T09:01:34.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f1197e00640 1 -- 172.21.15.59:0/2507402379 learned_addr learned my addr 172.21.15.59:0/2507402379 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:34.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f1197400640 1 --2- 172.21.15.59:0/2507402379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119815a680 0x7f119806d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:34.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f1196000640 1 -- 172.21.15.59:0/2507402379 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706528581 0 0) 0x7f11980725a0 con 0x7f119806c330 2024-04-25T09:01:34.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f1196000640 1 -- 172.21.15.59:0/2507402379 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f117c003530 con 0x7f119806c330 2024-04-25T09:01:34.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f1197400640 1 -- 172.21.15.59:0/2507402379 >> v1:172.21.15.178:6789/0 conn(0x7f119815aa60 legacy=0x7f119806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f1197400640 1 -- 172.21.15.59:0/2507402379 >> v1:172.21.15.59:6789/0 conn(0x7f119806c330 legacy=0x7f11980b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.368+0000 7f1197400640 1 -- 172.21.15.59:0/2507402379 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119815b500 con 0x7f119815a680 2024-04-25T09:01:34.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.372+0000 7f1197400640 1 --2- 172.21.15.59:0/2507402379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119815a680 0x7f119806d7c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f11880097f0 tx=0x7f118801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98b9ef574b3b5dff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:34.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.372+0000 7f1196000640 1 -- 172.21.15.59:0/2507402379 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11880ab640 con 0x7f119815a680 2024-04-25T09:01:34.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.372+0000 7f1196000640 1 -- 172.21.15.59:0/2507402379 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11880b0070 con 0x7f119815a680 2024-04-25T09:01:34.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.372+0000 7f1196000640 1 -- 172.21.15.59:0/2507402379 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11880aba00 con 0x7f119815a680 2024-04-25T09:01:34.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.372+0000 7f119cc00640 1 -- 172.21.15.59:0/2507402379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119815a680 msgr2=0x7f119806d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.372+0000 7f119cc00640 1 --2- 172.21.15.59:0/2507402379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119815a680 0x7f119806d7c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f11880097f0 tx=0x7f118801c420 comp rx=0 tx=0).stop 2024-04-25T09:01:34.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.372+0000 7f119cc00640 1 -- 172.21.15.59:0/2507402379 shutdown_connections 2024-04-25T09:01:34.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.372+0000 7f119cc00640 1 --2- 172.21.15.59:0/2507402379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119815a680 0x7f119806d7c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.372+0000 7f119cc00640 1 -- 172.21.15.59:0/2507402379 >> 172.21.15.59:0/2507402379 conn(0x7f11980cd560 msgr2=0x7f1198071890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:34.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.372+0000 7f119cc00640 1 -- 172.21.15.59:0/2507402379 shutdown_connections 2024-04-25T09:01:34.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.372+0000 7f119cc00640 1 -- 172.21.15.59:0/2507402379 wait complete. 2024-04-25T09:01:34.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.372+0000 7f119cc00640 1 Processor -- start 2024-04-25T09:01:34.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f119cc00640 1 -- start start 2024-04-25T09:01:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f119cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119806c330 0x7f119814c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f119cc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119815a680 0x7f119806dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f119cc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119815aa60 0x7f119806e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:34.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f119cc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11980b4dd0 con 0x7f119806c330 2024-04-25T09:01:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f119cc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11980b4c50 con 0x7f119815a680 2024-04-25T09:01:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f119cc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11980b4f50 con 0x7f119815aa60 2024-04-25T09:01:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f1197400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119806c330 0x7f119814c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f1197400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119806c330 0x7f119814c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58110/0 (socket says 172.21.15.59:58110) 2024-04-25T09:01:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f1197400640 1 -- 172.21.15.59:0/2030826267 learned_addr learned my addr 172.21.15.59:0/2030826267 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f1196a00640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119815a680 0x7f119806dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f1197e00640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119815aa60 0x7f119806e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f1197400640 1 -- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119815aa60 msgr2=0x7f119806e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f1197400640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119815aa60 0x7f119806e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f1197400640 1 -- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119815a680 msgr2=0x7f119806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f1197400640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119815a680 0x7f119806dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f1197400640 1 -- 172.21.15.59:0/2030826267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119814cac0 con 0x7f119806c330 2024-04-25T09:01:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f1197400640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119806c330 0x7f119814c580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1188019030 tx=0x7f118801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f118f400640 1 -- 172.21.15.59:0/2030826267 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11880bf410 con 0x7f119806c330 2024-04-25T09:01:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f118f400640 1 -- 172.21.15.59:0/2030826267 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11880bf5d0 con 0x7f119806c330 2024-04-25T09:01:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f119cc00640 1 -- 172.21.15.59:0/2030826267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119809ab00 con 0x7f119806c330 2024-04-25T09:01:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f118f400640 1 -- 172.21.15.59:0/2030826267 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11880bf9c0 con 0x7f119806c330 2024-04-25T09:01:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f119cc00640 1 -- 172.21.15.59:0/2030826267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119809b0c0 con 0x7f119806c330 2024-04-25T09:01:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.376+0000 7f119cc00640 1 -- 172.21.15.59:0/2030826267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119804efa0 con 0x7f119806c330 2024-04-25T09:01:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.380+0000 7f118f400640 1 -- 172.21.15.59:0/2030826267 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f11880bd020 con 0x7f119806c330 2024-04-25T09:01:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.380+0000 7f118f400640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1178066f60 0x7f1178069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.380+0000 7f118f400640 1 -- 172.21.15.59:0/2030826267 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f118811f7f0 con 0x7f119806c330 2024-04-25T09:01:34.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.380+0000 7f1196a00640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1178066f60 0x7f1178069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:34.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.380+0000 7f1196a00640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1178066f60 0x7f1178069420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f11980af080 tx=0x7f1184009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:34.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.384+0000 7f118f400640 1 -- 172.21.15.59:0/2030826267 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f11880c4060 con 0x7f119806c330 2024-04-25T09:01:34.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.544+0000 7f119cc00640 1 -- 172.21.15.59:0/2030826267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f119806dd80 con 0x7f119806c330 2024-04-25T09:01:34.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f118f400640 1 -- 172.21.15.59:0/2030826267 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7f11880f4e20 con 0x7f119806c330 2024-04-25T09:01:34.538 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:34.538 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f119cc00640 1 -- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1178066f60 msgr2=0x7f1178069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f119cc00640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1178066f60 0x7f1178069420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f11980af080 tx=0x7f1184009040 comp rx=0 tx=0).stop 2024-04-25T09:01:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f119cc00640 1 -- 172.21.15.59:0/2030826267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119806c330 msgr2=0x7f119814c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f119cc00640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119806c330 0x7f119814c580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1188019030 tx=0x7f118801ac60 comp rx=0 tx=0).stop 2024-04-25T09:01:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f119cc00640 1 -- 172.21.15.59:0/2030826267 shutdown_connections 2024-04-25T09:01:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f119cc00640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1178066f60 0x7f1178069420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f119cc00640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f119815aa60 0x7f119806e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f119cc00640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f119815a680 0x7f119806dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f119cc00640 1 --2- 172.21.15.59:0/2030826267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f119806c330 0x7f119814c580 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f119cc00640 1 -- 172.21.15.59:0/2030826267 >> 172.21.15.59:0/2030826267 conn(0x7f11980cd560 msgr2=0x7f119815d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f119cc00640 1 -- 172.21.15.59:0/2030826267 shutdown_connections 2024-04-25T09:01:34.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.548+0000 7f119cc00640 1 -- 172.21.15.59:0/2030826267 wait complete. 2024-04-25T09:01:34.559 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:34.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.708+0000 7f2aa9600640 1 Processor -- start 2024-04-25T09:01:34.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.708+0000 7f2aa9600640 1 -- start start 2024-04-25T09:01:34.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa9600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2aa415a6c0 0x7f2aa40ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:34.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa9600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2aa40b4a10 0x7f2aa40d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:34.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa9600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40b5120 0x7f2aa40b5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:34.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa9600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa40b5ad0 con 0x7f2aa40b4a10 2024-04-25T09:01:34.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa9600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa415e270 con 0x7f2aa415a6c0 2024-04-25T09:01:34.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa9600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa415f0d0 con 0x7f2aa40b5120 2024-04-25T09:01:34.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa2000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2aa40b4a10 0x7f2aa40d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa2000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2aa40b4a10 0x7f2aa40d0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58118/0 (socket says 172.21.15.59:58118) 2024-04-25T09:01:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa2000640 1 -- 172.21.15.59:0/1975667869 learned_addr learned my addr 172.21.15.59:0/1975667869 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa2a00640 1 --2- 172.21.15.59:0/1975667869 >> v2:172.21.15.178:3300/0 conn(0x7f2aa415a6c0 0x7f2aa40ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa3400640 1 --2- 172.21.15.59:0/1975667869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40b5120 0x7f2aa40b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa2000640 1 -- 172.21.15.59:0/1975667869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40b5120 msgr2=0x7f2aa40b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa2000640 1 --2- 172.21.15.59:0/1975667869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40b5120 0x7f2aa40b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa2000640 1 -- 172.21.15.59:0/1975667869 >> v2:172.21.15.178:3300/0 conn(0x7f2aa415a6c0 msgr2=0x7f2aa40ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa2000640 1 --2- 172.21.15.59:0/1975667869 >> v2:172.21.15.178:3300/0 conn(0x7f2aa415a6c0 0x7f2aa40ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa2000640 1 -- 172.21.15.59:0/1975667869 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa415e4c0 con 0x7f2aa40b4a10 2024-04-25T09:01:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.712+0000 7f2aa3400640 1 --2- 172.21.15.59:0/1975667869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40b5120 0x7f2aa40b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:34.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa2000640 1 --2- 172.21.15.59:0/1975667869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa40b4a10 0x7f2aa40d0d20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2aa406fdb0 tx=0x7f2a9001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca4c7214987cd76c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa1600640 1 -- 172.21.15.59:0/1975667869 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a900b1070 con 0x7f2aa40b4a10 2024-04-25T09:01:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa1600640 1 -- 172.21.15.59:0/1975667869 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a900ac630 con 0x7f2aa40b4a10 2024-04-25T09:01:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa1600640 1 -- 172.21.15.59:0/1975667869 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a900a8050 con 0x7f2aa40b4a10 2024-04-25T09:01:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 -- 172.21.15.59:0/1975667869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa40b4a10 msgr2=0x7f2aa40d0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 --2- 172.21.15.59:0/1975667869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa40b4a10 0x7f2aa40d0d20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2aa406fdb0 tx=0x7f2a9001c520 comp rx=0 tx=0).stop 2024-04-25T09:01:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 -- 172.21.15.59:0/1975667869 shutdown_connections 2024-04-25T09:01:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 --2- 172.21.15.59:0/1975667869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40b5120 0x7f2aa40b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 --2- 172.21.15.59:0/1975667869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa40b4a10 0x7f2aa40d0d20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 --2- 172.21.15.59:0/1975667869 >> v2:172.21.15.178:3300/0 conn(0x7f2aa415a6c0 0x7f2aa40ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 -- 172.21.15.59:0/1975667869 >> 172.21.15.59:0/1975667869 conn(0x7f2aa40b2400 msgr2=0x7f2aa40b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 -- 172.21.15.59:0/1975667869 shutdown_connections 2024-04-25T09:01:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 -- 172.21.15.59:0/1975667869 wait complete. 2024-04-25T09:01:34.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 Processor -- start 2024-04-25T09:01:34.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 -- start start 2024-04-25T09:01:34.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa40b4a10 0x7f2aa40b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:34.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40b5120 0x7f2aa4163730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:34.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa415a6c0 0x7f2aa4143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:34.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa4072b40 con 0x7f2aa40b4a10 2024-04-25T09:01:34.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa415aaa0 con 0x7f2aa415a6c0 2024-04-25T09:01:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.716+0000 7f2aa9600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa4072cc0 con 0x7f2aa40b5120 2024-04-25T09:01:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2aa2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa40b4a10 0x7f2aa40b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2aa2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa40b4a10 0x7f2aa40b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58124/0 (socket says 172.21.15.59:58124) 2024-04-25T09:01:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2aa2a00640 1 -- 172.21.15.59:0/1330599938 learned_addr learned my addr 172.21.15.59:0/1330599938 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2aa2a00640 1 -- 172.21.15.59:0/1330599938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40b5120 msgr2=0x7f2aa4163730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2aa2a00640 1 --2- 172.21.15.59:0/1330599938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40b5120 0x7f2aa4163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2aa2a00640 1 -- 172.21.15.59:0/1330599938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa415a6c0 msgr2=0x7f2aa4143c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2aa2a00640 1 --2- 172.21.15.59:0/1330599938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa415a6c0 0x7f2aa4143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2aa2a00640 1 -- 172.21.15.59:0/1330599938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa4164110 con 0x7f2aa40b4a10 2024-04-25T09:01:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2aa2a00640 1 --2- 172.21.15.59:0/1330599938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa40b4a10 0x7f2aa40b08c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400e870 tx=0x7f2a9400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2a9aa00640 1 -- 172.21.15.59:0/1330599938 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a94017070 con 0x7f2aa40b4a10 2024-04-25T09:01:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2a9aa00640 1 -- 172.21.15.59:0/1330599938 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9400c940 con 0x7f2aa40b4a10 2024-04-25T09:01:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2a9aa00640 1 -- 172.21.15.59:0/1330599938 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9400ccf0 con 0x7f2aa40b4a10 2024-04-25T09:01:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2aa9600640 1 -- 172.21.15.59:0/1330599938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa41643f0 con 0x7f2aa40b4a10 2024-04-25T09:01:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2aa9600640 1 -- 172.21.15.59:0/1330599938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa41649b0 con 0x7f2aa40b4a10 2024-04-25T09:01:34.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2aa9600640 1 -- 172.21.15.59:0/1330599938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa40745d0 con 0x7f2aa40b4a10 2024-04-25T09:01:34.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2a9aa00640 1 -- 172.21.15.59:0/1330599938 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2a9401a070 con 0x7f2aa40b4a10 2024-04-25T09:01:34.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2a9aa00640 1 --2- 172.21.15.59:0/1330599938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2a84066f60 0x7f2a84069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:34.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.720+0000 7f2a9aa00640 1 -- 172.21.15.59:0/1330599938 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2a94085600 con 0x7f2aa40b4a10 2024-04-25T09:01:34.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.724+0000 7f2aa2000640 1 --2- 172.21.15.59:0/1330599938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2a84066f60 0x7f2a84069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:34.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.724+0000 7f2aa2000640 1 --2- 172.21.15.59:0/1330599938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2a84066f60 0x7f2a84069420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a900ae000 tx=0x7f2a90004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:34.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.724+0000 7f2a9aa00640 1 -- 172.21.15.59:0/1330599938 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2a94056230 con 0x7f2aa40b4a10 2024-04-25T09:01:34.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.892+0000 7f2aa9600640 1 -- 172.21.15.59:0/1330599938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2aa40b2170 con 0x7f2aa40b4a10 2024-04-25T09:01:34.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.892+0000 7f2a9aa00640 1 -- 172.21.15.59:0/1330599938 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7f2a94055b30 con 0x7f2aa40b4a10 2024-04-25T09:01:34.884 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:34.884 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:34.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.896+0000 7f2aa9600640 1 -- 172.21.15.59:0/1330599938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2a84066f60 msgr2=0x7f2a84069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.896+0000 7f2aa9600640 1 --2- 172.21.15.59:0/1330599938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2a84066f60 0x7f2a84069420 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a900ae000 tx=0x7f2a90004740 comp rx=0 tx=0).stop 2024-04-25T09:01:34.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.896+0000 7f2aa9600640 1 -- 172.21.15.59:0/1330599938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa40b4a10 msgr2=0x7f2aa40b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:34.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.896+0000 7f2aa9600640 1 --2- 172.21.15.59:0/1330599938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa40b4a10 0x7f2aa40b08c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2a9400e870 tx=0x7f2a9400ec70 comp rx=0 tx=0).stop 2024-04-25T09:01:34.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.896+0000 7f2aa9600640 1 -- 172.21.15.59:0/1330599938 shutdown_connections 2024-04-25T09:01:34.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.896+0000 7f2aa9600640 1 --2- 172.21.15.59:0/1330599938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2a84066f60 0x7f2a84069420 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.896+0000 7f2aa9600640 1 --2- 172.21.15.59:0/1330599938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2aa415a6c0 0x7f2aa4143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.896+0000 7f2aa9600640 1 --2- 172.21.15.59:0/1330599938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2aa40b5120 0x7f2aa4163730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.896+0000 7f2aa9600640 1 --2- 172.21.15.59:0/1330599938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa40b4a10 0x7f2aa40b08c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:34.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.896+0000 7f2aa9600640 1 -- 172.21.15.59:0/1330599938 >> 172.21.15.59:0/1330599938 conn(0x7f2aa40b2400 msgr2=0x7f2aa406ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:34.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.896+0000 7f2aa9600640 1 -- 172.21.15.59:0/1330599938 shutdown_connections 2024-04-25T09:01:34.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:34.896+0000 7f2aa9600640 1 -- 172.21.15.59:0/1330599938 wait complete. 2024-04-25T09:01:34.920 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:35.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.068+0000 7fecfb800640 1 Processor -- start 2024-04-25T09:01:35.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.068+0000 7fecfb800640 1 -- start start 2024-04-25T09:01:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.072+0000 7fecfb800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fecf406ead0 0x7fecf41653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.072+0000 7fecfb800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf415ac60 con 0x7fecf4144140 2024-04-25T09:01:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.072+0000 7fecfb800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecf40cf3e0 con 0x7fecf40cef30 2024-04-25T09:01:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.072+0000 7fecfb800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecf415af20 con 0x7fecf406ead0 2024-04-25T09:01:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.072+0000 7fecf8e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fecf4144140 0x7fecf40ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43228/0 (socket says 172.21.15.59:43228) 2024-04-25T09:01:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.072+0000 7fecf8e00640 1 -- 172.21.15.59:0/36345170 learned_addr learned my addr 172.21.15.59:0/36345170 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:35.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.072+0000 7fecf9800640 1 --2- 172.21.15.59:0/36345170 >> v2:172.21.15.59:3300/0 conn(0x7fecf406ead0 0x7fecf41653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.072+0000 7fecf3e00640 1 -- 172.21.15.59:0/36345170 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290764855 0 0) 0x7fecf415ac60 con 0x7fecf4144140 2024-04-25T09:01:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.072+0000 7fecf3e00640 1 -- 172.21.15.59:0/36345170 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecd8003530 con 0x7fecf4144140 2024-04-25T09:01:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.072+0000 7fecf9800640 1 -- 172.21.15.59:0/36345170 >> v1:172.21.15.178:6789/0 conn(0x7fecf40cef30 legacy=0x7fecf406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.072+0000 7fecf9800640 1 -- 172.21.15.59:0/36345170 >> v1:172.21.15.59:6789/0 conn(0x7fecf4144140 legacy=0x7fecf40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.072+0000 7fecf9800640 1 -- 172.21.15.59:0/36345170 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf415b200 con 0x7fecf406ead0 2024-04-25T09:01:35.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecf9800640 1 --2- 172.21.15.59:0/36345170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecf406ead0 0x7fecf41653d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fecec009dc0 tx=0x7fecec01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289581cbbca35440 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecf3e00640 1 -- 172.21.15.59:0/36345170 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0b2070 con 0x7fecf406ead0 2024-04-25T09:01:35.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecf3e00640 1 -- 172.21.15.59:0/36345170 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecec0a5810 con 0x7fecf406ead0 2024-04-25T09:01:35.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecf3e00640 1 -- 172.21.15.59:0/36345170 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecec0a5be0 con 0x7fecf406ead0 2024-04-25T09:01:35.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 -- 172.21.15.59:0/36345170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecf406ead0 msgr2=0x7fecf41653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 --2- 172.21.15.59:0/36345170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecf406ead0 0x7fecf41653d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fecec009dc0 tx=0x7fecec01c950 comp rx=0 tx=0).stop 2024-04-25T09:01:35.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 -- 172.21.15.59:0/36345170 shutdown_connections 2024-04-25T09:01:35.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 --2- 172.21.15.59:0/36345170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecf406ead0 0x7fecf41653d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 -- 172.21.15.59:0/36345170 >> 172.21.15.59:0/36345170 conn(0x7fecf4066fa0 msgr2=0x7fecf406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 -- 172.21.15.59:0/36345170 shutdown_connections 2024-04-25T09:01:35.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 -- 172.21.15.59:0/36345170 wait complete. 2024-04-25T09:01:35.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 Processor -- start 2024-04-25T09:01:35.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 -- start start 2024-04-25T09:01:35.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecf406ead0 0x7fecf41374e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecf40cef30 0x7fecf415e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecf4144140 0x7fecf415e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf415bb80 con 0x7fecf40cef30 2024-04-25T09:01:35.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecf415ba00 con 0x7fecf406ead0 2024-04-25T09:01:35.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.076+0000 7fecfb800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecf4168540 con 0x7fecf4144140 2024-04-25T09:01:35.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecf40cef30 0x7fecf415e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecf40cef30 0x7fecf415e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58136/0 (socket says 172.21.15.59:58136) 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecebe00640 1 -- 172.21.15.59:0/2751803626 learned_addr learned my addr 172.21.15.59:0/2751803626 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecf8e00640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecf406ead0 0x7fecf41374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecf9800640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecf4144140 0x7fecf415e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecebe00640 1 -- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecf4144140 msgr2=0x7fecf415e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecebe00640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecf4144140 0x7fecf415e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecebe00640 1 -- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecf406ead0 msgr2=0x7fecf41374e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecebe00640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecf406ead0 0x7fecf41374e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecebe00640 1 -- 172.21.15.59:0/2751803626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecf4137a20 con 0x7fecf40cef30 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecf8e00640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecf406ead0 0x7fecf41374e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecebe00640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecf40cef30 0x7fecf415e0e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00c420 tx=0x7fecdc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecf1600640 1 -- 172.21.15.59:0/2751803626 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0052d0 con 0x7fecf40cef30 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecf1600640 1 -- 172.21.15.59:0/2751803626 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc005470 con 0x7fecf40cef30 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecf1600640 1 -- 172.21.15.59:0/2751803626 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc007260 con 0x7fecf40cef30 2024-04-25T09:01:35.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecfb800640 1 -- 172.21.15.59:0/2751803626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecf406daa0 con 0x7fecf40cef30 2024-04-25T09:01:35.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecfb800640 1 -- 172.21.15.59:0/2751803626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecf415d6d0 con 0x7fecf40cef30 2024-04-25T09:01:35.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecfb800640 1 -- 172.21.15.59:0/2751803626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecf40745d0 con 0x7fecf40cef30 2024-04-25T09:01:35.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecf1600640 1 -- 172.21.15.59:0/2751803626 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fecdc007400 con 0x7fecf40cef30 2024-04-25T09:01:35.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.080+0000 7fecf1600640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecd0066f60 0x7fecd0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.084+0000 7fecf1600640 1 -- 172.21.15.59:0/2751803626 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fecdc084940 con 0x7fecf40cef30 2024-04-25T09:01:35.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.084+0000 7fecf8e00640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecd0066f60 0x7fecd0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.084+0000 7fecf8e00640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecd0066f60 0x7fecd0069420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fece40011f0 tx=0x7fece4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.088+0000 7fecf1600640 1 -- 172.21.15.59:0/2751803626 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fecdc055570 con 0x7fecf40cef30 2024-04-25T09:01:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 -- 172.21.15.59:0/2751803626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecf406c250 con 0x7fecf40cef30 2024-04-25T09:01:35.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecf1600640 1 -- 172.21.15.59:0/2751803626 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4940 (secure 0 0 0) 0x7fecdc054e70 con 0x7fecf40cef30 2024-04-25T09:01:35.275 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:35.275 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2167197221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2167197221},{"type":"v1","addr":"172.21.15.59:6834","nonce":2167197221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2689387181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2689387181},{"type":"v1","addr":"172.21.15.178:6837","nonce":2689387181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1461695991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1461695991},{"type":"v1","addr":"172.21.15.59:6835","nonce":1461695991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:28.177275+0000","modified":"2024-04-25T09:01:33.216815+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/3239224017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3239224017},{"type":"v1","addr":"172.21.15.178:6836","nonce":3239224017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-04-25T09:01:35.275 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 7 2024-04-25T09:01:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 -- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecd0066f60 msgr2=0x7fecd0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecd0066f60 0x7fecd0069420 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fece40011f0 tx=0x7fece4009040 comp rx=0 tx=0).stop 2024-04-25T09:01:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 -- 172.21.15.59:0/2751803626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecf40cef30 msgr2=0x7fecf415e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecf40cef30 0x7fecf415e0e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00c420 tx=0x7fecdc00c8e0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 -- 172.21.15.59:0/2751803626 shutdown_connections 2024-04-25T09:01:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecd0066f60 0x7fecd0069420 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecf4144140 0x7fecf415e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecf40cef30 0x7fecf415e0e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 --2- 172.21.15.59:0/2751803626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecf406ead0 0x7fecf41374e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 -- 172.21.15.59:0/2751803626 >> 172.21.15.59:0/2751803626 conn(0x7fecf4066fa0 msgr2=0x7fecf40ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 -- 172.21.15.59:0/2751803626 shutdown_connections 2024-04-25T09:01:35.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.284+0000 7fecfb800640 1 -- 172.21.15.59:0/2751803626 wait complete. 2024-04-25T09:01:35.296 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:35.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.444+0000 7f2344800640 1 Processor -- start 2024-04-25T09:01:35.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.444+0000 7f2344800640 1 -- start start 2024-04-25T09:01:35.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.444+0000 7f2344800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f233c145270 0x7f233c15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.444+0000 7f2344800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f233c0b1e60 0x7f233c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.444+0000 7f2344800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233c0cc4e0 con 0x7f233c0cd4d0 2024-04-25T09:01:35.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.444+0000 7f2344800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c145650 con 0x7f233c145270 2024-04-25T09:01:35.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.444+0000 7f2344800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233c0ce040 con 0x7f233c0b1e60 2024-04-25T09:01:35.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2341e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f233c145270 0x7f233c15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2341e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f233c145270 0x7f233c15fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58138/0 (socket says 172.21.15.59:58138) 2024-04-25T09:01:35.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2341e00640 1 -- 172.21.15.59:0/1272327135 learned_addr learned my addr 172.21.15.59:0/1272327135 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2341e00640 1 -- 172.21.15.59:0/1272327135 >> v2:172.21.15.178:3300/0 conn(0x7f233c0b1e60 msgr2=0x7f233c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2342800640 1 --2- 172.21.15.59:0/1272327135 >> v2:172.21.15.178:3300/0 conn(0x7f233c0b1e60 0x7f233c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2341e00640 1 --2- 172.21.15.59:0/1272327135 >> v2:172.21.15.178:3300/0 conn(0x7f233c0b1e60 0x7f233c0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2341e00640 1 -- 172.21.15.59:0/1272327135 >> v1:172.21.15.178:6789/0 conn(0x7f233c0cd4d0 legacy=0x7f233c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2341e00640 1 -- 172.21.15.59:0/1272327135 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0ce320 con 0x7f233c145270 2024-04-25T09:01:35.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2342800640 1 --2- 172.21.15.59:0/1272327135 >> v2:172.21.15.178:3300/0 conn(0x7f233c0b1e60 0x7f233c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:35.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2341e00640 1 --2- 172.21.15.59:0/1272327135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f233c145270 0x7f233c15fe50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f233c0b4b90 tx=0x7f233001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d114337fc634c9f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2340a00640 1 -- 172.21.15.59:0/1272327135 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23300b1070 con 0x7f233c145270 2024-04-25T09:01:35.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2340a00640 1 -- 172.21.15.59:0/1272327135 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23300ac630 con 0x7f233c145270 2024-04-25T09:01:35.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.448+0000 7f2340a00640 1 -- 172.21.15.59:0/1272327135 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23300a8050 con 0x7f233c145270 2024-04-25T09:01:35.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 -- 172.21.15.59:0/1272327135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f233c145270 msgr2=0x7f233c15fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 --2- 172.21.15.59:0/1272327135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f233c145270 0x7f233c15fe50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f233c0b4b90 tx=0x7f233001c4e0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 -- 172.21.15.59:0/1272327135 shutdown_connections 2024-04-25T09:01:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 --2- 172.21.15.59:0/1272327135 >> v2:172.21.15.178:3300/0 conn(0x7f233c0b1e60 0x7f233c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 --2- 172.21.15.59:0/1272327135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f233c145270 0x7f233c15fe50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 -- 172.21.15.59:0/1272327135 >> 172.21.15.59:0/1272327135 conn(0x7f233c066fa0 msgr2=0x7f233c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 -- 172.21.15.59:0/1272327135 shutdown_connections 2024-04-25T09:01:35.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 -- 172.21.15.59:0/1272327135 wait complete. 2024-04-25T09:01:35.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 Processor -- start 2024-04-25T09:01:35.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 -- start start 2024-04-25T09:01:35.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f233c0b1e60 0x7f233c0a8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f233c0cd4d0 0x7f233c0b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f233c145270 0x7f233c13cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c15c710 con 0x7f233c145270 2024-04-25T09:01:35.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233c15c590 con 0x7f233c0cd4d0 2024-04-25T09:01:35.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2344800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233c15c890 con 0x7f233c0b1e60 2024-04-25T09:01:35.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2342800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f233c145270 0x7f233c13cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2342800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f233c145270 0x7f233c13cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58146/0 (socket says 172.21.15.59:58146) 2024-04-25T09:01:35.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2342800640 1 -- 172.21.15.59:0/2722897367 learned_addr learned my addr 172.21.15.59:0/2722897367 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:35.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2341400640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f233c0cd4d0 0x7f233c0b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2341e00640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f233c0b1e60 0x7f233c0a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2342800640 1 -- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f233c0b1e60 msgr2=0x7f233c0a8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2342800640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f233c0b1e60 0x7f233c0a8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2342800640 1 -- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f233c0cd4d0 msgr2=0x7f233c0b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2342800640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f233c0cd4d0 0x7f233c0b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2342800640 1 -- 172.21.15.59:0/2722897367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233c0a8f60 con 0x7f233c145270 2024-04-25T09:01:35.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2341e00640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f233c0b1e60 0x7f233c0a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:35.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2341400640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f233c0cd4d0 0x7f233c0b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:35.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.452+0000 7f2342800640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f233c145270 0x7f233c13cf20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f233800cef0 tx=0x7f233800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.456+0000 7f2336000640 1 -- 172.21.15.59:0/2722897367 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233801a070 con 0x7f233c145270 2024-04-25T09:01:35.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.456+0000 7f2336000640 1 -- 172.21.15.59:0/2722897367 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233800d860 con 0x7f233c145270 2024-04-25T09:01:35.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.456+0000 7f2344800640 1 -- 172.21.15.59:0/2722897367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233c0a9240 con 0x7f233c145270 2024-04-25T09:01:35.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.456+0000 7f2336000640 1 -- 172.21.15.59:0/2722897367 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233800dc50 con 0x7f233c145270 2024-04-25T09:01:35.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.456+0000 7f2344800640 1 -- 172.21.15.59:0/2722897367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233c0a9800 con 0x7f233c145270 2024-04-25T09:01:35.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.456+0000 7f2344800640 1 -- 172.21.15.59:0/2722897367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233c0745d0 con 0x7f233c145270 2024-04-25T09:01:35.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.456+0000 7f2336000640 1 -- 172.21.15.59:0/2722897367 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f233801d070 con 0x7f233c145270 2024-04-25T09:01:35.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.456+0000 7f2336000640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2320066f60 0x7f2320069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:35.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.456+0000 7f2336000640 1 -- 172.21.15.59:0/2722897367 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2338085c70 con 0x7f233c145270 2024-04-25T09:01:35.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.456+0000 7f2341e00640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2320066f60 0x7f2320069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:35.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.460+0000 7f2341e00640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2320066f60 0x7f2320069420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f23300ae000 tx=0x7f2330008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:35.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.460+0000 7f2336000640 1 -- 172.21.15.59:0/2722897367 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2338056930 con 0x7f233c145270 2024-04-25T09:01:35.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.624+0000 7f2344800640 1 -- 172.21.15.59:0/2722897367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f233c141ca0 con 0x7f233c145270 2024-04-25T09:01:35.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.624+0000 7f2336000640 1 -- 172.21.15.59:0/2722897367 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7f2338056230 con 0x7f233c145270 2024-04-25T09:01:35.617 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:35.617 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.628+0000 7f2344800640 1 -- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2320066f60 msgr2=0x7f2320069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.628+0000 7f2344800640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2320066f60 0x7f2320069420 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f23300ae000 tx=0x7f2330008040 comp rx=0 tx=0).stop 2024-04-25T09:01:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.628+0000 7f2344800640 1 -- 172.21.15.59:0/2722897367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f233c145270 msgr2=0x7f233c13cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.628+0000 7f2344800640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f233c145270 0x7f233c13cf20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f233800cef0 tx=0x7f233800a710 comp rx=0 tx=0).stop 2024-04-25T09:01:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.628+0000 7f2344800640 1 -- 172.21.15.59:0/2722897367 shutdown_connections 2024-04-25T09:01:35.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.628+0000 7f2344800640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2320066f60 0x7f2320069420 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.628+0000 7f2344800640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f233c145270 0x7f233c13cf20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.628+0000 7f2344800640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f233c0cd4d0 0x7f233c0b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.628+0000 7f2344800640 1 --2- 172.21.15.59:0/2722897367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f233c0b1e60 0x7f233c0a8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.628+0000 7f2344800640 1 -- 172.21.15.59:0/2722897367 >> 172.21.15.59:0/2722897367 conn(0x7f233c066fa0 msgr2=0x7f233c0b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.628+0000 7f2344800640 1 -- 172.21.15.59:0/2722897367 shutdown_connections 2024-04-25T09:01:35.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:35.628+0000 7f2344800640 1 -- 172.21.15.59:0/2722897367 wait complete. 2024-04-25T09:01:36.042 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:01:28.177275+0000', 'modified': '2024-04-25T09:01:33.216815+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6836/3239224017', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 3239224017}, {'type': 'v1', 'addr': '172.21.15.178:6836', 'nonce': 3239224017}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-04-25T09:01:36.042 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:01:36.042 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T09:01:36.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.192+0000 7fee2a400640 1 Processor -- start 2024-04-25T09:01:36.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.192+0000 7fee2a400640 1 -- start start 2024-04-25T09:01:36.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee2a400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee240c72a0 0x7fee240af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee2a400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee240b30d0 con 0x7fee240d0150 2024-04-25T09:01:36.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee2a400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee240ccf30 con 0x7fee2415dc00 2024-04-25T09:01:36.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee2a400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee240cd860 con 0x7fee240c72a0 2024-04-25T09:01:36.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee1be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fee240d0150 0x7fee240c54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:43244/0 (socket says 172.21.15.59:43244) 2024-04-25T09:01:36.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee1be00640 1 -- 172.21.15.59:0/2454475476 learned_addr learned my addr 172.21.15.59:0/2454475476 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee23e00640 1 --2- 172.21.15.59:0/2454475476 >> v2:172.21.15.178:3300/0 conn(0x7fee240c72a0 0x7fee240af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973911192 0 0) 0x7fee240b30d0 con 0x7fee240d0150 2024-04-25T09:01:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee08003530 con 0x7fee240d0150 2024-04-25T09:01:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3824517049 0 0) 0x7fee08003530 con 0x7fee240d0150 2024-04-25T09:01:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 >> v2:172.21.15.178:3300/0 conn(0x7fee240c72a0 msgr2=0x7fee240af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 --2- 172.21.15.59:0/2454475476 >> v2:172.21.15.178:3300/0 conn(0x7fee240c72a0 0x7fee240af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 >> v1:172.21.15.178:6789/0 conn(0x7fee2415dc00 legacy=0x7fee240c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240cd210 con 0x7fee240d0150 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fee0c001680 con 0x7fee240d0150 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 >> v1:172.21.15.59:6789/0 conn(0x7fee240d0150 legacy=0x7fee240c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 --2- 172.21.15.59:0/2454475476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee080039c0 0x7fee08003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 --2- 172.21.15.59:0/2454475476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee080043c0 0x7fee08004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 --2- 172.21.15.59:0/2454475476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee08005090 0x7fee0800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240cd860 con 0x7fee08005090 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0800bff0 con 0x7fee080039c0 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0800c1f0 con 0x7fee080043c0 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee23e00640 1 --2- 172.21.15.59:0/2454475476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee08005090 0x7fee0800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee23400640 1 --2- 172.21.15.59:0/2454475476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee080039c0 0x7fee08003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee1be00640 1 --2- 172.21.15.59:0/2454475476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee080043c0 0x7fee08004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee23e00640 1 -- 172.21.15.59:0/2454475476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee080043c0 msgr2=0x7fee08004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee23e00640 1 --2- 172.21.15.59:0/2454475476 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee080043c0 0x7fee08004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee23e00640 1 -- 172.21.15.59:0/2454475476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee080039c0 msgr2=0x7fee08003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee23e00640 1 --2- 172.21.15.59:0/2454475476 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee080039c0 0x7fee08003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.196+0000 7fee23e00640 1 -- 172.21.15.59:0/2454475476 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee08003530 con 0x7fee08005090 2024-04-25T09:01:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.200+0000 7fee23e00640 1 -- 172.21.15.59:0/2454475476 reap_dead start 2024-04-25T09:01:36.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.200+0000 7fee23e00640 1 --2- 172.21.15.59:0/2454475476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee08005090 0x7fee0800b9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009f90 tx=0x7fee1c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=612a7ba2d38d9062 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.200+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0b2070 con 0x7fee08005090 2024-04-25T09:01:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.200+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c0a5b80 con 0x7fee08005090 2024-04-25T09:01:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.200+0000 7fee22a00640 1 -- 172.21.15.59:0/2454475476 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c009c10 con 0x7fee08005090 2024-04-25T09:01:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.200+0000 7fee2a400640 1 -- 172.21.15.59:0/2454475476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee08005090 msgr2=0x7fee0800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.200+0000 7fee2a400640 1 --2- 172.21.15.59:0/2454475476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee08005090 0x7fee0800b9d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009f90 tx=0x7fee1c01cc80 comp rx=0 tx=0).stop 2024-04-25T09:01:36.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.200+0000 7fee2a400640 1 -- 172.21.15.59:0/2454475476 shutdown_connections 2024-04-25T09:01:36.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.200+0000 7fee2a400640 1 --2- 172.21.15.59:0/2454475476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee08005090 0x7fee0800b9d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.200+0000 7fee2a400640 1 -- 172.21.15.59:0/2454475476 >> 172.21.15.59:0/2454475476 conn(0x7fee240b2240 msgr2=0x7fee240b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.200+0000 7fee2a400640 1 -- 172.21.15.59:0/2454475476 shutdown_connections 2024-04-25T09:01:36.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.200+0000 7fee2a400640 1 -- 172.21.15.59:0/2454475476 wait complete. 2024-04-25T09:01:36.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee2a400640 1 Processor -- start 2024-04-25T09:01:36.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee2a400640 1 -- start start 2024-04-25T09:01:36.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee2a400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee08005090 0x7fee24159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee2a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee241f3190 0x7fee2415f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee2a400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee240ce9b0 0x7fee240b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee2a400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240b2ee0 con 0x7fee241f3190 2024-04-25T09:01:36.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee2a400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee240b2d60 con 0x7fee240ce9b0 2024-04-25T09:01:36.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee2a400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee240cdcf0 con 0x7fee08005090 2024-04-25T09:01:36.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee1be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee241f3190 0x7fee2415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee1be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee241f3190 0x7fee2415f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58170/0 (socket says 172.21.15.59:58170) 2024-04-25T09:01:36.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee1be00640 1 -- 172.21.15.59:0/658706953 learned_addr learned my addr 172.21.15.59:0/658706953 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:36.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee23e00640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee240ce9b0 0x7fee240b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee23400640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee08005090 0x7fee24159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee1be00640 1 -- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee08005090 msgr2=0x7fee24159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee1be00640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee08005090 0x7fee24159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee1be00640 1 -- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee240ce9b0 msgr2=0x7fee240b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee1be00640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee240ce9b0 0x7fee240b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee1be00640 1 -- 172.21.15.59:0/658706953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240af370 con 0x7fee241f3190 2024-04-25T09:01:36.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee1be00640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee241f3190 0x7fee2415f750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee0c011810 tx=0x7fee0c011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee1b400640 1 -- 172.21.15.59:0/658706953 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c010040 con 0x7fee241f3190 2024-04-25T09:01:36.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee1b400640 1 -- 172.21.15.59:0/658706953 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c01a070 con 0x7fee241f3190 2024-04-25T09:01:36.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee2a400640 1 -- 172.21.15.59:0/658706953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee24159a90 con 0x7fee241f3190 2024-04-25T09:01:36.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee1b400640 1 -- 172.21.15.59:0/658706953 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c00fb60 con 0x7fee241f3190 2024-04-25T09:01:36.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.204+0000 7fee2a400640 1 -- 172.21.15.59:0/658706953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee241f3950 con 0x7fee241f3190 2024-04-25T09:01:36.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee1b400640 1 -- 172.21.15.59:0/658706953 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fee0c00fd00 con 0x7fee241f3190 2024-04-25T09:01:36.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee1b400640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee00066f60 0x7fee00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee1b400640 1 -- 172.21.15.59:0/658706953 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fee0c0882f0 con 0x7fee241f3190 2024-04-25T09:01:36.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee2d916000 1 Processor -- start 2024-04-25T09:01:36.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee23400640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee00066f60 0x7fee00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee2d916000 1 -- start start 2024-04-25T09:01:36.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee23400640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee00066f60 0x7fee00069420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee14007fd0 tx=0x7fee14009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee2d916000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 0x5578b5189d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee2d916000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b518a240 0x5578b513f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee2d916000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b513ff30 0x5578b5140310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee2d916000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578b50275f0 con 0x5578b5189920 2024-04-25T09:01:36.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee2d916000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578b4f8eda0 con 0x5578b518a240 2024-04-25T09:01:36.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee2d916000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578b4f17150 con 0x5578b513ff30 2024-04-25T09:01:36.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee23400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 0x5578b5189d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee23400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 0x5578b5189d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58182/0 (socket says 172.21.15.59:58182) 2024-04-25T09:01:36.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee23400640 1 -- 172.21.15.59:0/3564266915 learned_addr learned my addr 172.21.15.59:0/3564266915 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:36.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee1be00640 1 --2- 172.21.15.59:0/3564266915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b518a240 0x5578b513f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee23e00640 1 --2- 172.21.15.59:0/3564266915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b513ff30 0x5578b5140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee23400640 1 -- 172.21.15.59:0/3564266915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b513ff30 msgr2=0x5578b5140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee23400640 1 --2- 172.21.15.59:0/3564266915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b513ff30 0x5578b5140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee23400640 1 -- 172.21.15.59:0/3564266915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b518a240 msgr2=0x5578b513f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee23400640 1 --2- 172.21.15.59:0/3564266915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b518a240 0x5578b513f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee23400640 1 -- 172.21.15.59:0/3564266915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578b4f30ca0 con 0x5578b5189920 2024-04-25T09:01:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.208+0000 7fee23400640 1 --2- 172.21.15.59:0/3564266915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 0x5578b5189d00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fee14012cc0 tx=0x7fee14015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3053b896cfe5da9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee13e00640 1 -- 172.21.15.59:0/3564266915 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14028070 con 0x5578b5189920 2024-04-25T09:01:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee13e00640 1 -- 172.21.15.59:0/3564266915 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee14012e70 con 0x5578b5189920 2024-04-25T09:01:36.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee13e00640 1 -- 172.21.15.59:0/3564266915 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14007230 con 0x5578b5189920 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 -- 172.21.15.59:0/3564266915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 msgr2=0x5578b5189d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 --2- 172.21.15.59:0/3564266915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 0x5578b5189d00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fee14012cc0 tx=0x7fee14015000 comp rx=0 tx=0).stop 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 -- 172.21.15.59:0/3564266915 shutdown_connections 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 --2- 172.21.15.59:0/3564266915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b513ff30 0x5578b5140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 --2- 172.21.15.59:0/3564266915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b518a240 0x5578b513f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 --2- 172.21.15.59:0/3564266915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 0x5578b5189d00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 -- 172.21.15.59:0/3564266915 >> 172.21.15.59:0/3564266915 conn(0x5578b51462a0 msgr2=0x5578b513e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 -- 172.21.15.59:0/3564266915 shutdown_connections 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 -- 172.21.15.59:0/3564266915 wait complete. 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 -- start start 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 Processor -- start 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b513ff30 0x5578b5190c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b5189920 0x5578b51911c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b518a240 0x5578b5143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578b4f49990 con 0x5578b513ff30 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578b4f8ae40 con 0x5578b518a240 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578b4f1a900 con 0x5578b5189920 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee2d916000 10 client.0 _ll_register_callbacks cb 0x5578b50421c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee23400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b513ff30 0x5578b5190c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee23400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b513ff30 0x5578b5190c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58192/0 (socket says 172.21.15.59:58192) 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee23400640 1 -- 172.21.15.59:0/3501275051 learned_addr learned my addr 172.21.15.59:0/3501275051 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee1be00640 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b5189920 0x5578b51911c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee23e00640 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b518a240 0x5578b5143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee23400640 1 -- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b5189920 msgr2=0x5578b51911c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee23400640 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b5189920 0x5578b51911c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee23400640 1 -- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b518a240 msgr2=0x5578b5143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee23400640 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b518a240 0x5578b5143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee23400640 1 -- 172.21.15.59:0/3501275051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5578b4f47630 con 0x5578b513ff30 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee1be00640 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b5189920 0x5578b51911c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee23e00640 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b518a240 0x5578b5143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee23400640 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b513ff30 0x5578b5190c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee14026040 tx=0x7fee14001240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e765e47e0e43c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.212+0000 7fee10c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee10c00640 1 -- 172.21.15.59:0/3501275051 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee14034060 con 0x5578b513ff30 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 -- 172.21.15.59:0/3501275051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee14012e70 con 0x5578b513ff30 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee10c00640 1 -- 172.21.15.59:0/3501275051 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fee14015850 con 0x5578b513ff30 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee10c00640 1 -- 172.21.15.59:0/3501275051 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee1403a050 con 0x5578b513ff30 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 10 client.4398 fetch_fsmap learned FSMap version 7 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 -- 172.21.15.59:0/3501275051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5578b4f173a0 con 0x5578b513ff30 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee10c00640 1 -- 172.21.15.59:0/3501275051 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee14012e70 con 0x5578b513ff30 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee10c00640 1 -- 172.21.15.59:0/3501275051 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fee1402e070 con 0x5578b513ff30 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 10 client.4398 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T09:01:36.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 10 client.4398 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 20 client.4398 populate_metadata read hostname 'smithi059' 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x5578b5145160 0x5578b519ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 4 client.4398 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 -- 172.21.15.59:0/3501275051 --> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5578b4f2aa50 con 0x5578b5145160 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee1be00640 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x5578b5145160 0x5578b519ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee1be00640 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x5578b5145160 0x5578b519ace0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2211f4a389610802 server_cookie=3853c9cda87d7ca0 in_seq=0 out_seq=0 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee10c00640 10 client.4398 ms_handle_connect on v2:172.21.15.178:6834/3239224017 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee10c00640 1 -- 172.21.15.59:0/3501275051 <== mds.0 v2:172.21.15.178:6834/3239224017 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5578b4f2aa50 con 0x5578b5145160 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee10c00640 10 client.4398 handle_command_reply: tid=0 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 client.4398 shutdown 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 -- 172.21.15.59:0/3501275051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b513ff30 msgr2=0x5578b5190c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b513ff30 0x5578b5190c80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fee14026040 tx=0x7fee14001240 comp rx=0 tx=0).stop 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 -- 172.21.15.59:0/3501275051 shutdown_connections 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x5578b5145160 0x5578b519ace0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b518a240 0x5578b5143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b5189920 0x5578b51911c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 --2- 172.21.15.59:0/3501275051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b513ff30 0x5578b5190c80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee10c00640 0 client.4398 ms_handle_reset on v2:172.21.15.178:6834/3239224017 2024-04-25T09:01:36.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 -- 172.21.15.59:0/3501275051 >> 172.21.15.59:0/3501275051 conn(0x5578b51462a0 msgr2=0x5578b513e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 -- 172.21.15.59:0/3501275051 shutdown_connections 2024-04-25T09:01:36.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 1 -- 172.21.15.59:0/3501275051 wait complete. 2024-04-25T09:01:36.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.216+0000 7fee2d916000 20 client.4398 trim_cache size 0 max 16384 2024-04-25T09:01:36.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.232+0000 7fee2d916000 1 Processor -- start 2024-04-25T09:01:36.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.232+0000 7fee2d916000 1 -- start start 2024-04-25T09:01:36.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.232+0000 7fee2d916000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b513ff30 0x5578b51e5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.232+0000 7fee2d916000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b5189920 0x5578b51e56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.232+0000 7fee2d916000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b518a240 0x5578b51e5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.232+0000 7fee2d916000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee24200610 con 0x5578b518a240 2024-04-25T09:01:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.232+0000 7fee2d916000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2415ed80 con 0x5578b513ff30 2024-04-25T09:01:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.232+0000 7fee2d916000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee24200040 con 0x5578b5189920 2024-04-25T09:01:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.232+0000 7fee23e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b518a240 0x5578b51e5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.232+0000 7fee23e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b518a240 0x5578b51e5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58208/0 (socket says 172.21.15.59:58208) 2024-04-25T09:01:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee23e00640 1 -- 172.21.15.59:0/4159724219 learned_addr learned my addr 172.21.15.59:0/4159724219 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee23400640 1 --2- 172.21.15.59:0/4159724219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b513ff30 0x5578b51e5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee23e00640 1 -- 172.21.15.59:0/4159724219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b5189920 msgr2=0x5578b51e56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee1be00640 1 --2- 172.21.15.59:0/4159724219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b5189920 0x5578b51e56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee23e00640 1 --2- 172.21.15.59:0/4159724219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b5189920 0x5578b51e56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee23e00640 1 -- 172.21.15.59:0/4159724219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b513ff30 msgr2=0x5578b51e5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee23e00640 1 --2- 172.21.15.59:0/4159724219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b513ff30 0x5578b51e5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee23e00640 1 -- 172.21.15.59:0/4159724219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578b518a070 con 0x5578b518a240 2024-04-25T09:01:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee23400640 1 --2- 172.21.15.59:0/4159724219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b513ff30 0x5578b51e5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee1be00640 1 --2- 172.21.15.59:0/4159724219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b5189920 0x5578b51e56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee23e00640 1 --2- 172.21.15.59:0/4159724219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b518a240 0x5578b51e5c10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009f90 tx=0x7fee1c01b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1879f07df950592e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee13400640 1 -- 172.21.15.59:0/4159724219 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0bd020 con 0x5578b518a240 2024-04-25T09:01:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee13400640 1 -- 172.21.15.59:0/4159724219 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c0a5b80 con 0x5578b518a240 2024-04-25T09:01:36.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee13400640 1 -- 172.21.15.59:0/4159724219 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0b2040 con 0x5578b518a240 2024-04-25T09:01:36.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 -- 172.21.15.59:0/4159724219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b518a240 msgr2=0x5578b51e5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 --2- 172.21.15.59:0/4159724219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b518a240 0x5578b51e5c10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009f90 tx=0x7fee1c01b4c0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 -- 172.21.15.59:0/4159724219 shutdown_connections 2024-04-25T09:01:36.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 --2- 172.21.15.59:0/4159724219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b518a240 0x5578b51e5c10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 --2- 172.21.15.59:0/4159724219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b5189920 0x5578b51e56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 --2- 172.21.15.59:0/4159724219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b513ff30 0x5578b51e5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 -- 172.21.15.59:0/4159724219 >> 172.21.15.59:0/4159724219 conn(0x5578b51462a0 msgr2=0x5578b5143220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 -- 172.21.15.59:0/4159724219 shutdown_connections 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 -- 172.21.15.59:0/4159724219 wait complete. 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 -- start start 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 Processor -- start 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b513ff30 0x5578b5196030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 0x5578b51cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b518a240 0x5578b51cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578b4f933d0 con 0x5578b5189920 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578b504ad50 con 0x5578b513ff30 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578b4f29980 con 0x5578b518a240 2024-04-25T09:01:36.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee2d916000 10 client.0 _ll_register_callbacks cb 0x7fee140016d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee1be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 0x5578b51cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee1be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 0x5578b51cd4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58212/0 (socket says 172.21.15.59:58212) 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee1be00640 1 -- 172.21.15.59:0/1364403494 learned_addr learned my addr 172.21.15.59:0/1364403494 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee23400640 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b513ff30 0x5578b5196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.236+0000 7fee23e00640 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b518a240 0x5578b51cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee1be00640 1 -- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b518a240 msgr2=0x5578b51cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee1be00640 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b518a240 0x5578b51cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee1be00640 1 -- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b513ff30 msgr2=0x5578b5196030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee1be00640 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b513ff30 0x5578b5196030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee1be00640 1 -- 172.21.15.59:0/1364403494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5578b5010600 con 0x5578b5189920 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee23e00640 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b518a240 0x5578b51cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee23400640 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b513ff30 0x5578b5196030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee1be00640 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 0x5578b51cd4e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0588f0 tx=0x7fee0c0863a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b20adb0f06dfbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee10c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:01:36.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee10c00640 1 -- 172.21.15.59:0/1364403494 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0860b0 con 0x5578b5189920 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee10c00640 1 -- 172.21.15.59:0/1364403494 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fee0c054fd0 con 0x5578b5189920 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 -- 172.21.15.59:0/1364403494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee1c0a5b80 con 0x5578b5189920 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee10c00640 1 -- 172.21.15.59:0/1364403494 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee0c070120 con 0x5578b5189920 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 10 client.4404 fetch_fsmap learned FSMap version 7 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 -- 172.21.15.59:0/1364403494 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5578b4f239b0 con 0x5578b5189920 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee10c00640 1 -- 172.21.15.59:0/1364403494 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c0a5b80 con 0x5578b5189920 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee10c00640 1 -- 172.21.15.59:0/1364403494 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fee0c0702c0 con 0x5578b5189920 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 10 client.4404 fetch_fsmap finished waiting for FSMap version 7 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 10 client.4404 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 20 client.4404 populate_metadata read hostname 'smithi059' 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x5578b51ce2a0 0x5578b51ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 4 client.4404 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 -- 172.21.15.59:0/1364403494 --> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5578b4f9c2e0 con 0x5578b51ce2a0 2024-04-25T09:01:36.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee23400640 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x5578b51ce2a0 0x5578b51ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee23400640 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x5578b51ce2a0 0x5578b51ce680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=820111c42069014 server_cookie=d825cfa65433a7d5 in_seq=0 out_seq=0 2024-04-25T09:01:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee10c00640 10 client.4404 ms_handle_connect on v2:172.21.15.178:6834/3239224017 2024-04-25T09:01:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee10c00640 1 -- 172.21.15.59:0/1364403494 <== mds.0 v2:172.21.15.178:6834/3239224017 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5578b4f9c2e0 con 0x5578b51ce2a0 2024-04-25T09:01:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee10c00640 10 client.4404 handle_command_reply: tid=0 2024-04-25T09:01:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 client.4404 shutdown 2024-04-25T09:01:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 -- 172.21.15.59:0/1364403494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 msgr2=0x5578b51cd4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 0x5578b51cd4e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fee0c0588f0 tx=0x7fee0c0863a0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 -- 172.21.15.59:0/1364403494 shutdown_connections 2024-04-25T09:01:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5578b518a240 0x5578b51cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5578b5189920 0x5578b51cd4e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x5578b51ce2a0 0x5578b51ce680 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 --2- 172.21.15.59:0/1364403494 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5578b513ff30 0x5578b5196030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee10c00640 0 client.4404 ms_handle_reset on v2:172.21.15.178:6834/3239224017 2024-04-25T09:01:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 -- 172.21.15.59:0/1364403494 >> 172.21.15.59:0/1364403494 conn(0x5578b51462a0 msgr2=0x5578b5191750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 -- 172.21.15.59:0/1364403494 shutdown_connections 2024-04-25T09:01:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 1 -- 172.21.15.59:0/1364403494 wait complete. 2024-04-25T09:01:36.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2d916000 20 client.4404 trim_cache size 0 max 16384 2024-04-25T09:01:36.236 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:01:36.236 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:01:36.236 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:01:36.236 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4275, 2024-04-25T09:01:36.237 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:01:36.237 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:01:36.237 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:01:36.237 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 7.4697991210000003, 2024-04-25T09:01:36.237 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 7, 2024-04-25T09:01:36.237 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 24, 2024-04-25T09:01:36.237 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 24, 2024-04-25T09:01:36.237 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 15.110882473 2024-04-25T09:01:36.237 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:01:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2a400640 1 -- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee00066f60 msgr2=0x7fee00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2a400640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee00066f60 0x7fee00069420 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee14007fd0 tx=0x7fee14009040 comp rx=0 tx=0).stop 2024-04-25T09:01:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2a400640 1 -- 172.21.15.59:0/658706953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee241f3190 msgr2=0x7fee2415f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2a400640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee241f3190 0x7fee2415f750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee0c011810 tx=0x7fee0c011cd0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2a400640 1 -- 172.21.15.59:0/658706953 shutdown_connections 2024-04-25T09:01:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2a400640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee00066f60 0x7fee00069420 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2a400640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee240ce9b0 0x7fee240b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2a400640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee241f3190 0x7fee2415f750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2a400640 1 --2- 172.21.15.59:0/658706953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee08005090 0x7fee24159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2a400640 1 -- 172.21.15.59:0/658706953 >> 172.21.15.59:0/658706953 conn(0x7fee240b2240 msgr2=0x7fee240aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2a400640 1 -- 172.21.15.59:0/658706953 shutdown_connections 2024-04-25T09:01:36.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.240+0000 7fee2a400640 1 -- 172.21.15.59:0/658706953 wait complete. 2024-04-25T09:01:36.251 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:01:36.251 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:01:36.251 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:01:36.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.400+0000 7f9199c00640 1 Processor -- start 2024-04-25T09:01:36.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.400+0000 7f9199c00640 1 -- start start 2024-04-25T09:01:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.400+0000 7f9199c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9194144140 0x7f91940ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.400+0000 7f9199c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91940ced60 0x7f919406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.400+0000 7f9199c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f919406e900 0x7f919415e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.400+0000 7f9199c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919406ed70 con 0x7f9194144140 2024-04-25T09:01:36.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.400+0000 7f9199c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919415ac60 con 0x7f919406e900 2024-04-25T09:01:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.400+0000 7f9199c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91940cf3e0 con 0x7f91940ced60 2024-04-25T09:01:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9192a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9194144140 0x7f91940ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9192a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9194144140 0x7f91940ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58214/0 (socket says 172.21.15.59:58214) 2024-04-25T09:01:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9192a00640 1 -- 172.21.15.59:0/640533669 learned_addr learned my addr 172.21.15.59:0/640533669 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f918a000640 1 --2- 172.21.15.59:0/640533669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91940ced60 0x7f919406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9193400640 1 --2- 172.21.15.59:0/640533669 >> v2:172.21.15.178:3300/0 conn(0x7f919406e900 0x7f919415e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9192a00640 1 -- 172.21.15.59:0/640533669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91940ced60 msgr2=0x7f919406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9192a00640 1 --2- 172.21.15.59:0/640533669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91940ced60 0x7f919406e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9192a00640 1 -- 172.21.15.59:0/640533669 >> v2:172.21.15.178:3300/0 conn(0x7f919406e900 msgr2=0x7f919415e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9192a00640 1 --2- 172.21.15.59:0/640533669 >> v2:172.21.15.178:3300/0 conn(0x7f919406e900 0x7f919415e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9192a00640 1 -- 172.21.15.59:0/640533669 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919415af20 con 0x7f9194144140 2024-04-25T09:01:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9192a00640 1 --2- 172.21.15.59:0/640533669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9194144140 0x7f91940ce820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f919406b690 tx=0x7f918401e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d20c70ef156f956 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9192000640 1 -- 172.21.15.59:0/640533669 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840b4070 con 0x7f9194144140 2024-04-25T09:01:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9192000640 1 -- 172.21.15.59:0/640533669 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91840a77c0 con 0x7f9194144140 2024-04-25T09:01:36.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.404+0000 7f9192000640 1 -- 172.21.15.59:0/640533669 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840a7b90 con 0x7f9194144140 2024-04-25T09:01:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 -- 172.21.15.59:0/640533669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9194144140 msgr2=0x7f91940ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 --2- 172.21.15.59:0/640533669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9194144140 0x7f91940ce820 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f919406b690 tx=0x7f918401e930 comp rx=0 tx=0).stop 2024-04-25T09:01:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 -- 172.21.15.59:0/640533669 shutdown_connections 2024-04-25T09:01:36.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 --2- 172.21.15.59:0/640533669 >> v2:172.21.15.178:3300/0 conn(0x7f919406e900 0x7f919415e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 --2- 172.21.15.59:0/640533669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91940ced60 0x7f919406e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 --2- 172.21.15.59:0/640533669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9194144140 0x7f91940ce820 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 -- 172.21.15.59:0/640533669 >> 172.21.15.59:0/640533669 conn(0x7f9194066fa0 msgr2=0x7f919406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 -- 172.21.15.59:0/640533669 shutdown_connections 2024-04-25T09:01:36.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 -- 172.21.15.59:0/640533669 wait complete. 2024-04-25T09:01:36.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 Processor -- start 2024-04-25T09:01:36.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 -- start start 2024-04-25T09:01:36.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f919406e900 0x7f9194133020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91940ced60 0x7f919415d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9194144140 0x7f919415d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919415ba00 con 0x7f9194144140 2024-04-25T09:01:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9194144520 con 0x7f91940ced60 2024-04-25T09:01:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9199c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919415bb80 con 0x7f919406e900 2024-04-25T09:01:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9193400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9194144140 0x7f919415d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9193400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9194144140 0x7f919415d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58222/0 (socket says 172.21.15.59:58222) 2024-04-25T09:01:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9193400640 1 -- 172.21.15.59:0/3834243039 learned_addr learned my addr 172.21.15.59:0/3834243039 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f918a000640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91940ced60 0x7f919415d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9192a00640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f919406e900 0x7f9194133020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9193400640 1 -- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f919406e900 msgr2=0x7f9194133020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9193400640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f919406e900 0x7f9194133020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9193400640 1 -- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91940ced60 msgr2=0x7f919415d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9193400640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91940ced60 0x7f919415d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.408+0000 7f9193400640 1 -- 172.21.15.59:0/3834243039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91941626c0 con 0x7f9194144140 2024-04-25T09:01:36.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.412+0000 7f9193400640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9194144140 0x7f919415d750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f918c00d560 tx=0x7f918c00da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.412+0000 7f918b400640 1 -- 172.21.15.59:0/3834243039 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c0125f0 con 0x7f9194144140 2024-04-25T09:01:36.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.412+0000 7f918b400640 1 -- 172.21.15.59:0/3834243039 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c019070 con 0x7f9194144140 2024-04-25T09:01:36.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.412+0000 7f918b400640 1 -- 172.21.15.59:0/3834243039 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c0129f0 con 0x7f9194144140 2024-04-25T09:01:36.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.412+0000 7f9199c00640 1 -- 172.21.15.59:0/3834243039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91941629a0 con 0x7f9194144140 2024-04-25T09:01:36.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.412+0000 7f9199c00640 1 -- 172.21.15.59:0/3834243039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9194162f60 con 0x7f9194144140 2024-04-25T09:01:36.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.412+0000 7f9199c00640 1 -- 172.21.15.59:0/3834243039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91940745d0 con 0x7f9194144140 2024-04-25T09:01:36.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.412+0000 7f918b400640 1 -- 172.21.15.59:0/3834243039 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f918c012b90 con 0x7f9194144140 2024-04-25T09:01:36.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.412+0000 7f918b400640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9170066f60 0x7f9170069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:36.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.412+0000 7f918b400640 1 -- 172.21.15.59:0/3834243039 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f918c0856d0 con 0x7f9194144140 2024-04-25T09:01:36.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.416+0000 7f9192a00640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9170066f60 0x7f9170069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:36.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.416+0000 7f9192a00640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9170066f60 0x7f9170069420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f91840b1000 tx=0x7f91840a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:36.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.416+0000 7f918b400640 1 -- 172.21.15.59:0/3834243039 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f918c055cb0 con 0x7f9194144140 2024-04-25T09:01:36.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.612+0000 7f9199c00640 1 -- 172.21.15.59:0/3834243039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f91940b2740 con 0x7f9194144140 2024-04-25T09:01:36.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.612+0000 7f918b400640 1 -- 172.21.15.59:0/3834243039 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f918c059d50 con 0x7f9194144140 2024-04-25T09:01:36.604 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:01:36.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.616+0000 7f9199c00640 1 -- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9170066f60 msgr2=0x7f9170069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.616+0000 7f9199c00640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9170066f60 0x7f9170069420 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f91840b1000 tx=0x7f91840a9070 comp rx=0 tx=0).stop 2024-04-25T09:01:36.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.616+0000 7f9199c00640 1 -- 172.21.15.59:0/3834243039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9194144140 msgr2=0x7f919415d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:36.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.616+0000 7f9199c00640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9194144140 0x7f919415d750 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f918c00d560 tx=0x7f918c00da20 comp rx=0 tx=0).stop 2024-04-25T09:01:36.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.616+0000 7f9199c00640 1 -- 172.21.15.59:0/3834243039 shutdown_connections 2024-04-25T09:01:36.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.616+0000 7f9199c00640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9170066f60 0x7f9170069420 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.616+0000 7f9199c00640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9194144140 0x7f919415d750 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.616+0000 7f9199c00640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91940ced60 0x7f919415d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.616+0000 7f9199c00640 1 --2- 172.21.15.59:0/3834243039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f919406e900 0x7f9194133020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:36.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.616+0000 7f9199c00640 1 -- 172.21.15.59:0/3834243039 >> 172.21.15.59:0/3834243039 conn(0x7f9194066fa0 msgr2=0x7f919415c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:36.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.616+0000 7f9199c00640 1 -- 172.21.15.59:0/3834243039 shutdown_connections 2024-04-25T09:01:36.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:36.616+0000 7f9199c00640 1 -- 172.21.15.59:0/3834243039 wait complete. 2024-04-25T09:01:36.625 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:01:36.625 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:01:36.625 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:01:36.625 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T09:01:36.625 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:01:36.625 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:01:36.625 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:01:36.626 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:01:36.626 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T09:01:36.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:36.626 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:01:36.636 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:01:36.636 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:01:36.636 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:01:36.636 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:36.636 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:01:36.636 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:36.636 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:01:36.636 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:36.636 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42471sec preferred_lft 42471sec 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:01:36.637 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:01:36.638 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:36.638 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:01:36.638 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:36.638 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T09:01:36.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:36.639 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:01:36.639 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:01:36.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add name ceph-brx type bridge 2024-04-25T09:01:36.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr flush dev ceph-brx 2024-04-25T09:01:36.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set ceph-brx up 2024-04-25T09:01:36.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T09:01:36.639 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:01:36.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:36.749 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:01:36.767 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:01:36.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:36.770 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:01:36.833 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:01:36.833 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:01:36.833 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:01:36.833 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:01:36.833 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:01:36.833 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:01:36.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:36.834 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:01:36.834 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:01:36.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:01:36.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:01:36.834 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:01:36.834 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:01:36.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:36.930 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:01:36.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:36.939 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2024-04-25T09:01:36.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:36.993 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:01:36.993 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:01:36.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:01:36.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T09:01:36.993 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:01:37.080 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T09:01:37.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:37.080 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:01:37.081 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:01:37.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T09:01:37.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T09:01:37.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T09:01:37.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T09:01:37.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T09:01:37.081 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:01:37.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:37.247 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:01:37.247 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:01:37.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:01:37.247 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T09:01:37.247 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:01:37.286 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T09:01:37.286 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:01:37.286 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:01:37.337 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T09:01:37.337 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:01:37.337 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:01:37.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-04-25T09:01:37.455 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T09:01:37.506 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-04-25T09:01:37.506 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-04-25T09:01:37.506 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-04-25T09:01:37.506 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-04-25T09:01:37.506 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-04-25T09:01:37.506 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-04-25T09:01:37.506 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-04-25T09:01:37.506 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-04-25T09:01:37.506 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-04-25T09:01:37.506 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-04-25T09:01:37.507 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T09:01:37.508 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T09:01:37.508 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T09:01:37.508 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T09:01:37.508 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-04-25T09:01:37.508 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:01:37.508 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:01:37.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:37.509 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-04-25T09:01:37.561 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T09:01:37.561 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T09:01:37.608 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-04-25T09:01:37.629 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T09:01:37.686 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-04-25T09:01:37.687 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-04-25T09:01:37.687 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-04-25T09:01:37.687 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-04-25T09:01:37.687 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-04-25T09:01:37.687 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-04-25T09:01:37.688 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-04-25T09:01:37.688 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-04-25T09:01:37.688 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-04-25T09:01:37.688 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-04-25T09:01:37.688 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-04-25T09:01:37.688 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-04-25T09:01:37.689 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T09:01:37.689 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-04-25T09:01:37.689 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-04-25T09:01:37.689 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-04-25T09:01:37.689 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-04-25T09:01:37.689 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-04-25T09:01:37.689 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-04-25T09:01:37.689 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-04-25T09:01:37.690 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T09:01:37.690 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-04-25T09:01:37.690 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-04-25T09:01:37.690 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-04-25T09:01:37.690 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T09:01:37.690 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T09:01:37.690 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T09:01:37.691 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T09:01:37.691 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-04-25T09:01:37.691 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:01:37.691 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:01:37.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:37.692 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-04-25T09:01:37.707 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi059.stderr:2024-04-25T09:01:37.716+0000 7f04a7447580 -1 init, newargv = 0x55bbf0a44390 newargc=15 2024-04-25T09:01:37.707 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi059.stderr:ceph-fuse[33737]: starting ceph client 2024-04-25T09:01:37.716 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi059.stderr:ceph-fuse[33737]: starting fuse 2024-04-25T09:01:38.816 DEBUG:teuthology.orchestra.run.smithi059:> sudo modprobe fuse 2024-04-25T09:01:38.841 DEBUG:teuthology.orchestra.run.smithi059:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T09:01:38.899 INFO:teuthology.orchestra.run.smithi059.stdout:/sys 2024-04-25T09:01:38.899 INFO:teuthology.orchestra.run.smithi059.stdout:/proc 2024-04-25T09:01:38.899 INFO:teuthology.orchestra.run.smithi059.stdout:/dev 2024-04-25T09:01:38.899 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/pts 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/run 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/ 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/security 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/shm 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/run/lock 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/cgroup 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/pstore 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/bpf 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/hugepages 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/dev/mqueue 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/debug 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/tracing 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/proc/fs/nfsd 2024-04-25T09:01:38.900 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/fs/fuse/connections 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/sys/kernel/config 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/run/rpc_pipefs 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/run/user/1000 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:01:38.901 INFO:teuthology.orchestra.run.smithi059.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-25T09:01:38.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:38.902 DEBUG:teuthology.orchestra.run.smithi059:> ls /sys/fs/fuse/connections 2024-04-25T09:01:38.953 INFO:teuthology.orchestra.run.smithi059.stdout:44 2024-04-25T09:01:38.953 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-04-25T09:01:38.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo stdin-killer -- python3 -c ' 2024-04-25T09:01:38.953 DEBUG:teuthology.orchestra.run.smithi059:> import glob 2024-04-25T09:01:38.953 DEBUG:teuthology.orchestra.run.smithi059:> import re 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> import subprocess 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> def _find_admin_socket(client_name): 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> files = glob.glob(asok_path) 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> # Given a non-glob path, it better be there 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> if "*" not in asok_path: 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> assert(len(files) == 1) 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> return files[0] 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> for f in files: 2024-04-25T09:01:38.954 DEBUG:teuthology.orchestra.run.smithi059:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T09:01:38.955 DEBUG:teuthology.orchestra.run.smithi059:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T09:01:38.955 DEBUG:teuthology.orchestra.run.smithi059:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T09:01:38.955 DEBUG:teuthology.orchestra.run.smithi059:> contents = proc_f.read() 2024-04-25T09:01:38.955 DEBUG:teuthology.orchestra.run.smithi059:> if mountpoint in contents: 2024-04-25T09:01:38.955 DEBUG:teuthology.orchestra.run.smithi059:> return f 2024-04-25T09:01:38.955 DEBUG:teuthology.orchestra.run.smithi059:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T09:01:38.955 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:01:38.955 DEBUG:teuthology.orchestra.run.smithi059:> print(_find_admin_socket("client.admin")) 2024-04-25T09:01:38.955 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:01:39.087 INFO:teuthology.orchestra.run.smithi059.stdout:/var/run/ceph/ceph-client.admin.33737.asok 2024-04-25T09:01:39.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:01:39.099 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33737.asok 2024-04-25T09:01:39.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:39.099 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33737.asok status 2024-04-25T09:01:39.280 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:01:39.280 INFO:teuthology.orchestra.run.smithi059.stdout: "metadata": { 2024-04-25T09:01:39.280 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_sha1": "97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec", 2024-04-25T09:01:39.280 INFO:teuthology.orchestra.run.smithi059.stdout: "ceph_version": "ceph version 19.0.0-1628-g97ae6cc9 (97ae6cc94daeb493fb1bfb6c82833f1485dfb1ec) squid (dev)", 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "entity_id": "admin", 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "hostname": "smithi059", 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "pid": "33737", 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "root": "/" 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_count": 0, 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "dentry_pinned_count": 0, 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4416, 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "inst": { 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "name": { 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "client", 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "num": 4416 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:01:39.281 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3404129463 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": { 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "type": "v1", 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "addr": "192.168.0.1:0", 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "nonce": 3404129463 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "inst_str": "client.4416 192.168.0.1:0/3404129463", 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "addr_str": "192.168.0.1:0/3404129463", 2024-04-25T09:01:39.282 INFO:teuthology.orchestra.run.smithi059.stdout: "inode_count": 1, 2024-04-25T09:01:39.283 INFO:teuthology.orchestra.run.smithi059.stdout: "mds_epoch": 7, 2024-04-25T09:01:39.283 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch": 24, 2024-04-25T09:01:39.283 INFO:teuthology.orchestra.run.smithi059.stdout: "osd_epoch_barrier": 0, 2024-04-25T09:01:39.283 INFO:teuthology.orchestra.run.smithi059.stdout: "blocklisted": false, 2024-04-25T09:01:39.283 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs" 2024-04-25T09:01:39.283 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:01:39.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:39.296 DEBUG:teuthology.orchestra.run.smithi059:> stat --file-system '--printf=%T 2024-04-25T09:01:39.296 DEBUG:teuthology.orchestra.run.smithi059:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:01:39.305 INFO:teuthology.orchestra.run.smithi059.stdout:fuseblk 2024-04-25T09:01:39.306 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:01:39.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:39.306 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:01:39.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:39.374 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T09:01:40.291 INFO:teuthology.orchestra.run.smithi059.stdout:# file: . 2024-04-25T09:01:40.291 INFO:teuthology.orchestra.run.smithi059.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T09:01:40.291 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:40.292 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:01:40.292 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:40.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.504+0000 7f7c4a200640 1 Processor -- start 2024-04-25T09:01:40.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c4a200640 1 -- start start 2024-04-25T09:01:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c4a200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c44099a60 0x7f7c44099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c4a200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c440cff30 0x7f7c440d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c4a200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c4409a380 con 0x7f7c4415ee00 2024-04-25T09:01:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c4a200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c4406c430 con 0x7f7c440cff30 2024-04-25T09:01:40.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c4a200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4406c650 con 0x7f7c44099a60 2024-04-25T09:01:40.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c43e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c440cff30 0x7f7c440d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c3aa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7c4415ee00 0x7f7c4406bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41738/0 (socket says 172.21.15.59:41738) 2024-04-25T09:01:40.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c43e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c440cff30 0x7f7c440d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46348/0 (socket says 172.21.15.59:46348) 2024-04-25T09:01:40.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c3aa00640 1 -- 172.21.15.59:0/2057470463 learned_addr learned my addr 172.21.15.59:0/2057470463 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:40.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c43400640 1 --2- 172.21.15.59:0/2057470463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c44099a60 0x7f7c44099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c43e00640 1 -- 172.21.15.59:0/2057470463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c44099a60 msgr2=0x7f7c44099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:40.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c43e00640 1 --2- 172.21.15.59:0/2057470463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c44099a60 0x7f7c44099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c43e00640 1 -- 172.21.15.59:0/2057470463 >> v1:172.21.15.59:6789/0 conn(0x7f7c4415ee00 legacy=0x7f7c4406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c42a00640 1 -- 172.21.15.59:0/2057470463 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373982379 0 0) 0x7f7c4409a380 con 0x7f7c4415ee00 2024-04-25T09:01:40.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c43e00640 1 -- 172.21.15.59:0/2057470463 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c4406c930 con 0x7f7c440cff30 2024-04-25T09:01:40.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.508+0000 7f7c43400640 1 --2- 172.21.15.59:0/2057470463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c44099a60 0x7f7c44099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:40.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c43e00640 1 --2- 172.21.15.59:0/2057470463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c440cff30 0x7f7c440d03e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009d90 tx=0x7f7c3c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f1ed634e6996fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c42a00640 1 -- 172.21.15.59:0/2057470463 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0b2070 con 0x7f7c440cff30 2024-04-25T09:01:40.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c42a00640 1 -- 172.21.15.59:0/2057470463 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3c0a5920 con 0x7f7c440cff30 2024-04-25T09:01:40.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c42a00640 1 -- 172.21.15.59:0/2057470463 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0a5cf0 con 0x7f7c440cff30 2024-04-25T09:01:40.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c4a200640 1 -- 172.21.15.59:0/2057470463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c440cff30 msgr2=0x7f7c440d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c4a200640 1 --2- 172.21.15.59:0/2057470463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c440cff30 0x7f7c440d03e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c3c009d90 tx=0x7f7c3c01c970 comp rx=0 tx=0).stop 2024-04-25T09:01:40.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c4a200640 1 -- 172.21.15.59:0/2057470463 shutdown_connections 2024-04-25T09:01:40.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c4a200640 1 --2- 172.21.15.59:0/2057470463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c440cff30 0x7f7c440d03e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c4a200640 1 --2- 172.21.15.59:0/2057470463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c44099a60 0x7f7c44099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c4a200640 1 -- 172.21.15.59:0/2057470463 >> 172.21.15.59:0/2057470463 conn(0x7f7c440d17a0 msgr2=0x7f7c440d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:40.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c4a200640 1 -- 172.21.15.59:0/2057470463 shutdown_connections 2024-04-25T09:01:40.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c4a200640 1 -- 172.21.15.59:0/2057470463 wait complete. 2024-04-25T09:01:40.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c4a200640 1 Processor -- start 2024-04-25T09:01:40.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.512+0000 7f7c4a200640 1 -- start start 2024-04-25T09:01:40.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c4a200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c44099a60 0x7f7c4415c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c4a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c440cff30 0x7f7c440b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c4a200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c4415ee00 0x7f7c440b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c4a200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4415e000 con 0x7f7c440cff30 2024-04-25T09:01:40.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c4a200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4415de80 con 0x7f7c44099a60 2024-04-25T09:01:40.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c4a200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c4416aa00 con 0x7f7c4415ee00 2024-04-25T09:01:40.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c3aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c440cff30 0x7f7c440b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c3aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c440cff30 0x7f7c440b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46358/0 (socket says 172.21.15.59:46358) 2024-04-25T09:01:40.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c3aa00640 1 -- 172.21.15.59:0/1648836570 learned_addr learned my addr 172.21.15.59:0/1648836570 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:40.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c43e00640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c4415ee00 0x7f7c440b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c43400640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c44099a60 0x7f7c4415c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c3aa00640 1 -- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c4415ee00 msgr2=0x7f7c440b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c3aa00640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c4415ee00 0x7f7c440b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c3aa00640 1 -- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c44099a60 msgr2=0x7f7c4415c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c3aa00640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c44099a60 0x7f7c4415c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c3aa00640 1 -- 172.21.15.59:0/1648836570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440b5c90 con 0x7f7c440cff30 2024-04-25T09:01:40.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c3aa00640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c440cff30 0x7f7c440b5210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00c480 tx=0x7f7c2c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c3be00640 1 -- 172.21.15.59:0/1648836570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c018070 con 0x7f7c440cff30 2024-04-25T09:01:40.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c3be00640 1 -- 172.21.15.59:0/1648836570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c0074e0 con 0x7f7c440cff30 2024-04-25T09:01:40.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c3be00640 1 -- 172.21.15.59:0/1648836570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c0049f0 con 0x7f7c440cff30 2024-04-25T09:01:40.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c4a200640 1 -- 172.21.15.59:0/1648836570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c440ca870 con 0x7f7c440cff30 2024-04-25T09:01:40.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c4a200640 1 -- 172.21.15.59:0/1648836570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c440cae30 con 0x7f7c440cff30 2024-04-25T09:01:40.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.516+0000 7f7c4a200640 1 -- 172.21.15.59:0/1648836570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c440745d0 con 0x7f7c440cff30 2024-04-25T09:01:40.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.520+0000 7f7c3be00640 1 -- 172.21.15.59:0/1648836570 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7c2c01b070 con 0x7f7c440cff30 2024-04-25T09:01:40.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.520+0000 7f7c3be00640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c20066f60 0x7f7c20069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.520+0000 7f7c3be00640 1 -- 172.21.15.59:0/1648836570 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7c2c0847b0 con 0x7f7c440cff30 2024-04-25T09:01:40.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.520+0000 7f7c43400640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c20066f60 0x7f7c20069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.520+0000 7f7c43400640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c20066f60 0x7f7c20069420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400a9a0 tx=0x7f7c34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.524+0000 7f7c3be00640 1 -- 172.21.15.59:0/1648836570 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7c2c055470 con 0x7f7c440cff30 2024-04-25T09:01:40.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.688+0000 7f7c4a200640 1 -- 172.21.15.59:0/1648836570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c4415b240 con 0x7f7c440cff30 2024-04-25T09:01:40.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.688+0000 7f7c3be00640 1 -- 172.21.15.59:0/1648836570 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7f7c2c054d70 con 0x7f7c440cff30 2024-04-25T09:01:40.681 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:40.681 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.692+0000 7f7c4a200640 1 -- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c20066f60 msgr2=0x7f7c20069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.692+0000 7f7c4a200640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c20066f60 0x7f7c20069420 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7c3400a9a0 tx=0x7f7c34008040 comp rx=0 tx=0).stop 2024-04-25T09:01:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.692+0000 7f7c4a200640 1 -- 172.21.15.59:0/1648836570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c440cff30 msgr2=0x7f7c440b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.692+0000 7f7c4a200640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c440cff30 0x7f7c440b5210 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00c480 tx=0x7f7c2c00c940 comp rx=0 tx=0).stop 2024-04-25T09:01:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.692+0000 7f7c4a200640 1 -- 172.21.15.59:0/1648836570 shutdown_connections 2024-04-25T09:01:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.692+0000 7f7c4a200640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c20066f60 0x7f7c20069420 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.692+0000 7f7c4a200640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c4415ee00 0x7f7c440b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.692+0000 7f7c4a200640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c440cff30 0x7f7c440b5210 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.692+0000 7f7c4a200640 1 --2- 172.21.15.59:0/1648836570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c44099a60 0x7f7c4415c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.692+0000 7f7c4a200640 1 -- 172.21.15.59:0/1648836570 >> 172.21.15.59:0/1648836570 conn(0x7f7c440d17a0 msgr2=0x7f7c4415e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:40.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.692+0000 7f7c4a200640 1 -- 172.21.15.59:0/1648836570 shutdown_connections 2024-04-25T09:01:40.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.692+0000 7f7c4a200640 1 -- 172.21.15.59:0/1648836570 wait complete. 2024-04-25T09:01:40.706 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:01:40.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:01:40.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.860+0000 7f77ff000640 1 Processor -- start 2024-04-25T09:01:40.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.860+0000 7f77ff000640 1 -- start start 2024-04-25T09:01:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77ff000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f80cf3b0 0x7f77f8168ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77ff000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f806ac10 con 0x7f77f8072210 2024-04-25T09:01:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77ff000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77f806aeb0 con 0x7f77f815dd90 2024-04-25T09:01:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77ff000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80b2dc0 con 0x7f77f80cf3b0 2024-04-25T09:01:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77ef400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f77f8072210 0x7f77f80cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41744/0 (socket says 172.21.15.59:41744) 2024-04-25T09:01:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77ef400640 1 -- 172.21.15.59:0/1600987927 learned_addr learned my addr 172.21.15.59:0/1600987927 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:40.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77fd000640 1 --2- 172.21.15.59:0/1600987927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f80cf3b0 0x7f77f8168ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453959352 0 0) 0x7f77f806ac10 con 0x7f77f8072210 2024-04-25T09:01:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77dc003530 con 0x7f77f8072210 2024-04-25T09:01:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2723794147 0 0) 0x7f77f806aeb0 con 0x7f77f815dd90 2024-04-25T09:01:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f806ac10 con 0x7f77f815dd90 2024-04-25T09:01:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2741282329 0 0) 0x7f77dc003530 con 0x7f77f8072210 2024-04-25T09:01:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f80cf3b0 msgr2=0x7f77f8168ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:40.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 --2- 172.21.15.59:0/1600987927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f80cf3b0 0x7f77f8168ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 >> v1:172.21.15.178:6789/0 conn(0x7f77f815dd90 legacy=0x7f77f8071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f806b190 con 0x7f77f8072210 2024-04-25T09:01:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f77e0001680 con 0x7f77f8072210 2024-04-25T09:01:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 >> v1:172.21.15.59:6789/0 conn(0x7f77f8072210 legacy=0x7f77f80cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 --2- 172.21.15.59:0/1600987927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77dc003b80 0x7f77dc003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 --2- 172.21.15.59:0/1600987927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77dc004810 0x7f77dc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 --2- 172.21.15.59:0/1600987927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77dc0051d0 0x7f77dc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc00c010 con 0x7f77dc004810 2024-04-25T09:01:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc00c1c0 con 0x7f77dc0051d0 2024-04-25T09:01:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77dc00c3c0 con 0x7f77dc003b80 2024-04-25T09:01:40.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77ef400640 1 --2- 172.21.15.59:0/1600987927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77dc004810 0x7f77dc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77f7e00640 1 --2- 172.21.15.59:0/1600987927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77dc003b80 0x7f77dc003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77fd000640 1 --2- 172.21.15.59:0/1600987927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77dc0051d0 0x7f77dc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77ef400640 1 -- 172.21.15.59:0/1600987927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77dc003b80 msgr2=0x7f77dc003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77ef400640 1 --2- 172.21.15.59:0/1600987927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77dc003b80 0x7f77dc003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77ef400640 1 -- 172.21.15.59:0/1600987927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77dc0051d0 msgr2=0x7f77dc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77ef400640 1 --2- 172.21.15.59:0/1600987927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77dc0051d0 0x7f77dc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.864+0000 7f77ef400640 1 -- 172.21.15.59:0/1600987927 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc003530 con 0x7f77dc004810 2024-04-25T09:01:40.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.868+0000 7f77ef400640 1 --2- 172.21.15.59:0/1600987927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77dc004810 0x7f77dc004c90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f77e000c1c0 tx=0x7f77e001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3059c02e674a0dd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.868+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0007cd0 con 0x7f77dc004810 2024-04-25T09:01:40.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.868+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e00a9020 con 0x7f77dc004810 2024-04-25T09:01:40.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.868+0000 7f77f7400640 1 -- 172.21.15.59:0/1600987927 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e0005b00 con 0x7f77dc004810 2024-04-25T09:01:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.868+0000 7f77ff000640 1 -- 172.21.15.59:0/1600987927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77dc004810 msgr2=0x7f77dc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.868+0000 7f77ff000640 1 --2- 172.21.15.59:0/1600987927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77dc004810 0x7f77dc004c90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f77e000c1c0 tx=0x7f77e001cc00 comp rx=0 tx=0).stop 2024-04-25T09:01:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.868+0000 7f77fd000640 1 -- 172.21.15.59:0/1600987927 reap_dead start 2024-04-25T09:01:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.868+0000 7f77ff000640 1 -- 172.21.15.59:0/1600987927 shutdown_connections 2024-04-25T09:01:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.868+0000 7f77ff000640 1 -- 172.21.15.59:0/1600987927 >> 172.21.15.59:0/1600987927 conn(0x7f77f80cfd90 msgr2=0x7f77f80d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.868+0000 7f77ff000640 1 -- 172.21.15.59:0/1600987927 shutdown_connections 2024-04-25T09:01:40.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.868+0000 7f77ff000640 1 -- 172.21.15.59:0/1600987927 wait complete. 2024-04-25T09:01:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ff000640 1 Processor -- start 2024-04-25T09:01:40.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ff000640 1 -- start start 2024-04-25T09:01:40.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ff000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77dc004810 0x7f77f8150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ff000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77f81511d0 0x7f77f8151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ff000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f8163420 0x7f77f81638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ff000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f81692c0 con 0x7f77dc004810 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ff000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f80cfa10 con 0x7f77f81511d0 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ff000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f8169440 con 0x7f77f8163420 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77f7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77dc004810 0x7f77f8150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77f7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77dc004810 0x7f77f8150ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46368/0 (socket says 172.21.15.59:46368) 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77f7e00640 1 -- 172.21.15.59:0/4032032416 learned_addr learned my addr 172.21.15.59:0/4032032416 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ef400640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77f81511d0 0x7f77f8151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77fd000640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f8163420 0x7f77f81638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77f7e00640 1 -- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f8163420 msgr2=0x7f77f81638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77f7e00640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f8163420 0x7f77f81638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77f7e00640 1 -- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77f81511d0 msgr2=0x7f77f8151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77f7e00640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77f81511d0 0x7f77f8151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77f7e00640 1 -- 172.21.15.59:0/4032032416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f815edc0 con 0x7f77dc004810 2024-04-25T09:01:40.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ef400640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77f81511d0 0x7f77f8151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:40.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77f7e00640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77dc004810 0x7f77f8150ac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f77e800f770 tx=0x7f77e800fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77f4c00640 1 -- 172.21.15.59:0/4032032416 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e801a070 con 0x7f77dc004810 2024-04-25T09:01:40.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77f4c00640 1 -- 172.21.15.59:0/4032032416 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e8005110 con 0x7f77dc004810 2024-04-25T09:01:40.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77f4c00640 1 -- 172.21.15.59:0/4032032416 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e80067e0 con 0x7f77dc004810 2024-04-25T09:01:40.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ff000640 1 -- 172.21.15.59:0/4032032416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f815f0a0 con 0x7f77dc004810 2024-04-25T09:01:40.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ff000640 1 -- 172.21.15.59:0/4032032416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f815f660 con 0x7f77dc004810 2024-04-25T09:01:40.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.872+0000 7f77ff000640 1 -- 172.21.15.59:0/4032032416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f80745d0 con 0x7f77dc004810 2024-04-25T09:01:40.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.876+0000 7f77f4c00640 1 -- 172.21.15.59:0/4032032416 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f77e8006980 con 0x7f77dc004810 2024-04-25T09:01:40.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.876+0000 7f77f4c00640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f77d4066f90 0x7f77d4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:40.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.876+0000 7f77f4c00640 1 -- 172.21.15.59:0/4032032416 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f77e8084b30 con 0x7f77dc004810 2024-04-25T09:01:40.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.876+0000 7f77ef400640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f77d4066f90 0x7f77d4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:40.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.876+0000 7f77ef400640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f77d4066f90 0x7f77d4069450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f77e00aa000 tx=0x7f77e00b0040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:40.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:40.880+0000 7f77f4c00640 1 -- 172.21.15.59:0/4032032416 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f77e8006c70 con 0x7f77dc004810 2024-04-25T09:01:41.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.044+0000 7f77ff000640 1 -- 172.21.15.59:0/4032032416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77f80671b0 con 0x7f77dc004810 2024-04-25T09:01:41.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.044+0000 7f77f4c00640 1 -- 172.21.15.59:0/4032032416 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77e8055800 con 0x7f77dc004810 2024-04-25T09:01:41.035 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:01:41.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.048+0000 7f77ff000640 1 -- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f77d4066f90 msgr2=0x7f77d4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.048+0000 7f77ff000640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f77d4066f90 0x7f77d4069450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f77e00aa000 tx=0x7f77e00b0040 comp rx=0 tx=0).stop 2024-04-25T09:01:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.048+0000 7f77ff000640 1 -- 172.21.15.59:0/4032032416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77dc004810 msgr2=0x7f77f8150ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.048+0000 7f77ff000640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77dc004810 0x7f77f8150ac0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f77e800f770 tx=0x7f77e800fb70 comp rx=0 tx=0).stop 2024-04-25T09:01:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.048+0000 7f77ff000640 1 -- 172.21.15.59:0/4032032416 shutdown_connections 2024-04-25T09:01:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.048+0000 7f77ff000640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f77d4066f90 0x7f77d4069450 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.048+0000 7f77ff000640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f77f8163420 0x7f77f81638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.048+0000 7f77ff000640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f77f81511d0 0x7f77f8151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.048+0000 7f77ff000640 1 --2- 172.21.15.59:0/4032032416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77dc004810 0x7f77f8150ac0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.048+0000 7f77ff000640 1 -- 172.21.15.59:0/4032032416 >> 172.21.15.59:0/4032032416 conn(0x7f77f80cfd90 msgr2=0x7f77f8154550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.048+0000 7f77ff000640 1 -- 172.21.15.59:0/4032032416 shutdown_connections 2024-04-25T09:01:41.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.048+0000 7f77ff000640 1 -- 172.21.15.59:0/4032032416 wait complete. 2024-04-25T09:01:41.057 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:01:41.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.212+0000 7f27a5200640 1 Processor -- start 2024-04-25T09:01:41.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.212+0000 7f27a5200640 1 -- start start 2024-04-25T09:01:41.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.212+0000 7f27a5200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f27a015acd0 0x7f27a015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.212+0000 7f27a5200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f27a015ee60 0x7f27a00b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.212+0000 7f27a5200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27a015bc40 con 0x7f27a0144120 2024-04-25T09:01:41.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.212+0000 7f27a5200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a015e490 con 0x7f27a015acd0 2024-04-25T09:01:41.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.212+0000 7f27a5200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27a015b150 con 0x7f27a015ee60 2024-04-25T09:01:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.216+0000 7f2795400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f27a015acd0 0x7f27a015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.216+0000 7f2795400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f27a015acd0 0x7f27a015e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46376/0 (socket says 172.21.15.59:46376) 2024-04-25T09:01:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.216+0000 7f2795400640 1 -- 172.21.15.59:0/2759544643 learned_addr learned my addr 172.21.15.59:0/2759544643 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.216+0000 7f279e800640 1 --2- 172.21.15.59:0/2759544643 >> v2:172.21.15.178:3300/0 conn(0x7f27a015ee60 0x7f27a00b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.216+0000 7f2795400640 1 -- 172.21.15.59:0/2759544643 >> v2:172.21.15.178:3300/0 conn(0x7f27a015ee60 msgr2=0x7f27a00b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.216+0000 7f2795400640 1 --2- 172.21.15.59:0/2759544643 >> v2:172.21.15.178:3300/0 conn(0x7f27a015ee60 0x7f27a00b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.216+0000 7f2795400640 1 -- 172.21.15.59:0/2759544643 >> v1:172.21.15.178:6789/0 conn(0x7f27a0144120 legacy=0x7f27a00ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.216+0000 7f2795400640 1 -- 172.21.15.59:0/2759544643 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a015b3a0 con 0x7f27a015acd0 2024-04-25T09:01:41.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.216+0000 7f2795400640 1 --2- 172.21.15.59:0/2759544643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015acd0 0x7f27a015e920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f27a006bb20 tx=0x7f278801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04237c0f5aef4d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.216+0000 7f279d400640 1 -- 172.21.15.59:0/2759544643 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27880b1070 con 0x7f27a015acd0 2024-04-25T09:01:41.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.216+0000 7f279d400640 1 -- 172.21.15.59:0/2759544643 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27880ac600 con 0x7f27a015acd0 2024-04-25T09:01:41.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.216+0000 7f279d400640 1 -- 172.21.15.59:0/2759544643 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27880ac9d0 con 0x7f27a015acd0 2024-04-25T09:01:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 -- 172.21.15.59:0/2759544643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015acd0 msgr2=0x7f27a015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 --2- 172.21.15.59:0/2759544643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015acd0 0x7f27a015e920 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f27a006bb20 tx=0x7f278801c490 comp rx=0 tx=0).stop 2024-04-25T09:01:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 -- 172.21.15.59:0/2759544643 shutdown_connections 2024-04-25T09:01:41.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 --2- 172.21.15.59:0/2759544643 >> v2:172.21.15.178:3300/0 conn(0x7f27a015ee60 0x7f27a00b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 --2- 172.21.15.59:0/2759544643 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015acd0 0x7f27a015e920 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 -- 172.21.15.59:0/2759544643 >> 172.21.15.59:0/2759544643 conn(0x7f27a0067080 msgr2=0x7f27a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:41.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 -- 172.21.15.59:0/2759544643 shutdown_connections 2024-04-25T09:01:41.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 -- 172.21.15.59:0/2759544643 wait complete. 2024-04-25T09:01:41.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 Processor -- start 2024-04-25T09:01:41.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 -- start start 2024-04-25T09:01:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a0144120 0x7f27a00b0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27a015acd0 0x7f27a0142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015ee60 0x7f27a013c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a01677d0 con 0x7f27a015ee60 2024-04-25T09:01:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0167650 con 0x7f27a0144120 2024-04-25T09:01:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f27a5200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a0167950 con 0x7f27a015acd0 2024-04-25T09:01:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f279e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015ee60 0x7f27a013c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f279e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015ee60 0x7f27a013c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46392/0 (socket says 172.21.15.59:46392) 2024-04-25T09:01:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f279e800640 1 -- 172.21.15.59:0/3284661554 learned_addr learned my addr 172.21.15.59:0/3284661554 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f279de00640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a0144120 0x7f27a00b0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f2795400640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27a015acd0 0x7f27a0142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f279e800640 1 -- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27a015acd0 msgr2=0x7f27a0142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.220+0000 7f279e800640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27a015acd0 0x7f27a0142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f279e800640 1 -- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a0144120 msgr2=0x7f27a00b0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f279e800640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a0144120 0x7f27a00b0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f279e800640 1 -- 172.21.15.59:0/3284661554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a015c020 con 0x7f27a015ee60 2024-04-25T09:01:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f279de00640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a0144120 0x7f27a00b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:41.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f279e800640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015ee60 0x7f27a013c210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f279800efc0 tx=0x7f279800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f2796a00640 1 -- 172.21.15.59:0/3284661554 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2798018020 con 0x7f27a015ee60 2024-04-25T09:01:41.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f2796a00640 1 -- 172.21.15.59:0/3284661554 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2798014480 con 0x7f27a015ee60 2024-04-25T09:01:41.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f2796a00640 1 -- 172.21.15.59:0/3284661554 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2798014870 con 0x7f27a015ee60 2024-04-25T09:01:41.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f27a5200640 1 -- 172.21.15.59:0/3284661554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27a015c300 con 0x7f27a015ee60 2024-04-25T09:01:41.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f27a5200640 1 -- 172.21.15.59:0/3284661554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a00ada50 con 0x7f27a015ee60 2024-04-25T09:01:41.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f27a5200640 1 -- 172.21.15.59:0/3284661554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a00745d0 con 0x7f27a015ee60 2024-04-25T09:01:41.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f2796a00640 1 -- 172.21.15.59:0/3284661554 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f279801b020 con 0x7f27a015ee60 2024-04-25T09:01:41.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f2796a00640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f277c066f60 0x7f277c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f2796a00640 1 -- 172.21.15.59:0/3284661554 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2798085e50 con 0x7f27a015ee60 2024-04-25T09:01:41.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.224+0000 7f279de00640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f277c066f60 0x7f277c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.228+0000 7f279de00640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f277c066f60 0x7f277c069420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2790001710 tx=0x7f2790009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.228+0000 7f2796a00640 1 -- 172.21.15.59:0/3284661554 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2798022030 con 0x7f27a015ee60 2024-04-25T09:01:41.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 -- 172.21.15.59:0/3284661554 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27a00ae980 con 0x7f27a015ee60 2024-04-25T09:01:41.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f2796a00640 1 -- 172.21.15.59:0/3284661554 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2798010040 con 0x7f27a015ee60 2024-04-25T09:01:41.386 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:01:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 -- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f277c066f60 msgr2=0x7f277c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f277c066f60 0x7f277c069420 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2790001710 tx=0x7f2790009040 comp rx=0 tx=0).stop 2024-04-25T09:01:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 -- 172.21.15.59:0/3284661554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015ee60 msgr2=0x7f27a013c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015ee60 0x7f27a013c210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f279800efc0 tx=0x7f279800c490 comp rx=0 tx=0).stop 2024-04-25T09:01:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 -- 172.21.15.59:0/3284661554 shutdown_connections 2024-04-25T09:01:41.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f277c066f60 0x7f277c069420 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27a015ee60 0x7f27a013c210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f27a015acd0 0x7f27a0142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 --2- 172.21.15.59:0/3284661554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27a0144120 0x7f27a00b0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 -- 172.21.15.59:0/3284661554 >> 172.21.15.59:0/3284661554 conn(0x7f27a0067080 msgr2=0x7f27a00b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:41.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 -- 172.21.15.59:0/3284661554 shutdown_connections 2024-04-25T09:01:41.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.396+0000 7f27a5200640 1 -- 172.21.15.59:0/3284661554 wait complete. 2024-04-25T09:01:41.407 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:01:41.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a9400640 1 Processor -- start 2024-04-25T09:01:41.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a9400640 1 -- start start 2024-04-25T09:01:41.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a9400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23a4144120 0x7f23a415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f23a40b3090 0x7f23a40b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a9400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a415bc40 con 0x7f23a40ccbf0 2024-04-25T09:01:41.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a9400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a415e490 con 0x7f23a40b3090 2024-04-25T09:01:41.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a9400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a415b3a0 con 0x7f23a4144120 2024-04-25T09:01:41.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f2399e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f23a40ccbf0 0x7f23a415e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41752/0 (socket says 172.21.15.59:41752) 2024-04-25T09:01:41.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f2399e00640 1 -- 172.21.15.59:0/744287781 learned_addr learned my addr 172.21.15.59:0/744287781 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:41.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a3200640 1 --2- 172.21.15.59:0/744287781 >> v2:172.21.15.59:3300/0 conn(0x7f23a40b3090 0x7f23a40b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a2800640 1 --2- 172.21.15.59:0/744287781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23a4144120 0x7f23a415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a1e00640 1 -- 172.21.15.59:0/744287781 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930311091 0 0) 0x7f23a415bc40 con 0x7f23a40ccbf0 2024-04-25T09:01:41.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a3200640 1 -- 172.21.15.59:0/744287781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23a4144120 msgr2=0x7f23a415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a3200640 1 --2- 172.21.15.59:0/744287781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23a4144120 0x7f23a415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a3200640 1 -- 172.21.15.59:0/744287781 >> v1:172.21.15.59:6789/0 conn(0x7f23a40ccbf0 legacy=0x7f23a415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.560+0000 7f23a3200640 1 -- 172.21.15.59:0/744287781 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a415b680 con 0x7f23a40b3090 2024-04-25T09:01:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.564+0000 7f23a3200640 1 --2- 172.21.15.59:0/744287781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23a40b3090 0x7f23a40b34f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f239c009d90 tx=0x7f239c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c47e49776ed4f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.564+0000 7f23a1e00640 1 -- 172.21.15.59:0/744287781 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c0b2070 con 0x7f23a40b3090 2024-04-25T09:01:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.564+0000 7f23a1e00640 1 -- 172.21.15.59:0/744287781 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c0a57f0 con 0x7f23a40b3090 2024-04-25T09:01:41.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.564+0000 7f23a1e00640 1 -- 172.21.15.59:0/744287781 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c0a5bc0 con 0x7f23a40b3090 2024-04-25T09:01:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.564+0000 7f23a9400640 1 -- 172.21.15.59:0/744287781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23a40b3090 msgr2=0x7f23a40b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.564+0000 7f23a9400640 1 --2- 172.21.15.59:0/744287781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23a40b3090 0x7f23a40b34f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f239c009d90 tx=0x7f239c01c8e0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.564+0000 7f23a9400640 1 -- 172.21.15.59:0/744287781 shutdown_connections 2024-04-25T09:01:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.564+0000 7f23a9400640 1 --2- 172.21.15.59:0/744287781 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23a40b3090 0x7f23a40b34f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.564+0000 7f23a9400640 1 --2- 172.21.15.59:0/744287781 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23a4144120 0x7f23a415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.564+0000 7f23a9400640 1 -- 172.21.15.59:0/744287781 >> 172.21.15.59:0/744287781 conn(0x7f23a4067080 msgr2=0x7f23a406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.564+0000 7f23a9400640 1 -- 172.21.15.59:0/744287781 shutdown_connections 2024-04-25T09:01:41.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.564+0000 7f23a9400640 1 -- 172.21.15.59:0/744287781 wait complete. 2024-04-25T09:01:41.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a9400640 1 Processor -- start 2024-04-25T09:01:41.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a9400640 1 -- start start 2024-04-25T09:01:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23a40b3090 0x7f23a40add40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a9400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23a40ccbf0 0x7f23a4140190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a9400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23a4144120 0x7f23a41406d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a9400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a41675c0 con 0x7f23a40b3090 2024-04-25T09:01:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a9400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4167440 con 0x7f23a40ccbf0 2024-04-25T09:01:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a9400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a4167740 con 0x7f23a4144120 2024-04-25T09:01:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23a40b3090 0x7f23a40add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23a40b3090 0x7f23a40add40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46410/0 (socket says 172.21.15.59:46410) 2024-04-25T09:01:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a2800640 1 -- 172.21.15.59:0/3844650109 learned_addr learned my addr 172.21.15.59:0/3844650109 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a3200640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23a4144120 0x7f23a41406d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f2399e00640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23a40ccbf0 0x7f23a4140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a2800640 1 -- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23a4144120 msgr2=0x7f23a41406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a2800640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23a4144120 0x7f23a41406d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a2800640 1 -- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23a40ccbf0 msgr2=0x7f23a4140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a2800640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23a40ccbf0 0x7f23a4140190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a2800640 1 -- 172.21.15.59:0/3844650109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a40acca0 con 0x7f23a40b3090 2024-04-25T09:01:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a2800640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23a40b3090 0x7f23a40add40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f239400e870 tx=0x7f239400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f239b400640 1 -- 172.21.15.59:0/3844650109 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2394017070 con 0x7f23a40b3090 2024-04-25T09:01:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f239b400640 1 -- 172.21.15.59:0/3844650109 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239400c940 con 0x7f23a40b3090 2024-04-25T09:01:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f239b400640 1 -- 172.21.15.59:0/3844650109 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239400ccf0 con 0x7f23a40b3090 2024-04-25T09:01:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a9400640 1 -- 172.21.15.59:0/3844650109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a40acf80 con 0x7f23a40b3090 2024-04-25T09:01:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a9400640 1 -- 172.21.15.59:0/3844650109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a40ad540 con 0x7f23a40b3090 2024-04-25T09:01:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.568+0000 7f23a9400640 1 -- 172.21.15.59:0/3844650109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a40745d0 con 0x7f23a40b3090 2024-04-25T09:01:41.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.572+0000 7f239b400640 1 -- 172.21.15.59:0/3844650109 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f239401a070 con 0x7f23a40b3090 2024-04-25T09:01:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.572+0000 7f239b400640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2380066f60 0x7f2380069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.572+0000 7f239b400640 1 -- 172.21.15.59:0/3844650109 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f23940855f0 con 0x7f23a40b3090 2024-04-25T09:01:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.572+0000 7f2399e00640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2380066f60 0x7f2380069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.572+0000 7f2399e00640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2380066f60 0x7f2380069420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23a41652e0 tx=0x7f238c007d60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.576+0000 7f239b400640 1 -- 172.21.15.59:0/3844650109 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2394055bd0 con 0x7f23a40b3090 2024-04-25T09:01:41.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.740+0000 7f23a9400640 1 -- 172.21.15.59:0/3844650109 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23a415ed30 con 0x7f23a40b3090 2024-04-25T09:01:41.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.740+0000 7f239b400640 1 -- 172.21.15.59:0/3844650109 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2394059c70 con 0x7f23a40b3090 2024-04-25T09:01:41.732 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:01:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.744+0000 7f23a9400640 1 -- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2380066f60 msgr2=0x7f2380069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.744+0000 7f23a9400640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2380066f60 0x7f2380069420 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23a41652e0 tx=0x7f238c007d60 comp rx=0 tx=0).stop 2024-04-25T09:01:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.744+0000 7f23a9400640 1 -- 172.21.15.59:0/3844650109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23a40b3090 msgr2=0x7f23a40add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.744+0000 7f23a9400640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23a40b3090 0x7f23a40add40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f239400e870 tx=0x7f239400ec70 comp rx=0 tx=0).stop 2024-04-25T09:01:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.744+0000 7f23a9400640 1 -- 172.21.15.59:0/3844650109 shutdown_connections 2024-04-25T09:01:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.744+0000 7f23a9400640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2380066f60 0x7f2380069420 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.744+0000 7f23a9400640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23a4144120 0x7f23a41406d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.744+0000 7f23a9400640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23a40ccbf0 0x7f23a4140190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.744+0000 7f23a9400640 1 --2- 172.21.15.59:0/3844650109 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23a40b3090 0x7f23a40add40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.744+0000 7f23a9400640 1 -- 172.21.15.59:0/3844650109 >> 172.21.15.59:0/3844650109 conn(0x7f23a4067080 msgr2=0x7f23a40b39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.744+0000 7f23a9400640 1 -- 172.21.15.59:0/3844650109 shutdown_connections 2024-04-25T09:01:41.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.744+0000 7f23a9400640 1 -- 172.21.15.59:0/3844650109 wait complete. 2024-04-25T09:01:41.754 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:01:41.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd358000640 1 Processor -- start 2024-04-25T09:01:41.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd358000640 1 -- start start 2024-04-25T09:01:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd358000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd350159320 0x7fd35015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd358000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd35015f440 0x7fd35006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd358000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd35006e010 0x7fd35006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd358000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35006d640 con 0x7fd35006e010 2024-04-25T09:01:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd358000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35015fc00 con 0x7fd35015f440 2024-04-25T09:01:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd358000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35015fee0 con 0x7fd350159320 2024-04-25T09:01:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd356000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd35006e010 0x7fd35006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd356000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd35006e010 0x7fd35006e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46420/0 (socket says 172.21.15.59:46420) 2024-04-25T09:01:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd356000640 1 -- 172.21.15.59:0/1807027770 learned_addr learned my addr 172.21.15.59:0/1807027770 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd355600640 1 --2- 172.21.15.59:0/1807027770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd350159320 0x7fd35015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd354c00640 1 --2- 172.21.15.59:0/1807027770 >> v2:172.21.15.178:3300/0 conn(0x7fd35015f440 0x7fd35006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd356000640 1 -- 172.21.15.59:0/1807027770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd350159320 msgr2=0x7fd35015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd356000640 1 --2- 172.21.15.59:0/1807027770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd350159320 0x7fd35015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd356000640 1 -- 172.21.15.59:0/1807027770 >> v2:172.21.15.178:3300/0 conn(0x7fd35015f440 msgr2=0x7fd35006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd356000640 1 --2- 172.21.15.59:0/1807027770 >> v2:172.21.15.178:3300/0 conn(0x7fd35015f440 0x7fd35006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd356000640 1 -- 172.21.15.59:0/1807027770 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3501601c0 con 0x7fd35006e010 2024-04-25T09:01:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.908+0000 7fd354c00640 1 --2- 172.21.15.59:0/1807027770 >> v2:172.21.15.178:3300/0 conn(0x7fd35015f440 0x7fd35006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:41.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd356000640 1 --2- 172.21.15.59:0/1807027770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35006e010 0x7fd35006e4a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd3500b4b00 tx=0x7fd34801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ff09fafbd82519 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd34fe00640 1 -- 172.21.15.59:0/1807027770 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480a56c0 con 0x7fd35006e010 2024-04-25T09:01:41.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd34fe00640 1 -- 172.21.15.59:0/1807027770 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3480a5860 con 0x7fd35006e010 2024-04-25T09:01:41.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd34fe00640 1 -- 172.21.15.59:0/1807027770 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3480a5c30 con 0x7fd35006e010 2024-04-25T09:01:41.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd358000640 1 -- 172.21.15.59:0/1807027770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35006e010 msgr2=0x7fd35006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd358000640 1 --2- 172.21.15.59:0/1807027770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35006e010 0x7fd35006e4a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd3500b4b00 tx=0x7fd34801c930 comp rx=0 tx=0).stop 2024-04-25T09:01:41.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd358000640 1 -- 172.21.15.59:0/1807027770 shutdown_connections 2024-04-25T09:01:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd358000640 1 --2- 172.21.15.59:0/1807027770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35006e010 0x7fd35006e4a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd358000640 1 --2- 172.21.15.59:0/1807027770 >> v2:172.21.15.178:3300/0 conn(0x7fd35015f440 0x7fd35006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd358000640 1 --2- 172.21.15.59:0/1807027770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd350159320 0x7fd35015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd358000640 1 -- 172.21.15.59:0/1807027770 >> 172.21.15.59:0/1807027770 conn(0x7fd350067080 msgr2=0x7fd35006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd358000640 1 -- 172.21.15.59:0/1807027770 shutdown_connections 2024-04-25T09:01:41.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd358000640 1 -- 172.21.15.59:0/1807027770 wait complete. 2024-04-25T09:01:41.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd358000640 1 Processor -- start 2024-04-25T09:01:41.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.912+0000 7fd358000640 1 -- start start 2024-04-25T09:01:41.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd358000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35006e010 0x7fd35015b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd358000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd350159320 0x7fd3501442c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd358000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd35015f440 0x7fd3501fa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd358000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500cc440 con 0x7fd35006e010 2024-04-25T09:01:41.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd358000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500cc2c0 con 0x7fd350159320 2024-04-25T09:01:41.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd358000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3500cc5c0 con 0x7fd35015f440 2024-04-25T09:01:41.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd355600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35006e010 0x7fd35015b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd355600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35006e010 0x7fd35015b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46432/0 (socket says 172.21.15.59:46432) 2024-04-25T09:01:41.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd355600640 1 -- 172.21.15.59:0/3410624488 learned_addr learned my addr 172.21.15.59:0/3410624488 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:41.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd356000640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd35015f440 0x7fd3501fa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd354c00640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd350159320 0x7fd3501442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd355600640 1 -- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd35015f440 msgr2=0x7fd3501fa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd355600640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd35015f440 0x7fd3501fa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd355600640 1 -- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd350159320 msgr2=0x7fd3501442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:41.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd355600640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd350159320 0x7fd3501442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:41.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd355600640 1 -- 172.21.15.59:0/3410624488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3501420f0 con 0x7fd35006e010 2024-04-25T09:01:41.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd355600640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35006e010 0x7fd35015b6b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd34400e8e0 tx=0x7fd34400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd34d600640 1 -- 172.21.15.59:0/3410624488 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344017070 con 0x7fd35006e010 2024-04-25T09:01:41.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd34d600640 1 -- 172.21.15.59:0/3410624488 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34400ca00 con 0x7fd35006e010 2024-04-25T09:01:41.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd34d600640 1 -- 172.21.15.59:0/3410624488 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34400cdd0 con 0x7fd35006e010 2024-04-25T09:01:41.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd358000640 1 -- 172.21.15.59:0/3410624488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3501faef0 con 0x7fd35006e010 2024-04-25T09:01:41.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd358000640 1 -- 172.21.15.59:0/3410624488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd350142390 con 0x7fd35006e010 2024-04-25T09:01:41.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.916+0000 7fd358000640 1 -- 172.21.15.59:0/3410624488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3500745d0 con 0x7fd35006e010 2024-04-25T09:01:41.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.920+0000 7fd34d600640 1 -- 172.21.15.59:0/3410624488 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd34401a070 con 0x7fd35006e010 2024-04-25T09:01:41.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.920+0000 7fd34d600640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd330066f60 0x7fd330069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:41.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.920+0000 7fd34d600640 1 -- 172.21.15.59:0/3410624488 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd3440853b0 con 0x7fd35006e010 2024-04-25T09:01:41.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.920+0000 7fd354c00640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd330066f60 0x7fd330069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:41.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.920+0000 7fd354c00640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd330066f60 0x7fd330069420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd35013e620 tx=0x7fd33c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:41.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:41.924+0000 7fd34d600640 1 -- 172.21.15.59:0/3410624488 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd3440559a0 con 0x7fd35006e010 2024-04-25T09:01:42.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 -- 172.21.15.59:0/3410624488 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd35006dda0 con 0x7fd35006e010 2024-04-25T09:01:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd34d600640 1 -- 172.21.15.59:0/3410624488 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd344059a40 con 0x7fd35006e010 2024-04-25T09:01:42.075 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:01:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 -- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd330066f60 msgr2=0x7fd330069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd330066f60 0x7fd330069420 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd35013e620 tx=0x7fd33c008040 comp rx=0 tx=0).stop 2024-04-25T09:01:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 -- 172.21.15.59:0/3410624488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35006e010 msgr2=0x7fd35015b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35006e010 0x7fd35015b6b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd34400e8e0 tx=0x7fd34400eda0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 -- 172.21.15.59:0/3410624488 shutdown_connections 2024-04-25T09:01:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd330066f60 0x7fd330069420 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd35015f440 0x7fd3501fa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd350159320 0x7fd3501442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 --2- 172.21.15.59:0/3410624488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd35006e010 0x7fd35015b6b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 -- 172.21.15.59:0/3410624488 >> 172.21.15.59:0/3410624488 conn(0x7fd350067080 msgr2=0x7fd35006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 -- 172.21.15.59:0/3410624488 shutdown_connections 2024-04-25T09:01:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.084+0000 7fd358000640 1 -- 172.21.15.59:0/3410624488 wait complete. 2024-04-25T09:01:42.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:01:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb43de00640 1 Processor -- start 2024-04-25T09:01:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb43de00640 1 -- start start 2024-04-25T09:01:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb43de00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb438144120 0x7fb43815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb43de00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb4380b3090 0x7fb4380b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb43de00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43815bc40 con 0x7fb4380ccbf0 2024-04-25T09:01:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb43de00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43815e490 con 0x7fb4380b3090 2024-04-25T09:01:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb43de00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43815b3a0 con 0x7fb438144120 2024-04-25T09:01:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb42fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb4380ccbf0 0x7fb43815e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41760/0 (socket says 172.21.15.59:41760) 2024-04-25T09:01:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb42fe00640 1 -- 172.21.15.59:0/1988064560 learned_addr learned my addr 172.21.15.59:0/1988064560 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb437400640 1 --2- 172.21.15.59:0/1988064560 >> v2:172.21.15.178:3300/0 conn(0x7fb4380b3090 0x7fb4380b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436a00640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb438144120 0x7fb43815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236654796 0 0) 0x7fb43815bc40 con 0x7fb4380ccbf0 2024-04-25T09:01:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb41c003530 con 0x7fb4380ccbf0 2024-04-25T09:01:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2308471408 0 0) 0x7fb41c003530 con 0x7fb4380ccbf0 2024-04-25T09:01:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb438144120 msgr2=0x7fb43815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb438144120 0x7fb43815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 >> v2:172.21.15.178:3300/0 conn(0x7fb4380b3090 msgr2=0x7fb4380b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 --2- 172.21.15.59:0/1988064560 >> v2:172.21.15.178:3300/0 conn(0x7fb4380b3090 0x7fb4380b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43815b680 con 0x7fb4380ccbf0 2024-04-25T09:01:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fb420001680 con 0x7fb4380ccbf0 2024-04-25T09:01:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 >> v1:172.21.15.59:6789/0 conn(0x7fb4380ccbf0 legacy=0x7fb43815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb41c0039c0 0x7fb41c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41c004810 0x7fb41c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb438144120 0x7fb41c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43815e490 con 0x7fb41c004810 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43815b3a0 con 0x7fb41c0039c0 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c00b9d0 con 0x7fb438144120 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb42fe00640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41c004810 0x7fb41c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb437400640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb438144120 0x7fb41c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436a00640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb41c0039c0 0x7fb41c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb42fe00640 1 -- 172.21.15.59:0/1988064560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb438144120 msgr2=0x7fb41c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb42fe00640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb438144120 0x7fb41c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb42fe00640 1 -- 172.21.15.59:0/1988064560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb41c0039c0 msgr2=0x7fb41c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb42fe00640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb41c0039c0 0x7fb41c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb42fe00640 1 -- 172.21.15.59:0/1988064560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c003530 con 0x7fb41c004810 2024-04-25T09:01:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.248+0000 7fb436a00640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb41c0039c0 0x7fb41c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.252+0000 7fb42fe00640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41c004810 0x7fb41c004c90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb42000c270 tx=0x7fb42001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e9102c02a5dbee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.252+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420007d40 con 0x7fb41c004810 2024-04-25T09:01:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.252+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4200a9020 con 0x7fb41c004810 2024-04-25T09:01:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.252+0000 7fb436000640 1 -- 172.21.15.59:0/1988064560 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb420005ae0 con 0x7fb41c004810 2024-04-25T09:01:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.252+0000 7fb43de00640 1 -- 172.21.15.59:0/1988064560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41c004810 msgr2=0x7fb41c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.252+0000 7fb43de00640 1 --2- 172.21.15.59:0/1988064560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb41c004810 0x7fb41c004c90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb42000c270 tx=0x7fb42001cca0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.252+0000 7fb437400640 1 -- 172.21.15.59:0/1988064560 reap_dead start 2024-04-25T09:01:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.252+0000 7fb43de00640 1 -- 172.21.15.59:0/1988064560 shutdown_connections 2024-04-25T09:01:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.252+0000 7fb43de00640 1 -- 172.21.15.59:0/1988064560 >> 172.21.15.59:0/1988064560 conn(0x7fb438067080 msgr2=0x7fb43806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.252+0000 7fb43de00640 1 -- 172.21.15.59:0/1988064560 shutdown_connections 2024-04-25T09:01:42.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.252+0000 7fb43de00640 1 -- 172.21.15.59:0/1988064560 wait complete. 2024-04-25T09:01:42.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb43de00640 1 Processor -- start 2024-04-25T09:01:42.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb43de00640 1 -- start start 2024-04-25T09:01:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb43de00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb41c004810 0x7fb43813d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb43de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb438137da0 0x7fb4381383f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb43de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb438138930 0x7fb4381f0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb43de00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43815f1b0 con 0x7fb438138930 2024-04-25T09:01:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb43de00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43815f030 con 0x7fb438137da0 2024-04-25T09:01:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb43de00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43806d2d0 con 0x7fb41c004810 2024-04-25T09:01:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb437400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb438138930 0x7fb4381f0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb437400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb438138930 0x7fb4381f0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46452/0 (socket says 172.21.15.59:46452) 2024-04-25T09:01:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb437400640 1 -- 172.21.15.59:0/2440638794 learned_addr learned my addr 172.21.15.59:0/2440638794 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb42fe00640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb438137da0 0x7fb4381383f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb436a00640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb41c004810 0x7fb43813d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb437400640 1 -- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb41c004810 msgr2=0x7fb43813d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb437400640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb41c004810 0x7fb43813d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb437400640 1 -- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb438137da0 msgr2=0x7fb4381383f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb437400640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb438137da0 0x7fb4381383f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb437400640 1 -- 172.21.15.59:0/2440638794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb438136d20 con 0x7fb438138930 2024-04-25T09:01:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb437400640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb438138930 0x7fb4381f0510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb43806b930 tx=0x7fb43000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb42f400640 1 -- 172.21.15.59:0/2440638794 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430011e90 con 0x7fb438138930 2024-04-25T09:01:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb42f400640 1 -- 172.21.15.59:0/2440638794 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43001d070 con 0x7fb438138930 2024-04-25T09:01:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb42f400640 1 -- 172.21.15.59:0/2440638794 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb430015650 con 0x7fb438138930 2024-04-25T09:01:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb43de00640 1 -- 172.21.15.59:0/2440638794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb438137000 con 0x7fb438138930 2024-04-25T09:01:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.256+0000 7fb43de00640 1 -- 172.21.15.59:0/2440638794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4381378a0 con 0x7fb438138930 2024-04-25T09:01:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.260+0000 7fb43de00640 1 -- 172.21.15.59:0/2440638794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4381371d0 con 0x7fb438138930 2024-04-25T09:01:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.260+0000 7fb42f400640 1 -- 172.21.15.59:0/2440638794 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb4300157f0 con 0x7fb438138930 2024-04-25T09:01:42.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.260+0000 7fb42f400640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb414067040 0x7fb414069500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.260+0000 7fb42f400640 1 -- 172.21.15.59:0/2440638794 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb430085db0 con 0x7fb438138930 2024-04-25T09:01:42.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.260+0000 7fb436a00640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb414067040 0x7fb414069500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.260+0000 7fb436a00640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb414067040 0x7fb414069500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb438143a20 tx=0x7fb428008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:42.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.264+0000 7fb42f400640 1 -- 172.21.15.59:0/2440638794 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb43008a070 con 0x7fb438138930 2024-04-25T09:01:42.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 -- 172.21.15.59:0/2440638794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb4380745d0 con 0x7fb438138930 2024-04-25T09:01:42.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb42f400640 1 -- 172.21.15.59:0/2440638794 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb430010040 con 0x7fb438138930 2024-04-25T09:01:42.431 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:01:42.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 -- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb414067040 msgr2=0x7fb414069500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb414067040 0x7fb414069500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb438143a20 tx=0x7fb428008040 comp rx=0 tx=0).stop 2024-04-25T09:01:42.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 -- 172.21.15.59:0/2440638794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb438138930 msgr2=0x7fb4381f0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb438138930 0x7fb4381f0510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb43806b930 tx=0x7fb43000f580 comp rx=0 tx=0).stop 2024-04-25T09:01:42.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 -- 172.21.15.59:0/2440638794 shutdown_connections 2024-04-25T09:01:42.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb414067040 0x7fb414069500 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb438138930 0x7fb4381f0510 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb438137da0 0x7fb4381383f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 --2- 172.21.15.59:0/2440638794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb41c004810 0x7fb43813d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 -- 172.21.15.59:0/2440638794 >> 172.21.15.59:0/2440638794 conn(0x7fb438067080 msgr2=0x7fb43813ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 -- 172.21.15.59:0/2440638794 shutdown_connections 2024-04-25T09:01:42.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.440+0000 7fb43de00640 1 -- 172.21.15.59:0/2440638794 wait complete. 2024-04-25T09:01:42.452 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:01:42.452 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:01:42.461 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.652+0000 7f1a0ee00640 1 Processor -- start 2024-04-25T09:01:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.652+0000 7f1a0ee00640 1 -- start start 2024-04-25T09:01:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a0ee00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a08099a60 0x7f1a0815bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a0ee00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a0815c310 con 0x7f1a0809a600 2024-04-25T09:01:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a0ee00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a080cf800 con 0x7f1a080cf370 2024-04-25T09:01:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a0ee00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a080d0410 con 0x7f1a08099a60 2024-04-25T09:01:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a0ce00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1a0809a600 0x7f1a080cc2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41774/0 (socket says 172.21.15.59:41774) 2024-04-25T09:01:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a0ce00640 1 -- 172.21.15.59:0/1071825687 learned_addr learned my addr 172.21.15.59:0/1071825687 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:42.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a07e00640 1 --2- 172.21.15.59:0/1071825687 >> v2:172.21.15.178:3300/0 conn(0x7f1a08099a60 0x7f1a0815bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a07400640 1 -- 172.21.15.59:0/1071825687 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967948270 0 0) 0x7f1a000014a0 con 0x7f1a0809a600 2024-04-25T09:01:42.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a07400640 1 -- 172.21.15.59:0/1071825687 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19ec003530 con 0x7f1a0809a600 2024-04-25T09:01:42.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a07e00640 1 -- 172.21.15.59:0/1071825687 >> v1:172.21.15.178:6789/0 conn(0x7f1a080cf370 legacy=0x7f1a08099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a07400640 1 -- 172.21.15.59:0/1071825687 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617852878 0 0) 0x7f1a080cf800 con 0x7f1a080cf370 2024-04-25T09:01:42.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a07e00640 1 -- 172.21.15.59:0/1071825687 >> v1:172.21.15.59:6789/0 conn(0x7f1a0809a600 legacy=0x7f1a080cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.656+0000 7f1a07e00640 1 -- 172.21.15.59:0/1071825687 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a080cfae0 con 0x7f1a08099a60 2024-04-25T09:01:42.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a07e00640 1 --2- 172.21.15.59:0/1071825687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a08099a60 0x7f1a0815bdd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19f80097c0 tx=0x7f19f801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6c6c7946d9966b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:42.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a07400640 1 -- 172.21.15.59:0/1071825687 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80b1070 con 0x7f1a08099a60 2024-04-25T09:01:42.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a07400640 1 -- 172.21.15.59:0/1071825687 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f80a8050 con 0x7f1a08099a60 2024-04-25T09:01:42.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a07400640 1 -- 172.21.15.59:0/1071825687 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80ac860 con 0x7f1a08099a60 2024-04-25T09:01:42.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a0ee00640 1 -- 172.21.15.59:0/1071825687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a08099a60 msgr2=0x7f1a0815bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a0ee00640 1 --2- 172.21.15.59:0/1071825687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a08099a60 0x7f1a0815bdd0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19f80097c0 tx=0x7f19f801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a0ee00640 1 -- 172.21.15.59:0/1071825687 shutdown_connections 2024-04-25T09:01:42.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a0ee00640 1 --2- 172.21.15.59:0/1071825687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a08099a60 0x7f1a0815bdd0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a0ee00640 1 -- 172.21.15.59:0/1071825687 >> 172.21.15.59:0/1071825687 conn(0x7f1a080d17a0 msgr2=0x7f1a080d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:42.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a0ee00640 1 -- 172.21.15.59:0/1071825687 shutdown_connections 2024-04-25T09:01:42.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a0ee00640 1 -- 172.21.15.59:0/1071825687 wait complete. 2024-04-25T09:01:42.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a0ee00640 1 Processor -- start 2024-04-25T09:01:42.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.660+0000 7f1a0ee00640 1 -- start start 2024-04-25T09:01:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a0ee00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a08099a60 0x7f1a080c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a0ee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a0809a600 0x7f1a080c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a0ee00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a081560a0 0x7f1a08154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a0ee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080cd560 con 0x7f1a0809a600 2024-04-25T09:01:42.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a0ee00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080cd3e0 con 0x7f1a081560a0 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a0ee00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080cd6e0 con 0x7f1a08099a60 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f19ffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a0809a600 0x7f1a080c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f19ffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a0809a600 0x7f1a080c78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46462/0 (socket says 172.21.15.59:46462) 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f19ffe00640 1 -- 172.21.15.59:0/2257729442 learned_addr learned my addr 172.21.15.59:0/2257729442 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a07e00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a08099a60 0x7f1a080c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a0ce00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a081560a0 0x7f1a08154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f19ffe00640 1 -- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a08099a60 msgr2=0x7f1a080c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f19ffe00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a08099a60 0x7f1a080c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f19ffe00640 1 -- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a081560a0 msgr2=0x7f1a08154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f19ffe00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a081560a0 0x7f1a08154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f19ffe00640 1 -- 172.21.15.59:0/2257729442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a080c9910 con 0x7f1a0809a600 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f19ffe00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a0809a600 0x7f1a080c78c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19f000c440 tx=0x7f19f000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:42.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a04c00640 1 -- 172.21.15.59:0/2257729442 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0005480 con 0x7f1a0809a600 2024-04-25T09:01:42.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a04c00640 1 -- 172.21.15.59:0/2257729442 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f0003600 con 0x7f1a0809a600 2024-04-25T09:01:42.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a04c00640 1 -- 172.21.15.59:0/2257729442 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00039f0 con 0x7f1a0809a600 2024-04-25T09:01:42.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a0ee00640 1 -- 172.21.15.59:0/2257729442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a080c9bf0 con 0x7f1a0809a600 2024-04-25T09:01:42.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a0ee00640 1 -- 172.21.15.59:0/2257729442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a080ca1b0 con 0x7f1a0809a600 2024-04-25T09:01:42.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a0ee00640 1 -- 172.21.15.59:0/2257729442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a080745d0 con 0x7f1a0809a600 2024-04-25T09:01:42.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.664+0000 7f1a04c00640 1 -- 172.21.15.59:0/2257729442 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f19f0003b90 con 0x7f1a0809a600 2024-04-25T09:01:42.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.668+0000 7f1a04c00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f19e4066f60 0x7f19e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.668+0000 7f1a04c00640 1 -- 172.21.15.59:0/2257729442 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f19f0084fe0 con 0x7f1a0809a600 2024-04-25T09:01:42.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.668+0000 7f1a07e00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f19e4066f60 0x7f19e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.668+0000 7f1a07e00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f19e4066f60 0x7f19e4069420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19f80ae000 tx=0x7f19f80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.672+0000 7f1a04c00640 1 -- 172.21.15.59:0/2257729442 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f19f0055600 con 0x7f1a0809a600 2024-04-25T09:01:42.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.832+0000 7f1a0ee00640 1 -- 172.21.15.59:0/2257729442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a080c5080 con 0x7f1a0809a600 2024-04-25T09:01:42.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a04c00640 1 -- 172.21.15.59:0/2257729442 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7f19f00596a0 con 0x7f1a0809a600 2024-04-25T09:01:42.826 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:42.826 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:42.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a0ee00640 1 -- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f19e4066f60 msgr2=0x7f19e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a0ee00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f19e4066f60 0x7f19e4069420 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f19f80ae000 tx=0x7f19f80a7000 comp rx=0 tx=0).stop 2024-04-25T09:01:42.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a0ee00640 1 -- 172.21.15.59:0/2257729442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a0809a600 msgr2=0x7f1a080c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a0ee00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a0809a600 0x7f1a080c78c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f19f000c440 tx=0x7f19f000c900 comp rx=0 tx=0).stop 2024-04-25T09:01:42.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a0ee00640 1 -- 172.21.15.59:0/2257729442 shutdown_connections 2024-04-25T09:01:42.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a0ee00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f19e4066f60 0x7f19e4069420 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a0ee00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a081560a0 0x7f1a08154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a0ee00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a0809a600 0x7f1a080c78c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a0ee00640 1 --2- 172.21.15.59:0/2257729442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a08099a60 0x7f1a080c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a0ee00640 1 -- 172.21.15.59:0/2257729442 >> 172.21.15.59:0/2257729442 conn(0x7f1a080d17a0 msgr2=0x7f1a0806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:42.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a0ee00640 1 -- 172.21.15.59:0/2257729442 shutdown_connections 2024-04-25T09:01:42.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:42.836+0000 7f1a0ee00640 1 -- 172.21.15.59:0/2257729442 wait complete. 2024-04-25T09:01:42.849 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:01:42.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:01:42.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f9483000640 1 Processor -- start 2024-04-25T09:01:42.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f9483000640 1 -- start start 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f9483000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f947c15dc60 0x7f947c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f9483000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f947c06bf30 0x7f947c0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f9483000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f947c15e040 con 0x7f947c099a60 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f9483000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c0cff80 con 0x7f947c15dc60 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f9483000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f947c0d0260 con 0x7f947c06bf30 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f947be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f947c15dc60 0x7f947c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f947be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f947c15dc60 0x7f947c0d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46478/0 (socket says 172.21.15.59:46478) 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f947be00640 1 -- 172.21.15.59:0/4198446226 learned_addr learned my addr 172.21.15.59:0/4198446226 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f9481000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f947c099a60 0x7f947c0cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41776/0 (socket says 172.21.15.59:41776) 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f9473400640 1 --2- 172.21.15.59:0/4198446226 >> v2:172.21.15.178:3300/0 conn(0x7f947c06bf30 0x7f947c0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f947be00640 1 -- 172.21.15.59:0/4198446226 >> v2:172.21.15.178:3300/0 conn(0x7f947c06bf30 msgr2=0x7f947c0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f947be00640 1 --2- 172.21.15.59:0/4198446226 >> v2:172.21.15.178:3300/0 conn(0x7f947c06bf30 0x7f947c0cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f947be00640 1 -- 172.21.15.59:0/4198446226 >> v1:172.21.15.59:6789/0 conn(0x7f947c099a60 legacy=0x7f947c0cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.004+0000 7f947be00640 1 -- 172.21.15.59:0/4198446226 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0d0540 con 0x7f947c15dc60 2024-04-25T09:01:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f947be00640 1 --2- 172.21.15.59:0/4198446226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947c15dc60 0x7f947c0d1020 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f947c0d2810 tx=0x7f946c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69094b251e255bae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f947b400640 1 -- 172.21.15.59:0/4198446226 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0a57f0 con 0x7f947c15dc60 2024-04-25T09:01:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f947b400640 1 -- 172.21.15.59:0/4198446226 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946c0a5990 con 0x7f947c15dc60 2024-04-25T09:01:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f947b400640 1 -- 172.21.15.59:0/4198446226 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946c0a5d60 con 0x7f947c15dc60 2024-04-25T09:01:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f9483000640 1 -- 172.21.15.59:0/4198446226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947c15dc60 msgr2=0x7f947c0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f9483000640 1 --2- 172.21.15.59:0/4198446226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947c15dc60 0x7f947c0d1020 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f947c0d2810 tx=0x7f946c01c930 comp rx=0 tx=0).stop 2024-04-25T09:01:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f9483000640 1 -- 172.21.15.59:0/4198446226 shutdown_connections 2024-04-25T09:01:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f9483000640 1 --2- 172.21.15.59:0/4198446226 >> v2:172.21.15.178:3300/0 conn(0x7f947c06bf30 0x7f947c0cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f9483000640 1 --2- 172.21.15.59:0/4198446226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947c15dc60 0x7f947c0d1020 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f9483000640 1 -- 172.21.15.59:0/4198446226 >> 172.21.15.59:0/4198446226 conn(0x7f947c0b3200 msgr2=0x7f947c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f9483000640 1 -- 172.21.15.59:0/4198446226 shutdown_connections 2024-04-25T09:01:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f9483000640 1 -- 172.21.15.59:0/4198446226 wait complete. 2024-04-25T09:01:43.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f9483000640 1 Processor -- start 2024-04-25T09:01:43.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.008+0000 7f9483000640 1 -- start start 2024-04-25T09:01:43.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9483000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f947c06bf30 0x7f947c14c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9483000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947c099a60 0x7f947c0b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9483000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f947c15dc60 0x7f947c155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9483000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c09a280 con 0x7f947c099a60 2024-04-25T09:01:43.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9483000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0cc880 con 0x7f947c06bf30 2024-04-25T09:01:43.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9483000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947c0b5d70 con 0x7f947c15dc60 2024-04-25T09:01:43.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9473400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947c099a60 0x7f947c0b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9473400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947c099a60 0x7f947c0b67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46490/0 (socket says 172.21.15.59:46490) 2024-04-25T09:01:43.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9473400640 1 -- 172.21.15.59:0/484399592 learned_addr learned my addr 172.21.15.59:0/484399592 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:43.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9481000640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f947c15dc60 0x7f947c155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f947be00640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f947c06bf30 0x7f947c14c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9473400640 1 -- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f947c15dc60 msgr2=0x7f947c155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9473400640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f947c15dc60 0x7f947c155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9473400640 1 -- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f947c06bf30 msgr2=0x7f947c14c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9473400640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f947c06bf30 0x7f947c14c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9473400640 1 -- 172.21.15.59:0/484399592 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c0b5160 con 0x7f947c099a60 2024-04-25T09:01:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9481000640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f947c15dc60 0x7f947c155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9473400640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947c099a60 0x7f947c0b67d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f946400d830 tx=0x7f946400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9478c00640 1 -- 172.21.15.59:0/484399592 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400b6c0 con 0x7f947c099a60 2024-04-25T09:01:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9478c00640 1 -- 172.21.15.59:0/484399592 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9464019070 con 0x7f947c099a60 2024-04-25T09:01:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9483000640 1 -- 172.21.15.59:0/484399592 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947c0b5440 con 0x7f947c099a60 2024-04-25T09:01:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9478c00640 1 -- 172.21.15.59:0/484399592 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f946400ba60 con 0x7f947c099a60 2024-04-25T09:01:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9483000640 1 -- 172.21.15.59:0/484399592 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947c0b5a00 con 0x7f947c099a60 2024-04-25T09:01:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9483000640 1 -- 172.21.15.59:0/484399592 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947c0745d0 con 0x7f947c099a60 2024-04-25T09:01:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.012+0000 7f9478c00640 1 -- 172.21.15.59:0/484399592 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f946401e460 con 0x7f947c099a60 2024-04-25T09:01:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.016+0000 7f9478c00640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9458066f90 0x7f9458069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.016+0000 7f9478c00640 1 -- 172.21.15.59:0/484399592 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f94640859b0 con 0x7f947c099a60 2024-04-25T09:01:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.016+0000 7f947be00640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9458066f90 0x7f9458069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.016+0000 7f947be00640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9458066f90 0x7f9458069450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f946c0ae000 tx=0x7f946c0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.020+0000 7f9478c00640 1 -- 172.21.15.59:0/484399592 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9464056670 con 0x7f947c099a60 2024-04-25T09:01:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.180+0000 7f9483000640 1 -- 172.21.15.59:0/484399592 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f947c0b5f20 con 0x7f947c099a60 2024-04-25T09:01:43.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.180+0000 7f9478c00640 1 -- 172.21.15.59:0/484399592 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9464055f70 con 0x7f947c099a60 2024-04-25T09:01:43.173 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:01:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.184+0000 7f9483000640 1 -- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9458066f90 msgr2=0x7f9458069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.184+0000 7f9483000640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9458066f90 0x7f9458069450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f946c0ae000 tx=0x7f946c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:01:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.184+0000 7f9483000640 1 -- 172.21.15.59:0/484399592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947c099a60 msgr2=0x7f947c0b67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.184+0000 7f9483000640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947c099a60 0x7f947c0b67d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f946400d830 tx=0x7f946400dcf0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.184+0000 7f9483000640 1 -- 172.21.15.59:0/484399592 shutdown_connections 2024-04-25T09:01:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.184+0000 7f9483000640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9458066f90 0x7f9458069450 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.184+0000 7f9483000640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f947c15dc60 0x7f947c155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.184+0000 7f9483000640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f947c099a60 0x7f947c0b67d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.184+0000 7f9483000640 1 --2- 172.21.15.59:0/484399592 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f947c06bf30 0x7f947c14c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.184+0000 7f9483000640 1 -- 172.21.15.59:0/484399592 >> 172.21.15.59:0/484399592 conn(0x7f947c0b3200 msgr2=0x7f947c0b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.184+0000 7f9483000640 1 -- 172.21.15.59:0/484399592 shutdown_connections 2024-04-25T09:01:43.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.184+0000 7f9483000640 1 -- 172.21.15.59:0/484399592 wait complete. 2024-04-25T09:01:43.193 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:01:43.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cd6c00640 1 Processor -- start 2024-04-25T09:01:43.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cd6c00640 1 -- start start 2024-04-25T09:01:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cd6c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5cd00d0aa0 0x7f5cd01617f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cd6c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd0161d30 0x7f5cd00d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cd6c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd00b95d0 con 0x7f5cd015dc60 2024-04-25T09:01:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cd6c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd01626b0 con 0x7f5cd00d0aa0 2024-04-25T09:01:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cd6c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd00d2180 con 0x7f5cd0161d30 2024-04-25T09:01:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccfe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5cd015dc60 0x7f5cd00d0390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41784/0 (socket says 172.21.15.59:41784) 2024-04-25T09:01:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccfe00640 1 -- 172.21.15.59:0/1337580065 learned_addr learned my addr 172.21.15.59:0/1337580065 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cc7e00640 1 --2- 172.21.15.59:0/1337580065 >> v2:172.21.15.178:3300/0 conn(0x7f5cd00d0aa0 0x7f5cd01617f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cd4c00640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd0161d30 0x7f5cd00d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617983382 0 0) 0x7f5cc0001120 con 0x7f5cd015dc60 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cb4003530 con 0x7f5cd015dc60 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 184208178 0 0) 0x7f5cb4003530 con 0x7f5cd015dc60 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd0161d30 msgr2=0x7f5cd00d2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd0161d30 0x7f5cd00d2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 >> v2:172.21.15.178:3300/0 conn(0x7f5cd00d0aa0 msgr2=0x7f5cd01617f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 --2- 172.21.15.59:0/1337580065 >> v2:172.21.15.178:3300/0 conn(0x7f5cd00d0aa0 0x7f5cd01617f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd01623d0 con 0x7f5cd015dc60 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f5cc0001850 con 0x7f5cd015dc60 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 >> v1:172.21.15.59:6789/0 conn(0x7f5cd015dc60 legacy=0x7f5cd00d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cb40039c0 0x7f5cb4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd0161d30 0x7f5cb4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb4004d50 0x7f5cb40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd01626b0 con 0x7f5cb40039c0 2024-04-25T09:01:43.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd00d2180 con 0x7f5cb4004d50 2024-04-25T09:01:43.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb400b9d0 con 0x7f5cd0161d30 2024-04-25T09:01:43.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccfe00640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cb40039c0 0x7f5cb4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cc7e00640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd0161d30 0x7f5cb4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cd4c00640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb4004d50 0x7f5cb40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccfe00640 1 -- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd0161d30 msgr2=0x7f5cb4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:43.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccfe00640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd0161d30 0x7f5cb4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccfe00640 1 -- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb4004d50 msgr2=0x7f5cb40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:43.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccfe00640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb4004d50 0x7f5cb40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5ccfe00640 1 -- 172.21.15.59:0/1337580065 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb4003530 con 0x7f5cb40039c0 2024-04-25T09:01:43.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cc7e00640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd0161d30 0x7f5cb4004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:43.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.348+0000 7f5cd4c00640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb4004d50 0x7f5cb40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:43.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.352+0000 7f5ccfe00640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cb40039c0 0x7f5cb4003de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5cc000c350 tx=0x7f5cc001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3413f457c3ce6228 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:43.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.352+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0007e60 con 0x7f5cb40039c0 2024-04-25T09:01:43.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.352+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc00a9020 con 0x7f5cb40039c0 2024-04-25T09:01:43.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.352+0000 7f5ccf400640 1 -- 172.21.15.59:0/1337580065 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0005ae0 con 0x7f5cb40039c0 2024-04-25T09:01:43.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.352+0000 7f5cd6c00640 1 -- 172.21.15.59:0/1337580065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cb40039c0 msgr2=0x7f5cb4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.352+0000 7f5cd6c00640 1 --2- 172.21.15.59:0/1337580065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cb40039c0 0x7f5cb4003de0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5cc000c350 tx=0x7f5cc001cbe0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.352+0000 7f5cd4c00640 1 -- 172.21.15.59:0/1337580065 reap_dead start 2024-04-25T09:01:43.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.352+0000 7f5cd6c00640 1 -- 172.21.15.59:0/1337580065 shutdown_connections 2024-04-25T09:01:43.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.352+0000 7f5cd6c00640 1 -- 172.21.15.59:0/1337580065 >> 172.21.15.59:0/1337580065 conn(0x7f5cd00b5490 msgr2=0x7f5cd00b58a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:43.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.352+0000 7f5cd6c00640 1 -- 172.21.15.59:0/1337580065 shutdown_connections 2024-04-25T09:01:43.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.352+0000 7f5cd6c00640 1 -- 172.21.15.59:0/1337580065 wait complete. 2024-04-25T09:01:43.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd6c00640 1 Processor -- start 2024-04-25T09:01:43.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd6c00640 1 -- start start 2024-04-25T09:01:43.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd6c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb40039c0 0x7f5cd015f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd6c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd014b940 0x7f5cd0157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd6c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cd0157890 0x7f5cd00ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd6c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd00d2f80 con 0x7f5cd0157890 2024-04-25T09:01:43.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd6c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd00d2e00 con 0x7f5cb40039c0 2024-04-25T09:01:43.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd6c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd00d3100 con 0x7f5cd014b940 2024-04-25T09:01:43.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd4c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cd0157890 0x7f5cd00ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd4c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cd0157890 0x7f5cd00ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46498/0 (socket says 172.21.15.59:46498) 2024-04-25T09:01:43.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd4c00640 1 -- 172.21.15.59:0/901782640 learned_addr learned my addr 172.21.15.59:0/901782640 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:43.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd4c00640 1 -- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd014b940 msgr2=0x7f5cd0157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd4c00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd014b940 0x7f5cd0157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5ccfe00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb40039c0 0x7f5cd015f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd4c00640 1 -- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb40039c0 msgr2=0x7f5cd015f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd4c00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb40039c0 0x7f5cd015f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd4c00640 1 -- 172.21.15.59:0/901782640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd015e4f0 con 0x7f5cd0157890 2024-04-25T09:01:43.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5ccfe00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb40039c0 0x7f5cd015f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:43.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd4c00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cd0157890 0x7f5cd00ccb40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0162110 tx=0x7f5cc8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:43.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cccc00640 1 -- 172.21.15.59:0/901782640 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc801a030 con 0x7f5cd0157890 2024-04-25T09:01:43.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cccc00640 1 -- 172.21.15.59:0/901782640 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc8010d20 con 0x7f5cd0157890 2024-04-25T09:01:43.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd6c00640 1 -- 172.21.15.59:0/901782640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd015e7d0 con 0x7f5cd0157890 2024-04-25T09:01:43.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cccc00640 1 -- 172.21.15.59:0/901782640 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc8003be0 con 0x7f5cd0157890 2024-04-25T09:01:43.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd6c00640 1 -- 172.21.15.59:0/901782640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd015ed90 con 0x7f5cd0157890 2024-04-25T09:01:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.356+0000 7f5cd6c00640 1 -- 172.21.15.59:0/901782640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd00745d0 con 0x7f5cd0157890 2024-04-25T09:01:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.360+0000 7f5cccc00640 1 -- 172.21.15.59:0/901782640 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5cc801d070 con 0x7f5cd0157890 2024-04-25T09:01:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.360+0000 7f5cccc00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5cac066f90 0x7f5cac069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.360+0000 7f5cccc00640 1 -- 172.21.15.59:0/901782640 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5cc8085970 con 0x7f5cd0157890 2024-04-25T09:01:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.360+0000 7f5ccfe00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5cac066f90 0x7f5cac069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.360+0000 7f5ccfe00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5cac066f90 0x7f5cac069450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00aa000 tx=0x7f5cc0001bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:43.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.364+0000 7f5cccc00640 1 -- 172.21.15.59:0/901782640 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5cc8056630 con 0x7f5cd0157890 2024-04-25T09:01:43.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 -- 172.21.15.59:0/901782640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5cd00d15b0 con 0x7f5cd0157890 2024-04-25T09:01:43.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cccc00640 1 -- 172.21.15.59:0/901782640 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5cc8055f30 con 0x7f5cd0157890 2024-04-25T09:01:43.519 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:01:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 -- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5cac066f90 msgr2=0x7f5cac069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5cac066f90 0x7f5cac069450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00aa000 tx=0x7f5cc0001bc0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 -- 172.21.15.59:0/901782640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cd0157890 msgr2=0x7f5cd00ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cd0157890 0x7f5cd00ccb40 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0162110 tx=0x7f5cc8010590 comp rx=0 tx=0).stop 2024-04-25T09:01:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 -- 172.21.15.59:0/901782640 shutdown_connections 2024-04-25T09:01:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5cac066f90 0x7f5cac069450 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cd0157890 0x7f5cd00ccb40 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cd014b940 0x7f5cd0157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 --2- 172.21.15.59:0/901782640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cb40039c0 0x7f5cd015f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 -- 172.21.15.59:0/901782640 >> 172.21.15.59:0/901782640 conn(0x7f5cd00b5490 msgr2=0x7f5cd01595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:43.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 -- 172.21.15.59:0/901782640 shutdown_connections 2024-04-25T09:01:43.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.528+0000 7f5cd6c00640 1 -- 172.21.15.59:0/901782640 wait complete. 2024-04-25T09:01:43.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:01:43.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5770600640 1 Processor -- start 2024-04-25T09:01:43.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5770600640 1 -- start start 2024-04-25T09:01:43.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5770600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f576809a170 0x7f57680d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5770600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576806bf30 0x7f57680cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5770600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f576815e040 con 0x7f576815dc60 2024-04-25T09:01:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5770600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57680cff80 con 0x7f576809a170 2024-04-25T09:01:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5770600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57680d0260 con 0x7f576806bf30 2024-04-25T09:01:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576dc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f576815dc60 0x7f5768099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41798/0 (socket says 172.21.15.59:41798) 2024-04-25T09:01:43.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576dc00640 1 -- 172.21.15.59:0/3280634079 learned_addr learned my addr 172.21.15.59:0/3280634079 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576e600640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576806bf30 0x7f57680cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576d200640 1 --2- 172.21.15.59:0/3280634079 >> v2:172.21.15.178:3300/0 conn(0x7f576809a170 0x7f57680d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260090785 0 0) 0x7f576815e040 con 0x7f576815dc60 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5750003530 con 0x7f576815dc60 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3864355480 0 0) 0x7f5750003530 con 0x7f576815dc60 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576806bf30 msgr2=0x7f57680cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576806bf30 0x7f57680cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 >> v2:172.21.15.178:3300/0 conn(0x7f576809a170 msgr2=0x7f57680d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 --2- 172.21.15.59:0/3280634079 >> v2:172.21.15.178:3300/0 conn(0x7f576809a170 0x7f57680d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57680d0540 con 0x7f576815dc60 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f575c001680 con 0x7f576815dc60 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 >> v1:172.21.15.59:6789/0 conn(0x7f576815dc60 legacy=0x7f5768099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576806bf30 0x7f57500039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5750003f90 0x7f5750004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5750004d50 0x7f57500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57680cff80 con 0x7f5750003f90 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57680d0260 con 0x7f5750004d50 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575000ba80 con 0x7f576806bf30 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576d200640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5750003f90 0x7f5750004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576e600640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5750004d50 0x7f57500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576dc00640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576806bf30 0x7f57500039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576d200640 1 -- 172.21.15.59:0/3280634079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576806bf30 msgr2=0x7f57500039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576d200640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576806bf30 0x7f57500039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576d200640 1 -- 172.21.15.59:0/3280634079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5750004d50 msgr2=0x7f57500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576d200640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5750004d50 0x7f57500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576d200640 1 -- 172.21.15.59:0/3280634079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750003530 con 0x7f5750003f90 2024-04-25T09:01:43.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.696+0000 7f576dc00640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f576806bf30 0x7f57500039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:43.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.700+0000 7f576d200640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5750003f90 0x7f5750004810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5754009ae0 tx=0x7f575401ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb142cc166bfc81d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:43.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.700+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57540b2070 con 0x7f5750003f90 2024-04-25T09:01:43.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.700+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57540a5650 con 0x7f5750003f90 2024-04-25T09:01:43.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.700+0000 7f5767e00640 1 -- 172.21.15.59:0/3280634079 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57540096b0 con 0x7f5750003f90 2024-04-25T09:01:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.700+0000 7f5770600640 1 -- 172.21.15.59:0/3280634079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5750003f90 msgr2=0x7f5750004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.700+0000 7f5770600640 1 --2- 172.21.15.59:0/3280634079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5750003f90 0x7f5750004810 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5754009ae0 tx=0x7f575401ca80 comp rx=0 tx=0).stop 2024-04-25T09:01:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.700+0000 7f576e600640 1 -- 172.21.15.59:0/3280634079 reap_dead start 2024-04-25T09:01:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.700+0000 7f5770600640 1 -- 172.21.15.59:0/3280634079 shutdown_connections 2024-04-25T09:01:43.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.700+0000 7f5770600640 1 -- 172.21.15.59:0/3280634079 >> 172.21.15.59:0/3280634079 conn(0x7f57680b3200 msgr2=0x7f57680b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.700+0000 7f5770600640 1 -- 172.21.15.59:0/3280634079 shutdown_connections 2024-04-25T09:01:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.700+0000 7f5770600640 1 -- 172.21.15.59:0/3280634079 wait complete. 2024-04-25T09:01:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5770600640 1 Processor -- start 2024-04-25T09:01:43.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5770600640 1 -- start start 2024-04-25T09:01:43.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5770600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5750003f90 0x7f57681572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5770600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768155c60 0x7f57681531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5770600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57681409c0 0x7f5768140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5770600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f576806cfa0 con 0x7f5750003f90 2024-04-25T09:01:43.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5770600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57680cc570 con 0x7f5768155c60 2024-04-25T09:01:43.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5770600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5768157800 con 0x7f57681409c0 2024-04-25T09:01:43.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f576dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5750003f90 0x7f57681572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f576dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5750003f90 0x7f57681572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46528/0 (socket says 172.21.15.59:46528) 2024-04-25T09:01:43.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f576dc00640 1 -- 172.21.15.59:0/2099302351 learned_addr learned my addr 172.21.15.59:0/2099302351 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:43.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f576d200640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768155c60 0x7f57681531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f576e600640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57681409c0 0x7f5768140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f576dc00640 1 -- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57681409c0 msgr2=0x7f5768140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f576dc00640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57681409c0 0x7f5768140e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f576dc00640 1 -- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768155c60 msgr2=0x7f57681531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f576dc00640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768155c60 0x7f57681531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f576dc00640 1 -- 172.21.15.59:0/2099302351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5768156220 con 0x7f5750003f90 2024-04-25T09:01:43.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f576dc00640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5750003f90 0x7f57681572c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f575c00e760 tx=0x7f575c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:43.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5765600640 1 -- 172.21.15.59:0/2099302351 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00ee70 con 0x7f5750003f90 2024-04-25T09:01:43.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5765600640 1 -- 172.21.15.59:0/2099302351 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575c018070 con 0x7f5750003f90 2024-04-25T09:01:43.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5770600640 1 -- 172.21.15.59:0/2099302351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5768156500 con 0x7f5750003f90 2024-04-25T09:01:43.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5765600640 1 -- 172.21.15.59:0/2099302351 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575c00cad0 con 0x7f5750003f90 2024-04-25T09:01:43.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.704+0000 7f5770600640 1 -- 172.21.15.59:0/2099302351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5768156ac0 con 0x7f5750003f90 2024-04-25T09:01:43.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.708+0000 7f5770600640 1 -- 172.21.15.59:0/2099302351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57680745d0 con 0x7f5750003f90 2024-04-25T09:01:43.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.708+0000 7f5765600640 1 -- 172.21.15.59:0/2099302351 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f575c00cc70 con 0x7f5750003f90 2024-04-25T09:01:43.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.708+0000 7f5765600640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5748066f60 0x7f5748069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:43.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.708+0000 7f5765600640 1 -- 172.21.15.59:0/2099302351 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f575c0850b0 con 0x7f5750003f90 2024-04-25T09:01:43.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.708+0000 7f576d200640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5748066f60 0x7f5748069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:43.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.708+0000 7f576d200640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5748066f60 0x7f5748069420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57540af000 tx=0x7f57540046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:43.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.712+0000 7f5765600640 1 -- 172.21.15.59:0/2099302351 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f575c055730 con 0x7f5750003f90 2024-04-25T09:01:43.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.876+0000 7f5770600640 1 -- 172.21.15.59:0/2099302351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f57680b7590 con 0x7f5750003f90 2024-04-25T09:01:43.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.876+0000 7f5765600640 1 -- 172.21.15.59:0/2099302351 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f575c0597d0 con 0x7f5750003f90 2024-04-25T09:01:43.868 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:01:43.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.880+0000 7f5770600640 1 -- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5748066f60 msgr2=0x7f5748069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.880+0000 7f5770600640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5748066f60 0x7f5748069420 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f57540af000 tx=0x7f57540046d0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.880+0000 7f5770600640 1 -- 172.21.15.59:0/2099302351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5750003f90 msgr2=0x7f57681572c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:43.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.880+0000 7f5770600640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5750003f90 0x7f57681572c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f575c00e760 tx=0x7f575c00ec20 comp rx=0 tx=0).stop 2024-04-25T09:01:43.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.880+0000 7f5770600640 1 -- 172.21.15.59:0/2099302351 shutdown_connections 2024-04-25T09:01:43.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.880+0000 7f5770600640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5748066f60 0x7f5748069420 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.880+0000 7f5770600640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57681409c0 0x7f5768140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.880+0000 7f5770600640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5768155c60 0x7f57681531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.880+0000 7f5770600640 1 --2- 172.21.15.59:0/2099302351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5750003f90 0x7f57681572c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:43.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.880+0000 7f5770600640 1 -- 172.21.15.59:0/2099302351 >> 172.21.15.59:0/2099302351 conn(0x7f57680b3200 msgr2=0x7f57680cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:43.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.880+0000 7f5770600640 1 -- 172.21.15.59:0/2099302351 shutdown_connections 2024-04-25T09:01:43.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:43.880+0000 7f5770600640 1 -- 172.21.15.59:0/2099302351 wait complete. 2024-04-25T09:01:43.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:01:44.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.040+0000 7ff2e5c00640 1 Processor -- start 2024-04-25T09:01:44.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.040+0000 7ff2e5c00640 1 -- start start 2024-04-25T09:01:44.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2e5c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2e015dc60 0x7ff2e00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2e5c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff2e009a170 0x7ff2e00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2e5c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e015e040 con 0x7ff2e006bf30 2024-04-25T09:01:44.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2e5c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e00cff80 con 0x7ff2e009a170 2024-04-25T09:01:44.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2e5c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00d0260 con 0x7ff2e015dc60 2024-04-25T09:01:44.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2d6000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff2e006bf30 0x7ff2e0099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41812/0 (socket says 172.21.15.59:41812) 2024-04-25T09:01:44.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2d6000640 1 -- 172.21.15.59:0/159340935 learned_addr learned my addr 172.21.15.59:0/159340935 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:44.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2df400640 1 --2- 172.21.15.59:0/159340935 >> v2:172.21.15.178:3300/0 conn(0x7ff2e009a170 0x7ff2e00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2dea00640 1 --2- 172.21.15.59:0/159340935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2e015dc60 0x7ff2e00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2de000640 1 -- 172.21.15.59:0/159340935 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949371895 0 0) 0x7ff2e015e040 con 0x7ff2e006bf30 2024-04-25T09:01:44.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2de000640 1 -- 172.21.15.59:0/159340935 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2c4003530 con 0x7ff2e006bf30 2024-04-25T09:01:44.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2de000640 1 -- 172.21.15.59:0/159340935 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 208039905 0 0) 0x7ff2c4003530 con 0x7ff2e006bf30 2024-04-25T09:01:44.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2dea00640 1 -- 172.21.15.59:0/159340935 >> v2:172.21.15.178:3300/0 conn(0x7ff2e009a170 msgr2=0x7ff2e00cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:44.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2dea00640 1 --2- 172.21.15.59:0/159340935 >> v2:172.21.15.178:3300/0 conn(0x7ff2e009a170 0x7ff2e00cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2dea00640 1 -- 172.21.15.59:0/159340935 >> v1:172.21.15.59:6789/0 conn(0x7ff2e006bf30 legacy=0x7ff2e0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2dea00640 1 -- 172.21.15.59:0/159340935 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e00d0540 con 0x7ff2e015dc60 2024-04-25T09:01:44.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.044+0000 7ff2df400640 1 --2- 172.21.15.59:0/159340935 >> v2:172.21.15.178:3300/0 conn(0x7ff2e009a170 0x7ff2e00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:44.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2dea00640 1 --2- 172.21.15.59:0/159340935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2e015dc60 0x7ff2e00d1020 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009d90 tx=0x7ff2d001c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab9a6aba1f42c4fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:44.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2de000640 1 -- 172.21.15.59:0/159340935 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00b2070 con 0x7ff2e015dc60 2024-04-25T09:01:44.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2de000640 1 -- 172.21.15.59:0/159340935 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d00a55d0 con 0x7ff2e015dc60 2024-04-25T09:01:44.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2de000640 1 -- 172.21.15.59:0/159340935 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8001680 con 0x7ff2e015dc60 2024-04-25T09:01:44.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2e5c00640 1 -- 172.21.15.59:0/159340935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2e015dc60 msgr2=0x7ff2e00d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2e5c00640 1 --2- 172.21.15.59:0/159340935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2e015dc60 0x7ff2e00d1020 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff2d0009d90 tx=0x7ff2d001c7d0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2e5c00640 1 -- 172.21.15.59:0/159340935 shutdown_connections 2024-04-25T09:01:44.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2e5c00640 1 --2- 172.21.15.59:0/159340935 >> v2:172.21.15.178:3300/0 conn(0x7ff2e009a170 0x7ff2e00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2e5c00640 1 --2- 172.21.15.59:0/159340935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2e015dc60 0x7ff2e00d1020 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2e5c00640 1 -- 172.21.15.59:0/159340935 >> 172.21.15.59:0/159340935 conn(0x7ff2e00b3200 msgr2=0x7ff2e00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:44.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2e5c00640 1 -- 172.21.15.59:0/159340935 shutdown_connections 2024-04-25T09:01:44.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2e5c00640 1 -- 172.21.15.59:0/159340935 wait complete. 2024-04-25T09:01:44.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2e5c00640 1 Processor -- start 2024-04-25T09:01:44.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.048+0000 7ff2e5c00640 1 -- start start 2024-04-25T09:01:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2e5c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e006bf30 0x7ff2e01553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2e5c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2e009a170 0x7ff2e00ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2e5c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2e015dc60 0x7ff2e015c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2e5c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00cc6f0 con 0x7ff2e006bf30 2024-04-25T09:01:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2e5c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00cc570 con 0x7ff2e009a170 2024-04-25T09:01:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2e5c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e00cc870 con 0x7ff2e015dc60 2024-04-25T09:01:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2dea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e006bf30 0x7ff2e01553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2dea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e006bf30 0x7ff2e01553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46532/0 (socket says 172.21.15.59:46532) 2024-04-25T09:01:44.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2dea00640 1 -- 172.21.15.59:0/2138680928 learned_addr learned my addr 172.21.15.59:0/2138680928 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2dea00640 1 -- 172.21.15.59:0/2138680928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2e015dc60 msgr2=0x7ff2e015c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2dea00640 1 --2- 172.21.15.59:0/2138680928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2e015dc60 0x7ff2e015c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2dea00640 1 -- 172.21.15.59:0/2138680928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2e009a170 msgr2=0x7ff2e00ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2dea00640 1 --2- 172.21.15.59:0/2138680928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2e009a170 0x7ff2e00ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2dea00640 1 -- 172.21.15.59:0/2138680928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e00c9570 con 0x7ff2e006bf30 2024-04-25T09:01:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2dea00640 1 --2- 172.21.15.59:0/2138680928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e006bf30 0x7ff2e01553b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff2d001ae80 tx=0x7ff2d0019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2d7400640 1 -- 172.21.15.59:0/2138680928 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00b2040 con 0x7ff2e006bf30 2024-04-25T09:01:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2d7400640 1 -- 172.21.15.59:0/2138680928 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d00bf070 con 0x7ff2e006bf30 2024-04-25T09:01:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2e5c00640 1 -- 172.21.15.59:0/2138680928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e00c9850 con 0x7ff2e006bf30 2024-04-25T09:01:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2d7400640 1 -- 172.21.15.59:0/2138680928 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0009450 con 0x7ff2e006bf30 2024-04-25T09:01:44.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2e5c00640 1 -- 172.21.15.59:0/2138680928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e00c9e10 con 0x7ff2e006bf30 2024-04-25T09:01:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2e5c00640 1 -- 172.21.15.59:0/2138680928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e00745d0 con 0x7ff2e006bf30 2024-04-25T09:01:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.052+0000 7ff2d7400640 1 -- 172.21.15.59:0/2138680928 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff2d00b8890 con 0x7ff2e006bf30 2024-04-25T09:01:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.056+0000 7ff2d7400640 1 --2- 172.21.15.59:0/2138680928 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2bc066f60 0x7ff2bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.056+0000 7ff2d7400640 1 -- 172.21.15.59:0/2138680928 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff2d0120330 con 0x7ff2e006bf30 2024-04-25T09:01:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.056+0000 7ff2d6000640 1 --2- 172.21.15.59:0/2138680928 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2bc066f60 0x7ff2bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.056+0000 7ff2d6000640 1 --2- 172.21.15.59:0/2138680928 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2bc066f60 0x7ff2bc069420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8000c10 tx=0x7ff2c8001030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:44.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.060+0000 7ff2d7400640 1 -- 172.21.15.59:0/2138680928 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff2d0016480 con 0x7ff2e006bf30 2024-04-25T09:01:44.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 -- 172.21.15.59:0/2138680928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff2e00c9fe0 con 0x7ff2e006bf30 2024-04-25T09:01:44.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2d7400640 1 -- 172.21.15.59:0/2138680928 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff2d00f0f70 con 0x7ff2e006bf30 2024-04-25T09:01:44.214 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:01:44.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 -- 172.21.15.59:0/2138680928 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2bc066f60 msgr2=0x7ff2bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 --2- 172.21.15.59:0/2138680928 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2bc066f60 0x7ff2bc069420 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff2c8000c10 tx=0x7ff2c8001030 comp rx=0 tx=0).stop 2024-04-25T09:01:44.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 -- 172.21.15.59:0/2138680928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e006bf30 msgr2=0x7ff2e01553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 --2- 172.21.15.59:0/2138680928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e006bf30 0x7ff2e01553b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff2d001ae80 tx=0x7ff2d0019570 comp rx=0 tx=0).stop 2024-04-25T09:01:44.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 -- 172.21.15.59:0/2138680928 shutdown_connections 2024-04-25T09:01:44.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 --2- 172.21.15.59:0/2138680928 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2bc066f60 0x7ff2bc069420 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 --2- 172.21.15.59:0/2138680928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2e015dc60 0x7ff2e015c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 --2- 172.21.15.59:0/2138680928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2e009a170 0x7ff2e00ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 --2- 172.21.15.59:0/2138680928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2e006bf30 0x7ff2e01553b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 -- 172.21.15.59:0/2138680928 >> 172.21.15.59:0/2138680928 conn(0x7ff2e00b3200 msgr2=0x7ff2e00736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:44.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 -- 172.21.15.59:0/2138680928 shutdown_connections 2024-04-25T09:01:44.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.224+0000 7ff2e5c00640 1 -- 172.21.15.59:0/2138680928 wait complete. 2024-04-25T09:01:44.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:01:44.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.384+0000 7f5734e00640 1 Processor -- start 2024-04-25T09:01:44.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f5734e00640 1 -- start start 2024-04-25T09:01:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f5734e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f573015dd90 0x7f5730071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f5734e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5730072460 con 0x7f5730161e90 2024-04-25T09:01:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f5734e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573006ac10 con 0x7f5730072040 2024-04-25T09:01:44.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f5734e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57300b2dc0 con 0x7f573015dd90 2024-04-25T09:01:44.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572e800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5730161e90 0x7f57300ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41814/0 (socket says 172.21.15.59:41814) 2024-04-25T09:01:44.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572e800640 1 -- 172.21.15.59:0/3027608134 learned_addr learned my addr 172.21.15.59:0/3027608134 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572de00640 1 --2- 172.21.15.59:0/3027608134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f573015dd90 0x7f5730071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284148496 0 0) 0x7f5730072460 con 0x7f5730161e90 2024-04-25T09:01:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5714003530 con 0x7f5730161e90 2024-04-25T09:01:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1285185604 0 0) 0x7f5714003530 con 0x7f5730161e90 2024-04-25T09:01:44.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f573015dd90 msgr2=0x7f5730071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 --2- 172.21.15.59:0/3027608134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f573015dd90 0x7f5730071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 >> v1:172.21.15.178:6789/0 conn(0x7f5730072040 legacy=0x7f5730161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573006aeb0 con 0x7f5730161e90 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f5728001a00 con 0x7f5730161e90 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 >> v1:172.21.15.59:6789/0 conn(0x7f5730161e90 legacy=0x7f57300ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 --2- 172.21.15.59:0/3027608134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57140039f0 0x7f5714003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 --2- 172.21.15.59:0/3027608134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5714004350 0x7f5714004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 --2- 172.21.15.59:0/3027608134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57140050d0 0x7f571400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571400bfc0 con 0x7f57140050d0 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f571400c170 con 0x7f5714004350 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571400c370 con 0x7f57140039f0 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572e800640 1 --2- 172.21.15.59:0/3027608134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57140050d0 0x7f571400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572de00640 1 --2- 172.21.15.59:0/3027608134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57140039f0 0x7f5714003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f5727e00640 1 --2- 172.21.15.59:0/3027608134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5714004350 0x7f5714004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572e800640 1 -- 172.21.15.59:0/3027608134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57140039f0 msgr2=0x7f5714003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:44.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572e800640 1 --2- 172.21.15.59:0/3027608134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57140039f0 0x7f5714003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572e800640 1 -- 172.21.15.59:0/3027608134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5714004350 msgr2=0x7f5714004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:44.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572e800640 1 --2- 172.21.15.59:0/3027608134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5714004350 0x7f5714004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.388+0000 7f572e800640 1 -- 172.21.15.59:0/3027608134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714003530 con 0x7f57140050d0 2024-04-25T09:01:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.392+0000 7f572e800640 1 --2- 172.21.15.59:0/3027608134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57140050d0 0x7f571400b9d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f572800a920 tx=0x7f572801d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fab584eb5b803ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.392+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572800a4c0 con 0x7f57140050d0 2024-04-25T09:01:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.392+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57280ad650 con 0x7f57140050d0 2024-04-25T09:01:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.392+0000 7f572d400640 1 -- 172.21.15.59:0/3027608134 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57280ada80 con 0x7f57140050d0 2024-04-25T09:01:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.392+0000 7f5734e00640 1 -- 172.21.15.59:0/3027608134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57140050d0 msgr2=0x7f571400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.392+0000 7f5734e00640 1 --2- 172.21.15.59:0/3027608134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57140050d0 0x7f571400b9d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f572800a920 tx=0x7f572801d420 comp rx=0 tx=0).stop 2024-04-25T09:01:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.392+0000 7f572e800640 1 -- 172.21.15.59:0/3027608134 reap_dead start 2024-04-25T09:01:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.392+0000 7f5734e00640 1 -- 172.21.15.59:0/3027608134 shutdown_connections 2024-04-25T09:01:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.392+0000 7f5734e00640 1 -- 172.21.15.59:0/3027608134 >> 172.21.15.59:0/3027608134 conn(0x7f57300cfd90 msgr2=0x7f57300d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.392+0000 7f5734e00640 1 -- 172.21.15.59:0/3027608134 shutdown_connections 2024-04-25T09:01:44.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.392+0000 7f5734e00640 1 -- 172.21.15.59:0/3027608134 wait complete. 2024-04-25T09:01:44.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5734e00640 1 Processor -- start 2024-04-25T09:01:44.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5734e00640 1 -- start start 2024-04-25T09:01:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5734e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57140050d0 0x7f57301555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5734e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5730154dc0 0x7f5730165380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5734e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57301658c0 0x7f573015f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5734e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5730169c40 con 0x7f57140050d0 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5734e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5730169ac0 con 0x7f5730154dc0 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5734e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5730169dc0 con 0x7f57301658c0 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f572de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57140050d0 0x7f57301555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f572de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57140050d0 0x7f57301555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46558/0 (socket says 172.21.15.59:46558) 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f572de00640 1 -- 172.21.15.59:0/32899694 learned_addr learned my addr 172.21.15.59:0/32899694 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5727e00640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5730154dc0 0x7f5730165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f572e800640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57301658c0 0x7f573015f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f572de00640 1 -- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57301658c0 msgr2=0x7f573015f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f572de00640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57301658c0 0x7f573015f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f572de00640 1 -- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5730154dc0 msgr2=0x7f5730165380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f572de00640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5730154dc0 0x7f5730165380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f572de00640 1 -- 172.21.15.59:0/32899694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730156ee0 con 0x7f57140050d0 2024-04-25T09:01:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f572de00640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57140050d0 0x7f57301555b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5720011890 tx=0x7f5720011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:44.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5726000640 1 -- 172.21.15.59:0/32899694 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5720019070 con 0x7f57140050d0 2024-04-25T09:01:44.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5726000640 1 -- 172.21.15.59:0/32899694 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5720004240 con 0x7f57140050d0 2024-04-25T09:01:44.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5734e00640 1 -- 172.21.15.59:0/32899694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5730157160 con 0x7f57140050d0 2024-04-25T09:01:44.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5726000640 1 -- 172.21.15.59:0/32899694 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572000f7a0 con 0x7f57140050d0 2024-04-25T09:01:44.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.396+0000 7f5734e00640 1 -- 172.21.15.59:0/32899694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5730157720 con 0x7f57140050d0 2024-04-25T09:01:44.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.400+0000 7f5734e00640 1 -- 172.21.15.59:0/32899694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57300745d0 con 0x7f57140050d0 2024-04-25T09:01:44.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.400+0000 7f5726000640 1 -- 172.21.15.59:0/32899694 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f572001c070 con 0x7f57140050d0 2024-04-25T09:01:44.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.400+0000 7f5726000640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f570c066f90 0x7f570c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.400+0000 7f5726000640 1 -- 172.21.15.59:0/32899694 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f57200855f0 con 0x7f57140050d0 2024-04-25T09:01:44.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.400+0000 7f5727e00640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f570c066f90 0x7f570c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.400+0000 7f5727e00640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f570c066f90 0x7f570c069450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f57301fa130 tx=0x7f5718009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:44.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.404+0000 7f5726000640 1 -- 172.21.15.59:0/32899694 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5730156ee0 con 0x7f57140050d0 2024-04-25T09:01:44.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 -- 172.21.15.59:0/32899694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5730165ca0 con 0x7f57140050d0 2024-04-25T09:01:44.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5726000640 1 -- 172.21.15.59:0/32899694 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5720055c60 con 0x7f57140050d0 2024-04-25T09:01:44.570 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:01:44.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 -- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f570c066f90 msgr2=0x7f570c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f570c066f90 0x7f570c069450 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f57301fa130 tx=0x7f5718009040 comp rx=0 tx=0).stop 2024-04-25T09:01:44.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 -- 172.21.15.59:0/32899694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57140050d0 msgr2=0x7f57301555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57140050d0 0x7f57301555b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5720011890 tx=0x7f5720011d50 comp rx=0 tx=0).stop 2024-04-25T09:01:44.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 -- 172.21.15.59:0/32899694 shutdown_connections 2024-04-25T09:01:44.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f570c066f90 0x7f570c069450 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57301658c0 0x7f573015f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5730154dc0 0x7f5730165380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 --2- 172.21.15.59:0/32899694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57140050d0 0x7f57301555b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 -- 172.21.15.59:0/32899694 >> 172.21.15.59:0/32899694 conn(0x7f57300cfd90 msgr2=0x7f57300cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:44.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 -- 172.21.15.59:0/32899694 shutdown_connections 2024-04-25T09:01:44.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.580+0000 7f5734e00640 1 -- 172.21.15.59:0/32899694 wait complete. 2024-04-25T09:01:44.590 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi059.front.sepia.ceph.com... 2024-04-25T09:01:44.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:44.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T09:01:44.624 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi059.stderr:ceph-fuse[33737]: fuse finished with error 0 and tester_r 0 2024-04-25T09:01:44.627 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:01:44.695 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:01:44.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:44.695 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T09:01:44.711 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf4400640 1 Processor -- start 2024-04-25T09:01:44.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf4400640 1 -- start start 2024-04-25T09:01:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf4400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffaec144140 0x7ffaec0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf4400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffaec0ced60 0x7ffaec06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf4400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaec15ac60 con 0x7ffaec06e900 2024-04-25T09:01:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf4400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaec06ed70 con 0x7ffaec144140 2024-04-25T09:01:44.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf4400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0cf3e0 con 0x7ffaec0ced60 2024-04-25T09:01:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf1a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffaec144140 0x7ffaec0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf1a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffaec144140 0x7ffaec0ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46562/0 (socket says 172.21.15.59:46562) 2024-04-25T09:01:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf1a00640 1 -- 172.21.15.59:0/3548480177 learned_addr learned my addr 172.21.15.59:0/3548480177 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf1000640 1 --2- 172.21.15.59:0/3548480177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffaec0ced60 0x7ffaec06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf1a00640 1 -- 172.21.15.59:0/3548480177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffaec0ced60 msgr2=0x7ffaec06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.908+0000 7ffaf1a00640 1 --2- 172.21.15.59:0/3548480177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffaec0ced60 0x7ffaec06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.912+0000 7ffaf1a00640 1 -- 172.21.15.59:0/3548480177 >> v1:172.21.15.178:6789/0 conn(0x7ffaec06e900 legacy=0x7ffaec15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:44.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.912+0000 7ffaf1a00640 1 -- 172.21.15.59:0/3548480177 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec15af20 con 0x7ffaec144140 2024-04-25T09:01:44.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.912+0000 7ffaf1a00640 1 --2- 172.21.15.59:0/3548480177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaec144140 0x7ffaec0ce820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009e50 tx=0x7ffae001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c55d4791c8c0387 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:44.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.912+0000 7ffaebe00640 1 -- 172.21.15.59:0/3548480177 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae00a5590 con 0x7ffaec144140 2024-04-25T09:01:44.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.912+0000 7ffaebe00640 1 -- 172.21.15.59:0/3548480177 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae00a5730 con 0x7ffaec144140 2024-04-25T09:01:44.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.912+0000 7ffaebe00640 1 -- 172.21.15.59:0/3548480177 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae00a5b00 con 0x7ffaec144140 2024-04-25T09:01:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.912+0000 7ffaf4400640 1 -- 172.21.15.59:0/3548480177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaec144140 msgr2=0x7ffaec0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.912+0000 7ffaf4400640 1 --2- 172.21.15.59:0/3548480177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaec144140 0x7ffaec0ce820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009e50 tx=0x7ffae001c9f0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.912+0000 7ffaf4400640 1 -- 172.21.15.59:0/3548480177 shutdown_connections 2024-04-25T09:01:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.912+0000 7ffaf4400640 1 --2- 172.21.15.59:0/3548480177 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffaec0ced60 0x7ffaec06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.912+0000 7ffaf4400640 1 --2- 172.21.15.59:0/3548480177 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaec144140 0x7ffaec0ce820 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf4400640 1 -- 172.21.15.59:0/3548480177 >> 172.21.15.59:0/3548480177 conn(0x7ffaec066fa0 msgr2=0x7ffaec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:44.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf4400640 1 -- 172.21.15.59:0/3548480177 shutdown_connections 2024-04-25T09:01:44.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf4400640 1 -- 172.21.15.59:0/3548480177 wait complete. 2024-04-25T09:01:44.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf4400640 1 Processor -- start 2024-04-25T09:01:44.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf4400640 1 -- start start 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf4400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffaec06e900 0x7ffaec13f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf4400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaec0ced60 0x7ffaec154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf4400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaec144140 0x7ffaec13b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf4400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec144520 con 0x7ffaec144140 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf4400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec0cf140 con 0x7ffaec0ced60 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf4400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaec15ba00 con 0x7ffaec06e900 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaec144140 0x7ffaec13b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaec144140 0x7ffaec13b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46564/0 (socket says 172.21.15.59:46564) 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf2400640 1 -- 172.21.15.59:0/762546493 learned_addr learned my addr 172.21.15.59:0/762546493 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf1a00640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffaec06e900 0x7ffaec13f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf1000640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaec0ced60 0x7ffaec154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf2400640 1 -- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffaec06e900 msgr2=0x7ffaec13f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf2400640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffaec06e900 0x7ffaec13f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf2400640 1 -- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaec0ced60 msgr2=0x7ffaec154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:44.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf2400640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaec0ced60 0x7ffaec154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:44.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf2400640 1 -- 172.21.15.59:0/762546493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec13e650 con 0x7ffaec144140 2024-04-25T09:01:44.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf1000640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaec0ced60 0x7ffaec154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:44.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffaf2400640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaec144140 0x7ffaec13b030 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c3c0 tx=0x7ffae400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:44.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffae9600640 1 -- 172.21.15.59:0/762546493 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4011790 con 0x7ffaec144140 2024-04-25T09:01:44.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.916+0000 7ffae9600640 1 -- 172.21.15.59:0/762546493 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae4017070 con 0x7ffaec144140 2024-04-25T09:01:44.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.920+0000 7ffae9600640 1 -- 172.21.15.59:0/762546493 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae4011b70 con 0x7ffaec144140 2024-04-25T09:01:44.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.920+0000 7ffaf4400640 1 -- 172.21.15.59:0/762546493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec13e930 con 0x7ffaec144140 2024-04-25T09:01:44.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.920+0000 7ffaf4400640 1 -- 172.21.15.59:0/762546493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec13eef0 con 0x7ffaec144140 2024-04-25T09:01:44.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.920+0000 7ffaf4400640 1 -- 172.21.15.59:0/762546493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaec0745d0 con 0x7ffaec144140 2024-04-25T09:01:44.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.920+0000 7ffae9600640 1 -- 172.21.15.59:0/762546493 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffae4011d10 con 0x7ffaec144140 2024-04-25T09:01:44.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.920+0000 7ffae9600640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffacc066f60 0x7ffacc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:44.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.920+0000 7ffae9600640 1 -- 172.21.15.59:0/762546493 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ffae40850e0 con 0x7ffaec144140 2024-04-25T09:01:44.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.920+0000 7ffaf1a00640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffacc066f60 0x7ffacc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:44.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.924+0000 7ffaf1a00640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffacc066f60 0x7ffacc069420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffae00ae000 tx=0x7ffae00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:44.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:44.924+0000 7ffae9600640 1 -- 172.21.15.59:0/762546493 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffae4055d10 con 0x7ffaec144140 2024-04-25T09:01:45.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 -- 172.21.15.59:0/762546493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaec06b360 con 0x7ffaec144140 2024-04-25T09:01:45.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffae9600640 1 -- 172.21.15.59:0/762546493 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7ffae4055610 con 0x7ffaec144140 2024-04-25T09:01:45.083 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:45.083 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:45.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 -- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffacc066f60 msgr2=0x7ffacc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffacc066f60 0x7ffacc069420 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ffae00ae000 tx=0x7ffae00a7070 comp rx=0 tx=0).stop 2024-04-25T09:01:45.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 -- 172.21.15.59:0/762546493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaec144140 msgr2=0x7ffaec13b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaec144140 0x7ffaec13b030 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffae400c3c0 tx=0x7ffae400c880 comp rx=0 tx=0).stop 2024-04-25T09:01:45.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 -- 172.21.15.59:0/762546493 shutdown_connections 2024-04-25T09:01:45.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffacc066f60 0x7ffacc069420 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffaec144140 0x7ffaec13b030 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffaec0ced60 0x7ffaec154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 --2- 172.21.15.59:0/762546493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffaec06e900 0x7ffaec13f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 -- 172.21.15.59:0/762546493 >> 172.21.15.59:0/762546493 conn(0x7ffaec066fa0 msgr2=0x7ffaec06df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:45.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 -- 172.21.15.59:0/762546493 shutdown_connections 2024-04-25T09:01:45.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.092+0000 7ffaf4400640 1 -- 172.21.15.59:0/762546493 wait complete. 2024-04-25T09:01:45.105 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:45.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a7a00640 1 Processor -- start 2024-04-25T09:01:45.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a7a00640 1 -- start start 2024-04-25T09:01:45.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a7a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4a00af670 0x7fb4a00afa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a7a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb4a006b0a0 0x7fb4a00d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a7a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a00cd4e0 con 0x7fb4a006ac10 2024-04-25T09:01:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a7a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a00cd7a0 con 0x7fb4a00af670 2024-04-25T09:01:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a7a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a00cda80 con 0x7fb4a006b0a0 2024-04-25T09:01:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a5000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4a00af670 0x7fb4a00afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a5000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4a00af670 0x7fb4a00afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46568/0 (socket says 172.21.15.59:46568) 2024-04-25T09:01:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a5000640 1 -- 172.21.15.59:0/1437114567 learned_addr learned my addr 172.21.15.59:0/1437114567 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:45.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a5a00640 1 --2- 172.21.15.59:0/1437114567 >> v2:172.21.15.178:3300/0 conn(0x7fb4a006b0a0 0x7fb4a00d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a5000640 1 -- 172.21.15.59:0/1437114567 >> v2:172.21.15.178:3300/0 conn(0x7fb4a006b0a0 msgr2=0x7fb4a00d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:45.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a5000640 1 --2- 172.21.15.59:0/1437114567 >> v2:172.21.15.178:3300/0 conn(0x7fb4a006b0a0 0x7fb4a00d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a5000640 1 -- 172.21.15.59:0/1437114567 >> v1:172.21.15.178:6789/0 conn(0x7fb4a006ac10 legacy=0x7fb4a00d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.256+0000 7fb4a5000640 1 -- 172.21.15.59:0/1437114567 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a00cdd60 con 0x7fb4a00af670 2024-04-25T09:01:45.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.260+0000 7fb4a5000640 1 --2- 172.21.15.59:0/1437114567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a00af670 0x7fb4a00afa50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00729b0 tx=0x7fb49001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ff3dca6e6a497a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.260+0000 7fb49fe00640 1 -- 172.21.15.59:0/1437114567 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4900b1070 con 0x7fb4a00af670 2024-04-25T09:01:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.260+0000 7fb49fe00640 1 -- 172.21.15.59:0/1437114567 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4900ac600 con 0x7fb4a00af670 2024-04-25T09:01:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.260+0000 7fb49fe00640 1 -- 172.21.15.59:0/1437114567 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4900ac9d0 con 0x7fb4a00af670 2024-04-25T09:01:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.260+0000 7fb4a7a00640 1 -- 172.21.15.59:0/1437114567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a00af670 msgr2=0x7fb4a00afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.260+0000 7fb4a7a00640 1 --2- 172.21.15.59:0/1437114567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a00af670 0x7fb4a00afa50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00729b0 tx=0x7fb49001c490 comp rx=0 tx=0).stop 2024-04-25T09:01:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.260+0000 7fb4a7a00640 1 -- 172.21.15.59:0/1437114567 shutdown_connections 2024-04-25T09:01:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.260+0000 7fb4a7a00640 1 --2- 172.21.15.59:0/1437114567 >> v2:172.21.15.178:3300/0 conn(0x7fb4a006b0a0 0x7fb4a00d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.260+0000 7fb4a7a00640 1 --2- 172.21.15.59:0/1437114567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a00af670 0x7fb4a00afa50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.260+0000 7fb4a7a00640 1 -- 172.21.15.59:0/1437114567 >> 172.21.15.59:0/1437114567 conn(0x7fb4a00b2400 msgr2=0x7fb4a00b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.260+0000 7fb4a7a00640 1 -- 172.21.15.59:0/1437114567 shutdown_connections 2024-04-25T09:01:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.260+0000 7fb4a7a00640 1 -- 172.21.15.59:0/1437114567 wait complete. 2024-04-25T09:01:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a7a00640 1 Processor -- start 2024-04-25T09:01:45.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a7a00640 1 -- start start 2024-04-25T09:01:45.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a7a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4a006ac10 0x7fb4a0156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a7a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4a006b0a0 0x7fb4a0136a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a7a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a00af670 0x7fb4a015bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a7a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a0070cb0 con 0x7fb4a00af670 2024-04-25T09:01:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a7a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a0070b30 con 0x7fb4a006ac10 2024-04-25T09:01:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a7a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a00d11f0 con 0x7fb4a006b0a0 2024-04-25T09:01:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a5a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a00af670 0x7fb4a015bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a5a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a00af670 0x7fb4a015bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46576/0 (socket says 172.21.15.59:46576) 2024-04-25T09:01:45.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a5a00640 1 -- 172.21.15.59:0/3974425635 learned_addr learned my addr 172.21.15.59:0/3974425635 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:45.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a5000640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4a006ac10 0x7fb4a0156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a5a00640 1 -- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4a006b0a0 msgr2=0x7fb4a0136a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a5a00640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4a006b0a0 0x7fb4a0136a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a5a00640 1 -- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4a006ac10 msgr2=0x7fb4a0156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a5a00640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4a006ac10 0x7fb4a0156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a5a00640 1 -- 172.21.15.59:0/3974425635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a01582a0 con 0x7fb4a00af670 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a5000640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4a006ac10 0x7fb4a0156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a5a00640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a00af670 0x7fb4a015bd60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb498007e40 tx=0x7fb49800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb49d600640 1 -- 172.21.15.59:0/3974425635 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498014620 con 0x7fb4a00af670 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb49d600640 1 -- 172.21.15.59:0/3974425635 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb498019070 con 0x7fb4a00af670 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb49d600640 1 -- 172.21.15.59:0/3974425635 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb498014a20 con 0x7fb4a00af670 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a7a00640 1 -- 172.21.15.59:0/3974425635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a015c8d0 con 0x7fb4a00af670 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.264+0000 7fb4a7a00640 1 -- 172.21.15.59:0/3974425635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a0156c40 con 0x7fb4a00af670 2024-04-25T09:01:45.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.268+0000 7fb4a7a00640 1 -- 172.21.15.59:0/3974425635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a00745d0 con 0x7fb4a00af670 2024-04-25T09:01:45.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.268+0000 7fb49d600640 1 -- 172.21.15.59:0/3974425635 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb498014bc0 con 0x7fb4a00af670 2024-04-25T09:01:45.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.268+0000 7fb49d600640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb47c066f60 0x7fb47c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.268+0000 7fb49d600640 1 -- 172.21.15.59:0/3974425635 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb498085d10 con 0x7fb4a00af670 2024-04-25T09:01:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.268+0000 7fb4a5000640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb47c066f60 0x7fb47c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.268+0000 7fb4a5000640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb47c066f60 0x7fb47c069420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb4900ae000 tx=0x7fb490008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:45.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.272+0000 7fb49d600640 1 -- 172.21.15.59:0/3974425635 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb49808b020 con 0x7fb4a00af670 2024-04-25T09:01:45.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 -- 172.21.15.59:0/3974425635 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4a00b34f0 con 0x7fb4a00af670 2024-04-25T09:01:45.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb49d600640 1 -- 172.21.15.59:0/3974425635 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7fb498056940 con 0x7fb4a00af670 2024-04-25T09:01:45.427 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:45.427 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:45.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 -- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb47c066f60 msgr2=0x7fb47c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb47c066f60 0x7fb47c069420 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb4900ae000 tx=0x7fb490008040 comp rx=0 tx=0).stop 2024-04-25T09:01:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 -- 172.21.15.59:0/3974425635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a00af670 msgr2=0x7fb4a015bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a00af670 0x7fb4a015bd60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb498007e40 tx=0x7fb49800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 -- 172.21.15.59:0/3974425635 shutdown_connections 2024-04-25T09:01:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb47c066f60 0x7fb47c069420 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a00af670 0x7fb4a015bd60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4a006b0a0 0x7fb4a0136a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 --2- 172.21.15.59:0/3974425635 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4a006ac10 0x7fb4a0156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 -- 172.21.15.59:0/3974425635 >> 172.21.15.59:0/3974425635 conn(0x7fb4a00b2400 msgr2=0x7fb4a00b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:45.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 -- 172.21.15.59:0/3974425635 shutdown_connections 2024-04-25T09:01:45.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.436+0000 7fb4a7a00640 1 -- 172.21.15.59:0/3974425635 wait complete. 2024-04-25T09:01:45.450 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:01:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c3400640 1 Processor -- start 2024-04-25T09:01:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c3400640 1 -- start start 2024-04-25T09:01:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c3400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2bc15e770 0x7ff2bc15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c3400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff2bc06d2d0 0x7ff2bc15f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c3400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2bc071270 0x7ff2bc0716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c3400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2bc15f090 con 0x7ff2bc15e770 2024-04-25T09:01:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c3400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2bc071c20 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c3400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc06db20 con 0x7ff2bc071270 2024-04-25T09:01:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c0a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2bc15e770 0x7ff2bc15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c0a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2bc15e770 0x7ff2bc15eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46584/0 (socket says 172.21.15.59:46584) 2024-04-25T09:01:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c0a00640 1 -- 172.21.15.59:0/4091076056 learned_addr learned my addr 172.21.15.59:0/4091076056 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c1400640 1 --2- 172.21.15.59:0/4091076056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2bc071270 0x7ff2bc0716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2b3e00640 1 --2- 172.21.15.59:0/4091076056 >> v2:172.21.15.178:3300/0 conn(0x7ff2bc06d2d0 0x7ff2bc15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c0a00640 1 -- 172.21.15.59:0/4091076056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2bc071270 msgr2=0x7ff2bc0716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c0a00640 1 --2- 172.21.15.59:0/4091076056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2bc071270 0x7ff2bc0716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c0a00640 1 -- 172.21.15.59:0/4091076056 >> v2:172.21.15.178:3300/0 conn(0x7ff2bc06d2d0 msgr2=0x7ff2bc15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c0a00640 1 --2- 172.21.15.59:0/4091076056 >> v2:172.21.15.178:3300/0 conn(0x7ff2bc06d2d0 0x7ff2bc15f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c0a00640 1 -- 172.21.15.59:0/4091076056 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc06de00 con 0x7ff2bc15e770 2024-04-25T09:01:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2c1400640 1 --2- 172.21.15.59:0/4091076056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2bc071270 0x7ff2bc0716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.604+0000 7ff2b3e00640 1 --2- 172.21.15.59:0/4091076056 >> v2:172.21.15.178:3300/0 conn(0x7ff2bc06d2d0 0x7ff2bc15f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2c0a00640 1 --2- 172.21.15.59:0/4091076056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2bc15e770 0x7ff2bc15eb50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc06ba80 tx=0x7ff2ac01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f1d9dba267ab95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2bbe00640 1 -- 172.21.15.59:0/4091076056 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0ab650 con 0x7ff2bc15e770 2024-04-25T09:01:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2bbe00640 1 -- 172.21.15.59:0/4091076056 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac0b0070 con 0x7ff2bc15e770 2024-04-25T09:01:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2bbe00640 1 -- 172.21.15.59:0/4091076056 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0aba10 con 0x7ff2bc15e770 2024-04-25T09:01:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2c3400640 1 -- 172.21.15.59:0/4091076056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2bc15e770 msgr2=0x7ff2bc15eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2c3400640 1 --2- 172.21.15.59:0/4091076056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2bc15e770 0x7ff2bc15eb50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc06ba80 tx=0x7ff2ac01c490 comp rx=0 tx=0).stop 2024-04-25T09:01:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2c3400640 1 -- 172.21.15.59:0/4091076056 shutdown_connections 2024-04-25T09:01:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2c3400640 1 --2- 172.21.15.59:0/4091076056 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2bc071270 0x7ff2bc0716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2c3400640 1 --2- 172.21.15.59:0/4091076056 >> v2:172.21.15.178:3300/0 conn(0x7ff2bc06d2d0 0x7ff2bc15f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2c3400640 1 --2- 172.21.15.59:0/4091076056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2bc15e770 0x7ff2bc15eb50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2c3400640 1 -- 172.21.15.59:0/4091076056 >> 172.21.15.59:0/4091076056 conn(0x7ff2bc067080 msgr2=0x7ff2bc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2c3400640 1 -- 172.21.15.59:0/4091076056 shutdown_connections 2024-04-25T09:01:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.608+0000 7ff2c3400640 1 -- 172.21.15.59:0/4091076056 wait complete. 2024-04-25T09:01:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c3400640 1 Processor -- start 2024-04-25T09:01:45.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c3400640 1 -- start start 2024-04-25T09:01:45.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2bc06d2d0 0x7ff2bc0cedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2bc071270 0x7ff2bc149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c3400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2bc15e770 0x7ff2bc1497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c3400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc06d6e0 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c3400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc15f770 con 0x7ff2bc071270 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c3400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2bc06d860 con 0x7ff2bc15e770 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2bc06d2d0 0x7ff2bc0cedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2bc06d2d0 0x7ff2bc0cedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46598/0 (socket says 172.21.15.59:46598) 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c0a00640 1 -- 172.21.15.59:0/2853105214 learned_addr learned my addr 172.21.15.59:0/2853105214 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2b3e00640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2bc071270 0x7ff2bc149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c1400640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2bc15e770 0x7ff2bc1497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c0a00640 1 -- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2bc15e770 msgr2=0x7ff2bc1497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c0a00640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2bc15e770 0x7ff2bc1497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c0a00640 1 -- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2bc071270 msgr2=0x7ff2bc149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c0a00640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2bc071270 0x7ff2bc149270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c0a00640 1 -- 172.21.15.59:0/2853105214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc14ecb0 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c1400640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2bc15e770 0x7ff2bc1497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:45.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c0a00640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2bc06d2d0 0x7ff2bc0cedd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac01ab40 tx=0x7ff2ac01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2b9600640 1 -- 172.21.15.59:0/2853105214 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0be5f0 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2b9600640 1 -- 172.21.15.59:0/2853105214 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac0be790 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2b9600640 1 -- 172.21.15.59:0/2853105214 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac0beb80 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c3400640 1 -- 172.21.15.59:0/2853105214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2bc1555d0 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.612+0000 7ff2c3400640 1 -- 172.21.15.59:0/2853105214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2bc147cb0 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.616+0000 7ff2c3400640 1 -- 172.21.15.59:0/2853105214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2bc0745d0 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.616+0000 7ff2b9600640 1 -- 172.21.15.59:0/2853105214 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff2ac0b43f0 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.616+0000 7ff2b9600640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff298066f60 0x7ff298069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:45.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.616+0000 7ff2b9600640 1 -- 172.21.15.59:0/2853105214 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff2ac11fe00 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.616+0000 7ff2b3e00640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff298066f60 0x7ff298069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:45.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.616+0000 7ff2b3e00640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff298066f60 0x7ff298069420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc158190 tx=0x7ff2a4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:45.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.620+0000 7ff2b9600640 1 -- 172.21.15.59:0/2853105214 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff2ac016110 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.816+0000 7ff2c3400640 1 -- 172.21.15.59:0/2853105214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff2bc15a890 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.852+0000 7ff2b9600640 1 -- 172.21.15.59:0/2853105214 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff2ac0f0590 con 0x7ff2bc06d2d0 2024-04-25T09:01:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.856+0000 7ff2c3400640 1 -- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff298066f60 msgr2=0x7ff298069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.856+0000 7ff2c3400640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff298066f60 0x7ff298069420 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc158190 tx=0x7ff2a4008040 comp rx=0 tx=0).stop 2024-04-25T09:01:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.856+0000 7ff2c3400640 1 -- 172.21.15.59:0/2853105214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2bc06d2d0 msgr2=0x7ff2bc0cedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.856+0000 7ff2c3400640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2bc06d2d0 0x7ff2bc0cedd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac01ab40 tx=0x7ff2ac01acd0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.856+0000 7ff2c3400640 1 -- 172.21.15.59:0/2853105214 shutdown_connections 2024-04-25T09:01:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.856+0000 7ff2c3400640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff298066f60 0x7ff298069420 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.856+0000 7ff2c3400640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2bc15e770 0x7ff2bc1497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.856+0000 7ff2c3400640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2bc071270 0x7ff2bc149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.856+0000 7ff2c3400640 1 --2- 172.21.15.59:0/2853105214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2bc06d2d0 0x7ff2bc0cedd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.856+0000 7ff2c3400640 1 -- 172.21.15.59:0/2853105214 >> 172.21.15.59:0/2853105214 conn(0x7ff2bc067080 msgr2=0x7ff2bc158730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.856+0000 7ff2c3400640 1 -- 172.21.15.59:0/2853105214 shutdown_connections 2024-04-25T09:01:45.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:45.856+0000 7ff2c3400640 1 -- 172.21.15.59:0/2853105214 wait complete. 2024-04-25T09:01:45.867 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-25T09:01:45.868 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:01:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.020+0000 7fcb29a00640 1 Processor -- start 2024-04-25T09:01:46.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.020+0000 7fcb29a00640 1 -- start start 2024-04-25T09:01:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.020+0000 7fcb29a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb2415dc60 0x7fcb240d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb29a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcb2409a170 0x7fcb240cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb29a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb2415e040 con 0x7fcb2406bf30 2024-04-25T09:01:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb29a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb240cff80 con 0x7fcb2409a170 2024-04-25T09:01:46.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb29a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240d0260 con 0x7fcb2415dc60 2024-04-25T09:01:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb22000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcb2406bf30 0x7fcb24099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41824/0 (socket says 172.21.15.59:41824) 2024-04-25T09:01:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb22000640 1 -- 172.21.15.59:0/3391060142 learned_addr learned my addr 172.21.15.59:0/3391060142 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb23400640 1 --2- 172.21.15.59:0/3391060142 >> v2:172.21.15.178:3300/0 conn(0x7fcb2409a170 0x7fcb240cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb22a00640 1 --2- 172.21.15.59:0/3391060142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb2415dc60 0x7fcb240d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb21600640 1 -- 172.21.15.59:0/3391060142 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2571010174 0 0) 0x7fcb2415e040 con 0x7fcb2406bf30 2024-04-25T09:01:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb21600640 1 -- 172.21.15.59:0/3391060142 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb08003530 con 0x7fcb2406bf30 2024-04-25T09:01:46.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb23400640 1 -- 172.21.15.59:0/3391060142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb2415dc60 msgr2=0x7fcb240d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb23400640 1 --2- 172.21.15.59:0/3391060142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb2415dc60 0x7fcb240d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb23400640 1 -- 172.21.15.59:0/3391060142 >> v1:172.21.15.59:6789/0 conn(0x7fcb2406bf30 legacy=0x7fcb24099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb23400640 1 -- 172.21.15.59:0/3391060142 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb240d0540 con 0x7fcb2409a170 2024-04-25T09:01:46.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.024+0000 7fcb22a00640 1 --2- 172.21.15.59:0/3391060142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb2415dc60 0x7fcb240d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb23400640 1 --2- 172.21.15.59:0/3391060142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb2409a170 0x7fcb240cf8a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0097c0 tx=0x7fcb1c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d5015f494642e8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb21600640 1 -- 172.21.15.59:0/3391060142 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0b1070 con 0x7fcb2409a170 2024-04-25T09:01:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb21600640 1 -- 172.21.15.59:0/3391060142 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1c0a8050 con 0x7fcb2409a170 2024-04-25T09:01:46.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb21600640 1 -- 172.21.15.59:0/3391060142 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1c0ac860 con 0x7fcb2409a170 2024-04-25T09:01:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb29a00640 1 -- 172.21.15.59:0/3391060142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb2409a170 msgr2=0x7fcb240cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb29a00640 1 --2- 172.21.15.59:0/3391060142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb2409a170 0x7fcb240cf8a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcb1c0097c0 tx=0x7fcb1c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb29a00640 1 -- 172.21.15.59:0/3391060142 shutdown_connections 2024-04-25T09:01:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb29a00640 1 --2- 172.21.15.59:0/3391060142 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb2409a170 0x7fcb240cf8a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb29a00640 1 --2- 172.21.15.59:0/3391060142 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb2415dc60 0x7fcb240d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb29a00640 1 -- 172.21.15.59:0/3391060142 >> 172.21.15.59:0/3391060142 conn(0x7fcb240b3200 msgr2=0x7fcb240b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:46.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb29a00640 1 -- 172.21.15.59:0/3391060142 shutdown_connections 2024-04-25T09:01:46.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb29a00640 1 -- 172.21.15.59:0/3391060142 wait complete. 2024-04-25T09:01:46.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb29a00640 1 Processor -- start 2024-04-25T09:01:46.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb29a00640 1 -- start start 2024-04-25T09:01:46.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.028+0000 7fcb29a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2406bf30 0x7fcb240c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb29a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb2409a170 0x7fcb24154f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb29a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb2415dc60 0x7fcb2409b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb29a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240cc6f0 con 0x7fcb2406bf30 2024-04-25T09:01:46.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb29a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240cc570 con 0x7fcb2409a170 2024-04-25T09:01:46.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb29a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb240cc870 con 0x7fcb2415dc60 2024-04-25T09:01:46.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb22a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2406bf30 0x7fcb240c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb22a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2406bf30 0x7fcb240c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46606/0 (socket says 172.21.15.59:46606) 2024-04-25T09:01:46.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb22a00640 1 -- 172.21.15.59:0/1385155292 learned_addr learned my addr 172.21.15.59:0/1385155292 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:46.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb22000640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb2409a170 0x7fcb24154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb23400640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb2415dc60 0x7fcb2409b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb22a00640 1 -- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb2415dc60 msgr2=0x7fcb2409b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb22a00640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb2415dc60 0x7fcb2409b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb22a00640 1 -- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb2409a170 msgr2=0x7fcb24154f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb22a00640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb2409a170 0x7fcb24154f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb22a00640 1 -- 172.21.15.59:0/1385155292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb2409d1c0 con 0x7fcb2406bf30 2024-04-25T09:01:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb23400640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb2415dc60 0x7fcb2409b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb22a00640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2406bf30 0x7fcb240c8c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009ec0 tx=0x7fcb1400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:46.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb1aa00640 1 -- 172.21.15.59:0/1385155292 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb14018020 con 0x7fcb2406bf30 2024-04-25T09:01:46.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb1aa00640 1 -- 172.21.15.59:0/1385155292 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb14014680 con 0x7fcb2406bf30 2024-04-25T09:01:46.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb1aa00640 1 -- 172.21.15.59:0/1385155292 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb14014a50 con 0x7fcb2406bf30 2024-04-25T09:01:46.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb29a00640 1 -- 172.21.15.59:0/1385155292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb24156460 con 0x7fcb2406bf30 2024-04-25T09:01:46.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb29a00640 1 -- 172.21.15.59:0/1385155292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb2409d440 con 0x7fcb2406bf30 2024-04-25T09:01:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb29a00640 1 -- 172.21.15.59:0/1385155292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb240745d0 con 0x7fcb2406bf30 2024-04-25T09:01:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.032+0000 7fcb1aa00640 1 -- 172.21.15.59:0/1385155292 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcb1401b020 con 0x7fcb2406bf30 2024-04-25T09:01:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.036+0000 7fcb1aa00640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcb04066f60 0x7fcb04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.036+0000 7fcb1aa00640 1 -- 172.21.15.59:0/1385155292 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fcb14086160 con 0x7fcb2406bf30 2024-04-25T09:01:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.036+0000 7fcb22000640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcb04066f60 0x7fcb04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.036+0000 7fcb22000640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcb04066f60 0x7fcb04069420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ced00 tx=0x7fcb10009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.040+0000 7fcb1aa00640 1 -- 172.21.15.59:0/1385155292 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcb14022030 con 0x7fcb2406bf30 2024-04-25T09:01:46.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.236+0000 7fcb29a00640 1 -- 172.21.15.59:0/1385155292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcb240b7590 con 0x7fcb2406bf30 2024-04-25T09:01:46.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.860+0000 7fcb1aa00640 1 -- 172.21.15.59:0/1385155292 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcb2409d1c0 con 0x7fcb2406bf30 2024-04-25T09:01:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.864+0000 7fcb29a00640 1 -- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcb04066f60 msgr2=0x7fcb04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.864+0000 7fcb29a00640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcb04066f60 0x7fcb04069420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcb240ced00 tx=0x7fcb10009040 comp rx=0 tx=0).stop 2024-04-25T09:01:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.864+0000 7fcb29a00640 1 -- 172.21.15.59:0/1385155292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2406bf30 msgr2=0x7fcb240c8c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.864+0000 7fcb29a00640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2406bf30 0x7fcb240c8c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcb14009ec0 tx=0x7fcb1400c490 comp rx=0 tx=0).stop 2024-04-25T09:01:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.864+0000 7fcb29a00640 1 -- 172.21.15.59:0/1385155292 shutdown_connections 2024-04-25T09:01:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.864+0000 7fcb29a00640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcb04066f60 0x7fcb04069420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.864+0000 7fcb29a00640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb2415dc60 0x7fcb2409b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.864+0000 7fcb29a00640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb2409a170 0x7fcb24154f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.864+0000 7fcb29a00640 1 --2- 172.21.15.59:0/1385155292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb2406bf30 0x7fcb240c8c40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.864+0000 7fcb29a00640 1 -- 172.21.15.59:0/1385155292 >> 172.21.15.59:0/1385155292 conn(0x7fcb240b3200 msgr2=0x7fcb240cda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.864+0000 7fcb29a00640 1 -- 172.21.15.59:0/1385155292 shutdown_connections 2024-04-25T09:01:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:46.864+0000 7fcb29a00640 1 -- 172.21.15.59:0/1385155292 wait complete. 2024-04-25T09:01:46.878 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:01:46.878 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:47.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.032+0000 7fef44a00640 1 Processor -- start 2024-04-25T09:01:47.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.032+0000 7fef44a00640 1 -- start start 2024-04-25T09:01:47.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.032+0000 7fef44a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef4015efa0 0x7fef40099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.032+0000 7fef44a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400cdb70 0x7fef40099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.032+0000 7fef44a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fef400b04b0 0x7fef400cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.032+0000 7fef44a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef400b3fe0 con 0x7fef4015efa0 2024-04-25T09:01:47.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.032+0000 7fef44a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef400cd6c0 con 0x7fef400b04b0 2024-04-25T09:01:47.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.032+0000 7fef44a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef400cce20 con 0x7fef400cdb70 2024-04-25T09:01:47.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.032+0000 7fef3e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef4015efa0 0x7fef40099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.032+0000 7fef3e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef4015efa0 0x7fef40099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46612/0 (socket says 172.21.15.59:46612) 2024-04-25T09:01:47.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.032+0000 7fef3e800640 1 -- 172.21.15.59:0/2534456469 learned_addr learned my addr 172.21.15.59:0/2534456469 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.032+0000 7fef37e00640 1 --2- 172.21.15.59:0/2534456469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400cdb70 0x7fef40099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef3f200640 1 --2- 172.21.15.59:0/2534456469 >> v2:172.21.15.178:3300/0 conn(0x7fef400b04b0 0x7fef400cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef3e800640 1 -- 172.21.15.59:0/2534456469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400cdb70 msgr2=0x7fef40099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef3e800640 1 --2- 172.21.15.59:0/2534456469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400cdb70 0x7fef40099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef3e800640 1 -- 172.21.15.59:0/2534456469 >> v2:172.21.15.178:3300/0 conn(0x7fef400b04b0 msgr2=0x7fef400cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef3e800640 1 --2- 172.21.15.59:0/2534456469 >> v2:172.21.15.178:3300/0 conn(0x7fef400b04b0 0x7fef400cf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef3e800640 1 -- 172.21.15.59:0/2534456469 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef400cd100 con 0x7fef4015efa0 2024-04-25T09:01:47.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef3f200640 1 --2- 172.21.15.59:0/2534456469 >> v2:172.21.15.178:3300/0 conn(0x7fef400b04b0 0x7fef400cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:47.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef3e800640 1 --2- 172.21.15.59:0/2534456469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef4015efa0 0x7fef40099a60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fef4009f510 tx=0x7fef3001c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d245e2a50b315adf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef3de00640 1 -- 172.21.15.59:0/2534456469 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300b0070 con 0x7fef4015efa0 2024-04-25T09:01:47.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef3de00640 1 -- 172.21.15.59:0/2534456469 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef300ab600 con 0x7fef4015efa0 2024-04-25T09:01:47.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef3de00640 1 -- 172.21.15.59:0/2534456469 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300ab9d0 con 0x7fef4015efa0 2024-04-25T09:01:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef44a00640 1 -- 172.21.15.59:0/2534456469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef4015efa0 msgr2=0x7fef40099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef44a00640 1 --2- 172.21.15.59:0/2534456469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef4015efa0 0x7fef40099a60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fef4009f510 tx=0x7fef3001c1d0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef44a00640 1 -- 172.21.15.59:0/2534456469 shutdown_connections 2024-04-25T09:01:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef44a00640 1 --2- 172.21.15.59:0/2534456469 >> v2:172.21.15.178:3300/0 conn(0x7fef400b04b0 0x7fef400cf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef44a00640 1 --2- 172.21.15.59:0/2534456469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400cdb70 0x7fef40099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef44a00640 1 --2- 172.21.15.59:0/2534456469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef4015efa0 0x7fef40099a60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef44a00640 1 -- 172.21.15.59:0/2534456469 >> 172.21.15.59:0/2534456469 conn(0x7fef400b3050 msgr2=0x7fef400b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef44a00640 1 -- 172.21.15.59:0/2534456469 shutdown_connections 2024-04-25T09:01:47.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.036+0000 7fef44a00640 1 -- 172.21.15.59:0/2534456469 wait complete. 2024-04-25T09:01:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef44a00640 1 Processor -- start 2024-04-25T09:01:47.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef44a00640 1 -- start start 2024-04-25T09:01:47.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef44a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef400b04b0 0x7fef401538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef44a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400cdb70 0x7fef40153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef44a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef4015efa0 0x7fef400b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef44a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef400b11a0 con 0x7fef400b04b0 2024-04-25T09:01:47.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef44a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef400b3dc0 con 0x7fef4015efa0 2024-04-25T09:01:47.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef44a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef400b1320 con 0x7fef400cdb70 2024-04-25T09:01:47.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef3e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef400b04b0 0x7fef401538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef3e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef400b04b0 0x7fef401538d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46624/0 (socket says 172.21.15.59:46624) 2024-04-25T09:01:47.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef3e800640 1 -- 172.21.15.59:0/2774501673 learned_addr learned my addr 172.21.15.59:0/2774501673 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:47.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef3f200640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef4015efa0 0x7fef400b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef37e00640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400cdb70 0x7fef40153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef3e800640 1 -- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400cdb70 msgr2=0x7fef40153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef3e800640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400cdb70 0x7fef40153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef3e800640 1 -- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef4015efa0 msgr2=0x7fef400b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef3e800640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef4015efa0 0x7fef400b18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef3e800640 1 -- 172.21.15.59:0/2774501673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef400b2610 con 0x7fef400b04b0 2024-04-25T09:01:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef3e800640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef400b04b0 0x7fef401538d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fef3001ca70 tx=0x7fef30018f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef36a00640 1 -- 172.21.15.59:0/2774501673 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300b0040 con 0x7fef400b04b0 2024-04-25T09:01:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef36a00640 1 -- 172.21.15.59:0/2774501673 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef300b4640 con 0x7fef400b04b0 2024-04-25T09:01:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef36a00640 1 -- 172.21.15.59:0/2774501673 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef300b4a30 con 0x7fef400b04b0 2024-04-25T09:01:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef44a00640 1 -- 172.21.15.59:0/2774501673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef400b6350 con 0x7fef400b04b0 2024-04-25T09:01:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.040+0000 7fef44a00640 1 -- 172.21.15.59:0/2774501673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef400b6910 con 0x7fef400b04b0 2024-04-25T09:01:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.044+0000 7fef44a00640 1 -- 172.21.15.59:0/2774501673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4004efa0 con 0x7fef400b04b0 2024-04-25T09:01:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.044+0000 7fef36a00640 1 -- 172.21.15.59:0/2774501673 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fef300ab4c0 con 0x7fef400b04b0 2024-04-25T09:01:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.044+0000 7fef36a00640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef1c066f60 0x7fef1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.044+0000 7fef36a00640 1 -- 172.21.15.59:0/2774501673 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fef3011efb0 con 0x7fef400b04b0 2024-04-25T09:01:47.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.044+0000 7fef37e00640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef1c066f60 0x7fef1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.044+0000 7fef37e00640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef1c066f60 0x7fef1c069420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fef400d09c0 tx=0x7fef28008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.048+0000 7fef36a00640 1 -- 172.21.15.59:0/2774501673 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fef30016110 con 0x7fef400b04b0 2024-04-25T09:01:47.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 -- 172.21.15.59:0/2774501673 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef400c59b0 con 0x7fef400b04b0 2024-04-25T09:01:47.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef36a00640 1 -- 172.21.15.59:0/2774501673 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7fef300ba2b0 con 0x7fef400b04b0 2024-04-25T09:01:47.235 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:47.235 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2167197221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2167197221},{"type":"v1","addr":"172.21.15.59:6834","nonce":2167197221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2689387181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2689387181},{"type":"v1","addr":"172.21.15.178:6837","nonce":2689387181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1461695991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1461695991},{"type":"v1","addr":"172.21.15.59:6835","nonce":1461695991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:28.177275+0000","modified":"2024-04-25T09:01:46.237549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/3239224017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3239224017},{"type":"v1","addr":"172.21.15.178:6836","nonce":3239224017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:01:47.235 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2024-04-25T09:01:47.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 -- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef1c066f60 msgr2=0x7fef1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef1c066f60 0x7fef1c069420 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fef400d09c0 tx=0x7fef28008040 comp rx=0 tx=0).stop 2024-04-25T09:01:47.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 -- 172.21.15.59:0/2774501673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef400b04b0 msgr2=0x7fef401538d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef400b04b0 0x7fef401538d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fef3001ca70 tx=0x7fef30018f70 comp rx=0 tx=0).stop 2024-04-25T09:01:47.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 -- 172.21.15.59:0/2774501673 shutdown_connections 2024-04-25T09:01:47.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef1c066f60 0x7fef1c069420 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef4015efa0 0x7fef400b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef400cdb70 0x7fef40153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 --2- 172.21.15.59:0/2774501673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef400b04b0 0x7fef401538d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 -- 172.21.15.59:0/2774501673 >> 172.21.15.59:0/2774501673 conn(0x7fef400b3050 msgr2=0x7fef400af590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:47.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 -- 172.21.15.59:0/2774501673 shutdown_connections 2024-04-25T09:01:47.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.244+0000 7fef44a00640 1 -- 172.21.15.59:0/2774501673 wait complete. 2024-04-25T09:01:47.256 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:47.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.404+0000 7f824ec00640 1 Processor -- start 2024-04-25T09:01:47.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f824ec00640 1 -- start start 2024-04-25T09:01:47.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f824ec00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f824815d7b0 0x7f824815e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f824ec00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8248072ce0 con 0x7f82480b46f0 2024-04-25T09:01:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f824ec00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82480b2dc0 con 0x7f82480669a0 2024-04-25T09:01:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f824ec00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82480b3990 con 0x7f824815d7b0 2024-04-25T09:01:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f824e200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f82480b46f0 0x7f82480adb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41832/0 (socket says 172.21.15.59:41832) 2024-04-25T09:01:47.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f824e200640 1 -- 172.21.15.59:0/2868327876 learned_addr learned my addr 172.21.15.59:0/2868327876 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:47.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f824d800640 1 --2- 172.21.15.59:0/2868327876 >> v2:172.21.15.178:3300/0 conn(0x7f824815d7b0 0x7f824815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f8247e00640 1 -- 172.21.15.59:0/2868327876 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852967334 0 0) 0x7f8248072ce0 con 0x7f82480b46f0 2024-04-25T09:01:47.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f8247e00640 1 -- 172.21.15.59:0/2868327876 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8230003530 con 0x7f82480b46f0 2024-04-25T09:01:47.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f824d800640 1 -- 172.21.15.59:0/2868327876 >> v1:172.21.15.178:6789/0 conn(0x7f82480669a0 legacy=0x7f82480b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f824d800640 1 -- 172.21.15.59:0/2868327876 >> v1:172.21.15.59:6789/0 conn(0x7f82480b46f0 legacy=0x7f82480adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f8247e00640 1 -- 172.21.15.59:0/2868327876 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 61321228 0 0) 0x7f8230003530 con 0x7f82480b46f0 2024-04-25T09:01:47.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.408+0000 7f824d800640 1 -- 172.21.15.59:0/2868327876 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82480b3060 con 0x7f824815d7b0 2024-04-25T09:01:47.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.412+0000 7f824d800640 1 --2- 172.21.15.59:0/2868327876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f824815d7b0 0x7f824815e890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f823c0097c0 tx=0x7f823c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0c3d2adad6d6757 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.412+0000 7f8247e00640 1 -- 172.21.15.59:0/2868327876 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c0b0070 con 0x7f824815d7b0 2024-04-25T09:01:47.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.412+0000 7f8247e00640 1 -- 172.21.15.59:0/2868327876 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c0ab400 con 0x7f824815d7b0 2024-04-25T09:01:47.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.412+0000 7f8247e00640 1 -- 172.21.15.59:0/2868327876 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8240001a00 con 0x7f824815d7b0 2024-04-25T09:01:47.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.412+0000 7f824ec00640 1 -- 172.21.15.59:0/2868327876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f824815d7b0 msgr2=0x7f824815e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.412+0000 7f824ec00640 1 --2- 172.21.15.59:0/2868327876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f824815d7b0 0x7f824815e890 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f823c0097c0 tx=0x7f823c01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.412+0000 7f824ec00640 1 -- 172.21.15.59:0/2868327876 shutdown_connections 2024-04-25T09:01:47.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.412+0000 7f824ec00640 1 --2- 172.21.15.59:0/2868327876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f824815d7b0 0x7f824815e890 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.412+0000 7f824ec00640 1 -- 172.21.15.59:0/2868327876 >> 172.21.15.59:0/2868327876 conn(0x7f82480726f0 msgr2=0x7f824806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:47.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.412+0000 7f824ec00640 1 -- 172.21.15.59:0/2868327876 shutdown_connections 2024-04-25T09:01:47.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.412+0000 7f824ec00640 1 -- 172.21.15.59:0/2868327876 wait complete. 2024-04-25T09:01:47.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ec00640 1 Processor -- start 2024-04-25T09:01:47.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ec00640 1 -- start start 2024-04-25T09:01:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ec00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82480669a0 0x7f82480c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ec00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82480b46f0 0x7f824815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ec00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f824815d7b0 0x7f82481548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ec00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82480aeba0 con 0x7f82480669a0 2024-04-25T09:01:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ec00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82480aea20 con 0x7f82480b46f0 2024-04-25T09:01:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ec00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82480aed20 con 0x7f824815d7b0 2024-04-25T09:01:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82480669a0 0x7f82480c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82480669a0 0x7f82480c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46634/0 (socket says 172.21.15.59:46634) 2024-04-25T09:01:47.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824d800640 1 -- 172.21.15.59:0/1372584258 learned_addr learned my addr 172.21.15.59:0/1372584258 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824e200640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f824815d7b0 0x7f82481548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ce00640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82480b46f0 0x7f824815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824d800640 1 -- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f824815d7b0 msgr2=0x7f82481548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824d800640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f824815d7b0 0x7f82481548b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824d800640 1 -- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82480b46f0 msgr2=0x7f824815bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824d800640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82480b46f0 0x7f824815bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824d800640 1 -- 172.21.15.59:0/1372584258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824815cf40 con 0x7f82480669a0 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ce00640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82480b46f0 0x7f824815bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824e200640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f824815d7b0 0x7f82481548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824d800640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82480669a0 0x7f82480c5b00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f823c0097c0 tx=0x7f823c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f8245600640 1 -- 172.21.15.59:0/1372584258 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c0bb020 con 0x7f82480669a0 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f8245600640 1 -- 172.21.15.59:0/1372584258 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c0b1040 con 0x7f82480669a0 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ec00640 1 -- 172.21.15.59:0/1372584258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824815c6a0 con 0x7f82480669a0 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f8245600640 1 -- 172.21.15.59:0/1372584258 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c0b0050 con 0x7f82480669a0 2024-04-25T09:01:47.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ec00640 1 -- 172.21.15.59:0/1372584258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824815cc60 con 0x7f82480669a0 2024-04-25T09:01:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.416+0000 7f824ec00640 1 -- 172.21.15.59:0/1372584258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f824804efa0 con 0x7f82480669a0 2024-04-25T09:01:47.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.420+0000 7f8245600640 1 -- 172.21.15.59:0/1372584258 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f823c0be070 con 0x7f82480669a0 2024-04-25T09:01:47.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.420+0000 7f8245600640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8228066f60 0x7f8228069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.420+0000 7f8245600640 1 -- 172.21.15.59:0/1372584258 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f823c11eac0 con 0x7f82480669a0 2024-04-25T09:01:47.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.420+0000 7f824ce00640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8228066f60 0x7f8228069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.420+0000 7f824ce00640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8228066f60 0x7f8228069420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f82480c5470 tx=0x7f8234009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.424+0000 7f8245600640 1 -- 172.21.15.59:0/1372584258 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f823c015fb0 con 0x7f82480669a0 2024-04-25T09:01:47.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 -- 172.21.15.59:0/1372584258 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f824806f3a0 con 0x7f82480669a0 2024-04-25T09:01:47.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f8245600640 1 -- 172.21.15.59:0/1372584258 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7f823c11ee20 con 0x7f82480669a0 2024-04-25T09:01:47.583 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:47.583 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 -- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8228066f60 msgr2=0x7f8228069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8228066f60 0x7f8228069420 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f82480c5470 tx=0x7f8234009040 comp rx=0 tx=0).stop 2024-04-25T09:01:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 -- 172.21.15.59:0/1372584258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82480669a0 msgr2=0x7f82480c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82480669a0 0x7f82480c5b00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f823c0097c0 tx=0x7f823c01ac00 comp rx=0 tx=0).stop 2024-04-25T09:01:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 -- 172.21.15.59:0/1372584258 shutdown_connections 2024-04-25T09:01:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8228066f60 0x7f8228069420 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f824815d7b0 0x7f82481548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82480b46f0 0x7f824815bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 --2- 172.21.15.59:0/1372584258 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82480669a0 0x7f82480c5b00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 -- 172.21.15.59:0/1372584258 >> 172.21.15.59:0/1372584258 conn(0x7f82480726f0 msgr2=0x7f82480affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 -- 172.21.15.59:0/1372584258 shutdown_connections 2024-04-25T09:01:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.592+0000 7f824ec00640 1 -- 172.21.15.59:0/1372584258 wait complete. 2024-04-25T09:01:47.605 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:01:47.605 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:47.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe04600640 1 Processor -- start 2024-04-25T09:01:47.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe04600640 1 -- start start 2024-04-25T09:01:47.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe04600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbdfc0cf710 0x7fbdfc06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe04600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbdfc06bb00 0x7fbdfc0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe04600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdfc0b49e0 con 0x7fbdfc15da70 2024-04-25T09:01:47.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe04600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdfc0b4c60 con 0x7fbdfc0cf710 2024-04-25T09:01:47.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe04600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdfc0b4f40 con 0x7fbdfc06bb00 2024-04-25T09:01:47.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe01200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbdfc0cf710 0x7fbdfc06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe01c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbdfc15da70 0x7fbdfc0b3000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41846/0 (socket says 172.21.15.59:41846) 2024-04-25T09:01:47.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe01c00640 1 -- 172.21.15.59:0/1750671215 learned_addr learned my addr 172.21.15.59:0/1750671215 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe02600640 1 --2- 172.21.15.59:0/1750671215 >> v2:172.21.15.178:3300/0 conn(0x7fbdfc06bb00 0x7fbdfc0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbdfbe00640 1 -- 172.21.15.59:0/1750671215 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61436644 0 0) 0x7fbdf0001120 con 0x7fbdfc15da70 2024-04-25T09:01:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe01200640 1 -- 172.21.15.59:0/1750671215 >> v2:172.21.15.178:3300/0 conn(0x7fbdfc06bb00 msgr2=0x7fbdfc0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe01200640 1 --2- 172.21.15.59:0/1750671215 >> v2:172.21.15.178:3300/0 conn(0x7fbdfc06bb00 0x7fbdfc0cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe01200640 1 -- 172.21.15.59:0/1750671215 >> v1:172.21.15.59:6789/0 conn(0x7fbdfc15da70 legacy=0x7fbdfc0b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe01200640 1 -- 172.21.15.59:0/1750671215 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc0ceef0 con 0x7fbdfc0cf710 2024-04-25T09:01:47.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.756+0000 7fbe02600640 1 --2- 172.21.15.59:0/1750671215 >> v2:172.21.15.178:3300/0 conn(0x7fbdfc06bb00 0x7fbdfc0cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.760+0000 7fbe01200640 1 --2- 172.21.15.59:0/1750671215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc0cf710 0x7fbdfc06b5c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0b5220 tx=0x7fbde801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862aca752dfab9fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.760+0000 7fbdfbe00640 1 -- 172.21.15.59:0/1750671215 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde80b0070 con 0x7fbdfc0cf710 2024-04-25T09:01:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.760+0000 7fbdfbe00640 1 -- 172.21.15.59:0/1750671215 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde80ab600 con 0x7fbdfc0cf710 2024-04-25T09:01:47.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.760+0000 7fbdfbe00640 1 -- 172.21.15.59:0/1750671215 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde80ab9d0 con 0x7fbdfc0cf710 2024-04-25T09:01:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.760+0000 7fbe04600640 1 -- 172.21.15.59:0/1750671215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc0cf710 msgr2=0x7fbdfc06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.760+0000 7fbe04600640 1 --2- 172.21.15.59:0/1750671215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc0cf710 0x7fbdfc06b5c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc0b5220 tx=0x7fbde801c3f0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.760+0000 7fbe04600640 1 -- 172.21.15.59:0/1750671215 shutdown_connections 2024-04-25T09:01:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.760+0000 7fbe04600640 1 --2- 172.21.15.59:0/1750671215 >> v2:172.21.15.178:3300/0 conn(0x7fbdfc06bb00 0x7fbdfc0cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.760+0000 7fbe04600640 1 --2- 172.21.15.59:0/1750671215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc0cf710 0x7fbdfc06b5c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.760+0000 7fbe04600640 1 -- 172.21.15.59:0/1750671215 >> 172.21.15.59:0/1750671215 conn(0x7fbdfc0cc810 msgr2=0x7fbdfc0ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.760+0000 7fbe04600640 1 -- 172.21.15.59:0/1750671215 shutdown_connections 2024-04-25T09:01:47.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.760+0000 7fbe04600640 1 -- 172.21.15.59:0/1750671215 wait complete. 2024-04-25T09:01:47.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe04600640 1 Processor -- start 2024-04-25T09:01:47.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe04600640 1 -- start start 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe04600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdfc06bb00 0x7fbdfc06f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe04600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdfc0cf710 0x7fbdfc1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe04600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc15da70 0x7fbdfc155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe04600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc16aa40 con 0x7fbdfc15da70 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe04600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc0cebf0 con 0x7fbdfc0cf710 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe04600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc16abc0 con 0x7fbdfc06bb00 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe02600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc15da70 0x7fbdfc155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe02600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc15da70 0x7fbdfc155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46648/0 (socket says 172.21.15.59:46648) 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe02600640 1 -- 172.21.15.59:0/431277695 learned_addr learned my addr 172.21.15.59:0/431277695 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe01c00640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdfc06bb00 0x7fbdfc06f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe01200640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdfc0cf710 0x7fbdfc1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe02600640 1 -- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdfc06bb00 msgr2=0x7fbdfc06f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe02600640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdfc06bb00 0x7fbdfc06f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe02600640 1 -- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdfc0cf710 msgr2=0x7fbdfc1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe02600640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdfc0cf710 0x7fbdfc1551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe02600640 1 -- 172.21.15.59:0/431277695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc15ae30 con 0x7fbdfc15da70 2024-04-25T09:01:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe01c00640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdfc06bb00 0x7fbdfc06f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe02600640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc15da70 0x7fbdfc155720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400cd50 tx=0x7fbdf400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbdf9600640 1 -- 172.21.15.59:0/431277695 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400f680 con 0x7fbdfc15da70 2024-04-25T09:01:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbdf9600640 1 -- 172.21.15.59:0/431277695 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf400f840 con 0x7fbdfc15da70 2024-04-25T09:01:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbdf9600640 1 -- 172.21.15.59:0/431277695 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf400fc30 con 0x7fbdfc15da70 2024-04-25T09:01:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe04600640 1 -- 172.21.15.59:0/431277695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc15b110 con 0x7fbdfc15da70 2024-04-25T09:01:47.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe04600640 1 -- 172.21.15.59:0/431277695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc15b6d0 con 0x7fbdfc15da70 2024-04-25T09:01:47.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.764+0000 7fbe04600640 1 -- 172.21.15.59:0/431277695 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc0cd6b0 con 0x7fbdfc15da70 2024-04-25T09:01:47.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.768+0000 7fbdf9600640 1 -- 172.21.15.59:0/431277695 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbdf40213f0 con 0x7fbdfc15da70 2024-04-25T09:01:47.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.768+0000 7fbdf9600640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbddc066f60 0x7fbddc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:47.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.768+0000 7fbdf9600640 1 -- 172.21.15.59:0/431277695 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbdf40860f0 con 0x7fbdfc15da70 2024-04-25T09:01:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.768+0000 7fbe01c00640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbddc066f60 0x7fbddc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:47.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.768+0000 7fbe01c00640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbddc066f60 0x7fbddc069420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0000f70 tx=0x7fbdf0007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:47.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.772+0000 7fbdf9600640 1 -- 172.21.15.59:0/431277695 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbdf4014030 con 0x7fbdfc15da70 2024-04-25T09:01:47.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.936+0000 7fbe04600640 1 -- 172.21.15.59:0/431277695 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdfc168710 con 0x7fbddc066f60 2024-04-25T09:01:47.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.948+0000 7fbdf9600640 1 -- 172.21.15.59:0/431277695 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332574 (secure 0 0 0) 0x7fbdfc168710 con 0x7fbddc066f60 2024-04-25T09:01:47.939 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:47.942 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:01:47.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.952+0000 7fbe04600640 1 -- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbddc066f60 msgr2=0x7fbddc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.952+0000 7fbe04600640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbddc066f60 0x7fbddc069420 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0000f70 tx=0x7fbdf0007a40 comp rx=0 tx=0).stop 2024-04-25T09:01:47.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.952+0000 7fbe04600640 1 -- 172.21.15.59:0/431277695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc15da70 msgr2=0x7fbdfc155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:47.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.952+0000 7fbe04600640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc15da70 0x7fbdfc155720 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbdf400cd50 tx=0x7fbdf400a650 comp rx=0 tx=0).stop 2024-04-25T09:01:47.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.952+0000 7fbe04600640 1 -- 172.21.15.59:0/431277695 shutdown_connections 2024-04-25T09:01:47.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.952+0000 7fbe04600640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbddc066f60 0x7fbddc069420 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.952+0000 7fbe04600640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbdfc15da70 0x7fbdfc155720 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.952+0000 7fbe04600640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbdfc0cf710 0x7fbdfc1551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.952+0000 7fbe04600640 1 --2- 172.21.15.59:0/431277695 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbdfc06bb00 0x7fbdfc06f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:47.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.952+0000 7fbe04600640 1 -- 172.21.15.59:0/431277695 >> 172.21.15.59:0/431277695 conn(0x7fbdfc0cc810 msgr2=0x7fbdfc156ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:47.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.952+0000 7fbe04600640 1 -- 172.21.15.59:0/431277695 shutdown_connections 2024-04-25T09:01:47.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:47.952+0000 7fbe04600640 1 -- 172.21.15.59:0/431277695 wait complete. 2024-04-25T09:01:47.961 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-25T09:01:47.652258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223552,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751168,"statfs":{"total":773094113280,"available":772865196032,"internally_reserved":0,"allocated":3284992,"data_stored":1991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003632"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709883+0000","last_change":"2024-04-25T09:01:27.802877+0000","last_active":"2024-04-25T09:01:34.709883+0000","last_peered":"2024-04-25T09:01:34.709883+0000","last_clean":"2024-04-25T09:01:34.709883+0000","last_became_active":"2024-04-25T09:01:27.802618+0000","last_became_peered":"2024-04-25T09:01:27.802618+0000","last_unstale":"2024-04-25T09:01:34.709883+0000","last_undegraded":"2024-04-25T09:01:34.709883+0000","last_fullsized":"2024-04-25T09:01:34.709883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:46.579225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210158+0000","last_change":"2024-04-25T09:01:28.808316+0000","last_active":"2024-04-25T09:01:35.210158+0000","last_peered":"2024-04-25T09:01:35.210158+0000","last_clean":"2024-04-25T09:01:35.210158+0000","last_became_active":"2024-04-25T09:01:28.807978+0000","last_became_peered":"2024-04-25T09:01:28.807978+0000","last_unstale":"2024-04-25T09:01:35.210158+0000","last_undegraded":"2024-04-25T09:01:35.210158+0000","last_fullsized":"2024-04-25T09:01:35.210158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209468+0000","last_change":"2024-04-25T09:01:33.021098+0000","last_active":"2024-04-25T09:01:35.209468+0000","last_peered":"2024-04-25T09:01:35.209468+0000","last_clean":"2024-04-25T09:01:35.209468+0000","last_became_active":"2024-04-25T09:01:33.020732+0000","last_became_peered":"2024-04-25T09:01:33.020732+0000","last_unstale":"2024-04-25T09:01:35.209468+0000","last_undegraded":"2024-04-25T09:01:35.209468+0000","last_fullsized":"2024-04-25T09:01:35.209468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:07.978442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210332+0000","last_change":"2024-04-25T09:01:27.807081+0000","last_active":"2024-04-25T09:01:35.210332+0000","last_peered":"2024-04-25T09:01:35.210332+0000","last_clean":"2024-04-25T09:01:35.210332+0000","last_became_active":"2024-04-25T09:01:27.806124+0000","last_became_peered":"2024-04-25T09:01:27.806124+0000","last_unstale":"2024-04-25T09:01:35.210332+0000","last_undegraded":"2024-04-25T09:01:35.210332+0000","last_fullsized":"2024-04-25T09:01:35.210332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709611+0000","last_change":"2024-04-25T09:01:28.806486+0000","last_active":"2024-04-25T09:01:34.709611+0000","last_peered":"2024-04-25T09:01:34.709611+0000","last_clean":"2024-04-25T09:01:34.709611+0000","last_became_active":"2024-04-25T09:01:28.806206+0000","last_became_peered":"2024-04-25T09:01:28.806206+0000","last_unstale":"2024-04-25T09:01:34.709611+0000","last_undegraded":"2024-04-25T09:01:34.709611+0000","last_fullsized":"2024-04-25T09:01:34.709611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824971+0000","last_change":"2024-04-25T09:01:32.828219+0000","last_active":"2024-04-25T09:01:33.824971+0000","last_peered":"2024-04-25T09:01:33.824971+0000","last_clean":"2024-04-25T09:01:33.824971+0000","last_became_active":"2024-04-25T09:01:32.827815+0000","last_became_peered":"2024-04-25T09:01:32.827815+0000","last_unstale":"2024-04-25T09:01:33.824971+0000","last_undegraded":"2024-04-25T09:01:33.824971+0000","last_fullsized":"2024-04-25T09:01:33.824971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:43.814734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212850+0000","last_change":"2024-04-25T09:01:27.805262+0000","last_active":"2024-04-25T09:01:35.212850+0000","last_peered":"2024-04-25T09:01:35.212850+0000","last_clean":"2024-04-25T09:01:35.212850+0000","last_became_active":"2024-04-25T09:01:27.804980+0000","last_became_peered":"2024-04-25T09:01:27.804980+0000","last_unstale":"2024-04-25T09:01:35.212850+0000","last_undegraded":"2024-04-25T09:01:35.212850+0000","last_fullsized":"2024-04-25T09:01:35.212850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:56.895362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825657+0000","last_change":"2024-04-25T09:01:28.799263+0000","last_active":"2024-04-25T09:01:33.825657+0000","last_peered":"2024-04-25T09:01:33.825657+0000","last_clean":"2024-04-25T09:01:33.825657+0000","last_became_active":"2024-04-25T09:01:28.790548+0000","last_became_peered":"2024-04-25T09:01:28.790548+0000","last_unstale":"2024-04-25T09:01:33.825657+0000","last_undegraded":"2024-04-25T09:01:33.825657+0000","last_fullsized":"2024-04-25T09:01:33.825657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826075+0000","last_change":"2024-04-25T09:01:32.835550+0000","last_active":"2024-04-25T09:01:33.826075+0000","last_peered":"2024-04-25T09:01:33.826075+0000","last_clean":"2024-04-25T09:01:33.826075+0000","last_became_active":"2024-04-25T09:01:32.835109+0000","last_became_peered":"2024-04-25T09:01:32.835109+0000","last_unstale":"2024-04-25T09:01:33.826075+0000","last_undegraded":"2024-04-25T09:01:33.826075+0000","last_fullsized":"2024-04-25T09:01:33.826075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:17.901732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212354+0000","last_change":"2024-04-25T09:01:27.802652+0000","last_active":"2024-04-25T09:01:35.212354+0000","last_peered":"2024-04-25T09:01:35.212354+0000","last_clean":"2024-04-25T09:01:35.212354+0000","last_became_active":"2024-04-25T09:01:27.802321+0000","last_became_peered":"2024-04-25T09:01:27.802321+0000","last_unstale":"2024-04-25T09:01:35.212354+0000","last_undegraded":"2024-04-25T09:01:35.212354+0000","last_fullsized":"2024-04-25T09:01:35.212354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:11.367072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825050+0000","last_change":"2024-04-25T09:01:28.796900+0000","last_active":"2024-04-25T09:01:33.825050+0000","last_peered":"2024-04-25T09:01:33.825050+0000","last_clean":"2024-04-25T09:01:33.825050+0000","last_became_active":"2024-04-25T09:01:28.796459+0000","last_became_peered":"2024-04-25T09:01:28.796459+0000","last_unstale":"2024-04-25T09:01:33.825050+0000","last_undegraded":"2024-04-25T09:01:33.825050+0000","last_fullsized":"2024-04-25T09:01:33.825050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:13.869416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825689+0000","last_change":"2024-04-25T09:01:32.841506+0000","last_active":"2024-04-25T09:01:33.825689+0000","last_peered":"2024-04-25T09:01:33.825689+0000","last_clean":"2024-04-25T09:01:33.825689+0000","last_became_active":"2024-04-25T09:01:32.841067+0000","last_became_peered":"2024-04-25T09:01:32.841067+0000","last_unstale":"2024-04-25T09:01:33.825689+0000","last_undegraded":"2024-04-25T09:01:33.825689+0000","last_fullsized":"2024-04-25T09:01:33.825689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:32.727379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211892+0000","last_change":"2024-04-25T09:01:28.799287+0000","last_active":"2024-04-25T09:01:35.211892+0000","last_peered":"2024-04-25T09:01:35.211892+0000","last_clean":"2024-04-25T09:01:35.211892+0000","last_became_active":"2024-04-25T09:01:28.798965+0000","last_became_peered":"2024-04-25T09:01:28.798965+0000","last_unstale":"2024-04-25T09:01:35.211892+0000","last_undegraded":"2024-04-25T09:01:35.211892+0000","last_fullsized":"2024-04-25T09:01:35.211892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212311+0000","last_change":"2024-04-25T09:01:27.801318+0000","last_active":"2024-04-25T09:01:35.212311+0000","last_peered":"2024-04-25T09:01:35.212311+0000","last_clean":"2024-04-25T09:01:35.212311+0000","last_became_active":"2024-04-25T09:01:27.801007+0000","last_became_peered":"2024-04-25T09:01:27.801007+0000","last_unstale":"2024-04-25T09:01:35.212311+0000","last_undegraded":"2024-04-25T09:01:35.212311+0000","last_fullsized":"2024-04-25T09:01:35.212311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:55.635349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826766+0000","last_change":"2024-04-25T09:01:32.838021+0000","last_active":"2024-04-25T09:01:33.826766+0000","last_peered":"2024-04-25T09:01:33.826766+0000","last_clean":"2024-04-25T09:01:33.826766+0000","last_became_active":"2024-04-25T09:01:32.837635+0000","last_became_peered":"2024-04-25T09:01:32.837635+0000","last_unstale":"2024-04-25T09:01:33.826766+0000","last_undegraded":"2024-04-25T09:01:33.826766+0000","last_fullsized":"2024-04-25T09:01:33.826766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:50.922350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209879+0000","last_change":"2024-04-25T09:01:28.802944+0000","last_active":"2024-04-25T09:01:35.209879+0000","last_peered":"2024-04-25T09:01:35.209879+0000","last_clean":"2024-04-25T09:01:35.209879+0000","last_became_active":"2024-04-25T09:01:28.801259+0000","last_became_peered":"2024-04-25T09:01:28.801259+0000","last_unstale":"2024-04-25T09:01:35.209879+0000","last_undegraded":"2024-04-25T09:01:35.209879+0000","last_fullsized":"2024-04-25T09:01:35.209879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366553+0000","last_change":"2024-04-25T09:01:27.794293+0000","last_active":"2024-04-25T09:01:34.366553+0000","last_peered":"2024-04-25T09:01:34.366553+0000","last_clean":"2024-04-25T09:01:34.366553+0000","last_became_active":"2024-04-25T09:01:27.794093+0000","last_became_peered":"2024-04-25T09:01:27.794093+0000","last_unstale":"2024-04-25T09:01:34.366553+0000","last_undegraded":"2024-04-25T09:01:34.366553+0000","last_fullsized":"2024-04-25T09:01:34.366553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826446+0000","last_change":"2024-04-25T09:01:32.835417+0000","last_active":"2024-04-25T09:01:33.826446+0000","last_peered":"2024-04-25T09:01:33.826446+0000","last_clean":"2024-04-25T09:01:33.826446+0000","last_became_active":"2024-04-25T09:01:32.834900+0000","last_became_peered":"2024-04-25T09:01:32.834900+0000","last_unstale":"2024-04-25T09:01:33.826446+0000","last_undegraded":"2024-04-25T09:01:33.826446+0000","last_fullsized":"2024-04-25T09:01:33.826446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:12.234115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209538+0000","last_change":"2024-04-25T09:01:28.807676+0000","last_active":"2024-04-25T09:01:35.209538+0000","last_peered":"2024-04-25T09:01:35.209538+0000","last_clean":"2024-04-25T09:01:35.209538+0000","last_became_active":"2024-04-25T09:01:28.807412+0000","last_became_peered":"2024-04-25T09:01:28.807412+0000","last_unstale":"2024-04-25T09:01:35.209538+0000","last_undegraded":"2024-04-25T09:01:35.209538+0000","last_fullsized":"2024-04-25T09:01:35.209538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366319+0000","last_change":"2024-04-25T09:01:27.792801+0000","last_active":"2024-04-25T09:01:34.366319+0000","last_peered":"2024-04-25T09:01:34.366319+0000","last_clean":"2024-04-25T09:01:34.366319+0000","last_became_active":"2024-04-25T09:01:27.792478+0000","last_became_peered":"2024-04-25T09:01:27.792478+0000","last_unstale":"2024-04-25T09:01:34.366319+0000","last_undegraded":"2024-04-25T09:01:34.366319+0000","last_fullsized":"2024-04-25T09:01:34.366319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:05.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.367126+0000","last_change":"2024-04-25T09:01:33.016837+0000","last_active":"2024-04-25T09:01:34.367126+0000","last_peered":"2024-04-25T09:01:34.367126+0000","last_clean":"2024-04-25T09:01:34.367126+0000","last_became_active":"2024-04-25T09:01:33.016394+0000","last_became_peered":"2024-04-25T09:01:33.016394+0000","last_unstale":"2024-04-25T09:01:34.367126+0000","last_undegraded":"2024-04-25T09:01:34.367126+0000","last_fullsized":"2024-04-25T09:01:34.367126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:10.891366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825930+0000","last_change":"2024-04-25T09:01:28.797789+0000","last_active":"2024-04-25T09:01:33.825930+0000","last_peered":"2024-04-25T09:01:33.825930+0000","last_clean":"2024-04-25T09:01:33.825930+0000","last_became_active":"2024-04-25T09:01:28.794550+0000","last_became_peered":"2024-04-25T09:01:28.794550+0000","last_unstale":"2024-04-25T09:01:33.825930+0000","last_undegraded":"2024-04-25T09:01:33.825930+0000","last_fullsized":"2024-04-25T09:01:33.825930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:38.459019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211810+0000","last_change":"2024-04-25T09:01:27.807626+0000","last_active":"2024-04-25T09:01:35.211810+0000","last_peered":"2024-04-25T09:01:35.211810+0000","last_clean":"2024-04-25T09:01:35.211810+0000","last_became_active":"2024-04-25T09:01:27.807340+0000","last_became_peered":"2024-04-25T09:01:27.807340+0000","last_unstale":"2024-04-25T09:01:35.211810+0000","last_undegraded":"2024-04-25T09:01:35.211810+0000","last_fullsized":"2024-04-25T09:01:35.211810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:05.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826818+0000","last_change":"2024-04-25T09:01:32.835653+0000","last_active":"2024-04-25T09:01:33.826818+0000","last_peered":"2024-04-25T09:01:33.826818+0000","last_clean":"2024-04-25T09:01:33.826818+0000","last_became_active":"2024-04-25T09:01:32.834905+0000","last_became_peered":"2024-04-25T09:01:32.834905+0000","last_unstale":"2024-04-25T09:01:33.826818+0000","last_undegraded":"2024-04-25T09:01:33.826818+0000","last_fullsized":"2024-04-25T09:01:33.826818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:28.511146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709868+0000","last_change":"2024-04-25T09:01:28.808561+0000","last_active":"2024-04-25T09:01:34.709868+0000","last_peered":"2024-04-25T09:01:34.709868+0000","last_clean":"2024-04-25T09:01:34.709868+0000","last_became_active":"2024-04-25T09:01:28.808259+0000","last_became_peered":"2024-04-25T09:01:28.808259+0000","last_unstale":"2024-04-25T09:01:34.709868+0000","last_undegraded":"2024-04-25T09:01:34.709868+0000","last_fullsized":"2024-04-25T09:01:34.709868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213361+0000","last_change":"2024-04-25T09:01:27.796535+0000","last_active":"2024-04-25T09:01:35.213361+0000","last_peered":"2024-04-25T09:01:35.213361+0000","last_clean":"2024-04-25T09:01:35.213361+0000","last_became_active":"2024-04-25T09:01:27.794550+0000","last_became_peered":"2024-04-25T09:01:27.794550+0000","last_unstale":"2024-04-25T09:01:35.213361+0000","last_undegraded":"2024-04-25T09:01:35.213361+0000","last_fullsized":"2024-04-25T09:01:35.213361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825685+0000","last_change":"2024-04-25T09:01:33.017620+0000","last_active":"2024-04-25T09:01:33.825685+0000","last_peered":"2024-04-25T09:01:33.825685+0000","last_clean":"2024-04-25T09:01:33.825685+0000","last_became_active":"2024-04-25T09:01:33.017217+0000","last_became_peered":"2024-04-25T09:01:33.017217+0000","last_unstale":"2024-04-25T09:01:33.825685+0000","last_undegraded":"2024-04-25T09:01:33.825685+0000","last_fullsized":"2024-04-25T09:01:33.825685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:49.256635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210450+0000","last_change":"2024-04-25T09:01:28.800633+0000","last_active":"2024-04-25T09:01:35.210450+0000","last_peered":"2024-04-25T09:01:35.210450+0000","last_clean":"2024-04-25T09:01:35.210450+0000","last_became_active":"2024-04-25T09:01:28.800261+0000","last_became_peered":"2024-04-25T09:01:28.800261+0000","last_unstale":"2024-04-25T09:01:35.210450+0000","last_undegraded":"2024-04-25T09:01:35.210450+0000","last_fullsized":"2024-04-25T09:01:35.210450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:45.224319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.367056+0000","last_change":"2024-04-25T09:01:27.801362+0000","last_active":"2024-04-25T09:01:34.367056+0000","last_peered":"2024-04-25T09:01:34.367056+0000","last_clean":"2024-04-25T09:01:34.367056+0000","last_became_active":"2024-04-25T09:01:27.800960+0000","last_became_peered":"2024-04-25T09:01:27.800960+0000","last_unstale":"2024-04-25T09:01:34.367056+0000","last_undegraded":"2024-04-25T09:01:34.367056+0000","last_fullsized":"2024-04-25T09:01:34.367056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209644+0000","last_change":"2024-04-25T09:01:33.014181+0000","last_active":"2024-04-25T09:01:35.209644+0000","last_peered":"2024-04-25T09:01:35.209644+0000","last_clean":"2024-04-25T09:01:35.209644+0000","last_became_active":"2024-04-25T09:01:33.013656+0000","last_became_peered":"2024-04-25T09:01:33.013656+0000","last_unstale":"2024-04-25T09:01:35.209644+0000","last_undegraded":"2024-04-25T09:01:35.209644+0000","last_fullsized":"2024-04-25T09:01:35.209644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:05.608973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366825+0000","last_change":"2024-04-25T09:01:28.801779+0000","last_active":"2024-04-25T09:01:34.366825+0000","last_peered":"2024-04-25T09:01:34.366825+0000","last_clean":"2024-04-25T09:01:34.366825+0000","last_became_active":"2024-04-25T09:01:28.801429+0000","last_became_peered":"2024-04-25T09:01:28.801429+0000","last_unstale":"2024-04-25T09:01:34.366825+0000","last_undegraded":"2024-04-25T09:01:34.366825+0000","last_fullsized":"2024-04-25T09:01:34.366825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212914+0000","last_change":"2024-04-25T09:01:27.812215+0000","last_active":"2024-04-25T09:01:35.212914+0000","last_peered":"2024-04-25T09:01:35.212914+0000","last_clean":"2024-04-25T09:01:35.212914+0000","last_became_active":"2024-04-25T09:01:27.811906+0000","last_became_peered":"2024-04-25T09:01:27.811906+0000","last_unstale":"2024-04-25T09:01:35.212914+0000","last_undegraded":"2024-04-25T09:01:35.212914+0000","last_fullsized":"2024-04-25T09:01:35.212914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:40.543447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709529+0000","last_change":"2024-04-25T09:01:33.012476+0000","last_active":"2024-04-25T09:01:34.709529+0000","last_peered":"2024-04-25T09:01:34.709529+0000","last_clean":"2024-04-25T09:01:34.709529+0000","last_became_active":"2024-04-25T09:01:33.012051+0000","last_became_peered":"2024-04-25T09:01:33.012051+0000","last_unstale":"2024-04-25T09:01:34.709529+0000","last_undegraded":"2024-04-25T09:01:34.709529+0000","last_fullsized":"2024-04-25T09:01:34.709529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:10.891366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825182+0000","last_change":"2024-04-25T09:01:28.796673+0000","last_active":"2024-04-25T09:01:33.825182+0000","last_peered":"2024-04-25T09:01:33.825182+0000","last_clean":"2024-04-25T09:01:33.825182+0000","last_became_active":"2024-04-25T09:01:28.796137+0000","last_became_peered":"2024-04-25T09:01:28.796137+0000","last_unstale":"2024-04-25T09:01:33.825182+0000","last_undegraded":"2024-04-25T09:01:33.825182+0000","last_fullsized":"2024-04-25T09:01:33.825182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:24.478830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366854+0000","last_change":"2024-04-25T09:01:27.806338+0000","last_active":"2024-04-25T09:01:34.366854+0000","last_peered":"2024-04-25T09:01:34.366854+0000","last_clean":"2024-04-25T09:01:34.366854+0000","last_became_active":"2024-04-25T09:01:27.806001+0000","last_became_peered":"2024-04-25T09:01:27.806001+0000","last_unstale":"2024-04-25T09:01:34.366854+0000","last_undegraded":"2024-04-25T09:01:34.366854+0000","last_fullsized":"2024-04-25T09:01:34.366854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366354+0000","last_change":"2024-04-25T09:01:32.842661+0000","last_active":"2024-04-25T09:01:34.366354+0000","last_peered":"2024-04-25T09:01:34.366354+0000","last_clean":"2024-04-25T09:01:34.366354+0000","last_became_active":"2024-04-25T09:01:32.840675+0000","last_became_peered":"2024-04-25T09:01:32.840675+0000","last_unstale":"2024-04-25T09:01:34.366354+0000","last_undegraded":"2024-04-25T09:01:34.366354+0000","last_fullsized":"2024-04-25T09:01:34.366354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:28.511146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826233+0000","last_change":"2024-04-25T09:01:28.808388+0000","last_active":"2024-04-25T09:01:33.826233+0000","last_peered":"2024-04-25T09:01:33.826233+0000","last_clean":"2024-04-25T09:01:33.826233+0000","last_became_active":"2024-04-25T09:01:28.808066+0000","last_became_peered":"2024-04-25T09:01:28.808066+0000","last_unstale":"2024-04-25T09:01:33.826233+0000","last_undegraded":"2024-04-25T09:01:33.826233+0000","last_fullsized":"2024-04-25T09:01:33.826233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:25.394669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825354+0000","last_change":"2024-04-25T09:01:27.791322+0000","last_active":"2024-04-25T09:01:33.825354+0000","last_peered":"2024-04-25T09:01:33.825354+0000","last_clean":"2024-04-25T09:01:33.825354+0000","last_became_active":"2024-04-25T09:01:27.790832+0000","last_became_peered":"2024-04-25T09:01:27.790832+0000","last_unstale":"2024-04-25T09:01:33.825354+0000","last_undegraded":"2024-04-25T09:01:33.825354+0000","last_fullsized":"2024-04-25T09:01:33.825354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366775+0000","last_change":"2024-04-25T09:01:32.833388+0000","last_active":"2024-04-25T09:01:34.366775+0000","last_peered":"2024-04-25T09:01:34.366775+0000","last_clean":"2024-04-25T09:01:34.366775+0000","last_became_active":"2024-04-25T09:01:32.832933+0000","last_became_peered":"2024-04-25T09:01:32.832933+0000","last_unstale":"2024-04-25T09:01:34.366775+0000","last_undegraded":"2024-04-25T09:01:34.366775+0000","last_fullsized":"2024-04-25T09:01:34.366775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366415+0000","last_change":"2024-04-25T09:01:28.808496+0000","last_active":"2024-04-25T09:01:34.366415+0000","last_peered":"2024-04-25T09:01:34.366415+0000","last_clean":"2024-04-25T09:01:34.366415+0000","last_became_active":"2024-04-25T09:01:28.808041+0000","last_became_peered":"2024-04-25T09:01:28.808041+0000","last_unstale":"2024-04-25T09:01:34.366415+0000","last_undegraded":"2024-04-25T09:01:34.366415+0000","last_fullsized":"2024-04-25T09:01:34.366415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821744+0000","last_change":"2024-04-25T09:01:27.794633+0000","last_active":"2024-04-25T09:01:33.821744+0000","last_peered":"2024-04-25T09:01:33.821744+0000","last_clean":"2024-04-25T09:01:33.821744+0000","last_became_active":"2024-04-25T09:01:27.794353+0000","last_became_peered":"2024-04-25T09:01:27.794353+0000","last_unstale":"2024-04-25T09:01:33.821744+0000","last_undegraded":"2024-04-25T09:01:33.821744+0000","last_fullsized":"2024-04-25T09:01:33.821744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.367203+0000","last_change":"2024-04-25T09:01:32.841897+0000","last_active":"2024-04-25T09:01:34.367203+0000","last_peered":"2024-04-25T09:01:34.367203+0000","last_clean":"2024-04-25T09:01:34.367203+0000","last_became_active":"2024-04-25T09:01:32.840196+0000","last_became_peered":"2024-04-25T09:01:32.840196+0000","last_unstale":"2024-04-25T09:01:34.367203+0000","last_undegraded":"2024-04-25T09:01:34.367203+0000","last_fullsized":"2024-04-25T09:01:34.367203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:35.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.708999+0000","last_change":"2024-04-25T09:01:28.791325+0000","last_active":"2024-04-25T09:01:34.708999+0000","last_peered":"2024-04-25T09:01:34.708999+0000","last_clean":"2024-04-25T09:01:34.708999+0000","last_became_active":"2024-04-25T09:01:28.791016+0000","last_became_peered":"2024-04-25T09:01:28.791016+0000","last_unstale":"2024-04-25T09:01:34.708999+0000","last_undegraded":"2024-04-25T09:01:34.708999+0000","last_fullsized":"2024-04-25T09:01:34.708999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:57.905760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211553+0000","last_change":"2024-04-25T09:01:27.799619+0000","last_active":"2024-04-25T09:01:35.211553+0000","last_peered":"2024-04-25T09:01:35.211553+0000","last_clean":"2024-04-25T09:01:35.211553+0000","last_became_active":"2024-04-25T09:01:27.799353+0000","last_became_peered":"2024-04-25T09:01:27.799353+0000","last_unstale":"2024-04-25T09:01:35.211553+0000","last_undegraded":"2024-04-25T09:01:35.211553+0000","last_fullsized":"2024-04-25T09:01:35.211553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709772+0000","last_change":"2024-04-25T09:01:33.017927+0000","last_active":"2024-04-25T09:01:34.709772+0000","last_peered":"2024-04-25T09:01:34.709772+0000","last_clean":"2024-04-25T09:01:34.709772+0000","last_became_active":"2024-04-25T09:01:33.017228+0000","last_became_peered":"2024-04-25T09:01:33.017228+0000","last_unstale":"2024-04-25T09:01:34.709772+0000","last_undegraded":"2024-04-25T09:01:34.709772+0000","last_fullsized":"2024-04-25T09:01:34.709772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.980668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209536+0000","last_change":"2024-04-25T09:01:28.797698+0000","last_active":"2024-04-25T09:01:35.209536+0000","last_peered":"2024-04-25T09:01:35.209536+0000","last_clean":"2024-04-25T09:01:35.209536+0000","last_became_active":"2024-04-25T09:01:28.797432+0000","last_became_peered":"2024-04-25T09:01:28.797432+0000","last_unstale":"2024-04-25T09:01:35.209536+0000","last_undegraded":"2024-04-25T09:01:35.209536+0000","last_fullsized":"2024-04-25T09:01:35.209536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824821+0000","last_change":"2024-04-25T09:01:27.786713+0000","last_active":"2024-04-25T09:01:33.824821+0000","last_peered":"2024-04-25T09:01:33.824821+0000","last_clean":"2024-04-25T09:01:33.824821+0000","last_became_active":"2024-04-25T09:01:27.786382+0000","last_became_peered":"2024-04-25T09:01:27.786382+0000","last_unstale":"2024-04-25T09:01:33.824821+0000","last_undegraded":"2024-04-25T09:01:33.824821+0000","last_fullsized":"2024-04-25T09:01:33.824821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211687+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:01:35.211687+0000","last_peered":"2024-04-25T09:01:35.211687+0000","last_clean":"2024-04-25T09:01:35.211687+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:01:35.211687+0000","last_undegraded":"2024-04-25T09:01:35.211687+0000","last_fullsized":"2024-04-25T09:01:35.211687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213128+0000","last_change":"2024-04-25T09:01:33.018970+0000","last_active":"2024-04-25T09:01:35.213128+0000","last_peered":"2024-04-25T09:01:35.213128+0000","last_clean":"2024-04-25T09:01:35.213128+0000","last_became_active":"2024-04-25T09:01:33.018274+0000","last_became_peered":"2024-04-25T09:01:33.018274+0000","last_unstale":"2024-04-25T09:01:35.213128+0000","last_undegraded":"2024-04-25T09:01:35.213128+0000","last_fullsized":"2024-04-25T09:01:35.213128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212686+0000","last_change":"2024-04-25T09:01:28.821408+0000","last_active":"2024-04-25T09:01:35.212686+0000","last_peered":"2024-04-25T09:01:35.212686+0000","last_clean":"2024-04-25T09:01:35.212686+0000","last_became_active":"2024-04-25T09:01:28.821141+0000","last_became_peered":"2024-04-25T09:01:28.821141+0000","last_unstale":"2024-04-25T09:01:35.212686+0000","last_undegraded":"2024-04-25T09:01:35.212686+0000","last_fullsized":"2024-04-25T09:01:35.212686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:33.239521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821975+0000","last_change":"2024-04-25T09:01:27.789772+0000","last_active":"2024-04-25T09:01:33.821975+0000","last_peered":"2024-04-25T09:01:33.821975+0000","last_clean":"2024-04-25T09:01:33.821975+0000","last_became_active":"2024-04-25T09:01:27.789396+0000","last_became_peered":"2024-04-25T09:01:27.789396+0000","last_unstale":"2024-04-25T09:01:33.821975+0000","last_undegraded":"2024-04-25T09:01:33.821975+0000","last_fullsized":"2024-04-25T09:01:33.821975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212034+0000","last_change":"2024-04-25T09:01:33.015998+0000","last_active":"2024-04-25T09:01:35.212034+0000","last_peered":"2024-04-25T09:01:35.212034+0000","last_clean":"2024-04-25T09:01:35.212034+0000","last_became_active":"2024-04-25T09:01:33.015527+0000","last_became_peered":"2024-04-25T09:01:33.015527+0000","last_unstale":"2024-04-25T09:01:35.212034+0000","last_undegraded":"2024-04-25T09:01:35.212034+0000","last_fullsized":"2024-04-25T09:01:35.212034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:28.511146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825725+0000","last_change":"2024-04-25T09:01:28.799867+0000","last_active":"2024-04-25T09:01:33.825725+0000","last_peered":"2024-04-25T09:01:33.825725+0000","last_clean":"2024-04-25T09:01:33.825725+0000","last_became_active":"2024-04-25T09:01:28.799555+0000","last_became_peered":"2024-04-25T09:01:28.799555+0000","last_unstale":"2024-04-25T09:01:33.825725+0000","last_undegraded":"2024-04-25T09:01:33.825725+0000","last_fullsized":"2024-04-25T09:01:33.825725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:46.890034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366891+0000","last_change":"2024-04-25T09:01:27.799345+0000","last_active":"2024-04-25T09:01:34.366891+0000","last_peered":"2024-04-25T09:01:34.366891+0000","last_clean":"2024-04-25T09:01:34.366891+0000","last_became_active":"2024-04-25T09:01:27.799041+0000","last_became_peered":"2024-04-25T09:01:27.799041+0000","last_unstale":"2024-04-25T09:01:34.366891+0000","last_undegraded":"2024-04-25T09:01:34.366891+0000","last_fullsized":"2024-04-25T09:01:34.366891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709467+0000","last_change":"2024-04-25T09:01:32.848657+0000","last_active":"2024-04-25T09:01:34.709467+0000","last_peered":"2024-04-25T09:01:34.709467+0000","last_clean":"2024-04-25T09:01:34.709467+0000","last_became_active":"2024-04-25T09:01:32.848154+0000","last_became_peered":"2024-04-25T09:01:32.848154+0000","last_unstale":"2024-04-25T09:01:34.709467+0000","last_undegraded":"2024-04-25T09:01:34.709467+0000","last_fullsized":"2024-04-25T09:01:34.709467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213067+0000","last_change":"2024-04-25T09:01:28.816736+0000","last_active":"2024-04-25T09:01:35.213067+0000","last_peered":"2024-04-25T09:01:35.213067+0000","last_clean":"2024-04-25T09:01:35.213067+0000","last_became_active":"2024-04-25T09:01:28.814910+0000","last_became_peered":"2024-04-25T09:01:28.814910+0000","last_unstale":"2024-04-25T09:01:35.213067+0000","last_undegraded":"2024-04-25T09:01:35.213067+0000","last_fullsized":"2024-04-25T09:01:35.213067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:03.946126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.822115+0000","last_change":"2024-04-25T09:01:27.791793+0000","last_active":"2024-04-25T09:01:33.822115+0000","last_peered":"2024-04-25T09:01:33.822115+0000","last_clean":"2024-04-25T09:01:33.822115+0000","last_became_active":"2024-04-25T09:01:27.791559+0000","last_became_peered":"2024-04-25T09:01:27.791559+0000","last_unstale":"2024-04-25T09:01:33.822115+0000","last_undegraded":"2024-04-25T09:01:33.822115+0000","last_fullsized":"2024-04-25T09:01:33.822115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824560+0000","last_change":"2024-04-25T09:01:33.014380+0000","last_active":"2024-04-25T09:01:33.824560+0000","last_peered":"2024-04-25T09:01:33.824560+0000","last_clean":"2024-04-25T09:01:33.824560+0000","last_became_active":"2024-04-25T09:01:33.013885+0000","last_became_peered":"2024-04-25T09:01:33.013885+0000","last_unstale":"2024-04-25T09:01:33.824560+0000","last_undegraded":"2024-04-25T09:01:33.824560+0000","last_fullsized":"2024-04-25T09:01:33.824560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:43.548883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212597+0000","last_change":"2024-04-25T09:01:28.818477+0000","last_active":"2024-04-25T09:01:35.212597+0000","last_peered":"2024-04-25T09:01:35.212597+0000","last_clean":"2024-04-25T09:01:35.212597+0000","last_became_active":"2024-04-25T09:01:28.815329+0000","last_became_peered":"2024-04-25T09:01:28.815329+0000","last_unstale":"2024-04-25T09:01:35.212597+0000","last_undegraded":"2024-04-25T09:01:35.212597+0000","last_fullsized":"2024-04-25T09:01:35.212597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:31.277254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.827013+0000","last_change":"2024-04-25T09:01:27.803319+0000","last_active":"2024-04-25T09:01:33.827013+0000","last_peered":"2024-04-25T09:01:33.827013+0000","last_clean":"2024-04-25T09:01:33.827013+0000","last_became_active":"2024-04-25T09:01:27.802815+0000","last_became_peered":"2024-04-25T09:01:27.802815+0000","last_unstale":"2024-04-25T09:01:33.827013+0000","last_undegraded":"2024-04-25T09:01:33.827013+0000","last_fullsized":"2024-04-25T09:01:33.827013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:51.791461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825394+0000","last_change":"2024-04-25T09:01:32.836009+0000","last_active":"2024-04-25T09:01:33.825394+0000","last_peered":"2024-04-25T09:01:33.825394+0000","last_clean":"2024-04-25T09:01:33.825394+0000","last_became_active":"2024-04-25T09:01:32.835471+0000","last_became_peered":"2024-04-25T09:01:32.835471+0000","last_unstale":"2024-04-25T09:01:33.825394+0000","last_undegraded":"2024-04-25T09:01:33.825394+0000","last_fullsized":"2024-04-25T09:01:33.825394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:59.537310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211909+0000","last_change":"2024-04-25T09:01:28.814374+0000","last_active":"2024-04-25T09:01:35.211909+0000","last_peered":"2024-04-25T09:01:35.211909+0000","last_clean":"2024-04-25T09:01:35.211909+0000","last_became_active":"2024-04-25T09:01:28.813316+0000","last_became_peered":"2024-04-25T09:01:28.813316+0000","last_unstale":"2024-04-25T09:01:35.211909+0000","last_undegraded":"2024-04-25T09:01:35.211909+0000","last_fullsized":"2024-04-25T09:01:35.211909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:06.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821520+0000","last_change":"2024-04-25T09:01:27.787446+0000","last_active":"2024-04-25T09:01:33.821520+0000","last_peered":"2024-04-25T09:01:33.821520+0000","last_clean":"2024-04-25T09:01:33.821520+0000","last_became_active":"2024-04-25T09:01:27.787231+0000","last_became_peered":"2024-04-25T09:01:27.787231+0000","last_unstale":"2024-04-25T09:01:33.821520+0000","last_undegraded":"2024-04-25T09:01:33.821520+0000","last_fullsized":"2024-04-25T09:01:33.821520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709640+0000","last_change":"2024-04-25T09:01:32.837266+0000","last_active":"2024-04-25T09:01:34.709640+0000","last_peered":"2024-04-25T09:01:34.709640+0000","last_clean":"2024-04-25T09:01:34.709640+0000","last_became_active":"2024-04-25T09:01:32.836642+0000","last_became_peered":"2024-04-25T09:01:32.836642+0000","last_unstale":"2024-04-25T09:01:34.709640+0000","last_undegraded":"2024-04-25T09:01:34.709640+0000","last_fullsized":"2024-04-25T09:01:34.709640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:35.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211856+0000","last_change":"2024-04-25T09:01:28.800379+0000","last_active":"2024-04-25T09:01:35.211856+0000","last_peered":"2024-04-25T09:01:35.211856+0000","last_clean":"2024-04-25T09:01:35.211856+0000","last_became_active":"2024-04-25T09:01:28.800083+0000","last_became_peered":"2024-04-25T09:01:28.800083+0000","last_unstale":"2024-04-25T09:01:35.211856+0000","last_undegraded":"2024-04-25T09:01:35.211856+0000","last_fullsized":"2024-04-25T09:01:35.211856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212519+0000","last_change":"2024-04-25T09:01:27.795530+0000","last_active":"2024-04-25T09:01:35.212519+0000","last_peered":"2024-04-25T09:01:35.212519+0000","last_clean":"2024-04-25T09:01:35.212519+0000","last_became_active":"2024-04-25T09:01:27.795206+0000","last_became_peered":"2024-04-25T09:01:27.795206+0000","last_unstale":"2024-04-25T09:01:35.212519+0000","last_undegraded":"2024-04-25T09:01:35.212519+0000","last_fullsized":"2024-04-25T09:01:35.212519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:05.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210403+0000","last_change":"2024-04-25T09:01:33.016132+0000","last_active":"2024-04-25T09:01:35.210403+0000","last_peered":"2024-04-25T09:01:35.210403+0000","last_clean":"2024-04-25T09:01:35.210403+0000","last_became_active":"2024-04-25T09:01:33.015731+0000","last_became_peered":"2024-04-25T09:01:33.015731+0000","last_unstale":"2024-04-25T09:01:35.210403+0000","last_undegraded":"2024-04-25T09:01:35.210403+0000","last_fullsized":"2024-04-25T09:01:35.210403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:50.222305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212180+0000","last_change":"2024-04-25T09:01:28.815186+0000","last_active":"2024-04-25T09:01:35.212180+0000","last_peered":"2024-04-25T09:01:35.212180+0000","last_clean":"2024-04-25T09:01:35.212180+0000","last_became_active":"2024-04-25T09:01:28.814898+0000","last_became_peered":"2024-04-25T09:01:28.814898+0000","last_unstale":"2024-04-25T09:01:35.212180+0000","last_undegraded":"2024-04-25T09:01:35.212180+0000","last_fullsized":"2024-04-25T09:01:35.212180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:06.715519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825295+0000","last_change":"2024-04-25T09:01:27.795891+0000","last_active":"2024-04-25T09:01:33.825295+0000","last_peered":"2024-04-25T09:01:33.825295+0000","last_clean":"2024-04-25T09:01:33.825295+0000","last_became_active":"2024-04-25T09:01:27.795562+0000","last_became_peered":"2024-04-25T09:01:27.795562+0000","last_unstale":"2024-04-25T09:01:33.825295+0000","last_undegraded":"2024-04-25T09:01:33.825295+0000","last_fullsized":"2024-04-25T09:01:33.825295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210193+0000","last_change":"2024-04-25T09:01:33.014268+0000","last_active":"2024-04-25T09:01:35.210193+0000","last_peered":"2024-04-25T09:01:35.210193+0000","last_clean":"2024-04-25T09:01:35.210193+0000","last_became_active":"2024-04-25T09:01:33.013631+0000","last_became_peered":"2024-04-25T09:01:33.013631+0000","last_unstale":"2024-04-25T09:01:35.210193+0000","last_undegraded":"2024-04-25T09:01:35.210193+0000","last_fullsized":"2024-04-25T09:01:35.210193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:53.678828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709267+0000","last_change":"2024-04-25T09:01:28.805284+0000","last_active":"2024-04-25T09:01:34.709267+0000","last_peered":"2024-04-25T09:01:34.709267+0000","last_clean":"2024-04-25T09:01:34.709267+0000","last_became_active":"2024-04-25T09:01:28.804641+0000","last_became_peered":"2024-04-25T09:01:28.804641+0000","last_unstale":"2024-04-25T09:01:34.709267+0000","last_undegraded":"2024-04-25T09:01:34.709267+0000","last_fullsized":"2024-04-25T09:01:34.709267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:45.827977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709703+0000","last_change":"2024-04-25T09:01:27.803192+0000","last_active":"2024-04-25T09:01:34.709703+0000","last_peered":"2024-04-25T09:01:34.709703+0000","last_clean":"2024-04-25T09:01:34.709703+0000","last_became_active":"2024-04-25T09:01:27.802987+0000","last_became_peered":"2024-04-25T09:01:27.802987+0000","last_unstale":"2024-04-25T09:01:34.709703+0000","last_undegraded":"2024-04-25T09:01:34.709703+0000","last_fullsized":"2024-04-25T09:01:34.709703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:09.133960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825159+0000","last_change":"2024-04-25T09:01:33.017405+0000","last_active":"2024-04-25T09:01:33.825159+0000","last_peered":"2024-04-25T09:01:33.825159+0000","last_clean":"2024-04-25T09:01:33.825159+0000","last_became_active":"2024-04-25T09:01:33.016855+0000","last_became_peered":"2024-04-25T09:01:33.016855+0000","last_unstale":"2024-04-25T09:01:33.825159+0000","last_undegraded":"2024-04-25T09:01:33.825159+0000","last_fullsized":"2024-04-25T09:01:33.825159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:24.797218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212580+0000","last_change":"2024-04-25T09:01:28.813680+0000","last_active":"2024-04-25T09:01:35.212580+0000","last_peered":"2024-04-25T09:01:35.212580+0000","last_clean":"2024-04-25T09:01:35.212580+0000","last_became_active":"2024-04-25T09:01:28.812991+0000","last_became_peered":"2024-04-25T09:01:28.812991+0000","last_unstale":"2024-04-25T09:01:35.212580+0000","last_undegraded":"2024-04-25T09:01:35.212580+0000","last_fullsized":"2024-04-25T09:01:35.212580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:24.478830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:44.640397+0000","last_change":"2024-04-25T09:01:27.792429+0000","last_active":"2024-04-25T09:01:44.640397+0000","last_peered":"2024-04-25T09:01:44.640397+0000","last_clean":"2024-04-25T09:01:44.640397+0000","last_became_active":"2024-04-25T09:01:27.792126+0000","last_became_peered":"2024-04-25T09:01:27.792126+0000","last_unstale":"2024-04-25T09:01:44.640397+0000","last_undegraded":"2024-04-25T09:01:44.640397+0000","last_fullsized":"2024-04-25T09:01:44.640397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366571+0000","last_change":"2024-04-25T09:01:32.840515+0000","last_active":"2024-04-25T09:01:34.366571+0000","last_peered":"2024-04-25T09:01:34.366571+0000","last_clean":"2024-04-25T09:01:34.366571+0000","last_became_active":"2024-04-25T09:01:32.840063+0000","last_became_peered":"2024-04-25T09:01:32.840063+0000","last_unstale":"2024-04-25T09:01:34.366571+0000","last_undegraded":"2024-04-25T09:01:34.366571+0000","last_fullsized":"2024-04-25T09:01:34.366571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.271837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826624+0000","last_change":"2024-04-25T09:01:28.809794+0000","last_active":"2024-04-25T09:01:33.826624+0000","last_peered":"2024-04-25T09:01:33.826624+0000","last_clean":"2024-04-25T09:01:33.826624+0000","last_became_active":"2024-04-25T09:01:28.809503+0000","last_became_peered":"2024-04-25T09:01:28.809503+0000","last_unstale":"2024-04-25T09:01:33.826624+0000","last_undegraded":"2024-04-25T09:01:33.826624+0000","last_fullsized":"2024-04-25T09:01:33.826624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:56.645747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366841+0000","last_change":"2024-04-25T09:01:27.789736+0000","last_active":"2024-04-25T09:01:34.366841+0000","last_peered":"2024-04-25T09:01:34.366841+0000","last_clean":"2024-04-25T09:01:34.366841+0000","last_became_active":"2024-04-25T09:01:27.789445+0000","last_became_peered":"2024-04-25T09:01:27.789445+0000","last_unstale":"2024-04-25T09:01:34.366841+0000","last_undegraded":"2024-04-25T09:01:34.366841+0000","last_fullsized":"2024-04-25T09:01:34.366841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826093+0000","last_change":"2024-04-25T09:01:32.835148+0000","last_active":"2024-04-25T09:01:33.826093+0000","last_peered":"2024-04-25T09:01:33.826093+0000","last_clean":"2024-04-25T09:01:33.826093+0000","last_became_active":"2024-04-25T09:01:32.834679+0000","last_became_peered":"2024-04-25T09:01:32.834679+0000","last_unstale":"2024-04-25T09:01:33.826093+0000","last_undegraded":"2024-04-25T09:01:33.826093+0000","last_fullsized":"2024-04-25T09:01:33.826093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:46.590077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709785+0000","last_change":"2024-04-25T09:01:28.805826+0000","last_active":"2024-04-25T09:01:34.709785+0000","last_peered":"2024-04-25T09:01:34.709785+0000","last_clean":"2024-04-25T09:01:34.709785+0000","last_became_active":"2024-04-25T09:01:28.805543+0000","last_became_peered":"2024-04-25T09:01:28.805543+0000","last_unstale":"2024-04-25T09:01:34.709785+0000","last_undegraded":"2024-04-25T09:01:34.709785+0000","last_fullsized":"2024-04-25T09:01:34.709785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825327+0000","last_change":"2024-04-25T09:01:27.801739+0000","last_active":"2024-04-25T09:01:33.825327+0000","last_peered":"2024-04-25T09:01:33.825327+0000","last_clean":"2024-04-25T09:01:33.825327+0000","last_became_active":"2024-04-25T09:01:27.801422+0000","last_became_peered":"2024-04-25T09:01:27.801422+0000","last_unstale":"2024-04-25T09:01:33.825327+0000","last_undegraded":"2024-04-25T09:01:33.825327+0000","last_fullsized":"2024-04-25T09:01:33.825327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209484+0000","last_change":"2024-04-25T09:01:32.836512+0000","last_active":"2024-04-25T09:01:35.209484+0000","last_peered":"2024-04-25T09:01:35.209484+0000","last_clean":"2024-04-25T09:01:35.209484+0000","last_became_active":"2024-04-25T09:01:32.834922+0000","last_became_peered":"2024-04-25T09:01:32.834922+0000","last_unstale":"2024-04-25T09:01:35.209484+0000","last_undegraded":"2024-04-25T09:01:35.209484+0000","last_fullsized":"2024-04-25T09:01:35.209484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:43.548883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825176+0000","last_change":"2024-04-25T09:01:28.803133+0000","last_active":"2024-04-25T09:01:33.825176+0000","last_peered":"2024-04-25T09:01:33.825176+0000","last_clean":"2024-04-25T09:01:33.825176+0000","last_became_active":"2024-04-25T09:01:28.802575+0000","last_became_peered":"2024-04-25T09:01:28.802575+0000","last_unstale":"2024-04-25T09:01:33.825176+0000","last_undegraded":"2024-04-25T09:01:33.825176+0000","last_fullsized":"2024-04-25T09:01:33.825176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:42.557761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213247+0000","last_change":"2024-04-25T09:01:27.795989+0000","last_active":"2024-04-25T09:01:35.213247+0000","last_peered":"2024-04-25T09:01:35.213247+0000","last_clean":"2024-04-25T09:01:35.213247+0000","last_became_active":"2024-04-25T09:01:27.794189+0000","last_became_peered":"2024-04-25T09:01:27.794189+0000","last_unstale":"2024-04-25T09:01:35.213247+0000","last_undegraded":"2024-04-25T09:01:35.213247+0000","last_fullsized":"2024-04-25T09:01:35.213247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209544+0000","last_change":"2024-04-25T09:01:33.016051+0000","last_active":"2024-04-25T09:01:35.209544+0000","last_peered":"2024-04-25T09:01:35.209544+0000","last_clean":"2024-04-25T09:01:35.209544+0000","last_became_active":"2024-04-25T09:01:33.015720+0000","last_became_peered":"2024-04-25T09:01:33.015720+0000","last_unstale":"2024-04-25T09:01:35.209544+0000","last_undegraded":"2024-04-25T09:01:35.209544+0000","last_fullsized":"2024-04-25T09:01:35.209544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:24.797218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709440+0000","last_change":"2024-04-25T09:01:33.018289+0000","last_active":"2024-04-25T09:01:34.709440+0000","last_peered":"2024-04-25T09:01:34.709440+0000","last_clean":"2024-04-25T09:01:34.709440+0000","last_became_active":"2024-04-25T09:01:33.017643+0000","last_became_peered":"2024-04-25T09:01:33.017643+0000","last_unstale":"2024-04-25T09:01:34.709440+0000","last_undegraded":"2024-04-25T09:01:34.709440+0000","last_fullsized":"2024-04-25T09:01:34.709440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.271837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366208+0000","last_change":"2024-04-25T09:01:28.805719+0000","last_active":"2024-04-25T09:01:34.366208+0000","last_peered":"2024-04-25T09:01:34.366208+0000","last_clean":"2024-04-25T09:01:34.366208+0000","last_became_active":"2024-04-25T09:01:28.805394+0000","last_became_peered":"2024-04-25T09:01:28.805394+0000","last_unstale":"2024-04-25T09:01:34.366208+0000","last_undegraded":"2024-04-25T09:01:34.366208+0000","last_fullsized":"2024-04-25T09:01:34.366208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824665+0000","last_change":"2024-04-25T09:01:27.797013+0000","last_active":"2024-04-25T09:01:33.824665+0000","last_peered":"2024-04-25T09:01:33.824665+0000","last_clean":"2024-04-25T09:01:33.824665+0000","last_became_active":"2024-04-25T09:01:27.795312+0000","last_became_peered":"2024-04-25T09:01:27.795312+0000","last_unstale":"2024-04-25T09:01:33.824665+0000","last_undegraded":"2024-04-25T09:01:33.824665+0000","last_fullsized":"2024-04-25T09:01:33.824665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212668+0000","last_change":"2024-04-25T09:01:32.845195+0000","last_active":"2024-04-25T09:01:35.212668+0000","last_peered":"2024-04-25T09:01:35.212668+0000","last_clean":"2024-04-25T09:01:35.212668+0000","last_became_active":"2024-04-25T09:01:32.844725+0000","last_became_peered":"2024-04-25T09:01:32.844725+0000","last_unstale":"2024-04-25T09:01:35.212668+0000","last_undegraded":"2024-04-25T09:01:35.212668+0000","last_fullsized":"2024-04-25T09:01:35.212668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.271837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209436+0000","last_change":"2024-04-25T09:01:28.802082+0000","last_active":"2024-04-25T09:01:35.209436+0000","last_peered":"2024-04-25T09:01:35.209436+0000","last_clean":"2024-04-25T09:01:35.209436+0000","last_became_active":"2024-04-25T09:01:28.801617+0000","last_became_peered":"2024-04-25T09:01:28.801617+0000","last_unstale":"2024-04-25T09:01:35.209436+0000","last_undegraded":"2024-04-25T09:01:35.209436+0000","last_fullsized":"2024-04-25T09:01:35.209436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209733+0000","last_change":"2024-04-25T09:01:27.799488+0000","last_active":"2024-04-25T09:01:35.209733+0000","last_peered":"2024-04-25T09:01:35.209733+0000","last_clean":"2024-04-25T09:01:35.209733+0000","last_became_active":"2024-04-25T09:01:27.799191+0000","last_became_peered":"2024-04-25T09:01:27.799191+0000","last_unstale":"2024-04-25T09:01:35.209733+0000","last_undegraded":"2024-04-25T09:01:35.209733+0000","last_fullsized":"2024-04-25T09:01:35.209733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:58.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212177+0000","last_change":"2024-04-25T09:01:27.802418+0000","last_active":"2024-04-25T09:01:35.212177+0000","last_peered":"2024-04-25T09:01:35.212177+0000","last_clean":"2024-04-25T09:01:35.212177+0000","last_became_active":"2024-04-25T09:01:27.802128+0000","last_became_peered":"2024-04-25T09:01:27.802128+0000","last_unstale":"2024-04-25T09:01:35.212177+0000","last_undegraded":"2024-04-25T09:01:35.212177+0000","last_fullsized":"2024-04-25T09:01:35.212177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709621+0000","last_change":"2024-04-25T09:01:28.802082+0000","last_active":"2024-04-25T09:01:34.709621+0000","last_peered":"2024-04-25T09:01:34.709621+0000","last_clean":"2024-04-25T09:01:34.709621+0000","last_became_active":"2024-04-25T09:01:28.801820+0000","last_became_peered":"2024-04-25T09:01:28.801820+0000","last_unstale":"2024-04-25T09:01:34.709621+0000","last_undegraded":"2024-04-25T09:01:34.709621+0000","last_fullsized":"2024-04-25T09:01:34.709621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821849+0000","last_change":"2024-04-25T09:01:32.838999+0000","last_active":"2024-04-25T09:01:33.821849+0000","last_peered":"2024-04-25T09:01:33.821849+0000","last_clean":"2024-04-25T09:01:33.821849+0000","last_became_active":"2024-04-25T09:01:32.838525+0000","last_became_peered":"2024-04-25T09:01:32.838525+0000","last_unstale":"2024-04-25T09:01:33.821849+0000","last_undegraded":"2024-04-25T09:01:33.821849+0000","last_fullsized":"2024-04-25T09:01:33.821849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:49.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209935+0000","last_change":"2024-04-25T09:01:27.795362+0000","last_active":"2024-04-25T09:01:35.209935+0000","last_peered":"2024-04-25T09:01:35.209935+0000","last_clean":"2024-04-25T09:01:35.209935+0000","last_became_active":"2024-04-25T09:01:27.795063+0000","last_became_peered":"2024-04-25T09:01:27.795063+0000","last_unstale":"2024-04-25T09:01:35.209935+0000","last_undegraded":"2024-04-25T09:01:35.209935+0000","last_fullsized":"2024-04-25T09:01:35.209935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825751+0000","last_change":"2024-04-25T09:01:28.804182+0000","last_active":"2024-04-25T09:01:33.825751+0000","last_peered":"2024-04-25T09:01:33.825751+0000","last_clean":"2024-04-25T09:01:33.825751+0000","last_became_active":"2024-04-25T09:01:28.803828+0000","last_became_peered":"2024-04-25T09:01:28.803828+0000","last_unstale":"2024-04-25T09:01:33.825751+0000","last_undegraded":"2024-04-25T09:01:33.825751+0000","last_fullsized":"2024-04-25T09:01:33.825751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:28.332372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210139+0000","last_change":"2024-04-25T09:01:32.838771+0000","last_active":"2024-04-25T09:01:35.210139+0000","last_peered":"2024-04-25T09:01:35.210139+0000","last_clean":"2024-04-25T09:01:35.210139+0000","last_became_active":"2024-04-25T09:01:32.838328+0000","last_became_peered":"2024-04-25T09:01:32.838328+0000","last_unstale":"2024-04-25T09:01:35.210139+0000","last_undegraded":"2024-04-25T09:01:35.210139+0000","last_fullsized":"2024-04-25T09:01:35.210139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:21.908859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211532+0000","last_change":"2024-04-25T09:01:28.800460+0000","last_active":"2024-04-25T09:01:35.211532+0000","last_peered":"2024-04-25T09:01:35.211532+0000","last_clean":"2024-04-25T09:01:35.211532+0000","last_became_active":"2024-04-25T09:01:28.800206+0000","last_became_peered":"2024-04-25T09:01:28.800206+0000","last_unstale":"2024-04-25T09:01:35.211532+0000","last_undegraded":"2024-04-25T09:01:35.211532+0000","last_fullsized":"2024-04-25T09:01:35.211532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821704+0000","last_change":"2024-04-25T09:01:28.813568+0000","last_active":"2024-04-25T09:01:33.821704+0000","last_peered":"2024-04-25T09:01:33.821704+0000","last_clean":"2024-04-25T09:01:33.821704+0000","last_became_active":"2024-04-25T09:01:28.813174+0000","last_became_peered":"2024-04-25T09:01:28.813174+0000","last_unstale":"2024-04-25T09:01:33.821704+0000","last_undegraded":"2024-04-25T09:01:33.821704+0000","last_fullsized":"2024-04-25T09:01:33.821704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:56.645747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825234+0000","last_change":"2024-04-25T09:01:28.795346+0000","last_active":"2024-04-25T09:01:33.825234+0000","last_peered":"2024-04-25T09:01:33.825234+0000","last_clean":"2024-04-25T09:01:33.825234+0000","last_became_active":"2024-04-25T09:01:28.795062+0000","last_became_peered":"2024-04-25T09:01:28.795062+0000","last_unstale":"2024-04-25T09:01:33.825234+0000","last_undegraded":"2024-04-25T09:01:33.825234+0000","last_fullsized":"2024-04-25T09:01:33.825234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:31.277254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709593+0000","last_change":"2024-04-25T09:01:28.796978+0000","last_active":"2024-04-25T09:01:34.709593+0000","last_peered":"2024-04-25T09:01:34.709593+0000","last_clean":"2024-04-25T09:01:34.709593+0000","last_became_active":"2024-04-25T09:01:28.796196+0000","last_became_peered":"2024-04-25T09:01:28.796196+0000","last_unstale":"2024-04-25T09:01:34.709593+0000","last_undegraded":"2024-04-25T09:01:34.709593+0000","last_fullsized":"2024-04-25T09:01:34.709593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:43.336463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210135+0000","last_change":"2024-04-25T09:01:28.814030+0000","last_active":"2024-04-25T09:01:35.210135+0000","last_peered":"2024-04-25T09:01:35.210135+0000","last_clean":"2024-04-25T09:01:35.210135+0000","last_became_active":"2024-04-25T09:01:28.813738+0000","last_became_peered":"2024-04-25T09:01:28.813738+0000","last_unstale":"2024-04-25T09:01:35.210135+0000","last_undegraded":"2024-04-25T09:01:35.210135+0000","last_fullsized":"2024-04-25T09:01:35.210135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:42.557761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366730+0000","last_change":"2024-04-25T09:01:28.795112+0000","last_active":"2024-04-25T09:01:34.366730+0000","last_peered":"2024-04-25T09:01:34.366730+0000","last_clean":"2024-04-25T09:01:34.366730+0000","last_became_active":"2024-04-25T09:01:28.794801+0000","last_became_peered":"2024-04-25T09:01:28.794801+0000","last_unstale":"2024-04-25T09:01:34.366730+0000","last_undegraded":"2024-04-25T09:01:34.366730+0000","last_fullsized":"2024-04-25T09:01:34.366730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213014+0000","last_change":"2024-04-25T09:01:28.809748+0000","last_active":"2024-04-25T09:01:35.213014+0000","last_peered":"2024-04-25T09:01:35.213014+0000","last_clean":"2024-04-25T09:01:35.213014+0000","last_became_active":"2024-04-25T09:01:28.809461+0000","last_became_peered":"2024-04-25T09:01:28.809461+0000","last_unstale":"2024-04-25T09:01:35.213014+0000","last_undegraded":"2024-04-25T09:01:35.213014+0000","last_fullsized":"2024-04-25T09:01:35.213014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210397+0000","last_change":"2024-04-25T09:01:28.813864+0000","last_active":"2024-04-25T09:01:35.210397+0000","last_peered":"2024-04-25T09:01:35.210397+0000","last_clean":"2024-04-25T09:01:35.210397+0000","last_became_active":"2024-04-25T09:01:28.813495+0000","last_became_peered":"2024-04-25T09:01:28.813495+0000","last_unstale":"2024-04-25T09:01:35.210397+0000","last_undegraded":"2024-04-25T09:01:35.210397+0000","last_fullsized":"2024-04-25T09:01:35.210397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825456+0000","last_change":"2024-04-25T09:01:28.794304+0000","last_active":"2024-04-25T09:01:33.825456+0000","last_peered":"2024-04-25T09:01:33.825456+0000","last_clean":"2024-04-25T09:01:33.825456+0000","last_became_active":"2024-04-25T09:01:28.794011+0000","last_became_peered":"2024-04-25T09:01:28.794011+0000","last_unstale":"2024-04-25T09:01:33.825456+0000","last_undegraded":"2024-04-25T09:01:33.825456+0000","last_fullsized":"2024-04-25T09:01:33.825456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:45.224319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209656+0000","last_change":"2024-04-25T09:01:28.799673+0000","last_active":"2024-04-25T09:01:35.209656+0000","last_peered":"2024-04-25T09:01:35.209656+0000","last_clean":"2024-04-25T09:01:35.209656+0000","last_became_active":"2024-04-25T09:01:28.799385+0000","last_became_peered":"2024-04-25T09:01:28.799385+0000","last_unstale":"2024-04-25T09:01:35.209656+0000","last_undegraded":"2024-04-25T09:01:35.209656+0000","last_fullsized":"2024-04-25T09:01:35.209656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:13.869416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825187+0000","last_change":"2024-04-25T09:01:28.807260+0000","last_active":"2024-04-25T09:01:33.825187+0000","last_peered":"2024-04-25T09:01:33.825187+0000","last_clean":"2024-04-25T09:01:33.825187+0000","last_became_active":"2024-04-25T09:01:28.806995+0000","last_became_peered":"2024-04-25T09:01:28.806995+0000","last_unstale":"2024-04-25T09:01:33.825187+0000","last_undegraded":"2024-04-25T09:01:33.825187+0000","last_fullsized":"2024-04-25T09:01:33.825187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:06.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709277+0000","last_change":"2024-04-25T09:01:28.797279+0000","last_active":"2024-04-25T09:01:34.709277+0000","last_peered":"2024-04-25T09:01:34.709277+0000","last_clean":"2024-04-25T09:01:34.709277+0000","last_became_active":"2024-04-25T09:01:28.796574+0000","last_became_peered":"2024-04-25T09:01:28.796574+0000","last_unstale":"2024-04-25T09:01:34.709277+0000","last_undegraded":"2024-04-25T09:01:34.709277+0000","last_fullsized":"2024-04-25T09:01:34.709277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:01.770247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212692+0000","last_change":"2024-04-25T09:01:28.799529+0000","last_active":"2024-04-25T09:01:35.212692+0000","last_peered":"2024-04-25T09:01:35.212692+0000","last_clean":"2024-04-25T09:01:35.212692+0000","last_became_active":"2024-04-25T09:01:28.799231+0000","last_became_peered":"2024-04-25T09:01:28.799231+0000","last_unstale":"2024-04-25T09:01:35.212692+0000","last_undegraded":"2024-04-25T09:01:35.212692+0000","last_fullsized":"2024-04-25T09:01:35.212692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:45.224319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212894+0000","last_change":"2024-04-25T09:01:28.820816+0000","last_active":"2024-04-25T09:01:35.212894+0000","last_peered":"2024-04-25T09:01:35.212894+0000","last_clean":"2024-04-25T09:01:35.212894+0000","last_became_active":"2024-04-25T09:01:28.819970+0000","last_became_peered":"2024-04-25T09:01:28.819970+0000","last_unstale":"2024-04-25T09:01:35.212894+0000","last_undegraded":"2024-04-25T09:01:35.212894+0000","last_fullsized":"2024-04-25T09:01:35.212894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:39.516566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.822061+0000","last_change":"2024-04-25T09:01:28.802779+0000","last_active":"2024-04-25T09:01:33.822061+0000","last_peered":"2024-04-25T09:01:33.822061+0000","last_clean":"2024-04-25T09:01:33.822061+0000","last_became_active":"2024-04-25T09:01:28.802504+0000","last_became_peered":"2024-04-25T09:01:28.802504+0000","last_unstale":"2024-04-25T09:01:33.822061+0000","last_undegraded":"2024-04-25T09:01:33.822061+0000","last_fullsized":"2024-04-25T09:01:33.822061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:12.377470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825926+0000","last_change":"2024-04-25T09:01:28.806216+0000","last_active":"2024-04-25T09:01:33.825926+0000","last_peered":"2024-04-25T09:01:33.825926+0000","last_clean":"2024-04-25T09:01:33.825926+0000","last_became_active":"2024-04-25T09:01:28.805683+0000","last_became_peered":"2024-04-25T09:01:28.805683+0000","last_unstale":"2024-04-25T09:01:33.825926+0000","last_undegraded":"2024-04-25T09:01:33.825926+0000","last_fullsized":"2024-04-25T09:01:33.825926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:06.715519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824510+0000","last_change":"2024-04-25T09:01:28.795390+0000","last_active":"2024-04-25T09:01:33.824510+0000","last_peered":"2024-04-25T09:01:33.824510+0000","last_clean":"2024-04-25T09:01:33.824510+0000","last_became_active":"2024-04-25T09:01:28.795100+0000","last_became_peered":"2024-04-25T09:01:28.795100+0000","last_unstale":"2024-04-25T09:01:33.824510+0000","last_undegraded":"2024-04-25T09:01:33.824510+0000","last_fullsized":"2024-04-25T09:01:33.824510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366292+0000","last_change":"2024-04-25T09:01:28.807705+0000","last_active":"2024-04-25T09:01:34.366292+0000","last_peered":"2024-04-25T09:01:34.366292+0000","last_clean":"2024-04-25T09:01:34.366292+0000","last_became_active":"2024-04-25T09:01:28.807321+0000","last_became_peered":"2024-04-25T09:01:28.807321+0000","last_unstale":"2024-04-25T09:01:34.366292+0000","last_undegraded":"2024-04-25T09:01:34.366292+0000","last_fullsized":"2024-04-25T09:01:34.366292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709236+0000","last_change":"2024-04-25T09:01:28.800758+0000","last_active":"2024-04-25T09:01:34.709236+0000","last_peered":"2024-04-25T09:01:34.709236+0000","last_clean":"2024-04-25T09:01:34.709236+0000","last_became_active":"2024-04-25T09:01:28.800380+0000","last_became_peered":"2024-04-25T09:01:28.800380+0000","last_unstale":"2024-04-25T09:01:34.709236+0000","last_undegraded":"2024-04-25T09:01:34.709236+0000","last_fullsized":"2024-04-25T09:01:34.709236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:41.553845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209750+0000","last_change":"2024-04-25T09:01:28.803209+0000","last_active":"2024-04-25T09:01:35.209750+0000","last_peered":"2024-04-25T09:01:35.209750+0000","last_clean":"2024-04-25T09:01:35.209750+0000","last_became_active":"2024-04-25T09:01:28.801889+0000","last_became_peered":"2024-04-25T09:01:28.801889+0000","last_unstale":"2024-04-25T09:01:35.209750+0000","last_undegraded":"2024-04-25T09:01:35.209750+0000","last_fullsized":"2024-04-25T09:01:35.209750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826547+0000","last_change":"2024-04-25T09:01:28.809150+0000","last_active":"2024-04-25T09:01:33.826547+0000","last_peered":"2024-04-25T09:01:33.826547+0000","last_clean":"2024-04-25T09:01:33.826547+0000","last_became_active":"2024-04-25T09:01:28.801172+0000","last_became_peered":"2024-04-25T09:01:28.801172+0000","last_unstale":"2024-04-25T09:01:33.826547+0000","last_undegraded":"2024-04-25T09:01:33.826547+0000","last_fullsized":"2024-04-25T09:01:33.826547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:06.124113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213293+0000","last_change":"2024-04-25T09:01:28.810054+0000","last_active":"2024-04-25T09:01:35.213293+0000","last_peered":"2024-04-25T09:01:35.213293+0000","last_clean":"2024-04-25T09:01:35.213293+0000","last_became_active":"2024-04-25T09:01:28.809288+0000","last_became_peered":"2024-04-25T09:01:28.809288+0000","last_unstale":"2024-04-25T09:01:35.213293+0000","last_undegraded":"2024-04-25T09:01:35.213293+0000","last_fullsized":"2024-04-25T09:01:35.213293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212915+0000","last_change":"2024-04-25T09:01:28.803094+0000","last_active":"2024-04-25T09:01:35.212915+0000","last_peered":"2024-04-25T09:01:35.212915+0000","last_clean":"2024-04-25T09:01:35.212915+0000","last_became_active":"2024-04-25T09:01:28.802768+0000","last_became_peered":"2024-04-25T09:01:28.802768+0000","last_unstale":"2024-04-25T09:01:35.212915+0000","last_undegraded":"2024-04-25T09:01:35.212915+0000","last_fullsized":"2024-04-25T09:01:35.212915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213016+0000","last_change":"2024-04-25T09:01:28.822072+0000","last_active":"2024-04-25T09:01:35.213016+0000","last_peered":"2024-04-25T09:01:35.213016+0000","last_clean":"2024-04-25T09:01:35.213016+0000","last_became_active":"2024-04-25T09:01:28.821805+0000","last_became_peered":"2024-04-25T09:01:28.821805+0000","last_unstale":"2024-04-25T09:01:35.213016+0000","last_undegraded":"2024-04-25T09:01:35.213016+0000","last_fullsized":"2024-04-25T09:01:35.213016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:10.070021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209311+0000","last_change":"2024-04-25T09:01:28.797350+0000","last_active":"2024-04-25T09:01:35.209311+0000","last_peered":"2024-04-25T09:01:35.209311+0000","last_clean":"2024-04-25T09:01:35.209311+0000","last_became_active":"2024-04-25T09:01:28.797039+0000","last_became_peered":"2024-04-25T09:01:28.797039+0000","last_unstale":"2024-04-25T09:01:35.209311+0000","last_undegraded":"2024-04-25T09:01:35.209311+0000","last_fullsized":"2024-04-25T09:01:35.209311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:28.695063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211801+0000","last_change":"2024-04-25T09:01:28.814399+0000","last_active":"2024-04-25T09:01:35.211801+0000","last_peered":"2024-04-25T09:01:35.211801+0000","last_clean":"2024-04-25T09:01:35.211801+0000","last_became_active":"2024-04-25T09:01:28.812569+0000","last_became_peered":"2024-04-25T09:01:28.812569+0000","last_unstale":"2024-04-25T09:01:35.211801+0000","last_undegraded":"2024-04-25T09:01:35.211801+0000","last_fullsized":"2024-04-25T09:01:35.211801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825039+0000","last_change":"2024-04-25T09:01:28.798631+0000","last_active":"2024-04-25T09:01:33.825039+0000","last_peered":"2024-04-25T09:01:33.825039+0000","last_clean":"2024-04-25T09:01:33.825039+0000","last_became_active":"2024-04-25T09:01:28.797450+0000","last_became_peered":"2024-04-25T09:01:28.797450+0000","last_unstale":"2024-04-25T09:01:33.825039+0000","last_undegraded":"2024-04-25T09:01:33.825039+0000","last_fullsized":"2024-04-25T09:01:33.825039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:33.239521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211711+0000","last_change":"2024-04-25T09:01:28.817741+0000","last_active":"2024-04-25T09:01:35.211711+0000","last_peered":"2024-04-25T09:01:35.211711+0000","last_clean":"2024-04-25T09:01:35.211711+0000","last_became_active":"2024-04-25T09:01:28.816875+0000","last_became_peered":"2024-04-25T09:01:28.816875+0000","last_unstale":"2024-04-25T09:01:35.211711+0000","last_undegraded":"2024-04-25T09:01:35.211711+0000","last_fullsized":"2024-04-25T09:01:35.211711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:46.890034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825594+0000","last_change":"2024-04-25T09:01:28.800127+0000","last_active":"2024-04-25T09:01:33.825594+0000","last_peered":"2024-04-25T09:01:33.825594+0000","last_clean":"2024-04-25T09:01:33.825594+0000","last_became_active":"2024-04-25T09:01:28.799878+0000","last_became_peered":"2024-04-25T09:01:28.799878+0000","last_unstale":"2024-04-25T09:01:33.825594+0000","last_undegraded":"2024-04-25T09:01:33.825594+0000","last_fullsized":"2024-04-25T09:01:33.825594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:28.695063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709466+0000","last_change":"2024-04-25T09:01:28.789959+0000","last_active":"2024-04-25T09:01:34.709466+0000","last_peered":"2024-04-25T09:01:34.709466+0000","last_clean":"2024-04-25T09:01:34.709466+0000","last_became_active":"2024-04-25T09:01:28.788152+0000","last_became_peered":"2024-04-25T09:01:28.788152+0000","last_unstale":"2024-04-25T09:01:34.709466+0000","last_undegraded":"2024-04-25T09:01:34.709466+0000","last_fullsized":"2024-04-25T09:01:34.709466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366996+0000","last_change":"2024-04-25T09:01:28.798328+0000","last_active":"2024-04-25T09:01:34.366996+0000","last_peered":"2024-04-25T09:01:34.366996+0000","last_clean":"2024-04-25T09:01:34.366996+0000","last_became_active":"2024-04-25T09:01:28.797356+0000","last_became_peered":"2024-04-25T09:01:28.797356+0000","last_unstale":"2024-04-25T09:01:34.366996+0000","last_undegraded":"2024-04-25T09:01:34.366996+0000","last_fullsized":"2024-04-25T09:01:34.366996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212405+0000","last_change":"2024-04-25T09:01:28.819648+0000","last_active":"2024-04-25T09:01:35.212405+0000","last_peered":"2024-04-25T09:01:35.212405+0000","last_clean":"2024-04-25T09:01:35.212405+0000","last_became_active":"2024-04-25T09:01:28.819185+0000","last_became_peered":"2024-04-25T09:01:28.819185+0000","last_unstale":"2024-04-25T09:01:35.212405+0000","last_undegraded":"2024-04-25T09:01:35.212405+0000","last_fullsized":"2024-04-25T09:01:35.212405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:38.948352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:01:47.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:48.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.152+0000 7f2fd7800640 1 Processor -- start 2024-04-25T09:01:48.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fd7800640 1 -- start start 2024-04-25T09:01:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fd7800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd015da10 0x7f2fd00afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fd7800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2fd00d11b0 0x7f2fd006ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fd7800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2fd00b4210 0x7f2fd00b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fd7800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd00b4bc0 con 0x7f2fd00d11b0 2024-04-25T09:01:48.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fd7800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd015ddf0 con 0x7f2fd00b4210 2024-04-25T09:01:48.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fd7800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd006b480 con 0x7f2fd015da10 2024-04-25T09:01:48.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fc7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2fd00d11b0 0x7f2fd006ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fc7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2fd00d11b0 0x7f2fd006ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46658/0 (socket says 172.21.15.59:46658) 2024-04-25T09:01:48.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fc7e00640 1 -- 172.21.15.59:0/2186402843 learned_addr learned my addr 172.21.15.59:0/2186402843 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:48.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fd4e00640 1 --2- 172.21.15.59:0/2186402843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd015da10 0x7f2fd00afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fd5800640 1 --2- 172.21.15.59:0/2186402843 >> v2:172.21.15.178:3300/0 conn(0x7f2fd00b4210 0x7f2fd00b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fc7e00640 1 -- 172.21.15.59:0/2186402843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd015da10 msgr2=0x7f2fd00afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fc7e00640 1 --2- 172.21.15.59:0/2186402843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd015da10 0x7f2fd00afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fc7e00640 1 -- 172.21.15.59:0/2186402843 >> v2:172.21.15.178:3300/0 conn(0x7f2fd00b4210 msgr2=0x7f2fd00b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fc7e00640 1 --2- 172.21.15.59:0/2186402843 >> v2:172.21.15.178:3300/0 conn(0x7f2fd00b4210 0x7f2fd00b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fc7e00640 1 -- 172.21.15.59:0/2186402843 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd00d06d0 con 0x7f2fd00d11b0 2024-04-25T09:01:48.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.156+0000 7f2fd5800640 1 --2- 172.21.15.59:0/2186402843 >> v2:172.21.15.178:3300/0 conn(0x7f2fd00b4210 0x7f2fd00b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:48.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fc7e00640 1 --2- 172.21.15.59:0/2186402843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd00d11b0 0x7f2fd006ac10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00720f0 tx=0x7f2fb801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77e20d875490e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:48.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fcfe00640 1 -- 172.21.15.59:0/2186402843 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80b0070 con 0x7f2fd00d11b0 2024-04-25T09:01:48.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fcfe00640 1 -- 172.21.15.59:0/2186402843 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb80ab600 con 0x7f2fd00d11b0 2024-04-25T09:01:48.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fcfe00640 1 -- 172.21.15.59:0/2186402843 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb80ab9d0 con 0x7f2fd00d11b0 2024-04-25T09:01:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fd7800640 1 -- 172.21.15.59:0/2186402843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd00d11b0 msgr2=0x7f2fd006ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fd7800640 1 --2- 172.21.15.59:0/2186402843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd00d11b0 0x7f2fd006ac10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00720f0 tx=0x7f2fb801c490 comp rx=0 tx=0).stop 2024-04-25T09:01:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fd7800640 1 -- 172.21.15.59:0/2186402843 shutdown_connections 2024-04-25T09:01:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fd7800640 1 --2- 172.21.15.59:0/2186402843 >> v2:172.21.15.178:3300/0 conn(0x7f2fd00b4210 0x7f2fd00b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fd7800640 1 --2- 172.21.15.59:0/2186402843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd00d11b0 0x7f2fd006ac10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fd7800640 1 --2- 172.21.15.59:0/2186402843 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd015da10 0x7f2fd00afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fd7800640 1 -- 172.21.15.59:0/2186402843 >> 172.21.15.59:0/2186402843 conn(0x7f2fd00b2400 msgr2=0x7f2fd00b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fd7800640 1 -- 172.21.15.59:0/2186402843 shutdown_connections 2024-04-25T09:01:48.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fd7800640 1 -- 172.21.15.59:0/2186402843 wait complete. 2024-04-25T09:01:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fd7800640 1 Processor -- start 2024-04-25T09:01:48.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.160+0000 7f2fd7800640 1 -- start start 2024-04-25T09:01:48.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd7800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd00b4210 0x7f2fd01574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd7800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd00d11b0 0x7f2fd014b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd7800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd015da10 0x7f2fd014d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd7800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd00704b0 con 0x7f2fd00b4210 2024-04-25T09:01:48.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd7800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0070330 con 0x7f2fd015da10 2024-04-25T09:01:48.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd7800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd0070630 con 0x7f2fd00d11b0 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd4e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd00b4210 0x7f2fd01574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd4e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd00b4210 0x7f2fd01574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46674/0 (socket says 172.21.15.59:46674) 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd4e00640 1 -- 172.21.15.59:0/165567620 learned_addr learned my addr 172.21.15.59:0/165567620 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fc7e00640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd00d11b0 0x7f2fd014b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd5800640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd015da10 0x7f2fd014d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd4e00640 1 -- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd00d11b0 msgr2=0x7f2fd014b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd4e00640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd00d11b0 0x7f2fd014b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd4e00640 1 -- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd015da10 msgr2=0x7f2fd014d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd4e00640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd015da10 0x7f2fd014d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd4e00640 1 -- 172.21.15.59:0/165567620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd014dee0 con 0x7f2fd00b4210 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fc7e00640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd00d11b0 0x7f2fd014b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd5800640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd015da10 0x7f2fd014d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd4e00640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd00b4210 0x7f2fd01574c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000e870 tx=0x7f2fc000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:48.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fcd600640 1 -- 172.21.15.59:0/165567620 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc0017070 con 0x7f2fd00b4210 2024-04-25T09:01:48.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fcd600640 1 -- 172.21.15.59:0/165567620 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc000c940 con 0x7f2fd00b4210 2024-04-25T09:01:48.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fcd600640 1 -- 172.21.15.59:0/165567620 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc000ccf0 con 0x7f2fd00b4210 2024-04-25T09:01:48.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd7800640 1 -- 172.21.15.59:0/165567620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd014dc00 con 0x7f2fd00b4210 2024-04-25T09:01:48.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd7800640 1 -- 172.21.15.59:0/165567620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd0156cc0 con 0x7f2fd00b4210 2024-04-25T09:01:48.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fd7800640 1 -- 172.21.15.59:0/165567620 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd00745d0 con 0x7f2fd00b4210 2024-04-25T09:01:48.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.164+0000 7f2fcd600640 1 -- 172.21.15.59:0/165567620 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2fc001a070 con 0x7f2fd00b4210 2024-04-25T09:01:48.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.168+0000 7f2fcd600640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2fac066f60 0x7f2fac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.168+0000 7f2fcd600640 1 -- 172.21.15.59:0/165567620 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2fc00852a0 con 0x7f2fd00b4210 2024-04-25T09:01:48.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.168+0000 7f2fc7e00640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2fac066f60 0x7f2fac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.168+0000 7f2fc7e00640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2fac066f60 0x7f2fac069420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00d1660 tx=0x7f2fb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:48.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.172+0000 7f2fcd600640 1 -- 172.21.15.59:0/165567620 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2fc0055ed0 con 0x7f2fd00b4210 2024-04-25T09:01:48.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.328+0000 7f2fd7800640 1 -- 172.21.15.59:0/165567620 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2fd0072860 con 0x7f2fac066f60 2024-04-25T09:01:48.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.336+0000 7f2fcd600640 1 -- 172.21.15.59:0/165567620 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332574 (secure 0 0 0) 0x7f2fd0072860 con 0x7f2fac066f60 2024-04-25T09:01:48.332 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:48.334 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:01:48.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.340+0000 7f2fd7800640 1 -- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2fac066f60 msgr2=0x7f2fac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.340+0000 7f2fd7800640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2fac066f60 0x7f2fac069420 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00d1660 tx=0x7f2fb8008040 comp rx=0 tx=0).stop 2024-04-25T09:01:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.340+0000 7f2fd7800640 1 -- 172.21.15.59:0/165567620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd00b4210 msgr2=0x7f2fd01574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.340+0000 7f2fd7800640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd00b4210 0x7f2fd01574c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2fc000e870 tx=0x7f2fc000ec70 comp rx=0 tx=0).stop 2024-04-25T09:01:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.344+0000 7f2fd7800640 1 -- 172.21.15.59:0/165567620 shutdown_connections 2024-04-25T09:01:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.344+0000 7f2fd7800640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2fac066f60 0x7f2fac069420 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.344+0000 7f2fd7800640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2fd015da10 0x7f2fd014d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.344+0000 7f2fd7800640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2fd00d11b0 0x7f2fd014b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.344+0000 7f2fd7800640 1 --2- 172.21.15.59:0/165567620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2fd00b4210 0x7f2fd01574c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.344+0000 7f2fd7800640 1 -- 172.21.15.59:0/165567620 >> 172.21.15.59:0/165567620 conn(0x7f2fd00b2400 msgr2=0x7f2fd0157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.344+0000 7f2fd7800640 1 -- 172.21.15.59:0/165567620 shutdown_connections 2024-04-25T09:01:48.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.344+0000 7f2fd7800640 1 -- 172.21.15.59:0/165567620 wait complete. 2024-04-25T09:01:48.352 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-25T09:01:47.652258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223552,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751168,"statfs":{"total":773094113280,"available":772865196032,"internally_reserved":0,"allocated":3284992,"data_stored":1991782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003632"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709883+0000","last_change":"2024-04-25T09:01:27.802877+0000","last_active":"2024-04-25T09:01:34.709883+0000","last_peered":"2024-04-25T09:01:34.709883+0000","last_clean":"2024-04-25T09:01:34.709883+0000","last_became_active":"2024-04-25T09:01:27.802618+0000","last_became_peered":"2024-04-25T09:01:27.802618+0000","last_unstale":"2024-04-25T09:01:34.709883+0000","last_undegraded":"2024-04-25T09:01:34.709883+0000","last_fullsized":"2024-04-25T09:01:34.709883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:46.579225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210158+0000","last_change":"2024-04-25T09:01:28.808316+0000","last_active":"2024-04-25T09:01:35.210158+0000","last_peered":"2024-04-25T09:01:35.210158+0000","last_clean":"2024-04-25T09:01:35.210158+0000","last_became_active":"2024-04-25T09:01:28.807978+0000","last_became_peered":"2024-04-25T09:01:28.807978+0000","last_unstale":"2024-04-25T09:01:35.210158+0000","last_undegraded":"2024-04-25T09:01:35.210158+0000","last_fullsized":"2024-04-25T09:01:35.210158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209468+0000","last_change":"2024-04-25T09:01:33.021098+0000","last_active":"2024-04-25T09:01:35.209468+0000","last_peered":"2024-04-25T09:01:35.209468+0000","last_clean":"2024-04-25T09:01:35.209468+0000","last_became_active":"2024-04-25T09:01:33.020732+0000","last_became_peered":"2024-04-25T09:01:33.020732+0000","last_unstale":"2024-04-25T09:01:35.209468+0000","last_undegraded":"2024-04-25T09:01:35.209468+0000","last_fullsized":"2024-04-25T09:01:35.209468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:07.978442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210332+0000","last_change":"2024-04-25T09:01:27.807081+0000","last_active":"2024-04-25T09:01:35.210332+0000","last_peered":"2024-04-25T09:01:35.210332+0000","last_clean":"2024-04-25T09:01:35.210332+0000","last_became_active":"2024-04-25T09:01:27.806124+0000","last_became_peered":"2024-04-25T09:01:27.806124+0000","last_unstale":"2024-04-25T09:01:35.210332+0000","last_undegraded":"2024-04-25T09:01:35.210332+0000","last_fullsized":"2024-04-25T09:01:35.210332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709611+0000","last_change":"2024-04-25T09:01:28.806486+0000","last_active":"2024-04-25T09:01:34.709611+0000","last_peered":"2024-04-25T09:01:34.709611+0000","last_clean":"2024-04-25T09:01:34.709611+0000","last_became_active":"2024-04-25T09:01:28.806206+0000","last_became_peered":"2024-04-25T09:01:28.806206+0000","last_unstale":"2024-04-25T09:01:34.709611+0000","last_undegraded":"2024-04-25T09:01:34.709611+0000","last_fullsized":"2024-04-25T09:01:34.709611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824971+0000","last_change":"2024-04-25T09:01:32.828219+0000","last_active":"2024-04-25T09:01:33.824971+0000","last_peered":"2024-04-25T09:01:33.824971+0000","last_clean":"2024-04-25T09:01:33.824971+0000","last_became_active":"2024-04-25T09:01:32.827815+0000","last_became_peered":"2024-04-25T09:01:32.827815+0000","last_unstale":"2024-04-25T09:01:33.824971+0000","last_undegraded":"2024-04-25T09:01:33.824971+0000","last_fullsized":"2024-04-25T09:01:33.824971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:43.814734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212850+0000","last_change":"2024-04-25T09:01:27.805262+0000","last_active":"2024-04-25T09:01:35.212850+0000","last_peered":"2024-04-25T09:01:35.212850+0000","last_clean":"2024-04-25T09:01:35.212850+0000","last_became_active":"2024-04-25T09:01:27.804980+0000","last_became_peered":"2024-04-25T09:01:27.804980+0000","last_unstale":"2024-04-25T09:01:35.212850+0000","last_undegraded":"2024-04-25T09:01:35.212850+0000","last_fullsized":"2024-04-25T09:01:35.212850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:56.895362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825657+0000","last_change":"2024-04-25T09:01:28.799263+0000","last_active":"2024-04-25T09:01:33.825657+0000","last_peered":"2024-04-25T09:01:33.825657+0000","last_clean":"2024-04-25T09:01:33.825657+0000","last_became_active":"2024-04-25T09:01:28.790548+0000","last_became_peered":"2024-04-25T09:01:28.790548+0000","last_unstale":"2024-04-25T09:01:33.825657+0000","last_undegraded":"2024-04-25T09:01:33.825657+0000","last_fullsized":"2024-04-25T09:01:33.825657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826075+0000","last_change":"2024-04-25T09:01:32.835550+0000","last_active":"2024-04-25T09:01:33.826075+0000","last_peered":"2024-04-25T09:01:33.826075+0000","last_clean":"2024-04-25T09:01:33.826075+0000","last_became_active":"2024-04-25T09:01:32.835109+0000","last_became_peered":"2024-04-25T09:01:32.835109+0000","last_unstale":"2024-04-25T09:01:33.826075+0000","last_undegraded":"2024-04-25T09:01:33.826075+0000","last_fullsized":"2024-04-25T09:01:33.826075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:17.901732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212354+0000","last_change":"2024-04-25T09:01:27.802652+0000","last_active":"2024-04-25T09:01:35.212354+0000","last_peered":"2024-04-25T09:01:35.212354+0000","last_clean":"2024-04-25T09:01:35.212354+0000","last_became_active":"2024-04-25T09:01:27.802321+0000","last_became_peered":"2024-04-25T09:01:27.802321+0000","last_unstale":"2024-04-25T09:01:35.212354+0000","last_undegraded":"2024-04-25T09:01:35.212354+0000","last_fullsized":"2024-04-25T09:01:35.212354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:11.367072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825050+0000","last_change":"2024-04-25T09:01:28.796900+0000","last_active":"2024-04-25T09:01:33.825050+0000","last_peered":"2024-04-25T09:01:33.825050+0000","last_clean":"2024-04-25T09:01:33.825050+0000","last_became_active":"2024-04-25T09:01:28.796459+0000","last_became_peered":"2024-04-25T09:01:28.796459+0000","last_unstale":"2024-04-25T09:01:33.825050+0000","last_undegraded":"2024-04-25T09:01:33.825050+0000","last_fullsized":"2024-04-25T09:01:33.825050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:13.869416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825689+0000","last_change":"2024-04-25T09:01:32.841506+0000","last_active":"2024-04-25T09:01:33.825689+0000","last_peered":"2024-04-25T09:01:33.825689+0000","last_clean":"2024-04-25T09:01:33.825689+0000","last_became_active":"2024-04-25T09:01:32.841067+0000","last_became_peered":"2024-04-25T09:01:32.841067+0000","last_unstale":"2024-04-25T09:01:33.825689+0000","last_undegraded":"2024-04-25T09:01:33.825689+0000","last_fullsized":"2024-04-25T09:01:33.825689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:32.727379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211892+0000","last_change":"2024-04-25T09:01:28.799287+0000","last_active":"2024-04-25T09:01:35.211892+0000","last_peered":"2024-04-25T09:01:35.211892+0000","last_clean":"2024-04-25T09:01:35.211892+0000","last_became_active":"2024-04-25T09:01:28.798965+0000","last_became_peered":"2024-04-25T09:01:28.798965+0000","last_unstale":"2024-04-25T09:01:35.211892+0000","last_undegraded":"2024-04-25T09:01:35.211892+0000","last_fullsized":"2024-04-25T09:01:35.211892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212311+0000","last_change":"2024-04-25T09:01:27.801318+0000","last_active":"2024-04-25T09:01:35.212311+0000","last_peered":"2024-04-25T09:01:35.212311+0000","last_clean":"2024-04-25T09:01:35.212311+0000","last_became_active":"2024-04-25T09:01:27.801007+0000","last_became_peered":"2024-04-25T09:01:27.801007+0000","last_unstale":"2024-04-25T09:01:35.212311+0000","last_undegraded":"2024-04-25T09:01:35.212311+0000","last_fullsized":"2024-04-25T09:01:35.212311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:55.635349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826766+0000","last_change":"2024-04-25T09:01:32.838021+0000","last_active":"2024-04-25T09:01:33.826766+0000","last_peered":"2024-04-25T09:01:33.826766+0000","last_clean":"2024-04-25T09:01:33.826766+0000","last_became_active":"2024-04-25T09:01:32.837635+0000","last_became_peered":"2024-04-25T09:01:32.837635+0000","last_unstale":"2024-04-25T09:01:33.826766+0000","last_undegraded":"2024-04-25T09:01:33.826766+0000","last_fullsized":"2024-04-25T09:01:33.826766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:50.922350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209879+0000","last_change":"2024-04-25T09:01:28.802944+0000","last_active":"2024-04-25T09:01:35.209879+0000","last_peered":"2024-04-25T09:01:35.209879+0000","last_clean":"2024-04-25T09:01:35.209879+0000","last_became_active":"2024-04-25T09:01:28.801259+0000","last_became_peered":"2024-04-25T09:01:28.801259+0000","last_unstale":"2024-04-25T09:01:35.209879+0000","last_undegraded":"2024-04-25T09:01:35.209879+0000","last_fullsized":"2024-04-25T09:01:35.209879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366553+0000","last_change":"2024-04-25T09:01:27.794293+0000","last_active":"2024-04-25T09:01:34.366553+0000","last_peered":"2024-04-25T09:01:34.366553+0000","last_clean":"2024-04-25T09:01:34.366553+0000","last_became_active":"2024-04-25T09:01:27.794093+0000","last_became_peered":"2024-04-25T09:01:27.794093+0000","last_unstale":"2024-04-25T09:01:34.366553+0000","last_undegraded":"2024-04-25T09:01:34.366553+0000","last_fullsized":"2024-04-25T09:01:34.366553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826446+0000","last_change":"2024-04-25T09:01:32.835417+0000","last_active":"2024-04-25T09:01:33.826446+0000","last_peered":"2024-04-25T09:01:33.826446+0000","last_clean":"2024-04-25T09:01:33.826446+0000","last_became_active":"2024-04-25T09:01:32.834900+0000","last_became_peered":"2024-04-25T09:01:32.834900+0000","last_unstale":"2024-04-25T09:01:33.826446+0000","last_undegraded":"2024-04-25T09:01:33.826446+0000","last_fullsized":"2024-04-25T09:01:33.826446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:12.234115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209538+0000","last_change":"2024-04-25T09:01:28.807676+0000","last_active":"2024-04-25T09:01:35.209538+0000","last_peered":"2024-04-25T09:01:35.209538+0000","last_clean":"2024-04-25T09:01:35.209538+0000","last_became_active":"2024-04-25T09:01:28.807412+0000","last_became_peered":"2024-04-25T09:01:28.807412+0000","last_unstale":"2024-04-25T09:01:35.209538+0000","last_undegraded":"2024-04-25T09:01:35.209538+0000","last_fullsized":"2024-04-25T09:01:35.209538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366319+0000","last_change":"2024-04-25T09:01:27.792801+0000","last_active":"2024-04-25T09:01:34.366319+0000","last_peered":"2024-04-25T09:01:34.366319+0000","last_clean":"2024-04-25T09:01:34.366319+0000","last_became_active":"2024-04-25T09:01:27.792478+0000","last_became_peered":"2024-04-25T09:01:27.792478+0000","last_unstale":"2024-04-25T09:01:34.366319+0000","last_undegraded":"2024-04-25T09:01:34.366319+0000","last_fullsized":"2024-04-25T09:01:34.366319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:05.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.367126+0000","last_change":"2024-04-25T09:01:33.016837+0000","last_active":"2024-04-25T09:01:34.367126+0000","last_peered":"2024-04-25T09:01:34.367126+0000","last_clean":"2024-04-25T09:01:34.367126+0000","last_became_active":"2024-04-25T09:01:33.016394+0000","last_became_peered":"2024-04-25T09:01:33.016394+0000","last_unstale":"2024-04-25T09:01:34.367126+0000","last_undegraded":"2024-04-25T09:01:34.367126+0000","last_fullsized":"2024-04-25T09:01:34.367126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:10.891366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825930+0000","last_change":"2024-04-25T09:01:28.797789+0000","last_active":"2024-04-25T09:01:33.825930+0000","last_peered":"2024-04-25T09:01:33.825930+0000","last_clean":"2024-04-25T09:01:33.825930+0000","last_became_active":"2024-04-25T09:01:28.794550+0000","last_became_peered":"2024-04-25T09:01:28.794550+0000","last_unstale":"2024-04-25T09:01:33.825930+0000","last_undegraded":"2024-04-25T09:01:33.825930+0000","last_fullsized":"2024-04-25T09:01:33.825930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:38.459019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211810+0000","last_change":"2024-04-25T09:01:27.807626+0000","last_active":"2024-04-25T09:01:35.211810+0000","last_peered":"2024-04-25T09:01:35.211810+0000","last_clean":"2024-04-25T09:01:35.211810+0000","last_became_active":"2024-04-25T09:01:27.807340+0000","last_became_peered":"2024-04-25T09:01:27.807340+0000","last_unstale":"2024-04-25T09:01:35.211810+0000","last_undegraded":"2024-04-25T09:01:35.211810+0000","last_fullsized":"2024-04-25T09:01:35.211810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:05.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826818+0000","last_change":"2024-04-25T09:01:32.835653+0000","last_active":"2024-04-25T09:01:33.826818+0000","last_peered":"2024-04-25T09:01:33.826818+0000","last_clean":"2024-04-25T09:01:33.826818+0000","last_became_active":"2024-04-25T09:01:32.834905+0000","last_became_peered":"2024-04-25T09:01:32.834905+0000","last_unstale":"2024-04-25T09:01:33.826818+0000","last_undegraded":"2024-04-25T09:01:33.826818+0000","last_fullsized":"2024-04-25T09:01:33.826818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:28.511146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709868+0000","last_change":"2024-04-25T09:01:28.808561+0000","last_active":"2024-04-25T09:01:34.709868+0000","last_peered":"2024-04-25T09:01:34.709868+0000","last_clean":"2024-04-25T09:01:34.709868+0000","last_became_active":"2024-04-25T09:01:28.808259+0000","last_became_peered":"2024-04-25T09:01:28.808259+0000","last_unstale":"2024-04-25T09:01:34.709868+0000","last_undegraded":"2024-04-25T09:01:34.709868+0000","last_fullsized":"2024-04-25T09:01:34.709868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213361+0000","last_change":"2024-04-25T09:01:27.796535+0000","last_active":"2024-04-25T09:01:35.213361+0000","last_peered":"2024-04-25T09:01:35.213361+0000","last_clean":"2024-04-25T09:01:35.213361+0000","last_became_active":"2024-04-25T09:01:27.794550+0000","last_became_peered":"2024-04-25T09:01:27.794550+0000","last_unstale":"2024-04-25T09:01:35.213361+0000","last_undegraded":"2024-04-25T09:01:35.213361+0000","last_fullsized":"2024-04-25T09:01:35.213361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825685+0000","last_change":"2024-04-25T09:01:33.017620+0000","last_active":"2024-04-25T09:01:33.825685+0000","last_peered":"2024-04-25T09:01:33.825685+0000","last_clean":"2024-04-25T09:01:33.825685+0000","last_became_active":"2024-04-25T09:01:33.017217+0000","last_became_peered":"2024-04-25T09:01:33.017217+0000","last_unstale":"2024-04-25T09:01:33.825685+0000","last_undegraded":"2024-04-25T09:01:33.825685+0000","last_fullsized":"2024-04-25T09:01:33.825685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:49.256635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210450+0000","last_change":"2024-04-25T09:01:28.800633+0000","last_active":"2024-04-25T09:01:35.210450+0000","last_peered":"2024-04-25T09:01:35.210450+0000","last_clean":"2024-04-25T09:01:35.210450+0000","last_became_active":"2024-04-25T09:01:28.800261+0000","last_became_peered":"2024-04-25T09:01:28.800261+0000","last_unstale":"2024-04-25T09:01:35.210450+0000","last_undegraded":"2024-04-25T09:01:35.210450+0000","last_fullsized":"2024-04-25T09:01:35.210450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:45.224319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.367056+0000","last_change":"2024-04-25T09:01:27.801362+0000","last_active":"2024-04-25T09:01:34.367056+0000","last_peered":"2024-04-25T09:01:34.367056+0000","last_clean":"2024-04-25T09:01:34.367056+0000","last_became_active":"2024-04-25T09:01:27.800960+0000","last_became_peered":"2024-04-25T09:01:27.800960+0000","last_unstale":"2024-04-25T09:01:34.367056+0000","last_undegraded":"2024-04-25T09:01:34.367056+0000","last_fullsized":"2024-04-25T09:01:34.367056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209644+0000","last_change":"2024-04-25T09:01:33.014181+0000","last_active":"2024-04-25T09:01:35.209644+0000","last_peered":"2024-04-25T09:01:35.209644+0000","last_clean":"2024-04-25T09:01:35.209644+0000","last_became_active":"2024-04-25T09:01:33.013656+0000","last_became_peered":"2024-04-25T09:01:33.013656+0000","last_unstale":"2024-04-25T09:01:35.209644+0000","last_undegraded":"2024-04-25T09:01:35.209644+0000","last_fullsized":"2024-04-25T09:01:35.209644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:05.608973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366825+0000","last_change":"2024-04-25T09:01:28.801779+0000","last_active":"2024-04-25T09:01:34.366825+0000","last_peered":"2024-04-25T09:01:34.366825+0000","last_clean":"2024-04-25T09:01:34.366825+0000","last_became_active":"2024-04-25T09:01:28.801429+0000","last_became_peered":"2024-04-25T09:01:28.801429+0000","last_unstale":"2024-04-25T09:01:34.366825+0000","last_undegraded":"2024-04-25T09:01:34.366825+0000","last_fullsized":"2024-04-25T09:01:34.366825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212914+0000","last_change":"2024-04-25T09:01:27.812215+0000","last_active":"2024-04-25T09:01:35.212914+0000","last_peered":"2024-04-25T09:01:35.212914+0000","last_clean":"2024-04-25T09:01:35.212914+0000","last_became_active":"2024-04-25T09:01:27.811906+0000","last_became_peered":"2024-04-25T09:01:27.811906+0000","last_unstale":"2024-04-25T09:01:35.212914+0000","last_undegraded":"2024-04-25T09:01:35.212914+0000","last_fullsized":"2024-04-25T09:01:35.212914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:40.543447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709529+0000","last_change":"2024-04-25T09:01:33.012476+0000","last_active":"2024-04-25T09:01:34.709529+0000","last_peered":"2024-04-25T09:01:34.709529+0000","last_clean":"2024-04-25T09:01:34.709529+0000","last_became_active":"2024-04-25T09:01:33.012051+0000","last_became_peered":"2024-04-25T09:01:33.012051+0000","last_unstale":"2024-04-25T09:01:34.709529+0000","last_undegraded":"2024-04-25T09:01:34.709529+0000","last_fullsized":"2024-04-25T09:01:34.709529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:10.891366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825182+0000","last_change":"2024-04-25T09:01:28.796673+0000","last_active":"2024-04-25T09:01:33.825182+0000","last_peered":"2024-04-25T09:01:33.825182+0000","last_clean":"2024-04-25T09:01:33.825182+0000","last_became_active":"2024-04-25T09:01:28.796137+0000","last_became_peered":"2024-04-25T09:01:28.796137+0000","last_unstale":"2024-04-25T09:01:33.825182+0000","last_undegraded":"2024-04-25T09:01:33.825182+0000","last_fullsized":"2024-04-25T09:01:33.825182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:24.478830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366854+0000","last_change":"2024-04-25T09:01:27.806338+0000","last_active":"2024-04-25T09:01:34.366854+0000","last_peered":"2024-04-25T09:01:34.366854+0000","last_clean":"2024-04-25T09:01:34.366854+0000","last_became_active":"2024-04-25T09:01:27.806001+0000","last_became_peered":"2024-04-25T09:01:27.806001+0000","last_unstale":"2024-04-25T09:01:34.366854+0000","last_undegraded":"2024-04-25T09:01:34.366854+0000","last_fullsized":"2024-04-25T09:01:34.366854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366354+0000","last_change":"2024-04-25T09:01:32.842661+0000","last_active":"2024-04-25T09:01:34.366354+0000","last_peered":"2024-04-25T09:01:34.366354+0000","last_clean":"2024-04-25T09:01:34.366354+0000","last_became_active":"2024-04-25T09:01:32.840675+0000","last_became_peered":"2024-04-25T09:01:32.840675+0000","last_unstale":"2024-04-25T09:01:34.366354+0000","last_undegraded":"2024-04-25T09:01:34.366354+0000","last_fullsized":"2024-04-25T09:01:34.366354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:28.511146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826233+0000","last_change":"2024-04-25T09:01:28.808388+0000","last_active":"2024-04-25T09:01:33.826233+0000","last_peered":"2024-04-25T09:01:33.826233+0000","last_clean":"2024-04-25T09:01:33.826233+0000","last_became_active":"2024-04-25T09:01:28.808066+0000","last_became_peered":"2024-04-25T09:01:28.808066+0000","last_unstale":"2024-04-25T09:01:33.826233+0000","last_undegraded":"2024-04-25T09:01:33.826233+0000","last_fullsized":"2024-04-25T09:01:33.826233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:25.394669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825354+0000","last_change":"2024-04-25T09:01:27.791322+0000","last_active":"2024-04-25T09:01:33.825354+0000","last_peered":"2024-04-25T09:01:33.825354+0000","last_clean":"2024-04-25T09:01:33.825354+0000","last_became_active":"2024-04-25T09:01:27.790832+0000","last_became_peered":"2024-04-25T09:01:27.790832+0000","last_unstale":"2024-04-25T09:01:33.825354+0000","last_undegraded":"2024-04-25T09:01:33.825354+0000","last_fullsized":"2024-04-25T09:01:33.825354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366775+0000","last_change":"2024-04-25T09:01:32.833388+0000","last_active":"2024-04-25T09:01:34.366775+0000","last_peered":"2024-04-25T09:01:34.366775+0000","last_clean":"2024-04-25T09:01:34.366775+0000","last_became_active":"2024-04-25T09:01:32.832933+0000","last_became_peered":"2024-04-25T09:01:32.832933+0000","last_unstale":"2024-04-25T09:01:34.366775+0000","last_undegraded":"2024-04-25T09:01:34.366775+0000","last_fullsized":"2024-04-25T09:01:34.366775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366415+0000","last_change":"2024-04-25T09:01:28.808496+0000","last_active":"2024-04-25T09:01:34.366415+0000","last_peered":"2024-04-25T09:01:34.366415+0000","last_clean":"2024-04-25T09:01:34.366415+0000","last_became_active":"2024-04-25T09:01:28.808041+0000","last_became_peered":"2024-04-25T09:01:28.808041+0000","last_unstale":"2024-04-25T09:01:34.366415+0000","last_undegraded":"2024-04-25T09:01:34.366415+0000","last_fullsized":"2024-04-25T09:01:34.366415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821744+0000","last_change":"2024-04-25T09:01:27.794633+0000","last_active":"2024-04-25T09:01:33.821744+0000","last_peered":"2024-04-25T09:01:33.821744+0000","last_clean":"2024-04-25T09:01:33.821744+0000","last_became_active":"2024-04-25T09:01:27.794353+0000","last_became_peered":"2024-04-25T09:01:27.794353+0000","last_unstale":"2024-04-25T09:01:33.821744+0000","last_undegraded":"2024-04-25T09:01:33.821744+0000","last_fullsized":"2024-04-25T09:01:33.821744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.367203+0000","last_change":"2024-04-25T09:01:32.841897+0000","last_active":"2024-04-25T09:01:34.367203+0000","last_peered":"2024-04-25T09:01:34.367203+0000","last_clean":"2024-04-25T09:01:34.367203+0000","last_became_active":"2024-04-25T09:01:32.840196+0000","last_became_peered":"2024-04-25T09:01:32.840196+0000","last_unstale":"2024-04-25T09:01:34.367203+0000","last_undegraded":"2024-04-25T09:01:34.367203+0000","last_fullsized":"2024-04-25T09:01:34.367203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:35.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.708999+0000","last_change":"2024-04-25T09:01:28.791325+0000","last_active":"2024-04-25T09:01:34.708999+0000","last_peered":"2024-04-25T09:01:34.708999+0000","last_clean":"2024-04-25T09:01:34.708999+0000","last_became_active":"2024-04-25T09:01:28.791016+0000","last_became_peered":"2024-04-25T09:01:28.791016+0000","last_unstale":"2024-04-25T09:01:34.708999+0000","last_undegraded":"2024-04-25T09:01:34.708999+0000","last_fullsized":"2024-04-25T09:01:34.708999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:57.905760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211553+0000","last_change":"2024-04-25T09:01:27.799619+0000","last_active":"2024-04-25T09:01:35.211553+0000","last_peered":"2024-04-25T09:01:35.211553+0000","last_clean":"2024-04-25T09:01:35.211553+0000","last_became_active":"2024-04-25T09:01:27.799353+0000","last_became_peered":"2024-04-25T09:01:27.799353+0000","last_unstale":"2024-04-25T09:01:35.211553+0000","last_undegraded":"2024-04-25T09:01:35.211553+0000","last_fullsized":"2024-04-25T09:01:35.211553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709772+0000","last_change":"2024-04-25T09:01:33.017927+0000","last_active":"2024-04-25T09:01:34.709772+0000","last_peered":"2024-04-25T09:01:34.709772+0000","last_clean":"2024-04-25T09:01:34.709772+0000","last_became_active":"2024-04-25T09:01:33.017228+0000","last_became_peered":"2024-04-25T09:01:33.017228+0000","last_unstale":"2024-04-25T09:01:34.709772+0000","last_undegraded":"2024-04-25T09:01:34.709772+0000","last_fullsized":"2024-04-25T09:01:34.709772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.980668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209536+0000","last_change":"2024-04-25T09:01:28.797698+0000","last_active":"2024-04-25T09:01:35.209536+0000","last_peered":"2024-04-25T09:01:35.209536+0000","last_clean":"2024-04-25T09:01:35.209536+0000","last_became_active":"2024-04-25T09:01:28.797432+0000","last_became_peered":"2024-04-25T09:01:28.797432+0000","last_unstale":"2024-04-25T09:01:35.209536+0000","last_undegraded":"2024-04-25T09:01:35.209536+0000","last_fullsized":"2024-04-25T09:01:35.209536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824821+0000","last_change":"2024-04-25T09:01:27.786713+0000","last_active":"2024-04-25T09:01:33.824821+0000","last_peered":"2024-04-25T09:01:33.824821+0000","last_clean":"2024-04-25T09:01:33.824821+0000","last_became_active":"2024-04-25T09:01:27.786382+0000","last_became_peered":"2024-04-25T09:01:27.786382+0000","last_unstale":"2024-04-25T09:01:33.824821+0000","last_undegraded":"2024-04-25T09:01:33.824821+0000","last_fullsized":"2024-04-25T09:01:33.824821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211687+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:01:35.211687+0000","last_peered":"2024-04-25T09:01:35.211687+0000","last_clean":"2024-04-25T09:01:35.211687+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:01:35.211687+0000","last_undegraded":"2024-04-25T09:01:35.211687+0000","last_fullsized":"2024-04-25T09:01:35.211687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213128+0000","last_change":"2024-04-25T09:01:33.018970+0000","last_active":"2024-04-25T09:01:35.213128+0000","last_peered":"2024-04-25T09:01:35.213128+0000","last_clean":"2024-04-25T09:01:35.213128+0000","last_became_active":"2024-04-25T09:01:33.018274+0000","last_became_peered":"2024-04-25T09:01:33.018274+0000","last_unstale":"2024-04-25T09:01:35.213128+0000","last_undegraded":"2024-04-25T09:01:35.213128+0000","last_fullsized":"2024-04-25T09:01:35.213128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212686+0000","last_change":"2024-04-25T09:01:28.821408+0000","last_active":"2024-04-25T09:01:35.212686+0000","last_peered":"2024-04-25T09:01:35.212686+0000","last_clean":"2024-04-25T09:01:35.212686+0000","last_became_active":"2024-04-25T09:01:28.821141+0000","last_became_peered":"2024-04-25T09:01:28.821141+0000","last_unstale":"2024-04-25T09:01:35.212686+0000","last_undegraded":"2024-04-25T09:01:35.212686+0000","last_fullsized":"2024-04-25T09:01:35.212686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:33.239521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821975+0000","last_change":"2024-04-25T09:01:27.789772+0000","last_active":"2024-04-25T09:01:33.821975+0000","last_peered":"2024-04-25T09:01:33.821975+0000","last_clean":"2024-04-25T09:01:33.821975+0000","last_became_active":"2024-04-25T09:01:27.789396+0000","last_became_peered":"2024-04-25T09:01:27.789396+0000","last_unstale":"2024-04-25T09:01:33.821975+0000","last_undegraded":"2024-04-25T09:01:33.821975+0000","last_fullsized":"2024-04-25T09:01:33.821975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212034+0000","last_change":"2024-04-25T09:01:33.015998+0000","last_active":"2024-04-25T09:01:35.212034+0000","last_peered":"2024-04-25T09:01:35.212034+0000","last_clean":"2024-04-25T09:01:35.212034+0000","last_became_active":"2024-04-25T09:01:33.015527+0000","last_became_peered":"2024-04-25T09:01:33.015527+0000","last_unstale":"2024-04-25T09:01:35.212034+0000","last_undegraded":"2024-04-25T09:01:35.212034+0000","last_fullsized":"2024-04-25T09:01:35.212034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:28.511146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825725+0000","last_change":"2024-04-25T09:01:28.799867+0000","last_active":"2024-04-25T09:01:33.825725+0000","last_peered":"2024-04-25T09:01:33.825725+0000","last_clean":"2024-04-25T09:01:33.825725+0000","last_became_active":"2024-04-25T09:01:28.799555+0000","last_became_peered":"2024-04-25T09:01:28.799555+0000","last_unstale":"2024-04-25T09:01:33.825725+0000","last_undegraded":"2024-04-25T09:01:33.825725+0000","last_fullsized":"2024-04-25T09:01:33.825725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:46.890034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366891+0000","last_change":"2024-04-25T09:01:27.799345+0000","last_active":"2024-04-25T09:01:34.366891+0000","last_peered":"2024-04-25T09:01:34.366891+0000","last_clean":"2024-04-25T09:01:34.366891+0000","last_became_active":"2024-04-25T09:01:27.799041+0000","last_became_peered":"2024-04-25T09:01:27.799041+0000","last_unstale":"2024-04-25T09:01:34.366891+0000","last_undegraded":"2024-04-25T09:01:34.366891+0000","last_fullsized":"2024-04-25T09:01:34.366891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709467+0000","last_change":"2024-04-25T09:01:32.848657+0000","last_active":"2024-04-25T09:01:34.709467+0000","last_peered":"2024-04-25T09:01:34.709467+0000","last_clean":"2024-04-25T09:01:34.709467+0000","last_became_active":"2024-04-25T09:01:32.848154+0000","last_became_peered":"2024-04-25T09:01:32.848154+0000","last_unstale":"2024-04-25T09:01:34.709467+0000","last_undegraded":"2024-04-25T09:01:34.709467+0000","last_fullsized":"2024-04-25T09:01:34.709467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213067+0000","last_change":"2024-04-25T09:01:28.816736+0000","last_active":"2024-04-25T09:01:35.213067+0000","last_peered":"2024-04-25T09:01:35.213067+0000","last_clean":"2024-04-25T09:01:35.213067+0000","last_became_active":"2024-04-25T09:01:28.814910+0000","last_became_peered":"2024-04-25T09:01:28.814910+0000","last_unstale":"2024-04-25T09:01:35.213067+0000","last_undegraded":"2024-04-25T09:01:35.213067+0000","last_fullsized":"2024-04-25T09:01:35.213067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:03.946126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.822115+0000","last_change":"2024-04-25T09:01:27.791793+0000","last_active":"2024-04-25T09:01:33.822115+0000","last_peered":"2024-04-25T09:01:33.822115+0000","last_clean":"2024-04-25T09:01:33.822115+0000","last_became_active":"2024-04-25T09:01:27.791559+0000","last_became_peered":"2024-04-25T09:01:27.791559+0000","last_unstale":"2024-04-25T09:01:33.822115+0000","last_undegraded":"2024-04-25T09:01:33.822115+0000","last_fullsized":"2024-04-25T09:01:33.822115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824560+0000","last_change":"2024-04-25T09:01:33.014380+0000","last_active":"2024-04-25T09:01:33.824560+0000","last_peered":"2024-04-25T09:01:33.824560+0000","last_clean":"2024-04-25T09:01:33.824560+0000","last_became_active":"2024-04-25T09:01:33.013885+0000","last_became_peered":"2024-04-25T09:01:33.013885+0000","last_unstale":"2024-04-25T09:01:33.824560+0000","last_undegraded":"2024-04-25T09:01:33.824560+0000","last_fullsized":"2024-04-25T09:01:33.824560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:43.548883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212597+0000","last_change":"2024-04-25T09:01:28.818477+0000","last_active":"2024-04-25T09:01:35.212597+0000","last_peered":"2024-04-25T09:01:35.212597+0000","last_clean":"2024-04-25T09:01:35.212597+0000","last_became_active":"2024-04-25T09:01:28.815329+0000","last_became_peered":"2024-04-25T09:01:28.815329+0000","last_unstale":"2024-04-25T09:01:35.212597+0000","last_undegraded":"2024-04-25T09:01:35.212597+0000","last_fullsized":"2024-04-25T09:01:35.212597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:31.277254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.827013+0000","last_change":"2024-04-25T09:01:27.803319+0000","last_active":"2024-04-25T09:01:33.827013+0000","last_peered":"2024-04-25T09:01:33.827013+0000","last_clean":"2024-04-25T09:01:33.827013+0000","last_became_active":"2024-04-25T09:01:27.802815+0000","last_became_peered":"2024-04-25T09:01:27.802815+0000","last_unstale":"2024-04-25T09:01:33.827013+0000","last_undegraded":"2024-04-25T09:01:33.827013+0000","last_fullsized":"2024-04-25T09:01:33.827013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:51.791461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825394+0000","last_change":"2024-04-25T09:01:32.836009+0000","last_active":"2024-04-25T09:01:33.825394+0000","last_peered":"2024-04-25T09:01:33.825394+0000","last_clean":"2024-04-25T09:01:33.825394+0000","last_became_active":"2024-04-25T09:01:32.835471+0000","last_became_peered":"2024-04-25T09:01:32.835471+0000","last_unstale":"2024-04-25T09:01:33.825394+0000","last_undegraded":"2024-04-25T09:01:33.825394+0000","last_fullsized":"2024-04-25T09:01:33.825394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:59.537310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211909+0000","last_change":"2024-04-25T09:01:28.814374+0000","last_active":"2024-04-25T09:01:35.211909+0000","last_peered":"2024-04-25T09:01:35.211909+0000","last_clean":"2024-04-25T09:01:35.211909+0000","last_became_active":"2024-04-25T09:01:28.813316+0000","last_became_peered":"2024-04-25T09:01:28.813316+0000","last_unstale":"2024-04-25T09:01:35.211909+0000","last_undegraded":"2024-04-25T09:01:35.211909+0000","last_fullsized":"2024-04-25T09:01:35.211909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:06.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821520+0000","last_change":"2024-04-25T09:01:27.787446+0000","last_active":"2024-04-25T09:01:33.821520+0000","last_peered":"2024-04-25T09:01:33.821520+0000","last_clean":"2024-04-25T09:01:33.821520+0000","last_became_active":"2024-04-25T09:01:27.787231+0000","last_became_peered":"2024-04-25T09:01:27.787231+0000","last_unstale":"2024-04-25T09:01:33.821520+0000","last_undegraded":"2024-04-25T09:01:33.821520+0000","last_fullsized":"2024-04-25T09:01:33.821520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709640+0000","last_change":"2024-04-25T09:01:32.837266+0000","last_active":"2024-04-25T09:01:34.709640+0000","last_peered":"2024-04-25T09:01:34.709640+0000","last_clean":"2024-04-25T09:01:34.709640+0000","last_became_active":"2024-04-25T09:01:32.836642+0000","last_became_peered":"2024-04-25T09:01:32.836642+0000","last_unstale":"2024-04-25T09:01:34.709640+0000","last_undegraded":"2024-04-25T09:01:34.709640+0000","last_fullsized":"2024-04-25T09:01:34.709640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:35.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211856+0000","last_change":"2024-04-25T09:01:28.800379+0000","last_active":"2024-04-25T09:01:35.211856+0000","last_peered":"2024-04-25T09:01:35.211856+0000","last_clean":"2024-04-25T09:01:35.211856+0000","last_became_active":"2024-04-25T09:01:28.800083+0000","last_became_peered":"2024-04-25T09:01:28.800083+0000","last_unstale":"2024-04-25T09:01:35.211856+0000","last_undegraded":"2024-04-25T09:01:35.211856+0000","last_fullsized":"2024-04-25T09:01:35.211856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212519+0000","last_change":"2024-04-25T09:01:27.795530+0000","last_active":"2024-04-25T09:01:35.212519+0000","last_peered":"2024-04-25T09:01:35.212519+0000","last_clean":"2024-04-25T09:01:35.212519+0000","last_became_active":"2024-04-25T09:01:27.795206+0000","last_became_peered":"2024-04-25T09:01:27.795206+0000","last_unstale":"2024-04-25T09:01:35.212519+0000","last_undegraded":"2024-04-25T09:01:35.212519+0000","last_fullsized":"2024-04-25T09:01:35.212519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:05.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210403+0000","last_change":"2024-04-25T09:01:33.016132+0000","last_active":"2024-04-25T09:01:35.210403+0000","last_peered":"2024-04-25T09:01:35.210403+0000","last_clean":"2024-04-25T09:01:35.210403+0000","last_became_active":"2024-04-25T09:01:33.015731+0000","last_became_peered":"2024-04-25T09:01:33.015731+0000","last_unstale":"2024-04-25T09:01:35.210403+0000","last_undegraded":"2024-04-25T09:01:35.210403+0000","last_fullsized":"2024-04-25T09:01:35.210403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:50.222305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212180+0000","last_change":"2024-04-25T09:01:28.815186+0000","last_active":"2024-04-25T09:01:35.212180+0000","last_peered":"2024-04-25T09:01:35.212180+0000","last_clean":"2024-04-25T09:01:35.212180+0000","last_became_active":"2024-04-25T09:01:28.814898+0000","last_became_peered":"2024-04-25T09:01:28.814898+0000","last_unstale":"2024-04-25T09:01:35.212180+0000","last_undegraded":"2024-04-25T09:01:35.212180+0000","last_fullsized":"2024-04-25T09:01:35.212180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:06.715519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825295+0000","last_change":"2024-04-25T09:01:27.795891+0000","last_active":"2024-04-25T09:01:33.825295+0000","last_peered":"2024-04-25T09:01:33.825295+0000","last_clean":"2024-04-25T09:01:33.825295+0000","last_became_active":"2024-04-25T09:01:27.795562+0000","last_became_peered":"2024-04-25T09:01:27.795562+0000","last_unstale":"2024-04-25T09:01:33.825295+0000","last_undegraded":"2024-04-25T09:01:33.825295+0000","last_fullsized":"2024-04-25T09:01:33.825295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210193+0000","last_change":"2024-04-25T09:01:33.014268+0000","last_active":"2024-04-25T09:01:35.210193+0000","last_peered":"2024-04-25T09:01:35.210193+0000","last_clean":"2024-04-25T09:01:35.210193+0000","last_became_active":"2024-04-25T09:01:33.013631+0000","last_became_peered":"2024-04-25T09:01:33.013631+0000","last_unstale":"2024-04-25T09:01:35.210193+0000","last_undegraded":"2024-04-25T09:01:35.210193+0000","last_fullsized":"2024-04-25T09:01:35.210193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:53.678828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709267+0000","last_change":"2024-04-25T09:01:28.805284+0000","last_active":"2024-04-25T09:01:34.709267+0000","last_peered":"2024-04-25T09:01:34.709267+0000","last_clean":"2024-04-25T09:01:34.709267+0000","last_became_active":"2024-04-25T09:01:28.804641+0000","last_became_peered":"2024-04-25T09:01:28.804641+0000","last_unstale":"2024-04-25T09:01:34.709267+0000","last_undegraded":"2024-04-25T09:01:34.709267+0000","last_fullsized":"2024-04-25T09:01:34.709267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:45.827977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709703+0000","last_change":"2024-04-25T09:01:27.803192+0000","last_active":"2024-04-25T09:01:34.709703+0000","last_peered":"2024-04-25T09:01:34.709703+0000","last_clean":"2024-04-25T09:01:34.709703+0000","last_became_active":"2024-04-25T09:01:27.802987+0000","last_became_peered":"2024-04-25T09:01:27.802987+0000","last_unstale":"2024-04-25T09:01:34.709703+0000","last_undegraded":"2024-04-25T09:01:34.709703+0000","last_fullsized":"2024-04-25T09:01:34.709703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:09.133960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825159+0000","last_change":"2024-04-25T09:01:33.017405+0000","last_active":"2024-04-25T09:01:33.825159+0000","last_peered":"2024-04-25T09:01:33.825159+0000","last_clean":"2024-04-25T09:01:33.825159+0000","last_became_active":"2024-04-25T09:01:33.016855+0000","last_became_peered":"2024-04-25T09:01:33.016855+0000","last_unstale":"2024-04-25T09:01:33.825159+0000","last_undegraded":"2024-04-25T09:01:33.825159+0000","last_fullsized":"2024-04-25T09:01:33.825159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:24.797218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212580+0000","last_change":"2024-04-25T09:01:28.813680+0000","last_active":"2024-04-25T09:01:35.212580+0000","last_peered":"2024-04-25T09:01:35.212580+0000","last_clean":"2024-04-25T09:01:35.212580+0000","last_became_active":"2024-04-25T09:01:28.812991+0000","last_became_peered":"2024-04-25T09:01:28.812991+0000","last_unstale":"2024-04-25T09:01:35.212580+0000","last_undegraded":"2024-04-25T09:01:35.212580+0000","last_fullsized":"2024-04-25T09:01:35.212580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:24.478830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:44.640397+0000","last_change":"2024-04-25T09:01:27.792429+0000","last_active":"2024-04-25T09:01:44.640397+0000","last_peered":"2024-04-25T09:01:44.640397+0000","last_clean":"2024-04-25T09:01:44.640397+0000","last_became_active":"2024-04-25T09:01:27.792126+0000","last_became_peered":"2024-04-25T09:01:27.792126+0000","last_unstale":"2024-04-25T09:01:44.640397+0000","last_undegraded":"2024-04-25T09:01:44.640397+0000","last_fullsized":"2024-04-25T09:01:44.640397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366571+0000","last_change":"2024-04-25T09:01:32.840515+0000","last_active":"2024-04-25T09:01:34.366571+0000","last_peered":"2024-04-25T09:01:34.366571+0000","last_clean":"2024-04-25T09:01:34.366571+0000","last_became_active":"2024-04-25T09:01:32.840063+0000","last_became_peered":"2024-04-25T09:01:32.840063+0000","last_unstale":"2024-04-25T09:01:34.366571+0000","last_undegraded":"2024-04-25T09:01:34.366571+0000","last_fullsized":"2024-04-25T09:01:34.366571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.271837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826624+0000","last_change":"2024-04-25T09:01:28.809794+0000","last_active":"2024-04-25T09:01:33.826624+0000","last_peered":"2024-04-25T09:01:33.826624+0000","last_clean":"2024-04-25T09:01:33.826624+0000","last_became_active":"2024-04-25T09:01:28.809503+0000","last_became_peered":"2024-04-25T09:01:28.809503+0000","last_unstale":"2024-04-25T09:01:33.826624+0000","last_undegraded":"2024-04-25T09:01:33.826624+0000","last_fullsized":"2024-04-25T09:01:33.826624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:56.645747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366841+0000","last_change":"2024-04-25T09:01:27.789736+0000","last_active":"2024-04-25T09:01:34.366841+0000","last_peered":"2024-04-25T09:01:34.366841+0000","last_clean":"2024-04-25T09:01:34.366841+0000","last_became_active":"2024-04-25T09:01:27.789445+0000","last_became_peered":"2024-04-25T09:01:27.789445+0000","last_unstale":"2024-04-25T09:01:34.366841+0000","last_undegraded":"2024-04-25T09:01:34.366841+0000","last_fullsized":"2024-04-25T09:01:34.366841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826093+0000","last_change":"2024-04-25T09:01:32.835148+0000","last_active":"2024-04-25T09:01:33.826093+0000","last_peered":"2024-04-25T09:01:33.826093+0000","last_clean":"2024-04-25T09:01:33.826093+0000","last_became_active":"2024-04-25T09:01:32.834679+0000","last_became_peered":"2024-04-25T09:01:32.834679+0000","last_unstale":"2024-04-25T09:01:33.826093+0000","last_undegraded":"2024-04-25T09:01:33.826093+0000","last_fullsized":"2024-04-25T09:01:33.826093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:46.590077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709785+0000","last_change":"2024-04-25T09:01:28.805826+0000","last_active":"2024-04-25T09:01:34.709785+0000","last_peered":"2024-04-25T09:01:34.709785+0000","last_clean":"2024-04-25T09:01:34.709785+0000","last_became_active":"2024-04-25T09:01:28.805543+0000","last_became_peered":"2024-04-25T09:01:28.805543+0000","last_unstale":"2024-04-25T09:01:34.709785+0000","last_undegraded":"2024-04-25T09:01:34.709785+0000","last_fullsized":"2024-04-25T09:01:34.709785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825327+0000","last_change":"2024-04-25T09:01:27.801739+0000","last_active":"2024-04-25T09:01:33.825327+0000","last_peered":"2024-04-25T09:01:33.825327+0000","last_clean":"2024-04-25T09:01:33.825327+0000","last_became_active":"2024-04-25T09:01:27.801422+0000","last_became_peered":"2024-04-25T09:01:27.801422+0000","last_unstale":"2024-04-25T09:01:33.825327+0000","last_undegraded":"2024-04-25T09:01:33.825327+0000","last_fullsized":"2024-04-25T09:01:33.825327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209484+0000","last_change":"2024-04-25T09:01:32.836512+0000","last_active":"2024-04-25T09:01:35.209484+0000","last_peered":"2024-04-25T09:01:35.209484+0000","last_clean":"2024-04-25T09:01:35.209484+0000","last_became_active":"2024-04-25T09:01:32.834922+0000","last_became_peered":"2024-04-25T09:01:32.834922+0000","last_unstale":"2024-04-25T09:01:35.209484+0000","last_undegraded":"2024-04-25T09:01:35.209484+0000","last_fullsized":"2024-04-25T09:01:35.209484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:43.548883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825176+0000","last_change":"2024-04-25T09:01:28.803133+0000","last_active":"2024-04-25T09:01:33.825176+0000","last_peered":"2024-04-25T09:01:33.825176+0000","last_clean":"2024-04-25T09:01:33.825176+0000","last_became_active":"2024-04-25T09:01:28.802575+0000","last_became_peered":"2024-04-25T09:01:28.802575+0000","last_unstale":"2024-04-25T09:01:33.825176+0000","last_undegraded":"2024-04-25T09:01:33.825176+0000","last_fullsized":"2024-04-25T09:01:33.825176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:42.557761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213247+0000","last_change":"2024-04-25T09:01:27.795989+0000","last_active":"2024-04-25T09:01:35.213247+0000","last_peered":"2024-04-25T09:01:35.213247+0000","last_clean":"2024-04-25T09:01:35.213247+0000","last_became_active":"2024-04-25T09:01:27.794189+0000","last_became_peered":"2024-04-25T09:01:27.794189+0000","last_unstale":"2024-04-25T09:01:35.213247+0000","last_undegraded":"2024-04-25T09:01:35.213247+0000","last_fullsized":"2024-04-25T09:01:35.213247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209544+0000","last_change":"2024-04-25T09:01:33.016051+0000","last_active":"2024-04-25T09:01:35.209544+0000","last_peered":"2024-04-25T09:01:35.209544+0000","last_clean":"2024-04-25T09:01:35.209544+0000","last_became_active":"2024-04-25T09:01:33.015720+0000","last_became_peered":"2024-04-25T09:01:33.015720+0000","last_unstale":"2024-04-25T09:01:35.209544+0000","last_undegraded":"2024-04-25T09:01:35.209544+0000","last_fullsized":"2024-04-25T09:01:35.209544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:24.797218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709440+0000","last_change":"2024-04-25T09:01:33.018289+0000","last_active":"2024-04-25T09:01:34.709440+0000","last_peered":"2024-04-25T09:01:34.709440+0000","last_clean":"2024-04-25T09:01:34.709440+0000","last_became_active":"2024-04-25T09:01:33.017643+0000","last_became_peered":"2024-04-25T09:01:33.017643+0000","last_unstale":"2024-04-25T09:01:34.709440+0000","last_undegraded":"2024-04-25T09:01:34.709440+0000","last_fullsized":"2024-04-25T09:01:34.709440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.271837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366208+0000","last_change":"2024-04-25T09:01:28.805719+0000","last_active":"2024-04-25T09:01:34.366208+0000","last_peered":"2024-04-25T09:01:34.366208+0000","last_clean":"2024-04-25T09:01:34.366208+0000","last_became_active":"2024-04-25T09:01:28.805394+0000","last_became_peered":"2024-04-25T09:01:28.805394+0000","last_unstale":"2024-04-25T09:01:34.366208+0000","last_undegraded":"2024-04-25T09:01:34.366208+0000","last_fullsized":"2024-04-25T09:01:34.366208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824665+0000","last_change":"2024-04-25T09:01:27.797013+0000","last_active":"2024-04-25T09:01:33.824665+0000","last_peered":"2024-04-25T09:01:33.824665+0000","last_clean":"2024-04-25T09:01:33.824665+0000","last_became_active":"2024-04-25T09:01:27.795312+0000","last_became_peered":"2024-04-25T09:01:27.795312+0000","last_unstale":"2024-04-25T09:01:33.824665+0000","last_undegraded":"2024-04-25T09:01:33.824665+0000","last_fullsized":"2024-04-25T09:01:33.824665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212668+0000","last_change":"2024-04-25T09:01:32.845195+0000","last_active":"2024-04-25T09:01:35.212668+0000","last_peered":"2024-04-25T09:01:35.212668+0000","last_clean":"2024-04-25T09:01:35.212668+0000","last_became_active":"2024-04-25T09:01:32.844725+0000","last_became_peered":"2024-04-25T09:01:32.844725+0000","last_unstale":"2024-04-25T09:01:35.212668+0000","last_undegraded":"2024-04-25T09:01:35.212668+0000","last_fullsized":"2024-04-25T09:01:35.212668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.271837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209436+0000","last_change":"2024-04-25T09:01:28.802082+0000","last_active":"2024-04-25T09:01:35.209436+0000","last_peered":"2024-04-25T09:01:35.209436+0000","last_clean":"2024-04-25T09:01:35.209436+0000","last_became_active":"2024-04-25T09:01:28.801617+0000","last_became_peered":"2024-04-25T09:01:28.801617+0000","last_unstale":"2024-04-25T09:01:35.209436+0000","last_undegraded":"2024-04-25T09:01:35.209436+0000","last_fullsized":"2024-04-25T09:01:35.209436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209733+0000","last_change":"2024-04-25T09:01:27.799488+0000","last_active":"2024-04-25T09:01:35.209733+0000","last_peered":"2024-04-25T09:01:35.209733+0000","last_clean":"2024-04-25T09:01:35.209733+0000","last_became_active":"2024-04-25T09:01:27.799191+0000","last_became_peered":"2024-04-25T09:01:27.799191+0000","last_unstale":"2024-04-25T09:01:35.209733+0000","last_undegraded":"2024-04-25T09:01:35.209733+0000","last_fullsized":"2024-04-25T09:01:35.209733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:58.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212177+0000","last_change":"2024-04-25T09:01:27.802418+0000","last_active":"2024-04-25T09:01:35.212177+0000","last_peered":"2024-04-25T09:01:35.212177+0000","last_clean":"2024-04-25T09:01:35.212177+0000","last_became_active":"2024-04-25T09:01:27.802128+0000","last_became_peered":"2024-04-25T09:01:27.802128+0000","last_unstale":"2024-04-25T09:01:35.212177+0000","last_undegraded":"2024-04-25T09:01:35.212177+0000","last_fullsized":"2024-04-25T09:01:35.212177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709621+0000","last_change":"2024-04-25T09:01:28.802082+0000","last_active":"2024-04-25T09:01:34.709621+0000","last_peered":"2024-04-25T09:01:34.709621+0000","last_clean":"2024-04-25T09:01:34.709621+0000","last_became_active":"2024-04-25T09:01:28.801820+0000","last_became_peered":"2024-04-25T09:01:28.801820+0000","last_unstale":"2024-04-25T09:01:34.709621+0000","last_undegraded":"2024-04-25T09:01:34.709621+0000","last_fullsized":"2024-04-25T09:01:34.709621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821849+0000","last_change":"2024-04-25T09:01:32.838999+0000","last_active":"2024-04-25T09:01:33.821849+0000","last_peered":"2024-04-25T09:01:33.821849+0000","last_clean":"2024-04-25T09:01:33.821849+0000","last_became_active":"2024-04-25T09:01:32.838525+0000","last_became_peered":"2024-04-25T09:01:32.838525+0000","last_unstale":"2024-04-25T09:01:33.821849+0000","last_undegraded":"2024-04-25T09:01:33.821849+0000","last_fullsized":"2024-04-25T09:01:33.821849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:49.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209935+0000","last_change":"2024-04-25T09:01:27.795362+0000","last_active":"2024-04-25T09:01:35.209935+0000","last_peered":"2024-04-25T09:01:35.209935+0000","last_clean":"2024-04-25T09:01:35.209935+0000","last_became_active":"2024-04-25T09:01:27.795063+0000","last_became_peered":"2024-04-25T09:01:27.795063+0000","last_unstale":"2024-04-25T09:01:35.209935+0000","last_undegraded":"2024-04-25T09:01:35.209935+0000","last_fullsized":"2024-04-25T09:01:35.209935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825751+0000","last_change":"2024-04-25T09:01:28.804182+0000","last_active":"2024-04-25T09:01:33.825751+0000","last_peered":"2024-04-25T09:01:33.825751+0000","last_clean":"2024-04-25T09:01:33.825751+0000","last_became_active":"2024-04-25T09:01:28.803828+0000","last_became_peered":"2024-04-25T09:01:28.803828+0000","last_unstale":"2024-04-25T09:01:33.825751+0000","last_undegraded":"2024-04-25T09:01:33.825751+0000","last_fullsized":"2024-04-25T09:01:33.825751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:28.332372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210139+0000","last_change":"2024-04-25T09:01:32.838771+0000","last_active":"2024-04-25T09:01:35.210139+0000","last_peered":"2024-04-25T09:01:35.210139+0000","last_clean":"2024-04-25T09:01:35.210139+0000","last_became_active":"2024-04-25T09:01:32.838328+0000","last_became_peered":"2024-04-25T09:01:32.838328+0000","last_unstale":"2024-04-25T09:01:35.210139+0000","last_undegraded":"2024-04-25T09:01:35.210139+0000","last_fullsized":"2024-04-25T09:01:35.210139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:21.908859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211532+0000","last_change":"2024-04-25T09:01:28.800460+0000","last_active":"2024-04-25T09:01:35.211532+0000","last_peered":"2024-04-25T09:01:35.211532+0000","last_clean":"2024-04-25T09:01:35.211532+0000","last_became_active":"2024-04-25T09:01:28.800206+0000","last_became_peered":"2024-04-25T09:01:28.800206+0000","last_unstale":"2024-04-25T09:01:35.211532+0000","last_undegraded":"2024-04-25T09:01:35.211532+0000","last_fullsized":"2024-04-25T09:01:35.211532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821704+0000","last_change":"2024-04-25T09:01:28.813568+0000","last_active":"2024-04-25T09:01:33.821704+0000","last_peered":"2024-04-25T09:01:33.821704+0000","last_clean":"2024-04-25T09:01:33.821704+0000","last_became_active":"2024-04-25T09:01:28.813174+0000","last_became_peered":"2024-04-25T09:01:28.813174+0000","last_unstale":"2024-04-25T09:01:33.821704+0000","last_undegraded":"2024-04-25T09:01:33.821704+0000","last_fullsized":"2024-04-25T09:01:33.821704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:56.645747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825234+0000","last_change":"2024-04-25T09:01:28.795346+0000","last_active":"2024-04-25T09:01:33.825234+0000","last_peered":"2024-04-25T09:01:33.825234+0000","last_clean":"2024-04-25T09:01:33.825234+0000","last_became_active":"2024-04-25T09:01:28.795062+0000","last_became_peered":"2024-04-25T09:01:28.795062+0000","last_unstale":"2024-04-25T09:01:33.825234+0000","last_undegraded":"2024-04-25T09:01:33.825234+0000","last_fullsized":"2024-04-25T09:01:33.825234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:31.277254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709593+0000","last_change":"2024-04-25T09:01:28.796978+0000","last_active":"2024-04-25T09:01:34.709593+0000","last_peered":"2024-04-25T09:01:34.709593+0000","last_clean":"2024-04-25T09:01:34.709593+0000","last_became_active":"2024-04-25T09:01:28.796196+0000","last_became_peered":"2024-04-25T09:01:28.796196+0000","last_unstale":"2024-04-25T09:01:34.709593+0000","last_undegraded":"2024-04-25T09:01:34.709593+0000","last_fullsized":"2024-04-25T09:01:34.709593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:43.336463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210135+0000","last_change":"2024-04-25T09:01:28.814030+0000","last_active":"2024-04-25T09:01:35.210135+0000","last_peered":"2024-04-25T09:01:35.210135+0000","last_clean":"2024-04-25T09:01:35.210135+0000","last_became_active":"2024-04-25T09:01:28.813738+0000","last_became_peered":"2024-04-25T09:01:28.813738+0000","last_unstale":"2024-04-25T09:01:35.210135+0000","last_undegraded":"2024-04-25T09:01:35.210135+0000","last_fullsized":"2024-04-25T09:01:35.210135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:42.557761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366730+0000","last_change":"2024-04-25T09:01:28.795112+0000","last_active":"2024-04-25T09:01:34.366730+0000","last_peered":"2024-04-25T09:01:34.366730+0000","last_clean":"2024-04-25T09:01:34.366730+0000","last_became_active":"2024-04-25T09:01:28.794801+0000","last_became_peered":"2024-04-25T09:01:28.794801+0000","last_unstale":"2024-04-25T09:01:34.366730+0000","last_undegraded":"2024-04-25T09:01:34.366730+0000","last_fullsized":"2024-04-25T09:01:34.366730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213014+0000","last_change":"2024-04-25T09:01:28.809748+0000","last_active":"2024-04-25T09:01:35.213014+0000","last_peered":"2024-04-25T09:01:35.213014+0000","last_clean":"2024-04-25T09:01:35.213014+0000","last_became_active":"2024-04-25T09:01:28.809461+0000","last_became_peered":"2024-04-25T09:01:28.809461+0000","last_unstale":"2024-04-25T09:01:35.213014+0000","last_undegraded":"2024-04-25T09:01:35.213014+0000","last_fullsized":"2024-04-25T09:01:35.213014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210397+0000","last_change":"2024-04-25T09:01:28.813864+0000","last_active":"2024-04-25T09:01:35.210397+0000","last_peered":"2024-04-25T09:01:35.210397+0000","last_clean":"2024-04-25T09:01:35.210397+0000","last_became_active":"2024-04-25T09:01:28.813495+0000","last_became_peered":"2024-04-25T09:01:28.813495+0000","last_unstale":"2024-04-25T09:01:35.210397+0000","last_undegraded":"2024-04-25T09:01:35.210397+0000","last_fullsized":"2024-04-25T09:01:35.210397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825456+0000","last_change":"2024-04-25T09:01:28.794304+0000","last_active":"2024-04-25T09:01:33.825456+0000","last_peered":"2024-04-25T09:01:33.825456+0000","last_clean":"2024-04-25T09:01:33.825456+0000","last_became_active":"2024-04-25T09:01:28.794011+0000","last_became_peered":"2024-04-25T09:01:28.794011+0000","last_unstale":"2024-04-25T09:01:33.825456+0000","last_undegraded":"2024-04-25T09:01:33.825456+0000","last_fullsized":"2024-04-25T09:01:33.825456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:45.224319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209656+0000","last_change":"2024-04-25T09:01:28.799673+0000","last_active":"2024-04-25T09:01:35.209656+0000","last_peered":"2024-04-25T09:01:35.209656+0000","last_clean":"2024-04-25T09:01:35.209656+0000","last_became_active":"2024-04-25T09:01:28.799385+0000","last_became_peered":"2024-04-25T09:01:28.799385+0000","last_unstale":"2024-04-25T09:01:35.209656+0000","last_undegraded":"2024-04-25T09:01:35.209656+0000","last_fullsized":"2024-04-25T09:01:35.209656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:13.869416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825187+0000","last_change":"2024-04-25T09:01:28.807260+0000","last_active":"2024-04-25T09:01:33.825187+0000","last_peered":"2024-04-25T09:01:33.825187+0000","last_clean":"2024-04-25T09:01:33.825187+0000","last_became_active":"2024-04-25T09:01:28.806995+0000","last_became_peered":"2024-04-25T09:01:28.806995+0000","last_unstale":"2024-04-25T09:01:33.825187+0000","last_undegraded":"2024-04-25T09:01:33.825187+0000","last_fullsized":"2024-04-25T09:01:33.825187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:06.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709277+0000","last_change":"2024-04-25T09:01:28.797279+0000","last_active":"2024-04-25T09:01:34.709277+0000","last_peered":"2024-04-25T09:01:34.709277+0000","last_clean":"2024-04-25T09:01:34.709277+0000","last_became_active":"2024-04-25T09:01:28.796574+0000","last_became_peered":"2024-04-25T09:01:28.796574+0000","last_unstale":"2024-04-25T09:01:34.709277+0000","last_undegraded":"2024-04-25T09:01:34.709277+0000","last_fullsized":"2024-04-25T09:01:34.709277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:01.770247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212692+0000","last_change":"2024-04-25T09:01:28.799529+0000","last_active":"2024-04-25T09:01:35.212692+0000","last_peered":"2024-04-25T09:01:35.212692+0000","last_clean":"2024-04-25T09:01:35.212692+0000","last_became_active":"2024-04-25T09:01:28.799231+0000","last_became_peered":"2024-04-25T09:01:28.799231+0000","last_unstale":"2024-04-25T09:01:35.212692+0000","last_undegraded":"2024-04-25T09:01:35.212692+0000","last_fullsized":"2024-04-25T09:01:35.212692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:45.224319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212894+0000","last_change":"2024-04-25T09:01:28.820816+0000","last_active":"2024-04-25T09:01:35.212894+0000","last_peered":"2024-04-25T09:01:35.212894+0000","last_clean":"2024-04-25T09:01:35.212894+0000","last_became_active":"2024-04-25T09:01:28.819970+0000","last_became_peered":"2024-04-25T09:01:28.819970+0000","last_unstale":"2024-04-25T09:01:35.212894+0000","last_undegraded":"2024-04-25T09:01:35.212894+0000","last_fullsized":"2024-04-25T09:01:35.212894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:39.516566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.822061+0000","last_change":"2024-04-25T09:01:28.802779+0000","last_active":"2024-04-25T09:01:33.822061+0000","last_peered":"2024-04-25T09:01:33.822061+0000","last_clean":"2024-04-25T09:01:33.822061+0000","last_became_active":"2024-04-25T09:01:28.802504+0000","last_became_peered":"2024-04-25T09:01:28.802504+0000","last_unstale":"2024-04-25T09:01:33.822061+0000","last_undegraded":"2024-04-25T09:01:33.822061+0000","last_fullsized":"2024-04-25T09:01:33.822061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:12.377470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825926+0000","last_change":"2024-04-25T09:01:28.806216+0000","last_active":"2024-04-25T09:01:33.825926+0000","last_peered":"2024-04-25T09:01:33.825926+0000","last_clean":"2024-04-25T09:01:33.825926+0000","last_became_active":"2024-04-25T09:01:28.805683+0000","last_became_peered":"2024-04-25T09:01:28.805683+0000","last_unstale":"2024-04-25T09:01:33.825926+0000","last_undegraded":"2024-04-25T09:01:33.825926+0000","last_fullsized":"2024-04-25T09:01:33.825926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:06.715519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824510+0000","last_change":"2024-04-25T09:01:28.795390+0000","last_active":"2024-04-25T09:01:33.824510+0000","last_peered":"2024-04-25T09:01:33.824510+0000","last_clean":"2024-04-25T09:01:33.824510+0000","last_became_active":"2024-04-25T09:01:28.795100+0000","last_became_peered":"2024-04-25T09:01:28.795100+0000","last_unstale":"2024-04-25T09:01:33.824510+0000","last_undegraded":"2024-04-25T09:01:33.824510+0000","last_fullsized":"2024-04-25T09:01:33.824510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366292+0000","last_change":"2024-04-25T09:01:28.807705+0000","last_active":"2024-04-25T09:01:34.366292+0000","last_peered":"2024-04-25T09:01:34.366292+0000","last_clean":"2024-04-25T09:01:34.366292+0000","last_became_active":"2024-04-25T09:01:28.807321+0000","last_became_peered":"2024-04-25T09:01:28.807321+0000","last_unstale":"2024-04-25T09:01:34.366292+0000","last_undegraded":"2024-04-25T09:01:34.366292+0000","last_fullsized":"2024-04-25T09:01:34.366292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709236+0000","last_change":"2024-04-25T09:01:28.800758+0000","last_active":"2024-04-25T09:01:34.709236+0000","last_peered":"2024-04-25T09:01:34.709236+0000","last_clean":"2024-04-25T09:01:34.709236+0000","last_became_active":"2024-04-25T09:01:28.800380+0000","last_became_peered":"2024-04-25T09:01:28.800380+0000","last_unstale":"2024-04-25T09:01:34.709236+0000","last_undegraded":"2024-04-25T09:01:34.709236+0000","last_fullsized":"2024-04-25T09:01:34.709236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:41.553845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209750+0000","last_change":"2024-04-25T09:01:28.803209+0000","last_active":"2024-04-25T09:01:35.209750+0000","last_peered":"2024-04-25T09:01:35.209750+0000","last_clean":"2024-04-25T09:01:35.209750+0000","last_became_active":"2024-04-25T09:01:28.801889+0000","last_became_peered":"2024-04-25T09:01:28.801889+0000","last_unstale":"2024-04-25T09:01:35.209750+0000","last_undegraded":"2024-04-25T09:01:35.209750+0000","last_fullsized":"2024-04-25T09:01:35.209750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826547+0000","last_change":"2024-04-25T09:01:28.809150+0000","last_active":"2024-04-25T09:01:33.826547+0000","last_peered":"2024-04-25T09:01:33.826547+0000","last_clean":"2024-04-25T09:01:33.826547+0000","last_became_active":"2024-04-25T09:01:28.801172+0000","last_became_peered":"2024-04-25T09:01:28.801172+0000","last_unstale":"2024-04-25T09:01:33.826547+0000","last_undegraded":"2024-04-25T09:01:33.826547+0000","last_fullsized":"2024-04-25T09:01:33.826547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:06.124113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213293+0000","last_change":"2024-04-25T09:01:28.810054+0000","last_active":"2024-04-25T09:01:35.213293+0000","last_peered":"2024-04-25T09:01:35.213293+0000","last_clean":"2024-04-25T09:01:35.213293+0000","last_became_active":"2024-04-25T09:01:28.809288+0000","last_became_peered":"2024-04-25T09:01:28.809288+0000","last_unstale":"2024-04-25T09:01:35.213293+0000","last_undegraded":"2024-04-25T09:01:35.213293+0000","last_fullsized":"2024-04-25T09:01:35.213293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212915+0000","last_change":"2024-04-25T09:01:28.803094+0000","last_active":"2024-04-25T09:01:35.212915+0000","last_peered":"2024-04-25T09:01:35.212915+0000","last_clean":"2024-04-25T09:01:35.212915+0000","last_became_active":"2024-04-25T09:01:28.802768+0000","last_became_peered":"2024-04-25T09:01:28.802768+0000","last_unstale":"2024-04-25T09:01:35.212915+0000","last_undegraded":"2024-04-25T09:01:35.212915+0000","last_fullsized":"2024-04-25T09:01:35.212915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213016+0000","last_change":"2024-04-25T09:01:28.822072+0000","last_active":"2024-04-25T09:01:35.213016+0000","last_peered":"2024-04-25T09:01:35.213016+0000","last_clean":"2024-04-25T09:01:35.213016+0000","last_became_active":"2024-04-25T09:01:28.821805+0000","last_became_peered":"2024-04-25T09:01:28.821805+0000","last_unstale":"2024-04-25T09:01:35.213016+0000","last_undegraded":"2024-04-25T09:01:35.213016+0000","last_fullsized":"2024-04-25T09:01:35.213016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:10.070021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209311+0000","last_change":"2024-04-25T09:01:28.797350+0000","last_active":"2024-04-25T09:01:35.209311+0000","last_peered":"2024-04-25T09:01:35.209311+0000","last_clean":"2024-04-25T09:01:35.209311+0000","last_became_active":"2024-04-25T09:01:28.797039+0000","last_became_peered":"2024-04-25T09:01:28.797039+0000","last_unstale":"2024-04-25T09:01:35.209311+0000","last_undegraded":"2024-04-25T09:01:35.209311+0000","last_fullsized":"2024-04-25T09:01:35.209311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:28.695063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211801+0000","last_change":"2024-04-25T09:01:28.814399+0000","last_active":"2024-04-25T09:01:35.211801+0000","last_peered":"2024-04-25T09:01:35.211801+0000","last_clean":"2024-04-25T09:01:35.211801+0000","last_became_active":"2024-04-25T09:01:28.812569+0000","last_became_peered":"2024-04-25T09:01:28.812569+0000","last_unstale":"2024-04-25T09:01:35.211801+0000","last_undegraded":"2024-04-25T09:01:35.211801+0000","last_fullsized":"2024-04-25T09:01:35.211801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825039+0000","last_change":"2024-04-25T09:01:28.798631+0000","last_active":"2024-04-25T09:01:33.825039+0000","last_peered":"2024-04-25T09:01:33.825039+0000","last_clean":"2024-04-25T09:01:33.825039+0000","last_became_active":"2024-04-25T09:01:28.797450+0000","last_became_peered":"2024-04-25T09:01:28.797450+0000","last_unstale":"2024-04-25T09:01:33.825039+0000","last_undegraded":"2024-04-25T09:01:33.825039+0000","last_fullsized":"2024-04-25T09:01:33.825039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:33.239521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211711+0000","last_change":"2024-04-25T09:01:28.817741+0000","last_active":"2024-04-25T09:01:35.211711+0000","last_peered":"2024-04-25T09:01:35.211711+0000","last_clean":"2024-04-25T09:01:35.211711+0000","last_became_active":"2024-04-25T09:01:28.816875+0000","last_became_peered":"2024-04-25T09:01:28.816875+0000","last_unstale":"2024-04-25T09:01:35.211711+0000","last_undegraded":"2024-04-25T09:01:35.211711+0000","last_fullsized":"2024-04-25T09:01:35.211711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:46.890034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825594+0000","last_change":"2024-04-25T09:01:28.800127+0000","last_active":"2024-04-25T09:01:33.825594+0000","last_peered":"2024-04-25T09:01:33.825594+0000","last_clean":"2024-04-25T09:01:33.825594+0000","last_became_active":"2024-04-25T09:01:28.799878+0000","last_became_peered":"2024-04-25T09:01:28.799878+0000","last_unstale":"2024-04-25T09:01:33.825594+0000","last_undegraded":"2024-04-25T09:01:33.825594+0000","last_fullsized":"2024-04-25T09:01:33.825594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:28.695063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709466+0000","last_change":"2024-04-25T09:01:28.789959+0000","last_active":"2024-04-25T09:01:34.709466+0000","last_peered":"2024-04-25T09:01:34.709466+0000","last_clean":"2024-04-25T09:01:34.709466+0000","last_became_active":"2024-04-25T09:01:28.788152+0000","last_became_peered":"2024-04-25T09:01:28.788152+0000","last_unstale":"2024-04-25T09:01:34.709466+0000","last_undegraded":"2024-04-25T09:01:34.709466+0000","last_fullsized":"2024-04-25T09:01:34.709466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366996+0000","last_change":"2024-04-25T09:01:28.798328+0000","last_active":"2024-04-25T09:01:34.366996+0000","last_peered":"2024-04-25T09:01:34.366996+0000","last_clean":"2024-04-25T09:01:34.366996+0000","last_became_active":"2024-04-25T09:01:28.797356+0000","last_became_peered":"2024-04-25T09:01:28.797356+0000","last_unstale":"2024-04-25T09:01:34.366996+0000","last_undegraded":"2024-04-25T09:01:34.366996+0000","last_fullsized":"2024-04-25T09:01:34.366996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212405+0000","last_change":"2024-04-25T09:01:28.819648+0000","last_active":"2024-04-25T09:01:35.212405+0000","last_peered":"2024-04-25T09:01:35.212405+0000","last_clean":"2024-04-25T09:01:35.212405+0000","last_became_active":"2024-04-25T09:01:28.819185+0000","last_became_peered":"2024-04-25T09:01:28.819185+0000","last_unstale":"2024-04-25T09:01:35.212405+0000","last_undegraded":"2024-04-25T09:01:35.212405+0000","last_fullsized":"2024-04-25T09:01:35.212405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:38.948352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:01:48.357 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:01:48.358 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T09:01:48.358 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T09:01:48.358 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T09:01:48.358 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T09:01:48.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.544+0000 7f18b0200640 1 Processor -- start 2024-04-25T09:01:48.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18b0200640 1 -- start start 2024-04-25T09:01:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18b0200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a8099a60 0x7f18a8099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18b0200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18a815ee00 0x7f18a806bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18b0200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f18a81616a0 0x7f18a8161b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18b0200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a809a380 con 0x7f18a815ee00 2024-04-25T09:01:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18b0200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a806c650 con 0x7f18a81616a0 2024-04-25T09:01:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18b0200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a806c930 con 0x7f18a8099a60 2024-04-25T09:01:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18ace00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18a815ee00 0x7f18a806bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18ace00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18a815ee00 0x7f18a806bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46684/0 (socket says 172.21.15.59:46684) 2024-04-25T09:01:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18ace00640 1 -- 172.21.15.59:0/1656651800 learned_addr learned my addr 172.21.15.59:0/1656651800 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18ad800640 1 --2- 172.21.15.59:0/1656651800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a8099a60 0x7f18a8099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18ace00640 1 -- 172.21.15.59:0/1656651800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a8099a60 msgr2=0x7f18a8099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:48.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18ae200640 1 --2- 172.21.15.59:0/1656651800 >> v2:172.21.15.178:3300/0 conn(0x7f18a81616a0 0x7f18a8161b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18ace00640 1 --2- 172.21.15.59:0/1656651800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a8099a60 0x7f18a8099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18ace00640 1 -- 172.21.15.59:0/1656651800 >> v2:172.21.15.178:3300/0 conn(0x7f18a81616a0 msgr2=0x7f18a8161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:48.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18ace00640 1 --2- 172.21.15.59:0/1656651800 >> v2:172.21.15.178:3300/0 conn(0x7f18a81616a0 0x7f18a8161b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18ace00640 1 -- 172.21.15.59:0/1656651800 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a806cc10 con 0x7f18a815ee00 2024-04-25T09:01:48.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18ae200640 1 --2- 172.21.15.59:0/1656651800 >> v2:172.21.15.178:3300/0 conn(0x7f18a81616a0 0x7f18a8161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:48.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.548+0000 7f18ad800640 1 --2- 172.21.15.59:0/1656651800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a8099a60 0x7f18a8099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:48.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18ace00640 1 --2- 172.21.15.59:0/1656651800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a815ee00 0x7f18a806bd20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f18a806dd30 tx=0x7f189401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568e75b36b6a3fc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:48.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18a7e00640 1 -- 172.21.15.59:0/1656651800 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18940ab5f0 con 0x7f18a815ee00 2024-04-25T09:01:48.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18a7e00640 1 -- 172.21.15.59:0/1656651800 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18940b0070 con 0x7f18a815ee00 2024-04-25T09:01:48.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18a7e00640 1 -- 172.21.15.59:0/1656651800 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18940ab9b0 con 0x7f18a815ee00 2024-04-25T09:01:48.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18b0200640 1 -- 172.21.15.59:0/1656651800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a815ee00 msgr2=0x7f18a806bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18b0200640 1 --2- 172.21.15.59:0/1656651800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a815ee00 0x7f18a806bd20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f18a806dd30 tx=0x7f189401c520 comp rx=0 tx=0).stop 2024-04-25T09:01:48.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18b0200640 1 -- 172.21.15.59:0/1656651800 shutdown_connections 2024-04-25T09:01:48.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18b0200640 1 --2- 172.21.15.59:0/1656651800 >> v2:172.21.15.178:3300/0 conn(0x7f18a81616a0 0x7f18a8161b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18b0200640 1 --2- 172.21.15.59:0/1656651800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a815ee00 0x7f18a806bd20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18b0200640 1 --2- 172.21.15.59:0/1656651800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a8099a60 0x7f18a8099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18b0200640 1 -- 172.21.15.59:0/1656651800 >> 172.21.15.59:0/1656651800 conn(0x7f18a80d17a0 msgr2=0x7f18a80d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:48.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18b0200640 1 -- 172.21.15.59:0/1656651800 shutdown_connections 2024-04-25T09:01:48.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18b0200640 1 -- 172.21.15.59:0/1656651800 wait complete. 2024-04-25T09:01:48.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18b0200640 1 Processor -- start 2024-04-25T09:01:48.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.552+0000 7f18b0200640 1 -- start start 2024-04-25T09:01:48.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18b0200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a8099a60 0x7f18a814fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18b0200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a815ee00 0x7f18a815c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18b0200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18a81616a0 0x7f18a815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18b0200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a815e000 con 0x7f18a8099a60 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18b0200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a815de80 con 0x7f18a81616a0 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18b0200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a806c260 con 0x7f18a815ee00 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18ad800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a8099a60 0x7f18a814fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18ad800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a8099a60 0x7f18a814fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46686/0 (socket says 172.21.15.59:46686) 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18ad800640 1 -- 172.21.15.59:0/3969384991 learned_addr learned my addr 172.21.15.59:0/3969384991 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18ace00640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a815ee00 0x7f18a815c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18ae200640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18a81616a0 0x7f18a815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18ad800640 1 -- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a815ee00 msgr2=0x7f18a815c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18ad800640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a815ee00 0x7f18a815c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18ad800640 1 -- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18a81616a0 msgr2=0x7f18a815cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18ad800640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18a81616a0 0x7f18a815cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18ad800640 1 -- 172.21.15.59:0/3969384991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a81501a0 con 0x7f18a8099a60 2024-04-25T09:01:48.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18ae200640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18a81616a0 0x7f18a815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:48.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18ad800640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a8099a60 0x7f18a814fc60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f189c00c7f0 tx=0x7f189c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:48.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18a5600640 1 -- 172.21.15.59:0/3969384991 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c015070 con 0x7f18a8099a60 2024-04-25T09:01:48.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18a5600640 1 -- 172.21.15.59:0/3969384991 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c007820 con 0x7f18a8099a60 2024-04-25T09:01:48.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18b0200640 1 -- 172.21.15.59:0/3969384991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a8156aa0 con 0x7f18a8099a60 2024-04-25T09:01:48.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18a5600640 1 -- 172.21.15.59:0/3969384991 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c007c10 con 0x7f18a8099a60 2024-04-25T09:01:48.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18b0200640 1 -- 172.21.15.59:0/3969384991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a8156070 con 0x7f18a8099a60 2024-04-25T09:01:48.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18b0200640 1 -- 172.21.15.59:0/3969384991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a80745d0 con 0x7f18a8099a60 2024-04-25T09:01:48.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.556+0000 7f18a5600640 1 -- 172.21.15.59:0/3969384991 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f189c018070 con 0x7f18a8099a60 2024-04-25T09:01:48.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.560+0000 7f18a5600640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1888066f90 0x7f1888069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.560+0000 7f18a5600640 1 -- 172.21.15.59:0/3969384991 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f189c085160 con 0x7f18a8099a60 2024-04-25T09:01:48.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.560+0000 7f18ace00640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1888066f90 0x7f1888069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.560+0000 7f18ace00640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1888066f90 0x7f1888069450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f18940af000 tx=0x7f18940a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:48.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.564+0000 7f18a5600640 1 -- 172.21.15.59:0/3969384991 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f189c0557d0 con 0x7f18a8099a60 2024-04-25T09:01:48.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.760+0000 7f18b0200640 1 -- 172.21.15.59:0/3969384991 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f18a806f830 con 0x7f18a8099a60 2024-04-25T09:01:48.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.764+0000 7f18a5600640 1 -- 172.21.15.59:0/3969384991 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+165735 (secure 0 0 0) 0x7f189c059870 con 0x7f18a8099a60 2024-04-25T09:01:48.757 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.768+0000 7f18b0200640 1 -- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1888066f90 msgr2=0x7f1888069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.768+0000 7f18b0200640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1888066f90 0x7f1888069450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f18940af000 tx=0x7f18940a7000 comp rx=0 tx=0).stop 2024-04-25T09:01:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.768+0000 7f18b0200640 1 -- 172.21.15.59:0/3969384991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a8099a60 msgr2=0x7f18a814fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.768+0000 7f18b0200640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a8099a60 0x7f18a814fc60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f189c00c7f0 tx=0x7f189c00ccb0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.768+0000 7f18b0200640 1 -- 172.21.15.59:0/3969384991 shutdown_connections 2024-04-25T09:01:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.768+0000 7f18b0200640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1888066f90 0x7f1888069450 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.768+0000 7f18b0200640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18a81616a0 0x7f18a815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.768+0000 7f18b0200640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a815ee00 0x7f18a815c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.768+0000 7f18b0200640 1 --2- 172.21.15.59:0/3969384991 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a8099a60 0x7f18a814fc60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.768+0000 7f18b0200640 1 -- 172.21.15.59:0/3969384991 >> 172.21.15.59:0/3969384991 conn(0x7f18a80d17a0 msgr2=0x7f18a806fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.768+0000 7f18b0200640 1 -- 172.21.15.59:0/3969384991 shutdown_connections 2024-04-25T09:01:48.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.768+0000 7f18b0200640 1 -- 172.21.15.59:0/3969384991 wait complete. 2024-04-25T09:01:48.778 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":226381240},{"type":"v1","addr":"172.21.15.178:6833","nonce":226381240}]},"active_addr":"172.21.15.178:6833/226381240","active_change":"2024-04-25T09:01:07.630906+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":2475803725}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":4291095041}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":13643529}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":3180111938}]}]} 2024-04-25T09:01:48.781 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T09:01:48.781 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T09:01:48.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:48.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.932+0000 7f465f200640 1 Processor -- start 2024-04-25T09:01:48.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465f200640 1 -- start start 2024-04-25T09:01:48.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465f200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f466015d7b0 0x7f466015e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465f200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f46600b46f0 0x7f46600adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4660072ce0 con 0x7f46600669a0 2024-04-25T09:01:48.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465f200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46600b3990 con 0x7f466015d7b0 2024-04-25T09:01:48.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465f200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46600b2dc0 con 0x7f46600b46f0 2024-04-25T09:01:48.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f4657e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f46600669a0 0x7f46600b3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41858/0 (socket says 172.21.15.59:41858) 2024-04-25T09:01:48.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f4657e00640 1 -- 172.21.15.59:0/3989894486 learned_addr learned my addr 172.21.15.59:0/3989894486 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:48.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465de00640 1 --2- 172.21.15.59:0/3989894486 >> v2:172.21.15.59:3300/0 conn(0x7f466015d7b0 0x7f466015e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465e800640 1 --2- 172.21.15.59:0/3989894486 >> v2:172.21.15.178:3300/0 conn(0x7f46600b46f0 0x7f46600adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465de00640 1 -- 172.21.15.59:0/3989894486 >> v2:172.21.15.178:3300/0 conn(0x7f46600b46f0 msgr2=0x7f46600adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:48.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465de00640 1 --2- 172.21.15.59:0/3989894486 >> v2:172.21.15.178:3300/0 conn(0x7f46600b46f0 0x7f46600adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465de00640 1 -- 172.21.15.59:0/3989894486 >> v1:172.21.15.59:6789/0 conn(0x7f46600669a0 legacy=0x7f46600b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465de00640 1 -- 172.21.15.59:0/3989894486 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46600b3060 con 0x7f466015d7b0 2024-04-25T09:01:48.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.936+0000 7f465d400640 1 -- 172.21.15.59:0/3989894486 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255387775 0 0) 0x7f4660072ce0 con 0x7f46600669a0 2024-04-25T09:01:48.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465de00640 1 --2- 172.21.15.59:0/3989894486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f466015d7b0 0x7f466015e890 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f46600b3b10 tx=0x7f465001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715e8159a183ece7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465d400640 1 -- 172.21.15.59:0/3989894486 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500b0070 con 0x7f466015d7b0 2024-04-25T09:01:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465d400640 1 -- 172.21.15.59:0/3989894486 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4650004230 con 0x7f466015d7b0 2024-04-25T09:01:48.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465d400640 1 -- 172.21.15.59:0/3989894486 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650003620 con 0x7f466015d7b0 2024-04-25T09:01:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465f200640 1 -- 172.21.15.59:0/3989894486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f466015d7b0 msgr2=0x7f466015e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465f200640 1 --2- 172.21.15.59:0/3989894486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f466015d7b0 0x7f466015e890 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f46600b3b10 tx=0x7f465001c460 comp rx=0 tx=0).stop 2024-04-25T09:01:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465f200640 1 -- 172.21.15.59:0/3989894486 shutdown_connections 2024-04-25T09:01:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465f200640 1 --2- 172.21.15.59:0/3989894486 >> v2:172.21.15.178:3300/0 conn(0x7f46600b46f0 0x7f46600adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465f200640 1 --2- 172.21.15.59:0/3989894486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f466015d7b0 0x7f466015e890 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465f200640 1 -- 172.21.15.59:0/3989894486 >> 172.21.15.59:0/3989894486 conn(0x7f46600726f0 msgr2=0x7f466006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465f200640 1 -- 172.21.15.59:0/3989894486 shutdown_connections 2024-04-25T09:01:48.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465f200640 1 -- 172.21.15.59:0/3989894486 wait complete. 2024-04-25T09:01:48.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465f200640 1 Processor -- start 2024-04-25T09:01:48.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.940+0000 7f465f200640 1 -- start start 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46600669a0 0x7f46600ce660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465f200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46600b46f0 0x7f466014bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465f200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f466015d7b0 0x7f4660158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46600ae9d0 con 0x7f46600669a0 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465f200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46600ae850 con 0x7f46600b46f0 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465f200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46600aeb50 con 0x7f466015d7b0 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46600669a0 0x7f46600ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46600669a0 0x7f46600ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46696/0 (socket says 172.21.15.59:46696) 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465de00640 1 -- 172.21.15.59:0/2894788819 learned_addr learned my addr 172.21.15.59:0/2894788819 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f4657e00640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46600b46f0 0x7f466014bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465e800640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f466015d7b0 0x7f4660158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465de00640 1 -- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f466015d7b0 msgr2=0x7f4660158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465de00640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f466015d7b0 0x7f4660158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465de00640 1 -- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46600b46f0 msgr2=0x7f466014bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465de00640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46600b46f0 0x7f466014bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465de00640 1 -- 172.21.15.59:0/2894788819 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466014c680 con 0x7f46600669a0 2024-04-25T09:01:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f4657e00640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46600b46f0 0x7f466014bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465de00640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46600669a0 0x7f46600ce660 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4650019070 tx=0x7f4650019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f4656000640 1 -- 172.21.15.59:0/2894788819 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500b0040 con 0x7f46600669a0 2024-04-25T09:01:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f4656000640 1 -- 172.21.15.59:0/2894788819 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46500bc070 con 0x7f46600669a0 2024-04-25T09:01:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f4656000640 1 -- 172.21.15.59:0/2894788819 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650006e20 con 0x7f46600669a0 2024-04-25T09:01:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465f200640 1 -- 172.21.15.59:0/2894788819 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466015b2d0 con 0x7f46600669a0 2024-04-25T09:01:48.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465f200640 1 -- 172.21.15.59:0/2894788819 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46600cdb80 con 0x7f46600669a0 2024-04-25T09:01:48.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f465f200640 1 -- 172.21.15.59:0/2894788819 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466004efa0 con 0x7f46600669a0 2024-04-25T09:01:48.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.944+0000 7f4656000640 1 -- 172.21.15.59:0/2894788819 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f46500b3070 con 0x7f46600669a0 2024-04-25T09:01:48.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.948+0000 7f4656000640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f463c066f60 0x7f463c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:48.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.948+0000 7f4656000640 1 -- 172.21.15.59:0/2894788819 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f465011f160 con 0x7f46600669a0 2024-04-25T09:01:48.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.948+0000 7f4657e00640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f463c066f60 0x7f463c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:48.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.948+0000 7f4657e00640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f463c066f60 0x7f463c069420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4648007fd0 tx=0x7f4648007c20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:48.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:48.952+0000 7f4656000640 1 -- 172.21.15.59:0/2894788819 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f466014c680 con 0x7f46600669a0 2024-04-25T09:01:49.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.116+0000 7f465f200640 1 -- 172.21.15.59:0/2894788819 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f466006c8e0 con 0x7f46600669a0 2024-04-25T09:01:49.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f4656000640 1 -- 172.21.15.59:0/2894788819 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7f4650016050 con 0x7f46600669a0 2024-04-25T09:01:49.109 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:49.109 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:49.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f465f200640 1 -- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f463c066f60 msgr2=0x7f463c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f465f200640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f463c066f60 0x7f463c069420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4648007fd0 tx=0x7f4648007c20 comp rx=0 tx=0).stop 2024-04-25T09:01:49.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f465f200640 1 -- 172.21.15.59:0/2894788819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46600669a0 msgr2=0x7f46600ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f465f200640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46600669a0 0x7f46600ce660 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4650019070 tx=0x7f4650019200 comp rx=0 tx=0).stop 2024-04-25T09:01:49.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f465f200640 1 -- 172.21.15.59:0/2894788819 shutdown_connections 2024-04-25T09:01:49.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f465f200640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f463c066f60 0x7f463c069420 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f465f200640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f466015d7b0 0x7f4660158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f465f200640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46600b46f0 0x7f466014bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f465f200640 1 --2- 172.21.15.59:0/2894788819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46600669a0 0x7f46600ce660 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f465f200640 1 -- 172.21.15.59:0/2894788819 >> 172.21.15.59:0/2894788819 conn(0x7f46600726f0 msgr2=0x7f46600b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f465f200640 1 -- 172.21.15.59:0/2894788819 shutdown_connections 2024-04-25T09:01:49.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.120+0000 7f465f200640 1 -- 172.21.15.59:0/2894788819 wait complete. 2024-04-25T09:01:49.131 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T09:01:49.131 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:49.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.280+0000 7f7011800640 1 Processor -- start 2024-04-25T09:01:49.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.280+0000 7f7011800640 1 -- start start 2024-04-25T09:01:49.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f7011800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f700c070fe0 0x7f700c161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f7011800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700c06d090 con 0x7f700c071800 2024-04-25T09:01:49.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f7011800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700c162390 con 0x7f700c0713c0 2024-04-25T09:01:49.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f7011800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700c161af0 con 0x7f700c070fe0 2024-04-25T09:01:49.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f700b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f700c071800 0x7f700c15e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41868/0 (socket says 172.21.15.59:41868) 2024-04-25T09:01:49.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f700b400640 1 -- 172.21.15.59:0/3521582593 learned_addr learned my addr 172.21.15.59:0/3521582593 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:49.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f700aa00640 1 --2- 172.21.15.59:0/3521582593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f700c070fe0 0x7f700c161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f700a000640 1 -- 172.21.15.59:0/3521582593 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 247519418 0 0) 0x7f7004001120 con 0x7f700c071800 2024-04-25T09:01:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f700a000640 1 -- 172.21.15.59:0/3521582593 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ff0003530 con 0x7f700c071800 2024-04-25T09:01:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f700a000640 1 -- 172.21.15.59:0/3521582593 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481338970 0 0) 0x7f700c162390 con 0x7f700c0713c0 2024-04-25T09:01:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f700a000640 1 -- 172.21.15.59:0/3521582593 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7004001120 con 0x7f700c0713c0 2024-04-25T09:01:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f700aa00640 1 -- 172.21.15.59:0/3521582593 >> v1:172.21.15.178:6789/0 conn(0x7f700c0713c0 legacy=0x7f700c143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f700aa00640 1 -- 172.21.15.59:0/3521582593 >> v1:172.21.15.59:6789/0 conn(0x7f700c071800 legacy=0x7f700c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f700a000640 1 -- 172.21.15.59:0/3521582593 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 675127798 0 0) 0x7f6ff0003530 con 0x7f700c071800 2024-04-25T09:01:49.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.284+0000 7f700aa00640 1 -- 172.21.15.59:0/3521582593 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c161dd0 con 0x7f700c070fe0 2024-04-25T09:01:49.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f700aa00640 1 --2- 172.21.15.59:0/3521582593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f700c070fe0 0x7f700c161510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009dc0 tx=0x7f6ffc01c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e06c6522572f265 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f700a000640 1 -- 172.21.15.59:0/3521582593 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc0b2070 con 0x7f700c070fe0 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f700a000640 1 -- 172.21.15.59:0/3521582593 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc0a56c0 con 0x7f700c070fe0 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f700a000640 1 -- 172.21.15.59:0/3521582593 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004001850 con 0x7f700c070fe0 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f7011800640 1 -- 172.21.15.59:0/3521582593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f700c070fe0 msgr2=0x7f700c161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f7011800640 1 --2- 172.21.15.59:0/3521582593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f700c070fe0 0x7f700c161510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009dc0 tx=0x7f6ffc01c880 comp rx=0 tx=0).stop 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f7011800640 1 -- 172.21.15.59:0/3521582593 shutdown_connections 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f7011800640 1 --2- 172.21.15.59:0/3521582593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f700c070fe0 0x7f700c161510 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f7011800640 1 -- 172.21.15.59:0/3521582593 >> 172.21.15.59:0/3521582593 conn(0x7f700c0b3390 msgr2=0x7f700c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f7011800640 1 -- 172.21.15.59:0/3521582593 shutdown_connections 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f7011800640 1 -- 172.21.15.59:0/3521582593 wait complete. 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f7011800640 1 Processor -- start 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.288+0000 7f7011800640 1 -- start start 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7011800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f700c070fe0 0x7f700c157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7011800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f700c0713c0 0x7f700c0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7011800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f700c071800 0x7f700c0b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7011800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c15ede0 con 0x7f700c071800 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7011800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c15ec60 con 0x7f700c070fe0 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7011800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700c0b0540 con 0x7f700c0713c0 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f700b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f700c071800 0x7f700c0b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f700b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f700c071800 0x7f700c0b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46704/0 (socket says 172.21.15.59:46704) 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f700b400640 1 -- 172.21.15.59:0/2762852886 learned_addr learned my addr 172.21.15.59:0/2762852886 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f700aa00640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f700c070fe0 0x7f700c157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7002000640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f700c0713c0 0x7f700c0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f700b400640 1 -- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f700c0713c0 msgr2=0x7f700c0b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f700b400640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f700c0713c0 0x7f700c0b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f700b400640 1 -- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f700c070fe0 msgr2=0x7f700c157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f700b400640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f700c070fe0 0x7f700c157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f700b400640 1 -- 172.21.15.59:0/2762852886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700c0d1b30 con 0x7f700c071800 2024-04-25T09:01:49.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f700aa00640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f700c070fe0 0x7f700c157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f700b400640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f700c071800 0x7f700c0b49c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f700400c780 tx=0x7f700400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7003400640 1 -- 172.21.15.59:0/2762852886 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004005cf0 con 0x7f700c071800 2024-04-25T09:01:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7003400640 1 -- 172.21.15.59:0/2762852886 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7004007070 con 0x7f700c071800 2024-04-25T09:01:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7003400640 1 -- 172.21.15.59:0/2762852886 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7004007460 con 0x7f700c071800 2024-04-25T09:01:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7011800640 1 -- 172.21.15.59:0/2762852886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700c0d1290 con 0x7f700c071800 2024-04-25T09:01:49.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7011800640 1 -- 172.21.15.59:0/2762852886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700c0d1850 con 0x7f700c071800 2024-04-25T09:01:49.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7011800640 1 -- 172.21.15.59:0/2762852886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700c0745d0 con 0x7f700c071800 2024-04-25T09:01:49.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.292+0000 7f7003400640 1 -- 172.21.15.59:0/2762852886 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7004007600 con 0x7f700c071800 2024-04-25T09:01:49.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.296+0000 7f7003400640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fe8066f60 0x7f6fe8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.296+0000 7f7003400640 1 -- 172.21.15.59:0/2762852886 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f7004085330 con 0x7f700c071800 2024-04-25T09:01:49.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.296+0000 7f700aa00640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fe8066f60 0x7f6fe8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.296+0000 7f700aa00640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fe8066f60 0x7f6fe8069420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0af000 tx=0x7f6ffc0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.300+0000 7f7003400640 1 -- 172.21.15.59:0/2762852886 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f700c06d090 con 0x7f700c071800 2024-04-25T09:01:49.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.460+0000 7f7011800640 1 -- 172.21.15.59:0/2762852886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f700c15e830 con 0x7f700c071800 2024-04-25T09:01:49.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7003400640 1 -- 172.21.15.59:0/2762852886 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7f7004055f60 con 0x7f700c071800 2024-04-25T09:01:49.454 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:49.454 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7011800640 1 -- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fe8066f60 msgr2=0x7f6fe8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7011800640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fe8066f60 0x7f6fe8069420 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0af000 tx=0x7f6ffc0a7070 comp rx=0 tx=0).stop 2024-04-25T09:01:49.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7011800640 1 -- 172.21.15.59:0/2762852886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f700c071800 msgr2=0x7f700c0b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7011800640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f700c071800 0x7f700c0b49c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f700400c780 tx=0x7f700400cc40 comp rx=0 tx=0).stop 2024-04-25T09:01:49.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7011800640 1 -- 172.21.15.59:0/2762852886 shutdown_connections 2024-04-25T09:01:49.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7011800640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fe8066f60 0x7f6fe8069420 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7011800640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f700c071800 0x7f700c0b49c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7011800640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f700c0713c0 0x7f700c0b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7011800640 1 --2- 172.21.15.59:0/2762852886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f700c070fe0 0x7f700c157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7011800640 1 -- 172.21.15.59:0/2762852886 >> 172.21.15.59:0/2762852886 conn(0x7f700c0b3390 msgr2=0x7f700c146e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7011800640 1 -- 172.21.15.59:0/2762852886 shutdown_connections 2024-04-25T09:01:49.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.464+0000 7f7011800640 1 -- 172.21.15.59:0/2762852886 wait complete. 2024-04-25T09:01:49.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T09:01:49.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T09:01:49.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T09:01:49.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T09:01:49.477 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T09:01:49.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T09:01:49.478 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T09:01:49.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T09:01:49.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.732+0000 7f83c0000640 1 Processor -- start 2024-04-25T09:01:49.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.732+0000 7f83c0000640 1 -- start start 2024-04-25T09:01:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.732+0000 7f83c0000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b806cf40 0x7f83b80b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.732+0000 7f83c0000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f83b806bd20 0x7f83b806c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.732+0000 7f83c0000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b806d7a0 con 0x7f83b8161fc0 2024-04-25T09:01:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.732+0000 7f83c0000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b806c6c0 con 0x7f83b806bd20 2024-04-25T09:01:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.732+0000 7f83c0000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80b4ba0 con 0x7f83b806cf40 2024-04-25T09:01:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.732+0000 7f83be000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f83b806bd20 0x7f83b806c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.732+0000 7f83be000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f83b806bd20 0x7f83b806c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56658/0 (socket says 172.21.15.59:56658) 2024-04-25T09:01:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.732+0000 7f83bd600640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f83b8161fc0 0x7f83b8162e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:35378/0 (socket says 172.21.15.59:35378) 2024-04-25T09:01:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.732+0000 7f83be000640 1 -- 172.21.15.59:0/3764131994 learned_addr learned my addr 172.21.15.59:0/3764131994 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.732+0000 7f83bcc00640 1 --2- 172.21.15.59:0/3764131994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b806cf40 0x7f83b80b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.736+0000 7f83be000640 1 -- 172.21.15.59:0/3764131994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b806cf40 msgr2=0x7f83b80b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.736+0000 7f83be000640 1 --2- 172.21.15.59:0/3764131994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b806cf40 0x7f83b80b5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.736+0000 7f83be000640 1 -- 172.21.15.59:0/3764131994 >> v1:172.21.15.178:6789/0 conn(0x7f83b8161fc0 legacy=0x7f83b8162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.736+0000 7f83be000640 1 -- 172.21.15.59:0/3764131994 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b806da80 con 0x7f83b806bd20 2024-04-25T09:01:49.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.736+0000 7f5a81000640 1 Processor -- start 2024-04-25T09:01:49.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.736+0000 7f5a81000640 1 -- start start 2024-04-25T09:01:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.736+0000 7f5a81000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a7c0cb8f0 0x7f5a7c0ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.736+0000 7f5a81000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5a7c0ccce0 0x7f5a7c0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.736+0000 7f5a81000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a7c1613d0 con 0x7f5a7c15e060 2024-04-25T09:01:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.736+0000 7f5a81000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a7c06d180 con 0x7f5a7c0ccce0 2024-04-25T09:01:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.736+0000 7f5a81000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c0cef10 con 0x7f5a7c0cb8f0 2024-04-25T09:01:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f5a7aa00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5a7c0ccce0 0x7f5a7c0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f5a7aa00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5a7c0ccce0 0x7f5a7c0ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56664/0 (socket says 172.21.15.59:56664) 2024-04-25T09:01:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f5a7aa00640 1 -- 172.21.15.59:0/1395756063 learned_addr learned my addr 172.21.15.59:0/1395756063 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f5a7b400640 1 --2- 172.21.15.59:0/1395756063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a7c0cb8f0 0x7f5a7c0ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f5a7aa00640 1 -- 172.21.15.59:0/1395756063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a7c0cb8f0 msgr2=0x7f5a7c0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f5a7aa00640 1 --2- 172.21.15.59:0/1395756063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a7c0cb8f0 0x7f5a7c0ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f5a7aa00640 1 -- 172.21.15.59:0/1395756063 >> v1:172.21.15.178:6789/0 conn(0x7f5a7c15e060 legacy=0x7f5a7c15e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f5a7aa00640 1 -- 172.21.15.59:0/1395756063 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c06baa0 con 0x7f5a7c0ccce0 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f83be000640 1 --2- 172.21.15.59:0/3764131994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b806bd20 0x7f83b806c180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009870 tx=0x7f83a401ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df06c9dbf14562da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f83b7e00640 1 -- 172.21.15.59:0/3764131994 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40b5070 con 0x7f83b806bd20 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f83b7e00640 1 -- 172.21.15.59:0/3764131994 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a40a8a50 con 0x7f83b806bd20 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f83b7e00640 1 -- 172.21.15.59:0/3764131994 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40a8e20 con 0x7f83b806bd20 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f83c0000640 1 -- 172.21.15.59:0/3764131994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b806bd20 msgr2=0x7f83b806c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f83c0000640 1 --2- 172.21.15.59:0/3764131994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b806bd20 0x7f83b806c180 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f83a4009870 tx=0x7f83a401ed50 comp rx=0 tx=0).stop 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f83c0000640 1 -- 172.21.15.59:0/3764131994 shutdown_connections 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f83c0000640 1 --2- 172.21.15.59:0/3764131994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b806bd20 0x7f83b806c180 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f83c0000640 1 --2- 172.21.15.59:0/3764131994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b806cf40 0x7f83b80b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f83c0000640 1 -- 172.21.15.59:0/3764131994 >> 172.21.15.59:0/3764131994 conn(0x7f83b806f510 msgr2=0x7f83b806f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f83c0000640 1 -- 172.21.15.59:0/3764131994 shutdown_connections 2024-04-25T09:01:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f83c0000640 1 -- 172.21.15.59:0/3764131994 wait complete. 2024-04-25T09:01:49.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f008fe00640 1 Processor -- start 2024-04-25T09:01:49.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.740+0000 7f008fe00640 1 -- start start 2024-04-25T09:01:49.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008fe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f00880cedf0 0x7f008815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008fe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088071ac0 0x7f0088071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008fe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008815eff0 con 0x7f0088161620 2024-04-25T09:01:49.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008fe00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008806ee30 con 0x7f00880cedf0 2024-04-25T09:01:49.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008fe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008806f110 con 0x7f0088071ac0 2024-04-25T09:01:49.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f5a7aa00640 1 --2- 172.21.15.59:0/1395756063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a7c0ccce0 0x7f5a7c0ce9d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009e50 tx=0x7f5a6c01ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd6bac3dfa46e71f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008d400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f00880cedf0 0x7f008815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008d400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f00880cedf0 0x7f008815eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56668/0 (socket says 172.21.15.59:56668) 2024-04-25T09:01:49.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008d400640 1 -- 172.21.15.59:0/1343308087 learned_addr learned my addr 172.21.15.59:0/1343308087 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f0eb7c00640 1 Processor -- start 2024-04-25T09:01:49.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008ca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088071ac0 0x7f0088071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f5a7a000640 1 -- 172.21.15.59:0/1395756063 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0a57f0 con 0x7f5a7c0ccce0 2024-04-25T09:01:49.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008ca00640 1 -- 172.21.15.59:0/1343308087 >> v2:172.21.15.178:3300/0 conn(0x7f00880cedf0 msgr2=0x7f008815eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008ca00640 1 --2- 172.21.15.59:0/1343308087 >> v2:172.21.15.178:3300/0 conn(0x7f00880cedf0 0x7f008815eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008ca00640 1 -- 172.21.15.59:0/1343308087 >> v1:172.21.15.59:6789/0 conn(0x7f0088161620 legacy=0x7f0088161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f008ca00640 1 -- 172.21.15.59:0/1343308087 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008806f3f0 con 0x7f0088071ac0 2024-04-25T09:01:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f5a7a000640 1 -- 172.21.15.59:0/1395756063 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6c0a5990 con 0x7f5a7c0ccce0 2024-04-25T09:01:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f5a7a000640 1 -- 172.21.15.59:0/1395756063 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0a5d60 con 0x7f5a7c0ccce0 2024-04-25T09:01:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.744+0000 7f0eb7c00640 1 -- start start 2024-04-25T09:01:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f83c0000640 1 Processor -- start 2024-04-25T09:01:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f56ca000640 1 Processor -- start 2024-04-25T09:01:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7faf70600640 1 Processor -- start 2024-04-25T09:01:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f83c0000640 1 -- start start 2024-04-25T09:01:49.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f5a81000640 1 -- 172.21.15.59:0/1395756063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a7c0ccce0 msgr2=0x7f5a7c0ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f5a81000640 1 --2- 172.21.15.59:0/1395756063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a7c0ccce0 0x7f5a7c0ce9d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009e50 tx=0x7f5a6c01ca50 comp rx=0 tx=0).stop 2024-04-25T09:01:49.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f56ca000640 1 -- start start 2024-04-25T09:01:49.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7faf70600640 1 -- start start 2024-04-25T09:01:49.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f0eb7c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00cedc0 0x7f0eb015bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f0eb7c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0eb00713a0 0x7f0eb015d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f0eb7c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb015cfa0 con 0x7f0eb00d11b0 2024-04-25T09:01:49.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f0eb7c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb00cf1a0 con 0x7f0eb00713a0 2024-04-25T09:01:49.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f0eb7c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb015c6a0 con 0x7f0eb00cedc0 2024-04-25T09:01:49.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f71d1600640 1 Processor -- start 2024-04-25T09:01:49.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f5a81000640 1 -- 172.21.15.59:0/1395756063 shutdown_connections 2024-04-25T09:01:49.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f5a81000640 1 --2- 172.21.15.59:0/1395756063 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a7c0ccce0 0x7f5a7c0ce9d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f5a81000640 1 --2- 172.21.15.59:0/1395756063 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a7c0cb8f0 0x7f5a7c0ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f5a81000640 1 -- 172.21.15.59:0/1395756063 >> 172.21.15.59:0/1395756063 conn(0x7f5a7c06ac10 msgr2=0x7f5a7c06b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f0eb5c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0eb00713a0 0x7f0eb015d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f0eb5c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0eb00713a0 0x7f0eb015d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46720/0 (socket says 172.21.15.59:46720) 2024-04-25T09:01:49.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f0eb5c00640 1 -- 172.21.15.59:0/1210465266 learned_addr learned my addr 172.21.15.59:0/1210465266 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7faf70600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faf6815db10 0x7faf680b9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f71d1600640 1 -- start start 2024-04-25T09:01:49.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7faf70600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf680b2cf0 0x7faf680ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7faf70600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf680cf0b0 con 0x7faf680cecb0 2024-04-25T09:01:49.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7faf70600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf680b60e0 con 0x7faf680b2cf0 2024-04-25T09:01:49.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7faf70600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf681623f0 con 0x7faf6815db10 2024-04-25T09:01:49.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f5a81000640 1 -- 172.21.15.59:0/1395756063 shutdown_connections 2024-04-25T09:01:49.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f5a81000640 1 -- 172.21.15.59:0/1395756063 wait complete. 2024-04-25T09:01:49.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f83c0000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b806bd20 0x7f83b8155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f83c0000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b806cf40 0x7f83b8156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.748+0000 7f83c0000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b8161fc0 0x7f83b81637d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f0eb5200640 1 --2- 172.21.15.59:0/1210465266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00cedc0 0x7f0eb015bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f0eb5c00640 1 -- 172.21.15.59:0/1210465266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00cedc0 msgr2=0x7f0eb015bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7faf6dc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faf6815db10 0x7faf680b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83bcc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b806cf40 0x7f83b8156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83bcc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b806cf40 0x7f83b8156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56698/0 (socket says 172.21.15.59:56698) 2024-04-25T09:01:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83be000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b8161fc0 0x7f83b81637d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83be000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b8161fc0 0x7f83b81637d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:60884/0 (socket says 172.21.15.59:60884) 2024-04-25T09:01:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83bcc00640 1 -- 172.21.15.59:0/3946431382 learned_addr learned my addr 172.21.15.59:0/3946431382 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80b56f0 con 0x7f83b806bd20 2024-04-25T09:01:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b80b5570 con 0x7f83b806cf40 2024-04-25T09:01:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8070c90 con 0x7f83b8161fc0 2024-04-25T09:01:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83be000640 1 -- 172.21.15.59:0/3946431382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b806cf40 msgr2=0x7f83b8156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f0eb5c00640 1 --2- 172.21.15.59:0/1210465266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00cedc0 0x7f0eb015bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f0eb5c00640 1 -- 172.21.15.59:0/1210465266 >> v1:172.21.15.178:6789/0 conn(0x7f0eb00d11b0 legacy=0x7f0eb0070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f0eaf400640 1 -- 172.21.15.59:0/1210465266 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111939984 0 0) 0x7f0eb015cfa0 con 0x7f0eb00d11b0 2024-04-25T09:01:49.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f008ca00640 1 --2- 172.21.15.59:0/1343308087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088071ac0 0x7f0088071f50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f00800097c0 tx=0x7f008001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdb43df611d2e321 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f0087e00640 1 -- 172.21.15.59:0/1343308087 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800b0070 con 0x7f0088071ac0 2024-04-25T09:01:49.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f0087e00640 1 -- 172.21.15.59:0/1343308087 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00800ab600 con 0x7f0088071ac0 2024-04-25T09:01:49.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f0087e00640 1 -- 172.21.15.59:0/1343308087 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800ab9d0 con 0x7f0088071ac0 2024-04-25T09:01:49.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7faf6dc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faf6815db10 0x7faf680b9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56684/0 (socket says 172.21.15.59:56684) 2024-04-25T09:01:49.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7faf6dc00640 1 -- 172.21.15.59:0/1946919685 learned_addr learned my addr 172.21.15.59:0/1946919685 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7faf6d200640 1 --2- 172.21.15.59:0/1946919685 >> v2:172.21.15.59:3300/0 conn(0x7faf680b2cf0 0x7faf680ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71d1600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f71cc0ae790 0x7f71cc0aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71d1600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f71cc0b4c50 0x7f71cc0b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71d1600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71cc0b3300 0x7f71cc161880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71d1600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc06bf50 con 0x7f71cc0b4c50 2024-04-25T09:01:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71d1600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71cc0aeb70 con 0x7f71cc0ae790 2024-04-25T09:01:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71d1600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc0b50b0 con 0x7f71cc0b3300 2024-04-25T09:01:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71caa00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f71cc0ae790 0x7f71cc0aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71caa00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f71cc0ae790 0x7f71cc0aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56710/0 (socket says 172.21.15.59:56710) 2024-04-25T09:01:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71cb400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71cc0b3300 0x7f71cc161880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71caa00640 1 -- 172.21.15.59:0/262700302 learned_addr learned my addr 172.21.15.59:0/262700302 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f3b32000640 1 Processor -- start 2024-04-25T09:01:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f3b32000640 1 -- start start 2024-04-25T09:01:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83bd600640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b806bd20 0x7f83b8155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83be000640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b806cf40 0x7f83b8156410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83be000640 1 -- 172.21.15.59:0/3946431382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b806bd20 msgr2=0x7f83b8155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83be000640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b806bd20 0x7f83b8155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71cb400640 1 -- 172.21.15.59:0/262700302 >> v2:172.21.15.178:3300/0 conn(0x7f71cc0ae790 msgr2=0x7f71cc0aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71cb400640 1 --2- 172.21.15.59:0/262700302 >> v2:172.21.15.178:3300/0 conn(0x7f71cc0ae790 0x7f71cc0aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71cb400640 1 -- 172.21.15.59:0/262700302 >> v2:172.21.15.59:3300/0 conn(0x7f71cc0b4c50 msgr2=0x7f71cc0b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71cb400640 1 --2- 172.21.15.59:0/262700302 >> v2:172.21.15.59:3300/0 conn(0x7f71cc0b4c50 0x7f71cc0b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83be000640 1 -- 172.21.15.59:0/3946431382 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b81ec5a0 con 0x7f83b8161fc0 2024-04-25T09:01:49.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f008fe00640 1 -- 172.21.15.59:0/1343308087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088071ac0 msgr2=0x7f0088071f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f008fe00640 1 --2- 172.21.15.59:0/1343308087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088071ac0 0x7f0088071f50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f00800097c0 tx=0x7f008001c410 comp rx=0 tx=0).stop 2024-04-25T09:01:49.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f56ca000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f56c406f400 0x7f56c41654d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f71cb400640 1 -- 172.21.15.59:0/262700302 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc0af630 con 0x7f71cc0b3300 2024-04-25T09:01:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83bcc00640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b806cf40 0x7f83b8156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83bd600640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b806bd20 0x7f83b8155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:49.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f0eb5c00640 1 -- 172.21.15.59:0/1210465266 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb015c980 con 0x7f0eb00713a0 2024-04-25T09:01:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f008fe00640 1 -- 172.21.15.59:0/1343308087 shutdown_connections 2024-04-25T09:01:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f008fe00640 1 --2- 172.21.15.59:0/1343308087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088071ac0 0x7f0088071f50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f008fe00640 1 --2- 172.21.15.59:0/1343308087 >> v2:172.21.15.178:3300/0 conn(0x7f00880cedf0 0x7f008815eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f008fe00640 1 -- 172.21.15.59:0/1343308087 >> 172.21.15.59:0/1343308087 conn(0x7f008806b010 msgr2=0x7f008806b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f5a81000640 1 Processor -- start 2024-04-25T09:01:49.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83be000640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b8161fc0 0x7f83b81637d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f83a40af000 tx=0x7f83a401baf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f008fe00640 1 -- 172.21.15.59:0/1343308087 shutdown_connections 2024-04-25T09:01:49.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f008fe00640 1 -- 172.21.15.59:0/1343308087 wait complete. 2024-04-25T09:01:49.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f3b32000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b2c1598a0 0x7f3b2c06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f0eb5200640 1 --2- 172.21.15.59:0/1210465266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00cedc0 0x7f0eb015bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:49.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f5a81000640 1 -- start start 2024-04-25T09:01:49.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83b5600640 1 -- 172.21.15.59:0/3946431382 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40c0070 con 0x7f83b8161fc0 2024-04-25T09:01:49.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83b5600640 1 -- 172.21.15.59:0/3946431382 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a40ae550 con 0x7f83b8161fc0 2024-04-25T09:01:49.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83b5600640 1 -- 172.21.15.59:0/3946431382 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40b5070 con 0x7f83b8161fc0 2024-04-25T09:01:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f56c3400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f56c415aa90 0x7f56c40cf260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41882/0 (socket says 172.21.15.59:41882) 2024-04-25T09:01:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f56c3400640 1 -- 172.21.15.59:0/669798902 learned_addr learned my addr 172.21.15.59:0/669798902 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f56c3e00640 1 --2- 172.21.15.59:0/669798902 >> v2:172.21.15.178:3300/0 conn(0x7f56c406f400 0x7f56c41654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f56ca000640 1 -- 172.21.15.59:0/669798902 --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c40cfa20 con 0x7f56c415aa90 2024-04-25T09:01:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f56ca000640 1 -- 172.21.15.59:0/669798902 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56c40cfd00 con 0x7f56c40b2d60 2024-04-25T09:01:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f56ca000640 1 -- 172.21.15.59:0/669798902 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c40cffe0 con 0x7f56c406f400 2024-04-25T09:01:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f3b32000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c071270 0x7f3b2c0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f3b32000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c0cde80 con 0x7f3b2c159c80 2024-04-25T09:01:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f3b32000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c06e810 con 0x7f3b2c1598a0 2024-04-25T09:01:49.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f3b32000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0ce120 con 0x7f3b2c071270 2024-04-25T09:01:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f3b23e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c071270 0x7f3b2c0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f3b23e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c071270 0x7f3b2c0cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:60900/0 (socket says 172.21.15.59:60900) 2024-04-25T09:01:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f3b23e00640 1 -- 172.21.15.59:0/2473700691 learned_addr learned my addr 172.21.15.59:0/2473700691 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b81ec880 con 0x7f83b8161fc0 2024-04-25T09:01:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b81547f0 con 0x7f83b8161fc0 2024-04-25T09:01:49.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f3b2b400640 1 --2- 172.21.15.59:0/2473700691 >> v2:172.21.15.59:3300/0 conn(0x7f3b2c1598a0 0x7f3b2c06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7faf6dc00640 1 -- 172.21.15.59:0/1946919685 >> v2:172.21.15.59:3300/0 conn(0x7faf680b2cf0 msgr2=0x7faf680ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7faf6dc00640 1 --2- 172.21.15.59:0/1946919685 >> v2:172.21.15.59:3300/0 conn(0x7faf680b2cf0 0x7faf680ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7faf6dc00640 1 -- 172.21.15.59:0/1946919685 >> v1:172.21.15.59:6789/0 conn(0x7faf680cecb0 legacy=0x7faf6806c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.752+0000 7faf6dc00640 1 -- 172.21.15.59:0/1946919685 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf681617e0 con 0x7faf6815db10 2024-04-25T09:01:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f56c2000640 1 -- 172.21.15.59:0/669798902 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027196827 0 0) 0x7f56c40cfa20 con 0x7f56c415aa90 2024-04-25T09:01:49.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f56c2000640 1 -- 172.21.15.59:0/669798902 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a8003530 con 0x7f56c415aa90 2024-04-25T09:01:49.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a81000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a7c0cb8f0 0x7f5a7c1689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a81000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a7c0ccce0 0x7f5a7c14ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a81000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a7c15e060 0x7f5a7c14cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f56c3e00640 1 -- 172.21.15.59:0/669798902 >> v1:172.21.15.178:6789/0 conn(0x7f56c40b2d60 legacy=0x7f56c406ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008fe00640 1 Processor -- start 2024-04-25T09:01:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a81000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c15a8c0 con 0x7f5a7c15e060 2024-04-25T09:01:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a81000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c15a740 con 0x7f5a7c0ccce0 2024-04-25T09:01:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a81000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c06e220 con 0x7f5a7c0cb8f0 2024-04-25T09:01:49.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a7b400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a7c0cb8f0 0x7f5a7c1689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83b8156950 con 0x7f83b8161fc0 2024-04-25T09:01:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008fe00640 1 -- start start 2024-04-25T09:01:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f3b2aa00640 1 -- 172.21.15.59:0/2473700691 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545560920 0 0) 0x7f3b2c0cde80 con 0x7f3b2c159c80 2024-04-25T09:01:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f3b2aa00640 1 -- 172.21.15.59:0/2473700691 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b10005740 con 0x7f3b2c159c80 2024-04-25T09:01:49.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f3b23e00640 1 -- 172.21.15.59:0/2473700691 >> v2:172.21.15.59:3300/0 conn(0x7f3b2c1598a0 msgr2=0x7f3b2c06e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a7b400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a7c0cb8f0 0x7f5a7c1689d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:60908/0 (socket says 172.21.15.59:60908) 2024-04-25T09:01:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a7b400640 1 -- 172.21.15.59:0/236892333 learned_addr learned my addr 172.21.15.59:0/236892333 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f3b2aa00640 1 -- 172.21.15.59:0/2473700691 <== mon.1 v1:172.21.15.178:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1915266721 0 0) 0x7f3b10005740 con 0x7f3b2c159c80 2024-04-25T09:01:49.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f56c3e00640 1 -- 172.21.15.59:0/669798902 >> v1:172.21.15.59:6789/0 conn(0x7f56c415aa90 legacy=0x7f56c40cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a7b400640 1 -- 172.21.15.59:0/236892333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a7c0ccce0 msgr2=0x7f5a7c14ea90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:01:49.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a7b400640 1 --2- 172.21.15.59:0/236892333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a7c0ccce0 0x7f5a7c14ea90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f56c3e00640 1 -- 172.21.15.59:0/669798902 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c40cad90 con 0x7f56c406f400 2024-04-25T09:01:49.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a7b400640 1 -- 172.21.15.59:0/236892333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a7c15e060 msgr2=0x7f5a7c14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a7b400640 1 --2- 172.21.15.59:0/236892333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a7c15e060 0x7f5a7c14cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f3b23e00640 1 --2- 172.21.15.59:0/2473700691 >> v2:172.21.15.59:3300/0 conn(0x7f3b2c1598a0 0x7f3b2c06e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f3b23e00640 1 -- 172.21.15.59:0/2473700691 >> v1:172.21.15.178:6789/0 conn(0x7f3b2c159c80 legacy=0x7f3b2c06f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f5a7b400640 1 -- 172.21.15.59:0/236892333 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c168f10 con 0x7f5a7c0cb8f0 2024-04-25T09:01:49.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f3b23e00640 1 -- 172.21.15.59:0/2473700691 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0ce400 con 0x7f3b2c071270 2024-04-25T09:01:49.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0088071ac0 0x7f00881fa840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00880cedf0 0x7f008815a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f71cb400640 1 --2- 172.21.15.59:0/262700302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71cc0b3300 0x7f71cc161880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71cc071a90 tx=0x7f71c401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48332eda8fc6ab51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008fe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088161620 0x7f008814ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008806eb50 con 0x7f0088071ac0 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008fe00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008806e9d0 con 0x7f00880cedf0 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008fe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008816b1d0 con 0x7f0088161620 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008ca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00880cedf0 0x7f008815a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008ca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00880cedf0 0x7f008815a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56732/0 (socket says 172.21.15.59:56732) 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008ca00640 1 -- 172.21.15.59:0/1182724245 learned_addr learned my addr 172.21.15.59:0/1182724245 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008de00640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088161620 0x7f008814ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008ca00640 1 -- 172.21.15.59:0/1182724245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088161620 msgr2=0x7f008814ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008ca00640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0088161620 0x7f008814ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008ca00640 1 -- 172.21.15.59:0/1182724245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0088071ac0 msgr2=0x7f00881fa840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008ca00640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0088071ac0 0x7f00881fa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f008ca00640 1 -- 172.21.15.59:0/1182724245 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00881559e0 con 0x7f00880cedf0 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f008ca00640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00880cedf0 0x7f008815a220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f00800ae040 tx=0x7f00800191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f0085600640 1 -- 172.21.15.59:0/1182724245 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800b0040 con 0x7f00880cedf0 2024-04-25T09:01:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f0085600640 1 -- 172.21.15.59:0/1182724245 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00800b43f0 con 0x7f00880cedf0 2024-04-25T09:01:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f0085600640 1 -- 172.21.15.59:0/1182724245 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800b47e0 con 0x7f00880cedf0 2024-04-25T09:01:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f008fe00640 1 -- 172.21.15.59:0/1182724245 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0088155cc0 con 0x7f00880cedf0 2024-04-25T09:01:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f71c9600640 1 -- 172.21.15.59:0/262700302 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40b2070 con 0x7f71cc0b3300 2024-04-25T09:01:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f71c9600640 1 -- 172.21.15.59:0/262700302 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c40a57b0 con 0x7f71cc0b3300 2024-04-25T09:01:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.756+0000 7f71c9600640 1 -- 172.21.15.59:0/262700302 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c40a5b80 con 0x7f71cc0b3300 2024-04-25T09:01:49.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f008fe00640 1 -- 172.21.15.59:0/1182724245 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0088156280 con 0x7f00880cedf0 2024-04-25T09:01:49.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f5a7b400640 1 --2- 172.21.15.59:0/236892333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a7c0cb8f0 0x7f5a7c1689d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400d830 tx=0x7f5a7400dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f008fe00640 1 -- 172.21.15.59:0/1182724245 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0088156660 con 0x7f00880cedf0 2024-04-25T09:01:49.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f83b5600640 1 -- 172.21.15.59:0/3946431382 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f83a40c3070 con 0x7f83b8161fc0 2024-04-25T09:01:49.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f83b5600640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8398066fb0 0x7f8398069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f83b5600640 1 -- 172.21.15.59:0/3946431382 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f83a4122cd0 con 0x7f83b8161fc0 2024-04-25T09:01:49.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f83b5600640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x7f83980706b0 0x7f8398072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f83b5600640 1 -- 172.21.15.59:0/3946431382 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83a40a8a50 con 0x7f83980706b0 2024-04-25T09:01:49.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f71d1600640 1 -- 172.21.15.59:0/262700302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71cc0b3300 msgr2=0x7f71cc161880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f71d1600640 1 --2- 172.21.15.59:0/262700302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71cc0b3300 0x7f71cc161880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f71cc071a90 tx=0x7f71c401c970 comp rx=0 tx=0).stop 2024-04-25T09:01:49.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f71d1600640 1 -- 172.21.15.59:0/262700302 shutdown_connections 2024-04-25T09:01:49.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f71d1600640 1 --2- 172.21.15.59:0/262700302 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71cc0b3300 0x7f71cc161880 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f71d1600640 1 --2- 172.21.15.59:0/262700302 >> v2:172.21.15.59:3300/0 conn(0x7f71cc0b4c50 0x7f71cc0b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f71d1600640 1 --2- 172.21.15.59:0/262700302 >> v2:172.21.15.178:3300/0 conn(0x7f71cc0ae790 0x7f71cc0aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f71d1600640 1 -- 172.21.15.59:0/262700302 >> 172.21.15.59:0/262700302 conn(0x7f71cc0cc830 msgr2=0x7f71cc0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f71d1600640 1 -- 172.21.15.59:0/262700302 shutdown_connections 2024-04-25T09:01:49.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f71d1600640 1 -- 172.21.15.59:0/262700302 wait complete. 2024-04-25T09:01:49.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f5a73400640 1 -- 172.21.15.59:0/236892333 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400b6c0 con 0x7f5a7c0cb8f0 2024-04-25T09:01:49.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f5a73400640 1 -- 172.21.15.59:0/236892333 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a74019070 con 0x7f5a7c0cb8f0 2024-04-25T09:01:49.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f5a73400640 1 -- 172.21.15.59:0/236892333 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7400ba60 con 0x7f5a7c0cb8f0 2024-04-25T09:01:49.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f83bd600640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8398066fb0 0x7f8398069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f83bcc00640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x7f83980706b0 0x7f8398072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f5a81000640 1 -- 172.21.15.59:0/236892333 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7c14d9f0 con 0x7f5a7c0cb8f0 2024-04-25T09:01:49.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7faf6dc00640 1 --2- 172.21.15.59:0/1946919685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf6815db10 0x7faf680b9350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf6808c160 tx=0x7faf5c01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b265cb09a85cc14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f83bd600640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8398066fb0 0x7f8398069470 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f83b00012f0 tx=0x7f83b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f0eb5c00640 1 --2- 172.21.15.59:0/1210465266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eb00713a0 0x7f0eb015d760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009e50 tx=0x7f0ea801f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae8d00301bdd5e1c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f0085600640 1 -- 172.21.15.59:0/1182724245 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f00800b4980 con 0x7f00880cedf0 2024-04-25T09:01:49.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f3b23e00640 1 --2- 172.21.15.59:0/2473700691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c071270 0x7f3b2c0cd940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009870 tx=0x7f3b1401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef1a4f97945ad9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f5a81000640 1 -- 172.21.15.59:0/236892333 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7c14dfb0 con 0x7f5a7c0cb8f0 2024-04-25T09:01:49.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f0eaf400640 1 -- 172.21.15.59:0/1210465266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80b4070 con 0x7f0eb00713a0 2024-04-25T09:01:49.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0eaf400640 1 -- 172.21.15.59:0/1210465266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea80af400 con 0x7f0eb00713a0 2024-04-25T09:01:49.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0eaf400640 1 -- 172.21.15.59:0/1210465266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80af7d0 con 0x7f0eb00713a0 2024-04-25T09:01:49.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f3b2aa00640 1 -- 172.21.15.59:0/2473700691 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140b2070 con 0x7f3b2c071270 2024-04-25T09:01:49.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f83bcc00640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x7f83980706b0 0x7f8398072af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f56c3e00640 1 --2- 172.21.15.59:0/669798902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c406f400 0x7f56c41654d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009dc0 tx=0x7f56bc01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=524cea86263fb7c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.760+0000 7f56c2000640 1 -- 172.21.15.59:0/669798902 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0b2070 con 0x7f56c406f400 2024-04-25T09:01:49.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f56c2000640 1 -- 172.21.15.59:0/669798902 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc0a5890 con 0x7f56c406f400 2024-04-25T09:01:49.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f56c2000640 1 -- 172.21.15.59:0/669798902 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0a5c60 con 0x7f56c406f400 2024-04-25T09:01:49.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f3b2aa00640 1 -- 172.21.15.59:0/2473700691 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c0b3610 con 0x7f3b2c071270 2024-04-25T09:01:49.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f3b2aa00640 1 -- 172.21.15.59:0/2473700691 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24001a00 con 0x7f3b2c071270 2024-04-25T09:01:49.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0085600640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0068066f60 0x7f0068069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0085600640 1 -- 172.21.15.59:0/1182724245 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f008011f890 con 0x7f00880cedf0 2024-04-25T09:01:49.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7faf67e00640 1 -- 172.21.15.59:0/1946919685 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0aa610 con 0x7faf6815db10 2024-04-25T09:01:49.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0085600640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x7f0068070660 0x7f0068072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0085600640 1 -- 172.21.15.59:0/1182724245 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00800ade90 con 0x7f0068070660 2024-04-25T09:01:49.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0085600640 1 -- 172.21.15.59:0/1182724245 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f008011fc40 con 0x7f00880cedf0 2024-04-25T09:01:49.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f83b5600640 1 -- 172.21.15.59:0/3946431382 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83a40ef660 con 0x7f83b8161fc0 2024-04-25T09:01:49.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f008de00640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x7f0068070660 0x7f0068072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7faf67e00640 1 -- 172.21.15.59:0/1946919685 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c0af070 con 0x7faf6815db10 2024-04-25T09:01:49.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0eb7c00640 1 -- 172.21.15.59:0/1210465266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eb00713a0 msgr2=0x7f0eb015d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0eb7c00640 1 --2- 172.21.15.59:0/1210465266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eb00713a0 0x7f0eb015d760 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0ea8009e50 tx=0x7f0ea801f210 comp rx=0 tx=0).stop 2024-04-25T09:01:49.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f71d1600640 1 Processor -- start 2024-04-25T09:01:49.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7faf67e00640 1 -- 172.21.15.59:0/1946919685 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0aa9d0 con 0x7faf6815db10 2024-04-25T09:01:49.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0eb7c00640 1 -- 172.21.15.59:0/1210465266 shutdown_connections 2024-04-25T09:01:49.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f008d400640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0068066f60 0x7f0068069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f83b5600640 1 -- 172.21.15.59:0/3946431382 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f83a40a8a50 con 0x7f83980706b0 2024-04-25T09:01:49.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f008de00640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x7f0068070660 0x7f0068072aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f5a81000640 1 -- 172.21.15.59:0/236892333 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5a7c0745d0 con 0x7f5a7c0cb8f0 2024-04-25T09:01:49.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f56ca000640 1 -- 172.21.15.59:0/669798902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c406f400 msgr2=0x7f56c41654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f3b32000640 1 -- 172.21.15.59:0/2473700691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c071270 msgr2=0x7f3b2c0cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f3b32000640 1 --2- 172.21.15.59:0/2473700691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c071270 0x7f3b2c0cd940 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3b14009870 tx=0x7f3b1401c450 comp rx=0 tx=0).stop 2024-04-25T09:01:49.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f56ca000640 1 --2- 172.21.15.59:0/669798902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c406f400 0x7f56c41654d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009dc0 tx=0x7f56bc01c8c0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0eb7c00640 1 --2- 172.21.15.59:0/1210465266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eb00713a0 0x7f0eb015d760 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f56ca000640 1 -- 172.21.15.59:0/669798902 shutdown_connections 2024-04-25T09:01:49.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f56ca000640 1 --2- 172.21.15.59:0/669798902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c406f400 0x7f56c41654d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f56ca000640 1 -- 172.21.15.59:0/669798902 >> 172.21.15.59:0/669798902 conn(0x7f56c40b2240 msgr2=0x7f56c40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0eb7c00640 1 --2- 172.21.15.59:0/1210465266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00cedc0 0x7f0eb015bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f3b32000640 1 -- 172.21.15.59:0/2473700691 shutdown_connections 2024-04-25T09:01:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f3b32000640 1 --2- 172.21.15.59:0/2473700691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c071270 0x7f3b2c0cd940 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f3b32000640 1 --2- 172.21.15.59:0/2473700691 >> v2:172.21.15.59:3300/0 conn(0x7f3b2c1598a0 0x7f3b2c06e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f3b32000640 1 -- 172.21.15.59:0/2473700691 >> 172.21.15.59:0/2473700691 conn(0x7f3b2c06b010 msgr2=0x7f3b2c06b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0eb7c00640 1 -- 172.21.15.59:0/1210465266 >> 172.21.15.59:0/1210465266 conn(0x7f0eb006f510 msgr2=0x7f0eb006f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7faf70600640 1 -- 172.21.15.59:0/1946919685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf6815db10 msgr2=0x7faf680b9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7faf70600640 1 --2- 172.21.15.59:0/1946919685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf6815db10 0x7faf680b9350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf6808c160 tx=0x7faf5c01c4b0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7faf70600640 1 -- 172.21.15.59:0/1946919685 shutdown_connections 2024-04-25T09:01:49.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7faf70600640 1 --2- 172.21.15.59:0/1946919685 >> v2:172.21.15.59:3300/0 conn(0x7faf680b2cf0 0x7faf680ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7faf70600640 1 --2- 172.21.15.59:0/1946919685 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf6815db10 0x7faf680b9350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7faf70600640 1 -- 172.21.15.59:0/1946919685 >> 172.21.15.59:0/1946919685 conn(0x7faf680d04b0 msgr2=0x7faf680d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f3b32000640 1 -- 172.21.15.59:0/2473700691 shutdown_connections 2024-04-25T09:01:49.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7faf70600640 1 -- 172.21.15.59:0/1946919685 shutdown_connections 2024-04-25T09:01:49.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7faf70600640 1 -- 172.21.15.59:0/1946919685 wait complete. 2024-04-25T09:01:49.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f008d400640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0068066f60 0x7f0068069420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f00740094a0 tx=0x7f00740093f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f3b32000640 1 -- 172.21.15.59:0/2473700691 wait complete. 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f71d1600640 1 -- start start 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f71d1600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc0ae790 0x7f71cc155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f71d1600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71cc0b3300 0x7f71cc15fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f71d1600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71cc0b4c50 0x7f71cc15a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f71d1600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc06c560 con 0x7f71cc0ae790 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f71d1600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc06c3e0 con 0x7f71cc0b3300 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f71d1600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71cc1621d0 con 0x7f71cc0b4c50 2024-04-25T09:01:49.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.764+0000 7f0eb7c00640 1 -- 172.21.15.59:0/1210465266 shutdown_connections 2024-04-25T09:01:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f56ca000640 1 -- 172.21.15.59:0/669798902 shutdown_connections 2024-04-25T09:01:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f0eb7c00640 1 -- 172.21.15.59:0/1210465266 wait complete. 2024-04-25T09:01:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f71caa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc0ae790 0x7f71cc155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f56ca000640 1 -- 172.21.15.59:0/669798902 wait complete. 2024-04-25T09:01:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f0085600640 1 -- 172.21.15.59:0/1182724245 <== osd.3 v2:172.21.15.59:6808/3810214969 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f00800ade90 con 0x7f0068070660 2024-04-25T09:01:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f71cb400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71cc0b4c50 0x7f71cc15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f71caa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc0ae790 0x7f71cc155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46774/0 (socket says 172.21.15.59:46774) 2024-04-25T09:01:49.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f71caa00640 1 -- 172.21.15.59:0/3865063836 learned_addr learned my addr 172.21.15.59:0/3865063836 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f71ca000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71cc0b3300 0x7f71cc15fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f71caa00640 1 -- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71cc0b4c50 msgr2=0x7f71cc15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f71caa00640 1 --2- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71cc0b4c50 0x7f71cc15a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f71caa00640 1 -- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71cc0b3300 msgr2=0x7f71cc15fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f71caa00640 1 --2- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71cc0b3300 0x7f71cc15fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f71caa00640 1 -- 172.21.15.59:0/3865063836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71cc160630 con 0x7f71cc0ae790 2024-04-25T09:01:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f5a73400640 1 -- 172.21.15.59:0/236892333 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5a7400bc00 con 0x7f5a7c0cb8f0 2024-04-25T09:01:49.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f5a73400640 1 --2- 172.21.15.59:0/236892333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5a58066fb0 0x7f5a58069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7faf70600640 1 Processor -- start 2024-04-25T09:01:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f5a7aa00640 1 --2- 172.21.15.59:0/236892333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5a58066fb0 0x7f5a58069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7faf70600640 1 -- start start 2024-04-25T09:01:49.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f5a73400640 1 -- 172.21.15.59:0/236892333 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5a74053890 con 0x7f5a7c0cb8f0 2024-04-25T09:01:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f56ca000640 1 Processor -- start 2024-04-25T09:01:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f5a73400640 1 --2- 172.21.15.59:0/236892333 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x7f5a58071440 0x7f5a580738e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f56ca000640 1 -- start start 2024-04-25T09:01:49.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f3b32000640 1 Processor -- start 2024-04-25T09:01:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f5a73400640 1 -- 172.21.15.59:0/236892333 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a58073fb0 con 0x7f5a58071440 2024-04-25T09:01:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f3b32000640 1 -- start start 2024-04-25T09:01:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f5a73400640 1 -- 172.21.15.59:0/236892333 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a74052010 con 0x7f5a7c0cb8f0 2024-04-25T09:01:49.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f5a7aa00640 1 --2- 172.21.15.59:0/236892333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5a58066fb0 0x7f5a58069470 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0ae000 tx=0x7f5a6c0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f0eb7c00640 1 Processor -- start 2024-04-25T09:01:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f5a7be00640 1 --2- 172.21.15.59:0/236892333 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x7f5a58071440 0x7f5a580738e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f0eb7c00640 1 -- start start 2024-04-25T09:01:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf70600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf680b2cf0 0x7faf680cd540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf70600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf680cecb0 0x7faf681521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf6dc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf680b2cf0 0x7faf680cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf6dc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf680b2cf0 0x7faf680cd540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56738/0 (socket says 172.21.15.59:56738) 2024-04-25T09:01:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf6dc00640 1 -- 172.21.15.59:0/2826570330 learned_addr learned my addr 172.21.15.59:0/2826570330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56ca000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c406f400 0x7f56c4153840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56ca000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56c40b2d60 0x7f56c40b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56ca000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56c415aa90 0x7f56c40af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56ca000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c41665f0 con 0x7f56c40b2d60 2024-04-25T09:01:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56ca000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c4166470 con 0x7f56c406f400 2024-04-25T09:01:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56ca000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c4166770 con 0x7f56c415aa90 2024-04-25T09:01:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b32000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c071270 0x7f3b2c14e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b32000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b2c1598a0 0x7f3b2c1f6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf70600640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf6815db10 0x7faf680cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf6d200640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf680cecb0 0x7faf681521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.768+0000 7f71caa00640 1 --2- 172.21.15.59:0/3865063836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc0ae790 0x7f71cc155770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00e8c0 tx=0x7f71bc00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b32000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c159c80 0x7f3b2c15c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b32000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c06f9a0 con 0x7f3b2c071270 2024-04-25T09:01:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b32000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0cf240 con 0x7f3b2c1598a0 2024-04-25T09:01:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b32000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c06fb20 con 0x7f3b2c159c80 2024-04-25T09:01:49.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f5a7be00640 1 --2- 172.21.15.59:0/236892333 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x7f5a58071440 0x7f5a580738e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b23e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b2c1598a0 0x7f3b2c1f6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b23e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b2c1598a0 0x7f3b2c1f6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56754/0 (socket says 172.21.15.59:56754) 2024-04-25T09:01:49.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56c3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c406f400 0x7f56c4153840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56c3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c406f400 0x7f56c4153840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56746/0 (socket says 172.21.15.59:56746) 2024-04-25T09:01:49.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56c3400640 1 -- 172.21.15.59:0/1230755038 learned_addr learned my addr 172.21.15.59:0/1230755038 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b23e00640 1 -- 172.21.15.59:0/2910562844 learned_addr learned my addr 172.21.15.59:0/2910562844 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b2be00640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c159c80 0x7f3b2c15c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6815def0 con 0x7faf6815db10 2024-04-25T09:01:49.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680b9890 con 0x7faf680b2cf0 2024-04-25T09:01:49.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf680cda80 con 0x7faf680cecb0 2024-04-25T09:01:49.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f0eb7c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb00713a0 0x7f0eb01357a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b2b400640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c071270 0x7f3b2c14e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf6e600640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf6815db10 0x7faf680cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf6dc00640 1 -- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf680cecb0 msgr2=0x7faf681521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf6dc00640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faf680cecb0 0x7faf681521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf6dc00640 1 -- 172.21.15.59:0/2826570330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf6815db10 msgr2=0x7faf680cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf6dc00640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf6815db10 0x7faf680cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf6dc00640 1 -- 172.21.15.59:0/2826570330 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf680cad50 con 0x7faf680b2cf0 2024-04-25T09:01:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56c2a00640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56c40b2d60 0x7f56c40b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56c3e00640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56c415aa90 0x7f56c40af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f0eb7c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eb00cedc0 0x7f0eb0158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f0eb7c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00d11b0 0x7f0eb00b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f0eb7c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb015c320 con 0x7f0eb00cedc0 2024-04-25T09:01:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f0eb7c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb015d240 con 0x7f0eb00713a0 2024-04-25T09:01:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f0eb7c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb015dca0 con 0x7f0eb00d11b0 2024-04-25T09:01:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf6dc00640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf680b2cf0 0x7faf680cd540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0ac040 tx=0x7faf5c01acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b23e00640 1 -- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c159c80 msgr2=0x7f3b2c15c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b23e00640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c159c80 0x7f3b2c15c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b23e00640 1 -- 172.21.15.59:0/2910562844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c071270 msgr2=0x7f3b2c14e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b23e00640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c071270 0x7f3b2c14e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b23e00640 1 -- 172.21.15.59:0/2910562844 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c1549d0 con 0x7f3b2c1598a0 2024-04-25T09:01:49.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56c3e00640 1 -- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c406f400 msgr2=0x7f56c4153840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56c3e00640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56c406f400 0x7f56c4153840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56c3e00640 1 -- 172.21.15.59:0/1230755038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56c40b2d60 msgr2=0x7f56c40b09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56c3e00640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56c40b2d60 0x7f56c40b09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f56c3e00640 1 -- 172.21.15.59:0/1230755038 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c40add90 con 0x7f56c415aa90 2024-04-25T09:01:49.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f3b23e00640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b2c1598a0 0x7f3b2c1f6b90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3b1401a080 tx=0x7f3b140191f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f5a73400640 1 -- 172.21.15.59:0/236892333 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5a58073fb0 con 0x7f5a58071440 2024-04-25T09:01:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf65600640 1 -- 172.21.15.59:0/2826570330 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0bd5f0 con 0x7faf680b2cf0 2024-04-25T09:01:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf65600640 1 -- 172.21.15.59:0/2826570330 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c0bd7b0 con 0x7faf680b2cf0 2024-04-25T09:01:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf65600640 1 -- 172.21.15.59:0/2826570330 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c0bdba0 con 0x7faf680b2cf0 2024-04-25T09:01:49.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f0eb5c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00d11b0 0x7f0eb00b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f0eb5c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00d11b0 0x7f0eb00b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:60970/0 (socket says 172.21.15.59:60970) 2024-04-25T09:01:49.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f0eb5c00640 1 -- 172.21.15.59:0/1692635163 learned_addr learned my addr 172.21.15.59:0/1692635163 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:49.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f0eb5200640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb00713a0 0x7f0eb01357a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7f0eafe00640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eb00cedc0 0x7f0eb0158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.772+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf680cb030 con 0x7faf680b2cf0 2024-04-25T09:01:49.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6815fa60 con 0x7faf680b2cf0 2024-04-25T09:01:49.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f56c3e00640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56c415aa90 0x7f56c40af120 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0ac000 tx=0x7f56bc019660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f0eb5c00640 1 -- 172.21.15.59:0/1692635163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb00713a0 msgr2=0x7f0eb01357a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f0eb5c00640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0eb00713a0 0x7f0eb01357a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f0eb5c00640 1 -- 172.21.15.59:0/1692635163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eb00cedc0 msgr2=0x7f0eb0158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f0eb5c00640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0eb00cedc0 0x7f0eb0158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f0eb5c00640 1 -- 172.21.15.59:0/1692635163 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb0135ce0 con 0x7f0eb00d11b0 2024-04-25T09:01:49.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f71c2a00640 1 -- 172.21.15.59:0/3865063836 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc017070 con 0x7f71cc0ae790 2024-04-25T09:01:49.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f71c2a00640 1 -- 172.21.15.59:0/3865063836 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71bc00c940 con 0x7f71cc0ae790 2024-04-25T09:01:49.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f71c2a00640 1 -- 172.21.15.59:0/3865063836 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71bc00ccf0 con 0x7f71cc0ae790 2024-04-25T09:01:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f71d1600640 1 -- 172.21.15.59:0/3865063836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71cc160910 con 0x7f71cc0ae790 2024-04-25T09:01:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f3b23400640 1 -- 172.21.15.59:0/2910562844 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140bc070 con 0x7f3b2c1598a0 2024-04-25T09:01:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f3b23400640 1 -- 172.21.15.59:0/2910562844 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b140add30 con 0x7f3b2c1598a0 2024-04-25T09:01:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f3b23400640 1 -- 172.21.15.59:0/2910562844 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b140b2040 con 0x7f3b2c1598a0 2024-04-25T09:01:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f3b32000640 1 -- 172.21.15.59:0/2910562844 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c154cb0 con 0x7f3b2c1598a0 2024-04-25T09:01:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f3b32000640 1 -- 172.21.15.59:0/2910562844 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c155270 con 0x7f3b2c1598a0 2024-04-25T09:01:49.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f71d1600640 1 -- 172.21.15.59:0/3865063836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71cc160ed0 con 0x7f71cc0ae790 2024-04-25T09:01:49.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f3b32000640 1 -- 172.21.15.59:0/2910562844 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3b2c0b3610 con 0x7f3b2c1598a0 2024-04-25T09:01:49.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf44001040 con 0x7faf680b2cf0 2024-04-25T09:01:49.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f0eb5c00640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00d11b0 0x7f0eb00b54d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80b2040 tx=0x7f0ea801bfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f71d1600640 1 -- 172.21.15.59:0/3865063836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71cc0745d0 con 0x7f71cc0ae790 2024-04-25T09:01:49.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f0eacc00640 1 -- 172.21.15.59:0/1692635163 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80c0070 con 0x7f0eb00d11b0 2024-04-25T09:01:49.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f0eacc00640 1 -- 172.21.15.59:0/1692635163 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea80090d0 con 0x7f0eb00d11b0 2024-04-25T09:01:49.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f0eacc00640 1 -- 172.21.15.59:0/1692635163 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80b4040 con 0x7f0eb00d11b0 2024-04-25T09:01:49.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f0eb7c00640 1 -- 172.21.15.59:0/1692635163 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb0139470 con 0x7f0eb00d11b0 2024-04-25T09:01:49.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f56bb400640 1 -- 172.21.15.59:0/1230755038 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0bd020 con 0x7f56c415aa90 2024-04-25T09:01:49.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f56ca000640 1 -- 172.21.15.59:0/1230755038 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c40ae070 con 0x7f56c415aa90 2024-04-25T09:01:49.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f56bb400640 1 -- 172.21.15.59:0/1230755038 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc0b3040 con 0x7f56c415aa90 2024-04-25T09:01:49.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f56bb400640 1 -- 172.21.15.59:0/1230755038 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0bd020 con 0x7f56c415aa90 2024-04-25T09:01:49.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f56ca000640 1 -- 172.21.15.59:0/1230755038 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c40ae630 con 0x7f56c415aa90 2024-04-25T09:01:49.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f3b23400640 1 -- 172.21.15.59:0/2910562844 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3b140b6620 con 0x7f3b2c1598a0 2024-04-25T09:01:49.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f3b23400640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3b08066fb0 0x7f3b08069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f3b23400640 1 -- 172.21.15.59:0/2910562844 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f3b1411e8d0 con 0x7f3b2c1598a0 2024-04-25T09:01:49.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.776+0000 7f0eb7c00640 1 -- 172.21.15.59:0/1692635163 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb0142990 con 0x7f0eb00d11b0 2024-04-25T09:01:49.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f3b23400640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x7f3b080706b0 0x7f3b08072af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f3b23400640 1 -- 172.21.15.59:0/2910562844 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3b140bae50 con 0x7f3b080706b0 2024-04-25T09:01:49.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7faf65600640 1 -- 172.21.15.59:0/2826570330 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faf5c0b33f0 con 0x7faf680b2cf0 2024-04-25T09:01:49.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f3b2be00640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x7f3b080706b0 0x7f3b08072af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f71c2a00640 1 -- 172.21.15.59:0/3865063836 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f71bc01a070 con 0x7f71cc0ae790 2024-04-25T09:01:49.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f71c2a00640 1 --2- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f71a8066f60 0x7f71a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f71c2a00640 1 -- 172.21.15.59:0/3865063836 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f71bc085600 con 0x7f71cc0ae790 2024-04-25T09:01:49.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f71c2a00640 1 --2- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x7f71a80706e0 0x7f71a8072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f71c2a00640 1 -- 172.21.15.59:0/3865063836 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71bc00ce90 con 0x7f71a80706e0 2024-04-25T09:01:49.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f71c2a00640 1 -- 172.21.15.59:0/3865063836 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71bc08c050 con 0x7f71cc0ae790 2024-04-25T09:01:49.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f56bb400640 1 -- 172.21.15.59:0/1230755038 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f56bc0c0020 con 0x7f56c415aa90 2024-04-25T09:01:49.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.780+0000 7f71ca000640 1 --2- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f71a8066f60 0x7f71a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f71cb400640 1 --2- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x7f71a80706e0 0x7f71a8072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f3b2b400640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3b08066fb0 0x7f3b08069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f0ea6000640 1 -- 172.21.15.59:0/1692635163 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0eb00745d0 con 0x7f0eb00d11b0 2024-04-25T09:01:49.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7faf65600640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faf48066f60 0x7faf48069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f3b2be00640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x7f3b080706b0 0x7f3b08072af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f3b23400640 1 -- 172.21.15.59:0/2910562844 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b140eb1d0 con 0x7f3b2c1598a0 2024-04-25T09:01:49.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f56ca000640 1 -- 172.21.15.59:0/1230755038 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f56c40aea10 con 0x7f56c415aa90 2024-04-25T09:01:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7faf65600640 1 -- 172.21.15.59:0/2826570330 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7faf5c11f430 con 0x7faf680b2cf0 2024-04-25T09:01:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7faf65600640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x7faf480706e0 0x7faf48072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7faf65600640 1 -- 172.21.15.59:0/2826570330 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf5c001d40 con 0x7faf480706e0 2024-04-25T09:01:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f56bb400640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f56a4067160 0x7f56a4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f71ca000640 1 --2- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f71a8066f60 0x7f71a8069420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0b3d20 tx=0x7f71b4006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f3b2b400640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3b08066fb0 0x7f3b08069470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00b9d0 tx=0x7f3b1c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f0eacc00640 1 -- 172.21.15.59:0/1692635163 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0ea80c3070 con 0x7f0eb00d11b0 2024-04-25T09:01:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f71cb400640 1 --2- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x7f71a80706e0 0x7f71a8072b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f56bb400640 1 -- 172.21.15.59:0/1230755038 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f56bc11ff20 con 0x7f56c415aa90 2024-04-25T09:01:49.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f56c3400640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f56a4067160 0x7f56a4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f56bb400640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x7f56a40707e0 0x7f56a4072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f56bb400640 1 -- 172.21.15.59:0/1230755038 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f56a40732f0 con 0x7f56a40707e0 2024-04-25T09:01:49.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f56bb400640 1 -- 172.21.15.59:0/1230755038 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56bc0ec530 con 0x7f56c415aa90 2024-04-25T09:01:49.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f3b23400640 1 -- 172.21.15.59:0/2910562844 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3b140bae50 con 0x7f3b080706b0 2024-04-25T09:01:49.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7faf65600640 1 -- 172.21.15.59:0/2826570330 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf5c126050 con 0x7faf680b2cf0 2024-04-25T09:01:49.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7faf6d200640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faf48066f60 0x7faf48069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7faf6e600640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x7faf480706e0 0x7faf48072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f0eacc00640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e90067030 0x7f0e900694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f56c2a00640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x7f56a40707e0 0x7f56a4072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7faf6e600640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x7faf480706e0 0x7faf48072b20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7faf6d200640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faf48066f60 0x7faf48069420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf680cc1d0 tx=0x7faf54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f56c3400640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f56a4067160 0x7f56a4069620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f56b40011f0 tx=0x7f56b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f71c2a00640 1 -- 172.21.15.59:0/3865063836 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f71bc00ce90 con 0x7f71a80706e0 2024-04-25T09:01:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f0eacc00640 1 -- 172.21.15.59:0/1692635163 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0ea8122ca0 con 0x7f0eb00d11b0 2024-04-25T09:01:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f0eb5200640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e90067030 0x7f0e900694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f0eacc00640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x7f0e900707a0 0x7f0e90072be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:49.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f0eacc00640 1 -- 172.21.15.59:0/1692635163 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e900732b0 con 0x7f0e900707a0 2024-04-25T09:01:49.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f0eacc00640 1 -- 172.21.15.59:0/1692635163 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea8125300 con 0x7f0eb00d11b0 2024-04-25T09:01:49.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f56c2a00640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x7f56a40707e0 0x7f56a4072c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.784+0000 7f0eafe00640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x7f0e900707a0 0x7f0e90072be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:49.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.788+0000 7f0eb5200640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e90067030 0x7f0e900694f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00ab60 tx=0x7f0e9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.788+0000 7f56bb400640 1 -- 172.21.15.59:0/1230755038 <== osd.4 v2:172.21.15.178:6805/2278719369 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f56a40732f0 con 0x7f56a40707e0 2024-04-25T09:01:49.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.792+0000 7faf65600640 1 -- 172.21.15.59:0/2826570330 <== osd.5 v2:172.21.15.178:6802/3576783051 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7faf5c001d40 con 0x7faf480706e0 2024-04-25T09:01:49.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.792+0000 7f0eafe00640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x7f0e900707a0 0x7f0e90072be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:49.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83b80745d0 con 0x7f83980706b0 2024-04-25T09:01:49.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f0eacc00640 1 -- 172.21.15.59:0/1692635163 <== osd.2 v2:172.21.15.59:6824/4113007731 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0e900732b0 con 0x7f0e900707a0 2024-04-25T09:01:49.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83b5600640 1 -- 172.21.15.59:0/3946431382 <== osd.1 v2:172.21.15.59:6809/1450066050 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f83b80745d0 con 0x7f83980706b0 2024-04-25T09:01:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x7f83980706b0 msgr2=0x7f8398072af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83c0000640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x7f83980706b0 0x7f8398072af0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8398066fb0 msgr2=0x7f8398069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83c0000640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8398066fb0 0x7f8398069470 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f83b00012f0 tx=0x7f83b0009040 comp rx=0 tx=0).stop 2024-04-25T09:01:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b8161fc0 msgr2=0x7f83b81637d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83c0000640 1 --2- 172.21.15.59:0/3946431382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b8161fc0 0x7f83b81637d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f83a40af000 tx=0x7f83a401baf0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83be000640 1 -- 172.21.15.59:0/3946431382 reap_dead start 2024-04-25T09:01:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 shutdown_connections 2024-04-25T09:01:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 >> 172.21.15.59:0/3946431382 conn(0x7f83b806f510 msgr2=0x7f83b81605d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 shutdown_connections 2024-04-25T09:01:49.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.796+0000 7f83c0000640 1 -- 172.21.15.59:0/3946431382 wait complete. 2024-04-25T09:01:49.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f008fe00640 1 -- 172.21.15.59:0/1182724245 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f00880745d0 con 0x7f0068070660 2024-04-25T09:01:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f0085600640 1 -- 172.21.15.59:0/1182724245 <== osd.3 v2:172.21.15.59:6808/3810214969 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f00880745d0 con 0x7f0068070660 2024-04-25T09:01:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f008fe00640 1 -- 172.21.15.59:0/1182724245 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x7f0068070660 msgr2=0x7f0068072aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f008fe00640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x7f0068070660 0x7f0068072aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f008fe00640 1 -- 172.21.15.59:0/1182724245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0068066f60 msgr2=0x7f0068069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f008fe00640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0068066f60 0x7f0068069420 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f00740094a0 tx=0x7f00740093f0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f008fe00640 1 -- 172.21.15.59:0/1182724245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00880cedf0 msgr2=0x7f008815a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f008fe00640 1 --2- 172.21.15.59:0/1182724245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00880cedf0 0x7f008815a220 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f00800ae040 tx=0x7f00800191b0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f008de00640 1 -- 172.21.15.59:0/1182724245 reap_dead start 2024-04-25T09:01:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f008fe00640 1 -- 172.21.15.59:0/1182724245 shutdown_connections 2024-04-25T09:01:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f008fe00640 1 -- 172.21.15.59:0/1182724245 >> 172.21.15.59:0/1182724245 conn(0x7f008806b010 msgr2=0x7f0088154260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f008fe00640 1 -- 172.21.15.59:0/1182724245 shutdown_connections 2024-04-25T09:01:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.800+0000 7f008fe00640 1 -- 172.21.15.59:0/1182724245 wait complete. 2024-04-25T09:01:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.808+0000 7f5a81000640 1 -- 172.21.15.59:0/236892333 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5a7c072370 con 0x7f5a58071440 2024-04-25T09:01:49.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.808+0000 7f5a73400640 1 -- 172.21.15.59:0/236892333 <== osd.0 v2:172.21.15.59:6800/4129855307 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5a7c072370 con 0x7f5a58071440 2024-04-25T09:01:49.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f5a81000640 1 -- 172.21.15.59:0/236892333 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x7f5a58071440 msgr2=0x7f5a580738e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f3b32000640 1 -- 172.21.15.59:0/2910562844 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3b2c155700 con 0x7f3b080706b0 2024-04-25T09:01:49.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f5a81000640 1 --2- 172.21.15.59:0/236892333 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x7f5a58071440 0x7f5a580738e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f5a81000640 1 -- 172.21.15.59:0/236892333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5a58066fb0 msgr2=0x7f5a58069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f5a81000640 1 --2- 172.21.15.59:0/236892333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5a58066fb0 0x7f5a58069470 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c0ae000 tx=0x7f5a6c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:01:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f5a81000640 1 -- 172.21.15.59:0/236892333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a7c0cb8f0 msgr2=0x7f5a7c1689d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f5a81000640 1 --2- 172.21.15.59:0/236892333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a7c0cb8f0 0x7f5a7c1689d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400d830 tx=0x7f5a7400dcf0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f5a7be00640 1 -- 172.21.15.59:0/236892333 reap_dead start 2024-04-25T09:01:49.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f3b23400640 1 -- 172.21.15.59:0/2910562844 <== osd.7 v2:172.21.15.178:6824/965369534 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3b2c155700 con 0x7f3b080706b0 2024-04-25T09:01:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f5a81000640 1 -- 172.21.15.59:0/236892333 shutdown_connections 2024-04-25T09:01:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f5a81000640 1 -- 172.21.15.59:0/236892333 >> 172.21.15.59:0/236892333 conn(0x7f5a7c06ac10 msgr2=0x7f5a7c0b3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f3b32000640 1 -- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x7f3b080706b0 msgr2=0x7f3b08072af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f3b32000640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x7f3b080706b0 0x7f3b08072af0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.812+0000 7f5a81000640 1 -- 172.21.15.59:0/236892333 shutdown_connections 2024-04-25T09:01:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7f5a81000640 1 -- 172.21.15.59:0/236892333 wait complete. 2024-04-25T09:01:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7f3b32000640 1 -- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3b08066fb0 msgr2=0x7f3b08069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7f3b32000640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3b08066fb0 0x7f3b08069470 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00b9d0 tx=0x7f3b1c008040 comp rx=0 tx=0).stop 2024-04-25T09:01:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7f3b32000640 1 -- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b2c1598a0 msgr2=0x7f3b2c1f6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7f3b32000640 1 --2- 172.21.15.59:0/2910562844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b2c1598a0 0x7f3b2c1f6b90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3b1401a080 tx=0x7f3b140191f0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7f3b2be00640 1 -- 172.21.15.59:0/2910562844 reap_dead start 2024-04-25T09:01:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7f3b32000640 1 -- 172.21.15.59:0/2910562844 shutdown_connections 2024-04-25T09:01:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7f3b32000640 1 -- 172.21.15.59:0/2910562844 >> 172.21.15.59:0/2910562844 conn(0x7f3b2c06b010 msgr2=0x7f3b2c0ad1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7f3b32000640 1 -- 172.21.15.59:0/2910562844 shutdown_connections 2024-04-25T09:01:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7f3b32000640 1 -- 172.21.15.59:0/2910562844 wait complete. 2024-04-25T09:01:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf44002de0 con 0x7faf480706e0 2024-04-25T09:01:49.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7faf65600640 1 -- 172.21.15.59:0/2826570330 <== osd.5 v2:172.21.15.178:6802/3576783051 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faf44002de0 con 0x7faf480706e0 2024-04-25T09:01:49.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x7faf480706e0 msgr2=0x7faf48072b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7faf70600640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x7faf480706e0 0x7faf48072b20 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faf48066f60 msgr2=0x7faf48069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7faf70600640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faf48066f60 0x7faf48069420 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf680cc1d0 tx=0x7faf54008040 comp rx=0 tx=0).stop 2024-04-25T09:01:49.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf680b2cf0 msgr2=0x7faf680cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7faf70600640 1 --2- 172.21.15.59:0/2826570330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faf680b2cf0 0x7faf680cd540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7faf5c0ac040 tx=0x7faf5c01acf0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.816+0000 7faf6e600640 1 -- 172.21.15.59:0/2826570330 reap_dead start 2024-04-25T09:01:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.820+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 shutdown_connections 2024-04-25T09:01:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.820+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 >> 172.21.15.59:0/2826570330 conn(0x7faf680d04b0 msgr2=0x7faf680c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.820+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 shutdown_connections 2024-04-25T09:01:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.820+0000 7faf70600640 1 -- 172.21.15.59:0/2826570330 wait complete. 2024-04-25T09:01:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.820+0000 7f71d1600640 1 -- 172.21.15.59:0/3865063836 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f71cc1639e0 con 0x7f71a80706e0 2024-04-25T09:01:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.820+0000 7f56ca000640 1 -- 172.21.15.59:0/1230755038 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f56c40745d0 con 0x7f56a40707e0 2024-04-25T09:01:49.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.820+0000 7f71c2a00640 1 -- 172.21.15.59:0/3865063836 <== osd.6 v2:172.21.15.178:6800/2032393933 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f71cc1639e0 con 0x7f71a80706e0 2024-04-25T09:01:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f56bb400640 1 -- 172.21.15.59:0/1230755038 <== osd.4 v2:172.21.15.178:6805/2278719369 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f56c40745d0 con 0x7f56a40707e0 2024-04-25T09:01:49.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f71d1600640 1 -- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x7f71a80706e0 msgr2=0x7f71a8072b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f71d1600640 1 --2- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x7f71a80706e0 0x7f71a8072b20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f71d1600640 1 -- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f71a8066f60 msgr2=0x7f71a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f71d1600640 1 --2- 172.21.15.59:0/3865063836 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f71a8066f60 0x7f71a8069420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f71cc0b3d20 tx=0x7f71b4006f90 comp rx=0 tx=0).stop 2024-04-25T09:01:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f71d1600640 1 -- 172.21.15.59:0/3865063836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc0ae790 msgr2=0x7f71cc155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f71d1600640 1 --2- 172.21.15.59:0/3865063836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71cc0ae790 0x7f71cc155770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f71bc00e8c0 tx=0x7f71bc00ed80 comp rx=0 tx=0).stop 2024-04-25T09:01:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f71cb400640 1 -- 172.21.15.59:0/3865063836 reap_dead start 2024-04-25T09:01:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f56ca000640 1 -- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x7f56a40707e0 msgr2=0x7f56a4072c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f56ca000640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x7f56a40707e0 0x7f56a4072c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f56ca000640 1 -- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f56a4067160 msgr2=0x7f56a4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f56ca000640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f56a4067160 0x7f56a4069620 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f56b40011f0 tx=0x7f56b4009040 comp rx=0 tx=0).stop 2024-04-25T09:01:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f56ca000640 1 -- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56c415aa90 msgr2=0x7f56c40af120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f56ca000640 1 --2- 172.21.15.59:0/1230755038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56c415aa90 0x7f56c40af120 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f56bc0ac000 tx=0x7f56bc019660 comp rx=0 tx=0).stop 2024-04-25T09:01:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f56c3e00640 1 -- 172.21.15.59:0/1230755038 reap_dead start 2024-04-25T09:01:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f56ca000640 1 -- 172.21.15.59:0/1230755038 shutdown_connections 2024-04-25T09:01:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f56ca000640 1 -- 172.21.15.59:0/1230755038 >> 172.21.15.59:0/1230755038 conn(0x7f56c40b2240 msgr2=0x7f56c40cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f71d1600640 1 -- 172.21.15.59:0/3865063836 shutdown_connections 2024-04-25T09:01:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f71d1600640 1 -- 172.21.15.59:0/3865063836 >> 172.21.15.59:0/3865063836 conn(0x7f71cc0cc830 msgr2=0x7f71cc06d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f71d1600640 1 -- 172.21.15.59:0/3865063836 shutdown_connections 2024-04-25T09:01:49.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f71d1600640 1 -- 172.21.15.59:0/3865063836 wait complete. 2024-04-25T09:01:49.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f56ca000640 1 -- 172.21.15.59:0/1230755038 shutdown_connections 2024-04-25T09:01:49.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.824+0000 7f56ca000640 1 -- 172.21.15.59:0/1230755038 wait complete. 2024-04-25T09:01:49.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.828+0000 7f0ea6000640 1 -- 172.21.15.59:0/1692635163 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0eb015c100 con 0x7f0e900707a0 2024-04-25T09:01:49.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.828+0000 7f0eacc00640 1 -- 172.21.15.59:0/1692635163 <== osd.2 v2:172.21.15.59:6824/4113007731 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0eb015c100 con 0x7f0e900707a0 2024-04-25T09:01:49.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.828+0000 7f0ea6000640 1 -- 172.21.15.59:0/1692635163 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x7f0e900707a0 msgr2=0x7f0e90072be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.828+0000 7f0ea6000640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x7f0e900707a0 0x7f0e90072be0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.832+0000 7f0ea6000640 1 -- 172.21.15.59:0/1692635163 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e90067030 msgr2=0x7f0e900694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.832+0000 7f0ea6000640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e90067030 0x7f0e900694f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c00ab60 tx=0x7f0e9c008040 comp rx=0 tx=0).stop 2024-04-25T09:01:49.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.832+0000 7f0ea6000640 1 -- 172.21.15.59:0/1692635163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00d11b0 msgr2=0x7f0eb00b54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:49.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.832+0000 7f0ea6000640 1 --2- 172.21.15.59:0/1692635163 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0eb00d11b0 0x7f0eb00b54d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ea80b2040 tx=0x7f0ea801bfb0 comp rx=0 tx=0).stop 2024-04-25T09:01:49.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.832+0000 7f0eb5c00640 1 -- 172.21.15.59:0/1692635163 reap_dead start 2024-04-25T09:01:49.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.832+0000 7f0ea6000640 1 -- 172.21.15.59:0/1692635163 shutdown_connections 2024-04-25T09:01:49.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.832+0000 7f0ea6000640 1 -- 172.21.15.59:0/1692635163 >> 172.21.15.59:0/1692635163 conn(0x7f0eb006f510 msgr2=0x7f0eb0144a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:49.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.832+0000 7f0ea6000640 1 -- 172.21.15.59:0/1692635163 shutdown_connections 2024-04-25T09:01:49.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:49.832+0000 7f0ea6000640 1 -- 172.21.15.59:0/1692635163 wait complete. 2024-04-25T09:01:49.842 INFO:teuthology.orchestra.run.smithi059.stdout:55834574857 2024-04-25T09:01:49.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:01:49.843 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2024-04-25T09:01:49.843 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T09:01:49.844 INFO:teuthology.orchestra.run.smithi059.stdout:55834574857 2024-04-25T09:01:49.844 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:01:49.850 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2024-04-25T09:01:49.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T09:01:49.851 INFO:teuthology.orchestra.run.smithi059.stdout:55834574857 2024-04-25T09:01:49.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T09:01:49.853 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2024-04-25T09:01:49.854 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T09:01:49.854 INFO:teuthology.orchestra.run.smithi059.stdout:55834574857 2024-04-25T09:01:49.855 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T09:01:49.862 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2024-04-25T09:01:49.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T09:01:50.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.100+0000 7fb764000640 1 Processor -- start 2024-04-25T09:01:50.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.100+0000 7fb764000640 1 -- start start 2024-04-25T09:01:50.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7fb764000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7540ddca0 0x7fb754054c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7fb761600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7540ddca0 0x7fb754054c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7f2b86200640 1 Processor -- start 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7fb761600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7540ddca0 0x7fb754054c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46810/0 (socket says 172.21.15.59:46810) 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7fb760c00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fb7540e3ba0 0x7fb754034660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:35436/0 (socket says 172.21.15.59:35436) 2024-04-25T09:01:50.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7fb760c00640 1 -- 172.21.15.59:0/1478663307 learned_addr learned my addr 172.21.15.59:0/1478663307 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:50.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7fb764000640 1 --2- 172.21.15.59:0/1478663307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7540e4000 0x7fb754034d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7fb764000640 1 -- 172.21.15.59:0/1478663307 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb754050820 con 0x7fb7540e3ba0 2024-04-25T09:01:50.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7f2b86200640 1 -- start start 2024-04-25T09:01:50.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7fb764000640 1 -- 172.21.15.59:0/1478663307 --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7540e4a40 con 0x7fb7540ddca0 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7fb764000640 1 -- 172.21.15.59:0/1478663307 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75403ba90 con 0x7fb7540e4000 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7fb75be00640 1 -- 172.21.15.59:0/1478663307 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026339696 0 0) 0x7fb754050820 con 0x7fb7540e3ba0 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.104+0000 7fb75be00640 1 -- 172.21.15.59:0/1478663307 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb744003530 con 0x7fb7540e3ba0 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.108+0000 7fb761600640 1 -- 172.21.15.59:0/1478663307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7540e4000 msgr2=0x7fb754034d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.108+0000 7fb761600640 1 --2- 172.21.15.59:0/1478663307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7540e4000 0x7fb754034d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.108+0000 7fb761600640 1 -- 172.21.15.59:0/1478663307 >> v1:172.21.15.178:6789/0 conn(0x7fb7540e3ba0 legacy=0x7fb754034660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.108+0000 7fb761600640 1 -- 172.21.15.59:0/1478663307 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754050b00 con 0x7fb7540ddca0 2024-04-25T09:01:50.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.108+0000 7f2b86200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 0x7f2b8006e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.108+0000 7f2b86200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b800ce120 con 0x7f2b80159c80 2024-04-25T09:01:50.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.108+0000 7f2b86200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b800ce400 con 0x7f2b801598a0 2024-04-25T09:01:50.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.108+0000 7f2b86200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8006e810 con 0x7f2b8006f9a0 2024-04-25T09:01:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.108+0000 7f2b7f400640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2b801598a0 0x7f2b800cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:35450/0 (socket says 172.21.15.59:35450) 2024-04-25T09:01:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.108+0000 7f2b7f400640 1 -- 172.21.15.59:0/704013490 learned_addr learned my addr 172.21.15.59:0/704013490 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:50.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.108+0000 7f2b7fe00640 1 --2- 172.21.15.59:0/704013490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 0x7f2b8006e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7f2b7fe00640 1 -- 172.21.15.59:0/704013490 >> v1:172.21.15.178:6789/0 conn(0x7f2b801598a0 legacy=0x7f2b800cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7f2b7fe00640 1 -- 172.21.15.59:0/704013490 >> v1:172.21.15.59:6789/0 conn(0x7f2b80159c80 legacy=0x7f2b8006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7f2b7fe00640 1 -- 172.21.15.59:0/704013490 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b800ce6e0 con 0x7f2b8006f9a0 2024-04-25T09:01:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fd984600640 1 Processor -- start 2024-04-25T09:01:50.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fd984600640 1 -- start start 2024-04-25T09:01:50.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fb761600640 1 --2- 172.21.15.59:0/1478663307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7540ddca0 0x7fb754054c70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb7500097c0 tx=0x7fb75001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=372ae07c63455560 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7f28c1a00640 1 Processor -- start 2024-04-25T09:01:50.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fb75be00640 1 -- 172.21.15.59:0/1478663307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500b0070 con 0x7fb7540ddca0 2024-04-25T09:01:50.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fb75be00640 1 -- 172.21.15.59:0/1478663307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7500ab600 con 0x7fb7540ddca0 2024-04-25T09:01:50.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fb75be00640 1 -- 172.21.15.59:0/1478663307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7500b0070 con 0x7fb7540ddca0 2024-04-25T09:01:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7f28c1a00640 1 -- start start 2024-04-25T09:01:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fd984600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd97c0b3ea0 0x7fd97c0b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fd984600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd97c0725d0 0x7fd97c0716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fd984600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd97c1626f0 con 0x7fd97c071c00 2024-04-25T09:01:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fd984600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97c0b4280 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fd984600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c163020 con 0x7fd97c0725d0 2024-04-25T09:01:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fb764000640 1 -- 172.21.15.59:0/1478663307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7540ddca0 msgr2=0x7fb754054c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.112+0000 7fb764000640 1 --2- 172.21.15.59:0/1478663307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7540ddca0 0x7fb754054c70 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb7500097c0 tx=0x7fb75001c430 comp rx=0 tx=0).stop 2024-04-25T09:01:50.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fd981200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd97c0725d0 0x7fd97c0716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fd981200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd97c0725d0 0x7fd97c0716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:32776/0 (socket says 172.21.15.59:32776) 2024-04-25T09:01:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fd981200640 1 -- 172.21.15.59:0/3738462975 learned_addr learned my addr 172.21.15.59:0/3738462975 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fd981c00640 1 --2- 172.21.15.59:0/3738462975 >> v2:172.21.15.178:3300/0 conn(0x7fd97c0b3ea0 0x7fd97c0b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28c1a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28bc15db10 0x7f28bc0b9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28c1a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28bc0cee80 0x7f28bc0d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28c1a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28bc1617e0 con 0x7f28bc0b2cf0 2024-04-25T09:01:50.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28c1a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc0b60e0 con 0x7f28bc0cee80 2024-04-25T09:01:50.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28c1a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28bc1623f0 con 0x7f28bc15db10 2024-04-25T09:01:50.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fb764000640 1 -- 172.21.15.59:0/1478663307 shutdown_connections 2024-04-25T09:01:50.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fb764000640 1 --2- 172.21.15.59:0/1478663307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7540e4000 0x7fb754034d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fa66f600640 1 Processor -- start 2024-04-25T09:01:50.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fb764000640 1 --2- 172.21.15.59:0/1478663307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7540ddca0 0x7fb754054c70 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fb764000640 1 -- 172.21.15.59:0/1478663307 >> 172.21.15.59:0/1478663307 conn(0x7fb754055be0 msgr2=0x7fb754055ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28baa00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28bc15db10 0x7f28bc0b9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28baa00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f28bc15db10 0x7f28bc0b9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56776/0 (socket says 172.21.15.59:56776) 2024-04-25T09:01:50.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28baa00640 1 -- 172.21.15.59:0/2628146553 learned_addr learned my addr 172.21.15.59:0/2628146553 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:50.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f2b7fe00640 1 --2- 172.21.15.59:0/704013490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 0x7f2b8006e2d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009dc0 tx=0x7f2b7801c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=929ba1bb04c1d2fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fd981200640 1 -- 172.21.15.59:0/3738462975 >> v2:172.21.15.178:3300/0 conn(0x7fd97c0b3ea0 msgr2=0x7fd97c0b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:50.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fd981200640 1 --2- 172.21.15.59:0/3738462975 >> v2:172.21.15.178:3300/0 conn(0x7fd97c0b3ea0 0x7fd97c0b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fd981200640 1 -- 172.21.15.59:0/3738462975 >> v1:172.21.15.59:6789/0 conn(0x7fd97c071c00 legacy=0x7fd97c165ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:50.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fd981200640 1 -- 172.21.15.59:0/3738462975 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c1629d0 con 0x7fd97c0725d0 2024-04-25T09:01:50.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fb764000640 1 -- 172.21.15.59:0/1478663307 shutdown_connections 2024-04-25T09:01:50.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28bb400640 1 --2- 172.21.15.59:0/2628146553 >> v2:172.21.15.59:3300/0 conn(0x7f28bc0cee80 0x7f28bc0d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fb764000640 1 -- 172.21.15.59:0/1478663307 wait complete. 2024-04-25T09:01:50.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f2b7e000640 1 -- 172.21.15.59:0/704013490 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780b2070 con 0x7f2b8006f9a0 2024-04-25T09:01:50.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28b9600640 1 -- 172.21.15.59:0/2628146553 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302145205 0 0) 0x7f28bc1617e0 con 0x7f28bc0b2cf0 2024-04-25T09:01:50.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f2b7e000640 1 -- 172.21.15.59:0/704013490 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b780a5880 con 0x7f2b8006f9a0 2024-04-25T09:01:50.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f2b7e000640 1 -- 172.21.15.59:0/704013490 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b780a5c50 con 0x7f2b8006f9a0 2024-04-25T09:01:50.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28baa00640 1 -- 172.21.15.59:0/2628146553 >> v2:172.21.15.59:3300/0 conn(0x7f28bc0cee80 msgr2=0x7f28bc0d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:50.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28baa00640 1 --2- 172.21.15.59:0/2628146553 >> v2:172.21.15.59:3300/0 conn(0x7f28bc0cee80 0x7f28bc0d1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28baa00640 1 -- 172.21.15.59:0/2628146553 >> v1:172.21.15.178:6789/0 conn(0x7f28bc0b2cf0 legacy=0x7f28bc0ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28baa00640 1 -- 172.21.15.59:0/2628146553 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc161ac0 con 0x7f28bc15db10 2024-04-25T09:01:50.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f548f600640 1 Processor -- start 2024-04-25T09:01:50.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f28bb400640 1 --2- 172.21.15.59:0/2628146553 >> v2:172.21.15.59:3300/0 conn(0x7f28bc0cee80 0x7f28bc0d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:50.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f2b86200640 1 -- 172.21.15.59:0/704013490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 msgr2=0x7f2b8006e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f2b86200640 1 --2- 172.21.15.59:0/704013490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 0x7f2b8006e2d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009dc0 tx=0x7f2b7801c950 comp rx=0 tx=0).stop 2024-04-25T09:01:50.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f2b86200640 1 -- 172.21.15.59:0/704013490 shutdown_connections 2024-04-25T09:01:50.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f2b86200640 1 --2- 172.21.15.59:0/704013490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 0x7f2b8006e2d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f2b86200640 1 -- 172.21.15.59:0/704013490 >> 172.21.15.59:0/704013490 conn(0x7f2b8006b010 msgr2=0x7f2b8006b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f548f600640 1 -- start start 2024-04-25T09:01:50.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f2b86200640 1 -- 172.21.15.59:0/704013490 shutdown_connections 2024-04-25T09:01:50.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7fa66f600640 1 -- start start 2024-04-25T09:01:50.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f8e9f400640 1 Processor -- start 2024-04-25T09:01:50.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fb764000640 1 Processor -- start 2024-04-25T09:01:50.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fb764000640 1 -- start start 2024-04-25T09:01:50.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548f600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5488161e10 0x7f54881621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548f600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54880cf330 0x7f54880b89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.116+0000 7f2b86200640 1 -- 172.21.15.59:0/704013490 wait complete. 2024-04-25T09:01:50.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f2b86200640 1 Processor -- start 2024-04-25T09:01:50.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548f600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548806c0e0 0x7f548806c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548f600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54880d18a0 con 0x7f54880cf330 2024-04-25T09:01:50.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548f600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54880cf7f0 con 0x7f5488161e10 2024-04-25T09:01:50.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548f600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54880cfad0 con 0x7f548806c0e0 2024-04-25T09:01:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fa66f600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa6680b2dc0 0x7fa66806c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fa66f600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66806b110 con 0x7fa66806ac10 2024-04-25T09:01:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fa66f600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66806b3f0 con 0x7fa6680cd790 2024-04-25T09:01:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fa66f600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6680670b0 con 0x7fa6680b2dc0 2024-04-25T09:01:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fa66d600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa6680b2dc0 0x7fa66806c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fa66d600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa6680b2dc0 0x7fa66806c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56788/0 (socket says 172.21.15.59:56788) 2024-04-25T09:01:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fa66d600640 1 -- 172.21.15.59:0/1684525763 learned_addr learned my addr 172.21.15.59:0/1684525763 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:50.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f2b86200640 1 -- start start 2024-04-25T09:01:50.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fd981200640 1 --2- 172.21.15.59:0/3738462975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd97c0725d0 0x7fd97c0716c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd968009870 tx=0x7fd96801c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84be021399fee7d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548cc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5488161e10 0x7f54881621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548cc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5488161e10 0x7f54881621f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56778/0 (socket says 172.21.15.59:56778) 2024-04-25T09:01:50.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548cc00640 1 -- 172.21.15.59:0/795970574 learned_addr learned my addr 172.21.15.59:0/795970574 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:50.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548d600640 1 --2- 172.21.15.59:0/795970574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548806c0e0 0x7f548806c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f8e9f400640 1 -- start start 2024-04-25T09:01:50.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f8e9f400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8e98161f90 0x7f8e980aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fb764000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7540ddca0 0x7fb7540ce280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fb764000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7540e3ba0 0x7fb754035a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fb764000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7540e4000 0x7fb7540d4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fb764000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540551b0 con 0x7fb7540e4000 2024-04-25T09:01:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fb764000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7540352b0 con 0x7fb7540ddca0 2024-04-25T09:01:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fb764000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb754050440 con 0x7fb7540e3ba0 2024-04-25T09:01:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fb761600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7540ddca0 0x7fb7540ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548cc00640 1 -- 172.21.15.59:0/795970574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548806c0e0 msgr2=0x7f548806c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548cc00640 1 --2- 172.21.15.59:0/795970574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548806c0e0 0x7f548806c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548cc00640 1 -- 172.21.15.59:0/795970574 >> v2:172.21.15.59:3300/0 conn(0x7f54880cf330 msgr2=0x7f54880b89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548cc00640 1 --2- 172.21.15.59:0/795970574 >> v2:172.21.15.59:3300/0 conn(0x7f54880cf330 0x7f54880b89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f548cc00640 1 -- 172.21.15.59:0/795970574 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54880cfdb0 con 0x7f5488161e10 2024-04-25T09:01:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f8e9f400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980aeb70 con 0x7f8e980b34d0 2024-04-25T09:01:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f8e97e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8e980b34d0 0x7f8e98161880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41908/0 (socket says 172.21.15.59:41908) 2024-04-25T09:01:50.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fd97be00640 1 -- 172.21.15.59:0/3738462975 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680b0070 con 0x7fd97c0725d0 2024-04-25T09:01:50.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f8e97e00640 1 -- 172.21.15.59:0/943972336 learned_addr learned my addr 172.21.15.59:0/943972336 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:50.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f8e9d400640 1 --2- 172.21.15.59:0/943972336 >> v2:172.21.15.178:3300/0 conn(0x7f8e98161f90 0x7f8e980aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fd97be00640 1 -- 172.21.15.59:0/3738462975 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9680ab600 con 0x7fd97c0725d0 2024-04-25T09:01:50.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fd97be00640 1 -- 172.21.15.59:0/3738462975 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680ab9d0 con 0x7fd97c0725d0 2024-04-25T09:01:50.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f8e9f400640 1 -- 172.21.15.59:0/943972336 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980af630 con 0x7f8e980ae790 2024-04-25T09:01:50.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7f8e9f400640 1 -- 172.21.15.59:0/943972336 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9806bf50 con 0x7f8e98161f90 2024-04-25T09:01:50.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f548d600640 1 --2- 172.21.15.59:0/795970574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548806c0e0 0x7f548806c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:50.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fa667400640 1 -- 172.21.15.59:0/1684525763 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000202421 0 0) 0x7fa66806b3f0 con 0x7fa6680cd790 2024-04-25T09:01:50.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fa667400640 1 -- 172.21.15.59:0/1684525763 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa64c003530 con 0x7fa6680cd790 2024-04-25T09:01:50.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f28baa00640 1 --2- 172.21.15.59:0/2628146553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28bc15db10 0x7f28bc0b9350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f28bc08c160 tx=0x7f28b401c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6b44b9912d0f46b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fb762000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7540e4000 0x7fb7540d4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fb762000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7540e4000 0x7fb7540d4a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46844/0 (socket says 172.21.15.59:46844) 2024-04-25T09:01:50.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.120+0000 7fb762000640 1 -- 172.21.15.59:0/460573136 learned_addr learned my addr 172.21.15.59:0/460573136 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:50.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fb760c00640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7540e3ba0 0x7fb754035a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fa66d600640 1 -- 172.21.15.59:0/1684525763 >> v1:172.21.15.178:6789/0 conn(0x7fa6680cd790 legacy=0x7fa6680669a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fa66d600640 1 -- 172.21.15.59:0/1684525763 >> v1:172.21.15.59:6789/0 conn(0x7fa66806ac10 legacy=0x7fa66815a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f28b9600640 1 -- 172.21.15.59:0/2628146553 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40aa650 con 0x7f28bc15db10 2024-04-25T09:01:50.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f28b9600640 1 -- 172.21.15.59:0/2628146553 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b40af070 con 0x7f28bc15db10 2024-04-25T09:01:50.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f28b9600640 1 -- 172.21.15.59:0/2628146553 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b40aaa10 con 0x7f28bc15db10 2024-04-25T09:01:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fa66d600640 1 -- 172.21.15.59:0/1684525763 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66806b6d0 con 0x7fa6680b2dc0 2024-04-25T09:01:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fb762000640 1 -- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7540e3ba0 msgr2=0x7fb754035a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fb762000640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7540e3ba0 0x7fb754035a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fb762000640 1 -- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7540ddca0 msgr2=0x7fb7540ce280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fb762000640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7540ddca0 0x7fb7540ce280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fb762000640 1 -- 172.21.15.59:0/460573136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7540ce7c0 con 0x7fb7540e4000 2024-04-25T09:01:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fb762000640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7540e4000 0x7fb7540d4a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb75c074b80 tx=0x7fb75c068740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fd984600640 1 -- 172.21.15.59:0/3738462975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd97c0725d0 msgr2=0x7fd97c0716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fd984600640 1 --2- 172.21.15.59:0/3738462975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd97c0725d0 0x7fd97c0716c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd968009870 tx=0x7fd96801c520 comp rx=0 tx=0).stop 2024-04-25T09:01:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f8e97400640 1 -- 172.21.15.59:0/943972336 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601872826 0 0) 0x7f8e980af630 con 0x7f8e980ae790 2024-04-25T09:01:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f8e97400640 1 -- 172.21.15.59:0/943972336 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e7c003530 con 0x7f8e980ae790 2024-04-25T09:01:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f8e9d400640 1 -- 172.21.15.59:0/943972336 >> v1:172.21.15.178:6789/0 conn(0x7f8e980ae790 legacy=0x7f8e980b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f8e9d400640 1 -- 172.21.15.59:0/943972336 >> v1:172.21.15.59:6789/0 conn(0x7f8e980b34d0 legacy=0x7f8e98161880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f8e9d400640 1 -- 172.21.15.59:0/943972336 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9806b620 con 0x7f8e98161f90 2024-04-25T09:01:50.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f28c1a00640 1 -- 172.21.15.59:0/2628146553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28bc15db10 msgr2=0x7f28bc0b9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f28c1a00640 1 --2- 172.21.15.59:0/2628146553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28bc15db10 0x7f28bc0b9350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f28bc08c160 tx=0x7f28b401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b86200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 0x7f2b8016c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b86200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b801598a0 0x7f2b801562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fd984600640 1 -- 172.21.15.59:0/3738462975 shutdown_connections 2024-04-25T09:01:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fd984600640 1 --2- 172.21.15.59:0/3738462975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd97c0725d0 0x7fd97c0716c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fd984600640 1 --2- 172.21.15.59:0/3738462975 >> v2:172.21.15.178:3300/0 conn(0x7fd97c0b3ea0 0x7fd97c0b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fd984600640 1 -- 172.21.15.59:0/3738462975 >> 172.21.15.59:0/3738462975 conn(0x7fd97c0b17b0 msgr2=0x7fd97c0b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b86200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b80159c80 0x7f2b80156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b86200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b80167490 con 0x7f2b80159c80 2024-04-25T09:01:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b86200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b80167310 con 0x7f2b801598a0 2024-04-25T09:01:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b86200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b80167610 con 0x7f2b8006f9a0 2024-04-25T09:01:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7f400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 0x7f2b8016c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7ea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b801598a0 0x7f2b801562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7f400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 0x7f2b8016c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:32802/0 (socket says 172.21.15.59:32802) 2024-04-25T09:01:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7f400640 1 -- 172.21.15.59:0/2926215538 learned_addr learned my addr 172.21.15.59:0/2926215538 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:50.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7fe00640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b80159c80 0x7f2b80156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f28c1a00640 1 -- 172.21.15.59:0/2628146553 shutdown_connections 2024-04-25T09:01:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f28c1a00640 1 --2- 172.21.15.59:0/2628146553 >> v2:172.21.15.59:3300/0 conn(0x7f28bc0cee80 0x7f28bc0d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f28c1a00640 1 --2- 172.21.15.59:0/2628146553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28bc15db10 0x7f28bc0b9350 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f28c1a00640 1 -- 172.21.15.59:0/2628146553 >> 172.21.15.59:0/2628146553 conn(0x7f28bc0d04b0 msgr2=0x7f28bc0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7f400640 1 -- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b801598a0 msgr2=0x7f2b801562e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7f400640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b801598a0 0x7f2b801562e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7f400640 1 -- 172.21.15.59:0/2926215538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b80159c80 msgr2=0x7f2b80156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f28c1a00640 1 -- 172.21.15.59:0/2628146553 shutdown_connections 2024-04-25T09:01:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f28c1a00640 1 -- 172.21.15.59:0/2628146553 wait complete. 2024-04-25T09:01:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7f400640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b80159c80 0x7f2b80156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7f400640 1 -- 172.21.15.59:0/2926215538 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8016ce70 con 0x7f2b8006f9a0 2024-04-25T09:01:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7fe00640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b80159c80 0x7f2b80156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:50.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7ea00640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b801598a0 0x7f2b801562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:50.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7f2b7f400640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 0x7f2b8016c930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000c4a0 tx=0x7f2b7000c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fb759600640 1 -- 172.21.15.59:0/460573136 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c067fd0 con 0x7fb7540e4000 2024-04-25T09:01:50.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fb759600640 1 -- 172.21.15.59:0/460573136 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c073c30 con 0x7fb7540e4000 2024-04-25T09:01:50.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fb759600640 1 -- 172.21.15.59:0/460573136 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c093420 con 0x7fb7540e4000 2024-04-25T09:01:50.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fb764000640 1 -- 172.21.15.59:0/460573136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7540364c0 con 0x7fb7540e4000 2024-04-25T09:01:50.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.124+0000 7fd984600640 1 -- 172.21.15.59:0/3738462975 shutdown_connections 2024-04-25T09:01:50.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7fb764000640 1 -- 172.21.15.59:0/460573136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb754036a80 con 0x7fb7540e4000 2024-04-25T09:01:50.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f548cc00640 1 --2- 172.21.15.59:0/795970574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5488161e10 0x7f54881621f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f548808c620 tx=0x7f547c01ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d253cadfad1fa70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f2b77400640 1 -- 172.21.15.59:0/2926215538 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70017070 con 0x7f2b8006f9a0 2024-04-25T09:01:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f2b86200640 1 -- 172.21.15.59:0/2926215538 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b80154e70 con 0x7f2b8006f9a0 2024-04-25T09:01:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f2b86200640 1 -- 172.21.15.59:0/2926215538 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b801545d0 con 0x7f2b8006f9a0 2024-04-25T09:01:50.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f5487400640 1 -- 172.21.15.59:0/795970574 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0a5670 con 0x7f5488161e10 2024-04-25T09:01:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7fd984600640 1 -- 172.21.15.59:0/3738462975 wait complete. 2024-04-25T09:01:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7fa66d600640 1 --2- 172.21.15.59:0/1684525763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6680b2dc0 0x7fa66806c1b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa660009e50 tx=0x7fa66001c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffa42e34691e1109 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f2b77400640 1 -- 172.21.15.59:0/2926215538 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b70005cf0 con 0x7f2b8006f9a0 2024-04-25T09:01:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f5487400640 1 -- 172.21.15.59:0/795970574 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c0a5810 con 0x7f5488161e10 2024-04-25T09:01:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f5487400640 1 -- 172.21.15.59:0/795970574 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0a5be0 con 0x7f5488161e10 2024-04-25T09:01:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f28c1a00640 1 Processor -- start 2024-04-25T09:01:50.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f28c1a00640 1 -- start start 2024-04-25T09:01:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f8e9d400640 1 --2- 172.21.15.59:0/943972336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e98161f90 0x7f8e980aef50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009d90 tx=0x7f8e9001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fd80aa801e91997 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f2b77400640 1 -- 172.21.15.59:0/2926215538 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70017070 con 0x7f2b8006f9a0 2024-04-25T09:01:50.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f548f600640 1 -- 172.21.15.59:0/795970574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5488161e10 msgr2=0x7f54881621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7fb764000640 1 -- 172.21.15.59:0/460573136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7540057f0 con 0x7fb7540e4000 2024-04-25T09:01:50.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7fa667400640 1 -- 172.21.15.59:0/1684525763 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600a5720 con 0x7fa6680b2dc0 2024-04-25T09:01:50.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7fa667400640 1 -- 172.21.15.59:0/1684525763 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6600a58c0 con 0x7fa6680b2dc0 2024-04-25T09:01:50.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7fa667400640 1 -- 172.21.15.59:0/1684525763 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600a5720 con 0x7fa6680b2dc0 2024-04-25T09:01:50.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f2b86200640 1 -- 172.21.15.59:0/2926215538 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b580052a0 con 0x7f2b8006f9a0 2024-04-25T09:01:50.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f8e97400640 1 -- 172.21.15.59:0/943972336 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900b2070 con 0x7f8e98161f90 2024-04-25T09:01:50.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f548f600640 1 --2- 172.21.15.59:0/795970574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5488161e10 0x7f54881621f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f548808c620 tx=0x7f547c01ca10 comp rx=0 tx=0).stop 2024-04-25T09:01:50.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f8e97400640 1 -- 172.21.15.59:0/943972336 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e900a5830 con 0x7f8e98161f90 2024-04-25T09:01:50.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f8e97400640 1 -- 172.21.15.59:0/943972336 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900b2070 con 0x7f8e98161f90 2024-04-25T09:01:50.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f28c1a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28bc0b2cf0 0x7f28bc147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7fd984600640 1 Processor -- start 2024-04-25T09:01:50.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f28c1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28bc0cee80 0x7f28bc0b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f28c1a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28bc15db10 0x7f28bc0704d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7fa66f600640 1 -- 172.21.15.59:0/1684525763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6680b2dc0 msgr2=0x7fa66806c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7fa66f600640 1 --2- 172.21.15.59:0/1684525763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6680b2dc0 0x7fa66806c1b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa660009e50 tx=0x7fa66001c8c0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f548f600640 1 -- 172.21.15.59:0/795970574 shutdown_connections 2024-04-25T09:01:50.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f548f600640 1 --2- 172.21.15.59:0/795970574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548806c0e0 0x7f548806c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f548f600640 1 --2- 172.21.15.59:0/795970574 >> v2:172.21.15.59:3300/0 conn(0x7f54880cf330 0x7f54880b89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f548f600640 1 --2- 172.21.15.59:0/795970574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5488161e10 0x7f54881621f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f548f600640 1 -- 172.21.15.59:0/795970574 >> 172.21.15.59:0/795970574 conn(0x7f54880d3a30 msgr2=0x7f54880d3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f28c1a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0b9a10 con 0x7f28bc0cee80 2024-04-25T09:01:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f28c1a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0b9890 con 0x7f28bc15db10 2024-04-25T09:01:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f28c1a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28bc0d28e0 con 0x7f28bc0b2cf0 2024-04-25T09:01:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.128+0000 7f28bb400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28bc15db10 0x7f28bc0704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28bb400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28bc15db10 0x7f28bc0704d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56836/0 (socket says 172.21.15.59:56836) 2024-04-25T09:01:50.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28bb400640 1 -- 172.21.15.59:0/857442436 learned_addr learned my addr 172.21.15.59:0/857442436 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:50.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fa66f600640 1 -- 172.21.15.59:0/1684525763 shutdown_connections 2024-04-25T09:01:50.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f548f600640 1 -- 172.21.15.59:0/795970574 shutdown_connections 2024-04-25T09:01:50.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fa66f600640 1 --2- 172.21.15.59:0/1684525763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa6680b2dc0 0x7fa66806c1b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f548f600640 1 -- 172.21.15.59:0/795970574 wait complete. 2024-04-25T09:01:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fa66f600640 1 -- 172.21.15.59:0/1684525763 >> 172.21.15.59:0/1684525763 conn(0x7fa6680cc830 msgr2=0x7fa6680ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28baa00640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28bc0b2cf0 0x7f28bc147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f8e9f400640 1 -- 172.21.15.59:0/943972336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e98161f90 msgr2=0x7f8e980aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f8e9f400640 1 --2- 172.21.15.59:0/943972336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e98161f90 0x7f8e980aef50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009d90 tx=0x7f8e9001c970 comp rx=0 tx=0).stop 2024-04-25T09:01:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f2b77400640 1 -- 172.21.15.59:0/2926215538 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2b7001a070 con 0x7f2b8006f9a0 2024-04-25T09:01:50.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd984600640 1 -- start start 2024-04-25T09:01:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28bb400640 1 -- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28bc0b2cf0 msgr2=0x7f28bc147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f8e9f400640 1 -- 172.21.15.59:0/943972336 shutdown_connections 2024-04-25T09:01:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f8e9f400640 1 --2- 172.21.15.59:0/943972336 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e98161f90 0x7f8e980aef50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28bb400640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28bc0b2cf0 0x7f28bc147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28bb400640 1 -- 172.21.15.59:0/857442436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28bc0cee80 msgr2=0x7f28bc0b7e40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:01:50.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28bb400640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28bc0cee80 0x7f28bc0b7e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f8e9f400640 1 -- 172.21.15.59:0/943972336 >> 172.21.15.59:0/943972336 conn(0x7f8e980cc830 msgr2=0x7f8e980ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f8e9f400640 1 -- 172.21.15.59:0/943972336 shutdown_connections 2024-04-25T09:01:50.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28bb400640 1 -- 172.21.15.59:0/857442436 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28bc0c75c0 con 0x7f28bc15db10 2024-04-25T09:01:50.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f8e9f400640 1 -- 172.21.15.59:0/943972336 wait complete. 2024-04-25T09:01:50.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28bb400640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28bc15db10 0x7f28bc0704d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f28ac007ef0 tx=0x7f28ac00d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f2b77400640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2b60067360 0x7f2b60069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28b2a00640 1 -- 172.21.15.59:0/857442436 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac01a070 con 0x7f28bc15db10 2024-04-25T09:01:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fa66f600640 1 -- 172.21.15.59:0/1684525763 shutdown_connections 2024-04-25T09:01:50.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28b2a00640 1 -- 172.21.15.59:0/857442436 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac003ba0 con 0x7f28bc15db10 2024-04-25T09:01:50.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f2b77400640 1 -- 172.21.15.59:0/2926215538 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2b70005af0 con 0x7f2b8006f9a0 2024-04-25T09:01:50.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f2b7ea00640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2b60067360 0x7f2b60069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28b2a00640 1 -- 172.21.15.59:0/857442436 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac004030 con 0x7f28bc15db10 2024-04-25T09:01:50.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28c1a00640 1 -- 172.21.15.59:0/857442436 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28bc0c7860 con 0x7f28bc15db10 2024-04-25T09:01:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fb759600640 1 -- 172.21.15.59:0/460573136 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb75c0935e0 con 0x7fb7540e4000 2024-04-25T09:01:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f28c1a00640 1 -- 172.21.15.59:0/857442436 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28bc0c7e20 con 0x7f28bc15db10 2024-04-25T09:01:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fb759600640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb73c066f60 0x7fb73c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f2b7ea00640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2b60067360 0x7f2b60069820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2b800b2560 tx=0x7f2b6c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f548f600640 1 Processor -- start 2024-04-25T09:01:50.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd984600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd97c071c00 0x7fd97c14d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd984600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c0725d0 0x7fd97c1447e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd984600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd97c0b3ea0 0x7fd97c14f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd984600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c16ee70 con 0x7fd97c0725d0 2024-04-25T09:01:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd984600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c06e940 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd984600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97c16eff0 con 0x7fd97c071c00 2024-04-25T09:01:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd982600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd97c0b3ea0 0x7fd97c14f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd982600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd97c0b3ea0 0x7fd97c14f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56844/0 (socket says 172.21.15.59:56844) 2024-04-25T09:01:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd982600640 1 -- 172.21.15.59:0/3542042994 learned_addr learned my addr 172.21.15.59:0/3542042994 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:50.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7f548f600640 1 -- start start 2024-04-25T09:01:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd982600640 1 -- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd97c071c00 msgr2=0x7fd97c14d790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T09:01:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd982600640 1 --2- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd97c071c00 0x7fd97c14d790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd982600640 1 -- 172.21.15.59:0/3542042994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c0725d0 msgr2=0x7fd97c1447e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd982600640 1 --2- 172.21.15.59:0/3542042994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c0725d0 0x7fd97c1447e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fd982600640 1 -- 172.21.15.59:0/3542042994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97c14e280 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.132+0000 7fa66f600640 1 -- 172.21.15.59:0/1684525763 wait complete. 2024-04-25T09:01:50.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fa66f600640 1 Processor -- start 2024-04-25T09:01:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fb761600640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb73c066f60 0x7fb73c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9f400640 1 Processor -- start 2024-04-25T09:01:50.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f28c1a00640 1 -- 172.21.15.59:0/857442436 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28bc0d1740 con 0x7f28bc15db10 2024-04-25T09:01:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fa66f600640 1 -- start start 2024-04-25T09:01:50.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9f400640 1 -- start start 2024-04-25T09:01:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fd982600640 1 --2- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd97c0b3ea0 0x7fd97c14f320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd97400c780 tx=0x7fd97400cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e980ae790 0x7f8e981625a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f548f600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548806c0e0 0x7f548815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f548f600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54880cf330 0x7f54880cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f548f600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5488161e10 0x7f5488160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f548f600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54880cec20 con 0x7f5488161e10 2024-04-25T09:01:50.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f548f600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54880ceaa0 con 0x7f548806c0e0 2024-04-25T09:01:50.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f548f600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54880ceda0 con 0x7f54880cf330 2024-04-25T09:01:50.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9f400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e980b34d0 0x7f8e981571b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9f400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e98161f90 0x7f8e980acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9f400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9806c3c0 con 0x7f8e980ae790 2024-04-25T09:01:50.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9f400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980cecc0 con 0x7f8e980b34d0 2024-04-25T09:01:50.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9f400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9806c540 con 0x7f8e98161f90 2024-04-25T09:01:50.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f28b2a00640 1 -- 172.21.15.59:0/857442436 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f28ac01d070 con 0x7f28bc15db10 2024-04-25T09:01:50.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e97e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e980b34d0 0x7f8e981571b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fa66f600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66806ac10 0x7fa668158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e97e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e980b34d0 0x7f8e981571b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56846/0 (socket says 172.21.15.59:56846) 2024-04-25T09:01:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e97e00640 1 -- 172.21.15.59:0/398338144 learned_addr learned my addr 172.21.15.59:0/398338144 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9d400640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e98161f90 0x7f8e980acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f548cc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548806c0e0 0x7f548815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f548cc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548806c0e0 0x7f548815b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56856/0 (socket says 172.21.15.59:56856) 2024-04-25T09:01:50.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f548cc00640 1 -- 172.21.15.59:0/3154615507 learned_addr learned my addr 172.21.15.59:0/3154615507 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:50.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fa66f600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6680b2dc0 0x7fa66814a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fa66f600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6680aec50 0x7fa66814a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f5487e00640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54880cf330 0x7f54880cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f2b77400640 1 -- 172.21.15.59:0/2926215538 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2b70054650 con 0x7f2b8006f9a0 2024-04-25T09:01:50.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9d400640 1 -- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e980b34d0 msgr2=0x7f8e981571b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9d400640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e980b34d0 0x7f8e981571b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9d400640 1 -- 172.21.15.59:0/398338144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e980ae790 msgr2=0x7f8e981625a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9d400640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e980ae790 0x7f8e981625a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f8e9d400640 1 -- 172.21.15.59:0/398338144 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9815f690 con 0x7f8e98161f90 2024-04-25T09:01:50.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f28b2a00640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f289c067030 0x7f289c0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fa66cc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66806ac10 0x7fa668158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7f28b2a00640 1 -- 172.21.15.59:0/857442436 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f28ac085550 con 0x7f28bc15db10 2024-04-25T09:01:50.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fa66cc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66806ac10 0x7fa668158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56868/0 (socket says 172.21.15.59:56868) 2024-04-25T09:01:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fa66f600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66815ae60 con 0x7fa6680b2dc0 2024-04-25T09:01:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fa66f600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66806bc90 con 0x7fa66806ac10 2024-04-25T09:01:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fa66f600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66815afe0 con 0x7fa6680aec50 2024-04-25T09:01:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f548cc00640 1 -- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54880cf330 msgr2=0x7f54880cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f548cc00640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54880cf330 0x7f54880cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa66d600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6680aec50 0x7fa66814a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa66d600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6680aec50 0x7fa66814a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:32832/0 (socket says 172.21.15.59:32832) 2024-04-25T09:01:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f548cc00640 1 -- 172.21.15.59:0/3154615507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5488161e10 msgr2=0x7f5488160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f548cc00640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5488161e10 0x7f5488160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f548cc00640 1 -- 172.21.15.59:0/3154615507 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54880cb400 con 0x7f548806c0e0 2024-04-25T09:01:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa66cc00640 1 -- 172.21.15.59:0/1209826465 learned_addr learned my addr 172.21.15.59:0/1209826465 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:50.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f5487e00640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54880cf330 0x7f54880cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:50.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.136+0000 7fb761600640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb73c066f60 0x7fb73c069420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb7500ad000 tx=0x7fb7500a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fb759600640 1 -- 172.21.15.59:0/460573136 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb75c0cde90 con 0x7fb7540e4000 2024-04-25T09:01:50.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f8e9d400640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e98161f90 0x7f8e980acda0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8e900ac000 tx=0x7f8e90019710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fd979600640 1 -- 172.21.15.59:0/3542042994 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974004b70 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f28baa00640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f289c067030 0x7f289c0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fd979600640 1 -- 172.21.15.59:0/3542042994 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd974004d10 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fd979600640 1 -- 172.21.15.59:0/3542042994 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97400aa90 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f548cc00640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548806c0e0 0x7f548815b150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f547c0af040 tx=0x7f547c0197b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f8e94c00640 1 -- 172.21.15.59:0/398338144 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900bd030 con 0x7f8e98161f90 2024-04-25T09:01:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f8e94c00640 1 -- 172.21.15.59:0/398338144 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e900039a0 con 0x7f8e98161f90 2024-04-25T09:01:50.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f8e94c00640 1 -- 172.21.15.59:0/398338144 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900b2040 con 0x7f8e98161f90 2024-04-25T09:01:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa66d600640 1 -- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66806ac10 msgr2=0x7fa668158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa66d600640 1 --2- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66806ac10 0x7fa668158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa66d600640 1 -- 172.21.15.59:0/1209826465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6680b2dc0 msgr2=0x7fa66814a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa66d600640 1 --2- 172.21.15.59:0/1209826465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6680b2dc0 0x7fa66814a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa66d600640 1 -- 172.21.15.59:0/1209826465 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa668099b00 con 0x7fa6680aec50 2024-04-25T09:01:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f8e9f400640 1 -- 172.21.15.59:0/398338144 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e98162e80 con 0x7f8e98161f90 2024-04-25T09:01:50.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f8e9f400640 1 -- 172.21.15.59:0/398338144 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e98163440 con 0x7f8e98161f90 2024-04-25T09:01:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa66d600640 1 --2- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6680aec50 0x7fa66814a6f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa6600ab000 tx=0x7fa660019660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f28baa00640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f289c067030 0x7f289c0694f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f28b40ae000 tx=0x7f28b40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa664c00640 1 -- 172.21.15.59:0/1209826465 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600bd020 con 0x7fa6680aec50 2024-04-25T09:01:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fd984600640 1 -- 172.21.15.59:0/3542042994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97c14e560 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fd984600640 1 -- 172.21.15.59:0/3542042994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97c14eb20 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa66f600640 1 -- 172.21.15.59:0/1209826465 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66809d380 con 0x7fa6680aec50 2024-04-25T09:01:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa664c00640 1 -- 172.21.15.59:0/1209826465 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa660004260 con 0x7fa6680aec50 2024-04-25T09:01:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa664c00640 1 -- 172.21.15.59:0/1209826465 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa660009510 con 0x7fa6680aec50 2024-04-25T09:01:50.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa66f600640 1 -- 172.21.15.59:0/1209826465 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa668099da0 con 0x7fa6680aec50 2024-04-25T09:01:50.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fd984600640 1 -- 172.21.15.59:0/3542042994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97c0745d0 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7fa66f600640 1 -- 172.21.15.59:0/1209826465 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6680745d0 con 0x7fa6680aec50 2024-04-25T09:01:50.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.140+0000 7f8e94c00640 1 -- 172.21.15.59:0/398338144 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8e900c0070 con 0x7f8e98161f90 2024-04-25T09:01:50.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7f8e9f400640 1 -- 172.21.15.59:0/398338144 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e980745d0 con 0x7f8e98161f90 2024-04-25T09:01:50.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7f5484c00640 1 -- 172.21.15.59:0/3154615507 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0a5670 con 0x7f548806c0e0 2024-04-25T09:01:50.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7f8e94c00640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e78066f60 0x7f8e78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7f8e94c00640 1 -- 172.21.15.59:0/398338144 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8e9011fbb0 con 0x7f8e98161f90 2024-04-25T09:01:50.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7f28b2a00640 1 -- 172.21.15.59:0/857442436 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f28ac010070 con 0x7f28bc15db10 2024-04-25T09:01:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7f548f600640 1 -- 172.21.15.59:0/3154615507 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54880cb6e0 con 0x7f548806c0e0 2024-04-25T09:01:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7f548f600640 1 -- 172.21.15.59:0/3154615507 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54880cbca0 con 0x7f548806c0e0 2024-04-25T09:01:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7f5484c00640 1 -- 172.21.15.59:0/3154615507 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c0be070 con 0x7f548806c0e0 2024-04-25T09:01:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7f5484c00640 1 -- 172.21.15.59:0/3154615507 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c0b8ae0 con 0x7f548806c0e0 2024-04-25T09:01:50.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7f8e9ca00640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e78066f60 0x7f8e78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7fa664c00640 1 -- 172.21.15.59:0/1209826465 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa6600c0070 con 0x7fa6680aec50 2024-04-25T09:01:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7fa664c00640 1 --2- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa644066f60 0x7fa644069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7fa66cc00640 1 --2- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa644066f60 0x7fa644069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7fa664c00640 1 -- 172.21.15.59:0/1209826465 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fa66011fc10 con 0x7fa6680aec50 2024-04-25T09:01:50.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.148+0000 7f8e9ca00640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e78066f60 0x7f8e78069420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8e88007fd0 tx=0x7f8e88007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.148+0000 7fb759600640 1 -- 172.21.15.59:0/460573136 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb75c0d04f0 con 0x7fb7540e4000 2024-04-25T09:01:50.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.144+0000 7f548f600640 1 -- 172.21.15.59:0/3154615507 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54640052a0 con 0x7f548806c0e0 2024-04-25T09:01:50.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.148+0000 7fa66cc00640 1 --2- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa644066f60 0x7fa644069420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa6580011f0 tx=0x7fa658009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.148+0000 7fd979600640 1 -- 172.21.15.59:0/3542042994 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd97400ac30 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.148+0000 7fd979600640 1 --2- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd95c066fb0 0x7fd95c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.148+0000 7fd979600640 1 -- 172.21.15.59:0/3542042994 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd974086140 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.148+0000 7fd979600640 1 -- 172.21.15.59:0/3542042994 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd974056df0 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.148+0000 7fd981c00640 1 --2- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd95c066fb0 0x7fd95c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.152+0000 7f5484c00640 1 -- 172.21.15.59:0/3154615507 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f547c0b8c80 con 0x7f548806c0e0 2024-04-25T09:01:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.152+0000 7fd981c00640 1 --2- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd95c066fb0 0x7fd95c069470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd970009950 tx=0x7fd970009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.152+0000 7f5484c00640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5468066f60 0x7f5468069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.152+0000 7f5484c00640 1 -- 172.21.15.59:0/3154615507 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f547c121190 con 0x7f548806c0e0 2024-04-25T09:01:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.152+0000 7f8e94c00640 1 -- 172.21.15.59:0/398338144 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8e90016560 con 0x7f8e98161f90 2024-04-25T09:01:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.152+0000 7f5487e00640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5468066f60 0x7f5468069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.152+0000 7f5484c00640 1 -- 172.21.15.59:0/3154615507 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f547c016600 con 0x7f548806c0e0 2024-04-25T09:01:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.156+0000 7f5487e00640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5468066f60 0x7f5468069420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f548815be60 tx=0x7f5474009110 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.164+0000 7fa664c00640 1 -- 172.21.15.59:0/1209826465 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa660016540 con 0x7fa6680aec50 2024-04-25T09:01:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.168+0000 7f2884000640 1 Processor -- start 2024-04-25T09:01:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.168+0000 7f2884000640 1 -- start start 2024-04-25T09:01:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.168+0000 7f2884000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f287c159c80 0x7f287c06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.168+0000 7f2884000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f287c06f290 0x7f287c06f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.168+0000 7f2884000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c0ce120 con 0x7f287c1598a0 2024-04-25T09:01:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.168+0000 7f2884000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c06e810 con 0x7f287c06f290 2024-04-25T09:01:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.168+0000 7f2884000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0b3610 con 0x7f287c159c80 2024-04-25T09:01:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.168+0000 7f2881600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f287c1598a0 0x7f287c0cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41910/0 (socket says 172.21.15.59:41910) 2024-04-25T09:01:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.168+0000 7f2882000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f287c06f290 0x7f287c06f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.168+0000 7f2881600640 1 -- 172.21.15.59:0/3641703349 learned_addr learned my addr 172.21.15.59:0/3641703349 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.172+0000 7f2882000640 1 -- 172.21.15.59:0/3641703349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f287c159c80 msgr2=0x7f287c06e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.172+0000 7f2882000640 1 --2- 172.21.15.59:0/3641703349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f287c159c80 0x7f287c06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.172+0000 7f2882000640 1 -- 172.21.15.59:0/3641703349 >> v1:172.21.15.59:6789/0 conn(0x7f287c1598a0 legacy=0x7f287c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.172+0000 7f2882000640 1 -- 172.21.15.59:0/3641703349 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0ce400 con 0x7f287c06f290 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.176+0000 7f2882000640 1 --2- 172.21.15.59:0/3641703349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f287c06f290 0x7f287c06f720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f287400d460 tx=0x7f287401f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77cda7dade90ff3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.176+0000 7f287be00640 1 -- 172.21.15.59:0/3641703349 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28740b3070 con 0x7f287c06f290 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.176+0000 7f287be00640 1 -- 172.21.15.59:0/3641703349 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287400a2d0 con 0x7f287c06f290 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.176+0000 7f287be00640 1 -- 172.21.15.59:0/3641703349 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287400a6a0 con 0x7f287c06f290 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.180+0000 7f2884000640 1 -- 172.21.15.59:0/3641703349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f287c06f290 msgr2=0x7f287c06f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.180+0000 7f2884000640 1 --2- 172.21.15.59:0/3641703349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f287c06f290 0x7f287c06f720 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f287400d460 tx=0x7f287401f210 comp rx=0 tx=0).stop 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.180+0000 7f2884000640 1 -- 172.21.15.59:0/3641703349 shutdown_connections 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.180+0000 7f2884000640 1 --2- 172.21.15.59:0/3641703349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f287c06f290 0x7f287c06f720 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.180+0000 7f2884000640 1 --2- 172.21.15.59:0/3641703349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f287c159c80 0x7f287c06e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.180+0000 7f2884000640 1 -- 172.21.15.59:0/3641703349 >> 172.21.15.59:0/3641703349 conn(0x7f287c06b010 msgr2=0x7f287c06b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.180+0000 7f2884000640 1 -- 172.21.15.59:0/3641703349 shutdown_connections 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.180+0000 7f2884000640 1 -- 172.21.15.59:0/3641703349 wait complete. 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2884000640 1 Processor -- start 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2884000640 1 -- start start 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2884000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f287c06f290 0x7f287c0af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2884000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f287c1598a0 0x7f287c13e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2881600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f287c06f290 0x7f287c0af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2881600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f287c06f290 0x7f287c0af750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56872/0 (socket says 172.21.15.59:56872) 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2884000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f287c159c80 0x7f287c13ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2880c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f287c1598a0 0x7f287c13e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2880c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f287c1598a0 0x7f287c13e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:32844/0 (socket says 172.21.15.59:32844) 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2882000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f287c159c80 0x7f287c13ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2882000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f287c159c80 0x7f287c13ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46912/0 (socket says 172.21.15.59:46912) 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2881600640 1 -- 172.21.15.59:0/2299180355 learned_addr learned my addr 172.21.15.59:0/2299180355 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0cf1c0 con 0x7f287c159c80 2024-04-25T09:01:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c0b2e10 con 0x7f287c06f290 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.184+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c13f3d0 con 0x7f287c1598a0 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.188+0000 7f2882000640 1 -- 172.21.15.59:0/2299180355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f287c1598a0 msgr2=0x7f287c13e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.188+0000 7f2882000640 1 --2- 172.21.15.59:0/2299180355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f287c1598a0 0x7f287c13e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.188+0000 7f2882000640 1 -- 172.21.15.59:0/2299180355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f287c06f290 msgr2=0x7f287c0af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.188+0000 7f2882000640 1 --2- 172.21.15.59:0/2299180355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f287c06f290 0x7f287c0af750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.188+0000 7f2882000640 1 -- 172.21.15.59:0/2299180355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c1556c0 con 0x7f287c159c80 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.188+0000 7f2882000640 1 --2- 172.21.15.59:0/2299180355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f287c159c80 0x7f287c13ee90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f28740ad000 tx=0x7f287401bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.188+0000 7f2879600640 1 -- 172.21.15.59:0/2299180355 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28740de070 con 0x7f287c159c80 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.188+0000 7f2879600640 1 -- 172.21.15.59:0/2299180355 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28740d5040 con 0x7f287c159c80 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.188+0000 7f2879600640 1 -- 172.21.15.59:0/2299180355 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28740aea30 con 0x7f287c159c80 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.188+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c14b2d0 con 0x7f287c159c80 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.192+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c14b890 con 0x7f287c159c80 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.192+0000 7f2879600640 1 -- 172.21.15.59:0/2299180355 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f28740aebd0 con 0x7f287c159c80 2024-04-25T09:01:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.192+0000 7f2879600640 1 --2- 172.21.15.59:0/2299180355 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f285c066fb0 0x7f285c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.192+0000 7f2881600640 1 --2- 172.21.15.59:0/2299180355 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f285c066fb0 0x7f285c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.196+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c0745d0 con 0x7f287c159c80 2024-04-25T09:01:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.200+0000 7f2881600640 1 --2- 172.21.15.59:0/2299180355 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f285c066fb0 0x7f285c069470 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2870005890 tx=0x7f2870009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.200+0000 7f2879600640 1 -- 172.21.15.59:0/2299180355 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2874002020 con 0x7f287c159c80 2024-04-25T09:01:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.204+0000 7f2879600640 1 -- 172.21.15.59:0/2299180355 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2874018e00 con 0x7f287c159c80 2024-04-25T09:01:50.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.484+0000 7f28c1a00640 1 -- 172.21.15.59:0/857442436 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f28bc0b54f0 con 0x7f28bc15db10 2024-04-25T09:01:50.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.488+0000 7f28b2a00640 1 -- 172.21.15.59:0/857442436 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f28ac055c40 con 0x7f28bc15db10 2024-04-25T09:01:50.480 INFO:teuthology.orchestra.run.smithi059.stdout:55834574855 2024-04-25T09:01:50.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.488+0000 7f2b86200640 1 -- 172.21.15.59:0/2926215538 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2b58005590 con 0x7f2b8006f9a0 2024-04-25T09:01:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.492+0000 7f28c1a00640 1 -- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f289c067030 msgr2=0x7f289c0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.492+0000 7f28c1a00640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f289c067030 0x7f289c0694f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f28b40ae000 tx=0x7f28b40a7000 comp rx=0 tx=0).stop 2024-04-25T09:01:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.492+0000 7f28c1a00640 1 -- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28bc15db10 msgr2=0x7f28bc0704d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.492+0000 7f28c1a00640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28bc15db10 0x7f28bc0704d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f28ac007ef0 tx=0x7f28ac00d4a0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.492+0000 7f2b77400640 1 -- 172.21.15.59:0/2926215538 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b700586f0 con 0x7f2b8006f9a0 2024-04-25T09:01:50.483 INFO:teuthology.orchestra.run.smithi059.stdout:55834574856 2024-04-25T09:01:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.492+0000 7f28c1a00640 1 -- 172.21.15.59:0/857442436 shutdown_connections 2024-04-25T09:01:50.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.492+0000 7f28c1a00640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f289c067030 0x7f289c0694f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.492+0000 7f28c1a00640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28bc15db10 0x7f28bc0704d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.492+0000 7f28c1a00640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28bc0cee80 0x7f28bc0b7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.492+0000 7f28c1a00640 1 --2- 172.21.15.59:0/857442436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28bc0b2cf0 0x7f28bc147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.492+0000 7f28c1a00640 1 -- 172.21.15.59:0/857442436 >> 172.21.15.59:0/857442436 conn(0x7f28bc0d04b0 msgr2=0x7f28bc0b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.492+0000 7f28c1a00640 1 -- 172.21.15.59:0/857442436 shutdown_connections 2024-04-25T09:01:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f28c1a00640 1 -- 172.21.15.59:0/857442436 wait complete. 2024-04-25T09:01:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f2b86200640 1 -- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2b60067360 msgr2=0x7f2b60069820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f2b86200640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2b60067360 0x7f2b60069820 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2b800b2560 tx=0x7f2b6c009040 comp rx=0 tx=0).stop 2024-04-25T09:01:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f2b86200640 1 -- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 msgr2=0x7f2b8016c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f2b86200640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 0x7f2b8016c930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2b7000c4a0 tx=0x7f2b7000c960 comp rx=0 tx=0).stop 2024-04-25T09:01:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f2b86200640 1 -- 172.21.15.59:0/2926215538 shutdown_connections 2024-04-25T09:01:50.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f548f600640 1 -- 172.21.15.59:0/3154615507 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5464005860 con 0x7f548806c0e0 2024-04-25T09:01:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f2b86200640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2b60067360 0x7f2b60069820 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f2b86200640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b80159c80 0x7f2b80156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f2b86200640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2b801598a0 0x7f2b801562e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f5484c00640 1 -- 172.21.15.59:0/3154615507 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f547c0f1e50 con 0x7f548806c0e0 2024-04-25T09:01:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f2b86200640 1 --2- 172.21.15.59:0/2926215538 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2b8006f9a0 0x7f2b8016c930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f2b86200640 1 -- 172.21.15.59:0/2926215538 >> 172.21.15.59:0/2926215538 conn(0x7f2b8006b010 msgr2=0x7f2b800cd940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f2b86200640 1 -- 172.21.15.59:0/2926215538 shutdown_connections 2024-04-25T09:01:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f2b86200640 1 -- 172.21.15.59:0/2926215538 wait complete. 2024-04-25T09:01:50.488 INFO:teuthology.orchestra.run.smithi059.stdout:55834574855 2024-04-25T09:01:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7fd984600640 1 -- 172.21.15.59:0/3542042994 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd97c16cc40 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f8e9f400640 1 -- 172.21.15.59:0/398338144 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8e981637e0 con 0x7f8e98161f90 2024-04-25T09:01:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7fd979600640 1 -- 172.21.15.59:0/3542042994 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9740566f0 con 0x7fd97c0b3ea0 2024-04-25T09:01:50.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.496+0000 7f8e94c00640 1 -- 172.21.15.59:0/398338144 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8e900c13b0 con 0x7f8e98161f90 2024-04-25T09:01:50.489 INFO:teuthology.orchestra.run.smithi059.stdout:55834574856 2024-04-25T09:01:50.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fb764000640 1 -- 172.21.15.59:0/460573136 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb754053af0 con 0x7fb7540e4000 2024-04-25T09:01:50.490 INFO:teuthology.orchestra.run.smithi059.stdout:55834574855 2024-04-25T09:01:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fd984600640 1 -- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd95c066fb0 msgr2=0x7fd95c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fd984600640 1 --2- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd95c066fb0 0x7fd95c069470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd970009950 tx=0x7fd970009190 comp rx=0 tx=0).stop 2024-04-25T09:01:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fd984600640 1 -- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd97c0b3ea0 msgr2=0x7fd97c14f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fd984600640 1 --2- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd97c0b3ea0 0x7fd97c14f320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd97400c780 tx=0x7fd97400cc40 comp rx=0 tx=0).stop 2024-04-25T09:01:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fd984600640 1 -- 172.21.15.59:0/3542042994 shutdown_connections 2024-04-25T09:01:50.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fd984600640 1 --2- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd95c066fb0 0x7fd95c069470 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fd984600640 1 --2- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd97c0b3ea0 0x7fd97c14f320 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fd984600640 1 --2- 172.21.15.59:0/3542042994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd97c0725d0 0x7fd97c1447e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fd984600640 1 --2- 172.21.15.59:0/3542042994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd97c071c00 0x7fd97c14d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f548f600640 1 -- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5468066f60 msgr2=0x7f5468069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f548f600640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5468066f60 0x7f5468069420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f548815be60 tx=0x7f5474009110 comp rx=0 tx=0).stop 2024-04-25T09:01:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f548f600640 1 -- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548806c0e0 msgr2=0x7f548815b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f548f600640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548806c0e0 0x7f548815b150 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f547c0af040 tx=0x7f547c0197b0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fd984600640 1 -- 172.21.15.59:0/3542042994 >> 172.21.15.59:0/3542042994 conn(0x7fd97c0b17b0 msgr2=0x7fd97c0cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f548f600640 1 -- 172.21.15.59:0/3154615507 shutdown_connections 2024-04-25T09:01:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f548f600640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5468066f60 0x7f5468069420 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f548f600640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5488161e10 0x7f5488160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f548f600640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54880cf330 0x7f54880cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f548f600640 1 --2- 172.21.15.59:0/3154615507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548806c0e0 0x7f548815b150 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f547c0af040 tx=0x7f547c0197b0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f548f600640 1 -- 172.21.15.59:0/3154615507 >> 172.21.15.59:0/3154615507 conn(0x7f54880d3a30 msgr2=0x7f54880d2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fb759600640 1 -- 172.21.15.59:0/460573136 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb75c0cfdf0 con 0x7fb7540e4000 2024-04-25T09:01:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f548f600640 1 -- 172.21.15.59:0/3154615507 shutdown_connections 2024-04-25T09:01:50.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f548f600640 1 -- 172.21.15.59:0/3154615507 wait complete. 2024-04-25T09:01:50.494 INFO:teuthology.orchestra.run.smithi059.stdout:55834574855 2024-04-25T09:01:50.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fd984600640 1 -- 172.21.15.59:0/3542042994 shutdown_connections 2024-04-25T09:01:50.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7fd984600640 1 -- 172.21.15.59:0/3542042994 wait complete. 2024-04-25T09:01:50.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f8e9f400640 1 -- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e78066f60 msgr2=0x7f8e78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f8e9f400640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e78066f60 0x7f8e78069420 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8e88007fd0 tx=0x7f8e88007900 comp rx=0 tx=0).stop 2024-04-25T09:01:50.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f8e9f400640 1 -- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e98161f90 msgr2=0x7f8e980acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.500+0000 7f8e9f400640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e98161f90 0x7f8e980acda0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8e900ac000 tx=0x7f8e90019710 comp rx=0 tx=0).stop 2024-04-25T09:01:50.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.504+0000 7f8e9f400640 1 -- 172.21.15.59:0/398338144 shutdown_connections 2024-04-25T09:01:50.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.504+0000 7f8e9f400640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e78066f60 0x7f8e78069420 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.504+0000 7f8e9f400640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e98161f90 0x7f8e980acda0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.504+0000 7f8e9f400640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e980b34d0 0x7f8e981571b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.504+0000 7f8e9f400640 1 --2- 172.21.15.59:0/398338144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e980ae790 0x7f8e981625a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.504+0000 7f8e9f400640 1 -- 172.21.15.59:0/398338144 >> 172.21.15.59:0/398338144 conn(0x7f8e980cc830 msgr2=0x7f8e980b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7fb764000640 1 -- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb73c066f60 msgr2=0x7fb73c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7fb764000640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb73c066f60 0x7fb73c069420 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb7500ad000 tx=0x7fb7500a6000 comp rx=0 tx=0).stop 2024-04-25T09:01:50.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7fb764000640 1 -- 172.21.15.59:0/460573136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7540e4000 msgr2=0x7fb7540d4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7fb764000640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7540e4000 0x7fb7540d4a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb75c074b80 tx=0x7fb75c068740 comp rx=0 tx=0).stop 2024-04-25T09:01:50.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7f8e9f400640 1 -- 172.21.15.59:0/398338144 shutdown_connections 2024-04-25T09:01:50.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7f8e9f400640 1 -- 172.21.15.59:0/398338144 wait complete. 2024-04-25T09:01:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7fb764000640 1 -- 172.21.15.59:0/460573136 shutdown_connections 2024-04-25T09:01:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7fb764000640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb73c066f60 0x7fb73c069420 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7fb764000640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7540e4000 0x7fb7540d4a20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7fb764000640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb7540e3ba0 0x7fb754035a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7fb764000640 1 --2- 172.21.15.59:0/460573136 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7540ddca0 0x7fb7540ce280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7fb764000640 1 -- 172.21.15.59:0/460573136 >> 172.21.15.59:0/460573136 conn(0x7fb754055be0 msgr2=0x7fb7540e18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7fb764000640 1 -- 172.21.15.59:0/460573136 shutdown_connections 2024-04-25T09:01:50.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.508+0000 7fb764000640 1 -- 172.21.15.59:0/460573136 wait complete. 2024-04-25T09:01:50.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.512+0000 7fa66f600640 1 -- 172.21.15.59:0/1209826465 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa668099f70 con 0x7fa6680aec50 2024-04-25T09:01:50.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.512+0000 7fa664c00640 1 -- 172.21.15.59:0/1209826465 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa6600f6090 con 0x7fa6680aec50 2024-04-25T09:01:50.503 INFO:teuthology.orchestra.run.smithi059.stdout:55834574856 2024-04-25T09:01:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.516+0000 7fa66f600640 1 -- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa644066f60 msgr2=0x7fa644069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.516+0000 7fa66f600640 1 --2- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa644066f60 0x7fa644069420 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa6580011f0 tx=0x7fa658009040 comp rx=0 tx=0).stop 2024-04-25T09:01:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.516+0000 7fa66f600640 1 -- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6680aec50 msgr2=0x7fa66814a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.516+0000 7fa66f600640 1 --2- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6680aec50 0x7fa66814a6f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa6600ab000 tx=0x7fa660019660 comp rx=0 tx=0).stop 2024-04-25T09:01:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.516+0000 7fa66f600640 1 -- 172.21.15.59:0/1209826465 shutdown_connections 2024-04-25T09:01:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.516+0000 7fa66f600640 1 --2- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa644066f60 0x7fa644069420 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.516+0000 7fa66f600640 1 --2- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa6680aec50 0x7fa66814a6f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.516+0000 7fa66f600640 1 --2- 172.21.15.59:0/1209826465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6680b2dc0 0x7fa66814a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.516+0000 7fa66f600640 1 --2- 172.21.15.59:0/1209826465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66806ac10 0x7fa668158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.516+0000 7fa66f600640 1 -- 172.21.15.59:0/1209826465 >> 172.21.15.59:0/1209826465 conn(0x7fa6680cc830 msgr2=0x7fa6680b4130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.516+0000 7fa66f600640 1 -- 172.21.15.59:0/1209826465 shutdown_connections 2024-04-25T09:01:50.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.516+0000 7fa66f600640 1 -- 172.21.15.59:0/1209826465 wait complete. 2024-04-25T09:01:50.525 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.6 2024-04-25T09:01:50.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.3 2024-04-25T09:01:50.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.544+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f287c15d1d0 con 0x7f287c159c80 2024-04-25T09:01:50.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.544+0000 7f2879600640 1 -- 172.21.15.59:0/2299180355 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2874018e00 con 0x7f287c159c80 2024-04-25T09:01:50.535 INFO:teuthology.orchestra.run.smithi059.stdout:55834574856 2024-04-25T09:01:50.536 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.0 2024-04-25T09:01:50.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.548+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f285c066fb0 msgr2=0x7f285c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.548+0000 7f2884000640 1 --2- 172.21.15.59:0/2299180355 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f285c066fb0 0x7f285c069470 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2870005890 tx=0x7f2870009040 comp rx=0 tx=0).stop 2024-04-25T09:01:50.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.548+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f287c159c80 msgr2=0x7f287c13ee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:50.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.548+0000 7f2884000640 1 --2- 172.21.15.59:0/2299180355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f287c159c80 0x7f287c13ee90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f28740ad000 tx=0x7f287401bfb0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.548+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 shutdown_connections 2024-04-25T09:01:50.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.548+0000 7f2884000640 1 --2- 172.21.15.59:0/2299180355 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f285c066fb0 0x7f285c069470 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.548+0000 7f2884000640 1 --2- 172.21.15.59:0/2299180355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f287c159c80 0x7f287c13ee90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.548+0000 7f2884000640 1 --2- 172.21.15.59:0/2299180355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f287c1598a0 0x7f287c13e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.548+0000 7f2884000640 1 --2- 172.21.15.59:0/2299180355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f287c06f290 0x7f287c0af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.548+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 >> 172.21.15.59:0/2299180355 conn(0x7f287c06b010 msgr2=0x7f287c156ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.548+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 shutdown_connections 2024-04-25T09:01:50.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:50.548+0000 7f2884000640 1 -- 172.21.15.59:0/2299180355 wait complete. 2024-04-25T09:01:50.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.5 2024-04-25T09:01:50.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2024-04-25T09:01:50.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.7 2024-04-25T09:01:50.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.4 2024-04-25T09:01:50.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.2 2024-04-25T09:01:51.527 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T09:01:51.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T09:01:51.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T09:01:51.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T09:01:51.567 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T09:01:51.567 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T09:01:51.567 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T09:01:51.568 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T09:01:51.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.836+0000 7ff9cf200640 1 Processor -- start 2024-04-25T09:01:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.836+0000 7ff9cf200640 1 -- start start 2024-04-25T09:01:51.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7ff9cf200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff9d00b1e20 0x7ff9d0150660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7ff9cf200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d015d5d0 con 0x7ff9d00aee40 2024-04-25T09:01:51.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7ff9ce800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff9d00aee40 0x7ff9d015a330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37606/0 (socket says 172.21.15.59:37606) 2024-04-25T09:01:51.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7ff9ce800640 1 -- 172.21.15.59:0/4008732678 learned_addr learned my addr 172.21.15.59:0/4008732678 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:51.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7ff9cf200640 1 -- 172.21.15.59:0/4008732678 --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d015d8b0 con 0x7ff9d0150ba0 2024-04-25T09:01:51.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7ff9cf200640 1 -- 172.21.15.59:0/4008732678 --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d0071c20 con 0x7ff9d00b1e20 2024-04-25T09:01:51.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7ff9cde00640 1 --2- 172.21.15.59:0/4008732678 >> v2:172.21.15.178:3300/0 conn(0x7ff9d00b1e20 0x7ff9d0150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7f1e66600640 1 Processor -- start 2024-04-25T09:01:51.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7ff9cca00640 1 -- 172.21.15.59:0/4008732678 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3439691469 0 0) 0x7ff9d015d8b0 con 0x7ff9d0150ba0 2024-04-25T09:01:51.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7ff9cca00640 1 -- 172.21.15.59:0/4008732678 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9b4003530 con 0x7ff9d0150ba0 2024-04-25T09:01:51.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7f1e66600640 1 -- start start 2024-04-25T09:01:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7fbc33a00640 1 Processor -- start 2024-04-25T09:01:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7fbc33a00640 1 -- start start 2024-04-25T09:01:51.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e66600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e6015c710 0x7f1e60163040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e66600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e60163610 0x7f1e60071270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e66600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e600cd470 con 0x7f1e6015c330 2024-04-25T09:01:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e66600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e600af0e0 con 0x7f1e6015c710 2024-04-25T09:01:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e66600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6006e350 con 0x7f1e60163610 2024-04-25T09:01:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e5f400640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f1e6015c330 0x7f1e6006d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:45652/0 (socket says 172.21.15.59:45652) 2024-04-25T09:01:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e5f400640 1 -- 172.21.15.59:0/2854649269 learned_addr learned my addr 172.21.15.59:0/2854649269 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e5fe00640 1 --2- 172.21.15.59:0/2854649269 >> v2:172.21.15.178:3300/0 conn(0x7f1e60163610 0x7f1e60071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e5ea00640 1 --2- 172.21.15.59:0/2854649269 >> v2:172.21.15.59:3300/0 conn(0x7f1e6015c710 0x7f1e60163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e5fe00640 1 -- 172.21.15.59:0/2854649269 >> v2:172.21.15.59:3300/0 conn(0x7f1e6015c710 msgr2=0x7f1e60163040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:51.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e5fe00640 1 --2- 172.21.15.59:0/2854649269 >> v2:172.21.15.59:3300/0 conn(0x7f1e6015c710 0x7f1e60163040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e5fe00640 1 -- 172.21.15.59:0/2854649269 >> v1:172.21.15.178:6789/0 conn(0x7f1e6015c330 legacy=0x7f1e6006d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f1e5fe00640 1 -- 172.21.15.59:0/2854649269 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60163a60 con 0x7f1e60163610 2024-04-25T09:01:51.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7ff9cde00640 1 -- 172.21.15.59:0/4008732678 >> v1:172.21.15.178:6789/0 conn(0x7ff9d0150ba0 legacy=0x7ff9d00ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7ff9cde00640 1 -- 172.21.15.59:0/4008732678 >> v1:172.21.15.59:6789/0 conn(0x7ff9d00aee40 legacy=0x7ff9d015a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:51.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.840+0000 7ff9cde00640 1 -- 172.21.15.59:0/4008732678 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d015db90 con 0x7ff9d00b1e20 2024-04-25T09:01:51.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f09cbe00640 1 Processor -- start 2024-04-25T09:01:51.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc33a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbc2c071270 0x7fbc2c06e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7f09cbe00640 1 -- start start 2024-04-25T09:01:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc33a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc2c159c80 0x7fbc2c06f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc33a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2c0ce120 con 0x7fbc2c1598a0 2024-04-25T09:01:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc33a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2c06e810 con 0x7fbc2c071270 2024-04-25T09:01:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc33a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0ce400 con 0x7fbc2c159c80 2024-04-25T09:01:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc31000640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fbc2c1598a0 0x7fbc2c0cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:45656/0 (socket says 172.21.15.59:45656) 2024-04-25T09:01:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc31000640 1 -- 172.21.15.59:0/1946611701 learned_addr learned my addr 172.21.15.59:0/1946611701 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc2be00640 1 --2- 172.21.15.59:0/1946611701 >> v2:172.21.15.178:3300/0 conn(0x7fbc2c071270 0x7fbc2c06e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc31a00640 1 --2- 172.21.15.59:0/1946611701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc2c159c80 0x7fbc2c06f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc31a00640 1 -- 172.21.15.59:0/1946611701 >> v2:172.21.15.178:3300/0 conn(0x7fbc2c071270 msgr2=0x7fbc2c06e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc31a00640 1 --2- 172.21.15.59:0/1946611701 >> v2:172.21.15.178:3300/0 conn(0x7fbc2c071270 0x7fbc2c06e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc31a00640 1 -- 172.21.15.59:0/1946611701 >> v1:172.21.15.178:6789/0 conn(0x7fbc2c1598a0 legacy=0x7fbc2c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:51.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc31a00640 1 -- 172.21.15.59:0/1946611701 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c0ce6e0 con 0x7fbc2c159c80 2024-04-25T09:01:51.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.844+0000 7fbc2be00640 1 --2- 172.21.15.59:0/1946611701 >> v2:172.21.15.178:3300/0 conn(0x7fbc2c071270 0x7fbc2c06e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:51.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f3a0c400640 1 Processor -- start 2024-04-25T09:01:51.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09cbe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09cc0b1de0 0x7f09cc15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09cbe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f09cc06eee0 0x7f09cc0b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09cbe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09cc15b510 con 0x7f09cc15b090 2024-04-25T09:01:51.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09cbe00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09cc0725b0 con 0x7f09cc06eee0 2024-04-25T09:01:51.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09cbe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc072890 con 0x7f09cc0b1de0 2024-04-25T09:01:51.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7ff9cde00640 1 --2- 172.21.15.59:0/4008732678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9d00b1e20 0x7ff9d0150660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00097c0 tx=0x7ff9c001c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1d81d319f6ce12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09caa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09cc0b1de0 0x7f09cc15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7ff9cca00640 1 -- 172.21.15.59:0/4008732678 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c00ab430 con 0x7ff9d00b1e20 2024-04-25T09:01:51.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09caa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09cc0b1de0 0x7f09cc15cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:46852/0 (socket says 172.21.15.59:46852) 2024-04-25T09:01:51.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09caa00640 1 -- 172.21.15.59:0/696948383 learned_addr learned my addr 172.21.15.59:0/696948383 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:51.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7ff9cca00640 1 -- 172.21.15.59:0/4008732678 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c00b0070 con 0x7ff9d00b1e20 2024-04-25T09:01:51.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7ff9cca00640 1 -- 172.21.15.59:0/4008732678 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c00ab7f0 con 0x7ff9d00b1e20 2024-04-25T09:01:51.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09cb400640 1 --2- 172.21.15.59:0/696948383 >> v2:172.21.15.178:3300/0 conn(0x7f09cc06eee0 0x7f09cc0b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f1e5fe00640 1 --2- 172.21.15.59:0/2854649269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e60163610 0x7f1e60071270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1e60163580 tx=0x7f1e5001bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d97c887d97db1c5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09cb400640 1 -- 172.21.15.59:0/696948383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09cc0b1de0 msgr2=0x7f09cc15cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:51.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09cb400640 1 --2- 172.21.15.59:0/696948383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09cc0b1de0 0x7f09cc15cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09cb400640 1 -- 172.21.15.59:0/696948383 >> v1:172.21.15.59:6789/0 conn(0x7f09cc15b090 legacy=0x7f09cc06e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f09cb400640 1 -- 172.21.15.59:0/696948383 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc072b70 con 0x7f09cc06eee0 2024-04-25T09:01:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f3a0c400640 1 -- start start 2024-04-25T09:01:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f3a0c400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a0406cf40 0x7f3a040b5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f3a0c400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3a0406bd20 0x7f3a0406c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f3a0c400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a0406d7a0 con 0x7f3a04161fc0 2024-04-25T09:01:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f3a0c400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a040b4ba0 con 0x7f3a0406cf40 2024-04-25T09:01:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f3a0c400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a0406da80 con 0x7f3a0406bd20 2024-04-25T09:01:51.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f3a09000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a0406cf40 0x7f3a040b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7ff9cf200640 1 -- 172.21.15.59:0/4008732678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9d00b1e20 msgr2=0x7ff9d0150660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7ff9cf200640 1 --2- 172.21.15.59:0/4008732678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9d00b1e20 0x7ff9d0150660 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00097c0 tx=0x7ff9c001c430 comp rx=0 tx=0).stop 2024-04-25T09:01:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7ff9cf200640 1 -- 172.21.15.59:0/4008732678 shutdown_connections 2024-04-25T09:01:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7ff9cf200640 1 --2- 172.21.15.59:0/4008732678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9d00b1e20 0x7ff9d0150660 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7ff9cf200640 1 -- 172.21.15.59:0/4008732678 >> 172.21.15.59:0/4008732678 conn(0x7ff9d00b1300 msgr2=0x7ff9d00b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f3a09000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a0406cf40 0x7f3a040b5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35056/0 (socket says 172.21.15.59:35056) 2024-04-25T09:01:51.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7f3a09000640 1 -- 172.21.15.59:0/3050043388 learned_addr learned my addr 172.21.15.59:0/3050043388 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:51.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7ff9cf200640 1 -- 172.21.15.59:0/4008732678 shutdown_connections 2024-04-25T09:01:51.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7ff9cf200640 1 -- 172.21.15.59:0/4008732678 wait complete. 2024-04-25T09:01:51.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7fd93c600640 1 Processor -- start 2024-04-25T09:01:51.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.848+0000 7fd93c600640 1 -- start start 2024-04-25T09:01:51.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f3a09000640 1 -- 172.21.15.59:0/3050043388 >> v2:172.21.15.178:3300/0 conn(0x7f3a0406bd20 msgr2=0x7f3a0406c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:51.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f3a0a400640 1 --2- 172.21.15.59:0/3050043388 >> v2:172.21.15.178:3300/0 conn(0x7f3a0406bd20 0x7f3a0406c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f3a09000640 1 --2- 172.21.15.59:0/3050043388 >> v2:172.21.15.178:3300/0 conn(0x7f3a0406bd20 0x7f3a0406c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f1e5e000640 1 -- 172.21.15.59:0/2854649269 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e500af600 con 0x7f1e60163610 2024-04-25T09:01:51.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f1e5e000640 1 -- 172.21.15.59:0/2854649269 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e500af7a0 con 0x7f1e60163610 2024-04-25T09:01:51.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f1e5e000640 1 -- 172.21.15.59:0/2854649269 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e500afb70 con 0x7f1e60163610 2024-04-25T09:01:51.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f3a09000640 1 -- 172.21.15.59:0/3050043388 >> v1:172.21.15.178:6789/0 conn(0x7f3a04161fc0 legacy=0x7f3a04162e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fbc31a00640 1 --2- 172.21.15.59:0/1946611701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc2c159c80 0x7fbc2c06f290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009d90 tx=0x7fbc2401c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bef71254a1cf9ca5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7ff9cf200640 1 Processor -- start 2024-04-25T09:01:51.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7ff9cf200640 1 -- start start 2024-04-25T09:01:51.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f1e66600640 1 -- 172.21.15.59:0/2854649269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e60163610 msgr2=0x7f1e60071270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f1e66600640 1 --2- 172.21.15.59:0/2854649269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e60163610 0x7f1e60071270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1e60163580 tx=0x7f1e5001bf30 comp rx=0 tx=0).stop 2024-04-25T09:01:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f1e66600640 1 -- 172.21.15.59:0/2854649269 shutdown_connections 2024-04-25T09:01:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f1e66600640 1 --2- 172.21.15.59:0/2854649269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e60163610 0x7f1e60071270 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f1e66600640 1 --2- 172.21.15.59:0/2854649269 >> v2:172.21.15.59:3300/0 conn(0x7f1e6015c710 0x7f1e60163040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f1e66600640 1 -- 172.21.15.59:0/2854649269 >> 172.21.15.59:0/2854649269 conn(0x7f1e60067080 msgr2=0x7f1e6006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f1e66600640 1 -- 172.21.15.59:0/2854649269 shutdown_connections 2024-04-25T09:01:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f1e66600640 1 -- 172.21.15.59:0/2854649269 wait complete. 2024-04-25T09:01:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f3a09000640 1 -- 172.21.15.59:0/3050043388 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a040b4830 con 0x7f3a0406cf40 2024-04-25T09:01:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fbc2b400640 1 -- 172.21.15.59:0/1946611701 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc240b2070 con 0x7fbc2c159c80 2024-04-25T09:01:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fbc2b400640 1 -- 172.21.15.59:0/1946611701 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c0b3610 con 0x7fbc2c159c80 2024-04-25T09:01:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fbc2b400640 1 -- 172.21.15.59:0/1946611701 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc240a5ab0 con 0x7fbc2c159c80 2024-04-25T09:01:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fbc33a00640 1 -- 172.21.15.59:0/1946611701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc2c159c80 msgr2=0x7fbc2c06f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fbc33a00640 1 --2- 172.21.15.59:0/1946611701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc2c159c80 0x7fbc2c06f290 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbc24009d90 tx=0x7fbc2401c900 comp rx=0 tx=0).stop 2024-04-25T09:01:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fbc33a00640 1 -- 172.21.15.59:0/1946611701 shutdown_connections 2024-04-25T09:01:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fbc33a00640 1 --2- 172.21.15.59:0/1946611701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc2c159c80 0x7fbc2c06f290 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fbc33a00640 1 --2- 172.21.15.59:0/1946611701 >> v2:172.21.15.178:3300/0 conn(0x7fbc2c071270 0x7fbc2c06e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fbc33a00640 1 -- 172.21.15.59:0/1946611701 >> 172.21.15.59:0/1946611701 conn(0x7fbc2c06b010 msgr2=0x7fbc2c06b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fd93c600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd934071dd0 0x7fd9340b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fd93c600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd9340725d0 0x7fd93406d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fd93c600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9341626f0 con 0x7fd9340b3ea0 2024-04-25T09:01:51.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fd93c600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9340b4280 con 0x7fd9340725d0 2024-04-25T09:01:51.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fd93c600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd934163020 con 0x7fd934071dd0 2024-04-25T09:01:51.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fd93a600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd9340725d0 0x7fd93406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fd93a600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd9340725d0 0x7fd93406d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56122/0 (socket says 172.21.15.59:56122) 2024-04-25T09:01:51.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fd93a600640 1 -- 172.21.15.59:0/3937060247 learned_addr learned my addr 172.21.15.59:0/3937060247 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:51.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f3a0a400640 1 --2- 172.21.15.59:0/3050043388 >> v2:172.21.15.178:3300/0 conn(0x7f3a0406bd20 0x7f3a0406c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:51.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fbc33a00640 1 -- 172.21.15.59:0/1946611701 shutdown_connections 2024-04-25T09:01:51.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7f09cb400640 1 --2- 172.21.15.59:0/696948383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09cc06eee0 0x7f09cc0b2e60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0097c0 tx=0x7f09bc01c310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a01ec216063b21a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fbc33a00640 1 -- 172.21.15.59:0/1946611701 wait complete. 2024-04-25T09:01:51.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f09c9600640 1 -- 172.21.15.59:0/696948383 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0b0070 con 0x7f09cc06eee0 2024-04-25T09:01:51.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9cf200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d00aee40 0x7ff9d0202e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fca91800640 1 Processor -- start 2024-04-25T09:01:51.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fca91800640 1 -- start start 2024-04-25T09:01:51.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f1e66600640 1 Processor -- start 2024-04-25T09:01:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9cf200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9d00b1e20 0x7ff9d0152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9cf200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9d0150ba0 0x7ff9d00b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f09c9600640 1 -- 172.21.15.59:0/696948383 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc0ab600 con 0x7f09cc06eee0 2024-04-25T09:01:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f09c9600640 1 -- 172.21.15.59:0/696948383 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0ab9d0 con 0x7f09cc06eee0 2024-04-25T09:01:51.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f1e66600640 1 -- start start 2024-04-25T09:01:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9cde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d00aee40 0x7ff9d0202e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9cde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d00aee40 0x7ff9d0202e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35070/0 (socket says 172.21.15.59:35070) 2024-04-25T09:01:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9cf200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d015ae50 con 0x7ff9d00aee40 2024-04-25T09:01:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9cf200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d00b4920 con 0x7ff9d0150ba0 2024-04-25T09:01:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9cf200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d0168890 con 0x7ff9d00b1e20 2024-04-25T09:01:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9ce800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9d0150ba0 0x7ff9d00b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9ce800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9d0150ba0 0x7ff9d00b0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56124/0 (socket says 172.21.15.59:56124) 2024-04-25T09:01:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9ce800640 1 -- 172.21.15.59:0/3670276788 learned_addr learned my addr 172.21.15.59:0/3670276788 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:51.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9cd400640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9d00b1e20 0x7ff9d0152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f3a09000640 1 --2- 172.21.15.59:0/3050043388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a0406cf40 0x7f3a040b5030 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f39fc009e50 tx=0x7f39fc01f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7b318a45f9a42f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f3a03e00640 1 -- 172.21.15.59:0/3050043388 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0b4070 con 0x7f3a0406cf40 2024-04-25T09:01:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fbc33a00640 1 Processor -- start 2024-04-25T09:01:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fbc33a00640 1 -- start start 2024-04-25T09:01:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f09cbe00640 1 -- 172.21.15.59:0/696948383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09cc06eee0 msgr2=0x7f09cc0b2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f09cbe00640 1 --2- 172.21.15.59:0/696948383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09cc06eee0 0x7f09cc0b2e60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0097c0 tx=0x7f09bc01c310 comp rx=0 tx=0).stop 2024-04-25T09:01:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fef8ee00640 1 Processor -- start 2024-04-25T09:01:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fef8ee00640 1 -- start start 2024-04-25T09:01:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f3a03e00640 1 -- 172.21.15.59:0/3050043388 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc0af400 con 0x7f3a0406cf40 2024-04-25T09:01:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f3a03e00640 1 -- 172.21.15.59:0/3050043388 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0af7d0 con 0x7f3a0406cf40 2024-04-25T09:01:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fd93a600640 1 -- 172.21.15.59:0/3937060247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd934071dd0 msgr2=0x7fd9340b2ab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T09:01:51.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fd93a600640 1 --2- 172.21.15.59:0/3937060247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd934071dd0 0x7fd9340b2ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fd93a600640 1 -- 172.21.15.59:0/3937060247 >> v1:172.21.15.59:6789/0 conn(0x7fd9340b3ea0 legacy=0x7fd9340716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.852+0000 7fd93a600640 1 -- 172.21.15.59:0/3937060247 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9341629d0 con 0x7fd9340725d0 2024-04-25T09:01:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9ce800640 1 -- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9d00b1e20 msgr2=0x7ff9d0152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9ce800640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9d00b1e20 0x7ff9d0152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9ce800640 1 -- 172.21.15.59:0/3670276788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d00aee40 msgr2=0x7ff9d0202e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9ce800640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d00aee40 0x7ff9d0202e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9ce800640 1 -- 172.21.15.59:0/3670276788 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d0153460 con 0x7ff9d0150ba0 2024-04-25T09:01:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f1e66600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6015c330 0x7f1e600adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f1e66600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e6015c710 0x7f1e601532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7f1e66600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e60163610 0x7f1e6015a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fca91800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca8c0cedf0 0x7fca8c15eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fca91800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c071ac0 0x7fca8c071f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fca91800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8c15eff0 con 0x7fca8c161620 2024-04-25T09:01:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fca91800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8c06ee30 con 0x7fca8c0cedf0 2024-04-25T09:01:51.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7fca91800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c06f110 con 0x7fca8c071ac0 2024-04-25T09:01:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.856+0000 7ff9cd400640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9d00b1e20 0x7ff9d0152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7ff9ce800640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9d0150ba0 0x7ff9d00b0270 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800b970 tx=0x7ff9c800be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7ff9cde00640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d00aee40 0x7ff9d0202e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e66600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600ce7d0 con 0x7f1e6015c330 2024-04-25T09:01:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e66600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e600ce650 con 0x7f1e60163610 2024-04-25T09:01:51.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e66600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6016fdf0 con 0x7f1e6015c710 2024-04-25T09:01:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f09cbe00640 1 -- 172.21.15.59:0/696948383 shutdown_connections 2024-04-25T09:01:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f09cbe00640 1 --2- 172.21.15.59:0/696948383 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09cc06eee0 0x7f09cc0b2e60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f09cbe00640 1 --2- 172.21.15.59:0/696948383 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09cc0b1de0 0x7f09cc15cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f09cbe00640 1 -- 172.21.15.59:0/696948383 >> 172.21.15.59:0/696948383 conn(0x7f09cc0b12c0 msgr2=0x7f09cc0b16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e5fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e60163610 0x7f1e6015a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e5ea00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e6015c710 0x7f1e601532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f3a0c400640 1 -- 172.21.15.59:0/3050043388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a0406cf40 msgr2=0x7f3a040b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc33a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c071270 0x7fbc2c163ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f3a0c400640 1 --2- 172.21.15.59:0/3050043388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a0406cf40 0x7f3a040b5030 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f39fc009e50 tx=0x7f39fc01f210 comp rx=0 tx=0).stop 2024-04-25T09:01:51.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fca8b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fca8c161620 0x7fca8c161a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37628/0 (socket says 172.21.15.59:37628) 2024-04-25T09:01:51.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fca8b400640 1 -- 172.21.15.59:0/2690930055 learned_addr learned my addr 172.21.15.59:0/2690930055 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:51.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7ff9c6000640 1 -- 172.21.15.59:0/3670276788 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8019070 con 0x7ff9d0150ba0 2024-04-25T09:01:51.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7ff9c6000640 1 -- 172.21.15.59:0/3670276788 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c800cb40 con 0x7ff9d0150ba0 2024-04-25T09:01:51.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e5fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e60163610 0x7f1e6015a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56138/0 (socket says 172.21.15.59:56138) 2024-04-25T09:01:51.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e5fe00640 1 -- 172.21.15.59:0/2459621331 learned_addr learned my addr 172.21.15.59:0/2459621331 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:51.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7ff9c6000640 1 -- 172.21.15.59:0/3670276788 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8014440 con 0x7ff9d0150ba0 2024-04-25T09:01:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f3a0c400640 1 -- 172.21.15.59:0/3050043388 shutdown_connections 2024-04-25T09:01:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f3a0c400640 1 --2- 172.21.15.59:0/3050043388 >> v2:172.21.15.178:3300/0 conn(0x7f3a0406bd20 0x7f3a0406c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f3a0c400640 1 --2- 172.21.15.59:0/3050043388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a0406cf40 0x7f3a040b5030 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f3a0c400640 1 -- 172.21.15.59:0/3050043388 >> 172.21.15.59:0/3050043388 conn(0x7f3a0406f510 msgr2=0x7f3a0406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:51.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f09cbe00640 1 -- 172.21.15.59:0/696948383 shutdown_connections 2024-04-25T09:01:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7ff9cf200640 1 -- 172.21.15.59:0/3670276788 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d0153740 con 0x7ff9d0150ba0 2024-04-25T09:01:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7ff9cf200640 1 -- 172.21.15.59:0/3670276788 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d0153d00 con 0x7ff9d0150ba0 2024-04-25T09:01:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f3a0c400640 1 -- 172.21.15.59:0/3050043388 shutdown_connections 2024-04-25T09:01:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc33a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc2c1598a0 0x7fbc2c138300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc33a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc2c159c80 0x7fbc2c138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc33a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0b2f90 con 0x7fbc2c071270 2024-04-25T09:01:51.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc33a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0b2e10 con 0x7fbc2c1598a0 2024-04-25T09:01:51.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc33a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0b3110 con 0x7fbc2c159c80 2024-04-25T09:01:51.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fca8aa00640 1 --2- 172.21.15.59:0/2690930055 >> v2:172.21.15.59:3300/0 conn(0x7fca8c0cedf0 0x7fca8c15eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef8ee00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fef8815c710 0x7fef88163040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef8ee00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef88163610 0x7fef88071270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef8ee00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef880cd470 con 0x7fef8815c330 2024-04-25T09:01:51.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef8ee00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef880af0e0 con 0x7fef8815c710 2024-04-25T09:01:51.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef8ee00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8806e350 con 0x7fef88163610 2024-04-25T09:01:51.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fca83e00640 1 --2- 172.21.15.59:0/2690930055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c071ac0 0x7fca8c071f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef87e00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fef8815c330 0x7fef8806d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:45676/0 (socket says 172.21.15.59:45676) 2024-04-25T09:01:51.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef87e00640 1 -- 172.21.15.59:0/1940648342 learned_addr learned my addr 172.21.15.59:0/1940648342 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:51.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fd93a600640 1 --2- 172.21.15.59:0/3937060247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9340725d0 0x7fd93406d720 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009e80 tx=0x7fd92c01c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cf7d99a94004bb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc31000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c071270 0x7fbc2c163ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc31000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c071270 0x7fbc2c163ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35100/0 (socket says 172.21.15.59:35100) 2024-04-25T09:01:51.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc31000640 1 -- 172.21.15.59:0/2600749041 learned_addr learned my addr 172.21.15.59:0/2600749041 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:51.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc2be00640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc2c1598a0 0x7fbc2c138300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc31a00640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc2c159c80 0x7fbc2c138c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e5f400640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6015c330 0x7f1e600adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f3a0c400640 1 -- 172.21.15.59:0/3050043388 wait complete. 2024-04-25T09:01:51.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef87400640 1 --2- 172.21.15.59:0/1940648342 >> v2:172.21.15.178:3300/0 conn(0x7fef8815c710 0x7fef88163040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc31000640 1 -- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc2c159c80 msgr2=0x7fbc2c138c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fca8aa00640 1 -- 172.21.15.59:0/2690930055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c071ac0 msgr2=0x7fca8c071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:51.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fca8aa00640 1 --2- 172.21.15.59:0/2690930055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c071ac0 0x7fca8c071f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fca8aa00640 1 -- 172.21.15.59:0/2690930055 >> v1:172.21.15.59:6789/0 conn(0x7fca8c161620 legacy=0x7fca8c161a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fca8aa00640 1 -- 172.21.15.59:0/2690930055 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c06f3f0 con 0x7fca8c0cedf0 2024-04-25T09:01:51.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fca83e00640 1 --2- 172.21.15.59:0/2690930055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c071ac0 0x7fca8c071f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:51.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc31000640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc2c159c80 0x7fbc2c138c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc31000640 1 -- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc2c1598a0 msgr2=0x7fbc2c138300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc31000640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc2c1598a0 0x7fbc2c138300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fd933e00640 1 -- 172.21.15.59:0/3937060247 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0a5670 con 0x7fd9340725d0 2024-04-25T09:01:51.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e5fe00640 1 -- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e6015c710 msgr2=0x7f1e601532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e5fe00640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e6015c710 0x7f1e601532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e5fe00640 1 -- 172.21.15.59:0/2459621331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6015c330 msgr2=0x7f1e600adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e5fe00640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6015c330 0x7f1e600adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc31000640 1 -- 172.21.15.59:0/2600749041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c14b030 con 0x7fbc2c071270 2024-04-25T09:01:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fd933e00640 1 -- 172.21.15.59:0/3937060247 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c0a5810 con 0x7fd9340725d0 2024-04-25T09:01:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fd933e00640 1 -- 172.21.15.59:0/3937060247 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0a5be0 con 0x7fd9340725d0 2024-04-25T09:01:51.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f1e5fe00640 1 -- 172.21.15.59:0/2459621331 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6015cbb0 con 0x7f1e60163610 2024-04-25T09:01:51.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef8ce00640 1 --2- 172.21.15.59:0/1940648342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef88163610 0x7fef88071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc31000640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c071270 0x7fbc2c163ed0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00c470 tx=0x7fbc1c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef86a00640 1 -- 172.21.15.59:0/1940648342 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986642234 0 0) 0x7fef880cd470 con 0x7fef8815c330 2024-04-25T09:01:51.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef86a00640 1 -- 172.21.15.59:0/1940648342 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef6c003530 con 0x7fef8815c330 2024-04-25T09:01:51.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc28c00640 1 -- 172.21.15.59:0/2600749041 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c005cf0 con 0x7fbc2c071270 2024-04-25T09:01:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc28c00640 1 -- 172.21.15.59:0/2600749041 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c007070 con 0x7fbc2c071270 2024-04-25T09:01:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc28c00640 1 -- 172.21.15.59:0/2600749041 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c007480 con 0x7fbc2c071270 2024-04-25T09:01:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fbc33a00640 1 -- 172.21.15.59:0/2600749041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2c162e30 con 0x7fbc2c071270 2024-04-25T09:01:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7f09cbe00640 1 -- 172.21.15.59:0/696948383 wait complete. 2024-04-25T09:01:51.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7fbc33a00640 1 -- 172.21.15.59:0/2600749041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2c1633f0 con 0x7fbc2c071270 2024-04-25T09:01:51.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09cbe00640 1 Processor -- start 2024-04-25T09:01:51.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef87400640 1 -- 172.21.15.59:0/1940648342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef88163610 msgr2=0x7fef88071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:51.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7ff9cf200640 1 -- 172.21.15.59:0/3670276788 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d00745d0 con 0x7ff9d0150ba0 2024-04-25T09:01:51.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef87400640 1 --2- 172.21.15.59:0/1940648342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef88163610 0x7fef88071270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09cbe00640 1 -- start start 2024-04-25T09:01:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef87400640 1 -- 172.21.15.59:0/1940648342 >> v1:172.21.15.178:6789/0 conn(0x7fef8815c330 legacy=0x7fef8806d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.860+0000 7fef87400640 1 -- 172.21.15.59:0/1940648342 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef88163a60 con 0x7fef8815c710 2024-04-25T09:01:51.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f1e5fe00640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e60163610 0x7f1e6015a8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1e50019d70 tx=0x7f1e5001a770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7ff9c6000640 1 -- 172.21.15.59:0/3670276788 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff9c801c070 con 0x7ff9d0150ba0 2024-04-25T09:01:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f1e57400640 1 -- 172.21.15.59:0/2459621331 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e500bc070 con 0x7f1e60163610 2024-04-25T09:01:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f1e57400640 1 -- 172.21.15.59:0/2459621331 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e500b7400 con 0x7f1e60163610 2024-04-25T09:01:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f1e57400640 1 -- 172.21.15.59:0/2459621331 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e500b77d0 con 0x7f1e60163610 2024-04-25T09:01:51.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f3a0c400640 1 Processor -- start 2024-04-25T09:01:51.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7fd93c600640 1 -- 172.21.15.59:0/3937060247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9340725d0 msgr2=0x7fd93406d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7fd93c600640 1 --2- 172.21.15.59:0/3937060247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9340725d0 0x7fd93406d720 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009e80 tx=0x7fd92c01c9f0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f1e66600640 1 -- 172.21.15.59:0/2459621331 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e60154680 con 0x7f1e60163610 2024-04-25T09:01:51.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09cbe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09cc06eee0 0x7f09cc169140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09cbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09cc0b1de0 0x7f09cc16ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7fd93c600640 1 -- 172.21.15.59:0/3937060247 shutdown_connections 2024-04-25T09:01:51.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f1e66600640 1 -- 172.21.15.59:0/2459621331 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e60154c40 con 0x7f1e60163610 2024-04-25T09:01:51.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09cbe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09cc15b090 0x7f09cc16b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09cbe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0b3520 con 0x7f09cc0b1de0 2024-04-25T09:01:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09cbe00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0b33a0 con 0x7f09cc15b090 2024-04-25T09:01:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09cbe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc0b36a0 con 0x7f09cc06eee0 2024-04-25T09:01:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09ca000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09cc0b1de0 0x7f09cc16ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f3a0c400640 1 -- start start 2024-04-25T09:01:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f3a0c400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a0406bd20 0x7f3a0414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f3a0c400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a04161fc0 0x7f3a0414bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f3a0c400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a04163d00 0x7f3a0414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09ca000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09cc0b1de0 0x7f09cc16ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35106/0 (socket says 172.21.15.59:35106) 2024-04-25T09:01:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09ca000640 1 -- 172.21.15.59:0/431182857 learned_addr learned my addr 172.21.15.59:0/431182857 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7fbc28c00640 1 -- 172.21.15.59:0/2600749041 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbc1c01b400 con 0x7fbc2c071270 2024-04-25T09:01:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7fd93c600640 1 --2- 172.21.15.59:0/3937060247 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9340725d0 0x7fd93406d720 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09caa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09cc06eee0 0x7f09cc169140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.864+0000 7f09cb400640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09cc15b090 0x7f09cc16b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a0a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a04163d00 0x7f3a0414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7ff9c6000640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff9ac067030 0x7ff9ac0694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a0a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a04163d00 0x7f3a0414c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35116/0 (socket says 172.21.15.59:35116) 2024-04-25T09:01:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a0a400640 1 -- 172.21.15.59:0/1833367279 learned_addr learned my addr 172.21.15.59:0/1833367279 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04070e10 con 0x7f3a04163d00 2024-04-25T09:01:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7ff9c6000640 1 -- 172.21.15.59:0/3670276788 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff9c8084f60 con 0x7ff9d0150ba0 2024-04-25T09:01:51.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a09000640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a04161fc0 0x7f3a0414bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f09cb400640 1 -- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09cc06eee0 msgr2=0x7f09cc169140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f09cb400640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09cc06eee0 0x7f09cc169140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f09cb400640 1 -- 172.21.15.59:0/431182857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09cc0b1de0 msgr2=0x7f09cc16ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f09cb400640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09cc0b1de0 0x7f09cc16ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04070c90 con 0x7f3a04161fc0 2024-04-25T09:01:51.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f09cb400640 1 -- 172.21.15.59:0/431182857 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc169c20 con 0x7f09cc15b090 2024-04-25T09:01:51.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a04070f90 con 0x7f3a0406bd20 2024-04-25T09:01:51.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a09a00640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a0406bd20 0x7f3a0414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f1e66600640 1 -- 172.21.15.59:0/2459621331 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e600745d0 con 0x7f1e60163610 2024-04-25T09:01:51.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fef87400640 1 --2- 172.21.15.59:0/1940648342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef8815c710 0x7fef88163040 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fef780097c0 tx=0x7fef7801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7093389ce088701a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fef86a00640 1 -- 172.21.15.59:0/1940648342 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef780b0070 con 0x7fef8815c710 2024-04-25T09:01:51.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fef86a00640 1 -- 172.21.15.59:0/1940648342 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef780ab600 con 0x7fef8815c710 2024-04-25T09:01:51.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fef86a00640 1 -- 172.21.15.59:0/1940648342 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef780ab9d0 con 0x7fef8815c710 2024-04-25T09:01:51.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fbc33a00640 1 -- 172.21.15.59:0/2600749041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc040052a0 con 0x7fbc2c071270 2024-04-25T09:01:51.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fd93c600640 1 --2- 172.21.15.59:0/3937060247 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd934071dd0 0x7fd9340b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fd93c600640 1 -- 172.21.15.59:0/3937060247 >> 172.21.15.59:0/3937060247 conn(0x7fd9340b17b0 msgr2=0x7fd9340b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:51.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7ff9cde00640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff9ac067030 0x7ff9ac0694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f09cb400640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09cc15b090 0x7f09cc16b250 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0ab000 tx=0x7f09bc0190b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f1e57400640 1 -- 172.21.15.59:0/2459621331 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1e500bf070 con 0x7f1e60163610 2024-04-25T09:01:51.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a09000640 1 -- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a0406bd20 msgr2=0x7f3a0414a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a09000640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a0406bd20 0x7f3a0414a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a09000640 1 -- 172.21.15.59:0/1833367279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a04163d00 msgr2=0x7f3a0414c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a09000640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a04163d00 0x7f3a0414c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a09000640 1 -- 172.21.15.59:0/1833367279 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a04148740 con 0x7f3a04161fc0 2024-04-25T09:01:51.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fd93c600640 1 -- 172.21.15.59:0/3937060247 shutdown_connections 2024-04-25T09:01:51.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fd93c600640 1 -- 172.21.15.59:0/3937060247 wait complete. 2024-04-25T09:01:51.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fbc28c00640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbc0c067060 0x7fbc0c069520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fef8ee00640 1 -- 172.21.15.59:0/1940648342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef8815c710 msgr2=0x7fef88163040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fef8ee00640 1 --2- 172.21.15.59:0/1940648342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef8815c710 0x7fef88163040 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fef780097c0 tx=0x7fef7801c330 comp rx=0 tx=0).stop 2024-04-25T09:01:51.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f3a09000640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a04161fc0 0x7f3a0414bc60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0ae000 tx=0x7f39fc01bfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fbc28c00640 1 -- 172.21.15.59:0/2600749041 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbc1c084f20 con 0x7fbc2c071270 2024-04-25T09:01:51.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fef8ee00640 1 -- 172.21.15.59:0/1940648342 shutdown_connections 2024-04-25T09:01:51.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fef8ee00640 1 --2- 172.21.15.59:0/1940648342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef88163610 0x7fef88071270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fef8ee00640 1 --2- 172.21.15.59:0/1940648342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef8815c710 0x7fef88163040 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fef8ee00640 1 -- 172.21.15.59:0/1940648342 >> 172.21.15.59:0/1940648342 conn(0x7fef88067080 msgr2=0x7fef8806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:51.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fef8ee00640 1 -- 172.21.15.59:0/1940648342 shutdown_connections 2024-04-25T09:01:51.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fbc2be00640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbc0c067060 0x7fbc0c069520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fef8ee00640 1 -- 172.21.15.59:0/1940648342 wait complete. 2024-04-25T09:01:51.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7ff9cde00640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff9ac067030 0x7ff9ac0694f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00af000 tx=0x7ff9c00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f1e57400640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e40067030 0x7f1e400694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fca8aa00640 1 --2- 172.21.15.59:0/2690930055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8c0cedf0 0x7fca8c15eab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0097c0 tx=0x7fca7c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4491e6587b37ff5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f1e57400640 1 -- 172.21.15.59:0/2459621331 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1e5011e250 con 0x7f1e60163610 2024-04-25T09:01:51.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7f1e5f400640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e40067030 0x7f1e400694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.868+0000 7fbc2be00640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbc0c067060 0x7fbc0c069520 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009580 tx=0x7fbc18008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7f1e5f400640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e40067030 0x7f1e400694f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c000c10 tx=0x7f1e4c007c30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd93c600640 1 Processor -- start 2024-04-25T09:01:51.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef8ee00640 1 Processor -- start 2024-04-25T09:01:51.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd93c600640 1 -- start start 2024-04-25T09:01:51.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef8ee00640 1 -- start start 2024-04-25T09:01:51.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef8ee00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef8815c330 0x7fef88153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd93c600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd934071dd0 0x7fd9340cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd93c600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9340725d0 0x7fd93415d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef8ee00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef8815c710 0x7fef8814f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef8ee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88163610 0x7fef880af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef8ee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef88165490 con 0x7fef88163610 2024-04-25T09:01:51.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef8ee00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef880cd710 con 0x7fef8815c710 2024-04-25T09:01:51.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd93c600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9340b3ea0 0x7fd93414d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7f3a01600640 1 -- 172.21.15.59:0/1833367279 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0b4040 con 0x7f3a04161fc0 2024-04-25T09:01:51.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef8ee00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef88165610 con 0x7fef8815c330 2024-04-25T09:01:51.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef87e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef8815c330 0x7fef88153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef87400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef8815c710 0x7fef8814f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7ff9c6000640 1 -- 172.21.15.59:0/3670276788 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff9c80b0cb0 con 0x7ff9d0150ba0 2024-04-25T09:01:51.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a04148a20 con 0x7f3a04161fc0 2024-04-25T09:01:51.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a040cdad0 con 0x7f3a04161fc0 2024-04-25T09:01:51.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd939c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd934071dd0 0x7fd9340cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd939c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd934071dd0 0x7fd9340cebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:46946/0 (socket says 172.21.15.59:46946) 2024-04-25T09:01:51.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd939200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9340725d0 0x7fd93415d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd939200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9340725d0 0x7fd93415d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35140/0 (socket says 172.21.15.59:35140) 2024-04-25T09:01:51.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd939c00640 1 -- 172.21.15.59:0/743044265 learned_addr learned my addr 172.21.15.59:0/743044265 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:51.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93406e800 con 0x7fd9340725d0 2024-04-25T09:01:51.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd93a600640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9340b3ea0 0x7fd93414d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7f09c3400640 1 -- 172.21.15.59:0/431182857 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0b9020 con 0x7f09cc15b090 2024-04-25T09:01:51.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7f09cbe00640 1 -- 172.21.15.59:0/431182857 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09cc169f00 con 0x7f09cc15b090 2024-04-25T09:01:51.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7f09cbe00640 1 -- 172.21.15.59:0/431182857 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09cc1555f0 con 0x7f09cc15b090 2024-04-25T09:01:51.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef87400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef8815c710 0x7fef8814f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56184/0 (socket says 172.21.15.59:56184) 2024-04-25T09:01:51.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef87e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef8815c330 0x7fef88153480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:46938/0 (socket says 172.21.15.59:46938) 2024-04-25T09:01:51.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef87400640 1 -- 172.21.15.59:0/837705890 learned_addr learned my addr 172.21.15.59:0/837705890 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:51.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef8ce00640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88163610 0x7fef880af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef87400640 1 -- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef8815c330 msgr2=0x7fef88153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef87400640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef8815c330 0x7fef88153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef87400640 1 -- 172.21.15.59:0/837705890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88163610 msgr2=0x7fef880af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef87400640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88163610 0x7fef880af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef87400640 1 -- 172.21.15.59:0/837705890 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef881fe280 con 0x7fef8815c710 2024-04-25T09:01:51.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd93406e680 con 0x7fd9340b3ea0 2024-04-25T09:01:51.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fef87400640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef8815c710 0x7fef8814f3f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef780097c0 tx=0x7fef780190d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.872+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd93416ee70 con 0x7fd934071dd0 2024-04-25T09:01:51.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a040745d0 con 0x7f3a04161fc0 2024-04-25T09:01:51.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fca8a000640 1 -- 172.21.15.59:0/2690930055 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0b0070 con 0x7fca8c0cedf0 2024-04-25T09:01:51.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fca8a000640 1 -- 172.21.15.59:0/2690930055 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7c0ab600 con 0x7fca8c0cedf0 2024-04-25T09:01:51.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fca8a000640 1 -- 172.21.15.59:0/2690930055 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7c0ab9d0 con 0x7fca8c0cedf0 2024-04-25T09:01:51.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fbc28c00640 1 -- 172.21.15.59:0/2600749041 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbc1c055bd0 con 0x7fbc2c071270 2024-04-25T09:01:51.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7f09cbe00640 1 -- 172.21.15.59:0/431182857 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09cc0745d0 con 0x7f09cc15b090 2024-04-25T09:01:51.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fd939c00640 1 -- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9340b3ea0 msgr2=0x7fd93414d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fd939c00640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9340b3ea0 0x7fd93414d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fd939c00640 1 -- 172.21.15.59:0/743044265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9340725d0 msgr2=0x7fd93415d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fd939c00640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9340725d0 0x7fd93415d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fd939c00640 1 -- 172.21.15.59:0/743044265 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93414f750 con 0x7fd934071dd0 2024-04-25T09:01:51.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fca91800640 1 -- 172.21.15.59:0/2690930055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8c0cedf0 msgr2=0x7fca8c15eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fca91800640 1 --2- 172.21.15.59:0/2690930055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8c0cedf0 0x7fca8c15eab0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0097c0 tx=0x7fca7c01c410 comp rx=0 tx=0).stop 2024-04-25T09:01:51.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fd939c00640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd934071dd0 0x7fd9340cebb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd92000b440 tx=0x7fd92000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fca91800640 1 -- 172.21.15.59:0/2690930055 shutdown_connections 2024-04-25T09:01:51.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fca91800640 1 --2- 172.21.15.59:0/2690930055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c071ac0 0x7fca8c071f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fca91800640 1 --2- 172.21.15.59:0/2690930055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8c0cedf0 0x7fca8c15eab0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fca91800640 1 -- 172.21.15.59:0/2690930055 >> 172.21.15.59:0/2690930055 conn(0x7fca8c06b010 msgr2=0x7fca8c06b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:51.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fca91800640 1 -- 172.21.15.59:0/2690930055 shutdown_connections 2024-04-25T09:01:51.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fca91800640 1 -- 172.21.15.59:0/2690930055 wait complete. 2024-04-25T09:01:51.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fd931600640 1 -- 172.21.15.59:0/743044265 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920015020 con 0x7fd934071dd0 2024-04-25T09:01:51.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fd931600640 1 -- 172.21.15.59:0/743044265 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd920011890 con 0x7fd934071dd0 2024-04-25T09:01:51.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fd931600640 1 -- 172.21.15.59:0/743044265 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920011c80 con 0x7fd934071dd0 2024-04-25T09:01:51.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7f3a01600640 1 -- 172.21.15.59:0/1833367279 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39fc0af400 con 0x7f3a04161fc0 2024-04-25T09:01:51.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9340cd690 con 0x7fd934071dd0 2024-04-25T09:01:51.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7f09c3400640 1 -- 172.21.15.59:0/431182857 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09bc000e50 con 0x7f09cc15b090 2024-04-25T09:01:51.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7f09c3400640 1 -- 172.21.15.59:0/431182857 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09bc0b0040 con 0x7f09cc15b090 2024-04-25T09:01:51.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7f1e57400640 1 -- 172.21.15.59:0/2459621331 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1e500ab030 con 0x7f1e60163610 2024-04-25T09:01:51.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9340cdc10 con 0x7fd934071dd0 2024-04-25T09:01:51.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fef7fe00640 1 -- 172.21.15.59:0/837705890 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef780b8020 con 0x7fef8815c710 2024-04-25T09:01:51.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fef8ee00640 1 -- 172.21.15.59:0/837705890 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef881fe560 con 0x7fef8815c710 2024-04-25T09:01:51.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fef7fe00640 1 -- 172.21.15.59:0/837705890 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef780abe50 con 0x7fef8815c710 2024-04-25T09:01:51.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fef7fe00640 1 -- 172.21.15.59:0/837705890 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef780b0040 con 0x7fef8815c710 2024-04-25T09:01:51.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7fef8ee00640 1 -- 172.21.15.59:0/837705890 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef881feb20 con 0x7fef8815c710 2024-04-25T09:01:51.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.876+0000 7f3a01600640 1 -- 172.21.15.59:0/1833367279 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39fc0afdd0 con 0x7f3a04161fc0 2024-04-25T09:01:51.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fca91800640 1 Processor -- start 2024-04-25T09:01:51.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7f09c3400640 1 -- 172.21.15.59:0/431182857 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f09bc0bc020 con 0x7f09cc15b090 2024-04-25T09:01:51.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fca91800640 1 -- start start 2024-04-25T09:01:51.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7f09c3400640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09a8066f60 0x7f09a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7f09c3400640 1 -- 172.21.15.59:0/431182857 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f09bc11f680 con 0x7f09cc15b090 2024-04-25T09:01:51.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fd931600640 1 -- 172.21.15.59:0/743044265 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd920018020 con 0x7fd934071dd0 2024-04-25T09:01:51.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fca91800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca8c071ac0 0x7fca8c14ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fca91800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c0cedf0 0x7fca8c1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fca91800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8c161620 0x7fca8c15bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fd931600640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd914066f90 0x7fd914069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fca91800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c06eb50 con 0x7fca8c161620 2024-04-25T09:01:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fca91800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c06e9d0 con 0x7fca8c071ac0 2024-04-25T09:01:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fca91800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8c16b1d0 con 0x7fca8c0cedf0 2024-04-25T09:01:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fca83e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c0cedf0 0x7fca8c1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fca83e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c0cedf0 0x7fca8c1549a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:46960/0 (socket says 172.21.15.59:46960) 2024-04-25T09:01:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.880+0000 7fca83e00640 1 -- 172.21.15.59:0/2230970116 learned_addr learned my addr 172.21.15.59:0/2230970116 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fca83e00640 1 -- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca8c071ac0 msgr2=0x7fca8c14ac20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T09:01:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fca83e00640 1 --2- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca8c071ac0 0x7fca8c14ac20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fca83e00640 1 -- 172.21.15.59:0/2230970116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8c161620 msgr2=0x7fca8c15bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fca83e00640 1 --2- 172.21.15.59:0/2230970116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8c161620 0x7fca8c15bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:51.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fca83e00640 1 -- 172.21.15.59:0/2230970116 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c149e60 con 0x7fca8c0cedf0 2024-04-25T09:01:51.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fd939200640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd914066f90 0x7fd914069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7f09c3400640 1 -- 172.21.15.59:0/431182857 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f09bc0c3070 con 0x7f09cc15b090 2024-04-25T09:01:51.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fd931600640 1 -- 172.21.15.59:0/743044265 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd920089060 con 0x7fd934071dd0 2024-04-25T09:01:51.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9340745d0 con 0x7fd934071dd0 2024-04-25T09:01:51.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fca83e00640 1 --2- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c0cedf0 0x7fca8c1549a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca7400e9b0 tx=0x7fca7400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fca82a00640 1 -- 172.21.15.59:0/2230970116 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74017070 con 0x7fca8c0cedf0 2024-04-25T09:01:51.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fca82a00640 1 -- 172.21.15.59:0/2230970116 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7400ca00 con 0x7fca8c0cedf0 2024-04-25T09:01:51.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fca82a00640 1 -- 172.21.15.59:0/2230970116 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7400cdb0 con 0x7fca8c0cedf0 2024-04-25T09:01:51.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fca91800640 1 -- 172.21.15.59:0/2230970116 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8c14a140 con 0x7fca8c0cedf0 2024-04-25T09:01:51.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fca91800640 1 -- 172.21.15.59:0/2230970116 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8c14a700 con 0x7fca8c0cedf0 2024-04-25T09:01:51.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fef8ee00640 1 -- 172.21.15.59:0/837705890 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef880745d0 con 0x7fef8815c710 2024-04-25T09:01:51.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7f3a01600640 1 -- 172.21.15.59:0/1833367279 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f39fc0c1030 con 0x7f3a04161fc0 2024-04-25T09:01:51.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7f09caa00640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09a8066f60 0x7f09a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7f09caa00640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09a8066f60 0x7f09a8069420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f09c40113e0 tx=0x7f09c400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.884+0000 7fca91800640 1 -- 172.21.15.59:0/2230970116 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8c0745d0 con 0x7fca8c0cedf0 2024-04-25T09:01:51.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.888+0000 7f3a01600640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f39e4066f90 0x7f39e4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.888+0000 7f3a01600640 1 -- 172.21.15.59:0/1833367279 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f39fc123230 con 0x7f3a04161fc0 2024-04-25T09:01:51.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.888+0000 7f3a01600640 1 -- 172.21.15.59:0/1833367279 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f39fc0c8020 con 0x7f3a04161fc0 2024-04-25T09:01:51.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.888+0000 7f3a09a00640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f39e4066f90 0x7f39e4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.888+0000 7fd939200640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd914066f90 0x7fd914069450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd934156c20 tx=0x7fd9280090e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.888+0000 7fd931600640 1 -- 172.21.15.59:0/743044265 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd92000d040 con 0x7fd934071dd0 2024-04-25T09:01:51.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.888+0000 7f3a09a00640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f39e4066f90 0x7f39e4069450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39f0007fd0 tx=0x7f39f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.892+0000 7fef7fe00640 1 -- 172.21.15.59:0/837705890 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fef780bb020 con 0x7fef8815c710 2024-04-25T09:01:51.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.892+0000 7fef7fe00640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef68066f60 0x7fef68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.892+0000 7fef7fe00640 1 -- 172.21.15.59:0/837705890 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fef7811f770 con 0x7fef8815c710 2024-04-25T09:01:51.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.896+0000 7fef87e00640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef68066f60 0x7fef68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.896+0000 7fef87e00640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef68066f60 0x7fef68069420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fef74000c10 tx=0x7fef74007dd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:51.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.896+0000 7fca82a00640 1 -- 172.21.15.59:0/2230970116 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fca7401a070 con 0x7fca8c0cedf0 2024-04-25T09:01:51.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.900+0000 7fef7fe00640 1 -- 172.21.15.59:0/837705890 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fef78016070 con 0x7fef8815c710 2024-04-25T09:01:51.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.900+0000 7fca82a00640 1 --2- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca68067030 0x7fca680694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:51.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.900+0000 7fca82a00640 1 -- 172.21.15.59:0/2230970116 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fca74085aa0 con 0x7fca8c0cedf0 2024-04-25T09:01:51.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.900+0000 7fca82a00640 1 -- 172.21.15.59:0/2230970116 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fca740b0d30 con 0x7fca8c0cedf0 2024-04-25T09:01:51.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.900+0000 7fca8aa00640 1 --2- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca68067030 0x7fca680694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:51.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:51.908+0000 7fca8aa00640 1 --2- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca68067030 0x7fca680694f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0ad000 tx=0x7fca7c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.216+0000 7f1e66600640 1 -- 172.21.15.59:0/2459621331 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1e6015cd80 con 0x7f1e60163610 2024-04-25T09:01:52.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.216+0000 7f1e57400640 1 -- 172.21.15.59:0/2459621331 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1e50015f90 con 0x7f1e60163610 2024-04-25T09:01:52.209 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2024-04-25T09:01:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.220+0000 7f1e66600640 1 -- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e40067030 msgr2=0x7f1e400694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.220+0000 7f1e66600640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e40067030 0x7f1e400694f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c000c10 tx=0x7f1e4c007c30 comp rx=0 tx=0).stop 2024-04-25T09:01:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.220+0000 7f1e66600640 1 -- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e60163610 msgr2=0x7f1e6015a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.220+0000 7f1e66600640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e60163610 0x7f1e6015a8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1e50019d70 tx=0x7f1e5001a770 comp rx=0 tx=0).stop 2024-04-25T09:01:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7f1e66600640 1 -- 172.21.15.59:0/2459621331 shutdown_connections 2024-04-25T09:01:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7f1e66600640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e40067030 0x7f1e400694f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7f1e66600640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e60163610 0x7f1e6015a8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7f1e66600640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e6015c710 0x7f1e601532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7f1e66600640 1 --2- 172.21.15.59:0/2459621331 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e6015c330 0x7f1e600adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7f1e66600640 1 -- 172.21.15.59:0/2459621331 >> 172.21.15.59:0/2459621331 conn(0x7f1e60067080 msgr2=0x7f1e601643a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7f1e66600640 1 -- 172.21.15.59:0/2459621331 shutdown_connections 2024-04-25T09:01:52.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7f1e66600640 1 -- 172.21.15.59:0/2459621331 wait complete. 2024-04-25T09:01:52.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7ff9cf200640 1 -- 172.21.15.59:0/3670276788 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff9d014bbe0 con 0x7ff9d0150ba0 2024-04-25T09:01:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7ff9c6000640 1 -- 172.21.15.59:0/3670276788 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9c8055650 con 0x7ff9d0150ba0 2024-04-25T09:01:52.215 INFO:teuthology.orchestra.run.smithi059.stdout:55834574857 2024-04-25T09:01:52.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7f09cbe00640 1 -- 172.21.15.59:0/431182857 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f09cc164740 con 0x7f09cc15b090 2024-04-25T09:01:52.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7fbc33a00640 1 -- 172.21.15.59:0/2600749041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbc04005590 con 0x7fbc2c071270 2024-04-25T09:01:52.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.224+0000 7f09c3400640 1 -- 172.21.15.59:0/431182857 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09bc016050 con 0x7f09cc15b090 2024-04-25T09:01:52.216 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2024-04-25T09:01:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7ff9cf200640 1 -- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff9ac067030 msgr2=0x7ff9ac0694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7ff9cf200640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff9ac067030 0x7ff9ac0694f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00af000 tx=0x7ff9c00a7000 comp rx=0 tx=0).stop 2024-04-25T09:01:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7ff9cf200640 1 -- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9d0150ba0 msgr2=0x7ff9d00b0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7ff9cf200640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9d0150ba0 0x7ff9d00b0270 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9c800b970 tx=0x7ff9c800be30 comp rx=0 tx=0).stop 2024-04-25T09:01:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7ff9cf200640 1 -- 172.21.15.59:0/3670276788 shutdown_connections 2024-04-25T09:01:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7ff9cf200640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff9ac067030 0x7ff9ac0694f0 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00af000 tx=0x7ff9c00a7000 comp rx=0 tx=0).stop 2024-04-25T09:01:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7ff9cf200640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff9d0150ba0 0x7ff9d00b0270 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7ff9cf200640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff9d00b1e20 0x7ff9d0152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7ff9cf200640 1 --2- 172.21.15.59:0/3670276788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9d00aee40 0x7ff9d0202e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7ff9cf200640 1 -- 172.21.15.59:0/3670276788 >> 172.21.15.59:0/3670276788 conn(0x7ff9d00b1300 msgr2=0x7ff9d006db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7fbc28c00640 1 -- 172.21.15.59:0/2600749041 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc1c0554d0 con 0x7fbc2c071270 2024-04-25T09:01:52.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd9340b2480 con 0x7fd934071dd0 2024-04-25T09:01:52.220 INFO:teuthology.orchestra.run.smithi059.stdout:55834574857 2024-04-25T09:01:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7f09cbe00640 1 -- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09a8066f60 msgr2=0x7f09a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7f09cbe00640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09a8066f60 0x7f09a8069420 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f09c40113e0 tx=0x7f09c400b040 comp rx=0 tx=0).stop 2024-04-25T09:01:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7f09cbe00640 1 -- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09cc15b090 msgr2=0x7f09cc16b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7f09cbe00640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09cc15b090 0x7f09cc16b250 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0ab000 tx=0x7f09bc0190b0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7ff9cf200640 1 -- 172.21.15.59:0/3670276788 shutdown_connections 2024-04-25T09:01:52.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7ff9cf200640 1 -- 172.21.15.59:0/3670276788 wait complete. 2024-04-25T09:01:52.222 INFO:teuthology.orchestra.run.smithi059.stdout:55834574857 2024-04-25T09:01:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7f09cbe00640 1 -- 172.21.15.59:0/431182857 shutdown_connections 2024-04-25T09:01:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7f09cbe00640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09a8066f60 0x7f09a8069420 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7f09cbe00640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09cc15b090 0x7f09cc16b250 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7f09cbe00640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09cc0b1de0 0x7f09cc16ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7f09cbe00640 1 --2- 172.21.15.59:0/431182857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09cc06eee0 0x7f09cc169140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7f09cbe00640 1 -- 172.21.15.59:0/431182857 >> 172.21.15.59:0/431182857 conn(0x7f09cc0b12c0 msgr2=0x7f09cc0b16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7f09cbe00640 1 -- 172.21.15.59:0/431182857 shutdown_connections 2024-04-25T09:01:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7f09cbe00640 1 -- 172.21.15.59:0/431182857 wait complete. 2024-04-25T09:01:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.228+0000 7fd931600640 1 -- 172.21.15.59:0/743044265 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd920011e20 con 0x7fd934071dd0 2024-04-25T09:01:52.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3a040b0f80 con 0x7f3a04161fc0 2024-04-25T09:01:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fbc33a00640 1 -- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbc0c067060 msgr2=0x7fbc0c069520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fbc33a00640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbc0c067060 0x7fbc0c069520 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009580 tx=0x7fbc18008040 comp rx=0 tx=0).stop 2024-04-25T09:01:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fbc33a00640 1 -- 172.21.15.59:0/2600749041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c071270 msgr2=0x7fbc2c163ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fbc33a00640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c071270 0x7fbc2c163ed0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00c470 tx=0x7fbc1c00c930 comp rx=0 tx=0).stop 2024-04-25T09:01:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fbc33a00640 1 -- 172.21.15.59:0/2600749041 shutdown_connections 2024-04-25T09:01:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fbc33a00640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbc0c067060 0x7fbc0c069520 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fbc33a00640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc2c159c80 0x7fbc2c138c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fbc33a00640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc2c1598a0 0x7fbc2c138300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fbc33a00640 1 --2- 172.21.15.59:0/2600749041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc2c071270 0x7fbc2c163ed0 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00c470 tx=0x7fbc1c00c930 comp rx=0 tx=0).stop 2024-04-25T09:01:52.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fbc33a00640 1 -- 172.21.15.59:0/2600749041 >> 172.21.15.59:0/2600749041 conn(0x7fbc2c06b010 msgr2=0x7fbc2c157820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fbc33a00640 1 -- 172.21.15.59:0/2600749041 shutdown_connections 2024-04-25T09:01:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd914066f90 msgr2=0x7fd914069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fd93c600640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd914066f90 0x7fd914069450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd934156c20 tx=0x7fd9280090e0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd934071dd0 msgr2=0x7fd9340cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fd93c600640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd934071dd0 0x7fd9340cebb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd92000b440 tx=0x7fd92000b900 comp rx=0 tx=0).stop 2024-04-25T09:01:52.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7f3a01600640 1 -- 172.21.15.59:0/1833367279 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f39fc018d70 con 0x7f3a04161fc0 2024-04-25T09:01:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fbc33a00640 1 -- 172.21.15.59:0/2600749041 wait complete. 2024-04-25T09:01:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 shutdown_connections 2024-04-25T09:01:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fd93c600640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd914066f90 0x7fd914069450 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fd93c600640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9340b3ea0 0x7fd93414d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fd93c600640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9340725d0 0x7fd93415d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fd93c600640 1 --2- 172.21.15.59:0/743044265 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd934071dd0 0x7fd9340cebb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 >> 172.21.15.59:0/743044265 conn(0x7fd9340b17b0 msgr2=0x7fd9341563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.226 INFO:teuthology.orchestra.run.smithi059.stdout:55834574857 2024-04-25T09:01:52.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 shutdown_connections 2024-04-25T09:01:52.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.232+0000 7fd93c600640 1 -- 172.21.15.59:0/743044265 wait complete. 2024-04-25T09:01:52.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.236+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f39e4066f90 msgr2=0x7f39e4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.236+0000 7f3a0c400640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f39e4066f90 0x7f39e4069450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f39f0007fd0 tx=0x7f39f0009040 comp rx=0 tx=0).stop 2024-04-25T09:01:52.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.236+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a04161fc0 msgr2=0x7f3a0414bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.236+0000 7f3a0c400640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a04161fc0 0x7f3a0414bc60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0ae000 tx=0x7f39fc01bfb0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.236+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 shutdown_connections 2024-04-25T09:01:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.236+0000 7f3a0c400640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f39e4066f90 0x7f39e4069450 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.236+0000 7f3a0c400640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a04163d00 0x7f3a0414c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.236+0000 7f3a0c400640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a04161fc0 0x7f3a0414bc60 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0ae000 tx=0x7f39fc01bfb0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.236+0000 7f3a0c400640 1 --2- 172.21.15.59:0/1833367279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a0406bd20 0x7f3a0414a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.236+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 >> 172.21.15.59:0/1833367279 conn(0x7f3a0406f510 msgr2=0x7f3a0414d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.236+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 shutdown_connections 2024-04-25T09:01:52.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.236+0000 7f3a0c400640 1 -- 172.21.15.59:0/1833367279 wait complete. 2024-04-25T09:01:52.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.252+0000 7fef8ee00640 1 -- 172.21.15.59:0/837705890 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fef88162c10 con 0x7fef8815c710 2024-04-25T09:01:52.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.252+0000 7fef7fe00640 1 -- 172.21.15.59:0/837705890 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef780f4e20 con 0x7fef8815c710 2024-04-25T09:01:52.245 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2024-04-25T09:01:52.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fef8ee00640 1 -- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef68066f60 msgr2=0x7fef68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fef8ee00640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef68066f60 0x7fef68069420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fef74000c10 tx=0x7fef74007dd0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fef8ee00640 1 -- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef8815c710 msgr2=0x7fef8814f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fef8ee00640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef8815c710 0x7fef8814f3f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fef780097c0 tx=0x7fef780190d0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fef8ee00640 1 -- 172.21.15.59:0/837705890 shutdown_connections 2024-04-25T09:01:52.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fef8ee00640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef68066f60 0x7fef68069420 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fef8ee00640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88163610 0x7fef880af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fef8ee00640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef8815c710 0x7fef8814f3f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fef8ee00640 1 --2- 172.21.15.59:0/837705890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef8815c330 0x7fef88153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fef8ee00640 1 -- 172.21.15.59:0/837705890 >> 172.21.15.59:0/837705890 conn(0x7fef88067080 msgr2=0x7fef881624c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fef8ee00640 1 -- 172.21.15.59:0/837705890 shutdown_connections 2024-04-25T09:01:52.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fef8ee00640 1 -- 172.21.15.59:0/837705890 wait complete. 2024-04-25T09:01:52.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.256+0000 7fca91800640 1 -- 172.21.15.59:0/2230970116 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fca8c0b43e0 con 0x7fca8c0cedf0 2024-04-25T09:01:52.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.260+0000 7fca82a00640 1 -- 172.21.15.59:0/2230970116 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca74056750 con 0x7fca8c0cedf0 2024-04-25T09:01:52.251 INFO:teuthology.orchestra.run.smithi059.stdout:55834574858 2024-04-25T09:01:52.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-04-25T09:01:52.257 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:52.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.264+0000 7fca91800640 1 -- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca68067030 msgr2=0x7fca680694f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.264+0000 7fca91800640 1 --2- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca68067030 0x7fca680694f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0ad000 tx=0x7fca7c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:01:52.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.264+0000 7fca91800640 1 -- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c0cedf0 msgr2=0x7fca8c1549a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.264+0000 7fca91800640 1 --2- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c0cedf0 0x7fca8c1549a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fca7400e9b0 tx=0x7fca7400ee70 comp rx=0 tx=0).stop 2024-04-25T09:01:52.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.264+0000 7fca91800640 1 -- 172.21.15.59:0/2230970116 shutdown_connections 2024-04-25T09:01:52.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.264+0000 7fca91800640 1 --2- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca68067030 0x7fca680694f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.264+0000 7fca91800640 1 --2- 172.21.15.59:0/2230970116 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca8c161620 0x7fca8c15bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.264+0000 7fca91800640 1 --2- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca8c0cedf0 0x7fca8c1549a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.264+0000 7fca91800640 1 --2- 172.21.15.59:0/2230970116 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca8c071ac0 0x7fca8c14ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.264+0000 7fca91800640 1 -- 172.21.15.59:0/2230970116 >> 172.21.15.59:0/2230970116 conn(0x7fca8c06b010 msgr2=0x7fca8c160700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.264+0000 7fca91800640 1 -- 172.21.15.59:0/2230970116 shutdown_connections 2024-04-25T09:01:52.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.264+0000 7fca91800640 1 -- 172.21.15.59:0/2230970116 wait complete. 2024-04-25T09:01:52.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-04-25T09:01:52.266 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:52.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-25T09:01:52.268 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:52.268 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-04-25T09:01:52.269 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:52.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-04-25T09:01:52.270 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:52.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-04-25T09:01:52.273 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:52.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-04-25T09:01:52.282 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:52.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-04-25T09:01:52.286 DEBUG:teuthology.parallel:result is None 2024-04-25T09:01:52.286 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:01:52.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:52.359 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:52.375 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:01:52.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.476+0000 7f88bd200640 1 Processor -- start 2024-04-25T09:01:52.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.476+0000 7f88bd200640 1 -- start start 2024-04-25T09:01:52.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88bd200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f88b815b5a0 0x7f88b80cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88bd200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b80cc440 0x7f88b80d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88bd200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b80ce7f0 con 0x7f88b815b980 2024-04-25T09:01:52.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88bd200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b80cfcd0 con 0x7f88b815b5a0 2024-04-25T09:01:52.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88bd200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80cead0 con 0x7f88b80cc440 2024-04-25T09:01:52.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88b5e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f88b815b5a0 0x7f88b80cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88b6800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b80cc440 0x7f88b80d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88b5e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f88b815b5a0 0x7f88b80cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:56204/0 (socket says 172.21.15.59:56204) 2024-04-25T09:01:52.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88ad400640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f88b815b980 0x7f88b80cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:45692/0 (socket says 172.21.15.59:45692) 2024-04-25T09:01:52.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88b5e00640 1 -- 172.21.15.59:0/3899923215 learned_addr learned my addr 172.21.15.59:0/3899923215 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:52.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88b5e00640 1 -- 172.21.15.59:0/3899923215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b80cc440 msgr2=0x7f88b80d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:52.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88b5e00640 1 --2- 172.21.15.59:0/3899923215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b80cc440 0x7f88b80d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88b5e00640 1 -- 172.21.15.59:0/3899923215 >> v1:172.21.15.178:6789/0 conn(0x7f88b815b980 legacy=0x7f88b80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88b5e00640 1 -- 172.21.15.59:0/3899923215 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80cf960 con 0x7f88b815b5a0 2024-04-25T09:01:52.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.480+0000 7f88b5400640 1 -- 172.21.15.59:0/3899923215 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406771171 0 0) 0x7f88b80ce7f0 con 0x7f88b815b980 2024-04-25T09:01:52.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88b5e00640 1 --2- 172.21.15.59:0/3899923215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b815b5a0 0x7f88b80cdea0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009870 tx=0x7f88a801c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe80a785e6edd5ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:52.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88b5400640 1 -- 172.21.15.59:0/3899923215 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a80a9640 con 0x7f88b815b5a0 2024-04-25T09:01:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88b5400640 1 -- 172.21.15.59:0/3899923215 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a80a97e0 con 0x7f88b815b5a0 2024-04-25T09:01:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88b5400640 1 -- 172.21.15.59:0/3899923215 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a80a9bb0 con 0x7f88b815b5a0 2024-04-25T09:01:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88bd200640 1 -- 172.21.15.59:0/3899923215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b815b5a0 msgr2=0x7f88b80cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88bd200640 1 --2- 172.21.15.59:0/3899923215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b815b5a0 0x7f88b80cdea0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f88a8009870 tx=0x7f88a801c560 comp rx=0 tx=0).stop 2024-04-25T09:01:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88bd200640 1 -- 172.21.15.59:0/3899923215 shutdown_connections 2024-04-25T09:01:52.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88bd200640 1 --2- 172.21.15.59:0/3899923215 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b80cc440 0x7f88b80d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88bd200640 1 --2- 172.21.15.59:0/3899923215 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b815b5a0 0x7f88b80cdea0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88bd200640 1 -- 172.21.15.59:0/3899923215 >> 172.21.15.59:0/3899923215 conn(0x7f88b80b3390 msgr2=0x7f88b80b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88bd200640 1 -- 172.21.15.59:0/3899923215 shutdown_connections 2024-04-25T09:01:52.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88bd200640 1 -- 172.21.15.59:0/3899923215 wait complete. 2024-04-25T09:01:52.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.484+0000 7f88bd200640 1 Processor -- start 2024-04-25T09:01:52.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88bd200640 1 -- start start 2024-04-25T09:01:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88bd200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b80cc440 0x7f88b8153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88bd200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b815b5a0 0x7f88b80c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88bd200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b815b980 0x7f88b80c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88bd200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80d1240 con 0x7f88b80cc440 2024-04-25T09:01:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88bd200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80d10c0 con 0x7f88b815b980 2024-04-25T09:01:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88bd200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b80d13c0 con 0x7f88b815b5a0 2024-04-25T09:01:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88b5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b80cc440 0x7f88b8153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88b5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b80cc440 0x7f88b8153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35154/0 (socket says 172.21.15.59:35154) 2024-04-25T09:01:52.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88b5e00640 1 -- 172.21.15.59:0/1827206797 learned_addr learned my addr 172.21.15.59:0/1827206797 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:52.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88ad400640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b815b5a0 0x7f88b80c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88b6800640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b815b980 0x7f88b80c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88b5e00640 1 -- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b815b5a0 msgr2=0x7f88b80c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88b5e00640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b815b5a0 0x7f88b80c6c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88b5e00640 1 -- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b815b980 msgr2=0x7f88b80c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88b5e00640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b815b980 0x7f88b80c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88b5e00640 1 -- 172.21.15.59:0/1827206797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8154550 con 0x7f88b80cc440 2024-04-25T09:01:52.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88b5e00640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b80cc440 0x7f88b8153090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f88a80ab040 tx=0x7f88a801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:52.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88aea00640 1 -- 172.21.15.59:0/1827206797 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a80b1900 con 0x7f88b80cc440 2024-04-25T09:01:52.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88aea00640 1 -- 172.21.15.59:0/1827206797 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a80b1ac0 con 0x7f88b80cc440 2024-04-25T09:01:52.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88aea00640 1 -- 172.21.15.59:0/1827206797 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a80bc450 con 0x7f88b80cc440 2024-04-25T09:01:52.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88bd200640 1 -- 172.21.15.59:0/1827206797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b8154830 con 0x7f88b80cc440 2024-04-25T09:01:52.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88bd200640 1 -- 172.21.15.59:0/1827206797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b80c79c0 con 0x7f88b80cc440 2024-04-25T09:01:52.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.488+0000 7f88bd200640 1 -- 172.21.15.59:0/1827206797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b8150a80 con 0x7f88b80cc440 2024-04-25T09:01:52.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.492+0000 7f88aea00640 1 -- 172.21.15.59:0/1827206797 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f88a80bc5f0 con 0x7f88b80cc440 2024-04-25T09:01:52.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.492+0000 7f88aea00640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8894066f90 0x7f8894069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.492+0000 7f88aea00640 1 -- 172.21.15.59:0/1827206797 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f88a811fbf0 con 0x7f88b80cc440 2024-04-25T09:01:52.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.492+0000 7f88ad400640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8894066f90 0x7f8894069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.492+0000 7f88ad400640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8894066f90 0x7f8894069450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f88b8153020 tx=0x7f88a0001690 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:52.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.496+0000 7f88aea00640 1 -- 172.21.15.59:0/1827206797 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f88a80c3030 con 0x7f88b80cc440 2024-04-25T09:01:52.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.652+0000 7f88bd200640 1 -- 172.21.15.59:0/1827206797 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88b80745d0 con 0x7f8894066f90 2024-04-25T09:01:52.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.664+0000 7f88aea00640 1 -- 172.21.15.59:0/1827206797 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332538 (secure 0 0 0) 0x7f88b80745d0 con 0x7f8894066f90 2024-04-25T09:01:52.657 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:52.660 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:01:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.668+0000 7f88bd200640 1 -- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8894066f90 msgr2=0x7f8894069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.668+0000 7f88bd200640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8894066f90 0x7f8894069450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f88b8153020 tx=0x7f88a0001690 comp rx=0 tx=0).stop 2024-04-25T09:01:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.668+0000 7f88bd200640 1 -- 172.21.15.59:0/1827206797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b80cc440 msgr2=0x7f88b8153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.668+0000 7f88bd200640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b80cc440 0x7f88b8153090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f88a80ab040 tx=0x7f88a801ada0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.668+0000 7f88bd200640 1 -- 172.21.15.59:0/1827206797 shutdown_connections 2024-04-25T09:01:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.668+0000 7f88bd200640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8894066f90 0x7f8894069450 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.668+0000 7f88bd200640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88b815b980 0x7f88b80c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.668+0000 7f88bd200640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88b815b5a0 0x7f88b80c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.668+0000 7f88bd200640 1 --2- 172.21.15.59:0/1827206797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88b80cc440 0x7f88b8153090 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.668+0000 7f88bd200640 1 -- 172.21.15.59:0/1827206797 >> 172.21.15.59:0/1827206797 conn(0x7f88b80b3390 msgr2=0x7f88b80b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.668+0000 7f88bd200640 1 -- 172.21.15.59:0/1827206797 shutdown_connections 2024-04-25T09:01:52.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.668+0000 7f88bd200640 1 -- 172.21.15.59:0/1827206797 wait complete. 2024-04-25T09:01:52.679 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-25T09:01:51.653201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223552,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751168,"statfs":{"total":773094113280,"available":772865196032,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003288"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709883+0000","last_change":"2024-04-25T09:01:27.802877+0000","last_active":"2024-04-25T09:01:34.709883+0000","last_peered":"2024-04-25T09:01:34.709883+0000","last_clean":"2024-04-25T09:01:34.709883+0000","last_became_active":"2024-04-25T09:01:27.802618+0000","last_became_peered":"2024-04-25T09:01:27.802618+0000","last_unstale":"2024-04-25T09:01:34.709883+0000","last_undegraded":"2024-04-25T09:01:34.709883+0000","last_fullsized":"2024-04-25T09:01:34.709883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:46.579225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210158+0000","last_change":"2024-04-25T09:01:28.808316+0000","last_active":"2024-04-25T09:01:35.210158+0000","last_peered":"2024-04-25T09:01:35.210158+0000","last_clean":"2024-04-25T09:01:35.210158+0000","last_became_active":"2024-04-25T09:01:28.807978+0000","last_became_peered":"2024-04-25T09:01:28.807978+0000","last_unstale":"2024-04-25T09:01:35.210158+0000","last_undegraded":"2024-04-25T09:01:35.210158+0000","last_fullsized":"2024-04-25T09:01:35.210158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209468+0000","last_change":"2024-04-25T09:01:33.021098+0000","last_active":"2024-04-25T09:01:35.209468+0000","last_peered":"2024-04-25T09:01:35.209468+0000","last_clean":"2024-04-25T09:01:35.209468+0000","last_became_active":"2024-04-25T09:01:33.020732+0000","last_became_peered":"2024-04-25T09:01:33.020732+0000","last_unstale":"2024-04-25T09:01:35.209468+0000","last_undegraded":"2024-04-25T09:01:35.209468+0000","last_fullsized":"2024-04-25T09:01:35.209468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:07.978442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210332+0000","last_change":"2024-04-25T09:01:27.807081+0000","last_active":"2024-04-25T09:01:35.210332+0000","last_peered":"2024-04-25T09:01:35.210332+0000","last_clean":"2024-04-25T09:01:35.210332+0000","last_became_active":"2024-04-25T09:01:27.806124+0000","last_became_peered":"2024-04-25T09:01:27.806124+0000","last_unstale":"2024-04-25T09:01:35.210332+0000","last_undegraded":"2024-04-25T09:01:35.210332+0000","last_fullsized":"2024-04-25T09:01:35.210332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709611+0000","last_change":"2024-04-25T09:01:28.806486+0000","last_active":"2024-04-25T09:01:34.709611+0000","last_peered":"2024-04-25T09:01:34.709611+0000","last_clean":"2024-04-25T09:01:34.709611+0000","last_became_active":"2024-04-25T09:01:28.806206+0000","last_became_peered":"2024-04-25T09:01:28.806206+0000","last_unstale":"2024-04-25T09:01:34.709611+0000","last_undegraded":"2024-04-25T09:01:34.709611+0000","last_fullsized":"2024-04-25T09:01:34.709611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824971+0000","last_change":"2024-04-25T09:01:32.828219+0000","last_active":"2024-04-25T09:01:33.824971+0000","last_peered":"2024-04-25T09:01:33.824971+0000","last_clean":"2024-04-25T09:01:33.824971+0000","last_became_active":"2024-04-25T09:01:32.827815+0000","last_became_peered":"2024-04-25T09:01:32.827815+0000","last_unstale":"2024-04-25T09:01:33.824971+0000","last_undegraded":"2024-04-25T09:01:33.824971+0000","last_fullsized":"2024-04-25T09:01:33.824971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:43.814734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212850+0000","last_change":"2024-04-25T09:01:27.805262+0000","last_active":"2024-04-25T09:01:35.212850+0000","last_peered":"2024-04-25T09:01:35.212850+0000","last_clean":"2024-04-25T09:01:35.212850+0000","last_became_active":"2024-04-25T09:01:27.804980+0000","last_became_peered":"2024-04-25T09:01:27.804980+0000","last_unstale":"2024-04-25T09:01:35.212850+0000","last_undegraded":"2024-04-25T09:01:35.212850+0000","last_fullsized":"2024-04-25T09:01:35.212850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:56.895362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825657+0000","last_change":"2024-04-25T09:01:28.799263+0000","last_active":"2024-04-25T09:01:33.825657+0000","last_peered":"2024-04-25T09:01:33.825657+0000","last_clean":"2024-04-25T09:01:33.825657+0000","last_became_active":"2024-04-25T09:01:28.790548+0000","last_became_peered":"2024-04-25T09:01:28.790548+0000","last_unstale":"2024-04-25T09:01:33.825657+0000","last_undegraded":"2024-04-25T09:01:33.825657+0000","last_fullsized":"2024-04-25T09:01:33.825657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826075+0000","last_change":"2024-04-25T09:01:32.835550+0000","last_active":"2024-04-25T09:01:33.826075+0000","last_peered":"2024-04-25T09:01:33.826075+0000","last_clean":"2024-04-25T09:01:33.826075+0000","last_became_active":"2024-04-25T09:01:32.835109+0000","last_became_peered":"2024-04-25T09:01:32.835109+0000","last_unstale":"2024-04-25T09:01:33.826075+0000","last_undegraded":"2024-04-25T09:01:33.826075+0000","last_fullsized":"2024-04-25T09:01:33.826075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:17.901732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212354+0000","last_change":"2024-04-25T09:01:27.802652+0000","last_active":"2024-04-25T09:01:35.212354+0000","last_peered":"2024-04-25T09:01:35.212354+0000","last_clean":"2024-04-25T09:01:35.212354+0000","last_became_active":"2024-04-25T09:01:27.802321+0000","last_became_peered":"2024-04-25T09:01:27.802321+0000","last_unstale":"2024-04-25T09:01:35.212354+0000","last_undegraded":"2024-04-25T09:01:35.212354+0000","last_fullsized":"2024-04-25T09:01:35.212354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:11.367072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825050+0000","last_change":"2024-04-25T09:01:28.796900+0000","last_active":"2024-04-25T09:01:33.825050+0000","last_peered":"2024-04-25T09:01:33.825050+0000","last_clean":"2024-04-25T09:01:33.825050+0000","last_became_active":"2024-04-25T09:01:28.796459+0000","last_became_peered":"2024-04-25T09:01:28.796459+0000","last_unstale":"2024-04-25T09:01:33.825050+0000","last_undegraded":"2024-04-25T09:01:33.825050+0000","last_fullsized":"2024-04-25T09:01:33.825050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:13.869416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825689+0000","last_change":"2024-04-25T09:01:32.841506+0000","last_active":"2024-04-25T09:01:33.825689+0000","last_peered":"2024-04-25T09:01:33.825689+0000","last_clean":"2024-04-25T09:01:33.825689+0000","last_became_active":"2024-04-25T09:01:32.841067+0000","last_became_peered":"2024-04-25T09:01:32.841067+0000","last_unstale":"2024-04-25T09:01:33.825689+0000","last_undegraded":"2024-04-25T09:01:33.825689+0000","last_fullsized":"2024-04-25T09:01:33.825689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:32.727379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211892+0000","last_change":"2024-04-25T09:01:28.799287+0000","last_active":"2024-04-25T09:01:35.211892+0000","last_peered":"2024-04-25T09:01:35.211892+0000","last_clean":"2024-04-25T09:01:35.211892+0000","last_became_active":"2024-04-25T09:01:28.798965+0000","last_became_peered":"2024-04-25T09:01:28.798965+0000","last_unstale":"2024-04-25T09:01:35.211892+0000","last_undegraded":"2024-04-25T09:01:35.211892+0000","last_fullsized":"2024-04-25T09:01:35.211892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212311+0000","last_change":"2024-04-25T09:01:27.801318+0000","last_active":"2024-04-25T09:01:35.212311+0000","last_peered":"2024-04-25T09:01:35.212311+0000","last_clean":"2024-04-25T09:01:35.212311+0000","last_became_active":"2024-04-25T09:01:27.801007+0000","last_became_peered":"2024-04-25T09:01:27.801007+0000","last_unstale":"2024-04-25T09:01:35.212311+0000","last_undegraded":"2024-04-25T09:01:35.212311+0000","last_fullsized":"2024-04-25T09:01:35.212311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:55.635349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826766+0000","last_change":"2024-04-25T09:01:32.838021+0000","last_active":"2024-04-25T09:01:33.826766+0000","last_peered":"2024-04-25T09:01:33.826766+0000","last_clean":"2024-04-25T09:01:33.826766+0000","last_became_active":"2024-04-25T09:01:32.837635+0000","last_became_peered":"2024-04-25T09:01:32.837635+0000","last_unstale":"2024-04-25T09:01:33.826766+0000","last_undegraded":"2024-04-25T09:01:33.826766+0000","last_fullsized":"2024-04-25T09:01:33.826766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:50.922350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209879+0000","last_change":"2024-04-25T09:01:28.802944+0000","last_active":"2024-04-25T09:01:35.209879+0000","last_peered":"2024-04-25T09:01:35.209879+0000","last_clean":"2024-04-25T09:01:35.209879+0000","last_became_active":"2024-04-25T09:01:28.801259+0000","last_became_peered":"2024-04-25T09:01:28.801259+0000","last_unstale":"2024-04-25T09:01:35.209879+0000","last_undegraded":"2024-04-25T09:01:35.209879+0000","last_fullsized":"2024-04-25T09:01:35.209879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366553+0000","last_change":"2024-04-25T09:01:27.794293+0000","last_active":"2024-04-25T09:01:34.366553+0000","last_peered":"2024-04-25T09:01:34.366553+0000","last_clean":"2024-04-25T09:01:34.366553+0000","last_became_active":"2024-04-25T09:01:27.794093+0000","last_became_peered":"2024-04-25T09:01:27.794093+0000","last_unstale":"2024-04-25T09:01:34.366553+0000","last_undegraded":"2024-04-25T09:01:34.366553+0000","last_fullsized":"2024-04-25T09:01:34.366553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826446+0000","last_change":"2024-04-25T09:01:32.835417+0000","last_active":"2024-04-25T09:01:33.826446+0000","last_peered":"2024-04-25T09:01:33.826446+0000","last_clean":"2024-04-25T09:01:33.826446+0000","last_became_active":"2024-04-25T09:01:32.834900+0000","last_became_peered":"2024-04-25T09:01:32.834900+0000","last_unstale":"2024-04-25T09:01:33.826446+0000","last_undegraded":"2024-04-25T09:01:33.826446+0000","last_fullsized":"2024-04-25T09:01:33.826446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:12.234115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209538+0000","last_change":"2024-04-25T09:01:28.807676+0000","last_active":"2024-04-25T09:01:35.209538+0000","last_peered":"2024-04-25T09:01:35.209538+0000","last_clean":"2024-04-25T09:01:35.209538+0000","last_became_active":"2024-04-25T09:01:28.807412+0000","last_became_peered":"2024-04-25T09:01:28.807412+0000","last_unstale":"2024-04-25T09:01:35.209538+0000","last_undegraded":"2024-04-25T09:01:35.209538+0000","last_fullsized":"2024-04-25T09:01:35.209538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366319+0000","last_change":"2024-04-25T09:01:27.792801+0000","last_active":"2024-04-25T09:01:34.366319+0000","last_peered":"2024-04-25T09:01:34.366319+0000","last_clean":"2024-04-25T09:01:34.366319+0000","last_became_active":"2024-04-25T09:01:27.792478+0000","last_became_peered":"2024-04-25T09:01:27.792478+0000","last_unstale":"2024-04-25T09:01:34.366319+0000","last_undegraded":"2024-04-25T09:01:34.366319+0000","last_fullsized":"2024-04-25T09:01:34.366319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:05.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.367126+0000","last_change":"2024-04-25T09:01:33.016837+0000","last_active":"2024-04-25T09:01:34.367126+0000","last_peered":"2024-04-25T09:01:34.367126+0000","last_clean":"2024-04-25T09:01:34.367126+0000","last_became_active":"2024-04-25T09:01:33.016394+0000","last_became_peered":"2024-04-25T09:01:33.016394+0000","last_unstale":"2024-04-25T09:01:34.367126+0000","last_undegraded":"2024-04-25T09:01:34.367126+0000","last_fullsized":"2024-04-25T09:01:34.367126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:10.891366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825930+0000","last_change":"2024-04-25T09:01:28.797789+0000","last_active":"2024-04-25T09:01:33.825930+0000","last_peered":"2024-04-25T09:01:33.825930+0000","last_clean":"2024-04-25T09:01:33.825930+0000","last_became_active":"2024-04-25T09:01:28.794550+0000","last_became_peered":"2024-04-25T09:01:28.794550+0000","last_unstale":"2024-04-25T09:01:33.825930+0000","last_undegraded":"2024-04-25T09:01:33.825930+0000","last_fullsized":"2024-04-25T09:01:33.825930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:38.459019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211810+0000","last_change":"2024-04-25T09:01:27.807626+0000","last_active":"2024-04-25T09:01:35.211810+0000","last_peered":"2024-04-25T09:01:35.211810+0000","last_clean":"2024-04-25T09:01:35.211810+0000","last_became_active":"2024-04-25T09:01:27.807340+0000","last_became_peered":"2024-04-25T09:01:27.807340+0000","last_unstale":"2024-04-25T09:01:35.211810+0000","last_undegraded":"2024-04-25T09:01:35.211810+0000","last_fullsized":"2024-04-25T09:01:35.211810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:05.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826818+0000","last_change":"2024-04-25T09:01:32.835653+0000","last_active":"2024-04-25T09:01:33.826818+0000","last_peered":"2024-04-25T09:01:33.826818+0000","last_clean":"2024-04-25T09:01:33.826818+0000","last_became_active":"2024-04-25T09:01:32.834905+0000","last_became_peered":"2024-04-25T09:01:32.834905+0000","last_unstale":"2024-04-25T09:01:33.826818+0000","last_undegraded":"2024-04-25T09:01:33.826818+0000","last_fullsized":"2024-04-25T09:01:33.826818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:28.511146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709868+0000","last_change":"2024-04-25T09:01:28.808561+0000","last_active":"2024-04-25T09:01:34.709868+0000","last_peered":"2024-04-25T09:01:34.709868+0000","last_clean":"2024-04-25T09:01:34.709868+0000","last_became_active":"2024-04-25T09:01:28.808259+0000","last_became_peered":"2024-04-25T09:01:28.808259+0000","last_unstale":"2024-04-25T09:01:34.709868+0000","last_undegraded":"2024-04-25T09:01:34.709868+0000","last_fullsized":"2024-04-25T09:01:34.709868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213361+0000","last_change":"2024-04-25T09:01:27.796535+0000","last_active":"2024-04-25T09:01:35.213361+0000","last_peered":"2024-04-25T09:01:35.213361+0000","last_clean":"2024-04-25T09:01:35.213361+0000","last_became_active":"2024-04-25T09:01:27.794550+0000","last_became_peered":"2024-04-25T09:01:27.794550+0000","last_unstale":"2024-04-25T09:01:35.213361+0000","last_undegraded":"2024-04-25T09:01:35.213361+0000","last_fullsized":"2024-04-25T09:01:35.213361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825685+0000","last_change":"2024-04-25T09:01:33.017620+0000","last_active":"2024-04-25T09:01:33.825685+0000","last_peered":"2024-04-25T09:01:33.825685+0000","last_clean":"2024-04-25T09:01:33.825685+0000","last_became_active":"2024-04-25T09:01:33.017217+0000","last_became_peered":"2024-04-25T09:01:33.017217+0000","last_unstale":"2024-04-25T09:01:33.825685+0000","last_undegraded":"2024-04-25T09:01:33.825685+0000","last_fullsized":"2024-04-25T09:01:33.825685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:49.256635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210450+0000","last_change":"2024-04-25T09:01:28.800633+0000","last_active":"2024-04-25T09:01:35.210450+0000","last_peered":"2024-04-25T09:01:35.210450+0000","last_clean":"2024-04-25T09:01:35.210450+0000","last_became_active":"2024-04-25T09:01:28.800261+0000","last_became_peered":"2024-04-25T09:01:28.800261+0000","last_unstale":"2024-04-25T09:01:35.210450+0000","last_undegraded":"2024-04-25T09:01:35.210450+0000","last_fullsized":"2024-04-25T09:01:35.210450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:45.224319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.367056+0000","last_change":"2024-04-25T09:01:27.801362+0000","last_active":"2024-04-25T09:01:34.367056+0000","last_peered":"2024-04-25T09:01:34.367056+0000","last_clean":"2024-04-25T09:01:34.367056+0000","last_became_active":"2024-04-25T09:01:27.800960+0000","last_became_peered":"2024-04-25T09:01:27.800960+0000","last_unstale":"2024-04-25T09:01:34.367056+0000","last_undegraded":"2024-04-25T09:01:34.367056+0000","last_fullsized":"2024-04-25T09:01:34.367056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209644+0000","last_change":"2024-04-25T09:01:33.014181+0000","last_active":"2024-04-25T09:01:35.209644+0000","last_peered":"2024-04-25T09:01:35.209644+0000","last_clean":"2024-04-25T09:01:35.209644+0000","last_became_active":"2024-04-25T09:01:33.013656+0000","last_became_peered":"2024-04-25T09:01:33.013656+0000","last_unstale":"2024-04-25T09:01:35.209644+0000","last_undegraded":"2024-04-25T09:01:35.209644+0000","last_fullsized":"2024-04-25T09:01:35.209644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:05.608973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366825+0000","last_change":"2024-04-25T09:01:28.801779+0000","last_active":"2024-04-25T09:01:34.366825+0000","last_peered":"2024-04-25T09:01:34.366825+0000","last_clean":"2024-04-25T09:01:34.366825+0000","last_became_active":"2024-04-25T09:01:28.801429+0000","last_became_peered":"2024-04-25T09:01:28.801429+0000","last_unstale":"2024-04-25T09:01:34.366825+0000","last_undegraded":"2024-04-25T09:01:34.366825+0000","last_fullsized":"2024-04-25T09:01:34.366825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212914+0000","last_change":"2024-04-25T09:01:27.812215+0000","last_active":"2024-04-25T09:01:35.212914+0000","last_peered":"2024-04-25T09:01:35.212914+0000","last_clean":"2024-04-25T09:01:35.212914+0000","last_became_active":"2024-04-25T09:01:27.811906+0000","last_became_peered":"2024-04-25T09:01:27.811906+0000","last_unstale":"2024-04-25T09:01:35.212914+0000","last_undegraded":"2024-04-25T09:01:35.212914+0000","last_fullsized":"2024-04-25T09:01:35.212914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:40.543447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709529+0000","last_change":"2024-04-25T09:01:33.012476+0000","last_active":"2024-04-25T09:01:34.709529+0000","last_peered":"2024-04-25T09:01:34.709529+0000","last_clean":"2024-04-25T09:01:34.709529+0000","last_became_active":"2024-04-25T09:01:33.012051+0000","last_became_peered":"2024-04-25T09:01:33.012051+0000","last_unstale":"2024-04-25T09:01:34.709529+0000","last_undegraded":"2024-04-25T09:01:34.709529+0000","last_fullsized":"2024-04-25T09:01:34.709529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:10.891366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825182+0000","last_change":"2024-04-25T09:01:28.796673+0000","last_active":"2024-04-25T09:01:33.825182+0000","last_peered":"2024-04-25T09:01:33.825182+0000","last_clean":"2024-04-25T09:01:33.825182+0000","last_became_active":"2024-04-25T09:01:28.796137+0000","last_became_peered":"2024-04-25T09:01:28.796137+0000","last_unstale":"2024-04-25T09:01:33.825182+0000","last_undegraded":"2024-04-25T09:01:33.825182+0000","last_fullsized":"2024-04-25T09:01:33.825182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:24.478830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366854+0000","last_change":"2024-04-25T09:01:27.806338+0000","last_active":"2024-04-25T09:01:34.366854+0000","last_peered":"2024-04-25T09:01:34.366854+0000","last_clean":"2024-04-25T09:01:34.366854+0000","last_became_active":"2024-04-25T09:01:27.806001+0000","last_became_peered":"2024-04-25T09:01:27.806001+0000","last_unstale":"2024-04-25T09:01:34.366854+0000","last_undegraded":"2024-04-25T09:01:34.366854+0000","last_fullsized":"2024-04-25T09:01:34.366854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366354+0000","last_change":"2024-04-25T09:01:32.842661+0000","last_active":"2024-04-25T09:01:34.366354+0000","last_peered":"2024-04-25T09:01:34.366354+0000","last_clean":"2024-04-25T09:01:34.366354+0000","last_became_active":"2024-04-25T09:01:32.840675+0000","last_became_peered":"2024-04-25T09:01:32.840675+0000","last_unstale":"2024-04-25T09:01:34.366354+0000","last_undegraded":"2024-04-25T09:01:34.366354+0000","last_fullsized":"2024-04-25T09:01:34.366354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:28.511146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826233+0000","last_change":"2024-04-25T09:01:28.808388+0000","last_active":"2024-04-25T09:01:33.826233+0000","last_peered":"2024-04-25T09:01:33.826233+0000","last_clean":"2024-04-25T09:01:33.826233+0000","last_became_active":"2024-04-25T09:01:28.808066+0000","last_became_peered":"2024-04-25T09:01:28.808066+0000","last_unstale":"2024-04-25T09:01:33.826233+0000","last_undegraded":"2024-04-25T09:01:33.826233+0000","last_fullsized":"2024-04-25T09:01:33.826233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:25.394669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825354+0000","last_change":"2024-04-25T09:01:27.791322+0000","last_active":"2024-04-25T09:01:33.825354+0000","last_peered":"2024-04-25T09:01:33.825354+0000","last_clean":"2024-04-25T09:01:33.825354+0000","last_became_active":"2024-04-25T09:01:27.790832+0000","last_became_peered":"2024-04-25T09:01:27.790832+0000","last_unstale":"2024-04-25T09:01:33.825354+0000","last_undegraded":"2024-04-25T09:01:33.825354+0000","last_fullsized":"2024-04-25T09:01:33.825354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366775+0000","last_change":"2024-04-25T09:01:32.833388+0000","last_active":"2024-04-25T09:01:34.366775+0000","last_peered":"2024-04-25T09:01:34.366775+0000","last_clean":"2024-04-25T09:01:34.366775+0000","last_became_active":"2024-04-25T09:01:32.832933+0000","last_became_peered":"2024-04-25T09:01:32.832933+0000","last_unstale":"2024-04-25T09:01:34.366775+0000","last_undegraded":"2024-04-25T09:01:34.366775+0000","last_fullsized":"2024-04-25T09:01:34.366775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366415+0000","last_change":"2024-04-25T09:01:28.808496+0000","last_active":"2024-04-25T09:01:34.366415+0000","last_peered":"2024-04-25T09:01:34.366415+0000","last_clean":"2024-04-25T09:01:34.366415+0000","last_became_active":"2024-04-25T09:01:28.808041+0000","last_became_peered":"2024-04-25T09:01:28.808041+0000","last_unstale":"2024-04-25T09:01:34.366415+0000","last_undegraded":"2024-04-25T09:01:34.366415+0000","last_fullsized":"2024-04-25T09:01:34.366415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821744+0000","last_change":"2024-04-25T09:01:27.794633+0000","last_active":"2024-04-25T09:01:33.821744+0000","last_peered":"2024-04-25T09:01:33.821744+0000","last_clean":"2024-04-25T09:01:33.821744+0000","last_became_active":"2024-04-25T09:01:27.794353+0000","last_became_peered":"2024-04-25T09:01:27.794353+0000","last_unstale":"2024-04-25T09:01:33.821744+0000","last_undegraded":"2024-04-25T09:01:33.821744+0000","last_fullsized":"2024-04-25T09:01:33.821744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.367203+0000","last_change":"2024-04-25T09:01:32.841897+0000","last_active":"2024-04-25T09:01:34.367203+0000","last_peered":"2024-04-25T09:01:34.367203+0000","last_clean":"2024-04-25T09:01:34.367203+0000","last_became_active":"2024-04-25T09:01:32.840196+0000","last_became_peered":"2024-04-25T09:01:32.840196+0000","last_unstale":"2024-04-25T09:01:34.367203+0000","last_undegraded":"2024-04-25T09:01:34.367203+0000","last_fullsized":"2024-04-25T09:01:34.367203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:35.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.708999+0000","last_change":"2024-04-25T09:01:28.791325+0000","last_active":"2024-04-25T09:01:34.708999+0000","last_peered":"2024-04-25T09:01:34.708999+0000","last_clean":"2024-04-25T09:01:34.708999+0000","last_became_active":"2024-04-25T09:01:28.791016+0000","last_became_peered":"2024-04-25T09:01:28.791016+0000","last_unstale":"2024-04-25T09:01:34.708999+0000","last_undegraded":"2024-04-25T09:01:34.708999+0000","last_fullsized":"2024-04-25T09:01:34.708999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:57.905760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211553+0000","last_change":"2024-04-25T09:01:27.799619+0000","last_active":"2024-04-25T09:01:35.211553+0000","last_peered":"2024-04-25T09:01:35.211553+0000","last_clean":"2024-04-25T09:01:35.211553+0000","last_became_active":"2024-04-25T09:01:27.799353+0000","last_became_peered":"2024-04-25T09:01:27.799353+0000","last_unstale":"2024-04-25T09:01:35.211553+0000","last_undegraded":"2024-04-25T09:01:35.211553+0000","last_fullsized":"2024-04-25T09:01:35.211553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709772+0000","last_change":"2024-04-25T09:01:33.017927+0000","last_active":"2024-04-25T09:01:34.709772+0000","last_peered":"2024-04-25T09:01:34.709772+0000","last_clean":"2024-04-25T09:01:34.709772+0000","last_became_active":"2024-04-25T09:01:33.017228+0000","last_became_peered":"2024-04-25T09:01:33.017228+0000","last_unstale":"2024-04-25T09:01:34.709772+0000","last_undegraded":"2024-04-25T09:01:34.709772+0000","last_fullsized":"2024-04-25T09:01:34.709772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.980668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209536+0000","last_change":"2024-04-25T09:01:28.797698+0000","last_active":"2024-04-25T09:01:35.209536+0000","last_peered":"2024-04-25T09:01:35.209536+0000","last_clean":"2024-04-25T09:01:35.209536+0000","last_became_active":"2024-04-25T09:01:28.797432+0000","last_became_peered":"2024-04-25T09:01:28.797432+0000","last_unstale":"2024-04-25T09:01:35.209536+0000","last_undegraded":"2024-04-25T09:01:35.209536+0000","last_fullsized":"2024-04-25T09:01:35.209536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824821+0000","last_change":"2024-04-25T09:01:27.786713+0000","last_active":"2024-04-25T09:01:33.824821+0000","last_peered":"2024-04-25T09:01:33.824821+0000","last_clean":"2024-04-25T09:01:33.824821+0000","last_became_active":"2024-04-25T09:01:27.786382+0000","last_became_peered":"2024-04-25T09:01:27.786382+0000","last_unstale":"2024-04-25T09:01:33.824821+0000","last_undegraded":"2024-04-25T09:01:33.824821+0000","last_fullsized":"2024-04-25T09:01:33.824821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211687+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:01:35.211687+0000","last_peered":"2024-04-25T09:01:35.211687+0000","last_clean":"2024-04-25T09:01:35.211687+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:01:35.211687+0000","last_undegraded":"2024-04-25T09:01:35.211687+0000","last_fullsized":"2024-04-25T09:01:35.211687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213128+0000","last_change":"2024-04-25T09:01:33.018970+0000","last_active":"2024-04-25T09:01:35.213128+0000","last_peered":"2024-04-25T09:01:35.213128+0000","last_clean":"2024-04-25T09:01:35.213128+0000","last_became_active":"2024-04-25T09:01:33.018274+0000","last_became_peered":"2024-04-25T09:01:33.018274+0000","last_unstale":"2024-04-25T09:01:35.213128+0000","last_undegraded":"2024-04-25T09:01:35.213128+0000","last_fullsized":"2024-04-25T09:01:35.213128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212686+0000","last_change":"2024-04-25T09:01:28.821408+0000","last_active":"2024-04-25T09:01:35.212686+0000","last_peered":"2024-04-25T09:01:35.212686+0000","last_clean":"2024-04-25T09:01:35.212686+0000","last_became_active":"2024-04-25T09:01:28.821141+0000","last_became_peered":"2024-04-25T09:01:28.821141+0000","last_unstale":"2024-04-25T09:01:35.212686+0000","last_undegraded":"2024-04-25T09:01:35.212686+0000","last_fullsized":"2024-04-25T09:01:35.212686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:33.239521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821975+0000","last_change":"2024-04-25T09:01:27.789772+0000","last_active":"2024-04-25T09:01:33.821975+0000","last_peered":"2024-04-25T09:01:33.821975+0000","last_clean":"2024-04-25T09:01:33.821975+0000","last_became_active":"2024-04-25T09:01:27.789396+0000","last_became_peered":"2024-04-25T09:01:27.789396+0000","last_unstale":"2024-04-25T09:01:33.821975+0000","last_undegraded":"2024-04-25T09:01:33.821975+0000","last_fullsized":"2024-04-25T09:01:33.821975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212034+0000","last_change":"2024-04-25T09:01:33.015998+0000","last_active":"2024-04-25T09:01:35.212034+0000","last_peered":"2024-04-25T09:01:35.212034+0000","last_clean":"2024-04-25T09:01:35.212034+0000","last_became_active":"2024-04-25T09:01:33.015527+0000","last_became_peered":"2024-04-25T09:01:33.015527+0000","last_unstale":"2024-04-25T09:01:35.212034+0000","last_undegraded":"2024-04-25T09:01:35.212034+0000","last_fullsized":"2024-04-25T09:01:35.212034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:28.511146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825725+0000","last_change":"2024-04-25T09:01:28.799867+0000","last_active":"2024-04-25T09:01:33.825725+0000","last_peered":"2024-04-25T09:01:33.825725+0000","last_clean":"2024-04-25T09:01:33.825725+0000","last_became_active":"2024-04-25T09:01:28.799555+0000","last_became_peered":"2024-04-25T09:01:28.799555+0000","last_unstale":"2024-04-25T09:01:33.825725+0000","last_undegraded":"2024-04-25T09:01:33.825725+0000","last_fullsized":"2024-04-25T09:01:33.825725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:46.890034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366891+0000","last_change":"2024-04-25T09:01:27.799345+0000","last_active":"2024-04-25T09:01:34.366891+0000","last_peered":"2024-04-25T09:01:34.366891+0000","last_clean":"2024-04-25T09:01:34.366891+0000","last_became_active":"2024-04-25T09:01:27.799041+0000","last_became_peered":"2024-04-25T09:01:27.799041+0000","last_unstale":"2024-04-25T09:01:34.366891+0000","last_undegraded":"2024-04-25T09:01:34.366891+0000","last_fullsized":"2024-04-25T09:01:34.366891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709467+0000","last_change":"2024-04-25T09:01:32.848657+0000","last_active":"2024-04-25T09:01:34.709467+0000","last_peered":"2024-04-25T09:01:34.709467+0000","last_clean":"2024-04-25T09:01:34.709467+0000","last_became_active":"2024-04-25T09:01:32.848154+0000","last_became_peered":"2024-04-25T09:01:32.848154+0000","last_unstale":"2024-04-25T09:01:34.709467+0000","last_undegraded":"2024-04-25T09:01:34.709467+0000","last_fullsized":"2024-04-25T09:01:34.709467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213067+0000","last_change":"2024-04-25T09:01:28.816736+0000","last_active":"2024-04-25T09:01:35.213067+0000","last_peered":"2024-04-25T09:01:35.213067+0000","last_clean":"2024-04-25T09:01:35.213067+0000","last_became_active":"2024-04-25T09:01:28.814910+0000","last_became_peered":"2024-04-25T09:01:28.814910+0000","last_unstale":"2024-04-25T09:01:35.213067+0000","last_undegraded":"2024-04-25T09:01:35.213067+0000","last_fullsized":"2024-04-25T09:01:35.213067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:03.946126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.822115+0000","last_change":"2024-04-25T09:01:27.791793+0000","last_active":"2024-04-25T09:01:33.822115+0000","last_peered":"2024-04-25T09:01:33.822115+0000","last_clean":"2024-04-25T09:01:33.822115+0000","last_became_active":"2024-04-25T09:01:27.791559+0000","last_became_peered":"2024-04-25T09:01:27.791559+0000","last_unstale":"2024-04-25T09:01:33.822115+0000","last_undegraded":"2024-04-25T09:01:33.822115+0000","last_fullsized":"2024-04-25T09:01:33.822115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824560+0000","last_change":"2024-04-25T09:01:33.014380+0000","last_active":"2024-04-25T09:01:33.824560+0000","last_peered":"2024-04-25T09:01:33.824560+0000","last_clean":"2024-04-25T09:01:33.824560+0000","last_became_active":"2024-04-25T09:01:33.013885+0000","last_became_peered":"2024-04-25T09:01:33.013885+0000","last_unstale":"2024-04-25T09:01:33.824560+0000","last_undegraded":"2024-04-25T09:01:33.824560+0000","last_fullsized":"2024-04-25T09:01:33.824560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:43.548883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212597+0000","last_change":"2024-04-25T09:01:28.818477+0000","last_active":"2024-04-25T09:01:35.212597+0000","last_peered":"2024-04-25T09:01:35.212597+0000","last_clean":"2024-04-25T09:01:35.212597+0000","last_became_active":"2024-04-25T09:01:28.815329+0000","last_became_peered":"2024-04-25T09:01:28.815329+0000","last_unstale":"2024-04-25T09:01:35.212597+0000","last_undegraded":"2024-04-25T09:01:35.212597+0000","last_fullsized":"2024-04-25T09:01:35.212597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:31.277254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.827013+0000","last_change":"2024-04-25T09:01:27.803319+0000","last_active":"2024-04-25T09:01:33.827013+0000","last_peered":"2024-04-25T09:01:33.827013+0000","last_clean":"2024-04-25T09:01:33.827013+0000","last_became_active":"2024-04-25T09:01:27.802815+0000","last_became_peered":"2024-04-25T09:01:27.802815+0000","last_unstale":"2024-04-25T09:01:33.827013+0000","last_undegraded":"2024-04-25T09:01:33.827013+0000","last_fullsized":"2024-04-25T09:01:33.827013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:51.791461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825394+0000","last_change":"2024-04-25T09:01:32.836009+0000","last_active":"2024-04-25T09:01:33.825394+0000","last_peered":"2024-04-25T09:01:33.825394+0000","last_clean":"2024-04-25T09:01:33.825394+0000","last_became_active":"2024-04-25T09:01:32.835471+0000","last_became_peered":"2024-04-25T09:01:32.835471+0000","last_unstale":"2024-04-25T09:01:33.825394+0000","last_undegraded":"2024-04-25T09:01:33.825394+0000","last_fullsized":"2024-04-25T09:01:33.825394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:59.537310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211909+0000","last_change":"2024-04-25T09:01:28.814374+0000","last_active":"2024-04-25T09:01:35.211909+0000","last_peered":"2024-04-25T09:01:35.211909+0000","last_clean":"2024-04-25T09:01:35.211909+0000","last_became_active":"2024-04-25T09:01:28.813316+0000","last_became_peered":"2024-04-25T09:01:28.813316+0000","last_unstale":"2024-04-25T09:01:35.211909+0000","last_undegraded":"2024-04-25T09:01:35.211909+0000","last_fullsized":"2024-04-25T09:01:35.211909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:06.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821520+0000","last_change":"2024-04-25T09:01:27.787446+0000","last_active":"2024-04-25T09:01:33.821520+0000","last_peered":"2024-04-25T09:01:33.821520+0000","last_clean":"2024-04-25T09:01:33.821520+0000","last_became_active":"2024-04-25T09:01:27.787231+0000","last_became_peered":"2024-04-25T09:01:27.787231+0000","last_unstale":"2024-04-25T09:01:33.821520+0000","last_undegraded":"2024-04-25T09:01:33.821520+0000","last_fullsized":"2024-04-25T09:01:33.821520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709640+0000","last_change":"2024-04-25T09:01:32.837266+0000","last_active":"2024-04-25T09:01:34.709640+0000","last_peered":"2024-04-25T09:01:34.709640+0000","last_clean":"2024-04-25T09:01:34.709640+0000","last_became_active":"2024-04-25T09:01:32.836642+0000","last_became_peered":"2024-04-25T09:01:32.836642+0000","last_unstale":"2024-04-25T09:01:34.709640+0000","last_undegraded":"2024-04-25T09:01:34.709640+0000","last_fullsized":"2024-04-25T09:01:34.709640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:35.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211856+0000","last_change":"2024-04-25T09:01:28.800379+0000","last_active":"2024-04-25T09:01:35.211856+0000","last_peered":"2024-04-25T09:01:35.211856+0000","last_clean":"2024-04-25T09:01:35.211856+0000","last_became_active":"2024-04-25T09:01:28.800083+0000","last_became_peered":"2024-04-25T09:01:28.800083+0000","last_unstale":"2024-04-25T09:01:35.211856+0000","last_undegraded":"2024-04-25T09:01:35.211856+0000","last_fullsized":"2024-04-25T09:01:35.211856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212519+0000","last_change":"2024-04-25T09:01:27.795530+0000","last_active":"2024-04-25T09:01:35.212519+0000","last_peered":"2024-04-25T09:01:35.212519+0000","last_clean":"2024-04-25T09:01:35.212519+0000","last_became_active":"2024-04-25T09:01:27.795206+0000","last_became_peered":"2024-04-25T09:01:27.795206+0000","last_unstale":"2024-04-25T09:01:35.212519+0000","last_undegraded":"2024-04-25T09:01:35.212519+0000","last_fullsized":"2024-04-25T09:01:35.212519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:05.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210403+0000","last_change":"2024-04-25T09:01:33.016132+0000","last_active":"2024-04-25T09:01:35.210403+0000","last_peered":"2024-04-25T09:01:35.210403+0000","last_clean":"2024-04-25T09:01:35.210403+0000","last_became_active":"2024-04-25T09:01:33.015731+0000","last_became_peered":"2024-04-25T09:01:33.015731+0000","last_unstale":"2024-04-25T09:01:35.210403+0000","last_undegraded":"2024-04-25T09:01:35.210403+0000","last_fullsized":"2024-04-25T09:01:35.210403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:50.222305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212180+0000","last_change":"2024-04-25T09:01:28.815186+0000","last_active":"2024-04-25T09:01:35.212180+0000","last_peered":"2024-04-25T09:01:35.212180+0000","last_clean":"2024-04-25T09:01:35.212180+0000","last_became_active":"2024-04-25T09:01:28.814898+0000","last_became_peered":"2024-04-25T09:01:28.814898+0000","last_unstale":"2024-04-25T09:01:35.212180+0000","last_undegraded":"2024-04-25T09:01:35.212180+0000","last_fullsized":"2024-04-25T09:01:35.212180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:06.715519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825295+0000","last_change":"2024-04-25T09:01:27.795891+0000","last_active":"2024-04-25T09:01:33.825295+0000","last_peered":"2024-04-25T09:01:33.825295+0000","last_clean":"2024-04-25T09:01:33.825295+0000","last_became_active":"2024-04-25T09:01:27.795562+0000","last_became_peered":"2024-04-25T09:01:27.795562+0000","last_unstale":"2024-04-25T09:01:33.825295+0000","last_undegraded":"2024-04-25T09:01:33.825295+0000","last_fullsized":"2024-04-25T09:01:33.825295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210193+0000","last_change":"2024-04-25T09:01:33.014268+0000","last_active":"2024-04-25T09:01:35.210193+0000","last_peered":"2024-04-25T09:01:35.210193+0000","last_clean":"2024-04-25T09:01:35.210193+0000","last_became_active":"2024-04-25T09:01:33.013631+0000","last_became_peered":"2024-04-25T09:01:33.013631+0000","last_unstale":"2024-04-25T09:01:35.210193+0000","last_undegraded":"2024-04-25T09:01:35.210193+0000","last_fullsized":"2024-04-25T09:01:35.210193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:53.678828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709267+0000","last_change":"2024-04-25T09:01:28.805284+0000","last_active":"2024-04-25T09:01:34.709267+0000","last_peered":"2024-04-25T09:01:34.709267+0000","last_clean":"2024-04-25T09:01:34.709267+0000","last_became_active":"2024-04-25T09:01:28.804641+0000","last_became_peered":"2024-04-25T09:01:28.804641+0000","last_unstale":"2024-04-25T09:01:34.709267+0000","last_undegraded":"2024-04-25T09:01:34.709267+0000","last_fullsized":"2024-04-25T09:01:34.709267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:45.827977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709703+0000","last_change":"2024-04-25T09:01:27.803192+0000","last_active":"2024-04-25T09:01:34.709703+0000","last_peered":"2024-04-25T09:01:34.709703+0000","last_clean":"2024-04-25T09:01:34.709703+0000","last_became_active":"2024-04-25T09:01:27.802987+0000","last_became_peered":"2024-04-25T09:01:27.802987+0000","last_unstale":"2024-04-25T09:01:34.709703+0000","last_undegraded":"2024-04-25T09:01:34.709703+0000","last_fullsized":"2024-04-25T09:01:34.709703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:09.133960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825159+0000","last_change":"2024-04-25T09:01:33.017405+0000","last_active":"2024-04-25T09:01:33.825159+0000","last_peered":"2024-04-25T09:01:33.825159+0000","last_clean":"2024-04-25T09:01:33.825159+0000","last_became_active":"2024-04-25T09:01:33.016855+0000","last_became_peered":"2024-04-25T09:01:33.016855+0000","last_unstale":"2024-04-25T09:01:33.825159+0000","last_undegraded":"2024-04-25T09:01:33.825159+0000","last_fullsized":"2024-04-25T09:01:33.825159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:24.797218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212580+0000","last_change":"2024-04-25T09:01:28.813680+0000","last_active":"2024-04-25T09:01:35.212580+0000","last_peered":"2024-04-25T09:01:35.212580+0000","last_clean":"2024-04-25T09:01:35.212580+0000","last_became_active":"2024-04-25T09:01:28.812991+0000","last_became_peered":"2024-04-25T09:01:28.812991+0000","last_unstale":"2024-04-25T09:01:35.212580+0000","last_undegraded":"2024-04-25T09:01:35.212580+0000","last_fullsized":"2024-04-25T09:01:35.212580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:24.478830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:44.640397+0000","last_change":"2024-04-25T09:01:27.792429+0000","last_active":"2024-04-25T09:01:44.640397+0000","last_peered":"2024-04-25T09:01:44.640397+0000","last_clean":"2024-04-25T09:01:44.640397+0000","last_became_active":"2024-04-25T09:01:27.792126+0000","last_became_peered":"2024-04-25T09:01:27.792126+0000","last_unstale":"2024-04-25T09:01:44.640397+0000","last_undegraded":"2024-04-25T09:01:44.640397+0000","last_fullsized":"2024-04-25T09:01:44.640397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366571+0000","last_change":"2024-04-25T09:01:32.840515+0000","last_active":"2024-04-25T09:01:34.366571+0000","last_peered":"2024-04-25T09:01:34.366571+0000","last_clean":"2024-04-25T09:01:34.366571+0000","last_became_active":"2024-04-25T09:01:32.840063+0000","last_became_peered":"2024-04-25T09:01:32.840063+0000","last_unstale":"2024-04-25T09:01:34.366571+0000","last_undegraded":"2024-04-25T09:01:34.366571+0000","last_fullsized":"2024-04-25T09:01:34.366571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.271837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826624+0000","last_change":"2024-04-25T09:01:28.809794+0000","last_active":"2024-04-25T09:01:33.826624+0000","last_peered":"2024-04-25T09:01:33.826624+0000","last_clean":"2024-04-25T09:01:33.826624+0000","last_became_active":"2024-04-25T09:01:28.809503+0000","last_became_peered":"2024-04-25T09:01:28.809503+0000","last_unstale":"2024-04-25T09:01:33.826624+0000","last_undegraded":"2024-04-25T09:01:33.826624+0000","last_fullsized":"2024-04-25T09:01:33.826624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:56.645747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366841+0000","last_change":"2024-04-25T09:01:27.789736+0000","last_active":"2024-04-25T09:01:34.366841+0000","last_peered":"2024-04-25T09:01:34.366841+0000","last_clean":"2024-04-25T09:01:34.366841+0000","last_became_active":"2024-04-25T09:01:27.789445+0000","last_became_peered":"2024-04-25T09:01:27.789445+0000","last_unstale":"2024-04-25T09:01:34.366841+0000","last_undegraded":"2024-04-25T09:01:34.366841+0000","last_fullsized":"2024-04-25T09:01:34.366841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826093+0000","last_change":"2024-04-25T09:01:32.835148+0000","last_active":"2024-04-25T09:01:33.826093+0000","last_peered":"2024-04-25T09:01:33.826093+0000","last_clean":"2024-04-25T09:01:33.826093+0000","last_became_active":"2024-04-25T09:01:32.834679+0000","last_became_peered":"2024-04-25T09:01:32.834679+0000","last_unstale":"2024-04-25T09:01:33.826093+0000","last_undegraded":"2024-04-25T09:01:33.826093+0000","last_fullsized":"2024-04-25T09:01:33.826093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:46.590077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709785+0000","last_change":"2024-04-25T09:01:28.805826+0000","last_active":"2024-04-25T09:01:34.709785+0000","last_peered":"2024-04-25T09:01:34.709785+0000","last_clean":"2024-04-25T09:01:34.709785+0000","last_became_active":"2024-04-25T09:01:28.805543+0000","last_became_peered":"2024-04-25T09:01:28.805543+0000","last_unstale":"2024-04-25T09:01:34.709785+0000","last_undegraded":"2024-04-25T09:01:34.709785+0000","last_fullsized":"2024-04-25T09:01:34.709785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825327+0000","last_change":"2024-04-25T09:01:27.801739+0000","last_active":"2024-04-25T09:01:33.825327+0000","last_peered":"2024-04-25T09:01:33.825327+0000","last_clean":"2024-04-25T09:01:33.825327+0000","last_became_active":"2024-04-25T09:01:27.801422+0000","last_became_peered":"2024-04-25T09:01:27.801422+0000","last_unstale":"2024-04-25T09:01:33.825327+0000","last_undegraded":"2024-04-25T09:01:33.825327+0000","last_fullsized":"2024-04-25T09:01:33.825327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209484+0000","last_change":"2024-04-25T09:01:32.836512+0000","last_active":"2024-04-25T09:01:35.209484+0000","last_peered":"2024-04-25T09:01:35.209484+0000","last_clean":"2024-04-25T09:01:35.209484+0000","last_became_active":"2024-04-25T09:01:32.834922+0000","last_became_peered":"2024-04-25T09:01:32.834922+0000","last_unstale":"2024-04-25T09:01:35.209484+0000","last_undegraded":"2024-04-25T09:01:35.209484+0000","last_fullsized":"2024-04-25T09:01:35.209484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:43.548883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825176+0000","last_change":"2024-04-25T09:01:28.803133+0000","last_active":"2024-04-25T09:01:33.825176+0000","last_peered":"2024-04-25T09:01:33.825176+0000","last_clean":"2024-04-25T09:01:33.825176+0000","last_became_active":"2024-04-25T09:01:28.802575+0000","last_became_peered":"2024-04-25T09:01:28.802575+0000","last_unstale":"2024-04-25T09:01:33.825176+0000","last_undegraded":"2024-04-25T09:01:33.825176+0000","last_fullsized":"2024-04-25T09:01:33.825176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:42.557761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213247+0000","last_change":"2024-04-25T09:01:27.795989+0000","last_active":"2024-04-25T09:01:35.213247+0000","last_peered":"2024-04-25T09:01:35.213247+0000","last_clean":"2024-04-25T09:01:35.213247+0000","last_became_active":"2024-04-25T09:01:27.794189+0000","last_became_peered":"2024-04-25T09:01:27.794189+0000","last_unstale":"2024-04-25T09:01:35.213247+0000","last_undegraded":"2024-04-25T09:01:35.213247+0000","last_fullsized":"2024-04-25T09:01:35.213247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209544+0000","last_change":"2024-04-25T09:01:33.016051+0000","last_active":"2024-04-25T09:01:35.209544+0000","last_peered":"2024-04-25T09:01:35.209544+0000","last_clean":"2024-04-25T09:01:35.209544+0000","last_became_active":"2024-04-25T09:01:33.015720+0000","last_became_peered":"2024-04-25T09:01:33.015720+0000","last_unstale":"2024-04-25T09:01:35.209544+0000","last_undegraded":"2024-04-25T09:01:35.209544+0000","last_fullsized":"2024-04-25T09:01:35.209544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:24.797218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709440+0000","last_change":"2024-04-25T09:01:33.018289+0000","last_active":"2024-04-25T09:01:34.709440+0000","last_peered":"2024-04-25T09:01:34.709440+0000","last_clean":"2024-04-25T09:01:34.709440+0000","last_became_active":"2024-04-25T09:01:33.017643+0000","last_became_peered":"2024-04-25T09:01:33.017643+0000","last_unstale":"2024-04-25T09:01:34.709440+0000","last_undegraded":"2024-04-25T09:01:34.709440+0000","last_fullsized":"2024-04-25T09:01:34.709440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.271837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366208+0000","last_change":"2024-04-25T09:01:28.805719+0000","last_active":"2024-04-25T09:01:34.366208+0000","last_peered":"2024-04-25T09:01:34.366208+0000","last_clean":"2024-04-25T09:01:34.366208+0000","last_became_active":"2024-04-25T09:01:28.805394+0000","last_became_peered":"2024-04-25T09:01:28.805394+0000","last_unstale":"2024-04-25T09:01:34.366208+0000","last_undegraded":"2024-04-25T09:01:34.366208+0000","last_fullsized":"2024-04-25T09:01:34.366208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824665+0000","last_change":"2024-04-25T09:01:27.797013+0000","last_active":"2024-04-25T09:01:33.824665+0000","last_peered":"2024-04-25T09:01:33.824665+0000","last_clean":"2024-04-25T09:01:33.824665+0000","last_became_active":"2024-04-25T09:01:27.795312+0000","last_became_peered":"2024-04-25T09:01:27.795312+0000","last_unstale":"2024-04-25T09:01:33.824665+0000","last_undegraded":"2024-04-25T09:01:33.824665+0000","last_fullsized":"2024-04-25T09:01:33.824665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212668+0000","last_change":"2024-04-25T09:01:32.845195+0000","last_active":"2024-04-25T09:01:35.212668+0000","last_peered":"2024-04-25T09:01:35.212668+0000","last_clean":"2024-04-25T09:01:35.212668+0000","last_became_active":"2024-04-25T09:01:32.844725+0000","last_became_peered":"2024-04-25T09:01:32.844725+0000","last_unstale":"2024-04-25T09:01:35.212668+0000","last_undegraded":"2024-04-25T09:01:35.212668+0000","last_fullsized":"2024-04-25T09:01:35.212668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.271837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209436+0000","last_change":"2024-04-25T09:01:28.802082+0000","last_active":"2024-04-25T09:01:35.209436+0000","last_peered":"2024-04-25T09:01:35.209436+0000","last_clean":"2024-04-25T09:01:35.209436+0000","last_became_active":"2024-04-25T09:01:28.801617+0000","last_became_peered":"2024-04-25T09:01:28.801617+0000","last_unstale":"2024-04-25T09:01:35.209436+0000","last_undegraded":"2024-04-25T09:01:35.209436+0000","last_fullsized":"2024-04-25T09:01:35.209436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209733+0000","last_change":"2024-04-25T09:01:27.799488+0000","last_active":"2024-04-25T09:01:35.209733+0000","last_peered":"2024-04-25T09:01:35.209733+0000","last_clean":"2024-04-25T09:01:35.209733+0000","last_became_active":"2024-04-25T09:01:27.799191+0000","last_became_peered":"2024-04-25T09:01:27.799191+0000","last_unstale":"2024-04-25T09:01:35.209733+0000","last_undegraded":"2024-04-25T09:01:35.209733+0000","last_fullsized":"2024-04-25T09:01:35.209733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:58.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212177+0000","last_change":"2024-04-25T09:01:27.802418+0000","last_active":"2024-04-25T09:01:35.212177+0000","last_peered":"2024-04-25T09:01:35.212177+0000","last_clean":"2024-04-25T09:01:35.212177+0000","last_became_active":"2024-04-25T09:01:27.802128+0000","last_became_peered":"2024-04-25T09:01:27.802128+0000","last_unstale":"2024-04-25T09:01:35.212177+0000","last_undegraded":"2024-04-25T09:01:35.212177+0000","last_fullsized":"2024-04-25T09:01:35.212177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709621+0000","last_change":"2024-04-25T09:01:28.802082+0000","last_active":"2024-04-25T09:01:34.709621+0000","last_peered":"2024-04-25T09:01:34.709621+0000","last_clean":"2024-04-25T09:01:34.709621+0000","last_became_active":"2024-04-25T09:01:28.801820+0000","last_became_peered":"2024-04-25T09:01:28.801820+0000","last_unstale":"2024-04-25T09:01:34.709621+0000","last_undegraded":"2024-04-25T09:01:34.709621+0000","last_fullsized":"2024-04-25T09:01:34.709621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821849+0000","last_change":"2024-04-25T09:01:32.838999+0000","last_active":"2024-04-25T09:01:33.821849+0000","last_peered":"2024-04-25T09:01:33.821849+0000","last_clean":"2024-04-25T09:01:33.821849+0000","last_became_active":"2024-04-25T09:01:32.838525+0000","last_became_peered":"2024-04-25T09:01:32.838525+0000","last_unstale":"2024-04-25T09:01:33.821849+0000","last_undegraded":"2024-04-25T09:01:33.821849+0000","last_fullsized":"2024-04-25T09:01:33.821849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:49.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209935+0000","last_change":"2024-04-25T09:01:27.795362+0000","last_active":"2024-04-25T09:01:35.209935+0000","last_peered":"2024-04-25T09:01:35.209935+0000","last_clean":"2024-04-25T09:01:35.209935+0000","last_became_active":"2024-04-25T09:01:27.795063+0000","last_became_peered":"2024-04-25T09:01:27.795063+0000","last_unstale":"2024-04-25T09:01:35.209935+0000","last_undegraded":"2024-04-25T09:01:35.209935+0000","last_fullsized":"2024-04-25T09:01:35.209935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825751+0000","last_change":"2024-04-25T09:01:28.804182+0000","last_active":"2024-04-25T09:01:33.825751+0000","last_peered":"2024-04-25T09:01:33.825751+0000","last_clean":"2024-04-25T09:01:33.825751+0000","last_became_active":"2024-04-25T09:01:28.803828+0000","last_became_peered":"2024-04-25T09:01:28.803828+0000","last_unstale":"2024-04-25T09:01:33.825751+0000","last_undegraded":"2024-04-25T09:01:33.825751+0000","last_fullsized":"2024-04-25T09:01:33.825751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:28.332372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210139+0000","last_change":"2024-04-25T09:01:32.838771+0000","last_active":"2024-04-25T09:01:35.210139+0000","last_peered":"2024-04-25T09:01:35.210139+0000","last_clean":"2024-04-25T09:01:35.210139+0000","last_became_active":"2024-04-25T09:01:32.838328+0000","last_became_peered":"2024-04-25T09:01:32.838328+0000","last_unstale":"2024-04-25T09:01:35.210139+0000","last_undegraded":"2024-04-25T09:01:35.210139+0000","last_fullsized":"2024-04-25T09:01:35.210139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:21.908859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211532+0000","last_change":"2024-04-25T09:01:28.800460+0000","last_active":"2024-04-25T09:01:35.211532+0000","last_peered":"2024-04-25T09:01:35.211532+0000","last_clean":"2024-04-25T09:01:35.211532+0000","last_became_active":"2024-04-25T09:01:28.800206+0000","last_became_peered":"2024-04-25T09:01:28.800206+0000","last_unstale":"2024-04-25T09:01:35.211532+0000","last_undegraded":"2024-04-25T09:01:35.211532+0000","last_fullsized":"2024-04-25T09:01:35.211532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821704+0000","last_change":"2024-04-25T09:01:28.813568+0000","last_active":"2024-04-25T09:01:33.821704+0000","last_peered":"2024-04-25T09:01:33.821704+0000","last_clean":"2024-04-25T09:01:33.821704+0000","last_became_active":"2024-04-25T09:01:28.813174+0000","last_became_peered":"2024-04-25T09:01:28.813174+0000","last_unstale":"2024-04-25T09:01:33.821704+0000","last_undegraded":"2024-04-25T09:01:33.821704+0000","last_fullsized":"2024-04-25T09:01:33.821704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:56.645747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825234+0000","last_change":"2024-04-25T09:01:28.795346+0000","last_active":"2024-04-25T09:01:33.825234+0000","last_peered":"2024-04-25T09:01:33.825234+0000","last_clean":"2024-04-25T09:01:33.825234+0000","last_became_active":"2024-04-25T09:01:28.795062+0000","last_became_peered":"2024-04-25T09:01:28.795062+0000","last_unstale":"2024-04-25T09:01:33.825234+0000","last_undegraded":"2024-04-25T09:01:33.825234+0000","last_fullsized":"2024-04-25T09:01:33.825234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:31.277254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709593+0000","last_change":"2024-04-25T09:01:28.796978+0000","last_active":"2024-04-25T09:01:34.709593+0000","last_peered":"2024-04-25T09:01:34.709593+0000","last_clean":"2024-04-25T09:01:34.709593+0000","last_became_active":"2024-04-25T09:01:28.796196+0000","last_became_peered":"2024-04-25T09:01:28.796196+0000","last_unstale":"2024-04-25T09:01:34.709593+0000","last_undegraded":"2024-04-25T09:01:34.709593+0000","last_fullsized":"2024-04-25T09:01:34.709593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:43.336463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210135+0000","last_change":"2024-04-25T09:01:28.814030+0000","last_active":"2024-04-25T09:01:35.210135+0000","last_peered":"2024-04-25T09:01:35.210135+0000","last_clean":"2024-04-25T09:01:35.210135+0000","last_became_active":"2024-04-25T09:01:28.813738+0000","last_became_peered":"2024-04-25T09:01:28.813738+0000","last_unstale":"2024-04-25T09:01:35.210135+0000","last_undegraded":"2024-04-25T09:01:35.210135+0000","last_fullsized":"2024-04-25T09:01:35.210135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:42.557761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366730+0000","last_change":"2024-04-25T09:01:28.795112+0000","last_active":"2024-04-25T09:01:34.366730+0000","last_peered":"2024-04-25T09:01:34.366730+0000","last_clean":"2024-04-25T09:01:34.366730+0000","last_became_active":"2024-04-25T09:01:28.794801+0000","last_became_peered":"2024-04-25T09:01:28.794801+0000","last_unstale":"2024-04-25T09:01:34.366730+0000","last_undegraded":"2024-04-25T09:01:34.366730+0000","last_fullsized":"2024-04-25T09:01:34.366730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213014+0000","last_change":"2024-04-25T09:01:28.809748+0000","last_active":"2024-04-25T09:01:35.213014+0000","last_peered":"2024-04-25T09:01:35.213014+0000","last_clean":"2024-04-25T09:01:35.213014+0000","last_became_active":"2024-04-25T09:01:28.809461+0000","last_became_peered":"2024-04-25T09:01:28.809461+0000","last_unstale":"2024-04-25T09:01:35.213014+0000","last_undegraded":"2024-04-25T09:01:35.213014+0000","last_fullsized":"2024-04-25T09:01:35.213014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210397+0000","last_change":"2024-04-25T09:01:28.813864+0000","last_active":"2024-04-25T09:01:35.210397+0000","last_peered":"2024-04-25T09:01:35.210397+0000","last_clean":"2024-04-25T09:01:35.210397+0000","last_became_active":"2024-04-25T09:01:28.813495+0000","last_became_peered":"2024-04-25T09:01:28.813495+0000","last_unstale":"2024-04-25T09:01:35.210397+0000","last_undegraded":"2024-04-25T09:01:35.210397+0000","last_fullsized":"2024-04-25T09:01:35.210397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825456+0000","last_change":"2024-04-25T09:01:28.794304+0000","last_active":"2024-04-25T09:01:33.825456+0000","last_peered":"2024-04-25T09:01:33.825456+0000","last_clean":"2024-04-25T09:01:33.825456+0000","last_became_active":"2024-04-25T09:01:28.794011+0000","last_became_peered":"2024-04-25T09:01:28.794011+0000","last_unstale":"2024-04-25T09:01:33.825456+0000","last_undegraded":"2024-04-25T09:01:33.825456+0000","last_fullsized":"2024-04-25T09:01:33.825456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:45.224319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209656+0000","last_change":"2024-04-25T09:01:28.799673+0000","last_active":"2024-04-25T09:01:35.209656+0000","last_peered":"2024-04-25T09:01:35.209656+0000","last_clean":"2024-04-25T09:01:35.209656+0000","last_became_active":"2024-04-25T09:01:28.799385+0000","last_became_peered":"2024-04-25T09:01:28.799385+0000","last_unstale":"2024-04-25T09:01:35.209656+0000","last_undegraded":"2024-04-25T09:01:35.209656+0000","last_fullsized":"2024-04-25T09:01:35.209656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:13.869416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825187+0000","last_change":"2024-04-25T09:01:28.807260+0000","last_active":"2024-04-25T09:01:33.825187+0000","last_peered":"2024-04-25T09:01:33.825187+0000","last_clean":"2024-04-25T09:01:33.825187+0000","last_became_active":"2024-04-25T09:01:28.806995+0000","last_became_peered":"2024-04-25T09:01:28.806995+0000","last_unstale":"2024-04-25T09:01:33.825187+0000","last_undegraded":"2024-04-25T09:01:33.825187+0000","last_fullsized":"2024-04-25T09:01:33.825187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:06.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709277+0000","last_change":"2024-04-25T09:01:28.797279+0000","last_active":"2024-04-25T09:01:34.709277+0000","last_peered":"2024-04-25T09:01:34.709277+0000","last_clean":"2024-04-25T09:01:34.709277+0000","last_became_active":"2024-04-25T09:01:28.796574+0000","last_became_peered":"2024-04-25T09:01:28.796574+0000","last_unstale":"2024-04-25T09:01:34.709277+0000","last_undegraded":"2024-04-25T09:01:34.709277+0000","last_fullsized":"2024-04-25T09:01:34.709277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:01.770247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212692+0000","last_change":"2024-04-25T09:01:28.799529+0000","last_active":"2024-04-25T09:01:35.212692+0000","last_peered":"2024-04-25T09:01:35.212692+0000","last_clean":"2024-04-25T09:01:35.212692+0000","last_became_active":"2024-04-25T09:01:28.799231+0000","last_became_peered":"2024-04-25T09:01:28.799231+0000","last_unstale":"2024-04-25T09:01:35.212692+0000","last_undegraded":"2024-04-25T09:01:35.212692+0000","last_fullsized":"2024-04-25T09:01:35.212692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:45.224319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212894+0000","last_change":"2024-04-25T09:01:28.820816+0000","last_active":"2024-04-25T09:01:35.212894+0000","last_peered":"2024-04-25T09:01:35.212894+0000","last_clean":"2024-04-25T09:01:35.212894+0000","last_became_active":"2024-04-25T09:01:28.819970+0000","last_became_peered":"2024-04-25T09:01:28.819970+0000","last_unstale":"2024-04-25T09:01:35.212894+0000","last_undegraded":"2024-04-25T09:01:35.212894+0000","last_fullsized":"2024-04-25T09:01:35.212894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:39.516566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.822061+0000","last_change":"2024-04-25T09:01:28.802779+0000","last_active":"2024-04-25T09:01:33.822061+0000","last_peered":"2024-04-25T09:01:33.822061+0000","last_clean":"2024-04-25T09:01:33.822061+0000","last_became_active":"2024-04-25T09:01:28.802504+0000","last_became_peered":"2024-04-25T09:01:28.802504+0000","last_unstale":"2024-04-25T09:01:33.822061+0000","last_undegraded":"2024-04-25T09:01:33.822061+0000","last_fullsized":"2024-04-25T09:01:33.822061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:12.377470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825926+0000","last_change":"2024-04-25T09:01:28.806216+0000","last_active":"2024-04-25T09:01:33.825926+0000","last_peered":"2024-04-25T09:01:33.825926+0000","last_clean":"2024-04-25T09:01:33.825926+0000","last_became_active":"2024-04-25T09:01:28.805683+0000","last_became_peered":"2024-04-25T09:01:28.805683+0000","last_unstale":"2024-04-25T09:01:33.825926+0000","last_undegraded":"2024-04-25T09:01:33.825926+0000","last_fullsized":"2024-04-25T09:01:33.825926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:06.715519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824510+0000","last_change":"2024-04-25T09:01:28.795390+0000","last_active":"2024-04-25T09:01:33.824510+0000","last_peered":"2024-04-25T09:01:33.824510+0000","last_clean":"2024-04-25T09:01:33.824510+0000","last_became_active":"2024-04-25T09:01:28.795100+0000","last_became_peered":"2024-04-25T09:01:28.795100+0000","last_unstale":"2024-04-25T09:01:33.824510+0000","last_undegraded":"2024-04-25T09:01:33.824510+0000","last_fullsized":"2024-04-25T09:01:33.824510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366292+0000","last_change":"2024-04-25T09:01:28.807705+0000","last_active":"2024-04-25T09:01:34.366292+0000","last_peered":"2024-04-25T09:01:34.366292+0000","last_clean":"2024-04-25T09:01:34.366292+0000","last_became_active":"2024-04-25T09:01:28.807321+0000","last_became_peered":"2024-04-25T09:01:28.807321+0000","last_unstale":"2024-04-25T09:01:34.366292+0000","last_undegraded":"2024-04-25T09:01:34.366292+0000","last_fullsized":"2024-04-25T09:01:34.366292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709236+0000","last_change":"2024-04-25T09:01:28.800758+0000","last_active":"2024-04-25T09:01:34.709236+0000","last_peered":"2024-04-25T09:01:34.709236+0000","last_clean":"2024-04-25T09:01:34.709236+0000","last_became_active":"2024-04-25T09:01:28.800380+0000","last_became_peered":"2024-04-25T09:01:28.800380+0000","last_unstale":"2024-04-25T09:01:34.709236+0000","last_undegraded":"2024-04-25T09:01:34.709236+0000","last_fullsized":"2024-04-25T09:01:34.709236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:41.553845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209750+0000","last_change":"2024-04-25T09:01:28.803209+0000","last_active":"2024-04-25T09:01:35.209750+0000","last_peered":"2024-04-25T09:01:35.209750+0000","last_clean":"2024-04-25T09:01:35.209750+0000","last_became_active":"2024-04-25T09:01:28.801889+0000","last_became_peered":"2024-04-25T09:01:28.801889+0000","last_unstale":"2024-04-25T09:01:35.209750+0000","last_undegraded":"2024-04-25T09:01:35.209750+0000","last_fullsized":"2024-04-25T09:01:35.209750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826547+0000","last_change":"2024-04-25T09:01:28.809150+0000","last_active":"2024-04-25T09:01:33.826547+0000","last_peered":"2024-04-25T09:01:33.826547+0000","last_clean":"2024-04-25T09:01:33.826547+0000","last_became_active":"2024-04-25T09:01:28.801172+0000","last_became_peered":"2024-04-25T09:01:28.801172+0000","last_unstale":"2024-04-25T09:01:33.826547+0000","last_undegraded":"2024-04-25T09:01:33.826547+0000","last_fullsized":"2024-04-25T09:01:33.826547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:06.124113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213293+0000","last_change":"2024-04-25T09:01:28.810054+0000","last_active":"2024-04-25T09:01:35.213293+0000","last_peered":"2024-04-25T09:01:35.213293+0000","last_clean":"2024-04-25T09:01:35.213293+0000","last_became_active":"2024-04-25T09:01:28.809288+0000","last_became_peered":"2024-04-25T09:01:28.809288+0000","last_unstale":"2024-04-25T09:01:35.213293+0000","last_undegraded":"2024-04-25T09:01:35.213293+0000","last_fullsized":"2024-04-25T09:01:35.213293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212915+0000","last_change":"2024-04-25T09:01:28.803094+0000","last_active":"2024-04-25T09:01:35.212915+0000","last_peered":"2024-04-25T09:01:35.212915+0000","last_clean":"2024-04-25T09:01:35.212915+0000","last_became_active":"2024-04-25T09:01:28.802768+0000","last_became_peered":"2024-04-25T09:01:28.802768+0000","last_unstale":"2024-04-25T09:01:35.212915+0000","last_undegraded":"2024-04-25T09:01:35.212915+0000","last_fullsized":"2024-04-25T09:01:35.212915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213016+0000","last_change":"2024-04-25T09:01:28.822072+0000","last_active":"2024-04-25T09:01:35.213016+0000","last_peered":"2024-04-25T09:01:35.213016+0000","last_clean":"2024-04-25T09:01:35.213016+0000","last_became_active":"2024-04-25T09:01:28.821805+0000","last_became_peered":"2024-04-25T09:01:28.821805+0000","last_unstale":"2024-04-25T09:01:35.213016+0000","last_undegraded":"2024-04-25T09:01:35.213016+0000","last_fullsized":"2024-04-25T09:01:35.213016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:10.070021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209311+0000","last_change":"2024-04-25T09:01:28.797350+0000","last_active":"2024-04-25T09:01:35.209311+0000","last_peered":"2024-04-25T09:01:35.209311+0000","last_clean":"2024-04-25T09:01:35.209311+0000","last_became_active":"2024-04-25T09:01:28.797039+0000","last_became_peered":"2024-04-25T09:01:28.797039+0000","last_unstale":"2024-04-25T09:01:35.209311+0000","last_undegraded":"2024-04-25T09:01:35.209311+0000","last_fullsized":"2024-04-25T09:01:35.209311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:28.695063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211801+0000","last_change":"2024-04-25T09:01:28.814399+0000","last_active":"2024-04-25T09:01:35.211801+0000","last_peered":"2024-04-25T09:01:35.211801+0000","last_clean":"2024-04-25T09:01:35.211801+0000","last_became_active":"2024-04-25T09:01:28.812569+0000","last_became_peered":"2024-04-25T09:01:28.812569+0000","last_unstale":"2024-04-25T09:01:35.211801+0000","last_undegraded":"2024-04-25T09:01:35.211801+0000","last_fullsized":"2024-04-25T09:01:35.211801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825039+0000","last_change":"2024-04-25T09:01:28.798631+0000","last_active":"2024-04-25T09:01:33.825039+0000","last_peered":"2024-04-25T09:01:33.825039+0000","last_clean":"2024-04-25T09:01:33.825039+0000","last_became_active":"2024-04-25T09:01:28.797450+0000","last_became_peered":"2024-04-25T09:01:28.797450+0000","last_unstale":"2024-04-25T09:01:33.825039+0000","last_undegraded":"2024-04-25T09:01:33.825039+0000","last_fullsized":"2024-04-25T09:01:33.825039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:33.239521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211711+0000","last_change":"2024-04-25T09:01:28.817741+0000","last_active":"2024-04-25T09:01:35.211711+0000","last_peered":"2024-04-25T09:01:35.211711+0000","last_clean":"2024-04-25T09:01:35.211711+0000","last_became_active":"2024-04-25T09:01:28.816875+0000","last_became_peered":"2024-04-25T09:01:28.816875+0000","last_unstale":"2024-04-25T09:01:35.211711+0000","last_undegraded":"2024-04-25T09:01:35.211711+0000","last_fullsized":"2024-04-25T09:01:35.211711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:46.890034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825594+0000","last_change":"2024-04-25T09:01:28.800127+0000","last_active":"2024-04-25T09:01:33.825594+0000","last_peered":"2024-04-25T09:01:33.825594+0000","last_clean":"2024-04-25T09:01:33.825594+0000","last_became_active":"2024-04-25T09:01:28.799878+0000","last_became_peered":"2024-04-25T09:01:28.799878+0000","last_unstale":"2024-04-25T09:01:33.825594+0000","last_undegraded":"2024-04-25T09:01:33.825594+0000","last_fullsized":"2024-04-25T09:01:33.825594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:28.695063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709466+0000","last_change":"2024-04-25T09:01:28.789959+0000","last_active":"2024-04-25T09:01:34.709466+0000","last_peered":"2024-04-25T09:01:34.709466+0000","last_clean":"2024-04-25T09:01:34.709466+0000","last_became_active":"2024-04-25T09:01:28.788152+0000","last_became_peered":"2024-04-25T09:01:28.788152+0000","last_unstale":"2024-04-25T09:01:34.709466+0000","last_undegraded":"2024-04-25T09:01:34.709466+0000","last_fullsized":"2024-04-25T09:01:34.709466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366996+0000","last_change":"2024-04-25T09:01:28.798328+0000","last_active":"2024-04-25T09:01:34.366996+0000","last_peered":"2024-04-25T09:01:34.366996+0000","last_clean":"2024-04-25T09:01:34.366996+0000","last_became_active":"2024-04-25T09:01:28.797356+0000","last_became_peered":"2024-04-25T09:01:28.797356+0000","last_unstale":"2024-04-25T09:01:34.366996+0000","last_undegraded":"2024-04-25T09:01:34.366996+0000","last_fullsized":"2024-04-25T09:01:34.366996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212405+0000","last_change":"2024-04-25T09:01:28.819648+0000","last_active":"2024-04-25T09:01:35.212405+0000","last_peered":"2024-04-25T09:01:35.212405+0000","last_clean":"2024-04-25T09:01:35.212405+0000","last_became_active":"2024-04-25T09:01:28.819185+0000","last_became_peered":"2024-04-25T09:01:28.819185+0000","last_unstale":"2024-04-25T09:01:35.212405+0000","last_undegraded":"2024-04-25T09:01:35.212405+0000","last_fullsized":"2024-04-25T09:01:35.212405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:38.948352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:01:52.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:01:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.872+0000 7f5466400640 1 Processor -- start 2024-04-25T09:01:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.872+0000 7f5466400640 1 -- start start 2024-04-25T09:01:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f5466400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5460145270 0x7f546015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f5466400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54600cd4d0 0x7f54600cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f5466400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54600b1750 0x7f54600b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f5466400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54600b20e0 con 0x7f54600b1750 2024-04-25T09:01:52.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f5466400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5460145650 con 0x7f5460145270 2024-04-25T09:01:52.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f5466400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54600cc4e0 con 0x7f54600cd4d0 2024-04-25T09:01:52.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f545fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54600b1750 0x7f54600b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f545fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54600b1750 0x7f54600b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35160/0 (socket says 172.21.15.59:35160) 2024-04-25T09:01:52.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f545fe00640 1 -- 172.21.15.59:0/2924643198 learned_addr learned my addr 172.21.15.59:0/2924643198 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:52.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f545f400640 1 --2- 172.21.15.59:0/2924643198 >> v2:172.21.15.178:3300/0 conn(0x7f5460145270 0x7f546015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f5456a00640 1 --2- 172.21.15.59:0/2924643198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54600cd4d0 0x7f54600cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f545fe00640 1 -- 172.21.15.59:0/2924643198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54600cd4d0 msgr2=0x7f54600cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f545fe00640 1 --2- 172.21.15.59:0/2924643198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54600cd4d0 0x7f54600cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f545fe00640 1 -- 172.21.15.59:0/2924643198 >> v2:172.21.15.178:3300/0 conn(0x7f5460145270 msgr2=0x7f546015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f545fe00640 1 --2- 172.21.15.59:0/2924643198 >> v2:172.21.15.178:3300/0 conn(0x7f5460145270 0x7f546015fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.876+0000 7f545fe00640 1 -- 172.21.15.59:0/2924643198 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54600ce040 con 0x7f54600b1750 2024-04-25T09:01:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f545fe00640 1 --2- 172.21.15.59:0/2924643198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54600b1750 0x7f54600b1ba0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f546006f3a0 tx=0x7f545801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb2e743ae1227ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f545ea00640 1 -- 172.21.15.59:0/2924643198 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54580a5760 con 0x7f54600b1750 2024-04-25T09:01:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f545ea00640 1 -- 172.21.15.59:0/2924643198 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54580a5900 con 0x7f54600b1750 2024-04-25T09:01:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f545ea00640 1 -- 172.21.15.59:0/2924643198 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54580a5cd0 con 0x7f54600b1750 2024-04-25T09:01:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 -- 172.21.15.59:0/2924643198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54600b1750 msgr2=0x7f54600b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 --2- 172.21.15.59:0/2924643198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54600b1750 0x7f54600b1ba0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f546006f3a0 tx=0x7f545801c9f0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 -- 172.21.15.59:0/2924643198 shutdown_connections 2024-04-25T09:01:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 --2- 172.21.15.59:0/2924643198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54600b1750 0x7f54600b1ba0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 --2- 172.21.15.59:0/2924643198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54600cd4d0 0x7f54600cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 --2- 172.21.15.59:0/2924643198 >> v2:172.21.15.178:3300/0 conn(0x7f5460145270 0x7f546015fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 -- 172.21.15.59:0/2924643198 >> 172.21.15.59:0/2924643198 conn(0x7f5460066fa0 msgr2=0x7f546006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:52.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 -- 172.21.15.59:0/2924643198 shutdown_connections 2024-04-25T09:01:52.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 -- 172.21.15.59:0/2924643198 wait complete. 2024-04-25T09:01:52.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 Processor -- start 2024-04-25T09:01:52.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 -- start start 2024-04-25T09:01:52.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54600b1750 0x7f54601fa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54600cd4d0 0x7f5460141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5460145270 0x7f546015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546015c590 con 0x7f54600b1750 2024-04-25T09:01:52.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546015f930 con 0x7f54600cd4d0 2024-04-25T09:01:52.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f5466400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546015c710 con 0x7f5460145270 2024-04-25T09:01:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.880+0000 7f545f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54600b1750 0x7f54601fa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f545f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54600b1750 0x7f54601fa7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35170/0 (socket says 172.21.15.59:35170) 2024-04-25T09:01:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f545f400640 1 -- 172.21.15.59:0/1616226117 learned_addr learned my addr 172.21.15.59:0/1616226117 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f5456a00640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54600cd4d0 0x7f5460141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f545fe00640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5460145270 0x7f546015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f545f400640 1 -- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5460145270 msgr2=0x7f546015b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f545f400640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5460145270 0x7f546015b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f545f400640 1 -- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54600cd4d0 msgr2=0x7f5460141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f545f400640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54600cd4d0 0x7f5460141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f545f400640 1 -- 172.21.15.59:0/1616226117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546006b2a0 con 0x7f54600b1750 2024-04-25T09:01:52.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f545f400640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54600b1750 0x7f54601fa7d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f545000e8a0 tx=0x7f545000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f5457e00640 1 -- 172.21.15.59:0/1616226117 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450017070 con 0x7f54600b1750 2024-04-25T09:01:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f5457e00640 1 -- 172.21.15.59:0/1616226117 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545000c940 con 0x7f54600b1750 2024-04-25T09:01:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f5466400640 1 -- 172.21.15.59:0/1616226117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546013f020 con 0x7f54600b1750 2024-04-25T09:01:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f5457e00640 1 -- 172.21.15.59:0/1616226117 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545000ccf0 con 0x7f54600b1750 2024-04-25T09:01:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f5466400640 1 -- 172.21.15.59:0/1616226117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546013f5e0 con 0x7f54600b1750 2024-04-25T09:01:52.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f5466400640 1 -- 172.21.15.59:0/1616226117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54600745d0 con 0x7f54600b1750 2024-04-25T09:01:52.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.884+0000 7f5457e00640 1 -- 172.21.15.59:0/1616226117 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f545001a070 con 0x7f54600b1750 2024-04-25T09:01:52.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.888+0000 7f5457e00640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f543c066f60 0x7f543c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:52.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.888+0000 7f5457e00640 1 -- 172.21.15.59:0/1616226117 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f54500852a0 con 0x7f54600b1750 2024-04-25T09:01:52.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.888+0000 7f5456a00640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f543c066f60 0x7f543c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:52.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.888+0000 7f5456a00640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f543c066f60 0x7f543c069420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f54600cb9f0 tx=0x7f5448008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:52.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:52.892+0000 7f5457e00640 1 -- 172.21.15.59:0/1616226117 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5450055f70 con 0x7f54600b1750 2024-04-25T09:01:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.051+0000 7f5466400640 1 -- 172.21.15.59:0/1616226117 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54600b4970 con 0x7f543c066f60 2024-04-25T09:01:53.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.059+0000 7f5457e00640 1 -- 172.21.15.59:0/1616226117 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+332538 (secure 0 0 0) 0x7f54600b4970 con 0x7f543c066f60 2024-04-25T09:01:53.054 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:53.056 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:01:53.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.063+0000 7f5466400640 1 -- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f543c066f60 msgr2=0x7f543c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.063+0000 7f5466400640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f543c066f60 0x7f543c069420 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f54600cb9f0 tx=0x7f5448008040 comp rx=0 tx=0).stop 2024-04-25T09:01:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.063+0000 7f5466400640 1 -- 172.21.15.59:0/1616226117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54600b1750 msgr2=0x7f54601fa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.063+0000 7f5466400640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54600b1750 0x7f54601fa7d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f545000e8a0 tx=0x7f545000eca0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.063+0000 7f5466400640 1 -- 172.21.15.59:0/1616226117 shutdown_connections 2024-04-25T09:01:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.063+0000 7f5466400640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f543c066f60 0x7f543c069420 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.063+0000 7f5466400640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5460145270 0x7f546015b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.063+0000 7f5466400640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54600cd4d0 0x7f5460141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.063+0000 7f5466400640 1 --2- 172.21.15.59:0/1616226117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54600b1750 0x7f54601fa7d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.063+0000 7f5466400640 1 -- 172.21.15.59:0/1616226117 >> 172.21.15.59:0/1616226117 conn(0x7f5460066fa0 msgr2=0x7f54600b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:53.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.063+0000 7f5466400640 1 -- 172.21.15.59:0/1616226117 shutdown_connections 2024-04-25T09:01:53.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.063+0000 7f5466400640 1 -- 172.21.15.59:0/1616226117 wait complete. 2024-04-25T09:01:53.074 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-25T09:01:51.653201+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223552,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751168,"statfs":{"total":773094113280,"available":772865196032,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003288"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709883+0000","last_change":"2024-04-25T09:01:27.802877+0000","last_active":"2024-04-25T09:01:34.709883+0000","last_peered":"2024-04-25T09:01:34.709883+0000","last_clean":"2024-04-25T09:01:34.709883+0000","last_became_active":"2024-04-25T09:01:27.802618+0000","last_became_peered":"2024-04-25T09:01:27.802618+0000","last_unstale":"2024-04-25T09:01:34.709883+0000","last_undegraded":"2024-04-25T09:01:34.709883+0000","last_fullsized":"2024-04-25T09:01:34.709883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:46.579225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210158+0000","last_change":"2024-04-25T09:01:28.808316+0000","last_active":"2024-04-25T09:01:35.210158+0000","last_peered":"2024-04-25T09:01:35.210158+0000","last_clean":"2024-04-25T09:01:35.210158+0000","last_became_active":"2024-04-25T09:01:28.807978+0000","last_became_peered":"2024-04-25T09:01:28.807978+0000","last_unstale":"2024-04-25T09:01:35.210158+0000","last_undegraded":"2024-04-25T09:01:35.210158+0000","last_fullsized":"2024-04-25T09:01:35.210158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209468+0000","last_change":"2024-04-25T09:01:33.021098+0000","last_active":"2024-04-25T09:01:35.209468+0000","last_peered":"2024-04-25T09:01:35.209468+0000","last_clean":"2024-04-25T09:01:35.209468+0000","last_became_active":"2024-04-25T09:01:33.020732+0000","last_became_peered":"2024-04-25T09:01:33.020732+0000","last_unstale":"2024-04-25T09:01:35.209468+0000","last_undegraded":"2024-04-25T09:01:35.209468+0000","last_fullsized":"2024-04-25T09:01:35.209468+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:07.978442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210332+0000","last_change":"2024-04-25T09:01:27.807081+0000","last_active":"2024-04-25T09:01:35.210332+0000","last_peered":"2024-04-25T09:01:35.210332+0000","last_clean":"2024-04-25T09:01:35.210332+0000","last_became_active":"2024-04-25T09:01:27.806124+0000","last_became_peered":"2024-04-25T09:01:27.806124+0000","last_unstale":"2024-04-25T09:01:35.210332+0000","last_undegraded":"2024-04-25T09:01:35.210332+0000","last_fullsized":"2024-04-25T09:01:35.210332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709611+0000","last_change":"2024-04-25T09:01:28.806486+0000","last_active":"2024-04-25T09:01:34.709611+0000","last_peered":"2024-04-25T09:01:34.709611+0000","last_clean":"2024-04-25T09:01:34.709611+0000","last_became_active":"2024-04-25T09:01:28.806206+0000","last_became_peered":"2024-04-25T09:01:28.806206+0000","last_unstale":"2024-04-25T09:01:34.709611+0000","last_undegraded":"2024-04-25T09:01:34.709611+0000","last_fullsized":"2024-04-25T09:01:34.709611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824971+0000","last_change":"2024-04-25T09:01:32.828219+0000","last_active":"2024-04-25T09:01:33.824971+0000","last_peered":"2024-04-25T09:01:33.824971+0000","last_clean":"2024-04-25T09:01:33.824971+0000","last_became_active":"2024-04-25T09:01:32.827815+0000","last_became_peered":"2024-04-25T09:01:32.827815+0000","last_unstale":"2024-04-25T09:01:33.824971+0000","last_undegraded":"2024-04-25T09:01:33.824971+0000","last_fullsized":"2024-04-25T09:01:33.824971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:43.814734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212850+0000","last_change":"2024-04-25T09:01:27.805262+0000","last_active":"2024-04-25T09:01:35.212850+0000","last_peered":"2024-04-25T09:01:35.212850+0000","last_clean":"2024-04-25T09:01:35.212850+0000","last_became_active":"2024-04-25T09:01:27.804980+0000","last_became_peered":"2024-04-25T09:01:27.804980+0000","last_unstale":"2024-04-25T09:01:35.212850+0000","last_undegraded":"2024-04-25T09:01:35.212850+0000","last_fullsized":"2024-04-25T09:01:35.212850+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:56.895362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825657+0000","last_change":"2024-04-25T09:01:28.799263+0000","last_active":"2024-04-25T09:01:33.825657+0000","last_peered":"2024-04-25T09:01:33.825657+0000","last_clean":"2024-04-25T09:01:33.825657+0000","last_became_active":"2024-04-25T09:01:28.790548+0000","last_became_peered":"2024-04-25T09:01:28.790548+0000","last_unstale":"2024-04-25T09:01:33.825657+0000","last_undegraded":"2024-04-25T09:01:33.825657+0000","last_fullsized":"2024-04-25T09:01:33.825657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826075+0000","last_change":"2024-04-25T09:01:32.835550+0000","last_active":"2024-04-25T09:01:33.826075+0000","last_peered":"2024-04-25T09:01:33.826075+0000","last_clean":"2024-04-25T09:01:33.826075+0000","last_became_active":"2024-04-25T09:01:32.835109+0000","last_became_peered":"2024-04-25T09:01:32.835109+0000","last_unstale":"2024-04-25T09:01:33.826075+0000","last_undegraded":"2024-04-25T09:01:33.826075+0000","last_fullsized":"2024-04-25T09:01:33.826075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:17.901732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212354+0000","last_change":"2024-04-25T09:01:27.802652+0000","last_active":"2024-04-25T09:01:35.212354+0000","last_peered":"2024-04-25T09:01:35.212354+0000","last_clean":"2024-04-25T09:01:35.212354+0000","last_became_active":"2024-04-25T09:01:27.802321+0000","last_became_peered":"2024-04-25T09:01:27.802321+0000","last_unstale":"2024-04-25T09:01:35.212354+0000","last_undegraded":"2024-04-25T09:01:35.212354+0000","last_fullsized":"2024-04-25T09:01:35.212354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:11.367072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825050+0000","last_change":"2024-04-25T09:01:28.796900+0000","last_active":"2024-04-25T09:01:33.825050+0000","last_peered":"2024-04-25T09:01:33.825050+0000","last_clean":"2024-04-25T09:01:33.825050+0000","last_became_active":"2024-04-25T09:01:28.796459+0000","last_became_peered":"2024-04-25T09:01:28.796459+0000","last_unstale":"2024-04-25T09:01:33.825050+0000","last_undegraded":"2024-04-25T09:01:33.825050+0000","last_fullsized":"2024-04-25T09:01:33.825050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:13.869416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825689+0000","last_change":"2024-04-25T09:01:32.841506+0000","last_active":"2024-04-25T09:01:33.825689+0000","last_peered":"2024-04-25T09:01:33.825689+0000","last_clean":"2024-04-25T09:01:33.825689+0000","last_became_active":"2024-04-25T09:01:32.841067+0000","last_became_peered":"2024-04-25T09:01:32.841067+0000","last_unstale":"2024-04-25T09:01:33.825689+0000","last_undegraded":"2024-04-25T09:01:33.825689+0000","last_fullsized":"2024-04-25T09:01:33.825689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:32.727379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211892+0000","last_change":"2024-04-25T09:01:28.799287+0000","last_active":"2024-04-25T09:01:35.211892+0000","last_peered":"2024-04-25T09:01:35.211892+0000","last_clean":"2024-04-25T09:01:35.211892+0000","last_became_active":"2024-04-25T09:01:28.798965+0000","last_became_peered":"2024-04-25T09:01:28.798965+0000","last_unstale":"2024-04-25T09:01:35.211892+0000","last_undegraded":"2024-04-25T09:01:35.211892+0000","last_fullsized":"2024-04-25T09:01:35.211892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212311+0000","last_change":"2024-04-25T09:01:27.801318+0000","last_active":"2024-04-25T09:01:35.212311+0000","last_peered":"2024-04-25T09:01:35.212311+0000","last_clean":"2024-04-25T09:01:35.212311+0000","last_became_active":"2024-04-25T09:01:27.801007+0000","last_became_peered":"2024-04-25T09:01:27.801007+0000","last_unstale":"2024-04-25T09:01:35.212311+0000","last_undegraded":"2024-04-25T09:01:35.212311+0000","last_fullsized":"2024-04-25T09:01:35.212311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:55.635349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826766+0000","last_change":"2024-04-25T09:01:32.838021+0000","last_active":"2024-04-25T09:01:33.826766+0000","last_peered":"2024-04-25T09:01:33.826766+0000","last_clean":"2024-04-25T09:01:33.826766+0000","last_became_active":"2024-04-25T09:01:32.837635+0000","last_became_peered":"2024-04-25T09:01:32.837635+0000","last_unstale":"2024-04-25T09:01:33.826766+0000","last_undegraded":"2024-04-25T09:01:33.826766+0000","last_fullsized":"2024-04-25T09:01:33.826766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:50.922350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209879+0000","last_change":"2024-04-25T09:01:28.802944+0000","last_active":"2024-04-25T09:01:35.209879+0000","last_peered":"2024-04-25T09:01:35.209879+0000","last_clean":"2024-04-25T09:01:35.209879+0000","last_became_active":"2024-04-25T09:01:28.801259+0000","last_became_peered":"2024-04-25T09:01:28.801259+0000","last_unstale":"2024-04-25T09:01:35.209879+0000","last_undegraded":"2024-04-25T09:01:35.209879+0000","last_fullsized":"2024-04-25T09:01:35.209879+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366553+0000","last_change":"2024-04-25T09:01:27.794293+0000","last_active":"2024-04-25T09:01:34.366553+0000","last_peered":"2024-04-25T09:01:34.366553+0000","last_clean":"2024-04-25T09:01:34.366553+0000","last_became_active":"2024-04-25T09:01:27.794093+0000","last_became_peered":"2024-04-25T09:01:27.794093+0000","last_unstale":"2024-04-25T09:01:34.366553+0000","last_undegraded":"2024-04-25T09:01:34.366553+0000","last_fullsized":"2024-04-25T09:01:34.366553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826446+0000","last_change":"2024-04-25T09:01:32.835417+0000","last_active":"2024-04-25T09:01:33.826446+0000","last_peered":"2024-04-25T09:01:33.826446+0000","last_clean":"2024-04-25T09:01:33.826446+0000","last_became_active":"2024-04-25T09:01:32.834900+0000","last_became_peered":"2024-04-25T09:01:32.834900+0000","last_unstale":"2024-04-25T09:01:33.826446+0000","last_undegraded":"2024-04-25T09:01:33.826446+0000","last_fullsized":"2024-04-25T09:01:33.826446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:12.234115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209538+0000","last_change":"2024-04-25T09:01:28.807676+0000","last_active":"2024-04-25T09:01:35.209538+0000","last_peered":"2024-04-25T09:01:35.209538+0000","last_clean":"2024-04-25T09:01:35.209538+0000","last_became_active":"2024-04-25T09:01:28.807412+0000","last_became_peered":"2024-04-25T09:01:28.807412+0000","last_unstale":"2024-04-25T09:01:35.209538+0000","last_undegraded":"2024-04-25T09:01:35.209538+0000","last_fullsized":"2024-04-25T09:01:35.209538+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366319+0000","last_change":"2024-04-25T09:01:27.792801+0000","last_active":"2024-04-25T09:01:34.366319+0000","last_peered":"2024-04-25T09:01:34.366319+0000","last_clean":"2024-04-25T09:01:34.366319+0000","last_became_active":"2024-04-25T09:01:27.792478+0000","last_became_peered":"2024-04-25T09:01:27.792478+0000","last_unstale":"2024-04-25T09:01:34.366319+0000","last_undegraded":"2024-04-25T09:01:34.366319+0000","last_fullsized":"2024-04-25T09:01:34.366319+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:05.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.367126+0000","last_change":"2024-04-25T09:01:33.016837+0000","last_active":"2024-04-25T09:01:34.367126+0000","last_peered":"2024-04-25T09:01:34.367126+0000","last_clean":"2024-04-25T09:01:34.367126+0000","last_became_active":"2024-04-25T09:01:33.016394+0000","last_became_peered":"2024-04-25T09:01:33.016394+0000","last_unstale":"2024-04-25T09:01:34.367126+0000","last_undegraded":"2024-04-25T09:01:34.367126+0000","last_fullsized":"2024-04-25T09:01:34.367126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:10.891366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825930+0000","last_change":"2024-04-25T09:01:28.797789+0000","last_active":"2024-04-25T09:01:33.825930+0000","last_peered":"2024-04-25T09:01:33.825930+0000","last_clean":"2024-04-25T09:01:33.825930+0000","last_became_active":"2024-04-25T09:01:28.794550+0000","last_became_peered":"2024-04-25T09:01:28.794550+0000","last_unstale":"2024-04-25T09:01:33.825930+0000","last_undegraded":"2024-04-25T09:01:33.825930+0000","last_fullsized":"2024-04-25T09:01:33.825930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:38.459019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211810+0000","last_change":"2024-04-25T09:01:27.807626+0000","last_active":"2024-04-25T09:01:35.211810+0000","last_peered":"2024-04-25T09:01:35.211810+0000","last_clean":"2024-04-25T09:01:35.211810+0000","last_became_active":"2024-04-25T09:01:27.807340+0000","last_became_peered":"2024-04-25T09:01:27.807340+0000","last_unstale":"2024-04-25T09:01:35.211810+0000","last_undegraded":"2024-04-25T09:01:35.211810+0000","last_fullsized":"2024-04-25T09:01:35.211810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:05.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826818+0000","last_change":"2024-04-25T09:01:32.835653+0000","last_active":"2024-04-25T09:01:33.826818+0000","last_peered":"2024-04-25T09:01:33.826818+0000","last_clean":"2024-04-25T09:01:33.826818+0000","last_became_active":"2024-04-25T09:01:32.834905+0000","last_became_peered":"2024-04-25T09:01:32.834905+0000","last_unstale":"2024-04-25T09:01:33.826818+0000","last_undegraded":"2024-04-25T09:01:33.826818+0000","last_fullsized":"2024-04-25T09:01:33.826818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:28.511146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709868+0000","last_change":"2024-04-25T09:01:28.808561+0000","last_active":"2024-04-25T09:01:34.709868+0000","last_peered":"2024-04-25T09:01:34.709868+0000","last_clean":"2024-04-25T09:01:34.709868+0000","last_became_active":"2024-04-25T09:01:28.808259+0000","last_became_peered":"2024-04-25T09:01:28.808259+0000","last_unstale":"2024-04-25T09:01:34.709868+0000","last_undegraded":"2024-04-25T09:01:34.709868+0000","last_fullsized":"2024-04-25T09:01:34.709868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213361+0000","last_change":"2024-04-25T09:01:27.796535+0000","last_active":"2024-04-25T09:01:35.213361+0000","last_peered":"2024-04-25T09:01:35.213361+0000","last_clean":"2024-04-25T09:01:35.213361+0000","last_became_active":"2024-04-25T09:01:27.794550+0000","last_became_peered":"2024-04-25T09:01:27.794550+0000","last_unstale":"2024-04-25T09:01:35.213361+0000","last_undegraded":"2024-04-25T09:01:35.213361+0000","last_fullsized":"2024-04-25T09:01:35.213361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825685+0000","last_change":"2024-04-25T09:01:33.017620+0000","last_active":"2024-04-25T09:01:33.825685+0000","last_peered":"2024-04-25T09:01:33.825685+0000","last_clean":"2024-04-25T09:01:33.825685+0000","last_became_active":"2024-04-25T09:01:33.017217+0000","last_became_peered":"2024-04-25T09:01:33.017217+0000","last_unstale":"2024-04-25T09:01:33.825685+0000","last_undegraded":"2024-04-25T09:01:33.825685+0000","last_fullsized":"2024-04-25T09:01:33.825685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:49.256635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210450+0000","last_change":"2024-04-25T09:01:28.800633+0000","last_active":"2024-04-25T09:01:35.210450+0000","last_peered":"2024-04-25T09:01:35.210450+0000","last_clean":"2024-04-25T09:01:35.210450+0000","last_became_active":"2024-04-25T09:01:28.800261+0000","last_became_peered":"2024-04-25T09:01:28.800261+0000","last_unstale":"2024-04-25T09:01:35.210450+0000","last_undegraded":"2024-04-25T09:01:35.210450+0000","last_fullsized":"2024-04-25T09:01:35.210450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:45.224319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.367056+0000","last_change":"2024-04-25T09:01:27.801362+0000","last_active":"2024-04-25T09:01:34.367056+0000","last_peered":"2024-04-25T09:01:34.367056+0000","last_clean":"2024-04-25T09:01:34.367056+0000","last_became_active":"2024-04-25T09:01:27.800960+0000","last_became_peered":"2024-04-25T09:01:27.800960+0000","last_unstale":"2024-04-25T09:01:34.367056+0000","last_undegraded":"2024-04-25T09:01:34.367056+0000","last_fullsized":"2024-04-25T09:01:34.367056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209644+0000","last_change":"2024-04-25T09:01:33.014181+0000","last_active":"2024-04-25T09:01:35.209644+0000","last_peered":"2024-04-25T09:01:35.209644+0000","last_clean":"2024-04-25T09:01:35.209644+0000","last_became_active":"2024-04-25T09:01:33.013656+0000","last_became_peered":"2024-04-25T09:01:33.013656+0000","last_unstale":"2024-04-25T09:01:35.209644+0000","last_undegraded":"2024-04-25T09:01:35.209644+0000","last_fullsized":"2024-04-25T09:01:35.209644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:48:05.608973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366825+0000","last_change":"2024-04-25T09:01:28.801779+0000","last_active":"2024-04-25T09:01:34.366825+0000","last_peered":"2024-04-25T09:01:34.366825+0000","last_clean":"2024-04-25T09:01:34.366825+0000","last_became_active":"2024-04-25T09:01:28.801429+0000","last_became_peered":"2024-04-25T09:01:28.801429+0000","last_unstale":"2024-04-25T09:01:34.366825+0000","last_undegraded":"2024-04-25T09:01:34.366825+0000","last_fullsized":"2024-04-25T09:01:34.366825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212914+0000","last_change":"2024-04-25T09:01:27.812215+0000","last_active":"2024-04-25T09:01:35.212914+0000","last_peered":"2024-04-25T09:01:35.212914+0000","last_clean":"2024-04-25T09:01:35.212914+0000","last_became_active":"2024-04-25T09:01:27.811906+0000","last_became_peered":"2024-04-25T09:01:27.811906+0000","last_unstale":"2024-04-25T09:01:35.212914+0000","last_undegraded":"2024-04-25T09:01:35.212914+0000","last_fullsized":"2024-04-25T09:01:35.212914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:40.543447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709529+0000","last_change":"2024-04-25T09:01:33.012476+0000","last_active":"2024-04-25T09:01:34.709529+0000","last_peered":"2024-04-25T09:01:34.709529+0000","last_clean":"2024-04-25T09:01:34.709529+0000","last_became_active":"2024-04-25T09:01:33.012051+0000","last_became_peered":"2024-04-25T09:01:33.012051+0000","last_unstale":"2024-04-25T09:01:34.709529+0000","last_undegraded":"2024-04-25T09:01:34.709529+0000","last_fullsized":"2024-04-25T09:01:34.709529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:10.891366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825182+0000","last_change":"2024-04-25T09:01:28.796673+0000","last_active":"2024-04-25T09:01:33.825182+0000","last_peered":"2024-04-25T09:01:33.825182+0000","last_clean":"2024-04-25T09:01:33.825182+0000","last_became_active":"2024-04-25T09:01:28.796137+0000","last_became_peered":"2024-04-25T09:01:28.796137+0000","last_unstale":"2024-04-25T09:01:33.825182+0000","last_undegraded":"2024-04-25T09:01:33.825182+0000","last_fullsized":"2024-04-25T09:01:33.825182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:24.478830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366854+0000","last_change":"2024-04-25T09:01:27.806338+0000","last_active":"2024-04-25T09:01:34.366854+0000","last_peered":"2024-04-25T09:01:34.366854+0000","last_clean":"2024-04-25T09:01:34.366854+0000","last_became_active":"2024-04-25T09:01:27.806001+0000","last_became_peered":"2024-04-25T09:01:27.806001+0000","last_unstale":"2024-04-25T09:01:34.366854+0000","last_undegraded":"2024-04-25T09:01:34.366854+0000","last_fullsized":"2024-04-25T09:01:34.366854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366354+0000","last_change":"2024-04-25T09:01:32.842661+0000","last_active":"2024-04-25T09:01:34.366354+0000","last_peered":"2024-04-25T09:01:34.366354+0000","last_clean":"2024-04-25T09:01:34.366354+0000","last_became_active":"2024-04-25T09:01:32.840675+0000","last_became_peered":"2024-04-25T09:01:32.840675+0000","last_unstale":"2024-04-25T09:01:34.366354+0000","last_undegraded":"2024-04-25T09:01:34.366354+0000","last_fullsized":"2024-04-25T09:01:34.366354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:28.511146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826233+0000","last_change":"2024-04-25T09:01:28.808388+0000","last_active":"2024-04-25T09:01:33.826233+0000","last_peered":"2024-04-25T09:01:33.826233+0000","last_clean":"2024-04-25T09:01:33.826233+0000","last_became_active":"2024-04-25T09:01:28.808066+0000","last_became_peered":"2024-04-25T09:01:28.808066+0000","last_unstale":"2024-04-25T09:01:33.826233+0000","last_undegraded":"2024-04-25T09:01:33.826233+0000","last_fullsized":"2024-04-25T09:01:33.826233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:25.394669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825354+0000","last_change":"2024-04-25T09:01:27.791322+0000","last_active":"2024-04-25T09:01:33.825354+0000","last_peered":"2024-04-25T09:01:33.825354+0000","last_clean":"2024-04-25T09:01:33.825354+0000","last_became_active":"2024-04-25T09:01:27.790832+0000","last_became_peered":"2024-04-25T09:01:27.790832+0000","last_unstale":"2024-04-25T09:01:33.825354+0000","last_undegraded":"2024-04-25T09:01:33.825354+0000","last_fullsized":"2024-04-25T09:01:33.825354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366775+0000","last_change":"2024-04-25T09:01:32.833388+0000","last_active":"2024-04-25T09:01:34.366775+0000","last_peered":"2024-04-25T09:01:34.366775+0000","last_clean":"2024-04-25T09:01:34.366775+0000","last_became_active":"2024-04-25T09:01:32.832933+0000","last_became_peered":"2024-04-25T09:01:32.832933+0000","last_unstale":"2024-04-25T09:01:34.366775+0000","last_undegraded":"2024-04-25T09:01:34.366775+0000","last_fullsized":"2024-04-25T09:01:34.366775+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366415+0000","last_change":"2024-04-25T09:01:28.808496+0000","last_active":"2024-04-25T09:01:34.366415+0000","last_peered":"2024-04-25T09:01:34.366415+0000","last_clean":"2024-04-25T09:01:34.366415+0000","last_became_active":"2024-04-25T09:01:28.808041+0000","last_became_peered":"2024-04-25T09:01:28.808041+0000","last_unstale":"2024-04-25T09:01:34.366415+0000","last_undegraded":"2024-04-25T09:01:34.366415+0000","last_fullsized":"2024-04-25T09:01:34.366415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821744+0000","last_change":"2024-04-25T09:01:27.794633+0000","last_active":"2024-04-25T09:01:33.821744+0000","last_peered":"2024-04-25T09:01:33.821744+0000","last_clean":"2024-04-25T09:01:33.821744+0000","last_became_active":"2024-04-25T09:01:27.794353+0000","last_became_peered":"2024-04-25T09:01:27.794353+0000","last_unstale":"2024-04-25T09:01:33.821744+0000","last_undegraded":"2024-04-25T09:01:33.821744+0000","last_fullsized":"2024-04-25T09:01:33.821744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.367203+0000","last_change":"2024-04-25T09:01:32.841897+0000","last_active":"2024-04-25T09:01:34.367203+0000","last_peered":"2024-04-25T09:01:34.367203+0000","last_clean":"2024-04-25T09:01:34.367203+0000","last_became_active":"2024-04-25T09:01:32.840196+0000","last_became_peered":"2024-04-25T09:01:32.840196+0000","last_unstale":"2024-04-25T09:01:34.367203+0000","last_undegraded":"2024-04-25T09:01:34.367203+0000","last_fullsized":"2024-04-25T09:01:34.367203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:35.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.708999+0000","last_change":"2024-04-25T09:01:28.791325+0000","last_active":"2024-04-25T09:01:34.708999+0000","last_peered":"2024-04-25T09:01:34.708999+0000","last_clean":"2024-04-25T09:01:34.708999+0000","last_became_active":"2024-04-25T09:01:28.791016+0000","last_became_peered":"2024-04-25T09:01:28.791016+0000","last_unstale":"2024-04-25T09:01:34.708999+0000","last_undegraded":"2024-04-25T09:01:34.708999+0000","last_fullsized":"2024-04-25T09:01:34.708999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:57.905760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211553+0000","last_change":"2024-04-25T09:01:27.799619+0000","last_active":"2024-04-25T09:01:35.211553+0000","last_peered":"2024-04-25T09:01:35.211553+0000","last_clean":"2024-04-25T09:01:35.211553+0000","last_became_active":"2024-04-25T09:01:27.799353+0000","last_became_peered":"2024-04-25T09:01:27.799353+0000","last_unstale":"2024-04-25T09:01:35.211553+0000","last_undegraded":"2024-04-25T09:01:35.211553+0000","last_fullsized":"2024-04-25T09:01:35.211553+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709772+0000","last_change":"2024-04-25T09:01:33.017927+0000","last_active":"2024-04-25T09:01:34.709772+0000","last_peered":"2024-04-25T09:01:34.709772+0000","last_clean":"2024-04-25T09:01:34.709772+0000","last_became_active":"2024-04-25T09:01:33.017228+0000","last_became_peered":"2024-04-25T09:01:33.017228+0000","last_unstale":"2024-04-25T09:01:34.709772+0000","last_undegraded":"2024-04-25T09:01:34.709772+0000","last_fullsized":"2024-04-25T09:01:34.709772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:42.980668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209536+0000","last_change":"2024-04-25T09:01:28.797698+0000","last_active":"2024-04-25T09:01:35.209536+0000","last_peered":"2024-04-25T09:01:35.209536+0000","last_clean":"2024-04-25T09:01:35.209536+0000","last_became_active":"2024-04-25T09:01:28.797432+0000","last_became_peered":"2024-04-25T09:01:28.797432+0000","last_unstale":"2024-04-25T09:01:35.209536+0000","last_undegraded":"2024-04-25T09:01:35.209536+0000","last_fullsized":"2024-04-25T09:01:35.209536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824821+0000","last_change":"2024-04-25T09:01:27.786713+0000","last_active":"2024-04-25T09:01:33.824821+0000","last_peered":"2024-04-25T09:01:33.824821+0000","last_clean":"2024-04-25T09:01:33.824821+0000","last_became_active":"2024-04-25T09:01:27.786382+0000","last_became_peered":"2024-04-25T09:01:27.786382+0000","last_unstale":"2024-04-25T09:01:33.824821+0000","last_undegraded":"2024-04-25T09:01:33.824821+0000","last_fullsized":"2024-04-25T09:01:33.824821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:24.384271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211687+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:01:35.211687+0000","last_peered":"2024-04-25T09:01:35.211687+0000","last_clean":"2024-04-25T09:01:35.211687+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:01:35.211687+0000","last_undegraded":"2024-04-25T09:01:35.211687+0000","last_fullsized":"2024-04-25T09:01:35.211687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213128+0000","last_change":"2024-04-25T09:01:33.018970+0000","last_active":"2024-04-25T09:01:35.213128+0000","last_peered":"2024-04-25T09:01:35.213128+0000","last_clean":"2024-04-25T09:01:35.213128+0000","last_became_active":"2024-04-25T09:01:33.018274+0000","last_became_peered":"2024-04-25T09:01:33.018274+0000","last_unstale":"2024-04-25T09:01:35.213128+0000","last_undegraded":"2024-04-25T09:01:35.213128+0000","last_fullsized":"2024-04-25T09:01:35.213128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212686+0000","last_change":"2024-04-25T09:01:28.821408+0000","last_active":"2024-04-25T09:01:35.212686+0000","last_peered":"2024-04-25T09:01:35.212686+0000","last_clean":"2024-04-25T09:01:35.212686+0000","last_became_active":"2024-04-25T09:01:28.821141+0000","last_became_peered":"2024-04-25T09:01:28.821141+0000","last_unstale":"2024-04-25T09:01:35.212686+0000","last_undegraded":"2024-04-25T09:01:35.212686+0000","last_fullsized":"2024-04-25T09:01:35.212686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:33.239521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821975+0000","last_change":"2024-04-25T09:01:27.789772+0000","last_active":"2024-04-25T09:01:33.821975+0000","last_peered":"2024-04-25T09:01:33.821975+0000","last_clean":"2024-04-25T09:01:33.821975+0000","last_became_active":"2024-04-25T09:01:27.789396+0000","last_became_peered":"2024-04-25T09:01:27.789396+0000","last_unstale":"2024-04-25T09:01:33.821975+0000","last_undegraded":"2024-04-25T09:01:33.821975+0000","last_fullsized":"2024-04-25T09:01:33.821975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212034+0000","last_change":"2024-04-25T09:01:33.015998+0000","last_active":"2024-04-25T09:01:35.212034+0000","last_peered":"2024-04-25T09:01:35.212034+0000","last_clean":"2024-04-25T09:01:35.212034+0000","last_became_active":"2024-04-25T09:01:33.015527+0000","last_became_peered":"2024-04-25T09:01:33.015527+0000","last_unstale":"2024-04-25T09:01:35.212034+0000","last_undegraded":"2024-04-25T09:01:35.212034+0000","last_fullsized":"2024-04-25T09:01:35.212034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:28.511146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825725+0000","last_change":"2024-04-25T09:01:28.799867+0000","last_active":"2024-04-25T09:01:33.825725+0000","last_peered":"2024-04-25T09:01:33.825725+0000","last_clean":"2024-04-25T09:01:33.825725+0000","last_became_active":"2024-04-25T09:01:28.799555+0000","last_became_peered":"2024-04-25T09:01:28.799555+0000","last_unstale":"2024-04-25T09:01:33.825725+0000","last_undegraded":"2024-04-25T09:01:33.825725+0000","last_fullsized":"2024-04-25T09:01:33.825725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:46.890034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366891+0000","last_change":"2024-04-25T09:01:27.799345+0000","last_active":"2024-04-25T09:01:34.366891+0000","last_peered":"2024-04-25T09:01:34.366891+0000","last_clean":"2024-04-25T09:01:34.366891+0000","last_became_active":"2024-04-25T09:01:27.799041+0000","last_became_peered":"2024-04-25T09:01:27.799041+0000","last_unstale":"2024-04-25T09:01:34.366891+0000","last_undegraded":"2024-04-25T09:01:34.366891+0000","last_fullsized":"2024-04-25T09:01:34.366891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709467+0000","last_change":"2024-04-25T09:01:32.848657+0000","last_active":"2024-04-25T09:01:34.709467+0000","last_peered":"2024-04-25T09:01:34.709467+0000","last_clean":"2024-04-25T09:01:34.709467+0000","last_became_active":"2024-04-25T09:01:32.848154+0000","last_became_peered":"2024-04-25T09:01:32.848154+0000","last_unstale":"2024-04-25T09:01:34.709467+0000","last_undegraded":"2024-04-25T09:01:34.709467+0000","last_fullsized":"2024-04-25T09:01:34.709467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:10.747835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213067+0000","last_change":"2024-04-25T09:01:28.816736+0000","last_active":"2024-04-25T09:01:35.213067+0000","last_peered":"2024-04-25T09:01:35.213067+0000","last_clean":"2024-04-25T09:01:35.213067+0000","last_became_active":"2024-04-25T09:01:28.814910+0000","last_became_peered":"2024-04-25T09:01:28.814910+0000","last_unstale":"2024-04-25T09:01:35.213067+0000","last_undegraded":"2024-04-25T09:01:35.213067+0000","last_fullsized":"2024-04-25T09:01:35.213067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:03.946126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.822115+0000","last_change":"2024-04-25T09:01:27.791793+0000","last_active":"2024-04-25T09:01:33.822115+0000","last_peered":"2024-04-25T09:01:33.822115+0000","last_clean":"2024-04-25T09:01:33.822115+0000","last_became_active":"2024-04-25T09:01:27.791559+0000","last_became_peered":"2024-04-25T09:01:27.791559+0000","last_unstale":"2024-04-25T09:01:33.822115+0000","last_undegraded":"2024-04-25T09:01:33.822115+0000","last_fullsized":"2024-04-25T09:01:33.822115+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824560+0000","last_change":"2024-04-25T09:01:33.014380+0000","last_active":"2024-04-25T09:01:33.824560+0000","last_peered":"2024-04-25T09:01:33.824560+0000","last_clean":"2024-04-25T09:01:33.824560+0000","last_became_active":"2024-04-25T09:01:33.013885+0000","last_became_peered":"2024-04-25T09:01:33.013885+0000","last_unstale":"2024-04-25T09:01:33.824560+0000","last_undegraded":"2024-04-25T09:01:33.824560+0000","last_fullsized":"2024-04-25T09:01:33.824560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:43.548883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212597+0000","last_change":"2024-04-25T09:01:28.818477+0000","last_active":"2024-04-25T09:01:35.212597+0000","last_peered":"2024-04-25T09:01:35.212597+0000","last_clean":"2024-04-25T09:01:35.212597+0000","last_became_active":"2024-04-25T09:01:28.815329+0000","last_became_peered":"2024-04-25T09:01:28.815329+0000","last_unstale":"2024-04-25T09:01:35.212597+0000","last_undegraded":"2024-04-25T09:01:35.212597+0000","last_fullsized":"2024-04-25T09:01:35.212597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:31.277254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.827013+0000","last_change":"2024-04-25T09:01:27.803319+0000","last_active":"2024-04-25T09:01:33.827013+0000","last_peered":"2024-04-25T09:01:33.827013+0000","last_clean":"2024-04-25T09:01:33.827013+0000","last_became_active":"2024-04-25T09:01:27.802815+0000","last_became_peered":"2024-04-25T09:01:27.802815+0000","last_unstale":"2024-04-25T09:01:33.827013+0000","last_undegraded":"2024-04-25T09:01:33.827013+0000","last_fullsized":"2024-04-25T09:01:33.827013+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:51.791461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825394+0000","last_change":"2024-04-25T09:01:32.836009+0000","last_active":"2024-04-25T09:01:33.825394+0000","last_peered":"2024-04-25T09:01:33.825394+0000","last_clean":"2024-04-25T09:01:33.825394+0000","last_became_active":"2024-04-25T09:01:32.835471+0000","last_became_peered":"2024-04-25T09:01:32.835471+0000","last_unstale":"2024-04-25T09:01:33.825394+0000","last_undegraded":"2024-04-25T09:01:33.825394+0000","last_fullsized":"2024-04-25T09:01:33.825394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:59.537310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211909+0000","last_change":"2024-04-25T09:01:28.814374+0000","last_active":"2024-04-25T09:01:35.211909+0000","last_peered":"2024-04-25T09:01:35.211909+0000","last_clean":"2024-04-25T09:01:35.211909+0000","last_became_active":"2024-04-25T09:01:28.813316+0000","last_became_peered":"2024-04-25T09:01:28.813316+0000","last_unstale":"2024-04-25T09:01:35.211909+0000","last_undegraded":"2024-04-25T09:01:35.211909+0000","last_fullsized":"2024-04-25T09:01:35.211909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:06.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":30,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821520+0000","last_change":"2024-04-25T09:01:27.787446+0000","last_active":"2024-04-25T09:01:33.821520+0000","last_peered":"2024-04-25T09:01:33.821520+0000","last_clean":"2024-04-25T09:01:33.821520+0000","last_became_active":"2024-04-25T09:01:27.787231+0000","last_became_peered":"2024-04-25T09:01:27.787231+0000","last_unstale":"2024-04-25T09:01:33.821520+0000","last_undegraded":"2024-04-25T09:01:33.821520+0000","last_fullsized":"2024-04-25T09:01:33.821520+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709640+0000","last_change":"2024-04-25T09:01:32.837266+0000","last_active":"2024-04-25T09:01:34.709640+0000","last_peered":"2024-04-25T09:01:34.709640+0000","last_clean":"2024-04-25T09:01:34.709640+0000","last_became_active":"2024-04-25T09:01:32.836642+0000","last_became_peered":"2024-04-25T09:01:32.836642+0000","last_unstale":"2024-04-25T09:01:34.709640+0000","last_undegraded":"2024-04-25T09:01:34.709640+0000","last_fullsized":"2024-04-25T09:01:34.709640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:35.309570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211856+0000","last_change":"2024-04-25T09:01:28.800379+0000","last_active":"2024-04-25T09:01:35.211856+0000","last_peered":"2024-04-25T09:01:35.211856+0000","last_clean":"2024-04-25T09:01:35.211856+0000","last_became_active":"2024-04-25T09:01:28.800083+0000","last_became_peered":"2024-04-25T09:01:28.800083+0000","last_unstale":"2024-04-25T09:01:35.211856+0000","last_undegraded":"2024-04-25T09:01:35.211856+0000","last_fullsized":"2024-04-25T09:01:35.211856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212519+0000","last_change":"2024-04-25T09:01:27.795530+0000","last_active":"2024-04-25T09:01:35.212519+0000","last_peered":"2024-04-25T09:01:35.212519+0000","last_clean":"2024-04-25T09:01:35.212519+0000","last_became_active":"2024-04-25T09:01:27.795206+0000","last_became_peered":"2024-04-25T09:01:27.795206+0000","last_unstale":"2024-04-25T09:01:35.212519+0000","last_undegraded":"2024-04-25T09:01:35.212519+0000","last_fullsized":"2024-04-25T09:01:35.212519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:05.113715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210403+0000","last_change":"2024-04-25T09:01:33.016132+0000","last_active":"2024-04-25T09:01:35.210403+0000","last_peered":"2024-04-25T09:01:35.210403+0000","last_clean":"2024-04-25T09:01:35.210403+0000","last_became_active":"2024-04-25T09:01:33.015731+0000","last_became_peered":"2024-04-25T09:01:33.015731+0000","last_unstale":"2024-04-25T09:01:35.210403+0000","last_undegraded":"2024-04-25T09:01:35.210403+0000","last_fullsized":"2024-04-25T09:01:35.210403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:50.222305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212180+0000","last_change":"2024-04-25T09:01:28.815186+0000","last_active":"2024-04-25T09:01:35.212180+0000","last_peered":"2024-04-25T09:01:35.212180+0000","last_clean":"2024-04-25T09:01:35.212180+0000","last_became_active":"2024-04-25T09:01:28.814898+0000","last_became_peered":"2024-04-25T09:01:28.814898+0000","last_unstale":"2024-04-25T09:01:35.212180+0000","last_undegraded":"2024-04-25T09:01:35.212180+0000","last_fullsized":"2024-04-25T09:01:35.212180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:06.715519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825295+0000","last_change":"2024-04-25T09:01:27.795891+0000","last_active":"2024-04-25T09:01:33.825295+0000","last_peered":"2024-04-25T09:01:33.825295+0000","last_clean":"2024-04-25T09:01:33.825295+0000","last_became_active":"2024-04-25T09:01:27.795562+0000","last_became_peered":"2024-04-25T09:01:27.795562+0000","last_unstale":"2024-04-25T09:01:33.825295+0000","last_undegraded":"2024-04-25T09:01:33.825295+0000","last_fullsized":"2024-04-25T09:01:33.825295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210193+0000","last_change":"2024-04-25T09:01:33.014268+0000","last_active":"2024-04-25T09:01:35.210193+0000","last_peered":"2024-04-25T09:01:35.210193+0000","last_clean":"2024-04-25T09:01:35.210193+0000","last_became_active":"2024-04-25T09:01:33.013631+0000","last_became_peered":"2024-04-25T09:01:33.013631+0000","last_unstale":"2024-04-25T09:01:35.210193+0000","last_undegraded":"2024-04-25T09:01:35.210193+0000","last_fullsized":"2024-04-25T09:01:35.210193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:53.678828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709267+0000","last_change":"2024-04-25T09:01:28.805284+0000","last_active":"2024-04-25T09:01:34.709267+0000","last_peered":"2024-04-25T09:01:34.709267+0000","last_clean":"2024-04-25T09:01:34.709267+0000","last_became_active":"2024-04-25T09:01:28.804641+0000","last_became_peered":"2024-04-25T09:01:28.804641+0000","last_unstale":"2024-04-25T09:01:34.709267+0000","last_undegraded":"2024-04-25T09:01:34.709267+0000","last_fullsized":"2024-04-25T09:01:34.709267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:45.827977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709703+0000","last_change":"2024-04-25T09:01:27.803192+0000","last_active":"2024-04-25T09:01:34.709703+0000","last_peered":"2024-04-25T09:01:34.709703+0000","last_clean":"2024-04-25T09:01:34.709703+0000","last_became_active":"2024-04-25T09:01:27.802987+0000","last_became_peered":"2024-04-25T09:01:27.802987+0000","last_unstale":"2024-04-25T09:01:34.709703+0000","last_undegraded":"2024-04-25T09:01:34.709703+0000","last_fullsized":"2024-04-25T09:01:34.709703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:10:09.133960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825159+0000","last_change":"2024-04-25T09:01:33.017405+0000","last_active":"2024-04-25T09:01:33.825159+0000","last_peered":"2024-04-25T09:01:33.825159+0000","last_clean":"2024-04-25T09:01:33.825159+0000","last_became_active":"2024-04-25T09:01:33.016855+0000","last_became_peered":"2024-04-25T09:01:33.016855+0000","last_unstale":"2024-04-25T09:01:33.825159+0000","last_undegraded":"2024-04-25T09:01:33.825159+0000","last_fullsized":"2024-04-25T09:01:33.825159+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:24.797218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212580+0000","last_change":"2024-04-25T09:01:28.813680+0000","last_active":"2024-04-25T09:01:35.212580+0000","last_peered":"2024-04-25T09:01:35.212580+0000","last_clean":"2024-04-25T09:01:35.212580+0000","last_became_active":"2024-04-25T09:01:28.812991+0000","last_became_peered":"2024-04-25T09:01:28.812991+0000","last_unstale":"2024-04-25T09:01:35.212580+0000","last_undegraded":"2024-04-25T09:01:35.212580+0000","last_fullsized":"2024-04-25T09:01:35.212580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:24.478830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'10","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:44.640397+0000","last_change":"2024-04-25T09:01:27.792429+0000","last_active":"2024-04-25T09:01:44.640397+0000","last_peered":"2024-04-25T09:01:44.640397+0000","last_clean":"2024-04-25T09:01:44.640397+0000","last_became_active":"2024-04-25T09:01:27.792126+0000","last_became_peered":"2024-04-25T09:01:27.792126+0000","last_unstale":"2024-04-25T09:01:44.640397+0000","last_undegraded":"2024-04-25T09:01:44.640397+0000","last_fullsized":"2024-04-25T09:01:44.640397+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:27.321974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366571+0000","last_change":"2024-04-25T09:01:32.840515+0000","last_active":"2024-04-25T09:01:34.366571+0000","last_peered":"2024-04-25T09:01:34.366571+0000","last_clean":"2024-04-25T09:01:34.366571+0000","last_became_active":"2024-04-25T09:01:32.840063+0000","last_became_peered":"2024-04-25T09:01:32.840063+0000","last_unstale":"2024-04-25T09:01:34.366571+0000","last_undegraded":"2024-04-25T09:01:34.366571+0000","last_fullsized":"2024-04-25T09:01:34.366571+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.271837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826624+0000","last_change":"2024-04-25T09:01:28.809794+0000","last_active":"2024-04-25T09:01:33.826624+0000","last_peered":"2024-04-25T09:01:33.826624+0000","last_clean":"2024-04-25T09:01:33.826624+0000","last_became_active":"2024-04-25T09:01:28.809503+0000","last_became_peered":"2024-04-25T09:01:28.809503+0000","last_unstale":"2024-04-25T09:01:33.826624+0000","last_undegraded":"2024-04-25T09:01:33.826624+0000","last_fullsized":"2024-04-25T09:01:33.826624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:56.645747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366841+0000","last_change":"2024-04-25T09:01:27.789736+0000","last_active":"2024-04-25T09:01:34.366841+0000","last_peered":"2024-04-25T09:01:34.366841+0000","last_clean":"2024-04-25T09:01:34.366841+0000","last_became_active":"2024-04-25T09:01:27.789445+0000","last_became_peered":"2024-04-25T09:01:27.789445+0000","last_unstale":"2024-04-25T09:01:34.366841+0000","last_undegraded":"2024-04-25T09:01:34.366841+0000","last_fullsized":"2024-04-25T09:01:34.366841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826093+0000","last_change":"2024-04-25T09:01:32.835148+0000","last_active":"2024-04-25T09:01:33.826093+0000","last_peered":"2024-04-25T09:01:33.826093+0000","last_clean":"2024-04-25T09:01:33.826093+0000","last_became_active":"2024-04-25T09:01:32.834679+0000","last_became_peered":"2024-04-25T09:01:32.834679+0000","last_unstale":"2024-04-25T09:01:33.826093+0000","last_undegraded":"2024-04-25T09:01:33.826093+0000","last_fullsized":"2024-04-25T09:01:33.826093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:46.590077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709785+0000","last_change":"2024-04-25T09:01:28.805826+0000","last_active":"2024-04-25T09:01:34.709785+0000","last_peered":"2024-04-25T09:01:34.709785+0000","last_clean":"2024-04-25T09:01:34.709785+0000","last_became_active":"2024-04-25T09:01:28.805543+0000","last_became_peered":"2024-04-25T09:01:28.805543+0000","last_unstale":"2024-04-25T09:01:34.709785+0000","last_undegraded":"2024-04-25T09:01:34.709785+0000","last_fullsized":"2024-04-25T09:01:34.709785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825327+0000","last_change":"2024-04-25T09:01:27.801739+0000","last_active":"2024-04-25T09:01:33.825327+0000","last_peered":"2024-04-25T09:01:33.825327+0000","last_clean":"2024-04-25T09:01:33.825327+0000","last_became_active":"2024-04-25T09:01:27.801422+0000","last_became_peered":"2024-04-25T09:01:27.801422+0000","last_unstale":"2024-04-25T09:01:33.825327+0000","last_undegraded":"2024-04-25T09:01:33.825327+0000","last_fullsized":"2024-04-25T09:01:33.825327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209484+0000","last_change":"2024-04-25T09:01:32.836512+0000","last_active":"2024-04-25T09:01:35.209484+0000","last_peered":"2024-04-25T09:01:35.209484+0000","last_clean":"2024-04-25T09:01:35.209484+0000","last_became_active":"2024-04-25T09:01:32.834922+0000","last_became_peered":"2024-04-25T09:01:32.834922+0000","last_unstale":"2024-04-25T09:01:35.209484+0000","last_undegraded":"2024-04-25T09:01:35.209484+0000","last_fullsized":"2024-04-25T09:01:35.209484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:43.548883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825176+0000","last_change":"2024-04-25T09:01:28.803133+0000","last_active":"2024-04-25T09:01:33.825176+0000","last_peered":"2024-04-25T09:01:33.825176+0000","last_clean":"2024-04-25T09:01:33.825176+0000","last_became_active":"2024-04-25T09:01:28.802575+0000","last_became_peered":"2024-04-25T09:01:28.802575+0000","last_unstale":"2024-04-25T09:01:33.825176+0000","last_undegraded":"2024-04-25T09:01:33.825176+0000","last_fullsized":"2024-04-25T09:01:33.825176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:42.557761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213247+0000","last_change":"2024-04-25T09:01:27.795989+0000","last_active":"2024-04-25T09:01:35.213247+0000","last_peered":"2024-04-25T09:01:35.213247+0000","last_clean":"2024-04-25T09:01:35.213247+0000","last_became_active":"2024-04-25T09:01:27.794189+0000","last_became_peered":"2024-04-25T09:01:27.794189+0000","last_unstale":"2024-04-25T09:01:35.213247+0000","last_undegraded":"2024-04-25T09:01:35.213247+0000","last_fullsized":"2024-04-25T09:01:35.213247+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:37.448621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209544+0000","last_change":"2024-04-25T09:01:33.016051+0000","last_active":"2024-04-25T09:01:35.209544+0000","last_peered":"2024-04-25T09:01:35.209544+0000","last_clean":"2024-04-25T09:01:35.209544+0000","last_became_active":"2024-04-25T09:01:33.015720+0000","last_became_peered":"2024-04-25T09:01:33.015720+0000","last_unstale":"2024-04-25T09:01:35.209544+0000","last_undegraded":"2024-04-25T09:01:35.209544+0000","last_fullsized":"2024-04-25T09:01:35.209544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:04:24.797218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709440+0000","last_change":"2024-04-25T09:01:33.018289+0000","last_active":"2024-04-25T09:01:34.709440+0000","last_peered":"2024-04-25T09:01:34.709440+0000","last_clean":"2024-04-25T09:01:34.709440+0000","last_became_active":"2024-04-25T09:01:33.017643+0000","last_became_peered":"2024-04-25T09:01:33.017643+0000","last_unstale":"2024-04-25T09:01:34.709440+0000","last_undegraded":"2024-04-25T09:01:34.709440+0000","last_fullsized":"2024-04-25T09:01:34.709440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.271837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366208+0000","last_change":"2024-04-25T09:01:28.805719+0000","last_active":"2024-04-25T09:01:34.366208+0000","last_peered":"2024-04-25T09:01:34.366208+0000","last_clean":"2024-04-25T09:01:34.366208+0000","last_became_active":"2024-04-25T09:01:28.805394+0000","last_became_peered":"2024-04-25T09:01:28.805394+0000","last_unstale":"2024-04-25T09:01:34.366208+0000","last_undegraded":"2024-04-25T09:01:34.366208+0000","last_fullsized":"2024-04-25T09:01:34.366208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824665+0000","last_change":"2024-04-25T09:01:27.797013+0000","last_active":"2024-04-25T09:01:33.824665+0000","last_peered":"2024-04-25T09:01:33.824665+0000","last_clean":"2024-04-25T09:01:33.824665+0000","last_became_active":"2024-04-25T09:01:27.795312+0000","last_became_peered":"2024-04-25T09:01:27.795312+0000","last_unstale":"2024-04-25T09:01:33.824665+0000","last_undegraded":"2024-04-25T09:01:33.824665+0000","last_fullsized":"2024-04-25T09:01:33.824665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212668+0000","last_change":"2024-04-25T09:01:32.845195+0000","last_active":"2024-04-25T09:01:35.212668+0000","last_peered":"2024-04-25T09:01:35.212668+0000","last_clean":"2024-04-25T09:01:35.212668+0000","last_became_active":"2024-04-25T09:01:32.844725+0000","last_became_peered":"2024-04-25T09:01:32.844725+0000","last_unstale":"2024-04-25T09:01:35.212668+0000","last_undegraded":"2024-04-25T09:01:35.212668+0000","last_fullsized":"2024-04-25T09:01:35.212668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:37.271837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209436+0000","last_change":"2024-04-25T09:01:28.802082+0000","last_active":"2024-04-25T09:01:35.209436+0000","last_peered":"2024-04-25T09:01:35.209436+0000","last_clean":"2024-04-25T09:01:35.209436+0000","last_became_active":"2024-04-25T09:01:28.801617+0000","last_became_peered":"2024-04-25T09:01:28.801617+0000","last_unstale":"2024-04-25T09:01:35.209436+0000","last_undegraded":"2024-04-25T09:01:35.209436+0000","last_fullsized":"2024-04-25T09:01:35.209436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209733+0000","last_change":"2024-04-25T09:01:27.799488+0000","last_active":"2024-04-25T09:01:35.209733+0000","last_peered":"2024-04-25T09:01:35.209733+0000","last_clean":"2024-04-25T09:01:35.209733+0000","last_became_active":"2024-04-25T09:01:27.799191+0000","last_became_peered":"2024-04-25T09:01:27.799191+0000","last_unstale":"2024-04-25T09:01:35.209733+0000","last_undegraded":"2024-04-25T09:01:35.209733+0000","last_fullsized":"2024-04-25T09:01:35.209733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:13:58.986572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212177+0000","last_change":"2024-04-25T09:01:27.802418+0000","last_active":"2024-04-25T09:01:35.212177+0000","last_peered":"2024-04-25T09:01:35.212177+0000","last_clean":"2024-04-25T09:01:35.212177+0000","last_became_active":"2024-04-25T09:01:27.802128+0000","last_became_peered":"2024-04-25T09:01:27.802128+0000","last_unstale":"2024-04-25T09:01:35.212177+0000","last_undegraded":"2024-04-25T09:01:35.212177+0000","last_fullsized":"2024-04-25T09:01:35.212177+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.422611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709621+0000","last_change":"2024-04-25T09:01:28.802082+0000","last_active":"2024-04-25T09:01:34.709621+0000","last_peered":"2024-04-25T09:01:34.709621+0000","last_clean":"2024-04-25T09:01:34.709621+0000","last_became_active":"2024-04-25T09:01:28.801820+0000","last_became_peered":"2024-04-25T09:01:28.801820+0000","last_unstale":"2024-04-25T09:01:34.709621+0000","last_undegraded":"2024-04-25T09:01:34.709621+0000","last_fullsized":"2024-04-25T09:01:34.709621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:29:17.770689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821849+0000","last_change":"2024-04-25T09:01:32.838999+0000","last_active":"2024-04-25T09:01:33.821849+0000","last_peered":"2024-04-25T09:01:33.821849+0000","last_clean":"2024-04-25T09:01:33.821849+0000","last_became_active":"2024-04-25T09:01:32.838525+0000","last_became_peered":"2024-04-25T09:01:32.838525+0000","last_unstale":"2024-04-25T09:01:33.821849+0000","last_undegraded":"2024-04-25T09:01:33.821849+0000","last_fullsized":"2024-04-25T09:01:33.821849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:49.860293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209935+0000","last_change":"2024-04-25T09:01:27.795362+0000","last_active":"2024-04-25T09:01:35.209935+0000","last_peered":"2024-04-25T09:01:35.209935+0000","last_clean":"2024-04-25T09:01:35.209935+0000","last_became_active":"2024-04-25T09:01:27.795063+0000","last_became_peered":"2024-04-25T09:01:27.795063+0000","last_unstale":"2024-04-25T09:01:35.209935+0000","last_undegraded":"2024-04-25T09:01:35.209935+0000","last_fullsized":"2024-04-25T09:01:35.209935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:26.753739+0000","last_clean_scrub_stamp":"2024-04-25T09:01:26.753739+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:28:29.964710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825751+0000","last_change":"2024-04-25T09:01:28.804182+0000","last_active":"2024-04-25T09:01:33.825751+0000","last_peered":"2024-04-25T09:01:33.825751+0000","last_clean":"2024-04-25T09:01:33.825751+0000","last_became_active":"2024-04-25T09:01:28.803828+0000","last_became_peered":"2024-04-25T09:01:28.803828+0000","last_unstale":"2024-04-25T09:01:33.825751+0000","last_undegraded":"2024-04-25T09:01:33.825751+0000","last_fullsized":"2024-04-25T09:01:33.825751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:28.332372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210139+0000","last_change":"2024-04-25T09:01:32.838771+0000","last_active":"2024-04-25T09:01:35.210139+0000","last_peered":"2024-04-25T09:01:35.210139+0000","last_clean":"2024-04-25T09:01:35.210139+0000","last_became_active":"2024-04-25T09:01:32.838328+0000","last_became_peered":"2024-04-25T09:01:32.838328+0000","last_unstale":"2024-04-25T09:01:35.210139+0000","last_undegraded":"2024-04-25T09:01:35.210139+0000","last_fullsized":"2024-04-25T09:01:35.210139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:31.796453+0000","last_clean_scrub_stamp":"2024-04-25T09:01:31.796453+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:53:21.908859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211532+0000","last_change":"2024-04-25T09:01:28.800460+0000","last_active":"2024-04-25T09:01:35.211532+0000","last_peered":"2024-04-25T09:01:35.211532+0000","last_clean":"2024-04-25T09:01:35.211532+0000","last_became_active":"2024-04-25T09:01:28.800206+0000","last_became_peered":"2024-04-25T09:01:28.800206+0000","last_unstale":"2024-04-25T09:01:35.211532+0000","last_undegraded":"2024-04-25T09:01:35.211532+0000","last_fullsized":"2024-04-25T09:01:35.211532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.821704+0000","last_change":"2024-04-25T09:01:28.813568+0000","last_active":"2024-04-25T09:01:33.821704+0000","last_peered":"2024-04-25T09:01:33.821704+0000","last_clean":"2024-04-25T09:01:33.821704+0000","last_became_active":"2024-04-25T09:01:28.813174+0000","last_became_peered":"2024-04-25T09:01:28.813174+0000","last_unstale":"2024-04-25T09:01:33.821704+0000","last_undegraded":"2024-04-25T09:01:33.821704+0000","last_fullsized":"2024-04-25T09:01:33.821704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:56.645747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825234+0000","last_change":"2024-04-25T09:01:28.795346+0000","last_active":"2024-04-25T09:01:33.825234+0000","last_peered":"2024-04-25T09:01:33.825234+0000","last_clean":"2024-04-25T09:01:33.825234+0000","last_became_active":"2024-04-25T09:01:28.795062+0000","last_became_peered":"2024-04-25T09:01:28.795062+0000","last_unstale":"2024-04-25T09:01:33.825234+0000","last_undegraded":"2024-04-25T09:01:33.825234+0000","last_fullsized":"2024-04-25T09:01:33.825234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:31.277254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709593+0000","last_change":"2024-04-25T09:01:28.796978+0000","last_active":"2024-04-25T09:01:34.709593+0000","last_peered":"2024-04-25T09:01:34.709593+0000","last_clean":"2024-04-25T09:01:34.709593+0000","last_became_active":"2024-04-25T09:01:28.796196+0000","last_became_peered":"2024-04-25T09:01:28.796196+0000","last_unstale":"2024-04-25T09:01:34.709593+0000","last_undegraded":"2024-04-25T09:01:34.709593+0000","last_fullsized":"2024-04-25T09:01:34.709593+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:43.336463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210135+0000","last_change":"2024-04-25T09:01:28.814030+0000","last_active":"2024-04-25T09:01:35.210135+0000","last_peered":"2024-04-25T09:01:35.210135+0000","last_clean":"2024-04-25T09:01:35.210135+0000","last_became_active":"2024-04-25T09:01:28.813738+0000","last_became_peered":"2024-04-25T09:01:28.813738+0000","last_unstale":"2024-04-25T09:01:35.210135+0000","last_undegraded":"2024-04-25T09:01:35.210135+0000","last_fullsized":"2024-04-25T09:01:35.210135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:42.557761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366730+0000","last_change":"2024-04-25T09:01:28.795112+0000","last_active":"2024-04-25T09:01:34.366730+0000","last_peered":"2024-04-25T09:01:34.366730+0000","last_clean":"2024-04-25T09:01:34.366730+0000","last_became_active":"2024-04-25T09:01:28.794801+0000","last_became_peered":"2024-04-25T09:01:28.794801+0000","last_unstale":"2024-04-25T09:01:34.366730+0000","last_undegraded":"2024-04-25T09:01:34.366730+0000","last_fullsized":"2024-04-25T09:01:34.366730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:14.702471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213014+0000","last_change":"2024-04-25T09:01:28.809748+0000","last_active":"2024-04-25T09:01:35.213014+0000","last_peered":"2024-04-25T09:01:35.213014+0000","last_clean":"2024-04-25T09:01:35.213014+0000","last_became_active":"2024-04-25T09:01:28.809461+0000","last_became_peered":"2024-04-25T09:01:28.809461+0000","last_unstale":"2024-04-25T09:01:35.213014+0000","last_undegraded":"2024-04-25T09:01:35.213014+0000","last_fullsized":"2024-04-25T09:01:35.213014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.210397+0000","last_change":"2024-04-25T09:01:28.813864+0000","last_active":"2024-04-25T09:01:35.210397+0000","last_peered":"2024-04-25T09:01:35.210397+0000","last_clean":"2024-04-25T09:01:35.210397+0000","last_became_active":"2024-04-25T09:01:28.813495+0000","last_became_peered":"2024-04-25T09:01:28.813495+0000","last_unstale":"2024-04-25T09:01:35.210397+0000","last_undegraded":"2024-04-25T09:01:35.210397+0000","last_fullsized":"2024-04-25T09:01:35.210397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825456+0000","last_change":"2024-04-25T09:01:28.794304+0000","last_active":"2024-04-25T09:01:33.825456+0000","last_peered":"2024-04-25T09:01:33.825456+0000","last_clean":"2024-04-25T09:01:33.825456+0000","last_became_active":"2024-04-25T09:01:28.794011+0000","last_became_peered":"2024-04-25T09:01:28.794011+0000","last_unstale":"2024-04-25T09:01:33.825456+0000","last_undegraded":"2024-04-25T09:01:33.825456+0000","last_fullsized":"2024-04-25T09:01:33.825456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:45.224319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209656+0000","last_change":"2024-04-25T09:01:28.799673+0000","last_active":"2024-04-25T09:01:35.209656+0000","last_peered":"2024-04-25T09:01:35.209656+0000","last_clean":"2024-04-25T09:01:35.209656+0000","last_became_active":"2024-04-25T09:01:28.799385+0000","last_became_peered":"2024-04-25T09:01:28.799385+0000","last_unstale":"2024-04-25T09:01:35.209656+0000","last_undegraded":"2024-04-25T09:01:35.209656+0000","last_fullsized":"2024-04-25T09:01:35.209656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:13.869416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825187+0000","last_change":"2024-04-25T09:01:28.807260+0000","last_active":"2024-04-25T09:01:33.825187+0000","last_peered":"2024-04-25T09:01:33.825187+0000","last_clean":"2024-04-25T09:01:33.825187+0000","last_became_active":"2024-04-25T09:01:28.806995+0000","last_became_peered":"2024-04-25T09:01:28.806995+0000","last_unstale":"2024-04-25T09:01:33.825187+0000","last_undegraded":"2024-04-25T09:01:33.825187+0000","last_fullsized":"2024-04-25T09:01:33.825187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:06.859050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709277+0000","last_change":"2024-04-25T09:01:28.797279+0000","last_active":"2024-04-25T09:01:34.709277+0000","last_peered":"2024-04-25T09:01:34.709277+0000","last_clean":"2024-04-25T09:01:34.709277+0000","last_became_active":"2024-04-25T09:01:28.796574+0000","last_became_peered":"2024-04-25T09:01:28.796574+0000","last_unstale":"2024-04-25T09:01:34.709277+0000","last_undegraded":"2024-04-25T09:01:34.709277+0000","last_fullsized":"2024-04-25T09:01:34.709277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:15:01.770247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212692+0000","last_change":"2024-04-25T09:01:28.799529+0000","last_active":"2024-04-25T09:01:35.212692+0000","last_peered":"2024-04-25T09:01:35.212692+0000","last_clean":"2024-04-25T09:01:35.212692+0000","last_became_active":"2024-04-25T09:01:28.799231+0000","last_became_peered":"2024-04-25T09:01:28.799231+0000","last_unstale":"2024-04-25T09:01:35.212692+0000","last_undegraded":"2024-04-25T09:01:35.212692+0000","last_fullsized":"2024-04-25T09:01:35.212692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:36:45.224319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212894+0000","last_change":"2024-04-25T09:01:28.820816+0000","last_active":"2024-04-25T09:01:35.212894+0000","last_peered":"2024-04-25T09:01:35.212894+0000","last_clean":"2024-04-25T09:01:35.212894+0000","last_became_active":"2024-04-25T09:01:28.819970+0000","last_became_peered":"2024-04-25T09:01:28.819970+0000","last_unstale":"2024-04-25T09:01:35.212894+0000","last_undegraded":"2024-04-25T09:01:35.212894+0000","last_fullsized":"2024-04-25T09:01:35.212894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:39.516566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.822061+0000","last_change":"2024-04-25T09:01:28.802779+0000","last_active":"2024-04-25T09:01:33.822061+0000","last_peered":"2024-04-25T09:01:33.822061+0000","last_clean":"2024-04-25T09:01:33.822061+0000","last_became_active":"2024-04-25T09:01:28.802504+0000","last_became_peered":"2024-04-25T09:01:28.802504+0000","last_unstale":"2024-04-25T09:01:33.822061+0000","last_undegraded":"2024-04-25T09:01:33.822061+0000","last_fullsized":"2024-04-25T09:01:33.822061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:42:12.377470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825926+0000","last_change":"2024-04-25T09:01:28.806216+0000","last_active":"2024-04-25T09:01:33.825926+0000","last_peered":"2024-04-25T09:01:33.825926+0000","last_clean":"2024-04-25T09:01:33.825926+0000","last_became_active":"2024-04-25T09:01:28.805683+0000","last_became_peered":"2024-04-25T09:01:28.805683+0000","last_unstale":"2024-04-25T09:01:33.825926+0000","last_undegraded":"2024-04-25T09:01:33.825926+0000","last_fullsized":"2024-04-25T09:01:33.825926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:06.715519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.824510+0000","last_change":"2024-04-25T09:01:28.795390+0000","last_active":"2024-04-25T09:01:33.824510+0000","last_peered":"2024-04-25T09:01:33.824510+0000","last_clean":"2024-04-25T09:01:33.824510+0000","last_became_active":"2024-04-25T09:01:28.795100+0000","last_became_peered":"2024-04-25T09:01:28.795100+0000","last_unstale":"2024-04-25T09:01:33.824510+0000","last_undegraded":"2024-04-25T09:01:33.824510+0000","last_fullsized":"2024-04-25T09:01:33.824510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366292+0000","last_change":"2024-04-25T09:01:28.807705+0000","last_active":"2024-04-25T09:01:34.366292+0000","last_peered":"2024-04-25T09:01:34.366292+0000","last_clean":"2024-04-25T09:01:34.366292+0000","last_became_active":"2024-04-25T09:01:28.807321+0000","last_became_peered":"2024-04-25T09:01:28.807321+0000","last_unstale":"2024-04-25T09:01:34.366292+0000","last_undegraded":"2024-04-25T09:01:34.366292+0000","last_fullsized":"2024-04-25T09:01:34.366292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709236+0000","last_change":"2024-04-25T09:01:28.800758+0000","last_active":"2024-04-25T09:01:34.709236+0000","last_peered":"2024-04-25T09:01:34.709236+0000","last_clean":"2024-04-25T09:01:34.709236+0000","last_became_active":"2024-04-25T09:01:28.800380+0000","last_became_peered":"2024-04-25T09:01:28.800380+0000","last_unstale":"2024-04-25T09:01:34.709236+0000","last_undegraded":"2024-04-25T09:01:34.709236+0000","last_fullsized":"2024-04-25T09:01:34.709236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:41.553845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209750+0000","last_change":"2024-04-25T09:01:28.803209+0000","last_active":"2024-04-25T09:01:35.209750+0000","last_peered":"2024-04-25T09:01:35.209750+0000","last_clean":"2024-04-25T09:01:35.209750+0000","last_became_active":"2024-04-25T09:01:28.801889+0000","last_became_peered":"2024-04-25T09:01:28.801889+0000","last_unstale":"2024-04-25T09:01:35.209750+0000","last_undegraded":"2024-04-25T09:01:35.209750+0000","last_fullsized":"2024-04-25T09:01:35.209750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.826547+0000","last_change":"2024-04-25T09:01:28.809150+0000","last_active":"2024-04-25T09:01:33.826547+0000","last_peered":"2024-04-25T09:01:33.826547+0000","last_clean":"2024-04-25T09:01:33.826547+0000","last_became_active":"2024-04-25T09:01:28.801172+0000","last_became_peered":"2024-04-25T09:01:28.801172+0000","last_unstale":"2024-04-25T09:01:33.826547+0000","last_undegraded":"2024-04-25T09:01:33.826547+0000","last_fullsized":"2024-04-25T09:01:33.826547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:19:06.124113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213293+0000","last_change":"2024-04-25T09:01:28.810054+0000","last_active":"2024-04-25T09:01:35.213293+0000","last_peered":"2024-04-25T09:01:35.213293+0000","last_clean":"2024-04-25T09:01:35.213293+0000","last_became_active":"2024-04-25T09:01:28.809288+0000","last_became_peered":"2024-04-25T09:01:28.809288+0000","last_unstale":"2024-04-25T09:01:35.213293+0000","last_undegraded":"2024-04-25T09:01:35.213293+0000","last_fullsized":"2024-04-25T09:01:35.213293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:09.351330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212915+0000","last_change":"2024-04-25T09:01:28.803094+0000","last_active":"2024-04-25T09:01:35.212915+0000","last_peered":"2024-04-25T09:01:35.212915+0000","last_clean":"2024-04-25T09:01:35.212915+0000","last_became_active":"2024-04-25T09:01:28.802768+0000","last_became_peered":"2024-04-25T09:01:28.802768+0000","last_unstale":"2024-04-25T09:01:35.212915+0000","last_undegraded":"2024-04-25T09:01:35.212915+0000","last_fullsized":"2024-04-25T09:01:35.212915+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:40:39.782418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.213016+0000","last_change":"2024-04-25T09:01:28.822072+0000","last_active":"2024-04-25T09:01:35.213016+0000","last_peered":"2024-04-25T09:01:35.213016+0000","last_clean":"2024-04-25T09:01:35.213016+0000","last_became_active":"2024-04-25T09:01:28.821805+0000","last_became_peered":"2024-04-25T09:01:28.821805+0000","last_unstale":"2024-04-25T09:01:35.213016+0000","last_undegraded":"2024-04-25T09:01:35.213016+0000","last_fullsized":"2024-04-25T09:01:35.213016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:05:10.070021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.209311+0000","last_change":"2024-04-25T09:01:28.797350+0000","last_active":"2024-04-25T09:01:35.209311+0000","last_peered":"2024-04-25T09:01:35.209311+0000","last_clean":"2024-04-25T09:01:35.209311+0000","last_became_active":"2024-04-25T09:01:28.797039+0000","last_became_peered":"2024-04-25T09:01:28.797039+0000","last_unstale":"2024-04-25T09:01:35.209311+0000","last_undegraded":"2024-04-25T09:01:35.209311+0000","last_fullsized":"2024-04-25T09:01:35.209311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:28.695063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211801+0000","last_change":"2024-04-25T09:01:28.814399+0000","last_active":"2024-04-25T09:01:35.211801+0000","last_peered":"2024-04-25T09:01:35.211801+0000","last_clean":"2024-04-25T09:01:35.211801+0000","last_became_active":"2024-04-25T09:01:28.812569+0000","last_became_peered":"2024-04-25T09:01:28.812569+0000","last_unstale":"2024-04-25T09:01:35.211801+0000","last_undegraded":"2024-04-25T09:01:35.211801+0000","last_fullsized":"2024-04-25T09:01:35.211801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:08.201799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825039+0000","last_change":"2024-04-25T09:01:28.798631+0000","last_active":"2024-04-25T09:01:33.825039+0000","last_peered":"2024-04-25T09:01:33.825039+0000","last_clean":"2024-04-25T09:01:33.825039+0000","last_became_active":"2024-04-25T09:01:28.797450+0000","last_became_peered":"2024-04-25T09:01:28.797450+0000","last_unstale":"2024-04-25T09:01:33.825039+0000","last_undegraded":"2024-04-25T09:01:33.825039+0000","last_fullsized":"2024-04-25T09:01:33.825039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:33.239521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.211711+0000","last_change":"2024-04-25T09:01:28.817741+0000","last_active":"2024-04-25T09:01:35.211711+0000","last_peered":"2024-04-25T09:01:35.211711+0000","last_clean":"2024-04-25T09:01:35.211711+0000","last_became_active":"2024-04-25T09:01:28.816875+0000","last_became_peered":"2024-04-25T09:01:28.816875+0000","last_unstale":"2024-04-25T09:01:35.211711+0000","last_undegraded":"2024-04-25T09:01:35.211711+0000","last_fullsized":"2024-04-25T09:01:35.211711+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:55:46.890034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:33.825594+0000","last_change":"2024-04-25T09:01:28.800127+0000","last_active":"2024-04-25T09:01:33.825594+0000","last_peered":"2024-04-25T09:01:33.825594+0000","last_clean":"2024-04-25T09:01:33.825594+0000","last_became_active":"2024-04-25T09:01:28.799878+0000","last_became_peered":"2024-04-25T09:01:28.799878+0000","last_unstale":"2024-04-25T09:01:33.825594+0000","last_undegraded":"2024-04-25T09:01:33.825594+0000","last_fullsized":"2024-04-25T09:01:33.825594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:28.695063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.709466+0000","last_change":"2024-04-25T09:01:28.789959+0000","last_active":"2024-04-25T09:01:34.709466+0000","last_peered":"2024-04-25T09:01:34.709466+0000","last_clean":"2024-04-25T09:01:34.709466+0000","last_became_active":"2024-04-25T09:01:28.788152+0000","last_became_peered":"2024-04-25T09:01:28.788152+0000","last_unstale":"2024-04-25T09:01:34.709466+0000","last_undegraded":"2024-04-25T09:01:34.709466+0000","last_fullsized":"2024-04-25T09:01:34.709466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:49.956453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:34.366996+0000","last_change":"2024-04-25T09:01:28.798328+0000","last_active":"2024-04-25T09:01:34.366996+0000","last_peered":"2024-04-25T09:01:34.366996+0000","last_clean":"2024-04-25T09:01:34.366996+0000","last_became_active":"2024-04-25T09:01:28.797356+0000","last_became_peered":"2024-04-25T09:01:28.797356+0000","last_unstale":"2024-04-25T09:01:34.366996+0000","last_undegraded":"2024-04-25T09:01:34.366996+0000","last_fullsized":"2024-04-25T09:01:34.366996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:55.504994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-25T09:01:35.212405+0000","last_change":"2024-04-25T09:01:28.819648+0000","last_active":"2024-04-25T09:01:35.212405+0000","last_peered":"2024-04-25T09:01:35.212405+0000","last_clean":"2024-04-25T09:01:35.212405+0000","last_became_active":"2024-04-25T09:01:28.819185+0000","last_became_peered":"2024-04-25T09:01:28.819185+0000","last_unstale":"2024-04-25T09:01:35.212405+0000","last_undegraded":"2024-04-25T09:01:35.212405+0000","last_fullsized":"2024-04-25T09:01:35.212405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:27.764137+0000","last_clean_scrub_stamp":"2024-04-25T09:01:27.764137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:38.948352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32012,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339828,"statfs":{"total":96636764160,"available":96603983872,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:01:53.080 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:01:53.080 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T09:01:53.080 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T09:01:53.081 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:01:53.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.263+0000 7fd78b200640 1 Processor -- start 2024-04-25T09:01:53.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.263+0000 7fd78b200640 1 -- start start 2024-04-25T09:01:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd78b200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd78c15b5d0 0x7fd78c0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd78b200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd78c0b2450 0x7fd78c0b2900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd78b200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd78c0b13b0 con 0x7fd78c0d0010 2024-04-25T09:01:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd78b200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78c0b1690 con 0x7fd78c15b5d0 2024-04-25T09:01:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd78b200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78c0b1970 con 0x7fd78c0b2450 2024-04-25T09:01:53.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd789e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd78c15b5d0 0x7fd78c0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd789e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd78c15b5d0 0x7fd78c0cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35180/0 (socket says 172.21.15.59:35180) 2024-04-25T09:01:53.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd789e00640 1 -- 172.21.15.59:0/2358861336 learned_addr learned my addr 172.21.15.59:0/2358861336 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:53.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd78a800640 1 --2- 172.21.15.59:0/2358861336 >> v2:172.21.15.178:3300/0 conn(0x7fd78c0b2450 0x7fd78c0b2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd789e00640 1 -- 172.21.15.59:0/2358861336 >> v2:172.21.15.178:3300/0 conn(0x7fd78c0b2450 msgr2=0x7fd78c0b2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:53.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd789e00640 1 --2- 172.21.15.59:0/2358861336 >> v2:172.21.15.178:3300/0 conn(0x7fd78c0b2450 0x7fd78c0b2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd789e00640 1 -- 172.21.15.59:0/2358861336 >> v1:172.21.15.178:6789/0 conn(0x7fd78c0d0010 legacy=0x7fd78c0cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.267+0000 7fd789e00640 1 -- 172.21.15.59:0/2358861336 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c0b1c50 con 0x7fd78c15b5d0 2024-04-25T09:01:53.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd789e00640 1 --2- 172.21.15.59:0/2358861336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd78c15b5d0 0x7fd78c0cfad0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd78c09b0c0 tx=0x7fd77c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57a9891f182de07a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd789400640 1 -- 172.21.15.59:0/2358861336 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0b1070 con 0x7fd78c15b5d0 2024-04-25T09:01:53.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd789400640 1 -- 172.21.15.59:0/2358861336 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c0ac410 con 0x7fd78c15b5d0 2024-04-25T09:01:53.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd789400640 1 -- 172.21.15.59:0/2358861336 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0ac7e0 con 0x7fd78c15b5d0 2024-04-25T09:01:53.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 -- 172.21.15.59:0/2358861336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd78c15b5d0 msgr2=0x7fd78c0cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 --2- 172.21.15.59:0/2358861336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd78c15b5d0 0x7fd78c0cfad0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd78c09b0c0 tx=0x7fd77c01c520 comp rx=0 tx=0).stop 2024-04-25T09:01:53.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 -- 172.21.15.59:0/2358861336 shutdown_connections 2024-04-25T09:01:53.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 --2- 172.21.15.59:0/2358861336 >> v2:172.21.15.178:3300/0 conn(0x7fd78c0b2450 0x7fd78c0b2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 --2- 172.21.15.59:0/2358861336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd78c15b5d0 0x7fd78c0cfad0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 -- 172.21.15.59:0/2358861336 >> 172.21.15.59:0/2358861336 conn(0x7fd78c0d14f0 msgr2=0x7fd78c0d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:53.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 -- 172.21.15.59:0/2358861336 shutdown_connections 2024-04-25T09:01:53.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 -- 172.21.15.59:0/2358861336 wait complete. 2024-04-25T09:01:53.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 Processor -- start 2024-04-25T09:01:53.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 -- start start 2024-04-25T09:01:53.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd78c0b2450 0x7fd78c151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd78c0d0010 0x7fd78c156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd78c15b5d0 0x7fd78c0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c15bb30 con 0x7fd78c0b2450 2024-04-25T09:01:53.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c15b9b0 con 0x7fd78c15b5d0 2024-04-25T09:01:53.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd78b200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c1685a0 con 0x7fd78c0d0010 2024-04-25T09:01:53.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd789e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd78c0b2450 0x7fd78c151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd789e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd78c0b2450 0x7fd78c151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35188/0 (socket says 172.21.15.59:35188) 2024-04-25T09:01:53.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.271+0000 7fd789e00640 1 -- 172.21.15.59:0/3199810746 learned_addr learned my addr 172.21.15.59:0/3199810746 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:53.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd783e00640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd78c0d0010 0x7fd78c156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd789e00640 1 -- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd78c0d0010 msgr2=0x7fd78c156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd78a800640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd78c15b5d0 0x7fd78c0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd789e00640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd78c0d0010 0x7fd78c156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd789e00640 1 -- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd78c15b5d0 msgr2=0x7fd78c0ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd789e00640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd78c15b5d0 0x7fd78c0ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd789e00640 1 -- 172.21.15.59:0/3199810746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c15c240 con 0x7fd78c0b2450 2024-04-25T09:01:53.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd783e00640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd78c0d0010 0x7fd78c156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:53.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd78a800640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd78c15b5d0 0x7fd78c0ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:53.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd789e00640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd78c0b2450 0x7fd78c151a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0af040 tx=0x7fd77c0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd782000640 1 -- 172.21.15.59:0/3199810746 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0bc070 con 0x7fd78c0b2450 2024-04-25T09:01:53.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd782000640 1 -- 172.21.15.59:0/3199810746 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c0acd80 con 0x7fd78c0b2450 2024-04-25T09:01:53.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd782000640 1 -- 172.21.15.59:0/3199810746 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c0b1040 con 0x7fd78c0b2450 2024-04-25T09:01:53.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd78b200640 1 -- 172.21.15.59:0/3199810746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78c15c520 con 0x7fd78c0b2450 2024-04-25T09:01:53.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd78b200640 1 -- 172.21.15.59:0/3199810746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78c15cae0 con 0x7fd78c0b2450 2024-04-25T09:01:53.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd78b200640 1 -- 172.21.15.59:0/3199810746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd78c04efa0 con 0x7fd78c0b2450 2024-04-25T09:01:53.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.275+0000 7fd782000640 1 -- 172.21.15.59:0/3199810746 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd77c0b63d0 con 0x7fd78c0b2450 2024-04-25T09:01:53.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.279+0000 7fd782000640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd768066f60 0x7fd768069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.279+0000 7fd782000640 1 -- 172.21.15.59:0/3199810746 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd77c11ea10 con 0x7fd78c0b2450 2024-04-25T09:01:53.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.279+0000 7fd783e00640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd768066f60 0x7fd768069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.279+0000 7fd783e00640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd768066f60 0x7fd768069420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd78c1f9b00 tx=0x7fd774009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.279+0000 7fd782000640 1 -- 172.21.15.59:0/3199810746 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd77c016110 con 0x7fd78c0b2450 2024-04-25T09:01:53.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 -- 172.21.15.59:0/3199810746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd78c0b48b0 con 0x7fd78c0b2450 2024-04-25T09:01:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd782000640 1 -- 172.21.15.59:0/3199810746 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd77c0ef6d0 con 0x7fd78c0b2450 2024-04-25T09:01:53.470 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:53.470 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:01:53.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 -- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd768066f60 msgr2=0x7fd768069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd768066f60 0x7fd768069420 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd78c1f9b00 tx=0x7fd774009040 comp rx=0 tx=0).stop 2024-04-25T09:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 -- 172.21.15.59:0/3199810746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd78c0b2450 msgr2=0x7fd78c151a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd78c0b2450 0x7fd78c151a10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0af040 tx=0x7fd77c0192c0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 -- 172.21.15.59:0/3199810746 shutdown_connections 2024-04-25T09:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd768066f60 0x7fd768069420 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd78c15b5d0 0x7fd78c0ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd78c0d0010 0x7fd78c156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 --2- 172.21.15.59:0/3199810746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd78c0b2450 0x7fd78c151a10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 -- 172.21.15.59:0/3199810746 >> 172.21.15.59:0/3199810746 conn(0x7fd78c0d14f0 msgr2=0x7fd78c0b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 -- 172.21.15.59:0/3199810746 shutdown_connections 2024-04-25T09:01:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.479+0000 7fd78b200640 1 -- 172.21.15.59:0/3199810746 wait complete. 2024-04-25T09:01:53.491 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T09:01:53.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:53.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.639+0000 7f3589c00640 1 Processor -- start 2024-04-25T09:01:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.639+0000 7f3589c00640 1 -- start start 2024-04-25T09:01:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3589c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3584099a60 0x7f3584099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3589c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358409a380 con 0x7f358415ee00 2024-04-25T09:01:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3589c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358406c650 con 0x7f35840cff30 2024-04-25T09:01:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3589c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358406c430 con 0x7f3584099a60 2024-04-25T09:01:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f357be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f358415ee00 0x7f358406bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37640/0 (socket says 172.21.15.59:37640) 2024-04-25T09:01:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f357be00640 1 -- 172.21.15.59:0/1712615091 learned_addr learned my addr 172.21.15.59:0/1712615091 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582a00640 1 --2- 172.21.15.59:0/1712615091 >> v2:172.21.15.178:3300/0 conn(0x7f3584099a60 0x7f3584099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512562843 0 0) 0x7f358409a380 con 0x7f358415ee00 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3568003530 con 0x7f358415ee00 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3079422409 0 0) 0x7f3568003530 con 0x7f358415ee00 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 >> v2:172.21.15.178:3300/0 conn(0x7f3584099a60 msgr2=0x7f3584099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 --2- 172.21.15.59:0/1712615091 >> v2:172.21.15.178:3300/0 conn(0x7f3584099a60 0x7f3584099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 >> v1:172.21.15.178:6789/0 conn(0x7f35840cff30 legacy=0x7f35840d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358406c930 con 0x7f358415ee00 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f356c001680 con 0x7f358415ee00 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582a00640 1 --2- 172.21.15.59:0/1712615091 >> v2:172.21.15.178:3300/0 conn(0x7f3584099a60 0x7f3584099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 >> v1:172.21.15.59:6789/0 conn(0x7f358415ee00 legacy=0x7f358406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 --2- 172.21.15.59:0/1712615091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35680039c0 0x7f3568003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 --2- 172.21.15.59:0/1712615091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3568004810 0x7f3568004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 --2- 172.21.15.59:0/1712615091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35680051d0 0x7f356800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358406c430 con 0x7f3568004810 2024-04-25T09:01:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356800c070 con 0x7f35680051d0 2024-04-25T09:01:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356800c270 con 0x7f35680039c0 2024-04-25T09:01:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f357be00640 1 --2- 172.21.15.59:0/1712615091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3568004810 0x7f3568004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3583400640 1 --2- 172.21.15.59:0/1712615091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35680051d0 0x7f356800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3582a00640 1 --2- 172.21.15.59:0/1712615091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35680039c0 0x7f3568003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f357be00640 1 -- 172.21.15.59:0/1712615091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35680039c0 msgr2=0x7f3568003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f357be00640 1 --2- 172.21.15.59:0/1712615091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f35680039c0 0x7f3568003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f357be00640 1 -- 172.21.15.59:0/1712615091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35680051d0 msgr2=0x7f356800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f357be00640 1 --2- 172.21.15.59:0/1712615091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35680051d0 0x7f356800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f357be00640 1 -- 172.21.15.59:0/1712615091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3568003530 con 0x7f3568004810 2024-04-25T09:01:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.643+0000 7f3583400640 1 -- 172.21.15.59:0/1712615091 reap_dead start 2024-04-25T09:01:53.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f357be00640 1 --2- 172.21.15.59:0/1712615091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3568004810 0x7f3568004c90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f358415f260 tx=0x7f356c01f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f552ef185ba3d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c007d40 con 0x7f3568004810 2024-04-25T09:01:53.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c005b00 con 0x7f3568004810 2024-04-25T09:01:53.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f3582000640 1 -- 172.21.15.59:0/1712615091 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c007070 con 0x7f3568004810 2024-04-25T09:01:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f3589c00640 1 -- 172.21.15.59:0/1712615091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3568004810 msgr2=0x7f3568004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f3589c00640 1 --2- 172.21.15.59:0/1712615091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3568004810 0x7f3568004c90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f358415f260 tx=0x7f356c01f3d0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f3589c00640 1 -- 172.21.15.59:0/1712615091 shutdown_connections 2024-04-25T09:01:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f3589c00640 1 --2- 172.21.15.59:0/1712615091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3568004810 0x7f3568004c90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f3589c00640 1 -- 172.21.15.59:0/1712615091 >> 172.21.15.59:0/1712615091 conn(0x7f35840d17a0 msgr2=0x7f35840d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f3589c00640 1 -- 172.21.15.59:0/1712615091 shutdown_connections 2024-04-25T09:01:53.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f3589c00640 1 -- 172.21.15.59:0/1712615091 wait complete. 2024-04-25T09:01:53.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f3589c00640 1 Processor -- start 2024-04-25T09:01:53.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.647+0000 7f3589c00640 1 -- start start 2024-04-25T09:01:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f3589c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3568004810 0x7f3584154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f3589c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f358415cce0 0x7f35840ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f3589c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f358415c5e0 0x7f35840cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f3589c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840cf9e0 con 0x7f358415cce0 2024-04-25T09:01:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f3589c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358406cef0 con 0x7f358415c5e0 2024-04-25T09:01:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f3589c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358415de80 con 0x7f3568004810 2024-04-25T09:01:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f358415cce0 0x7f35840ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f358415cce0 0x7f35840ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35198/0 (socket says 172.21.15.59:35198) 2024-04-25T09:01:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357be00640 1 -- 172.21.15.59:0/114010197 learned_addr learned my addr 172.21.15.59:0/114010197 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f3582a00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3568004810 0x7f3584154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f3583400640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f358415c5e0 0x7f35840cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357be00640 1 -- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3568004810 msgr2=0x7f3584154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357be00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3568004810 0x7f3584154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357be00640 1 -- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f358415c5e0 msgr2=0x7f35840cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357be00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f358415c5e0 0x7f35840cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357be00640 1 -- 172.21.15.59:0/114010197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3584156460 con 0x7f358415cce0 2024-04-25T09:01:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f3583400640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f358415c5e0 0x7f35840cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357be00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f358415cce0 0x7f35840ccf50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f356c01f200 tx=0x7f3568005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357aa00640 1 -- 172.21.15.59:0/114010197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c001680 con 0x7f358415cce0 2024-04-25T09:01:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357aa00640 1 -- 172.21.15.59:0/114010197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c0b6070 con 0x7f358415cce0 2024-04-25T09:01:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357aa00640 1 -- 172.21.15.59:0/114010197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c0049f0 con 0x7f358415cce0 2024-04-25T09:01:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f3589c00640 1 -- 172.21.15.59:0/114010197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35840cc7c0 con 0x7f358415cce0 2024-04-25T09:01:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f3589c00640 1 -- 172.21.15.59:0/114010197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3584159920 con 0x7f358415cce0 2024-04-25T09:01:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f3589c00640 1 -- 172.21.15.59:0/114010197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35840745d0 con 0x7f358415cce0 2024-04-25T09:01:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.651+0000 7f357aa00640 1 -- 172.21.15.59:0/114010197 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f356c0b8020 con 0x7f358415cce0 2024-04-25T09:01:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.655+0000 7f357aa00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3560066f90 0x7f3560069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.655+0000 7f357aa00640 1 -- 172.21.15.59:0/114010197 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f356c1223b0 con 0x7f358415cce0 2024-04-25T09:01:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.655+0000 7f3582a00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3560066f90 0x7f3560069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.655+0000 7f3582a00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3560066f90 0x7f3560069450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f35840cdc30 tx=0x7f3574008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.659+0000 7f357aa00640 1 -- 172.21.15.59:0/114010197 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f356c0190e0 con 0x7f358415cce0 2024-04-25T09:01:53.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.823+0000 7f3589c00640 1 -- 172.21.15.59:0/114010197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f358409ae10 con 0x7f358415cce0 2024-04-25T09:01:53.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.823+0000 7f357aa00640 1 -- 172.21.15.59:0/114010197 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7f356c0f3130 con 0x7f358415cce0 2024-04-25T09:01:53.816 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:53.816 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:53.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.827+0000 7f3589c00640 1 -- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3560066f90 msgr2=0x7f3560069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.827+0000 7f3589c00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3560066f90 0x7f3560069450 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f35840cdc30 tx=0x7f3574008040 comp rx=0 tx=0).stop 2024-04-25T09:01:53.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.827+0000 7f3589c00640 1 -- 172.21.15.59:0/114010197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f358415cce0 msgr2=0x7f35840ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.827+0000 7f3589c00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f358415cce0 0x7f35840ccf50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f356c01f200 tx=0x7f3568005840 comp rx=0 tx=0).stop 2024-04-25T09:01:53.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.827+0000 7f3589c00640 1 -- 172.21.15.59:0/114010197 shutdown_connections 2024-04-25T09:01:53.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.827+0000 7f3589c00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3560066f90 0x7f3560069450 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.827+0000 7f3589c00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f358415c5e0 0x7f35840cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.827+0000 7f3589c00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f358415cce0 0x7f35840ccf50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.827+0000 7f3589c00640 1 --2- 172.21.15.59:0/114010197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3568004810 0x7f3584154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.827+0000 7f3589c00640 1 -- 172.21.15.59:0/114010197 >> 172.21.15.59:0/114010197 conn(0x7f35840d17a0 msgr2=0x7f35840ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:53.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.827+0000 7f3589c00640 1 -- 172.21.15.59:0/114010197 shutdown_connections 2024-04-25T09:01:53.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.827+0000 7f3589c00640 1 -- 172.21.15.59:0/114010197 wait complete. 2024-04-25T09:01:53.839 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:01:53.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:01:53.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69b0200640 1 Processor -- start 2024-04-25T09:01:53.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69b0200640 1 -- start start 2024-04-25T09:01:53.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69b0200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69a815dc60 0x7f69a80d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69b0200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69a806bf30 0x7f69a80cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69b0200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69a815e040 con 0x7f69a8099a60 2024-04-25T09:01:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69b0200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69a80cff80 con 0x7f69a806bf30 2024-04-25T09:01:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69b0200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a80d0260 con 0x7f69a815dc60 2024-04-25T09:01:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69ae200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f69a8099a60 0x7f69a80cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37656/0 (socket says 172.21.15.59:37656) 2024-04-25T09:01:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69ae200640 1 -- 172.21.15.59:0/963763385 learned_addr learned my addr 172.21.15.59:0/963763385 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69ad800640 1 --2- 172.21.15.59:0/963763385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69a815dc60 0x7f69a80d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69ace00640 1 --2- 172.21.15.59:0/963763385 >> v2:172.21.15.59:3300/0 conn(0x7f69a806bf30 0x7f69a80cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69a7e00640 1 -- 172.21.15.59:0/963763385 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182685321 0 0) 0x7f69a815e040 con 0x7f69a8099a60 2024-04-25T09:01:53.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69a7e00640 1 -- 172.21.15.59:0/963763385 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6990003530 con 0x7f69a8099a60 2024-04-25T09:01:53.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69ace00640 1 -- 172.21.15.59:0/963763385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69a815dc60 msgr2=0x7f69a80d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:53.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69ace00640 1 --2- 172.21.15.59:0/963763385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69a815dc60 0x7f69a80d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69ace00640 1 -- 172.21.15.59:0/963763385 >> v1:172.21.15.59:6789/0 conn(0x7f69a8099a60 legacy=0x7f69a80cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.995+0000 7f69ace00640 1 -- 172.21.15.59:0/963763385 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a80d0540 con 0x7f69a806bf30 2024-04-25T09:01:53.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.999+0000 7f69ace00640 1 --2- 172.21.15.59:0/963763385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a806bf30 0x7f69a80cf8a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f69940097c0 tx=0x7f699401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70dd8abdfe0b10f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.999+0000 7f69a7e00640 1 -- 172.21.15.59:0/963763385 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940b1070 con 0x7f69a806bf30 2024-04-25T09:01:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.999+0000 7f69a7e00640 1 -- 172.21.15.59:0/963763385 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69940a8050 con 0x7f69a806bf30 2024-04-25T09:01:53.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.999+0000 7f69a7e00640 1 -- 172.21.15.59:0/963763385 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940ac860 con 0x7f69a806bf30 2024-04-25T09:01:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.999+0000 7f69b0200640 1 -- 172.21.15.59:0/963763385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a806bf30 msgr2=0x7f69a80cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.999+0000 7f69b0200640 1 --2- 172.21.15.59:0/963763385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a806bf30 0x7f69a80cf8a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f69940097c0 tx=0x7f699401c3e0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.999+0000 7f69b0200640 1 -- 172.21.15.59:0/963763385 shutdown_connections 2024-04-25T09:01:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.999+0000 7f69b0200640 1 --2- 172.21.15.59:0/963763385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a806bf30 0x7f69a80cf8a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.999+0000 7f69b0200640 1 --2- 172.21.15.59:0/963763385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69a815dc60 0x7f69a80d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.999+0000 7f69b0200640 1 -- 172.21.15.59:0/963763385 >> 172.21.15.59:0/963763385 conn(0x7f69a80b3200 msgr2=0x7f69a80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.999+0000 7f69b0200640 1 -- 172.21.15.59:0/963763385 shutdown_connections 2024-04-25T09:01:53.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:53.999+0000 7f69b0200640 1 -- 172.21.15.59:0/963763385 wait complete. 2024-04-25T09:01:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69b0200640 1 Processor -- start 2024-04-25T09:01:53.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69b0200640 1 -- start start 2024-04-25T09:01:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69b0200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69a806bf30 0x7f69a8158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69b0200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8099a60 0x7f69a80ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69b0200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69a815dc60 0x7f69a8155340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69b0200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a809a280 con 0x7f69a8099a60 2024-04-25T09:01:54.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69b0200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69a80cc880 con 0x7f69a806bf30 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69b0200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69a8159150 con 0x7f69a815dc60 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ace00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8099a60 0x7f69a80ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ace00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8099a60 0x7f69a80ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35228/0 (socket says 172.21.15.59:35228) 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ace00640 1 -- 172.21.15.59:0/3669235712 learned_addr learned my addr 172.21.15.59:0/3669235712 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ad800640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69a806bf30 0x7f69a8158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ae200640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69a815dc60 0x7f69a8155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ace00640 1 -- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69a815dc60 msgr2=0x7f69a8155340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ace00640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69a815dc60 0x7f69a8155340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ace00640 1 -- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69a806bf30 msgr2=0x7f69a8158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ace00640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69a806bf30 0x7f69a8158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ace00640 1 -- 172.21.15.59:0/3669235712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a8155e70 con 0x7f69a8099a60 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ad800640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69a806bf30 0x7f69a8158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ae200640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69a815dc60 0x7f69a8155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69ace00640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8099a60 0x7f69a80ca960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f69940af040 tx=0x7f6994019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69a5600640 1 -- 172.21.15.59:0/3669235712 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940b9020 con 0x7f69a8099a60 2024-04-25T09:01:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69a5600640 1 -- 172.21.15.59:0/3669235712 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69940acd80 con 0x7f69a8099a60 2024-04-25T09:01:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69a5600640 1 -- 172.21.15.59:0/3669235712 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69940b1040 con 0x7f69a8099a60 2024-04-25T09:01:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69b0200640 1 -- 172.21.15.59:0/3669235712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69a8157b70 con 0x7f69a8099a60 2024-04-25T09:01:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69b0200640 1 -- 172.21.15.59:0/3669235712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69a8158130 con 0x7f69a8099a60 2024-04-25T09:01:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.003+0000 7f69b0200640 1 -- 172.21.15.59:0/3669235712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69a80745d0 con 0x7f69a8099a60 2024-04-25T09:01:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.007+0000 7f69a5600640 1 -- 172.21.15.59:0/3669235712 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f69940bc020 con 0x7f69a8099a60 2024-04-25T09:01:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.007+0000 7f69a5600640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6988066f60 0x7f6988069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.007+0000 7f69a5600640 1 -- 172.21.15.59:0/3669235712 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f699411ef50 con 0x7f69a8099a60 2024-04-25T09:01:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.007+0000 7f69ad800640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6988066f60 0x7f6988069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.007+0000 7f69ad800640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6988066f60 0x7f6988069420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f69a806c550 tx=0x7f699c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:54.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.011+0000 7f69a5600640 1 -- 172.21.15.59:0/3669235712 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f69940c3030 con 0x7f69a8099a60 2024-04-25T09:01:54.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.175+0000 7f69b0200640 1 -- 172.21.15.59:0/3669235712 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69a80caea0 con 0x7f69a8099a60 2024-04-25T09:01:54.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.175+0000 7f69a5600640 1 -- 172.21.15.59:0/3669235712 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6994016090 con 0x7f69a8099a60 2024-04-25T09:01:54.167 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:01:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.179+0000 7f69b0200640 1 -- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6988066f60 msgr2=0x7f6988069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.179+0000 7f69b0200640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6988066f60 0x7f6988069420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f69a806c550 tx=0x7f699c008040 comp rx=0 tx=0).stop 2024-04-25T09:01:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.179+0000 7f69b0200640 1 -- 172.21.15.59:0/3669235712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8099a60 msgr2=0x7f69a80ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.179+0000 7f69b0200640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8099a60 0x7f69a80ca960 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f69940af040 tx=0x7f6994019180 comp rx=0 tx=0).stop 2024-04-25T09:01:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.179+0000 7f69b0200640 1 -- 172.21.15.59:0/3669235712 shutdown_connections 2024-04-25T09:01:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.179+0000 7f69b0200640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6988066f60 0x7f6988069420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.179+0000 7f69b0200640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69a815dc60 0x7f69a8155340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.179+0000 7f69b0200640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69a8099a60 0x7f69a80ca960 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.179+0000 7f69b0200640 1 --2- 172.21.15.59:0/3669235712 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f69a806bf30 0x7f69a8158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.179+0000 7f69b0200640 1 -- 172.21.15.59:0/3669235712 >> 172.21.15.59:0/3669235712 conn(0x7f69a80b3200 msgr2=0x7f69a80cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.179+0000 7f69b0200640 1 -- 172.21.15.59:0/3669235712 shutdown_connections 2024-04-25T09:01:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.179+0000 7f69b0200640 1 -- 172.21.15.59:0/3669235712 wait complete. 2024-04-25T09:01:54.188 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:01:54.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.339+0000 7f4d4c600640 1 Processor -- start 2024-04-25T09:01:54.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.339+0000 7f4d4c600640 1 -- start start 2024-04-25T09:01:54.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4c600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4d4415dc60 0x7f4d440d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4c600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d4406bf30 0x7f4d440cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4c600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d44099a60 0x7f4d44099ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4c600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d4415e040 con 0x7f4d44099a60 2024-04-25T09:01:54.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4c600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d440cff80 con 0x7f4d4415dc60 2024-04-25T09:01:54.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4c600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d440d0260 con 0x7f4d4406bf30 2024-04-25T09:01:54.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4a600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d44099a60 0x7f4d44099ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4a600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d44099a60 0x7f4d44099ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35234/0 (socket says 172.21.15.59:35234) 2024-04-25T09:01:54.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4a600640 1 -- 172.21.15.59:0/3140698454 learned_addr learned my addr 172.21.15.59:0/3140698454 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:54.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d49200640 1 --2- 172.21.15.59:0/3140698454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d4406bf30 0x7f4d440cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d49c00640 1 --2- 172.21.15.59:0/3140698454 >> v2:172.21.15.178:3300/0 conn(0x7f4d4415dc60 0x7f4d440d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4a600640 1 -- 172.21.15.59:0/3140698454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d4406bf30 msgr2=0x7f4d440cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:54.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4a600640 1 --2- 172.21.15.59:0/3140698454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d4406bf30 0x7f4d440cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4a600640 1 -- 172.21.15.59:0/3140698454 >> v2:172.21.15.178:3300/0 conn(0x7f4d4415dc60 msgr2=0x7f4d440d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:54.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4a600640 1 --2- 172.21.15.59:0/3140698454 >> v2:172.21.15.178:3300/0 conn(0x7f4d4415dc60 0x7f4d440d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d4a600640 1 -- 172.21.15.59:0/3140698454 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d440d0540 con 0x7f4d44099a60 2024-04-25T09:01:54.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.343+0000 7f4d49c00640 1 --2- 172.21.15.59:0/3140698454 >> v2:172.21.15.178:3300/0 conn(0x7f4d4415dc60 0x7f4d440d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:54.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d4a600640 1 --2- 172.21.15.59:0/3140698454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d44099a60 0x7f4d44099ef0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d4409a6b0 tx=0x7f4d3c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a52f92c417dd6f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:54.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d43e00640 1 -- 172.21.15.59:0/3140698454 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0a56d0 con 0x7f4d44099a60 2024-04-25T09:01:54.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d43e00640 1 -- 172.21.15.59:0/3140698454 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c0a5870 con 0x7f4d44099a60 2024-04-25T09:01:54.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d43e00640 1 -- 172.21.15.59:0/3140698454 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0a5c40 con 0x7f4d44099a60 2024-04-25T09:01:54.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d4c600640 1 -- 172.21.15.59:0/3140698454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d44099a60 msgr2=0x7f4d44099ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d4c600640 1 --2- 172.21.15.59:0/3140698454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d44099a60 0x7f4d44099ef0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4d4409a6b0 tx=0x7f4d3c01c960 comp rx=0 tx=0).stop 2024-04-25T09:01:54.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d4c600640 1 -- 172.21.15.59:0/3140698454 shutdown_connections 2024-04-25T09:01:54.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d4c600640 1 --2- 172.21.15.59:0/3140698454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d44099a60 0x7f4d44099ef0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d4c600640 1 --2- 172.21.15.59:0/3140698454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d4406bf30 0x7f4d440cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d4c600640 1 --2- 172.21.15.59:0/3140698454 >> v2:172.21.15.178:3300/0 conn(0x7f4d4415dc60 0x7f4d440d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d4c600640 1 -- 172.21.15.59:0/3140698454 >> 172.21.15.59:0/3140698454 conn(0x7f4d440b3200 msgr2=0x7f4d440b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:54.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d4c600640 1 -- 172.21.15.59:0/3140698454 shutdown_connections 2024-04-25T09:01:54.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d4c600640 1 -- 172.21.15.59:0/3140698454 wait complete. 2024-04-25T09:01:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d4c600640 1 Processor -- start 2024-04-25T09:01:54.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.347+0000 7f4d4c600640 1 -- start start 2024-04-25T09:01:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d4c600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4406bf30 0x7f4d4414c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d4c600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d44099a60 0x7f4d4414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d4c600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d4415dc60 0x7f4d440b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d4c600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d440cc6f0 con 0x7f4d4406bf30 2024-04-25T09:01:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d4c600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d440cc570 con 0x7f4d44099a60 2024-04-25T09:01:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d4c600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d440cc870 con 0x7f4d4415dc60 2024-04-25T09:01:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d49c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4406bf30 0x7f4d4414c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d49c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4406bf30 0x7f4d4414c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35242/0 (socket says 172.21.15.59:35242) 2024-04-25T09:01:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d49c00640 1 -- 172.21.15.59:0/3338431831 learned_addr learned my addr 172.21.15.59:0/3338431831 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d49200640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d44099a60 0x7f4d4414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d4a600640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d4415dc60 0x7f4d440b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d49c00640 1 -- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d4415dc60 msgr2=0x7f4d440b6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d49c00640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d4415dc60 0x7f4d440b6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d49c00640 1 -- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d44099a60 msgr2=0x7f4d4414bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d49c00640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d44099a60 0x7f4d4414bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d49c00640 1 -- 172.21.15.59:0/3338431831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d440cf390 con 0x7f4d4406bf30 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d49c00640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4406bf30 0x7f4d4414c2e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800c7f0 tx=0x7f4d3800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d41600640 1 -- 172.21.15.59:0/3338431831 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d38007a30 con 0x7f4d4406bf30 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d41600640 1 -- 172.21.15.59:0/3338431831 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d38007bd0 con 0x7f4d4406bf30 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d41600640 1 -- 172.21.15.59:0/3338431831 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d380113f0 con 0x7f4d4406bf30 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d4c600640 1 -- 172.21.15.59:0/3338431831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4414cb10 con 0x7f4d4406bf30 2024-04-25T09:01:54.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d4c600640 1 -- 172.21.15.59:0/3338431831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4414d0d0 con 0x7f4d4406bf30 2024-04-25T09:01:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d4c600640 1 -- 172.21.15.59:0/3338431831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d440745d0 con 0x7f4d4406bf30 2024-04-25T09:01:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.351+0000 7f4d41600640 1 -- 172.21.15.59:0/3338431831 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4d38011590 con 0x7f4d4406bf30 2024-04-25T09:01:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.355+0000 7f4d41600640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4d24066f60 0x7f4d24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.355+0000 7f4d41600640 1 -- 172.21.15.59:0/3338431831 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f4d38085560 con 0x7f4d4406bf30 2024-04-25T09:01:54.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.355+0000 7f4d49200640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4d24066f60 0x7f4d24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.355+0000 7f4d49200640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4d24066f60 0x7f4d24069420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4d440cf340 tx=0x7f4d30008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.359+0000 7f4d41600640 1 -- 172.21.15.59:0/3338431831 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4d38015020 con 0x7f4d4406bf30 2024-04-25T09:01:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.519+0000 7f4d4c600640 1 -- 172.21.15.59:0/3338431831 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d4409ac50 con 0x7f4d4406bf30 2024-04-25T09:01:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.519+0000 7f4d41600640 1 -- 172.21.15.59:0/3338431831 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d38055b40 con 0x7f4d4406bf30 2024-04-25T09:01:54.512 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:01:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.523+0000 7f4d4c600640 1 -- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4d24066f60 msgr2=0x7f4d24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.523+0000 7f4d4c600640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4d24066f60 0x7f4d24069420 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4d440cf340 tx=0x7f4d30008040 comp rx=0 tx=0).stop 2024-04-25T09:01:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.523+0000 7f4d4c600640 1 -- 172.21.15.59:0/3338431831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4406bf30 msgr2=0x7f4d4414c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.523+0000 7f4d4c600640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4406bf30 0x7f4d4414c2e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4d3800c7f0 tx=0x7f4d3800ccb0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.523+0000 7f4d4c600640 1 -- 172.21.15.59:0/3338431831 shutdown_connections 2024-04-25T09:01:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.523+0000 7f4d4c600640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4d24066f60 0x7f4d24069420 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.523+0000 7f4d4c600640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4d4415dc60 0x7f4d440b6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.523+0000 7f4d4c600640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4d44099a60 0x7f4d4414bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.523+0000 7f4d4c600640 1 --2- 172.21.15.59:0/3338431831 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d4406bf30 0x7f4d4414c2e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.523+0000 7f4d4c600640 1 -- 172.21.15.59:0/3338431831 >> 172.21.15.59:0/3338431831 conn(0x7f4d440b3200 msgr2=0x7f4d4406c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:54.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.523+0000 7f4d4c600640 1 -- 172.21.15.59:0/3338431831 shutdown_connections 2024-04-25T09:01:54.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.523+0000 7f4d4c600640 1 -- 172.21.15.59:0/3338431831 wait complete. 2024-04-25T09:01:54.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:01:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.683+0000 7fb33da00640 1 Processor -- start 2024-04-25T09:01:54.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.683+0000 7fb33da00640 1 -- start start 2024-04-25T09:01:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb33da00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb33815dc60 0x7fb3380d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb33da00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb33809a170 0x7fb3380cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb33da00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33815e040 con 0x7fb33806bf30 2024-04-25T09:01:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb33da00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3380cff80 con 0x7fb33815dc60 2024-04-25T09:01:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb33da00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3380d0260 con 0x7fb33809a170 2024-04-25T09:01:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb32e000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb33806bf30 0x7fb338099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37658/0 (socket says 172.21.15.59:37658) 2024-04-25T09:01:54.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb32e000640 1 -- 172.21.15.59:0/2103754907 learned_addr learned my addr 172.21.15.59:0/2103754907 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb336a00640 1 --2- 172.21.15.59:0/2103754907 >> v2:172.21.15.59:3300/0 conn(0x7fb33815dc60 0x7fb3380d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb337400640 1 --2- 172.21.15.59:0/2103754907 >> v2:172.21.15.178:3300/0 conn(0x7fb33809a170 0x7fb3380cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb336000640 1 -- 172.21.15.59:0/2103754907 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815544328 0 0) 0x7fb33815e040 con 0x7fb33806bf30 2024-04-25T09:01:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb336000640 1 -- 172.21.15.59:0/2103754907 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb31c003530 con 0x7fb33806bf30 2024-04-25T09:01:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb336a00640 1 -- 172.21.15.59:0/2103754907 >> v2:172.21.15.178:3300/0 conn(0x7fb33809a170 msgr2=0x7fb3380cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb336a00640 1 --2- 172.21.15.59:0/2103754907 >> v2:172.21.15.178:3300/0 conn(0x7fb33809a170 0x7fb3380cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb336a00640 1 -- 172.21.15.59:0/2103754907 >> v1:172.21.15.59:6789/0 conn(0x7fb33806bf30 legacy=0x7fb338099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.687+0000 7fb336a00640 1 -- 172.21.15.59:0/2103754907 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3380d0540 con 0x7fb33815dc60 2024-04-25T09:01:54.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb336a00640 1 --2- 172.21.15.59:0/2103754907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33815dc60 0x7fb3380d1020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb338072a70 tx=0x7fb32801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b8e2c0117c7d8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:54.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb336000640 1 -- 172.21.15.59:0/2103754907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3280b1070 con 0x7fb33815dc60 2024-04-25T09:01:54.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb336000640 1 -- 172.21.15.59:0/2103754907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3280ac620 con 0x7fb33815dc60 2024-04-25T09:01:54.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb336000640 1 -- 172.21.15.59:0/2103754907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3280ac9f0 con 0x7fb33815dc60 2024-04-25T09:01:54.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 -- 172.21.15.59:0/2103754907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33815dc60 msgr2=0x7fb3380d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 --2- 172.21.15.59:0/2103754907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33815dc60 0x7fb3380d1020 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb338072a70 tx=0x7fb32801c3c0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 -- 172.21.15.59:0/2103754907 shutdown_connections 2024-04-25T09:01:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 --2- 172.21.15.59:0/2103754907 >> v2:172.21.15.178:3300/0 conn(0x7fb33809a170 0x7fb3380cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 --2- 172.21.15.59:0/2103754907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33815dc60 0x7fb3380d1020 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 -- 172.21.15.59:0/2103754907 >> 172.21.15.59:0/2103754907 conn(0x7fb3380b3200 msgr2=0x7fb3380b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:54.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 -- 172.21.15.59:0/2103754907 shutdown_connections 2024-04-25T09:01:54.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 -- 172.21.15.59:0/2103754907 wait complete. 2024-04-25T09:01:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 Processor -- start 2024-04-25T09:01:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 -- start start 2024-04-25T09:01:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb33806bf30 0x7fb33814c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33809a170 0x7fb3380cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb33815dc60 0x7fb338158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3380cc6f0 con 0x7fb33809a170 2024-04-25T09:01:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3380cc570 con 0x7fb33806bf30 2024-04-25T09:01:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.691+0000 7fb33da00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3380cc870 con 0x7fb33815dc60 2024-04-25T09:01:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33809a170 0x7fb3380cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33809a170 0x7fb3380cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35266/0 (socket says 172.21.15.59:35266) 2024-04-25T09:01:54.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32e000640 1 -- 172.21.15.59:0/4142819165 learned_addr learned my addr 172.21.15.59:0/4142819165 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:54.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb336a00640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb33806bf30 0x7fb33814c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb337400640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb33815dc60 0x7fb338158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32e000640 1 -- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb33815dc60 msgr2=0x7fb338158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32e000640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb33815dc60 0x7fb338158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32e000640 1 -- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb33806bf30 msgr2=0x7fb33814c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32e000640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb33806bf30 0x7fb33814c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32e000640 1 -- 172.21.15.59:0/4142819165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3380b6be0 con 0x7fb33809a170 2024-04-25T09:01:54.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32e000640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33809a170 0x7fb3380cb100 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb32000c450 tx=0x7fb32000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:54.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32f400640 1 -- 172.21.15.59:0/4142819165 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb320017070 con 0x7fb33809a170 2024-04-25T09:01:54.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32f400640 1 -- 172.21.15.59:0/4142819165 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb320005cf0 con 0x7fb33809a170 2024-04-25T09:01:54.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32f400640 1 -- 172.21.15.59:0/4142819165 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb320007290 con 0x7fb33809a170 2024-04-25T09:01:54.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb33da00640 1 -- 172.21.15.59:0/4142819165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3380b6ec0 con 0x7fb33809a170 2024-04-25T09:01:54.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb33da00640 1 -- 172.21.15.59:0/4142819165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb33814c660 con 0x7fb33809a170 2024-04-25T09:01:54.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb33da00640 1 -- 172.21.15.59:0/4142819165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3380745d0 con 0x7fb33809a170 2024-04-25T09:01:54.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32f400640 1 -- 172.21.15.59:0/4142819165 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb32001a070 con 0x7fb33809a170 2024-04-25T09:01:54.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32f400640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb314066f60 0x7fb314069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:54.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.695+0000 7fb32f400640 1 -- 172.21.15.59:0/4142819165 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fb320084600 con 0x7fb33809a170 2024-04-25T09:01:54.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.699+0000 7fb336a00640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb314066f60 0x7fb314069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:54.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.699+0000 7fb336a00640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb314066f60 0x7fb314069420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb3280ae000 tx=0x7fb328008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:54.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.699+0000 7fb32f400640 1 -- 172.21.15.59:0/4142819165 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb320054cf0 con 0x7fb33809a170 2024-04-25T09:01:54.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 -- 172.21.15.59:0/4142819165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3380b7090 con 0x7fb33809a170 2024-04-25T09:01:54.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb32f400640 1 -- 172.21.15.59:0/4142819165 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb320058d90 con 0x7fb33809a170 2024-04-25T09:01:54.855 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:01:54.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 -- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb314066f60 msgr2=0x7fb314069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb314066f60 0x7fb314069420 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb3280ae000 tx=0x7fb328008040 comp rx=0 tx=0).stop 2024-04-25T09:01:54.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 -- 172.21.15.59:0/4142819165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33809a170 msgr2=0x7fb3380cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:54.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33809a170 0x7fb3380cb100 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb32000c450 tx=0x7fb32000c910 comp rx=0 tx=0).stop 2024-04-25T09:01:54.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 -- 172.21.15.59:0/4142819165 shutdown_connections 2024-04-25T09:01:54.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb314066f60 0x7fb314069420 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb33815dc60 0x7fb338158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb33809a170 0x7fb3380cb100 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 --2- 172.21.15.59:0/4142819165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb33806bf30 0x7fb33814c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:54.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 -- 172.21.15.59:0/4142819165 >> 172.21.15.59:0/4142819165 conn(0x7fb3380b3200 msgr2=0x7fb33815a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:54.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 -- 172.21.15.59:0/4142819165 shutdown_connections 2024-04-25T09:01:54.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:54.863+0000 7fb33da00640 1 -- 172.21.15.59:0/4142819165 wait complete. 2024-04-25T09:01:54.876 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:01:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.027+0000 7f5076800640 1 Processor -- start 2024-04-25T09:01:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.027+0000 7f5076800640 1 -- start start 2024-04-25T09:01:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.027+0000 7f5076800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f507006bf30 0x7f50700d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.027+0000 7f5076800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507015e040 con 0x7f507015dc60 2024-04-25T09:01:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.027+0000 7f5076800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700cff80 con 0x7f507009a170 2024-04-25T09:01:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.027+0000 7f5076800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50700d0260 con 0x7f507006bf30 2024-04-25T09:01:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.031+0000 7f506f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f507015dc60 0x7f5070099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37672/0 (socket says 172.21.15.59:37672) 2024-04-25T09:01:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.031+0000 7f506f400640 1 -- 172.21.15.59:0/4122206509 learned_addr learned my addr 172.21.15.59:0/4122206509 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.031+0000 7f506fe00640 1 --2- 172.21.15.59:0/4122206509 >> v2:172.21.15.59:3300/0 conn(0x7f507006bf30 0x7f50700d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.031+0000 7f506ea00640 1 -- 172.21.15.59:0/4122206509 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520480966 0 0) 0x7f507015e040 con 0x7f507015dc60 2024-04-25T09:01:55.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.031+0000 7f506ea00640 1 -- 172.21.15.59:0/4122206509 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5054003530 con 0x7f507015dc60 2024-04-25T09:01:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.031+0000 7f506fe00640 1 -- 172.21.15.59:0/4122206509 >> v1:172.21.15.178:6789/0 conn(0x7f507009a170 legacy=0x7f50700cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.031+0000 7f506fe00640 1 -- 172.21.15.59:0/4122206509 >> v1:172.21.15.59:6789/0 conn(0x7f507015dc60 legacy=0x7f5070099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.031+0000 7f506fe00640 1 -- 172.21.15.59:0/4122206509 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700d0540 con 0x7f507006bf30 2024-04-25T09:01:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.031+0000 7f506fe00640 1 --2- 172.21.15.59:0/4122206509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507006bf30 0x7f50700d1020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5068009d90 tx=0x7f506801c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e13a4005e9a5c35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.031+0000 7f506ea00640 1 -- 172.21.15.59:0/4122206509 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680b2070 con 0x7f507006bf30 2024-04-25T09:01:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.031+0000 7f506ea00640 1 -- 172.21.15.59:0/4122206509 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50680a58e0 con 0x7f507006bf30 2024-04-25T09:01:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.031+0000 7f506ea00640 1 -- 172.21.15.59:0/4122206509 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680a5cb0 con 0x7f507006bf30 2024-04-25T09:01:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 -- 172.21.15.59:0/4122206509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507006bf30 msgr2=0x7f50700d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 --2- 172.21.15.59:0/4122206509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507006bf30 0x7f50700d1020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5068009d90 tx=0x7f506801c820 comp rx=0 tx=0).stop 2024-04-25T09:01:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 -- 172.21.15.59:0/4122206509 shutdown_connections 2024-04-25T09:01:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 --2- 172.21.15.59:0/4122206509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507006bf30 0x7f50700d1020 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 -- 172.21.15.59:0/4122206509 >> 172.21.15.59:0/4122206509 conn(0x7f50700b3200 msgr2=0x7f50700b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:55.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 -- 172.21.15.59:0/4122206509 shutdown_connections 2024-04-25T09:01:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 -- 172.21.15.59:0/4122206509 wait complete. 2024-04-25T09:01:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 Processor -- start 2024-04-25T09:01:55.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 -- start start 2024-04-25T09:01:55.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507006bf30 0x7f5070151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009a170 0x7f507015c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f507015dc60 0x7f507015c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507006cfa0 con 0x7f507009a170 2024-04-25T09:01:55.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700cc880 con 0x7f507006bf30 2024-04-25T09:01:55.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5076800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507015d350 con 0x7f507015dc60 2024-04-25T09:01:55.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5067e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009a170 0x7f507015c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5067e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009a170 0x7f507015c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35282/0 (socket says 172.21.15.59:35282) 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5067e00640 1 -- 172.21.15.59:0/2883137598 learned_addr learned my addr 172.21.15.59:0/2883137598 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f506f400640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507006bf30 0x7f5070151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f506fe00640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f507015dc60 0x7f507015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5067e00640 1 -- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f507015dc60 msgr2=0x7f507015c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5067e00640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f507015dc60 0x7f507015c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5067e00640 1 -- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507006bf30 msgr2=0x7f5070151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5067e00640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507006bf30 0x7f5070151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f5067e00640 1 -- 172.21.15.59:0/2883137598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507015cd90 con 0x7f507009a170 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.035+0000 7f506f400640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507006bf30 0x7f5070151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.039+0000 7f5067e00640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009a170 0x7f507015c010 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f505800c420 tx=0x7f505800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.039+0000 7f5067400640 1 -- 172.21.15.59:0/2883137598 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50580052d0 con 0x7f507009a170 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.039+0000 7f5067400640 1 -- 172.21.15.59:0/2883137598 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5058005470 con 0x7f507009a170 2024-04-25T09:01:55.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.039+0000 7f5076800640 1 -- 172.21.15.59:0/2883137598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507015d070 con 0x7f507009a170 2024-04-25T09:01:55.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.039+0000 7f5067400640 1 -- 172.21.15.59:0/2883137598 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058007260 con 0x7f507009a170 2024-04-25T09:01:55.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.039+0000 7f5076800640 1 -- 172.21.15.59:0/2883137598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50700c8c80 con 0x7f507009a170 2024-04-25T09:01:55.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.039+0000 7f5076800640 1 -- 172.21.15.59:0/2883137598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507015caf0 con 0x7f507009a170 2024-04-25T09:01:55.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.039+0000 7f5067400640 1 -- 172.21.15.59:0/2883137598 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5058007400 con 0x7f507009a170 2024-04-25T09:01:55.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.039+0000 7f5067400640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f504c066f60 0x7f504c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.039+0000 7f5067400640 1 -- 172.21.15.59:0/2883137598 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f5058084800 con 0x7f507009a170 2024-04-25T09:01:55.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.039+0000 7f506f400640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f504c066f60 0x7f504c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.043+0000 7f506f400640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f504c066f60 0x7f504c069420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f50600011f0 tx=0x7f5060009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.043+0000 7f5067400640 1 -- 172.21.15.59:0/2883137598 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5058054e70 con 0x7f507009a170 2024-04-25T09:01:55.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.207+0000 7f5076800640 1 -- 172.21.15.59:0/2883137598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f50700745d0 con 0x7f507009a170 2024-04-25T09:01:55.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.207+0000 7f5067400640 1 -- 172.21.15.59:0/2883137598 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5058058f10 con 0x7f507009a170 2024-04-25T09:01:55.199 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:01:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.211+0000 7f5076800640 1 -- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f504c066f60 msgr2=0x7f504c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.211+0000 7f5076800640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f504c066f60 0x7f504c069420 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f50600011f0 tx=0x7f5060009040 comp rx=0 tx=0).stop 2024-04-25T09:01:55.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.211+0000 7f5076800640 1 -- 172.21.15.59:0/2883137598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009a170 msgr2=0x7f507015c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.211+0000 7f5076800640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009a170 0x7f507015c010 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f505800c420 tx=0x7f505800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.211+0000 7f5076800640 1 -- 172.21.15.59:0/2883137598 shutdown_connections 2024-04-25T09:01:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.211+0000 7f5076800640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f504c066f60 0x7f504c069420 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.211+0000 7f5076800640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f507015dc60 0x7f507015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.211+0000 7f5076800640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f507009a170 0x7f507015c010 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.211+0000 7f5076800640 1 --2- 172.21.15.59:0/2883137598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f507006bf30 0x7f5070151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.211+0000 7f5076800640 1 -- 172.21.15.59:0/2883137598 >> 172.21.15.59:0/2883137598 conn(0x7f50700b3200 msgr2=0x7f507006f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.211+0000 7f5076800640 1 -- 172.21.15.59:0/2883137598 shutdown_connections 2024-04-25T09:01:55.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.211+0000 7f5076800640 1 -- 172.21.15.59:0/2883137598 wait complete. 2024-04-25T09:01:55.220 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:55.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd452200640 1 Processor -- start 2024-04-25T09:01:55.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd452200640 1 -- start start 2024-04-25T09:01:55.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd452200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd44c070fe0 0x7fd44c161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd452200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0713c0 0x7fd44c143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd452200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd44c071800 0x7fd44c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd452200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c06d090 con 0x7fd44c070fe0 2024-04-25T09:01:55.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd452200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd44c162390 con 0x7fd44c071800 2024-04-25T09:01:55.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd452200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c161af0 con 0x7fd44c0713c0 2024-04-25T09:01:55.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd44b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd44c070fe0 0x7fd44c161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd44b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd44c070fe0 0x7fd44c161510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35292/0 (socket says 172.21.15.59:35292) 2024-04-25T09:01:55.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd44b400640 1 -- 172.21.15.59:0/3494996131 learned_addr learned my addr 172.21.15.59:0/3494996131 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:55.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd442a00640 1 --2- 172.21.15.59:0/3494996131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0713c0 0x7fd44c143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd44be00640 1 --2- 172.21.15.59:0/3494996131 >> v2:172.21.15.178:3300/0 conn(0x7fd44c071800 0x7fd44c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd44b400640 1 -- 172.21.15.59:0/3494996131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0713c0 msgr2=0x7fd44c143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:55.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd44b400640 1 --2- 172.21.15.59:0/3494996131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0713c0 0x7fd44c143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd44b400640 1 -- 172.21.15.59:0/3494996131 >> v2:172.21.15.178:3300/0 conn(0x7fd44c071800 msgr2=0x7fd44c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:55.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd44b400640 1 --2- 172.21.15.59:0/3494996131 >> v2:172.21.15.178:3300/0 conn(0x7fd44c071800 0x7fd44c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd44b400640 1 -- 172.21.15.59:0/3494996131 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c161dd0 con 0x7fd44c070fe0 2024-04-25T09:01:55.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd442a00640 1 --2- 172.21.15.59:0/3494996131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0713c0 0x7fd44c143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:55.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.371+0000 7fd44be00640 1 --2- 172.21.15.59:0/3494996131 >> v2:172.21.15.178:3300/0 conn(0x7fd44c071800 0x7fd44c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:55.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd44b400640 1 --2- 172.21.15.59:0/3494996131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44c070fe0 0x7fd44c161510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd44c071f60 tx=0x7fd43c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2200ccb93cfe7ea7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd44aa00640 1 -- 172.21.15.59:0/3494996131 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c0aa610 con 0x7fd44c070fe0 2024-04-25T09:01:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd44aa00640 1 -- 172.21.15.59:0/3494996131 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43c0af070 con 0x7fd44c070fe0 2024-04-25T09:01:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd44aa00640 1 -- 172.21.15.59:0/3494996131 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43c0aa9d0 con 0x7fd44c070fe0 2024-04-25T09:01:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd452200640 1 -- 172.21.15.59:0/3494996131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44c070fe0 msgr2=0x7fd44c161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd452200640 1 --2- 172.21.15.59:0/3494996131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44c070fe0 0x7fd44c161510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd44c071f60 tx=0x7fd43c01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd452200640 1 -- 172.21.15.59:0/3494996131 shutdown_connections 2024-04-25T09:01:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd452200640 1 --2- 172.21.15.59:0/3494996131 >> v2:172.21.15.178:3300/0 conn(0x7fd44c071800 0x7fd44c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd452200640 1 --2- 172.21.15.59:0/3494996131 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c0713c0 0x7fd44c143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd452200640 1 --2- 172.21.15.59:0/3494996131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44c070fe0 0x7fd44c161510 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd452200640 1 -- 172.21.15.59:0/3494996131 >> 172.21.15.59:0/3494996131 conn(0x7fd44c0b3390 msgr2=0x7fd44c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd452200640 1 -- 172.21.15.59:0/3494996131 shutdown_connections 2024-04-25T09:01:55.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.375+0000 7fd452200640 1 -- 172.21.15.59:0/3494996131 wait complete. 2024-04-25T09:01:55.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd452200640 1 Processor -- start 2024-04-25T09:01:55.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd452200640 1 -- start start 2024-04-25T09:01:55.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd452200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c070fe0 0x7fd44c13a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd452200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44c0713c0 0x7fd44c13d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd452200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd44c071800 0x7fd44c138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd452200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0b06c0 con 0x7fd44c0713c0 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd452200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0b0540 con 0x7fd44c071800 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd452200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44c0b0840 con 0x7fd44c070fe0 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd442a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44c0713c0 0x7fd44c13d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd442a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44c0713c0 0x7fd44c13d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35302/0 (socket says 172.21.15.59:35302) 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd442a00640 1 -- 172.21.15.59:0/2754118690 learned_addr learned my addr 172.21.15.59:0/2754118690 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd44b400640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c070fe0 0x7fd44c13a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd44be00640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd44c071800 0x7fd44c138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd442a00640 1 -- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c070fe0 msgr2=0x7fd44c13a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd442a00640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c070fe0 0x7fd44c13a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd442a00640 1 -- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd44c071800 msgr2=0x7fd44c138ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd442a00640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd44c071800 0x7fd44c138ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd442a00640 1 -- 172.21.15.59:0/2754118690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd44c13add0 con 0x7fd44c0713c0 2024-04-25T09:01:55.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd44b400640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c070fe0 0x7fd44c13a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:55.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd44be00640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd44c071800 0x7fd44c138ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:55.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd442a00640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44c0713c0 0x7fd44c13d470 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd43400e810 tx=0x7fd43400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd443e00640 1 -- 172.21.15.59:0/2754118690 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43400f040 con 0x7fd44c0713c0 2024-04-25T09:01:55.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd443e00640 1 -- 172.21.15.59:0/2754118690 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd434004030 con 0x7fd44c0713c0 2024-04-25T09:01:55.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd443e00640 1 -- 172.21.15.59:0/2754118690 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd434004400 con 0x7fd44c0713c0 2024-04-25T09:01:55.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd452200640 1 -- 172.21.15.59:0/2754118690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd44c13b0b0 con 0x7fd44c0713c0 2024-04-25T09:01:55.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd452200640 1 -- 172.21.15.59:0/2754118690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd44c0d1a50 con 0x7fd44c0713c0 2024-04-25T09:01:55.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.379+0000 7fd452200640 1 -- 172.21.15.59:0/2754118690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44c0745d0 con 0x7fd44c0713c0 2024-04-25T09:01:55.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.383+0000 7fd443e00640 1 -- 172.21.15.59:0/2754118690 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd43400c6d0 con 0x7fd44c0713c0 2024-04-25T09:01:55.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.383+0000 7fd443e00640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd428066f60 0x7fd428069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.383+0000 7fd443e00640 1 -- 172.21.15.59:0/2754118690 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd434085060 con 0x7fd44c0713c0 2024-04-25T09:01:55.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.383+0000 7fd44b400640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd428066f60 0x7fd428069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.383+0000 7fd44b400640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd428066f60 0x7fd428069420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0ae000 tx=0x7fd43c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.387+0000 7fd443e00640 1 -- 172.21.15.59:0/2754118690 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd434017020 con 0x7fd44c0713c0 2024-04-25T09:01:55.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.579+0000 7fd452200640 1 -- 172.21.15.59:0/2754118690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd44c158310 con 0x7fd44c0713c0 2024-04-25T09:01:55.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd443e00640 1 -- 172.21.15.59:0/2754118690 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7fd434055d20 con 0x7fd44c0713c0 2024-04-25T09:01:55.573 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:55.573 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2167197221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2167197221},{"type":"v1","addr":"172.21.15.59:6834","nonce":2167197221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2689387181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2689387181},{"type":"v1","addr":"172.21.15.178:6837","nonce":2689387181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1461695991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1461695991},{"type":"v1","addr":"172.21.15.59:6835","nonce":1461695991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:28.177275+0000","modified":"2024-04-25T09:01:46.237549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/3239224017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3239224017},{"type":"v1","addr":"172.21.15.178:6836","nonce":3239224017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:01:55.573 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2024-04-25T09:01:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd452200640 1 -- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd428066f60 msgr2=0x7fd428069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd452200640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd428066f60 0x7fd428069420 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd43c0ae000 tx=0x7fd43c008040 comp rx=0 tx=0).stop 2024-04-25T09:01:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd452200640 1 -- 172.21.15.59:0/2754118690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44c0713c0 msgr2=0x7fd44c13d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd452200640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44c0713c0 0x7fd44c13d470 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd43400e810 tx=0x7fd43400ecd0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd452200640 1 -- 172.21.15.59:0/2754118690 shutdown_connections 2024-04-25T09:01:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd452200640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd428066f60 0x7fd428069420 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd452200640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd44c071800 0x7fd44c138ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd452200640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd44c0713c0 0x7fd44c13d470 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd452200640 1 --2- 172.21.15.59:0/2754118690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd44c070fe0 0x7fd44c13a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd452200640 1 -- 172.21.15.59:0/2754118690 >> 172.21.15.59:0/2754118690 conn(0x7fd44c0b3390 msgr2=0x7fd44c141c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:55.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd452200640 1 -- 172.21.15.59:0/2754118690 shutdown_connections 2024-04-25T09:01:55.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.583+0000 7fd452200640 1 -- 172.21.15.59:0/2754118690 wait complete. 2024-04-25T09:01:55.595 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.743+0000 7f6441200640 1 Processor -- start 2024-04-25T09:01:55.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.743+0000 7f6441200640 1 -- start start 2024-04-25T09:01:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f6441200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f643c15fe50 0x7f643c0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f6441200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f643c0b1c90 0x7f643c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f6441200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f643c0cc4e0 con 0x7f643c145270 2024-04-25T09:01:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f6441200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f643c145650 con 0x7f643c15fe50 2024-04-25T09:01:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f6441200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c1602b0 con 0x7f643c0b1c90 2024-04-25T09:01:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f6439e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f643c145270 0x7f643c0cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37678/0 (socket says 172.21.15.59:37678) 2024-04-25T09:01:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f6439e00640 1 -- 172.21.15.59:0/4272726657 learned_addr learned my addr 172.21.15.59:0/4272726657 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f643a800640 1 --2- 172.21.15.59:0/4272726657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f643c0b1c90 0x7f643c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f6431400640 1 --2- 172.21.15.59:0/4272726657 >> v2:172.21.15.178:3300/0 conn(0x7f643c15fe50 0x7f643c0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f6439400640 1 -- 172.21.15.59:0/4272726657 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348603270 0 0) 0x7f643c0cc4e0 con 0x7f643c145270 2024-04-25T09:01:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f6439400640 1 -- 172.21.15.59:0/4272726657 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6420003530 con 0x7f643c145270 2024-04-25T09:01:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f643a800640 1 -- 172.21.15.59:0/4272726657 >> v2:172.21.15.178:3300/0 conn(0x7f643c15fe50 msgr2=0x7f643c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f643a800640 1 --2- 172.21.15.59:0/4272726657 >> v2:172.21.15.178:3300/0 conn(0x7f643c15fe50 0x7f643c0b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f643a800640 1 -- 172.21.15.59:0/4272726657 >> v1:172.21.15.59:6789/0 conn(0x7f643c145270 legacy=0x7f643c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.747+0000 7f643a800640 1 -- 172.21.15.59:0/4272726657 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c0ce040 con 0x7f643c0b1c90 2024-04-25T09:01:55.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f643a800640 1 --2- 172.21.15.59:0/4272726657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f643c0b1c90 0x7f643c15bd80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6434009d90 tx=0x7f643401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa5a130755dcd19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6439400640 1 -- 172.21.15.59:0/4272726657 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64340b2070 con 0x7f643c0b1c90 2024-04-25T09:01:55.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6439400640 1 -- 172.21.15.59:0/4272726657 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64340a5920 con 0x7f643c0b1c90 2024-04-25T09:01:55.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6439400640 1 -- 172.21.15.59:0/4272726657 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64340a5cf0 con 0x7f643c0b1c90 2024-04-25T09:01:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6441200640 1 -- 172.21.15.59:0/4272726657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f643c0b1c90 msgr2=0x7f643c15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6441200640 1 --2- 172.21.15.59:0/4272726657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f643c0b1c90 0x7f643c15bd80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6434009d90 tx=0x7f643401c970 comp rx=0 tx=0).stop 2024-04-25T09:01:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6441200640 1 -- 172.21.15.59:0/4272726657 shutdown_connections 2024-04-25T09:01:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6441200640 1 --2- 172.21.15.59:0/4272726657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f643c0b1c90 0x7f643c15bd80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6441200640 1 --2- 172.21.15.59:0/4272726657 >> v2:172.21.15.178:3300/0 conn(0x7f643c15fe50 0x7f643c0b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6441200640 1 -- 172.21.15.59:0/4272726657 >> 172.21.15.59:0/4272726657 conn(0x7f643c066fa0 msgr2=0x7f643c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6441200640 1 -- 172.21.15.59:0/4272726657 shutdown_connections 2024-04-25T09:01:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6441200640 1 -- 172.21.15.59:0/4272726657 wait complete. 2024-04-25T09:01:55.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6441200640 1 Processor -- start 2024-04-25T09:01:55.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.751+0000 7f6441200640 1 -- start start 2024-04-25T09:01:55.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6441200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f643c0b1c90 0x7f643c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6441200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f643c145270 0x7f643c141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6441200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c15fe50 0x7f643c13ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6441200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0cdbe0 con 0x7f643c15fe50 2024-04-25T09:01:55.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6441200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643c15f930 con 0x7f643c145270 2024-04-25T09:01:55.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6441200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f643c0cdd60 con 0x7f643c0b1c90 2024-04-25T09:01:55.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f643a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c15fe50 0x7f643c13ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f643a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c15fe50 0x7f643c13ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35312/0 (socket says 172.21.15.59:35312) 2024-04-25T09:01:55.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f643a800640 1 -- 172.21.15.59:0/2200215049 learned_addr learned my addr 172.21.15.59:0/2200215049 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:55.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6439e00640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f643c0b1c90 0x7f643c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6431400640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f643c145270 0x7f643c141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f643a800640 1 -- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f643c0b1c90 msgr2=0x7f643c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f643a800640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f643c0b1c90 0x7f643c15b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f643a800640 1 -- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f643c145270 msgr2=0x7f643c141df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f643a800640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f643c145270 0x7f643c141df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f643a800640 1 -- 172.21.15.59:0/2200215049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c0b00e0 con 0x7f643c15fe50 2024-04-25T09:01:55.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6431400640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f643c145270 0x7f643c141df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:55.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f643a800640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c15fe50 0x7f643c13ff20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f64340b0040 tx=0x7f6434019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6432a00640 1 -- 172.21.15.59:0/2200215049 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64340b2050 con 0x7f643c15fe50 2024-04-25T09:01:55.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6432a00640 1 -- 172.21.15.59:0/2200215049 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64340be070 con 0x7f643c15fe50 2024-04-25T09:01:55.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6441200640 1 -- 172.21.15.59:0/2200215049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643c0b03c0 con 0x7f643c15fe50 2024-04-25T09:01:55.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6432a00640 1 -- 172.21.15.59:0/2200215049 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64340ad850 con 0x7f643c15fe50 2024-04-25T09:01:55.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6441200640 1 -- 172.21.15.59:0/2200215049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643c0b0980 con 0x7f643c15fe50 2024-04-25T09:01:55.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6441200640 1 -- 172.21.15.59:0/2200215049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f643c0745d0 con 0x7f643c15fe50 2024-04-25T09:01:55.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.755+0000 7f6432a00640 1 -- 172.21.15.59:0/2200215049 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f64340ad9f0 con 0x7f643c15fe50 2024-04-25T09:01:55.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.759+0000 7f6432a00640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6418066f60 0x7f6418069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:55.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.759+0000 7f6432a00640 1 -- 172.21.15.59:0/2200215049 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6434120490 con 0x7f643c15fe50 2024-04-25T09:01:55.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.759+0000 7f6439e00640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6418066f60 0x7f6418069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:55.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.759+0000 7f6439e00640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6418066f60 0x7f6418069420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f642c005890 tx=0x7f642c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:55.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.763+0000 7f6432a00640 1 -- 172.21.15.59:0/2200215049 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6434016560 con 0x7f643c15fe50 2024-04-25T09:01:55.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.927+0000 7f6441200640 1 -- 172.21.15.59:0/2200215049 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f643c06e9a0 con 0x7f643c15fe50 2024-04-25T09:01:55.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.927+0000 7f6432a00640 1 -- 172.21.15.59:0/2200215049 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7f64340f1150 con 0x7f643c15fe50 2024-04-25T09:01:55.919 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:55.919 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:55.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.931+0000 7f6441200640 1 -- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6418066f60 msgr2=0x7f6418069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.931+0000 7f6441200640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6418066f60 0x7f6418069420 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f642c005890 tx=0x7f642c009040 comp rx=0 tx=0).stop 2024-04-25T09:01:55.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.931+0000 7f6441200640 1 -- 172.21.15.59:0/2200215049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c15fe50 msgr2=0x7f643c13ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:55.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.931+0000 7f6441200640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c15fe50 0x7f643c13ff20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f64340b0040 tx=0x7f6434019710 comp rx=0 tx=0).stop 2024-04-25T09:01:55.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.931+0000 7f6441200640 1 -- 172.21.15.59:0/2200215049 shutdown_connections 2024-04-25T09:01:55.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.931+0000 7f6441200640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6418066f60 0x7f6418069420 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.931+0000 7f6441200640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f643c15fe50 0x7f643c13ff20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.931+0000 7f6441200640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f643c145270 0x7f643c141df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.931+0000 7f6441200640 1 --2- 172.21.15.59:0/2200215049 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f643c0b1c90 0x7f643c15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:55.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.931+0000 7f6441200640 1 -- 172.21.15.59:0/2200215049 >> 172.21.15.59:0/2200215049 conn(0x7f643c066fa0 msgr2=0x7f643c15e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:55.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.931+0000 7f6441200640 1 -- 172.21.15.59:0/2200215049 shutdown_connections 2024-04-25T09:01:55.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:55.931+0000 7f6441200640 1 -- 172.21.15.59:0/2200215049 wait complete. 2024-04-25T09:01:55.940 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:01:55.941 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:01:56.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c88400640 1 Processor -- start 2024-04-25T09:01:56.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c88400640 1 -- start start 2024-04-25T09:01:56.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c88400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c8015dc60 0x7f2c800d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c88400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2c8006bf30 0x7f2c800cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c88400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c8015e040 con 0x7f2c80099a60 2024-04-25T09:01:56.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c88400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c800cff80 con 0x7f2c8015dc60 2024-04-25T09:01:56.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c88400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c800d0260 con 0x7f2c8006bf30 2024-04-25T09:01:56.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c85a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2c8015dc60 0x7f2c800d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c86400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2c80099a60 0x7f2c800cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37692/0 (socket says 172.21.15.59:37692) 2024-04-25T09:01:56.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c86400640 1 -- 172.21.15.59:0/3366504891 learned_addr learned my addr 172.21.15.59:0/3366504891 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:56.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c85000640 1 --2- 172.21.15.59:0/3366504891 >> v2:172.21.15.178:3300/0 conn(0x7f2c8006bf30 0x7f2c800cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c85a00640 1 -- 172.21.15.59:0/3366504891 >> v2:172.21.15.178:3300/0 conn(0x7f2c8006bf30 msgr2=0x7f2c800cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:56.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c85a00640 1 --2- 172.21.15.59:0/3366504891 >> v2:172.21.15.178:3300/0 conn(0x7f2c8006bf30 0x7f2c800cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c85a00640 1 -- 172.21.15.59:0/3366504891 >> v1:172.21.15.59:6789/0 conn(0x7f2c80099a60 legacy=0x7f2c800cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c85a00640 1 -- 172.21.15.59:0/3366504891 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c800d0540 con 0x7f2c8015dc60 2024-04-25T09:01:56.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.099+0000 7f2c7fe00640 1 -- 172.21.15.59:0/3366504891 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142807136 0 0) 0x7f2c8015e040 con 0x7f2c80099a60 2024-04-25T09:01:56.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c85a00640 1 --2- 172.21.15.59:0/3366504891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8015dc60 0x7f2c800d1020 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c800d2810 tx=0x7f2c7401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26aea6968dbc17b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c7fe00640 1 -- 172.21.15.59:0/3366504891 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c740b1070 con 0x7f2c8015dc60 2024-04-25T09:01:56.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c7fe00640 1 -- 172.21.15.59:0/3366504891 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c740ac620 con 0x7f2c8015dc60 2024-04-25T09:01:56.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c7fe00640 1 -- 172.21.15.59:0/3366504891 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c740ac9f0 con 0x7f2c8015dc60 2024-04-25T09:01:56.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c88400640 1 -- 172.21.15.59:0/3366504891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8015dc60 msgr2=0x7f2c800d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c88400640 1 --2- 172.21.15.59:0/3366504891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8015dc60 0x7f2c800d1020 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2c800d2810 tx=0x7f2c7401c3c0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c88400640 1 -- 172.21.15.59:0/3366504891 shutdown_connections 2024-04-25T09:01:56.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c88400640 1 --2- 172.21.15.59:0/3366504891 >> v2:172.21.15.178:3300/0 conn(0x7f2c8006bf30 0x7f2c800cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c88400640 1 --2- 172.21.15.59:0/3366504891 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c8015dc60 0x7f2c800d1020 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c88400640 1 -- 172.21.15.59:0/3366504891 >> 172.21.15.59:0/3366504891 conn(0x7f2c800b3200 msgr2=0x7f2c800b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:56.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c88400640 1 -- 172.21.15.59:0/3366504891 shutdown_connections 2024-04-25T09:01:56.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c88400640 1 -- 172.21.15.59:0/3366504891 wait complete. 2024-04-25T09:01:56.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.103+0000 7f2c88400640 1 Processor -- start 2024-04-25T09:01:56.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c88400640 1 -- start start 2024-04-25T09:01:56.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c88400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8006bf30 0x7f2c8015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c88400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c80099a60 0x7f2c800b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c88400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8015dc60 0x7f2c800b6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c88400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8006cfa0 con 0x7f2c80099a60 2024-04-25T09:01:56.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c88400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c800cc880 con 0x7f2c8015dc60 2024-04-25T09:01:56.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c88400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c800b4d80 con 0x7f2c8006bf30 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c85000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c80099a60 0x7f2c800b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c85000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c80099a60 0x7f2c800b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35326/0 (socket says 172.21.15.59:35326) 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c85000640 1 -- 172.21.15.59:0/1076169315 learned_addr learned my addr 172.21.15.59:0/1076169315 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c85a00640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8006bf30 0x7f2c8015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c86400640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8015dc60 0x7f2c800b6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c85000640 1 -- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8006bf30 msgr2=0x7f2c8015c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c85000640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8006bf30 0x7f2c8015c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c85000640 1 -- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8015dc60 msgr2=0x7f2c800b6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c85000640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8015dc60 0x7f2c800b6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c85000640 1 -- 172.21.15.59:0/1076169315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c8006cc10 con 0x7f2c80099a60 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c86400640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8015dc60 0x7f2c800b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c85000640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c80099a60 0x7f2c800b63f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00d800 tx=0x7f2c6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c7d600640 1 -- 172.21.15.59:0/1076169315 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c00b6c0 con 0x7f2c80099a60 2024-04-25T09:01:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c7d600640 1 -- 172.21.15.59:0/1076169315 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c019070 con 0x7f2c80099a60 2024-04-25T09:01:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c7d600640 1 -- 172.21.15.59:0/1076169315 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c00ba60 con 0x7f2c80099a60 2024-04-25T09:01:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c88400640 1 -- 172.21.15.59:0/1076169315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c800b7000 con 0x7f2c80099a60 2024-04-25T09:01:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c88400640 1 -- 172.21.15.59:0/1076169315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c800b52b0 con 0x7f2c80099a60 2024-04-25T09:01:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.107+0000 7f2c88400640 1 -- 172.21.15.59:0/1076169315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c800745d0 con 0x7f2c80099a60 2024-04-25T09:01:56.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.111+0000 7f2c7d600640 1 -- 172.21.15.59:0/1076169315 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2c6c00bc00 con 0x7f2c80099a60 2024-04-25T09:01:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.111+0000 7f2c7d600640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2c60066f60 0x7f2c60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.111+0000 7f2c7d600640 1 -- 172.21.15.59:0/1076169315 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f2c6c085830 con 0x7f2c80099a60 2024-04-25T09:01:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.111+0000 7f2c85a00640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2c60066f60 0x7f2c60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.111+0000 7f2c85a00640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2c60066f60 0x7f2c60069420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2c740ae000 tx=0x7f2c740a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.115+0000 7f2c7d600640 1 -- 172.21.15.59:0/1076169315 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2c6c056470 con 0x7f2c80099a60 2024-04-25T09:01:56.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 -- 172.21.15.59:0/1076169315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c800b7590 con 0x7f2c80099a60 2024-04-25T09:01:56.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c7d600640 1 -- 172.21.15.59:0/1076169315 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c6c055d70 con 0x7f2c80099a60 2024-04-25T09:01:56.267 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:01:56.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 -- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2c60066f60 msgr2=0x7f2c60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2c60066f60 0x7f2c60069420 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2c740ae000 tx=0x7f2c740a7000 comp rx=0 tx=0).stop 2024-04-25T09:01:56.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 -- 172.21.15.59:0/1076169315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c80099a60 msgr2=0x7f2c800b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c80099a60 0x7f2c800b63f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00d800 tx=0x7f2c6c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 -- 172.21.15.59:0/1076169315 shutdown_connections 2024-04-25T09:01:56.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2c60066f60 0x7f2c60069420 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2c8015dc60 0x7f2c800b6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c80099a60 0x7f2c800b63f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 --2- 172.21.15.59:0/1076169315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2c8006bf30 0x7f2c8015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 -- 172.21.15.59:0/1076169315 >> 172.21.15.59:0/1076169315 conn(0x7f2c800b3200 msgr2=0x7f2c80070ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 -- 172.21.15.59:0/1076169315 shutdown_connections 2024-04-25T09:01:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.275+0000 7f2c88400640 1 -- 172.21.15.59:0/1076169315 wait complete. 2024-04-25T09:01:56.289 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:01:56.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6149000640 1 Processor -- start 2024-04-25T09:01:56.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6149000640 1 -- start start 2024-04-25T09:01:56.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6149000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f614415dc60 0x7f61440d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6149000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f614406bf30 0x7f61440cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6149000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6144099a60 0x7f6144099ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6149000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614415e040 con 0x7f6144099a60 2024-04-25T09:01:56.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6149000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61440cff80 con 0x7f614415dc60 2024-04-25T09:01:56.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6149000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61440d0260 con 0x7f614406bf30 2024-04-25T09:01:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6142800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6144099a60 0x7f6144099ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6142800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6144099a60 0x7f6144099ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35340/0 (socket says 172.21.15.59:35340) 2024-04-25T09:01:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6142800640 1 -- 172.21.15.59:0/2586220607 learned_addr learned my addr 172.21.15.59:0/2586220607 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6141400640 1 --2- 172.21.15.59:0/2586220607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f614406bf30 0x7f61440cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6141e00640 1 --2- 172.21.15.59:0/2586220607 >> v2:172.21.15.178:3300/0 conn(0x7f614415dc60 0x7f61440d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6142800640 1 -- 172.21.15.59:0/2586220607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f614406bf30 msgr2=0x7f61440cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6142800640 1 --2- 172.21.15.59:0/2586220607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f614406bf30 0x7f61440cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6142800640 1 -- 172.21.15.59:0/2586220607 >> v2:172.21.15.178:3300/0 conn(0x7f614415dc60 msgr2=0x7f61440d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6142800640 1 --2- 172.21.15.59:0/2586220607 >> v2:172.21.15.178:3300/0 conn(0x7f614415dc60 0x7f61440d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6142800640 1 -- 172.21.15.59:0/2586220607 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61440d0540 con 0x7f6144099a60 2024-04-25T09:01:56.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.443+0000 7f6141e00640 1 --2- 172.21.15.59:0/2586220607 >> v2:172.21.15.178:3300/0 conn(0x7f614415dc60 0x7f61440d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:56.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6142800640 1 --2- 172.21.15.59:0/2586220607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6144099a60 0x7f6144099ef0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f614409a6b0 tx=0x7f613c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c7edecb08c1903 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6140a00640 1 -- 172.21.15.59:0/2586220607 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0a56d0 con 0x7f6144099a60 2024-04-25T09:01:56.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6140a00640 1 -- 172.21.15.59:0/2586220607 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c0a5870 con 0x7f6144099a60 2024-04-25T09:01:56.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6140a00640 1 -- 172.21.15.59:0/2586220607 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c0a5c40 con 0x7f6144099a60 2024-04-25T09:01:56.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6149000640 1 -- 172.21.15.59:0/2586220607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6144099a60 msgr2=0x7f6144099ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6149000640 1 --2- 172.21.15.59:0/2586220607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6144099a60 0x7f6144099ef0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f614409a6b0 tx=0x7f613c01c960 comp rx=0 tx=0).stop 2024-04-25T09:01:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6149000640 1 -- 172.21.15.59:0/2586220607 shutdown_connections 2024-04-25T09:01:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6149000640 1 --2- 172.21.15.59:0/2586220607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6144099a60 0x7f6144099ef0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6149000640 1 --2- 172.21.15.59:0/2586220607 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f614406bf30 0x7f61440cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6149000640 1 --2- 172.21.15.59:0/2586220607 >> v2:172.21.15.178:3300/0 conn(0x7f614415dc60 0x7f61440d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6149000640 1 -- 172.21.15.59:0/2586220607 >> 172.21.15.59:0/2586220607 conn(0x7f61440b3200 msgr2=0x7f61440b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6149000640 1 -- 172.21.15.59:0/2586220607 shutdown_connections 2024-04-25T09:01:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6149000640 1 -- 172.21.15.59:0/2586220607 wait complete. 2024-04-25T09:01:56.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6149000640 1 Processor -- start 2024-04-25T09:01:56.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.447+0000 7f6149000640 1 -- start start 2024-04-25T09:01:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6149000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f614406bf30 0x7f614415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6149000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6144099a60 0x7f61440c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6149000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f614415dc60 0x7f614414cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6149000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61440cc6f0 con 0x7f614406bf30 2024-04-25T09:01:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6149000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61440cc570 con 0x7f614415dc60 2024-04-25T09:01:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6149000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61440cc870 con 0x7f6144099a60 2024-04-25T09:01:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6141e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f614406bf30 0x7f614415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6141e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f614406bf30 0x7f614415bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35356/0 (socket says 172.21.15.59:35356) 2024-04-25T09:01:56.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6141e00640 1 -- 172.21.15.59:0/3764224107 learned_addr learned my addr 172.21.15.59:0/3764224107 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6141400640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6144099a60 0x7f61440c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6142800640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f614415dc60 0x7f614414cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6141e00640 1 -- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6144099a60 msgr2=0x7f61440c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6141e00640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6144099a60 0x7f61440c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6141e00640 1 -- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f614415dc60 msgr2=0x7f614414cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6141e00640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f614415dc60 0x7f614414cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6141e00640 1 -- 172.21.15.59:0/3764224107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61440c9e50 con 0x7f614406bf30 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6141e00640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f614406bf30 0x7f614415bf60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f613400e810 tx=0x7f613400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f613a000640 1 -- 172.21.15.59:0/3764224107 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134017070 con 0x7f614406bf30 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f613a000640 1 -- 172.21.15.59:0/3764224107 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613400c8d0 con 0x7f614406bf30 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6149000640 1 -- 172.21.15.59:0/3764224107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61440ca130 con 0x7f614406bf30 2024-04-25T09:01:56.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f613a000640 1 -- 172.21.15.59:0/3764224107 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613400f040 con 0x7f614406bf30 2024-04-25T09:01:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6149000640 1 -- 172.21.15.59:0/3764224107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61440ca6f0 con 0x7f614406bf30 2024-04-25T09:01:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.451+0000 7f6149000640 1 -- 172.21.15.59:0/3764224107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61440745d0 con 0x7f614406bf30 2024-04-25T09:01:56.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.455+0000 7f613a000640 1 -- 172.21.15.59:0/3764224107 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f613401a070 con 0x7f614406bf30 2024-04-25T09:01:56.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.455+0000 7f613a000640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6124066f60 0x7f6124069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.455+0000 7f613a000640 1 -- 172.21.15.59:0/3764224107 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6134084fe0 con 0x7f614406bf30 2024-04-25T09:01:56.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.455+0000 7f6141400640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6124066f60 0x7f6124069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.455+0000 7f6141400640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6124066f60 0x7f6124069420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f61441570c0 tx=0x7f6130008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.459+0000 7f613a000640 1 -- 172.21.15.59:0/3764224107 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6134055c50 con 0x7f614406bf30 2024-04-25T09:01:56.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.619+0000 7f6149000640 1 -- 172.21.15.59:0/3764224107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61440b7590 con 0x7f614406bf30 2024-04-25T09:01:56.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.619+0000 7f613a000640 1 -- 172.21.15.59:0/3764224107 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6134055550 con 0x7f614406bf30 2024-04-25T09:01:56.612 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:01:56.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.623+0000 7f6149000640 1 -- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6124066f60 msgr2=0x7f6124069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.623+0000 7f6149000640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6124066f60 0x7f6124069420 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f61441570c0 tx=0x7f6130008040 comp rx=0 tx=0).stop 2024-04-25T09:01:56.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.623+0000 7f6149000640 1 -- 172.21.15.59:0/3764224107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f614406bf30 msgr2=0x7f614415bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.623+0000 7f6149000640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f614406bf30 0x7f614415bf60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f613400e810 tx=0x7f613400ecd0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.623+0000 7f6149000640 1 -- 172.21.15.59:0/3764224107 shutdown_connections 2024-04-25T09:01:56.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.623+0000 7f6149000640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6124066f60 0x7f6124069420 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.623+0000 7f6149000640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f614415dc60 0x7f614414cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.623+0000 7f6149000640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6144099a60 0x7f61440c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.623+0000 7f6149000640 1 --2- 172.21.15.59:0/3764224107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f614406bf30 0x7f614415bf60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.623+0000 7f6149000640 1 -- 172.21.15.59:0/3764224107 >> 172.21.15.59:0/3764224107 conn(0x7f61440b3200 msgr2=0x7f61440ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:56.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.623+0000 7f6149000640 1 -- 172.21.15.59:0/3764224107 shutdown_connections 2024-04-25T09:01:56.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.623+0000 7f6149000640 1 -- 172.21.15.59:0/3764224107 wait complete. 2024-04-25T09:01:56.634 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:01:56.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.783+0000 7f82d7600640 1 Processor -- start 2024-04-25T09:01:56.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.783+0000 7f82d7600640 1 -- start start 2024-04-25T09:01:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d7600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82d015dc60 0x7f82d00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d7600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82d009a170 0x7f82d00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d7600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d015e040 con 0x7f82d006bf30 2024-04-25T09:01:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d7600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d00cff80 con 0x7f82d009a170 2024-04-25T09:01:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d7600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00d0260 con 0x7f82d015dc60 2024-04-25T09:01:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d5600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82d009a170 0x7f82d00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d5600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f82d009a170 0x7f82d00cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35370/0 (socket says 172.21.15.59:35370) 2024-04-25T09:01:56.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d5600640 1 -- 172.21.15.59:0/393600871 learned_addr learned my addr 172.21.15.59:0/393600871 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:56.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d4c00640 1 --2- 172.21.15.59:0/393600871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82d015dc60 0x7f82d00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d5600640 1 -- 172.21.15.59:0/393600871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82d015dc60 msgr2=0x7f82d00d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:56.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d5600640 1 --2- 172.21.15.59:0/393600871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82d015dc60 0x7f82d00d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d5600640 1 -- 172.21.15.59:0/393600871 >> v1:172.21.15.178:6789/0 conn(0x7f82d006bf30 legacy=0x7f82d0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:56.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d5600640 1 -- 172.21.15.59:0/393600871 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d00d0540 con 0x7f82d009a170 2024-04-25T09:01:56.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.787+0000 7f82d4c00640 1 --2- 172.21.15.59:0/393600871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82d015dc60 0x7f82d00d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:56.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82d5600640 1 --2- 172.21.15.59:0/393600871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d009a170 0x7f82d00cf8a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009e50 tx=0x7f82c801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4801fe2255a02c49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82cf400640 1 -- 172.21.15.59:0/393600871 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80a57b0 con 0x7f82d009a170 2024-04-25T09:01:56.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82cf400640 1 -- 172.21.15.59:0/393600871 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c80a5950 con 0x7f82d009a170 2024-04-25T09:01:56.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82cf400640 1 -- 172.21.15.59:0/393600871 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80a5d20 con 0x7f82d009a170 2024-04-25T09:01:56.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82d7600640 1 -- 172.21.15.59:0/393600871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d009a170 msgr2=0x7f82d00cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82d7600640 1 --2- 172.21.15.59:0/393600871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d009a170 0x7f82d00cf8a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f82c8009e50 tx=0x7f82c801c930 comp rx=0 tx=0).stop 2024-04-25T09:01:56.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82d7600640 1 -- 172.21.15.59:0/393600871 shutdown_connections 2024-04-25T09:01:56.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82d7600640 1 --2- 172.21.15.59:0/393600871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d009a170 0x7f82d00cf8a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82d7600640 1 --2- 172.21.15.59:0/393600871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82d015dc60 0x7f82d00d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82d7600640 1 -- 172.21.15.59:0/393600871 >> 172.21.15.59:0/393600871 conn(0x7f82d00b3200 msgr2=0x7f82d00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:56.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82d7600640 1 -- 172.21.15.59:0/393600871 shutdown_connections 2024-04-25T09:01:56.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82d7600640 1 -- 172.21.15.59:0/393600871 wait complete. 2024-04-25T09:01:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82d7600640 1 Processor -- start 2024-04-25T09:01:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.791+0000 7f82d7600640 1 -- start start 2024-04-25T09:01:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d7600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82d006bf30 0x7f82d009e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d7600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82d009a170 0x7f82d00b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d7600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d015dc60 0x7f82d00c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d7600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00cc6f0 con 0x7f82d015dc60 2024-04-25T09:01:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d7600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00cc570 con 0x7f82d006bf30 2024-04-25T09:01:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d7600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d00cc870 con 0x7f82d009a170 2024-04-25T09:01:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d015dc60 0x7f82d00c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d015dc60 0x7f82d00c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35376/0 (socket says 172.21.15.59:35376) 2024-04-25T09:01:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d5600640 1 -- 172.21.15.59:0/2941464624 learned_addr learned my addr 172.21.15.59:0/2941464624 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d4c00640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82d006bf30 0x7f82d009e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82cfe00640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82d009a170 0x7f82d00b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d5600640 1 -- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82d009a170 msgr2=0x7f82d00b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d5600640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82d009a170 0x7f82d00b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d5600640 1 -- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82d006bf30 msgr2=0x7f82d009e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d5600640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82d006bf30 0x7f82d009e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d5600640 1 -- 172.21.15.59:0/2941464624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d009d400 con 0x7f82d015dc60 2024-04-25T09:01:56.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d5600640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d015dc60 0x7f82d00c87e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f82c801afe0 tx=0x7f82c80196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82ccc00640 1 -- 172.21.15.59:0/2941464624 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80bc020 con 0x7f82d015dc60 2024-04-25T09:01:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82ccc00640 1 -- 172.21.15.59:0/2941464624 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c80b8880 con 0x7f82d015dc60 2024-04-25T09:01:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82ccc00640 1 -- 172.21.15.59:0/2941464624 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80b8c70 con 0x7f82d015dc60 2024-04-25T09:01:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d7600640 1 -- 172.21.15.59:0/2941464624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d009d6e0 con 0x7f82d015dc60 2024-04-25T09:01:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d7600640 1 -- 172.21.15.59:0/2941464624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d009dca0 con 0x7f82d015dc60 2024-04-25T09:01:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82d7600640 1 -- 172.21.15.59:0/2941464624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d00745d0 con 0x7f82d015dc60 2024-04-25T09:01:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.795+0000 7f82ccc00640 1 -- 172.21.15.59:0/2941464624 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f82c80bf020 con 0x7f82d015dc60 2024-04-25T09:01:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.799+0000 7f82ccc00640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f82b0066f90 0x7f82b0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.799+0000 7f82ccc00640 1 -- 172.21.15.59:0/2941464624 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f82c81203e0 con 0x7f82d015dc60 2024-04-25T09:01:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.799+0000 7f82d4c00640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f82b0066f90 0x7f82b0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.799+0000 7f82d4c00640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f82b0066f90 0x7f82b0069450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f82c400ab60 tx=0x7f82c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.803+0000 7f82ccc00640 1 -- 172.21.15.59:0/2941464624 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f82c80c6030 con 0x7f82d015dc60 2024-04-25T09:01:56.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.963+0000 7f82d7600640 1 -- 172.21.15.59:0/2941464624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82d00b7590 con 0x7f82d015dc60 2024-04-25T09:01:56.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82ccc00640 1 -- 172.21.15.59:0/2941464624 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f82c80165e0 con 0x7f82d015dc60 2024-04-25T09:01:56.958 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:01:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82d7600640 1 -- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f82b0066f90 msgr2=0x7f82b0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82d7600640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f82b0066f90 0x7f82b0069450 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f82c400ab60 tx=0x7f82c4008040 comp rx=0 tx=0).stop 2024-04-25T09:01:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82d7600640 1 -- 172.21.15.59:0/2941464624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d015dc60 msgr2=0x7f82d00c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82d7600640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d015dc60 0x7f82d00c87e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f82c801afe0 tx=0x7f82c80196d0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82d7600640 1 -- 172.21.15.59:0/2941464624 shutdown_connections 2024-04-25T09:01:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82d7600640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f82b0066f90 0x7f82b0069450 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82d7600640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f82d015dc60 0x7f82d00c87e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82d7600640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f82d009a170 0x7f82d00b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82d7600640 1 --2- 172.21.15.59:0/2941464624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f82d006bf30 0x7f82d009e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:56.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82d7600640 1 -- 172.21.15.59:0/2941464624 >> 172.21.15.59:0/2941464624 conn(0x7f82d00b3200 msgr2=0x7f82d00ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:56.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82d7600640 1 -- 172.21.15.59:0/2941464624 shutdown_connections 2024-04-25T09:01:56.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:56.967+0000 7f82d7600640 1 -- 172.21.15.59:0/2941464624 wait complete. 2024-04-25T09:01:56.979 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:01:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.131+0000 7ff63c200640 1 Processor -- start 2024-04-25T09:01:57.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.131+0000 7ff63c200640 1 -- start start 2024-04-25T09:01:57.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.131+0000 7ff63c200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff63415acd0 0x7ff63415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.131+0000 7ff63c200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff63415ee60 0x7ff6340b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff63c200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63415bc40 con 0x7ff634144120 2024-04-25T09:01:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff63c200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63415e490 con 0x7ff63415ee60 2024-04-25T09:01:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff63c200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63415b150 con 0x7ff63415acd0 2024-04-25T09:01:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff63a200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff63415ee60 0x7ff6340b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff639800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff634144120 0x7ff6340ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37702/0 (socket says 172.21.15.59:37702) 2024-04-25T09:01:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff639800640 1 -- 172.21.15.59:0/2047064282 learned_addr learned my addr 172.21.15.59:0/2047064282 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff638e00640 1 --2- 172.21.15.59:0/2047064282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff63415acd0 0x7ff63415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff63a200640 1 -- 172.21.15.59:0/2047064282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff63415acd0 msgr2=0x7ff63415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff63a200640 1 --2- 172.21.15.59:0/2047064282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff63415acd0 0x7ff63415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff63a200640 1 -- 172.21.15.59:0/2047064282 >> v1:172.21.15.59:6789/0 conn(0x7ff634144120 legacy=0x7ff6340ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff63a200640 1 -- 172.21.15.59:0/2047064282 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63415b3a0 con 0x7ff63415ee60 2024-04-25T09:01:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff633e00640 1 -- 172.21.15.59:0/2047064282 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511680407 0 0) 0x7ff63415bc40 con 0x7ff634144120 2024-04-25T09:01:57.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff638e00640 1 --2- 172.21.15.59:0/2047064282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff63415acd0 0x7ff63415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:57.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff63a200640 1 --2- 172.21.15.59:0/2047064282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63415ee60 0x7ff6340b3090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009d90 tx=0x7ff62c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3c9247345f5955 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:57.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff633e00640 1 -- 172.21.15.59:0/2047064282 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0b2070 con 0x7ff63415ee60 2024-04-25T09:01:57.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff633e00640 1 -- 172.21.15.59:0/2047064282 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c0a57a0 con 0x7ff63415ee60 2024-04-25T09:01:57.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.135+0000 7ff633e00640 1 -- 172.21.15.59:0/2047064282 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0a5b70 con 0x7ff63415ee60 2024-04-25T09:01:57.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 -- 172.21.15.59:0/2047064282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63415ee60 msgr2=0x7ff6340b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 --2- 172.21.15.59:0/2047064282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63415ee60 0x7ff6340b3090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009d90 tx=0x7ff62c01c8e0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 -- 172.21.15.59:0/2047064282 shutdown_connections 2024-04-25T09:01:57.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 --2- 172.21.15.59:0/2047064282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63415ee60 0x7ff6340b3090 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 --2- 172.21.15.59:0/2047064282 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff63415acd0 0x7ff63415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 -- 172.21.15.59:0/2047064282 >> 172.21.15.59:0/2047064282 conn(0x7ff634067080 msgr2=0x7ff63406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 -- 172.21.15.59:0/2047064282 shutdown_connections 2024-04-25T09:01:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 -- 172.21.15.59:0/2047064282 wait complete. 2024-04-25T09:01:57.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 Processor -- start 2024-04-25T09:01:57.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 -- start start 2024-04-25T09:01:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff634144120 0x7ff6340b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff63415acd0 0x7ff6340cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63415ee60 0x7ff6340cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6341677d0 con 0x7ff63415ee60 2024-04-25T09:01:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff634167650 con 0x7ff634144120 2024-04-25T09:01:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63c200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff634167950 con 0x7ff63415acd0 2024-04-25T09:01:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63415ee60 0x7ff6340cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63415ee60 0x7ff6340cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35394/0 (socket says 172.21.15.59:35394) 2024-04-25T09:01:57.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63a200640 1 -- 172.21.15.59:0/188416761 learned_addr learned my addr 172.21.15.59:0/188416761 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff638e00640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff63415acd0 0x7ff6340cb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff639800640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff634144120 0x7ff6340b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63a200640 1 -- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff63415acd0 msgr2=0x7ff6340cb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63a200640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff63415acd0 0x7ff6340cb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63a200640 1 -- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff634144120 msgr2=0x7ff6340b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63a200640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff634144120 0x7ff6340b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff63a200640 1 -- 172.21.15.59:0/188416761 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6341f9e70 con 0x7ff63415ee60 2024-04-25T09:01:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff638e00640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff63415acd0 0x7ff6340cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:57.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.139+0000 7ff639800640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff634144120 0x7ff6340b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.143+0000 7ff63a200640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63415ee60 0x7ff6340cbe70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0b0040 tx=0x7ff62c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.143+0000 7ff631600640 1 -- 172.21.15.59:0/188416761 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0bd020 con 0x7ff63415ee60 2024-04-25T09:01:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.143+0000 7ff631600640 1 -- 172.21.15.59:0/188416761 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c0b8470 con 0x7ff63415ee60 2024-04-25T09:01:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.143+0000 7ff631600640 1 -- 172.21.15.59:0/188416761 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c0b2040 con 0x7ff63415ee60 2024-04-25T09:01:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.143+0000 7ff63c200640 1 -- 172.21.15.59:0/188416761 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6341fa110 con 0x7ff63415ee60 2024-04-25T09:01:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.143+0000 7ff63c200640 1 -- 172.21.15.59:0/188416761 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6341fa6d0 con 0x7ff63415ee60 2024-04-25T09:01:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.143+0000 7ff63c200640 1 -- 172.21.15.59:0/188416761 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6340745d0 con 0x7ff63415ee60 2024-04-25T09:01:57.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.143+0000 7ff631600640 1 -- 172.21.15.59:0/188416761 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff62c0c0020 con 0x7ff63415ee60 2024-04-25T09:01:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.143+0000 7ff631600640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff614066f60 0x7ff614069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.143+0000 7ff631600640 1 -- 172.21.15.59:0/188416761 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7ff62c120220 con 0x7ff63415ee60 2024-04-25T09:01:57.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.143+0000 7ff639800640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff614066f60 0x7ff614069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.147+0000 7ff639800640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff614066f60 0x7ff614069420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff628000f70 tx=0x7ff628009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:57.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.147+0000 7ff631600640 1 -- 172.21.15.59:0/188416761 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff62c0c7070 con 0x7ff63415ee60 2024-04-25T09:01:57.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 -- 172.21.15.59:0/188416761 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff6340b45d0 con 0x7ff63415ee60 2024-04-25T09:01:57.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff631600640 1 -- 172.21.15.59:0/188416761 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff62c016560 con 0x7ff63415ee60 2024-04-25T09:01:57.303 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:01:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 -- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff614066f60 msgr2=0x7ff614069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff614066f60 0x7ff614069420 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff628000f70 tx=0x7ff628009040 comp rx=0 tx=0).stop 2024-04-25T09:01:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 -- 172.21.15.59:0/188416761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63415ee60 msgr2=0x7ff6340cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63415ee60 0x7ff6340cbe70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff62c0b0040 tx=0x7ff62c019680 comp rx=0 tx=0).stop 2024-04-25T09:01:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 -- 172.21.15.59:0/188416761 shutdown_connections 2024-04-25T09:01:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff614066f60 0x7ff614069420 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff63415ee60 0x7ff6340cbe70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff63415acd0 0x7ff6340cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 --2- 172.21.15.59:0/188416761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff634144120 0x7ff6340b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 -- 172.21.15.59:0/188416761 >> 172.21.15.59:0/188416761 conn(0x7ff634067080 msgr2=0x7ff6340b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:57.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 -- 172.21.15.59:0/188416761 shutdown_connections 2024-04-25T09:01:57.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.311+0000 7ff63c200640 1 -- 172.21.15.59:0/188416761 wait complete. 2024-04-25T09:01:57.325 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6add800640 1 Processor -- start 2024-04-25T09:01:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6add800640 1 -- start start 2024-04-25T09:01:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6add800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ad80b4920 0x7f6ad80afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6add800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad815ddf0 con 0x7f6ad815da10 2024-04-25T09:01:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6add800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad806b480 con 0x7f6ad80d11b0 2024-04-25T09:01:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6add800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ad80d06d0 con 0x7f6ad80b4920 2024-04-25T09:01:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6ad6a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6ad815da10 0x7f6ad806ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37708/0 (socket says 172.21.15.59:37708) 2024-04-25T09:01:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6ad6a00640 1 -- 172.21.15.59:0/831133707 learned_addr learned my addr 172.21.15.59:0/831133707 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6ad7400640 1 --2- 172.21.15.59:0/831133707 >> v2:172.21.15.59:3300/0 conn(0x7f6ad80b4920 0x7f6ad80afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6ad6000640 1 -- 172.21.15.59:0/831133707 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591309922 0 0) 0x7f6ad815ddf0 con 0x7f6ad815da10 2024-04-25T09:01:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6ad6000640 1 -- 172.21.15.59:0/831133707 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6abc003530 con 0x7f6ad815da10 2024-04-25T09:01:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6ad7400640 1 -- 172.21.15.59:0/831133707 >> v1:172.21.15.178:6789/0 conn(0x7f6ad80d11b0 legacy=0x7f6ad80b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6ad7400640 1 -- 172.21.15.59:0/831133707 >> v1:172.21.15.59:6789/0 conn(0x7f6ad815da10 legacy=0x7f6ad806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.475+0000 7f6ad7400640 1 -- 172.21.15.59:0/831133707 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80d09b0 con 0x7f6ad80b4920 2024-04-25T09:01:57.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.479+0000 7f6ad7400640 1 --2- 172.21.15.59:0/831133707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad80b4920 0x7f6ad80afe20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009d90 tx=0x7f6ad001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de72323bbcbaae02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.479+0000 7f6ad6000640 1 -- 172.21.15.59:0/831133707 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00b2070 con 0x7f6ad80b4920 2024-04-25T09:01:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.479+0000 7f6ad6000640 1 -- 172.21.15.59:0/831133707 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad00a58b0 con 0x7f6ad80b4920 2024-04-25T09:01:57.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.479+0000 7f6ad6000640 1 -- 172.21.15.59:0/831133707 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00a5c80 con 0x7f6ad80b4920 2024-04-25T09:01:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.479+0000 7f6add800640 1 -- 172.21.15.59:0/831133707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad80b4920 msgr2=0x7f6ad80afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.479+0000 7f6add800640 1 --2- 172.21.15.59:0/831133707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad80b4920 0x7f6ad80afe20 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0009d90 tx=0x7f6ad001c8e0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.479+0000 7f6add800640 1 -- 172.21.15.59:0/831133707 shutdown_connections 2024-04-25T09:01:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.479+0000 7f6add800640 1 --2- 172.21.15.59:0/831133707 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad80b4920 0x7f6ad80afe20 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.479+0000 7f6add800640 1 -- 172.21.15.59:0/831133707 >> 172.21.15.59:0/831133707 conn(0x7f6ad80b2400 msgr2=0x7f6ad80b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.479+0000 7f6add800640 1 -- 172.21.15.59:0/831133707 shutdown_connections 2024-04-25T09:01:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.479+0000 7f6add800640 1 -- 172.21.15.59:0/831133707 wait complete. 2024-04-25T09:01:57.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6add800640 1 Processor -- start 2024-04-25T09:01:57.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6add800640 1 -- start start 2024-04-25T09:01:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6add800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ad80b4920 0x7f6ad8159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6add800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ad80d11b0 0x7f6ad80cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6add800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad815da10 0x7f6ad80cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6add800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad816b900 con 0x7f6ad815da10 2024-04-25T09:01:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6add800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad816b780 con 0x7f6ad80b4920 2024-04-25T09:01:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6add800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad816ba80 con 0x7f6ad80d11b0 2024-04-25T09:01:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6ad7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad815da10 0x7f6ad80cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6ad7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad815da10 0x7f6ad80cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35420/0 (socket says 172.21.15.59:35420) 2024-04-25T09:01:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6ad7400640 1 -- 172.21.15.59:0/1523171551 learned_addr learned my addr 172.21.15.59:0/1523171551 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6ad6a00640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ad80b4920 0x7f6ad8159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6acfe00640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ad80d11b0 0x7f6ad80cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6ad7400640 1 -- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ad80d11b0 msgr2=0x7f6ad80cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6ad7400640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ad80d11b0 0x7f6ad80cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6ad7400640 1 -- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ad80b4920 msgr2=0x7f6ad8159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6ad7400640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ad80b4920 0x7f6ad8159480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6ad7400640 1 -- 172.21.15.59:0/1523171551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80c9a80 con 0x7f6ad815da10 2024-04-25T09:01:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6ad7400640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad815da10 0x7f6ad80cffb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6ad001a510 tx=0x7f6ad0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6acea00640 1 -- 172.21.15.59:0/1523171551 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00b2050 con 0x7f6ad815da10 2024-04-25T09:01:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6acea00640 1 -- 172.21.15.59:0/1523171551 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad00be070 con 0x7f6ad815da10 2024-04-25T09:01:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6acea00640 1 -- 172.21.15.59:0/1523171551 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00adc00 con 0x7f6ad815da10 2024-04-25T09:01:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6add800640 1 -- 172.21.15.59:0/1523171551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad8159a90 con 0x7f6ad815da10 2024-04-25T09:01:57.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6add800640 1 -- 172.21.15.59:0/1523171551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad815a050 con 0x7f6ad815da10 2024-04-25T09:01:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.483+0000 7f6add800640 1 -- 172.21.15.59:0/1523171551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad80745d0 con 0x7f6ad815da10 2024-04-25T09:01:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.487+0000 7f6acea00640 1 -- 172.21.15.59:0/1523171551 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6ad00c3460 con 0x7f6ad815da10 2024-04-25T09:01:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.487+0000 7f6acea00640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ab4066f60 0x7f6ab4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.487+0000 7f6acea00640 1 -- 172.21.15.59:0/1523171551 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f6ad0120780 con 0x7f6ad815da10 2024-04-25T09:01:57.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.487+0000 7f6ad6a00640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ab4066f60 0x7f6ab4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.487+0000 7f6ad6a00640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ab4066f60 0x7f6ab4069420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80011f0 tx=0x7f6ac8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.491+0000 7f6acea00640 1 -- 172.21.15.59:0/1523171551 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6ad0016560 con 0x7f6ad815da10 2024-04-25T09:01:57.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 -- 172.21.15.59:0/1523171551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ad8072860 con 0x7f6ad815da10 2024-04-25T09:01:57.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6acea00640 1 -- 172.21.15.59:0/1523171551 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f6ad00f1440 con 0x7f6ad815da10 2024-04-25T09:01:57.682 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:57.682 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2167197221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2167197221},{"type":"v1","addr":"172.21.15.59:6834","nonce":2167197221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2689387181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2689387181},{"type":"v1","addr":"172.21.15.178:6837","nonce":2689387181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1461695991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1461695991},{"type":"v1","addr":"172.21.15.59:6835","nonce":1461695991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:28.177275+0000","modified":"2024-04-25T09:01:46.237549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/3239224017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3239224017},{"type":"v1","addr":"172.21.15.178:6836","nonce":3239224017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:01:57.682 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2024-04-25T09:01:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 -- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ab4066f60 msgr2=0x7f6ab4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ab4066f60 0x7f6ab4069420 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6ac80011f0 tx=0x7f6ac8009040 comp rx=0 tx=0).stop 2024-04-25T09:01:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 -- 172.21.15.59:0/1523171551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad815da10 msgr2=0x7f6ad80cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad815da10 0x7f6ad80cffb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6ad001a510 tx=0x7f6ad0019680 comp rx=0 tx=0).stop 2024-04-25T09:01:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 -- 172.21.15.59:0/1523171551 shutdown_connections 2024-04-25T09:01:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ab4066f60 0x7f6ab4069420 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ad815da10 0x7f6ad80cffb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ad80d11b0 0x7f6ad80cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 --2- 172.21.15.59:0/1523171551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ad80b4920 0x7f6ad8159480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 -- 172.21.15.59:0/1523171551 >> 172.21.15.59:0/1523171551 conn(0x7f6ad80b2400 msgr2=0x7f6ad814f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 -- 172.21.15.59:0/1523171551 shutdown_connections 2024-04-25T09:01:57.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.691+0000 7f6add800640 1 -- 172.21.15.59:0/1523171551 wait complete. 2024-04-25T09:01:57.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:01:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf8a800640 1 Processor -- start 2024-04-25T09:01:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf8a800640 1 -- start start 2024-04-25T09:01:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf8a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbf84144140 0x7fbf840ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf8a800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8406ead0 0x7fbf840b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf8a800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8415ac60 con 0x7fbf840ced60 2024-04-25T09:01:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf8a800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf840cf3e0 con 0x7fbf84144140 2024-04-25T09:01:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf8a800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8415af20 con 0x7fbf8406ead0 2024-04-25T09:01:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf83400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbf84144140 0x7fbf840ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf7be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbf840ced60 0x7fbf8406e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37718/0 (socket says 172.21.15.59:37718) 2024-04-25T09:01:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf7be00640 1 -- 172.21.15.59:0/1308309673 learned_addr learned my addr 172.21.15.59:0/1308309673 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf83e00640 1 --2- 172.21.15.59:0/1308309673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8406ead0 0x7fbf840b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf83400640 1 -- 172.21.15.59:0/1308309673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8406ead0 msgr2=0x7fbf840b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf83400640 1 --2- 172.21.15.59:0/1308309673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8406ead0 0x7fbf840b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf83400640 1 -- 172.21.15.59:0/1308309673 >> v1:172.21.15.59:6789/0 conn(0x7fbf840ced60 legacy=0x7fbf8406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf83400640 1 -- 172.21.15.59:0/1308309673 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8415b200 con 0x7fbf84144140 2024-04-25T09:01:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.851+0000 7fbf82a00640 1 -- 172.21.15.59:0/1308309673 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467072092 0 0) 0x7fbf8415ac60 con 0x7fbf840ced60 2024-04-25T09:01:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.855+0000 7fbf83400640 1 --2- 172.21.15.59:0/1308309673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf84144140 0x7fbf840ce820 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbf740097c0 tx=0x7fbf7401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9010cff8420d66 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.855+0000 7fbf82a00640 1 -- 172.21.15.59:0/1308309673 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740b1070 con 0x7fbf84144140 2024-04-25T09:01:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.855+0000 7fbf82a00640 1 -- 172.21.15.59:0/1308309673 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf740ac440 con 0x7fbf84144140 2024-04-25T09:01:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.855+0000 7fbf82a00640 1 -- 172.21.15.59:0/1308309673 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf740ac810 con 0x7fbf84144140 2024-04-25T09:01:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.855+0000 7fbf8a800640 1 -- 172.21.15.59:0/1308309673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf84144140 msgr2=0x7fbf840ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.855+0000 7fbf8a800640 1 --2- 172.21.15.59:0/1308309673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf84144140 0x7fbf840ce820 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbf740097c0 tx=0x7fbf7401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.855+0000 7fbf8a800640 1 -- 172.21.15.59:0/1308309673 shutdown_connections 2024-04-25T09:01:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.855+0000 7fbf8a800640 1 --2- 172.21.15.59:0/1308309673 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8406ead0 0x7fbf840b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.855+0000 7fbf8a800640 1 --2- 172.21.15.59:0/1308309673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf84144140 0x7fbf840ce820 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.855+0000 7fbf8a800640 1 -- 172.21.15.59:0/1308309673 >> 172.21.15.59:0/1308309673 conn(0x7fbf84066fa0 msgr2=0x7fbf8406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.855+0000 7fbf8a800640 1 -- 172.21.15.59:0/1308309673 shutdown_connections 2024-04-25T09:01:57.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.855+0000 7fbf8a800640 1 -- 172.21.15.59:0/1308309673 wait complete. 2024-04-25T09:01:57.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf8a800640 1 Processor -- start 2024-04-25T09:01:57.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf8a800640 1 -- start start 2024-04-25T09:01:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf8a800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8406ead0 0x7fbf8413ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf8a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf840ced60 0x7fbf8413d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf8a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf84144140 0x7fbf8413e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf8a800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8415bb80 con 0x7fbf840ced60 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf8a800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8415ba00 con 0x7fbf84144140 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf8a800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf841673e0 con 0x7fbf8406ead0 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf7be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf840ced60 0x7fbf8413d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf7be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf840ced60 0x7fbf8413d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35444/0 (socket says 172.21.15.59:35444) 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf7be00640 1 -- 172.21.15.59:0/3669633609 learned_addr learned my addr 172.21.15.59:0/3669633609 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf83400640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8406ead0 0x7fbf8413ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf83e00640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf84144140 0x7fbf8413e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf7be00640 1 -- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8406ead0 msgr2=0x7fbf8413ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf7be00640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8406ead0 0x7fbf8413ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf7be00640 1 -- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf84144140 msgr2=0x7fbf8413e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf7be00640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf84144140 0x7fbf8413e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf7be00640 1 -- 172.21.15.59:0/3669633609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8413c810 con 0x7fbf840ced60 2024-04-25T09:01:57.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf83e00640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf84144140 0x7fbf8413e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf7be00640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf840ced60 0x7fbf8413d860 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0011f0 tx=0x7fbf6c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf7b400640 1 -- 172.21.15.59:0/3669633609 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c018070 con 0x7fbf840ced60 2024-04-25T09:01:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf7b400640 1 -- 172.21.15.59:0/3669633609 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6c0074e0 con 0x7fbf840ced60 2024-04-25T09:01:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf7b400640 1 -- 172.21.15.59:0/3669633609 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c004a10 con 0x7fbf840ced60 2024-04-25T09:01:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf8a800640 1 -- 172.21.15.59:0/3669633609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8413caf0 con 0x7fbf840ced60 2024-04-25T09:01:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.859+0000 7fbf8a800640 1 -- 172.21.15.59:0/3669633609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf840b2780 con 0x7fbf840ced60 2024-04-25T09:01:57.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.863+0000 7fbf8a800640 1 -- 172.21.15.59:0/3669633609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf840745d0 con 0x7fbf840ced60 2024-04-25T09:01:57.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.863+0000 7fbf7b400640 1 -- 172.21.15.59:0/3669633609 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbf6c004bb0 con 0x7fbf840ced60 2024-04-25T09:01:57.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.863+0000 7fbf7b400640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbf60066f60 0x7fbf60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:57.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.863+0000 7fbf7b400640 1 -- 172.21.15.59:0/3669633609 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fbf6c084670 con 0x7fbf840ced60 2024-04-25T09:01:57.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.863+0000 7fbf83400640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbf60066f60 0x7fbf60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:57.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.867+0000 7fbf83400640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbf60066f60 0x7fbf60069420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbf740ae000 tx=0x7fbf740a6070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:57.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:57.867+0000 7fbf7b400640 1 -- 172.21.15.59:0/3669633609 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbf6c054ce0 con 0x7fbf840ced60 2024-04-25T09:01:58.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.031+0000 7fbf8a800640 1 -- 172.21.15.59:0/3669633609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf8415a070 con 0x7fbf840ced60 2024-04-25T09:01:58.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf7b400640 1 -- 172.21.15.59:0/3669633609 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7fbf6c081870 con 0x7fbf840ced60 2024-04-25T09:01:58.026 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:58.026 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:01:58.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf8a800640 1 -- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbf60066f60 msgr2=0x7fbf60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf8a800640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbf60066f60 0x7fbf60069420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbf740ae000 tx=0x7fbf740a6070 comp rx=0 tx=0).stop 2024-04-25T09:01:58.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf8a800640 1 -- 172.21.15.59:0/3669633609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf840ced60 msgr2=0x7fbf8413d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf8a800640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf840ced60 0x7fbf8413d860 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c0011f0 tx=0x7fbf6c00c9b0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf8a800640 1 -- 172.21.15.59:0/3669633609 shutdown_connections 2024-04-25T09:01:58.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf8a800640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbf60066f60 0x7fbf60069420 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf8a800640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf84144140 0x7fbf8413e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf8a800640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf840ced60 0x7fbf8413d860 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf8a800640 1 --2- 172.21.15.59:0/3669633609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8406ead0 0x7fbf8413ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf8a800640 1 -- 172.21.15.59:0/3669633609 >> 172.21.15.59:0/3669633609 conn(0x7fbf84066fa0 msgr2=0x7fbf8406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf8a800640 1 -- 172.21.15.59:0/3669633609 shutdown_connections 2024-04-25T09:01:58.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.035+0000 7fbf8a800640 1 -- 172.21.15.59:0/3669633609 wait complete. 2024-04-25T09:01:58.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:01:58.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd076a00640 1 Processor -- start 2024-04-25T09:01:58.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd076a00640 1 -- start start 2024-04-25T09:01:58.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd076a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd070161510 0x7fd070143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd076a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0701435c0 0x7fd07015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd076a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd07006d090 con 0x7fd070070fe0 2024-04-25T09:01:58.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd076a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd070071ad0 con 0x7fd0701435c0 2024-04-25T09:01:58.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd076a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd070162390 con 0x7fd070161510 2024-04-25T09:01:58.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd074a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0701435c0 0x7fd07015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd074a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0701435c0 0x7fd07015e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35454/0 (socket says 172.21.15.59:35454) 2024-04-25T09:01:58.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd074a00640 1 -- 172.21.15.59:0/3771713346 learned_addr learned my addr 172.21.15.59:0/3771713346 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd06f400640 1 --2- 172.21.15.59:0/3771713346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd070161510 0x7fd070143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd074a00640 1 -- 172.21.15.59:0/3771713346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd070161510 msgr2=0x7fd070143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd074a00640 1 --2- 172.21.15.59:0/3771713346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd070161510 0x7fd070143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd074a00640 1 -- 172.21.15.59:0/3771713346 >> v1:172.21.15.178:6789/0 conn(0x7fd070070fe0 legacy=0x7fd0700713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd074a00640 1 -- 172.21.15.59:0/3771713346 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd070161af0 con 0x7fd0701435c0 2024-04-25T09:01:58.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.199+0000 7fd06f400640 1 --2- 172.21.15.59:0/3771713346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd070161510 0x7fd070143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:58.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd074a00640 1 --2- 172.21.15.59:0/3771713346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0701435c0 0x7fd07015e550 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd068009e50 tx=0x7fd06801c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35365f11b45e6b16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd06ea00640 1 -- 172.21.15.59:0/3771713346 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680a5570 con 0x7fd0701435c0 2024-04-25T09:01:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd06ea00640 1 -- 172.21.15.59:0/3771713346 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0680a5710 con 0x7fd0701435c0 2024-04-25T09:01:58.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd06ea00640 1 -- 172.21.15.59:0/3771713346 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0680a5ae0 con 0x7fd0701435c0 2024-04-25T09:01:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd076a00640 1 -- 172.21.15.59:0/3771713346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0701435c0 msgr2=0x7fd07015e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd076a00640 1 --2- 172.21.15.59:0/3771713346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0701435c0 0x7fd07015e550 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd068009e50 tx=0x7fd06801c7e0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd076a00640 1 -- 172.21.15.59:0/3771713346 shutdown_connections 2024-04-25T09:01:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd076a00640 1 --2- 172.21.15.59:0/3771713346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0701435c0 0x7fd07015e550 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd076a00640 1 --2- 172.21.15.59:0/3771713346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd070161510 0x7fd070143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd076a00640 1 -- 172.21.15.59:0/3771713346 >> 172.21.15.59:0/3771713346 conn(0x7fd0700b3390 msgr2=0x7fd0700b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd076a00640 1 -- 172.21.15.59:0/3771713346 shutdown_connections 2024-04-25T09:01:58.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd076a00640 1 -- 172.21.15.59:0/3771713346 wait complete. 2024-04-25T09:01:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd076a00640 1 Processor -- start 2024-04-25T09:01:58.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.203+0000 7fd076a00640 1 -- start start 2024-04-25T09:01:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd076a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd070070fe0 0x7fd07013a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd076a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0701435c0 0x7fd07015fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd076a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd070161510 0x7fd070133db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd076a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700b06c0 con 0x7fd070070fe0 2024-04-25T09:01:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd076a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700b0540 con 0x7fd070161510 2024-04-25T09:01:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd076a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0700b0840 con 0x7fd0701435c0 2024-04-25T09:01:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd06fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd070070fe0 0x7fd07013a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd06fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd070070fe0 0x7fd07013a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35460/0 (socket says 172.21.15.59:35460) 2024-04-25T09:01:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd06fe00640 1 -- 172.21.15.59:0/1642440320 learned_addr learned my addr 172.21.15.59:0/1642440320 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:58.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd074a00640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd070161510 0x7fd070133db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd06f400640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0701435c0 0x7fd07015fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd06fe00640 1 -- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0701435c0 msgr2=0x7fd07015fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd06fe00640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0701435c0 0x7fd07015fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd06fe00640 1 -- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd070161510 msgr2=0x7fd070133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd06fe00640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd070161510 0x7fd070133db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd06fe00640 1 -- 172.21.15.59:0/1642440320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0701604b0 con 0x7fd070070fe0 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd06f400640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0701435c0 0x7fd07015fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd074a00640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd070161510 0x7fd070133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd06fe00640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd070070fe0 0x7fd07013a600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd06000c450 tx=0x7fd06000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd067e00640 1 -- 172.21.15.59:0/1642440320 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060012830 con 0x7fd070070fe0 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd067e00640 1 -- 172.21.15.59:0/1642440320 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd060017070 con 0x7fd070070fe0 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd076a00640 1 -- 172.21.15.59:0/1642440320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0700d0390 con 0x7fd070070fe0 2024-04-25T09:01:58.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd067e00640 1 -- 172.21.15.59:0/1642440320 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060012c30 con 0x7fd070070fe0 2024-04-25T09:01:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd076a00640 1 -- 172.21.15.59:0/1642440320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0700d0950 con 0x7fd070070fe0 2024-04-25T09:01:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.207+0000 7fd076a00640 1 -- 172.21.15.59:0/1642440320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd07006deb0 con 0x7fd070070fe0 2024-04-25T09:01:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.211+0000 7fd067e00640 1 -- 172.21.15.59:0/1642440320 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd06001c460 con 0x7fd070070fe0 2024-04-25T09:01:58.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.211+0000 7fd067e00640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd050066f60 0x7fd050069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.211+0000 7fd067e00640 1 -- 172.21.15.59:0/1642440320 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7fd0600851b0 con 0x7fd070070fe0 2024-04-25T09:01:58.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.211+0000 7fd06f400640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd050066f60 0x7fd050069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.211+0000 7fd06f400640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd050066f60 0x7fd050069420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd05c006fd0 tx=0x7fd05c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.215+0000 7fd067e00640 1 -- 172.21.15.59:0/1642440320 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd060055e80 con 0x7fd070070fe0 2024-04-25T09:01:58.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.407+0000 7fd076a00640 1 -- 172.21.15.59:0/1642440320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0700745d0 con 0x7fd070070fe0 2024-04-25T09:01:58.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.407+0000 7fd067e00640 1 -- 172.21.15.59:0/1642440320 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7fd060055780 con 0x7fd070070fe0 2024-04-25T09:01:58.400 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:01:58.400 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2167197221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2167197221},{"type":"v1","addr":"172.21.15.59:6834","nonce":2167197221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2689387181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2689387181},{"type":"v1","addr":"172.21.15.178:6837","nonce":2689387181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1461695991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1461695991},{"type":"v1","addr":"172.21.15.59:6835","nonce":1461695991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:28.177275+0000","modified":"2024-04-25T09:01:46.237549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/3239224017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3239224017},{"type":"v1","addr":"172.21.15.178:6836","nonce":3239224017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:01:58.400 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2024-04-25T09:01:58.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.411+0000 7fd076a00640 1 -- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd050066f60 msgr2=0x7fd050069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.411+0000 7fd076a00640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd050066f60 0x7fd050069420 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd05c006fd0 tx=0x7fd05c008040 comp rx=0 tx=0).stop 2024-04-25T09:01:58.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.411+0000 7fd076a00640 1 -- 172.21.15.59:0/1642440320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd070070fe0 msgr2=0x7fd07013a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.411+0000 7fd076a00640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd070070fe0 0x7fd07013a600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd06000c450 tx=0x7fd06000c910 comp rx=0 tx=0).stop 2024-04-25T09:01:58.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.411+0000 7fd076a00640 1 -- 172.21.15.59:0/1642440320 shutdown_connections 2024-04-25T09:01:58.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.411+0000 7fd076a00640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd050066f60 0x7fd050069420 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.411+0000 7fd076a00640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd070161510 0x7fd070133db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.411+0000 7fd076a00640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0701435c0 0x7fd07015fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.411+0000 7fd076a00640 1 --2- 172.21.15.59:0/1642440320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd070070fe0 0x7fd07013a600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.411+0000 7fd076a00640 1 -- 172.21.15.59:0/1642440320 >> 172.21.15.59:0/1642440320 conn(0x7fd0700b3390 msgr2=0x7fd0700caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.411+0000 7fd076a00640 1 -- 172.21.15.59:0/1642440320 shutdown_connections 2024-04-25T09:01:58.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.411+0000 7fd076a00640 1 -- 172.21.15.59:0/1642440320 wait complete. 2024-04-25T09:01:58.824 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:01:28.177275+0000', 'modified': '2024-04-25T09:01:46.237549+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.178:6836/3239224017', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.178:6834', 'nonce': 3239224017}, {'type': 'v1', 'addr': '172.21.15.178:6836', 'nonce': 3239224017}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:01:58.824 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:01:58.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T09:01:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.975+0000 7f8d1dc00640 1 Processor -- start 2024-04-25T09:01:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.975+0000 7f8d1dc00640 1 -- start start 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d1dc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8d180cf3c0 0x7f8d180cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d1dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d180cd370 0x7f8d18099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d1dc00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d180d02a0 con 0x7f8d1815b910 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d1dc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d180cc350 con 0x7f8d180cd370 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d1dc00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d180cc630 con 0x7f8d180cf3c0 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d17400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d180cd370 0x7f8d18099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d17400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d180cd370 0x7f8d18099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35464/0 (socket says 172.21.15.59:35464) 2024-04-25T09:01:58.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d17400640 1 -- 172.21.15.59:0/2530303058 learned_addr learned my addr 172.21.15.59:0/2530303058 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:58.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d17400640 1 -- 172.21.15.59:0/2530303058 >> v2:172.21.15.178:3300/0 conn(0x7f8d180cf3c0 msgr2=0x7f8d180cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d17400640 1 --2- 172.21.15.59:0/2530303058 >> v2:172.21.15.178:3300/0 conn(0x7f8d180cf3c0 0x7f8d180cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d17400640 1 -- 172.21.15.59:0/2530303058 >> v1:172.21.15.178:6789/0 conn(0x7f8d1815b910 legacy=0x7f8d180cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d17400640 1 -- 172.21.15.59:0/2530303058 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d180cc910 con 0x7f8d180cd370 2024-04-25T09:01:58.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d17400640 1 --2- 172.21.15.59:0/2530303058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d180cd370 0x7f8d18099a60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d18072e20 tx=0x7f8d1001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8edd35227e5183b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d16000640 1 -- 172.21.15.59:0/2530303058 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d100a5780 con 0x7f8d180cd370 2024-04-25T09:01:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d16000640 1 -- 172.21.15.59:0/2530303058 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d100a5920 con 0x7f8d180cd370 2024-04-25T09:01:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.979+0000 7f8d16000640 1 -- 172.21.15.59:0/2530303058 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d100a5cf0 con 0x7f8d180cd370 2024-04-25T09:01:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2530303058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d180cd370 msgr2=0x7f8d18099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 --2- 172.21.15.59:0/2530303058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d180cd370 0x7f8d18099a60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8d18072e20 tx=0x7f8d1001c9b0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2530303058 shutdown_connections 2024-04-25T09:01:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 --2- 172.21.15.59:0/2530303058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d180cd370 0x7f8d18099a60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 --2- 172.21.15.59:0/2530303058 >> v2:172.21.15.178:3300/0 conn(0x7f8d180cf3c0 0x7f8d180cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2530303058 >> 172.21.15.59:0/2530303058 conn(0x7f8d180b3200 msgr2=0x7f8d180b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2530303058 shutdown_connections 2024-04-25T09:01:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2530303058 wait complete. 2024-04-25T09:01:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 Processor -- start 2024-04-25T09:01:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 -- start start 2024-04-25T09:01:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d180cd370 0x7f8d18155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d180cf3c0 0x7f8d1806c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d1815b910 0x7f8d181644f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d18168d30 con 0x7f8d180cd370 2024-04-25T09:01:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d18168bb0 con 0x7f8d1815b910 2024-04-25T09:01:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d1dc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d18168eb0 con 0x7f8d180cf3c0 2024-04-25T09:01:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d16a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d180cd370 0x7f8d18155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d16a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d180cd370 0x7f8d18155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35470/0 (socket says 172.21.15.59:35470) 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d16a00640 1 -- 172.21.15.59:0/2366377932 learned_addr learned my addr 172.21.15.59:0/2366377932 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d17400640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d1815b910 0x7f8d181644f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d0e000640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d180cf3c0 0x7f8d1806c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d16a00640 1 -- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d180cf3c0 msgr2=0x7f8d1806c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d16a00640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d180cf3c0 0x7f8d1806c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d16a00640 1 -- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d1815b910 msgr2=0x7f8d181644f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d16a00640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d1815b910 0x7f8d181644f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.983+0000 7f8d16a00640 1 -- 172.21.15.59:0/2366377932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d18164a30 con 0x7f8d180cd370 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.987+0000 7f8d16a00640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d180cd370 0x7f8d18155560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d0800b3e0 tx=0x7f8d0800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.987+0000 7f8d0f400640 1 -- 172.21.15.59:0/2366377932 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d08015020 con 0x7f8d180cd370 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.987+0000 7f8d0f400640 1 -- 172.21.15.59:0/2366377932 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d08011850 con 0x7f8d180cd370 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.987+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2366377932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1806cdc0 con 0x7f8d180cd370 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.987+0000 7f8d0f400640 1 -- 172.21.15.59:0/2366377932 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d08011c40 con 0x7f8d180cd370 2024-04-25T09:01:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.987+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2366377932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1806d380 con 0x7f8d180cd370 2024-04-25T09:01:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.987+0000 7f8d0f400640 1 -- 172.21.15.59:0/2366377932 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8d08018020 con 0x7f8d180cd370 2024-04-25T09:01:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0f400640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8cf4066f60 0x7f8cf4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0f400640 1 -- 172.21.15.59:0/2366377932 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8d080852f0 con 0x7f8d180cd370 2024-04-25T09:01:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 Processor -- start 2024-04-25T09:01:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 -- start start 2024-04-25T09:01:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0e000640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8cf4066f60 0x7f8cf4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e05726d920 0x55e05726dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 0x55e0572239f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e057223f30 0x55e057224310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05710b5f0 con 0x55e05726e240 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e057072da0 con 0x55e057223f30 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e056ffb150 con 0x55e05726d920 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0e000640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8cf4066f60 0x7f8cf4069420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8d00006fd0 tx=0x7f8d00008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 0x55e0572239f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 0x55e0572239f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35476/0 (socket says 172.21.15.59:35476) 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0e000640 1 -- 172.21.15.59:0/2159368474 learned_addr learned my addr 172.21.15.59:0/2159368474 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d16a00640 1 --2- 172.21.15.59:0/2159368474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e05726d920 0x55e05726dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d17400640 1 --2- 172.21.15.59:0/2159368474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e057223f30 0x55e057224310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0e000640 1 -- 172.21.15.59:0/2159368474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e05726d920 msgr2=0x55e05726dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0e000640 1 --2- 172.21.15.59:0/2159368474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e05726d920 0x55e05726dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0e000640 1 -- 172.21.15.59:0/2159368474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e057223f30 msgr2=0x55e057224310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0e000640 1 --2- 172.21.15.59:0/2159368474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e057223f30 0x55e057224310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0e000640 1 -- 172.21.15.59:0/2159368474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e057014ca0 con 0x55e05726e240 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d17400640 1 --2- 172.21.15.59:0/2159368474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e057223f30 0x55e057224310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:01:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d0e000640 1 --2- 172.21.15.59:0/2159368474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 0x55e0572239f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000d7e0 tx=0x7f8d00010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78bb2440a9e23b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d07400640 1 -- 172.21.15.59:0/2159368474 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00024070 con 0x55e05726e240 2024-04-25T09:01:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d07400640 1 -- 172.21.15.59:0/2159368474 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0000de20 con 0x55e05726e240 2024-04-25T09:01:58.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d07400640 1 -- 172.21.15.59:0/2159368474 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00014dc0 con 0x55e05726e240 2024-04-25T09:01:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 -- 172.21.15.59:0/2159368474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 msgr2=0x55e0572239f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 --2- 172.21.15.59:0/2159368474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 0x55e0572239f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8d0000d7e0 tx=0x7f8d00010000 comp rx=0 tx=0).stop 2024-04-25T09:01:58.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 -- 172.21.15.59:0/2159368474 shutdown_connections 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 --2- 172.21.15.59:0/2159368474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e057223f30 0x55e057224310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 --2- 172.21.15.59:0/2159368474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 0x55e0572239f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 --2- 172.21.15.59:0/2159368474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e05726d920 0x55e05726dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 -- 172.21.15.59:0/2159368474 >> 172.21.15.59:0/2159368474 conn(0x55e05722a2a0 msgr2=0x55e0572222d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 -- 172.21.15.59:0/2159368474 shutdown_connections 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.991+0000 7f8d2114c000 1 -- 172.21.15.59:0/2159368474 wait complete. 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 1 -- start start 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 1 Processor -- start 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e057223f30 0x55e057274cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726d920 0x55e057275230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 0x55e057227aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05702d990 con 0x55e05726e240 2024-04-25T09:01:58.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05706ee40 con 0x55e05726d920 2024-04-25T09:01:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e056ffe900 con 0x55e057223f30 2024-04-25T09:01:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 10 client.0 _ll_register_callbacks cb 0x55e0571261c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d17400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 0x55e057227aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d17400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 0x55e057227aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35484/0 (socket says 172.21.15.59:35484) 2024-04-25T09:01:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d17400640 1 -- 172.21.15.59:0/430543420 learned_addr learned my addr 172.21.15.59:0/430543420 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d0e000640 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726d920 0x55e057275230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d16a00640 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e057223f30 0x55e057274cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d17400640 1 -- 172.21.15.59:0/430543420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e057223f30 msgr2=0x55e057274cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d17400640 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e057223f30 0x55e057274cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d17400640 1 -- 172.21.15.59:0/430543420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726d920 msgr2=0x55e057275230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d17400640 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726d920 0x55e057275230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d17400640 1 -- 172.21.15.59:0/430543420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e05702b630 con 0x55e05726e240 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d17400640 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 0x55e057227aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8d1001a5e0 tx=0x7f8d1001b1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b150ec38aa47f4e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8cfbe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8cfbe00640 1 -- 172.21.15.59:0/430543420 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d100bc070 con 0x55e05726e240 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8cfbe00640 1 -- 172.21.15.59:0/430543420 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8d100c1df0 con 0x55e05726e240 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 1 -- 172.21.15.59:0/430543420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d0000de20 con 0x55e05726e240 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8cfbe00640 1 -- 172.21.15.59:0/430543420 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d100a5c20 con 0x55e05726e240 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 10 client.4785 fetch_fsmap learned FSMap version 9 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 1 -- 172.21.15.59:0/430543420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e056ffb3a0 con 0x55e05726e240 2024-04-25T09:01:58.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8cfbe00640 1 -- 172.21.15.59:0/430543420 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0000de20 con 0x55e05726e240 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8cfbe00640 1 -- 172.21.15.59:0/430543420 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f8d100c0400 con 0x55e05726e240 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 10 client.4785 fetch_fsmap finished waiting for FSMap version 9 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 10 client.4785 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 20 client.4785 populate_metadata read hostname 'smithi059' 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x55e057229160 0x55e05727ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 4 client.4785 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.995+0000 7f8d2114c000 1 -- 172.21.15.59:0/430543420 --> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e05700ea50 con 0x55e057229160 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d16a00640 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x55e057229160 0x55e05727ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d16a00640 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x55e057229160 0x55e05727ed50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a97369030a32b34 server_cookie=6704435a75b47993 in_seq=0 out_seq=0 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8cfbe00640 10 client.4785 ms_handle_connect on v2:172.21.15.178:6834/3239224017 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8cfbe00640 1 -- 172.21.15.59:0/430543420 <== mds.0 v2:172.21.15.178:6834/3239224017 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e05700ea50 con 0x55e057229160 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8cfbe00640 10 client.4785 handle_command_reply: tid=0 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d2114c000 1 client.4785 shutdown 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d2114c000 1 -- 172.21.15.59:0/430543420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 msgr2=0x55e057227aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:58.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d2114c000 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 0x55e057227aa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f8d1001a5e0 tx=0x7f8d1001b1f0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d2114c000 1 -- 172.21.15.59:0/430543420 shutdown_connections 2024-04-25T09:01:58.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d2114c000 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726e240 0x55e057227aa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d2114c000 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x55e057229160 0x55e05727ed50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d2114c000 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726d920 0x55e057275230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d2114c000 1 --2- 172.21.15.59:0/430543420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e057223f30 0x55e057274cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:58.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d2114c000 1 -- 172.21.15.59:0/430543420 >> 172.21.15.59:0/430543420 conn(0x55e05722a2a0 msgr2=0x55e0572229e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:58.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8cfbe00640 0 client.4785 ms_handle_reset on v2:172.21.15.178:6834/3239224017 2024-04-25T09:01:58.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d2114c000 1 -- 172.21.15.59:0/430543420 shutdown_connections 2024-04-25T09:01:58.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d2114c000 1 -- 172.21.15.59:0/430543420 wait complete. 2024-04-25T09:01:58.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:58.999+0000 7f8d2114c000 20 client.4785 trim_cache size 0 max 16384 2024-04-25T09:01:59.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d2114c000 1 Processor -- start 2024-04-25T09:01:59.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d2114c000 1 -- start start 2024-04-25T09:01:59.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d2114c000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e057223f30 0x55e0572c8610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d2114c000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726d920 0x55e0572c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d2114c000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726e240 0x55e0572c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d2114c000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d18203d60 con 0x55e05726d920 2024-04-25T09:01:59.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d2114c000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d180c9e00 con 0x55e05726e240 2024-04-25T09:01:59.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d2114c000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d18203760 con 0x55e057223f30 2024-04-25T09:01:59.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d0e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726d920 0x55e0572c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d0e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726d920 0x55e0572c8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35490/0 (socket says 172.21.15.59:35490) 2024-04-25T09:01:59.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d0e000640 1 -- 172.21.15.59:0/1643216530 learned_addr learned my addr 172.21.15.59:0/1643216530 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d17400640 1 --2- 172.21.15.59:0/1643216530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726e240 0x55e0572c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d16a00640 1 --2- 172.21.15.59:0/1643216530 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e057223f30 0x55e0572c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d0e000640 1 -- 172.21.15.59:0/1643216530 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e057223f30 msgr2=0x55e0572c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d0e000640 1 --2- 172.21.15.59:0/1643216530 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e057223f30 0x55e0572c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d0e000640 1 -- 172.21.15.59:0/1643216530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726e240 msgr2=0x55e0572c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d0e000640 1 --2- 172.21.15.59:0/1643216530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726e240 0x55e0572c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d0e000640 1 -- 172.21.15.59:0/1643216530 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e05726e070 con 0x55e05726d920 2024-04-25T09:01:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d0e000640 1 --2- 172.21.15.59:0/1643216530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726d920 0x55e0572c8b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8d00008010 tx=0x7f8d0001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef8dacfc3e7cbcb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d06a00640 1 -- 172.21.15.59:0/1643216530 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0002e070 con 0x55e05726d920 2024-04-25T09:01:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d06a00640 1 -- 172.21.15.59:0/1643216530 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00014d00 con 0x55e05726d920 2024-04-25T09:01:59.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.015+0000 7f8d06a00640 1 -- 172.21.15.59:0/1643216530 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d00024040 con 0x55e05726d920 2024-04-25T09:01:59.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 -- 172.21.15.59:0/1643216530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726d920 msgr2=0x55e0572c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 --2- 172.21.15.59:0/1643216530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726d920 0x55e0572c8b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8d00008010 tx=0x7f8d0001c000 comp rx=0 tx=0).stop 2024-04-25T09:01:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 -- 172.21.15.59:0/1643216530 shutdown_connections 2024-04-25T09:01:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 --2- 172.21.15.59:0/1643216530 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726e240 0x55e0572c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 --2- 172.21.15.59:0/1643216530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e05726d920 0x55e0572c8b50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 --2- 172.21.15.59:0/1643216530 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e057223f30 0x55e0572c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 -- 172.21.15.59:0/1643216530 >> 172.21.15.59:0/1643216530 conn(0x55e05722a2a0 msgr2=0x55e057227470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 -- 172.21.15.59:0/1643216530 shutdown_connections 2024-04-25T09:01:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 -- 172.21.15.59:0/1643216530 wait complete. 2024-04-25T09:01:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 -- start start 2024-04-25T09:01:59.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 Processor -- start 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e057223f30 0x55e05727a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e05726d920 0x55e05727a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726e240 0x55e0572b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0570773d0 con 0x55e057223f30 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05712ed50 con 0x55e05726e240 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e05700d980 con 0x55e05726d920 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 10 client.0 _ll_register_callbacks cb 0x7f8d00009100 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d16a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e057223f30 0x55e05727a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d16a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e057223f30 0x55e05727a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35502/0 (socket says 172.21.15.59:35502) 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d16a00640 1 -- 172.21.15.59:0/162443919 learned_addr learned my addr 172.21.15.59:0/162443919 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d17400640 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726e240 0x55e0572b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d0e000640 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e05726d920 0x55e05727a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d16a00640 1 -- 172.21.15.59:0/162443919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e05726d920 msgr2=0x55e05727a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d16a00640 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e05726d920 0x55e05727a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d16a00640 1 -- 172.21.15.59:0/162443919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726e240 msgr2=0x55e0572b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d16a00640 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726e240 0x55e0572b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d16a00640 1 -- 172.21.15.59:0/162443919 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0570f4600 con 0x55e057223f30 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d16a00640 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e057223f30 0x55e05727a3b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d08051d30 tx=0x7f8d08055750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f612ca76bf25969 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8cfbe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8cfbe00640 1 -- 172.21.15.59:0/162443919 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d08072060 con 0x55e057223f30 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8cfbe00640 1 -- 172.21.15.59:0/162443919 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f8d08085070 con 0x55e057223f30 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 -- 172.21.15.59:0/162443919 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8d00014d00 con 0x55e057223f30 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8cfbe00640 1 -- 172.21.15.59:0/162443919 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d0806d030 con 0x55e057223f30 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 10 client.4791 fetch_fsmap learned FSMap version 9 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 -- 172.21.15.59:0/162443919 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55e0570079b0 con 0x55e057223f30 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8cfbe00640 1 -- 172.21.15.59:0/162443919 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d00014d00 con 0x55e057223f30 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8cfbe00640 1 -- 172.21.15.59:0/162443919 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f8d08051f40 con 0x55e057223f30 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 10 client.4791 fetch_fsmap finished waiting for FSMap version 9 2024-04-25T09:01:59.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 10 client.4791 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T09:01:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 20 client.4791 populate_metadata read hostname 'smithi059' 2024-04-25T09:01:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x55e05727ae30 0x55e0572b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 4 client.4791 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:01:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.019+0000 7f8d2114c000 1 -- 172.21.15.59:0/162443919 --> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e0570802e0 con 0x55e05727ae30 2024-04-25T09:01:59.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d0e000640 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x55e05727ae30 0x55e0572b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d0e000640 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x55e05727ae30 0x55e0572b23c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf9e0b5f63848d8f server_cookie=85319b8be2f1acfd in_seq=0 out_seq=0 2024-04-25T09:01:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8cfbe00640 10 client.4791 ms_handle_connect on v2:172.21.15.178:6834/3239224017 2024-04-25T09:01:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8cfbe00640 1 -- 172.21.15.59:0/162443919 <== mds.0 v2:172.21.15.178:6834/3239224017 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55e0570802e0 con 0x55e05727ae30 2024-04-25T09:01:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8cfbe00640 10 client.4791 handle_command_reply: tid=0 2024-04-25T09:01:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d2114c000 1 client.4791 shutdown 2024-04-25T09:01:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d2114c000 1 -- 172.21.15.59:0/162443919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e057223f30 msgr2=0x55e05727a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d2114c000 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e057223f30 0x55e05727a3b0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8d08051d30 tx=0x7f8d08055750 comp rx=0 tx=0).stop 2024-04-25T09:01:59.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d2114c000 1 -- 172.21.15.59:0/162443919 shutdown_connections 2024-04-25T09:01:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d2114c000 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.178:6834/3239224017,v1:172.21.15.178:6836/3239224017] conn(0x55e05727ae30 0x55e0572b23c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d2114c000 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e05726e240 0x55e0572b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d2114c000 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e05726d920 0x55e05727a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d2114c000 1 --2- 172.21.15.59:0/162443919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e057223f30 0x55e05727a3b0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8cfbe00640 0 client.4791 ms_handle_reset on v2:172.21.15.178:6834/3239224017 2024-04-25T09:01:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d2114c000 1 -- 172.21.15.59:0/162443919 >> 172.21.15.59:0/162443919 conn(0x55e05722a2a0 msgr2=0x55e057275910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d2114c000 1 -- 172.21.15.59:0/162443919 shutdown_connections 2024-04-25T09:01:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d2114c000 1 -- 172.21.15.59:0/162443919 wait complete. 2024-04-25T09:01:59.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d2114c000 20 client.4791 trim_cache size 0 max 16384 2024-04-25T09:01:59.018 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:01:59.018 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:01:59.019 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:01:59.019 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4275, 2024-04-25T09:01:59.019 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:01:59.019 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:01:59.019 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:01:59.019 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 30.251973013000001, 2024-04-25T09:01:59.019 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 9, 2024-04-25T09:01:59.019 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 24, 2024-04-25T09:01:59.019 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 24, 2024-04-25T09:01:59.019 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 37.893058731000004 2024-04-25T09:01:59.019 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:01:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8cf4066f60 msgr2=0x7f8cf4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d1dc00640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8cf4066f60 0x7f8cf4069420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8d00006fd0 tx=0x7f8d00008040 comp rx=0 tx=0).stop 2024-04-25T09:01:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2366377932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d180cd370 msgr2=0x7f8d18155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d1dc00640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d180cd370 0x7f8d18155560 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8d0800b3e0 tx=0x7f8d0800b8a0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2366377932 shutdown_connections 2024-04-25T09:01:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d1dc00640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8cf4066f60 0x7f8cf4069420 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d1dc00640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d1815b910 0x7f8d181644f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d1dc00640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d180cf3c0 0x7f8d1806c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d1dc00640 1 --2- 172.21.15.59:0/2366377932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d180cd370 0x7f8d18155560 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2366377932 >> 172.21.15.59:0/2366377932 conn(0x7f8d180b3200 msgr2=0x7f8d18073920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:59.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2366377932 shutdown_connections 2024-04-25T09:01:59.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.023+0000 7f8d1dc00640 1 -- 172.21.15.59:0/2366377932 wait complete. 2024-04-25T09:01:59.034 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T09:01:59.049 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T09:01:59.049 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-25T09:01:59.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:59.049 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:01:59.059 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T09:01:59.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:59.060 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T09:01:59.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:59.122 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2024-04-25T09:01:59.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:59.300 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:01:59.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:59.310 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2024-04-25T09:01:59.375 INFO:teuthology.orchestra.run.smithi059.stderr:Cannot find device "ceph-brx" 2024-04-25T09:01:59.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:01:59.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:59.377 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-04-25T09:01:59.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:59.388 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2024-04-25T09:01:59.455 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2024-04-25T09:01:59.457 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:01:59.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:59.458 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-04-25T09:01:59.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:59.509 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2024-04-25T09:01:59.575 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2024-04-25T09:01:59.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:01:59.577 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-04-25T09:01:59.577 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:01:59.578 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:01:59.578 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:01:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.727+0000 7f9505c00640 1 Processor -- start 2024-04-25T09:01:59.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.727+0000 7f9505c00640 1 -- start start 2024-04-25T09:01:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.727+0000 7f9505c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f950015ee00 0x7f950006bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.727+0000 7f9505c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95000cff30 0x7f95000d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.727+0000 7f9505c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f950006c650 con 0x7f9500099a60 2024-04-25T09:01:59.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.727+0000 7f9505c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950006c930 con 0x7f950015ee00 2024-04-25T09:01:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.727+0000 7f9505c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950006cc10 con 0x7f95000cff30 2024-04-25T09:01:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.727+0000 7f94fea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9500099a60 0x7f9500099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37730/0 (socket says 172.21.15.59:37730) 2024-04-25T09:01:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.727+0000 7f94f6000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f950015ee00 0x7f950006bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.727+0000 7f94fea00640 1 -- 172.21.15.59:0/3441060670 learned_addr learned my addr 172.21.15.59:0/3441060670 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:01:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f94ff400640 1 --2- 172.21.15.59:0/3441060670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95000cff30 0x7f95000d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f94f6000640 1 -- 172.21.15.59:0/3441060670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95000cff30 msgr2=0x7f95000d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:01:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f94f6000640 1 --2- 172.21.15.59:0/3441060670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95000cff30 0x7f95000d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f94f6000640 1 -- 172.21.15.59:0/3441060670 >> v1:172.21.15.59:6789/0 conn(0x7f9500099a60 legacy=0x7f9500099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f94f6000640 1 -- 172.21.15.59:0/3441060670 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950006cef0 con 0x7f950015ee00 2024-04-25T09:01:59.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f94ff400640 1 --2- 172.21.15.59:0/3441060670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95000cff30 0x7f95000d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:01:59.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f94f6000640 1 --2- 172.21.15.59:0/3441060670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f950015ee00 0x7f950006bd20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f94e80097c0 tx=0x7f94e801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df70f1a1e24f3483 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:59.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f94fe000640 1 -- 172.21.15.59:0/3441060670 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80b0070 con 0x7f950015ee00 2024-04-25T09:01:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f94fe000640 1 -- 172.21.15.59:0/3441060670 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e80ab600 con 0x7f950015ee00 2024-04-25T09:01:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f94fe000640 1 -- 172.21.15.59:0/3441060670 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80ab9d0 con 0x7f950015ee00 2024-04-25T09:01:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f9505c00640 1 -- 172.21.15.59:0/3441060670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f950015ee00 msgr2=0x7f950006bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f9505c00640 1 --2- 172.21.15.59:0/3441060670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f950015ee00 0x7f950006bd20 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f94e80097c0 tx=0x7f94e801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f9505c00640 1 -- 172.21.15.59:0/3441060670 shutdown_connections 2024-04-25T09:01:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f9505c00640 1 --2- 172.21.15.59:0/3441060670 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95000cff30 0x7f95000d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f9505c00640 1 --2- 172.21.15.59:0/3441060670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f950015ee00 0x7f950006bd20 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.731+0000 7f9505c00640 1 -- 172.21.15.59:0/3441060670 >> 172.21.15.59:0/3441060670 conn(0x7f95000d17a0 msgr2=0x7f95000d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f9505c00640 1 -- 172.21.15.59:0/3441060670 shutdown_connections 2024-04-25T09:01:59.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f9505c00640 1 -- 172.21.15.59:0/3441060670 wait complete. 2024-04-25T09:01:59.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f9505c00640 1 Processor -- start 2024-04-25T09:01:59.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f9505c00640 1 -- start start 2024-04-25T09:01:59.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f9505c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9500099a60 0x7f950014b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f9505c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95000cff30 0x7f950014a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f9505c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f950015ee00 0x7f95000cd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f9505c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950016ab80 con 0x7f9500099a60 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f9505c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950016aa00 con 0x7f95000cff30 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f9505c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950016ad00 con 0x7f950015ee00 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94fea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9500099a60 0x7f950014b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94fea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9500099a60 0x7f950014b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:35516/0 (socket says 172.21.15.59:35516) 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94fea00640 1 -- 172.21.15.59:0/2564519447 learned_addr learned my addr 172.21.15.59:0/2564519447 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94f6000640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95000cff30 0x7f950014a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94ff400640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f950015ee00 0x7f95000cd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94fea00640 1 -- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f950015ee00 msgr2=0x7f95000cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94fea00640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f950015ee00 0x7f95000cd2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94fea00640 1 -- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95000cff30 msgr2=0x7f950014a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94fea00640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95000cff30 0x7f950014a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94fea00640 1 -- 172.21.15.59:0/2564519447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950014b790 con 0x7f9500099a60 2024-04-25T09:01:59.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94fea00640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9500099a60 0x7f950014b090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f94f000ca70 tx=0x7f94f000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:59.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94f7400640 1 -- 172.21.15.59:0/2564519447 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0017070 con 0x7f9500099a60 2024-04-25T09:01:59.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94f7400640 1 -- 172.21.15.59:0/2564519447 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f000abd0 con 0x7f9500099a60 2024-04-25T09:01:59.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f94f7400640 1 -- 172.21.15.59:0/2564519447 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0012400 con 0x7f9500099a60 2024-04-25T09:01:59.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f9505c00640 1 -- 172.21.15.59:0/2564519447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9500149730 con 0x7f9500099a60 2024-04-25T09:01:59.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.735+0000 7f9505c00640 1 -- 172.21.15.59:0/2564519447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9500149cf0 con 0x7f9500099a60 2024-04-25T09:01:59.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.739+0000 7f9505c00640 1 -- 172.21.15.59:0/2564519447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95000745d0 con 0x7f9500099a60 2024-04-25T09:01:59.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.739+0000 7f94f7400640 1 -- 172.21.15.59:0/2564519447 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f94f001a070 con 0x7f9500099a60 2024-04-25T09:01:59.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.739+0000 7f94f7400640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f94dc066f60 0x7f94dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:01:59.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.739+0000 7f94f7400640 1 -- 172.21.15.59:0/2564519447 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f94f0085110 con 0x7f9500099a60 2024-04-25T09:01:59.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.739+0000 7f94f6000640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f94dc066f60 0x7f94dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:01:59.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.739+0000 7f94f6000640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f94dc066f60 0x7f94dc069420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f94e80ad000 tx=0x7f94e80a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:01:59.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.743+0000 7f94f7400640 1 -- 172.21.15.59:0/2564519447 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94f0055d40 con 0x7f9500099a60 2024-04-25T09:01:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.939+0000 7f9505c00640 1 -- 172.21.15.59:0/2564519447 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f950009ae10 con 0x7f9500099a60 2024-04-25T09:01:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f94f7400640 1 -- 172.21.15.59:0/2564519447 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f94f0055640 con 0x7f9500099a60 2024-04-25T09:01:59.933 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:01:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f9505c00640 1 -- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f94dc066f60 msgr2=0x7f94dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f9505c00640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f94dc066f60 0x7f94dc069420 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f94e80ad000 tx=0x7f94e80a6000 comp rx=0 tx=0).stop 2024-04-25T09:01:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f9505c00640 1 -- 172.21.15.59:0/2564519447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9500099a60 msgr2=0x7f950014b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:01:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f9505c00640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9500099a60 0x7f950014b090 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f94f000ca70 tx=0x7f94f000cf30 comp rx=0 tx=0).stop 2024-04-25T09:01:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f9505c00640 1 -- 172.21.15.59:0/2564519447 shutdown_connections 2024-04-25T09:01:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f9505c00640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f94dc066f60 0x7f94dc069420 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f9505c00640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f950015ee00 0x7f95000cd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f9505c00640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95000cff30 0x7f950014a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f9505c00640 1 --2- 172.21.15.59:0/2564519447 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9500099a60 0x7f950014b090 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:01:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f9505c00640 1 -- 172.21.15.59:0/2564519447 >> 172.21.15.59:0/2564519447 conn(0x7f95000d17a0 msgr2=0x7f950006f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:01:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f9505c00640 1 -- 172.21.15.59:0/2564519447 shutdown_connections 2024-04-25T09:01:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:01:59.943+0000 7f9505c00640 1 -- 172.21.15.59:0/2564519447 wait complete. 2024-04-25T09:01:59.955 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:01:59.955 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:01:59.955 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:01:59.955 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:01:59.955 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:01:59.955 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:01:59.955 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:01:59.955 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:01:59.956 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:01:59.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:59.956 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:01:59.964 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:01:59.964 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:01:59.965 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42448sec preferred_lft 42448sec 2024-04-25T09:01:59.966 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:01:59.966 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:59.966 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:01:59.966 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:59.966 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:01:59.966 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:01:59.966 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:01:59.966 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:01:59.966 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:01:59.967 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T09:01:59.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:01:59.967 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:01:59.967 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:01:59.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add name ceph-brx type bridge 2024-04-25T09:01:59.967 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr flush dev ceph-brx 2024-04-25T09:01:59.968 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set ceph-brx up 2024-04-25T09:01:59.968 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T09:01:59.968 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:02:00.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:00.077 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:02:00.095 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:02:00.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:00.098 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:02:00.149 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:02:00.149 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:02:00.150 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:02:00.150 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:02:00.150 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:02:00.150 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:02:00.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:00.150 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:02:00.150 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:02:00.150 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:02:00.150 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:02:00.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:02:00.151 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:02:00.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:00.242 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:02:00.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:00.252 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2024-04-25T09:02:00.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:00.301 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:02:00.301 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:02:00.301 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:02:00.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T09:02:00.302 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:02:00.383 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T09:02:00.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:00.384 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:02:00.384 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:02:00.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T09:02:00.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T09:02:00.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T09:02:00.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T09:02:00.384 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T09:02:00.384 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:02:00.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:00.522 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:02:00.522 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:02:00.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:02:00.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T09:02:00.522 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:02:00.563 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:00.563 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:00.622 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:02:00.622 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:00.622 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:00.672 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:02:00.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:00.673 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:02:00.769 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:02:00.770 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:02:00.770 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:02:01.392 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:02:01.392 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:02:01.392 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:02:01.392 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:02:01.392 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:02:01.405 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:02:01.405 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:02:01.405 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:02:01.405 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:02:01.405 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:02:01.405 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:02:01.405 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:02:01.405 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:02:01.409 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:02:01.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:01.409 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:02:01.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:01.429 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:01.485 INFO:teuthology.orchestra.run.smithi059.stdout:client4637 2024-04-25T09:02:01.485 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:02:01.485 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:01.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:01.543 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:01.600 INFO:teuthology.orchestra.run.smithi059.stdout:client4637 2024-04-25T09:02:01.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:01.600 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:01.655 INFO:teuthology.orchestra.run.smithi059.stdout:client4637 2024-04-25T09:02:01.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:01.656 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/fbbb9dc0-22e4-4685-972c-77e9262d4773.client4637/status') 2024-04-25T09:02:01.716 INFO:teuthology.orchestra.run.smithi059.stdout:instance: client.4637 (3)172.21.15.59:0/2546064159 2024-04-25T09:02:01.716 INFO:teuthology.orchestra.run.smithi059.stdout:blocklisted: false 2024-04-25T09:02:01.716 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2024-04-25T09:02:01.716 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2024-04-25T09:02:01.716 INFO:teuthology.orchestra.run.smithi059.stderr:70 bytes copied, 5.2509e-05 s, 1.3 MB/s 2024-04-25T09:02:01.718 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-04-25T09:02:01.718 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:02:01.718 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T09:02:01.718 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:02:01.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.911+0000 7f1d55c00640 1 Processor -- start 2024-04-25T09:02:01.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.911+0000 7f1d55c00640 1 -- start start 2024-04-25T09:02:01.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d55c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d500cef30 0x7f1d5006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d55c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d5015ac60 con 0x7f1d5006e900 2024-04-25T09:02:01.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d55c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d500cf3e0 con 0x7f1d50144140 2024-04-25T09:02:01.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d55c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d5006ed50 con 0x7f1d500cef30 2024-04-25T09:02:01.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d4f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1d5006e900 0x7f1d500b0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55344/0 (socket says 172.21.15.59:55344) 2024-04-25T09:02:01.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d4f400640 1 -- 172.21.15.59:0/3839310256 learned_addr learned my addr 172.21.15.59:0/3839310256 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:01.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d47e00640 1 --2- 172.21.15.59:0/3839310256 >> v2:172.21.15.178:3300/0 conn(0x7f1d500cef30 0x7f1d5006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d4e000640 1 -- 172.21.15.59:0/3839310256 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405115404 0 0) 0x7f1d5015ac60 con 0x7f1d5006e900 2024-04-25T09:02:01.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d4e000640 1 -- 172.21.15.59:0/3839310256 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d34003530 con 0x7f1d5006e900 2024-04-25T09:02:01.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d47e00640 1 -- 172.21.15.59:0/3839310256 >> v1:172.21.15.178:6789/0 conn(0x7f1d50144140 legacy=0x7f1d500ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d4e000640 1 -- 172.21.15.59:0/3839310256 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3790630214 0 0) 0x7f1d34003530 con 0x7f1d5006e900 2024-04-25T09:02:01.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d47e00640 1 -- 172.21.15.59:0/3839310256 >> v1:172.21.15.59:6789/0 conn(0x7f1d5006e900 legacy=0x7f1d500b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.915+0000 7f1d47e00640 1 -- 172.21.15.59:0/3839310256 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5015af20 con 0x7f1d500cef30 2024-04-25T09:02:01.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.919+0000 7f1d47e00640 1 --2- 172.21.15.59:0/3839310256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d500cef30 0x7f1d5006e3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1d380097c0 tx=0x7f1d3801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b663db13d210e29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:01.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.919+0000 7f1d4e000640 1 -- 172.21.15.59:0/3839310256 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d380b0070 con 0x7f1d500cef30 2024-04-25T09:02:01.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.919+0000 7f1d4e000640 1 -- 172.21.15.59:0/3839310256 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d380ab400 con 0x7f1d500cef30 2024-04-25T09:02:01.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.919+0000 7f1d4e000640 1 -- 172.21.15.59:0/3839310256 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48001a00 con 0x7f1d500cef30 2024-04-25T09:02:01.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.919+0000 7f1d55c00640 1 -- 172.21.15.59:0/3839310256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d500cef30 msgr2=0x7f1d5006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.919+0000 7f1d55c00640 1 --2- 172.21.15.59:0/3839310256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d500cef30 0x7f1d5006e3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1d380097c0 tx=0x7f1d3801c3c0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.919+0000 7f1d55c00640 1 -- 172.21.15.59:0/3839310256 shutdown_connections 2024-04-25T09:02:01.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.919+0000 7f1d55c00640 1 --2- 172.21.15.59:0/3839310256 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d500cef30 0x7f1d5006e3c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.919+0000 7f1d55c00640 1 -- 172.21.15.59:0/3839310256 >> 172.21.15.59:0/3839310256 conn(0x7f1d50066fa0 msgr2=0x7f1d5006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:01.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.919+0000 7f1d55c00640 1 -- 172.21.15.59:0/3839310256 shutdown_connections 2024-04-25T09:02:01.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.919+0000 7f1d55c00640 1 -- 172.21.15.59:0/3839310256 wait complete. 2024-04-25T09:02:01.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.919+0000 7f1d55c00640 1 Processor -- start 2024-04-25T09:02:01.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d55c00640 1 -- start start 2024-04-25T09:02:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d55c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d5006e900 0x7f1d5012a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d55c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d500cef30 0x7f1d50164850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d55c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d50144140 0x7f1d500b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d55c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5015ba00 con 0x7f1d50144140 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d55c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d50144520 con 0x7f1d5006e900 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d55c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5015bb80 con 0x7f1d500cef30 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d4f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d50144140 0x7f1d500b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d4f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d50144140 0x7f1d500b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34382/0 (socket says 172.21.15.59:34382) 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d4f400640 1 -- 172.21.15.59:0/3034611279 learned_addr learned my addr 172.21.15.59:0/3034611279 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d4ea00640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d5006e900 0x7f1d5012a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d47e00640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d500cef30 0x7f1d50164850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d4f400640 1 -- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d500cef30 msgr2=0x7f1d50164850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d4f400640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d500cef30 0x7f1d50164850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d4f400640 1 -- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d5006e900 msgr2=0x7f1d5012a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d4f400640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d5006e900 0x7f1d5012a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:01.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d4f400640 1 -- 172.21.15.59:0/3034611279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d5013bca0 con 0x7f1d50144140 2024-04-25T09:02:01.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d4f400640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d50144140 0x7f1d500b41e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1d48001f60 tx=0x7f1d4800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:01.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d46a00640 1 -- 172.21.15.59:0/3034611279 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48012400 con 0x7f1d50144140 2024-04-25T09:02:01.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d46a00640 1 -- 172.21.15.59:0/3034611279 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d480125a0 con 0x7f1d50144140 2024-04-25T09:02:01.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d55c00640 1 -- 172.21.15.59:0/3034611279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d50129430 con 0x7f1d50144140 2024-04-25T09:02:01.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d46a00640 1 -- 172.21.15.59:0/3034611279 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d48012990 con 0x7f1d50144140 2024-04-25T09:02:01.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d55c00640 1 -- 172.21.15.59:0/3034611279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d501299f0 con 0x7f1d50144140 2024-04-25T09:02:01.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.923+0000 7f1d55c00640 1 -- 172.21.15.59:0/3034611279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d500745d0 con 0x7f1d50144140 2024-04-25T09:02:01.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.927+0000 7f1d46a00640 1 -- 172.21.15.59:0/3034611279 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1d48012b30 con 0x7f1d50144140 2024-04-25T09:02:01.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.927+0000 7f1d46a00640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d2c066f60 0x7f1d2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:01.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.927+0000 7f1d46a00640 1 -- 172.21.15.59:0/3034611279 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f1d48085b50 con 0x7f1d50144140 2024-04-25T09:02:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.927+0000 7f1d4ea00640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d2c066f60 0x7f1d2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:01.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.927+0000 7f1d4ea00640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d2c066f60 0x7f1d2c069420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1d40007fd0 tx=0x7f1d40009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:01.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:01.931+0000 7f1d46a00640 1 -- 172.21.15.59:0/3034611279 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1d5013bca0 con 0x7f1d50144140 2024-04-25T09:02:02.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.127+0000 7f1d55c00640 1 -- 172.21.15.59:0/3034611279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1d500ce8c0 con 0x7f1d50144140 2024-04-25T09:02:02.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.127+0000 7f1d46a00640 1 -- 172.21.15.59:0/3034611279 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1d48012e20 con 0x7f1d50144140 2024-04-25T09:02:02.121 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:02:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.131+0000 7f1d55c00640 1 -- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d2c066f60 msgr2=0x7f1d2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.131+0000 7f1d55c00640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d2c066f60 0x7f1d2c069420 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1d40007fd0 tx=0x7f1d40009040 comp rx=0 tx=0).stop 2024-04-25T09:02:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.131+0000 7f1d55c00640 1 -- 172.21.15.59:0/3034611279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d50144140 msgr2=0x7f1d500b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.131+0000 7f1d55c00640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d50144140 0x7f1d500b41e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1d48001f60 tx=0x7f1d4800a430 comp rx=0 tx=0).stop 2024-04-25T09:02:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.131+0000 7f1d55c00640 1 -- 172.21.15.59:0/3034611279 shutdown_connections 2024-04-25T09:02:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.131+0000 7f1d55c00640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d2c066f60 0x7f1d2c069420 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.131+0000 7f1d55c00640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d50144140 0x7f1d500b41e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.131+0000 7f1d55c00640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d500cef30 0x7f1d50164850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.131+0000 7f1d55c00640 1 --2- 172.21.15.59:0/3034611279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d5006e900 0x7f1d5012a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:02.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.131+0000 7f1d55c00640 1 -- 172.21.15.59:0/3034611279 >> 172.21.15.59:0/3034611279 conn(0x7f1d50066fa0 msgr2=0x7f1d5015cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.131+0000 7f1d55c00640 1 -- 172.21.15.59:0/3034611279 shutdown_connections 2024-04-25T09:02:02.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:02.131+0000 7f1d55c00640 1 -- 172.21.15.59:0/3034611279 wait complete. 2024-04-25T09:02:02.141 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:02:02.142 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:02:02.142 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:02:02.142 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-25T09:02:02.142 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-25T09:02:02.142 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:02:02.142 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:02:02.142 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:02:02.142 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-25T09:02:02.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.142 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:02:02.152 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:02:02.152 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:02:02.152 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:02:02.152 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.152 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:02:02.152 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.152 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:02:02.152 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:02.152 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:02:02.152 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:02:02.152 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:02.152 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42445sec preferred_lft 42445sec 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:02:02.153 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.154 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:02:02.154 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:02.154 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:02:02.154 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.154 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:02:02.154 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.154 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:02:02.154 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:02:02.154 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:02:02.154 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.155 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:02:02.215 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:02:02.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.217 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:02:02.274 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:02:02.274 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:02:02.274 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:02:02.274 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:02:02.275 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:02:02.275 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:02:02.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.275 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:02:02.275 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:02:02.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:02:02.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:02:02.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:02:02.275 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:02:02.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.371 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:02:02.380 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:02:02.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.381 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2024-04-25T09:02:02.433 INFO:teuthology.orchestra.run.smithi059.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-25T09:02:02.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.434 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:02:02.434 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:02:02.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:02:02.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-25T09:02:02.434 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:02:02.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.516 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T09:02:02.577 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:02:02.577 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:02:02.577 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:02:02.577 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.577 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:02:02.577 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.577 INFO:teuthology.orchestra.run.smithi059.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:02:02.577 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 3a:1e:b2:0c:be:c2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:02:02.577 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:02:02.577 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.578 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::381e:b2ff:fe0c:bec2/64 scope link 2024-04-25T09:02:02.578 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.579 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-25T09:02:02.641 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:02:02.641 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:02:02.641 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:02:02.641 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.641 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:02:02.641 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.641 INFO:teuthology.orchestra.run.smithi059.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:02:02.641 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 3a:1e:b2:0c:be:c2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:02:02.641 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:02:02.642 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.642 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::381e:b2ff:fe0c:bec2/64 scope link 2024-04-25T09:02:02.642 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:02.643 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-25T09:02:02.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.643 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:02:02.643 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:02:02.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-25T09:02:02.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T09:02:02.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-25T09:02:02.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-25T09:02:02.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-25T09:02:02.644 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:02:02.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.782 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:02:02.782 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:02:02.782 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.1 up 2024-04-25T09:02:02.783 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T09:02:02.783 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:02:02.822 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:02.822 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-25T09:02:02.873 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-25T09:02:02.873 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:02.873 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-25T09:02:02.924 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:02:02.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:02.925 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:02:03.021 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:02:03.021 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T09:02:03.022 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:02:03.037 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:02:03.037 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T09:02:03.037 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:02:03.037 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:02:03.037 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:02:03.047 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-04-25T09:02:03.048 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-04-25T09:02:03.048 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:02:03.048 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:02:03.048 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:02:03.048 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:02:03.048 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:02:03.048 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:02:03.052 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:02:03.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:03.052 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-25T09:02:03.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:03.073 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:03.128 INFO:teuthology.orchestra.run.smithi059.stdout:client4809 2024-04-25T09:02:03.128 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:02:03.128 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:03.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:03.177 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:03.231 INFO:teuthology.orchestra.run.smithi059.stdout:client4809 2024-04-25T09:02:03.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:03.231 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:03.288 INFO:teuthology.orchestra.run.smithi059.stdout:client4809 2024-04-25T09:02:03.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:03.288 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/fbbb9dc0-22e4-4685-972c-77e9262d4773.client4809/status') 2024-04-25T09:02:03.349 INFO:teuthology.orchestra.run.smithi059.stdout:instance: client.4809 (3)192.168.0.2:0/2491482651 2024-04-25T09:02:03.349 INFO:teuthology.orchestra.run.smithi059.stdout:blocklisted: false 2024-04-25T09:02:03.349 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records in 2024-04-25T09:02:03.349 INFO:teuthology.orchestra.run.smithi059.stderr:0+1 records out 2024-04-25T09:02:03.349 INFO:teuthology.orchestra.run.smithi059.stderr:69 bytes copied, 5.6126e-05 s, 1.2 MB/s 2024-04-25T09:02:03.351 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-04-25T09:02:03.351 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:02:03.351 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T09:02:03.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:02:03.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.543+0000 7f4405c00640 1 Processor -- start 2024-04-25T09:02:03.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.543+0000 7f4405c00640 1 -- start start 2024-04-25T09:02:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.543+0000 7f4405c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44000cef30 0x7f440006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.543+0000 7f4405c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f440006e900 0x7f44000b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.543+0000 7f4405c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f440015ac60 con 0x7f4400144140 2024-04-25T09:02:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.543+0000 7f4405c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f440006ed50 con 0x7f44000cef30 2024-04-25T09:02:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.543+0000 7f4405c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44000cf3e0 con 0x7f440006e900 2024-04-25T09:02:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.543+0000 7f43fe000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44000cef30 0x7f440006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.543+0000 7f43fe000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44000cef30 0x7f440006e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34396/0 (socket says 172.21.15.59:34396) 2024-04-25T09:02:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.543+0000 7f43fe000640 1 -- 172.21.15.59:0/2043943019 learned_addr learned my addr 172.21.15.59:0/2043943019 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.543+0000 7f43ff400640 1 --2- 172.21.15.59:0/2043943019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f440006e900 0x7f44000b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.547+0000 7f43fe000640 1 -- 172.21.15.59:0/2043943019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f440006e900 msgr2=0x7f44000b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:03.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.547+0000 7f43fe000640 1 --2- 172.21.15.59:0/2043943019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f440006e900 0x7f44000b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.547+0000 7f43fe000640 1 -- 172.21.15.59:0/2043943019 >> v1:172.21.15.178:6789/0 conn(0x7f4400144140 legacy=0x7f44000ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.547+0000 7f43fe000640 1 -- 172.21.15.59:0/2043943019 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f440015af20 con 0x7f44000cef30 2024-04-25T09:02:03.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.547+0000 7f43fe000640 1 --2- 172.21.15.59:0/2043943019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44000cef30 0x7f440006e3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00bb10 tx=0x7f43ec01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48b73776c67fb5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:03.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.547+0000 7f43fd600640 1 -- 172.21.15.59:0/2043943019 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0b4070 con 0x7f44000cef30 2024-04-25T09:02:03.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.547+0000 7f43fd600640 1 -- 172.21.15.59:0/2043943019 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec0a7820 con 0x7f44000cef30 2024-04-25T09:02:03.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.547+0000 7f43fd600640 1 -- 172.21.15.59:0/2043943019 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0a7bf0 con 0x7f44000cef30 2024-04-25T09:02:03.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.547+0000 7f4405c00640 1 -- 172.21.15.59:0/2043943019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44000cef30 msgr2=0x7f440006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.547+0000 7f4405c00640 1 --2- 172.21.15.59:0/2043943019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44000cef30 0x7f440006e3c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00bb10 tx=0x7f43ec01ec30 comp rx=0 tx=0).stop 2024-04-25T09:02:03.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 -- 172.21.15.59:0/2043943019 shutdown_connections 2024-04-25T09:02:03.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 --2- 172.21.15.59:0/2043943019 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f440006e900 0x7f44000b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 --2- 172.21.15.59:0/2043943019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44000cef30 0x7f440006e3c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 -- 172.21.15.59:0/2043943019 >> 172.21.15.59:0/2043943019 conn(0x7f4400066fa0 msgr2=0x7f440006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:03.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 -- 172.21.15.59:0/2043943019 shutdown_connections 2024-04-25T09:02:03.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 -- 172.21.15.59:0/2043943019 wait complete. 2024-04-25T09:02:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 Processor -- start 2024-04-25T09:02:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 -- start start 2024-04-25T09:02:03.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f440006e900 0x7f4400154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44000cef30 0x7f4400151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4400144140 0x7f44000b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f440015ba00 con 0x7f44000cef30 2024-04-25T09:02:03.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4400144520 con 0x7f4400144140 2024-04-25T09:02:03.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f4405c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f440015bb80 con 0x7f440006e900 2024-04-25T09:02:03.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f43fe000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44000cef30 0x7f4400151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f43fe000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44000cef30 0x7f4400151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34406/0 (socket says 172.21.15.59:34406) 2024-04-25T09:02:03.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f43fe000640 1 -- 172.21.15.59:0/133610415 learned_addr learned my addr 172.21.15.59:0/133610415 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:03.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f43fea00640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f440006e900 0x7f4400154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f43ff400640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4400144140 0x7f44000b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f43fe000640 1 -- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f440006e900 msgr2=0x7f4400154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f43fe000640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f440006e900 0x7f4400154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f43fe000640 1 -- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4400144140 msgr2=0x7f44000b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f43fe000640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4400144140 0x7f44000b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f43fe000640 1 -- 172.21.15.59:0/133610415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4400154cb0 con 0x7f44000cef30 2024-04-25T09:02:03.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f43fe000640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44000cef30 0x7f4400151190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00b2c0 tx=0x7f43ec01b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:03.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.551+0000 7f43f6a00640 1 -- 172.21.15.59:0/133610415 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0b4070 con 0x7f44000cef30 2024-04-25T09:02:03.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.555+0000 7f43f6a00640 1 -- 172.21.15.59:0/133610415 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ec0b6070 con 0x7f44000cef30 2024-04-25T09:02:03.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.555+0000 7f4405c00640 1 -- 172.21.15.59:0/133610415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f440015f380 con 0x7f44000cef30 2024-04-25T09:02:03.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.555+0000 7f43f6a00640 1 -- 172.21.15.59:0/133610415 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ec0afa70 con 0x7f44000cef30 2024-04-25T09:02:03.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.555+0000 7f4405c00640 1 -- 172.21.15.59:0/133610415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f440015f940 con 0x7f44000cef30 2024-04-25T09:02:03.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.555+0000 7f4405c00640 1 -- 172.21.15.59:0/133610415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44000745d0 con 0x7f44000cef30 2024-04-25T09:02:03.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.555+0000 7f43f6a00640 1 -- 172.21.15.59:0/133610415 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f43ec0afc10 con 0x7f44000cef30 2024-04-25T09:02:03.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.555+0000 7f43f6a00640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f43e0066f60 0x7f43e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:03.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.555+0000 7f43f6a00640 1 -- 172.21.15.59:0/133610415 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f43ec11f370 con 0x7f44000cef30 2024-04-25T09:02:03.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.555+0000 7f43fea00640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f43e0066f60 0x7f43e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:03.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.559+0000 7f43fea00640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f43e0066f60 0x7f43e0069420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f43f0001770 tx=0x7f43f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:03.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.559+0000 7f43f6a00640 1 -- 172.21.15.59:0/133610415 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f43ec018820 con 0x7f44000cef30 2024-04-25T09:02:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 -- 172.21.15.59:0/133610415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f440006d950 con 0x7f44000cef30 2024-04-25T09:02:03.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f43f6a00640 1 -- 172.21.15.59:0/133610415 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f43ec0ef9d0 con 0x7f44000cef30 2024-04-25T09:02:03.758 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:02:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 -- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f43e0066f60 msgr2=0x7f43e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f43e0066f60 0x7f43e0069420 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f43f0001770 tx=0x7f43f0009040 comp rx=0 tx=0).stop 2024-04-25T09:02:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 -- 172.21.15.59:0/133610415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44000cef30 msgr2=0x7f4400151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44000cef30 0x7f4400151190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f43ec00b2c0 tx=0x7f43ec01b9d0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 -- 172.21.15.59:0/133610415 shutdown_connections 2024-04-25T09:02:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f43e0066f60 0x7f43e0069420 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4400144140 0x7f44000b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44000cef30 0x7f4400151190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 --2- 172.21.15.59:0/133610415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f440006e900 0x7f4400154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:03.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 -- 172.21.15.59:0/133610415 >> 172.21.15.59:0/133610415 conn(0x7f4400066fa0 msgr2=0x7f440015bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:03.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 -- 172.21.15.59:0/133610415 shutdown_connections 2024-04-25T09:02:03.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:03.767+0000 7f4405c00640 1 -- 172.21.15.59:0/133610415 wait complete. 2024-04-25T09:02:03.780 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:02:03.780 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:02:03.780 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi178.front.sepia.ceph.com 2024-04-25T09:02:03.780 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T09:02:03.780 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T09:02:03.780 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:02:03.780 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:02:03.780 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:02:03.780 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T09:02:03.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:03.781 DEBUG:teuthology.orchestra.run.smithi178:> ip addr 2024-04-25T09:02:03.791 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:02:03.791 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:02:03.791 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:02:03.791 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:03.791 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2024-04-25T09:02:03.791 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:03.791 INFO:teuthology.orchestra.run.smithi178.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:02:03.791 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:20 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:03.791 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f0 2024-04-25T09:02:03.791 INFO:teuthology.orchestra.run.smithi178.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:02:03.791 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:21 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f1 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f8 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f9 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.21.15.178/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft 42456sec preferred_lft 42456sec 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::ec4:7aff:fe88:7ef9/64 scope link 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 02:42:67:13:5e:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:02:03.792 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:03.793 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T09:02:03.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:03.793 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-04-25T09:02:03.794 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-04-25T09:02:03.794 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add name ceph-brx type bridge 2024-04-25T09:02:03.794 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip addr flush dev ceph-brx 2024-04-25T09:02:03.794 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set ceph-brx up 2024-04-25T09:02:03.794 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T09:02:03.794 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-04-25T09:02:03.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:03.910 DEBUG:teuthology.orchestra.run.smithi178:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:02:03.930 INFO:teuthology.orchestra.run.smithi178.stdout:1 2024-04-25T09:02:03.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:03.932 DEBUG:teuthology.orchestra.run.smithi178:> route 2024-04-25T09:02:04.001 INFO:teuthology.orchestra.run.smithi178.stdout:Kernel IP routing table 2024-04-25T09:02:04.001 INFO:teuthology.orchestra.run.smithi178.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:02:04.001 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:02:04.001 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:02:04.001 INFO:teuthology.orchestra.run.smithi178.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:02:04.001 INFO:teuthology.orchestra.run.smithi178.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:02:04.001 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:02:04.001 INFO:teuthology.orchestra.run.smithi178.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:02:04.001 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:02:04.002 INFO:teuthology.orchestra.run.smithi178.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:02:04.002 INFO:teuthology.orchestra.run.smithi178.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:02:04.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:04.002 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-04-25T09:02:04.002 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-04-25T09:02:04.002 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:02:04.002 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:02:04.002 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:02:04.002 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-04-25T09:02:04.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:04.092 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-04-25T09:02:04.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:04.101 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list-id 2024-04-25T09:02:04.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:04.151 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-04-25T09:02:04.151 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-04-25T09:02:04.151 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:02:04.151 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T09:02:04.151 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-04-25T09:02:04.237 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T09:02:04.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:04.238 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-04-25T09:02:04.238 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-04-25T09:02:04.238 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T09:02:04.238 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T09:02:04.238 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T09:02:04.238 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T09:02:04.238 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T09:02:04.238 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-04-25T09:02:04.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:04.397 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-04-25T09:02:04.397 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-04-25T09:02:04.398 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set brx.0 up 2024-04-25T09:02:04.398 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T09:02:04.398 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-04-25T09:02:04.437 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:04.437 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T09:02:04.491 INFO:teuthology.orchestra.run.smithi178.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T09:02:04.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:04.492 DEBUG:teuthology.orchestra.run.smithi178:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T09:02:04.546 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:02:04.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:04.547 DEBUG:teuthology.orchestra.run.smithi178:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:02:04.634 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:02:04.634 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T09:02:04.635 INFO:teuthology.orchestra.run.smithi178.stdout:invalid new device string format 2024-04-25T09:02:05.295 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:02:05.295 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T09:02:05.295 INFO:teuthology.orchestra.run.smithi178.stdout:invalid new device string format 2024-04-25T09:02:05.295 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:02:05.295 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:02:05.307 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-04-25T09:02:05.307 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-04-25T09:02:05.307 INFO:teuthology.orchestra.run.smithi178.stdout:invalid new device string format 2024-04-25T09:02:05.307 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:02:05.307 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:02:05.307 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:02:05.307 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:02:05.307 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:02:05.311 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:02:05.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:05.311 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T09:02:05.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:05.330 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:05.388 INFO:teuthology.orchestra.run.smithi178.stdout:client4649 2024-04-25T09:02:05.389 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:02:05.389 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:05.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:05.439 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:05.493 INFO:teuthology.orchestra.run.smithi178.stdout:client4649 2024-04-25T09:02:05.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:05.494 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:05.545 INFO:teuthology.orchestra.run.smithi178.stdout:client4649 2024-04-25T09:02:05.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:05.546 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/fbbb9dc0-22e4-4685-972c-77e9262d4773.client4649/status') 2024-04-25T09:02:05.606 INFO:teuthology.orchestra.run.smithi178.stdout:instance: client.4649 (3)192.168.0.1:0/4066777826 2024-04-25T09:02:05.606 INFO:teuthology.orchestra.run.smithi178.stdout:blocklisted: false 2024-04-25T09:02:05.607 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records in 2024-04-25T09:02:05.607 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records out 2024-04-25T09:02:05.607 INFO:teuthology.orchestra.run.smithi178.stderr:69 bytes copied, 4.9978e-05 s, 1.4 MB/s 2024-04-25T09:02:05.608 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-04-25T09:02:05.608 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T09:02:05.608 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T09:02:05.609 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:02:05.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93e8c00640 1 Processor -- start 2024-04-25T09:02:05.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93e8c00640 1 -- start start 2024-04-25T09:02:05.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93e8c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e415fe50 0x7f93e40b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93e8c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e40cc4e0 con 0x7f93e4145270 2024-04-25T09:02:05.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93e8c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e40ce040 con 0x7f93e40b1c90 2024-04-25T09:02:05.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93e8c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40b20e0 con 0x7f93e415fe50 2024-04-25T09:02:05.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93e1e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f93e4145270 0x7f93e40cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55346/0 (socket says 172.21.15.59:55346) 2024-04-25T09:02:05.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93e1e00640 1 -- 172.21.15.59:0/2230990617 learned_addr learned my addr 172.21.15.59:0/2230990617 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:05.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93dbe00640 1 --2- 172.21.15.59:0/2230990617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e415fe50 0x7f93e40b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93e1400640 1 -- 172.21.15.59:0/2230990617 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914676818 0 0) 0x7f93e40cc4e0 con 0x7f93e4145270 2024-04-25T09:02:05.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93e1400640 1 -- 172.21.15.59:0/2230990617 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93c8003530 con 0x7f93e4145270 2024-04-25T09:02:05.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93e1400640 1 -- 172.21.15.59:0/2230990617 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 406498212 0 0) 0x7f93e40ce040 con 0x7f93e40b1c90 2024-04-25T09:02:05.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93e1400640 1 -- 172.21.15.59:0/2230990617 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93e40cc4e0 con 0x7f93e40b1c90 2024-04-25T09:02:05.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93dbe00640 1 -- 172.21.15.59:0/2230990617 >> v1:172.21.15.178:6789/0 conn(0x7f93e40b1c90 legacy=0x7f93e415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93dbe00640 1 -- 172.21.15.59:0/2230990617 >> v1:172.21.15.59:6789/0 conn(0x7f93e4145270 legacy=0x7f93e40cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.771+0000 7f93dbe00640 1 -- 172.21.15.59:0/2230990617 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e40ce320 con 0x7f93e415fe50 2024-04-25T09:02:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.775+0000 7f93dbe00640 1 --2- 172.21.15.59:0/2230990617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e415fe50 0x7f93e40b1750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0097f0 tx=0x7f93cc01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=938e03d75306c5b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.775+0000 7f93e1400640 1 -- 172.21.15.59:0/2230990617 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0b0070 con 0x7f93e415fe50 2024-04-25T09:02:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.775+0000 7f93e1400640 1 -- 172.21.15.59:0/2230990617 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc0ab600 con 0x7f93e415fe50 2024-04-25T09:02:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.775+0000 7f93e1400640 1 -- 172.21.15.59:0/2230990617 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0ab9b0 con 0x7f93e415fe50 2024-04-25T09:02:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.775+0000 7f93e8c00640 1 -- 172.21.15.59:0/2230990617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e415fe50 msgr2=0x7f93e40b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.775+0000 7f93e8c00640 1 --2- 172.21.15.59:0/2230990617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e415fe50 0x7f93e40b1750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0097f0 tx=0x7f93cc01c4e0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.775+0000 7f93e8c00640 1 -- 172.21.15.59:0/2230990617 shutdown_connections 2024-04-25T09:02:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.775+0000 7f93e8c00640 1 --2- 172.21.15.59:0/2230990617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e415fe50 0x7f93e40b1750 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.775+0000 7f93e8c00640 1 -- 172.21.15.59:0/2230990617 >> 172.21.15.59:0/2230990617 conn(0x7f93e4066fa0 msgr2=0x7f93e406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.775+0000 7f93e8c00640 1 -- 172.21.15.59:0/2230990617 shutdown_connections 2024-04-25T09:02:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.775+0000 7f93e8c00640 1 -- 172.21.15.59:0/2230990617 wait complete. 2024-04-25T09:02:05.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e8c00640 1 Processor -- start 2024-04-25T09:02:05.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e8c00640 1 -- start start 2024-04-25T09:02:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e8c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e40b1c90 0x7f93e40cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93e4145270 0x7f93e41461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e8c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e415fe50 0x7f93e4143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e8c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40cdd60 con 0x7f93e4145270 2024-04-25T09:02:05.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e8c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e40cdbe0 con 0x7f93e40b1c90 2024-04-25T09:02:05.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e8c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e4169720 con 0x7f93e415fe50 2024-04-25T09:02:05.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93dbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93e4145270 0x7f93e41461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93dbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93e4145270 0x7f93e41461f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34408/0 (socket says 172.21.15.59:34408) 2024-04-25T09:02:05.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93dbe00640 1 -- 172.21.15.59:0/1467039970 learned_addr learned my addr 172.21.15.59:0/1467039970 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:05.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e2800640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e415fe50 0x7f93e4143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e1e00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e40b1c90 0x7f93e40cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93dbe00640 1 -- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e415fe50 msgr2=0x7f93e4143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93dbe00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e415fe50 0x7f93e4143ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93dbe00640 1 -- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e40b1c90 msgr2=0x7f93e40cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93dbe00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e40b1c90 0x7f93e40cbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93dbe00640 1 -- 172.21.15.59:0/1467039970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e4142a10 con 0x7f93e4145270 2024-04-25T09:02:05.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e2800640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e415fe50 0x7f93e4143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:05.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e1e00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e40b1c90 0x7f93e40cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:05.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93dbe00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93e4145270 0x7f93e41461f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0190f0 tx=0x7f93cc019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93da000640 1 -- 172.21.15.59:0/1467039970 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0b9070 con 0x7f93e4145270 2024-04-25T09:02:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93da000640 1 -- 172.21.15.59:0/1467039970 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc0ab7b0 con 0x7f93e4145270 2024-04-25T09:02:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93da000640 1 -- 172.21.15.59:0/1467039970 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc0b0040 con 0x7f93e4145270 2024-04-25T09:02:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e8c00640 1 -- 172.21.15.59:0/1467039970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e4142cf0 con 0x7f93e4145270 2024-04-25T09:02:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.779+0000 7f93e8c00640 1 -- 172.21.15.59:0/1467039970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e41432b0 con 0x7f93e4145270 2024-04-25T09:02:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.783+0000 7f93e8c00640 1 -- 172.21.15.59:0/1467039970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e40745d0 con 0x7f93e4145270 2024-04-25T09:02:05.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.783+0000 7f93da000640 1 -- 172.21.15.59:0/1467039970 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f93cc0abb60 con 0x7f93e4145270 2024-04-25T09:02:05.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.783+0000 7f93da000640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f93c0066f60 0x7f93c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:05.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.783+0000 7f93da000640 1 -- 172.21.15.59:0/1467039970 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f93cc11e370 con 0x7f93e4145270 2024-04-25T09:02:05.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.783+0000 7f93e1e00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f93c0066f60 0x7f93c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:05.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.783+0000 7f93e1e00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f93c0066f60 0x7f93c0069420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f93d4000f70 tx=0x7f93d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:05.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.787+0000 7f93da000640 1 -- 172.21.15.59:0/1467039970 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f93cc0160d0 con 0x7f93e4145270 2024-04-25T09:02:05.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 -- 172.21.15.59:0/1467039970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f93e40b1a70 con 0x7f93e4145270 2024-04-25T09:02:05.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93da000640 1 -- 172.21.15.59:0/1467039970 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f93cc0eefa0 con 0x7f93e4145270 2024-04-25T09:02:05.978 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T09:02:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 -- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f93c0066f60 msgr2=0x7f93c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f93c0066f60 0x7f93c0069420 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f93d4000f70 tx=0x7f93d4009040 comp rx=0 tx=0).stop 2024-04-25T09:02:05.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 -- 172.21.15.59:0/1467039970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93e4145270 msgr2=0x7f93e41461f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93e4145270 0x7f93e41461f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f93cc0190f0 tx=0x7f93cc019280 comp rx=0 tx=0).stop 2024-04-25T09:02:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 -- 172.21.15.59:0/1467039970 shutdown_connections 2024-04-25T09:02:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f93c0066f60 0x7f93c0069420 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93e415fe50 0x7f93e4143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93e4145270 0x7f93e41461f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 --2- 172.21.15.59:0/1467039970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f93e40b1c90 0x7f93e40cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 -- 172.21.15.59:0/1467039970 >> 172.21.15.59:0/1467039970 conn(0x7f93e4066fa0 msgr2=0x7f93e415cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 -- 172.21.15.59:0/1467039970 shutdown_connections 2024-04-25T09:02:05.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:05.987+0000 7f93e8c00640 1 -- 172.21.15.59:0/1467039970 wait complete. 2024-04-25T09:02:06.000 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T09:02:06.000 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:02:06.000 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi178.front.sepia.ceph.com 2024-04-25T09:02:06.000 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-25T09:02:06.000 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-25T09:02:06.000 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T09:02:06.000 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T09:02:06.000 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:02:06.000 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-25T09:02:06.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.001 DEBUG:teuthology.orchestra.run.smithi178:> ip addr 2024-04-25T09:02:06.010 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:02:06.010 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:02:06.010 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:02:06.010 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.010 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2024-04-25T09:02:06.010 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.010 INFO:teuthology.orchestra.run.smithi178.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:20 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f0 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:d9:3b:21 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout: altname enp7s0f1 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f8 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0c:c4:7a:88:7e:f9 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.21.15.178/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft 42454sec preferred_lft 42454sec 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::ec4:7aff:fe88:7ef9/64 scope link 2024-04-25T09:02:06.011 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 02:42:67:13:5e:07 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-04-25T09:02:06.012 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.013 DEBUG:teuthology.orchestra.run.smithi178:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:02:06.073 INFO:teuthology.orchestra.run.smithi178.stdout:1 2024-04-25T09:02:06.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.076 DEBUG:teuthology.orchestra.run.smithi178:> route 2024-04-25T09:02:06.134 INFO:teuthology.orchestra.run.smithi178.stdout:Kernel IP routing table 2024-04-25T09:02:06.134 INFO:teuthology.orchestra.run.smithi178.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:02:06.134 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T09:02:06.134 INFO:teuthology.orchestra.run.smithi178.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T09:02:06.134 INFO:teuthology.orchestra.run.smithi178.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T09:02:06.134 INFO:teuthology.orchestra.run.smithi178.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:02:06.134 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T09:02:06.135 INFO:teuthology.orchestra.run.smithi178.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:02:06.135 INFO:teuthology.orchestra.run.smithi178.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:02:06.135 INFO:teuthology.orchestra.run.smithi178.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T09:02:06.135 INFO:teuthology.orchestra.run.smithi178.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:02:06.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.135 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-04-25T09:02:06.135 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-04-25T09:02:06.135 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T09:02:06.135 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T09:02:06.135 DEBUG:teuthology.orchestra.run.smithi178:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T09:02:06.135 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-04-25T09:02:06.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.224 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-04-25T09:02:06.275 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T09:02:06.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.276 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list-id 2024-04-25T09:02:06.326 INFO:teuthology.orchestra.run.smithi178.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-25T09:02:06.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.327 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-04-25T09:02:06.327 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-04-25T09:02:06.327 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T09:02:06.328 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-25T09:02:06.328 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-04-25T09:02:06.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.409 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T09:02:06.471 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:02:06.471 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:02:06.471 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:02:06.471 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.471 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2024-04-25T09:02:06.471 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.471 INFO:teuthology.orchestra.run.smithi178.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:02:06.471 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 7a:6f:db:1a:a8:79 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:02:06.471 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:02:06.471 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.471 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::786f:dbff:fe1a:a879/64 scope link 2024-04-25T09:02:06.471 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.473 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-25T09:02:06.534 INFO:teuthology.orchestra.run.smithi178.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:02:06.534 INFO:teuthology.orchestra.run.smithi178.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:02:06.534 INFO:teuthology.orchestra.run.smithi178.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:02:06.534 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.534 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 ::1/128 scope host 2024-04-25T09:02:06.534 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.535 INFO:teuthology.orchestra.run.smithi178.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:02:06.535 INFO:teuthology.orchestra.run.smithi178.stdout: link/ether 7a:6f:db:1a:a8:79 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-25T09:02:06.535 INFO:teuthology.orchestra.run.smithi178.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-25T09:02:06.535 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.535 INFO:teuthology.orchestra.run.smithi178.stdout: inet6 fe80::786f:dbff:fe1a:a879/64 scope link 2024-04-25T09:02:06.535 INFO:teuthology.orchestra.run.smithi178.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:02:06.536 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-25T09:02:06.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.536 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-04-25T09:02:06.536 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-04-25T09:02:06.536 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-25T09:02:06.537 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-25T09:02:06.537 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-25T09:02:06.537 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-25T09:02:06.537 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-25T09:02:06.537 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-04-25T09:02:06.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.670 DEBUG:teuthology.orchestra.run.smithi178:> (cd / && exec bash -c ' 2024-04-25T09:02:06.670 DEBUG:teuthology.orchestra.run.smithi178:> set -e 2024-04-25T09:02:06.670 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set brx.1 up 2024-04-25T09:02:06.670 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link set dev brx.1 master ceph-brx 2024-04-25T09:02:06.670 DEBUG:teuthology.orchestra.run.smithi178:> ') 2024-04-25T09:02:06.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:06.708 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-25T09:02:06.759 INFO:teuthology.orchestra.run.smithi178.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-25T09:02:06.759 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:02:06.759 DEBUG:teuthology.orchestra.run.smithi178:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-25T09:02:06.810 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:02:06.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.810 DEBUG:teuthology.orchestra.run.smithi178:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:02:06.899 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:02:06.899 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T09:02:06.899 INFO:teuthology.orchestra.run.smithi178.stdout:invalid new device string format 2024-04-25T09:02:06.914 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:02:06.914 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T09:02:06.914 INFO:teuthology.orchestra.run.smithi178.stdout:invalid new device string format 2024-04-25T09:02:06.914 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:02:06.914 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:02:06.923 INFO:teuthology.orchestra.run.smithi178.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-04-25T09:02:06.923 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-04-25T09:02:06.923 INFO:teuthology.orchestra.run.smithi178.stdout:invalid new device string format 2024-04-25T09:02:06.923 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:02:06.923 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:02:06.924 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:02:06.924 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:02:06.924 INFO:teuthology.orchestra.run.smithi178.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:02:06.927 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:02:06.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.927 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-25T09:02:06.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:06.946 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:06.997 INFO:teuthology.orchestra.run.smithi178.stdout:client4824 2024-04-25T09:02:06.998 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:02:06.998 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:07.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:07.047 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:07.101 INFO:teuthology.orchestra.run.smithi178.stdout:client4824 2024-04-25T09:02:07.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:07.102 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:02:07.153 INFO:teuthology.orchestra.run.smithi178.stdout:client4824 2024-04-25T09:02:07.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:07.154 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/fbbb9dc0-22e4-4685-972c-77e9262d4773.client4824/status') 2024-04-25T09:02:07.214 INFO:teuthology.orchestra.run.smithi178.stdout:instance: client.4824 (3)172.21.15.178:0/1255459916 2024-04-25T09:02:07.214 INFO:teuthology.orchestra.run.smithi178.stdout:blocklisted: false 2024-04-25T09:02:07.214 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records in 2024-04-25T09:02:07.214 INFO:teuthology.orchestra.run.smithi178.stderr:0+1 records out 2024-04-25T09:02:07.214 INFO:teuthology.orchestra.run.smithi178.stderr:71 bytes copied, 5.012e-05 s, 1.4 MB/s 2024-04-25T09:02:07.216 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-25T09:02:07.232 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.391+0000 7f5558400640 1 Processor -- start 2024-04-25T09:02:07.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.391+0000 7f5558400640 1 -- start start 2024-04-25T09:02:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f5558400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5550099a60 0x7f5550099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:07.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f5558400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555009a380 con 0x7f555015ee00 2024-04-25T09:02:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f5558400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f555006c650 con 0x7f55500cff30 2024-04-25T09:02:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f5558400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555006c430 con 0x7f5550099a60 2024-04-25T09:02:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f5555000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f555015ee00 0x7f555006bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55362/0 (socket says 172.21.15.59:55362) 2024-04-25T09:02:07.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f5555000640 1 -- 172.21.15.59:0/2166525628 learned_addr learned my addr 172.21.15.59:0/2166525628 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f5555a00640 1 --2- 172.21.15.59:0/2166525628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5550099a60 0x7f5550099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f554fe00640 1 -- 172.21.15.59:0/2166525628 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 685316553 0 0) 0x7f555009a380 con 0x7f555015ee00 2024-04-25T09:02:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f554fe00640 1 -- 172.21.15.59:0/2166525628 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5538003530 con 0x7f555015ee00 2024-04-25T09:02:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f5555a00640 1 -- 172.21.15.59:0/2166525628 >> v1:172.21.15.178:6789/0 conn(0x7f55500cff30 legacy=0x7f55500d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f554fe00640 1 -- 172.21.15.59:0/2166525628 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502768653 0 0) 0x7f555006c650 con 0x7f55500cff30 2024-04-25T09:02:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f5555a00640 1 -- 172.21.15.59:0/2166525628 >> v1:172.21.15.59:6789/0 conn(0x7f555015ee00 legacy=0x7f555006bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.395+0000 7f5555a00640 1 -- 172.21.15.59:0/2166525628 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f555006c930 con 0x7f5550099a60 2024-04-25T09:02:07.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f5555a00640 1 --2- 172.21.15.59:0/2166525628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5550099a60 0x7f5550099e40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f55440097f0 tx=0x7f554401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=887e79b8acdaf062 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f554fe00640 1 -- 172.21.15.59:0/2166525628 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440b0070 con 0x7f5550099a60 2024-04-25T09:02:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f554fe00640 1 -- 172.21.15.59:0/2166525628 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55440ab600 con 0x7f5550099a60 2024-04-25T09:02:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f554fe00640 1 -- 172.21.15.59:0/2166525628 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440ab9d0 con 0x7f5550099a60 2024-04-25T09:02:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f5558400640 1 -- 172.21.15.59:0/2166525628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5550099a60 msgr2=0x7f5550099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f5558400640 1 --2- 172.21.15.59:0/2166525628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5550099a60 0x7f5550099e40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f55440097f0 tx=0x7f554401c4e0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f5558400640 1 -- 172.21.15.59:0/2166525628 shutdown_connections 2024-04-25T09:02:07.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f5558400640 1 --2- 172.21.15.59:0/2166525628 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5550099a60 0x7f5550099e40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f5558400640 1 -- 172.21.15.59:0/2166525628 >> 172.21.15.59:0/2166525628 conn(0x7f55500d17a0 msgr2=0x7f55500d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:07.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f5558400640 1 -- 172.21.15.59:0/2166525628 shutdown_connections 2024-04-25T09:02:07.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f5558400640 1 -- 172.21.15.59:0/2166525628 wait complete. 2024-04-25T09:02:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f5558400640 1 Processor -- start 2024-04-25T09:02:07.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.399+0000 7f5558400640 1 -- start start 2024-04-25T09:02:07.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5558400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5550099a60 0x7f55500b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:07.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5558400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55500cff30 0x7f555014bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:07.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5558400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555015ee00 0x7f55500b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:07.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5558400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555015e000 con 0x7f555015ee00 2024-04-25T09:02:07.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5558400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555015de80 con 0x7f5550099a60 2024-04-25T09:02:07.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5558400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555016ba10 con 0x7f55500cff30 2024-04-25T09:02:07.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5556400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555015ee00 0x7f55500b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:07.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5556400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555015ee00 0x7f55500b6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34420/0 (socket says 172.21.15.59:34420) 2024-04-25T09:02:07.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5556400640 1 -- 172.21.15.59:0/892540579 learned_addr learned my addr 172.21.15.59:0/892540579 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:07.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5555a00640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5550099a60 0x7f55500b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:07.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5555000640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55500cff30 0x7f555014bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:07.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5556400640 1 -- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55500cff30 msgr2=0x7f555014bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5556400640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55500cff30 0x7f555014bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5556400640 1 -- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5550099a60 msgr2=0x7f55500b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5556400640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5550099a60 0x7f55500b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5556400640 1 -- 172.21.15.59:0/892540579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55500b73e0 con 0x7f555015ee00 2024-04-25T09:02:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5556400640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555015ee00 0x7f55500b6b90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f554800c780 tx=0x7f554800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f554d600640 1 -- 172.21.15.59:0/892540579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548003db0 con 0x7f555015ee00 2024-04-25T09:02:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f554d600640 1 -- 172.21.15.59:0/892540579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554800ce30 con 0x7f555015ee00 2024-04-25T09:02:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f554d600640 1 -- 172.21.15.59:0/892540579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548005290 con 0x7f555015ee00 2024-04-25T09:02:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5558400640 1 -- 172.21.15.59:0/892540579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5550156dd0 con 0x7f555015ee00 2024-04-25T09:02:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5558400640 1 -- 172.21.15.59:0/892540579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5550157390 con 0x7f555015ee00 2024-04-25T09:02:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f5558400640 1 -- 172.21.15.59:0/892540579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55500745d0 con 0x7f555015ee00 2024-04-25T09:02:07.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.403+0000 7f554d600640 1 -- 172.21.15.59:0/892540579 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5548005430 con 0x7f555015ee00 2024-04-25T09:02:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.407+0000 7f554d600640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5530066f60 0x7f5530069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:07.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.407+0000 7f554d600640 1 -- 172.21.15.59:0/892540579 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f55480851b0 con 0x7f555015ee00 2024-04-25T09:02:07.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.407+0000 7f5555a00640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5530066f60 0x7f5530069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:07.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.407+0000 7f5555a00640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5530066f60 0x7f5530069420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f55440ad000 tx=0x7f55440a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:07.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.411+0000 7f554d600640 1 -- 172.21.15.59:0/892540579 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5548055790 con 0x7f555015ee00 2024-04-25T09:02:07.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.575+0000 7f5558400640 1 -- 172.21.15.59:0/892540579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55500d1500 con 0x7f555015ee00 2024-04-25T09:02:07.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.575+0000 7f554d600640 1 -- 172.21.15.59:0/892540579 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18514 (secure 0 0 0) 0x7f5548059830 con 0x7f555015ee00 2024-04-25T09:02:07.567 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:07.567 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":24,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:01:33.216654+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.579+0000 7f5558400640 1 -- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5530066f60 msgr2=0x7f5530069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.579+0000 7f5558400640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5530066f60 0x7f5530069420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f55440ad000 tx=0x7f55440a6000 comp rx=0 tx=0).stop 2024-04-25T09:02:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.579+0000 7f5558400640 1 -- 172.21.15.59:0/892540579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555015ee00 msgr2=0x7f55500b6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.579+0000 7f5558400640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555015ee00 0x7f55500b6b90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f554800c780 tx=0x7f554800cc40 comp rx=0 tx=0).stop 2024-04-25T09:02:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.579+0000 7f5558400640 1 -- 172.21.15.59:0/892540579 shutdown_connections 2024-04-25T09:02:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.579+0000 7f5558400640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5530066f60 0x7f5530069420 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.579+0000 7f5558400640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f555015ee00 0x7f55500b6b90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.579+0000 7f5558400640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55500cff30 0x7f555014bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.579+0000 7f5558400640 1 --2- 172.21.15.59:0/892540579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5550099a60 0x7f55500b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.579+0000 7f5558400640 1 -- 172.21.15.59:0/892540579 >> 172.21.15.59:0/892540579 conn(0x7f55500d17a0 msgr2=0x7f55500d1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:07.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.579+0000 7f5558400640 1 -- 172.21.15.59:0/892540579 shutdown_connections 2024-04-25T09:02:07.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.579+0000 7f5558400640 1 -- 172.21.15.59:0/892540579 wait complete. 2024-04-25T09:02:07.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:02:07.590 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:07.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.743+0000 7f05a4800640 1 Processor -- start 2024-04-25T09:02:07.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.743+0000 7f05a4800640 1 -- start start 2024-04-25T09:02:07.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.747+0000 7f05a4800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f059c159320 0x7f059c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:07.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.747+0000 7f05a4800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c15fc00 con 0x7f059c15f440 2024-04-25T09:02:07.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.747+0000 7f05a4800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c15fee0 con 0x7f059c06e4a0 2024-04-25T09:02:07.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.747+0000 7f05a4800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c06d640 con 0x7f059c159320 2024-04-25T09:02:07.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.747+0000 7f05a1e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f059c159320 0x7f059c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:07.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.747+0000 7f05a1e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f059c159320 0x7f059c15c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34428/0 (socket says 172.21.15.59:34428) 2024-04-25T09:02:07.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.747+0000 7f05a1400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f059c15f440 0x7f059c06dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55366/0 (socket says 172.21.15.59:55366) 2024-04-25T09:02:07.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.747+0000 7f05a1e00640 1 -- 172.21.15.59:0/3395008050 learned_addr learned my addr 172.21.15.59:0/3395008050 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:07.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.747+0000 7f05a1e00640 1 -- 172.21.15.59:0/3395008050 >> v1:172.21.15.178:6789/0 conn(0x7f059c06e4a0 legacy=0x7f059c071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:07.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.747+0000 7f05a0a00640 1 -- 172.21.15.59:0/3395008050 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539751230 0 0) 0x7f059c15fc00 con 0x7f059c15f440 2024-04-25T09:02:07.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.747+0000 7f05a1e00640 1 -- 172.21.15.59:0/3395008050 >> v1:172.21.15.59:6789/0 conn(0x7f059c15f440 legacy=0x7f059c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.747+0000 7f05a1e00640 1 -- 172.21.15.59:0/3395008050 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c1601c0 con 0x7f059c159320 2024-04-25T09:02:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a1e00640 1 --2- 172.21.15.59:0/3395008050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f059c159320 0x7f059c15c9b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f059c06d7c0 tx=0x7f059001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d2817d851e5a8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a0a00640 1 -- 172.21.15.59:0/3395008050 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05900ab620 con 0x7f059c159320 2024-04-25T09:02:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a0a00640 1 -- 172.21.15.59:0/3395008050 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05900b0070 con 0x7f059c159320 2024-04-25T09:02:07.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a0a00640 1 -- 172.21.15.59:0/3395008050 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05900ab9e0 con 0x7f059c159320 2024-04-25T09:02:07.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 -- 172.21.15.59:0/3395008050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f059c159320 msgr2=0x7f059c15c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 --2- 172.21.15.59:0/3395008050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f059c159320 0x7f059c15c9b0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f059c06d7c0 tx=0x7f059001c480 comp rx=0 tx=0).stop 2024-04-25T09:02:07.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 -- 172.21.15.59:0/3395008050 shutdown_connections 2024-04-25T09:02:07.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 --2- 172.21.15.59:0/3395008050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f059c159320 0x7f059c15c9b0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 -- 172.21.15.59:0/3395008050 >> 172.21.15.59:0/3395008050 conn(0x7f059c067080 msgr2=0x7f059c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:07.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 -- 172.21.15.59:0/3395008050 shutdown_connections 2024-04-25T09:02:07.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 -- 172.21.15.59:0/3395008050 wait complete. 2024-04-25T09:02:07.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 Processor -- start 2024-04-25T09:02:07.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 -- start start 2024-04-25T09:02:07.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f059c06e4a0 0x7f059c139c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:07.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f059c159320 0x7f059c151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:07.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f059c15f440 0x7f059c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:07.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c15f9e0 con 0x7f059c15f440 2024-04-25T09:02:07.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c15f860 con 0x7f059c159320 2024-04-25T09:02:07.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a4800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c071980 con 0x7f059c06e4a0 2024-04-25T09:02:07.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f059c15f440 0x7f059c1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:07.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f059c15f440 0x7f059c1517d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34444/0 (socket says 172.21.15.59:34444) 2024-04-25T09:02:07.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a2800640 1 -- 172.21.15.59:0/2974901212 learned_addr learned my addr 172.21.15.59:0/2974901212 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:07.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a1e00640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f059c06e4a0 0x7f059c139c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:07.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.751+0000 7f05a1400640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f059c159320 0x7f059c151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:07.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f05a2800640 1 -- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f059c06e4a0 msgr2=0x7f059c139c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f05a2800640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f059c06e4a0 0x7f059c139c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f05a2800640 1 -- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f059c159320 msgr2=0x7f059c151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f05a2800640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f059c159320 0x7f059c151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f05a2800640 1 -- 172.21.15.59:0/2974901212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c14efe0 con 0x7f059c15f440 2024-04-25T09:02:07.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f05a2800640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f059c15f440 0x7f059c1517d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f059800c770 tx=0x7f059800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:07.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f0596000640 1 -- 172.21.15.59:0/2974901212 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0598003b80 con 0x7f059c15f440 2024-04-25T09:02:07.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f0596000640 1 -- 172.21.15.59:0/2974901212 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0598003d20 con 0x7f059c15f440 2024-04-25T09:02:07.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f0596000640 1 -- 172.21.15.59:0/2974901212 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059800aa90 con 0x7f059c15f440 2024-04-25T09:02:07.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f05a4800640 1 -- 172.21.15.59:0/2974901212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c14f2c0 con 0x7f059c15f440 2024-04-25T09:02:07.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f05a4800640 1 -- 172.21.15.59:0/2974901212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c14f880 con 0x7f059c15f440 2024-04-25T09:02:07.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f05a4800640 1 -- 172.21.15.59:0/2974901212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c14fa80 con 0x7f059c15f440 2024-04-25T09:02:07.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f0596000640 1 -- 172.21.15.59:0/2974901212 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f059800ac30 con 0x7f059c15f440 2024-04-25T09:02:07.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f0596000640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0580066f60 0x7f0580069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:07.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f0596000640 1 -- 172.21.15.59:0/2974901212 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6532+0+0 (secure 0 0 0) 0x7f0598085200 con 0x7f059c15f440 2024-04-25T09:02:07.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.755+0000 7f05a1e00640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0580066f60 0x7f0580069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:07.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.759+0000 7f05a1e00640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0580066f60 0x7f0580069420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05900af000 tx=0x7f05900a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:07.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.759+0000 7f0596000640 1 -- 172.21.15.59:0/2974901212 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f059c14fa80 con 0x7f059c15f440 2024-04-25T09:02:07.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 -- 172.21.15.59:0/2974901212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f059c0745d0 con 0x7f059c15f440 2024-04-25T09:02:07.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f0596000640 1 -- 172.21.15.59:0/2974901212 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05980557e0 con 0x7f059c15f440 2024-04-25T09:02:07.914 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:02:07.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 -- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0580066f60 msgr2=0x7f0580069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0580066f60 0x7f0580069420 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05900af000 tx=0x7f05900a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 -- 172.21.15.59:0/2974901212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f059c15f440 msgr2=0x7f059c1517d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f059c15f440 0x7f059c1517d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f059800c770 tx=0x7f059800cc30 comp rx=0 tx=0).stop 2024-04-25T09:02:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 -- 172.21.15.59:0/2974901212 shutdown_connections 2024-04-25T09:02:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0580066f60 0x7f0580069420 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f059c15f440 0x7f059c1517d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f059c159320 0x7f059c151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 --2- 172.21.15.59:0/2974901212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f059c06e4a0 0x7f059c139c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 -- 172.21.15.59:0/2974901212 >> 172.21.15.59:0/2974901212 conn(0x7f059c067080 msgr2=0x7f059c15e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 -- 172.21.15.59:0/2974901212 shutdown_connections 2024-04-25T09:02:07.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:07.923+0000 7f05a4800640 1 -- 172.21.15.59:0/2974901212 wait complete. 2024-04-25T09:02:07.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:08.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e7d400640 1 Processor -- start 2024-04-25T09:02:08.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e7d400640 1 -- start start 2024-04-25T09:02:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e7d400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e7815c9b0 0x7f3e7806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e7d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e7806e010 0x7f3e7806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e7d400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7815fc00 con 0x7f3e78159320 2024-04-25T09:02:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e7d400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7806d640 con 0x7f3e7806e010 2024-04-25T09:02:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e7d400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7815fee0 con 0x7f3e7815c9b0 2024-04-25T09:02:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e77200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e7806e010 0x7f3e7806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e76800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3e78159320 0x7f3e7815f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55370/0 (socket says 172.21.15.59:55370) 2024-04-25T09:02:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e76800640 1 -- 172.21.15.59:0/982569314 learned_addr learned my addr 172.21.15.59:0/982569314 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e77200640 1 --2- 172.21.15.59:0/982569314 >> v2:172.21.15.59:3300/0 conn(0x7f3e7806e010 0x7f3e7806e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34456/0 (socket says 172.21.15.59:34456) 2024-04-25T09:02:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e6de00640 1 --2- 172.21.15.59:0/982569314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e7815c9b0 0x7f3e7806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e77200640 1 -- 172.21.15.59:0/982569314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e7815c9b0 msgr2=0x7f3e7806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e77200640 1 --2- 172.21.15.59:0/982569314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e7815c9b0 0x7f3e7806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e77200640 1 -- 172.21.15.59:0/982569314 >> v1:172.21.15.59:6789/0 conn(0x7f3e78159320 legacy=0x7f3e7815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e77200640 1 -- 172.21.15.59:0/982569314 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e781601c0 con 0x7f3e7806e010 2024-04-25T09:02:08.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.095+0000 7f3e6de00640 1 --2- 172.21.15.59:0/982569314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e7815c9b0 0x7f3e7806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:08.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.099+0000 7f3e77200640 1 --2- 172.21.15.59:0/982569314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7806e010 0x7f3e7806e4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009d90 tx=0x7f3e7001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05ff72af73ae37a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.099+0000 7f3e75e00640 1 -- 172.21.15.59:0/982569314 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e700b2070 con 0x7f3e7806e010 2024-04-25T09:02:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.099+0000 7f3e75e00640 1 -- 172.21.15.59:0/982569314 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e700a5830 con 0x7f3e7806e010 2024-04-25T09:02:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.099+0000 7f3e75e00640 1 -- 172.21.15.59:0/982569314 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e700a5c00 con 0x7f3e7806e010 2024-04-25T09:02:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.099+0000 7f3e7d400640 1 -- 172.21.15.59:0/982569314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7806e010 msgr2=0x7f3e7806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.099+0000 7f3e7d400640 1 --2- 172.21.15.59:0/982569314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7806e010 0x7f3e7806e4a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009d90 tx=0x7f3e7001c970 comp rx=0 tx=0).stop 2024-04-25T09:02:08.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.099+0000 7f3e7d400640 1 -- 172.21.15.59:0/982569314 shutdown_connections 2024-04-25T09:02:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.099+0000 7f3e7d400640 1 --2- 172.21.15.59:0/982569314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7806e010 0x7f3e7806e4a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.099+0000 7f3e7d400640 1 --2- 172.21.15.59:0/982569314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e7815c9b0 0x7f3e7806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.099+0000 7f3e7d400640 1 -- 172.21.15.59:0/982569314 >> 172.21.15.59:0/982569314 conn(0x7f3e78067080 msgr2=0x7f3e7806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.099+0000 7f3e7d400640 1 -- 172.21.15.59:0/982569314 shutdown_connections 2024-04-25T09:02:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.099+0000 7f3e7d400640 1 -- 172.21.15.59:0/982569314 wait complete. 2024-04-25T09:02:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e7d400640 1 Processor -- start 2024-04-25T09:02:08.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e7d400640 1 -- start start 2024-04-25T09:02:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e7d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7806e010 0x7f3e7813d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e7d400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e78159320 0x7f3e7813fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e7d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e7815c9b0 0x7f3e78164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e7d400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78168920 con 0x7f3e7806e010 2024-04-25T09:02:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e7d400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e781687a0 con 0x7f3e7815c9b0 2024-04-25T09:02:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e7d400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e78168aa0 con 0x7f3e78159320 2024-04-25T09:02:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e76800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7806e010 0x7f3e7813d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e76800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7806e010 0x7f3e7813d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34464/0 (socket says 172.21.15.59:34464) 2024-04-25T09:02:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e76800640 1 -- 172.21.15.59:0/1229889935 learned_addr learned my addr 172.21.15.59:0/1229889935 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:08.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e6de00640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e78159320 0x7f3e7813fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e77200640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e7815c9b0 0x7f3e78164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e76800640 1 -- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e78159320 msgr2=0x7f3e7813fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e76800640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e78159320 0x7f3e7813fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e76800640 1 -- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e7815c9b0 msgr2=0x7f3e78164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e76800640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e7815c9b0 0x7f3e78164f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e76800640 1 -- 172.21.15.59:0/1229889935 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e780b31e0 con 0x7f3e7806e010 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e77200640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e7815c9b0 0x7f3e78164f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e76800640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7806e010 0x7f3e7813d9a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c420 tx=0x7f3e6800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e6f400640 1 -- 172.21.15.59:0/1229889935 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e68017070 con 0x7f3e7806e010 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e6f400640 1 -- 172.21.15.59:0/1229889935 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e68005cf0 con 0x7f3e7806e010 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e6f400640 1 -- 172.21.15.59:0/1229889935 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e680072f0 con 0x7f3e7806e010 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e7d400640 1 -- 172.21.15.59:0/1229889935 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e780b34c0 con 0x7f3e7806e010 2024-04-25T09:02:08.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.103+0000 7f3e7d400640 1 -- 172.21.15.59:0/1229889935 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e780b3a80 con 0x7f3e7806e010 2024-04-25T09:02:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.107+0000 7f3e7d400640 1 -- 172.21.15.59:0/1229889935 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e780745d0 con 0x7f3e7806e010 2024-04-25T09:02:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.107+0000 7f3e6f400640 1 -- 172.21.15.59:0/1229889935 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3e6801a070 con 0x7f3e7806e010 2024-04-25T09:02:08.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.107+0000 7f3e6f400640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3e54066f90 0x7f3e54069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.107+0000 7f3e6f400640 1 -- 172.21.15.59:0/1229889935 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f3e680847f0 con 0x7f3e7806e010 2024-04-25T09:02:08.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.107+0000 7f3e6de00640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3e54066f90 0x7f3e54069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.107+0000 7f3e6de00640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3e54066f90 0x7f3e54069450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3e60006fd0 tx=0x7f3e60008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.111+0000 7f3e6f400640 1 -- 172.21.15.59:0/1229889935 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3e680553b0 con 0x7f3e7806e010 2024-04-25T09:02:08.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.271+0000 7f3e7d400640 1 -- 172.21.15.59:0/1229889935 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e7815b510 con 0x7f3e7806e010 2024-04-25T09:02:08.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.271+0000 7f3e6f400640 1 -- 172.21.15.59:0/1229889935 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e68054cb0 con 0x7f3e7806e010 2024-04-25T09:02:08.265 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.275+0000 7f3e7d400640 1 -- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3e54066f90 msgr2=0x7f3e54069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.275+0000 7f3e7d400640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3e54066f90 0x7f3e54069450 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3e60006fd0 tx=0x7f3e60008040 comp rx=0 tx=0).stop 2024-04-25T09:02:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.275+0000 7f3e7d400640 1 -- 172.21.15.59:0/1229889935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7806e010 msgr2=0x7f3e7813d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.275+0000 7f3e7d400640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7806e010 0x7f3e7813d9a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3e6800c420 tx=0x7f3e6800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.275+0000 7f3e7d400640 1 -- 172.21.15.59:0/1229889935 shutdown_connections 2024-04-25T09:02:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.275+0000 7f3e7d400640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3e54066f90 0x7f3e54069450 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.275+0000 7f3e7d400640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e7815c9b0 0x7f3e78164f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.275+0000 7f3e7d400640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e78159320 0x7f3e7813fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.275+0000 7f3e7d400640 1 --2- 172.21.15.59:0/1229889935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e7806e010 0x7f3e7813d9a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.275+0000 7f3e7d400640 1 -- 172.21.15.59:0/1229889935 >> 172.21.15.59:0/1229889935 conn(0x7f3e78067080 msgr2=0x7f3e780cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:08.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.275+0000 7f3e7d400640 1 -- 172.21.15.59:0/1229889935 shutdown_connections 2024-04-25T09:02:08.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.275+0000 7f3e7d400640 1 -- 172.21.15.59:0/1229889935 wait complete. 2024-04-25T09:02:08.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:08.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b29a00640 1 Processor -- start 2024-04-25T09:02:08.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b29a00640 1 -- start start 2024-04-25T09:02:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b29a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b24159320 0x7f1b2415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b29a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b2415f440 0x7f1b2406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b29a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b2406e010 0x7f1b2406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b29a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2406d640 con 0x7f1b2406e010 2024-04-25T09:02:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b29a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2415fc00 con 0x7f1b24159320 2024-04-25T09:02:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b29a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2415fee0 con 0x7f1b2415f440 2024-04-25T09:02:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b23400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b2406e010 0x7f1b2406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b23400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1b2406e010 0x7f1b2406e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34468/0 (socket says 172.21.15.59:34468) 2024-04-25T09:02:08.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b23400640 1 -- 172.21.15.59:0/175639817 learned_addr learned my addr 172.21.15.59:0/175639817 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:08.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b1be00640 1 --2- 172.21.15.59:0/175639817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b2415f440 0x7f1b2406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b22a00640 1 --2- 172.21.15.59:0/175639817 >> v2:172.21.15.178:3300/0 conn(0x7f1b24159320 0x7f1b2415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b23400640 1 -- 172.21.15.59:0/175639817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b2415f440 msgr2=0x7f1b2406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:08.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b23400640 1 --2- 172.21.15.59:0/175639817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b2415f440 0x7f1b2406dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b23400640 1 -- 172.21.15.59:0/175639817 >> v2:172.21.15.178:3300/0 conn(0x7f1b24159320 msgr2=0x7f1b2415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:08.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b23400640 1 --2- 172.21.15.59:0/175639817 >> v2:172.21.15.178:3300/0 conn(0x7f1b24159320 0x7f1b2415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b23400640 1 -- 172.21.15.59:0/175639817 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b241601c0 con 0x7f1b2406e010 2024-04-25T09:02:08.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.439+0000 7f1b1be00640 1 --2- 172.21.15.59:0/175639817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b2415f440 0x7f1b2406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:08.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b23400640 1 --2- 172.21.15.59:0/175639817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b2406e010 0x7f1b2406e4a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1b2406e470 tx=0x7f1b1c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab8bf3f2347e5a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b22000640 1 -- 172.21.15.59:0/175639817 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0a56c0 con 0x7f1b2406e010 2024-04-25T09:02:08.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b22000640 1 -- 172.21.15.59:0/175639817 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c0a5860 con 0x7f1b2406e010 2024-04-25T09:02:08.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b22000640 1 -- 172.21.15.59:0/175639817 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0a5c30 con 0x7f1b2406e010 2024-04-25T09:02:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b29a00640 1 -- 172.21.15.59:0/175639817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b2406e010 msgr2=0x7f1b2406e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b29a00640 1 --2- 172.21.15.59:0/175639817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b2406e010 0x7f1b2406e4a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1b2406e470 tx=0x7f1b1c01c930 comp rx=0 tx=0).stop 2024-04-25T09:02:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b29a00640 1 -- 172.21.15.59:0/175639817 shutdown_connections 2024-04-25T09:02:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b29a00640 1 --2- 172.21.15.59:0/175639817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b2406e010 0x7f1b2406e4a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b29a00640 1 --2- 172.21.15.59:0/175639817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b2415f440 0x7f1b2406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b29a00640 1 --2- 172.21.15.59:0/175639817 >> v2:172.21.15.178:3300/0 conn(0x7f1b24159320 0x7f1b2415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b29a00640 1 -- 172.21.15.59:0/175639817 >> 172.21.15.59:0/175639817 conn(0x7f1b24067080 msgr2=0x7f1b2406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b29a00640 1 -- 172.21.15.59:0/175639817 shutdown_connections 2024-04-25T09:02:08.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b29a00640 1 -- 172.21.15.59:0/175639817 wait complete. 2024-04-25T09:02:08.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b29a00640 1 Processor -- start 2024-04-25T09:02:08.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.443+0000 7f1b29a00640 1 -- start start 2024-04-25T09:02:08.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b29a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b2406e010 0x7f1b24165370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b29a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b24159320 0x7f1b2415ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b29a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b2415f440 0x7f1b2415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b29a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240cc440 con 0x7f1b24159320 2024-04-25T09:02:08.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b29a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240cc2c0 con 0x7f1b2406e010 2024-04-25T09:02:08.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b29a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240cc5c0 con 0x7f1b2415f440 2024-04-25T09:02:08.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b24159320 0x7f1b2415ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b24159320 0x7f1b2415ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34474/0 (socket says 172.21.15.59:34474) 2024-04-25T09:02:08.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1be00640 1 -- 172.21.15.59:0/2058381241 learned_addr learned my addr 172.21.15.59:0/2058381241 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:08.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b23400640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b2415f440 0x7f1b2415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b22a00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b2406e010 0x7f1b24165370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1be00640 1 -- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b2415f440 msgr2=0x7f1b2415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1be00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b2415f440 0x7f1b2415b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1be00640 1 -- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b2406e010 msgr2=0x7f1b24165370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1be00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b2406e010 0x7f1b24165370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1be00640 1 -- 172.21.15.59:0/2058381241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2415aa40 con 0x7f1b24159320 2024-04-25T09:02:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b22a00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b2406e010 0x7f1b24165370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1be00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b24159320 0x7f1b2415ad70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00d830 tx=0x7f1b0c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1aa00640 1 -- 172.21.15.59:0/2058381241 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c018020 con 0x7f1b24159320 2024-04-25T09:02:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1aa00640 1 -- 172.21.15.59:0/2058381241 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0c0096c0 con 0x7f1b24159320 2024-04-25T09:02:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1aa00640 1 -- 172.21.15.59:0/2058381241 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0c009ab0 con 0x7f1b24159320 2024-04-25T09:02:08.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b29a00640 1 -- 172.21.15.59:0/2058381241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b24165a00 con 0x7f1b24159320 2024-04-25T09:02:08.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b29a00640 1 -- 172.21.15.59:0/2058381241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b24165fc0 con 0x7f1b24159320 2024-04-25T09:02:08.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b29a00640 1 -- 172.21.15.59:0/2058381241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b240745d0 con 0x7f1b24159320 2024-04-25T09:02:08.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.447+0000 7f1b1aa00640 1 -- 172.21.15.59:0/2058381241 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1b0c01b020 con 0x7f1b24159320 2024-04-25T09:02:08.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.451+0000 7f1b1aa00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1b00066f60 0x7f1b00069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.451+0000 7f1b1aa00640 1 -- 172.21.15.59:0/2058381241 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f1b0c085ad0 con 0x7f1b24159320 2024-04-25T09:02:08.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.451+0000 7f1b22a00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1b00066f60 0x7f1b00069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.451+0000 7f1b22a00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1b00066f60 0x7f1b00069420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b14004660 tx=0x7f1b14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.455+0000 7f1b1aa00640 1 -- 172.21.15.59:0/2058381241 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1b0c022020 con 0x7f1b24159320 2024-04-25T09:02:08.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 -- 172.21.15.59:0/2058381241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1b2413a760 con 0x7f1b24159320 2024-04-25T09:02:08.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b1aa00640 1 -- 172.21.15.59:0/2058381241 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1b0c056690 con 0x7f1b24159320 2024-04-25T09:02:08.610 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:02:08.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 -- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1b00066f60 msgr2=0x7f1b00069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1b00066f60 0x7f1b00069420 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1b14004660 tx=0x7f1b14008040 comp rx=0 tx=0).stop 2024-04-25T09:02:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 -- 172.21.15.59:0/2058381241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b24159320 msgr2=0x7f1b2415ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b24159320 0x7f1b2415ad70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c00d830 tx=0x7f1b0c00dcf0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 -- 172.21.15.59:0/2058381241 shutdown_connections 2024-04-25T09:02:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1b00066f60 0x7f1b00069420 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b2415f440 0x7f1b2415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b24159320 0x7f1b2415ad70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 --2- 172.21.15.59:0/2058381241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b2406e010 0x7f1b24165370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 -- 172.21.15.59:0/2058381241 >> 172.21.15.59:0/2058381241 conn(0x7f1b24067080 msgr2=0x7f1b2406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 -- 172.21.15.59:0/2058381241 shutdown_connections 2024-04-25T09:02:08.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.619+0000 7f1b29a00640 1 -- 172.21.15.59:0/2058381241 wait complete. 2024-04-25T09:02:08.632 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:02:08.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.783+0000 7f5c9e600640 1 Processor -- start 2024-04-25T09:02:08.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.783+0000 7f5c9e600640 1 -- start start 2024-04-25T09:02:08.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9e600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c98144e20 0x7f5c9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9e600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c980b0e60 0x7f5c9815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9e600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c980b30f0 con 0x7f5c9806d900 2024-04-25T09:02:08.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9e600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c980b33d0 con 0x7f5c98144e20 2024-04-25T09:02:08.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9e600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c980b36b0 con 0x7f5c980b0e60 2024-04-25T09:02:08.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9d200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c98144e20 0x7f5c9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9d200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5c98144e20 0x7f5c9806d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:48502/0 (socket says 172.21.15.59:48502) 2024-04-25T09:02:08.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9dc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c980b0e60 0x7f5c9815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9d200640 1 -- 172.21.15.59:0/2630414902 learned_addr learned my addr 172.21.15.59:0/2630414902 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:08.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c8fe00640 1 --1- 172.21.15.59:0/2630414902 >> v1:172.21.15.178:6789/0 conn(0x7f5c9806d900 0x7f5c980b0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:58020/0 (socket says 172.21.15.59:58020) 2024-04-25T09:02:08.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c97e00640 1 -- 172.21.15.59:0/2630414902 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844282586 0 0) 0x7f5c980b30f0 con 0x7f5c9806d900 2024-04-25T09:02:08.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c97e00640 1 -- 172.21.15.59:0/2630414902 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c7c003530 con 0x7f5c9806d900 2024-04-25T09:02:08.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9dc00640 1 -- 172.21.15.59:0/2630414902 >> v2:172.21.15.178:3300/0 conn(0x7f5c98144e20 msgr2=0x7f5c9806d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:08.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9dc00640 1 --2- 172.21.15.59:0/2630414902 >> v2:172.21.15.178:3300/0 conn(0x7f5c98144e20 0x7f5c9806d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9dc00640 1 -- 172.21.15.59:0/2630414902 >> v1:172.21.15.178:6789/0 conn(0x7f5c9806d900 legacy=0x7f5c980b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9dc00640 1 -- 172.21.15.59:0/2630414902 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c980b3990 con 0x7f5c980b0e60 2024-04-25T09:02:08.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.787+0000 7f5c9d200640 1 --2- 172.21.15.59:0/2630414902 >> v2:172.21.15.178:3300/0 conn(0x7f5c98144e20 0x7f5c9806d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:08.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.791+0000 7f5c9dc00640 1 --2- 172.21.15.59:0/2630414902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c980b0e60 0x7f5c9815bdb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009d90 tx=0x7f5c9001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18c8271e95e04563 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.791+0000 7f5c97e00640 1 -- 172.21.15.59:0/2630414902 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c900b2070 con 0x7f5c980b0e60 2024-04-25T09:02:08.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.791+0000 7f5c97e00640 1 -- 172.21.15.59:0/2630414902 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c900a5910 con 0x7f5c980b0e60 2024-04-25T09:02:08.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.791+0000 7f5c97e00640 1 -- 172.21.15.59:0/2630414902 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c900a5ce0 con 0x7f5c980b0e60 2024-04-25T09:02:08.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.791+0000 7f5c9e600640 1 -- 172.21.15.59:0/2630414902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c980b0e60 msgr2=0x7f5c9815bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.791+0000 7f5c9e600640 1 --2- 172.21.15.59:0/2630414902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c980b0e60 0x7f5c9815bdb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5c90009d90 tx=0x7f5c9001c940 comp rx=0 tx=0).stop 2024-04-25T09:02:08.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.791+0000 7f5c9e600640 1 -- 172.21.15.59:0/2630414902 shutdown_connections 2024-04-25T09:02:08.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.791+0000 7f5c9e600640 1 --2- 172.21.15.59:0/2630414902 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c980b0e60 0x7f5c9815bdb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.791+0000 7f5c9e600640 1 --2- 172.21.15.59:0/2630414902 >> v2:172.21.15.178:3300/0 conn(0x7f5c98144e20 0x7f5c9806d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.791+0000 7f5c9e600640 1 -- 172.21.15.59:0/2630414902 >> 172.21.15.59:0/2630414902 conn(0x7f5c98066fa0 msgr2=0x7f5c9806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:08.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.791+0000 7f5c9e600640 1 -- 172.21.15.59:0/2630414902 shutdown_connections 2024-04-25T09:02:08.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.791+0000 7f5c9e600640 1 -- 172.21.15.59:0/2630414902 wait complete. 2024-04-25T09:02:08.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c9e600640 1 Processor -- start 2024-04-25T09:02:08.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c9e600640 1 -- start start 2024-04-25T09:02:08.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c9e600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c9806d900 0x7f5c9813c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c9e600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c980b0e60 0x7f5c9815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c9e600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c98144e20 0x7f5c9815e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c9e600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c98168370 con 0x7f5c980b0e60 2024-04-25T09:02:08.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c9e600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c98145410 con 0x7f5c9806d900 2024-04-25T09:02:08.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c9e600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c981684f0 con 0x7f5c98144e20 2024-04-25T09:02:08.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c8fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c980b0e60 0x7f5c9815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c9d200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c9806d900 0x7f5c9813c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c8fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c980b0e60 0x7f5c9815dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34486/0 (socket says 172.21.15.59:34486) 2024-04-25T09:02:08.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c8fe00640 1 -- 172.21.15.59:0/133285801 learned_addr learned my addr 172.21.15.59:0/133285801 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:08.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c9dc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c98144e20 0x7f5c9815e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c8fe00640 1 -- 172.21.15.59:0/133285801 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c98144e20 msgr2=0x7f5c9815e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c8fe00640 1 --2- 172.21.15.59:0/133285801 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c98144e20 0x7f5c9815e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c8fe00640 1 -- 172.21.15.59:0/133285801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c9806d900 msgr2=0x7f5c9813c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c8fe00640 1 --2- 172.21.15.59:0/133285801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c9806d900 0x7f5c9813c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c8fe00640 1 -- 172.21.15.59:0/133285801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c980ce320 con 0x7f5c980b0e60 2024-04-25T09:02:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c8fe00640 1 --2- 172.21.15.59:0/133285801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c980b0e60 0x7f5c9815dff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000c460 tx=0x7f5c8000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c95600640 1 -- 172.21.15.59:0/133285801 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c80018070 con 0x7f5c980b0e60 2024-04-25T09:02:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c95600640 1 -- 172.21.15.59:0/133285801 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c800074a0 con 0x7f5c980b0e60 2024-04-25T09:02:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c9e600640 1 -- 172.21.15.59:0/133285801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c980ce600 con 0x7f5c980b0e60 2024-04-25T09:02:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c95600640 1 -- 172.21.15.59:0/133285801 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c80004a30 con 0x7f5c980b0e60 2024-04-25T09:02:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.795+0000 7f5c9e600640 1 -- 172.21.15.59:0/133285801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c980ce8e0 con 0x7f5c980b0e60 2024-04-25T09:02:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.799+0000 7f5c9e600640 1 -- 172.21.15.59:0/133285801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c980745d0 con 0x7f5c980b0e60 2024-04-25T09:02:08.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.799+0000 7f5c95600640 1 -- 172.21.15.59:0/133285801 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5c8001b070 con 0x7f5c980b0e60 2024-04-25T09:02:08.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.799+0000 7f5c95600640 1 --2- 172.21.15.59:0/133285801 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5c74066f90 0x7f5c74069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:08.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.799+0000 7f5c95600640 1 -- 172.21.15.59:0/133285801 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f5c80084630 con 0x7f5c980b0e60 2024-04-25T09:02:08.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.799+0000 7f5c9d200640 1 --2- 172.21.15.59:0/133285801 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5c74066f90 0x7f5c74069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:08.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.799+0000 7f5c9d200640 1 --2- 172.21.15.59:0/133285801 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5c74066f90 0x7f5c74069450 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5c88006cb0 tx=0x7f5c88009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:08.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.803+0000 7f5c95600640 1 -- 172.21.15.59:0/133285801 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5c80054b90 con 0x7f5c980b0e60 2024-04-25T09:02:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.975+0000 7f5c9e600640 1 -- 172.21.15.59:0/133285801 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5c980b1e50 con 0x7f5c980b0e60 2024-04-25T09:02:08.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.975+0000 7f5c95600640 1 -- 172.21.15.59:0/133285801 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5c80058c30 con 0x7f5c980b0e60 2024-04-25T09:02:08.967 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.979+0000 7f5c9e600640 1 -- 172.21.15.59:0/133285801 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5c74066f90 msgr2=0x7f5c74069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.979+0000 7f5c9e600640 1 --2- 172.21.15.59:0/133285801 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5c74066f90 0x7f5c74069450 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f5c88006cb0 tx=0x7f5c88009240 comp rx=0 tx=0).stop 2024-04-25T09:02:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.979+0000 7f5c9e600640 1 -- 172.21.15.59:0/133285801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c980b0e60 msgr2=0x7f5c9815dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:08.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.979+0000 7f5c9e600640 1 --2- 172.21.15.59:0/133285801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c980b0e60 0x7f5c9815dff0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000c460 tx=0x7f5c8000c920 comp rx=0 tx=0).stop 2024-04-25T09:02:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.979+0000 7f5c9e600640 1 -- 172.21.15.59:0/133285801 shutdown_connections 2024-04-25T09:02:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.979+0000 7f5c9e600640 1 --2- 172.21.15.59:0/133285801 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5c74066f90 0x7f5c74069450 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.979+0000 7f5c9e600640 1 --2- 172.21.15.59:0/133285801 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5c98144e20 0x7f5c9815e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.979+0000 7f5c9e600640 1 --2- 172.21.15.59:0/133285801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c980b0e60 0x7f5c9815dff0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.979+0000 7f5c9e600640 1 --2- 172.21.15.59:0/133285801 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5c9806d900 0x7f5c9813c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.979+0000 7f5c9e600640 1 -- 172.21.15.59:0/133285801 >> 172.21.15.59:0/133285801 conn(0x7f5c98066fa0 msgr2=0x7f5c9815ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.979+0000 7f5c9e600640 1 -- 172.21.15.59:0/133285801 shutdown_connections 2024-04-25T09:02:08.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:08.979+0000 7f5c9e600640 1 -- 172.21.15.59:0/133285801 wait complete. 2024-04-25T09:02:08.989 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f038aa00640 1 Processor -- start 2024-04-25T09:02:09.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f038aa00640 1 -- start start 2024-04-25T09:02:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f038aa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03840cef30 0x7f038406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f038aa00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f038406e900 0x7f03840b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f038aa00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f038415ac60 con 0x7f0384144140 2024-04-25T09:02:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f038aa00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f038406ed30 con 0x7f038406e900 2024-04-25T09:02:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f038aa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03840cf3e0 con 0x7f03840cef30 2024-04-25T09:02:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f0388a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f038406e900 0x7f03840b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f037be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03840cef30 0x7f038406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f037be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03840cef30 0x7f038406e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:45696/0 (socket says 172.21.15.59:45696) 2024-04-25T09:02:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f0388a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f038406e900 0x7f03840b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:48522/0 (socket says 172.21.15.59:48522) 2024-04-25T09:02:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f037be00640 1 -- 172.21.15.59:0/477545744 learned_addr learned my addr 172.21.15.59:0/477545744 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f0383e00640 1 --1- 172.21.15.59:0/477545744 >> v1:172.21.15.178:6789/0 conn(0x7f0384144140 0x7f03840ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:58024/0 (socket says 172.21.15.59:58024) 2024-04-25T09:02:09.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f037be00640 1 -- 172.21.15.59:0/477545744 >> v2:172.21.15.178:3300/0 conn(0x7f038406e900 msgr2=0x7f03840b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f037be00640 1 --2- 172.21.15.59:0/477545744 >> v2:172.21.15.178:3300/0 conn(0x7f038406e900 0x7f03840b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f037be00640 1 -- 172.21.15.59:0/477545744 >> v1:172.21.15.178:6789/0 conn(0x7f0384144140 legacy=0x7f03840ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f037be00640 1 -- 172.21.15.59:0/477545744 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038415af20 con 0x7f03840cef30 2024-04-25T09:02:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f0383400640 1 -- 172.21.15.59:0/477545744 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026393167 0 0) 0x7f038415ac60 con 0x7f0384144140 2024-04-25T09:02:09.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.139+0000 7f0388a00640 1 --2- 172.21.15.59:0/477545744 >> v2:172.21.15.178:3300/0 conn(0x7f038406e900 0x7f03840b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.143+0000 7f037be00640 1 --2- 172.21.15.59:0/477545744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03840cef30 0x7f038406e3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f036c009870 tx=0x7f036c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ba9e76a308924c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f0383400640 1 -- 172.21.15.59:0/477545744 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c0b0070 con 0x7f03840cef30 2024-04-25T09:02:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f0383400640 1 -- 172.21.15.59:0/477545744 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c0ab600 con 0x7f03840cef30 2024-04-25T09:02:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f0383400640 1 -- 172.21.15.59:0/477545744 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c0ab9d0 con 0x7f03840cef30 2024-04-25T09:02:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f038aa00640 1 -- 172.21.15.59:0/477545744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03840cef30 msgr2=0x7f038406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f038aa00640 1 --2- 172.21.15.59:0/477545744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03840cef30 0x7f038406e3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f036c009870 tx=0x7f036c01c560 comp rx=0 tx=0).stop 2024-04-25T09:02:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f038aa00640 1 -- 172.21.15.59:0/477545744 shutdown_connections 2024-04-25T09:02:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f038aa00640 1 --2- 172.21.15.59:0/477545744 >> v2:172.21.15.178:3300/0 conn(0x7f038406e900 0x7f03840b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f038aa00640 1 --2- 172.21.15.59:0/477545744 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f03840cef30 0x7f038406e3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f038aa00640 1 -- 172.21.15.59:0/477545744 >> 172.21.15.59:0/477545744 conn(0x7f0384066fa0 msgr2=0x7f038406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:09.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f038aa00640 1 -- 172.21.15.59:0/477545744 shutdown_connections 2024-04-25T09:02:09.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f038aa00640 1 -- 172.21.15.59:0/477545744 wait complete. 2024-04-25T09:02:09.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f038aa00640 1 Processor -- start 2024-04-25T09:02:09.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.147+0000 7f038aa00640 1 -- start start 2024-04-25T09:02:09.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f038aa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f038406e900 0x7f0384141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f038aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03840cef30 0x7f03841626a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f038aa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0384144140 0x7f0384155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f038aa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038415ba00 con 0x7f03840cef30 2024-04-25T09:02:09.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f038aa00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0384144520 con 0x7f038406e900 2024-04-25T09:02:09.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f038aa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f038415bb80 con 0x7f0384144140 2024-04-25T09:02:09.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f037be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03840cef30 0x7f03841626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f037be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03840cef30 0x7f03841626a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34494/0 (socket says 172.21.15.59:34494) 2024-04-25T09:02:09.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f037be00640 1 -- 172.21.15.59:0/2629282176 learned_addr learned my addr 172.21.15.59:0/2629282176 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:09.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f0388a00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0384144140 0x7f0384155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f0383e00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f038406e900 0x7f0384141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f037be00640 1 -- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0384144140 msgr2=0x7f0384155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f037be00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0384144140 0x7f0384155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f037be00640 1 -- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f038406e900 msgr2=0x7f0384141f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f037be00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f038406e900 0x7f0384141f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f037be00640 1 -- 172.21.15.59:0/2629282176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03841424b0 con 0x7f03840cef30 2024-04-25T09:02:09.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f037be00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03840cef30 0x7f03841626a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f036c0ae040 tx=0x7f036c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f0380c00640 1 -- 172.21.15.59:0/2629282176 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c0ba070 con 0x7f03840cef30 2024-04-25T09:02:09.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f0380c00640 1 -- 172.21.15.59:0/2629282176 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036c0b4420 con 0x7f03840cef30 2024-04-25T09:02:09.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f0380c00640 1 -- 172.21.15.59:0/2629282176 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f036c0b0040 con 0x7f03840cef30 2024-04-25T09:02:09.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f038aa00640 1 -- 172.21.15.59:0/2629282176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0384163160 con 0x7f03840cef30 2024-04-25T09:02:09.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f038aa00640 1 -- 172.21.15.59:0/2629282176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0384163720 con 0x7f03840cef30 2024-04-25T09:02:09.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f038aa00640 1 -- 172.21.15.59:0/2629282176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03840745d0 con 0x7f03840cef30 2024-04-25T09:02:09.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.151+0000 7f0380c00640 1 -- 172.21.15.59:0/2629282176 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f036c0a4d10 con 0x7f03840cef30 2024-04-25T09:02:09.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.155+0000 7f0380c00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0360066f60 0x7f0360069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.155+0000 7f0380c00640 1 -- 172.21.15.59:0/2629282176 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f036c11e310 con 0x7f03840cef30 2024-04-25T09:02:09.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.155+0000 7f0383e00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0360066f60 0x7f0360069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.155+0000 7f0383e00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0360066f60 0x7f0360069420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0374000f70 tx=0x7f0374007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.159+0000 7f0380c00640 1 -- 172.21.15.59:0/2629282176 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f036c016150 con 0x7f03840cef30 2024-04-25T09:02:09.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.319+0000 7f038aa00640 1 -- 172.21.15.59:0/2629282176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0384164f80 con 0x7f03840cef30 2024-04-25T09:02:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.319+0000 7f0380c00640 1 -- 172.21.15.59:0/2629282176 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f036c0ee7f0 con 0x7f03840cef30 2024-04-25T09:02:09.312 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:09.312 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:08.938626+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.323+0000 7f038aa00640 1 -- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0360066f60 msgr2=0x7f0360069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.323+0000 7f038aa00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0360066f60 0x7f0360069420 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0374000f70 tx=0x7f0374007df0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.323+0000 7f038aa00640 1 -- 172.21.15.59:0/2629282176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03840cef30 msgr2=0x7f03841626a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.323+0000 7f038aa00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03840cef30 0x7f03841626a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f036c0ae040 tx=0x7f036c019300 comp rx=0 tx=0).stop 2024-04-25T09:02:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.323+0000 7f038aa00640 1 -- 172.21.15.59:0/2629282176 shutdown_connections 2024-04-25T09:02:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.323+0000 7f038aa00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0360066f60 0x7f0360069420 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.323+0000 7f038aa00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0384144140 0x7f0384155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.323+0000 7f038aa00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03840cef30 0x7f03841626a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.323+0000 7f038aa00640 1 --2- 172.21.15.59:0/2629282176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f038406e900 0x7f0384141f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.323+0000 7f038aa00640 1 -- 172.21.15.59:0/2629282176 >> 172.21.15.59:0/2629282176 conn(0x7f0384066fa0 msgr2=0x7f03840ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:09.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.323+0000 7f038aa00640 1 -- 172.21.15.59:0/2629282176 shutdown_connections 2024-04-25T09:02:09.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.323+0000 7f038aa00640 1 -- 172.21.15.59:0/2629282176 wait complete. 2024-04-25T09:02:09.333 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:02:09.334 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f868be00640 1 Processor -- start 2024-04-25T09:02:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f868be00640 1 -- start start 2024-04-25T09:02:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f868be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868409a170 0x7f86840d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f868be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f868406bf30 0x7f86840cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f868be00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868415e040 con 0x7f868415dc60 2024-04-25T09:02:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f868be00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86840cff80 con 0x7f868406bf30 2024-04-25T09:02:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f868be00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86840d0260 con 0x7f868409a170 2024-04-25T09:02:09.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f8689e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f868406bf30 0x7f86840cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f8689e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f868406bf30 0x7f86840cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34506/0 (socket says 172.21.15.59:34506) 2024-04-25T09:02:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f8689e00640 1 -- 172.21.15.59:0/3427562057 learned_addr learned my addr 172.21.15.59:0/3427562057 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f8688a00640 1 --2- 172.21.15.59:0/3427562057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868409a170 0x7f86840d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f8689e00640 1 -- 172.21.15.59:0/3427562057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868409a170 msgr2=0x7f86840d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f8689e00640 1 --2- 172.21.15.59:0/3427562057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868409a170 0x7f86840d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f8689e00640 1 -- 172.21.15.59:0/3427562057 >> v1:172.21.15.178:6789/0 conn(0x7f868415dc60 legacy=0x7f8684099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.487+0000 7f8689e00640 1 -- 172.21.15.59:0/3427562057 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840d0540 con 0x7f868406bf30 2024-04-25T09:02:09.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.491+0000 7f8689e00640 1 --2- 172.21.15.59:0/3427562057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868406bf30 0x7f86840cf8a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f867c009e50 tx=0x7f867c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11f8d0c784f400d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.491+0000 7f8683e00640 1 -- 172.21.15.59:0/3427562057 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0a5830 con 0x7f868406bf30 2024-04-25T09:02:09.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.491+0000 7f8683e00640 1 -- 172.21.15.59:0/3427562057 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c0a59d0 con 0x7f868406bf30 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.491+0000 7f8683e00640 1 -- 172.21.15.59:0/3427562057 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0a5da0 con 0x7f868406bf30 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.491+0000 7f868be00640 1 -- 172.21.15.59:0/3427562057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868406bf30 msgr2=0x7f86840cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.491+0000 7f868be00640 1 --2- 172.21.15.59:0/3427562057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868406bf30 0x7f86840cf8a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f867c009e50 tx=0x7f867c01c970 comp rx=0 tx=0).stop 2024-04-25T09:02:09.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.491+0000 7f868be00640 1 -- 172.21.15.59:0/3427562057 shutdown_connections 2024-04-25T09:02:09.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.491+0000 7f868be00640 1 --2- 172.21.15.59:0/3427562057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868406bf30 0x7f86840cf8a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.491+0000 7f868be00640 1 --2- 172.21.15.59:0/3427562057 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868409a170 0x7f86840d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.491+0000 7f868be00640 1 -- 172.21.15.59:0/3427562057 >> 172.21.15.59:0/3427562057 conn(0x7f86840b3200 msgr2=0x7f86840b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:09.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.491+0000 7f868be00640 1 -- 172.21.15.59:0/3427562057 shutdown_connections 2024-04-25T09:02:09.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.491+0000 7f868be00640 1 -- 172.21.15.59:0/3427562057 wait complete. 2024-04-25T09:02:09.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f868be00640 1 Processor -- start 2024-04-25T09:02:09.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f868be00640 1 -- start start 2024-04-25T09:02:09.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f868be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868406bf30 0x7f86840b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f868be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f868409a170 0x7f86840b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f868be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868415dc60 0x7f86840ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f868be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840cc6f0 con 0x7f868415dc60 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f868be00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840cc570 con 0x7f868409a170 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f868be00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86840cc870 con 0x7f868406bf30 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8689e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868415dc60 0x7f86840ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8689400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868406bf30 0x7f86840b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8689e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868415dc60 0x7f86840ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34516/0 (socket says 172.21.15.59:34516) 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8689e00640 1 -- 172.21.15.59:0/239009139 learned_addr learned my addr 172.21.15.59:0/239009139 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8688a00640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f868409a170 0x7f86840b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8689e00640 1 -- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868406bf30 msgr2=0x7f86840b6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8689e00640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868406bf30 0x7f86840b6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8689e00640 1 -- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f868409a170 msgr2=0x7f86840b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8689e00640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f868409a170 0x7f86840b4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8689e00640 1 -- 172.21.15.59:0/239009139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840b52c0 con 0x7f868415dc60 2024-04-25T09:02:09.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8689e00640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868415dc60 0x7f86840ca5e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f867c0af040 tx=0x7f867c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8681600640 1 -- 172.21.15.59:0/239009139 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0bc020 con 0x7f868415dc60 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8681600640 1 -- 172.21.15.59:0/239009139 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c0b8690 con 0x7f868415dc60 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f8681600640 1 -- 172.21.15.59:0/239009139 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0b8a80 con 0x7f868415dc60 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f868be00640 1 -- 172.21.15.59:0/239009139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86840cb0a0 con 0x7f868415dc60 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f868be00640 1 -- 172.21.15.59:0/239009139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86840cb660 con 0x7f868415dc60 2024-04-25T09:02:09.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.495+0000 7f868be00640 1 -- 172.21.15.59:0/239009139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86840cb830 con 0x7f868415dc60 2024-04-25T09:02:09.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.499+0000 7f8681600640 1 -- 172.21.15.59:0/239009139 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f867c0bf020 con 0x7f868415dc60 2024-04-25T09:02:09.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.499+0000 7f8681600640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8664066f90 0x7f8664069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.499+0000 7f8681600640 1 -- 172.21.15.59:0/239009139 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f867c1203e0 con 0x7f868415dc60 2024-04-25T09:02:09.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.499+0000 7f8689400640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8664066f90 0x7f8664069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.499+0000 7f8689400640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8664066f90 0x7f8664069450 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8678007fd0 tx=0x7f8678009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.503+0000 7f8681600640 1 -- 172.21.15.59:0/239009139 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f867c0c6030 con 0x7f868415dc60 2024-04-25T09:02:09.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.663+0000 7f868be00640 1 -- 172.21.15.59:0/239009139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86840745d0 con 0x7f868415dc60 2024-04-25T09:02:09.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.663+0000 7f8681600640 1 -- 172.21.15.59:0/239009139 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f867c016620 con 0x7f868415dc60 2024-04-25T09:02:09.655 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:02:09.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.667+0000 7f868be00640 1 -- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8664066f90 msgr2=0x7f8664069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.667+0000 7f868be00640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8664066f90 0x7f8664069450 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8678007fd0 tx=0x7f8678009040 comp rx=0 tx=0).stop 2024-04-25T09:02:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.667+0000 7f868be00640 1 -- 172.21.15.59:0/239009139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868415dc60 msgr2=0x7f86840ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.667+0000 7f868be00640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868415dc60 0x7f86840ca5e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f867c0af040 tx=0x7f867c019710 comp rx=0 tx=0).stop 2024-04-25T09:02:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.667+0000 7f868be00640 1 -- 172.21.15.59:0/239009139 shutdown_connections 2024-04-25T09:02:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.667+0000 7f868be00640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8664066f90 0x7f8664069450 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.667+0000 7f868be00640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868415dc60 0x7f86840ca5e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.667+0000 7f868be00640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f868409a170 0x7f86840b4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.667+0000 7f868be00640 1 --2- 172.21.15.59:0/239009139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f868406bf30 0x7f86840b6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.667+0000 7f868be00640 1 -- 172.21.15.59:0/239009139 >> 172.21.15.59:0/239009139 conn(0x7f86840b3200 msgr2=0x7f86840b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.667+0000 7f868be00640 1 -- 172.21.15.59:0/239009139 shutdown_connections 2024-04-25T09:02:09.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.667+0000 7f868be00640 1 -- 172.21.15.59:0/239009139 wait complete. 2024-04-25T09:02:09.677 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:09.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2adb800640 1 Processor -- start 2024-04-25T09:02:09.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2adb800640 1 -- start start 2024-04-25T09:02:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2adb800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2ad415c9b0 0x7f2ad406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2adb800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ad406e010 0x7f2ad406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2adb800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad415fc00 con 0x7f2ad4159320 2024-04-25T09:02:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2adb800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ad406d640 con 0x7f2ad415c9b0 2024-04-25T09:02:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2adb800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad415fee0 con 0x7f2ad406e010 2024-04-25T09:02:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad8e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2ad4159320 0x7f2ad415f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55374/0 (socket says 172.21.15.59:55374) 2024-04-25T09:02:09.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad8e00640 1 -- 172.21.15.59:0/1220937813 learned_addr learned my addr 172.21.15.59:0/1220937813 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:09.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3e00640 1 --2- 172.21.15.59:0/1220937813 >> v2:172.21.15.178:3300/0 conn(0x7f2ad415c9b0 0x7f2ad406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad9800640 1 --2- 172.21.15.59:0/1220937813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ad406e010 0x7f2ad406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201371045 0 0) 0x7f2ad415fc00 con 0x7f2ad4159320 2024-04-25T09:02:09.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2abc003530 con 0x7f2ad4159320 2024-04-25T09:02:09.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4236826758 0 0) 0x7f2abc003530 con 0x7f2ad4159320 2024-04-25T09:02:09.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ad406e010 msgr2=0x7f2ad406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:09.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 --2- 172.21.15.59:0/1220937813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2ad406e010 0x7f2ad406e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 >> v2:172.21.15.178:3300/0 conn(0x7f2ad415c9b0 msgr2=0x7f2ad406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:09.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 --2- 172.21.15.59:0/1220937813 >> v2:172.21.15.178:3300/0 conn(0x7f2ad415c9b0 0x7f2ad406dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad41601c0 con 0x7f2ad4159320 2024-04-25T09:02:09.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f2ac8001680 con 0x7f2ad4159320 2024-04-25T09:02:09.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 >> v1:172.21.15.59:6789/0 conn(0x7f2ad4159320 legacy=0x7f2ad415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 --2- 172.21.15.59:0/1220937813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2abc0039c0 0x7f2abc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 --2- 172.21.15.59:0/1220937813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2abc004810 0x7f2abc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 --2- 172.21.15.59:0/1220937813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2abc0051d0 0x7f2abc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad406d640 con 0x7f2abc0039c0 2024-04-25T09:02:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad415fee0 con 0x7f2abc0051d0 2024-04-25T09:02:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2abc00bf10 con 0x7f2abc004810 2024-04-25T09:02:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad3e00640 1 --2- 172.21.15.59:0/1220937813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2abc004810 0x7f2abc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad9800640 1 --2- 172.21.15.59:0/1220937813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2abc0051d0 0x7f2abc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad8e00640 1 --2- 172.21.15.59:0/1220937813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2abc0039c0 0x7f2abc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad8e00640 1 -- 172.21.15.59:0/1220937813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2abc004810 msgr2=0x7f2abc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:09.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad8e00640 1 --2- 172.21.15.59:0/1220937813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2abc004810 0x7f2abc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad8e00640 1 -- 172.21.15.59:0/1220937813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2abc0051d0 msgr2=0x7f2abc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:09.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad8e00640 1 --2- 172.21.15.59:0/1220937813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2abc0051d0 0x7f2abc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.831+0000 7f2ad8e00640 1 -- 172.21.15.59:0/1220937813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2abc003530 con 0x7f2abc0039c0 2024-04-25T09:02:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.835+0000 7f2ad8e00640 1 --2- 172.21.15.59:0/1220937813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2abc0039c0 0x7f2abc003de0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800c2f0 tx=0x7f2ac801cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0cb6883d1718fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.835+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8007d60 con 0x7f2abc0039c0 2024-04-25T09:02:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.835+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac80a9020 con 0x7f2abc0039c0 2024-04-25T09:02:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.835+0000 7f2ad3400640 1 -- 172.21.15.59:0/1220937813 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8005ae0 con 0x7f2abc0039c0 2024-04-25T09:02:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.835+0000 7f2adb800640 1 -- 172.21.15.59:0/1220937813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2abc0039c0 msgr2=0x7f2abc003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.835+0000 7f2adb800640 1 --2- 172.21.15.59:0/1220937813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2abc0039c0 0x7f2abc003de0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2ac800c2f0 tx=0x7f2ac801cd40 comp rx=0 tx=0).stop 2024-04-25T09:02:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.835+0000 7f2ad9800640 1 -- 172.21.15.59:0/1220937813 reap_dead start 2024-04-25T09:02:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.835+0000 7f2adb800640 1 -- 172.21.15.59:0/1220937813 shutdown_connections 2024-04-25T09:02:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.835+0000 7f2adb800640 1 -- 172.21.15.59:0/1220937813 >> 172.21.15.59:0/1220937813 conn(0x7f2ad4067080 msgr2=0x7f2ad406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.835+0000 7f2adb800640 1 -- 172.21.15.59:0/1220937813 shutdown_connections 2024-04-25T09:02:09.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.835+0000 7f2adb800640 1 -- 172.21.15.59:0/1220937813 wait complete. 2024-04-25T09:02:09.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2adb800640 1 Processor -- start 2024-04-25T09:02:09.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2adb800640 1 -- start start 2024-04-25T09:02:09.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2adb800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2abc0039c0 0x7f2ad4158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2adb800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ad40b09d0 0x7f2ad40b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2adb800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ad40b1af0 0x7f2ad40b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2adb800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4071680 con 0x7f2ad40b1af0 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2adb800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4071500 con 0x7f2ad40b09d0 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2adb800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad4071800 con 0x7f2abc0039c0 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ad40b1af0 0x7f2ad40b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ad40b1af0 0x7f2ad40b2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34532/0 (socket says 172.21.15.59:34532) 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad9800640 1 -- 172.21.15.59:0/2754635208 learned_addr learned my addr 172.21.15.59:0/2754635208 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad3e00640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ad40b09d0 0x7f2ad40b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad8e00640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2abc0039c0 0x7f2ad4158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad9800640 1 -- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2abc0039c0 msgr2=0x7f2ad4158170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad9800640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2abc0039c0 0x7f2ad4158170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad9800640 1 -- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ad40b09d0 msgr2=0x7f2ad40b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:09.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad9800640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ad40b09d0 0x7f2ad40b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad9800640 1 -- 172.21.15.59:0/2754635208 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40ad6b0 con 0x7f2ad40b1af0 2024-04-25T09:02:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad8e00640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2abc0039c0 0x7f2ad4158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad9800640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ad40b1af0 0x7f2ad40b2700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2acc000f90 tx=0x7f2acc00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad0c00640 1 -- 172.21.15.59:0/2754635208 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00fe00 con 0x7f2ad40b1af0 2024-04-25T09:02:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad0c00640 1 -- 172.21.15.59:0/2754635208 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc01d070 con 0x7f2ad40b1af0 2024-04-25T09:02:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2adb800640 1 -- 172.21.15.59:0/2754635208 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad40ad990 con 0x7f2ad40b1af0 2024-04-25T09:02:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2ad0c00640 1 -- 172.21.15.59:0/2754635208 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc015670 con 0x7f2ad40b1af0 2024-04-25T09:02:09.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2adb800640 1 -- 172.21.15.59:0/2754635208 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad40b2c40 con 0x7f2ad40b1af0 2024-04-25T09:02:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.839+0000 7f2adb800640 1 -- 172.21.15.59:0/2754635208 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad40745d0 con 0x7f2ad40b1af0 2024-04-25T09:02:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.843+0000 7f2ad0c00640 1 -- 172.21.15.59:0/2754635208 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2acc015810 con 0x7f2ad40b1af0 2024-04-25T09:02:09.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.843+0000 7f2ad0c00640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ab4066f60 0x7f2ab4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:09.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.843+0000 7f2ad0c00640 1 -- 172.21.15.59:0/2754635208 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f2acc085da0 con 0x7f2ad40b1af0 2024-04-25T09:02:09.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.843+0000 7f2ad8e00640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ab4066f60 0x7f2ab4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:09.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.843+0000 7f2ad8e00640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ab4066f60 0x7f2ab4069420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80aa000 tx=0x7f2ac8001a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:09.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:09.847+0000 7f2ad0c00640 1 -- 172.21.15.59:0/2754635208 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2acc010040 con 0x7f2ad40b1af0 2024-04-25T09:02:10.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.015+0000 7f2adb800640 1 -- 172.21.15.59:0/2754635208 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ad41403a0 con 0x7f2ad40b1af0 2024-04-25T09:02:10.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.015+0000 7f2ad0c00640 1 -- 172.21.15.59:0/2754635208 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2acc056960 con 0x7f2ad40b1af0 2024-04-25T09:02:10.008 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.019+0000 7f2adb800640 1 -- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ab4066f60 msgr2=0x7f2ab4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.019+0000 7f2adb800640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ab4066f60 0x7f2ab4069420 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2ac80aa000 tx=0x7f2ac8001a50 comp rx=0 tx=0).stop 2024-04-25T09:02:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.019+0000 7f2adb800640 1 -- 172.21.15.59:0/2754635208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ad40b1af0 msgr2=0x7f2ad40b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.019+0000 7f2adb800640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ad40b1af0 0x7f2ad40b2700 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2acc000f90 tx=0x7f2acc00f1b0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.019+0000 7f2adb800640 1 -- 172.21.15.59:0/2754635208 shutdown_connections 2024-04-25T09:02:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.019+0000 7f2adb800640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ab4066f60 0x7f2ab4069420 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.019+0000 7f2adb800640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ad40b1af0 0x7f2ad40b2700 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.019+0000 7f2adb800640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2ad40b09d0 0x7f2ad40b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.019+0000 7f2adb800640 1 --2- 172.21.15.59:0/2754635208 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2abc0039c0 0x7f2ad4158170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.019+0000 7f2adb800640 1 -- 172.21.15.59:0/2754635208 >> 172.21.15.59:0/2754635208 conn(0x7f2ad4067080 msgr2=0x7f2ad40736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.019+0000 7f2adb800640 1 -- 172.21.15.59:0/2754635208 shutdown_connections 2024-04-25T09:02:10.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.019+0000 7f2adb800640 1 -- 172.21.15.59:0/2754635208 wait complete. 2024-04-25T09:02:10.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:10.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.179+0000 7f1ac1c00640 1 Processor -- start 2024-04-25T09:02:10.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ac1c00640 1 -- start start 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ac1c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1abc159320 0x7f1abc15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ac1c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1abc15f440 0x7f1abc06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ac1c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1abc15fc00 con 0x7f1abc06e010 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ac1c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1abc06d640 con 0x7f1abc15f440 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ac1c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc15fee0 con 0x7f1abc159320 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ab2000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1abc15f440 0x7f1abc06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ab2000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1abc15f440 0x7f1abc06dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34540/0 (socket says 172.21.15.59:34540) 2024-04-25T09:02:10.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ab2000640 1 -- 172.21.15.59:0/2391845484 learned_addr learned my addr 172.21.15.59:0/2391845484 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:10.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1abaa00640 1 --2- 172.21.15.59:0/2391845484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1abc159320 0x7f1abc15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ab2000640 1 -- 172.21.15.59:0/2391845484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1abc159320 msgr2=0x7f1abc15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ab2000640 1 --2- 172.21.15.59:0/2391845484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1abc159320 0x7f1abc15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ab2000640 1 -- 172.21.15.59:0/2391845484 >> v1:172.21.15.178:6789/0 conn(0x7f1abc06e010 legacy=0x7f1abc06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1ab2000640 1 -- 172.21.15.59:0/2391845484 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc1601c0 con 0x7f1abc15f440 2024-04-25T09:02:10.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.183+0000 7f1abaa00640 1 --2- 172.21.15.59:0/2391845484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1abc159320 0x7f1abc15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:10.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1ab2000640 1 --2- 172.21.15.59:0/2391845484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1abc15f440 0x7f1abc06dad0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009870 tx=0x7f1aa401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6e46cd861dfb7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1aba000640 1 -- 172.21.15.59:0/2391845484 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40ab640 con 0x7f1abc15f440 2024-04-25T09:02:10.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1aba000640 1 -- 172.21.15.59:0/2391845484 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa40b0070 con 0x7f1abc15f440 2024-04-25T09:02:10.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1aba000640 1 -- 172.21.15.59:0/2391845484 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa40aba00 con 0x7f1abc15f440 2024-04-25T09:02:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2391845484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1abc15f440 msgr2=0x7f1abc06dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1ac1c00640 1 --2- 172.21.15.59:0/2391845484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1abc15f440 0x7f1abc06dad0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009870 tx=0x7f1aa401c460 comp rx=0 tx=0).stop 2024-04-25T09:02:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2391845484 shutdown_connections 2024-04-25T09:02:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1ac1c00640 1 --2- 172.21.15.59:0/2391845484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1abc15f440 0x7f1abc06dad0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1ac1c00640 1 --2- 172.21.15.59:0/2391845484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1abc159320 0x7f1abc15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2391845484 >> 172.21.15.59:0/2391845484 conn(0x7f1abc067080 msgr2=0x7f1abc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2391845484 shutdown_connections 2024-04-25T09:02:10.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2391845484 wait complete. 2024-04-25T09:02:10.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1ac1c00640 1 Processor -- start 2024-04-25T09:02:10.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.187+0000 7f1ac1c00640 1 -- start start 2024-04-25T09:02:10.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ac1c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1abc06e010 0x7f1abc13f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ac1c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1abc159320 0x7f1abc13fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ac1c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1abc15f440 0x7f1abc140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ac1c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc071c00 con 0x7f1abc15f440 2024-04-25T09:02:10.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ac1c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc071a80 con 0x7f1abc159320 2024-04-25T09:02:10.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ac1c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1abc06ebb0 con 0x7f1abc06e010 2024-04-25T09:02:10.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1abb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1abc15f440 0x7f1abc140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1abb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1abc15f440 0x7f1abc140d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34546/0 (socket says 172.21.15.59:34546) 2024-04-25T09:02:10.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1abb400640 1 -- 172.21.15.59:0/2639581860 learned_addr learned my addr 172.21.15.59:0/2639581860 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:10.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ab2000640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1abc159320 0x7f1abc13fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1abaa00640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1abc06e010 0x7f1abc13f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1abb400640 1 -- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1abc06e010 msgr2=0x7f1abc13f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1abb400640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1abc06e010 0x7f1abc13f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1abb400640 1 -- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1abc159320 msgr2=0x7f1abc13fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1abb400640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1abc159320 0x7f1abc13fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1abb400640 1 -- 172.21.15.59:0/2639581860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc13f880 con 0x7f1abc15f440 2024-04-25T09:02:10.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1abb400640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1abc15f440 0x7f1abc140d00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400c780 tx=0x7f1ab400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ab3400640 1 -- 172.21.15.59:0/2639581860 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4016020 con 0x7f1abc15f440 2024-04-25T09:02:10.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ab3400640 1 -- 172.21.15.59:0/2639581860 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab400aa90 con 0x7f1abc15f440 2024-04-25T09:02:10.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ab3400640 1 -- 172.21.15.59:0/2639581860 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab400ce30 con 0x7f1abc15f440 2024-04-25T09:02:10.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2639581860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1abc15aa00 con 0x7f1abc15f440 2024-04-25T09:02:10.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2639581860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1abc140280 con 0x7f1abc15f440 2024-04-25T09:02:10.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2639581860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1abc0745d0 con 0x7f1abc15f440 2024-04-25T09:02:10.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.191+0000 7f1ab3400640 1 -- 172.21.15.59:0/2639581860 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1ab4019020 con 0x7f1abc15f440 2024-04-25T09:02:10.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.195+0000 7f1ab3400640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a98066f60 0x7f1a98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.195+0000 7f1ab3400640 1 -- 172.21.15.59:0/2639581860 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f1ab4085600 con 0x7f1abc15f440 2024-04-25T09:02:10.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.195+0000 7f1abaa00640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a98066f60 0x7f1a98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.195+0000 7f1abaa00640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a98066f60 0x7f1a98069420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1abc1661f0 tx=0x7f1aac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.199+0000 7f1ab3400640 1 -- 172.21.15.59:0/2639581860 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1ab4020020 con 0x7f1abc15f440 2024-04-25T09:02:10.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.359+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2639581860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1abc0ae530 con 0x7f1abc15f440 2024-04-25T09:02:10.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.359+0000 7f1ab3400640 1 -- 172.21.15.59:0/2639581860 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1ab4055b60 con 0x7f1abc15f440 2024-04-25T09:02:10.351 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:02:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.359+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a98066f60 msgr2=0x7f1a98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.359+0000 7f1ac1c00640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a98066f60 0x7f1a98069420 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1abc1661f0 tx=0x7f1aac008040 comp rx=0 tx=0).stop 2024-04-25T09:02:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.359+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2639581860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1abc15f440 msgr2=0x7f1abc140d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.359+0000 7f1ac1c00640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1abc15f440 0x7f1abc140d00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400c780 tx=0x7f1ab400cc40 comp rx=0 tx=0).stop 2024-04-25T09:02:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.359+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2639581860 shutdown_connections 2024-04-25T09:02:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.359+0000 7f1ac1c00640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a98066f60 0x7f1a98069420 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.359+0000 7f1ac1c00640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1abc15f440 0x7f1abc140d00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.359+0000 7f1ac1c00640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1abc159320 0x7f1abc13fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.359+0000 7f1ac1c00640 1 --2- 172.21.15.59:0/2639581860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1abc06e010 0x7f1abc13f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.359+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2639581860 >> 172.21.15.59:0/2639581860 conn(0x7f1abc067080 msgr2=0x7f1abc144e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.363+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2639581860 shutdown_connections 2024-04-25T09:02:10.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.363+0000 7f1ac1c00640 1 -- 172.21.15.59:0/2639581860 wait complete. 2024-04-25T09:02:10.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:02:10.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca95200640 1 Processor -- start 2024-04-25T09:02:10.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca95200640 1 -- start start 2024-04-25T09:02:10.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca95200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca9006e4a0 0x7fca9006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca95200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9015fc00 con 0x7fca90159320 2024-04-25T09:02:10.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca95200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca9015fee0 con 0x7fca9015c9b0 2024-04-25T09:02:10.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca95200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca9006d640 con 0x7fca9006e4a0 2024-04-25T09:02:10.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca8de00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fca90159320 0x7fca9015f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34574/0 (socket says 172.21.15.59:34574) 2024-04-25T09:02:10.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca8de00640 1 -- 172.21.15.59:0/294815918 learned_addr learned my addr 172.21.15.59:0/294815918 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:10.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca8e800640 1 --2- 172.21.15.59:0/294815918 >> v2:172.21.15.59:3300/0 conn(0x7fca9006e4a0 0x7fca9006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca8e800640 1 -- 172.21.15.59:0/294815918 >> v1:172.21.15.178:6789/0 conn(0x7fca9015c9b0 legacy=0x7fca9006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca8e800640 1 -- 172.21.15.59:0/294815918 >> v1:172.21.15.59:6789/0 conn(0x7fca90159320 legacy=0x7fca9015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca8e800640 1 -- 172.21.15.59:0/294815918 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca901601c0 con 0x7fca9006e4a0 2024-04-25T09:02:10.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.523+0000 7fca8d400640 1 -- 172.21.15.59:0/294815918 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401698154 0 0) 0x7fca9015fc00 con 0x7fca90159320 2024-04-25T09:02:10.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.527+0000 7fca8e800640 1 --2- 172.21.15.59:0/294815918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca9006e4a0 0x7fca9006e8d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fca9006d7c0 tx=0x7fca8801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3771f60558038ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.527+0000 7fca8d400640 1 -- 172.21.15.59:0/294815918 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880b2070 con 0x7fca9006e4a0 2024-04-25T09:02:10.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.527+0000 7fca8d400640 1 -- 172.21.15.59:0/294815918 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca880a57d0 con 0x7fca9006e4a0 2024-04-25T09:02:10.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.527+0000 7fca8d400640 1 -- 172.21.15.59:0/294815918 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880a5ba0 con 0x7fca9006e4a0 2024-04-25T09:02:10.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.527+0000 7fca95200640 1 -- 172.21.15.59:0/294815918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca9006e4a0 msgr2=0x7fca9006e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.527+0000 7fca95200640 1 --2- 172.21.15.59:0/294815918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca9006e4a0 0x7fca9006e8d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fca9006d7c0 tx=0x7fca8801c910 comp rx=0 tx=0).stop 2024-04-25T09:02:10.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.527+0000 7fca95200640 1 -- 172.21.15.59:0/294815918 shutdown_connections 2024-04-25T09:02:10.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.527+0000 7fca95200640 1 --2- 172.21.15.59:0/294815918 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca9006e4a0 0x7fca9006e8d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.527+0000 7fca95200640 1 -- 172.21.15.59:0/294815918 >> 172.21.15.59:0/294815918 conn(0x7fca90067080 msgr2=0x7fca9006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.527+0000 7fca95200640 1 -- 172.21.15.59:0/294815918 shutdown_connections 2024-04-25T09:02:10.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.527+0000 7fca95200640 1 -- 172.21.15.59:0/294815918 wait complete. 2024-04-25T09:02:10.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca95200640 1 Processor -- start 2024-04-25T09:02:10.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca95200640 1 -- start start 2024-04-25T09:02:10.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca95200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca9006e4a0 0x7fca90157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca95200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca90159320 0x7fca901552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca95200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca9015c9b0 0x7fca90135f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca95200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca90169720 con 0x7fca90159320 2024-04-25T09:02:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca95200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca901695a0 con 0x7fca9015c9b0 2024-04-25T09:02:10.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca95200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca901698a0 con 0x7fca9006e4a0 2024-04-25T09:02:10.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca85400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca90159320 0x7fca901552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca85400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca90159320 0x7fca901552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59992/0 (socket says 172.21.15.59:59992) 2024-04-25T09:02:10.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca85400640 1 -- 172.21.15.59:0/4097756573 learned_addr learned my addr 172.21.15.59:0/4097756573 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:10.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca8e800640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca9015c9b0 0x7fca90135f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca8de00640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca9006e4a0 0x7fca90157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca85400640 1 -- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca9006e4a0 msgr2=0x7fca90157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca85400640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca9006e4a0 0x7fca90157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca85400640 1 -- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca9015c9b0 msgr2=0x7fca90135f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca85400640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca9015c9b0 0x7fca90135f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca85400640 1 -- 172.21.15.59:0/4097756573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca900ce6e0 con 0x7fca90159320 2024-04-25T09:02:10.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca8de00640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca9006e4a0 0x7fca90157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:10.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca85400640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca90159320 0x7fca901552c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c450 tx=0x7fca7800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca86a00640 1 -- 172.21.15.59:0/4097756573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78012830 con 0x7fca90159320 2024-04-25T09:02:10.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca86a00640 1 -- 172.21.15.59:0/4097756573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca78017070 con 0x7fca90159320 2024-04-25T09:02:10.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca86a00640 1 -- 172.21.15.59:0/4097756573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78012c30 con 0x7fca90159320 2024-04-25T09:02:10.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca95200640 1 -- 172.21.15.59:0/4097756573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9015dbe0 con 0x7fca90159320 2024-04-25T09:02:10.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.531+0000 7fca95200640 1 -- 172.21.15.59:0/4097756573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9015e1a0 con 0x7fca90159320 2024-04-25T09:02:10.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.535+0000 7fca95200640 1 -- 172.21.15.59:0/4097756573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca900745d0 con 0x7fca90159320 2024-04-25T09:02:10.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.535+0000 7fca86a00640 1 -- 172.21.15.59:0/4097756573 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fca7801c460 con 0x7fca90159320 2024-04-25T09:02:10.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.535+0000 7fca86a00640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca6c066f60 0x7fca6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.535+0000 7fca86a00640 1 -- 172.21.15.59:0/4097756573 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fca78085070 con 0x7fca90159320 2024-04-25T09:02:10.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.535+0000 7fca8de00640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca6c066f60 0x7fca6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.535+0000 7fca8de00640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca6c066f60 0x7fca6c069420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fca80007fd0 tx=0x7fca80007c20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.539+0000 7fca86a00640 1 -- 172.21.15.59:0/4097756573 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fca78055cd0 con 0x7fca90159320 2024-04-25T09:02:10.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.703+0000 7fca95200640 1 -- 172.21.15.59:0/4097756573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fca901666e0 con 0x7fca90159320 2024-04-25T09:02:10.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.703+0000 7fca86a00640 1 -- 172.21.15.59:0/4097756573 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fca780555d0 con 0x7fca90159320 2024-04-25T09:02:10.696 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:10.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.707+0000 7fca95200640 1 -- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca6c066f60 msgr2=0x7fca6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.707+0000 7fca95200640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca6c066f60 0x7fca6c069420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fca80007fd0 tx=0x7fca80007c20 comp rx=0 tx=0).stop 2024-04-25T09:02:10.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.707+0000 7fca95200640 1 -- 172.21.15.59:0/4097756573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca90159320 msgr2=0x7fca901552c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.707+0000 7fca95200640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca90159320 0x7fca901552c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fca7800c450 tx=0x7fca7800c910 comp rx=0 tx=0).stop 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.707+0000 7fca95200640 1 -- 172.21.15.59:0/4097756573 shutdown_connections 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.707+0000 7fca95200640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca6c066f60 0x7fca6c069420 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.707+0000 7fca95200640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca9015c9b0 0x7fca90135f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.707+0000 7fca95200640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca90159320 0x7fca901552c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.707+0000 7fca95200640 1 --2- 172.21.15.59:0/4097756573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca9006e4a0 0x7fca90157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.707+0000 7fca95200640 1 -- 172.21.15.59:0/4097756573 >> 172.21.15.59:0/4097756573 conn(0x7fca90067080 msgr2=0x7fca9006dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.707+0000 7fca95200640 1 -- 172.21.15.59:0/4097756573 shutdown_connections 2024-04-25T09:02:10.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.707+0000 7fca95200640 1 -- 172.21.15.59:0/4097756573 wait complete. 2024-04-25T09:02:10.718 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:10.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.867+0000 7f2949800640 1 Processor -- start 2024-04-25T09:02:10.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.867+0000 7f2949800640 1 -- start start 2024-04-25T09:02:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.867+0000 7f2949800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29440d11b0 0x7f29440afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.867+0000 7f2949800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29440b4210 0x7f29440b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.867+0000 7f2949800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294415ddf0 con 0x7f294415da10 2024-04-25T09:02:10.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.867+0000 7f2949800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29440b4ba0 con 0x7f29440d11b0 2024-04-25T09:02:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.867+0000 7f2949800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294406b480 con 0x7f29440b4210 2024-04-25T09:02:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.867+0000 7f293a000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29440d11b0 0x7f29440afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.867+0000 7f293a000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f29440d11b0 0x7f29440afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60000/0 (socket says 172.21.15.59:60000) 2024-04-25T09:02:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.867+0000 7f293a000640 1 -- 172.21.15.59:0/2912589825 learned_addr learned my addr 172.21.15.59:0/2912589825 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.867+0000 7f2943400640 1 --2- 172.21.15.59:0/2912589825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29440b4210 0x7f29440b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f293a000640 1 -- 172.21.15.59:0/2912589825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29440b4210 msgr2=0x7f29440b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f293a000640 1 --2- 172.21.15.59:0/2912589825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29440b4210 0x7f29440b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f293a000640 1 -- 172.21.15.59:0/2912589825 >> v1:172.21.15.178:6789/0 conn(0x7f294415da10 legacy=0x7f294406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f293a000640 1 -- 172.21.15.59:0/2912589825 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440d06d0 con 0x7f29440d11b0 2024-04-25T09:02:10.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f293a000640 1 --2- 172.21.15.59:0/2912589825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29440d11b0 0x7f29440afe20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f292c009870 tx=0x7f292c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb76924ebd2839da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f2942000640 1 -- 172.21.15.59:0/2912589825 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0b1070 con 0x7f29440d11b0 2024-04-25T09:02:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f2942000640 1 -- 172.21.15.59:0/2912589825 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c0ac620 con 0x7f29440d11b0 2024-04-25T09:02:10.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f2942000640 1 -- 172.21.15.59:0/2912589825 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0ac9f0 con 0x7f29440d11b0 2024-04-25T09:02:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f2949800640 1 -- 172.21.15.59:0/2912589825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29440d11b0 msgr2=0x7f29440afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f2949800640 1 --2- 172.21.15.59:0/2912589825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29440d11b0 0x7f29440afe20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f292c009870 tx=0x7f292c01c4d0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f2949800640 1 -- 172.21.15.59:0/2912589825 shutdown_connections 2024-04-25T09:02:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f2949800640 1 --2- 172.21.15.59:0/2912589825 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29440b4210 0x7f29440b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f2949800640 1 --2- 172.21.15.59:0/2912589825 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29440d11b0 0x7f29440afe20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f2949800640 1 -- 172.21.15.59:0/2912589825 >> 172.21.15.59:0/2912589825 conn(0x7f29440b2400 msgr2=0x7f29440b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.871+0000 7f2949800640 1 -- 172.21.15.59:0/2912589825 shutdown_connections 2024-04-25T09:02:10.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f2949800640 1 -- 172.21.15.59:0/2912589825 wait complete. 2024-04-25T09:02:10.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f2949800640 1 Processor -- start 2024-04-25T09:02:10.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f2949800640 1 -- start start 2024-04-25T09:02:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f2949800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29440b4210 0x7f29440cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f2949800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29440d11b0 0x7f29440cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f2949800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f294415da10 0x7f29441467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f2949800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2944162150 con 0x7f29440d11b0 2024-04-25T09:02:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f2949800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2944161fd0 con 0x7f294415da10 2024-04-25T09:02:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f2949800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29441622d0 con 0x7f29440b4210 2024-04-25T09:02:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f293a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29440d11b0 0x7f29440cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f293a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29440d11b0 0x7f29440cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60002/0 (socket says 172.21.15.59:60002) 2024-04-25T09:02:10.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f293a000640 1 -- 172.21.15.59:0/2402345196 learned_addr learned my addr 172.21.15.59:0/2402345196 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f293a000640 1 -- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29440b4210 msgr2=0x7f29440cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f293a000640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29440b4210 0x7f29440cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f293a000640 1 -- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f294415da10 msgr2=0x7f29441467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f2943400640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f294415da10 0x7f29441467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f293a000640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f294415da10 0x7f29441467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f293a000640 1 -- 172.21.15.59:0/2402345196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29440cb7a0 con 0x7f29440d11b0 2024-04-25T09:02:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f2943400640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f294415da10 0x7f29441467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:10.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f293a000640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29440d11b0 0x7f29440cc530 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f292c0af040 tx=0x7f292c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f293b400640 1 -- 172.21.15.59:0/2402345196 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0b1040 con 0x7f29440d11b0 2024-04-25T09:02:10.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f293b400640 1 -- 172.21.15.59:0/2402345196 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c0ac420 con 0x7f29440d11b0 2024-04-25T09:02:10.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f293b400640 1 -- 172.21.15.59:0/2402345196 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c0b5680 con 0x7f29440d11b0 2024-04-25T09:02:10.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.875+0000 7f2949800640 1 -- 172.21.15.59:0/2402345196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29440cba80 con 0x7f29440d11b0 2024-04-25T09:02:10.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.879+0000 7f2949800640 1 -- 172.21.15.59:0/2402345196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294415f140 con 0x7f29440d11b0 2024-04-25T09:02:10.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.879+0000 7f2949800640 1 -- 172.21.15.59:0/2402345196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29440745d0 con 0x7f29440d11b0 2024-04-25T09:02:10.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.879+0000 7f293b400640 1 -- 172.21.15.59:0/2402345196 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f292c0bc020 con 0x7f29440d11b0 2024-04-25T09:02:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.879+0000 7f293b400640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2920066f60 0x7f2920069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:10.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.879+0000 7f293b400640 1 -- 172.21.15.59:0/2402345196 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f292c11e950 con 0x7f29440d11b0 2024-04-25T09:02:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.879+0000 7f2942a00640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2920066f60 0x7f2920069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:10.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.879+0000 7f2942a00640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2920066f60 0x7f2920069420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2934000f70 tx=0x7f29340079e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:10.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:10.883+0000 7f293b400640 1 -- 172.21.15.59:0/2402345196 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f292c0c3020 con 0x7f29440d11b0 2024-04-25T09:02:11.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 -- 172.21.15.59:0/2402345196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2944072860 con 0x7f29440d11b0 2024-04-25T09:02:11.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f293b400640 1 -- 172.21.15.59:0/2402345196 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f292c016150 con 0x7f29440d11b0 2024-04-25T09:02:11.042 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:11.043 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:08.938626+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 -- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2920066f60 msgr2=0x7f2920069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2920066f60 0x7f2920069420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2934000f70 tx=0x7f29340079e0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 -- 172.21.15.59:0/2402345196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29440d11b0 msgr2=0x7f29440cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29440d11b0 0x7f29440cc530 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f292c0af040 tx=0x7f292c019270 comp rx=0 tx=0).stop 2024-04-25T09:02:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 -- 172.21.15.59:0/2402345196 shutdown_connections 2024-04-25T09:02:11.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2920066f60 0x7f2920069420 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f294415da10 0x7f29441467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29440d11b0 0x7f29440cc530 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 --2- 172.21.15.59:0/2402345196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29440b4210 0x7f29440cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 -- 172.21.15.59:0/2402345196 >> 172.21.15.59:0/2402345196 conn(0x7f29440b2400 msgr2=0x7f29440afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:11.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 -- 172.21.15.59:0/2402345196 shutdown_connections 2024-04-25T09:02:11.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.051+0000 7f2949800640 1 -- 172.21.15.59:0/2402345196 wait complete. 2024-04-25T09:02:11.063 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:02:11.064 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:11.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.215+0000 7f9d6da00640 1 Processor -- start 2024-04-25T09:02:11.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.215+0000 7f9d6da00640 1 -- start start 2024-04-25T09:02:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.215+0000 7f9d6da00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9d68150f40 0x7f9d6806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.215+0000 7f9d6da00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d6815af40 0x7f9d68071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.215+0000 7f9d6da00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d6815e9a0 con 0x7f9d68072040 2024-04-25T09:02:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.215+0000 7f9d6da00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d68072490 con 0x7f9d68150f40 2024-04-25T09:02:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.215+0000 7f9d6da00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6806f530 con 0x7f9d6815af40 2024-04-25T09:02:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.215+0000 7f9d66a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9d68150f40 0x7f9d6806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.215+0000 7f9d5fe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d6815af40 0x7f9d68071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d66a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9d68150f40 0x7f9d6806ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:49340/0 (socket says 172.21.15.59:49340) 2024-04-25T09:02:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d66a00640 1 -- 172.21.15.59:0/1708146814 learned_addr learned my addr 172.21.15.59:0/1708146814 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d5fe00640 1 --2- 172.21.15.59:0/1708146814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d6815af40 0x7f9d68071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:50072/0 (socket says 172.21.15.59:50072) 2024-04-25T09:02:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d67400640 1 --1- 172.21.15.59:0/1708146814 >> v1:172.21.15.178:6789/0 conn(0x7f9d68072040 0x7f9d6806d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:51500/0 (socket says 172.21.15.59:51500) 2024-04-25T09:02:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d66a00640 1 -- 172.21.15.59:0/1708146814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d6815af40 msgr2=0x7f9d68071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d66a00640 1 --2- 172.21.15.59:0/1708146814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d6815af40 0x7f9d68071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d66a00640 1 -- 172.21.15.59:0/1708146814 >> v1:172.21.15.178:6789/0 conn(0x7f9d68072040 legacy=0x7f9d6806d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d66a00640 1 -- 172.21.15.59:0/1708146814 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d6815dbe0 con 0x7f9d68150f40 2024-04-25T09:02:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d5fe00640 1 --2- 172.21.15.59:0/1708146814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d6815af40 0x7f9d68071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d66000640 1 -- 172.21.15.59:0/1708146814 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341073478 0 0) 0x7f9d6815e9a0 con 0x7f9d68072040 2024-04-25T09:02:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d66a00640 1 --2- 172.21.15.59:0/1708146814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d68150f40 0x7f9d6806ef50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009870 tx=0x7f9d5801c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=307229dbec6c6296 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d66000640 1 -- 172.21.15.59:0/1708146814 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d580b0070 con 0x7f9d68150f40 2024-04-25T09:02:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d66000640 1 -- 172.21.15.59:0/1708146814 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d580ab600 con 0x7f9d68150f40 2024-04-25T09:02:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.219+0000 7f9d66000640 1 -- 172.21.15.59:0/1708146814 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d580ab9d0 con 0x7f9d68150f40 2024-04-25T09:02:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 -- 172.21.15.59:0/1708146814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d68150f40 msgr2=0x7f9d6806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 --2- 172.21.15.59:0/1708146814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d68150f40 0x7f9d6806ef50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9d58009870 tx=0x7f9d5801c440 comp rx=0 tx=0).stop 2024-04-25T09:02:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 -- 172.21.15.59:0/1708146814 shutdown_connections 2024-04-25T09:02:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 --2- 172.21.15.59:0/1708146814 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d6815af40 0x7f9d68071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 --2- 172.21.15.59:0/1708146814 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d68150f40 0x7f9d6806ef50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 -- 172.21.15.59:0/1708146814 >> 172.21.15.59:0/1708146814 conn(0x7f9d68067080 msgr2=0x7f9d6806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 -- 172.21.15.59:0/1708146814 shutdown_connections 2024-04-25T09:02:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 -- 172.21.15.59:0/1708146814 wait complete. 2024-04-25T09:02:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 Processor -- start 2024-04-25T09:02:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 -- start start 2024-04-25T09:02:11.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d68072040 0x7f9d680b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d68150f40 0x7f9d680ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d6815af40 0x7f9d680aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680cecd0 con 0x7f9d68150f40 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d6815b320 con 0x7f9d6815af40 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d6da00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680cee50 con 0x7f9d68072040 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d5fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d68150f40 0x7f9d680ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d5fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d68150f40 0x7f9d680ae900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60006/0 (socket says 172.21.15.59:60006) 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d5fe00640 1 -- 172.21.15.59:0/1035245031 learned_addr learned my addr 172.21.15.59:0/1035245031 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d67400640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d6815af40 0x7f9d680aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d66a00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d68072040 0x7f9d680b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d5fe00640 1 -- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d68072040 msgr2=0x7f9d680b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d5fe00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d68072040 0x7f9d680b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d5fe00640 1 -- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d6815af40 msgr2=0x7f9d680aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d5fe00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d6815af40 0x7f9d680aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d5fe00640 1 -- 172.21.15.59:0/1035245031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d68152940 con 0x7f9d68150f40 2024-04-25T09:02:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.223+0000 7f9d5fe00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d68150f40 0x7f9d680ae900 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000de40 tx=0x7f9d50010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:11.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.227+0000 7f9d5ea00640 1 -- 172.21.15.59:0/1035245031 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50004030 con 0x7f9d68150f40 2024-04-25T09:02:11.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.227+0000 7f9d5ea00640 1 -- 172.21.15.59:0/1035245031 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d500041d0 con 0x7f9d68150f40 2024-04-25T09:02:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.227+0000 7f9d5ea00640 1 -- 172.21.15.59:0/1035245031 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d50003620 con 0x7f9d68150f40 2024-04-25T09:02:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.227+0000 7f9d6da00640 1 -- 172.21.15.59:0/1035245031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d68152c20 con 0x7f9d68150f40 2024-04-25T09:02:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.227+0000 7f9d6da00640 1 -- 172.21.15.59:0/1035245031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d681531e0 con 0x7f9d68150f40 2024-04-25T09:02:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.227+0000 7f9d6da00640 1 -- 172.21.15.59:0/1035245031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d68153610 con 0x7f9d68150f40 2024-04-25T09:02:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.227+0000 7f9d5ea00640 1 -- 172.21.15.59:0/1035245031 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9d500037c0 con 0x7f9d68150f40 2024-04-25T09:02:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.227+0000 7f9d5ea00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9d44066f60 0x7f9d44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.227+0000 7f9d5ea00640 1 -- 172.21.15.59:0/1035245031 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f9d50087e30 con 0x7f9d68150f40 2024-04-25T09:02:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.227+0000 7f9d66a00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9d44066f60 0x7f9d44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.231+0000 7f9d66a00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9d44066f60 0x7f9d44069420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9d580ad000 tx=0x7f9d580a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.231+0000 7f9d5ea00640 1 -- 172.21.15.59:0/1035245031 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9d50058960 con 0x7f9d68150f40 2024-04-25T09:02:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.395+0000 7f9d6da00640 1 -- 172.21.15.59:0/1035245031 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9d680cf310 con 0x7f9d68150f40 2024-04-25T09:02:11.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.395+0000 7f9d5ea00640 1 -- 172.21.15.59:0/1035245031 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9d50058260 con 0x7f9d68150f40 2024-04-25T09:02:11.387 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:02:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.395+0000 7f9d6da00640 1 -- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9d44066f60 msgr2=0x7f9d44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.395+0000 7f9d6da00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9d44066f60 0x7f9d44069420 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9d580ad000 tx=0x7f9d580a6000 comp rx=0 tx=0).stop 2024-04-25T09:02:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.395+0000 7f9d6da00640 1 -- 172.21.15.59:0/1035245031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d68150f40 msgr2=0x7f9d680ae900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.395+0000 7f9d6da00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d68150f40 0x7f9d680ae900 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000de40 tx=0x7f9d50010490 comp rx=0 tx=0).stop 2024-04-25T09:02:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.399+0000 7f9d6da00640 1 -- 172.21.15.59:0/1035245031 shutdown_connections 2024-04-25T09:02:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.399+0000 7f9d6da00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9d44066f60 0x7f9d44069420 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.399+0000 7f9d6da00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d6815af40 0x7f9d680aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.399+0000 7f9d6da00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d68150f40 0x7f9d680ae900 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.399+0000 7f9d6da00640 1 --2- 172.21.15.59:0/1035245031 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d68072040 0x7f9d680b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.399+0000 7f9d6da00640 1 -- 172.21.15.59:0/1035245031 >> 172.21.15.59:0/1035245031 conn(0x7f9d68067080 msgr2=0x7f9d68163f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.399+0000 7f9d6da00640 1 -- 172.21.15.59:0/1035245031 shutdown_connections 2024-04-25T09:02:11.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.399+0000 7f9d6da00640 1 -- 172.21.15.59:0/1035245031 wait complete. 2024-04-25T09:02:11.408 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:11.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.559+0000 7fece7600640 1 Processor -- start 2024-04-25T09:02:11.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.559+0000 7fece7600640 1 -- start start 2024-04-25T09:02:11.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fece7600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fece015dc60 0x7fece00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fece7600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fece006bf30 0x7fece00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fece7600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece015e040 con 0x7fece0099a60 2024-04-25T09:02:11.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fece7600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece00cff80 con 0x7fece006bf30 2024-04-25T09:02:11.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fece7600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece00d0260 con 0x7fece015dc60 2024-04-25T09:02:11.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fecd7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fece006bf30 0x7fece00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fece5600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fece0099a60 0x7fece00cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34578/0 (socket says 172.21.15.59:34578) 2024-04-25T09:02:11.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fece5600640 1 -- 172.21.15.59:0/3928810160 learned_addr learned my addr 172.21.15.59:0/3928810160 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:11.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fece4c00640 1 --2- 172.21.15.59:0/3928810160 >> v2:172.21.15.178:3300/0 conn(0x7fece015dc60 0x7fece00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fecd7e00640 1 -- 172.21.15.59:0/3928810160 >> v2:172.21.15.178:3300/0 conn(0x7fece015dc60 msgr2=0x7fece00d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:11.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fecd7e00640 1 --2- 172.21.15.59:0/3928810160 >> v2:172.21.15.178:3300/0 conn(0x7fece015dc60 0x7fece00d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fecd7e00640 1 -- 172.21.15.59:0/3928810160 >> v1:172.21.15.59:6789/0 conn(0x7fece0099a60 legacy=0x7fece00cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.563+0000 7fecd7e00640 1 -- 172.21.15.59:0/3928810160 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00d0540 con 0x7fece006bf30 2024-04-25T09:02:11.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fecd7e00640 1 --2- 172.21.15.59:0/3928810160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece006bf30 0x7fece00cf8a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fece009a6b0 tx=0x7fecc801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f644bf305dc0127 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:11.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fecdfe00640 1 -- 172.21.15.59:0/3928810160 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc80b1070 con 0x7fece006bf30 2024-04-25T09:02:11.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fecdfe00640 1 -- 172.21.15.59:0/3928810160 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc80ac620 con 0x7fece006bf30 2024-04-25T09:02:11.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fecdfe00640 1 -- 172.21.15.59:0/3928810160 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc80ac9f0 con 0x7fece006bf30 2024-04-25T09:02:11.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fece7600640 1 -- 172.21.15.59:0/3928810160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece006bf30 msgr2=0x7fece00cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fece7600640 1 --2- 172.21.15.59:0/3928810160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece006bf30 0x7fece00cf8a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fece009a6b0 tx=0x7fecc801c3c0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fece7600640 1 -- 172.21.15.59:0/3928810160 shutdown_connections 2024-04-25T09:02:11.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fece7600640 1 --2- 172.21.15.59:0/3928810160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece006bf30 0x7fece00cf8a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fece7600640 1 --2- 172.21.15.59:0/3928810160 >> v2:172.21.15.178:3300/0 conn(0x7fece015dc60 0x7fece00d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fece7600640 1 -- 172.21.15.59:0/3928810160 >> 172.21.15.59:0/3928810160 conn(0x7fece00b3200 msgr2=0x7fece00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:11.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fece7600640 1 -- 172.21.15.59:0/3928810160 shutdown_connections 2024-04-25T09:02:11.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fece7600640 1 -- 172.21.15.59:0/3928810160 wait complete. 2024-04-25T09:02:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fece7600640 1 Processor -- start 2024-04-25T09:02:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.567+0000 7fece7600640 1 -- start start 2024-04-25T09:02:11.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece7600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fece006bf30 0x7fece00cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece7600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fece0099a60 0x7fece00b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece7600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece015dc60 0x7fece00c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece7600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece009a280 con 0x7fece015dc60 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece7600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece00cc880 con 0x7fece0099a60 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece7600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece00cae80 con 0x7fece006bf30 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece015dc60 0x7fece00c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece015dc60 0x7fece00c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60022/0 (socket says 172.21.15.59:60022) 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece5600640 1 -- 172.21.15.59:0/2724198938 learned_addr learned my addr 172.21.15.59:0/2724198938 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fecd7e00640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fece0099a60 0x7fece00b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece4c00640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fece006bf30 0x7fece00cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece5600640 1 -- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fece006bf30 msgr2=0x7fece00cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece5600640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fece006bf30 0x7fece00cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece5600640 1 -- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fece0099a60 msgr2=0x7fece00b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece5600640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fece0099a60 0x7fece00b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece5600640 1 -- 172.21.15.59:0/2724198938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00cb140 con 0x7fece015dc60 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fecd7e00640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fece0099a60 0x7fece00b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:11.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece4c00640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fece006bf30 0x7fece00cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:11.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece5600640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece015dc60 0x7fece00c87e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fecd800cbc0 tx=0x7fecd800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:11.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fecdd600640 1 -- 172.21.15.59:0/2724198938 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8017070 con 0x7fece015dc60 2024-04-25T09:02:11.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fecdd600640 1 -- 172.21.15.59:0/2724198938 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd800ad40 con 0x7fece015dc60 2024-04-25T09:02:11.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fecdd600640 1 -- 172.21.15.59:0/2724198938 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8012600 con 0x7fece015dc60 2024-04-25T09:02:11.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece7600640 1 -- 172.21.15.59:0/2724198938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece00cb420 con 0x7fece015dc60 2024-04-25T09:02:11.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece7600640 1 -- 172.21.15.59:0/2724198938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece00c8d20 con 0x7fece015dc60 2024-04-25T09:02:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fece7600640 1 -- 172.21.15.59:0/2724198938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece00745d0 con 0x7fece015dc60 2024-04-25T09:02:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.571+0000 7fecdd600640 1 -- 172.21.15.59:0/2724198938 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fecd801a070 con 0x7fece015dc60 2024-04-25T09:02:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.575+0000 7fecdd600640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecbc066f60 0x7fecbc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.575+0000 7fecdd600640 1 -- 172.21.15.59:0/2724198938 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fecd80851a0 con 0x7fece015dc60 2024-04-25T09:02:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.575+0000 7fece4c00640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecbc066f60 0x7fecbc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.575+0000 7fece4c00640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecbc066f60 0x7fecbc069420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fecd00097a0 tx=0x7fecd0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:11.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.579+0000 7fecdd600640 1 -- 172.21.15.59:0/2724198938 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fecd8055680 con 0x7fece015dc60 2024-04-25T09:02:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.739+0000 7fece7600640 1 -- 172.21.15.59:0/2724198938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fece00b7590 con 0x7fece015dc60 2024-04-25T09:02:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.739+0000 7fecdd600640 1 -- 172.21.15.59:0/2724198938 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fecd8059720 con 0x7fece015dc60 2024-04-25T09:02:11.731 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:11.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.743+0000 7fece7600640 1 -- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecbc066f60 msgr2=0x7fecbc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.743+0000 7fece7600640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecbc066f60 0x7fecbc069420 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fecd00097a0 tx=0x7fecd0008040 comp rx=0 tx=0).stop 2024-04-25T09:02:11.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.743+0000 7fece7600640 1 -- 172.21.15.59:0/2724198938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece015dc60 msgr2=0x7fece00c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.743+0000 7fece7600640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece015dc60 0x7fece00c87e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fecd800cbc0 tx=0x7fecd800a430 comp rx=0 tx=0).stop 2024-04-25T09:02:11.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.743+0000 7fece7600640 1 -- 172.21.15.59:0/2724198938 shutdown_connections 2024-04-25T09:02:11.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.743+0000 7fece7600640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecbc066f60 0x7fecbc069420 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.743+0000 7fece7600640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fece015dc60 0x7fece00c87e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.743+0000 7fece7600640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fece0099a60 0x7fece00b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.743+0000 7fece7600640 1 --2- 172.21.15.59:0/2724198938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fece006bf30 0x7fece00cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.743+0000 7fece7600640 1 -- 172.21.15.59:0/2724198938 >> 172.21.15.59:0/2724198938 conn(0x7fece00b3200 msgr2=0x7fece0070340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:11.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.743+0000 7fece7600640 1 -- 172.21.15.59:0/2724198938 shutdown_connections 2024-04-25T09:02:11.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.743+0000 7fece7600640 1 -- 172.21.15.59:0/2724198938 wait complete. 2024-04-25T09:02:11.753 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:11.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.903+0000 7f3559400640 1 Processor -- start 2024-04-25T09:02:11.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.903+0000 7f3559400640 1 -- start start 2024-04-25T09:02:11.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3559400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f355415acd0 0x7f355415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3559400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355415ee60 0x7f35540b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3559400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355415bc40 con 0x7f3554144120 2024-04-25T09:02:11.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3559400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355415e490 con 0x7f355415acd0 2024-04-25T09:02:11.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3559400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355415b150 con 0x7f355415ee60 2024-04-25T09:02:11.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3549e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f355415acd0 0x7f355415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3552800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3554144120 0x7f35540ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34588/0 (socket says 172.21.15.59:34588) 2024-04-25T09:02:11.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3549e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f355415acd0 0x7f355415e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60038/0 (socket says 172.21.15.59:60038) 2024-04-25T09:02:11.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3552800640 1 -- 172.21.15.59:0/1955213037 learned_addr learned my addr 172.21.15.59:0/1955213037 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:11.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3553200640 1 --2- 172.21.15.59:0/1955213037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355415ee60 0x7f35540b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3549e00640 1 -- 172.21.15.59:0/1955213037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355415ee60 msgr2=0x7f35540b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:11.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3549e00640 1 --2- 172.21.15.59:0/1955213037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355415ee60 0x7f35540b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3549e00640 1 -- 172.21.15.59:0/1955213037 >> v1:172.21.15.59:6789/0 conn(0x7f3554144120 legacy=0x7f35540ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3549e00640 1 -- 172.21.15.59:0/1955213037 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355415b3a0 con 0x7f355415acd0 2024-04-25T09:02:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3551e00640 1 -- 172.21.15.59:0/1955213037 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226128523 0 0) 0x7f355415bc40 con 0x7f3554144120 2024-04-25T09:02:11.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3549e00640 1 --2- 172.21.15.59:0/1955213037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355415acd0 0x7f355415e920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f353c0097c0 tx=0x7f353c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b1c4217cc29dbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:11.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.907+0000 7f3551e00640 1 -- 172.21.15.59:0/1955213037 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0b0070 con 0x7f355415acd0 2024-04-25T09:02:11.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3551e00640 1 -- 172.21.15.59:0/1955213037 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c0ab600 con 0x7f355415acd0 2024-04-25T09:02:11.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3551e00640 1 -- 172.21.15.59:0/1955213037 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0ab9d0 con 0x7f355415acd0 2024-04-25T09:02:11.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 -- 172.21.15.59:0/1955213037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355415acd0 msgr2=0x7f355415e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 --2- 172.21.15.59:0/1955213037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355415acd0 0x7f355415e920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f353c0097c0 tx=0x7f353c01c410 comp rx=0 tx=0).stop 2024-04-25T09:02:11.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 -- 172.21.15.59:0/1955213037 shutdown_connections 2024-04-25T09:02:11.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 --2- 172.21.15.59:0/1955213037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355415ee60 0x7f35540b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 --2- 172.21.15.59:0/1955213037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355415acd0 0x7f355415e920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 -- 172.21.15.59:0/1955213037 >> 172.21.15.59:0/1955213037 conn(0x7f3554067080 msgr2=0x7f355406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:11.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 -- 172.21.15.59:0/1955213037 shutdown_connections 2024-04-25T09:02:11.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 -- 172.21.15.59:0/1955213037 wait complete. 2024-04-25T09:02:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 Processor -- start 2024-04-25T09:02:11.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 -- start start 2024-04-25T09:02:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3554144120 0x7f355415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355415acd0 0x7f355413fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f355415ee60 0x7f35540b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355406d450 con 0x7f355415acd0 2024-04-25T09:02:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355406d2d0 con 0x7f355415ee60 2024-04-25T09:02:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3559400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355406d5d0 con 0x7f3554144120 2024-04-25T09:02:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3549e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355415acd0 0x7f355413fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3549e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355415acd0 0x7f355413fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60046/0 (socket says 172.21.15.59:60046) 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3549e00640 1 -- 172.21.15.59:0/485892241 learned_addr learned my addr 172.21.15.59:0/485892241 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3553200640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f355415ee60 0x7f35540b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3552800640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3554144120 0x7f355415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3549e00640 1 -- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3554144120 msgr2=0x7f355415a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3549e00640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3554144120 0x7f355415a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3549e00640 1 -- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f355415ee60 msgr2=0x7f35540b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3549e00640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f355415ee60 0x7f35540b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.911+0000 7f3549e00640 1 -- 172.21.15.59:0/485892241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355413ed40 con 0x7f355415acd0 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.915+0000 7f3549e00640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355415acd0 0x7f355413fde0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f353c0ae040 tx=0x7f353c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.915+0000 7f354b400640 1 -- 172.21.15.59:0/485892241 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0b0050 con 0x7f355415acd0 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.915+0000 7f354b400640 1 -- 172.21.15.59:0/485892241 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353c0b1040 con 0x7f355415acd0 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.915+0000 7f3559400640 1 -- 172.21.15.59:0/485892241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355413f020 con 0x7f355415acd0 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.915+0000 7f354b400640 1 -- 172.21.15.59:0/485892241 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353c0b5610 con 0x7f355415acd0 2024-04-25T09:02:11.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.915+0000 7f3559400640 1 -- 172.21.15.59:0/485892241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355413f5e0 con 0x7f355415acd0 2024-04-25T09:02:11.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.915+0000 7f3559400640 1 -- 172.21.15.59:0/485892241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35540745d0 con 0x7f355415acd0 2024-04-25T09:02:11.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.915+0000 7f354b400640 1 -- 172.21.15.59:0/485892241 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f353c0be030 con 0x7f355415acd0 2024-04-25T09:02:11.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.915+0000 7f354b400640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3530066f60 0x7f3530069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:11.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.915+0000 7f354b400640 1 -- 172.21.15.59:0/485892241 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f353c11f280 con 0x7f355415acd0 2024-04-25T09:02:11.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.915+0000 7f3552800640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3530066f60 0x7f3530069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:11.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.919+0000 7f3552800640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3530066f60 0x7f3530069420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3544000f70 tx=0x7f3544007b80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:11.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:11.919+0000 7f354b400640 1 -- 172.21.15.59:0/485892241 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f353c0c5020 con 0x7f355415acd0 2024-04-25T09:02:12.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 -- 172.21.15.59:0/485892241 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3554143500 con 0x7f355415acd0 2024-04-25T09:02:12.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f354b400640 1 -- 172.21.15.59:0/485892241 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f353c016090 con 0x7f355415acd0 2024-04-25T09:02:12.074 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:02:12.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 -- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3530066f60 msgr2=0x7f3530069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3530066f60 0x7f3530069420 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3544000f70 tx=0x7f3544007b80 comp rx=0 tx=0).stop 2024-04-25T09:02:12.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 -- 172.21.15.59:0/485892241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355415acd0 msgr2=0x7f355413fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355415acd0 0x7f355413fde0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f353c0ae040 tx=0x7f353c01ac50 comp rx=0 tx=0).stop 2024-04-25T09:02:12.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 -- 172.21.15.59:0/485892241 shutdown_connections 2024-04-25T09:02:12.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3530066f60 0x7f3530069420 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f355415ee60 0x7f35540b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355415acd0 0x7f355413fde0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 --2- 172.21.15.59:0/485892241 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3554144120 0x7f355415a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 -- 172.21.15.59:0/485892241 >> 172.21.15.59:0/485892241 conn(0x7f3554067080 msgr2=0x7f355406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:12.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 -- 172.21.15.59:0/485892241 shutdown_connections 2024-04-25T09:02:12.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.083+0000 7f3559400640 1 -- 172.21.15.59:0/485892241 wait complete. 2024-04-25T09:02:12.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:02:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.247+0000 7f52bf200640 1 Processor -- start 2024-04-25T09:02:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.247+0000 7f52bf200640 1 -- start start 2024-04-25T09:02:12.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.247+0000 7f52bf200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b8144120 0x7f52b815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.247+0000 7f52bf200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f52b80b3090 0x7f52b80b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.247+0000 7f52bf200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b815bc40 con 0x7f52b80ccbf0 2024-04-25T09:02:12.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.247+0000 7f52bf200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b815e490 con 0x7f52b80b3090 2024-04-25T09:02:12.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.247+0000 7f52bf200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b815b3a0 con 0x7f52b8144120 2024-04-25T09:02:12.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.251+0000 7f52b7e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b8144120 0x7f52b815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.251+0000 7f52bd200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f52b80b3090 0x7f52b80b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.251+0000 7f52b7e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b8144120 0x7f52b815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:50108/0 (socket says 172.21.15.59:50108) 2024-04-25T09:02:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.251+0000 7f52bd200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f52b80b3090 0x7f52b80b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:49394/0 (socket says 172.21.15.59:49394) 2024-04-25T09:02:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.251+0000 7f52b7e00640 1 -- 172.21.15.59:0/1668497489 learned_addr learned my addr 172.21.15.59:0/1668497489 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.251+0000 7f52b7e00640 1 -- 172.21.15.59:0/1668497489 >> v2:172.21.15.178:3300/0 conn(0x7f52b80b3090 msgr2=0x7f52b80b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.251+0000 7f52b7e00640 1 --2- 172.21.15.59:0/1668497489 >> v2:172.21.15.178:3300/0 conn(0x7f52b80b3090 0x7f52b80b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.251+0000 7f52b7e00640 1 -- 172.21.15.59:0/1668497489 >> v1:172.21.15.178:6789/0 conn(0x7f52b80ccbf0 legacy=0x7f52b815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.251+0000 7f52b7e00640 1 -- 172.21.15.59:0/1668497489 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b815b680 con 0x7f52b8144120 2024-04-25T09:02:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.251+0000 7f52b7e00640 1 --2- 172.21.15.59:0/1668497489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b8144120 0x7f52b815acd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009870 tx=0x7f52a801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9cd8db6a4f30bcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.251+0000 7f52b7400640 1 -- 172.21.15.59:0/1668497489 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80b0070 con 0x7f52b8144120 2024-04-25T09:02:12.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52b7400640 1 -- 172.21.15.59:0/1668497489 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a80ab600 con 0x7f52b8144120 2024-04-25T09:02:12.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52b7400640 1 -- 172.21.15.59:0/1668497489 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80ab9d0 con 0x7f52b8144120 2024-04-25T09:02:12.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 -- 172.21.15.59:0/1668497489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b8144120 msgr2=0x7f52b815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 --2- 172.21.15.59:0/1668497489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b8144120 0x7f52b815acd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009870 tx=0x7f52a801c4d0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 -- 172.21.15.59:0/1668497489 shutdown_connections 2024-04-25T09:02:12.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 --2- 172.21.15.59:0/1668497489 >> v2:172.21.15.178:3300/0 conn(0x7f52b80b3090 0x7f52b80b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 --2- 172.21.15.59:0/1668497489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b8144120 0x7f52b815acd0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 -- 172.21.15.59:0/1668497489 >> 172.21.15.59:0/1668497489 conn(0x7f52b8067080 msgr2=0x7f52b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:12.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 -- 172.21.15.59:0/1668497489 shutdown_connections 2024-04-25T09:02:12.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 -- 172.21.15.59:0/1668497489 wait complete. 2024-04-25T09:02:12.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 Processor -- start 2024-04-25T09:02:12.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 -- start start 2024-04-25T09:02:12.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b80b3090 0x7f52b815a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52b80ccbf0 0x7f52b81643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52b8144120 0x7f52b8160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b806d450 con 0x7f52b8144120 2024-04-25T09:02:12.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b806d2d0 con 0x7f52b80ccbf0 2024-04-25T09:02:12.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bf200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b806d5d0 con 0x7f52b80b3090 2024-04-25T09:02:12.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bd200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52b8144120 0x7f52b8160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bd200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52b8144120 0x7f52b8160c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60056/0 (socket says 172.21.15.59:60056) 2024-04-25T09:02:12.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52bd200640 1 -- 172.21.15.59:0/526926977 learned_addr learned my addr 172.21.15.59:0/526926977 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:12.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52afe00640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52b80ccbf0 0x7f52b81643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.255+0000 7f52b7e00640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b80b3090 0x7f52b815a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52bd200640 1 -- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b80b3090 msgr2=0x7f52b815a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52bd200640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b80b3090 0x7f52b815a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52bd200640 1 -- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52b80ccbf0 msgr2=0x7f52b81643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52bd200640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52b80ccbf0 0x7f52b81643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52bd200640 1 -- 172.21.15.59:0/526926977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b815fbe0 con 0x7f52b8144120 2024-04-25T09:02:12.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52b7e00640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b80b3090 0x7f52b815a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:12.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52bd200640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52b8144120 0x7f52b8160c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f52b000efc0 tx=0x7f52b000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:12.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52b4c00640 1 -- 172.21.15.59:0/526926977 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0018020 con 0x7f52b8144120 2024-04-25T09:02:12.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52b4c00640 1 -- 172.21.15.59:0/526926977 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0014480 con 0x7f52b8144120 2024-04-25T09:02:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52b4c00640 1 -- 172.21.15.59:0/526926977 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0014870 con 0x7f52b8144120 2024-04-25T09:02:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52bf200640 1 -- 172.21.15.59:0/526926977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b815fec0 con 0x7f52b8144120 2024-04-25T09:02:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52bf200640 1 -- 172.21.15.59:0/526926977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b8160480 con 0x7f52b8144120 2024-04-25T09:02:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52bf200640 1 -- 172.21.15.59:0/526926977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b80745d0 con 0x7f52b8144120 2024-04-25T09:02:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52b4c00640 1 -- 172.21.15.59:0/526926977 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f52b001b020 con 0x7f52b8144120 2024-04-25T09:02:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52b4c00640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5294066f60 0x7f5294069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.259+0000 7f52b4c00640 1 -- 172.21.15.59:0/526926977 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f52b0085e50 con 0x7f52b8144120 2024-04-25T09:02:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.263+0000 7f52b7e00640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5294066f60 0x7f5294069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.263+0000 7f52b7e00640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5294066f60 0x7f5294069420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f52a80ad000 tx=0x7f52a80a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.263+0000 7f52b4c00640 1 -- 172.21.15.59:0/526926977 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f52b0022070 con 0x7f52b8144120 2024-04-25T09:02:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.423+0000 7f52bf200640 1 -- 172.21.15.59:0/526926977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f52b80cc8c0 con 0x7f52b8144120 2024-04-25T09:02:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52b4c00640 1 -- 172.21.15.59:0/526926977 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f52b0010040 con 0x7f52b8144120 2024-04-25T09:02:12.417 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52bf200640 1 -- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5294066f60 msgr2=0x7f5294069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52bf200640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5294066f60 0x7f5294069420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f52a80ad000 tx=0x7f52a80a6000 comp rx=0 tx=0).stop 2024-04-25T09:02:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52bf200640 1 -- 172.21.15.59:0/526926977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52b8144120 msgr2=0x7f52b8160c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52bf200640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52b8144120 0x7f52b8160c80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f52b000efc0 tx=0x7f52b000c490 comp rx=0 tx=0).stop 2024-04-25T09:02:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52bf200640 1 -- 172.21.15.59:0/526926977 shutdown_connections 2024-04-25T09:02:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52bf200640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5294066f60 0x7f5294069420 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52bf200640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52b8144120 0x7f52b8160c80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52bf200640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52b80ccbf0 0x7f52b81643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52bf200640 1 --2- 172.21.15.59:0/526926977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52b80b3090 0x7f52b815a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52bf200640 1 -- 172.21.15.59:0/526926977 >> 172.21.15.59:0/526926977 conn(0x7f52b8067080 msgr2=0x7f52b815e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52bf200640 1 -- 172.21.15.59:0/526926977 shutdown_connections 2024-04-25T09:02:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.427+0000 7f52bf200640 1 -- 172.21.15.59:0/526926977 wait complete. 2024-04-25T09:02:12.438 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:12.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.587+0000 7f13d7600640 1 Processor -- start 2024-04-25T09:02:12.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.587+0000 7f13d7600640 1 -- start start 2024-04-25T09:02:12.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13d7600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d0146740 0x7f13d006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13d7600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f13d00aeb50 0x7f13d00aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13d7600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d00b23e0 con 0x7f13d00af840 2024-04-25T09:02:12.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13d7600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d0146b20 con 0x7f13d00aeb50 2024-04-25T09:02:12.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13d7600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00acb80 con 0x7f13d0146740 2024-04-25T09:02:12.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13c7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f13d00af840 0x7f13d00b19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34602/0 (socket says 172.21.15.59:34602) 2024-04-25T09:02:12.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13c7e00640 1 -- 172.21.15.59:0/3157868743 learned_addr learned my addr 172.21.15.59:0/3157868743 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:12.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13d4c00640 1 --2- 172.21.15.59:0/3157868743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d0146740 0x7f13d006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13d5600640 1 --2- 172.21.15.59:0/3157868743 >> v2:172.21.15.178:3300/0 conn(0x7f13d00aeb50 0x7f13d00aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13cfe00640 1 -- 172.21.15.59:0/3157868743 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281869108 0 0) 0x7f13d00b23e0 con 0x7f13d00af840 2024-04-25T09:02:12.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13cfe00640 1 -- 172.21.15.59:0/3157868743 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b4003530 con 0x7f13d00af840 2024-04-25T09:02:12.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13d5600640 1 -- 172.21.15.59:0/3157868743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d0146740 msgr2=0x7f13d006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:12.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13d5600640 1 --2- 172.21.15.59:0/3157868743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d0146740 0x7f13d006d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13d5600640 1 -- 172.21.15.59:0/3157868743 >> v1:172.21.15.59:6789/0 conn(0x7f13d00af840 legacy=0x7f13d00b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.591+0000 7f13d5600640 1 -- 172.21.15.59:0/3157868743 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d00ace60 con 0x7f13d00aeb50 2024-04-25T09:02:12.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13d5600640 1 --2- 172.21.15.59:0/3157868743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d00aeb50 0x7f13d00aefe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009d90 tx=0x7f13c801c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fb44faf2ee69be0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:12.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13cfe00640 1 -- 172.21.15.59:0/3157868743 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80b2070 con 0x7f13d00aeb50 2024-04-25T09:02:12.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13cfe00640 1 -- 172.21.15.59:0/3157868743 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c80a5920 con 0x7f13d00aeb50 2024-04-25T09:02:12.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13cfe00640 1 -- 172.21.15.59:0/3157868743 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c80a5cf0 con 0x7f13d00aeb50 2024-04-25T09:02:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13d7600640 1 -- 172.21.15.59:0/3157868743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d00aeb50 msgr2=0x7f13d00aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13d7600640 1 --2- 172.21.15.59:0/3157868743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d00aeb50 0x7f13d00aefe0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f13c8009d90 tx=0x7f13c801c970 comp rx=0 tx=0).stop 2024-04-25T09:02:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13d7600640 1 -- 172.21.15.59:0/3157868743 shutdown_connections 2024-04-25T09:02:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13d7600640 1 --2- 172.21.15.59:0/3157868743 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d00aeb50 0x7f13d00aefe0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13d7600640 1 --2- 172.21.15.59:0/3157868743 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d0146740 0x7f13d006d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13d7600640 1 -- 172.21.15.59:0/3157868743 >> 172.21.15.59:0/3157868743 conn(0x7f13d0066fa0 msgr2=0x7f13d006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13d7600640 1 -- 172.21.15.59:0/3157868743 shutdown_connections 2024-04-25T09:02:12.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13d7600640 1 -- 172.21.15.59:0/3157868743 wait complete. 2024-04-25T09:02:12.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13d7600640 1 Processor -- start 2024-04-25T09:02:12.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.595+0000 7f13d7600640 1 -- start start 2024-04-25T09:02:12.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d7600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d00aeb50 0x7f13d01393b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d7600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d00af840 0x7f13d01401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d7600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d0146740 0x7f13d0140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d7600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d006d970 con 0x7f13d00aeb50 2024-04-25T09:02:12.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d7600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d006d7f0 con 0x7f13d0146740 2024-04-25T09:02:12.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d7600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d00ae150 con 0x7f13d00af840 2024-04-25T09:02:12.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d4c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d00aeb50 0x7f13d01393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d4c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d00aeb50 0x7f13d01393b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60060/0 (socket says 172.21.15.59:60060) 2024-04-25T09:02:12.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d4c00640 1 -- 172.21.15.59:0/1487091698 learned_addr learned my addr 172.21.15.59:0/1487091698 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:12.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13c7e00640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d00af840 0x7f13d01401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d5600640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d0146740 0x7f13d0140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d4c00640 1 -- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d00af840 msgr2=0x7f13d01401e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d4c00640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d00af840 0x7f13d01401e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d4c00640 1 -- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d0146740 msgr2=0x7f13d0140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d4c00640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d0146740 0x7f13d0140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d4c00640 1 -- 172.21.15.59:0/1487091698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0143190 con 0x7f13d00aeb50 2024-04-25T09:02:12.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d5600640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d0146740 0x7f13d0140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:12.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d4c00640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d00aeb50 0x7f13d01393b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f13c000e870 tx=0x7f13c000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:12.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13cd600640 1 -- 172.21.15.59:0/1487091698 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c0017070 con 0x7f13d00aeb50 2024-04-25T09:02:12.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13cd600640 1 -- 172.21.15.59:0/1487091698 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c000c940 con 0x7f13d00aeb50 2024-04-25T09:02:12.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d7600640 1 -- 172.21.15.59:0/1487091698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d0143470 con 0x7f13d00aeb50 2024-04-25T09:02:12.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13cd600640 1 -- 172.21.15.59:0/1487091698 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000ccf0 con 0x7f13d00aeb50 2024-04-25T09:02:12.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d7600640 1 -- 172.21.15.59:0/1487091698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d0140fc0 con 0x7f13d00aeb50 2024-04-25T09:02:12.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.599+0000 7f13d7600640 1 -- 172.21.15.59:0/1487091698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d00745d0 con 0x7f13d00aeb50 2024-04-25T09:02:12.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.603+0000 7f13cd600640 1 -- 172.21.15.59:0/1487091698 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f13c001a070 con 0x7f13d00aeb50 2024-04-25T09:02:12.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.603+0000 7f13cd600640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f13ac066f60 0x7f13ac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.603+0000 7f13cd600640 1 -- 172.21.15.59:0/1487091698 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f13c00857b0 con 0x7f13d00aeb50 2024-04-25T09:02:12.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.603+0000 7f13c7e00640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f13ac066f60 0x7f13ac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.603+0000 7f13c7e00640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f13ac066f60 0x7f13ac069420 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f13d01f9be0 tx=0x7f13b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:12.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.607+0000 7f13cd600640 1 -- 172.21.15.59:0/1487091698 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f13c00562f0 con 0x7f13d00aeb50 2024-04-25T09:02:12.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 -- 172.21.15.59:0/1487091698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13d006b870 con 0x7f13d00aeb50 2024-04-25T09:02:12.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13cd600640 1 -- 172.21.15.59:0/1487091698 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f13c0055bf0 con 0x7f13d00aeb50 2024-04-25T09:02:12.763 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:12.763 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:08.938626+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:12.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 -- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f13ac066f60 msgr2=0x7f13ac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f13ac066f60 0x7f13ac069420 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f13d01f9be0 tx=0x7f13b8009040 comp rx=0 tx=0).stop 2024-04-25T09:02:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 -- 172.21.15.59:0/1487091698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d00aeb50 msgr2=0x7f13d01393b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d00aeb50 0x7f13d01393b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f13c000e870 tx=0x7f13c000ec70 comp rx=0 tx=0).stop 2024-04-25T09:02:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 -- 172.21.15.59:0/1487091698 shutdown_connections 2024-04-25T09:02:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f13ac066f60 0x7f13ac069420 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13d0146740 0x7f13d0140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13d00af840 0x7f13d01401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 --2- 172.21.15.59:0/1487091698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13d00aeb50 0x7f13d01393b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 -- 172.21.15.59:0/1487091698 >> 172.21.15.59:0/1487091698 conn(0x7f13d0066fa0 msgr2=0x7f13d0071220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 -- 172.21.15.59:0/1487091698 shutdown_connections 2024-04-25T09:02:12.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.771+0000 7f13d7600640 1 -- 172.21.15.59:0/1487091698 wait complete. 2024-04-25T09:02:12.784 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:02:12.784 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:12.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fdaa00640 1 Processor -- start 2024-04-25T09:02:12.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fdaa00640 1 -- start start 2024-04-25T09:02:12.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fdaa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fd415acd0 0x7f1fd415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fdaa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1fd415ee60 0x7f1fd40b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fdaa00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fd415bc40 con 0x7f1fd4144120 2024-04-25T09:02:12.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fdaa00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fd415e490 con 0x7f1fd415ee60 2024-04-25T09:02:12.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fdaa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd415b150 con 0x7f1fd415acd0 2024-04-25T09:02:12.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fd8a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1fd415ee60 0x7f1fd40b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fd8a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1fd415ee60 0x7f1fd40b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60062/0 (socket says 172.21.15.59:60062) 2024-04-25T09:02:12.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fd8a00640 1 -- 172.21.15.59:0/1964636261 learned_addr learned my addr 172.21.15.59:0/1964636261 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:12.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fcbe00640 1 --2- 172.21.15.59:0/1964636261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fd415acd0 0x7f1fd415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fd8a00640 1 -- 172.21.15.59:0/1964636261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fd415acd0 msgr2=0x7f1fd415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:12.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fd8a00640 1 --2- 172.21.15.59:0/1964636261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fd415acd0 0x7f1fd415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fd8a00640 1 -- 172.21.15.59:0/1964636261 >> v1:172.21.15.178:6789/0 conn(0x7f1fd4144120 legacy=0x7f1fd40ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.939+0000 7f1fd8a00640 1 -- 172.21.15.59:0/1964636261 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd415b3a0 con 0x7f1fd415ee60 2024-04-25T09:02:12.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.943+0000 7f1fd8a00640 1 --2- 172.21.15.59:0/1964636261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fd415ee60 0x7f1fd40b3090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009e50 tx=0x7f1fcc01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e9a77f704478c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.943+0000 7f1fd3400640 1 -- 172.21.15.59:0/1964636261 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0a5660 con 0x7f1fd415ee60 2024-04-25T09:02:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.943+0000 7f1fd3400640 1 -- 172.21.15.59:0/1964636261 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0a5800 con 0x7f1fd415ee60 2024-04-25T09:02:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.943+0000 7f1fd3400640 1 -- 172.21.15.59:0/1964636261 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0a5bd0 con 0x7f1fd415ee60 2024-04-25T09:02:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.943+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1964636261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fd415ee60 msgr2=0x7f1fd40b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.943+0000 7f1fdaa00640 1 --2- 172.21.15.59:0/1964636261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fd415ee60 0x7f1fd40b3090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009e50 tx=0x7f1fcc01c9a0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.943+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1964636261 shutdown_connections 2024-04-25T09:02:12.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.943+0000 7f1fdaa00640 1 --2- 172.21.15.59:0/1964636261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fd415ee60 0x7f1fd40b3090 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.943+0000 7f1fdaa00640 1 --2- 172.21.15.59:0/1964636261 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fd415acd0 0x7f1fd415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.943+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1964636261 >> 172.21.15.59:0/1964636261 conn(0x7f1fd4067080 msgr2=0x7f1fd406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.943+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1964636261 shutdown_connections 2024-04-25T09:02:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.943+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1964636261 wait complete. 2024-04-25T09:02:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fdaa00640 1 Processor -- start 2024-04-25T09:02:12.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fdaa00640 1 -- start start 2024-04-25T09:02:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fdaa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fd4144120 0x7f1fd4140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fdaa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fd415acd0 0x7f1fd4168040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fdaa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fd415ee60 0x7f1fd415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fdaa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd4166010 con 0x7f1fd415acd0 2024-04-25T09:02:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fdaa00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd4165e90 con 0x7f1fd415ee60 2024-04-25T09:02:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fdaa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fd4166190 con 0x7f1fd4144120 2024-04-25T09:02:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fcbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fd415acd0 0x7f1fd4168040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fcbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fd415acd0 0x7f1fd4168040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60070/0 (socket says 172.21.15.59:60070) 2024-04-25T09:02:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fcbe00640 1 -- 172.21.15.59:0/1025938297 learned_addr learned my addr 172.21.15.59:0/1025938297 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:12.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fd8a00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fd415ee60 0x7f1fd415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fd3e00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fd4144120 0x7f1fd4140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fcbe00640 1 -- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fd4144120 msgr2=0x7f1fd4140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fcbe00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fd4144120 0x7f1fd4140bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fcbe00640 1 -- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fd415ee60 msgr2=0x7f1fd415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fcbe00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fd415ee60 0x7f1fd415a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fcbe00640 1 -- 172.21.15.59:0/1025938297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd4140990 con 0x7f1fd415acd0 2024-04-25T09:02:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fcbe00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fd415acd0 0x7f1fd4168040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00e960 tx=0x7f1fbc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fd0c00640 1 -- 172.21.15.59:0/1025938297 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc017070 con 0x7f1fd415acd0 2024-04-25T09:02:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fd0c00640 1 -- 172.21.15.59:0/1025938297 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc00ca00 con 0x7f1fd415acd0 2024-04-25T09:02:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fd0c00640 1 -- 172.21.15.59:0/1025938297 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc00cdb0 con 0x7f1fd415acd0 2024-04-25T09:02:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1025938297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fd41fa980 con 0x7f1fd415acd0 2024-04-25T09:02:12.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1025938297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fd415c9e0 con 0x7f1fd415acd0 2024-04-25T09:02:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.947+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1025938297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fd40745d0 con 0x7f1fd415acd0 2024-04-25T09:02:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.951+0000 7f1fd0c00640 1 -- 172.21.15.59:0/1025938297 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1fbc01a070 con 0x7f1fd415acd0 2024-04-25T09:02:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.951+0000 7f1fd0c00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1fb0066f90 0x7f1fb0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:12.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.951+0000 7f1fd0c00640 1 -- 172.21.15.59:0/1025938297 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f1fbc0858d0 con 0x7f1fd415acd0 2024-04-25T09:02:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.951+0000 7f1fd3e00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1fb0066f90 0x7f1fb0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:12.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.951+0000 7f1fd3e00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1fb0066f90 0x7f1fb0069450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40015b0 tx=0x7f1fc4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:12.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:12.955+0000 7f1fd0c00640 1 -- 172.21.15.59:0/1025938297 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1fd4140990 con 0x7f1fd415acd0 2024-04-25T09:02:13.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.119+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1025938297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fd40cbcb0 con 0x7f1fd415acd0 2024-04-25T09:02:13.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.119+0000 7f1fd0c00640 1 -- 172.21.15.59:0/1025938297 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fbc055d20 con 0x7f1fd415acd0 2024-04-25T09:02:13.112 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:02:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.123+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1fb0066f90 msgr2=0x7f1fb0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.123+0000 7f1fdaa00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1fb0066f90 0x7f1fb0069450 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40015b0 tx=0x7f1fc4009040 comp rx=0 tx=0).stop 2024-04-25T09:02:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.123+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1025938297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fd415acd0 msgr2=0x7f1fd4168040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.123+0000 7f1fdaa00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fd415acd0 0x7f1fd4168040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00e960 tx=0x7f1fbc00ee20 comp rx=0 tx=0).stop 2024-04-25T09:02:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.123+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1025938297 shutdown_connections 2024-04-25T09:02:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.123+0000 7f1fdaa00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1fb0066f90 0x7f1fb0069450 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.123+0000 7f1fdaa00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fd415ee60 0x7f1fd415a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.123+0000 7f1fdaa00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fd415acd0 0x7f1fd4168040 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.123+0000 7f1fdaa00640 1 --2- 172.21.15.59:0/1025938297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fd4144120 0x7f1fd4140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.123+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1025938297 >> 172.21.15.59:0/1025938297 conn(0x7f1fd4067080 msgr2=0x7f1fd406d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.123+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1025938297 shutdown_connections 2024-04-25T09:02:13.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.123+0000 7f1fdaa00640 1 -- 172.21.15.59:0/1025938297 wait complete. 2024-04-25T09:02:13.133 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:13.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.283+0000 7f4daca00640 1 Processor -- start 2024-04-25T09:02:13.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.283+0000 7f4daca00640 1 -- start start 2024-04-25T09:02:13.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4daca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4da815b9e0 0x7f4da80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4daca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4da80d0080 0x7f4da815f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4daca00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4da815f8f0 0x7f4da815bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4daca00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da815fd20 con 0x7f4da80d0080 2024-04-25T09:02:13.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4daca00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da809ade0 con 0x7f4da815f8f0 2024-04-25T09:02:13.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4daca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da8099a60 con 0x7f4da815b9e0 2024-04-25T09:02:13.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4d9de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4da80d0080 0x7f4da815f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4d9de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4da80d0080 0x7f4da815f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60072/0 (socket says 172.21.15.59:60072) 2024-04-25T09:02:13.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4d9de00640 1 -- 172.21.15.59:0/1790441640 learned_addr learned my addr 172.21.15.59:0/1790441640 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:13.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4da7200640 1 --2- 172.21.15.59:0/1790441640 >> v2:172.21.15.178:3300/0 conn(0x7f4da815f8f0 0x7f4da815bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4da6800640 1 --2- 172.21.15.59:0/1790441640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4da815b9e0 0x7f4da80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4d9de00640 1 -- 172.21.15.59:0/1790441640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4da815b9e0 msgr2=0x7f4da80cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:13.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4d9de00640 1 --2- 172.21.15.59:0/1790441640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4da815b9e0 0x7f4da80cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4d9de00640 1 -- 172.21.15.59:0/1790441640 >> v2:172.21.15.178:3300/0 conn(0x7f4da815f8f0 msgr2=0x7f4da815bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:13.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4d9de00640 1 --2- 172.21.15.59:0/1790441640 >> v2:172.21.15.178:3300/0 conn(0x7f4da815f8f0 0x7f4da815bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.287+0000 7f4d9de00640 1 -- 172.21.15.59:0/1790441640 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8099d40 con 0x7f4da80d0080 2024-04-25T09:02:13.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4d9de00640 1 --2- 172.21.15.59:0/1790441640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da80d0080 0x7f4da815f3b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4da8073200 tx=0x7f4d9001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bdd09cae9e97cfa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:13.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4da5e00640 1 -- 172.21.15.59:0/1790441640 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d900a6040 con 0x7f4da80d0080 2024-04-25T09:02:13.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4da5e00640 1 -- 172.21.15.59:0/1790441640 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d900af070 con 0x7f4da80d0080 2024-04-25T09:02:13.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4da5e00640 1 -- 172.21.15.59:0/1790441640 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d900aa860 con 0x7f4da80d0080 2024-04-25T09:02:13.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 -- 172.21.15.59:0/1790441640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da80d0080 msgr2=0x7f4da815f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 --2- 172.21.15.59:0/1790441640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da80d0080 0x7f4da815f3b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4da8073200 tx=0x7f4d9001c520 comp rx=0 tx=0).stop 2024-04-25T09:02:13.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 -- 172.21.15.59:0/1790441640 shutdown_connections 2024-04-25T09:02:13.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 --2- 172.21.15.59:0/1790441640 >> v2:172.21.15.178:3300/0 conn(0x7f4da815f8f0 0x7f4da815bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 --2- 172.21.15.59:0/1790441640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da80d0080 0x7f4da815f3b0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 --2- 172.21.15.59:0/1790441640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4da815b9e0 0x7f4da80cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 -- 172.21.15.59:0/1790441640 >> 172.21.15.59:0/1790441640 conn(0x7f4da80b3030 msgr2=0x7f4da80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:13.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 -- 172.21.15.59:0/1790441640 shutdown_connections 2024-04-25T09:02:13.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 -- 172.21.15.59:0/1790441640 wait complete. 2024-04-25T09:02:13.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 Processor -- start 2024-04-25T09:02:13.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 -- start start 2024-04-25T09:02:13.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da80d0080 0x7f4da80ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4da815b9e0 0x7f4da80c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4da815f8f0 0x7f4da80b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80cc050 con 0x7f4da80d0080 2024-04-25T09:02:13.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da809a8c0 con 0x7f4da815f8f0 2024-04-25T09:02:13.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4daca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80cc1d0 con 0x7f4da815b9e0 2024-04-25T09:02:13.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4da6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da80d0080 0x7f4da80ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4da6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da80d0080 0x7f4da80ca5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60074/0 (socket says 172.21.15.59:60074) 2024-04-25T09:02:13.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.291+0000 7f4da6800640 1 -- 172.21.15.59:0/3933701043 learned_addr learned my addr 172.21.15.59:0/3933701043 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4da7200640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4da815f8f0 0x7f4da80b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4d9de00640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4da815b9e0 0x7f4da80c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4da6800640 1 -- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4da815b9e0 msgr2=0x7f4da80c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4da6800640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4da815b9e0 0x7f4da80c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4da6800640 1 -- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4da815f8f0 msgr2=0x7f4da80b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4da6800640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4da815f8f0 0x7f4da80b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4da6800640 1 -- 172.21.15.59:0/3933701043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da80cb050 con 0x7f4da80d0080 2024-04-25T09:02:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4da6800640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da80d0080 0x7f4da80ca5e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800d830 tx=0x7f4d9800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4d9f400640 1 -- 172.21.15.59:0/3933701043 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9800b6c0 con 0x7f4da80d0080 2024-04-25T09:02:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4d9f400640 1 -- 172.21.15.59:0/3933701043 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d98019070 con 0x7f4da80d0080 2024-04-25T09:02:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4daca00640 1 -- 172.21.15.59:0/3933701043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da80cb330 con 0x7f4da80d0080 2024-04-25T09:02:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4d9f400640 1 -- 172.21.15.59:0/3933701043 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9800ba60 con 0x7f4da80d0080 2024-04-25T09:02:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4daca00640 1 -- 172.21.15.59:0/3933701043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da80b4ef0 con 0x7f4da80d0080 2024-04-25T09:02:13.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4daca00640 1 -- 172.21.15.59:0/3933701043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da80745d0 con 0x7f4da80d0080 2024-04-25T09:02:13.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4d9f400640 1 -- 172.21.15.59:0/3933701043 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4d9801e460 con 0x7f4da80d0080 2024-04-25T09:02:13.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4d9f400640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4d84066f60 0x7f4d84069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.295+0000 7f4d9f400640 1 -- 172.21.15.59:0/3933701043 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f4d98085ab0 con 0x7f4da80d0080 2024-04-25T09:02:13.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.299+0000 7f4d9de00640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4d84066f60 0x7f4d84069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.299+0000 7f4d9de00640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4d84066f60 0x7f4d84069420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4d900ae000 tx=0x7f4d900a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:13.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.299+0000 7f4d9f400640 1 -- 172.21.15.59:0/3933701043 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4d98055f90 con 0x7f4da80d0080 2024-04-25T09:02:13.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.467+0000 7f4daca00640 1 -- 172.21.15.59:0/3933701043 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4da80cb500 con 0x7f4da80d0080 2024-04-25T09:02:13.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.467+0000 7f4d9f400640 1 -- 172.21.15.59:0/3933701043 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d9805a030 con 0x7f4da80d0080 2024-04-25T09:02:13.459 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.467+0000 7f4daca00640 1 -- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4d84066f60 msgr2=0x7f4d84069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.467+0000 7f4daca00640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4d84066f60 0x7f4d84069420 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4d900ae000 tx=0x7f4d900a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.467+0000 7f4daca00640 1 -- 172.21.15.59:0/3933701043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da80d0080 msgr2=0x7f4da80ca5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.467+0000 7f4daca00640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da80d0080 0x7f4da80ca5e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4d9800d830 tx=0x7f4d9800dcf0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.467+0000 7f4daca00640 1 -- 172.21.15.59:0/3933701043 shutdown_connections 2024-04-25T09:02:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.467+0000 7f4daca00640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4d84066f60 0x7f4d84069420 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.467+0000 7f4daca00640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4da815f8f0 0x7f4da80b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.467+0000 7f4daca00640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4da815b9e0 0x7f4da80c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.467+0000 7f4daca00640 1 --2- 172.21.15.59:0/3933701043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4da80d0080 0x7f4da80ca5e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.467+0000 7f4daca00640 1 -- 172.21.15.59:0/3933701043 >> 172.21.15.59:0/3933701043 conn(0x7f4da80b3030 msgr2=0x7f4da815efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.471+0000 7f4daca00640 1 -- 172.21.15.59:0/3933701043 shutdown_connections 2024-04-25T09:02:13.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.471+0000 7f4daca00640 1 -- 172.21.15.59:0/3933701043 wait complete. 2024-04-25T09:02:13.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:13.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.631+0000 7f44a1400640 1 Processor -- start 2024-04-25T09:02:13.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.631+0000 7f44a1400640 1 -- start start 2024-04-25T09:02:13.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f44a1400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c15b910 0x7f449c0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f44a1400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f449c0cf3c0 0x7f449c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f44a1400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f449c0cd370 0x7f449c099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f44a1400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c0d02a0 con 0x7f449c0cf3c0 2024-04-25T09:02:13.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f44a1400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c0cc350 con 0x7f449c0cd370 2024-04-25T09:02:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f44a1400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0cc630 con 0x7f449c15b910 2024-04-25T09:02:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f4491e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f449c0cf3c0 0x7f449c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f4491e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f449c0cf3c0 0x7f449c0cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60084/0 (socket says 172.21.15.59:60084) 2024-04-25T09:02:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f4491e00640 1 -- 172.21.15.59:0/256567021 learned_addr learned my addr 172.21.15.59:0/256567021 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f449b200640 1 --2- 172.21.15.59:0/256567021 >> v2:172.21.15.178:3300/0 conn(0x7f449c0cd370 0x7f449c099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f449a800640 1 --2- 172.21.15.59:0/256567021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c15b910 0x7f449c0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f4491e00640 1 -- 172.21.15.59:0/256567021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c15b910 msgr2=0x7f449c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:13.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f4491e00640 1 --2- 172.21.15.59:0/256567021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c15b910 0x7f449c0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f4491e00640 1 -- 172.21.15.59:0/256567021 >> v2:172.21.15.178:3300/0 conn(0x7f449c0cd370 msgr2=0x7f449c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f4491e00640 1 --2- 172.21.15.59:0/256567021 >> v2:172.21.15.178:3300/0 conn(0x7f449c0cd370 0x7f449c099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f4491e00640 1 -- 172.21.15.59:0/256567021 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c0cc910 con 0x7f449c0cf3c0 2024-04-25T09:02:13.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.635+0000 7f4491e00640 1 --2- 172.21.15.59:0/256567021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cf3c0 0x7f449c0cce30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f449c072fa0 tx=0x7f448401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd8c0ba774a9768 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:13.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f4499e00640 1 -- 172.21.15.59:0/256567021 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840ab5f0 con 0x7f449c0cf3c0 2024-04-25T09:02:13.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f4499e00640 1 -- 172.21.15.59:0/256567021 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44840b0070 con 0x7f449c0cf3c0 2024-04-25T09:02:13.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f4499e00640 1 -- 172.21.15.59:0/256567021 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840ab9b0 con 0x7f449c0cf3c0 2024-04-25T09:02:13.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 -- 172.21.15.59:0/256567021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cf3c0 msgr2=0x7f449c0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 --2- 172.21.15.59:0/256567021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cf3c0 0x7f449c0cce30 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f449c072fa0 tx=0x7f448401c520 comp rx=0 tx=0).stop 2024-04-25T09:02:13.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 -- 172.21.15.59:0/256567021 shutdown_connections 2024-04-25T09:02:13.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 --2- 172.21.15.59:0/256567021 >> v2:172.21.15.178:3300/0 conn(0x7f449c0cd370 0x7f449c099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 --2- 172.21.15.59:0/256567021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cf3c0 0x7f449c0cce30 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 --2- 172.21.15.59:0/256567021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c15b910 0x7f449c0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 -- 172.21.15.59:0/256567021 >> 172.21.15.59:0/256567021 conn(0x7f449c0b3200 msgr2=0x7f449c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:13.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 -- 172.21.15.59:0/256567021 shutdown_connections 2024-04-25T09:02:13.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 -- 172.21.15.59:0/256567021 wait complete. 2024-04-25T09:02:13.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 Processor -- start 2024-04-25T09:02:13.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 -- start start 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449c0cd370 0x7f449c14ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cf3c0 0x7f449c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c15b910 0x7f449c157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c15f660 con 0x7f449c0cf3c0 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c09a3b0 con 0x7f449c0cd370 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f44a1400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c15f7e0 con 0x7f449c15b910 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f4491e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cf3c0 0x7f449c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f4491e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cf3c0 0x7f449c156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60096/0 (socket says 172.21.15.59:60096) 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.639+0000 7f4491e00640 1 -- 172.21.15.59:0/1646855730 learned_addr learned my addr 172.21.15.59:0/1646855730 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f449a800640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449c0cd370 0x7f449c14ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f4491e00640 1 -- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c15b910 msgr2=0x7f449c157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f449b200640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c15b910 0x7f449c157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f4491e00640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c15b910 0x7f449c157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f4491e00640 1 -- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449c0cd370 msgr2=0x7f449c14ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f4491e00640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449c0cd370 0x7f449c14ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f4491e00640 1 -- 172.21.15.59:0/1646855730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c1fa9f0 con 0x7f449c0cf3c0 2024-04-25T09:02:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f449a800640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449c0cd370 0x7f449c14ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f449b200640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c15b910 0x7f449c157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f4491e00640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cf3c0 0x7f449c156bc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f448401ca00 tx=0x7f448401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f4493400640 1 -- 172.21.15.59:0/1646855730 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840be3f0 con 0x7f449c0cf3c0 2024-04-25T09:02:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f4493400640 1 -- 172.21.15.59:0/1646855730 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44840be5b0 con 0x7f449c0cf3c0 2024-04-25T09:02:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f4493400640 1 -- 172.21.15.59:0/1646855730 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840be9a0 con 0x7f449c0cf3c0 2024-04-25T09:02:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f44a1400640 1 -- 172.21.15.59:0/1646855730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c1facd0 con 0x7f449c0cf3c0 2024-04-25T09:02:13.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f44a1400640 1 -- 172.21.15.59:0/1646855730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c1fb290 con 0x7f449c0cf3c0 2024-04-25T09:02:13.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f44a1400640 1 -- 172.21.15.59:0/1646855730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c0745d0 con 0x7f449c0cf3c0 2024-04-25T09:02:13.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f4493400640 1 -- 172.21.15.59:0/1646855730 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f44840b43f0 con 0x7f449c0cf3c0 2024-04-25T09:02:13.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f4493400640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4478066f60 0x7f4478069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.643+0000 7f4493400640 1 -- 172.21.15.59:0/1646855730 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f448411f720 con 0x7f449c0cf3c0 2024-04-25T09:02:13.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.647+0000 7f449a800640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4478066f60 0x7f4478069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.647+0000 7f449a800640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4478066f60 0x7f4478069420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f449c150aa0 tx=0x7f448c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:13.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.647+0000 7f4493400640 1 -- 172.21.15.59:0/1646855730 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f44840c4060 con 0x7f449c0cf3c0 2024-04-25T09:02:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.807+0000 7f44a1400640 1 -- 172.21.15.59:0/1646855730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f449c0cdcd0 con 0x7f449c0cf3c0 2024-04-25T09:02:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f4493400640 1 -- 172.21.15.59:0/1646855730 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4484016110 con 0x7f449c0cf3c0 2024-04-25T09:02:13.801 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:02:13.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f44a1400640 1 -- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4478066f60 msgr2=0x7f4478069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f44a1400640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4478066f60 0x7f4478069420 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f449c150aa0 tx=0x7f448c008040 comp rx=0 tx=0).stop 2024-04-25T09:02:13.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f44a1400640 1 -- 172.21.15.59:0/1646855730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cf3c0 msgr2=0x7f449c156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f44a1400640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cf3c0 0x7f449c156bc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f448401ca00 tx=0x7f448401ad60 comp rx=0 tx=0).stop 2024-04-25T09:02:13.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f44a1400640 1 -- 172.21.15.59:0/1646855730 shutdown_connections 2024-04-25T09:02:13.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f44a1400640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4478066f60 0x7f4478069420 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f44a1400640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c15b910 0x7f449c157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f44a1400640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cf3c0 0x7f449c156bc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f44a1400640 1 --2- 172.21.15.59:0/1646855730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449c0cd370 0x7f449c14ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f44a1400640 1 -- 172.21.15.59:0/1646855730 >> 172.21.15.59:0/1646855730 conn(0x7f449c0b3200 msgr2=0x7f449c0c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:13.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f44a1400640 1 -- 172.21.15.59:0/1646855730 shutdown_connections 2024-04-25T09:02:13.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.811+0000 7f44a1400640 1 -- 172.21.15.59:0/1646855730 wait complete. 2024-04-25T09:02:13.822 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:02:13.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1f4c00640 1 Processor -- start 2024-04-25T09:02:13.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1f4c00640 1 -- start start 2024-04-25T09:02:13.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1f4c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1f009a170 0x7fe1f00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1f4c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f006bf30 0x7fe1f00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1f4c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f015e040 con 0x7fe1f015dc60 2024-04-25T09:02:13.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1f4c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f00cff80 con 0x7fe1f009a170 2024-04-25T09:02:13.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1f4c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00d0260 con 0x7fe1f006bf30 2024-04-25T09:02:13.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1e7e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1f009a170 0x7fe1f00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1ee800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f006bf30 0x7fe1f00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1e7e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe1f009a170 0x7fe1f00d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:49472/0 (socket says 172.21.15.59:49472) 2024-04-25T09:02:13.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1e7e00640 1 -- 172.21.15.59:0/3366470429 learned_addr learned my addr 172.21.15.59:0/3366470429 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:13.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1e7e00640 1 -- 172.21.15.59:0/3366470429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f006bf30 msgr2=0x7fe1f00cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:13.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1e7e00640 1 --2- 172.21.15.59:0/3366470429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f006bf30 0x7fe1f00cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1e7e00640 1 -- 172.21.15.59:0/3366470429 >> v1:172.21.15.178:6789/0 conn(0x7fe1f015dc60 legacy=0x7fe1f0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1e7e00640 1 -- 172.21.15.59:0/3366470429 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f00d0540 con 0x7fe1f009a170 2024-04-25T09:02:13.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.975+0000 7fe1ee800640 1 --2- 172.21.15.59:0/3366470429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f006bf30 0x7fe1f00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.979+0000 7fe1e7e00640 1 --2- 172.21.15.59:0/3366470429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f009a170 0x7fe1f00d1020 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009870 tx=0x7fe1d801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4da42ac8f35a8f57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.979+0000 7fe1ed400640 1 -- 172.21.15.59:0/3366470429 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80aa600 con 0x7fe1f009a170 2024-04-25T09:02:13.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.979+0000 7fe1ed400640 1 -- 172.21.15.59:0/3366470429 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d80af070 con 0x7fe1f009a170 2024-04-25T09:02:13.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.979+0000 7fe1ed400640 1 -- 172.21.15.59:0/3366470429 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80aa9c0 con 0x7fe1f009a170 2024-04-25T09:02:13.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.979+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3366470429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f009a170 msgr2=0x7fe1f00d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.979+0000 7fe1f4c00640 1 --2- 172.21.15.59:0/3366470429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f009a170 0x7fe1f00d1020 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe1d8009870 tx=0x7fe1d801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.979+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3366470429 shutdown_connections 2024-04-25T09:02:13.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.979+0000 7fe1f4c00640 1 --2- 172.21.15.59:0/3366470429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f006bf30 0x7fe1f00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.979+0000 7fe1f4c00640 1 --2- 172.21.15.59:0/3366470429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f009a170 0x7fe1f00d1020 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.979+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3366470429 >> 172.21.15.59:0/3366470429 conn(0x7fe1f00b3200 msgr2=0x7fe1f00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:13.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.979+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3366470429 shutdown_connections 2024-04-25T09:02:13.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.979+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3366470429 wait complete. 2024-04-25T09:02:13.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1f4c00640 1 Processor -- start 2024-04-25T09:02:13.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1f4c00640 1 -- start start 2024-04-25T09:02:13.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1f4c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f006bf30 0x7fe1f00c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1f4c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f009a170 0x7fe1f0155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1f4c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f015dc60 0x7fe1f0158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1f4c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00cc6f0 con 0x7fe1f015dc60 2024-04-25T09:02:13.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1f4c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00cc570 con 0x7fe1f009a170 2024-04-25T09:02:13.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1f4c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00cc870 con 0x7fe1f006bf30 2024-04-25T09:02:13.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1ee800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f015dc60 0x7fe1f0158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1ee800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f015dc60 0x7fe1f0158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60104/0 (socket says 172.21.15.59:60104) 2024-04-25T09:02:13.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1e7e00640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f009a170 0x7fe1f0155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1ee800640 1 -- 172.21.15.59:0/3931005117 learned_addr learned my addr 172.21.15.59:0/3931005117 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:13.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1ede00640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f006bf30 0x7fe1f00c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1ee800640 1 -- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f006bf30 msgr2=0x7fe1f00c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1ee800640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f006bf30 0x7fe1f00c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1ee800640 1 -- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f009a170 msgr2=0x7fe1f0155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:13.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1ee800640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f009a170 0x7fe1f0155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:13.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1ee800640 1 -- 172.21.15.59:0/3931005117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f00c9a40 con 0x7fe1f015dc60 2024-04-25T09:02:13.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1ee800640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f015dc60 0x7fe1f0158d40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800efc0 tx=0x7fe1e8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:13.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1e6000640 1 -- 172.21.15.59:0/3931005117 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8018030 con 0x7fe1f015dc60 2024-04-25T09:02:13.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1e6000640 1 -- 172.21.15.59:0/3931005117 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e800cde0 con 0x7fe1f015dc60 2024-04-25T09:02:13.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3931005117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f00c9d20 con 0x7fe1f015dc60 2024-04-25T09:02:13.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1e6000640 1 -- 172.21.15.59:0/3931005117 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e8003bc0 con 0x7fe1f015dc60 2024-04-25T09:02:13.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3931005117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f009bcb0 con 0x7fe1f015dc60 2024-04-25T09:02:13.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.983+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3931005117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f00ca240 con 0x7fe1f015dc60 2024-04-25T09:02:13.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.987+0000 7fe1e6000640 1 -- 172.21.15.59:0/3931005117 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe1e801b070 con 0x7fe1f015dc60 2024-04-25T09:02:13.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.987+0000 7fe1e6000640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe1cc066f60 0x7fe1cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:13.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.987+0000 7fe1e6000640 1 -- 172.21.15.59:0/3931005117 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fe1e8085d40 con 0x7fe1f015dc60 2024-04-25T09:02:13.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.987+0000 7fe1ede00640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe1cc066f60 0x7fe1cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:13.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.987+0000 7fe1ede00640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe1cc066f60 0x7fe1cc069420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00cb600 tx=0x7fe1e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:13.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:13.991+0000 7fe1e6000640 1 -- 172.21.15.59:0/3931005117 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe1f00ca240 con 0x7fe1f015dc60 2024-04-25T09:02:14.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.151+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3931005117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe1f00745d0 con 0x7fe1f015dc60 2024-04-25T09:02:14.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.151+0000 7fe1e6000640 1 -- 172.21.15.59:0/3931005117 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe1e8085070 con 0x7fe1f015dc60 2024-04-25T09:02:14.143 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:14.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.151+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe1cc066f60 msgr2=0x7fe1cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.151+0000 7fe1f4c00640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe1cc066f60 0x7fe1cc069420 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00cb600 tx=0x7fe1e0009040 comp rx=0 tx=0).stop 2024-04-25T09:02:14.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.151+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3931005117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f015dc60 msgr2=0x7fe1f0158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.151+0000 7fe1f4c00640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f015dc60 0x7fe1f0158d40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe1e800efc0 tx=0x7fe1e8009f90 comp rx=0 tx=0).stop 2024-04-25T09:02:14.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.155+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3931005117 shutdown_connections 2024-04-25T09:02:14.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.155+0000 7fe1f4c00640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe1cc066f60 0x7fe1cc069420 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.155+0000 7fe1f4c00640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1f015dc60 0x7fe1f0158d40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.155+0000 7fe1f4c00640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe1f009a170 0x7fe1f0155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.155+0000 7fe1f4c00640 1 --2- 172.21.15.59:0/3931005117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1f006bf30 0x7fe1f00c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.155+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3931005117 >> 172.21.15.59:0/3931005117 conn(0x7fe1f00b3200 msgr2=0x7fe1f0070340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:14.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.155+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3931005117 shutdown_connections 2024-04-25T09:02:14.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.155+0000 7fe1f4c00640 1 -- 172.21.15.59:0/3931005117 wait complete. 2024-04-25T09:02:14.172 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:02:14.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:14.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.319+0000 7f18bec00640 1 Processor -- start 2024-04-25T09:02:14.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bec00640 1 -- start start 2024-04-25T09:02:14.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bec00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815efa0 0x7f18b8099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bec00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f18b80b21b0 0x7f18b8099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bec00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b80cd6c0 con 0x7f18b80cdb70 2024-04-25T09:02:14.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bec00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b80b3fe0 con 0x7f18b80b21b0 2024-04-25T09:02:14.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bec00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80cce20 con 0x7f18b815efa0 2024-04-25T09:02:14.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bce00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f18b80cdb70 0x7f18b80cf460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34614/0 (socket says 172.21.15.59:34614) 2024-04-25T09:02:14.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bce00640 1 -- 172.21.15.59:0/681148821 learned_addr learned my addr 172.21.15.59:0/681148821 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:14.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18be200640 1 --2- 172.21.15.59:0/681148821 >> v2:172.21.15.178:3300/0 conn(0x7f18b80b21b0 0x7f18b8099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bd800640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815efa0 0x7f18b8099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474003505 0 0) 0x7f18b80cd6c0 con 0x7f18b80cdb70 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a0003530 con 0x7f18b80cdb70 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2231282237 0 0) 0x7f18a0003530 con 0x7f18b80cdb70 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815efa0 msgr2=0x7f18b8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815efa0 0x7f18b8099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 >> v2:172.21.15.178:3300/0 conn(0x7f18b80b21b0 msgr2=0x7f18b8099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 --2- 172.21.15.59:0/681148821 >> v2:172.21.15.178:3300/0 conn(0x7f18b80b21b0 0x7f18b8099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80cd100 con 0x7f18b80cdb70 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f18a4001680 con 0x7f18b80cdb70 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 >> v1:172.21.15.59:6789/0 conn(0x7f18b80cdb70 legacy=0x7f18b80cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815efa0 0x7f18a00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a0003f40 0x7f18a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18a0004d50 0x7f18a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b3fe0 con 0x7f18a0003f40 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80cce20 con 0x7f18a0004d50 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a000b9d0 con 0x7f18b815efa0 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bce00640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a0003f40 0x7f18a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bd800640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815efa0 0x7f18a00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18be200640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18a0004d50 0x7f18a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bce00640 1 -- 172.21.15.59:0/681148821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815efa0 msgr2=0x7f18a00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bce00640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815efa0 0x7f18a00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bce00640 1 -- 172.21.15.59:0/681148821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18a0004d50 msgr2=0x7f18a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bce00640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18a0004d50 0x7f18a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18bce00640 1 -- 172.21.15.59:0/681148821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a0003530 con 0x7f18a0003f40 2024-04-25T09:02:14.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.323+0000 7f18be200640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18a0004d50 0x7f18a00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.327+0000 7f18bce00640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a0003f40 0x7f18a0004810 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f18a4001060 tx=0x7f18a401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96fb7ad254ad6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.327+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4007d80 con 0x7f18a0003f40 2024-04-25T09:02:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.327+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4005b00 con 0x7f18a0003f40 2024-04-25T09:02:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.327+0000 7f18b7e00640 1 -- 172.21.15.59:0/681148821 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4007070 con 0x7f18a0003f40 2024-04-25T09:02:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.327+0000 7f18bec00640 1 -- 172.21.15.59:0/681148821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a0003f40 msgr2=0x7f18a0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.327+0000 7f18bec00640 1 --2- 172.21.15.59:0/681148821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a0003f40 0x7f18a0004810 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f18a4001060 tx=0x7f18a401f370 comp rx=0 tx=0).stop 2024-04-25T09:02:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.327+0000 7f18be200640 1 -- 172.21.15.59:0/681148821 reap_dead start 2024-04-25T09:02:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.327+0000 7f18bec00640 1 -- 172.21.15.59:0/681148821 shutdown_connections 2024-04-25T09:02:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.327+0000 7f18bec00640 1 -- 172.21.15.59:0/681148821 >> 172.21.15.59:0/681148821 conn(0x7f18b80b3050 msgr2=0x7f18b80b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.327+0000 7f18bec00640 1 -- 172.21.15.59:0/681148821 shutdown_connections 2024-04-25T09:02:14.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.327+0000 7f18bec00640 1 -- 172.21.15.59:0/681148821 wait complete. 2024-04-25T09:02:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bec00640 1 Processor -- start 2024-04-25T09:02:14.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bec00640 1 -- start start 2024-04-25T09:02:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bec00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a0003f40 0x7f18b815d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bec00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b80c6d30 0x7f18b80b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bec00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18b80b59c0 0x7f18b80cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bec00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b3b70 con 0x7f18b80c6d30 2024-04-25T09:02:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bec00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b815f380 con 0x7f18b80b59c0 2024-04-25T09:02:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bec00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80b3cf0 con 0x7f18a0003f40 2024-04-25T09:02:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b80c6d30 0x7f18b80b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b80c6d30 0x7f18b80b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60120/0 (socket says 172.21.15.59:60120) 2024-04-25T09:02:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bce00640 1 -- 172.21.15.59:0/1714591315 learned_addr learned my addr 172.21.15.59:0/1714591315 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:14.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bd800640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a0003f40 0x7f18b815d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18be200640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18b80b59c0 0x7f18b80cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bce00640 1 -- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a0003f40 msgr2=0x7f18b815d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bce00640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a0003f40 0x7f18b815d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bce00640 1 -- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18b80b59c0 msgr2=0x7f18b80cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bce00640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18b80b59c0 0x7f18b80cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bce00640 1 -- 172.21.15.59:0/1714591315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b80c7210 con 0x7f18b80c6d30 2024-04-25T09:02:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bd800640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a0003f40 0x7f18b815d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:14.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bce00640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b80c6d30 0x7f18b80b5480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f18a401f1a0 tx=0x7f18a0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18b5600640 1 -- 172.21.15.59:0/1714591315 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4005cb0 con 0x7f18b80c6d30 2024-04-25T09:02:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18b5600640 1 -- 172.21.15.59:0/1714591315 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4005e50 con 0x7f18b80c6d30 2024-04-25T09:02:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18b5600640 1 -- 172.21.15.59:0/1714591315 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a40049f0 con 0x7f18b80c6d30 2024-04-25T09:02:14.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bec00640 1 -- 172.21.15.59:0/1714591315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b80c74f0 con 0x7f18b80c6d30 2024-04-25T09:02:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bec00640 1 -- 172.21.15.59:0/1714591315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b80c7ab0 con 0x7f18b80c6d30 2024-04-25T09:02:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.331+0000 7f18bec00640 1 -- 172.21.15.59:0/1714591315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b804efa0 con 0x7f18b80c6d30 2024-04-25T09:02:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.335+0000 7f18b5600640 1 -- 172.21.15.59:0/1714591315 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f18a40ba030 con 0x7f18b80c6d30 2024-04-25T09:02:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.335+0000 7f18b5600640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1898066f60 0x7f1898069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.335+0000 7f18b5600640 1 -- 172.21.15.59:0/1714591315 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f18a4121ca0 con 0x7f18b80c6d30 2024-04-25T09:02:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.335+0000 7f18bd800640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1898066f60 0x7f1898069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.335+0000 7f18bd800640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1898066f60 0x7f1898069420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009a10 tx=0x7f18ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.339+0000 7f18b5600640 1 -- 172.21.15.59:0/1714591315 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f18a40190e0 con 0x7f18b80c6d30 2024-04-25T09:02:14.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.499+0000 7f18bec00640 1 -- 172.21.15.59:0/1714591315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18b80b1dc0 con 0x7f18b80c6d30 2024-04-25T09:02:14.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18b5600640 1 -- 172.21.15.59:0/1714591315 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f18a40f22d0 con 0x7f18b80c6d30 2024-04-25T09:02:14.493 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:14.493 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:08.938626+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18bec00640 1 -- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1898066f60 msgr2=0x7f1898069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18bec00640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1898066f60 0x7f1898069420 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f18ac009a10 tx=0x7f18ac008040 comp rx=0 tx=0).stop 2024-04-25T09:02:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18bec00640 1 -- 172.21.15.59:0/1714591315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b80c6d30 msgr2=0x7f18b80b5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18bec00640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b80c6d30 0x7f18b80b5480 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f18a401f1a0 tx=0x7f18a0005840 comp rx=0 tx=0).stop 2024-04-25T09:02:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18bec00640 1 -- 172.21.15.59:0/1714591315 shutdown_connections 2024-04-25T09:02:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18bec00640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1898066f60 0x7f1898069420 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18bec00640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18b80b59c0 0x7f18b80cdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18bec00640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b80c6d30 0x7f18b80b5480 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18bec00640 1 --2- 172.21.15.59:0/1714591315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18a0003f40 0x7f18b815d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18bec00640 1 -- 172.21.15.59:0/1714591315 >> 172.21.15.59:0/1714591315 conn(0x7f18b80b3050 msgr2=0x7f18b80ae1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18bec00640 1 -- 172.21.15.59:0/1714591315 shutdown_connections 2024-04-25T09:02:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.503+0000 7f18bec00640 1 -- 172.21.15.59:0/1714591315 wait complete. 2024-04-25T09:02:14.514 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:02:14.515 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:14.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2d2200640 1 Processor -- start 2024-04-25T09:02:14.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2d2200640 1 -- start start 2024-04-25T09:02:14.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2d2200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff2cc159320 0x7ff2cc15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2d2200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2cc06e4a0 0x7ff2cc06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2d2200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2cc15fc00 con 0x7ff2cc15f440 2024-04-25T09:02:14.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2d2200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc06d640 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2d2200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2cc06ee10 con 0x7ff2cc159320 2024-04-25T09:02:14.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2cbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2cc06e4a0 0x7ff2cc06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2cbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2cc06e4a0 0x7ff2cc06e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60124/0 (socket says 172.21.15.59:60124) 2024-04-25T09:02:14.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2cbe00640 1 -- 172.21.15.59:0/4074662828 learned_addr learned my addr 172.21.15.59:0/4074662828 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:14.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2cb400640 1 --2- 172.21.15.59:0/4074662828 >> v2:172.21.15.178:3300/0 conn(0x7ff2cc159320 0x7ff2cc15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2cbe00640 1 -- 172.21.15.59:0/4074662828 >> v2:172.21.15.178:3300/0 conn(0x7ff2cc159320 msgr2=0x7ff2cc15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:14.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2cbe00640 1 --2- 172.21.15.59:0/4074662828 >> v2:172.21.15.178:3300/0 conn(0x7ff2cc159320 0x7ff2cc15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.667+0000 7ff2caa00640 1 -- 172.21.15.59:0/4074662828 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743604203 0 0) 0x7ff2cc15fc00 con 0x7ff2cc15f440 2024-04-25T09:02:14.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2cbe00640 1 -- 172.21.15.59:0/4074662828 >> v1:172.21.15.59:6789/0 conn(0x7ff2cc15f440 legacy=0x7ff2cc06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2cbe00640 1 -- 172.21.15.59:0/4074662828 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc15fee0 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2cbe00640 1 --2- 172.21.15.59:0/4074662828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2cc06e4a0 0x7ff2cc06e8d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc06e470 tx=0x7ff2c401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb8420a2d1219b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:14.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2caa00640 1 -- 172.21.15.59:0/4074662828 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40a57f0 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2caa00640 1 -- 172.21.15.59:0/4074662828 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c40a5990 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2caa00640 1 -- 172.21.15.59:0/4074662828 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40a5d60 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2d2200640 1 -- 172.21.15.59:0/4074662828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2cc06e4a0 msgr2=0x7ff2cc06e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2d2200640 1 --2- 172.21.15.59:0/4074662828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2cc06e4a0 0x7ff2cc06e8d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc06e470 tx=0x7ff2c401c930 comp rx=0 tx=0).stop 2024-04-25T09:02:14.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2d2200640 1 -- 172.21.15.59:0/4074662828 shutdown_connections 2024-04-25T09:02:14.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2d2200640 1 --2- 172.21.15.59:0/4074662828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2cc06e4a0 0x7ff2cc06e8d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2d2200640 1 --2- 172.21.15.59:0/4074662828 >> v2:172.21.15.178:3300/0 conn(0x7ff2cc159320 0x7ff2cc15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2d2200640 1 -- 172.21.15.59:0/4074662828 >> 172.21.15.59:0/4074662828 conn(0x7ff2cc067080 msgr2=0x7ff2cc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:14.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2d2200640 1 -- 172.21.15.59:0/4074662828 shutdown_connections 2024-04-25T09:02:14.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.671+0000 7ff2d2200640 1 -- 172.21.15.59:0/4074662828 wait complete. 2024-04-25T09:02:14.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2d2200640 1 Processor -- start 2024-04-25T09:02:14.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2d2200640 1 -- start start 2024-04-25T09:02:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2d2200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2cc06e4a0 0x7ff2cc157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2d2200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2cc159320 0x7ff2cc13dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2d2200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2cc15f440 0x7ff2cc164960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2d2200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc15f860 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2d2200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc159700 con 0x7ff2cc159320 2024-04-25T09:02:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2d2200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2cc15f9e0 con 0x7ff2cc15f440 2024-04-25T09:02:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2cb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2cc06e4a0 0x7ff2cc157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2cb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2cc06e4a0 0x7ff2cc157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60134/0 (socket says 172.21.15.59:60134) 2024-04-25T09:02:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2cb400640 1 -- 172.21.15.59:0/1402275521 learned_addr learned my addr 172.21.15.59:0/1402275521 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2cb400640 1 -- 172.21.15.59:0/1402275521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2cc15f440 msgr2=0x7ff2cc164960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2cb400640 1 --2- 172.21.15.59:0/1402275521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2cc15f440 0x7ff2cc164960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2cb400640 1 -- 172.21.15.59:0/1402275521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2cc159320 msgr2=0x7ff2cc13dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2cb400640 1 --2- 172.21.15.59:0/1402275521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2cc159320 0x7ff2cc13dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2cb400640 1 -- 172.21.15.59:0/1402275521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc1581a0 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2cb400640 1 --2- 172.21.15.59:0/1402275521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2cc06e4a0 0x7ff2cc157c60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00e930 tx=0x7ff2bc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.675+0000 7ff2c3400640 1 -- 172.21.15.59:0/1402275521 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc017070 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.679+0000 7ff2c3400640 1 -- 172.21.15.59:0/1402275521 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc00ca00 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.679+0000 7ff2c3400640 1 -- 172.21.15.59:0/1402275521 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc00cdb0 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.679+0000 7ff2d2200640 1 -- 172.21.15.59:0/1402275521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2cc13e830 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.679+0000 7ff2d2200640 1 -- 172.21.15.59:0/1402275521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2cc13edf0 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.679+0000 7ff2d2200640 1 -- 172.21.15.59:0/1402275521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2cc0745d0 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.679+0000 7ff2c3400640 1 -- 172.21.15.59:0/1402275521 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff2bc01a070 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.679+0000 7ff2c3400640 1 --2- 172.21.15.59:0/1402275521 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2a8066f60 0x7ff2a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:14.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.679+0000 7ff2c3400640 1 -- 172.21.15.59:0/1402275521 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7ff2bc0854b0 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.679+0000 7ff2c3e00640 1 --2- 172.21.15.59:0/1402275521 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2a8066f60 0x7ff2a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:14.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.683+0000 7ff2c3e00640 1 --2- 172.21.15.59:0/1402275521 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2a8066f60 0x7ff2a8069420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4007fd0 tx=0x7ff2b4007920 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.683+0000 7ff2c3400640 1 -- 172.21.15.59:0/1402275521 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff2bc056130 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.855+0000 7ff2d2200640 1 -- 172.21.15.59:0/1402275521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff2cc158a30 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.855+0000 7ff2c3400640 1 -- 172.21.15.59:0/1402275521 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff2bc055a30 con 0x7ff2cc06e4a0 2024-04-25T09:02:14.847 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:02:14.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.859+0000 7ff2d2200640 1 -- 172.21.15.59:0/1402275521 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2a8066f60 msgr2=0x7ff2a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.859+0000 7ff2d2200640 1 --2- 172.21.15.59:0/1402275521 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2a8066f60 0x7ff2a8069420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff2b4007fd0 tx=0x7ff2b4007920 comp rx=0 tx=0).stop 2024-04-25T09:02:14.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.859+0000 7ff2d2200640 1 -- 172.21.15.59:0/1402275521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2cc06e4a0 msgr2=0x7ff2cc157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:14.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.859+0000 7ff2d2200640 1 --2- 172.21.15.59:0/1402275521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2cc06e4a0 0x7ff2cc157c60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc00e930 tx=0x7ff2bc00edf0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.859+0000 7ff2d2200640 1 -- 172.21.15.59:0/1402275521 shutdown_connections 2024-04-25T09:02:14.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.859+0000 7ff2d2200640 1 --2- 172.21.15.59:0/1402275521 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2a8066f60 0x7ff2a8069420 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.859+0000 7ff2d2200640 1 --2- 172.21.15.59:0/1402275521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2cc15f440 0x7ff2cc164960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.859+0000 7ff2d2200640 1 --2- 172.21.15.59:0/1402275521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2cc159320 0x7ff2cc13dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.859+0000 7ff2d2200640 1 --2- 172.21.15.59:0/1402275521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2cc06e4a0 0x7ff2cc157c60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:14.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.859+0000 7ff2d2200640 1 -- 172.21.15.59:0/1402275521 >> 172.21.15.59:0/1402275521 conn(0x7ff2cc067080 msgr2=0x7ff2cc142230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:14.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.859+0000 7ff2d2200640 1 -- 172.21.15.59:0/1402275521 shutdown_connections 2024-04-25T09:02:14.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:14.859+0000 7ff2d2200640 1 -- 172.21.15.59:0/1402275521 wait complete. 2024-04-25T09:02:14.868 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:15.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.019+0000 7fb1b6800640 1 Processor -- start 2024-04-25T09:02:15.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.019+0000 7fb1b6800640 1 -- start start 2024-04-25T09:02:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1b6800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb1b015b910 0x7fb1b00cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1b6800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b015bcf0 0x7fb1b0099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1b6800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b00d02a0 con 0x7fb1b00cf3c0 2024-04-25T09:02:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1b6800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b00cc350 con 0x7fb1b015b910 2024-04-25T09:02:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1b6800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b00cc630 con 0x7fb1b015bcf0 2024-04-25T09:02:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1a6a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb1b00cf3c0 0x7fb1b00cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34636/0 (socket says 172.21.15.59:34636) 2024-04-25T09:02:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1a6a00640 1 -- 172.21.15.59:0/1276349042 learned_addr learned my addr 172.21.15.59:0/1276349042 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1af400640 1 --2- 172.21.15.59:0/1276349042 >> v2:172.21.15.178:3300/0 conn(0x7fb1b015b910 0x7fb1b00cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1afe00640 1 --2- 172.21.15.59:0/1276349042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b015bcf0 0x7fb1b0099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1aea00640 1 -- 172.21.15.59:0/1276349042 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1361758970 0 0) 0x7fb1b00d02a0 con 0x7fb1b00cf3c0 2024-04-25T09:02:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1aea00640 1 -- 172.21.15.59:0/1276349042 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb194003530 con 0x7fb1b00cf3c0 2024-04-25T09:02:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1afe00640 1 -- 172.21.15.59:0/1276349042 >> v2:172.21.15.178:3300/0 conn(0x7fb1b015b910 msgr2=0x7fb1b00cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1afe00640 1 --2- 172.21.15.59:0/1276349042 >> v2:172.21.15.178:3300/0 conn(0x7fb1b015b910 0x7fb1b00cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1afe00640 1 -- 172.21.15.59:0/1276349042 >> v1:172.21.15.59:6789/0 conn(0x7fb1b00cf3c0 legacy=0x7fb1b00cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1afe00640 1 -- 172.21.15.59:0/1276349042 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b00cc910 con 0x7fb1b015bcf0 2024-04-25T09:02:15.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.023+0000 7fb1af400640 1 --2- 172.21.15.59:0/1276349042 >> v2:172.21.15.178:3300/0 conn(0x7fb1b015b910 0x7fb1b00cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:15.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1afe00640 1 --2- 172.21.15.59:0/1276349042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b015bcf0 0x7fb1b0099a60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009d90 tx=0x7fb1a801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ce09c2ec8db9f0c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:15.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1aea00640 1 -- 172.21.15.59:0/1276349042 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80b2070 con 0x7fb1b015bcf0 2024-04-25T09:02:15.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1aea00640 1 -- 172.21.15.59:0/1276349042 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a80a5910 con 0x7fb1b015bcf0 2024-04-25T09:02:15.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1aea00640 1 -- 172.21.15.59:0/1276349042 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a80a5ce0 con 0x7fb1b015bcf0 2024-04-25T09:02:15.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1b6800640 1 -- 172.21.15.59:0/1276349042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b015bcf0 msgr2=0x7fb1b0099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1b6800640 1 --2- 172.21.15.59:0/1276349042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b015bcf0 0x7fb1b0099a60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8009d90 tx=0x7fb1a801c940 comp rx=0 tx=0).stop 2024-04-25T09:02:15.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1b6800640 1 -- 172.21.15.59:0/1276349042 shutdown_connections 2024-04-25T09:02:15.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1b6800640 1 --2- 172.21.15.59:0/1276349042 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b015bcf0 0x7fb1b0099a60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1b6800640 1 --2- 172.21.15.59:0/1276349042 >> v2:172.21.15.178:3300/0 conn(0x7fb1b015b910 0x7fb1b00cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1b6800640 1 -- 172.21.15.59:0/1276349042 >> 172.21.15.59:0/1276349042 conn(0x7fb1b00b3200 msgr2=0x7fb1b00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:15.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1b6800640 1 -- 172.21.15.59:0/1276349042 shutdown_connections 2024-04-25T09:02:15.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1b6800640 1 -- 172.21.15.59:0/1276349042 wait complete. 2024-04-25T09:02:15.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1b6800640 1 Processor -- start 2024-04-25T09:02:15.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.027+0000 7fb1b6800640 1 -- start start 2024-04-25T09:02:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1b6800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b00cf3c0 0x7fb1b0153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1b6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1b015b910 0x7fb1b015e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1b6800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b015bcf0 0x7fb1b01501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1b6800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0168b20 con 0x7fb1b015b910 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1b6800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b01689a0 con 0x7fb1b00cf3c0 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1b6800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b0168ca0 con 0x7fb1b015bcf0 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1b015b910 0x7fb1b015e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1b015b910 0x7fb1b015e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60140/0 (socket says 172.21.15.59:60140) 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a6a00640 1 -- 172.21.15.59:0/1334161627 learned_addr learned my addr 172.21.15.59:0/1334161627 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1afe00640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b015bcf0 0x7fb1b01501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1af400640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b00cf3c0 0x7fb1b0153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a6a00640 1 -- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b015bcf0 msgr2=0x7fb1b01501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a6a00640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b015bcf0 0x7fb1b01501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a6a00640 1 -- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b00cf3c0 msgr2=0x7fb1b0153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a6a00640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b00cf3c0 0x7fb1b0153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a6a00640 1 -- 172.21.15.59:0/1334161627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b00b63a0 con 0x7fb1b015b910 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1af400640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b00cf3c0 0x7fb1b0153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:15.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1afe00640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b015bcf0 0x7fb1b01501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a6a00640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1b015b910 0x7fb1b015e560 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb19800c390 tx=0x7fb19800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a7e00640 1 -- 172.21.15.59:0/1334161627 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb198017070 con 0x7fb1b015b910 2024-04-25T09:02:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a7e00640 1 -- 172.21.15.59:0/1334161627 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb198005d10 con 0x7fb1b015b910 2024-04-25T09:02:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a7e00640 1 -- 172.21.15.59:0/1334161627 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb198007310 con 0x7fb1b015b910 2024-04-25T09:02:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1b6800640 1 -- 172.21.15.59:0/1334161627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b00b6680 con 0x7fb1b015b910 2024-04-25T09:02:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1b6800640 1 -- 172.21.15.59:0/1334161627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b015eaa0 con 0x7fb1b015b910 2024-04-25T09:02:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1b6800640 1 -- 172.21.15.59:0/1334161627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b00745d0 con 0x7fb1b015b910 2024-04-25T09:02:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.031+0000 7fb1a7e00640 1 -- 172.21.15.59:0/1334161627 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb19801a070 con 0x7fb1b015b910 2024-04-25T09:02:15.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.035+0000 7fb1a7e00640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb18c066f90 0x7fb18c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.035+0000 7fb1a7e00640 1 -- 172.21.15.59:0/1334161627 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fb1980847b0 con 0x7fb1b015b910 2024-04-25T09:02:15.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.035+0000 7fb1af400640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb18c066f90 0x7fb18c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.035+0000 7fb1af400640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb18c066f90 0x7fb18c069450 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009ae0 tx=0x7fb1a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:15.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.039+0000 7fb1a7e00640 1 -- 172.21.15.59:0/1334161627 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb1980554b0 con 0x7fb1b015b910 2024-04-25T09:02:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.199+0000 7fb1b6800640 1 -- 172.21.15.59:0/1334161627 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1b00cdcd0 con 0x7fb1b015b910 2024-04-25T09:02:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.199+0000 7fb1a7e00640 1 -- 172.21.15.59:0/1334161627 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb198059e20 con 0x7fb1b015b910 2024-04-25T09:02:15.192 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:15.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.203+0000 7fb1b6800640 1 -- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb18c066f90 msgr2=0x7fb18c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.203+0000 7fb1b6800640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb18c066f90 0x7fb18c069450 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb1a0009ae0 tx=0x7fb1a0008040 comp rx=0 tx=0).stop 2024-04-25T09:02:15.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.203+0000 7fb1b6800640 1 -- 172.21.15.59:0/1334161627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1b015b910 msgr2=0x7fb1b015e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.203+0000 7fb1b6800640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1b015b910 0x7fb1b015e560 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb19800c390 tx=0x7fb19800c850 comp rx=0 tx=0).stop 2024-04-25T09:02:15.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.203+0000 7fb1b6800640 1 -- 172.21.15.59:0/1334161627 shutdown_connections 2024-04-25T09:02:15.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.203+0000 7fb1b6800640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb18c066f90 0x7fb18c069450 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.203+0000 7fb1b6800640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb1b015bcf0 0x7fb1b01501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.203+0000 7fb1b6800640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1b015b910 0x7fb1b015e560 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.203+0000 7fb1b6800640 1 --2- 172.21.15.59:0/1334161627 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb1b00cf3c0 0x7fb1b0153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.203+0000 7fb1b6800640 1 -- 172.21.15.59:0/1334161627 >> 172.21.15.59:0/1334161627 conn(0x7fb1b00b3200 msgr2=0x7fb1b00c7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:15.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.203+0000 7fb1b6800640 1 -- 172.21.15.59:0/1334161627 shutdown_connections 2024-04-25T09:02:15.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.203+0000 7fb1b6800640 1 -- 172.21.15.59:0/1334161627 wait complete. 2024-04-25T09:02:15.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:15.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.363+0000 7fafa9400640 1 Processor -- start 2024-04-25T09:02:15.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.363+0000 7fafa9400640 1 -- start start 2024-04-25T09:02:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fafa4159320 0x7fafa415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa9400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafa415f440 0x7fafa406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa9400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fafa406e010 0x7fafa406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa9400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa406d640 con 0x7fafa4159320 2024-04-25T09:02:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa9400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa415fc00 con 0x7fafa406e010 2024-04-25T09:02:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa9400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa415fee0 con 0x7fafa415f440 2024-04-25T09:02:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa2800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fafa4159320 0x7fafa415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa2800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fafa4159320 0x7fafa415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60144/0 (socket says 172.21.15.59:60144) 2024-04-25T09:02:15.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa2800640 1 -- 172.21.15.59:0/2002820631 learned_addr learned my addr 172.21.15.59:0/2002820631 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:15.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa3200640 1 --2- 172.21.15.59:0/2002820631 >> v2:172.21.15.178:3300/0 conn(0x7fafa406e010 0x7fafa406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7faf99e00640 1 --2- 172.21.15.59:0/2002820631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafa415f440 0x7fafa406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa2800640 1 -- 172.21.15.59:0/2002820631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafa415f440 msgr2=0x7fafa406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:15.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa2800640 1 --2- 172.21.15.59:0/2002820631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafa415f440 0x7fafa406dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa2800640 1 -- 172.21.15.59:0/2002820631 >> v2:172.21.15.178:3300/0 conn(0x7fafa406e010 msgr2=0x7fafa406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:15.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa2800640 1 --2- 172.21.15.59:0/2002820631 >> v2:172.21.15.178:3300/0 conn(0x7fafa406e010 0x7fafa406e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa2800640 1 -- 172.21.15.59:0/2002820631 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa41601c0 con 0x7fafa4159320 2024-04-25T09:02:15.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7faf99e00640 1 --2- 172.21.15.59:0/2002820631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafa415f440 0x7fafa406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:15.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.367+0000 7fafa2800640 1 --2- 172.21.15.59:0/2002820631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4159320 0x7fafa415c9b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fafa41604a0 tx=0x7faf9401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85e6370982e1a53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:15.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa1e00640 1 -- 172.21.15.59:0/2002820631 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940b0070 con 0x7fafa4159320 2024-04-25T09:02:15.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa1e00640 1 -- 172.21.15.59:0/2002820631 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf940ab600 con 0x7fafa4159320 2024-04-25T09:02:15.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa1e00640 1 -- 172.21.15.59:0/2002820631 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940ab9d0 con 0x7fafa4159320 2024-04-25T09:02:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 -- 172.21.15.59:0/2002820631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4159320 msgr2=0x7fafa415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 --2- 172.21.15.59:0/2002820631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4159320 0x7fafa415c9b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fafa41604a0 tx=0x7faf9401c460 comp rx=0 tx=0).stop 2024-04-25T09:02:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 -- 172.21.15.59:0/2002820631 shutdown_connections 2024-04-25T09:02:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 --2- 172.21.15.59:0/2002820631 >> v2:172.21.15.178:3300/0 conn(0x7fafa406e010 0x7fafa406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 --2- 172.21.15.59:0/2002820631 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafa415f440 0x7fafa406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 --2- 172.21.15.59:0/2002820631 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa4159320 0x7fafa415c9b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 -- 172.21.15.59:0/2002820631 >> 172.21.15.59:0/2002820631 conn(0x7fafa4067080 msgr2=0x7fafa406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:15.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 -- 172.21.15.59:0/2002820631 shutdown_connections 2024-04-25T09:02:15.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 -- 172.21.15.59:0/2002820631 wait complete. 2024-04-25T09:02:15.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 Processor -- start 2024-04-25T09:02:15.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 -- start start 2024-04-25T09:02:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa406e010 0x7fafa413ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafa4159320 0x7fafa4142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafa415f440 0x7fafa4140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40cc440 con 0x7fafa406e010 2024-04-25T09:02:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40cc2c0 con 0x7fafa4159320 2024-04-25T09:02:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa9400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40cc5c0 con 0x7fafa415f440 2024-04-25T09:02:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa406e010 0x7fafa413ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa406e010 0x7fafa413ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60158/0 (socket says 172.21.15.59:60158) 2024-04-25T09:02:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa2800640 1 -- 172.21.15.59:0/4024290322 learned_addr learned my addr 172.21.15.59:0/4024290322 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:15.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7faf99e00640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafa4159320 0x7fafa4142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.371+0000 7fafa3200640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafa415f440 0x7fafa4140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7fafa2800640 1 -- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafa415f440 msgr2=0x7fafa4140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7fafa2800640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafa415f440 0x7fafa4140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7fafa2800640 1 -- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafa4159320 msgr2=0x7fafa4142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7fafa2800640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafa4159320 0x7fafa4142940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7fafa2800640 1 -- 172.21.15.59:0/4024290322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40b2440 con 0x7fafa406e010 2024-04-25T09:02:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7faf99e00640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafa4159320 0x7fafa4142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7fafa2800640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa406e010 0x7fafa413ce00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf940ae040 tx=0x7faf94019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7faf9b400640 1 -- 172.21.15.59:0/4024290322 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940b0040 con 0x7fafa406e010 2024-04-25T09:02:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7faf9b400640 1 -- 172.21.15.59:0/4024290322 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf940b9070 con 0x7fafa406e010 2024-04-25T09:02:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7faf9b400640 1 -- 172.21.15.59:0/4024290322 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf940b4680 con 0x7fafa406e010 2024-04-25T09:02:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7fafa9400640 1 -- 172.21.15.59:0/4024290322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa40b2720 con 0x7fafa406e010 2024-04-25T09:02:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7fafa9400640 1 -- 172.21.15.59:0/4024290322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa40b2ce0 con 0x7fafa406e010 2024-04-25T09:02:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7fafa9400640 1 -- 172.21.15.59:0/4024290322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa40745d0 con 0x7fafa406e010 2024-04-25T09:02:15.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7faf9b400640 1 -- 172.21.15.59:0/4024290322 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faf940b4820 con 0x7fafa406e010 2024-04-25T09:02:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7faf9b400640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faf80066f60 0x7faf80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7faf9b400640 1 -- 172.21.15.59:0/4024290322 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7faf9411f150 con 0x7fafa406e010 2024-04-25T09:02:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.375+0000 7faf99e00640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faf80066f60 0x7faf80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.379+0000 7faf99e00640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faf80066f60 0x7faf80069420 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fafa41435f0 tx=0x7faf8c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:15.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.379+0000 7faf9b400640 1 -- 172.21.15.59:0/4024290322 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faf94016110 con 0x7fafa406e010 2024-04-25T09:02:15.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.539+0000 7fafa9400640 1 -- 172.21.15.59:0/4024290322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fafa413d340 con 0x7fafa406e010 2024-04-25T09:02:15.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.539+0000 7faf9b400640 1 -- 172.21.15.59:0/4024290322 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf940efc80 con 0x7fafa406e010 2024-04-25T09:02:15.532 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:02:15.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.543+0000 7fafa9400640 1 -- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faf80066f60 msgr2=0x7faf80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.543+0000 7fafa9400640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faf80066f60 0x7faf80069420 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fafa41435f0 tx=0x7faf8c008040 comp rx=0 tx=0).stop 2024-04-25T09:02:15.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.543+0000 7fafa9400640 1 -- 172.21.15.59:0/4024290322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa406e010 msgr2=0x7fafa413ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.543+0000 7fafa9400640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa406e010 0x7fafa413ce00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf940ae040 tx=0x7faf94019200 comp rx=0 tx=0).stop 2024-04-25T09:02:15.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.543+0000 7fafa9400640 1 -- 172.21.15.59:0/4024290322 shutdown_connections 2024-04-25T09:02:15.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.543+0000 7fafa9400640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faf80066f60 0x7faf80069420 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.543+0000 7fafa9400640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafa415f440 0x7fafa4140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.543+0000 7fafa9400640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafa4159320 0x7fafa4142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.543+0000 7fafa9400640 1 --2- 172.21.15.59:0/4024290322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafa406e010 0x7fafa413ce00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.543+0000 7fafa9400640 1 -- 172.21.15.59:0/4024290322 >> 172.21.15.59:0/4024290322 conn(0x7fafa4067080 msgr2=0x7fafa415d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:15.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.543+0000 7fafa9400640 1 -- 172.21.15.59:0/4024290322 shutdown_connections 2024-04-25T09:02:15.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.543+0000 7fafa9400640 1 -- 172.21.15.59:0/4024290322 wait complete. 2024-04-25T09:02:15.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:02:15.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d0d200640 1 Processor -- start 2024-04-25T09:02:15.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d0d200640 1 -- start start 2024-04-25T09:02:15.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d0d200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d0806e4a0 0x7f0d0806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d0d200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0815fc00 con 0x7f0d08159320 2024-04-25T09:02:15.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d0d200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d0815fee0 con 0x7f0d0815c9b0 2024-04-25T09:02:15.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d0d200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0806ee50 con 0x7f0d0806e4a0 2024-04-25T09:02:15.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d05e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0d08159320 0x7f0d0815f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34648/0 (socket says 172.21.15.59:34648) 2024-04-25T09:02:15.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d05e00640 1 -- 172.21.15.59:0/824750962 learned_addr learned my addr 172.21.15.59:0/824750962 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:15.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d06800640 1 --2- 172.21.15.59:0/824750962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d0806e4a0 0x7f0d0806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d04a00640 1 -- 172.21.15.59:0/824750962 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028869874 0 0) 0x7f0d0815fc00 con 0x7f0d08159320 2024-04-25T09:02:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d04a00640 1 -- 172.21.15.59:0/824750962 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cec003530 con 0x7f0d08159320 2024-04-25T09:02:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d06800640 1 -- 172.21.15.59:0/824750962 >> v1:172.21.15.178:6789/0 conn(0x7f0d0815c9b0 legacy=0x7f0d0806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d04a00640 1 -- 172.21.15.59:0/824750962 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762204171 0 0) 0x7f0d0815fee0 con 0x7f0d0815c9b0 2024-04-25T09:02:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d06800640 1 -- 172.21.15.59:0/824750962 >> v1:172.21.15.59:6789/0 conn(0x7f0d08159320 legacy=0x7f0d0815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.707+0000 7f0d06800640 1 -- 172.21.15.59:0/824750962 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d081601c0 con 0x7f0d0806e4a0 2024-04-25T09:02:15.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.711+0000 7f0d06800640 1 --2- 172.21.15.59:0/824750962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d0806e4a0 0x7f0d0806e910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009dc0 tx=0x7f0d0001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17a64d266f8d5a8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:15.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.711+0000 7f0d04a00640 1 -- 172.21.15.59:0/824750962 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d000b2070 con 0x7f0d0806e4a0 2024-04-25T09:02:15.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.711+0000 7f0d04a00640 1 -- 172.21.15.59:0/824750962 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d000a5850 con 0x7f0d0806e4a0 2024-04-25T09:02:15.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.711+0000 7f0d04a00640 1 -- 172.21.15.59:0/824750962 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d000a5c00 con 0x7f0d0806e4a0 2024-04-25T09:02:15.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.711+0000 7f0d0d200640 1 -- 172.21.15.59:0/824750962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d0806e4a0 msgr2=0x7f0d0806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.711+0000 7f0d0d200640 1 --2- 172.21.15.59:0/824750962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d0806e4a0 0x7f0d0806e910 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0d00009dc0 tx=0x7f0d0001c990 comp rx=0 tx=0).stop 2024-04-25T09:02:15.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.711+0000 7f0d0d200640 1 -- 172.21.15.59:0/824750962 shutdown_connections 2024-04-25T09:02:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.711+0000 7f0d0d200640 1 --2- 172.21.15.59:0/824750962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d0806e4a0 0x7f0d0806e910 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.711+0000 7f0d0d200640 1 -- 172.21.15.59:0/824750962 >> 172.21.15.59:0/824750962 conn(0x7f0d08067080 msgr2=0x7f0d0806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.711+0000 7f0d0d200640 1 -- 172.21.15.59:0/824750962 shutdown_connections 2024-04-25T09:02:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.711+0000 7f0d0d200640 1 -- 172.21.15.59:0/824750962 wait complete. 2024-04-25T09:02:15.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d0d200640 1 Processor -- start 2024-04-25T09:02:15.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d0d200640 1 -- start start 2024-04-25T09:02:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d0d200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d0806e4a0 0x7f0d080b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d0d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d08159320 0x7f0d08154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d0d200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d0815c9b0 0x7f0d081556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d0d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08169720 con 0x7f0d08159320 2024-04-25T09:02:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d0d200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d081695a0 con 0x7f0d0806e4a0 2024-04-25T09:02:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d0d200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d081698a0 con 0x7f0d0815c9b0 2024-04-25T09:02:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d05400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d08159320 0x7f0d08154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d05400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d08159320 0x7f0d08154f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60164/0 (socket says 172.21.15.59:60164) 2024-04-25T09:02:15.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d05400640 1 -- 172.21.15.59:0/227327559 learned_addr learned my addr 172.21.15.59:0/227327559 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d05400640 1 -- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d0815c9b0 msgr2=0x7f0d081556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d06800640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d0815c9b0 0x7f0d081556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d05e00640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d0806e4a0 0x7f0d080b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d05400640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d0815c9b0 0x7f0d081556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d05400640 1 -- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d0806e4a0 msgr2=0x7f0d080b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d05400640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d0806e4a0 0x7f0d080b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d05400640 1 -- 172.21.15.59:0/227327559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d0813ff10 con 0x7f0d08159320 2024-04-25T09:02:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d06800640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d0815c9b0 0x7f0d081556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d05400640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d08159320 0x7f0d08154f10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400c450 tx=0x7f0cf400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0cfe000640 1 -- 172.21.15.59:0/227327559 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4017070 con 0x7f0d08159320 2024-04-25T09:02:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0cfe000640 1 -- 172.21.15.59:0/227327559 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf4005480 con 0x7f0d08159320 2024-04-25T09:02:15.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0cfe000640 1 -- 172.21.15.59:0/227327559 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf4003840 con 0x7f0d08159320 2024-04-25T09:02:15.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d0d200640 1 -- 172.21.15.59:0/227327559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d080afe90 con 0x7f0d08159320 2024-04-25T09:02:15.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d0d200640 1 -- 172.21.15.59:0/227327559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d080b0450 con 0x7f0d08159320 2024-04-25T09:02:15.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.715+0000 7f0d0d200640 1 -- 172.21.15.59:0/227327559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d080745d0 con 0x7f0d08159320 2024-04-25T09:02:15.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.719+0000 7f0cfe000640 1 -- 172.21.15.59:0/227327559 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0cf401a070 con 0x7f0d08159320 2024-04-25T09:02:15.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.719+0000 7f0cfe000640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0ce8066f60 0x7f0ce8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:15.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.719+0000 7f0cfe000640 1 -- 172.21.15.59:0/227327559 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f0cf4084770 con 0x7f0d08159320 2024-04-25T09:02:15.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.719+0000 7f0d05e00640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0ce8066f60 0x7f0ce8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:15.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.719+0000 7f0d05e00640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0ce8066f60 0x7f0ce8069420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8007fd0 tx=0x7f0cf8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:15.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.723+0000 7f0cfe000640 1 -- 172.21.15.59:0/227327559 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0d0813ff10 con 0x7f0d08159320 2024-04-25T09:02:15.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 -- 172.21.15.59:0/227327559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0d0815bc30 con 0x7f0d08159320 2024-04-25T09:02:15.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0cfe000640 1 -- 172.21.15.59:0/227327559 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0cf4055340 con 0x7f0d08159320 2024-04-25T09:02:15.878 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:15.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 -- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0ce8066f60 msgr2=0x7f0ce8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0ce8066f60 0x7f0ce8069420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8007fd0 tx=0x7f0cf8009040 comp rx=0 tx=0).stop 2024-04-25T09:02:15.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 -- 172.21.15.59:0/227327559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d08159320 msgr2=0x7f0d08154f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:15.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d08159320 0x7f0d08154f10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0cf400c450 tx=0x7f0cf400c910 comp rx=0 tx=0).stop 2024-04-25T09:02:15.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 -- 172.21.15.59:0/227327559 shutdown_connections 2024-04-25T09:02:15.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0ce8066f60 0x7f0ce8069420 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d0815c9b0 0x7f0d081556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d08159320 0x7f0d08154f10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 --2- 172.21.15.59:0/227327559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d0806e4a0 0x7f0d080b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:15.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 -- 172.21.15.59:0/227327559 >> 172.21.15.59:0/227327559 conn(0x7f0d08067080 msgr2=0x7f0d0806dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:15.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 -- 172.21.15.59:0/227327559 shutdown_connections 2024-04-25T09:02:15.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:15.887+0000 7f0d0d200640 1 -- 172.21.15.59:0/227327559 wait complete. 2024-04-25T09:02:15.899 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-25T09:02:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.047+0000 7fe312400640 1 Processor -- start 2024-04-25T09:02:16.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.047+0000 7fe312400640 1 -- start start 2024-04-25T09:02:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.047+0000 7fe312400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe30c099a60 0x7fe30c099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe312400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30c09a380 con 0x7fe30c15ee00 2024-04-25T09:02:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe312400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe30c06c650 con 0x7fe30c0cff30 2024-04-25T09:02:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe312400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe30c06c430 con 0x7fe30c099a60 2024-04-25T09:02:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe302a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe30c15ee00 0x7fe30c06bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34664/0 (socket says 172.21.15.59:34664) 2024-04-25T09:02:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe302a00640 1 -- 172.21.15.59:0/1738429322 learned_addr learned my addr 172.21.15.59:0/1738429322 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30b400640 1 --2- 172.21.15.59:0/1738429322 >> v2:172.21.15.178:3300/0 conn(0x7fe30c099a60 0x7fe30c099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063683696 0 0) 0x7fe30c09a380 con 0x7fe30c15ee00 2024-04-25T09:02:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f0003530 con 0x7fe30c15ee00 2024-04-25T09:02:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976444033 0 0) 0x7fe30c06c650 con 0x7fe30c0cff30 2024-04-25T09:02:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe30c09a380 con 0x7fe30c0cff30 2024-04-25T09:02:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3165699003 0 0) 0x7fe2f0003530 con 0x7fe30c15ee00 2024-04-25T09:02:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 >> v2:172.21.15.178:3300/0 conn(0x7fe30c099a60 msgr2=0x7fe30c099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 --2- 172.21.15.59:0/1738429322 >> v2:172.21.15.178:3300/0 conn(0x7fe30c099a60 0x7fe30c099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 >> v1:172.21.15.178:6789/0 conn(0x7fe30c0cff30 legacy=0x7fe30c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c06c930 con 0x7fe30c15ee00 2024-04-25T09:02:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fe2f4001680 con 0x7fe30c15ee00 2024-04-25T09:02:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 >> v1:172.21.15.59:6789/0 conn(0x7fe30c15ee00 legacy=0x7fe30c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 --2- 172.21.15.59:0/1738429322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f0003b50 0x7fe2f0003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 --2- 172.21.15.59:0/1738429322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f0004810 0x7fe2f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 --2- 172.21.15.59:0/1738429322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f00051d0 0x7fe2f000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c06c430 con 0x7fe2f0003b50 2024-04-25T09:02:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f000c050 con 0x7fe2f00051d0 2024-04-25T09:02:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2f000c250 con 0x7fe2f0004810 2024-04-25T09:02:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30b400640 1 --2- 172.21.15.59:0/1738429322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f0003b50 0x7fe2f0003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30be00640 1 --2- 172.21.15.59:0/1738429322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f00051d0 0x7fe2f000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe302a00640 1 --2- 172.21.15.59:0/1738429322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f0004810 0x7fe2f0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30b400640 1 -- 172.21.15.59:0/1738429322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f0004810 msgr2=0x7fe2f0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30b400640 1 --2- 172.21.15.59:0/1738429322 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f0004810 0x7fe2f0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30b400640 1 -- 172.21.15.59:0/1738429322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f00051d0 msgr2=0x7fe2f000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30b400640 1 --2- 172.21.15.59:0/1738429322 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2f00051d0 0x7fe2f000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30be00640 1 -- 172.21.15.59:0/1738429322 reap_dead start 2024-04-25T09:02:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.051+0000 7fe30b400640 1 -- 172.21.15.59:0/1738429322 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0003530 con 0x7fe2f0003b50 2024-04-25T09:02:16.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe30b400640 1 --2- 172.21.15.59:0/1738429322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f0003b50 0x7fe2f0003f50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009ae0 tx=0x7fe2fc01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535c0beeb2b81c31 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:16.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0096b0 con 0x7fe2f0003b50 2024-04-25T09:02:16.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc0a6450 con 0x7fe2f0003b50 2024-04-25T09:02:16.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe30aa00640 1 -- 172.21.15.59:0/1738429322 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2fc0a6840 con 0x7fe2f0003b50 2024-04-25T09:02:16.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe312400640 1 -- 172.21.15.59:0/1738429322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f0003b50 msgr2=0x7fe2f0003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:16.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe312400640 1 --2- 172.21.15.59:0/1738429322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f0003b50 0x7fe2f0003f50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc009ae0 tx=0x7fe2fc01ca70 comp rx=0 tx=0).stop 2024-04-25T09:02:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe312400640 1 -- 172.21.15.59:0/1738429322 shutdown_connections 2024-04-25T09:02:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe312400640 1 --2- 172.21.15.59:0/1738429322 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2f0003b50 0x7fe2f0003f50 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe312400640 1 -- 172.21.15.59:0/1738429322 >> 172.21.15.59:0/1738429322 conn(0x7fe30c0d17a0 msgr2=0x7fe30c0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe312400640 1 -- 172.21.15.59:0/1738429322 shutdown_connections 2024-04-25T09:02:16.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe312400640 1 -- 172.21.15.59:0/1738429322 wait complete. 2024-04-25T09:02:16.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe312400640 1 Processor -- start 2024-04-25T09:02:16.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.055+0000 7fe312400640 1 -- start start 2024-04-25T09:02:16.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe312400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f0003b50 0x7fe30c151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe312400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30c0c93a0 0x7fe30c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe312400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c0cb040 0x7fe30c0c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe312400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c06c2b0 con 0x7fe30c0cb040 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe312400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c06c130 con 0x7fe30c0c93a0 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe312400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c15de80 con 0x7fe2f0003b50 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe30be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c0cb040 0x7fe30c0c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe30be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c0cb040 0x7fe30c0c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60176/0 (socket says 172.21.15.59:60176) 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe30be00640 1 -- 172.21.15.59:0/3498300970 learned_addr learned my addr 172.21.15.59:0/3498300970 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe302a00640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30c0c93a0 0x7fe30c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe30b400640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f0003b50 0x7fe30c151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe30be00640 1 -- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f0003b50 msgr2=0x7fe30c151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe30be00640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f0003b50 0x7fe30c151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:16.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe30be00640 1 -- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30c0c93a0 msgr2=0x7fe30c0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:16.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe30be00640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30c0c93a0 0x7fe30c0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:16.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe30be00640 1 -- 172.21.15.59:0/3498300970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c0cb550 con 0x7fe30c0cb040 2024-04-25T09:02:16.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe30be00640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c0cb040 0x7fe30c0c52d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe30400e700 tx=0x7fe30400ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:16.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe303e00640 1 -- 172.21.15.59:0/3498300970 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304006b60 con 0x7fe30c0cb040 2024-04-25T09:02:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe303e00640 1 -- 172.21.15.59:0/3498300970 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe304006d00 con 0x7fe30c0cb040 2024-04-25T09:02:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe303e00640 1 -- 172.21.15.59:0/3498300970 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe304003bc0 con 0x7fe30c0cb040 2024-04-25T09:02:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe312400640 1 -- 172.21.15.59:0/3498300970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c0b5810 con 0x7fe30c0cb040 2024-04-25T09:02:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe312400640 1 -- 172.21.15.59:0/3498300970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c0b5dd0 con 0x7fe30c0cb040 2024-04-25T09:02:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe312400640 1 -- 172.21.15.59:0/3498300970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c0b5fd0 con 0x7fe30c0cb040 2024-04-25T09:02:16.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.059+0000 7fe303e00640 1 -- 172.21.15.59:0/3498300970 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe304005070 con 0x7fe30c0cb040 2024-04-25T09:02:16.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.063+0000 7fe303e00640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2e8066f90 0x7fe2e8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:16.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.063+0000 7fe303e00640 1 -- 172.21.15.59:0/3498300970 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fe304084ba0 con 0x7fe30c0cb040 2024-04-25T09:02:16.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.063+0000 7fe30b400640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2e8066f90 0x7fe2e8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:16.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.063+0000 7fe30b400640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2e8066f90 0x7fe2e8069450 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0ad000 tx=0x7fe2fc0b2040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:16.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.067+0000 7fe303e00640 1 -- 172.21.15.59:0/3498300970 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe30c0b5fd0 con 0x7fe30c0cb040 2024-04-25T09:02:16.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.283+0000 7fe312400640 1 -- 172.21.15.59:0/3498300970 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7fe30c0745d0 con 0x7fe30c0cb040 2024-04-25T09:02:16.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.975+0000 7fe303e00640 1 -- 172.21.15.59:0/3498300970 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v68) v1 ==== 145+0+0 (secure 0 0 0) 0x7fe304055770 con 0x7fe30c0cb040 2024-04-25T09:02:16.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.979+0000 7fe312400640 1 -- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2e8066f90 msgr2=0x7fe2e8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:16.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.979+0000 7fe312400640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2e8066f90 0x7fe2e8069450 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe2fc0ad000 tx=0x7fe2fc0b2040 comp rx=0 tx=0).stop 2024-04-25T09:02:16.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.979+0000 7fe312400640 1 -- 172.21.15.59:0/3498300970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c0cb040 msgr2=0x7fe30c0c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:16.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.979+0000 7fe312400640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c0cb040 0x7fe30c0c52d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe30400e700 tx=0x7fe30400ebc0 comp rx=0 tx=0).stop 2024-04-25T09:02:16.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.979+0000 7fe312400640 1 -- 172.21.15.59:0/3498300970 shutdown_connections 2024-04-25T09:02:16.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.979+0000 7fe312400640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2e8066f90 0x7fe2e8069450 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.979+0000 7fe312400640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe30c0cb040 0x7fe30c0c52d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.979+0000 7fe312400640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe30c0c93a0 0x7fe30c0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.979+0000 7fe312400640 1 --2- 172.21.15.59:0/3498300970 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2f0003b50 0x7fe30c151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.979+0000 7fe312400640 1 -- 172.21.15.59:0/3498300970 >> 172.21.15.59:0/3498300970 conn(0x7fe30c0d17a0 msgr2=0x7fe30c162120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.979+0000 7fe312400640 1 -- 172.21.15.59:0/3498300970 shutdown_connections 2024-04-25T09:02:16.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:16.979+0000 7fe312400640 1 -- 172.21.15.59:0/3498300970 wait complete. 2024-04-25T09:02:16.992 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:02:17.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.147+0000 7fe7c5000640 1 Processor -- start 2024-04-25T09:02:17.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.147+0000 7fe7c5000640 1 -- start start 2024-04-25T09:02:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.147+0000 7fe7c5000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe7c015dc60 0x7fe7c00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.147+0000 7fe7c5000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7c006bf30 0x7fe7c00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.147+0000 7fe7c5000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c015e040 con 0x7fe7c0099a60 2024-04-25T09:02:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.147+0000 7fe7c5000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c00cff80 con 0x7fe7c015dc60 2024-04-25T09:02:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.147+0000 7fe7c5000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00d0260 con 0x7fe7c006bf30 2024-04-25T09:02:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.151+0000 7fe7b7e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7c006bf30 0x7fe7c00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.151+0000 7fe7b7e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7c006bf30 0x7fe7c00cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:50328/0 (socket says 172.21.15.59:50328) 2024-04-25T09:02:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.151+0000 7fe7b7e00640 1 -- 172.21.15.59:0/682733899 learned_addr learned my addr 172.21.15.59:0/682733899 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:17.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.151+0000 7fe7bde00640 1 --2- 172.21.15.59:0/682733899 >> v2:172.21.15.178:3300/0 conn(0x7fe7c015dc60 0x7fe7c00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.151+0000 7fe7b7e00640 1 -- 172.21.15.59:0/682733899 >> v2:172.21.15.178:3300/0 conn(0x7fe7c015dc60 msgr2=0x7fe7c00d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.151+0000 7fe7b7e00640 1 --2- 172.21.15.59:0/682733899 >> v2:172.21.15.178:3300/0 conn(0x7fe7c015dc60 0x7fe7c00d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.151+0000 7fe7b7e00640 1 -- 172.21.15.59:0/682733899 >> v1:172.21.15.178:6789/0 conn(0x7fe7c0099a60 legacy=0x7fe7c00cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:17.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.151+0000 7fe7b7e00640 1 -- 172.21.15.59:0/682733899 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c00d0540 con 0x7fe7c006bf30 2024-04-25T09:02:17.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.151+0000 7fe7b7e00640 1 --2- 172.21.15.59:0/682733899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7c006bf30 0x7fe7c00cf8a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009870 tx=0x7fe7a801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b217cc45a86eb5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:17.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.151+0000 7fe7bd400640 1 -- 172.21.15.59:0/682733899 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80aa600 con 0x7fe7c006bf30 2024-04-25T09:02:17.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.151+0000 7fe7bd400640 1 -- 172.21.15.59:0/682733899 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a80af070 con 0x7fe7c006bf30 2024-04-25T09:02:17.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.151+0000 7fe7bd400640 1 -- 172.21.15.59:0/682733899 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80aa9c0 con 0x7fe7c006bf30 2024-04-25T09:02:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 -- 172.21.15.59:0/682733899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7c006bf30 msgr2=0x7fe7c00cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 --2- 172.21.15.59:0/682733899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7c006bf30 0x7fe7c00cf8a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009870 tx=0x7fe7a801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 -- 172.21.15.59:0/682733899 shutdown_connections 2024-04-25T09:02:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 --2- 172.21.15.59:0/682733899 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7c006bf30 0x7fe7c00cf8a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 --2- 172.21.15.59:0/682733899 >> v2:172.21.15.178:3300/0 conn(0x7fe7c015dc60 0x7fe7c00d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 -- 172.21.15.59:0/682733899 >> 172.21.15.59:0/682733899 conn(0x7fe7c00b3200 msgr2=0x7fe7c00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 -- 172.21.15.59:0/682733899 shutdown_connections 2024-04-25T09:02:17.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 -- 172.21.15.59:0/682733899 wait complete. 2024-04-25T09:02:17.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 Processor -- start 2024-04-25T09:02:17.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 -- start start 2024-04-25T09:02:17.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7c006bf30 0x7fe7c00c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7c0099a60 0x7fe7c0154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c015dc60 0x7fe7c0158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c009a280 con 0x7fe7c015dc60 2024-04-25T09:02:17.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00cc880 con 0x7fe7c0099a60 2024-04-25T09:02:17.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7c5000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c00ca210 con 0x7fe7c006bf30 2024-04-25T09:02:17.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7be800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c015dc60 0x7fe7c0158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7be800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c015dc60 0x7fe7c0158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60190/0 (socket says 172.21.15.59:60190) 2024-04-25T09:02:17.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7be800640 1 -- 172.21.15.59:0/3040209214 learned_addr learned my addr 172.21.15.59:0/3040209214 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:17.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7bde00640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7c006bf30 0x7fe7c00c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7b7e00640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7c0099a60 0x7fe7c0154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.155+0000 7fe7be800640 1 -- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7c006bf30 msgr2=0x7fe7c00c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7be800640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7c006bf30 0x7fe7c00c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7be800640 1 -- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7c0099a60 msgr2=0x7fe7c0154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7be800640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7c0099a60 0x7fe7c0154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7be800640 1 -- 172.21.15.59:0/3040209214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c0157d70 con 0x7fe7c015dc60 2024-04-25T09:02:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7be800640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c015dc60 0x7fe7c0158e10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800c770 tx=0x7fe7b800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7b6000640 1 -- 172.21.15.59:0/3040209214 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b8003b80 con 0x7fe7c015dc60 2024-04-25T09:02:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7b6000640 1 -- 172.21.15.59:0/3040209214 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b8003d20 con 0x7fe7c015dc60 2024-04-25T09:02:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7b6000640 1 -- 172.21.15.59:0/3040209214 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b800aa90 con 0x7fe7c015dc60 2024-04-25T09:02:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7c5000640 1 -- 172.21.15.59:0/3040209214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c0158050 con 0x7fe7c015dc60 2024-04-25T09:02:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7c5000640 1 -- 172.21.15.59:0/3040209214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c0158610 con 0x7fe7c015dc60 2024-04-25T09:02:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7c5000640 1 -- 172.21.15.59:0/3040209214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c00745d0 con 0x7fe7c015dc60 2024-04-25T09:02:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7b6000640 1 -- 172.21.15.59:0/3040209214 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe7b800ac30 con 0x7fe7c015dc60 2024-04-25T09:02:17.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7b6000640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe79c066f60 0x7fe79c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7b6000640 1 -- 172.21.15.59:0/3040209214 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fe7b8085240 con 0x7fe7c015dc60 2024-04-25T09:02:17.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.159+0000 7fe7bde00640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe79c066f60 0x7fe79c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.163+0000 7fe7bde00640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe79c066f60 0x7fe79c069420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009ac0 tx=0x7fe7b0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:17.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.163+0000 7fe7b6000640 1 -- 172.21.15.59:0/3040209214 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe7b80557b0 con 0x7fe7c015dc60 2024-04-25T09:02:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.327+0000 7fe7c5000640 1 -- 172.21.15.59:0/3040209214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe7c00b7590 con 0x7fe7c015dc60 2024-04-25T09:02:17.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.331+0000 7fe7b6000640 1 -- 172.21.15.59:0/3040209214 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe7b8059850 con 0x7fe7c015dc60 2024-04-25T09:02:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.331+0000 7fe7c5000640 1 -- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe79c066f60 msgr2=0x7fe79c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.331+0000 7fe7c5000640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe79c066f60 0x7fe79c069420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0009ac0 tx=0x7fe7b0009190 comp rx=0 tx=0).stop 2024-04-25T09:02:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.335+0000 7fe7c5000640 1 -- 172.21.15.59:0/3040209214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c015dc60 msgr2=0x7fe7c0158e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.335+0000 7fe7c5000640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c015dc60 0x7fe7c0158e10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe7b800c770 tx=0x7fe7b800cc30 comp rx=0 tx=0).stop 2024-04-25T09:02:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.335+0000 7fe7c5000640 1 -- 172.21.15.59:0/3040209214 shutdown_connections 2024-04-25T09:02:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.335+0000 7fe7c5000640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe79c066f60 0x7fe79c069420 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.335+0000 7fe7c5000640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7c015dc60 0x7fe7c0158e10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.335+0000 7fe7c5000640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7c0099a60 0x7fe7c0154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.335+0000 7fe7c5000640 1 --2- 172.21.15.59:0/3040209214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7c006bf30 0x7fe7c00c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.335+0000 7fe7c5000640 1 -- 172.21.15.59:0/3040209214 >> 172.21.15.59:0/3040209214 conn(0x7fe7c00b3200 msgr2=0x7fe7c00ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.335+0000 7fe7c5000640 1 -- 172.21.15.59:0/3040209214 shutdown_connections 2024-04-25T09:02:17.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.335+0000 7fe7c5000640 1 -- 172.21.15.59:0/3040209214 wait complete. 2024-04-25T09:02:17.345 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:02:17.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:02:17.471 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:02:17.547 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:02:17.547 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:02:17.547 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:17.556 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:02:17.557 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:17.609 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:02:17.609 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:17.666 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:17.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.855+0000 7f92dd400640 1 Processor -- start 2024-04-25T09:02:17.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.855+0000 7f92dd400640 1 -- start start 2024-04-25T09:02:17.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92dd400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f92d815fe50 0x7f92d80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92dd400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d80b1c90 0x7f92d815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92dd400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d80cc4e0 con 0x7f92d8145270 2024-04-25T09:02:17.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92dd400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92d8145650 con 0x7f92d815fe50 2024-04-25T09:02:17.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92dd400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d81602b0 con 0x7f92d80b1c90 2024-04-25T09:02:17.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d6800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f92d8145270 0x7f92d80cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34674/0 (socket says 172.21.15.59:34674) 2024-04-25T09:02:17.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d6800640 1 -- 172.21.15.59:0/952533736 learned_addr learned my addr 172.21.15.59:0/952533736 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d7200640 1 --2- 172.21.15.59:0/952533736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d80b1c90 0x7f92d815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92cde00640 1 --2- 172.21.15.59:0/952533736 >> v2:172.21.15.178:3300/0 conn(0x7f92d815fe50 0x7f92d80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362359289 0 0) 0x7f92d80cc4e0 con 0x7f92d8145270 2024-04-25T09:02:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92bc003530 con 0x7f92d8145270 2024-04-25T09:02:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3809480585 0 0) 0x7f92bc003530 con 0x7f92d8145270 2024-04-25T09:02:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d80b1c90 msgr2=0x7f92d815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 --2- 172.21.15.59:0/952533736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d80b1c90 0x7f92d815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 >> v2:172.21.15.178:3300/0 conn(0x7f92d815fe50 msgr2=0x7f92d80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 --2- 172.21.15.59:0/952533736 >> v2:172.21.15.178:3300/0 conn(0x7f92d815fe50 0x7f92d80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80ce040 con 0x7f92d8145270 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f92c8001680 con 0x7f92d8145270 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 >> v1:172.21.15.59:6789/0 conn(0x7f92d8145270 legacy=0x7f92d80cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 --2- 172.21.15.59:0/952533736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d80b1c90 0x7f92bc0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 --2- 172.21.15.59:0/952533736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92bc003f40 0x7f92bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 --2- 172.21.15.59:0/952533736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92bc004d50 0x7f92bc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d8145650 con 0x7f92bc003f40 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d81602b0 con 0x7f92bc004d50 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92bc00b9d0 con 0x7f92d80b1c90 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92cde00640 1 --2- 172.21.15.59:0/952533736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92bc003f40 0x7f92bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d7200640 1 --2- 172.21.15.59:0/952533736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92bc004d50 0x7f92bc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92d6800640 1 --2- 172.21.15.59:0/952533736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d80b1c90 0x7f92bc0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92cde00640 1 -- 172.21.15.59:0/952533736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d80b1c90 msgr2=0x7f92bc0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92cde00640 1 --2- 172.21.15.59:0/952533736 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d80b1c90 0x7f92bc0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92cde00640 1 -- 172.21.15.59:0/952533736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92bc004d50 msgr2=0x7f92bc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:17.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92cde00640 1 --2- 172.21.15.59:0/952533736 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92bc004d50 0x7f92bc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.859+0000 7f92cde00640 1 -- 172.21.15.59:0/952533736 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc003530 con 0x7f92bc003f40 2024-04-25T09:02:17.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.863+0000 7f92cde00640 1 --2- 172.21.15.59:0/952533736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92bc003f40 0x7f92bc004810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009ae0 tx=0x7f92c001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51699af092d13520 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:17.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.863+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c00b1070 con 0x7f92bc003f40 2024-04-25T09:02:17.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.863+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c00a4aa0 con 0x7f92bc003f40 2024-04-25T09:02:17.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.863+0000 7f92d5e00640 1 -- 172.21.15.59:0/952533736 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c00096b0 con 0x7f92bc003f40 2024-04-25T09:02:17.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.863+0000 7f92dd400640 1 -- 172.21.15.59:0/952533736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92bc003f40 msgr2=0x7f92bc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:17.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.863+0000 7f92dd400640 1 --2- 172.21.15.59:0/952533736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92bc003f40 0x7f92bc004810 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f92c0009ae0 tx=0x7f92c001c730 comp rx=0 tx=0).stop 2024-04-25T09:02:17.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.863+0000 7f92d7200640 1 -- 172.21.15.59:0/952533736 reap_dead start 2024-04-25T09:02:17.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.863+0000 7f92dd400640 1 -- 172.21.15.59:0/952533736 shutdown_connections 2024-04-25T09:02:17.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.863+0000 7f92dd400640 1 -- 172.21.15.59:0/952533736 >> 172.21.15.59:0/952533736 conn(0x7f92d8066fa0 msgr2=0x7f92d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:17.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.863+0000 7f92dd400640 1 -- 172.21.15.59:0/952533736 shutdown_connections 2024-04-25T09:02:17.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.863+0000 7f92dd400640 1 -- 172.21.15.59:0/952533736 wait complete. 2024-04-25T09:02:17.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92dd400640 1 Processor -- start 2024-04-25T09:02:17.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92dd400640 1 -- start start 2024-04-25T09:02:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92dd400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92bc003f40 0x7f92d80ae010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92dd400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92d80aca70 0x7f92d815af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92dd400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d8140c80 0x7f92d8141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92dd400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80cdbe0 con 0x7f92bc003f40 2024-04-25T09:02:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92dd400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d815f930 con 0x7f92d80aca70 2024-04-25T09:02:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92dd400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80cdd60 con 0x7f92d8140c80 2024-04-25T09:02:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92d6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92bc003f40 0x7f92d80ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92d6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92bc003f40 0x7f92d80ae010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60204/0 (socket says 172.21.15.59:60204) 2024-04-25T09:02:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92d6800640 1 -- 172.21.15.59:0/4253538214 learned_addr learned my addr 172.21.15.59:0/4253538214 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92d7200640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d8140c80 0x7f92d8141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92cde00640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92d80aca70 0x7f92d815af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92d6800640 1 -- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d8140c80 msgr2=0x7f92d8141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92d6800640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d8140c80 0x7f92d8141100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92d6800640 1 -- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92d80aca70 msgr2=0x7f92d815af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92d6800640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92d80aca70 0x7f92d815af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92d6800640 1 -- 172.21.15.59:0/4253538214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d815b450 con 0x7f92bc003f40 2024-04-25T09:02:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92d6800640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92bc003f40 0x7f92d80ae010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f92c8012520 tx=0x7f92c80129e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92cf400640 1 -- 172.21.15.59:0/4253538214 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c801c070 con 0x7f92bc003f40 2024-04-25T09:02:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92cf400640 1 -- 172.21.15.59:0/4253538214 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c8014810 con 0x7f92bc003f40 2024-04-25T09:02:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92dd400640 1 -- 172.21.15.59:0/4253538214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d80ada60 con 0x7f92bc003f40 2024-04-25T09:02:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92cf400640 1 -- 172.21.15.59:0/4253538214 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8014be0 con 0x7f92bc003f40 2024-04-25T09:02:17.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92dd400640 1 -- 172.21.15.59:0/4253538214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d80ad1c0 con 0x7f92bc003f40 2024-04-25T09:02:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.867+0000 7f92dd400640 1 -- 172.21.15.59:0/4253538214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d8141640 con 0x7f92bc003f40 2024-04-25T09:02:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.871+0000 7f92cf400640 1 -- 172.21.15.59:0/4253538214 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f92c801f070 con 0x7f92bc003f40 2024-04-25T09:02:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.871+0000 7f92cf400640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92b4066f90 0x7f92b4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.871+0000 7f92cf400640 1 -- 172.21.15.59:0/4253538214 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f92c8087d90 con 0x7f92bc003f40 2024-04-25T09:02:17.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.871+0000 7f92cde00640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92b4066f90 0x7f92b4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:17.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.871+0000 7f92cde00640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92b4066f90 0x7f92b4069450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f92c00ae000 tx=0x7f92c00046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:17.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:17.875+0000 7f92cf400640 1 -- 172.21.15.59:0/4253538214 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f92d815b450 con 0x7f92bc003f40 2024-04-25T09:02:18.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.039+0000 7f92dd400640 1 -- 172.21.15.59:0/4253538214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92d806b8e0 con 0x7f92bc003f40 2024-04-25T09:02:18.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.039+0000 7f92cf400640 1 -- 172.21.15.59:0/4253538214 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f92c8058310 con 0x7f92bc003f40 2024-04-25T09:02:18.032 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:18.032 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:08.938626+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.043+0000 7f92dd400640 1 -- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92b4066f90 msgr2=0x7f92b4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.043+0000 7f92dd400640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92b4066f90 0x7f92b4069450 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f92c00ae000 tx=0x7f92c00046d0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.043+0000 7f92dd400640 1 -- 172.21.15.59:0/4253538214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92bc003f40 msgr2=0x7f92d80ae010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.043+0000 7f92dd400640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92bc003f40 0x7f92d80ae010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f92c8012520 tx=0x7f92c80129e0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.043+0000 7f92dd400640 1 -- 172.21.15.59:0/4253538214 shutdown_connections 2024-04-25T09:02:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.043+0000 7f92dd400640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92b4066f90 0x7f92b4069450 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.043+0000 7f92dd400640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92d8140c80 0x7f92d8141100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.043+0000 7f92dd400640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92d80aca70 0x7f92d815af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.043+0000 7f92dd400640 1 --2- 172.21.15.59:0/4253538214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92bc003f40 0x7f92d80ae010 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.043+0000 7f92dd400640 1 -- 172.21.15.59:0/4253538214 >> 172.21.15.59:0/4253538214 conn(0x7f92d8066fa0 msgr2=0x7f92d815e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.043+0000 7f92dd400640 1 -- 172.21.15.59:0/4253538214 shutdown_connections 2024-04-25T09:02:18.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.043+0000 7f92dd400640 1 -- 172.21.15.59:0/4253538214 wait complete. 2024-04-25T09:02:18.053 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:02:18.054 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:18.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.203+0000 7f412a600640 1 Processor -- start 2024-04-25T09:02:18.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f412a600640 1 -- start start 2024-04-25T09:02:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f412a600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41240d0150 0x7f41240af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f412a600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f41240c72a0 0x7f41240c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f412a600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41240b30d0 con 0x7f412415dc00 2024-04-25T09:02:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f412a600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41240cd860 con 0x7f41240d0150 2024-04-25T09:02:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f412a600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41240ccf30 con 0x7f41240c72a0 2024-04-25T09:02:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f4123400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f412415dc00 0x7f41240c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34690/0 (socket says 172.21.15.59:34690) 2024-04-25T09:02:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f4123400640 1 -- 172.21.15.59:0/617549345 learned_addr learned my addr 172.21.15.59:0/617549345 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f4122a00640 1 --2- 172.21.15.59:0/617549345 >> v2:172.21.15.59:3300/0 conn(0x7f41240d0150 0x7f41240af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f4123e00640 1 --2- 172.21.15.59:0/617549345 >> v2:172.21.15.178:3300/0 conn(0x7f41240c72a0 0x7f41240c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f4122000640 1 -- 172.21.15.59:0/617549345 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244457598 0 0) 0x7f41240b30d0 con 0x7f412415dc00 2024-04-25T09:02:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f4122000640 1 -- 172.21.15.59:0/617549345 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4108003530 con 0x7f412415dc00 2024-04-25T09:02:18.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f4122a00640 1 -- 172.21.15.59:0/617549345 >> v2:172.21.15.178:3300/0 conn(0x7f41240c72a0 msgr2=0x7f41240c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:18.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f4122a00640 1 --2- 172.21.15.59:0/617549345 >> v2:172.21.15.178:3300/0 conn(0x7f41240c72a0 0x7f41240c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f4122a00640 1 -- 172.21.15.59:0/617549345 >> v1:172.21.15.59:6789/0 conn(0x7f412415dc00 legacy=0x7f41240c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.207+0000 7f4122a00640 1 -- 172.21.15.59:0/617549345 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41240cd210 con 0x7f41240d0150 2024-04-25T09:02:18.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f4122a00640 1 --2- 172.21.15.59:0/617549345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41240d0150 0x7f41240af770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f41240c6980 tx=0x7f411001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bdbfbf87f8853be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:18.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f4122000640 1 -- 172.21.15.59:0/617549345 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41100b0070 con 0x7f41240d0150 2024-04-25T09:02:18.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f4122000640 1 -- 172.21.15.59:0/617549345 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41100ab600 con 0x7f41240d0150 2024-04-25T09:02:18.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f4122000640 1 -- 172.21.15.59:0/617549345 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41100ab9d0 con 0x7f41240d0150 2024-04-25T09:02:18.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f412a600640 1 -- 172.21.15.59:0/617549345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41240d0150 msgr2=0x7f41240af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f412a600640 1 --2- 172.21.15.59:0/617549345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41240d0150 0x7f41240af770 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f41240c6980 tx=0x7f411001c480 comp rx=0 tx=0).stop 2024-04-25T09:02:18.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f412a600640 1 -- 172.21.15.59:0/617549345 shutdown_connections 2024-04-25T09:02:18.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f412a600640 1 --2- 172.21.15.59:0/617549345 >> v2:172.21.15.178:3300/0 conn(0x7f41240c72a0 0x7f41240c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f412a600640 1 --2- 172.21.15.59:0/617549345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41240d0150 0x7f41240af770 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f412a600640 1 -- 172.21.15.59:0/617549345 >> 172.21.15.59:0/617549345 conn(0x7f41240b2240 msgr2=0x7f41240b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:18.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f412a600640 1 -- 172.21.15.59:0/617549345 shutdown_connections 2024-04-25T09:02:18.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f412a600640 1 -- 172.21.15.59:0/617549345 wait complete. 2024-04-25T09:02:18.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f412a600640 1 Processor -- start 2024-04-25T09:02:18.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.211+0000 7f412a600640 1 -- start start 2024-04-25T09:02:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f412a600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41240c72a0 0x7f4124151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f412a600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41240d0150 0x7f412409e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f412a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f412415dc00 0x7f41241522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f412a600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412416a7c0 con 0x7f412415dc00 2024-04-25T09:02:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f412a600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412416a640 con 0x7f41240d0150 2024-04-25T09:02:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f412a600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412416a940 con 0x7f41240c72a0 2024-04-25T09:02:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f4123e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f412415dc00 0x7f41241522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f4123e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f412415dc00 0x7f41241522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60224/0 (socket says 172.21.15.59:60224) 2024-04-25T09:02:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f4123e00640 1 -- 172.21.15.59:0/572142909 learned_addr learned my addr 172.21.15.59:0/572142909 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f4122a00640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41240d0150 0x7f412409e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f4123400640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41240c72a0 0x7f4124151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f4123e00640 1 -- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41240c72a0 msgr2=0x7f4124151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f4123e00640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41240c72a0 0x7f4124151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f4123e00640 1 -- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41240d0150 msgr2=0x7f412409e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f4123e00640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41240d0150 0x7f412409e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f4123e00640 1 -- 172.21.15.59:0/572142909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41240b4920 con 0x7f412415dc00 2024-04-25T09:02:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f4123e00640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f412415dc00 0x7f41241522f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f411c007e60 tx=0x7f411c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f411b400640 1 -- 172.21.15.59:0/572142909 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c014620 con 0x7f412415dc00 2024-04-25T09:02:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f411b400640 1 -- 172.21.15.59:0/572142909 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411c019070 con 0x7f412415dc00 2024-04-25T09:02:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f411b400640 1 -- 172.21.15.59:0/572142909 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411c014a00 con 0x7f412415dc00 2024-04-25T09:02:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f412a600640 1 -- 172.21.15.59:0/572142909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41240b4c00 con 0x7f412415dc00 2024-04-25T09:02:18.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f412a600640 1 -- 172.21.15.59:0/572142909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412409ab60 con 0x7f412415dc00 2024-04-25T09:02:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f412a600640 1 -- 172.21.15.59:0/572142909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41240745d0 con 0x7f412415dc00 2024-04-25T09:02:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.215+0000 7f411b400640 1 -- 172.21.15.59:0/572142909 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f411c014ba0 con 0x7f412415dc00 2024-04-25T09:02:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.219+0000 7f411b400640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4104066f60 0x7f4104069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.219+0000 7f411b400640 1 -- 172.21.15.59:0/572142909 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f411c085cc0 con 0x7f412415dc00 2024-04-25T09:02:18.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.219+0000 7f4123400640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4104066f60 0x7f4104069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.219+0000 7f4123400640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4104066f60 0x7f4104069420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4114007fd0 tx=0x7f4114009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:18.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.223+0000 7f411b400640 1 -- 172.21.15.59:0/572142909 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f411c08c080 con 0x7f412415dc00 2024-04-25T09:02:18.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.383+0000 7f412a600640 1 -- 172.21.15.59:0/572142909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4124161120 con 0x7f412415dc00 2024-04-25T09:02:18.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.383+0000 7f411b400640 1 -- 172.21.15.59:0/572142909 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f411c0561a0 con 0x7f412415dc00 2024-04-25T09:02:18.376 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:02:18.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.387+0000 7f412a600640 1 -- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4104066f60 msgr2=0x7f4104069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.387+0000 7f412a600640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4104066f60 0x7f4104069420 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4114007fd0 tx=0x7f4114009040 comp rx=0 tx=0).stop 2024-04-25T09:02:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.387+0000 7f412a600640 1 -- 172.21.15.59:0/572142909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f412415dc00 msgr2=0x7f41241522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.387+0000 7f412a600640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f412415dc00 0x7f41241522f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f411c007e60 tx=0x7f411c00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.387+0000 7f412a600640 1 -- 172.21.15.59:0/572142909 shutdown_connections 2024-04-25T09:02:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.387+0000 7f412a600640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4104066f60 0x7f4104069420 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.387+0000 7f412a600640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f412415dc00 0x7f41241522f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.387+0000 7f412a600640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f41240d0150 0x7f412409e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.387+0000 7f412a600640 1 --2- 172.21.15.59:0/572142909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41240c72a0 0x7f4124151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.387+0000 7f412a600640 1 -- 172.21.15.59:0/572142909 >> 172.21.15.59:0/572142909 conn(0x7f41240b2240 msgr2=0x7f41240addb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:18.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.387+0000 7f412a600640 1 -- 172.21.15.59:0/572142909 shutdown_connections 2024-04-25T09:02:18.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.387+0000 7f412a600640 1 -- 172.21.15.59:0/572142909 wait complete. 2024-04-25T09:02:18.397 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:18.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.547+0000 7f7ebc800640 1 Processor -- start 2024-04-25T09:02:18.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.547+0000 7f7ebc800640 1 -- start start 2024-04-25T09:02:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7ebc800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7eb40b4810 0x7f7eb40d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7ebc800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7eb406e0f0 0x7f7eb41615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7ebc800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eb4161b20 0x7f7eb415dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7ebc800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb4161f30 con 0x7f7eb40b4810 2024-04-25T09:02:18.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7ebc800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb406e5f0 con 0x7f7eb406e0f0 2024-04-25T09:02:18.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7ebc800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb406e8d0 con 0x7f7eb4161b20 2024-04-25T09:02:18.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7eb9e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7eb40b4810 0x7f7eb40d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7eb9e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7eb40b4810 0x7f7eb40d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60226/0 (socket says 172.21.15.59:60226) 2024-04-25T09:02:18.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7eb9e00640 1 -- 172.21.15.59:0/209652556 learned_addr learned my addr 172.21.15.59:0/209652556 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:18.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7eba800640 1 --2- 172.21.15.59:0/209652556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eb4161b20 0x7f7eb415dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7eb9400640 1 --2- 172.21.15.59:0/209652556 >> v2:172.21.15.178:3300/0 conn(0x7f7eb406e0f0 0x7f7eb41615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7eb9e00640 1 -- 172.21.15.59:0/209652556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eb4161b20 msgr2=0x7f7eb415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:18.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7eb9e00640 1 --2- 172.21.15.59:0/209652556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eb4161b20 0x7f7eb415dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7eb9e00640 1 -- 172.21.15.59:0/209652556 >> v2:172.21.15.178:3300/0 conn(0x7f7eb406e0f0 msgr2=0x7f7eb41615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:18.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7eb9e00640 1 --2- 172.21.15.59:0/209652556 >> v2:172.21.15.178:3300/0 conn(0x7f7eb406e0f0 0x7f7eb41615e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.551+0000 7f7eb9e00640 1 -- 172.21.15.59:0/209652556 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb406ebb0 con 0x7f7eb40b4810 2024-04-25T09:02:18.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7eb9e00640 1 --2- 172.21.15.59:0/209652556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb40b4810 0x7f7eb40d04e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4072e50 tx=0x7f7ea801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0c1e6bef15d37b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:18.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7eb8a00640 1 -- 172.21.15.59:0/209652556 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80b0070 con 0x7f7eb40b4810 2024-04-25T09:02:18.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7eb8a00640 1 -- 172.21.15.59:0/209652556 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea80ab600 con 0x7f7eb40b4810 2024-04-25T09:02:18.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7eb8a00640 1 -- 172.21.15.59:0/209652556 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80ab9d0 con 0x7f7eb40b4810 2024-04-25T09:02:18.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7ebc800640 1 -- 172.21.15.59:0/209652556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb40b4810 msgr2=0x7f7eb40d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7ebc800640 1 --2- 172.21.15.59:0/209652556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb40b4810 0x7f7eb40d04e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7eb4072e50 tx=0x7f7ea801c490 comp rx=0 tx=0).stop 2024-04-25T09:02:18.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7ebc800640 1 -- 172.21.15.59:0/209652556 shutdown_connections 2024-04-25T09:02:18.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7ebc800640 1 --2- 172.21.15.59:0/209652556 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eb4161b20 0x7f7eb415dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7ebc800640 1 --2- 172.21.15.59:0/209652556 >> v2:172.21.15.178:3300/0 conn(0x7f7eb406e0f0 0x7f7eb41615e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7ebc800640 1 --2- 172.21.15.59:0/209652556 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb40b4810 0x7f7eb40d04e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7ebc800640 1 -- 172.21.15.59:0/209652556 >> 172.21.15.59:0/209652556 conn(0x7f7eb40cf9c0 msgr2=0x7f7eb40cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:18.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7ebc800640 1 -- 172.21.15.59:0/209652556 shutdown_connections 2024-04-25T09:02:18.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7ebc800640 1 -- 172.21.15.59:0/209652556 wait complete. 2024-04-25T09:02:18.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7ebc800640 1 Processor -- start 2024-04-25T09:02:18.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.555+0000 7f7ebc800640 1 -- start start 2024-04-25T09:02:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7ebc800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eb406e0f0 0x7f7eb40ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7ebc800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eb40b4810 0x7f7eb41602a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7ebc800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb4161b20 0x7f7eb41607e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7ebc800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40b2ec0 con 0x7f7eb4161b20 2024-04-25T09:02:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7ebc800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40b2d40 con 0x7f7eb406e0f0 2024-04-25T09:02:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7ebc800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40b3040 con 0x7f7eb40b4810 2024-04-25T09:02:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eba800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb4161b20 0x7f7eb41607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eba800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb4161b20 0x7f7eb41607e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60228/0 (socket says 172.21.15.59:60228) 2024-04-25T09:02:18.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eba800640 1 -- 172.21.15.59:0/745962032 learned_addr learned my addr 172.21.15.59:0/745962032 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eb9400640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eb40b4810 0x7f7eb41602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eb9e00640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eb406e0f0 0x7f7eb40ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eba800640 1 -- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eb40b4810 msgr2=0x7f7eb41602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eba800640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eb40b4810 0x7f7eb41602a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eba800640 1 -- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eb406e0f0 msgr2=0x7f7eb40ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eba800640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eb406e0f0 0x7f7eb40ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eba800640 1 -- 172.21.15.59:0/745962032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb414a340 con 0x7f7eb4161b20 2024-04-25T09:02:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eba800640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb4161b20 0x7f7eb41607e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0007e60 tx=0x7f7eb000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:18.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eae000640 1 -- 172.21.15.59:0/745962032 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0014420 con 0x7f7eb4161b20 2024-04-25T09:02:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eae000640 1 -- 172.21.15.59:0/745962032 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb0019070 con 0x7f7eb4161b20 2024-04-25T09:02:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7ebc800640 1 -- 172.21.15.59:0/745962032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb414a620 con 0x7f7eb4161b20 2024-04-25T09:02:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eae000640 1 -- 172.21.15.59:0/745962032 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb0014820 con 0x7f7eb4161b20 2024-04-25T09:02:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7ebc800640 1 -- 172.21.15.59:0/745962032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb414abe0 con 0x7f7eb4161b20 2024-04-25T09:02:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7ebc800640 1 -- 172.21.15.59:0/745962032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb40745d0 con 0x7f7eb4161b20 2024-04-25T09:02:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.559+0000 7f7eae000640 1 -- 172.21.15.59:0/745962032 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7eb00149c0 con 0x7f7eb4161b20 2024-04-25T09:02:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.563+0000 7f7eae000640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e98066f60 0x7f7e98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.563+0000 7f7eae000640 1 -- 172.21.15.59:0/745962032 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f7eb0085c70 con 0x7f7eb4161b20 2024-04-25T09:02:18.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.563+0000 7f7eb9e00640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e98066f60 0x7f7e98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.563+0000 7f7eb9e00640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e98066f60 0x7f7e98069420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80ad000 tx=0x7f7ea8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:18.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.567+0000 7f7eae000640 1 -- 172.21.15.59:0/745962032 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7eb0056830 con 0x7f7eb4161b20 2024-04-25T09:02:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.727+0000 7f7ebc800640 1 -- 172.21.15.59:0/745962032 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7eb40cbe00 con 0x7f7eb4161b20 2024-04-25T09:02:18.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.727+0000 7f7eae000640 1 -- 172.21.15.59:0/745962032 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7eb0056130 con 0x7f7eb4161b20 2024-04-25T09:02:18.719 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.731+0000 7f7ebc800640 1 -- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e98066f60 msgr2=0x7f7e98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.731+0000 7f7ebc800640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e98066f60 0x7f7e98069420 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80ad000 tx=0x7f7ea8008040 comp rx=0 tx=0).stop 2024-04-25T09:02:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.731+0000 7f7ebc800640 1 -- 172.21.15.59:0/745962032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb4161b20 msgr2=0x7f7eb41607e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.731+0000 7f7ebc800640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb4161b20 0x7f7eb41607e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f7eb0007e60 tx=0x7f7eb000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.731+0000 7f7ebc800640 1 -- 172.21.15.59:0/745962032 shutdown_connections 2024-04-25T09:02:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.731+0000 7f7ebc800640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e98066f60 0x7f7e98069420 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.731+0000 7f7ebc800640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7eb4161b20 0x7f7eb41607e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.731+0000 7f7ebc800640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7eb40b4810 0x7f7eb41602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.731+0000 7f7ebc800640 1 --2- 172.21.15.59:0/745962032 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7eb406e0f0 0x7f7eb40ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.731+0000 7f7ebc800640 1 -- 172.21.15.59:0/745962032 >> 172.21.15.59:0/745962032 conn(0x7f7eb40cf9c0 msgr2=0x7f7eb415bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.731+0000 7f7ebc800640 1 -- 172.21.15.59:0/745962032 shutdown_connections 2024-04-25T09:02:18.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.731+0000 7f7ebc800640 1 -- 172.21.15.59:0/745962032 wait complete. 2024-04-25T09:02:18.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:18.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f0920600640 1 Processor -- start 2024-04-25T09:02:18.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f0920600640 1 -- start start 2024-04-25T09:02:18.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f0920600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0918144120 0x7f091815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f0920600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09180ccbf0 0x7f091815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f0920600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f091815bc40 con 0x7f091815ee60 2024-04-25T09:02:18.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f0920600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f091815e490 con 0x7f0918144120 2024-04-25T09:02:18.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f0920600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f091815b3a0 con 0x7f09180ccbf0 2024-04-25T09:02:18.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f091e600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f091815ee60 0x7f09180b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34704/0 (socket says 172.21.15.59:34704) 2024-04-25T09:02:18.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f091e600640 1 -- 172.21.15.59:0/3202562441 learned_addr learned my addr 172.21.15.59:0/3202562441 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:18.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f091dc00640 1 --2- 172.21.15.59:0/3202562441 >> v2:172.21.15.178:3300/0 conn(0x7f0918144120 0x7f091815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f091d200640 1 --2- 172.21.15.59:0/3202562441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09180ccbf0 0x7f091815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f0917e00640 1 -- 172.21.15.59:0/3202562441 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416945323 0 0) 0x7f091815bc40 con 0x7f091815ee60 2024-04-25T09:02:18.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f0917e00640 1 -- 172.21.15.59:0/3202562441 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0900003530 con 0x7f091815ee60 2024-04-25T09:02:18.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f091dc00640 1 -- 172.21.15.59:0/3202562441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09180ccbf0 msgr2=0x7f091815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:18.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f091dc00640 1 --2- 172.21.15.59:0/3202562441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09180ccbf0 0x7f091815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f091dc00640 1 -- 172.21.15.59:0/3202562441 >> v1:172.21.15.59:6789/0 conn(0x7f091815ee60 legacy=0x7f09180b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.895+0000 7f091dc00640 1 -- 172.21.15.59:0/3202562441 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091815b680 con 0x7f0918144120 2024-04-25T09:02:18.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.899+0000 7f091dc00640 1 --2- 172.21.15.59:0/3202562441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0918144120 0x7f091815acd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f090c0097c0 tx=0x7f090c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f7ae22efb44d71f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:18.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.899+0000 7f0917e00640 1 -- 172.21.15.59:0/3202562441 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0b0070 con 0x7f0918144120 2024-04-25T09:02:18.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.899+0000 7f0917e00640 1 -- 172.21.15.59:0/3202562441 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0ab600 con 0x7f0918144120 2024-04-25T09:02:18.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.899+0000 7f0917e00640 1 -- 172.21.15.59:0/3202562441 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0ab9d0 con 0x7f0918144120 2024-04-25T09:02:18.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.899+0000 7f0920600640 1 -- 172.21.15.59:0/3202562441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0918144120 msgr2=0x7f091815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.899+0000 7f0920600640 1 --2- 172.21.15.59:0/3202562441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0918144120 0x7f091815acd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f090c0097c0 tx=0x7f090c01c410 comp rx=0 tx=0).stop 2024-04-25T09:02:18.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.899+0000 7f0920600640 1 -- 172.21.15.59:0/3202562441 shutdown_connections 2024-04-25T09:02:18.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.899+0000 7f0920600640 1 --2- 172.21.15.59:0/3202562441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09180ccbf0 0x7f091815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.899+0000 7f0920600640 1 --2- 172.21.15.59:0/3202562441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0918144120 0x7f091815acd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.899+0000 7f0920600640 1 -- 172.21.15.59:0/3202562441 >> 172.21.15.59:0/3202562441 conn(0x7f0918067080 msgr2=0x7f091806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:18.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.899+0000 7f0920600640 1 -- 172.21.15.59:0/3202562441 shutdown_connections 2024-04-25T09:02:18.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.899+0000 7f0920600640 1 -- 172.21.15.59:0/3202562441 wait complete. 2024-04-25T09:02:18.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0920600640 1 Processor -- start 2024-04-25T09:02:18.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0920600640 1 -- start start 2024-04-25T09:02:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0920600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09180ccbf0 0x7f091813be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0920600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0918144120 0x7f09181637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0920600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091815ee60 0x7f0918163d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0920600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09181675c0 con 0x7f091815ee60 2024-04-25T09:02:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0920600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0918167440 con 0x7f09180ccbf0 2024-04-25T09:02:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0920600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0918167740 con 0x7f0918144120 2024-04-25T09:02:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f091e600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091815ee60 0x7f0918163d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f091e600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091815ee60 0x7f0918163d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60232/0 (socket says 172.21.15.59:60232) 2024-04-25T09:02:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f091e600640 1 -- 172.21.15.59:0/1224723771 learned_addr learned my addr 172.21.15.59:0/1224723771 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f091dc00640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09180ccbf0 0x7f091813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f091d200640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0918144120 0x7f09181637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f091e600640 1 -- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0918144120 msgr2=0x7f09181637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f091e600640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0918144120 0x7f09181637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f091e600640 1 -- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09180ccbf0 msgr2=0x7f091813be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:18.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f091e600640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09180ccbf0 0x7f091813be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:18.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f091e600640 1 -- 172.21.15.59:0/1224723771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091815ccd0 con 0x7f091815ee60 2024-04-25T09:02:18.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f091e600640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091815ee60 0x7f0918163d30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f091000caa0 tx=0x7f091000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:18.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0915600640 1 -- 172.21.15.59:0/1224723771 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910017070 con 0x7f091815ee60 2024-04-25T09:02:18.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0915600640 1 -- 172.21.15.59:0/1224723771 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091000ac00 con 0x7f091815ee60 2024-04-25T09:02:18.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0915600640 1 -- 172.21.15.59:0/1224723771 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910012400 con 0x7f091815ee60 2024-04-25T09:02:18.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0920600640 1 -- 172.21.15.59:0/1224723771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f091815cfb0 con 0x7f091815ee60 2024-04-25T09:02:18.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.903+0000 7f0920600640 1 -- 172.21.15.59:0/1224723771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091815d570 con 0x7f091815ee60 2024-04-25T09:02:18.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.907+0000 7f0920600640 1 -- 172.21.15.59:0/1224723771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09180745d0 con 0x7f091815ee60 2024-04-25T09:02:18.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.907+0000 7f0915600640 1 -- 172.21.15.59:0/1224723771 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f091001a070 con 0x7f091815ee60 2024-04-25T09:02:18.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.907+0000 7f0915600640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f08f8066f90 0x7f08f8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:18.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.907+0000 7f0915600640 1 -- 172.21.15.59:0/1224723771 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f09100850d0 con 0x7f091815ee60 2024-04-25T09:02:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.907+0000 7f091dc00640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f08f8066f90 0x7f08f8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:18.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.911+0000 7f091dc00640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f08f8066f90 0x7f08f8069450 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f090c0ad000 tx=0x7f090c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:18.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:18.911+0000 7f0915600640 1 -- 172.21.15.59:0/1224723771 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f09100556c0 con 0x7f091815ee60 2024-04-25T09:02:19.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.075+0000 7f0920600640 1 -- 172.21.15.59:0/1224723771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09180b32e0 con 0x7f091815ee60 2024-04-25T09:02:19.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.075+0000 7f0915600640 1 -- 172.21.15.59:0/1224723771 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0910059760 con 0x7f091815ee60 2024-04-25T09:02:19.068 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:02:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.079+0000 7f0920600640 1 -- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f08f8066f90 msgr2=0x7f08f8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.079+0000 7f0920600640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f08f8066f90 0x7f08f8069450 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f090c0ad000 tx=0x7f090c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:02:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.079+0000 7f0920600640 1 -- 172.21.15.59:0/1224723771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091815ee60 msgr2=0x7f0918163d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.079+0000 7f0920600640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091815ee60 0x7f0918163d30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f091000caa0 tx=0x7f091000cf60 comp rx=0 tx=0).stop 2024-04-25T09:02:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.079+0000 7f0920600640 1 -- 172.21.15.59:0/1224723771 shutdown_connections 2024-04-25T09:02:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.079+0000 7f0920600640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f08f8066f90 0x7f08f8069450 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.079+0000 7f0920600640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f091815ee60 0x7f0918163d30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.079+0000 7f0920600640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0918144120 0x7f09181637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.079+0000 7f0920600640 1 --2- 172.21.15.59:0/1224723771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09180ccbf0 0x7f091813be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.079+0000 7f0920600640 1 -- 172.21.15.59:0/1224723771 >> 172.21.15.59:0/1224723771 conn(0x7f0918067080 msgr2=0x7f0918140d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.079+0000 7f0920600640 1 -- 172.21.15.59:0/1224723771 shutdown_connections 2024-04-25T09:02:19.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.079+0000 7f0920600640 1 -- 172.21.15.59:0/1224723771 wait complete. 2024-04-25T09:02:19.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:02:19.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.243+0000 7f8ff6000640 1 Processor -- start 2024-04-25T09:02:19.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.243+0000 7f8ff6000640 1 -- start start 2024-04-25T09:02:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.243+0000 7f8ff6000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ff015dc60 0x7f8ff00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.243+0000 7f8ff6000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff015e040 con 0x7f8ff009a170 2024-04-25T09:02:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.243+0000 7f8ff6000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ff00cff80 con 0x7f8ff006bf30 2024-04-25T09:02:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.243+0000 7f8ff6000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ff00d0260 con 0x7f8ff015dc60 2024-04-25T09:02:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.243+0000 7f8fef400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ff015dc60 0x7f8ff00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:19.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.243+0000 7f8fefe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8ff009a170 0x7f8ff00cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34716/0 (socket says 172.21.15.59:34716) 2024-04-25T09:02:19.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.243+0000 7f8fefe00640 1 -- 172.21.15.59:0/4068100234 learned_addr learned my addr 172.21.15.59:0/4068100234 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:19.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.243+0000 7f8fef400640 1 -- 172.21.15.59:0/4068100234 >> v1:172.21.15.178:6789/0 conn(0x7f8ff006bf30 legacy=0x7f8ff0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:19.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.243+0000 7f8fef400640 1 -- 172.21.15.59:0/4068100234 >> v1:172.21.15.59:6789/0 conn(0x7f8ff009a170 legacy=0x7f8ff00cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.247+0000 7f8fef400640 1 -- 172.21.15.59:0/4068100234 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff00d0540 con 0x7f8ff015dc60 2024-04-25T09:02:19.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.243+0000 7f8fee000640 1 -- 172.21.15.59:0/4068100234 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965299994 0 0) 0x7f8ff015e040 con 0x7f8ff009a170 2024-04-25T09:02:19.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.247+0000 7f8fef400640 1 --2- 172.21.15.59:0/4068100234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff015dc60 0x7f8ff00d1020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00097c0 tx=0x7f8fe001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aefcffea0c20a68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:19.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.247+0000 7f8fee000640 1 -- 172.21.15.59:0/4068100234 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe00b1070 con 0x7f8ff015dc60 2024-04-25T09:02:19.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.247+0000 7f8fee000640 1 -- 172.21.15.59:0/4068100234 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe00a8050 con 0x7f8ff015dc60 2024-04-25T09:02:19.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.247+0000 7f8fee000640 1 -- 172.21.15.59:0/4068100234 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe00ac860 con 0x7f8ff015dc60 2024-04-25T09:02:19.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.247+0000 7f8ff6000640 1 -- 172.21.15.59:0/4068100234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff015dc60 msgr2=0x7f8ff00d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.247+0000 7f8ff6000640 1 --2- 172.21.15.59:0/4068100234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff015dc60 0x7f8ff00d1020 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00097c0 tx=0x7f8fe001c3e0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.247+0000 7f8ff6000640 1 -- 172.21.15.59:0/4068100234 shutdown_connections 2024-04-25T09:02:19.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.247+0000 7f8ff6000640 1 --2- 172.21.15.59:0/4068100234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff015dc60 0x7f8ff00d1020 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.247+0000 7f8ff6000640 1 -- 172.21.15.59:0/4068100234 >> 172.21.15.59:0/4068100234 conn(0x7f8ff00b3200 msgr2=0x7f8ff00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:19.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.247+0000 7f8ff6000640 1 -- 172.21.15.59:0/4068100234 shutdown_connections 2024-04-25T09:02:19.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.247+0000 7f8ff6000640 1 -- 172.21.15.59:0/4068100234 wait complete. 2024-04-25T09:02:19.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8ff6000640 1 Processor -- start 2024-04-25T09:02:19.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8ff6000640 1 -- start start 2024-04-25T09:02:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8ff6000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff006bf30 0x7f8ff00c9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8ff6000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ff009a170 0x7f8ff015c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8ff6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff015dc60 0x7f8ff015f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8ff6000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff006cfa0 con 0x7f8ff015dc60 2024-04-25T09:02:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8ff6000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff00cc880 con 0x7f8ff009a170 2024-04-25T09:02:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8ff6000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff015cd60 con 0x7f8ff006bf30 2024-04-25T09:02:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fefe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff015dc60 0x7f8ff015f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fefe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff015dc60 0x7f8ff015f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60250/0 (socket says 172.21.15.59:60250) 2024-04-25T09:02:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fefe00640 1 -- 172.21.15.59:0/3405216406 learned_addr learned my addr 172.21.15.59:0/3405216406 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fef400640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff006bf30 0x7f8ff00c9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8feea00640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ff009a170 0x7f8ff015c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:19.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fefe00640 1 -- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff006bf30 msgr2=0x7f8ff00c9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fefe00640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff006bf30 0x7f8ff00c9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fefe00640 1 -- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ff009a170 msgr2=0x7f8ff015c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fefe00640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ff009a170 0x7f8ff015c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fefe00640 1 -- 172.21.15.59:0/3405216406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff00c9d70 con 0x7f8ff015dc60 2024-04-25T09:02:19.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8feea00640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ff009a170 0x7f8ff015c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:19.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fefe00640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff015dc60 0x7f8ff015f2e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800c750 tx=0x7f8fe800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fe7400640 1 -- 172.21.15.59:0/3405216406 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe8018070 con 0x7f8ff015dc60 2024-04-25T09:02:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fe7400640 1 -- 172.21.15.59:0/3405216406 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe800a640 con 0x7f8ff015dc60 2024-04-25T09:02:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8fe7400640 1 -- 172.21.15.59:0/3405216406 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe800ce60 con 0x7f8ff015dc60 2024-04-25T09:02:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8ff6000640 1 -- 172.21.15.59:0/3405216406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff015ca80 con 0x7f8ff015dc60 2024-04-25T09:02:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.251+0000 7f8ff6000640 1 -- 172.21.15.59:0/3405216406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff015eae0 con 0x7f8ff015dc60 2024-04-25T09:02:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.255+0000 7f8ff6000640 1 -- 172.21.15.59:0/3405216406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff00745d0 con 0x7f8ff015dc60 2024-04-25T09:02:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.255+0000 7f8fe7400640 1 -- 172.21.15.59:0/3405216406 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8fe800aa70 con 0x7f8ff015dc60 2024-04-25T09:02:19.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.255+0000 7f8fe7400640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8fd0066f60 0x7f8fd0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:19.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.255+0000 7f8fe7400640 1 -- 172.21.15.59:0/3405216406 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f8fe8084b00 con 0x7f8ff015dc60 2024-04-25T09:02:19.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.255+0000 7f8fef400640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8fd0066f60 0x7f8fd0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:19.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.255+0000 7f8fef400640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8fd0066f60 0x7f8fd0069420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00ae000 tx=0x7f8fe00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:19.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.259+0000 7f8fe7400640 1 -- 172.21.15.59:0/3405216406 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8fe8055630 con 0x7f8ff015dc60 2024-04-25T09:02:19.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.423+0000 7f8ff6000640 1 -- 172.21.15.59:0/3405216406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8ff0158820 con 0x7f8ff015dc60 2024-04-25T09:02:19.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.423+0000 7f8fe7400640 1 -- 172.21.15.59:0/3405216406 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8fe8054f30 con 0x7f8ff015dc60 2024-04-25T09:02:19.415 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:19.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.427+0000 7f8ff6000640 1 -- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8fd0066f60 msgr2=0x7f8fd0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.427+0000 7f8ff6000640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8fd0066f60 0x7f8fd0069420 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8fe00ae000 tx=0x7f8fe00a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:19.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.427+0000 7f8ff6000640 1 -- 172.21.15.59:0/3405216406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff015dc60 msgr2=0x7f8ff015f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.427+0000 7f8ff6000640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff015dc60 0x7f8ff015f2e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800c750 tx=0x7f8fe800cc10 comp rx=0 tx=0).stop 2024-04-25T09:02:19.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.427+0000 7f8ff6000640 1 -- 172.21.15.59:0/3405216406 shutdown_connections 2024-04-25T09:02:19.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.427+0000 7f8ff6000640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8fd0066f60 0x7f8fd0069420 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.427+0000 7f8ff6000640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ff015dc60 0x7f8ff015f2e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.427+0000 7f8ff6000640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8ff009a170 0x7f8ff015c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.427+0000 7f8ff6000640 1 --2- 172.21.15.59:0/3405216406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8ff006bf30 0x7f8ff00c9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.427+0000 7f8ff6000640 1 -- 172.21.15.59:0/3405216406 >> 172.21.15.59:0/3405216406 conn(0x7f8ff00b3200 msgr2=0x7f8ff006c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:19.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.427+0000 7f8ff6000640 1 -- 172.21.15.59:0/3405216406 shutdown_connections 2024-04-25T09:02:19.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.427+0000 7f8ff6000640 1 -- 172.21.15.59:0/3405216406 wait complete. 2024-04-25T09:02:19.437 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:02:19.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8f5800640 1 Processor -- start 2024-04-25T09:02:19.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8f5800640 1 -- start start 2024-04-25T09:02:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8f5800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8f0161570 0x7fe8f00b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8f5800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe8f00b0ef0 0x7fe8f0161950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8f5800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f006c860 con 0x7fe8f0161e90 2024-04-25T09:02:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8f5800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f006d100 con 0x7fe8f0161570 2024-04-25T09:02:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8f5800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f00b27f0 con 0x7fe8f00b0ef0 2024-04-25T09:02:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8efe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8f0161570 0x7fe8f00b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8f4e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe8f0161e90 0x7fe8f00d0020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34724/0 (socket says 172.21.15.59:34724) 2024-04-25T09:02:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8efe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8f0161570 0x7fe8f00b22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60266/0 (socket says 172.21.15.59:60266) 2024-04-25T09:02:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8f4e00640 1 -- 172.21.15.59:0/4077258794 learned_addr learned my addr 172.21.15.59:0/4077258794 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8e7e00640 1 --2- 172.21.15.59:0/4077258794 >> v2:172.21.15.178:3300/0 conn(0x7fe8f00b0ef0 0x7fe8f0161950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:19.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8efe00640 1 -- 172.21.15.59:0/4077258794 >> v2:172.21.15.178:3300/0 conn(0x7fe8f00b0ef0 msgr2=0x7fe8f0161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8efe00640 1 --2- 172.21.15.59:0/4077258794 >> v2:172.21.15.178:3300/0 conn(0x7fe8f00b0ef0 0x7fe8f0161950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8efe00640 1 -- 172.21.15.59:0/4077258794 >> v1:172.21.15.59:6789/0 conn(0x7fe8f0161e90 legacy=0x7fe8f00d0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8efe00640 1 -- 172.21.15.59:0/4077258794 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f006cb40 con 0x7fe8f0161570 2024-04-25T09:02:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8ef400640 1 -- 172.21.15.59:0/4077258794 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598889774 0 0) 0x7fe8f006c860 con 0x7fe8f0161e90 2024-04-25T09:02:19.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.587+0000 7fe8e7e00640 1 --2- 172.21.15.59:0/4077258794 >> v2:172.21.15.178:3300/0 conn(0x7fe8f00b0ef0 0x7fe8f0161950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:19.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.591+0000 7fe8efe00640 1 --2- 172.21.15.59:0/4077258794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f0161570 0x7fe8f00b22b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00cbc20 tx=0x7fe8e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824d3a3a2f20d3f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.591+0000 7fe8ef400640 1 -- 172.21.15.59:0/4077258794 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00ab650 con 0x7fe8f0161570 2024-04-25T09:02:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.591+0000 7fe8ef400640 1 -- 172.21.15.59:0/4077258794 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e00b0070 con 0x7fe8f0161570 2024-04-25T09:02:19.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.591+0000 7fe8ef400640 1 -- 172.21.15.59:0/4077258794 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00aba10 con 0x7fe8f0161570 2024-04-25T09:02:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.591+0000 7fe8f5800640 1 -- 172.21.15.59:0/4077258794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f0161570 msgr2=0x7fe8f00b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.591+0000 7fe8f5800640 1 --2- 172.21.15.59:0/4077258794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f0161570 0x7fe8f00b22b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe8f00cbc20 tx=0x7fe8e001c450 comp rx=0 tx=0).stop 2024-04-25T09:02:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.591+0000 7fe8f5800640 1 -- 172.21.15.59:0/4077258794 shutdown_connections 2024-04-25T09:02:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.591+0000 7fe8f5800640 1 --2- 172.21.15.59:0/4077258794 >> v2:172.21.15.178:3300/0 conn(0x7fe8f00b0ef0 0x7fe8f0161950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.591+0000 7fe8f5800640 1 --2- 172.21.15.59:0/4077258794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f0161570 0x7fe8f00b22b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.591+0000 7fe8f5800640 1 -- 172.21.15.59:0/4077258794 >> 172.21.15.59:0/4077258794 conn(0x7fe8f00d1640 msgr2=0x7fe8f00d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.591+0000 7fe8f5800640 1 -- 172.21.15.59:0/4077258794 shutdown_connections 2024-04-25T09:02:19.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.591+0000 7fe8f5800640 1 -- 172.21.15.59:0/4077258794 wait complete. 2024-04-25T09:02:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8f5800640 1 Processor -- start 2024-04-25T09:02:19.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8f5800640 1 -- start start 2024-04-25T09:02:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8f5800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8f00b0ef0 0x7fe8f0152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8f5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f0161570 0x7fe8f0157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8f5800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8f0161e90 0x7fe8f015f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8f5800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00b2b70 con 0x7fe8f0161570 2024-04-25T09:02:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8f5800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00cf7b0 con 0x7fe8f00b0ef0 2024-04-25T09:02:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8f5800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00b1300 con 0x7fe8f0161e90 2024-04-25T09:02:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f0161570 0x7fe8f0157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:19.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f0161570 0x7fe8f0157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60282/0 (socket says 172.21.15.59:60282) 2024-04-25T09:02:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8e7e00640 1 -- 172.21.15.59:0/1434647994 learned_addr learned my addr 172.21.15.59:0/1434647994 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8f4e00640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8f0161e90 0x7fe8f015f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8efe00640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8f00b0ef0 0x7fe8f0152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8e7e00640 1 -- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8f0161e90 msgr2=0x7fe8f015f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8e7e00640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8f0161e90 0x7fe8f015f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8e7e00640 1 -- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8f00b0ef0 msgr2=0x7fe8f0152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8e7e00640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8f00b0ef0 0x7fe8f0152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8e7e00640 1 -- 172.21.15.59:0/1434647994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f0156940 con 0x7fe8f0161570 2024-04-25T09:02:19.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8e7e00640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f0161570 0x7fe8f0157fe0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800e810 tx=0x7fe8d800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:19.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8ecc00640 1 -- 172.21.15.59:0/1434647994 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d8017070 con 0x7fe8f0161570 2024-04-25T09:02:19.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8ecc00640 1 -- 172.21.15.59:0/1434647994 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d800c8d0 con 0x7fe8f0161570 2024-04-25T09:02:19.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8ecc00640 1 -- 172.21.15.59:0/1434647994 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d800f040 con 0x7fe8f0161570 2024-04-25T09:02:19.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8f5800640 1 -- 172.21.15.59:0/1434647994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f0156c20 con 0x7fe8f0161570 2024-04-25T09:02:19.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8f5800640 1 -- 172.21.15.59:0/1434647994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f01571e0 con 0x7fe8f0161570 2024-04-25T09:02:19.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.595+0000 7fe8f5800640 1 -- 172.21.15.59:0/1434647994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f00745d0 con 0x7fe8f0161570 2024-04-25T09:02:19.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.599+0000 7fe8ecc00640 1 -- 172.21.15.59:0/1434647994 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe8d801a070 con 0x7fe8f0161570 2024-04-25T09:02:19.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.599+0000 7fe8ecc00640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8cc066f60 0x7fe8cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:19.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.599+0000 7fe8ecc00640 1 -- 172.21.15.59:0/1434647994 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fe8d80850e0 con 0x7fe8f0161570 2024-04-25T09:02:19.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.599+0000 7fe8efe00640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8cc066f60 0x7fe8cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:19.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.599+0000 7fe8efe00640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8cc066f60 0x7fe8cc069420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00af000 tx=0x7fe8e00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:19.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.603+0000 7fe8ecc00640 1 -- 172.21.15.59:0/1434647994 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe8d8055c10 con 0x7fe8f0161570 2024-04-25T09:02:19.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 -- 172.21.15.59:0/1434647994 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe8f00c66b0 con 0x7fe8f0161570 2024-04-25T09:02:19.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8ecc00640 1 -- 172.21.15.59:0/1434647994 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe8d8055510 con 0x7fe8f0161570 2024-04-25T09:02:19.771 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:02:19.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 -- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8cc066f60 msgr2=0x7fe8cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8cc066f60 0x7fe8cc069420 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00af000 tx=0x7fe8e00a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:19.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 -- 172.21.15.59:0/1434647994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f0161570 msgr2=0x7fe8f0157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:19.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f0161570 0x7fe8f0157fe0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe8d800e810 tx=0x7fe8d800ecd0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 -- 172.21.15.59:0/1434647994 shutdown_connections 2024-04-25T09:02:19.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8cc066f60 0x7fe8cc069420 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8f0161e90 0x7fe8f015f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8f0161570 0x7fe8f0157fe0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 --2- 172.21.15.59:0/1434647994 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8f00b0ef0 0x7fe8f0152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:19.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 -- 172.21.15.59:0/1434647994 >> 172.21.15.59:0/1434647994 conn(0x7fe8f00d1640 msgr2=0x7fe8f00aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:19.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 -- 172.21.15.59:0/1434647994 shutdown_connections 2024-04-25T09:02:19.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:19.779+0000 7fe8f5800640 1 -- 172.21.15.59:0/1434647994 wait complete. 2024-04-25T09:02:19.793 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:02:19.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:19.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-25T09:02:19.828 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:02:19.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:19.829 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:02:19.885 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:02:19.886 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:19.895 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:02:19.896 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:19.951 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:02:19.951 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:20.008 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:20.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19dbe00640 1 Processor -- start 2024-04-25T09:02:20.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19dbe00640 1 -- start start 2024-04-25T09:02:20.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19dbe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19d415a720 0x7f19d415e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19dbe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d409dca0 0x7f19d415e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19dbe00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d406f3d0 con 0x7f19d415ecb0 2024-04-25T09:02:20.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19dbe00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d415ab00 con 0x7f19d415a720 2024-04-25T09:02:20.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19dbe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d415f160 con 0x7f19d409dca0 2024-04-25T09:02:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19d9400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19d415a720 0x7f19d415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19d8a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d409dca0 0x7f19d415e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19d9400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19d415a720 0x7f19d415e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:49710/0 (socket says 172.21.15.59:49710) 2024-04-25T09:02:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19d8a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d409dca0 0x7f19d415e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:50462/0 (socket says 172.21.15.59:50462) 2024-04-25T09:02:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19d9400640 1 -- 172.21.15.59:0/591749836 learned_addr learned my addr 172.21.15.59:0/591749836 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19d8a00640 1 -- 172.21.15.59:0/591749836 >> v2:172.21.15.178:3300/0 conn(0x7f19d415a720 msgr2=0x7f19d415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19d8a00640 1 --2- 172.21.15.59:0/591749836 >> v2:172.21.15.178:3300/0 conn(0x7f19d415a720 0x7f19d415e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19d8a00640 1 -- 172.21.15.59:0/591749836 >> v1:172.21.15.178:6789/0 conn(0x7f19d415ecb0 legacy=0x7f19d40ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19d8a00640 1 -- 172.21.15.59:0/591749836 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d406e610 con 0x7f19d409dca0 2024-04-25T09:02:20.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.159+0000 7f19d3e00640 1 -- 172.21.15.59:0/591749836 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519930357 0 0) 0x7f19d406f3d0 con 0x7f19d415ecb0 2024-04-25T09:02:20.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.163+0000 7f19d8a00640 1 --2- 172.21.15.59:0/591749836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d409dca0 0x7f19d415e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19c00097c0 tx=0x7f19c001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f8b2caa961f63b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:20.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.163+0000 7f19d3e00640 1 -- 172.21.15.59:0/591749836 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00a7070 con 0x7f19d409dca0 2024-04-25T09:02:20.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.163+0000 7f19d3e00640 1 -- 172.21.15.59:0/591749836 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c00b0070 con 0x7f19d409dca0 2024-04-25T09:02:20.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.163+0000 7f19d3e00640 1 -- 172.21.15.59:0/591749836 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c00ab890 con 0x7f19d409dca0 2024-04-25T09:02:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.163+0000 7f19dbe00640 1 -- 172.21.15.59:0/591749836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d409dca0 msgr2=0x7f19d415e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.163+0000 7f19dbe00640 1 --2- 172.21.15.59:0/591749836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d409dca0 0x7f19d415e770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f19c00097c0 tx=0x7f19c001c470 comp rx=0 tx=0).stop 2024-04-25T09:02:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.163+0000 7f19dbe00640 1 -- 172.21.15.59:0/591749836 shutdown_connections 2024-04-25T09:02:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.163+0000 7f19dbe00640 1 --2- 172.21.15.59:0/591749836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d409dca0 0x7f19d415e770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.163+0000 7f19dbe00640 1 --2- 172.21.15.59:0/591749836 >> v2:172.21.15.178:3300/0 conn(0x7f19d415a720 0x7f19d415e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.163+0000 7f19dbe00640 1 -- 172.21.15.59:0/591749836 >> 172.21.15.59:0/591749836 conn(0x7f19d40b23b0 msgr2=0x7f19d40cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.163+0000 7f19dbe00640 1 -- 172.21.15.59:0/591749836 shutdown_connections 2024-04-25T09:02:20.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.163+0000 7f19dbe00640 1 -- 172.21.15.59:0/591749836 wait complete. 2024-04-25T09:02:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19dbe00640 1 Processor -- start 2024-04-25T09:02:20.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19dbe00640 1 -- start start 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19dbe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19d409dca0 0x7f19d4142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19dbe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d415a720 0x7f19d414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19dbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19d415ecb0 0x7f19d414efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19dbe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d406ac10 con 0x7f19d415ecb0 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19dbe00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d40b3dd0 con 0x7f19d409dca0 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19dbe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d406ad90 con 0x7f19d415a720 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19d415ecb0 0x7f19d414efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d8a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d415a720 0x7f19d414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19d415ecb0 0x7f19d414efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60294/0 (socket says 172.21.15.59:60294) 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d9e00640 1 -- 172.21.15.59:0/2481542428 learned_addr learned my addr 172.21.15.59:0/2481542428 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d9400640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19d409dca0 0x7f19d4142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d9e00640 1 -- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d415a720 msgr2=0x7f19d414ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d9e00640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d415a720 0x7f19d414ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d9e00640 1 -- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19d409dca0 msgr2=0x7f19d4142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d9e00640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19d409dca0 0x7f19d4142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d9e00640 1 -- 172.21.15.59:0/2481542428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d4143050 con 0x7f19d415ecb0 2024-04-25T09:02:20.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d9e00640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19d415ecb0 0x7f19d414efd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00c780 tx=0x7f19cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:20.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d1600640 1 -- 172.21.15.59:0/2481542428 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc003db0 con 0x7f19d415ecb0 2024-04-25T09:02:20.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d1600640 1 -- 172.21.15.59:0/2481542428 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19cc00ce30 con 0x7f19d415ecb0 2024-04-25T09:02:20.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19d1600640 1 -- 172.21.15.59:0/2481542428 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19cc005290 con 0x7f19d415ecb0 2024-04-25T09:02:20.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19dbe00640 1 -- 172.21.15.59:0/2481542428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d4143a80 con 0x7f19d415ecb0 2024-04-25T09:02:20.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19dbe00640 1 -- 172.21.15.59:0/2481542428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d414c910 con 0x7f19d415ecb0 2024-04-25T09:02:20.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.167+0000 7f19dbe00640 1 -- 172.21.15.59:0/2481542428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d40745d0 con 0x7f19d415ecb0 2024-04-25T09:02:20.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.171+0000 7f19d1600640 1 -- 172.21.15.59:0/2481542428 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f19cc005430 con 0x7f19d415ecb0 2024-04-25T09:02:20.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.171+0000 7f19d1600640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f19b4066f60 0x7f19b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.171+0000 7f19d1600640 1 -- 172.21.15.59:0/2481542428 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f19cc0852c0 con 0x7f19d415ecb0 2024-04-25T09:02:20.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.171+0000 7f19d9400640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f19b4066f60 0x7f19b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.171+0000 7f19d9400640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f19b4066f60 0x7f19b4069420 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009b50 tx=0x7f19c8009240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:20.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.175+0000 7f19d1600640 1 -- 172.21.15.59:0/2481542428 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f19cc055710 con 0x7f19d415ecb0 2024-04-25T09:02:20.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 -- 172.21.15.59:0/2481542428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19d406ca70 con 0x7f19d415ecb0 2024-04-25T09:02:20.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19d1600640 1 -- 172.21.15.59:0/2481542428 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f19cc0597b0 con 0x7f19d415ecb0 2024-04-25T09:02:20.330 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:20.330 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:08.938626+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:20.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 -- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f19b4066f60 msgr2=0x7f19b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f19b4066f60 0x7f19b4069420 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f19c8009b50 tx=0x7f19c8009240 comp rx=0 tx=0).stop 2024-04-25T09:02:20.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 -- 172.21.15.59:0/2481542428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19d415ecb0 msgr2=0x7f19d414efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19d415ecb0 0x7f19d414efd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f19cc00c780 tx=0x7f19cc00cc40 comp rx=0 tx=0).stop 2024-04-25T09:02:20.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 -- 172.21.15.59:0/2481542428 shutdown_connections 2024-04-25T09:02:20.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f19b4066f60 0x7f19b4069420 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19d415ecb0 0x7f19d414efd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19d415a720 0x7f19d414ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 --2- 172.21.15.59:0/2481542428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19d409dca0 0x7f19d4142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 -- 172.21.15.59:0/2481542428 >> 172.21.15.59:0/2481542428 conn(0x7f19d40b23b0 msgr2=0x7f19d40ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:20.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 -- 172.21.15.59:0/2481542428 shutdown_connections 2024-04-25T09:02:20.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.339+0000 7f19dbe00640 1 -- 172.21.15.59:0/2481542428 wait complete. 2024-04-25T09:02:20.352 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:02:20.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:20.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.503+0000 7f2a4ba00640 1 Processor -- start 2024-04-25T09:02:20.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.503+0000 7f2a4ba00640 1 -- start start 2024-04-25T09:02:20.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.507+0000 7f2a4ba00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a4415c9b0 0x7f2a4406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.507+0000 7f2a4ba00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2a4406e010 0x7f2a4406e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.507+0000 7f2a4ba00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4415fc00 con 0x7f2a44159320 2024-04-25T09:02:20.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.507+0000 7f2a4ba00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4406d640 con 0x7f2a4415c9b0 2024-04-25T09:02:20.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.507+0000 7f2a4ba00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4415fee0 con 0x7f2a4406e010 2024-04-25T09:02:20.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.507+0000 7f2a3be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a4415c9b0 0x7f2a4406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.507+0000 7f2a3be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a4415c9b0 0x7f2a4406dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55286/0 (socket says 172.21.15.59:55286) 2024-04-25T09:02:20.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.507+0000 7f2a3be00640 1 -- 172.21.15.59:0/3191221934 learned_addr learned my addr 172.21.15.59:0/3191221934 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:20.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.507+0000 7f2a3be00640 1 -- 172.21.15.59:0/3191221934 >> v2:172.21.15.178:3300/0 conn(0x7f2a4406e010 msgr2=0x7f2a4406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:20.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.507+0000 7f2a3be00640 1 --2- 172.21.15.59:0/3191221934 >> v2:172.21.15.178:3300/0 conn(0x7f2a4406e010 0x7f2a4406e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.507+0000 7f2a3be00640 1 -- 172.21.15.59:0/3191221934 >> v1:172.21.15.178:6789/0 conn(0x7f2a44159320 legacy=0x7f2a4415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:20.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.507+0000 7f2a3be00640 1 -- 172.21.15.59:0/3191221934 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a441601c0 con 0x7f2a4415c9b0 2024-04-25T09:02:20.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a3be00640 1 --2- 172.21.15.59:0/3191221934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a4415c9b0 0x7f2a4406dad0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2a44072630 tx=0x7f2a2c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf20efed1a72dce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:20.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a43e00640 1 -- 172.21.15.59:0/3191221934 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0b0070 con 0x7f2a4415c9b0 2024-04-25T09:02:20.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a43e00640 1 -- 172.21.15.59:0/3191221934 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2c0ab600 con 0x7f2a4415c9b0 2024-04-25T09:02:20.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a43e00640 1 -- 172.21.15.59:0/3191221934 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2c0ab9d0 con 0x7f2a4415c9b0 2024-04-25T09:02:20.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 -- 172.21.15.59:0/3191221934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a4415c9b0 msgr2=0x7f2a4406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 --2- 172.21.15.59:0/3191221934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a4415c9b0 0x7f2a4406dad0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2a44072630 tx=0x7f2a2c01c4e0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 -- 172.21.15.59:0/3191221934 shutdown_connections 2024-04-25T09:02:20.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 --2- 172.21.15.59:0/3191221934 >> v2:172.21.15.178:3300/0 conn(0x7f2a4406e010 0x7f2a4406e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 --2- 172.21.15.59:0/3191221934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a4415c9b0 0x7f2a4406dad0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 -- 172.21.15.59:0/3191221934 >> 172.21.15.59:0/3191221934 conn(0x7f2a44067080 msgr2=0x7f2a4406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:20.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 -- 172.21.15.59:0/3191221934 shutdown_connections 2024-04-25T09:02:20.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 -- 172.21.15.59:0/3191221934 wait complete. 2024-04-25T09:02:20.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 Processor -- start 2024-04-25T09:02:20.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 -- start start 2024-04-25T09:02:20.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a4406e010 0x7f2a441413a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a44159320 0x7f2a44140330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a4415c9b0 0x7f2a4413c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44168920 con 0x7f2a4406e010 2024-04-25T09:02:20.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a441687a0 con 0x7f2a44159320 2024-04-25T09:02:20.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.511+0000 7f2a4ba00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a44168aa0 con 0x7f2a4415c9b0 2024-04-25T09:02:20.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a49000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a4406e010 0x7f2a441413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a49000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a4406e010 0x7f2a441413a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55298/0 (socket says 172.21.15.59:55298) 2024-04-25T09:02:20.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a49000640 1 -- 172.21.15.59:0/2891994348 learned_addr learned my addr 172.21.15.59:0/2891994348 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a3be00640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a44159320 0x7f2a44140330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a49a00640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a4415c9b0 0x7f2a4413c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a49000640 1 -- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a4415c9b0 msgr2=0x7f2a4413c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a49000640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a4415c9b0 0x7f2a4413c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a49000640 1 -- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a44159320 msgr2=0x7f2a44140330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a49000640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a44159320 0x7f2a44140330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a49000640 1 -- 172.21.15.59:0/2891994348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a44140870 con 0x7f2a4406e010 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a3be00640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a44159320 0x7f2a44140330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a49000640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a4406e010 0x7f2a441413a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c4c0 tx=0x7f2a34001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a41600640 1 -- 172.21.15.59:0/2891994348 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a34017070 con 0x7f2a4406e010 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a41600640 1 -- 172.21.15.59:0/2891994348 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a34003600 con 0x7f2a4406e010 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a4ba00640 1 -- 172.21.15.59:0/2891994348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a44141a30 con 0x7f2a4406e010 2024-04-25T09:02:20.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a41600640 1 -- 172.21.15.59:0/2891994348 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a340039f0 con 0x7f2a4406e010 2024-04-25T09:02:20.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a4ba00640 1 -- 172.21.15.59:0/2891994348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a44141ff0 con 0x7f2a4406e010 2024-04-25T09:02:20.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a4ba00640 1 -- 172.21.15.59:0/2891994348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a440745d0 con 0x7f2a4406e010 2024-04-25T09:02:20.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a41600640 1 -- 172.21.15.59:0/2891994348 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2a3401a070 con 0x7f2a4406e010 2024-04-25T09:02:20.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a41600640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2a20066f60 0x7f2a20069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.515+0000 7f2a41600640 1 -- 172.21.15.59:0/2891994348 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f2a340848b0 con 0x7f2a4406e010 2024-04-25T09:02:20.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.519+0000 7f2a3be00640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2a20066f60 0x7f2a20069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.519+0000 7f2a3be00640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2a20066f60 0x7f2a20069420 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0ad000 tx=0x7f2a2c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:20.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.519+0000 7f2a41600640 1 -- 172.21.15.59:0/2891994348 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2a340553e0 con 0x7f2a4406e010 2024-04-25T09:02:20.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.683+0000 7f2a4ba00640 1 -- 172.21.15.59:0/2891994348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a44142920 con 0x7f2a4406e010 2024-04-25T09:02:20.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.683+0000 7f2a41600640 1 -- 172.21.15.59:0/2891994348 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a34054ce0 con 0x7f2a4406e010 2024-04-25T09:02:20.677 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:02:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.687+0000 7f2a4ba00640 1 -- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2a20066f60 msgr2=0x7f2a20069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.687+0000 7f2a4ba00640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2a20066f60 0x7f2a20069420 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0ad000 tx=0x7f2a2c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:02:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.687+0000 7f2a4ba00640 1 -- 172.21.15.59:0/2891994348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a4406e010 msgr2=0x7f2a441413a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.687+0000 7f2a4ba00640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a4406e010 0x7f2a441413a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2a3400c4c0 tx=0x7f2a34001e80 comp rx=0 tx=0).stop 2024-04-25T09:02:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.687+0000 7f2a4ba00640 1 -- 172.21.15.59:0/2891994348 shutdown_connections 2024-04-25T09:02:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.687+0000 7f2a4ba00640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2a20066f60 0x7f2a20069420 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.687+0000 7f2a4ba00640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2a4415c9b0 0x7f2a4413c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.687+0000 7f2a4ba00640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2a44159320 0x7f2a44140330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.687+0000 7f2a4ba00640 1 --2- 172.21.15.59:0/2891994348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a4406e010 0x7f2a441413a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.687+0000 7f2a4ba00640 1 -- 172.21.15.59:0/2891994348 >> 172.21.15.59:0/2891994348 conn(0x7f2a44067080 msgr2=0x7f2a4406ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.687+0000 7f2a4ba00640 1 -- 172.21.15.59:0/2891994348 shutdown_connections 2024-04-25T09:02:20.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.687+0000 7f2a4ba00640 1 -- 172.21.15.59:0/2891994348 wait complete. 2024-04-25T09:02:20.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:20.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.851+0000 7f1ccee00640 1 Processor -- start 2024-04-25T09:02:20.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.851+0000 7f1ccee00640 1 -- start start 2024-04-25T09:02:20.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.851+0000 7f1ccee00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cc815b9e0 0x7f1cc80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.851+0000 7f1ccee00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc809ade0 con 0x7f1cc815fac0 2024-04-25T09:02:20.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.851+0000 7f1ccee00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc8099a60 con 0x7f1cc80d0080 2024-04-25T09:02:20.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.851+0000 7f1ccee00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc8099d40 con 0x7f1cc815b9e0 2024-04-25T09:02:20.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.851+0000 7f1ccda00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cc815b9e0 0x7f1cc80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.851+0000 7f1cce400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1cc815fac0 0x7f1cc80cc050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52274/0 (socket says 172.21.15.59:52274) 2024-04-25T09:02:20.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.851+0000 7f1ccda00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cc815b9e0 0x7f1cc80cfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55306/0 (socket says 172.21.15.59:55306) 2024-04-25T09:02:20.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.851+0000 7f1cce400640 1 -- 172.21.15.59:0/891465611 learned_addr learned my addr 172.21.15.59:0/891465611 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:20.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.855+0000 7f1ccda00640 1 -- 172.21.15.59:0/891465611 >> v1:172.21.15.178:6789/0 conn(0x7f1cc80d0080 legacy=0x7f1cc815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.855+0000 7f1ccda00640 1 -- 172.21.15.59:0/891465611 >> v1:172.21.15.59:6789/0 conn(0x7f1cc815fac0 legacy=0x7f1cc80cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.855+0000 7f1ccda00640 1 -- 172.21.15.59:0/891465611 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc809a020 con 0x7f1cc815b9e0 2024-04-25T09:02:20.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.855+0000 7f1cc7e00640 1 -- 172.21.15.59:0/891465611 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974717205 0 0) 0x7f1cc00014a0 con 0x7f1cc815fac0 2024-04-25T09:02:20.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.855+0000 7f1ccda00640 1 --2- 172.21.15.59:0/891465611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc815b9e0 0x7f1cc80cfb40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0097c0 tx=0x7f1cbc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bf37041070495b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:20.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.855+0000 7f1cc7e00640 1 -- 172.21.15.59:0/891465611 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0b2070 con 0x7f1cc815b9e0 2024-04-25T09:02:20.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.855+0000 7f1cc7e00640 1 -- 172.21.15.59:0/891465611 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc0ad680 con 0x7f1cc815b9e0 2024-04-25T09:02:20.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.855+0000 7f1cc7e00640 1 -- 172.21.15.59:0/891465611 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0ada50 con 0x7f1cc815b9e0 2024-04-25T09:02:20.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.855+0000 7f1ccee00640 1 -- 172.21.15.59:0/891465611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc815b9e0 msgr2=0x7f1cc80cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.855+0000 7f1ccee00640 1 --2- 172.21.15.59:0/891465611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc815b9e0 0x7f1cc80cfb40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0097c0 tx=0x7f1cbc01c470 comp rx=0 tx=0).stop 2024-04-25T09:02:20.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 -- 172.21.15.59:0/891465611 shutdown_connections 2024-04-25T09:02:20.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 --2- 172.21.15.59:0/891465611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc815b9e0 0x7f1cc80cfb40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 -- 172.21.15.59:0/891465611 >> 172.21.15.59:0/891465611 conn(0x7f1cc80b3030 msgr2=0x7f1cc80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:20.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 -- 172.21.15.59:0/891465611 shutdown_connections 2024-04-25T09:02:20.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 -- 172.21.15.59:0/891465611 wait complete. 2024-04-25T09:02:20.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 Processor -- start 2024-04-25T09:02:20.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 -- start start 2024-04-25T09:02:20.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc80d0080 0x7f1cc814a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1cc815b9e0 0x7f1cc80c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cc815fac0 0x7f1cc81528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80cd0f0 con 0x7f1cc80d0080 2024-04-25T09:02:20.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80ccf70 con 0x7f1cc815fac0 2024-04-25T09:02:20.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc80cd270 con 0x7f1cc815b9e0 2024-04-25T09:02:20.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc80d0080 0x7f1cc814a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc80d0080 0x7f1cc814a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55320/0 (socket says 172.21.15.59:55320) 2024-04-25T09:02:20.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccda00640 1 -- 172.21.15.59:0/1485661881 learned_addr learned my addr 172.21.15.59:0/1485661881 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:20.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccda00640 1 -- 172.21.15.59:0/1485661881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1cc815b9e0 msgr2=0x7f1cc80c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccda00640 1 --2- 172.21.15.59:0/1485661881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1cc815b9e0 0x7f1cc80c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccda00640 1 -- 172.21.15.59:0/1485661881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cc815fac0 msgr2=0x7f1cc81528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:20.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccda00640 1 --2- 172.21.15.59:0/1485661881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cc815fac0 0x7f1cc81528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:20.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccda00640 1 -- 172.21.15.59:0/1485661881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc80c6f80 con 0x7f1cc80d0080 2024-04-25T09:02:20.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccda00640 1 --2- 172.21.15.59:0/1485661881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc80d0080 0x7f1cc814a080 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc019080 tx=0x7f1cbc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:20.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1cc5600640 1 -- 172.21.15.59:0/1485661881 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0bc020 con 0x7f1cc80d0080 2024-04-25T09:02:20.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1cc5600640 1 -- 172.21.15.59:0/1485661881 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cbc0adc70 con 0x7f1cc80d0080 2024-04-25T09:02:20.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1cc5600640 1 -- 172.21.15.59:0/1485661881 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cbc0b2040 con 0x7f1cc80d0080 2024-04-25T09:02:20.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.859+0000 7f1ccee00640 1 -- 172.21.15.59:0/1485661881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc80c7260 con 0x7f1cc80d0080 2024-04-25T09:02:20.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.863+0000 7f1ccee00640 1 -- 172.21.15.59:0/1485661881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc814a5c0 con 0x7f1cc80d0080 2024-04-25T09:02:20.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.863+0000 7f1ccee00640 1 -- 172.21.15.59:0/1485661881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc80745d0 con 0x7f1cc80d0080 2024-04-25T09:02:20.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.863+0000 7f1cc5600640 1 -- 172.21.15.59:0/1485661881 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1cbc0bf020 con 0x7f1cc80d0080 2024-04-25T09:02:20.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.863+0000 7f1cc5600640 1 --2- 172.21.15.59:0/1485661881 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ca8066f60 0x7f1ca8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:20.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.863+0000 7f1cc5600640 1 -- 172.21.15.59:0/1485661881 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f1cbc11f780 con 0x7f1cc80d0080 2024-04-25T09:02:20.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.863+0000 7f1ccd000640 1 --2- 172.21.15.59:0/1485661881 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ca8066f60 0x7f1ca8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:20.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.863+0000 7f1ccd000640 1 --2- 172.21.15.59:0/1485661881 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ca8066f60 0x7f1ca8069420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4000f70 tx=0x7f1cb40079c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:20.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:20.867+0000 7f1cc5600640 1 -- 172.21.15.59:0/1485661881 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1cbc0c6030 con 0x7f1cc80d0080 2024-04-25T09:02:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.031+0000 7f1ccee00640 1 -- 172.21.15.59:0/1485661881 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1cc80ae250 con 0x7f1cc80d0080 2024-04-25T09:02:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.031+0000 7f1cc5600640 1 -- 172.21.15.59:0/1485661881 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1cbc016090 con 0x7f1cc80d0080 2024-04-25T09:02:21.024 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:21.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.035+0000 7f1ccee00640 1 -- 172.21.15.59:0/1485661881 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ca8066f60 msgr2=0x7f1ca8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.035+0000 7f1ccee00640 1 --2- 172.21.15.59:0/1485661881 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ca8066f60 0x7f1ca8069420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4000f70 tx=0x7f1cb40079c0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.035+0000 7f1ccee00640 1 -- 172.21.15.59:0/1485661881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc80d0080 msgr2=0x7f1cc814a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.035+0000 7f1ccee00640 1 --2- 172.21.15.59:0/1485661881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc80d0080 0x7f1cc814a080 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc019080 tx=0x7f1cbc01acb0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.035+0000 7f1ccee00640 1 -- 172.21.15.59:0/1485661881 shutdown_connections 2024-04-25T09:02:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.035+0000 7f1ccee00640 1 --2- 172.21.15.59:0/1485661881 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ca8066f60 0x7f1ca8069420 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.035+0000 7f1ccee00640 1 --2- 172.21.15.59:0/1485661881 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1cc815fac0 0x7f1cc81528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.035+0000 7f1ccee00640 1 --2- 172.21.15.59:0/1485661881 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1cc815b9e0 0x7f1cc80c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.035+0000 7f1ccee00640 1 --2- 172.21.15.59:0/1485661881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cc80d0080 0x7f1cc814a080 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.035+0000 7f1ccee00640 1 -- 172.21.15.59:0/1485661881 >> 172.21.15.59:0/1485661881 conn(0x7f1cc80b3030 msgr2=0x7f1cc80aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.035+0000 7f1ccee00640 1 -- 172.21.15.59:0/1485661881 shutdown_connections 2024-04-25T09:02:21.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.035+0000 7f1ccee00640 1 -- 172.21.15.59:0/1485661881 wait complete. 2024-04-25T09:02:21.045 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5139c00640 1 Processor -- start 2024-04-25T09:02:21.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5139c00640 1 -- start start 2024-04-25T09:02:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5139c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415acd0 0x7f513415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5139c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f513415ee60 0x7f51340b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5139c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513415bc40 con 0x7f5134144120 2024-04-25T09:02:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5139c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513415e490 con 0x7f513415ee60 2024-04-25T09:02:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5139c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513415b150 con 0x7f513415acd0 2024-04-25T09:02:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5133400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f513415ee60 0x7f51340b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5133400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f513415ee60 0x7f51340b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55336/0 (socket says 172.21.15.59:55336) 2024-04-25T09:02:21.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5133400640 1 -- 172.21.15.59:0/3897828346 learned_addr learned my addr 172.21.15.59:0/3897828346 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:21.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f512be00640 1 --2- 172.21.15.59:0/3897828346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415acd0 0x7f513415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5133400640 1 -- 172.21.15.59:0/3897828346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415acd0 msgr2=0x7f513415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:21.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5133400640 1 --2- 172.21.15.59:0/3897828346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415acd0 0x7f513415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5133400640 1 -- 172.21.15.59:0/3897828346 >> v1:172.21.15.178:6789/0 conn(0x7f5134144120 legacy=0x7f51340ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.199+0000 7f5133400640 1 -- 172.21.15.59:0/3897828346 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513415b3a0 con 0x7f513415ee60 2024-04-25T09:02:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.203+0000 7f5133400640 1 --2- 172.21.15.59:0/3897828346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f513415ee60 0x7f51340b3090 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f512c009e50 tx=0x7f512c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=947f6c20a12c46c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.203+0000 7f5132000640 1 -- 172.21.15.59:0/3897828346 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0a5660 con 0x7f513415ee60 2024-04-25T09:02:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.203+0000 7f5132000640 1 -- 172.21.15.59:0/3897828346 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c0a5800 con 0x7f513415ee60 2024-04-25T09:02:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.203+0000 7f5132000640 1 -- 172.21.15.59:0/3897828346 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c0a5bd0 con 0x7f513415ee60 2024-04-25T09:02:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.203+0000 7f5139c00640 1 -- 172.21.15.59:0/3897828346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f513415ee60 msgr2=0x7f51340b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.203+0000 7f5139c00640 1 --2- 172.21.15.59:0/3897828346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f513415ee60 0x7f51340b3090 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f512c009e50 tx=0x7f512c01c9a0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.203+0000 7f5139c00640 1 -- 172.21.15.59:0/3897828346 shutdown_connections 2024-04-25T09:02:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.203+0000 7f5139c00640 1 --2- 172.21.15.59:0/3897828346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f513415ee60 0x7f51340b3090 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.203+0000 7f5139c00640 1 --2- 172.21.15.59:0/3897828346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415acd0 0x7f513415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.203+0000 7f5139c00640 1 -- 172.21.15.59:0/3897828346 >> 172.21.15.59:0/3897828346 conn(0x7f5134067080 msgr2=0x7f513406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:21.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.203+0000 7f5139c00640 1 -- 172.21.15.59:0/3897828346 shutdown_connections 2024-04-25T09:02:21.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.203+0000 7f5139c00640 1 -- 172.21.15.59:0/3897828346 wait complete. 2024-04-25T09:02:21.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5139c00640 1 Processor -- start 2024-04-25T09:02:21.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5139c00640 1 -- start start 2024-04-25T09:02:21.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5139c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5134144120 0x7f51341405a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5139c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f513415acd0 0x7f513413d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5139c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415ee60 0x7f5134142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5139c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513406d6e0 con 0x7f5134144120 2024-04-25T09:02:21.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5139c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513406d560 con 0x7f513415acd0 2024-04-25T09:02:21.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5139c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513406d860 con 0x7f513415ee60 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5132a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5134144120 0x7f51341405a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5132a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5134144120 0x7f51341405a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55352/0 (socket says 172.21.15.59:55352) 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5132a00640 1 -- 172.21.15.59:0/323364434 learned_addr learned my addr 172.21.15.59:0/323364434 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f512be00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f513415acd0 0x7f513413d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5133400640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415ee60 0x7f5134142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5132a00640 1 -- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415ee60 msgr2=0x7f5134142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5132a00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415ee60 0x7f5134142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5132a00640 1 -- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f513415acd0 msgr2=0x7f513413d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5132a00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f513415acd0 0x7f513413d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5132a00640 1 -- 172.21.15.59:0/323364434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5134140ae0 con 0x7f5134144120 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5132a00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5134144120 0x7f51341405a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f512400c420 tx=0x7f512400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f512aa00640 1 -- 172.21.15.59:0/323364434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51240052d0 con 0x7f5134144120 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f512aa00640 1 -- 172.21.15.59:0/323364434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5124005470 con 0x7f5134144120 2024-04-25T09:02:21.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f512aa00640 1 -- 172.21.15.59:0/323364434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124007260 con 0x7f5134144120 2024-04-25T09:02:21.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5139c00640 1 -- 172.21.15.59:0/323364434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513413eda0 con 0x7f5134144120 2024-04-25T09:02:21.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5139c00640 1 -- 172.21.15.59:0/323364434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513413f360 con 0x7f5134144120 2024-04-25T09:02:21.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.207+0000 7f5139c00640 1 -- 172.21.15.59:0/323364434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51340745d0 con 0x7f5134144120 2024-04-25T09:02:21.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.211+0000 7f512aa00640 1 -- 172.21.15.59:0/323364434 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5124007400 con 0x7f5134144120 2024-04-25T09:02:21.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.211+0000 7f512aa00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5110066f90 0x7f5110069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.211+0000 7f512aa00640 1 -- 172.21.15.59:0/323364434 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f5124084980 con 0x7f5134144120 2024-04-25T09:02:21.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.211+0000 7f512be00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5110066f90 0x7f5110069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.211+0000 7f512be00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5110066f90 0x7f5110069450 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f511c00b9d0 tx=0x7f511c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:21.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.215+0000 7f512aa00640 1 -- 172.21.15.59:0/323364434 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f51240554f0 con 0x7f5134144120 2024-04-25T09:02:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.375+0000 7f5139c00640 1 -- 172.21.15.59:0/323364434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f513413f9b0 con 0x7f5134144120 2024-04-25T09:02:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.375+0000 7f512aa00640 1 -- 172.21.15.59:0/323364434 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5124054df0 con 0x7f5134144120 2024-04-25T09:02:21.370 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:02:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.379+0000 7f5139c00640 1 -- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5110066f90 msgr2=0x7f5110069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.379+0000 7f5139c00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5110066f90 0x7f5110069450 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f511c00b9d0 tx=0x7f511c008040 comp rx=0 tx=0).stop 2024-04-25T09:02:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.379+0000 7f5139c00640 1 -- 172.21.15.59:0/323364434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5134144120 msgr2=0x7f51341405a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.379+0000 7f5139c00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5134144120 0x7f51341405a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f512400c420 tx=0x7f512400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.379+0000 7f5139c00640 1 -- 172.21.15.59:0/323364434 shutdown_connections 2024-04-25T09:02:21.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.379+0000 7f5139c00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5110066f90 0x7f5110069450 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.379+0000 7f5139c00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415ee60 0x7f5134142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.379+0000 7f5139c00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f513415acd0 0x7f513413d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.379+0000 7f5139c00640 1 --2- 172.21.15.59:0/323364434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5134144120 0x7f51341405a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.379+0000 7f5139c00640 1 -- 172.21.15.59:0/323364434 >> 172.21.15.59:0/323364434 conn(0x7f5134067080 msgr2=0x7f51340b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.379+0000 7f5139c00640 1 -- 172.21.15.59:0/323364434 shutdown_connections 2024-04-25T09:02:21.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.379+0000 7f5139c00640 1 -- 172.21.15.59:0/323364434 wait complete. 2024-04-25T09:02:21.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:02:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.539+0000 7f95b4a00640 1 Processor -- start 2024-04-25T09:02:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.539+0000 7f95b4a00640 1 -- start start 2024-04-25T09:02:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95b4a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95b01433e0 0x7f95b006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95b4a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f95b006d6b0 0x7f95b00b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95b4a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95b00b4290 0x7f95b015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95b4a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b006db10 con 0x7f95b00b4290 2024-04-25T09:02:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95b4a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b01437c0 con 0x7f95b006d6b0 2024-04-25T09:02:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95b4a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00710e0 con 0x7f95b01433e0 2024-04-25T09:02:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95afe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95b00b4290 0x7f95b015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95afe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95b00b4290 0x7f95b015e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55358/0 (socket says 172.21.15.59:55358) 2024-04-25T09:02:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95afe00640 1 -- 172.21.15.59:0/243011100 learned_addr learned my addr 172.21.15.59:0/243011100 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95a7e00640 1 --2- 172.21.15.59:0/243011100 >> v2:172.21.15.178:3300/0 conn(0x7f95b006d6b0 0x7f95b00b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95af400640 1 --2- 172.21.15.59:0/243011100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95b01433e0 0x7f95b006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95afe00640 1 -- 172.21.15.59:0/243011100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95b01433e0 msgr2=0x7f95b006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95afe00640 1 --2- 172.21.15.59:0/243011100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95b01433e0 0x7f95b006d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95afe00640 1 -- 172.21.15.59:0/243011100 >> v2:172.21.15.178:3300/0 conn(0x7f95b006d6b0 msgr2=0x7f95b00b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95afe00640 1 --2- 172.21.15.59:0/243011100 >> v2:172.21.15.178:3300/0 conn(0x7f95b006d6b0 0x7f95b00b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.543+0000 7f95afe00640 1 -- 172.21.15.59:0/243011100 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b00713c0 con 0x7f95b00b4290 2024-04-25T09:02:21.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95afe00640 1 --2- 172.21.15.59:0/243011100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95b00b4290 0x7f95b015e2e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f95b006ca90 tx=0x7f95a801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edde0d0ce2e132e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:21.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95aea00640 1 -- 172.21.15.59:0/243011100 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a80a5580 con 0x7f95b00b4290 2024-04-25T09:02:21.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95aea00640 1 -- 172.21.15.59:0/243011100 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a80a5720 con 0x7f95b00b4290 2024-04-25T09:02:21.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95aea00640 1 -- 172.21.15.59:0/243011100 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a80a5af0 con 0x7f95b00b4290 2024-04-25T09:02:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95b4a00640 1 -- 172.21.15.59:0/243011100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95b00b4290 msgr2=0x7f95b015e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95b4a00640 1 --2- 172.21.15.59:0/243011100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95b00b4290 0x7f95b015e2e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f95b006ca90 tx=0x7f95a801c700 comp rx=0 tx=0).stop 2024-04-25T09:02:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95b4a00640 1 -- 172.21.15.59:0/243011100 shutdown_connections 2024-04-25T09:02:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95b4a00640 1 --2- 172.21.15.59:0/243011100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95b00b4290 0x7f95b015e2e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95b4a00640 1 --2- 172.21.15.59:0/243011100 >> v2:172.21.15.178:3300/0 conn(0x7f95b006d6b0 0x7f95b00b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95b4a00640 1 --2- 172.21.15.59:0/243011100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95b01433e0 0x7f95b006d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95b4a00640 1 -- 172.21.15.59:0/243011100 >> 172.21.15.59:0/243011100 conn(0x7f95b0066fa0 msgr2=0x7f95b006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95b4a00640 1 -- 172.21.15.59:0/243011100 shutdown_connections 2024-04-25T09:02:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95b4a00640 1 -- 172.21.15.59:0/243011100 wait complete. 2024-04-25T09:02:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95b4a00640 1 Processor -- start 2024-04-25T09:02:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95b4a00640 1 -- start start 2024-04-25T09:02:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.547+0000 7f95b4a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95b006d6b0 0x7f95b00b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95b4a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95b00b4290 0x7f95b013a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95b4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95b01433e0 0x7f95b0163820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95b4a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b0072180 con 0x7f95b01433e0 2024-04-25T09:02:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95b4a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b00b4720 con 0x7f95b00b4290 2024-04-25T09:02:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95b4a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b013c130 con 0x7f95b006d6b0 2024-04-25T09:02:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95b01433e0 0x7f95b0163820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95b01433e0 0x7f95b0163820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55370/0 (socket says 172.21.15.59:55370) 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95afe00640 1 -- 172.21.15.59:0/2053888193 learned_addr learned my addr 172.21.15.59:0/2053888193 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95a7e00640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95b00b4290 0x7f95b013a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95af400640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95b006d6b0 0x7f95b00b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95afe00640 1 -- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95b006d6b0 msgr2=0x7f95b00b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95afe00640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95b006d6b0 0x7f95b00b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95afe00640 1 -- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95b00b4290 msgr2=0x7f95b013a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95afe00640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95b00b4290 0x7f95b013a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95afe00640 1 -- 172.21.15.59:0/2053888193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b013b470 con 0x7f95b01433e0 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95af400640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95b006d6b0 0x7f95b00b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95afe00640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95b01433e0 0x7f95b0163820 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f95a801adb0 tx=0x7f95a80194a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95a7400640 1 -- 172.21.15.59:0/2053888193 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a80a5580 con 0x7f95b01433e0 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95a7400640 1 -- 172.21.15.59:0/2053888193 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a80be070 con 0x7f95b01433e0 2024-04-25T09:02:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95a7400640 1 -- 172.21.15.59:0/2053888193 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8009510 con 0x7f95b01433e0 2024-04-25T09:02:21.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95b4a00640 1 -- 172.21.15.59:0/2053888193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b013b750 con 0x7f95b01433e0 2024-04-25T09:02:21.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95b4a00640 1 -- 172.21.15.59:0/2053888193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b013bdc0 con 0x7f95b01433e0 2024-04-25T09:02:21.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95b4a00640 1 -- 172.21.15.59:0/2053888193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b00745d0 con 0x7f95b01433e0 2024-04-25T09:02:21.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.551+0000 7f95a7400640 1 -- 172.21.15.59:0/2053888193 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f95a80b8910 con 0x7f95b01433e0 2024-04-25T09:02:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.555+0000 7f95a7400640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f958c066f90 0x7f958c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.555+0000 7f95a7400640 1 -- 172.21.15.59:0/2053888193 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f95a811fff0 con 0x7f95b01433e0 2024-04-25T09:02:21.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.555+0000 7f95af400640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f958c066f90 0x7f958c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.555+0000 7f95af400640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f958c066f90 0x7f958c069450 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009b10 tx=0x7f95a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:21.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.559+0000 7f95a7400640 1 -- 172.21.15.59:0/2053888193 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f95a80165e0 con 0x7f95b01433e0 2024-04-25T09:02:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 -- 172.21.15.59:0/2053888193 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f95b015e050 con 0x7f95b01433e0 2024-04-25T09:02:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95a7400640 1 -- 172.21.15.59:0/2053888193 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f95a80f0c70 con 0x7f95b01433e0 2024-04-25T09:02:21.713 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 -- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f958c066f90 msgr2=0x7f958c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f958c066f90 0x7f958c069450 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f95a0009b10 tx=0x7f95a0008040 comp rx=0 tx=0).stop 2024-04-25T09:02:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 -- 172.21.15.59:0/2053888193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95b01433e0 msgr2=0x7f95b0163820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95b01433e0 0x7f95b0163820 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f95a801adb0 tx=0x7f95a80194a0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 -- 172.21.15.59:0/2053888193 shutdown_connections 2024-04-25T09:02:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f958c066f90 0x7f958c069450 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95b01433e0 0x7f95b0163820 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f95b00b4290 0x7f95b013a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 --2- 172.21.15.59:0/2053888193 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f95b006d6b0 0x7f95b00b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 -- 172.21.15.59:0/2053888193 >> 172.21.15.59:0/2053888193 conn(0x7f95b0066fa0 msgr2=0x7f95b00ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:21.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 -- 172.21.15.59:0/2053888193 shutdown_connections 2024-04-25T09:02:21.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.723+0000 7f95b4a00640 1 -- 172.21.15.59:0/2053888193 wait complete. 2024-04-25T09:02:21.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:02:21.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.883+0000 7f98f7200640 1 Processor -- start 2024-04-25T09:02:21.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.883+0000 7f98f7200640 1 -- start start 2024-04-25T09:02:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98f7200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f98f815f440 0x7f98f80b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98f7200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98f80cc150 0x7f98f815f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98f7200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98f81601f0 con 0x7f98f815fd60 2024-04-25T09:02:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98f7200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f80b2720 con 0x7f98f80cc150 2024-04-25T09:02:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98f7200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98f80b19d0 con 0x7f98f815f440 2024-04-25T09:02:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98ed400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98f80cc150 0x7f98f815f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98ed400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98f80cc150 0x7f98f815f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55386/0 (socket says 172.21.15.59:55386) 2024-04-25T09:02:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98ed400640 1 -- 172.21.15.59:0/1959644206 learned_addr learned my addr 172.21.15.59:0/1959644206 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:21.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98f5e00640 1 --2- 172.21.15.59:0/1959644206 >> v2:172.21.15.178:3300/0 conn(0x7f98f815f440 0x7f98f80b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98ed400640 1 -- 172.21.15.59:0/1959644206 >> v2:172.21.15.178:3300/0 conn(0x7f98f815f440 msgr2=0x7f98f80b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98ed400640 1 --2- 172.21.15.59:0/1959644206 >> v2:172.21.15.178:3300/0 conn(0x7f98f815f440 0x7f98f80b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98ed400640 1 -- 172.21.15.59:0/1959644206 >> v1:172.21.15.178:6789/0 conn(0x7f98f815fd60 legacy=0x7f98f80cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:21.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.887+0000 7f98ed400640 1 -- 172.21.15.59:0/1959644206 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f80b1c20 con 0x7f98f80cc150 2024-04-25T09:02:21.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98ed400640 1 --2- 172.21.15.59:0/1959644206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f80cc150 0x7f98f815f820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f98f8072710 tx=0x7f98e001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d5a0554ecc7c8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f5400640 1 -- 172.21.15.59:0/1959644206 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00b1070 con 0x7f98f80cc150 2024-04-25T09:02:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f5400640 1 -- 172.21.15.59:0/1959644206 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e00ac640 con 0x7f98f80cc150 2024-04-25T09:02:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f5400640 1 -- 172.21.15.59:0/1959644206 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e00aca10 con 0x7f98f80cc150 2024-04-25T09:02:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f7200640 1 -- 172.21.15.59:0/1959644206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f80cc150 msgr2=0x7f98f815f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f7200640 1 --2- 172.21.15.59:0/1959644206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f80cc150 0x7f98f815f820 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f98f8072710 tx=0x7f98e001c490 comp rx=0 tx=0).stop 2024-04-25T09:02:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f7200640 1 -- 172.21.15.59:0/1959644206 shutdown_connections 2024-04-25T09:02:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f7200640 1 --2- 172.21.15.59:0/1959644206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f80cc150 0x7f98f815f820 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f7200640 1 --2- 172.21.15.59:0/1959644206 >> v2:172.21.15.178:3300/0 conn(0x7f98f815f440 0x7f98f80b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f7200640 1 -- 172.21.15.59:0/1959644206 >> 172.21.15.59:0/1959644206 conn(0x7f98f80d1640 msgr2=0x7f98f80d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f7200640 1 -- 172.21.15.59:0/1959644206 shutdown_connections 2024-04-25T09:02:21.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f7200640 1 -- 172.21.15.59:0/1959644206 wait complete. 2024-04-25T09:02:21.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f7200640 1 Processor -- start 2024-04-25T09:02:21.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.891+0000 7f98f7200640 1 -- start start 2024-04-25T09:02:21.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f7200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98f80cc150 0x7f98f806d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f7200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98f815f440 0x7f98f80c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f815fd60 0x7f98f8159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80cd370 con 0x7f98f815fd60 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f7200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80cdf40 con 0x7f98f80cc150 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f7200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98f80cd4f0 con 0x7f98f815f440 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f815fd60 0x7f98f8159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98ed400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98f815f440 0x7f98f80c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f815fd60 0x7f98f8159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55390/0 (socket says 172.21.15.59:55390) 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f6800640 1 -- 172.21.15.59:0/2327411767 learned_addr learned my addr 172.21.15.59:0/2327411767 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f5e00640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98f80cc150 0x7f98f806d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f6800640 1 -- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98f815f440 msgr2=0x7f98f80c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f6800640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98f815f440 0x7f98f80c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f6800640 1 -- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98f80cc150 msgr2=0x7f98f806d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:21.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f6800640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98f80cc150 0x7f98f806d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:21.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f6800640 1 -- 172.21.15.59:0/2327411767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f80c9270 con 0x7f98f815fd60 2024-04-25T09:02:21.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f6800640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f815fd60 0x7f98f8159650 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f98f000c340 tx=0x7f98f000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:21.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98eea00640 1 -- 172.21.15.59:0/2327411767 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0005220 con 0x7f98f815fd60 2024-04-25T09:02:21.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98eea00640 1 -- 172.21.15.59:0/2327411767 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f00053c0 con 0x7f98f815fd60 2024-04-25T09:02:21.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f7200640 1 -- 172.21.15.59:0/2327411767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f80cb4f0 con 0x7f98f815fd60 2024-04-25T09:02:21.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98eea00640 1 -- 172.21.15.59:0/2327411767 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0007270 con 0x7f98f815fd60 2024-04-25T09:02:21.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f7200640 1 -- 172.21.15.59:0/2327411767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f80caf30 con 0x7f98f815fd60 2024-04-25T09:02:21.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98f7200640 1 -- 172.21.15.59:0/2327411767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98f80745d0 con 0x7f98f815fd60 2024-04-25T09:02:21.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.895+0000 7f98eea00640 1 -- 172.21.15.59:0/2327411767 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f98f0019020 con 0x7f98f815fd60 2024-04-25T09:02:21.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.899+0000 7f98eea00640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f98d4066f60 0x7f98d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:21.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.899+0000 7f98eea00640 1 -- 172.21.15.59:0/2327411767 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f98f0084630 con 0x7f98f815fd60 2024-04-25T09:02:21.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.899+0000 7f98f5e00640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f98d4066f60 0x7f98d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:21.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.899+0000 7f98f5e00640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f98d4066f60 0x7f98d4069420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009fd0 tx=0x7f98e8009800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:21.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:21.903+0000 7f98eea00640 1 -- 172.21.15.59:0/2327411767 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f98f81601f0 con 0x7f98f815fd60 2024-04-25T09:02:22.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.075+0000 7f98f7200640 1 -- 172.21.15.59:0/2327411767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f98f80d2270 con 0x7f98f815fd60 2024-04-25T09:02:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.075+0000 7f98eea00640 1 -- 172.21.15.59:0/2327411767 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f98f0054ba0 con 0x7f98f815fd60 2024-04-25T09:02:22.069 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:02:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.079+0000 7f98f7200640 1 -- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f98d4066f60 msgr2=0x7f98d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.079+0000 7f98f7200640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f98d4066f60 0x7f98d4069420 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f98e8009fd0 tx=0x7f98e8009800 comp rx=0 tx=0).stop 2024-04-25T09:02:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.079+0000 7f98f7200640 1 -- 172.21.15.59:0/2327411767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f815fd60 msgr2=0x7f98f8159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.079+0000 7f98f7200640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f815fd60 0x7f98f8159650 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f98f000c340 tx=0x7f98f000c800 comp rx=0 tx=0).stop 2024-04-25T09:02:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.079+0000 7f98f7200640 1 -- 172.21.15.59:0/2327411767 shutdown_connections 2024-04-25T09:02:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.079+0000 7f98f7200640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f98d4066f60 0x7f98d4069420 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.079+0000 7f98f7200640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98f815fd60 0x7f98f8159650 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.079+0000 7f98f7200640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f98f815f440 0x7f98f80c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.079+0000 7f98f7200640 1 --2- 172.21.15.59:0/2327411767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98f80cc150 0x7f98f806d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.079+0000 7f98f7200640 1 -- 172.21.15.59:0/2327411767 >> 172.21.15.59:0/2327411767 conn(0x7f98f80d1640 msgr2=0x7f98f806f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.079+0000 7f98f7200640 1 -- 172.21.15.59:0/2327411767 shutdown_connections 2024-04-25T09:02:22.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.079+0000 7f98f7200640 1 -- 172.21.15.59:0/2327411767 wait complete. 2024-04-25T09:02:22.089 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-25T09:02:22.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:22.090 DEBUG:teuthology.orchestra.run.smithi178:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-25T09:02:22.131 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T09:02:22.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:22.132 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T09:02:22.191 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:02:22.191 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:22.201 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:02:22.201 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:22.253 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:02:22.344 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:22.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:22.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6ea6e00640 1 Processor -- start 2024-04-25T09:02:22.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6ea6e00640 1 -- start start 2024-04-25T09:02:22.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6ea6e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ea0070fe0 0x7f6ea0161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:22.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6ea6e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6ea00713c0 0x7f6ea0143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:22.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6ea6e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea0071830 0x7f6ea015e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:22.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6ea6e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea006d090 con 0x7f6ea0070fe0 2024-04-25T09:02:22.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6ea6e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea0162390 con 0x7f6ea00713c0 2024-04-25T09:02:22.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6ea6e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea0161af0 con 0x7f6ea0071830 2024-04-25T09:02:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6e9fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ea0070fe0 0x7f6ea0161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6e9fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ea0070fe0 0x7f6ea0161510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55400/0 (socket says 172.21.15.59:55400) 2024-04-25T09:02:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6e9fe00640 1 -- 172.21.15.59:0/666676961 learned_addr learned my addr 172.21.15.59:0/666676961 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6ea4e00640 1 --2- 172.21.15.59:0/666676961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea0071830 0x7f6ea015e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6e97400640 1 --2- 172.21.15.59:0/666676961 >> v2:172.21.15.178:3300/0 conn(0x7f6ea00713c0 0x7f6ea0143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6e9fe00640 1 -- 172.21.15.59:0/666676961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea0071830 msgr2=0x7f6ea015e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6e9fe00640 1 --2- 172.21.15.59:0/666676961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea0071830 0x7f6ea015e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6e9fe00640 1 -- 172.21.15.59:0/666676961 >> v2:172.21.15.178:3300/0 conn(0x7f6ea00713c0 msgr2=0x7f6ea0143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6e9fe00640 1 --2- 172.21.15.59:0/666676961 >> v2:172.21.15.178:3300/0 conn(0x7f6ea00713c0 0x7f6ea0143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.547+0000 7f6e9fe00640 1 -- 172.21.15.59:0/666676961 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea0161dd0 con 0x7f6ea0070fe0 2024-04-25T09:02:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6e9fe00640 1 --2- 172.21.15.59:0/666676961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea0070fe0 0x7f6ea0161510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ea006ee80 tx=0x7f6e9001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be5f0413a6955b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6e9f400640 1 -- 172.21.15.59:0/666676961 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900a5840 con 0x7f6ea0070fe0 2024-04-25T09:02:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6e9f400640 1 -- 172.21.15.59:0/666676961 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e900a59e0 con 0x7f6ea0070fe0 2024-04-25T09:02:22.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6e9f400640 1 -- 172.21.15.59:0/666676961 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900a5db0 con 0x7f6ea0070fe0 2024-04-25T09:02:22.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6ea6e00640 1 -- 172.21.15.59:0/666676961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea0070fe0 msgr2=0x7f6ea0161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:22.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6ea6e00640 1 --2- 172.21.15.59:0/666676961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea0070fe0 0x7f6ea0161510 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f6ea006ee80 tx=0x7f6e9001c9c0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6ea6e00640 1 -- 172.21.15.59:0/666676961 shutdown_connections 2024-04-25T09:02:22.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6ea6e00640 1 --2- 172.21.15.59:0/666676961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea0071830 0x7f6ea015e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6ea6e00640 1 --2- 172.21.15.59:0/666676961 >> v2:172.21.15.178:3300/0 conn(0x7f6ea00713c0 0x7f6ea0143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6ea6e00640 1 --2- 172.21.15.59:0/666676961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea0070fe0 0x7f6ea0161510 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6ea6e00640 1 -- 172.21.15.59:0/666676961 >> 172.21.15.59:0/666676961 conn(0x7f6ea00b3390 msgr2=0x7f6ea00b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:22.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6ea6e00640 1 -- 172.21.15.59:0/666676961 shutdown_connections 2024-04-25T09:02:22.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.551+0000 7f6ea6e00640 1 -- 172.21.15.59:0/666676961 wait complete. 2024-04-25T09:02:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6ea6e00640 1 Processor -- start 2024-04-25T09:02:22.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6ea6e00640 1 -- start start 2024-04-25T09:02:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6ea6e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea0070fe0 0x7f6ea013c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6ea6e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea00713c0 0x7f6ea00cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6ea6e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea0071830 0x7f6ea01574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6ea6e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00b06c0 con 0x7f6ea0070fe0 2024-04-25T09:02:22.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6ea6e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00b0540 con 0x7f6ea0071830 2024-04-25T09:02:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6ea6e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00b0840 con 0x7f6ea00713c0 2024-04-25T09:02:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6e9fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea0070fe0 0x7f6ea013c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6e9fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea0070fe0 0x7f6ea013c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55404/0 (socket says 172.21.15.59:55404) 2024-04-25T09:02:22.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6e9fe00640 1 -- 172.21.15.59:0/822010944 learned_addr learned my addr 172.21.15.59:0/822010944 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:22.548 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:22.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6e9fe00640 1 -- 172.21.15.59:0/822010944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea00713c0 msgr2=0x7f6ea00cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:22.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6e9fe00640 1 --2- 172.21.15.59:0/822010944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea00713c0 0x7f6ea00cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6e9fe00640 1 -- 172.21.15.59:0/822010944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea0071830 msgr2=0x7f6ea01574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:22.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6e9fe00640 1 --2- 172.21.15.59:0/822010944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea0071830 0x7f6ea01574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6e9fe00640 1 -- 172.21.15.59:0/822010944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea013bb40 con 0x7f6ea0070fe0 2024-04-25T09:02:22.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6e9fe00640 1 --2- 172.21.15.59:0/822010944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea0070fe0 0x7f6ea013c900 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6e9001b070 tx=0x7f6e90019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:22.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6e9cc00640 1 -- 172.21.15.59:0/822010944 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900b8670 con 0x7f6ea0070fe0 2024-04-25T09:02:22.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6e9cc00640 1 -- 172.21.15.59:0/822010944 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e900be070 con 0x7f6ea0070fe0 2024-04-25T09:02:22.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6e9cc00640 1 -- 172.21.15.59:0/822010944 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900b8a90 con 0x7f6ea0070fe0 2024-04-25T09:02:22.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6ea6e00640 1 -- 172.21.15.59:0/822010944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea013be20 con 0x7f6ea0070fe0 2024-04-25T09:02:22.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6ea6e00640 1 -- 172.21.15.59:0/822010944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea00cb1b0 con 0x7f6ea0070fe0 2024-04-25T09:02:22.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.555+0000 7f6ea6e00640 1 -- 172.21.15.59:0/822010944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea00745d0 con 0x7f6ea0070fe0 2024-04-25T09:02:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.559+0000 7f6e9cc00640 1 -- 172.21.15.59:0/822010944 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6e900b8c30 con 0x7f6ea0070fe0 2024-04-25T09:02:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.559+0000 7f6e9cc00640 1 --2- 172.21.15.59:0/822010944 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e7c066f60 0x7f6e7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.559+0000 7f6e9cc00640 1 -- 172.21.15.59:0/822010944 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f6e90120820 con 0x7f6ea0070fe0 2024-04-25T09:02:22.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.559+0000 7f6e97400640 1 --2- 172.21.15.59:0/822010944 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e7c066f60 0x7f6e7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:22.552 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:22.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.559+0000 7f6e97400640 1 --2- 172.21.15.59:0/822010944 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e7c066f60 0x7f6e7c069420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00b72c0 tx=0x7f6e88008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:22.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.563+0000 7f6e9cc00640 1 -- 172.21.15.59:0/822010944 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6e900165e0 con 0x7f6ea0070fe0 2024-04-25T09:02:22.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.727+0000 7f6ea6e00640 1 -- 172.21.15.59:0/822010944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ea00cef80 con 0x7f6ea0070fe0 2024-04-25T09:02:22.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.727+0000 7f6e9cc00640 1 -- 172.21.15.59:0/822010944 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f6e900f1480 con 0x7f6ea0070fe0 2024-04-25T09:02:22.719 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:22.720 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:08.938626+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:22.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.731+0000 7f6ea6e00640 1 -- 172.21.15.59:0/822010944 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e7c066f60 msgr2=0x7f6e7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:22.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.731+0000 7f6ea6e00640 1 --2- 172.21.15.59:0/822010944 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e7c066f60 0x7f6e7c069420 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00b72c0 tx=0x7f6e88008040 comp rx=0 tx=0).stop 2024-04-25T09:02:22.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.731+0000 7f6ea6e00640 1 -- 172.21.15.59:0/822010944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea0070fe0 msgr2=0x7f6ea013c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:22.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.731+0000 7f6ea6e00640 1 --2- 172.21.15.59:0/822010944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea0070fe0 0x7f6ea013c900 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f6e9001b070 tx=0x7f6e90019760 comp rx=0 tx=0).stop 2024-04-25T09:02:22.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.731+0000 7f6ea6e00640 1 -- 172.21.15.59:0/822010944 shutdown_connections 2024-04-25T09:02:22.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.731+0000 7f6ea6e00640 1 --2- 172.21.15.59:0/822010944 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e7c066f60 0x7f6e7c069420 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.731+0000 7f6ea6e00640 1 --2- 172.21.15.59:0/822010944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ea0071830 0x7f6ea01574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.731+0000 7f6ea6e00640 1 --2- 172.21.15.59:0/822010944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ea00713c0 0x7f6ea00cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.731+0000 7f6ea6e00640 1 --2- 172.21.15.59:0/822010944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ea0070fe0 0x7f6ea013c900 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.731+0000 7f6ea6e00640 1 -- 172.21.15.59:0/822010944 >> 172.21.15.59:0/822010944 conn(0x7f6ea00b3390 msgr2=0x7f6ea013fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:22.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.731+0000 7f6ea6e00640 1 -- 172.21.15.59:0/822010944 shutdown_connections 2024-04-25T09:02:22.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.731+0000 7f6ea6e00640 1 -- 172.21.15.59:0/822010944 wait complete. 2024-04-25T09:02:22.741 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:02:22.742 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:22.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23f7e00640 1 Processor -- start 2024-04-25T09:02:22.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23f7e00640 1 -- start start 2024-04-25T09:02:22.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23f7e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23f015eb50 0x7f23f015f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:22.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23f7e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f006db20 con 0x7f23f0071270 2024-04-25T09:02:22.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23f7e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f006de00 con 0x7f23f015e770 2024-04-25T09:02:22.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23f7e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f006e0e0 con 0x7f23f015eb50 2024-04-25T09:02:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23f5e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f23f0071270 0x7f23f00ae560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52286/0 (socket says 172.21.15.59:52286) 2024-04-25T09:02:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23f5e00640 1 -- 172.21.15.59:0/1404631622 learned_addr learned my addr 172.21.15.59:0/1404631622 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23f4a00640 1 --2- 172.21.15.59:0/1404631622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23f015eb50 0x7f23f015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23efe00640 1 -- 172.21.15.59:0/1404631622 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786619960 0 0) 0x7f23f006db20 con 0x7f23f0071270 2024-04-25T09:02:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23efe00640 1 -- 172.21.15.59:0/1404631622 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d8003530 con 0x7f23f0071270 2024-04-25T09:02:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23efe00640 1 -- 172.21.15.59:0/1404631622 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603082166 0 0) 0x7f23f006de00 con 0x7f23f015e770 2024-04-25T09:02:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23efe00640 1 -- 172.21.15.59:0/1404631622 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23f006db20 con 0x7f23f015e770 2024-04-25T09:02:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23f4a00640 1 -- 172.21.15.59:0/1404631622 >> v1:172.21.15.178:6789/0 conn(0x7f23f015e770 legacy=0x7f23f006d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23f4a00640 1 -- 172.21.15.59:0/1404631622 >> v1:172.21.15.59:6789/0 conn(0x7f23f0071270 legacy=0x7f23f00ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:22.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.895+0000 7f23f4a00640 1 -- 172.21.15.59:0/1404631622 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f00ae040 con 0x7f23f015eb50 2024-04-25T09:02:22.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.899+0000 7f23f4a00640 1 --2- 172.21.15.59:0/1404631622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23f015eb50 0x7f23f015f230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0097f0 tx=0x7f23dc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd90aa7a73115a42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.899+0000 7f23efe00640 1 -- 172.21.15.59:0/1404631622 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0b2070 con 0x7f23f015eb50 2024-04-25T09:02:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.899+0000 7f23efe00640 1 -- 172.21.15.59:0/1404631622 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc0a9070 con 0x7f23f015eb50 2024-04-25T09:02:22.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.899+0000 7f23efe00640 1 -- 172.21.15.59:0/1404631622 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0ad860 con 0x7f23f015eb50 2024-04-25T09:02:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.899+0000 7f23f7e00640 1 -- 172.21.15.59:0/1404631622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23f015eb50 msgr2=0x7f23f015f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.899+0000 7f23f7e00640 1 --2- 172.21.15.59:0/1404631622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23f015eb50 0x7f23f015f230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0097f0 tx=0x7f23dc01c450 comp rx=0 tx=0).stop 2024-04-25T09:02:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.899+0000 7f23f7e00640 1 -- 172.21.15.59:0/1404631622 shutdown_connections 2024-04-25T09:02:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.899+0000 7f23f7e00640 1 --2- 172.21.15.59:0/1404631622 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23f015eb50 0x7f23f015f230 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.899+0000 7f23f7e00640 1 -- 172.21.15.59:0/1404631622 >> 172.21.15.59:0/1404631622 conn(0x7f23f0067080 msgr2=0x7f23f006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.899+0000 7f23f7e00640 1 -- 172.21.15.59:0/1404631622 shutdown_connections 2024-04-25T09:02:22.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.899+0000 7f23f7e00640 1 -- 172.21.15.59:0/1404631622 wait complete. 2024-04-25T09:02:22.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f7e00640 1 Processor -- start 2024-04-25T09:02:22.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f7e00640 1 -- start start 2024-04-25T09:02:22.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23f0071270 0x7f23f014a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:22.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f015e770 0x7f23f014e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:22.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f7e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23f015eb50 0x7f23f0134860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:22.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f7e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f0071a90 con 0x7f23f015e770 2024-04-25T09:02:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f7e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f016c220 con 0x7f23f0071270 2024-04-25T09:02:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f7e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f014de70 con 0x7f23f015eb50 2024-04-25T09:02:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f015e770 0x7f23f014e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f015e770 0x7f23f014e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55414/0 (socket says 172.21.15.59:55414) 2024-04-25T09:02:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f4a00640 1 -- 172.21.15.59:0/3855659742 learned_addr learned my addr 172.21.15.59:0/3855659742 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f5400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23f0071270 0x7f23f014a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f5e00640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23f015eb50 0x7f23f0134860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f4a00640 1 -- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23f015eb50 msgr2=0x7f23f0134860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f4a00640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23f015eb50 0x7f23f0134860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f4a00640 1 -- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23f0071270 msgr2=0x7f23f014a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f4a00640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23f0071270 0x7f23f014a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:22.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f4a00640 1 -- 172.21.15.59:0/3855659742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f014d5c0 con 0x7f23f015e770 2024-04-25T09:02:22.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f4a00640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f015e770 0x7f23f014e300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0b0040 tx=0x7f23dc0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:22.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23ed600640 1 -- 172.21.15.59:0/3855659742 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc0b2050 con 0x7f23f015e770 2024-04-25T09:02:22.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23ed600640 1 -- 172.21.15.59:0/3855659742 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23dc0b3040 con 0x7f23f015e770 2024-04-25T09:02:22.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23ed600640 1 -- 172.21.15.59:0/3855659742 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23dc006e20 con 0x7f23f015e770 2024-04-25T09:02:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f7e00640 1 -- 172.21.15.59:0/3855659742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23f014d840 con 0x7f23f015e770 2024-04-25T09:02:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.903+0000 7f23f7e00640 1 -- 172.21.15.59:0/3855659742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f014db00 con 0x7f23f015e770 2024-04-25T09:02:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.907+0000 7f23f7e00640 1 -- 172.21.15.59:0/3855659742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f00745d0 con 0x7f23f015e770 2024-04-25T09:02:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.907+0000 7f23ed600640 1 -- 172.21.15.59:0/3855659742 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f23dc0c0020 con 0x7f23f015e770 2024-04-25T09:02:22.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.907+0000 7f23ed600640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f23d0066f60 0x7f23d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.907+0000 7f23ed600640 1 -- 172.21.15.59:0/3855659742 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f23dc11f0e0 con 0x7f23f015e770 2024-04-25T09:02:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.907+0000 7f23f5400640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f23d0066f60 0x7f23d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:22.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.907+0000 7f23f5400640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f23d0066f60 0x7f23d0069420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f23e40011f0 tx=0x7f23e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:22.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:22.911+0000 7f23ed600640 1 -- 172.21.15.59:0/3855659742 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f23f014d5c0 con 0x7f23f015e770 2024-04-25T09:02:23.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.075+0000 7f23f7e00640 1 -- 172.21.15.59:0/3855659742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23f0071c10 con 0x7f23f015e770 2024-04-25T09:02:23.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.075+0000 7f23ed600640 1 -- 172.21.15.59:0/3855659742 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23f0071c10 con 0x7f23f015e770 2024-04-25T09:02:23.068 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:02:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.079+0000 7f23f7e00640 1 -- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f23d0066f60 msgr2=0x7f23d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.079+0000 7f23f7e00640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f23d0066f60 0x7f23d0069420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f23e40011f0 tx=0x7f23e4009040 comp rx=0 tx=0).stop 2024-04-25T09:02:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.079+0000 7f23f7e00640 1 -- 172.21.15.59:0/3855659742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f015e770 msgr2=0x7f23f014e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.079+0000 7f23f7e00640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f015e770 0x7f23f014e300 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0b0040 tx=0x7f23dc0191f0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.079+0000 7f23f7e00640 1 -- 172.21.15.59:0/3855659742 shutdown_connections 2024-04-25T09:02:23.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.079+0000 7f23f7e00640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f23d0066f60 0x7f23d0069420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.079+0000 7f23f7e00640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f23f015eb50 0x7f23f0134860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.079+0000 7f23f7e00640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f23f015e770 0x7f23f014e300 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.079+0000 7f23f7e00640 1 --2- 172.21.15.59:0/3855659742 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f23f0071270 0x7f23f014a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.079+0000 7f23f7e00640 1 -- 172.21.15.59:0/3855659742 >> 172.21.15.59:0/3855659742 conn(0x7f23f0067080 msgr2=0x7f23f006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.079+0000 7f23f7e00640 1 -- 172.21.15.59:0/3855659742 shutdown_connections 2024-04-25T09:02:23.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.079+0000 7f23f7e00640 1 -- 172.21.15.59:0/3855659742 wait complete. 2024-04-25T09:02:23.090 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f66a0a00640 1 Processor -- start 2024-04-25T09:02:23.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f66a0a00640 1 -- start start 2024-04-25T09:02:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f66a0a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f669c0cf3b0 0x7f669c168ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f66a0a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c06ac10 con 0x7f669c15dd90 2024-04-25T09:02:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f66a0a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c06aeb0 con 0x7f669c072210 2024-04-25T09:02:23.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f66a0a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c0b2dc0 con 0x7f669c0cf3b0 2024-04-25T09:02:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f669c15dd90 0x7f669c071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52294/0 (socket says 172.21.15.59:52294) 2024-04-25T09:02:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699e00640 1 -- 172.21.15.59:0/1231691226 learned_addr learned my addr 172.21.15.59:0/1231691226 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:23.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f669a800640 1 --2- 172.21.15.59:0/1231691226 >> v2:172.21.15.178:3300/0 conn(0x7f669c0cf3b0 0x7f669c168ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679636593 0 0) 0x7f669c06ac10 con 0x7f669c15dd90 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6680003530 con 0x7f669c15dd90 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737705300 0 0) 0x7f669c06aeb0 con 0x7f669c072210 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f669c06ac10 con 0x7f669c072210 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4008329388 0 0) 0x7f6680003530 con 0x7f669c15dd90 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 >> v2:172.21.15.178:3300/0 conn(0x7f669c0cf3b0 msgr2=0x7f669c168ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 --2- 172.21.15.59:0/1231691226 >> v2:172.21.15.178:3300/0 conn(0x7f669c0cf3b0 0x7f669c168ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 >> v1:172.21.15.178:6789/0 conn(0x7f669c072210 legacy=0x7f669c0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c06b190 con 0x7f669c15dd90 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f668c001680 con 0x7f669c15dd90 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f669a800640 1 --2- 172.21.15.59:0/1231691226 >> v2:172.21.15.178:3300/0 conn(0x7f669c0cf3b0 0x7f669c168ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 >> v1:172.21.15.59:6789/0 conn(0x7f669c15dd90 legacy=0x7f669c071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 --2- 172.21.15.59:0/1231691226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6680003b50 0x7f6680003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 --2- 172.21.15.59:0/1231691226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6680004810 0x7f6680004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 --2- 172.21.15.59:0/1231691226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66800051d0 0x7f668000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668000c0d0 con 0x7f66800051d0 2024-04-25T09:02:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668000c280 con 0x7f6680003b50 2024-04-25T09:02:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668000c480 con 0x7f6680004810 2024-04-25T09:02:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.243+0000 7f669a800640 1 --2- 172.21.15.59:0/1231691226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66800051d0 0x7f668000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f6699e00640 1 --2- 172.21.15.59:0/1231691226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6680003b50 0x7f6680003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f6691400640 1 --2- 172.21.15.59:0/1231691226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6680004810 0x7f6680004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f669a800640 1 -- 172.21.15.59:0/1231691226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6680004810 msgr2=0x7f6680004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f669a800640 1 --2- 172.21.15.59:0/1231691226 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6680004810 0x7f6680004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f669a800640 1 -- 172.21.15.59:0/1231691226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6680003b50 msgr2=0x7f6680003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f669a800640 1 --2- 172.21.15.59:0/1231691226 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6680003b50 0x7f6680003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f669a800640 1 -- 172.21.15.59:0/1231691226 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6680003530 con 0x7f66800051d0 2024-04-25T09:02:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f669a800640 1 -- 172.21.15.59:0/1231691226 reap_dead start 2024-04-25T09:02:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f669a800640 1 --2- 172.21.15.59:0/1231691226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66800051d0 0x7f668000b9d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f669400e350 tx=0x7f669401ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9adda4062f387eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694009de0 con 0x7f66800051d0 2024-04-25T09:02:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66940039a0 con 0x7f66800051d0 2024-04-25T09:02:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f6699400640 1 -- 172.21.15.59:0/1231691226 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694003d90 con 0x7f66800051d0 2024-04-25T09:02:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f66a0a00640 1 -- 172.21.15.59:0/1231691226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66800051d0 msgr2=0x7f668000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f66a0a00640 1 --2- 172.21.15.59:0/1231691226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66800051d0 0x7f668000b9d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f669400e350 tx=0x7f669401ce80 comp rx=0 tx=0).stop 2024-04-25T09:02:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f66a0a00640 1 -- 172.21.15.59:0/1231691226 shutdown_connections 2024-04-25T09:02:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f66a0a00640 1 --2- 172.21.15.59:0/1231691226 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66800051d0 0x7f668000b9d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.247+0000 7f66a0a00640 1 -- 172.21.15.59:0/1231691226 >> 172.21.15.59:0/1231691226 conn(0x7f669c0cfd90 msgr2=0x7f669c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f66a0a00640 1 -- 172.21.15.59:0/1231691226 shutdown_connections 2024-04-25T09:02:23.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f66a0a00640 1 -- 172.21.15.59:0/1231691226 wait complete. 2024-04-25T09:02:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f66a0a00640 1 Processor -- start 2024-04-25T09:02:23.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f66a0a00640 1 -- start start 2024-04-25T09:02:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f66a0a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800051d0 0x7f669c15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f66a0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f669c15e2b0 0x7f669c15b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f66a0a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f669c0ad7b0 0x7f669c15bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f66a0a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0cf7c0 con 0x7f669c15e2b0 2024-04-25T09:02:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f66a0a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c06b750 con 0x7f669c0ad7b0 2024-04-25T09:02:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f66a0a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c0cf940 con 0x7f66800051d0 2024-04-25T09:02:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6691400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f669c15e2b0 0x7f669c15b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6691400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f669c15e2b0 0x7f669c15b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55428/0 (socket says 172.21.15.59:55428) 2024-04-25T09:02:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6691400640 1 -- 172.21.15.59:0/477871083 learned_addr learned my addr 172.21.15.59:0/477871083 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f669a800640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f669c0ad7b0 0x7f669c15bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6699e00640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800051d0 0x7f669c15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6691400640 1 -- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800051d0 msgr2=0x7f669c15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6691400640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800051d0 0x7f669c15d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6691400640 1 -- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f669c0ad7b0 msgr2=0x7f669c15bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6691400640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f669c0ad7b0 0x7f669c15bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6691400640 1 -- 172.21.15.59:0/477871083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c154f10 con 0x7f669c15e2b0 2024-04-25T09:02:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6699e00640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800051d0 0x7f669c15d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6691400640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f669c15e2b0 0x7f669c15b880 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6684007800 tx=0x7f668400f540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6692a00640 1 -- 172.21.15.59:0/477871083 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684010040 con 0x7f669c15e2b0 2024-04-25T09:02:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6692a00640 1 -- 172.21.15.59:0/477871083 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668401a070 con 0x7f669c15e2b0 2024-04-25T09:02:23.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f6692a00640 1 -- 172.21.15.59:0/477871083 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684015630 con 0x7f669c15e2b0 2024-04-25T09:02:23.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f66a0a00640 1 -- 172.21.15.59:0/477871083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669c0add70 con 0x7f669c15e2b0 2024-04-25T09:02:23.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.251+0000 7f66a0a00640 1 -- 172.21.15.59:0/477871083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c155340 con 0x7f669c15e2b0 2024-04-25T09:02:23.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.255+0000 7f66a0a00640 1 -- 172.21.15.59:0/477871083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c0ae290 con 0x7f669c15e2b0 2024-04-25T09:02:23.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.255+0000 7f6692a00640 1 -- 172.21.15.59:0/477871083 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f66840157d0 con 0x7f669c15e2b0 2024-04-25T09:02:23.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.255+0000 7f6692a00640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6678066f60 0x7f6678069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.255+0000 7f6692a00640 1 -- 172.21.15.59:0/477871083 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f6684088b80 con 0x7f669c15e2b0 2024-04-25T09:02:23.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.255+0000 7f6699e00640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6678066f60 0x7f6678069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.255+0000 7f6699e00640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6678066f60 0x7f6678069420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f668c007b90 tx=0x7f668c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:23.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.259+0000 7f6692a00640 1 -- 172.21.15.59:0/477871083 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f669c0ae290 con 0x7f669c15e2b0 2024-04-25T09:02:23.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.423+0000 7f66a0a00640 1 -- 172.21.15.59:0/477871083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f669c0745d0 con 0x7f669c15e2b0 2024-04-25T09:02:23.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.423+0000 7f6692a00640 1 -- 172.21.15.59:0/477871083 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f669c154f10 con 0x7f669c15e2b0 2024-04-25T09:02:23.418 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:23.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.427+0000 7f66a0a00640 1 -- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6678066f60 msgr2=0x7f6678069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.427+0000 7f66a0a00640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6678066f60 0x7f6678069420 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f668c007b90 tx=0x7f668c009040 comp rx=0 tx=0).stop 2024-04-25T09:02:23.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.427+0000 7f66a0a00640 1 -- 172.21.15.59:0/477871083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f669c15e2b0 msgr2=0x7f669c15b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.427+0000 7f66a0a00640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f669c15e2b0 0x7f669c15b880 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6684007800 tx=0x7f668400f540 comp rx=0 tx=0).stop 2024-04-25T09:02:23.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.427+0000 7f66a0a00640 1 -- 172.21.15.59:0/477871083 shutdown_connections 2024-04-25T09:02:23.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.427+0000 7f66a0a00640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6678066f60 0x7f6678069420 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.427+0000 7f66a0a00640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f669c0ad7b0 0x7f669c15bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.427+0000 7f66a0a00640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f669c15e2b0 0x7f669c15b880 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.427+0000 7f66a0a00640 1 --2- 172.21.15.59:0/477871083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f66800051d0 0x7f669c15d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.427+0000 7f66a0a00640 1 -- 172.21.15.59:0/477871083 >> 172.21.15.59:0/477871083 conn(0x7f669c0cfd90 msgr2=0x7f669c0ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:23.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.427+0000 7f66a0a00640 1 -- 172.21.15.59:0/477871083 shutdown_connections 2024-04-25T09:02:23.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.427+0000 7f66a0a00640 1 -- 172.21.15.59:0/477871083 wait complete. 2024-04-25T09:02:23.438 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e95000640 1 Processor -- start 2024-04-25T09:02:23.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e95000640 1 -- start start 2024-04-25T09:02:23.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e95000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9e90144120 0x7f9e9015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e95000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9015bc40 con 0x7f9e900b3090 2024-04-25T09:02:23.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e95000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e9015b3a0 con 0x7f9e900ccbf0 2024-04-25T09:02:23.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e95000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e9015e490 con 0x7f9e90144120 2024-04-25T09:02:23.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e8e800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9e900b3090 0x7f9e9006e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52304/0 (socket says 172.21.15.59:52304) 2024-04-25T09:02:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e8e800640 1 -- 172.21.15.59:0/3020833581 learned_addr learned my addr 172.21.15.59:0/3020833581 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e8de00640 1 --2- 172.21.15.59:0/3020833581 >> v2:172.21.15.178:3300/0 conn(0x7f9e90144120 0x7f9e9015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e8d400640 1 -- 172.21.15.59:0/3020833581 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359365221 0 0) 0x7f9e9015bc40 con 0x7f9e900b3090 2024-04-25T09:02:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e8d400640 1 -- 172.21.15.59:0/3020833581 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e74005740 con 0x7f9e900b3090 2024-04-25T09:02:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e8d400640 1 -- 172.21.15.59:0/3020833581 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4195962800 0 0) 0x7f9e74005740 con 0x7f9e900b3090 2024-04-25T09:02:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e8de00640 1 -- 172.21.15.59:0/3020833581 >> v1:172.21.15.178:6789/0 conn(0x7f9e900ccbf0 legacy=0x7f9e9015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e8de00640 1 -- 172.21.15.59:0/3020833581 >> v1:172.21.15.59:6789/0 conn(0x7f9e900b3090 legacy=0x7f9e9006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.591+0000 7f9e8de00640 1 -- 172.21.15.59:0/3020833581 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e9015b680 con 0x7f9e90144120 2024-04-25T09:02:23.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.595+0000 7f9e8de00640 1 --2- 172.21.15.59:0/3020833581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e90144120 0x7f9e9015acd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9e800097c0 tx=0x7f9e8001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20e428594299d9c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:23.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.595+0000 7f9e8d400640 1 -- 172.21.15.59:0/3020833581 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e800b0070 con 0x7f9e90144120 2024-04-25T09:02:23.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.595+0000 7f9e8d400640 1 -- 172.21.15.59:0/3020833581 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e800ab400 con 0x7f9e90144120 2024-04-25T09:02:23.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.595+0000 7f9e8d400640 1 -- 172.21.15.59:0/3020833581 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88001a00 con 0x7f9e90144120 2024-04-25T09:02:23.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.595+0000 7f9e95000640 1 -- 172.21.15.59:0/3020833581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e90144120 msgr2=0x7f9e9015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.595+0000 7f9e95000640 1 --2- 172.21.15.59:0/3020833581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e90144120 0x7f9e9015acd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9e800097c0 tx=0x7f9e8001c330 comp rx=0 tx=0).stop 2024-04-25T09:02:23.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.595+0000 7f9e95000640 1 -- 172.21.15.59:0/3020833581 shutdown_connections 2024-04-25T09:02:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.595+0000 7f9e95000640 1 --2- 172.21.15.59:0/3020833581 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e90144120 0x7f9e9015acd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.595+0000 7f9e95000640 1 -- 172.21.15.59:0/3020833581 >> 172.21.15.59:0/3020833581 conn(0x7f9e90067080 msgr2=0x7f9e9006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.595+0000 7f9e95000640 1 -- 172.21.15.59:0/3020833581 shutdown_connections 2024-04-25T09:02:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.595+0000 7f9e95000640 1 -- 172.21.15.59:0/3020833581 wait complete. 2024-04-25T09:02:23.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e95000640 1 Processor -- start 2024-04-25T09:02:23.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e95000640 1 -- start start 2024-04-25T09:02:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e95000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e900b3090 0x7f9e90142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e95000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e900ccbf0 0x7f9e9013baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e95000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e90144120 0x7f9e9013c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e95000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9006ec70 con 0x7f9e900b3090 2024-04-25T09:02:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e95000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9006eaf0 con 0x7f9e900ccbf0 2024-04-25T09:02:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e95000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e900b3520 con 0x7f9e90144120 2024-04-25T09:02:23.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e8de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e900b3090 0x7f9e90142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e8de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e900b3090 0x7f9e90142bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55430/0 (socket says 172.21.15.59:55430) 2024-04-25T09:02:23.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e8de00640 1 -- 172.21.15.59:0/2104198442 learned_addr learned my addr 172.21.15.59:0/2104198442 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:23.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e8e800640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e90144120 0x7f9e9013c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e87e00640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e900ccbf0 0x7f9e9013baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e8de00640 1 -- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e90144120 msgr2=0x7f9e9013c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e8de00640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e90144120 0x7f9e9013c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e8de00640 1 -- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e900ccbf0 msgr2=0x7f9e9013baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e8de00640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e900ccbf0 0x7f9e9013baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e8de00640 1 -- 172.21.15.59:0/2104198442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e900acb60 con 0x7f9e900b3090 2024-04-25T09:02:23.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e8de00640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e900b3090 0x7f9e90142bd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9e80000c10 tx=0x7f9e800190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:23.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e86000640 1 -- 172.21.15.59:0/2104198442 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e800b0040 con 0x7f9e900b3090 2024-04-25T09:02:23.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e86000640 1 -- 172.21.15.59:0/2104198442 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e80004330 con 0x7f9e900b3090 2024-04-25T09:02:23.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e86000640 1 -- 172.21.15.59:0/2104198442 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e80003820 con 0x7f9e900b3090 2024-04-25T09:02:23.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e95000640 1 -- 172.21.15.59:0/2104198442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9013ad70 con 0x7f9e900b3090 2024-04-25T09:02:23.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e95000640 1 -- 172.21.15.59:0/2104198442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9013b010 con 0x7f9e900b3090 2024-04-25T09:02:23.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.599+0000 7f9e95000640 1 -- 172.21.15.59:0/2104198442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e900745d0 con 0x7f9e900b3090 2024-04-25T09:02:23.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.603+0000 7f9e86000640 1 -- 172.21.15.59:0/2104198442 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9e800bd020 con 0x7f9e900b3090 2024-04-25T09:02:23.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.603+0000 7f9e86000640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9e6c066f60 0x7f9e6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.603+0000 7f9e86000640 1 -- 172.21.15.59:0/2104198442 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f9e8011ec20 con 0x7f9e900b3090 2024-04-25T09:02:23.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.603+0000 7f9e87e00640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9e6c066f60 0x7f9e6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.603+0000 7f9e87e00640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9e6c066f60 0x7f9e6c069420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9e9015b0e0 tx=0x7f9e78009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:23.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.607+0000 7f9e86000640 1 -- 172.21.15.59:0/2104198442 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9e80015fb0 con 0x7f9e900b3090 2024-04-25T09:02:23.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 -- 172.21.15.59:0/2104198442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e90143950 con 0x7f9e900b3090 2024-04-25T09:02:23.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e86000640 1 -- 172.21.15.59:0/2104198442 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e800ef6c0 con 0x7f9e900b3090 2024-04-25T09:02:23.759 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:02:23.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 -- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9e6c066f60 msgr2=0x7f9e6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9e6c066f60 0x7f9e6c069420 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9e9015b0e0 tx=0x7f9e78009040 comp rx=0 tx=0).stop 2024-04-25T09:02:23.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 -- 172.21.15.59:0/2104198442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e900b3090 msgr2=0x7f9e90142bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e900b3090 0x7f9e90142bd0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9e80000c10 tx=0x7f9e800190d0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 -- 172.21.15.59:0/2104198442 shutdown_connections 2024-04-25T09:02:23.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9e6c066f60 0x7f9e6c069420 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9e90144120 0x7f9e9013c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9e900ccbf0 0x7f9e9013baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 --2- 172.21.15.59:0/2104198442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e900b3090 0x7f9e90142bd0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 -- 172.21.15.59:0/2104198442 >> 172.21.15.59:0/2104198442 conn(0x7f9e90067080 msgr2=0x7f9e9006dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:23.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 -- 172.21.15.59:0/2104198442 shutdown_connections 2024-04-25T09:02:23.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.767+0000 7f9e95000640 1 -- 172.21.15.59:0/2104198442 wait complete. 2024-04-25T09:02:23.780 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:02:23.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.931+0000 7fefe8e00640 1 Processor -- start 2024-04-25T09:02:23.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.931+0000 7fefe8e00640 1 -- start start 2024-04-25T09:02:23.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe8e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe415dc00 0x7fefe40af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe8e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefe40d0150 0x7fefe40c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe8e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40b30d0 con 0x7fefe40c70d0 2024-04-25T09:02:23.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe8e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40cd860 con 0x7fefe40d0150 2024-04-25T09:02:23.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe8e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40ccf30 con 0x7fefe415dc00 2024-04-25T09:02:23.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefdbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefe40d0150 0x7fefe40c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe2800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fefe40c70d0 0x7fefe406ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52308/0 (socket says 172.21.15.59:52308) 2024-04-25T09:02:23.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe2800640 1 -- 172.21.15.59:0/1383808914 learned_addr learned my addr 172.21.15.59:0/1383808914 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:23.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe1e00640 1 --2- 172.21.15.59:0/1383808914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe415dc00 0x7fefe40af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefdbe00640 1 -- 172.21.15.59:0/1383808914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe415dc00 msgr2=0x7fefe40af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:23.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefdbe00640 1 --2- 172.21.15.59:0/1383808914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe415dc00 0x7fefe40af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe1400640 1 -- 172.21.15.59:0/1383808914 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2931097029 0 0) 0x7fefe40b30d0 con 0x7fefe40c70d0 2024-04-25T09:02:23.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefdbe00640 1 -- 172.21.15.59:0/1383808914 >> v1:172.21.15.59:6789/0 conn(0x7fefe40c70d0 legacy=0x7fefe406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefdbe00640 1 -- 172.21.15.59:0/1383808914 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40cd210 con 0x7fefe40d0150 2024-04-25T09:02:23.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe1e00640 1 --2- 172.21.15.59:0/1383808914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe415dc00 0x7fefe40af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:23.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefdbe00640 1 --2- 172.21.15.59:0/1383808914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe40d0150 0x7fefe40c6b90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0097c0 tx=0x7fefcc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93633df2e365a3f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:23.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe1400640 1 -- 172.21.15.59:0/1383808914 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0b0070 con 0x7fefe40d0150 2024-04-25T09:02:23.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe1400640 1 -- 172.21.15.59:0/1383808914 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc0a4e50 con 0x7fefe40d0150 2024-04-25T09:02:23.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.935+0000 7fefe1400640 1 -- 172.21.15.59:0/1383808914 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0ab820 con 0x7fefe40d0150 2024-04-25T09:02:23.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 -- 172.21.15.59:0/1383808914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe40d0150 msgr2=0x7fefe40c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 --2- 172.21.15.59:0/1383808914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe40d0150 0x7fefe40c6b90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0097c0 tx=0x7fefcc01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 -- 172.21.15.59:0/1383808914 shutdown_connections 2024-04-25T09:02:23.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 --2- 172.21.15.59:0/1383808914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe40d0150 0x7fefe40c6b90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 --2- 172.21.15.59:0/1383808914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe415dc00 0x7fefe40af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 -- 172.21.15.59:0/1383808914 >> 172.21.15.59:0/1383808914 conn(0x7fefe40b2240 msgr2=0x7fefe40b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:23.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 -- 172.21.15.59:0/1383808914 shutdown_connections 2024-04-25T09:02:23.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 -- 172.21.15.59:0/1383808914 wait complete. 2024-04-25T09:02:23.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 Processor -- start 2024-04-25T09:02:23.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 -- start start 2024-04-25T09:02:23.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c70d0 0x7fefe4153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe40d0150 0x7fefe40b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe415dc00 0x7fefe414b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c7520 con 0x7fefe40d0150 2024-04-25T09:02:23.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40cdee0 con 0x7fefe415dc00 2024-04-25T09:02:23.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe8e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe416a640 con 0x7fefe40c70d0 2024-04-25T09:02:23.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefdbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe40d0150 0x7fefe40b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefdbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe40d0150 0x7fefe40b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55438/0 (socket says 172.21.15.59:55438) 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefdbe00640 1 -- 172.21.15.59:0/46193750 learned_addr learned my addr 172.21.15.59:0/46193750 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe1e00640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c70d0 0x7fefe4153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefe2800640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe415dc00 0x7fefe414b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefdbe00640 1 -- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c70d0 msgr2=0x7fefe4153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefdbe00640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c70d0 0x7fefe4153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefdbe00640 1 -- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe415dc00 msgr2=0x7fefe414b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefdbe00640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe415dc00 0x7fefe414b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.939+0000 7fefdbe00640 1 -- 172.21.15.59:0/46193750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40b1890 con 0x7fefe40d0150 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.943+0000 7fefdbe00640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe40d0150 0x7fefe40b0a70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fefcc01a0d0 tx=0x7fefcc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.943+0000 7fefda000640 1 -- 172.21.15.59:0/46193750 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0b8020 con 0x7fefe40d0150 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.943+0000 7fefda000640 1 -- 172.21.15.59:0/46193750 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc0b4410 con 0x7fefe40d0150 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.943+0000 7fefe8e00640 1 -- 172.21.15.59:0/46193750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe40b15b0 con 0x7fefe40d0150 2024-04-25T09:02:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.943+0000 7fefda000640 1 -- 172.21.15.59:0/46193750 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc0b0040 con 0x7fefe40d0150 2024-04-25T09:02:23.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.943+0000 7fefe8e00640 1 -- 172.21.15.59:0/46193750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe4153350 con 0x7fefe40d0150 2024-04-25T09:02:23.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.943+0000 7fefe8e00640 1 -- 172.21.15.59:0/46193750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe40745d0 con 0x7fefe40d0150 2024-04-25T09:02:23.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.943+0000 7fefda000640 1 -- 172.21.15.59:0/46193750 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fefcc0bb020 con 0x7fefe40d0150 2024-04-25T09:02:23.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.943+0000 7fefda000640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fefc0066f60 0x7fefc0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:23.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.947+0000 7fefda000640 1 -- 172.21.15.59:0/46193750 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fefcc11eef0 con 0x7fefe40d0150 2024-04-25T09:02:23.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.947+0000 7fefe1e00640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fefc0066f60 0x7fefc0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:23.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.947+0000 7fefe1e00640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fefc0066f60 0x7fefc0069420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fefd4006fd0 tx=0x7fefd4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:23.951+0000 7fefda000640 1 -- 172.21.15.59:0/46193750 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fefcc0c2030 con 0x7fefe40d0150 2024-04-25T09:02:24.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.111+0000 7fefe8e00640 1 -- 172.21.15.59:0/46193750 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fefe41582e0 con 0x7fefe40d0150 2024-04-25T09:02:24.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefda000640 1 -- 172.21.15.59:0/46193750 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fefcc016090 con 0x7fefe40d0150 2024-04-25T09:02:24.105 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefe8e00640 1 -- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fefc0066f60 msgr2=0x7fefc0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefe8e00640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fefc0066f60 0x7fefc0069420 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fefd4006fd0 tx=0x7fefd4008040 comp rx=0 tx=0).stop 2024-04-25T09:02:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefe8e00640 1 -- 172.21.15.59:0/46193750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe40d0150 msgr2=0x7fefe40b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefe8e00640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe40d0150 0x7fefe40b0a70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fefcc01a0d0 tx=0x7fefcc019240 comp rx=0 tx=0).stop 2024-04-25T09:02:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefe8e00640 1 -- 172.21.15.59:0/46193750 shutdown_connections 2024-04-25T09:02:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefe8e00640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fefc0066f60 0x7fefc0069420 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefe8e00640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fefe415dc00 0x7fefe414b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefe8e00640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe40d0150 0x7fefe40b0a70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefe8e00640 1 --2- 172.21.15.59:0/46193750 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fefe40c70d0 0x7fefe4153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefe8e00640 1 -- 172.21.15.59:0/46193750 >> 172.21.15.59:0/46193750 conn(0x7fefe40b2240 msgr2=0x7fefe406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:24.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefe8e00640 1 -- 172.21.15.59:0/46193750 shutdown_connections 2024-04-25T09:02:24.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.115+0000 7fefe8e00640 1 -- 172.21.15.59:0/46193750 wait complete. 2024-04-25T09:02:24.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:02:24.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f9342600640 1 Processor -- start 2024-04-25T09:02:24.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f9342600640 1 -- start start 2024-04-25T09:02:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f9342600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f933c15dc00 0x7f933c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f9342600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f933c0d0150 0x7f933c0c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f9342600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933c0b30d0 con 0x7f933c0c70d0 2024-04-25T09:02:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f9342600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933c0cd860 con 0x7f933c15dc00 2024-04-25T09:02:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f9342600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933c0c7500 con 0x7f933c0d0150 2024-04-25T09:02:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f933b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f933c15dc00 0x7f933c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f933be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f933c0c70d0 0x7f933c06ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52324/0 (socket says 172.21.15.59:52324) 2024-04-25T09:02:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f933be00640 1 -- 172.21.15.59:0/2672631760 learned_addr learned my addr 172.21.15.59:0/2672631760 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:24.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f933b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f933c15dc00 0x7f933c0af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55446/0 (socket says 172.21.15.59:55446) 2024-04-25T09:02:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f9332a00640 1 --2- 172.21.15.59:0/2672631760 >> v2:172.21.15.178:3300/0 conn(0x7f933c0d0150 0x7f933c0c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f933b400640 1 -- 172.21.15.59:0/2672631760 >> v2:172.21.15.178:3300/0 conn(0x7f933c0d0150 msgr2=0x7f933c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f933b400640 1 --2- 172.21.15.59:0/2672631760 >> v2:172.21.15.178:3300/0 conn(0x7f933c0d0150 0x7f933c0c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f933b400640 1 -- 172.21.15.59:0/2672631760 >> v1:172.21.15.59:6789/0 conn(0x7f933c0c70d0 legacy=0x7f933c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f933b400640 1 -- 172.21.15.59:0/2672631760 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c0ccf30 con 0x7f933c15dc00 2024-04-25T09:02:24.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f9332a00640 1 --2- 172.21.15.59:0/2672631760 >> v2:172.21.15.178:3300/0 conn(0x7f933c0d0150 0x7f933c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:24.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.279+0000 7f933aa00640 1 -- 172.21.15.59:0/2672631760 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103579922 0 0) 0x7f933c0b30d0 con 0x7f933c0c70d0 2024-04-25T09:02:24.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.283+0000 7f933b400640 1 --2- 172.21.15.59:0/2672631760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933c15dc00 0x7f933c0af770 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f933c072850 tx=0x7f932c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e49adf395519c42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:24.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.283+0000 7f933aa00640 1 -- 172.21.15.59:0/2672631760 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c0b2070 con 0x7f933c15dc00 2024-04-25T09:02:24.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.283+0000 7f933aa00640 1 -- 172.21.15.59:0/2672631760 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932c0a5710 con 0x7f933c15dc00 2024-04-25T09:02:24.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.283+0000 7f933aa00640 1 -- 172.21.15.59:0/2672631760 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f932c0a5ae0 con 0x7f933c15dc00 2024-04-25T09:02:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.283+0000 7f9342600640 1 -- 172.21.15.59:0/2672631760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933c15dc00 msgr2=0x7f933c0af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.283+0000 7f9342600640 1 --2- 172.21.15.59:0/2672631760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933c15dc00 0x7f933c0af770 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f933c072850 tx=0x7f932c01c930 comp rx=0 tx=0).stop 2024-04-25T09:02:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.283+0000 7f9342600640 1 -- 172.21.15.59:0/2672631760 shutdown_connections 2024-04-25T09:02:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.283+0000 7f9342600640 1 --2- 172.21.15.59:0/2672631760 >> v2:172.21.15.178:3300/0 conn(0x7f933c0d0150 0x7f933c0c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.283+0000 7f9342600640 1 --2- 172.21.15.59:0/2672631760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933c15dc00 0x7f933c0af770 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.283+0000 7f9342600640 1 -- 172.21.15.59:0/2672631760 >> 172.21.15.59:0/2672631760 conn(0x7f933c0b2240 msgr2=0x7f933c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.283+0000 7f9342600640 1 -- 172.21.15.59:0/2672631760 shutdown_connections 2024-04-25T09:02:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.283+0000 7f9342600640 1 -- 172.21.15.59:0/2672631760 wait complete. 2024-04-25T09:02:24.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9342600640 1 Processor -- start 2024-04-25T09:02:24.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9342600640 1 -- start start 2024-04-25T09:02:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9342600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f933c0c70d0 0x7f933c157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9342600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933c0d0150 0x7f933c152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9342600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f933c15dc00 0x7f933c14a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9342600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0cde70 con 0x7f933c0d0150 2024-04-25T09:02:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9342600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c0cdcf0 con 0x7f933c15dc00 2024-04-25T09:02:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9342600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c16a640 con 0x7f933c0c70d0 2024-04-25T09:02:24.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9332a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933c0d0150 0x7f933c152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9332a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933c0d0150 0x7f933c152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55452/0 (socket says 172.21.15.59:55452) 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9332a00640 1 -- 172.21.15.59:0/2316353478 learned_addr learned my addr 172.21.15.59:0/2316353478 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f933b400640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f933c0c70d0 0x7f933c157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f933be00640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f933c15dc00 0x7f933c14a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9332a00640 1 -- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f933c0c70d0 msgr2=0x7f933c157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9332a00640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f933c0c70d0 0x7f933c157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9332a00640 1 -- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f933c15dc00 msgr2=0x7f933c14a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9332a00640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f933c15dc00 0x7f933c14a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9332a00640 1 -- 172.21.15.59:0/2316353478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c152ab0 con 0x7f933c0d0150 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f933b400640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f933c0c70d0 0x7f933c157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f933be00640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f933c15dc00 0x7f933c14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9332a00640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933c0d0150 0x7f933c152080 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f932400c7c0 tx=0x7f932400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9333e00640 1 -- 172.21.15.59:0/2316353478 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9324007a30 con 0x7f933c0d0150 2024-04-25T09:02:24.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9333e00640 1 -- 172.21.15.59:0/2316353478 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9324007bd0 con 0x7f933c0d0150 2024-04-25T09:02:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9342600640 1 -- 172.21.15.59:0/2316353478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933c156920 con 0x7f933c0d0150 2024-04-25T09:02:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9333e00640 1 -- 172.21.15.59:0/2316353478 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93240113f0 con 0x7f933c0d0150 2024-04-25T09:02:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9342600640 1 -- 172.21.15.59:0/2316353478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f933c157940 con 0x7f933c0d0150 2024-04-25T09:02:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.287+0000 7f9342600640 1 -- 172.21.15.59:0/2316353478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f933c0745d0 con 0x7f933c0d0150 2024-04-25T09:02:24.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.291+0000 7f9333e00640 1 -- 172.21.15.59:0/2316353478 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9324011590 con 0x7f933c0d0150 2024-04-25T09:02:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.291+0000 7f9333e00640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9318066f90 0x7f9318069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.291+0000 7f9333e00640 1 -- 172.21.15.59:0/2316353478 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f9324085680 con 0x7f933c0d0150 2024-04-25T09:02:24.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.291+0000 7f933b400640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9318066f90 0x7f9318069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.291+0000 7f933b400640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9318066f90 0x7f9318069450 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f932c0af000 tx=0x7f932c0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:24.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.295+0000 7f9333e00640 1 -- 172.21.15.59:0/2316353478 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9324015020 con 0x7f933c0d0150 2024-04-25T09:02:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 -- 172.21.15.59:0/2316353478 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f933c158480 con 0x7f933c0d0150 2024-04-25T09:02:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9333e00640 1 -- 172.21.15.59:0/2316353478 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9324056240 con 0x7f933c0d0150 2024-04-25T09:02:24.459 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:02:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 -- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9318066f90 msgr2=0x7f9318069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9318066f90 0x7f9318069450 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f932c0af000 tx=0x7f932c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:02:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 -- 172.21.15.59:0/2316353478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933c0d0150 msgr2=0x7f933c152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933c0d0150 0x7f933c152080 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f932400c7c0 tx=0x7f932400cc80 comp rx=0 tx=0).stop 2024-04-25T09:02:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 -- 172.21.15.59:0/2316353478 shutdown_connections 2024-04-25T09:02:24.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9318066f90 0x7f9318069450 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f933c15dc00 0x7f933c14a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f933c0d0150 0x7f933c152080 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 --2- 172.21.15.59:0/2316353478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f933c0c70d0 0x7f933c157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 -- 172.21.15.59:0/2316353478 >> 172.21.15.59:0/2316353478 conn(0x7f933c0b2240 msgr2=0x7f933c0ad520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 -- 172.21.15.59:0/2316353478 shutdown_connections 2024-04-25T09:02:24.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.467+0000 7f9342600640 1 -- 172.21.15.59:0/2316353478 wait complete. 2024-04-25T09:02:24.479 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-25T09:02:24.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:24.480 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-25T09:02:24.504 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:02:24.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:24.505 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-25T09:02:24.557 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:02:24.557 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:24.567 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:02:24.567 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:24.620 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:02:24.620 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:02:24.674 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:24.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f449b400640 1 Processor -- start 2024-04-25T09:02:24.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f449b400640 1 -- start start 2024-04-25T09:02:24.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f449b400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f449415e550 0x7f449415e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:24.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f449b400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449406d090 con 0x7f4494161510 2024-04-25T09:02:24.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f449b400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4494071ad0 con 0x7f4494070fe0 2024-04-25T09:02:24.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f449b400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4494162390 con 0x7f449415e550 2024-04-25T09:02:24.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f4493e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4494161510 0x7f4494143080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52340/0 (socket says 172.21.15.59:52340) 2024-04-25T09:02:24.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f4493e00640 1 -- 172.21.15.59:0/2650469147 learned_addr learned my addr 172.21.15.59:0/2650469147 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:24.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f4499400640 1 --2- 172.21.15.59:0/2650469147 >> v2:172.21.15.178:3300/0 conn(0x7f449415e550 0x7f449415e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f4493400640 1 -- 172.21.15.59:0/2650469147 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3215076600 0 0) 0x7f4480001120 con 0x7f4494161510 2024-04-25T09:02:24.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f4493400640 1 -- 172.21.15.59:0/2650469147 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f447c003530 con 0x7f4494161510 2024-04-25T09:02:24.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f4499400640 1 -- 172.21.15.59:0/2650469147 >> v1:172.21.15.178:6789/0 conn(0x7f4494070fe0 legacy=0x7f44940713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f4499400640 1 -- 172.21.15.59:0/2650469147 >> v1:172.21.15.59:6789/0 conn(0x7f4494161510 legacy=0x7f4494143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.827+0000 7f4499400640 1 -- 172.21.15.59:0/2650469147 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494161af0 con 0x7f449415e550 2024-04-25T09:02:24.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.831+0000 7f4499400640 1 --2- 172.21.15.59:0/2650469147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449415e550 0x7f449415e980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f448c009d90 tx=0x7f448c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1744127b8f22e3b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:24.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.831+0000 7f4493400640 1 -- 172.21.15.59:0/2650469147 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c0b2070 con 0x7f449415e550 2024-04-25T09:02:24.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.831+0000 7f4493400640 1 -- 172.21.15.59:0/2650469147 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c0a5830 con 0x7f449415e550 2024-04-25T09:02:24.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.831+0000 7f4493400640 1 -- 172.21.15.59:0/2650469147 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c0a5c00 con 0x7f449415e550 2024-04-25T09:02:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.831+0000 7f449b400640 1 -- 172.21.15.59:0/2650469147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449415e550 msgr2=0x7f449415e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.831+0000 7f449b400640 1 --2- 172.21.15.59:0/2650469147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449415e550 0x7f449415e980 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f448c009d90 tx=0x7f448c01c970 comp rx=0 tx=0).stop 2024-04-25T09:02:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.831+0000 7f449b400640 1 -- 172.21.15.59:0/2650469147 shutdown_connections 2024-04-25T09:02:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.831+0000 7f449b400640 1 --2- 172.21.15.59:0/2650469147 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f449415e550 0x7f449415e980 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.831+0000 7f449b400640 1 -- 172.21.15.59:0/2650469147 >> 172.21.15.59:0/2650469147 conn(0x7f44940b3390 msgr2=0x7f44940b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.831+0000 7f449b400640 1 -- 172.21.15.59:0/2650469147 shutdown_connections 2024-04-25T09:02:24.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.831+0000 7f449b400640 1 -- 172.21.15.59:0/2650469147 wait complete. 2024-04-25T09:02:24.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f449b400640 1 Processor -- start 2024-04-25T09:02:24.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f449b400640 1 -- start start 2024-04-25T09:02:24.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f449b400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4494070fe0 0x7f449413c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f449b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449415e550 0x7f44940b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f449b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4494161510 0x7f44940b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f449b400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494143790 con 0x7f449415e550 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f449b400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940b0540 con 0x7f4494161510 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f449b400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449413e2f0 con 0x7f4494070fe0 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4493e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449415e550 0x7f44940b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4493e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449415e550 0x7f44940b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55454/0 (socket says 172.21.15.59:55454) 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4493e00640 1 -- 172.21.15.59:0/3216270433 learned_addr learned my addr 172.21.15.59:0/3216270433 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4499400640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4494161510 0x7f44940b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4498a00640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4494070fe0 0x7f449413c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4493e00640 1 -- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4494070fe0 msgr2=0x7f449413c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4493e00640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4494070fe0 0x7f449413c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4493e00640 1 -- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4494161510 msgr2=0x7f44940b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:24.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4493e00640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4494161510 0x7f44940b1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:24.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4493e00640 1 -- 172.21.15.59:0/3216270433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940b67d0 con 0x7f449415e550 2024-04-25T09:02:24.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4499400640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4494161510 0x7f44940b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:24.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4493e00640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449415e550 0x7f44940b5e60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f448000c460 tx=0x7f448000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:24.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4490c00640 1 -- 172.21.15.59:0/3216270433 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480017070 con 0x7f449415e550 2024-04-25T09:02:24.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4490c00640 1 -- 172.21.15.59:0/3216270433 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4480005cf0 con 0x7f449415e550 2024-04-25T09:02:24.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f449b400640 1 -- 172.21.15.59:0/3216270433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449413dca0 con 0x7f449415e550 2024-04-25T09:02:24.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f4490c00640 1 -- 172.21.15.59:0/3216270433 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4480007290 con 0x7f449415e550 2024-04-25T09:02:24.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f449b400640 1 -- 172.21.15.59:0/3216270433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940b63a0 con 0x7f449415e550 2024-04-25T09:02:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.835+0000 7f449b400640 1 -- 172.21.15.59:0/3216270433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44940745d0 con 0x7f449415e550 2024-04-25T09:02:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.839+0000 7f4490c00640 1 -- 172.21.15.59:0/3216270433 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f448001a070 con 0x7f449415e550 2024-04-25T09:02:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.839+0000 7f4490c00640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4474066f60 0x7f4474069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.839+0000 7f4490c00640 1 -- 172.21.15.59:0/3216270433 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f44800847a0 con 0x7f449415e550 2024-04-25T09:02:24.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.839+0000 7f4498a00640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4474066f60 0x7f4474069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:24.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.839+0000 7f4498a00640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4474066f60 0x7f4474069420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4488001650 tx=0x7f4488009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:24.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:24.843+0000 7f4490c00640 1 -- 172.21.15.59:0/3216270433 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f449406d090 con 0x7f449415e550 2024-04-25T09:02:24.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.007+0000 7f449b400640 1 -- 172.21.15.59:0/3216270433 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44940cef80 con 0x7f449415e550 2024-04-25T09:02:25.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.011+0000 7f4490c00640 1 -- 172.21.15.59:0/3216270433 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f4480055360 con 0x7f449415e550 2024-04-25T09:02:25.003 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:25.004 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:08.938626+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.015+0000 7f449b400640 1 -- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4474066f60 msgr2=0x7f4474069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.015+0000 7f449b400640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4474066f60 0x7f4474069420 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4488001650 tx=0x7f4488009040 comp rx=0 tx=0).stop 2024-04-25T09:02:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.015+0000 7f449b400640 1 -- 172.21.15.59:0/3216270433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449415e550 msgr2=0x7f44940b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.015+0000 7f449b400640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449415e550 0x7f44940b5e60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f448000c460 tx=0x7f448000c920 comp rx=0 tx=0).stop 2024-04-25T09:02:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.015+0000 7f449b400640 1 -- 172.21.15.59:0/3216270433 shutdown_connections 2024-04-25T09:02:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.015+0000 7f449b400640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4474066f60 0x7f4474069420 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.015+0000 7f449b400640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4494161510 0x7f44940b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.015+0000 7f449b400640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449415e550 0x7f44940b5e60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.015+0000 7f449b400640 1 --2- 172.21.15.59:0/3216270433 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4494070fe0 0x7f449413c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.015+0000 7f449b400640 1 -- 172.21.15.59:0/3216270433 >> 172.21.15.59:0/3216270433 conn(0x7f44940b3390 msgr2=0x7f44940d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:25.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.015+0000 7f449b400640 1 -- 172.21.15.59:0/3216270433 shutdown_connections 2024-04-25T09:02:25.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.015+0000 7f449b400640 1 -- 172.21.15.59:0/3216270433 wait complete. 2024-04-25T09:02:25.025 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:02:25.025 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:25.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.175+0000 7fb92ae00640 1 Processor -- start 2024-04-25T09:02:25.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb92ae00640 1 -- start start 2024-04-25T09:02:25.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb92ae00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92415bcf0 0x7fb924099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb92ae00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9240d02a0 con 0x7fb9240cf3c0 2024-04-25T09:02:25.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb92ae00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9240cc350 con 0x7fb92415b910 2024-04-25T09:02:25.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb92ae00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240cc630 con 0x7fb92415bcf0 2024-04-25T09:02:25.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb91be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb9240cf3c0 0x7fb9240cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52344/0 (socket says 172.21.15.59:52344) 2024-04-25T09:02:25.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb91be00640 1 -- 172.21.15.59:0/2116846968 learned_addr learned my addr 172.21.15.59:0/2116846968 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:25.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb928e00640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92415bcf0 0x7fb924099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309891234 0 0) 0x7fb9240d02a0 con 0x7fb9240cf3c0 2024-04-25T09:02:25.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb908003530 con 0x7fb9240cf3c0 2024-04-25T09:02:25.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812464371 0 0) 0x7fb9240cc350 con 0x7fb92415b910 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9240d02a0 con 0x7fb92415b910 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 556677904 0 0) 0x7fb908003530 con 0x7fb9240cf3c0 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92415bcf0 msgr2=0x7fb924099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92415bcf0 0x7fb924099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 >> v1:172.21.15.178:6789/0 conn(0x7fb92415b910 legacy=0x7fb9240cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240cc910 con 0x7fb9240cf3c0 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fb90c001680 con 0x7fb9240cf3c0 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb928e00640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92415bcf0 0x7fb924099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 >> v1:172.21.15.59:6789/0 conn(0x7fb9240cf3c0 legacy=0x7fb9240cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92415bcf0 0x7fb908003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9080040c0 0x7fb908004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb908004d50 0x7fb9080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240cc630 con 0x7fb908004d50 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90800ba80 con 0x7fb9080040c0 2024-04-25T09:02:25.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90800bc80 con 0x7fb92415bcf0 2024-04-25T09:02:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb928e00640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb908004d50 0x7fb9080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb923e00640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92415bcf0 0x7fb908003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb91be00640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9080040c0 0x7fb908004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb928e00640 1 -- 172.21.15.59:0/2116846968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92415bcf0 msgr2=0x7fb908003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb928e00640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92415bcf0 0x7fb908003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb928e00640 1 -- 172.21.15.59:0/2116846968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9080040c0 msgr2=0x7fb908004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb928e00640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9080040c0 0x7fb908004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.179+0000 7fb928e00640 1 -- 172.21.15.59:0/2116846968 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb908003530 con 0x7fb908004d50 2024-04-25T09:02:25.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.183+0000 7fb928e00640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb908004d50 0x7fb9080051d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00e350 tx=0x7fb91c01ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1fe121076b26e09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:25.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.183+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c009dc0 con 0x7fb908004d50 2024-04-25T09:02:25.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.183+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c0a5e10 con 0x7fb908004d50 2024-04-25T09:02:25.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.183+0000 7fb923400640 1 -- 172.21.15.59:0/2116846968 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c003ba0 con 0x7fb908004d50 2024-04-25T09:02:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.183+0000 7fb92ae00640 1 -- 172.21.15.59:0/2116846968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb908004d50 msgr2=0x7fb9080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.183+0000 7fb92ae00640 1 --2- 172.21.15.59:0/2116846968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb908004d50 0x7fb9080051d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb91c00e350 tx=0x7fb91c01ce00 comp rx=0 tx=0).stop 2024-04-25T09:02:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.183+0000 7fb928e00640 1 -- 172.21.15.59:0/2116846968 reap_dead start 2024-04-25T09:02:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.183+0000 7fb92ae00640 1 -- 172.21.15.59:0/2116846968 shutdown_connections 2024-04-25T09:02:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.183+0000 7fb92ae00640 1 -- 172.21.15.59:0/2116846968 >> 172.21.15.59:0/2116846968 conn(0x7fb9240b3200 msgr2=0x7fb9240b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.183+0000 7fb92ae00640 1 -- 172.21.15.59:0/2116846968 shutdown_connections 2024-04-25T09:02:25.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.183+0000 7fb92ae00640 1 -- 172.21.15.59:0/2116846968 wait complete. 2024-04-25T09:02:25.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb92ae00640 1 Processor -- start 2024-04-25T09:02:25.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb92ae00640 1 -- start start 2024-04-25T09:02:25.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb92ae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb908004d50 0x7fb9241505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb92ae00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92409ecf0 0x7fb9240b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb92ae00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9240b4870 0x7fb9240ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb92ae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb924099a60 con 0x7fb908004d50 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb92ae00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9240d0580 con 0x7fb9240b4870 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb92ae00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb924099be0 con 0x7fb92409ecf0 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb923e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb908004d50 0x7fb9241505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb923e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb908004d50 0x7fb9241505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55464/0 (socket says 172.21.15.59:55464) 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb923e00640 1 -- 172.21.15.59:0/1518153393 learned_addr learned my addr 172.21.15.59:0/1518153393 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb928e00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9240b4870 0x7fb9240ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb91be00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92409ecf0 0x7fb9240b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb923e00640 1 -- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92409ecf0 msgr2=0x7fb9240b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb923e00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92409ecf0 0x7fb9240b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb923e00640 1 -- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9240b4870 msgr2=0x7fb9240ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb923e00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9240b4870 0x7fb9240ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb923e00640 1 -- 172.21.15.59:0/1518153393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240cef90 con 0x7fb908004d50 2024-04-25T09:02:25.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb923e00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb908004d50 0x7fb9241505e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb91400f770 tx=0x7fb91400fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:25.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb920c00640 1 -- 172.21.15.59:0/1518153393 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91400fe80 con 0x7fb908004d50 2024-04-25T09:02:25.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb920c00640 1 -- 172.21.15.59:0/1518153393 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb914018070 con 0x7fb908004d50 2024-04-25T09:02:25.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb92ae00640 1 -- 172.21.15.59:0/1518153393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb924150b20 con 0x7fb908004d50 2024-04-25T09:02:25.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb920c00640 1 -- 172.21.15.59:0/1518153393 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91400d6d0 con 0x7fb908004d50 2024-04-25T09:02:25.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb92ae00640 1 -- 172.21.15.59:0/1518153393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9240b5160 con 0x7fb908004d50 2024-04-25T09:02:25.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.187+0000 7fb92ae00640 1 -- 172.21.15.59:0/1518153393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9240745d0 con 0x7fb908004d50 2024-04-25T09:02:25.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.191+0000 7fb920c00640 1 -- 172.21.15.59:0/1518153393 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb91400d870 con 0x7fb908004d50 2024-04-25T09:02:25.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.191+0000 7fb920c00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb900066f60 0x7fb900069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.191+0000 7fb920c00640 1 -- 172.21.15.59:0/1518153393 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fb9140854a0 con 0x7fb908004d50 2024-04-25T09:02:25.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.191+0000 7fb91be00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb900066f60 0x7fb900069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.191+0000 7fb91be00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb900066f60 0x7fb900069420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb92415d790 tx=0x7fb90c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:25.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.195+0000 7fb920c00640 1 -- 172.21.15.59:0/1518153393 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb91401a310 con 0x7fb908004d50 2024-04-25T09:02:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.355+0000 7fb92ae00640 1 -- 172.21.15.59:0/1518153393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb9240b3f70 con 0x7fb908004d50 2024-04-25T09:02:25.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.355+0000 7fb920c00640 1 -- 172.21.15.59:0/1518153393 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb914055fd0 con 0x7fb908004d50 2024-04-25T09:02:25.348 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:02:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.359+0000 7fb92ae00640 1 -- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb900066f60 msgr2=0x7fb900069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.359+0000 7fb92ae00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb900066f60 0x7fb900069420 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb92415d790 tx=0x7fb90c009040 comp rx=0 tx=0).stop 2024-04-25T09:02:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.359+0000 7fb92ae00640 1 -- 172.21.15.59:0/1518153393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb908004d50 msgr2=0x7fb9241505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.359+0000 7fb92ae00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb908004d50 0x7fb9241505e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb91400f770 tx=0x7fb91400fc30 comp rx=0 tx=0).stop 2024-04-25T09:02:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.359+0000 7fb92ae00640 1 -- 172.21.15.59:0/1518153393 shutdown_connections 2024-04-25T09:02:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.359+0000 7fb92ae00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb900066f60 0x7fb900069420 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.359+0000 7fb92ae00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb9240b4870 0x7fb9240ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.359+0000 7fb92ae00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb92409ecf0 0x7fb9240b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.359+0000 7fb92ae00640 1 --2- 172.21.15.59:0/1518153393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb908004d50 0x7fb9241505e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.359+0000 7fb92ae00640 1 -- 172.21.15.59:0/1518153393 >> 172.21.15.59:0/1518153393 conn(0x7fb9240b3200 msgr2=0x7fb9240736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.359+0000 7fb92ae00640 1 -- 172.21.15.59:0/1518153393 shutdown_connections 2024-04-25T09:02:25.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.359+0000 7fb92ae00640 1 -- 172.21.15.59:0/1518153393 wait complete. 2024-04-25T09:02:25.369 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc85e00640 1 Processor -- start 2024-04-25T09:02:25.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc85e00640 1 -- start start 2024-04-25T09:02:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc85e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcc8009a170 0x7fcc800d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc85e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc8006bf30 0x7fcc800cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc85e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc8015e040 con 0x7fcc8015dc60 2024-04-25T09:02:25.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc85e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800cff80 con 0x7fcc8006bf30 2024-04-25T09:02:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc85e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc800d0260 con 0x7fcc8009a170 2024-04-25T09:02:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc7ea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcc8015dc60 0x7fcc80099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52348/0 (socket says 172.21.15.59:52348) 2024-04-25T09:02:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc7ea00640 1 -- 172.21.15.59:0/2169958754 learned_addr learned my addr 172.21.15.59:0/2169958754 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc7f400640 1 --2- 172.21.15.59:0/2169958754 >> v2:172.21.15.59:3300/0 conn(0x7fcc8006bf30 0x7fcc800cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc76000640 1 --2- 172.21.15.59:0/2169958754 >> v2:172.21.15.178:3300/0 conn(0x7fcc8009a170 0x7fcc800d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc7e000640 1 -- 172.21.15.59:0/2169958754 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788070397 0 0) 0x7fcc8015e040 con 0x7fcc8015dc60 2024-04-25T09:02:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc7e000640 1 -- 172.21.15.59:0/2169958754 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc64003530 con 0x7fcc8015dc60 2024-04-25T09:02:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc7f400640 1 -- 172.21.15.59:0/2169958754 >> v2:172.21.15.178:3300/0 conn(0x7fcc8009a170 msgr2=0x7fcc800d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc7f400640 1 --2- 172.21.15.59:0/2169958754 >> v2:172.21.15.178:3300/0 conn(0x7fcc8009a170 0x7fcc800d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc7f400640 1 -- 172.21.15.59:0/2169958754 >> v1:172.21.15.59:6789/0 conn(0x7fcc8015dc60 legacy=0x7fcc80099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc7f400640 1 -- 172.21.15.59:0/2169958754 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800d0540 con 0x7fcc8006bf30 2024-04-25T09:02:25.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.523+0000 7fcc76000640 1 --2- 172.21.15.59:0/2169958754 >> v2:172.21.15.178:3300/0 conn(0x7fcc8009a170 0x7fcc800d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.527+0000 7fcc7f400640 1 --2- 172.21.15.59:0/2169958754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8006bf30 0x7fcc800cf8a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcc800d2810 tx=0x7fcc7801c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a27e84b3b698ddf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.527+0000 7fcc7e000640 1 -- 172.21.15.59:0/2169958754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780b2070 con 0x7fcc8006bf30 2024-04-25T09:02:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.527+0000 7fcc7e000640 1 -- 172.21.15.59:0/2169958754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc780a58a0 con 0x7fcc8006bf30 2024-04-25T09:02:25.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.527+0000 7fcc7e000640 1 -- 172.21.15.59:0/2169958754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc780a5c70 con 0x7fcc8006bf30 2024-04-25T09:02:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.527+0000 7fcc85e00640 1 -- 172.21.15.59:0/2169958754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8006bf30 msgr2=0x7fcc800cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.527+0000 7fcc85e00640 1 --2- 172.21.15.59:0/2169958754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8006bf30 0x7fcc800cf8a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcc800d2810 tx=0x7fcc7801c7e0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.527+0000 7fcc85e00640 1 -- 172.21.15.59:0/2169958754 shutdown_connections 2024-04-25T09:02:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.527+0000 7fcc85e00640 1 --2- 172.21.15.59:0/2169958754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8006bf30 0x7fcc800cf8a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.527+0000 7fcc85e00640 1 --2- 172.21.15.59:0/2169958754 >> v2:172.21.15.178:3300/0 conn(0x7fcc8009a170 0x7fcc800d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.527+0000 7fcc85e00640 1 -- 172.21.15.59:0/2169958754 >> 172.21.15.59:0/2169958754 conn(0x7fcc800b3200 msgr2=0x7fcc800b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:25.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.527+0000 7fcc85e00640 1 -- 172.21.15.59:0/2169958754 shutdown_connections 2024-04-25T09:02:25.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.527+0000 7fcc85e00640 1 -- 172.21.15.59:0/2169958754 wait complete. 2024-04-25T09:02:25.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc85e00640 1 Processor -- start 2024-04-25T09:02:25.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc85e00640 1 -- start start 2024-04-25T09:02:25.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc85e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc8006bf30 0x7fcc800b6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc85e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8009a170 0x7fcc80151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc85e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc8015dc60 0x7fcc801553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc85e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800cc6f0 con 0x7fcc8009a170 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc85e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800cc570 con 0x7fcc8006bf30 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc85e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc800cc870 con 0x7fcc8015dc60 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc76000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8009a170 0x7fcc80151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc76000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8009a170 0x7fcc80151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55492/0 (socket says 172.21.15.59:55492) 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc76000640 1 -- 172.21.15.59:0/1731931168 learned_addr learned my addr 172.21.15.59:0/1731931168 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc7f400640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc8015dc60 0x7fcc801553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc7ea00640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc8006bf30 0x7fcc800b6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc76000640 1 -- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc8015dc60 msgr2=0x7fcc801553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc76000640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc8015dc60 0x7fcc801553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc76000640 1 -- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc8006bf30 msgr2=0x7fcc800b6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc76000640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc8006bf30 0x7fcc800b6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc76000640 1 -- 172.21.15.59:0/1731931168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80152530 con 0x7fcc8009a170 2024-04-25T09:02:25.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc76000640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8009a170 0x7fcc80151bc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800e840 tx=0x7fcc6800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:25.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc77e00640 1 -- 172.21.15.59:0/1731931168 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68017070 con 0x7fcc8009a170 2024-04-25T09:02:25.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc77e00640 1 -- 172.21.15.59:0/1731931168 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6800c8d0 con 0x7fcc8009a170 2024-04-25T09:02:25.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc77e00640 1 -- 172.21.15.59:0/1731931168 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6800f040 con 0x7fcc8009a170 2024-04-25T09:02:25.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc85e00640 1 -- 172.21.15.59:0/1731931168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc80152810 con 0x7fcc8009a170 2024-04-25T09:02:25.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc85e00640 1 -- 172.21.15.59:0/1731931168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc80152dd0 con 0x7fcc8009a170 2024-04-25T09:02:25.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.531+0000 7fcc85e00640 1 -- 172.21.15.59:0/1731931168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc800745d0 con 0x7fcc8009a170 2024-04-25T09:02:25.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.535+0000 7fcc77e00640 1 -- 172.21.15.59:0/1731931168 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcc6801a070 con 0x7fcc8009a170 2024-04-25T09:02:25.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.535+0000 7fcc77e00640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc5c066f60 0x7fcc5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.535+0000 7fcc77e00640 1 -- 172.21.15.59:0/1731931168 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fcc68085050 con 0x7fcc8009a170 2024-04-25T09:02:25.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.535+0000 7fcc7ea00640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc5c066f60 0x7fcc5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.535+0000 7fcc7ea00640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc5c066f60 0x7fcc5c069420 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcc70007fd0 tx=0x7fcc70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:25.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.539+0000 7fcc77e00640 1 -- 172.21.15.59:0/1731931168 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcc68055530 con 0x7fcc8009a170 2024-04-25T09:02:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.699+0000 7fcc85e00640 1 -- 172.21.15.59:0/1731931168 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcc800b4740 con 0x7fcc8009a170 2024-04-25T09:02:25.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.699+0000 7fcc77e00640 1 -- 172.21.15.59:0/1731931168 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcc680595d0 con 0x7fcc8009a170 2024-04-25T09:02:25.692 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:25.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.703+0000 7fcc85e00640 1 -- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc5c066f60 msgr2=0x7fcc5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.703+0000 7fcc85e00640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc5c066f60 0x7fcc5c069420 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcc70007fd0 tx=0x7fcc70009040 comp rx=0 tx=0).stop 2024-04-25T09:02:25.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.703+0000 7fcc85e00640 1 -- 172.21.15.59:0/1731931168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8009a170 msgr2=0x7fcc80151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.703+0000 7fcc85e00640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8009a170 0x7fcc80151bc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcc6800e840 tx=0x7fcc6800ed00 comp rx=0 tx=0).stop 2024-04-25T09:02:25.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.703+0000 7fcc85e00640 1 -- 172.21.15.59:0/1731931168 shutdown_connections 2024-04-25T09:02:25.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.703+0000 7fcc85e00640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc5c066f60 0x7fcc5c069420 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.703+0000 7fcc85e00640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc8015dc60 0x7fcc801553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.703+0000 7fcc85e00640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc8009a170 0x7fcc80151bc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.703+0000 7fcc85e00640 1 --2- 172.21.15.59:0/1731931168 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc8006bf30 0x7fcc800b6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.703+0000 7fcc85e00640 1 -- 172.21.15.59:0/1731931168 >> 172.21.15.59:0/1731931168 conn(0x7fcc800b3200 msgr2=0x7fcc800cdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:25.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.703+0000 7fcc85e00640 1 -- 172.21.15.59:0/1731931168 shutdown_connections 2024-04-25T09:02:25.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.703+0000 7fcc85e00640 1 -- 172.21.15.59:0/1731931168 wait complete. 2024-04-25T09:02:25.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:25.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.863+0000 7f99bc800640 1 Processor -- start 2024-04-25T09:02:25.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.863+0000 7f99bc800640 1 -- start start 2024-04-25T09:02:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99bc800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99b4159320 0x7f99b415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99bc800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99b406e4a0 0x7f99b406e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99bc800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b415fc00 con 0x7f99b415f440 2024-04-25T09:02:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99bc800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b406ee50 con 0x7f99b4159320 2024-04-25T09:02:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99bc800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b406d640 con 0x7f99b406e4a0 2024-04-25T09:02:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99b9400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f99b415f440 0x7f99b406dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52364/0 (socket says 172.21.15.59:52364) 2024-04-25T09:02:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99b9e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99b4159320 0x7f99b415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99b9400640 1 -- 172.21.15.59:0/2399927933 learned_addr learned my addr 172.21.15.59:0/2399927933 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:25.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99ba800640 1 --2- 172.21.15.59:0/2399927933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99b406e4a0 0x7f99b406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99b9e00640 1 -- 172.21.15.59:0/2399927933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99b406e4a0 msgr2=0x7f99b406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:25.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99b9e00640 1 --2- 172.21.15.59:0/2399927933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99b406e4a0 0x7f99b406e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99b9e00640 1 -- 172.21.15.59:0/2399927933 >> v1:172.21.15.59:6789/0 conn(0x7f99b415f440 legacy=0x7f99b406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99b9e00640 1 -- 172.21.15.59:0/2399927933 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b415fee0 con 0x7f99b4159320 2024-04-25T09:02:25.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.867+0000 7f99b8a00640 1 -- 172.21.15.59:0/2399927933 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280187794 0 0) 0x7f99b415fc00 con 0x7f99b415f440 2024-04-25T09:02:25.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99b9e00640 1 --2- 172.21.15.59:0/2399927933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b4159320 0x7f99b415c9b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f99a80097c0 tx=0x7f99a801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39dd37976d6556f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:25.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99b8a00640 1 -- 172.21.15.59:0/2399927933 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80b1070 con 0x7f99b4159320 2024-04-25T09:02:25.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99b8a00640 1 -- 172.21.15.59:0/2399927933 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a80a8050 con 0x7f99b4159320 2024-04-25T09:02:25.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99b8a00640 1 -- 172.21.15.59:0/2399927933 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a80ac860 con 0x7f99b4159320 2024-04-25T09:02:25.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99bc800640 1 -- 172.21.15.59:0/2399927933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b4159320 msgr2=0x7f99b415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99bc800640 1 --2- 172.21.15.59:0/2399927933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b4159320 0x7f99b415c9b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f99a80097c0 tx=0x7f99a801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99bc800640 1 -- 172.21.15.59:0/2399927933 shutdown_connections 2024-04-25T09:02:25.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99bc800640 1 --2- 172.21.15.59:0/2399927933 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99b406e4a0 0x7f99b406e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99bc800640 1 --2- 172.21.15.59:0/2399927933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b4159320 0x7f99b415c9b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99bc800640 1 -- 172.21.15.59:0/2399927933 >> 172.21.15.59:0/2399927933 conn(0x7f99b4067080 msgr2=0x7f99b406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:25.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99bc800640 1 -- 172.21.15.59:0/2399927933 shutdown_connections 2024-04-25T09:02:25.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99bc800640 1 -- 172.21.15.59:0/2399927933 wait complete. 2024-04-25T09:02:25.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99bc800640 1 Processor -- start 2024-04-25T09:02:25.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.871+0000 7f99bc800640 1 -- start start 2024-04-25T09:02:25.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99bc800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99b406e4a0 0x7f99b4136d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99bc800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b4159320 0x7f99b413f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99bc800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99b415f440 0x7f99b415a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99bc800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b415f860 con 0x7f99b4159320 2024-04-25T09:02:25.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99bc800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b4159700 con 0x7f99b406e4a0 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99bc800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b415f9e0 con 0x7f99b415f440 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99b9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b4159320 0x7f99b413f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99b9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b4159320 0x7f99b413f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55510/0 (socket says 172.21.15.59:55510) 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99b9400640 1 -- 172.21.15.59:0/3180102461 learned_addr learned my addr 172.21.15.59:0/3180102461 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99ba800640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99b415f440 0x7f99b415a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99b9e00640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99b406e4a0 0x7f99b4136d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99b9400640 1 -- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99b415f440 msgr2=0x7f99b415a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99b9400640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99b415f440 0x7f99b415a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99b9400640 1 -- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99b406e4a0 msgr2=0x7f99b4136d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99b9400640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99b406e4a0 0x7f99b4136d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99b9400640 1 -- 172.21.15.59:0/3180102461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b413e3b0 con 0x7f99b4159320 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99b9e00640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99b406e4a0 0x7f99b4136d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99ba800640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99b415f440 0x7f99b415a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:25.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99b9400640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b4159320 0x7f99b413f450 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f99a400c4b0 tx=0x7f99a400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:25.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99ae000640 1 -- 172.21.15.59:0/3180102461 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4018070 con 0x7f99b4159320 2024-04-25T09:02:25.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99ae000640 1 -- 172.21.15.59:0/3180102461 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a4007500 con 0x7f99b4159320 2024-04-25T09:02:25.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99bc800640 1 -- 172.21.15.59:0/3180102461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b413e690 con 0x7f99b4159320 2024-04-25T09:02:25.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99ae000640 1 -- 172.21.15.59:0/3180102461 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a4004a30 con 0x7f99b4159320 2024-04-25T09:02:25.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99bc800640 1 -- 172.21.15.59:0/3180102461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b413ec50 con 0x7f99b4159320 2024-04-25T09:02:25.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99bc800640 1 -- 172.21.15.59:0/3180102461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b40745d0 con 0x7f99b4159320 2024-04-25T09:02:25.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.875+0000 7f99ae000640 1 -- 172.21.15.59:0/3180102461 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f99a401b070 con 0x7f99b4159320 2024-04-25T09:02:25.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.879+0000 7f99ae000640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9998066f60 0x7f9998069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:25.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.879+0000 7f99ae000640 1 -- 172.21.15.59:0/3180102461 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f99a40847c0 con 0x7f99b4159320 2024-04-25T09:02:25.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.879+0000 7f99b9e00640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9998066f60 0x7f9998069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:25.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.879+0000 7f99b9e00640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9998066f60 0x7f9998069420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f99a80ae000 tx=0x7f99a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:25.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:25.883+0000 7f99ae000640 1 -- 172.21.15.59:0/3180102461 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f99a4055380 con 0x7f99b4159320 2024-04-25T09:02:26.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.043+0000 7f99bc800640 1 -- 172.21.15.59:0/3180102461 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99b4164ce0 con 0x7f99b4159320 2024-04-25T09:02:26.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.043+0000 7f99ae000640 1 -- 172.21.15.59:0/3180102461 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99a4054c80 con 0x7f99b4159320 2024-04-25T09:02:26.036 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:02:26.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.047+0000 7f99bc800640 1 -- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9998066f60 msgr2=0x7f9998069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.047+0000 7f99bc800640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9998066f60 0x7f9998069420 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f99a80ae000 tx=0x7f99a8008040 comp rx=0 tx=0).stop 2024-04-25T09:02:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.047+0000 7f99bc800640 1 -- 172.21.15.59:0/3180102461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b4159320 msgr2=0x7f99b413f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.047+0000 7f99bc800640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b4159320 0x7f99b413f450 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f99a400c4b0 tx=0x7f99a400c970 comp rx=0 tx=0).stop 2024-04-25T09:02:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.047+0000 7f99bc800640 1 -- 172.21.15.59:0/3180102461 shutdown_connections 2024-04-25T09:02:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.047+0000 7f99bc800640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9998066f60 0x7f9998069420 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.047+0000 7f99bc800640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99b415f440 0x7f99b415a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.047+0000 7f99bc800640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b4159320 0x7f99b413f450 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.047+0000 7f99bc800640 1 --2- 172.21.15.59:0/3180102461 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99b406e4a0 0x7f99b4136d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.047+0000 7f99bc800640 1 -- 172.21.15.59:0/3180102461 >> 172.21.15.59:0/3180102461 conn(0x7f99b4067080 msgr2=0x7f99b4140f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.047+0000 7f99bc800640 1 -- 172.21.15.59:0/3180102461 shutdown_connections 2024-04-25T09:02:26.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.047+0000 7f99bc800640 1 -- 172.21.15.59:0/3180102461 wait complete. 2024-04-25T09:02:26.058 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:02:26.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553be00640 1 Processor -- start 2024-04-25T09:02:26.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553be00640 1 -- start start 2024-04-25T09:02:26.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f553c06c730 0x7f553c15ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553be00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f553c06cb10 0x7f553c161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553be00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f553c15ef90 con 0x7f553c161ad0 2024-04-25T09:02:26.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553be00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c09a9e0 con 0x7f553c06c730 2024-04-25T09:02:26.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553be00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f553c09ae70 con 0x7f553c06cb10 2024-04-25T09:02:26.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f553c06c730 0x7f553c15ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f553c06c730 0x7f553c15ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55518/0 (socket says 172.21.15.59:55518) 2024-04-25T09:02:26.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553aa00640 1 -- 172.21.15.59:0/126130822 learned_addr learned my addr 172.21.15.59:0/126130822 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:26.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f5532000640 1 --2- 172.21.15.59:0/126130822 >> v2:172.21.15.178:3300/0 conn(0x7f553c06cb10 0x7f553c161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553aa00640 1 -- 172.21.15.59:0/126130822 >> v2:172.21.15.178:3300/0 conn(0x7f553c06cb10 msgr2=0x7f553c161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:26.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553aa00640 1 --2- 172.21.15.59:0/126130822 >> v2:172.21.15.178:3300/0 conn(0x7f553c06cb10 0x7f553c161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553aa00640 1 -- 172.21.15.59:0/126130822 >> v1:172.21.15.178:6789/0 conn(0x7f553c161ad0 legacy=0x7f553c0cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:26.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f553aa00640 1 -- 172.21.15.59:0/126130822 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c099dd0 con 0x7f553c06c730 2024-04-25T09:02:26.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.211+0000 7f5532000640 1 --2- 172.21.15.59:0/126130822 >> v2:172.21.15.178:3300/0 conn(0x7f553c06cb10 0x7f553c161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:26.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553aa00640 1 --2- 172.21.15.59:0/126130822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c06c730 0x7f553c15ea50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f553c06dd50 tx=0x7f552c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdd9ed1f656c388 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:26.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553a000640 1 -- 172.21.15.59:0/126130822 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c0aa610 con 0x7f553c06c730 2024-04-25T09:02:26.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553a000640 1 -- 172.21.15.59:0/126130822 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552c0af070 con 0x7f553c06c730 2024-04-25T09:02:26.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553a000640 1 -- 172.21.15.59:0/126130822 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552c0aa9d0 con 0x7f553c06c730 2024-04-25T09:02:26.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553be00640 1 -- 172.21.15.59:0/126130822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c06c730 msgr2=0x7f553c15ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553be00640 1 --2- 172.21.15.59:0/126130822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c06c730 0x7f553c15ea50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f553c06dd50 tx=0x7f552c01c4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553be00640 1 -- 172.21.15.59:0/126130822 shutdown_connections 2024-04-25T09:02:26.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553be00640 1 --2- 172.21.15.59:0/126130822 >> v2:172.21.15.178:3300/0 conn(0x7f553c06cb10 0x7f553c161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553be00640 1 --2- 172.21.15.59:0/126130822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c06c730 0x7f553c15ea50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553be00640 1 -- 172.21.15.59:0/126130822 >> 172.21.15.59:0/126130822 conn(0x7f553c0b3030 msgr2=0x7f553c0b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:26.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553be00640 1 -- 172.21.15.59:0/126130822 shutdown_connections 2024-04-25T09:02:26.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553be00640 1 -- 172.21.15.59:0/126130822 wait complete. 2024-04-25T09:02:26.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553be00640 1 Processor -- start 2024-04-25T09:02:26.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.215+0000 7f553be00640 1 -- start start 2024-04-25T09:02:26.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f553be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f553c06c730 0x7f553c157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f553be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c06cb10 0x7f553c09eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f553be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f553c161ad0 0x7f553c159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f553be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c15de20 con 0x7f553c06cb10 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f553be00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553c162350 con 0x7f553c06c730 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f553be00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553c099a60 con 0x7f553c161ad0 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f5532000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c06cb10 0x7f553c09eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f5532000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c06cb10 0x7f553c09eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55524/0 (socket says 172.21.15.59:55524) 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f5532000640 1 -- 172.21.15.59:0/843666092 learned_addr learned my addr 172.21.15.59:0/843666092 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f553aa00640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f553c06c730 0x7f553c157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f553b400640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f553c161ad0 0x7f553c159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f5532000640 1 -- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f553c161ad0 msgr2=0x7f553c159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f5532000640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f553c161ad0 0x7f553c159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f5532000640 1 -- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f553c06c730 msgr2=0x7f553c157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f5532000640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f553c06c730 0x7f553c157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f5532000640 1 -- 172.21.15.59:0/843666092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553c159fa0 con 0x7f553c06cb10 2024-04-25T09:02:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f5532000640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c06cb10 0x7f553c09eeb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f552400c7f0 tx=0x7f552400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f5533400640 1 -- 172.21.15.59:0/843666092 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524015070 con 0x7f553c06cb10 2024-04-25T09:02:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f5533400640 1 -- 172.21.15.59:0/843666092 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5524007820 con 0x7f553c06cb10 2024-04-25T09:02:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f5533400640 1 -- 172.21.15.59:0/843666092 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5524007c10 con 0x7f553c06cb10 2024-04-25T09:02:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f553be00640 1 -- 172.21.15.59:0/843666092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f553c15a240 con 0x7f553c06cb10 2024-04-25T09:02:26.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f553be00640 1 -- 172.21.15.59:0/843666092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f553c15a800 con 0x7f553c06cb10 2024-04-25T09:02:26.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.219+0000 7f553be00640 1 -- 172.21.15.59:0/843666092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f553c0745d0 con 0x7f553c06cb10 2024-04-25T09:02:26.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.223+0000 7f5533400640 1 -- 172.21.15.59:0/843666092 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5524018070 con 0x7f553c06cb10 2024-04-25T09:02:26.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.223+0000 7f5533400640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5518066f60 0x7f5518069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.223+0000 7f5533400640 1 -- 172.21.15.59:0/843666092 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f5524085570 con 0x7f553c06cb10 2024-04-25T09:02:26.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.223+0000 7f553aa00640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5518066f60 0x7f5518069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.223+0000 7f553aa00640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5518066f60 0x7f5518069420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f552c0ae000 tx=0x7f552c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:26.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.227+0000 7f5533400640 1 -- 172.21.15.59:0/843666092 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5524055a50 con 0x7f553c06cb10 2024-04-25T09:02:26.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.387+0000 7f553be00640 1 -- 172.21.15.59:0/843666092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f553c06c510 con 0x7f553c06cb10 2024-04-25T09:02:26.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.387+0000 7f5533400640 1 -- 172.21.15.59:0/843666092 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5524059af0 con 0x7f553c06cb10 2024-04-25T09:02:26.379 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.387+0000 7f553be00640 1 -- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5518066f60 msgr2=0x7f5518069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.387+0000 7f553be00640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5518066f60 0x7f5518069420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f552c0ae000 tx=0x7f552c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.387+0000 7f553be00640 1 -- 172.21.15.59:0/843666092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c06cb10 msgr2=0x7f553c09eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.387+0000 7f553be00640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c06cb10 0x7f553c09eeb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f552400c7f0 tx=0x7f552400ccb0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.387+0000 7f553be00640 1 -- 172.21.15.59:0/843666092 shutdown_connections 2024-04-25T09:02:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.387+0000 7f553be00640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5518066f60 0x7f5518069420 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.387+0000 7f553be00640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f553c161ad0 0x7f553c159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.387+0000 7f553be00640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f553c06cb10 0x7f553c09eeb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.387+0000 7f553be00640 1 --2- 172.21.15.59:0/843666092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f553c06c730 0x7f553c157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.387+0000 7f553be00640 1 -- 172.21.15.59:0/843666092 >> 172.21.15.59:0/843666092 conn(0x7f553c0b3030 msgr2=0x7f553c06f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.391+0000 7f553be00640 1 -- 172.21.15.59:0/843666092 shutdown_connections 2024-04-25T09:02:26.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.391+0000 7f553be00640 1 -- 172.21.15.59:0/843666092 wait complete. 2024-04-25T09:02:26.400 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:02:26.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5998c00640 1 Processor -- start 2024-04-25T09:02:26.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5998c00640 1 -- start start 2024-04-25T09:02:26.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5998c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5994162060 0x7f59940d0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5998c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5994162470 con 0x7f5994161570 2024-04-25T09:02:26.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5998c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59940b2760 con 0x7f59940b22b0 2024-04-25T09:02:26.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5998c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f599406d100 con 0x7f5994162060 2024-04-25T09:02:26.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5993400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5994161570 0x7f59940b0ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52370/0 (socket says 172.21.15.59:52370) 2024-04-25T09:02:26.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5993400640 1 -- 172.21.15.59:0/2036505523 learned_addr learned my addr 172.21.15.59:0/2036505523 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:26.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5993e00640 1 --2- 172.21.15.59:0/2036505523 >> v2:172.21.15.59:3300/0 conn(0x7f5994162060 0x7f59940d0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5992a00640 1 -- 172.21.15.59:0/2036505523 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053725189 0 0) 0x7f5994162470 con 0x7f5994161570 2024-04-25T09:02:26.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5992a00640 1 -- 172.21.15.59:0/2036505523 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5978003530 con 0x7f5994161570 2024-04-25T09:02:26.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5992a00640 1 -- 172.21.15.59:0/2036505523 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945727777 0 0) 0x7f59940b2760 con 0x7f59940b22b0 2024-04-25T09:02:26.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5993e00640 1 -- 172.21.15.59:0/2036505523 >> v1:172.21.15.178:6789/0 conn(0x7f59940b22b0 legacy=0x7f5994161950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5993e00640 1 -- 172.21.15.59:0/2036505523 >> v1:172.21.15.59:6789/0 conn(0x7f5994161570 legacy=0x7f59940b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.551+0000 7f5993e00640 1 -- 172.21.15.59:0/2036505523 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599406c860 con 0x7f5994162060 2024-04-25T09:02:26.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.555+0000 7f5993e00640 1 --2- 172.21.15.59:0/2036505523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5994162060 0x7f59940d0020 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f598c009d90 tx=0x7f598c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e6dbc1392f811a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:26.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.555+0000 7f5992a00640 1 -- 172.21.15.59:0/2036505523 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c0b2070 con 0x7f5994162060 2024-04-25T09:02:26.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.555+0000 7f5992a00640 1 -- 172.21.15.59:0/2036505523 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c0a5a00 con 0x7f5994162060 2024-04-25T09:02:26.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.555+0000 7f5992a00640 1 -- 172.21.15.59:0/2036505523 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c0a5dd0 con 0x7f5994162060 2024-04-25T09:02:26.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.555+0000 7f5998c00640 1 -- 172.21.15.59:0/2036505523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5994162060 msgr2=0x7f59940d0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.555+0000 7f5998c00640 1 --2- 172.21.15.59:0/2036505523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5994162060 0x7f59940d0020 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f598c009d90 tx=0x7f598c01c940 comp rx=0 tx=0).stop 2024-04-25T09:02:26.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.555+0000 7f5998c00640 1 -- 172.21.15.59:0/2036505523 shutdown_connections 2024-04-25T09:02:26.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.555+0000 7f5998c00640 1 --2- 172.21.15.59:0/2036505523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5994162060 0x7f59940d0020 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.555+0000 7f5998c00640 1 -- 172.21.15.59:0/2036505523 >> 172.21.15.59:0/2036505523 conn(0x7f59940d1640 msgr2=0x7f59940d1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:26.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.555+0000 7f5998c00640 1 -- 172.21.15.59:0/2036505523 shutdown_connections 2024-04-25T09:02:26.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.555+0000 7f5998c00640 1 -- 172.21.15.59:0/2036505523 wait complete. 2024-04-25T09:02:26.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f5998c00640 1 Processor -- start 2024-04-25T09:02:26.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f5998c00640 1 -- start start 2024-04-25T09:02:26.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f5998c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59940b22b0 0x7f59940b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f5998c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5994161570 0x7f59940b5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f5998c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5994162060 0x7f59941f9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f5998c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59940b2b70 con 0x7f5994161570 2024-04-25T09:02:26.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f5998c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59940cf7b0 con 0x7f5994162060 2024-04-25T09:02:26.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f5998c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599416b8c0 con 0x7f59940b22b0 2024-04-25T09:02:26.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f598aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5994161570 0x7f59940b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f598aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5994161570 0x7f59940b5240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55536/0 (socket says 172.21.15.59:55536) 2024-04-25T09:02:26.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f598aa00640 1 -- 172.21.15.59:0/2796724711 learned_addr learned my addr 172.21.15.59:0/2796724711 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:26.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f5993400640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59940b22b0 0x7f59940b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f5993e00640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5994162060 0x7f59941f9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f598aa00640 1 -- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59940b22b0 msgr2=0x7f59940b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f598aa00640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59940b22b0 0x7f59940b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f598aa00640 1 -- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5994162060 msgr2=0x7f59941f9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f598aa00640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5994162060 0x7f59941f9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f598aa00640 1 -- 172.21.15.59:0/2796724711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59940b5820 con 0x7f5994161570 2024-04-25T09:02:26.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f598aa00640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5994161570 0x7f59940b5240 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f597c00c4d0 tx=0x7f597c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:26.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f598be00640 1 -- 172.21.15.59:0/2796724711 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c017070 con 0x7f5994161570 2024-04-25T09:02:26.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f598be00640 1 -- 172.21.15.59:0/2796724711 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597c005480 con 0x7f5994161570 2024-04-25T09:02:26.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f5998c00640 1 -- 172.21.15.59:0/2796724711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59940b5b00 con 0x7f5994161570 2024-04-25T09:02:26.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f598be00640 1 -- 172.21.15.59:0/2796724711 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f597c003840 con 0x7f5994161570 2024-04-25T09:02:26.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.559+0000 7f5998c00640 1 -- 172.21.15.59:0/2796724711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59941fa3d0 con 0x7f5994161570 2024-04-25T09:02:26.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.563+0000 7f5998c00640 1 -- 172.21.15.59:0/2796724711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59940745d0 con 0x7f5994161570 2024-04-25T09:02:26.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.563+0000 7f598be00640 1 -- 172.21.15.59:0/2796724711 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f597c01a070 con 0x7f5994161570 2024-04-25T09:02:26.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.563+0000 7f598be00640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5970066f60 0x7f5970069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.563+0000 7f598be00640 1 -- 172.21.15.59:0/2796724711 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f597c0847b0 con 0x7f5994161570 2024-04-25T09:02:26.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.563+0000 7f5993400640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5970066f60 0x7f5970069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.563+0000 7f5993400640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5970066f60 0x7f5970069420 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5984007fd0 tx=0x7f5984009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:26.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.567+0000 7f598be00640 1 -- 172.21.15.59:0/2796724711 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f597c054de0 con 0x7f5994161570 2024-04-25T09:02:26.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.739+0000 7f5998c00640 1 -- 172.21.15.59:0/2796724711 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f59940d0e80 con 0x7f5994161570 2024-04-25T09:02:26.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f598be00640 1 -- 172.21.15.59:0/2796724711 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f597c058e80 con 0x7f5994161570 2024-04-25T09:02:26.733 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:02:26.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f5998c00640 1 -- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5970066f60 msgr2=0x7f5970069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f5998c00640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5970066f60 0x7f5970069420 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5984007fd0 tx=0x7f5984009040 comp rx=0 tx=0).stop 2024-04-25T09:02:26.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f5998c00640 1 -- 172.21.15.59:0/2796724711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5994161570 msgr2=0x7f59940b5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f5998c00640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5994161570 0x7f59940b5240 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f597c00c4d0 tx=0x7f597c00c990 comp rx=0 tx=0).stop 2024-04-25T09:02:26.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f5998c00640 1 -- 172.21.15.59:0/2796724711 shutdown_connections 2024-04-25T09:02:26.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f5998c00640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5970066f60 0x7f5970069420 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f5998c00640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5994162060 0x7f59941f9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f5998c00640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5994161570 0x7f59940b5240 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f5998c00640 1 --2- 172.21.15.59:0/2796724711 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59940b22b0 0x7f59940b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f5998c00640 1 -- 172.21.15.59:0/2796724711 >> 172.21.15.59:0/2796724711 conn(0x7f59940d1640 msgr2=0x7f59940b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:26.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f5998c00640 1 -- 172.21.15.59:0/2796724711 shutdown_connections 2024-04-25T09:02:26.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.743+0000 7f5998c00640 1 -- 172.21.15.59:0/2796724711 wait complete. 2024-04-25T09:02:26.754 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-25T09:02:26.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:26.754 DEBUG:teuthology.orchestra.run.smithi178:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-25T09:02:26.780 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T09:02:26.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:02:26.780 DEBUG:teuthology.orchestra.run.smithi178:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-25T09:02:26.833 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:02:26.833 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:26.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0948600640 1 Processor -- start 2024-04-25T09:02:26.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0948600640 1 -- start start 2024-04-25T09:02:26.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0948600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f094015b5a0 0x7f09400cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0948600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09400cc440 0x7f09400d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0948600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09400ce7f0 con 0x7f094015b980 2024-04-25T09:02:26.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0948600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09400cfcd0 con 0x7f094015b5a0 2024-04-25T09:02:26.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0948600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09400cead0 con 0x7f09400cc440 2024-04-25T09:02:26.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0945c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f094015b5a0 0x7f09400cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0945c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f094015b5a0 0x7f09400cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55538/0 (socket says 172.21.15.59:55538) 2024-04-25T09:02:26.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0945c00640 1 -- 172.21.15.59:0/1882642947 learned_addr learned my addr 172.21.15.59:0/1882642947 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:26.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0946600640 1 --2- 172.21.15.59:0/1882642947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09400cc440 0x7f09400d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0945c00640 1 -- 172.21.15.59:0/1882642947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09400cc440 msgr2=0x7f09400d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:26.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0945c00640 1 --2- 172.21.15.59:0/1882642947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09400cc440 0x7f09400d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0945c00640 1 -- 172.21.15.59:0/1882642947 >> v1:172.21.15.178:6789/0 conn(0x7f094015b980 legacy=0x7f09400cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:26.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.983+0000 7f0945c00640 1 -- 172.21.15.59:0/1882642947 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09400cf960 con 0x7f094015b5a0 2024-04-25T09:02:26.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.987+0000 7f0945c00640 1 --2- 172.21.15.59:0/1882642947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f094015b5a0 0x7f09400cdea0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0934009870 tx=0x7f093401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31640c02795c9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:26.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.987+0000 7f093fe00640 1 -- 172.21.15.59:0/1882642947 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340a9640 con 0x7f094015b5a0 2024-04-25T09:02:26.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.987+0000 7f093fe00640 1 -- 172.21.15.59:0/1882642947 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09340a97e0 con 0x7f094015b5a0 2024-04-25T09:02:26.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.987+0000 7f093fe00640 1 -- 172.21.15.59:0/1882642947 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340a9bb0 con 0x7f094015b5a0 2024-04-25T09:02:26.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.987+0000 7f0948600640 1 -- 172.21.15.59:0/1882642947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f094015b5a0 msgr2=0x7f09400cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.987+0000 7f0948600640 1 --2- 172.21.15.59:0/1882642947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f094015b5a0 0x7f09400cdea0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0934009870 tx=0x7f093401c560 comp rx=0 tx=0).stop 2024-04-25T09:02:26.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.987+0000 7f0948600640 1 -- 172.21.15.59:0/1882642947 shutdown_connections 2024-04-25T09:02:26.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.987+0000 7f0948600640 1 --2- 172.21.15.59:0/1882642947 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09400cc440 0x7f09400d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.987+0000 7f0948600640 1 --2- 172.21.15.59:0/1882642947 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f094015b5a0 0x7f09400cdea0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.987+0000 7f0948600640 1 -- 172.21.15.59:0/1882642947 >> 172.21.15.59:0/1882642947 conn(0x7f09400b3390 msgr2=0x7f09400b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:26.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.987+0000 7f0948600640 1 -- 172.21.15.59:0/1882642947 shutdown_connections 2024-04-25T09:02:26.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.987+0000 7f0948600640 1 -- 172.21.15.59:0/1882642947 wait complete. 2024-04-25T09:02:26.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0948600640 1 Processor -- start 2024-04-25T09:02:26.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0948600640 1 -- start start 2024-04-25T09:02:26.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0948600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09400cc440 0x7f09401562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0948600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f094015b5a0 0x7f094014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0948600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f094015b980 0x7f0940157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0948600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09400d1280 con 0x7f094015b980 2024-04-25T09:02:26.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0948600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09400d1100 con 0x7f09400cc440 2024-04-25T09:02:26.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0948600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09400d1400 con 0x7f094015b5a0 2024-04-25T09:02:26.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0946600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f094015b980 0x7f0940157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0946600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f094015b980 0x7f0940157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55554/0 (socket says 172.21.15.59:55554) 2024-04-25T09:02:26.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0946600640 1 -- 172.21.15.59:0/4273682818 learned_addr learned my addr 172.21.15.59:0/4273682818 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:26.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0945c00640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09400cc440 0x7f09401562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0945200640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f094015b5a0 0x7f094014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0946600640 1 -- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f094015b5a0 msgr2=0x7f094014e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0946600640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f094015b5a0 0x7f094014e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0946600640 1 -- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09400cc440 msgr2=0x7f09401562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:26.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0946600640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09400cc440 0x7f09401562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:26.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0946600640 1 -- 172.21.15.59:0/4273682818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09401568a0 con 0x7f094015b980 2024-04-25T09:02:26.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0946600640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f094015b980 0x7f0940157400 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0938009fd0 tx=0x7f093800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:26.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f093d600640 1 -- 172.21.15.59:0/4273682818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938014420 con 0x7f094015b980 2024-04-25T09:02:26.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f093d600640 1 -- 172.21.15.59:0/4273682818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0938019070 con 0x7f094015b980 2024-04-25T09:02:26.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f093d600640 1 -- 172.21.15.59:0/4273682818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938014800 con 0x7f094015b980 2024-04-25T09:02:26.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0948600640 1 -- 172.21.15.59:0/4273682818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0940156b80 con 0x7f094015b980 2024-04-25T09:02:26.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0948600640 1 -- 172.21.15.59:0/4273682818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f094015c2c0 con 0x7f094015b980 2024-04-25T09:02:26.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.991+0000 7f0948600640 1 -- 172.21.15.59:0/4273682818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09400745d0 con 0x7f094015b980 2024-04-25T09:02:26.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.995+0000 7f093d600640 1 -- 172.21.15.59:0/4273682818 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f09380149a0 con 0x7f094015b980 2024-04-25T09:02:26.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.995+0000 7f093d600640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0920066f60 0x7f0920069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:26.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.995+0000 7f093d600640 1 -- 172.21.15.59:0/4273682818 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f0938085b60 con 0x7f094015b980 2024-04-25T09:02:26.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.995+0000 7f0945c00640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0920066f60 0x7f0920069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:26.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.995+0000 7f0945c00640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0920066f60 0x7f0920069420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f09340ae000 tx=0x7f09340b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:26.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:26.999+0000 7f093d600640 1 -- 172.21.15.59:0/4273682818 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f09380560d0 con 0x7f094015b980 2024-04-25T09:02:27.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.191+0000 7f0948600640 1 -- 172.21.15.59:0/4273682818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09400cc960 con 0x7f094015b980 2024-04-25T09:02:27.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f093d600640 1 -- 172.21.15.59:0/4273682818 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f093805a170 con 0x7f094015b980 2024-04-25T09:02:27.186 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:27.186 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2167197221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2167197221},{"type":"v1","addr":"172.21.15.59:6834","nonce":2167197221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2689387181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2689387181},{"type":"v1","addr":"172.21.15.178:6837","nonce":2689387181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1461695991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1461695991},{"type":"v1","addr":"172.21.15.59:6835","nonce":1461695991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:28.177275+0000","modified":"2024-04-25T09:01:46.237549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/3239224017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3239224017},{"type":"v1","addr":"172.21.15.178:6836","nonce":3239224017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:02:27.186 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2024-04-25T09:02:27.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f0948600640 1 -- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0920066f60 msgr2=0x7f0920069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f0948600640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0920066f60 0x7f0920069420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f09340ae000 tx=0x7f09340b3040 comp rx=0 tx=0).stop 2024-04-25T09:02:27.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f0948600640 1 -- 172.21.15.59:0/4273682818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f094015b980 msgr2=0x7f0940157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f0948600640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f094015b980 0x7f0940157400 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0938009fd0 tx=0x7f093800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f0948600640 1 -- 172.21.15.59:0/4273682818 shutdown_connections 2024-04-25T09:02:27.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f0948600640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0920066f60 0x7f0920069420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f0948600640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f094015b980 0x7f0940157400 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f0948600640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f094015b5a0 0x7f094014e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f0948600640 1 --2- 172.21.15.59:0/4273682818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09400cc440 0x7f09401562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f0948600640 1 -- 172.21.15.59:0/4273682818 >> 172.21.15.59:0/4273682818 conn(0x7f09400b3390 msgr2=0x7f09400b66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f0948600640 1 -- 172.21.15.59:0/4273682818 shutdown_connections 2024-04-25T09:02:27.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.195+0000 7f0948600640 1 -- 172.21.15.59:0/4273682818 wait complete. 2024-04-25T09:02:27.207 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:27.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.355+0000 7f7853e00640 1 Processor -- start 2024-04-25T09:02:27.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.355+0000 7f7853e00640 1 -- start start 2024-04-25T09:02:27.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f7853e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f784c0cef30 0x7f784c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f7853e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784c15ac60 con 0x7f784c06e900 2024-04-25T09:02:27.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f7853e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784c0cf3e0 con 0x7f784c144140 2024-04-25T09:02:27.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f7853e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c06ed30 con 0x7f784c0cef30 2024-04-25T09:02:27.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f7851e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f784c06e900 0x7f784c0b0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52386/0 (socket says 172.21.15.59:52386) 2024-04-25T09:02:27.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f7851e00640 1 -- 172.21.15.59:0/4257057547 learned_addr learned my addr 172.21.15.59:0/4257057547 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:27.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f7850a00640 1 --2- 172.21.15.59:0/4257057547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f784c0cef30 0x7f784c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f784be00640 1 -- 172.21.15.59:0/4257057547 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229208247 0 0) 0x7f784c15ac60 con 0x7f784c06e900 2024-04-25T09:02:27.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f784be00640 1 -- 172.21.15.59:0/4257057547 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7834005740 con 0x7f784c06e900 2024-04-25T09:02:27.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f784be00640 1 -- 172.21.15.59:0/4257057547 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201583060 0 0) 0x7f784c0cf3e0 con 0x7f784c144140 2024-04-25T09:02:27.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f784be00640 1 -- 172.21.15.59:0/4257057547 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f784c15ac60 con 0x7f784c144140 2024-04-25T09:02:27.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f7850a00640 1 -- 172.21.15.59:0/4257057547 >> v1:172.21.15.178:6789/0 conn(0x7f784c144140 legacy=0x7f784c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f7850a00640 1 -- 172.21.15.59:0/4257057547 >> v1:172.21.15.59:6789/0 conn(0x7f784c06e900 legacy=0x7f784c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f784be00640 1 -- 172.21.15.59:0/4257057547 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2862956818 0 0) 0x7f7834005740 con 0x7f784c06e900 2024-04-25T09:02:27.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.359+0000 7f7850a00640 1 -- 172.21.15.59:0/4257057547 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c15af20 con 0x7f784c0cef30 2024-04-25T09:02:27.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f7850a00640 1 --2- 172.21.15.59:0/4257057547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f784c0cef30 0x7f784c06e3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f78380097f0 tx=0x7f783801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a30a4feee7e4dade server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f784be00640 1 -- 172.21.15.59:0/4257057547 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78380b0070 con 0x7f784c0cef30 2024-04-25T09:02:27.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f784be00640 1 -- 172.21.15.59:0/4257057547 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78380ab400 con 0x7f784c0cef30 2024-04-25T09:02:27.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f784be00640 1 -- 172.21.15.59:0/4257057547 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844001a00 con 0x7f784c0cef30 2024-04-25T09:02:27.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f7853e00640 1 -- 172.21.15.59:0/4257057547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f784c0cef30 msgr2=0x7f784c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f7853e00640 1 --2- 172.21.15.59:0/4257057547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f784c0cef30 0x7f784c06e3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f78380097f0 tx=0x7f783801c400 comp rx=0 tx=0).stop 2024-04-25T09:02:27.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f7853e00640 1 -- 172.21.15.59:0/4257057547 shutdown_connections 2024-04-25T09:02:27.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f7853e00640 1 --2- 172.21.15.59:0/4257057547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f784c0cef30 0x7f784c06e3c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f7853e00640 1 -- 172.21.15.59:0/4257057547 >> 172.21.15.59:0/4257057547 conn(0x7f784c066fa0 msgr2=0x7f784c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f7853e00640 1 -- 172.21.15.59:0/4257057547 shutdown_connections 2024-04-25T09:02:27.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f7853e00640 1 -- 172.21.15.59:0/4257057547 wait complete. 2024-04-25T09:02:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f7853e00640 1 Processor -- start 2024-04-25T09:02:27.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f7853e00640 1 -- start start 2024-04-25T09:02:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.363+0000 7f7853e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c06e900 0x7f784c162950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7853e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f784c0cef30 0x7f784c1643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7853e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f784c144140 0x7f784c15e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7853e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c15ba00 con 0x7f784c06e900 2024-04-25T09:02:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7853e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c144520 con 0x7f784c0cef30 2024-04-25T09:02:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7853e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c15bb80 con 0x7f784c144140 2024-04-25T09:02:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7851400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c06e900 0x7f784c162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7851400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c06e900 0x7f784c162950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55556/0 (socket says 172.21.15.59:55556) 2024-04-25T09:02:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7851400640 1 -- 172.21.15.59:0/2441510330 learned_addr learned my addr 172.21.15.59:0/2441510330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:27.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7850a00640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f784c0cef30 0x7f784c1643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7851e00640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f784c144140 0x7f784c15e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7851400640 1 -- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f784c144140 msgr2=0x7f784c15e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7851400640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f784c144140 0x7f784c15e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7851400640 1 -- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f784c0cef30 msgr2=0x7f784c1643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7851400640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f784c0cef30 0x7f784c1643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7851400640 1 -- 172.21.15.59:0/2441510330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c164e60 con 0x7f784c06e900 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7850a00640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f784c0cef30 0x7f784c1643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7851400640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c06e900 0x7f784c162950 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f784000c430 tx=0x7f784000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7849600640 1 -- 172.21.15.59:0/2441510330 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840017070 con 0x7f784c06e900 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7849600640 1 -- 172.21.15.59:0/2441510330 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78400052f0 con 0x7f784c06e900 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7849600640 1 -- 172.21.15.59:0/2441510330 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840003840 con 0x7f784c06e900 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7853e00640 1 -- 172.21.15.59:0/2441510330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c165140 con 0x7f784c06e900 2024-04-25T09:02:27.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7853e00640 1 -- 172.21.15.59:0/2441510330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784c15ff10 con 0x7f784c06e900 2024-04-25T09:02:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7853e00640 1 -- 172.21.15.59:0/2441510330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784c0745d0 con 0x7f784c06e900 2024-04-25T09:02:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.367+0000 7f7849600640 1 -- 172.21.15.59:0/2441510330 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f784001a070 con 0x7f784c06e900 2024-04-25T09:02:27.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.371+0000 7f7849600640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f782c066f60 0x7f782c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.371+0000 7f7849600640 1 -- 172.21.15.59:0/2441510330 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f78400848b0 con 0x7f784c06e900 2024-04-25T09:02:27.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.371+0000 7f7850a00640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f782c066f60 0x7f782c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.371+0000 7f7850a00640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f782c066f60 0x7f782c069420 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f78380ad000 tx=0x7f78380a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.375+0000 7f7849600640 1 -- 172.21.15.59:0/2441510330 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7840055470 con 0x7f784c06e900 2024-04-25T09:02:27.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.535+0000 7f7853e00640 1 -- 172.21.15.59:0/2441510330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f784c15f9e0 con 0x7f784c06e900 2024-04-25T09:02:27.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.535+0000 7f7849600640 1 -- 172.21.15.59:0/2441510330 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f7840054d70 con 0x7f784c06e900 2024-04-25T09:02:27.528 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:27.528 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:08.938626+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.539+0000 7f7853e00640 1 -- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f782c066f60 msgr2=0x7f782c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.539+0000 7f7853e00640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f782c066f60 0x7f782c069420 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f78380ad000 tx=0x7f78380a6000 comp rx=0 tx=0).stop 2024-04-25T09:02:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.539+0000 7f7853e00640 1 -- 172.21.15.59:0/2441510330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c06e900 msgr2=0x7f784c162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.539+0000 7f7853e00640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c06e900 0x7f784c162950 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f784000c430 tx=0x7f784000c8f0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.539+0000 7f7853e00640 1 -- 172.21.15.59:0/2441510330 shutdown_connections 2024-04-25T09:02:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.539+0000 7f7853e00640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f782c066f60 0x7f782c069420 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.539+0000 7f7853e00640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f784c144140 0x7f784c15e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.539+0000 7f7853e00640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f784c0cef30 0x7f784c1643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.539+0000 7f7853e00640 1 --2- 172.21.15.59:0/2441510330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f784c06e900 0x7f784c162950 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.539+0000 7f7853e00640 1 -- 172.21.15.59:0/2441510330 >> 172.21.15.59:0/2441510330 conn(0x7f784c066fa0 msgr2=0x7f784c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.539+0000 7f7853e00640 1 -- 172.21.15.59:0/2441510330 shutdown_connections 2024-04-25T09:02:27.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.539+0000 7f7853e00640 1 -- 172.21.15.59:0/2441510330 wait complete. 2024-04-25T09:02:27.550 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:01:25.852302+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:01:27.174274+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T09:01:30.844655+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T09:02:27.550 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d79600640 1 Processor -- start 2024-04-25T09:02:27.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d79600640 1 -- start start 2024-04-25T09:02:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d79600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d7415e770 0x7f8d7415eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d79600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8d7406d2d0 0x7f8d7415f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d79600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d74071270 0x7f8d740716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d79600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7415f090 con 0x7f8d7415e770 2024-04-25T09:02:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d79600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d74071c20 con 0x7f8d7406d2d0 2024-04-25T09:02:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d79600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7406db20 con 0x7f8d74071270 2024-04-25T09:02:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d72a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d7415e770 0x7f8d7415eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d72a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d7415e770 0x7f8d7415eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55564/0 (socket says 172.21.15.59:55564) 2024-04-25T09:02:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d72a00640 1 -- 172.21.15.59:0/3839630767 learned_addr learned my addr 172.21.15.59:0/3839630767 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d73400640 1 --2- 172.21.15.59:0/3839630767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d74071270 0x7f8d740716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d6a000640 1 --2- 172.21.15.59:0/3839630767 >> v2:172.21.15.178:3300/0 conn(0x7f8d7406d2d0 0x7f8d7415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d72a00640 1 -- 172.21.15.59:0/3839630767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d74071270 msgr2=0x7f8d740716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d72a00640 1 --2- 172.21.15.59:0/3839630767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d74071270 0x7f8d740716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d72a00640 1 -- 172.21.15.59:0/3839630767 >> v2:172.21.15.178:3300/0 conn(0x7f8d7406d2d0 msgr2=0x7f8d7415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:27.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d72a00640 1 --2- 172.21.15.59:0/3839630767 >> v2:172.21.15.178:3300/0 conn(0x7f8d7406d2d0 0x7f8d7415f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d72a00640 1 -- 172.21.15.59:0/3839630767 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7406de00 con 0x7f8d7415e770 2024-04-25T09:02:27.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.703+0000 7f8d73400640 1 --2- 172.21.15.59:0/3839630767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d74071270 0x7f8d740716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:27.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d72a00640 1 --2- 172.21.15.59:0/3839630767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7415e770 0x7f8d7415eb50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8d7406ba80 tx=0x7f8d6401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d5ea111e9fc3a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d72000640 1 -- 172.21.15.59:0/3839630767 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d640ab650 con 0x7f8d7415e770 2024-04-25T09:02:27.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d72000640 1 -- 172.21.15.59:0/3839630767 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d640b0070 con 0x7f8d7415e770 2024-04-25T09:02:27.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d72000640 1 -- 172.21.15.59:0/3839630767 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d640aba10 con 0x7f8d7415e770 2024-04-25T09:02:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d79600640 1 -- 172.21.15.59:0/3839630767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7415e770 msgr2=0x7f8d7415eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d79600640 1 --2- 172.21.15.59:0/3839630767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7415e770 0x7f8d7415eb50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8d7406ba80 tx=0x7f8d6401c490 comp rx=0 tx=0).stop 2024-04-25T09:02:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d79600640 1 -- 172.21.15.59:0/3839630767 shutdown_connections 2024-04-25T09:02:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d79600640 1 --2- 172.21.15.59:0/3839630767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d74071270 0x7f8d740716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d79600640 1 --2- 172.21.15.59:0/3839630767 >> v2:172.21.15.178:3300/0 conn(0x7f8d7406d2d0 0x7f8d7415f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d79600640 1 --2- 172.21.15.59:0/3839630767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7415e770 0x7f8d7415eb50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d79600640 1 -- 172.21.15.59:0/3839630767 >> 172.21.15.59:0/3839630767 conn(0x7f8d74067080 msgr2=0x7f8d7406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d79600640 1 -- 172.21.15.59:0/3839630767 shutdown_connections 2024-04-25T09:02:27.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d79600640 1 -- 172.21.15.59:0/3839630767 wait complete. 2024-04-25T09:02:27.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.707+0000 7f8d79600640 1 Processor -- start 2024-04-25T09:02:27.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d79600640 1 -- start start 2024-04-25T09:02:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d79600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d7406d2d0 0x7f8d74152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d79600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d74071270 0x7f8d7413bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d79600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7415e770 0x7f8d7414b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d79600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7406d6e0 con 0x7f8d7415e770 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d79600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7415f770 con 0x7f8d7406d2d0 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d79600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7406d860 con 0x7f8d74071270 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d73400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7415e770 0x7f8d7414b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d73400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7415e770 0x7f8d7414b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55578/0 (socket says 172.21.15.59:55578) 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d73400640 1 -- 172.21.15.59:0/1164326098 learned_addr learned my addr 172.21.15.59:0/1164326098 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d72a00640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d7406d2d0 0x7f8d74152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d6a000640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d74071270 0x7f8d7413bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d73400640 1 -- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d74071270 msgr2=0x7f8d7413bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d73400640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d74071270 0x7f8d7413bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d73400640 1 -- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d7406d2d0 msgr2=0x7f8d74152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d73400640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d7406d2d0 0x7f8d74152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d73400640 1 -- 172.21.15.59:0/1164326098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7413c190 con 0x7f8d7415e770 2024-04-25T09:02:27.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d72a00640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d7406d2d0 0x7f8d74152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:27.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d73400640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7415e770 0x7f8d7414b930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c007e70 tx=0x7f8d6c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d6b400640 1 -- 172.21.15.59:0/1164326098 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c01a070 con 0x7f8d7415e770 2024-04-25T09:02:27.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d6b400640 1 -- 172.21.15.59:0/1164326098 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c003bc0 con 0x7f8d7415e770 2024-04-25T09:02:27.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d79600640 1 -- 172.21.15.59:0/1164326098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7414ad20 con 0x7f8d7415e770 2024-04-25T09:02:27.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d6b400640 1 -- 172.21.15.59:0/1164326098 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c004030 con 0x7f8d7415e770 2024-04-25T09:02:27.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d79600640 1 -- 172.21.15.59:0/1164326098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7414d7e0 con 0x7f8d7415e770 2024-04-25T09:02:27.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.711+0000 7f8d79600640 1 -- 172.21.15.59:0/1164326098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d740745d0 con 0x7f8d7415e770 2024-04-25T09:02:27.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.715+0000 7f8d6b400640 1 -- 172.21.15.59:0/1164326098 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8d6c01d070 con 0x7f8d7415e770 2024-04-25T09:02:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.715+0000 7f8d6b400640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d50066f60 0x7f8d50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.715+0000 7f8d6b400640 1 -- 172.21.15.59:0/1164326098 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f8d6c085650 con 0x7f8d7415e770 2024-04-25T09:02:27.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.715+0000 7f8d72a00640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d50066f60 0x7f8d50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:27.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.715+0000 7f8d72a00640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d50066f60 0x7f8d50069420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d640af000 tx=0x7f8d640a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:27.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.719+0000 7f8d6b400640 1 -- 172.21.15.59:0/1164326098 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8d6c010070 con 0x7f8d7415e770 2024-04-25T09:02:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 -- 172.21.15.59:0/1164326098 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d7415ee70 con 0x7f8d7415e770 2024-04-25T09:02:27.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d6b400640 1 -- 172.21.15.59:0/1164326098 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d6c056210 con 0x7f8d7415e770 2024-04-25T09:02:27.870 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:02:27.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 -- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d50066f60 msgr2=0x7f8d50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d50066f60 0x7f8d50069420 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d640af000 tx=0x7f8d640a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:27.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 -- 172.21.15.59:0/1164326098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7415e770 msgr2=0x7f8d7414b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:27.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7415e770 0x7f8d7414b930 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c007e70 tx=0x7f8d6c00d4a0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 -- 172.21.15.59:0/1164326098 shutdown_connections 2024-04-25T09:02:27.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d50066f60 0x7f8d50069420 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7415e770 0x7f8d7414b930 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d74071270 0x7f8d7413bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 --2- 172.21.15.59:0/1164326098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d7406d2d0 0x7f8d74152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 -- 172.21.15.59:0/1164326098 >> 172.21.15.59:0/1164326098 conn(0x7f8d74067080 msgr2=0x7f8d74159040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 -- 172.21.15.59:0/1164326098 shutdown_connections 2024-04-25T09:02:27.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:27.879+0000 7f8d79600640 1 -- 172.21.15.59:0/1164326098 wait complete. 2024-04-25T09:02:27.891 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:02:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4214400640 1 Processor -- start 2024-04-25T09:02:28.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4214400640 1 -- start start 2024-04-25T09:02:28.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4214400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f420c15c9b0 0x7f420c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4214400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f420c06e010 0x7f420c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4214400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f420c15fc00 con 0x7f420c159320 2024-04-25T09:02:28.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4214400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420c06d640 con 0x7f420c06e010 2024-04-25T09:02:28.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4214400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c15fee0 con 0x7f420c15c9b0 2024-04-25T09:02:28.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4211a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f420c159320 0x7f420c15f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52390/0 (socket says 172.21.15.59:52390) 2024-04-25T09:02:28.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4211a00640 1 -- 172.21.15.59:0/2951832451 learned_addr learned my addr 172.21.15.59:0/2951832451 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:28.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4212400640 1 --2- 172.21.15.59:0/2951832451 >> v2:172.21.15.178:3300/0 conn(0x7f420c06e010 0x7f420c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4211000640 1 --2- 172.21.15.59:0/2951832451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f420c15c9b0 0x7f420c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f420be00640 1 -- 172.21.15.59:0/2951832451 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1887270294 0 0) 0x7f420c15fc00 con 0x7f420c159320 2024-04-25T09:02:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f420be00640 1 -- 172.21.15.59:0/2951832451 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41f4003530 con 0x7f420c159320 2024-04-25T09:02:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4211000640 1 -- 172.21.15.59:0/2951832451 >> v2:172.21.15.178:3300/0 conn(0x7f420c06e010 msgr2=0x7f420c06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4211000640 1 --2- 172.21.15.59:0/2951832451 >> v2:172.21.15.178:3300/0 conn(0x7f420c06e010 0x7f420c06e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4211000640 1 -- 172.21.15.59:0/2951832451 >> v1:172.21.15.59:6789/0 conn(0x7f420c159320 legacy=0x7f420c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.047+0000 7f4211000640 1 -- 172.21.15.59:0/2951832451 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c1601c0 con 0x7f420c15c9b0 2024-04-25T09:02:28.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.051+0000 7f4211000640 1 --2- 172.21.15.59:0/2951832451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f420c15c9b0 0x7f420c06dad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41f80097c0 tx=0x7f41f801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d1103103b7dcabe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.051+0000 7f420be00640 1 -- 172.21.15.59:0/2951832451 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f80b0070 con 0x7f420c15c9b0 2024-04-25T09:02:28.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.051+0000 7f420be00640 1 -- 172.21.15.59:0/2951832451 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f80ab600 con 0x7f420c15c9b0 2024-04-25T09:02:28.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.051+0000 7f420be00640 1 -- 172.21.15.59:0/2951832451 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f80ab9d0 con 0x7f420c15c9b0 2024-04-25T09:02:28.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.051+0000 7f4214400640 1 -- 172.21.15.59:0/2951832451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f420c15c9b0 msgr2=0x7f420c06dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.051+0000 7f4214400640 1 --2- 172.21.15.59:0/2951832451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f420c15c9b0 0x7f420c06dad0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f41f80097c0 tx=0x7f41f801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.051+0000 7f4214400640 1 -- 172.21.15.59:0/2951832451 shutdown_connections 2024-04-25T09:02:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.051+0000 7f4214400640 1 --2- 172.21.15.59:0/2951832451 >> v2:172.21.15.178:3300/0 conn(0x7f420c06e010 0x7f420c06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.051+0000 7f4214400640 1 --2- 172.21.15.59:0/2951832451 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f420c15c9b0 0x7f420c06dad0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.051+0000 7f4214400640 1 -- 172.21.15.59:0/2951832451 >> 172.21.15.59:0/2951832451 conn(0x7f420c067080 msgr2=0x7f420c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.051+0000 7f4214400640 1 -- 172.21.15.59:0/2951832451 shutdown_connections 2024-04-25T09:02:28.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.051+0000 7f4214400640 1 -- 172.21.15.59:0/2951832451 wait complete. 2024-04-25T09:02:28.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4214400640 1 Processor -- start 2024-04-25T09:02:28.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4214400640 1 -- start start 2024-04-25T09:02:28.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4214400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f420c06e010 0x7f420c158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4214400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c159320 0x7f420c12e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4214400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f420c15c9b0 0x7f420c0b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4214400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c168920 con 0x7f420c159320 2024-04-25T09:02:28.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4214400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420c1687a0 con 0x7f420c15c9b0 2024-04-25T09:02:28.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4214400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420c168aa0 con 0x7f420c06e010 2024-04-25T09:02:28.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4211000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c159320 0x7f420c12e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4211000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c159320 0x7f420c12e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55582/0 (socket says 172.21.15.59:55582) 2024-04-25T09:02:28.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4211000640 1 -- 172.21.15.59:0/3586249809 learned_addr learned my addr 172.21.15.59:0/3586249809 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:28.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4211a00640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f420c06e010 0x7f420c158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4212400640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f420c15c9b0 0x7f420c0b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4211000640 1 -- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f420c06e010 msgr2=0x7f420c158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4211000640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f420c06e010 0x7f420c158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4211000640 1 -- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f420c15c9b0 msgr2=0x7f420c0b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4211000640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f420c15c9b0 0x7f420c0b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4211000640 1 -- 172.21.15.59:0/3586249809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c12ead0 con 0x7f420c159320 2024-04-25T09:02:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4211000640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c159320 0x7f420c12e590 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f41f80190b0 tx=0x7f41f8019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4209600640 1 -- 172.21.15.59:0/3586249809 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f80b0040 con 0x7f420c159320 2024-04-25T09:02:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4209600640 1 -- 172.21.15.59:0/3586249809 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f80ba070 con 0x7f420c159320 2024-04-25T09:02:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4209600640 1 -- 172.21.15.59:0/3586249809 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f80b4840 con 0x7f420c159320 2024-04-25T09:02:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4214400640 1 -- 172.21.15.59:0/3586249809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f420c0b1d60 con 0x7f420c159320 2024-04-25T09:02:28.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.055+0000 7f4214400640 1 -- 172.21.15.59:0/3586249809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f420c12dd90 con 0x7f420c159320 2024-04-25T09:02:28.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.059+0000 7f4214400640 1 -- 172.21.15.59:0/3586249809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420c0745d0 con 0x7f420c159320 2024-04-25T09:02:28.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.059+0000 7f4209600640 1 -- 172.21.15.59:0/3586249809 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f41f80b3070 con 0x7f420c159320 2024-04-25T09:02:28.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.059+0000 7f4209600640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f41ec066f60 0x7f41ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.059+0000 7f4209600640 1 -- 172.21.15.59:0/3586249809 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f41f811ed50 con 0x7f420c159320 2024-04-25T09:02:28.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.059+0000 7f4211a00640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f41ec066f60 0x7f41ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.059+0000 7f4211a00640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f41ec066f60 0x7f41ec069420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4200005890 tx=0x7f4200009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.063+0000 7f4209600640 1 -- 172.21.15.59:0/3586249809 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f420c12ead0 con 0x7f420c159320 2024-04-25T09:02:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 -- 172.21.15.59:0/3586249809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f420c140750 con 0x7f420c159320 2024-04-25T09:02:28.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4209600640 1 -- 172.21.15.59:0/3586249809 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f41f8016090 con 0x7f420c159320 2024-04-25T09:02:28.219 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:28.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 -- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f41ec066f60 msgr2=0x7f41ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f41ec066f60 0x7f41ec069420 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4200005890 tx=0x7f4200009040 comp rx=0 tx=0).stop 2024-04-25T09:02:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 -- 172.21.15.59:0/3586249809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c159320 msgr2=0x7f420c12e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c159320 0x7f420c12e590 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f41f80190b0 tx=0x7f41f8019240 comp rx=0 tx=0).stop 2024-04-25T09:02:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 -- 172.21.15.59:0/3586249809 shutdown_connections 2024-04-25T09:02:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f41ec066f60 0x7f41ec069420 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f420c15c9b0 0x7f420c0b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f420c159320 0x7f420c12e590 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 --2- 172.21.15.59:0/3586249809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f420c06e010 0x7f420c158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 -- 172.21.15.59:0/3586249809 >> 172.21.15.59:0/3586249809 conn(0x7f420c067080 msgr2=0x7f420c13f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 -- 172.21.15.59:0/3586249809 shutdown_connections 2024-04-25T09:02:28.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.227+0000 7f4214400640 1 -- 172.21.15.59:0/3586249809 wait complete. 2024-04-25T09:02:28.240 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:02:28.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.391+0000 7ffb87200640 1 Processor -- start 2024-04-25T09:02:28.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.391+0000 7ffb87200640 1 -- start start 2024-04-25T09:02:28.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb87200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb8015f3d0 0x7ffb800b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb87200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffb800b1fb0 0x7ffb8015f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb87200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb800b2440 0x7ffb8015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb87200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb800d0580 con 0x7ffb8015f3d0 2024-04-25T09:02:28.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb87200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb800cfce0 con 0x7ffb800b1fb0 2024-04-25T09:02:28.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb87200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800cffc0 con 0x7ffb800b2440 2024-04-25T09:02:28.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb85e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb8015f3d0 0x7ffb800b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb85e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb8015f3d0 0x7ffb800b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55594/0 (socket says 172.21.15.59:55594) 2024-04-25T09:02:28.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb85e00640 1 -- 172.21.15.59:0/1304908810 learned_addr learned my addr 172.21.15.59:0/1304908810 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:28.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb86800640 1 --2- 172.21.15.59:0/1304908810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb800b2440 0x7ffb8015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb85400640 1 --2- 172.21.15.59:0/1304908810 >> v2:172.21.15.178:3300/0 conn(0x7ffb800b1fb0 0x7ffb8015f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb85e00640 1 -- 172.21.15.59:0/1304908810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb800b2440 msgr2=0x7ffb8015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:28.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb85e00640 1 --2- 172.21.15.59:0/1304908810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb800b2440 0x7ffb8015fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb85e00640 1 -- 172.21.15.59:0/1304908810 >> v2:172.21.15.178:3300/0 conn(0x7ffb800b1fb0 msgr2=0x7ffb8015f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:28.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb85e00640 1 --2- 172.21.15.59:0/1304908810 >> v2:172.21.15.178:3300/0 conn(0x7ffb800b1fb0 0x7ffb8015f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.395+0000 7ffb85e00640 1 -- 172.21.15.59:0/1304908810 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800d02a0 con 0x7ffb8015f3d0 2024-04-25T09:02:28.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb85e00640 1 --2- 172.21.15.59:0/1304908810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8015f3d0 0x7ffb800b0c30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffb80073350 tx=0x7ffb7401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483d8ea8e1cd088d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb84a00640 1 -- 172.21.15.59:0/1304908810 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740b0070 con 0x7ffb8015f3d0 2024-04-25T09:02:28.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb84a00640 1 -- 172.21.15.59:0/1304908810 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb740ab600 con 0x7ffb8015f3d0 2024-04-25T09:02:28.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb84a00640 1 -- 172.21.15.59:0/1304908810 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb740ab9d0 con 0x7ffb8015f3d0 2024-04-25T09:02:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 -- 172.21.15.59:0/1304908810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8015f3d0 msgr2=0x7ffb800b0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 --2- 172.21.15.59:0/1304908810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8015f3d0 0x7ffb800b0c30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ffb80073350 tx=0x7ffb7401c490 comp rx=0 tx=0).stop 2024-04-25T09:02:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 -- 172.21.15.59:0/1304908810 shutdown_connections 2024-04-25T09:02:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 --2- 172.21.15.59:0/1304908810 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb800b2440 0x7ffb8015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 --2- 172.21.15.59:0/1304908810 >> v2:172.21.15.178:3300/0 conn(0x7ffb800b1fb0 0x7ffb8015f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 --2- 172.21.15.59:0/1304908810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8015f3d0 0x7ffb800b0c30 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 -- 172.21.15.59:0/1304908810 >> 172.21.15.59:0/1304908810 conn(0x7ffb800d15d0 msgr2=0x7ffb800d19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 -- 172.21.15.59:0/1304908810 shutdown_connections 2024-04-25T09:02:28.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 -- 172.21.15.59:0/1304908810 wait complete. 2024-04-25T09:02:28.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 Processor -- start 2024-04-25T09:02:28.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 -- start start 2024-04-25T09:02:28.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb800b1fb0 0x7ffb801f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb800b2440 0x7ffb8014e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8015f3d0 0x7ffb8006f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb80160230 con 0x7ffb8015f3d0 2024-04-25T09:02:28.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800cc0e0 con 0x7ffb800b2440 2024-04-25T09:02:28.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb87200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800cd140 con 0x7ffb800b1fb0 2024-04-25T09:02:28.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb86800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8015f3d0 0x7ffb8006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb86800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8015f3d0 0x7ffb8006f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55598/0 (socket says 172.21.15.59:55598) 2024-04-25T09:02:28.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb86800640 1 -- 172.21.15.59:0/31652834 learned_addr learned my addr 172.21.15.59:0/31652834 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:28.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb85e00640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb800b1fb0 0x7ffb801f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.399+0000 7ffb85400640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb800b2440 0x7ffb8014e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb86800640 1 -- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb800b1fb0 msgr2=0x7ffb801f8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb86800640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb800b1fb0 0x7ffb801f8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb86800640 1 -- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb800b2440 msgr2=0x7ffb8014e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb86800640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb800b2440 0x7ffb8014e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb86800640 1 -- 172.21.15.59:0/31652834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8015cd40 con 0x7ffb8015f3d0 2024-04-25T09:02:28.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb86800640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8015f3d0 0x7ffb8006f910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c007e30 tx=0x7ffb7c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb7a000640 1 -- 172.21.15.59:0/31652834 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c014620 con 0x7ffb8015f3d0 2024-04-25T09:02:28.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb7a000640 1 -- 172.21.15.59:0/31652834 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7c019070 con 0x7ffb8015f3d0 2024-04-25T09:02:28.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb7a000640 1 -- 172.21.15.59:0/31652834 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c014a00 con 0x7ffb8015f3d0 2024-04-25T09:02:28.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb87200640 1 -- 172.21.15.59:0/31652834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8015d020 con 0x7ffb8015f3d0 2024-04-25T09:02:28.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb87200640 1 -- 172.21.15.59:0/31652834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8015d5e0 con 0x7ffb8015f3d0 2024-04-25T09:02:28.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb87200640 1 -- 172.21.15.59:0/31652834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb800745d0 con 0x7ffb8015f3d0 2024-04-25T09:02:28.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb7a000640 1 -- 172.21.15.59:0/31652834 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffb7c014ba0 con 0x7ffb8015f3d0 2024-04-25T09:02:28.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb7a000640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffb64066f60 0x7ffb64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb7a000640 1 -- 172.21.15.59:0/31652834 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7ffb7c085c30 con 0x7ffb8015f3d0 2024-04-25T09:02:28.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.403+0000 7ffb85e00640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffb64066f60 0x7ffb64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.407+0000 7ffb85e00640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffb64066f60 0x7ffb64069420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffb800726a0 tx=0x7ffb74008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.407+0000 7ffb7a000640 1 -- 172.21.15.59:0/31652834 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffb7c056110 con 0x7ffb8015f3d0 2024-04-25T09:02:28.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.571+0000 7ffb87200640 1 -- 172.21.15.59:0/31652834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb800d21f0 con 0x7ffb8015f3d0 2024-04-25T09:02:28.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.571+0000 7ffb7a000640 1 -- 172.21.15.59:0/31652834 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb7c05a1b0 con 0x7ffb8015f3d0 2024-04-25T09:02:28.563 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:02:28.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.575+0000 7ffb87200640 1 -- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffb64066f60 msgr2=0x7ffb64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.575+0000 7ffb87200640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffb64066f60 0x7ffb64069420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffb800726a0 tx=0x7ffb74008040 comp rx=0 tx=0).stop 2024-04-25T09:02:28.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.575+0000 7ffb87200640 1 -- 172.21.15.59:0/31652834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8015f3d0 msgr2=0x7ffb8006f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.575+0000 7ffb87200640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8015f3d0 0x7ffb8006f910 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c007e30 tx=0x7ffb7c00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.575+0000 7ffb87200640 1 -- 172.21.15.59:0/31652834 shutdown_connections 2024-04-25T09:02:28.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.575+0000 7ffb87200640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffb64066f60 0x7ffb64069420 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.575+0000 7ffb87200640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb8015f3d0 0x7ffb8006f910 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.575+0000 7ffb87200640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb800b2440 0x7ffb8014e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.575+0000 7ffb87200640 1 --2- 172.21.15.59:0/31652834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb800b1fb0 0x7ffb801f8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.575+0000 7ffb87200640 1 -- 172.21.15.59:0/31652834 >> 172.21.15.59:0/31652834 conn(0x7ffb800d15d0 msgr2=0x7ffb800afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.575+0000 7ffb87200640 1 -- 172.21.15.59:0/31652834 shutdown_connections 2024-04-25T09:02:28.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.575+0000 7ffb87200640 1 -- 172.21.15.59:0/31652834 wait complete. 2024-04-25T09:02:28.585 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T09:02:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.735+0000 7f7331800640 1 Processor -- start 2024-04-25T09:02:28.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.735+0000 7f7331800640 1 -- start start 2024-04-25T09:02:28.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.739+0000 7f7331800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f732c0cf3c0 0x7f732c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.739+0000 7f7331800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732c0d02a0 con 0x7f732c15b910 2024-04-25T09:02:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.739+0000 7f7331800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f732c0cc350 con 0x7f732c0cd370 2024-04-25T09:02:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.739+0000 7f7331800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732c0cc630 con 0x7f732c0cf3c0 2024-04-25T09:02:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.739+0000 7f732aa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f732c15b910 0x7f732c0cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52404/0 (socket says 172.21.15.59:52404) 2024-04-25T09:02:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.739+0000 7f732aa00640 1 -- 172.21.15.59:0/1945870041 learned_addr learned my addr 172.21.15.59:0/1945870041 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.739+0000 7f7323e00640 1 --2- 172.21.15.59:0/1945870041 >> v2:172.21.15.178:3300/0 conn(0x7f732c0cf3c0 0x7f732c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.739+0000 7f732a000640 1 -- 172.21.15.59:0/1945870041 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1380139621 0 0) 0x7f732c0d02a0 con 0x7f732c15b910 2024-04-25T09:02:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.739+0000 7f732a000640 1 -- 172.21.15.59:0/1945870041 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7310003530 con 0x7f732c15b910 2024-04-25T09:02:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.739+0000 7f7323e00640 1 -- 172.21.15.59:0/1945870041 >> v1:172.21.15.178:6789/0 conn(0x7f732c0cd370 legacy=0x7f732c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.739+0000 7f7323e00640 1 -- 172.21.15.59:0/1945870041 >> v1:172.21.15.59:6789/0 conn(0x7f732c15b910 legacy=0x7f732c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.739+0000 7f7323e00640 1 -- 172.21.15.59:0/1945870041 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c0cc910 con 0x7f732c0cf3c0 2024-04-25T09:02:28.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f7323e00640 1 --2- 172.21.15.59:0/1945870041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732c0cf3c0 0x7f732c0cce30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f73140097c0 tx=0x7f731401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fb55dce396e8dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f732a000640 1 -- 172.21.15.59:0/1945870041 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73140b1070 con 0x7f732c0cf3c0 2024-04-25T09:02:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f732a000640 1 -- 172.21.15.59:0/1945870041 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73140ac410 con 0x7f732c0cf3c0 2024-04-25T09:02:28.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f732a000640 1 -- 172.21.15.59:0/1945870041 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73140ac7e0 con 0x7f732c0cf3c0 2024-04-25T09:02:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f7331800640 1 -- 172.21.15.59:0/1945870041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732c0cf3c0 msgr2=0x7f732c0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f7331800640 1 --2- 172.21.15.59:0/1945870041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732c0cf3c0 0x7f732c0cce30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f73140097c0 tx=0x7f731401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f7331800640 1 -- 172.21.15.59:0/1945870041 shutdown_connections 2024-04-25T09:02:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f7331800640 1 --2- 172.21.15.59:0/1945870041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732c0cf3c0 0x7f732c0cce30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f7331800640 1 -- 172.21.15.59:0/1945870041 >> 172.21.15.59:0/1945870041 conn(0x7f732c0b3200 msgr2=0x7f732c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f7331800640 1 -- 172.21.15.59:0/1945870041 shutdown_connections 2024-04-25T09:02:28.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f7331800640 1 -- 172.21.15.59:0/1945870041 wait complete. 2024-04-25T09:02:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f7331800640 1 Processor -- start 2024-04-25T09:02:28.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.743+0000 7f7331800640 1 -- start start 2024-04-25T09:02:28.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7331800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732c0cd370 0x7f732c15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7331800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f732c0cf3c0 0x7f732c153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7331800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f732c15b910 0x7f732c15d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7331800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c169b30 con 0x7f732c15b910 2024-04-25T09:02:28.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7331800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f732c1699b0 con 0x7f732c0cd370 2024-04-25T09:02:28.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7331800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f732c169cb0 con 0x7f732c0cf3c0 2024-04-25T09:02:28.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f732b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f732c15b910 0x7f732c15d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f732b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f732c15b910 0x7f732c15d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55614/0 (socket says 172.21.15.59:55614) 2024-04-25T09:02:28.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f732b400640 1 -- 172.21.15.59:0/2174652656 learned_addr learned my addr 172.21.15.59:0/2174652656 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f732aa00640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732c0cd370 0x7f732c15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7323e00640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f732c0cf3c0 0x7f732c153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f732b400640 1 -- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f732c0cf3c0 msgr2=0x7f732c153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f732b400640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f732c0cf3c0 0x7f732c153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f732b400640 1 -- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732c0cd370 msgr2=0x7f732c15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f732b400640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732c0cd370 0x7f732c15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f732b400640 1 -- 172.21.15.59:0/2174652656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f732c154090 con 0x7f732c15b910 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7323e00640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f732c0cf3c0 0x7f732c153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f732b400640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f732c15b910 0x7f732c15d890 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f732400c770 tx=0x7f732400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7322a00640 1 -- 172.21.15.59:0/2174652656 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324003b80 con 0x7f732c15b910 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7322a00640 1 -- 172.21.15.59:0/2174652656 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7324003d20 con 0x7f732c15b910 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7331800640 1 -- 172.21.15.59:0/2174652656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f732c15c200 con 0x7f732c15b910 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7322a00640 1 -- 172.21.15.59:0/2174652656 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732400aa90 con 0x7f732c15b910 2024-04-25T09:02:28.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7331800640 1 -- 172.21.15.59:0/2174652656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f732c15c7c0 con 0x7f732c15b910 2024-04-25T09:02:28.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.747+0000 7f7331800640 1 -- 172.21.15.59:0/2174652656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732c0745d0 con 0x7f732c15b910 2024-04-25T09:02:28.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.751+0000 7f7322a00640 1 -- 172.21.15.59:0/2174652656 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f732400ac30 con 0x7f732c15b910 2024-04-25T09:02:28.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.751+0000 7f7322a00640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7308066f90 0x7f7308069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:28.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.751+0000 7f7322a00640 1 -- 172.21.15.59:0/2174652656 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f7324085300 con 0x7f732c15b910 2024-04-25T09:02:28.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.751+0000 7f732aa00640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7308066f90 0x7f7308069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:28.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.751+0000 7f732aa00640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7308066f90 0x7f7308069450 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f731c0011f0 tx=0x7f731c007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:28.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.755+0000 7f7322a00640 1 -- 172.21.15.59:0/2174652656 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7324055ec0 con 0x7f732c15b910 2024-04-25T09:02:28.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.919+0000 7f7331800640 1 -- 172.21.15.59:0/2174652656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f732c0cdcd0 con 0x7f732c15b910 2024-04-25T09:02:28.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.919+0000 7f7322a00640 1 -- 172.21.15.59:0/2174652656 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f73240557c0 con 0x7f732c15b910 2024-04-25T09:02:28.911 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:02:28.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.923+0000 7f7331800640 1 -- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7308066f90 msgr2=0x7f7308069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.923+0000 7f7331800640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7308066f90 0x7f7308069450 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f731c0011f0 tx=0x7f731c007d40 comp rx=0 tx=0).stop 2024-04-25T09:02:28.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.923+0000 7f7331800640 1 -- 172.21.15.59:0/2174652656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f732c15b910 msgr2=0x7f732c15d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.923+0000 7f7331800640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f732c15b910 0x7f732c15d890 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f732400c770 tx=0x7f732400cc30 comp rx=0 tx=0).stop 2024-04-25T09:02:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.923+0000 7f7331800640 1 -- 172.21.15.59:0/2174652656 shutdown_connections 2024-04-25T09:02:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.923+0000 7f7331800640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7308066f90 0x7f7308069450 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.923+0000 7f7331800640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f732c15b910 0x7f732c15d890 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.923+0000 7f7331800640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f732c0cf3c0 0x7f732c153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.923+0000 7f7331800640 1 --2- 172.21.15.59:0/2174652656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f732c0cd370 0x7f732c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.923+0000 7f7331800640 1 -- 172.21.15.59:0/2174652656 >> 172.21.15.59:0/2174652656 conn(0x7f732c0b3200 msgr2=0x7f732c099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.923+0000 7f7331800640 1 -- 172.21.15.59:0/2174652656 shutdown_connections 2024-04-25T09:02:28.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:28.923+0000 7f7331800640 1 -- 172.21.15.59:0/2174652656 wait complete. 2024-04-25T09:02:28.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839e000640 1 Processor -- start 2024-04-25T09:02:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839e000640 1 -- start start 2024-04-25T09:02:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839e000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83981450f0 0x7f83980b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839e000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f83980b3900 0x7f839806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839e000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f839806b150 0x7f83980cbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839e000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839806b5b0 con 0x7f839806b150 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839e000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83980b4a20 con 0x7f83980b3900 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839e000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83981454d0 con 0x7f83981450f0 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839d600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f839806b150 0x7f83980cbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839d600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f839806b150 0x7f83980cbd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55620/0 (socket says 172.21.15.59:55620) 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839d600640 1 -- 172.21.15.59:0/1302975003 learned_addr learned my addr 172.21.15.59:0/1302975003 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f8397e00640 1 --2- 172.21.15.59:0/1302975003 >> v2:172.21.15.178:3300/0 conn(0x7f83980b3900 0x7f839806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839cc00640 1 --2- 172.21.15.59:0/1302975003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83981450f0 0x7f83980b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839d600640 1 -- 172.21.15.59:0/1302975003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83981450f0 msgr2=0x7f83980b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839d600640 1 --2- 172.21.15.59:0/1302975003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83981450f0 0x7f83980b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839d600640 1 -- 172.21.15.59:0/1302975003 >> v2:172.21.15.178:3300/0 conn(0x7f83980b3900 msgr2=0x7f839806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839d600640 1 --2- 172.21.15.59:0/1302975003 >> v2:172.21.15.178:3300/0 conn(0x7f83980b3900 0x7f839806ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.087+0000 7f839d600640 1 -- 172.21.15.59:0/1302975003 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83980b3e10 con 0x7f839806b150 2024-04-25T09:02:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f839d600640 1 --2- 172.21.15.59:0/1302975003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839806b150 0x7f83980cbd60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8398071bd0 tx=0x7f839001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97b3b4bccfa257b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f8397400640 1 -- 172.21.15.59:0/1302975003 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83900a5840 con 0x7f839806b150 2024-04-25T09:02:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f8397400640 1 -- 172.21.15.59:0/1302975003 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83900a59e0 con 0x7f839806b150 2024-04-25T09:02:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f8397400640 1 -- 172.21.15.59:0/1302975003 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83900a5db0 con 0x7f839806b150 2024-04-25T09:02:29.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f839e000640 1 -- 172.21.15.59:0/1302975003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839806b150 msgr2=0x7f83980cbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f839e000640 1 --2- 172.21.15.59:0/1302975003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839806b150 0x7f83980cbd60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8398071bd0 tx=0x7f839001c9c0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f839e000640 1 -- 172.21.15.59:0/1302975003 shutdown_connections 2024-04-25T09:02:29.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f839e000640 1 --2- 172.21.15.59:0/1302975003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f839806b150 0x7f83980cbd60 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f839e000640 1 --2- 172.21.15.59:0/1302975003 >> v2:172.21.15.178:3300/0 conn(0x7f83980b3900 0x7f839806ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f839e000640 1 --2- 172.21.15.59:0/1302975003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83981450f0 0x7f83980b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f839e000640 1 -- 172.21.15.59:0/1302975003 >> 172.21.15.59:0/1302975003 conn(0x7f8398099a60 msgr2=0x7f83980b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f839e000640 1 -- 172.21.15.59:0/1302975003 shutdown_connections 2024-04-25T09:02:29.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.091+0000 7f839e000640 1 -- 172.21.15.59:0/1302975003 wait complete. 2024-04-25T09:02:29.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839e000640 1 Processor -- start 2024-04-25T09:02:29.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839e000640 1 -- start start 2024-04-25T09:02:29.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839e000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f839806b150 0x7f8398141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839e000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83980b3900 0x7f83981606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83981450f0 0x7f83981612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980cd1b0 con 0x7f83981450f0 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839e000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980cd030 con 0x7f83980b3900 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839e000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83980b4e90 con 0x7f839806b150 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83981450f0 0x7f83981612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83981450f0 0x7f83981612b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55622/0 (socket says 172.21.15.59:55622) 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839d600640 1 -- 172.21.15.59:0/3526663885 learned_addr learned my addr 172.21.15.59:0/3526663885 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839cc00640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f839806b150 0x7f8398141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f8397e00640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83980b3900 0x7f83981606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839d600640 1 -- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f839806b150 msgr2=0x7f8398141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839d600640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f839806b150 0x7f8398141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839d600640 1 -- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83980b3900 msgr2=0x7f83981606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839d600640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83980b3900 0x7f83981606c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839d600640 1 -- 172.21.15.59:0/3526663885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83981619b0 con 0x7f83981450f0 2024-04-25T09:02:29.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839cc00640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f839806b150 0x7f8398141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:29.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839d600640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83981450f0 0x7f83981612b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f83900af040 tx=0x7f8390019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f8394c00640 1 -- 172.21.15.59:0/3526663885 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83900b8880 con 0x7f83981450f0 2024-04-25T09:02:29.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f8394c00640 1 -- 172.21.15.59:0/3526663885 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83900be070 con 0x7f83981450f0 2024-04-25T09:02:29.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f8394c00640 1 -- 172.21.15.59:0/3526663885 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83900b8c80 con 0x7f83981450f0 2024-04-25T09:02:29.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839e000640 1 -- 172.21.15.59:0/3526663885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8398161c90 con 0x7f83981450f0 2024-04-25T09:02:29.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839e000640 1 -- 172.21.15.59:0/3526663885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83980ceaa0 con 0x7f83981450f0 2024-04-25T09:02:29.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.095+0000 7f839e000640 1 -- 172.21.15.59:0/3526663885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f839804efa0 con 0x7f83981450f0 2024-04-25T09:02:29.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.099+0000 7f8394c00640 1 -- 172.21.15.59:0/3526663885 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f83900c3460 con 0x7f83981450f0 2024-04-25T09:02:29.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.099+0000 7f8394c00640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8378066f90 0x7f8378069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.099+0000 7f8394c00640 1 -- 172.21.15.59:0/3526663885 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f8390120970 con 0x7f83981450f0 2024-04-25T09:02:29.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.099+0000 7f839cc00640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8378066f90 0x7f8378069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.099+0000 7f839cc00640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8378066f90 0x7f8378069450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f839815f1a0 tx=0x7f838c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.103+0000 7f8394c00640 1 -- 172.21.15.59:0/3526663885 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f83900165e0 con 0x7f83981450f0 2024-04-25T09:02:29.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 -- 172.21.15.59:0/3526663885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83981445c0 con 0x7f83981450f0 2024-04-25T09:02:29.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f8394c00640 1 -- 172.21.15.59:0/3526663885 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f83900f1660 con 0x7f83981450f0 2024-04-25T09:02:29.290 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:29.290 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2167197221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2167197221},{"type":"v1","addr":"172.21.15.59:6834","nonce":2167197221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2689387181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2689387181},{"type":"v1","addr":"172.21.15.178:6837","nonce":2689387181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1461695991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1461695991},{"type":"v1","addr":"172.21.15.59:6835","nonce":1461695991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:28.177275+0000","modified":"2024-04-25T09:01:46.237549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/3239224017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3239224017},{"type":"v1","addr":"172.21.15.178:6836","nonce":3239224017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:02:29.290 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2024-04-25T09:02:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 -- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8378066f90 msgr2=0x7f8378069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8378066f90 0x7f8378069450 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f839815f1a0 tx=0x7f838c008040 comp rx=0 tx=0).stop 2024-04-25T09:02:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 -- 172.21.15.59:0/3526663885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83981450f0 msgr2=0x7f83981612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83981450f0 0x7f83981612b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f83900af040 tx=0x7f8390019760 comp rx=0 tx=0).stop 2024-04-25T09:02:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 -- 172.21.15.59:0/3526663885 shutdown_connections 2024-04-25T09:02:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8378066f90 0x7f8378069450 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83981450f0 0x7f83981612b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83980b3900 0x7f83981606c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 --2- 172.21.15.59:0/3526663885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f839806b150 0x7f8398141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 -- 172.21.15.59:0/3526663885 >> 172.21.15.59:0/3526663885 conn(0x7f8398099a60 msgr2=0x7f83980cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 -- 172.21.15.59:0/3526663885 shutdown_connections 2024-04-25T09:02:29.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.299+0000 7f839e000640 1 -- 172.21.15.59:0/3526663885 wait complete. 2024-04-25T09:02:29.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.459+0000 7ff207c00640 1 Processor -- start 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.459+0000 7ff207c00640 1 -- start start 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff207c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2000cf370 0x7ff200099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff207c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff20009a380 con 0x7ff200099a60 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff207c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2000cf800 con 0x7ff20009a600 2024-04-25T09:02:29.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff207c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2000d0410 con 0x7ff2000cf370 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff1f7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff2000cf370 0x7ff200099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff205200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff200099a60 0x7ff20015bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52412/0 (socket says 172.21.15.59:52412) 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff205200640 1 -- 172.21.15.59:0/2737781835 learned_addr learned my addr 172.21.15.59:0/2737781835 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff1f7e00640 1 -- 172.21.15.59:0/2737781835 >> v1:172.21.15.178:6789/0 conn(0x7ff20009a600 legacy=0x7ff2000cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff1f7e00640 1 -- 172.21.15.59:0/2737781835 >> v1:172.21.15.59:6789/0 conn(0x7ff200099a60 legacy=0x7ff20015bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff1f7e00640 1 -- 172.21.15.59:0/2737781835 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2000cfae0 con 0x7ff2000cf370 2024-04-25T09:02:29.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff1ffe00640 1 -- 172.21.15.59:0/2737781835 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1708223280 0 0) 0x7ff20009a380 con 0x7ff200099a60 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff1f7e00640 1 --2- 172.21.15.59:0/2737781835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2000cf370 0x7ff200099e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80097c0 tx=0x7ff1e801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e129857757b452 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff1ffe00640 1 -- 172.21.15.59:0/2737781835 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80b1070 con 0x7ff2000cf370 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff1ffe00640 1 -- 172.21.15.59:0/2737781835 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e80ac600 con 0x7ff2000cf370 2024-04-25T09:02:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.463+0000 7ff1ffe00640 1 -- 172.21.15.59:0/2737781835 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e80ac9d0 con 0x7ff2000cf370 2024-04-25T09:02:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 -- 172.21.15.59:0/2737781835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2000cf370 msgr2=0x7ff200099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 --2- 172.21.15.59:0/2737781835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2000cf370 0x7ff200099e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80097c0 tx=0x7ff1e801c3a0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 -- 172.21.15.59:0/2737781835 shutdown_connections 2024-04-25T09:02:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 --2- 172.21.15.59:0/2737781835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2000cf370 0x7ff200099e40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 -- 172.21.15.59:0/2737781835 >> 172.21.15.59:0/2737781835 conn(0x7ff2000d17a0 msgr2=0x7ff2000d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 -- 172.21.15.59:0/2737781835 shutdown_connections 2024-04-25T09:02:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 -- 172.21.15.59:0/2737781835 wait complete. 2024-04-25T09:02:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 Processor -- start 2024-04-25T09:02:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 -- start start 2024-04-25T09:02:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff200099a60 0x7ff2000c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff20009a600 0x7ff2001669d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2001527b0 0x7ff200152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2000cd5e0 con 0x7ff200099a60 2024-04-25T09:02:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2000cd460 con 0x7ff20009a600 2024-04-25T09:02:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff207c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff200169860 con 0x7ff2001527b0 2024-04-25T09:02:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff205200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff200099a60 0x7ff2000c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff205200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff200099a60 0x7ff2000c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55640/0 (socket says 172.21.15.59:55640) 2024-04-25T09:02:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff205200640 1 -- 172.21.15.59:0/2053874377 learned_addr learned my addr 172.21.15.59:0/2053874377 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff1f7e00640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff20009a600 0x7ff2001669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff205c00640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2001527b0 0x7ff200152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff205200640 1 -- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2001527b0 msgr2=0x7ff200152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff205200640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2001527b0 0x7ff200152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff205200640 1 -- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff20009a600 msgr2=0x7ff2001669d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff205200640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff20009a600 0x7ff2001669d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff205200640 1 -- 172.21.15.59:0/2053874377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff200156850 con 0x7ff200099a60 2024-04-25T09:02:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff1f7e00640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff20009a600 0x7ff2001669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:29.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.467+0000 7ff205c00640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2001527b0 0x7ff200152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.471+0000 7ff205200640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff200099a60 0x7ff2000c93f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00011f0 tx=0x7ff1f000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.471+0000 7ff1fd600640 1 -- 172.21.15.59:0/2053874377 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0018070 con 0x7ff200099a60 2024-04-25T09:02:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.471+0000 7ff1fd600640 1 -- 172.21.15.59:0/2053874377 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f00074e0 con 0x7ff200099a60 2024-04-25T09:02:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.471+0000 7ff1fd600640 1 -- 172.21.15.59:0/2053874377 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f0004a10 con 0x7ff200099a60 2024-04-25T09:02:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.471+0000 7ff207c00640 1 -- 172.21.15.59:0/2053874377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2000c8910 con 0x7ff200099a60 2024-04-25T09:02:29.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.471+0000 7ff207c00640 1 -- 172.21.15.59:0/2053874377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2000c8ed0 con 0x7ff200099a60 2024-04-25T09:02:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.471+0000 7ff207c00640 1 -- 172.21.15.59:0/2053874377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2000745d0 con 0x7ff200099a60 2024-04-25T09:02:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.471+0000 7ff1fd600640 1 -- 172.21.15.59:0/2053874377 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff1f0004bb0 con 0x7ff200099a60 2024-04-25T09:02:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.471+0000 7ff1fd600640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1dc066f60 0x7ff1dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.471+0000 7ff1fd600640 1 -- 172.21.15.59:0/2053874377 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7ff1f00848e0 con 0x7ff200099a60 2024-04-25T09:02:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.471+0000 7ff1f7e00640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1dc066f60 0x7ff1dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.475+0000 7ff1f7e00640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1dc066f60 0x7ff1dc069420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80ae000 tx=0x7ff1e80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.475+0000 7ff1fd600640 1 -- 172.21.15.59:0/2053874377 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff1f0055410 con 0x7ff200099a60 2024-04-25T09:02:29.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.639+0000 7ff207c00640 1 -- 172.21.15.59:0/2053874377 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2000d2620 con 0x7ff200099a60 2024-04-25T09:02:29.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.639+0000 7ff1fd600640 1 -- 172.21.15.59:0/2053874377 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18938 (secure 0 0 0) 0x7ff1f0054d10 con 0x7ff200099a60 2024-04-25T09:02:29.632 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:29.632 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:08.938626+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.643+0000 7ff207c00640 1 -- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1dc066f60 msgr2=0x7ff1dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.643+0000 7ff207c00640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1dc066f60 0x7ff1dc069420 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff1e80ae000 tx=0x7ff1e80a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.643+0000 7ff207c00640 1 -- 172.21.15.59:0/2053874377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff200099a60 msgr2=0x7ff2000c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.643+0000 7ff207c00640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff200099a60 0x7ff2000c93f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff1f00011f0 tx=0x7ff1f000c9b0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.643+0000 7ff207c00640 1 -- 172.21.15.59:0/2053874377 shutdown_connections 2024-04-25T09:02:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.643+0000 7ff207c00640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1dc066f60 0x7ff1dc069420 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.643+0000 7ff207c00640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2001527b0 0x7ff200152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.643+0000 7ff207c00640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff20009a600 0x7ff2001669d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.643+0000 7ff207c00640 1 --2- 172.21.15.59:0/2053874377 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff200099a60 0x7ff2000c93f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.643+0000 7ff207c00640 1 -- 172.21.15.59:0/2053874377 >> 172.21.15.59:0/2053874377 conn(0x7ff2000d17a0 msgr2=0x7ff2000b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.643+0000 7ff207c00640 1 -- 172.21.15.59:0/2053874377 shutdown_connections 2024-04-25T09:02:29.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.643+0000 7ff207c00640 1 -- 172.21.15.59:0/2053874377 wait complete. 2024-04-25T09:02:29.653 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:02:29.654 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:29.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e75a00640 1 Processor -- start 2024-04-25T09:02:29.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e75a00640 1 -- start start 2024-04-25T09:02:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e75a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e7015dad0 0x7f6e701621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e75a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e700d0e80 0x7f6e700d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e75a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e700ce810 con 0x7f6e7015deb0 2024-04-25T09:02:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e75a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e700d1be0 con 0x7f6e7015dad0 2024-04-25T09:02:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e75a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e70162720 con 0x7f6e700d0e80 2024-04-25T09:02:29.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e6ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e7015dad0 0x7f6e701621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e67e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6e7015deb0 0x7f6e700d0770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52418/0 (socket says 172.21.15.59:52418) 2024-04-25T09:02:29.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e67e00640 1 -- 172.21.15.59:0/2244071207 learned_addr learned my addr 172.21.15.59:0/2244071207 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:29.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e6f400640 1 --2- 172.21.15.59:0/2244071207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e700d0e80 0x7f6e700d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e6ea00640 1 -- 172.21.15.59:0/2244071207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e700d0e80 msgr2=0x7f6e700d2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e6ea00640 1 --2- 172.21.15.59:0/2244071207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e700d0e80 0x7f6e700d2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e6ea00640 1 -- 172.21.15.59:0/2244071207 >> v1:172.21.15.59:6789/0 conn(0x7f6e7015deb0 legacy=0x7f6e700d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e6ea00640 1 -- 172.21.15.59:0/2244071207 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e700ceaf0 con 0x7f6e7015dad0 2024-04-25T09:02:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.803+0000 7f6e6e000640 1 -- 172.21.15.59:0/2244071207 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978148199 0 0) 0x7f6e700ce810 con 0x7f6e7015deb0 2024-04-25T09:02:29.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.807+0000 7f6e6ea00640 1 --2- 172.21.15.59:0/2244071207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7015dad0 0x7f6e701621e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6e600097c0 tx=0x7f6e6001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efec7078d7ea3637 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.807+0000 7f6e6e000640 1 -- 172.21.15.59:0/2244071207 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e600b2070 con 0x7f6e7015dad0 2024-04-25T09:02:29.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.807+0000 7f6e6e000640 1 -- 172.21.15.59:0/2244071207 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e600ad680 con 0x7f6e7015dad0 2024-04-25T09:02:29.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.807+0000 7f6e6e000640 1 -- 172.21.15.59:0/2244071207 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e600ada50 con 0x7f6e7015dad0 2024-04-25T09:02:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.807+0000 7f6e75a00640 1 -- 172.21.15.59:0/2244071207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7015dad0 msgr2=0x7f6e701621e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.807+0000 7f6e75a00640 1 --2- 172.21.15.59:0/2244071207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7015dad0 0x7f6e701621e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6e600097c0 tx=0x7f6e6001c470 comp rx=0 tx=0).stop 2024-04-25T09:02:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.807+0000 7f6e75a00640 1 -- 172.21.15.59:0/2244071207 shutdown_connections 2024-04-25T09:02:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.807+0000 7f6e75a00640 1 --2- 172.21.15.59:0/2244071207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e700d0e80 0x7f6e700d2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.807+0000 7f6e75a00640 1 --2- 172.21.15.59:0/2244071207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e7015dad0 0x7f6e701621e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.807+0000 7f6e75a00640 1 -- 172.21.15.59:0/2244071207 >> 172.21.15.59:0/2244071207 conn(0x7f6e700b5900 msgr2=0x7f6e700b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.807+0000 7f6e75a00640 1 -- 172.21.15.59:0/2244071207 shutdown_connections 2024-04-25T09:02:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.807+0000 7f6e75a00640 1 -- 172.21.15.59:0/2244071207 wait complete. 2024-04-25T09:02:29.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e75a00640 1 Processor -- start 2024-04-25T09:02:29.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e75a00640 1 -- start start 2024-04-25T09:02:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e75a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e700d0e80 0x7f6e701656d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e75a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e7015dad0 0x7f6e7015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e75a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e7015deb0 0x7f6e701628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e75a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e700d3150 con 0x7f6e700d0e80 2024-04-25T09:02:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e75a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e700d2fd0 con 0x7f6e7015deb0 2024-04-25T09:02:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e75a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e700d32d0 con 0x7f6e7015dad0 2024-04-25T09:02:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e6ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e700d0e80 0x7f6e701656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e6ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e700d0e80 0x7f6e701656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55658/0 (socket says 172.21.15.59:55658) 2024-04-25T09:02:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e6ea00640 1 -- 172.21.15.59:0/3946600099 learned_addr learned my addr 172.21.15.59:0/3946600099 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e6ea00640 1 -- 172.21.15.59:0/3946600099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e7015dad0 msgr2=0x7f6e7015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e6ea00640 1 --2- 172.21.15.59:0/3946600099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e7015dad0 0x7f6e7015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e6ea00640 1 -- 172.21.15.59:0/3946600099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e7015deb0 msgr2=0x7f6e701628a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:29.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e6ea00640 1 --2- 172.21.15.59:0/3946600099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e7015deb0 0x7f6e701628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:29.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e6ea00640 1 -- 172.21.15.59:0/3946600099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e70163360 con 0x7f6e700d0e80 2024-04-25T09:02:29.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e6ea00640 1 --2- 172.21.15.59:0/3946600099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e700d0e80 0x7f6e701656d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6e6001a0a0 tx=0x7f6e6001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e66a00640 1 -- 172.21.15.59:0/3946600099 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e600b2040 con 0x7f6e700d0e80 2024-04-25T09:02:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e66a00640 1 -- 172.21.15.59:0/3946600099 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e600bd070 con 0x7f6e700d0e80 2024-04-25T09:02:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e66a00640 1 -- 172.21.15.59:0/3946600099 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e600addf0 con 0x7f6e700d0e80 2024-04-25T09:02:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e75a00640 1 -- 172.21.15.59:0/3946600099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e70160110 con 0x7f6e700d0e80 2024-04-25T09:02:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.811+0000 7f6e75a00640 1 -- 172.21.15.59:0/3946600099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e701606d0 con 0x7f6e700d0e80 2024-04-25T09:02:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.815+0000 7f6e75a00640 1 -- 172.21.15.59:0/3946600099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e70160b10 con 0x7f6e700d0e80 2024-04-25T09:02:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.815+0000 7f6e66a00640 1 -- 172.21.15.59:0/3946600099 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6e600c2460 con 0x7f6e700d0e80 2024-04-25T09:02:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.815+0000 7f6e66a00640 1 --2- 172.21.15.59:0/3946600099 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e4c066f90 0x7f6e4c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.815+0000 7f6e66a00640 1 -- 172.21.15.59:0/3946600099 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f6e6011f6d0 con 0x7f6e700d0e80 2024-04-25T09:02:29.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.815+0000 7f6e67e00640 1 --2- 172.21.15.59:0/3946600099 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e4c066f90 0x7f6e4c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:29.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.815+0000 7f6e67e00640 1 --2- 172.21.15.59:0/3946600099 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e4c066f90 0x7f6e4c069450 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e70160000 tx=0x7f6e58007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:29.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:29.819+0000 7f6e66a00640 1 -- 172.21.15.59:0/3946600099 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6e60016090 con 0x7f6e700d0e80 2024-04-25T09:02:30.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 -- 172.21.15.59:0/3946600099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e700745d0 con 0x7f6e700d0e80 2024-04-25T09:02:30.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e66a00640 1 -- 172.21.15.59:0/3946600099 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7f6e600c0360 con 0x7f6e700d0e80 2024-04-25T09:02:30.005 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:30.006 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2167197221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2167197221},{"type":"v1","addr":"172.21.15.59:6834","nonce":2167197221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2689387181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2689387181},{"type":"v1","addr":"172.21.15.178:6837","nonce":2689387181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1461695991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1461695991},{"type":"v1","addr":"172.21.15.59:6835","nonce":1461695991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:28.177275+0000","modified":"2024-04-25T09:01:46.237549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/3239224017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3239224017},{"type":"v1","addr":"172.21.15.178:6836","nonce":3239224017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:02:30.006 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2024-04-25T09:02:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 -- 172.21.15.59:0/3946600099 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e4c066f90 msgr2=0x7f6e4c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 --2- 172.21.15.59:0/3946600099 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e4c066f90 0x7f6e4c069450 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6e70160000 tx=0x7f6e58007970 comp rx=0 tx=0).stop 2024-04-25T09:02:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 -- 172.21.15.59:0/3946600099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e700d0e80 msgr2=0x7f6e701656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 --2- 172.21.15.59:0/3946600099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e700d0e80 0x7f6e701656d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6e6001a0a0 tx=0x7f6e6001acb0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 -- 172.21.15.59:0/3946600099 shutdown_connections 2024-04-25T09:02:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 --2- 172.21.15.59:0/3946600099 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e4c066f90 0x7f6e4c069450 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 --2- 172.21.15.59:0/3946600099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e7015deb0 0x7f6e701628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 --2- 172.21.15.59:0/3946600099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e7015dad0 0x7f6e7015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 --2- 172.21.15.59:0/3946600099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e700d0e80 0x7f6e701656d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 -- 172.21.15.59:0/3946600099 >> 172.21.15.59:0/3946600099 conn(0x7f6e700b5900 msgr2=0x7f6e700b92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 -- 172.21.15.59:0/3946600099 shutdown_connections 2024-04-25T09:02:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.015+0000 7f6e75a00640 1 -- 172.21.15.59:0/3946600099 wait complete. 2024-04-25T09:02:30.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:30.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.175+0000 7fb48cc00640 1 Processor -- start 2024-04-25T09:02:30.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.175+0000 7fb48cc00640 1 -- start start 2024-04-25T09:02:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb48cc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488145270 0x7fb48815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb48cc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb4880cd4d0 0x7fb4880cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb48cc00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880cc4e0 con 0x7fb4880b1750 2024-04-25T09:02:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb48cc00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb488145650 con 0x7fb4880cd4d0 2024-04-25T09:02:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb48cc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880ce040 con 0x7fb488145270 2024-04-25T09:02:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb485e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488145270 0x7fb48815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb47fe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb4880cd4d0 0x7fb4880cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb485e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488145270 0x7fb48815fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:49366/0 (socket says 172.21.15.59:49366) 2024-04-25T09:02:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb485e00640 1 -- 172.21.15.59:0/220428820 learned_addr learned my addr 172.21.15.59:0/220428820 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb486800640 1 --1- 172.21.15.59:0/220428820 >> v1:172.21.15.178:6789/0 conn(0x7fb4880b1750 0x7fb48815bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:45792/0 (socket says 172.21.15.59:45792) 2024-04-25T09:02:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb47fe00640 1 -- 172.21.15.59:0/220428820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488145270 msgr2=0x7fb48815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb47fe00640 1 --2- 172.21.15.59:0/220428820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488145270 0x7fb48815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb47fe00640 1 -- 172.21.15.59:0/220428820 >> v1:172.21.15.178:6789/0 conn(0x7fb4880b1750 legacy=0x7fb48815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb47fe00640 1 -- 172.21.15.59:0/220428820 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880ce320 con 0x7fb4880cd4d0 2024-04-25T09:02:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.179+0000 7fb485e00640 1 --2- 172.21.15.59:0/220428820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488145270 0x7fb48815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb47fe00640 1 --2- 172.21.15.59:0/220428820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4880cd4d0 0x7fb4880cd930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4700097c0 tx=0x7fb47001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b4f94bb9e1d9003 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb485400640 1 -- 172.21.15.59:0/220428820 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700b2070 con 0x7fb4880cd4d0 2024-04-25T09:02:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb485400640 1 -- 172.21.15.59:0/220428820 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4700ad640 con 0x7fb4880cd4d0 2024-04-25T09:02:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb485400640 1 -- 172.21.15.59:0/220428820 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4700ada10 con 0x7fb4880cd4d0 2024-04-25T09:02:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb48cc00640 1 -- 172.21.15.59:0/220428820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4880cd4d0 msgr2=0x7fb4880cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb48cc00640 1 --2- 172.21.15.59:0/220428820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4880cd4d0 0x7fb4880cd930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb4700097c0 tx=0x7fb47001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb48cc00640 1 -- 172.21.15.59:0/220428820 shutdown_connections 2024-04-25T09:02:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb48cc00640 1 --2- 172.21.15.59:0/220428820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb4880cd4d0 0x7fb4880cd930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb48cc00640 1 --2- 172.21.15.59:0/220428820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb488145270 0x7fb48815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb48cc00640 1 -- 172.21.15.59:0/220428820 >> 172.21.15.59:0/220428820 conn(0x7fb488066fa0 msgr2=0x7fb48806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb48cc00640 1 -- 172.21.15.59:0/220428820 shutdown_connections 2024-04-25T09:02:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb48cc00640 1 -- 172.21.15.59:0/220428820 wait complete. 2024-04-25T09:02:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb48cc00640 1 Processor -- start 2024-04-25T09:02:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.183+0000 7fb48cc00640 1 -- start start 2024-04-25T09:02:30.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb48cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4880b1750 0x7fb4881faa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb48cc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4880cd4d0 0x7fb48813a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb48cc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb488145270 0x7fb48815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb48cc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880b1f70 con 0x7fb4880b1750 2024-04-25T09:02:30.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb48cc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb488168710 con 0x7fb488145270 2024-04-25T09:02:30.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb48cc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4881fafc0 con 0x7fb4880cd4d0 2024-04-25T09:02:30.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb485e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4880b1750 0x7fb4881faa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb485e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4880b1750 0x7fb4881faa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55662/0 (socket says 172.21.15.59:55662) 2024-04-25T09:02:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb485e00640 1 -- 172.21.15.59:0/2101734678 learned_addr learned my addr 172.21.15.59:0/2101734678 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb47fe00640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4880cd4d0 0x7fb48813a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb486800640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb488145270 0x7fb48815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb485e00640 1 -- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4880cd4d0 msgr2=0x7fb48813a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb485e00640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4880cd4d0 0x7fb48813a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb485e00640 1 -- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb488145270 msgr2=0x7fb48815ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb485e00640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb488145270 0x7fb48815ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb485e00640 1 -- 172.21.15.59:0/2101734678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb48813cf40 con 0x7fb4880b1750 2024-04-25T09:02:30.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb485e00640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4880b1750 0x7fb4881faa80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb47800e930 tx=0x7fb47800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb47e000640 1 -- 172.21.15.59:0/2101734678 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb478017070 con 0x7fb4880b1750 2024-04-25T09:02:30.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb47e000640 1 -- 172.21.15.59:0/2101734678 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47800ca00 con 0x7fb4880b1750 2024-04-25T09:02:30.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb47e000640 1 -- 172.21.15.59:0/2101734678 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800cdd0 con 0x7fb4880b1750 2024-04-25T09:02:30.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb48cc00640 1 -- 172.21.15.59:0/2101734678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb48813d280 con 0x7fb4880b1750 2024-04-25T09:02:30.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb48cc00640 1 -- 172.21.15.59:0/2101734678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb48813dac0 con 0x7fb4880b1750 2024-04-25T09:02:30.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.187+0000 7fb48cc00640 1 -- 172.21.15.59:0/2101734678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4880745d0 con 0x7fb4880b1750 2024-04-25T09:02:30.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.191+0000 7fb47e000640 1 -- 172.21.15.59:0/2101734678 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb47801a070 con 0x7fb4880b1750 2024-04-25T09:02:30.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.191+0000 7fb47e000640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb464066f60 0x7fb464069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.191+0000 7fb47e000640 1 -- 172.21.15.59:0/2101734678 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fb4780853d0 con 0x7fb4880b1750 2024-04-25T09:02:30.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.191+0000 7fb47fe00640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb464066f60 0x7fb464069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.191+0000 7fb47fe00640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb464066f60 0x7fb464069420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb4700af000 tx=0x7fb470008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.195+0000 7fb47e000640 1 -- 172.21.15.59:0/2101734678 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb48813d280 con 0x7fb4880b1750 2024-04-25T09:02:30.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.387+0000 7fb48cc00640 1 -- 172.21.15.59:0/2101734678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb48806b8e0 con 0x7fb4880b1750 2024-04-25T09:02:30.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.387+0000 7fb47e000640 1 -- 172.21.15.59:0/2101734678 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4940 (secure 0 0 0) 0x7fb4780558b0 con 0x7fb4880b1750 2024-04-25T09:02:30.382 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:30.383 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2167197221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2167197221},{"type":"v1","addr":"172.21.15.59:6834","nonce":2167197221}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4253,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2689387181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2689387181},{"type":"v1","addr":"172.21.15.178:6837","nonce":2689387181}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1461695991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1461695991},{"type":"v1","addr":"172.21.15.59:6835","nonce":1461695991}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:01:28.177275+0000","modified":"2024-04-25T09:01:46.237549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.178:6836/3239224017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3239224017},{"type":"v1","addr":"172.21.15.178:6836","nonce":3239224017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-25T09:02:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 9 2024-04-25T09:02:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.391+0000 7fb48cc00640 1 -- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb464066f60 msgr2=0x7fb464069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.391+0000 7fb48cc00640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb464066f60 0x7fb464069420 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb4700af000 tx=0x7fb470008040 comp rx=0 tx=0).stop 2024-04-25T09:02:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.391+0000 7fb48cc00640 1 -- 172.21.15.59:0/2101734678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4880b1750 msgr2=0x7fb4881faa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.391+0000 7fb48cc00640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4880b1750 0x7fb4881faa80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fb47800e930 tx=0x7fb47800edf0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.391+0000 7fb48cc00640 1 -- 172.21.15.59:0/2101734678 shutdown_connections 2024-04-25T09:02:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.391+0000 7fb48cc00640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb464066f60 0x7fb464069420 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.391+0000 7fb48cc00640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb488145270 0x7fb48815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.391+0000 7fb48cc00640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb4880cd4d0 0x7fb48813a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.391+0000 7fb48cc00640 1 --2- 172.21.15.59:0/2101734678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4880b1750 0x7fb4881faa80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.391+0000 7fb48cc00640 1 -- 172.21.15.59:0/2101734678 >> 172.21.15.59:0/2101734678 conn(0x7fb488066fa0 msgr2=0x7fb48813f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.391+0000 7fb48cc00640 1 -- 172.21.15.59:0/2101734678 shutdown_connections 2024-04-25T09:02:30.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.391+0000 7fb48cc00640 1 -- 172.21.15.59:0/2101734678 wait complete. 2024-04-25T09:02:30.402 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:30.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.551+0000 7f9ad7200640 1 Processor -- start 2024-04-25T09:02:30.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.551+0000 7f9ad7200640 1 -- start start 2024-04-25T09:02:30.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.551+0000 7f9ad7200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ad0146740 0x7f9ad006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.551+0000 7f9ad7200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad00aeb50 0x7f9ad00aef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.551+0000 7f9ad7200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad00b23e0 con 0x7f9ad00af840 2024-04-25T09:02:30.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.551+0000 7f9ad7200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ad0146b20 con 0x7f9ad0146740 2024-04-25T09:02:30.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.551+0000 7f9ad7200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00af4c0 con 0x7f9ad00aeb50 2024-04-25T09:02:30.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.555+0000 7f9acfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ad0146740 0x7f9ad006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.555+0000 7f9ac7e00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f9ad00af840 0x7f9ad00b19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:45132/0 (socket says 172.21.15.59:45132) 2024-04-25T09:02:30.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.555+0000 7f9ac7e00640 1 -- 172.21.15.59:0/1133639091 learned_addr learned my addr 172.21.15.59:0/1133639091 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:30.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.555+0000 7f9ad5200640 1 --2- 172.21.15.59:0/1133639091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad00aeb50 0x7f9ad00aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.555+0000 7f9acfe00640 1 -- 172.21.15.59:0/1133639091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad00aeb50 msgr2=0x7f9ad00aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:30.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.555+0000 7f9acfe00640 1 --2- 172.21.15.59:0/1133639091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad00aeb50 0x7f9ad00aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.555+0000 7f9acfe00640 1 -- 172.21.15.59:0/1133639091 >> v1:172.21.15.178:6789/0 conn(0x7f9ad00af840 legacy=0x7f9ad00b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.555+0000 7f9acfe00640 1 -- 172.21.15.59:0/1133639091 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad00acb80 con 0x7f9ad0146740 2024-04-25T09:02:30.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.555+0000 7f9acfe00640 1 --2- 172.21.15.59:0/1133639091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad0146740 0x7f9ad006d2b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00097c0 tx=0x7f9ac001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a42f4c0fa9e8d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.555+0000 7f9acf400640 1 -- 172.21.15.59:0/1133639091 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac00a7070 con 0x7f9ad0146740 2024-04-25T09:02:30.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.555+0000 7f9acf400640 1 -- 172.21.15.59:0/1133639091 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac00b0070 con 0x7f9ad0146740 2024-04-25T09:02:30.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.555+0000 7f9acf400640 1 -- 172.21.15.59:0/1133639091 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac00ab890 con 0x7f9ad0146740 2024-04-25T09:02:30.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 -- 172.21.15.59:0/1133639091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad0146740 msgr2=0x7f9ad006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 --2- 172.21.15.59:0/1133639091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad0146740 0x7f9ad006d2b0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00097c0 tx=0x7f9ac001c470 comp rx=0 tx=0).stop 2024-04-25T09:02:30.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 -- 172.21.15.59:0/1133639091 shutdown_connections 2024-04-25T09:02:30.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 --2- 172.21.15.59:0/1133639091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad00aeb50 0x7f9ad00aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 --2- 172.21.15.59:0/1133639091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad0146740 0x7f9ad006d2b0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 -- 172.21.15.59:0/1133639091 >> 172.21.15.59:0/1133639091 conn(0x7f9ad0066fa0 msgr2=0x7f9ad006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 -- 172.21.15.59:0/1133639091 shutdown_connections 2024-04-25T09:02:30.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 -- 172.21.15.59:0/1133639091 wait complete. 2024-04-25T09:02:30.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 Processor -- start 2024-04-25T09:02:30.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 -- start start 2024-04-25T09:02:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad00aeb50 0x7f9ad01457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad00af840 0x7f9ad0134080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0146740 0x7f9ad0135590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad006d7f0 con 0x7f9ad00af840 2024-04-25T09:02:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad00b20f0 con 0x7f9ad00aeb50 2024-04-25T09:02:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad7200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad006d970 con 0x7f9ad0146740 2024-04-25T09:02:30.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ac7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad00af840 0x7f9ad0134080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ac7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad00af840 0x7f9ad0134080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38376/0 (socket says 172.21.15.59:38376) 2024-04-25T09:02:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ac7e00640 1 -- 172.21.15.59:0/684408067 learned_addr learned my addr 172.21.15.59:0/684408067 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ad5200640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0146740 0x7f9ad0135590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9acfe00640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad00aeb50 0x7f9ad01457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ac7e00640 1 -- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0146740 msgr2=0x7f9ad0135590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ac7e00640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0146740 0x7f9ad0135590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ac7e00640 1 -- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad00aeb50 msgr2=0x7f9ad01457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ac7e00640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad00aeb50 0x7f9ad01457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ac7e00640 1 -- 172.21.15.59:0/684408067 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad0145d10 con 0x7f9ad00af840 2024-04-25T09:02:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9acfe00640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad00aeb50 0x7f9ad01457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:30.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.559+0000 7f9ac7e00640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad00af840 0x7f9ad0134080 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800c420 tx=0x7f9ab800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.563+0000 7f9accc00640 1 -- 172.21.15.59:0/684408067 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8017070 con 0x7f9ad00af840 2024-04-25T09:02:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.563+0000 7f9accc00640 1 -- 172.21.15.59:0/684408067 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab8005cf0 con 0x7f9ad00af840 2024-04-25T09:02:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.563+0000 7f9accc00640 1 -- 172.21.15.59:0/684408067 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab80072f0 con 0x7f9ad00af840 2024-04-25T09:02:30.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.563+0000 7f9ad7200640 1 -- 172.21.15.59:0/684408067 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad0138f00 con 0x7f9ad00af840 2024-04-25T09:02:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.563+0000 7f9ad7200640 1 -- 172.21.15.59:0/684408067 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad0134ab0 con 0x7f9ad00af840 2024-04-25T09:02:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.563+0000 7f9ad7200640 1 -- 172.21.15.59:0/684408067 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad00745d0 con 0x7f9ad00af840 2024-04-25T09:02:30.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.563+0000 7f9accc00640 1 -- 172.21.15.59:0/684408067 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ab801a070 con 0x7f9ad00af840 2024-04-25T09:02:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.563+0000 7f9accc00640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9aac066f60 0x7f9aac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.563+0000 7f9accc00640 1 -- 172.21.15.59:0/684408067 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7f9ab8084790 con 0x7f9ad00af840 2024-04-25T09:02:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.563+0000 7f9acfe00640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9aac066f60 0x7f9aac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.567+0000 7f9acfe00640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9aac066f60 0x7f9aac069420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00af000 tx=0x7f9ac00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.567+0000 7f9accc00640 1 -- 172.21.15.59:0/684408067 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ab8054d10 con 0x7f9ad00af840 2024-04-25T09:02:30.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 -- 172.21.15.59:0/684408067 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ad0145ee0 con 0x7f9ad00af840 2024-04-25T09:02:30.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9accc00640 1 -- 172.21.15.59:0/684408067 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18938 (secure 0 0 0) 0x7f9ab8058db0 con 0x7f9ad00af840 2024-04-25T09:02:30.726 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:30.726 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":26,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:08.938626+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:01:25.852302+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T09:01:27.174274+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T09:01:30.844655+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.35","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":5,"to":1}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:30.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 -- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9aac066f60 msgr2=0x7f9aac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9aac066f60 0x7f9aac069420 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9ac00af000 tx=0x7f9ac00a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:30.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 -- 172.21.15.59:0/684408067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad00af840 msgr2=0x7f9ad0134080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad00af840 0x7f9ad0134080 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800c420 tx=0x7f9ab800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 -- 172.21.15.59:0/684408067 shutdown_connections 2024-04-25T09:02:30.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9aac066f60 0x7f9aac069420 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ad0146740 0x7f9ad0135590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ad00af840 0x7f9ad0134080 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 --2- 172.21.15.59:0/684408067 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ad00aeb50 0x7f9ad01457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 -- 172.21.15.59:0/684408067 >> 172.21.15.59:0/684408067 conn(0x7f9ad0066fa0 msgr2=0x7f9ad006db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 -- 172.21.15.59:0/684408067 shutdown_connections 2024-04-25T09:02:30.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.735+0000 7f9ad7200640 1 -- 172.21.15.59:0/684408067 wait complete. 2024-04-25T09:02:30.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:02:30.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa425200640 1 Processor -- start 2024-04-25T09:02:30.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa425200640 1 -- start start 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa425200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa420159320 0x7fa42015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa425200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa42015f440 0x7fa42006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa425200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42015fc00 con 0x7fa42006e010 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa425200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42006d640 con 0x7fa420159320 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa425200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42015fee0 con 0x7fa42015f440 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa41de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa420159320 0x7fa42015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa41de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa420159320 0x7fa42015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38386/0 (socket says 172.21.15.59:38386) 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa41de00640 1 -- 172.21.15.59:0/2357038720 learned_addr learned my addr 172.21.15.59:0/2357038720 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa417e00640 1 --2- 172.21.15.59:0/2357038720 >> v2:172.21.15.178:3300/0 conn(0x7fa42015f440 0x7fa42006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa41de00640 1 -- 172.21.15.59:0/2357038720 >> v2:172.21.15.178:3300/0 conn(0x7fa42015f440 msgr2=0x7fa42006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa41de00640 1 --2- 172.21.15.59:0/2357038720 >> v2:172.21.15.178:3300/0 conn(0x7fa42015f440 0x7fa42006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa41de00640 1 -- 172.21.15.59:0/2357038720 >> v1:172.21.15.178:6789/0 conn(0x7fa42006e010 legacy=0x7fa42006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:30.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.899+0000 7fa41de00640 1 -- 172.21.15.59:0/2357038720 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4201601c0 con 0x7fa420159320 2024-04-25T09:02:30.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa41de00640 1 --2- 172.21.15.59:0/2357038720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa420159320 0x7fa42015c9b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa4200b4b50 tx=0x7fa41001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb175297a437cf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa41d400640 1 -- 172.21.15.59:0/2357038720 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4100ab640 con 0x7fa420159320 2024-04-25T09:02:30.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa41d400640 1 -- 172.21.15.59:0/2357038720 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4100b0070 con 0x7fa420159320 2024-04-25T09:02:30.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa41d400640 1 -- 172.21.15.59:0/2357038720 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4100aba00 con 0x7fa420159320 2024-04-25T09:02:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa425200640 1 -- 172.21.15.59:0/2357038720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa420159320 msgr2=0x7fa42015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa425200640 1 --2- 172.21.15.59:0/2357038720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa420159320 0x7fa42015c9b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa4200b4b50 tx=0x7fa41001c420 comp rx=0 tx=0).stop 2024-04-25T09:02:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa425200640 1 -- 172.21.15.59:0/2357038720 shutdown_connections 2024-04-25T09:02:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa425200640 1 --2- 172.21.15.59:0/2357038720 >> v2:172.21.15.178:3300/0 conn(0x7fa42015f440 0x7fa42006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa425200640 1 --2- 172.21.15.59:0/2357038720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa420159320 0x7fa42015c9b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa425200640 1 -- 172.21.15.59:0/2357038720 >> 172.21.15.59:0/2357038720 conn(0x7fa420067080 msgr2=0x7fa42006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa425200640 1 -- 172.21.15.59:0/2357038720 shutdown_connections 2024-04-25T09:02:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa425200640 1 -- 172.21.15.59:0/2357038720 wait complete. 2024-04-25T09:02:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa425200640 1 Processor -- start 2024-04-25T09:02:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.903+0000 7fa425200640 1 -- start start 2024-04-25T09:02:30.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa425200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42006e010 0x7fa420130560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa425200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa420159320 0x7fa4200afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa425200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42015f440 0x7fa420157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa425200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42015f9a0 con 0x7fa420159320 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa425200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42015f820 con 0x7fa42006e010 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa425200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42006ebb0 con 0x7fa42015f440 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa417e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa420159320 0x7fa4200afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa417e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa420159320 0x7fa4200afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38394/0 (socket says 172.21.15.59:38394) 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa417e00640 1 -- 172.21.15.59:0/825717866 learned_addr learned my addr 172.21.15.59:0/825717866 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa41de00640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42006e010 0x7fa420130560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa41e800640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42015f440 0x7fa420157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa417e00640 1 -- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42015f440 msgr2=0x7fa420157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa417e00640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42015f440 0x7fa420157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa417e00640 1 -- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42006e010 msgr2=0x7fa420130560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:30.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa417e00640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42006e010 0x7fa420130560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:30.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa417e00640 1 -- 172.21.15.59:0/825717866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa420130bf0 con 0x7fa420159320 2024-04-25T09:02:30.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa41e800640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42015f440 0x7fa420157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:30.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa417e00640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa420159320 0x7fa4200afcf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa40800d800 tx=0x7fa40800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa416000640 1 -- 172.21.15.59:0/825717866 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40800b6c0 con 0x7fa420159320 2024-04-25T09:02:30.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa416000640 1 -- 172.21.15.59:0/825717866 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa408019070 con 0x7fa420159320 2024-04-25T09:02:30.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa425200640 1 -- 172.21.15.59:0/825717866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa420130ed0 con 0x7fa420159320 2024-04-25T09:02:30.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa416000640 1 -- 172.21.15.59:0/825717866 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa40800ba60 con 0x7fa420159320 2024-04-25T09:02:30.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa425200640 1 -- 172.21.15.59:0/825717866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa420131490 con 0x7fa420159320 2024-04-25T09:02:30.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.907+0000 7fa425200640 1 -- 172.21.15.59:0/825717866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4200745d0 con 0x7fa420159320 2024-04-25T09:02:30.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.911+0000 7fa416000640 1 -- 172.21.15.59:0/825717866 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa40800bc00 con 0x7fa420159320 2024-04-25T09:02:30.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.911+0000 7fa416000640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa3fc066f60 0x7fa3fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:30.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.911+0000 7fa416000640 1 -- 172.21.15.59:0/825717866 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6793+0+0 (secure 0 0 0) 0x7fa4080858b0 con 0x7fa420159320 2024-04-25T09:02:30.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.911+0000 7fa41de00640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa3fc066f60 0x7fa3fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:30.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.911+0000 7fa41de00640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa3fc066f60 0x7fa3fc069420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa4100af000 tx=0x7fa4100a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:30.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:30.915+0000 7fa416000640 1 -- 172.21.15.59:0/825717866 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa408056480 con 0x7fa420159320 2024-04-25T09:02:31.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.107+0000 7fa425200640 1 -- 172.21.15.59:0/825717866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa42015bc30 con 0x7fa420159320 2024-04-25T09:02:31.101 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:02:31.111+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:02:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.111+0000 7fa416000640 1 -- 172.21.15.59:0/825717866 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa408055d80 con 0x7fa420159320 2024-04-25T09:02:31.103 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:02:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.111+0000 7fa425200640 1 -- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa3fc066f60 msgr2=0x7fa3fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.111+0000 7fa425200640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa3fc066f60 0x7fa3fc069420 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa4100af000 tx=0x7fa4100a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.111+0000 7fa425200640 1 -- 172.21.15.59:0/825717866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa420159320 msgr2=0x7fa4200afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.111+0000 7fa425200640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa420159320 0x7fa4200afcf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa40800d800 tx=0x7fa40800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.115+0000 7fa425200640 1 -- 172.21.15.59:0/825717866 shutdown_connections 2024-04-25T09:02:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.115+0000 7fa425200640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa3fc066f60 0x7fa3fc069420 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.115+0000 7fa425200640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa42015f440 0x7fa420157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.115+0000 7fa425200640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa420159320 0x7fa4200afcf0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.115+0000 7fa425200640 1 --2- 172.21.15.59:0/825717866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa42006e010 0x7fa420130560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.115+0000 7fa425200640 1 -- 172.21.15.59:0/825717866 >> 172.21.15.59:0/825717866 conn(0x7fa420067080 msgr2=0x7fa42015cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:31.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.115+0000 7fa425200640 1 -- 172.21.15.59:0/825717866 shutdown_connections 2024-04-25T09:02:31.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.115+0000 7fa425200640 1 -- 172.21.15.59:0/825717866 wait complete. 2024-04-25T09:02:31.117 INFO:tasks.ceph.mds.b.smithi178.stderr: -5227> 2024-04-25T09:01:32.103+0000 7f9c37200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:02:31.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:02:31.169 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-04-25T09:02:31.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.275+0000 7fdb49e00640 1 Processor -- start 2024-04-25T09:02:31.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.275+0000 7fdb49e00640 1 -- start start 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.279+0000 7fdb49e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdb44144120 0x7fdb4415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.279+0000 7fdb49e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4415bc40 con 0x7fdb440b3090 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.279+0000 7fdb49e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4415b3a0 con 0x7fdb440ccbf0 2024-04-25T09:02:31.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.279+0000 7fdb49e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4415e490 con 0x7fdb44144120 2024-04-25T09:02:31.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.279+0000 7fdb43400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdb440b3090 0x7fdb4406e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34768/0 (socket says 172.21.15.59:34768) 2024-04-25T09:02:31.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.279+0000 7fdb43400640 1 -- 172.21.15.59:0/2338052164 learned_addr learned my addr 172.21.15.59:0/2338052164 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:31.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.279+0000 7fdb42a00640 1 --2- 172.21.15.59:0/2338052164 >> v2:172.21.15.178:3300/0 conn(0x7fdb44144120 0x7fdb4415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.279+0000 7fdb42000640 1 -- 172.21.15.59:0/2338052164 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396848037 0 0) 0x7fdb4415bc40 con 0x7fdb440b3090 2024-04-25T09:02:31.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.279+0000 7fdb42000640 1 -- 172.21.15.59:0/2338052164 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb28003530 con 0x7fdb440b3090 2024-04-25T09:02:31.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.279+0000 7fdb42a00640 1 -- 172.21.15.59:0/2338052164 >> v1:172.21.15.178:6789/0 conn(0x7fdb440ccbf0 legacy=0x7fdb4415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.279+0000 7fdb42a00640 1 -- 172.21.15.59:0/2338052164 >> v1:172.21.15.59:6789/0 conn(0x7fdb440b3090 legacy=0x7fdb4406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.279+0000 7fdb42a00640 1 -- 172.21.15.59:0/2338052164 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4415b680 con 0x7fdb44144120 2024-04-25T09:02:31.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb42a00640 1 --2- 172.21.15.59:0/2338052164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44144120 0x7fdb4415acd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0097c0 tx=0x7fdb2c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bbe531169875c43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:31.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb42000640 1 -- 172.21.15.59:0/2338052164 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0b0070 con 0x7fdb44144120 2024-04-25T09:02:31.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb42000640 1 -- 172.21.15.59:0/2338052164 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c0ab600 con 0x7fdb44144120 2024-04-25T09:02:31.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb42000640 1 -- 172.21.15.59:0/2338052164 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0ab9d0 con 0x7fdb44144120 2024-04-25T09:02:31.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb49e00640 1 -- 172.21.15.59:0/2338052164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44144120 msgr2=0x7fdb4415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb49e00640 1 --2- 172.21.15.59:0/2338052164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44144120 0x7fdb4415acd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c0097c0 tx=0x7fdb2c01c410 comp rx=0 tx=0).stop 2024-04-25T09:02:31.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb49e00640 1 -- 172.21.15.59:0/2338052164 shutdown_connections 2024-04-25T09:02:31.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb49e00640 1 --2- 172.21.15.59:0/2338052164 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44144120 0x7fdb4415acd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb49e00640 1 -- 172.21.15.59:0/2338052164 >> 172.21.15.59:0/2338052164 conn(0x7fdb44067080 msgr2=0x7fdb4406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:31.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb49e00640 1 -- 172.21.15.59:0/2338052164 shutdown_connections 2024-04-25T09:02:31.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb49e00640 1 -- 172.21.15.59:0/2338052164 wait complete. 2024-04-25T09:02:31.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb49e00640 1 Processor -- start 2024-04-25T09:02:31.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.283+0000 7fdb49e00640 1 -- start start 2024-04-25T09:02:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb49e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb440b3090 0x7fdb4413e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb49e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb440ccbf0 0x7fdb440acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb49e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44144120 0x7fdb440ad520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb49e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4406ec70 con 0x7fdb440b3090 2024-04-25T09:02:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb49e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb4406eaf0 con 0x7fdb44144120 2024-04-25T09:02:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb49e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440b34a0 con 0x7fdb440ccbf0 2024-04-25T09:02:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb42a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb440b3090 0x7fdb4413e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb42a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb440b3090 0x7fdb4413e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38408/0 (socket says 172.21.15.59:38408) 2024-04-25T09:02:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb42a00640 1 -- 172.21.15.59:0/379683756 learned_addr learned my addr 172.21.15.59:0/379683756 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb43400640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44144120 0x7fdb440ad520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb3a000640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb440ccbf0 0x7fdb440acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb42a00640 1 -- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb440ccbf0 msgr2=0x7fdb440acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb42a00640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb440ccbf0 0x7fdb440acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb42a00640 1 -- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44144120 msgr2=0x7fdb440ad520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb42a00640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44144120 0x7fdb440ad520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb42a00640 1 -- 172.21.15.59:0/379683756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4413d280 con 0x7fdb440b3090 2024-04-25T09:02:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb42a00640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb440b3090 0x7fdb4413e320 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c019020 tx=0x7fdb2c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb3be00640 1 -- 172.21.15.59:0/379683756 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0b0050 con 0x7fdb440b3090 2024-04-25T09:02:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb3be00640 1 -- 172.21.15.59:0/379683756 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c0bc070 con 0x7fdb440b3090 2024-04-25T09:02:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb3be00640 1 -- 172.21.15.59:0/379683756 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c0b5830 con 0x7fdb440b3090 2024-04-25T09:02:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb49e00640 1 -- 172.21.15.59:0/379683756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb4413d560 con 0x7fdb440b3090 2024-04-25T09:02:31.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb49e00640 1 -- 172.21.15.59:0/379683756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4413de00 con 0x7fdb440b3090 2024-04-25T09:02:31.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.287+0000 7fdb49e00640 1 -- 172.21.15.59:0/379683756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb4413d730 con 0x7fdb440b3090 2024-04-25T09:02:31.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.291+0000 7fdb3be00640 1 -- 172.21.15.59:0/379683756 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdb2c0b59d0 con 0x7fdb440b3090 2024-04-25T09:02:31.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.291+0000 7fdb3be00640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb20066f60 0x7fdb20069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:31.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.291+0000 7fdb3be00640 1 -- 172.21.15.59:0/379683756 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6879+0+0 (secure 0 0 0) 0x7fdb2c11fc40 con 0x7fdb440b3090 2024-04-25T09:02:31.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.291+0000 7fdb3a000640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb20066f60 0x7fdb20069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:31.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.291+0000 7fdb3a000640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb20066f60 0x7fdb20069420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdb4406e560 tx=0x7fdb34009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:31.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.295+0000 7fdb3be00640 1 -- 172.21.15.59:0/379683756 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdb2c016090 con 0x7fdb440b3090 2024-04-25T09:02:31.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:31.491+0000 7fdb49e00640 1 -- 172.21.15.59:0/379683756 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdb440745d0 con 0x7fdb440b3090 2024-04-25T09:02:32.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.119+0000 7fdb3be00640 1 -- 172.21.15.59:0/379683756 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdb2c0f6030 con 0x7fdb440b3090 2024-04-25T09:02:32.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.123+0000 7fdb49e00640 1 -- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb20066f60 msgr2=0x7fdb20069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.123+0000 7fdb49e00640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb20066f60 0x7fdb20069420 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdb4406e560 tx=0x7fdb34009040 comp rx=0 tx=0).stop 2024-04-25T09:02:32.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.123+0000 7fdb49e00640 1 -- 172.21.15.59:0/379683756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb440b3090 msgr2=0x7fdb4413e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.123+0000 7fdb49e00640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb440b3090 0x7fdb4413e320 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c019020 tx=0x7fdb2c01ac50 comp rx=0 tx=0).stop 2024-04-25T09:02:32.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.123+0000 7fdb49e00640 1 -- 172.21.15.59:0/379683756 shutdown_connections 2024-04-25T09:02:32.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.123+0000 7fdb49e00640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb20066f60 0x7fdb20069420 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.123+0000 7fdb49e00640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb44144120 0x7fdb440ad520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.123+0000 7fdb49e00640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb440ccbf0 0x7fdb440acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.123+0000 7fdb49e00640 1 --2- 172.21.15.59:0/379683756 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb440b3090 0x7fdb4413e320 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.123+0000 7fdb49e00640 1 -- 172.21.15.59:0/379683756 >> 172.21.15.59:0/379683756 conn(0x7fdb44067080 msgr2=0x7fdb4413ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:32.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.123+0000 7fdb49e00640 1 -- 172.21.15.59:0/379683756 shutdown_connections 2024-04-25T09:02:32.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.123+0000 7fdb49e00640 1 -- 172.21.15.59:0/379683756 wait complete. 2024-04-25T09:02:32.136 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:02:32.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3560c00640 1 Processor -- start 2024-04-25T09:02:32.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3560c00640 1 -- start start 2024-04-25T09:02:32.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3560c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355c0713c0 0x7f355c0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3560c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355c15de90 con 0x7f355c0b0c00 2024-04-25T09:02:32.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3560c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f355c071a70 con 0x7f355c15dab0 2024-04-25T09:02:32.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3560c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c0b57a0 con 0x7f355c0713c0 2024-04-25T09:02:32.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f355a800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f355c0b0c00 0x7f355c06c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34774/0 (socket says 172.21.15.59:34774) 2024-04-25T09:02:32.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f355a800640 1 -- 172.21.15.59:0/4003032859 learned_addr learned my addr 172.21.15.59:0/4003032859 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:32.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3553e00640 1 --2- 172.21.15.59:0/4003032859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355c0713c0 0x7f355c0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563834280 0 0) 0x7f355c15de90 con 0x7f355c0b0c00 2024-04-25T09:02:32.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3540003530 con 0x7f355c0b0c00 2024-04-25T09:02:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762823935 0 0) 0x7f355c071a70 con 0x7f355c15dab0 2024-04-25T09:02:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f355c15de90 con 0x7f355c15dab0 2024-04-25T09:02:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1127621873 0 0) 0x7f3540003530 con 0x7f355c0b0c00 2024-04-25T09:02:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355c0713c0 msgr2=0x7f355c0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 --2- 172.21.15.59:0/4003032859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355c0713c0 0x7f355c0b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 >> v1:172.21.15.178:6789/0 conn(0x7f355c15dab0 legacy=0x7f355c070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c06bec0 con 0x7f355c0b0c00 2024-04-25T09:02:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f3554001a00 con 0x7f355c0b0c00 2024-04-25T09:02:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 >> v1:172.21.15.59:6789/0 conn(0x7f355c0b0c00 legacy=0x7f355c06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 --2- 172.21.15.59:0/4003032859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355c0713c0 0x7f3540003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 --2- 172.21.15.59:0/4003032859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3540004130 0x7f3540004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 --2- 172.21.15.59:0/4003032859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3540004d50 0x7f35400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c0b57a0 con 0x7f3540004d50 2024-04-25T09:02:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354000bb10 con 0x7f3540004130 2024-04-25T09:02:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.291+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354000bd10 con 0x7f355c0713c0 2024-04-25T09:02:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.295+0000 7f355a800640 1 --2- 172.21.15.59:0/4003032859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3540004d50 0x7f35400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.295+0000 7f3553e00640 1 --2- 172.21.15.59:0/4003032859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3540004130 0x7f3540004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.295+0000 7f3559e00640 1 --2- 172.21.15.59:0/4003032859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355c0713c0 0x7f3540003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.295+0000 7f355a800640 1 -- 172.21.15.59:0/4003032859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355c0713c0 msgr2=0x7f3540003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.295+0000 7f355a800640 1 --2- 172.21.15.59:0/4003032859 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f355c0713c0 0x7f3540003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.295+0000 7f355a800640 1 -- 172.21.15.59:0/4003032859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3540004130 msgr2=0x7f3540004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.295+0000 7f355a800640 1 --2- 172.21.15.59:0/4003032859 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3540004130 0x7f3540004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.295+0000 7f355a800640 1 -- 172.21.15.59:0/4003032859 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540003530 con 0x7f3540004d50 2024-04-25T09:02:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.295+0000 7f355a800640 1 --2- 172.21.15.59:0/4003032859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3540004d50 0x7f35400051d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f355400a750 tx=0x7f355401f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec9c1b7247346c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.295+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355400a370 con 0x7f3540004d50 2024-04-25T09:02:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.295+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35540b1070 con 0x7f3540004d50 2024-04-25T09:02:32.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.295+0000 7f3559400640 1 -- 172.21.15.59:0/4003032859 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35540ac890 con 0x7f3540004d50 2024-04-25T09:02:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 -- 172.21.15.59:0/4003032859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3540004d50 msgr2=0x7f35400051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 --2- 172.21.15.59:0/4003032859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3540004d50 0x7f35400051d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f355400a750 tx=0x7f355401f9a0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f355a800640 1 -- 172.21.15.59:0/4003032859 reap_dead start 2024-04-25T09:02:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 -- 172.21.15.59:0/4003032859 shutdown_connections 2024-04-25T09:02:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 -- 172.21.15.59:0/4003032859 >> 172.21.15.59:0/4003032859 conn(0x7f355c06f510 msgr2=0x7f355c06f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:32.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 -- 172.21.15.59:0/4003032859 shutdown_connections 2024-04-25T09:02:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 -- 172.21.15.59:0/4003032859 wait complete. 2024-04-25T09:02:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 Processor -- start 2024-04-25T09:02:32.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 -- start start 2024-04-25T09:02:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3540004d50 0x7f355c15c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355c0ac2c0 0x7f355c0ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f355c0cbf00 0x7f355c0cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c0b5110 con 0x7f355c0ac2c0 2024-04-25T09:02:32.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355c06c480 con 0x7f355c0cbf00 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3560c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355c0b5290 con 0x7f3540004d50 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3553e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355c0ac2c0 0x7f355c0ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3553e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355c0ac2c0 0x7f355c0ac740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38432/0 (socket says 172.21.15.59:38432) 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3553e00640 1 -- 172.21.15.59:0/1820894727 learned_addr learned my addr 172.21.15.59:0/1820894727 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3559e00640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3540004d50 0x7f355c15c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f355a800640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f355c0cbf00 0x7f355c0cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3553e00640 1 -- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3540004d50 msgr2=0x7f355c15c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3553e00640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3540004d50 0x7f355c15c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3553e00640 1 -- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f355c0cbf00 msgr2=0x7f355c0cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3553e00640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f355c0cbf00 0x7f355c0cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3553e00640 1 -- 172.21.15.59:0/1820894727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c0a8560 con 0x7f355c0ac2c0 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f355a800640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f355c0cbf00 0x7f355c0cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:32.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.299+0000 7f3553e00640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355c0ac2c0 0x7f355c0ac740 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3544011a30 tx=0x7f3544011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:32.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.303+0000 7f3552000640 1 -- 172.21.15.59:0/1820894727 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354400fbb0 con 0x7f355c0ac2c0 2024-04-25T09:02:32.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.303+0000 7f3552000640 1 -- 172.21.15.59:0/1820894727 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354400fd50 con 0x7f355c0ac2c0 2024-04-25T09:02:32.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.303+0000 7f3552000640 1 -- 172.21.15.59:0/1820894727 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3544014680 con 0x7f355c0ac2c0 2024-04-25T09:02:32.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.303+0000 7f3560c00640 1 -- 172.21.15.59:0/1820894727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355c0a8840 con 0x7f355c0ac2c0 2024-04-25T09:02:32.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.303+0000 7f3560c00640 1 -- 172.21.15.59:0/1820894727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355c0a8e00 con 0x7f355c0ac2c0 2024-04-25T09:02:32.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.303+0000 7f3560c00640 1 -- 172.21.15.59:0/1820894727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355c0745d0 con 0x7f355c0ac2c0 2024-04-25T09:02:32.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.303+0000 7f3552000640 1 -- 172.21.15.59:0/1820894727 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3544012040 con 0x7f355c0ac2c0 2024-04-25T09:02:32.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.303+0000 7f3552000640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3538066f90 0x7f3538069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:32.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.303+0000 7f3552000640 1 -- 172.21.15.59:0/1820894727 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6879+0+0 (secure 0 0 0) 0x7f3544085af0 con 0x7f355c0ac2c0 2024-04-25T09:02:32.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.303+0000 7f3559e00640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3538066f90 0x7f3538069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:32.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.307+0000 7f3559e00640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3538066f90 0x7f3538069450 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f354c000c10 tx=0x7f354c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:32.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.307+0000 7f3552000640 1 -- 172.21.15.59:0/1820894727 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3544019030 con 0x7f355c0ac2c0 2024-04-25T09:02:32.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:32.471+0000 7f3560c00640 1 -- 172.21.15.59:0/1820894727 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f355c0b1150 con 0x7f355c0ac2c0 2024-04-25T09:02:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.123+0000 7f3552000640 1 -- 172.21.15.59:0/1820894727 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3544056720 con 0x7f355c0ac2c0 2024-04-25T09:02:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:02:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.127+0000 7f3560c00640 1 -- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3538066f90 msgr2=0x7f3538069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.127+0000 7f3560c00640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3538066f90 0x7f3538069450 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f354c000c10 tx=0x7f354c009040 comp rx=0 tx=0).stop 2024-04-25T09:02:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.127+0000 7f3560c00640 1 -- 172.21.15.59:0/1820894727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355c0ac2c0 msgr2=0x7f355c0ac740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.127+0000 7f3560c00640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355c0ac2c0 0x7f355c0ac740 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f3544011a30 tx=0x7f3544011ef0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.127+0000 7f3560c00640 1 -- 172.21.15.59:0/1820894727 shutdown_connections 2024-04-25T09:02:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.127+0000 7f3560c00640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3538066f90 0x7f3538069450 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.127+0000 7f3560c00640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f355c0cbf00 0x7f355c0cc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.127+0000 7f3560c00640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f355c0ac2c0 0x7f355c0ac740 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.127+0000 7f3560c00640 1 --2- 172.21.15.59:0/1820894727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3540004d50 0x7f355c15c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.127+0000 7f3560c00640 1 -- 172.21.15.59:0/1820894727 >> 172.21.15.59:0/1820894727 conn(0x7f355c06f510 msgr2=0x7f355c15ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.127+0000 7f3560c00640 1 -- 172.21.15.59:0/1820894727 shutdown_connections 2024-04-25T09:02:33.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.127+0000 7f3560c00640 1 -- 172.21.15.59:0/1820894727 wait complete. 2024-04-25T09:02:33.140 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:02:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.295+0000 7f5f07a00640 1 Processor -- start 2024-04-25T09:02:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.295+0000 7f5f07a00640 1 -- start start 2024-04-25T09:02:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5f07a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f000b47d0 0x7f5f00071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5f07a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f00157ec0 con 0x7f5f00072020 2024-04-25T09:02:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5f07a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f0015a610 con 0x7f5f00157ae0 2024-04-25T09:02:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5f07a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f0015a8f0 con 0x7f5f000b47d0 2024-04-25T09:02:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5f05a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5f00072020 0x7f5f000cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34790/0 (socket says 172.21.15.59:34790) 2024-04-25T09:02:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5f05a00640 1 -- 172.21.15.59:0/4028390549 learned_addr learned my addr 172.21.15.59:0/4028390549 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5effe00640 1 --2- 172.21.15.59:0/4028390549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f000b47d0 0x7f5f00071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5eff400640 1 -- 172.21.15.59:0/4028390549 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2212543980 0 0) 0x7f5f00157ec0 con 0x7f5f00072020 2024-04-25T09:02:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5eff400640 1 -- 172.21.15.59:0/4028390549 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ee8003530 con 0x7f5f00072020 2024-04-25T09:02:33.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5eff400640 1 -- 172.21.15.59:0/4028390549 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752411916 0 0) 0x7f5f0015a610 con 0x7f5f00157ae0 2024-04-25T09:02:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5eff400640 1 -- 172.21.15.59:0/4028390549 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f00157ec0 con 0x7f5f00157ae0 2024-04-25T09:02:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5effe00640 1 -- 172.21.15.59:0/4028390549 >> v1:172.21.15.178:6789/0 conn(0x7f5f00157ae0 legacy=0x7f5f0015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5effe00640 1 -- 172.21.15.59:0/4028390549 >> v1:172.21.15.59:6789/0 conn(0x7f5f00072020 legacy=0x7f5f000cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.299+0000 7f5effe00640 1 -- 172.21.15.59:0/4028390549 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0015abd0 con 0x7f5f000b47d0 2024-04-25T09:02:33.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5effe00640 1 --2- 172.21.15.59:0/4028390549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f000b47d0 0x7f5f00071ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00a990 tx=0x7f5eec01d8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=151823f17362637 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:33.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5eff400640 1 -- 172.21.15.59:0/4028390549 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec00b040 con 0x7f5f000b47d0 2024-04-25T09:02:33.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5eff400640 1 -- 172.21.15.59:0/4028390549 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eec0a7710 con 0x7f5f000b47d0 2024-04-25T09:02:33.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5eff400640 1 -- 172.21.15.59:0/4028390549 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0a7ae0 con 0x7f5f000b47d0 2024-04-25T09:02:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5f07a00640 1 -- 172.21.15.59:0/4028390549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f000b47d0 msgr2=0x7f5f00071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5f07a00640 1 --2- 172.21.15.59:0/4028390549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f000b47d0 0x7f5f00071ae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00a990 tx=0x7f5eec01d8b0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5f07a00640 1 -- 172.21.15.59:0/4028390549 shutdown_connections 2024-04-25T09:02:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5f07a00640 1 --2- 172.21.15.59:0/4028390549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f000b47d0 0x7f5f00071ae0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5f07a00640 1 -- 172.21.15.59:0/4028390549 >> 172.21.15.59:0/4028390549 conn(0x7f5f0006ac10 msgr2=0x7f5f0006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5f07a00640 1 -- 172.21.15.59:0/4028390549 shutdown_connections 2024-04-25T09:02:33.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5f07a00640 1 -- 172.21.15.59:0/4028390549 wait complete. 2024-04-25T09:02:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5f07a00640 1 Processor -- start 2024-04-25T09:02:33.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.303+0000 7f5f07a00640 1 -- start start 2024-04-25T09:02:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f07a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f00072020 0x7f5f0014d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f07a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f000b47d0 0x7f5f00148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f07a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f00157ae0 0x7f5f001f7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f07a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000cf280 con 0x7f5f00072020 2024-04-25T09:02:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f07a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f000cf100 con 0x7f5f000b47d0 2024-04-25T09:02:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f07a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f00167e30 con 0x7f5f00157ae0 2024-04-25T09:02:33.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f05000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f00072020 0x7f5f0014d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f05000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f00072020 0x7f5f0014d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38446/0 (socket says 172.21.15.59:38446) 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f05000640 1 -- 172.21.15.59:0/1416757691 learned_addr learned my addr 172.21.15.59:0/1416757691 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5effe00640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f000b47d0 0x7f5f00148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f05a00640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f00157ae0 0x7f5f001f7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f05000640 1 -- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f00157ae0 msgr2=0x7f5f001f7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f05000640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f00157ae0 0x7f5f001f7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f05000640 1 -- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f000b47d0 msgr2=0x7f5f00148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f05000640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f000b47d0 0x7f5f00148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f05000640 1 -- 172.21.15.59:0/1416757691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f00071be0 con 0x7f5f00072020 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f05000640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f00072020 0x7f5f0014d4a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c430 tx=0x7f5ef400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5efcc00640 1 -- 172.21.15.59:0/1416757691 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4017070 con 0x7f5f00072020 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5efcc00640 1 -- 172.21.15.59:0/1416757691 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ef40052f0 con 0x7f5f00072020 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5efcc00640 1 -- 172.21.15.59:0/1416757691 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4003840 con 0x7f5f00072020 2024-04-25T09:02:33.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f07a00640 1 -- 172.21.15.59:0/1416757691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f00149150 con 0x7f5f00072020 2024-04-25T09:02:33.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f07a00640 1 -- 172.21.15.59:0/1416757691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f0014bb40 con 0x7f5f00072020 2024-04-25T09:02:33.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5f07a00640 1 -- 172.21.15.59:0/1416757691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f000745d0 con 0x7f5f00072020 2024-04-25T09:02:33.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.307+0000 7f5efcc00640 1 -- 172.21.15.59:0/1416757691 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5ef401a070 con 0x7f5f00072020 2024-04-25T09:02:33.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.311+0000 7f5efcc00640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ee0066f60 0x7f5ee0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:33.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.311+0000 7f5efcc00640 1 -- 172.21.15.59:0/1416757691 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6441+0+0 (secure 0 0 0) 0x7f5ef4084740 con 0x7f5f00072020 2024-04-25T09:02:33.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.311+0000 7f5effe00640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ee0066f60 0x7f5ee0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:33.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.311+0000 7f5effe00640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ee0066f60 0x7f5ee0069420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0b0000 tx=0x7f5eec00c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:33.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.315+0000 7f5efcc00640 1 -- 172.21.15.59:0/1416757691 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5ef4054d80 con 0x7f5f00072020 2024-04-25T09:02:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:33.479+0000 7f5f07a00640 1 -- 172.21.15.59:0/1416757691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5f0006ecf0 con 0x7f5f00072020 2024-04-25T09:02:34.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.127+0000 7f5efcc00640 1 -- 172.21.15.59:0/1416757691 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5ef405b0d0 con 0x7f5f00072020 2024-04-25T09:02:34.119 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-04-25T09:02:34.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.131+0000 7f5f07a00640 1 -- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ee0066f60 msgr2=0x7f5ee0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.131+0000 7f5f07a00640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ee0066f60 0x7f5ee0069420 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0b0000 tx=0x7f5eec00c040 comp rx=0 tx=0).stop 2024-04-25T09:02:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.131+0000 7f5f07a00640 1 -- 172.21.15.59:0/1416757691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f00072020 msgr2=0x7f5f0014d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.131+0000 7f5f07a00640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f00072020 0x7f5f0014d4a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c430 tx=0x7f5ef400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.131+0000 7f5f07a00640 1 -- 172.21.15.59:0/1416757691 shutdown_connections 2024-04-25T09:02:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.131+0000 7f5f07a00640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ee0066f60 0x7f5ee0069420 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.131+0000 7f5f07a00640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5f00157ae0 0x7f5f001f7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.131+0000 7f5f07a00640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5f000b47d0 0x7f5f00148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.131+0000 7f5f07a00640 1 --2- 172.21.15.59:0/1416757691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f00072020 0x7f5f0014d4a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.131+0000 7f5f07a00640 1 -- 172.21.15.59:0/1416757691 >> 172.21.15.59:0/1416757691 conn(0x7f5f0006ac10 msgr2=0x7f5f000b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.131+0000 7f5f07a00640 1 -- 172.21.15.59:0/1416757691 shutdown_connections 2024-04-25T09:02:34.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.131+0000 7f5f07a00640 1 -- 172.21.15.59:0/1416757691 wait complete. 2024-04-25T09:02:34.149 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T09:02:34.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.303+0000 7fee51200640 1 Processor -- start 2024-04-25T09:02:34.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.303+0000 7fee51200640 1 -- start start 2024-04-25T09:02:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee51200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee4c099a60 0x7fee4c099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee51200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee4c09a810 0x7fee4c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee51200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee4c09a380 con 0x7fee4c161420 2024-04-25T09:02:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee51200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c15e180 con 0x7fee4c099a60 2024-04-25T09:02:34.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee51200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c15e460 con 0x7fee4c09a810 2024-04-25T09:02:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee4b400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee4c099a60 0x7fee4c099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee43e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee4c09a810 0x7fee4c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee4be00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fee4c161420 0x7fee4c161870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:45172/0 (socket says 172.21.15.59:45172) 2024-04-25T09:02:34.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee4be00640 1 -- 172.21.15.59:0/905015376 learned_addr learned my addr 172.21.15.59:0/905015376 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:34.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee4b400640 1 -- 172.21.15.59:0/905015376 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee4c09a810 msgr2=0x7fee4c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:34.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee4b400640 1 --2- 172.21.15.59:0/905015376 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee4c09a810 0x7fee4c06bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee4b400640 1 -- 172.21.15.59:0/905015376 >> v1:172.21.15.178:6789/0 conn(0x7fee4c161420 legacy=0x7fee4c161870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.307+0000 7fee4b400640 1 -- 172.21.15.59:0/905015376 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c15e740 con 0x7fee4c099a60 2024-04-25T09:02:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee4b400640 1 --2- 172.21.15.59:0/905015376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee4c099a60 0x7fee4c099e40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0097c0 tx=0x7fee3c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eef7ad60515446a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee4aa00640 1 -- 172.21.15.59:0/905015376 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0ab600 con 0x7fee4c099a60 2024-04-25T09:02:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee4aa00640 1 -- 172.21.15.59:0/905015376 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c0b0070 con 0x7fee4c099a60 2024-04-25T09:02:34.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee4aa00640 1 -- 172.21.15.59:0/905015376 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0ab9c0 con 0x7fee4c099a60 2024-04-25T09:02:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee51200640 1 -- 172.21.15.59:0/905015376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee4c099a60 msgr2=0x7fee4c099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee51200640 1 --2- 172.21.15.59:0/905015376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee4c099a60 0x7fee4c099e40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0097c0 tx=0x7fee3c01c470 comp rx=0 tx=0).stop 2024-04-25T09:02:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee51200640 1 -- 172.21.15.59:0/905015376 shutdown_connections 2024-04-25T09:02:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee51200640 1 --2- 172.21.15.59:0/905015376 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee4c09a810 0x7fee4c06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee51200640 1 --2- 172.21.15.59:0/905015376 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee4c099a60 0x7fee4c099e40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee51200640 1 -- 172.21.15.59:0/905015376 >> 172.21.15.59:0/905015376 conn(0x7fee4c0d15b0 msgr2=0x7fee4c0d19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee51200640 1 -- 172.21.15.59:0/905015376 shutdown_connections 2024-04-25T09:02:34.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee51200640 1 -- 172.21.15.59:0/905015376 wait complete. 2024-04-25T09:02:34.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee51200640 1 Processor -- start 2024-04-25T09:02:34.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.311+0000 7fee51200640 1 -- start start 2024-04-25T09:02:34.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee51200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee4c099a60 0x7fee4c0b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee51200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee4c09a810 0x7fee4c160320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee51200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee4c161420 0x7fee4c153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee51200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c06c260 con 0x7fee4c161420 2024-04-25T09:02:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee51200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c06c3e0 con 0x7fee4c099a60 2024-04-25T09:02:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee51200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c16afd0 con 0x7fee4c09a810 2024-04-25T09:02:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee4be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee4c161420 0x7fee4c153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee4be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee4c161420 0x7fee4c153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:38452/0 (socket says 172.21.15.59:38452) 2024-04-25T09:02:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee4be00640 1 -- 172.21.15.59:0/467906463 learned_addr learned my addr 172.21.15.59:0/467906463 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee4b400640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee4c099a60 0x7fee4c0b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee43e00640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee4c09a810 0x7fee4c160320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee4be00640 1 -- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee4c09a810 msgr2=0x7fee4c160320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee4be00640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee4c09a810 0x7fee4c160320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee4be00640 1 -- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee4c099a60 msgr2=0x7fee4c0b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee4be00640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee4c099a60 0x7fee4c0b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee4be00640 1 -- 172.21.15.59:0/467906463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c1f80b0 con 0x7fee4c161420 2024-04-25T09:02:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee4be00640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee4c161420 0x7fee4c153af0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fee4400cbc0 tx=0x7fee4400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee43400640 1 -- 172.21.15.59:0/467906463 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44017070 con 0x7fee4c161420 2024-04-25T09:02:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee43400640 1 -- 172.21.15.59:0/467906463 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4400ad40 con 0x7fee4c161420 2024-04-25T09:02:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee51200640 1 -- 172.21.15.59:0/467906463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c160a70 con 0x7fee4c161420 2024-04-25T09:02:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee43400640 1 -- 172.21.15.59:0/467906463 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee44012600 con 0x7fee4c161420 2024-04-25T09:02:34.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee51200640 1 -- 172.21.15.59:0/467906463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c1f72f0 con 0x7fee4c161420 2024-04-25T09:02:34.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.315+0000 7fee51200640 1 -- 172.21.15.59:0/467906463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c0745d0 con 0x7fee4c161420 2024-04-25T09:02:34.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.319+0000 7fee43400640 1 -- 172.21.15.59:0/467906463 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fee4401a070 con 0x7fee4c161420 2024-04-25T09:02:34.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.319+0000 7fee43400640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee28066f60 0x7fee28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:34.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.319+0000 7fee43400640 1 -- 172.21.15.59:0/467906463 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fee44084da0 con 0x7fee4c161420 2024-04-25T09:02:34.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.319+0000 7fee4b400640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee28066f60 0x7fee28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:34.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.319+0000 7fee4b400640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee28066f60 0x7fee28069420 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0af000 tx=0x7fee3c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:34.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.323+0000 7fee43400640 1 -- 172.21.15.59:0/467906463 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fee44055630 con 0x7fee4c161420 2024-04-25T09:02:34.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:34.483+0000 7fee51200640 1 -- 172.21.15.59:0/467906463 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fee4c168590 con 0x7fee4c161420 2024-04-25T09:02:35.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.139+0000 7fee43400640 1 -- 172.21.15.59:0/467906463 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7fee440596d0 con 0x7fee4c161420 2024-04-25T09:02:35.133 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data_ec' removed 2024-04-25T09:02:35.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.143+0000 7fee51200640 1 -- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee28066f60 msgr2=0x7fee28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:35.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.143+0000 7fee51200640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee28066f60 0x7fee28069420 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0af000 tx=0x7fee3c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:35.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.143+0000 7fee51200640 1 -- 172.21.15.59:0/467906463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee4c161420 msgr2=0x7fee4c153af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:35.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.143+0000 7fee51200640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee4c161420 0x7fee4c153af0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fee4400cbc0 tx=0x7fee4400a430 comp rx=0 tx=0).stop 2024-04-25T09:02:35.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.143+0000 7fee51200640 1 -- 172.21.15.59:0/467906463 shutdown_connections 2024-04-25T09:02:35.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.143+0000 7fee51200640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee28066f60 0x7fee28069420 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:35.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.143+0000 7fee51200640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee4c161420 0x7fee4c153af0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:35.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.143+0000 7fee51200640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee4c09a810 0x7fee4c160320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:35.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.143+0000 7fee51200640 1 --2- 172.21.15.59:0/467906463 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee4c099a60 0x7fee4c0b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:35.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.143+0000 7fee51200640 1 -- 172.21.15.59:0/467906463 >> 172.21.15.59:0/467906463 conn(0x7fee4c0d15b0 msgr2=0x7fee4c161830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:35.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.143+0000 7fee51200640 1 -- 172.21.15.59:0/467906463 shutdown_connections 2024-04-25T09:02:35.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:35.143+0000 7fee51200640 1 -- 172.21.15.59:0/467906463 wait complete. 2024-04-25T09:02:35.162 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:02:35.162 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:02:35.162 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:02:35.162 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:02:35.163 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:02:35.163 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:02:35.163 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:02:35.163 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:02:35.163 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:02:35.163 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:02:35.163 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:02:35.164 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:02:35.164 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:02:35.164 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:02:35.164 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:02:35.164 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:02:35.176 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:02:35.176 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:02:35.178 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:02:35.178 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:02:35.178 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:02:35.179 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:02:35.223 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:02:35.223 DEBUG:teuthology.parallel:result is None 2024-04-25T09:02:35.224 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:02:35.224 DEBUG:teuthology.parallel:result is None 2024-04-25T09:02:35.227 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:02:35.227 DEBUG:teuthology.parallel:result is None 2024-04-25T09:02:35.309 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-04-25T09:02:35.309 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-04-25T09:02:35.315 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T09:02:36.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-25T09:02:41.176 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:02:41.176 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:02:41.181 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:02:41.181 DEBUG:teuthology.parallel:result is None 2024-04-25T09:02:41.182 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:02:41.274 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:02:41.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd2c400640 1 Processor -- start 2024-04-25T09:02:41.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd2c400640 1 -- start start 2024-04-25T09:02:41.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd2c400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd24159320 0x7fdd2415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd2c400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2415fc00 con 0x7fdd2415f440 2024-04-25T09:02:41.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd2c400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd2415fee0 con 0x7fdd2406e4a0 2024-04-25T09:02:41.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd2c400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2406d640 con 0x7fdd24159320 2024-04-25T09:02:41.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd29000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdd2415f440 0x7fdd2406dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44990/0 (socket says 172.21.15.59:44990) 2024-04-25T09:02:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd29000640 1 -- 172.21.15.59:0/703200773 learned_addr learned my addr 172.21.15.59:0/703200773 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd29a00640 1 --2- 172.21.15.59:0/703200773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd24159320 0x7fdd2415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd23e00640 1 -- 172.21.15.59:0/703200773 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812436693 0 0) 0x7fdd2415fc00 con 0x7fdd2415f440 2024-04-25T09:02:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd23e00640 1 -- 172.21.15.59:0/703200773 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd0c003530 con 0x7fdd2415f440 2024-04-25T09:02:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd23e00640 1 -- 172.21.15.59:0/703200773 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631054364 0 0) 0x7fdd2415fee0 con 0x7fdd2406e4a0 2024-04-25T09:02:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd23e00640 1 -- 172.21.15.59:0/703200773 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd2415fc00 con 0x7fdd2406e4a0 2024-04-25T09:02:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd29a00640 1 -- 172.21.15.59:0/703200773 >> v1:172.21.15.178:6789/0 conn(0x7fdd2406e4a0 legacy=0x7fdd24071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd29a00640 1 -- 172.21.15.59:0/703200773 >> v1:172.21.15.59:6789/0 conn(0x7fdd2415f440 legacy=0x7fdd2406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.343+0000 7fdd29a00640 1 -- 172.21.15.59:0/703200773 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd241601c0 con 0x7fdd24159320 2024-04-25T09:02:41.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.347+0000 7fdd29a00640 1 --2- 172.21.15.59:0/703200773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd24159320 0x7fdd2415c9b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdd180097f0 tx=0x7fdd1801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcd42c2527eec239 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.347+0000 7fdd23e00640 1 -- 172.21.15.59:0/703200773 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd180b1070 con 0x7fdd24159320 2024-04-25T09:02:41.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.347+0000 7fdd23e00640 1 -- 172.21.15.59:0/703200773 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd180ac620 con 0x7fdd24159320 2024-04-25T09:02:41.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.347+0000 7fdd23e00640 1 -- 172.21.15.59:0/703200773 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd180ac9f0 con 0x7fdd24159320 2024-04-25T09:02:41.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.347+0000 7fdd2c400640 1 -- 172.21.15.59:0/703200773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd24159320 msgr2=0x7fdd2415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.347+0000 7fdd2c400640 1 --2- 172.21.15.59:0/703200773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd24159320 0x7fdd2415c9b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdd180097f0 tx=0x7fdd1801c420 comp rx=0 tx=0).stop 2024-04-25T09:02:41.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.347+0000 7fdd2c400640 1 -- 172.21.15.59:0/703200773 shutdown_connections 2024-04-25T09:02:41.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.347+0000 7fdd2c400640 1 --2- 172.21.15.59:0/703200773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd24159320 0x7fdd2415c9b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.347+0000 7fdd2c400640 1 -- 172.21.15.59:0/703200773 >> 172.21.15.59:0/703200773 conn(0x7fdd24067080 msgr2=0x7fdd2406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:41.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.347+0000 7fdd2c400640 1 -- 172.21.15.59:0/703200773 shutdown_connections 2024-04-25T09:02:41.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.347+0000 7fdd2c400640 1 -- 172.21.15.59:0/703200773 wait complete. 2024-04-25T09:02:41.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2c400640 1 Processor -- start 2024-04-25T09:02:41.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2c400640 1 -- start start 2024-04-25T09:02:41.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2c400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2406e4a0 0x7fdd2415e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2c400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd24159320 0x7fdd24158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2c400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd2415f440 0x7fdd2415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2c400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2415f9a0 con 0x7fdd2415f440 2024-04-25T09:02:41.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2c400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2415f820 con 0x7fdd2406e4a0 2024-04-25T09:02:41.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2c400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd24071980 con 0x7fdd24159320 2024-04-25T09:02:41.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd2415f440 0x7fdd2415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd2415f440 0x7fdd2415d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32806/0 (socket says 172.21.15.59:32806) 2024-04-25T09:02:41.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2a400640 1 -- 172.21.15.59:0/2971356004 learned_addr learned my addr 172.21.15.59:0/2971356004 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:41.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd29a00640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2406e4a0 0x7fdd2415e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd29000640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd24159320 0x7fdd24158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2a400640 1 -- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd24159320 msgr2=0x7fdd24158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2a400640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd24159320 0x7fdd24158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2a400640 1 -- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2406e4a0 msgr2=0x7fdd2415e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:41.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2a400640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2406e4a0 0x7fdd2415e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:41.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2a400640 1 -- 172.21.15.59:0/2971356004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd2412f7a0 con 0x7fdd2415f440 2024-04-25T09:02:41.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd29000640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd24159320 0x7fdd24158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:41.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2a400640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd2415f440 0x7fdd2415d7b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00c760 tx=0x7fdd1c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd21600640 1 -- 172.21.15.59:0/2971356004 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c003b80 con 0x7fdd2415f440 2024-04-25T09:02:41.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd21600640 1 -- 172.21.15.59:0/2971356004 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1c003d20 con 0x7fdd2415f440 2024-04-25T09:02:41.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd21600640 1 -- 172.21.15.59:0/2971356004 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1c00aa90 con 0x7fdd2415f440 2024-04-25T09:02:41.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2c400640 1 -- 172.21.15.59:0/2971356004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2412fa80 con 0x7fdd2415f440 2024-04-25T09:02:41.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.351+0000 7fdd2c400640 1 -- 172.21.15.59:0/2971356004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd24130040 con 0x7fdd2415f440 2024-04-25T09:02:41.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.355+0000 7fdd2c400640 1 -- 172.21.15.59:0/2971356004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd24130240 con 0x7fdd2415f440 2024-04-25T09:02:41.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.355+0000 7fdd21600640 1 -- 172.21.15.59:0/2971356004 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdd1c00ac30 con 0x7fdd2415f440 2024-04-25T09:02:41.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.355+0000 7fdd21600640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd04066f60 0x7fdd04069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:41.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.355+0000 7fdd21600640 1 -- 172.21.15.59:0/2971356004 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fdd1c084d40 con 0x7fdd2415f440 2024-04-25T09:02:41.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.355+0000 7fdd29a00640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd04066f60 0x7fdd04069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:41.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.359+0000 7fdd29a00640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd04066f60 0x7fdd04069420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdd180ae000 tx=0x7fdd180a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:41.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.359+0000 7fdd21600640 1 -- 172.21.15.59:0/2971356004 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd24130240 con 0x7fdd2415f440 2024-04-25T09:02:41.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:41.535+0000 7fdd2c400640 1 -- 172.21.15.59:0/2971356004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdd2415e590 con 0x7fdd2415f440 2024-04-25T09:02:43.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.179+0000 7fdd21600640 1 -- 172.21.15.59:0/2971356004 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdd1c055ec0 con 0x7fdd2415f440 2024-04-25T09:02:43.170 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-04-25T09:02:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.183+0000 7fdd2c400640 1 -- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd04066f60 msgr2=0x7fdd04069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.183+0000 7fdd2c400640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd04066f60 0x7fdd04069420 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdd180ae000 tx=0x7fdd180a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.183+0000 7fdd2c400640 1 -- 172.21.15.59:0/2971356004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd2415f440 msgr2=0x7fdd2415d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.183+0000 7fdd2c400640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd2415f440 0x7fdd2415d7b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fdd1c00c760 tx=0x7fdd1c00cc20 comp rx=0 tx=0).stop 2024-04-25T09:02:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.183+0000 7fdd2c400640 1 -- 172.21.15.59:0/2971356004 shutdown_connections 2024-04-25T09:02:43.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.183+0000 7fdd2c400640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd04066f60 0x7fdd04069420 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.183+0000 7fdd2c400640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd2415f440 0x7fdd2415d7b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.183+0000 7fdd2c400640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd24159320 0x7fdd24158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.183+0000 7fdd2c400640 1 --2- 172.21.15.59:0/2971356004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd2406e4a0 0x7fdd2415e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.183+0000 7fdd2c400640 1 -- 172.21.15.59:0/2971356004 >> 172.21.15.59:0/2971356004 conn(0x7fdd24067080 msgr2=0x7fdd240adf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.183+0000 7fdd2c400640 1 -- 172.21.15.59:0/2971356004 shutdown_connections 2024-04-25T09:02:43.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.183+0000 7fdd2c400640 1 -- 172.21.15.59:0/2971356004 wait complete. 2024-04-25T09:02:43.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:02:43.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c3a00640 1 Processor -- start 2024-04-25T09:02:43.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c3a00640 1 -- start start 2024-04-25T09:02:43.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c3a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86bc070fe0 0x7f86bc161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c3a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f86bc071830 0x7f86bc15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c3a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86bc06d090 con 0x7f86bc0713c0 2024-04-25T09:02:43.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c3a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86bc162390 con 0x7f86bc070fe0 2024-04-25T09:02:43.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c3a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86bc161af0 con 0x7f86bc071830 2024-04-25T09:02:43.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c1000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86bc070fe0 0x7f86bc161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c1000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86bc070fe0 0x7f86bc161510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32822/0 (socket says 172.21.15.59:32822) 2024-04-25T09:02:43.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c1000640 1 -- 172.21.15.59:0/635413771 learned_addr learned my addr 172.21.15.59:0/635413771 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:43.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c1a00640 1 --2- 172.21.15.59:0/635413771 >> v2:172.21.15.178:3300/0 conn(0x7f86bc071830 0x7f86bc15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c1000640 1 -- 172.21.15.59:0/635413771 >> v2:172.21.15.178:3300/0 conn(0x7f86bc071830 msgr2=0x7f86bc15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:43.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c1000640 1 --2- 172.21.15.59:0/635413771 >> v2:172.21.15.178:3300/0 conn(0x7f86bc071830 0x7f86bc15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c1000640 1 -- 172.21.15.59:0/635413771 >> v1:172.21.15.178:6789/0 conn(0x7f86bc0713c0 legacy=0x7f86bc143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:43.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.355+0000 7f86c1000640 1 -- 172.21.15.59:0/635413771 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc161dd0 con 0x7f86bc070fe0 2024-04-25T09:02:43.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.359+0000 7f86c1000640 1 --2- 172.21.15.59:0/635413771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc070fe0 0x7f86bc161510 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f86bc147660 tx=0x7f86b001c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46dc0d19169207 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.359+0000 7f86bb400640 1 -- 172.21.15.59:0/635413771 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b00b0070 con 0x7f86bc070fe0 2024-04-25T09:02:43.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.359+0000 7f86bb400640 1 -- 172.21.15.59:0/635413771 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b00ab600 con 0x7f86bc070fe0 2024-04-25T09:02:43.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.359+0000 7f86bb400640 1 -- 172.21.15.59:0/635413771 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b00ab9d0 con 0x7f86bc070fe0 2024-04-25T09:02:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.359+0000 7f86c3a00640 1 -- 172.21.15.59:0/635413771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc070fe0 msgr2=0x7f86bc161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.359+0000 7f86c3a00640 1 --2- 172.21.15.59:0/635413771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc070fe0 0x7f86bc161510 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f86bc147660 tx=0x7f86b001c2d0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.359+0000 7f86c3a00640 1 -- 172.21.15.59:0/635413771 shutdown_connections 2024-04-25T09:02:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.359+0000 7f86c3a00640 1 --2- 172.21.15.59:0/635413771 >> v2:172.21.15.178:3300/0 conn(0x7f86bc071830 0x7f86bc15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.359+0000 7f86c3a00640 1 --2- 172.21.15.59:0/635413771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc070fe0 0x7f86bc161510 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.359+0000 7f86c3a00640 1 -- 172.21.15.59:0/635413771 >> 172.21.15.59:0/635413771 conn(0x7f86bc0b3390 msgr2=0x7f86bc0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.359+0000 7f86c3a00640 1 -- 172.21.15.59:0/635413771 shutdown_connections 2024-04-25T09:02:43.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.359+0000 7f86c3a00640 1 -- 172.21.15.59:0/635413771 wait complete. 2024-04-25T09:02:43.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c3a00640 1 Processor -- start 2024-04-25T09:02:43.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c3a00640 1 -- start start 2024-04-25T09:02:43.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c3a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86bc070fe0 0x7f86bc153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c3a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86bc0713c0 0x7f86bc0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c3a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc071830 0x7f86bc0b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c3a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc0b06c0 con 0x7f86bc071830 2024-04-25T09:02:43.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c3a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc0b0540 con 0x7f86bc070fe0 2024-04-25T09:02:43.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c3a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86bc0b0840 con 0x7f86bc0713c0 2024-04-25T09:02:43.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc071830 0x7f86bc0b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc071830 0x7f86bc0b49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32830/0 (socket says 172.21.15.59:32830) 2024-04-25T09:02:43.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c1a00640 1 -- 172.21.15.59:0/3500364273 learned_addr learned my addr 172.21.15.59:0/3500364273 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:43.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c1000640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86bc070fe0 0x7f86bc153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86bbe00640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86bc0713c0 0x7f86bc0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c1a00640 1 -- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86bc0713c0 msgr2=0x7f86bc0b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c1a00640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86bc0713c0 0x7f86bc0b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c1a00640 1 -- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86bc070fe0 msgr2=0x7f86bc153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c1a00640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86bc070fe0 0x7f86bc153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c1a00640 1 -- 172.21.15.59:0/3500364273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86bc157450 con 0x7f86bc071830 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c1000640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86bc070fe0 0x7f86bc153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c1a00640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc071830 0x7f86bc0b49c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f86b4007e90 tx=0x7f86b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86b8c00640 1 -- 172.21.15.59:0/3500364273 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4014420 con 0x7f86bc071830 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86b8c00640 1 -- 172.21.15.59:0/3500364273 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b4019070 con 0x7f86bc071830 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86b8c00640 1 -- 172.21.15.59:0/3500364273 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b4014800 con 0x7f86bc071830 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c3a00640 1 -- 172.21.15.59:0/3500364273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86bc0b4ff0 con 0x7f86bc071830 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c3a00640 1 -- 172.21.15.59:0/3500364273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86bc154b60 con 0x7f86bc071830 2024-04-25T09:02:43.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.363+0000 7f86c3a00640 1 -- 172.21.15.59:0/3500364273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86bc0745d0 con 0x7f86bc071830 2024-04-25T09:02:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.367+0000 7f86b8c00640 1 -- 172.21.15.59:0/3500364273 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f86b40149a0 con 0x7f86bc071830 2024-04-25T09:02:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.367+0000 7f86b8c00640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f869c066f60 0x7f869c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.367+0000 7f86b8c00640 1 -- 172.21.15.59:0/3500364273 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f86b40856c0 con 0x7f86bc071830 2024-04-25T09:02:43.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.367+0000 7f86c1000640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f869c066f60 0x7f869c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.367+0000 7f86c1000640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f869c066f60 0x7f869c069420 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f86b00ad000 tx=0x7f86b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.371+0000 7f86b8c00640 1 -- 172.21.15.59:0/3500364273 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f86b4011260 con 0x7f86bc071830 2024-04-25T09:02:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.587+0000 7f86c3a00640 1 -- 172.21.15.59:0/3500364273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f86bc0cef80 con 0x7f86bc071830 2024-04-25T09:02:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86b8c00640 1 -- 172.21.15.59:0/3500364273 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f86b4056880 con 0x7f86bc071830 2024-04-25T09:02:43.581 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:43.582 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:02:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-04-25T09:02:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-04-25T09:02:43.582 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmefAMLRAAyOhrYPGN2IYchV7wMDkkTQ==", 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.583 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-04-25T09:02:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmcZtGORAA9RU5OkQHTCXe5nkpEp77Fw==", 2024-04-25T09:02:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:02:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:02:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:02:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.584 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-04-25T09:02:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmF3skNBAAcKEUsLnvjEY8fz59SnjWtg==", 2024-04-25T09:02:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:02:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:02:43.585 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm95/1BBAAsIbA6GBVS4dl7sZ8CoZoLA==", 2024-04-25T09:02:43.586 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.587 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCsGypmmikBDRAAcxA0eWyo/w0bALsf4Fb3KQ==", 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.588 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCvGypm66dNFxAAzl06IBbHoxHorB3FuCFNOQ==", 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCyGypmQrwdIhAAyF53f8p7/vnJ6L4ZjXcKhQ==", 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.589 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC1GypmtETmLBAAM4p1FOPAiB0aOcdfIcl6vg==", 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.590 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC6GypmyXGCAhAAKJ2Yh0lezpRfFMPXjN4Asg==", 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC9GypmmfZZDBAAzw9IygUbRErERr2lXEfutA==", 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.591 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDAGypmS4KRFRAAXrvA1QNbuWF6+ln+cz6orQ==", 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-04-25T09:02:43.592 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDDGypmruPJHRAAWFONkZiSsYgvsr04uO9J9A==", 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg==", 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:02:43.593 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm8NCkEhAAEELIQ7EAUFHsANHAa5EnTA==", 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-04-25T09:02:43.594 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmdosADxAAxmQqp2O5lT5XenyqxyyMKw==", 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmsqWgGBAAIXaSazGZkKiY2hqcC+WApA==", 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:02:43.595 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypm5ldPEBAAepEqWPcDy8atp78XxKERYg==", 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-mds", 2024-04-25T09:02:43.596 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDOGypmEo94IBAARR0w6LssvKB+NL6qMfKmnw==", 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-mds" 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-mgr", 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDOGypmxJl4IBAAx7fJ9nbzLD5/HWCZtbPmZQ==", 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-osd", 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDOGypmsqJ4IBAAWnwGUYk7xudDPNKImFW4iQ==", 2024-04-25T09:02:43.597 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-osd" 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-rbd", 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDOGypmYqt4IBAAqn+nx9HRqWn8ZKAO1YX4uw==", 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDOGypmO7R4IBAAMvTloARz5M2ZZa7Obvnr7w==", 2024-04-25T09:02:43.598 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.bootstrap-rgw", 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDOGypmEL14IBAABfcJEOpXMxzSB4L7DLbgtg==", 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmwOe7KBAAIvO6OJiUeb5hRdu9VX11cA==", 2024-04-25T09:02:43.599 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmX2GpJBAA8RvpxNpdPFExISwQzT56fA==", 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-25T09:02:43.600 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:02:43.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86c3a00640 1 -- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f869c066f60 msgr2=0x7f869c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86c3a00640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f869c066f60 0x7f869c069420 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f86b00ad000 tx=0x7f86b0008040 comp rx=0 tx=0).stop 2024-04-25T09:02:43.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86c3a00640 1 -- 172.21.15.59:0/3500364273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc071830 msgr2=0x7f86bc0b49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86c3a00640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc071830 0x7f86bc0b49c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f86b4007e90 tx=0x7f86b400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86c3a00640 1 -- 172.21.15.59:0/3500364273 shutdown_connections 2024-04-25T09:02:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86c3a00640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f869c066f60 0x7f869c069420 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86c3a00640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86bc071830 0x7f86bc0b49c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86c3a00640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86bc0713c0 0x7f86bc0b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86c3a00640 1 --2- 172.21.15.59:0/3500364273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86bc070fe0 0x7f86bc153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86c3a00640 1 -- 172.21.15.59:0/3500364273 >> 172.21.15.59:0/3500364273 conn(0x7f86bc0b3390 msgr2=0x7f86bc0d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86c3a00640 1 -- 172.21.15.59:0/3500364273 shutdown_connections 2024-04-25T09:02:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.591+0000 7f86c3a00640 1 -- 172.21.15.59:0/3500364273 wait complete. 2024-04-25T09:02:43.603 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-25T09:02:43.702 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-25T09:02:43.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f19400640 1 Processor -- start 2024-04-25T09:02:43.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f19400640 1 -- start start 2024-04-25T09:02:43.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f19400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f14144120 0x7f9f1415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f19400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f140ccbf0 0x7f9f1415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f19400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f1415bc40 con 0x7f9f1415ee60 2024-04-25T09:02:43.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f19400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1415e490 con 0x7f9f140ccbf0 2024-04-25T09:02:43.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f19400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1415b3a0 con 0x7f9f14144120 2024-04-25T09:02:43.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f13200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9f1415ee60 0x7f9f140b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44996/0 (socket says 172.21.15.59:44996) 2024-04-25T09:02:43.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f13200640 1 -- 172.21.15.59:0/2273156278 learned_addr learned my addr 172.21.15.59:0/2273156278 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:43.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f12800640 1 --2- 172.21.15.59:0/2273156278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f14144120 0x7f9f1415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f09e00640 1 --2- 172.21.15.59:0/2273156278 >> v2:172.21.15.178:3300/0 conn(0x7f9f140ccbf0 0x7f9f1415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f11e00640 1 -- 172.21.15.59:0/2273156278 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693641656 0 0) 0x7f9f1415bc40 con 0x7f9f1415ee60 2024-04-25T09:02:43.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f11e00640 1 -- 172.21.15.59:0/2273156278 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef8003530 con 0x7f9f1415ee60 2024-04-25T09:02:43.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f12800640 1 -- 172.21.15.59:0/2273156278 >> v2:172.21.15.178:3300/0 conn(0x7f9f140ccbf0 msgr2=0x7f9f1415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:43.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f12800640 1 --2- 172.21.15.59:0/2273156278 >> v2:172.21.15.178:3300/0 conn(0x7f9f140ccbf0 0x7f9f1415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f12800640 1 -- 172.21.15.59:0/2273156278 >> v1:172.21.15.59:6789/0 conn(0x7f9f1415ee60 legacy=0x7f9f140b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f12800640 1 -- 172.21.15.59:0/2273156278 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1415b680 con 0x7f9f14144120 2024-04-25T09:02:43.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.755+0000 7f9f09e00640 1 --2- 172.21.15.59:0/2273156278 >> v2:172.21.15.178:3300/0 conn(0x7f9f140ccbf0 0x7f9f1415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.759+0000 7f9f12800640 1 --2- 172.21.15.59:0/2273156278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f14144120 0x7f9f1415acd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f040097c0 tx=0x7f9f0401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8596e81bd6677f05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.759+0000 7f9f11e00640 1 -- 172.21.15.59:0/2273156278 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f040b0070 con 0x7f9f14144120 2024-04-25T09:02:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.759+0000 7f9f11e00640 1 -- 172.21.15.59:0/2273156278 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f040ab600 con 0x7f9f14144120 2024-04-25T09:02:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.759+0000 7f9f11e00640 1 -- 172.21.15.59:0/2273156278 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f040ab9d0 con 0x7f9f14144120 2024-04-25T09:02:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.759+0000 7f9f19400640 1 -- 172.21.15.59:0/2273156278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f14144120 msgr2=0x7f9f1415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.759+0000 7f9f19400640 1 --2- 172.21.15.59:0/2273156278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f14144120 0x7f9f1415acd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f040097c0 tx=0x7f9f0401c410 comp rx=0 tx=0).stop 2024-04-25T09:02:43.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.759+0000 7f9f19400640 1 -- 172.21.15.59:0/2273156278 shutdown_connections 2024-04-25T09:02:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.759+0000 7f9f19400640 1 --2- 172.21.15.59:0/2273156278 >> v2:172.21.15.178:3300/0 conn(0x7f9f140ccbf0 0x7f9f1415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.759+0000 7f9f19400640 1 --2- 172.21.15.59:0/2273156278 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f14144120 0x7f9f1415acd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.759+0000 7f9f19400640 1 -- 172.21.15.59:0/2273156278 >> 172.21.15.59:0/2273156278 conn(0x7f9f14067080 msgr2=0x7f9f1406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.759+0000 7f9f19400640 1 -- 172.21.15.59:0/2273156278 shutdown_connections 2024-04-25T09:02:43.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.759+0000 7f9f19400640 1 -- 172.21.15.59:0/2273156278 wait complete. 2024-04-25T09:02:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f19400640 1 Processor -- start 2024-04-25T09:02:43.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f19400640 1 -- start start 2024-04-25T09:02:43.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f19400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f140ccbf0 0x7f9f140ae330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f19400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f14144120 0x7f9f14142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f19400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1415ee60 0x7f9f14159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f19400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f141675c0 con 0x7f9f1415ee60 2024-04-25T09:02:43.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f19400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f14167440 con 0x7f9f140ccbf0 2024-04-25T09:02:43.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f19400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f14167740 con 0x7f9f14144120 2024-04-25T09:02:43.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f13200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1415ee60 0x7f9f14159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f13200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1415ee60 0x7f9f14159ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32846/0 (socket says 172.21.15.59:32846) 2024-04-25T09:02:43.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f13200640 1 -- 172.21.15.59:0/2800792399 learned_addr learned my addr 172.21.15.59:0/2800792399 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f12800640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f140ccbf0 0x7f9f140ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f09e00640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f14144120 0x7f9f14142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f13200640 1 -- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f14144120 msgr2=0x7f9f14142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f13200640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f14144120 0x7f9f14142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f13200640 1 -- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f140ccbf0 msgr2=0x7f9f140ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f13200640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f140ccbf0 0x7f9f140ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f13200640 1 -- 172.21.15.59:0/2800792399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f141606d0 con 0x7f9f1415ee60 2024-04-25T09:02:43.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f13200640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1415ee60 0x7f9f14159ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00caa0 tx=0x7f9f0c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f0b400640 1 -- 172.21.15.59:0/2800792399 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c017070 con 0x7f9f1415ee60 2024-04-25T09:02:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f0b400640 1 -- 172.21.15.59:0/2800792399 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f0c00aba0 con 0x7f9f1415ee60 2024-04-25T09:02:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f0b400640 1 -- 172.21.15.59:0/2800792399 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0c012400 con 0x7f9f1415ee60 2024-04-25T09:02:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f19400640 1 -- 172.21.15.59:0/2800792399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f141f9e70 con 0x7f9f1415ee60 2024-04-25T09:02:43.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.763+0000 7f9f19400640 1 -- 172.21.15.59:0/2800792399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f141fa430 con 0x7f9f1415ee60 2024-04-25T09:02:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.767+0000 7f9f19400640 1 -- 172.21.15.59:0/2800792399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f140745d0 con 0x7f9f1415ee60 2024-04-25T09:02:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.767+0000 7f9f0b400640 1 -- 172.21.15.59:0/2800792399 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9f0c01a070 con 0x7f9f1415ee60 2024-04-25T09:02:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.767+0000 7f9f0b400640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9ef0066f60 0x7f9ef0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.767+0000 7f9f0b400640 1 -- 172.21.15.59:0/2800792399 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f9f0c084b10 con 0x7f9f1415ee60 2024-04-25T09:02:43.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.767+0000 7f9f12800640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9ef0066f60 0x7f9ef0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:43.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.771+0000 7f9f12800640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9ef0066f60 0x7f9ef0069420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f040ad000 tx=0x7f9f04008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:43.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.771+0000 7f9f0b400640 1 -- 172.21.15.59:0/2800792399 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9f0c055690 con 0x7f9f1415ee60 2024-04-25T09:02:43.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.987+0000 7f9f19400640 1 -- 172.21.15.59:0/2800792399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f9f14141280 con 0x7f9f1415ee60 2024-04-25T09:02:43.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.991+0000 7f9f0b400640 1 -- 172.21.15.59:0/2800792399 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9f0c059730 con 0x7f9f1415ee60 2024-04-25T09:02:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.991+0000 7f9f19400640 1 -- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9ef0066f60 msgr2=0x7f9ef0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.991+0000 7f9f19400640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9ef0066f60 0x7f9ef0069420 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9f040ad000 tx=0x7f9f04008040 comp rx=0 tx=0).stop 2024-04-25T09:02:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.991+0000 7f9f19400640 1 -- 172.21.15.59:0/2800792399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1415ee60 msgr2=0x7f9f14159ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:43.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.991+0000 7f9f19400640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1415ee60 0x7f9f14159ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9f0c00caa0 tx=0x7f9f0c00cf60 comp rx=0 tx=0).stop 2024-04-25T09:02:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.995+0000 7f9f19400640 1 -- 172.21.15.59:0/2800792399 shutdown_connections 2024-04-25T09:02:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.995+0000 7f9f19400640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9ef0066f60 0x7f9ef0069420 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.995+0000 7f9f19400640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f1415ee60 0x7f9f14159ab0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.995+0000 7f9f19400640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f14144120 0x7f9f14142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.995+0000 7f9f19400640 1 --2- 172.21.15.59:0/2800792399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f140ccbf0 0x7f9f140ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.995+0000 7f9f19400640 1 -- 172.21.15.59:0/2800792399 >> 172.21.15.59:0/2800792399 conn(0x7f9f14067080 msgr2=0x7f9f140b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.995+0000 7f9f19400640 1 -- 172.21.15.59:0/2800792399 shutdown_connections 2024-04-25T09:02:43.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:43.995+0000 7f9f19400640 1 -- 172.21.15.59:0/2800792399 wait complete. 2024-04-25T09:02:44.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-25T09:02:44.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.155+0000 7f24fa800640 1 Processor -- start 2024-04-25T09:02:44.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.155+0000 7f24fa800640 1 -- start start 2024-04-25T09:02:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.155+0000 7f24fa800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f415dc60 0x7f24f40d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.155+0000 7f24fa800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f24f406bf30 0x7f24f40cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.155+0000 7f24fa800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24f415e040 con 0x7f24f4099a60 2024-04-25T09:02:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.155+0000 7f24fa800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24f40cff80 con 0x7f24f406bf30 2024-04-25T09:02:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.155+0000 7f24fa800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40d0260 con 0x7f24f415dc60 2024-04-25T09:02:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.155+0000 7f24f3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f24f4099a60 0x7f24f40cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45002/0 (socket says 172.21.15.59:45002) 2024-04-25T09:02:44.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.155+0000 7f24f3e00640 1 -- 172.21.15.59:0/2247571289 learned_addr learned my addr 172.21.15.59:0/2247571289 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.155+0000 7f24f3400640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f415dc60 0x7f24f40d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.155+0000 7f24ebe00640 1 --2- 172.21.15.59:0/2247571289 >> v2:172.21.15.178:3300/0 conn(0x7f24f406bf30 0x7f24f40cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777496484 0 0) 0x7f24f415e040 con 0x7f24f4099a60 2024-04-25T09:02:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24d8003530 con 0x7f24f4099a60 2024-04-25T09:02:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1182679759 0 0) 0x7f24d8003530 con 0x7f24f4099a60 2024-04-25T09:02:44.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f415dc60 msgr2=0x7f24f40d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f415dc60 0x7f24f40d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 >> v2:172.21.15.178:3300/0 conn(0x7f24f406bf30 msgr2=0x7f24f40cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 --2- 172.21.15.59:0/2247571289 >> v2:172.21.15.178:3300/0 conn(0x7f24f406bf30 0x7f24f40cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f40d0540 con 0x7f24f4099a60 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f24ec001a00 con 0x7f24f4099a60 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 >> v1:172.21.15.59:6789/0 conn(0x7f24f4099a60 legacy=0x7f24f40cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f415dc60 0x7f24d80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d8003f40 0x7f24d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24d8004d50 0x7f24d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40cff80 con 0x7f24d8003f40 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40d0260 con 0x7f24d8004d50 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d800ba20 con 0x7f24f415dc60 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24ebe00640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d8003f40 0x7f24d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f3400640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f415dc60 0x7f24d80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f3e00640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24d8004d50 0x7f24d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24ebe00640 1 -- 172.21.15.59:0/2247571289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f415dc60 msgr2=0x7f24d80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24ebe00640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f415dc60 0x7f24d80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24ebe00640 1 -- 172.21.15.59:0/2247571289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24d8004d50 msgr2=0x7f24d80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24ebe00640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24d8004d50 0x7f24d80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24ebe00640 1 -- 172.21.15.59:0/2247571289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d8003530 con 0x7f24d8003f40 2024-04-25T09:02:44.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.159+0000 7f24f3e00640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24d8004d50 0x7f24d80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24ebe00640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d8003f40 0x7f24d8004810 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f24dc009b10 tx=0x7f24dc01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fb9664baaf7d52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc0b2070 con 0x7f24d8003f40 2024-04-25T09:02:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24dc0a5560 con 0x7f24d8003f40 2024-04-25T09:02:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24f2a00640 1 -- 172.21.15.59:0/2247571289 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24dc0096b0 con 0x7f24d8003f40 2024-04-25T09:02:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 -- 172.21.15.59:0/2247571289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d8003f40 msgr2=0x7f24d8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 --2- 172.21.15.59:0/2247571289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d8003f40 0x7f24d8004810 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f24dc009b10 tx=0x7f24dc01ca80 comp rx=0 tx=0).stop 2024-04-25T09:02:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24f3e00640 1 -- 172.21.15.59:0/2247571289 reap_dead start 2024-04-25T09:02:44.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 -- 172.21.15.59:0/2247571289 shutdown_connections 2024-04-25T09:02:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 -- 172.21.15.59:0/2247571289 >> 172.21.15.59:0/2247571289 conn(0x7f24f40b3200 msgr2=0x7f24f40b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 -- 172.21.15.59:0/2247571289 shutdown_connections 2024-04-25T09:02:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 -- 172.21.15.59:0/2247571289 wait complete. 2024-04-25T09:02:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 Processor -- start 2024-04-25T09:02:44.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 -- start start 2024-04-25T09:02:44.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d8003f40 0x7f24f415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24f415c830 0x7f24f40c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f409bdf0 0x7f24f409c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f409a280 con 0x7f24d8003f40 2024-04-25T09:02:44.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40cc470 con 0x7f24f415c830 2024-04-25T09:02:44.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24fa800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f40ca290 con 0x7f24f409bdf0 2024-04-25T09:02:44.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.163+0000 7f24f3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d8003f40 0x7f24f415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24f3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d8003f40 0x7f24f415bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32870/0 (socket says 172.21.15.59:32870) 2024-04-25T09:02:44.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24f3400640 1 -- 172.21.15.59:0/864741486 learned_addr learned my addr 172.21.15.59:0/864741486 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:44.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24ebe00640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24f415c830 0x7f24f40c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24f3e00640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f409bdf0 0x7f24f409c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24f3400640 1 -- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f409bdf0 msgr2=0x7f24f409c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24f3400640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f409bdf0 0x7f24f409c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24f3400640 1 -- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24f415c830 msgr2=0x7f24f40c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24f3400640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24f415c830 0x7f24f40c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24f3400640 1 -- 172.21.15.59:0/864741486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f40ca570 con 0x7f24d8003f40 2024-04-25T09:02:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24ebe00640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24f415c830 0x7f24f40c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24f3e00640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f409bdf0 0x7f24f409c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:44.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24f3400640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d8003f40 0x7f24f415bf60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f24e40119d0 tx=0x7f24e4011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24eb400640 1 -- 172.21.15.59:0/864741486 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e400fb50 con 0x7f24d8003f40 2024-04-25T09:02:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24eb400640 1 -- 172.21.15.59:0/864741486 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24e400fcf0 con 0x7f24d8003f40 2024-04-25T09:02:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24fa800640 1 -- 172.21.15.59:0/864741486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f40ca850 con 0x7f24d8003f40 2024-04-25T09:02:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24eb400640 1 -- 172.21.15.59:0/864741486 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24e400fea0 con 0x7f24d8003f40 2024-04-25T09:02:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24fa800640 1 -- 172.21.15.59:0/864741486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f415c4a0 con 0x7f24d8003f40 2024-04-25T09:02:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24fa800640 1 -- 172.21.15.59:0/864741486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f40745d0 con 0x7f24d8003f40 2024-04-25T09:02:44.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24eb400640 1 -- 172.21.15.59:0/864741486 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f24e4012040 con 0x7f24d8003f40 2024-04-25T09:02:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.167+0000 7f24eb400640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f24d0066f90 0x7f24d0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.171+0000 7f24eb400640 1 -- 172.21.15.59:0/864741486 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f24e4085530 con 0x7f24d8003f40 2024-04-25T09:02:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.171+0000 7f24ebe00640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f24d0066f90 0x7f24d0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.171+0000 7f24ebe00640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f24d0066f90 0x7f24d0069450 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0af000 tx=0x7f24dc0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.171+0000 7f24eb400640 1 -- 172.21.15.59:0/864741486 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f24e4019030 con 0x7f24d8003f40 2024-04-25T09:02:44.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.391+0000 7f24fa800640 1 -- 172.21.15.59:0/864741486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f24f40b7590 con 0x7f24d8003f40 2024-04-25T09:02:44.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24eb400640 1 -- 172.21.15.59:0/864741486 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f24e40560d0 con 0x7f24d8003f40 2024-04-25T09:02:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24fa800640 1 -- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f24d0066f90 msgr2=0x7f24d0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24fa800640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f24d0066f90 0x7f24d0069450 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f24dc0af000 tx=0x7f24dc0046d0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24fa800640 1 -- 172.21.15.59:0/864741486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d8003f40 msgr2=0x7f24f415bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24fa800640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d8003f40 0x7f24f415bf60 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f24e40119d0 tx=0x7f24e4011e90 comp rx=0 tx=0).stop 2024-04-25T09:02:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24fa800640 1 -- 172.21.15.59:0/864741486 shutdown_connections 2024-04-25T09:02:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24fa800640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f24d0066f90 0x7f24d0069450 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24fa800640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24f409bdf0 0x7f24f409c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24fa800640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24f415c830 0x7f24f40c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24fa800640 1 --2- 172.21.15.59:0/864741486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24d8003f40 0x7f24f415bf60 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24fa800640 1 -- 172.21.15.59:0/864741486 >> 172.21.15.59:0/864741486 conn(0x7f24f40b3200 msgr2=0x7f24f40b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24fa800640 1 -- 172.21.15.59:0/864741486 shutdown_connections 2024-04-25T09:02:44.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.395+0000 7f24fa800640 1 -- 172.21.15.59:0/864741486 wait complete. 2024-04-25T09:02:44.408 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-25T09:02:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e1f000640 1 Processor -- start 2024-04-25T09:02:44.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e1f000640 1 -- start start 2024-04-25T09:02:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e1f000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0e1809a170 0x7f0e180d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e1f000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e1806bf30 0x7f0e180cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e1f000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1815e040 con 0x7f0e1815dc60 2024-04-25T09:02:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e1f000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180cff80 con 0x7f0e1806bf30 2024-04-25T09:02:44.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e1f000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e180d0260 con 0x7f0e1809a170 2024-04-25T09:02:44.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e1d000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e1806bf30 0x7f0e180cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e17e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0e1815dc60 0x7f0e18099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45006/0 (socket says 172.21.15.59:45006) 2024-04-25T09:02:44.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e17e00640 1 -- 172.21.15.59:0/1874896135 learned_addr learned my addr 172.21.15.59:0/1874896135 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:44.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e17400640 1 --2- 172.21.15.59:0/1874896135 >> v2:172.21.15.178:3300/0 conn(0x7f0e1809a170 0x7f0e180d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e1d000640 1 -- 172.21.15.59:0/1874896135 >> v2:172.21.15.178:3300/0 conn(0x7f0e1809a170 msgr2=0x7f0e180d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e1d000640 1 --2- 172.21.15.59:0/1874896135 >> v2:172.21.15.178:3300/0 conn(0x7f0e1809a170 0x7f0e180d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e1d000640 1 -- 172.21.15.59:0/1874896135 >> v1:172.21.15.59:6789/0 conn(0x7f0e1815dc60 legacy=0x7f0e18099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e1d000640 1 -- 172.21.15.59:0/1874896135 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180d0540 con 0x7f0e1806bf30 2024-04-25T09:02:44.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.559+0000 7f0e16a00640 1 -- 172.21.15.59:0/1874896135 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 561086048 0 0) 0x7f0e1815e040 con 0x7f0e1815dc60 2024-04-25T09:02:44.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e1d000640 1 --2- 172.21.15.59:0/1874896135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1806bf30 0x7f0e180cf8a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0e180d2810 tx=0x7f0e1001c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a74e625f7cbd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e16a00640 1 -- 172.21.15.59:0/1874896135 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e100b2070 con 0x7f0e1806bf30 2024-04-25T09:02:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e16a00640 1 -- 172.21.15.59:0/1874896135 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e100a58a0 con 0x7f0e1806bf30 2024-04-25T09:02:44.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e16a00640 1 -- 172.21.15.59:0/1874896135 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e100a5c70 con 0x7f0e1806bf30 2024-04-25T09:02:44.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e1f000640 1 -- 172.21.15.59:0/1874896135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1806bf30 msgr2=0x7f0e180cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e1f000640 1 --2- 172.21.15.59:0/1874896135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1806bf30 0x7f0e180cf8a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0e180d2810 tx=0x7f0e1001c7e0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e1f000640 1 -- 172.21.15.59:0/1874896135 shutdown_connections 2024-04-25T09:02:44.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e1f000640 1 --2- 172.21.15.59:0/1874896135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1806bf30 0x7f0e180cf8a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e1f000640 1 --2- 172.21.15.59:0/1874896135 >> v2:172.21.15.178:3300/0 conn(0x7f0e1809a170 0x7f0e180d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e1f000640 1 -- 172.21.15.59:0/1874896135 >> 172.21.15.59:0/1874896135 conn(0x7f0e180b3200 msgr2=0x7f0e180b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e1f000640 1 -- 172.21.15.59:0/1874896135 shutdown_connections 2024-04-25T09:02:44.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e1f000640 1 -- 172.21.15.59:0/1874896135 wait complete. 2024-04-25T09:02:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e1f000640 1 Processor -- start 2024-04-25T09:02:44.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.563+0000 7f0e1f000640 1 -- start start 2024-04-25T09:02:44.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e1f000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1806bf30 0x7f0e18155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e1f000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e1809a170 0x7f0e18155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e1f000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e1815dc60 0x7f0e180c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e1f000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180cc6f0 con 0x7f0e1806bf30 2024-04-25T09:02:44.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e1f000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180cc570 con 0x7f0e1809a170 2024-04-25T09:02:44.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e1f000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e180cc870 con 0x7f0e1815dc60 2024-04-25T09:02:44.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e17e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1806bf30 0x7f0e18155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e17e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1806bf30 0x7f0e18155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32888/0 (socket says 172.21.15.59:32888) 2024-04-25T09:02:44.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e17e00640 1 -- 172.21.15.59:0/2605260600 learned_addr learned my addr 172.21.15.59:0/2605260600 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:44.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e17400640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e1809a170 0x7f0e18155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e1d000640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e1815dc60 0x7f0e180c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e17e00640 1 -- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e1815dc60 msgr2=0x7f0e180c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e17e00640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e1815dc60 0x7f0e180c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e17e00640 1 -- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e1809a170 msgr2=0x7f0e18155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e17e00640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e1809a170 0x7f0e18155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e17e00640 1 -- 172.21.15.59:0/2605260600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1815ba70 con 0x7f0e1806bf30 2024-04-25T09:02:44.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e1d000640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e1815dc60 0x7f0e180c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:44.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e17e00640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1806bf30 0x7f0e18155670 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0e080011f0 tx=0x7f0e0800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e0fe00640 1 -- 172.21.15.59:0/2605260600 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08018070 con 0x7f0e1806bf30 2024-04-25T09:02:44.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e0fe00640 1 -- 172.21.15.59:0/2605260600 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e080074e0 con 0x7f0e1806bf30 2024-04-25T09:02:44.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e1f000640 1 -- 172.21.15.59:0/2605260600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1815bd50 con 0x7f0e1806bf30 2024-04-25T09:02:44.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e0fe00640 1 -- 172.21.15.59:0/2605260600 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08004a10 con 0x7f0e1806bf30 2024-04-25T09:02:44.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e1f000640 1 -- 172.21.15.59:0/2605260600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1815c310 con 0x7f0e1806bf30 2024-04-25T09:02:44.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.567+0000 7f0e1f000640 1 -- 172.21.15.59:0/2605260600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e180745d0 con 0x7f0e1806bf30 2024-04-25T09:02:44.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.571+0000 7f0e0fe00640 1 -- 172.21.15.59:0/2605260600 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0e0801b070 con 0x7f0e1806bf30 2024-04-25T09:02:44.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.571+0000 7f0e0fe00640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0df8066f60 0x7f0df8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.571+0000 7f0e0fe00640 1 -- 172.21.15.59:0/2605260600 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f0e080841a0 con 0x7f0e1806bf30 2024-04-25T09:02:44.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.571+0000 7f0e17400640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0df8066f60 0x7f0df8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.571+0000 7f0e17400640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0df8066f60 0x7f0df8069420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e180ce8e0 tx=0x7f0e04008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.575+0000 7f0e0fe00640 1 -- 172.21.15.59:0/2605260600 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0e08054c80 con 0x7f0e1806bf30 2024-04-25T09:02:44.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.795+0000 7f0e1f000640 1 -- 172.21.15.59:0/2605260600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f0e180b7590 con 0x7f0e1806bf30 2024-04-25T09:02:44.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e0fe00640 1 -- 172.21.15.59:0/2605260600 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0e08058d20 con 0x7f0e1806bf30 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e1f000640 1 -- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0df8066f60 msgr2=0x7f0df8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e1f000640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0df8066f60 0x7f0df8069420 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0e180ce8e0 tx=0x7f0e04008040 comp rx=0 tx=0).stop 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e1f000640 1 -- 172.21.15.59:0/2605260600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1806bf30 msgr2=0x7f0e18155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e1f000640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1806bf30 0x7f0e18155670 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0e080011f0 tx=0x7f0e0800c9b0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e1f000640 1 -- 172.21.15.59:0/2605260600 shutdown_connections 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e1f000640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0df8066f60 0x7f0df8069420 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e1f000640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e1815dc60 0x7f0e180c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e1f000640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e1809a170 0x7f0e18155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e1f000640 1 --2- 172.21.15.59:0/2605260600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e1806bf30 0x7f0e18155670 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e1f000640 1 -- 172.21.15.59:0/2605260600 >> 172.21.15.59:0/2605260600 conn(0x7f0e180b3200 msgr2=0x7f0e18099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e1f000640 1 -- 172.21.15.59:0/2605260600 shutdown_connections 2024-04-25T09:02:44.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.799+0000 7f0e1f000640 1 -- 172.21.15.59:0/2605260600 wait complete. 2024-04-25T09:02:44.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-25T09:02:44.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f4776400640 1 Processor -- start 2024-04-25T09:02:44.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f4776400640 1 -- start start 2024-04-25T09:02:44.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f4776400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47700aebc0 0x7f477015e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f4776400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47700aefa0 con 0x7f47700af3b0 2024-04-25T09:02:44.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f4776400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47700b5a00 con 0x7f47700b51f0 2024-04-25T09:02:44.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f4776400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f477006b320 con 0x7f47700aebc0 2024-04-25T09:02:44.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f4775a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f47700af3b0 0x7f47701619f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45020/0 (socket says 172.21.15.59:45020) 2024-04-25T09:02:44.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f4775a00640 1 -- 172.21.15.59:0/1573136961 learned_addr learned my addr 172.21.15.59:0/1573136961 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:44.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f4775000640 1 --2- 172.21.15.59:0/1573136961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47700aebc0 0x7f477015e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f476f400640 1 -- 172.21.15.59:0/1573136961 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716963784 0 0) 0x7f47700aefa0 con 0x7f47700af3b0 2024-04-25T09:02:44.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f476f400640 1 -- 172.21.15.59:0/1573136961 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4758003530 con 0x7f47700af3b0 2024-04-25T09:02:44.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f476f400640 1 -- 172.21.15.59:0/1573136961 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922324270 0 0) 0x7f47700b5a00 con 0x7f47700b51f0 2024-04-25T09:02:44.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f4775000640 1 -- 172.21.15.59:0/1573136961 >> v1:172.21.15.178:6789/0 conn(0x7f47700b51f0 legacy=0x7f477006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f4775000640 1 -- 172.21.15.59:0/1573136961 >> v1:172.21.15.59:6789/0 conn(0x7f47700af3b0 legacy=0x7f47701619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.963+0000 7f4775000640 1 -- 172.21.15.59:0/1573136961 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47700b3620 con 0x7f47700aebc0 2024-04-25T09:02:44.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.967+0000 7f4775000640 1 --2- 172.21.15.59:0/1573136961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47700aebc0 0x7f477015e980 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47640097f0 tx=0x7f476401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9191d3c23385dcf0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.967+0000 7f476f400640 1 -- 172.21.15.59:0/1573136961 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640b0070 con 0x7f47700aebc0 2024-04-25T09:02:44.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.967+0000 7f476f400640 1 -- 172.21.15.59:0/1573136961 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47640ab600 con 0x7f47700aebc0 2024-04-25T09:02:44.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.967+0000 7f476f400640 1 -- 172.21.15.59:0/1573136961 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640ab9b0 con 0x7f47700aebc0 2024-04-25T09:02:44.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.967+0000 7f4776400640 1 -- 172.21.15.59:0/1573136961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47700aebc0 msgr2=0x7f477015e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.967+0000 7f4776400640 1 --2- 172.21.15.59:0/1573136961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47700aebc0 0x7f477015e980 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47640097f0 tx=0x7f476401c3c0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.967+0000 7f4776400640 1 -- 172.21.15.59:0/1573136961 shutdown_connections 2024-04-25T09:02:44.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.967+0000 7f4776400640 1 --2- 172.21.15.59:0/1573136961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47700aebc0 0x7f477015e980 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.967+0000 7f4776400640 1 -- 172.21.15.59:0/1573136961 >> 172.21.15.59:0/1573136961 conn(0x7f47700b5c30 msgr2=0x7f4770099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:44.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.967+0000 7f4776400640 1 -- 172.21.15.59:0/1573136961 shutdown_connections 2024-04-25T09:02:44.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.967+0000 7f4776400640 1 -- 172.21.15.59:0/1573136961 wait complete. 2024-04-25T09:02:44.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4776400640 1 Processor -- start 2024-04-25T09:02:44.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4776400640 1 -- start start 2024-04-25T09:02:44.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4776400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47700aebc0 0x7f4770157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4776400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47700af3b0 0x7f4770151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4776400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47700b51f0 0x7f4770151b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4776400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47700afbd0 con 0x7f47700aebc0 2024-04-25T09:02:44.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4776400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47700b55f0 con 0x7f47700af3b0 2024-04-25T09:02:44.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4776400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47701583e0 con 0x7f47700b51f0 2024-04-25T09:02:44.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4775000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47700aebc0 0x7f4770157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4775000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47700aebc0 0x7f4770157ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32892/0 (socket says 172.21.15.59:32892) 2024-04-25T09:02:44.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4775000640 1 -- 172.21.15.59:0/2017003804 learned_addr learned my addr 172.21.15.59:0/2017003804 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:44.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4775a00640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47700b51f0 0x7f4770151b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f476fe00640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47700af3b0 0x7f4770151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4775000640 1 -- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47700b51f0 msgr2=0x7f4770151b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4775000640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47700b51f0 0x7f4770151b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4775000640 1 -- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47700af3b0 msgr2=0x7f4770151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:44.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4775000640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47700af3b0 0x7f4770151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:44.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4775000640 1 -- 172.21.15.59:0/2017003804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477014a370 con 0x7f47700aebc0 2024-04-25T09:02:44.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4775000640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47700aebc0 0x7f4770157ea0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4764000c10 tx=0x7f4764019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f476cc00640 1 -- 172.21.15.59:0/2017003804 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640b9020 con 0x7f47700aebc0 2024-04-25T09:02:44.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f476cc00640 1 -- 172.21.15.59:0/2017003804 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47640ab9b0 con 0x7f47700aebc0 2024-04-25T09:02:44.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f476cc00640 1 -- 172.21.15.59:0/2017003804 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640b0040 con 0x7f47700aebc0 2024-04-25T09:02:44.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4776400640 1 -- 172.21.15.59:0/2017003804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4770154c90 con 0x7f47700aebc0 2024-04-25T09:02:44.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.971+0000 7f4776400640 1 -- 172.21.15.59:0/2017003804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4770155250 con 0x7f47700aebc0 2024-04-25T09:02:44.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.975+0000 7f4776400640 1 -- 172.21.15.59:0/2017003804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47700b12a0 con 0x7f47700aebc0 2024-04-25T09:02:44.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.975+0000 7f476cc00640 1 -- 172.21.15.59:0/2017003804 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f47640bc020 con 0x7f47700aebc0 2024-04-25T09:02:44.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.975+0000 7f476cc00640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4750066f60 0x7f4750069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:44.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.975+0000 7f476cc00640 1 -- 172.21.15.59:0/2017003804 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f476411ed10 con 0x7f47700aebc0 2024-04-25T09:02:44.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.975+0000 7f476fe00640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4750066f60 0x7f4750069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:44.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.979+0000 7f476fe00640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4750066f60 0x7f4750069420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4770153a80 tx=0x7f475c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:44.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:44.979+0000 7f476cc00640 1 -- 172.21.15.59:0/2017003804 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f47640c3030 con 0x7f47700aebc0 2024-04-25T09:02:45.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.199+0000 7f4776400640 1 -- 172.21.15.59:0/2017003804 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f47700d0a70 con 0x7f47700aebc0 2024-04-25T09:02:45.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.199+0000 7f476cc00640 1 -- 172.21.15.59:0/2017003804 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f47640160d0 con 0x7f47700aebc0 2024-04-25T09:02:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.203+0000 7f4776400640 1 -- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4750066f60 msgr2=0x7f4750069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.203+0000 7f4776400640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4750066f60 0x7f4750069420 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f4770153a80 tx=0x7f475c009040 comp rx=0 tx=0).stop 2024-04-25T09:02:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.203+0000 7f4776400640 1 -- 172.21.15.59:0/2017003804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47700aebc0 msgr2=0x7f4770157ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.203+0000 7f4776400640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47700aebc0 0x7f4770157ea0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4764000c10 tx=0x7f4764019160 comp rx=0 tx=0).stop 2024-04-25T09:02:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.203+0000 7f4776400640 1 -- 172.21.15.59:0/2017003804 shutdown_connections 2024-04-25T09:02:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.203+0000 7f4776400640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4750066f60 0x7f4750069420 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.203+0000 7f4776400640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f47700b51f0 0x7f4770151b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.203+0000 7f4776400640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f47700af3b0 0x7f4770151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.203+0000 7f4776400640 1 --2- 172.21.15.59:0/2017003804 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47700aebc0 0x7f4770157ea0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.203+0000 7f4776400640 1 -- 172.21.15.59:0/2017003804 >> 172.21.15.59:0/2017003804 conn(0x7f47700b5c30 msgr2=0x7f477006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:45.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.203+0000 7f4776400640 1 -- 172.21.15.59:0/2017003804 shutdown_connections 2024-04-25T09:02:45.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.203+0000 7f4776400640 1 -- 172.21.15.59:0/2017003804 wait complete. 2024-04-25T09:02:45.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-25T09:02:45.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce8800640 1 Processor -- start 2024-04-25T09:02:45.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce8800640 1 -- start start 2024-04-25T09:02:45.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce8800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ce0144120 0x7f4ce015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce8800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ce00ccbf0 0x7f4ce015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce8800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce015bc40 con 0x7f4ce015ee60 2024-04-25T09:02:45.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce8800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce015e490 con 0x7f4ce00ccbf0 2024-04-25T09:02:45.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce8800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce015b3a0 con 0x7f4ce0144120 2024-04-25T09:02:45.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce5400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ce00ccbf0 0x7f4ce015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce6800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4ce015ee60 0x7f4ce00b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45028/0 (socket says 172.21.15.59:45028) 2024-04-25T09:02:45.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce6800640 1 -- 172.21.15.59:0/610414841 learned_addr learned my addr 172.21.15.59:0/610414841 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:45.356 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce5e00640 1 --2- 172.21.15.59:0/610414841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ce0144120 0x7f4ce015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce4a00640 1 -- 172.21.15.59:0/610414841 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470392505 0 0) 0x7f4ce015bc40 con 0x7f4ce015ee60 2024-04-25T09:02:45.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce4a00640 1 -- 172.21.15.59:0/610414841 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cc8003530 con 0x7f4ce015ee60 2024-04-25T09:02:45.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce5400640 1 -- 172.21.15.59:0/610414841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ce0144120 msgr2=0x7f4ce015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:45.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce5400640 1 --2- 172.21.15.59:0/610414841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ce0144120 0x7f4ce015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce5400640 1 -- 172.21.15.59:0/610414841 >> v1:172.21.15.59:6789/0 conn(0x7f4ce015ee60 legacy=0x7f4ce00b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.363+0000 7f4ce5400640 1 -- 172.21.15.59:0/610414841 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce015b680 con 0x7f4ce00ccbf0 2024-04-25T09:02:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.367+0000 7f4ce5400640 1 --2- 172.21.15.59:0/610414841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce00ccbf0 0x7f4ce015e920 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00097c0 tx=0x7f4cd001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42700ba10a580a49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.367+0000 7f4ce4a00640 1 -- 172.21.15.59:0/610414841 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00b0070 con 0x7f4ce00ccbf0 2024-04-25T09:02:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.367+0000 7f4ce4a00640 1 -- 172.21.15.59:0/610414841 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd00ab600 con 0x7f4ce00ccbf0 2024-04-25T09:02:45.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.367+0000 7f4ce4a00640 1 -- 172.21.15.59:0/610414841 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00ab9d0 con 0x7f4ce00ccbf0 2024-04-25T09:02:45.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.367+0000 7f4ce8800640 1 -- 172.21.15.59:0/610414841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce00ccbf0 msgr2=0x7f4ce015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.367+0000 7f4ce8800640 1 --2- 172.21.15.59:0/610414841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce00ccbf0 0x7f4ce015e920 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4cd00097c0 tx=0x7f4cd001c410 comp rx=0 tx=0).stop 2024-04-25T09:02:45.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.367+0000 7f4ce8800640 1 -- 172.21.15.59:0/610414841 shutdown_connections 2024-04-25T09:02:45.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.367+0000 7f4ce8800640 1 --2- 172.21.15.59:0/610414841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce00ccbf0 0x7f4ce015e920 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.367+0000 7f4ce8800640 1 --2- 172.21.15.59:0/610414841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ce0144120 0x7f4ce015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.367+0000 7f4ce8800640 1 -- 172.21.15.59:0/610414841 >> 172.21.15.59:0/610414841 conn(0x7f4ce0067080 msgr2=0x7f4ce006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:45.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.367+0000 7f4ce8800640 1 -- 172.21.15.59:0/610414841 shutdown_connections 2024-04-25T09:02:45.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.367+0000 7f4ce8800640 1 -- 172.21.15.59:0/610414841 wait complete. 2024-04-25T09:02:45.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce8800640 1 Processor -- start 2024-04-25T09:02:45.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce8800640 1 -- start start 2024-04-25T09:02:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce8800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ce00ccbf0 0x7f4ce01fa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce8800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ce0144120 0x7f4ce013f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce8800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce015ee60 0x7f4ce00b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce8800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce01675c0 con 0x7f4ce015ee60 2024-04-25T09:02:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce8800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce0167440 con 0x7f4ce00ccbf0 2024-04-25T09:02:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce8800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce0167740 con 0x7f4ce0144120 2024-04-25T09:02:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce015ee60 0x7f4ce00b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce015ee60 0x7f4ce00b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32918/0 (socket says 172.21.15.59:32918) 2024-04-25T09:02:45.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce6800640 1 -- 172.21.15.59:0/1778993429 learned_addr learned my addr 172.21.15.59:0/1778993429 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce5400640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ce0144120 0x7f4ce013f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce5e00640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ce00ccbf0 0x7f4ce01fa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce6800640 1 -- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ce0144120 msgr2=0x7f4ce013f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce6800640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ce0144120 0x7f4ce013f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce6800640 1 -- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ce00ccbf0 msgr2=0x7f4ce01fa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce6800640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ce00ccbf0 0x7f4ce01fa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce6800640 1 -- 172.21.15.59:0/1778993429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce00af6f0 con 0x7f4ce015ee60 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce6800640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce015ee60 0x7f4ce00b0790 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00caa0 tx=0x7f4cdc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4cda000640 1 -- 172.21.15.59:0/1778993429 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc017070 con 0x7f4ce015ee60 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4cda000640 1 -- 172.21.15.59:0/1778993429 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc00ac00 con 0x7f4ce015ee60 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4cda000640 1 -- 172.21.15.59:0/1778993429 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc012400 con 0x7f4ce015ee60 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce8800640 1 -- 172.21.15.59:0/1778993429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce00af9d0 con 0x7f4ce015ee60 2024-04-25T09:02:45.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.371+0000 7f4ce8800640 1 -- 172.21.15.59:0/1778993429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce00aff90 con 0x7f4ce015ee60 2024-04-25T09:02:45.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.375+0000 7f4ce8800640 1 -- 172.21.15.59:0/1778993429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce00745d0 con 0x7f4ce015ee60 2024-04-25T09:02:45.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.375+0000 7f4cda000640 1 -- 172.21.15.59:0/1778993429 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4cdc01a070 con 0x7f4ce015ee60 2024-04-25T09:02:45.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.375+0000 7f4cda000640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4cc4066f60 0x7f4cc4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.375+0000 7f4cda000640 1 -- 172.21.15.59:0/1778993429 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f4cdc084ca0 con 0x7f4ce015ee60 2024-04-25T09:02:45.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.375+0000 7f4ce5e00640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4cc4066f60 0x7f4cc4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.375+0000 7f4ce5e00640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4cc4066f60 0x7f4cc4069420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009af0 tx=0x7f4cd4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.379+0000 7f4cda000640 1 -- 172.21.15.59:0/1778993429 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4cdc055dd0 con 0x7f4ce015ee60 2024-04-25T09:02:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.603+0000 7f4ce8800640 1 -- 172.21.15.59:0/1778993429 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f4ce00b23e0 con 0x7f4ce015ee60 2024-04-25T09:02:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4cda000640 1 -- 172.21.15.59:0/1778993429 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4cdc0556d0 con 0x7f4ce015ee60 2024-04-25T09:02:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4ce8800640 1 -- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4cc4066f60 msgr2=0x7f4cc4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4ce8800640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4cc4066f60 0x7f4cc4069420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009af0 tx=0x7f4cd4008040 comp rx=0 tx=0).stop 2024-04-25T09:02:45.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4ce8800640 1 -- 172.21.15.59:0/1778993429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce015ee60 msgr2=0x7f4ce00b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4ce8800640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce015ee60 0x7f4ce00b0790 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00caa0 tx=0x7f4cdc00cf60 comp rx=0 tx=0).stop 2024-04-25T09:02:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4ce8800640 1 -- 172.21.15.59:0/1778993429 shutdown_connections 2024-04-25T09:02:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4ce8800640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4cc4066f60 0x7f4cc4069420 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4ce8800640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ce015ee60 0x7f4ce00b0790 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4ce8800640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ce0144120 0x7f4ce013f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4ce8800640 1 --2- 172.21.15.59:0/1778993429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ce00ccbf0 0x7f4ce01fa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4ce8800640 1 -- 172.21.15.59:0/1778993429 >> 172.21.15.59:0/1778993429 conn(0x7f4ce0067080 msgr2=0x7f4ce0141150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4ce8800640 1 -- 172.21.15.59:0/1778993429 shutdown_connections 2024-04-25T09:02:45.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.607+0000 7f4ce8800640 1 -- 172.21.15.59:0/1778993429 wait complete. 2024-04-25T09:02:45.619 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-25T09:02:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.767+0000 7f2f3f600640 1 Processor -- start 2024-04-25T09:02:45.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3f600640 1 -- start start 2024-04-25T09:02:45.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3f600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f38159320 0x7f2f3815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3f600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f3815f440 0x7f2f3806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3f600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3815fc00 con 0x7f2f3806e010 2024-04-25T09:02:45.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3f600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3806d640 con 0x7f2f38159320 2024-04-25T09:02:45.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3f600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3815fee0 con 0x7f2f3815f440 2024-04-25T09:02:45.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3cc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f38159320 0x7f2f3815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3d600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2f3806e010 0x7f2f3806e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45032/0 (socket says 172.21.15.59:45032) 2024-04-25T09:02:45.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3d600640 1 -- 172.21.15.59:0/495207886 learned_addr learned my addr 172.21.15.59:0/495207886 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:45.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f37e00640 1 --2- 172.21.15.59:0/495207886 >> v2:172.21.15.178:3300/0 conn(0x7f2f3815f440 0x7f2f3806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3cc00640 1 -- 172.21.15.59:0/495207886 >> v2:172.21.15.178:3300/0 conn(0x7f2f3815f440 msgr2=0x7f2f3806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3cc00640 1 --2- 172.21.15.59:0/495207886 >> v2:172.21.15.178:3300/0 conn(0x7f2f3815f440 0x7f2f3806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3cc00640 1 -- 172.21.15.59:0/495207886 >> v1:172.21.15.59:6789/0 conn(0x7f2f3806e010 legacy=0x7f2f3806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.771+0000 7f2f3cc00640 1 -- 172.21.15.59:0/495207886 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f381601c0 con 0x7f2f38159320 2024-04-25T09:02:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f3cc00640 1 --2- 172.21.15.59:0/495207886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f38159320 0x7f2f3815c9b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2f380b4b50 tx=0x7f2f2c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa185572bee6f05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f37400640 1 -- 172.21.15.59:0/495207886 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c0b1070 con 0x7f2f38159320 2024-04-25T09:02:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f37400640 1 -- 172.21.15.59:0/495207886 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0a8050 con 0x7f2f38159320 2024-04-25T09:02:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f37400640 1 -- 172.21.15.59:0/495207886 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c0ac860 con 0x7f2f38159320 2024-04-25T09:02:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f3f600640 1 -- 172.21.15.59:0/495207886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f38159320 msgr2=0x7f2f3815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f3f600640 1 --2- 172.21.15.59:0/495207886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f38159320 0x7f2f3815c9b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2f380b4b50 tx=0x7f2f2c01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f3f600640 1 -- 172.21.15.59:0/495207886 shutdown_connections 2024-04-25T09:02:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f3f600640 1 --2- 172.21.15.59:0/495207886 >> v2:172.21.15.178:3300/0 conn(0x7f2f3815f440 0x7f2f3806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f3f600640 1 --2- 172.21.15.59:0/495207886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f38159320 0x7f2f3815c9b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f3f600640 1 -- 172.21.15.59:0/495207886 >> 172.21.15.59:0/495207886 conn(0x7f2f38067080 msgr2=0x7f2f3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f3f600640 1 -- 172.21.15.59:0/495207886 shutdown_connections 2024-04-25T09:02:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f3f600640 1 -- 172.21.15.59:0/495207886 wait complete. 2024-04-25T09:02:45.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f3f600640 1 Processor -- start 2024-04-25T09:02:45.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.775+0000 7f2f3f600640 1 -- start start 2024-04-25T09:02:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3f600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f3806e010 0x7f2f3815e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3f600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38159320 0x7f2f381377f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3f600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f3815f440 0x7f2f38137d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3f600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3815f9a0 con 0x7f2f3815f440 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3f600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3815f820 con 0x7f2f3806e010 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3f600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3806ebb0 con 0x7f2f38159320 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f3815f440 0x7f2f38137d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f3815f440 0x7f2f38137d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32928/0 (socket says 172.21.15.59:32928) 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3d600640 1 -- 172.21.15.59:0/3743795527 learned_addr learned my addr 172.21.15.59:0/3743795527 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f37e00640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38159320 0x7f2f381377f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3cc00640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f3806e010 0x7f2f3815e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3d600640 1 -- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38159320 msgr2=0x7f2f381377f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3d600640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38159320 0x7f2f381377f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3d600640 1 -- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f3806e010 msgr2=0x7f2f3815e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3d600640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f3806e010 0x7f2f3815e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3d600640 1 -- 172.21.15.59:0/3743795527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f38158610 con 0x7f2f3815f440 2024-04-25T09:02:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3d600640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f3815f440 0x7f2f38137d30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000caf0 tx=0x7f2f3000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f34c00640 1 -- 172.21.15.59:0/3743795527 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30017070 con 0x7f2f3815f440 2024-04-25T09:02:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f34c00640 1 -- 172.21.15.59:0/3743795527 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3000aca0 con 0x7f2f3815f440 2024-04-25T09:02:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3f600640 1 -- 172.21.15.59:0/3743795527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f38138620 con 0x7f2f3815f440 2024-04-25T09:02:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f34c00640 1 -- 172.21.15.59:0/3743795527 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30012600 con 0x7f2f3815f440 2024-04-25T09:02:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3f600640 1 -- 172.21.15.59:0/3743795527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f38138be0 con 0x7f2f3815f440 2024-04-25T09:02:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.779+0000 7f2f3f600640 1 -- 172.21.15.59:0/3743795527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f380745d0 con 0x7f2f3815f440 2024-04-25T09:02:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.783+0000 7f2f34c00640 1 -- 172.21.15.59:0/3743795527 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2f3001a070 con 0x7f2f3815f440 2024-04-25T09:02:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.783+0000 7f2f34c00640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2f18066f60 0x7f2f18069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.783+0000 7f2f34c00640 1 -- 172.21.15.59:0/3743795527 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f2f30084a80 con 0x7f2f3815f440 2024-04-25T09:02:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.783+0000 7f2f3cc00640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2f18066f60 0x7f2f18069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.783+0000 7f2f3cc00640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2f18066f60 0x7f2f18069420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0ae000 tx=0x7f2f2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:45.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:45.787+0000 7f2f34c00640 1 -- 172.21.15.59:0/3743795527 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2f30086e20 con 0x7f2f3815f440 2024-04-25T09:02:45.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.003+0000 7f2f3f600640 1 -- 172.21.15.59:0/3743795527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f2f3815bc30 con 0x7f2f3815f440 2024-04-25T09:02:45.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.003+0000 7f2f34c00640 1 -- 172.21.15.59:0/3743795527 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2f300555f0 con 0x7f2f3815f440 2024-04-25T09:02:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.007+0000 7f2f3f600640 1 -- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2f18066f60 msgr2=0x7f2f18069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.007+0000 7f2f3f600640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2f18066f60 0x7f2f18069420 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0ae000 tx=0x7f2f2c008040 comp rx=0 tx=0).stop 2024-04-25T09:02:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.007+0000 7f2f3f600640 1 -- 172.21.15.59:0/3743795527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f3815f440 msgr2=0x7f2f38137d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.007+0000 7f2f3f600640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f3815f440 0x7f2f38137d30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000caf0 tx=0x7f2f3000a060 comp rx=0 tx=0).stop 2024-04-25T09:02:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.007+0000 7f2f3f600640 1 -- 172.21.15.59:0/3743795527 shutdown_connections 2024-04-25T09:02:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.007+0000 7f2f3f600640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2f18066f60 0x7f2f18069420 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.007+0000 7f2f3f600640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f3815f440 0x7f2f38137d30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.007+0000 7f2f3f600640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f38159320 0x7f2f381377f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.007+0000 7f2f3f600640 1 --2- 172.21.15.59:0/3743795527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f3806e010 0x7f2f3815e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.007+0000 7f2f3f600640 1 -- 172.21.15.59:0/3743795527 >> 172.21.15.59:0/3743795527 conn(0x7f2f38067080 msgr2=0x7f2f3806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:45.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.007+0000 7f2f3f600640 1 -- 172.21.15.59:0/3743795527 shutdown_connections 2024-04-25T09:02:46.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.007+0000 7f2f3f600640 1 -- 172.21.15.59:0/3743795527 wait complete. 2024-04-25T09:02:46.018 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:46.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7ded400640 1 Processor -- start 2024-04-25T09:02:46.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7ded400640 1 -- start start 2024-04-25T09:02:46.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7ded400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7de8070fe0 0x7f7de8161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7ded400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7de8071830 0x7f7de815e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7ded400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de806d090 con 0x7f7de80713c0 2024-04-25T09:02:46.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7ded400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de8162390 con 0x7f7de8071830 2024-04-25T09:02:46.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7ded400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de8161af0 con 0x7f7de8070fe0 2024-04-25T09:02:46.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7ddde00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7de80713c0 0x7f7de8143080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45038/0 (socket says 172.21.15.59:45038) 2024-04-25T09:02:46.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7ddde00640 1 -- 172.21.15.59:0/2984502837 learned_addr learned my addr 172.21.15.59:0/2984502837 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:46.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7de7200640 1 --2- 172.21.15.59:0/2984502837 >> v2:172.21.15.59:3300/0 conn(0x7f7de8071830 0x7f7de815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7de6800640 1 --2- 172.21.15.59:0/2984502837 >> v2:172.21.15.178:3300/0 conn(0x7f7de8070fe0 0x7f7de8161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7de5e00640 1 -- 172.21.15.59:0/2984502837 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674214186 0 0) 0x7f7dd0001120 con 0x7f7de80713c0 2024-04-25T09:02:46.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7de5e00640 1 -- 172.21.15.59:0/2984502837 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dcc003530 con 0x7f7de80713c0 2024-04-25T09:02:46.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7de7200640 1 -- 172.21.15.59:0/2984502837 >> v2:172.21.15.178:3300/0 conn(0x7f7de8070fe0 msgr2=0x7f7de8161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7de7200640 1 --2- 172.21.15.59:0/2984502837 >> v2:172.21.15.178:3300/0 conn(0x7f7de8070fe0 0x7f7de8161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7de7200640 1 -- 172.21.15.59:0/2984502837 >> v1:172.21.15.59:6789/0 conn(0x7f7de80713c0 legacy=0x7f7de8143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.167+0000 7f7de7200640 1 -- 172.21.15.59:0/2984502837 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de8161dd0 con 0x7f7de8071830 2024-04-25T09:02:46.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.171+0000 7f7de7200640 1 --2- 172.21.15.59:0/2984502837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de8071830 0x7f7de815e550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7de8072ce0 tx=0x7f7de001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c77d2baeba3398 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.171+0000 7f7de5e00640 1 -- 172.21.15.59:0/2984502837 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de00b2070 con 0x7f7de8071830 2024-04-25T09:02:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.171+0000 7f7de5e00640 1 -- 172.21.15.59:0/2984502837 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de00a58d0 con 0x7f7de8071830 2024-04-25T09:02:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.171+0000 7f7de5e00640 1 -- 172.21.15.59:0/2984502837 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de00a5ca0 con 0x7f7de8071830 2024-04-25T09:02:46.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.171+0000 7f7ded400640 1 -- 172.21.15.59:0/2984502837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de8071830 msgr2=0x7f7de815e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.171+0000 7f7ded400640 1 --2- 172.21.15.59:0/2984502837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de8071830 0x7f7de815e550 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7de8072ce0 tx=0x7f7de001c900 comp rx=0 tx=0).stop 2024-04-25T09:02:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.171+0000 7f7ded400640 1 -- 172.21.15.59:0/2984502837 shutdown_connections 2024-04-25T09:02:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.171+0000 7f7ded400640 1 --2- 172.21.15.59:0/2984502837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de8071830 0x7f7de815e550 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.171+0000 7f7ded400640 1 --2- 172.21.15.59:0/2984502837 >> v2:172.21.15.178:3300/0 conn(0x7f7de8070fe0 0x7f7de8161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.171+0000 7f7ded400640 1 -- 172.21.15.59:0/2984502837 >> 172.21.15.59:0/2984502837 conn(0x7f7de80b3390 msgr2=0x7f7de80b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.171+0000 7f7ded400640 1 -- 172.21.15.59:0/2984502837 shutdown_connections 2024-04-25T09:02:46.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.171+0000 7f7ded400640 1 -- 172.21.15.59:0/2984502837 wait complete. 2024-04-25T09:02:46.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ded400640 1 Processor -- start 2024-04-25T09:02:46.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ded400640 1 -- start start 2024-04-25T09:02:46.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ded400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de8070fe0 0x7f7de813b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ded400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de80713c0 0x7f7de815f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ded400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de8071830 0x7f7de815f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ded400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80b06c0 con 0x7f7de8070fe0 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ded400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80b0540 con 0x7f7de80713c0 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ded400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de80b0840 con 0x7f7de8071830 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7de6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de8070fe0 0x7f7de813b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7de6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de8070fe0 0x7f7de813b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32946/0 (socket says 172.21.15.59:32946) 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7de6800640 1 -- 172.21.15.59:0/878956263 learned_addr learned my addr 172.21.15.59:0/878956263 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ddde00640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de80713c0 0x7f7de815f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7de7200640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de8071830 0x7f7de815f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7de6800640 1 -- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de8071830 msgr2=0x7f7de815f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7de6800640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de8071830 0x7f7de815f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7de6800640 1 -- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de80713c0 msgr2=0x7f7de815f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7de6800640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de80713c0 0x7f7de815f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7de6800640 1 -- 172.21.15.59:0/878956263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de8152400 con 0x7f7de8070fe0 2024-04-25T09:02:46.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7de6800640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de8070fe0 0x7f7de813b000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800d800 tx=0x7f7dd800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ddf400640 1 -- 172.21.15.59:0/878956263 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd800b6c0 con 0x7f7de8070fe0 2024-04-25T09:02:46.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ddf400640 1 -- 172.21.15.59:0/878956263 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd8019070 con 0x7f7de8070fe0 2024-04-25T09:02:46.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ddf400640 1 -- 172.21.15.59:0/878956263 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd800ba60 con 0x7f7de8070fe0 2024-04-25T09:02:46.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ded400640 1 -- 172.21.15.59:0/878956263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de81526e0 con 0x7f7de8070fe0 2024-04-25T09:02:46.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ded400640 1 -- 172.21.15.59:0/878956263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de8152ca0 con 0x7f7de8070fe0 2024-04-25T09:02:46.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.175+0000 7f7ded400640 1 -- 172.21.15.59:0/878956263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de80745d0 con 0x7f7de8070fe0 2024-04-25T09:02:46.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.179+0000 7f7ddf400640 1 -- 172.21.15.59:0/878956263 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7dd800bc00 con 0x7f7de8070fe0 2024-04-25T09:02:46.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.179+0000 7f7ddf400640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7dc4066f60 0x7f7dc4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.179+0000 7f7ddf400640 1 -- 172.21.15.59:0/878956263 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7dd80853b0 con 0x7f7de8070fe0 2024-04-25T09:02:46.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.179+0000 7f7ddde00640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7dc4066f60 0x7f7dc4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.179+0000 7f7ddde00640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7dc4066f60 0x7f7dc4069420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7de81543d0 tx=0x7f7dd0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.183+0000 7f7ddf400640 1 -- 172.21.15.59:0/878956263 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7dd80564e0 con 0x7f7de8070fe0 2024-04-25T09:02:46.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.343+0000 7f7ded400640 1 -- 172.21.15.59:0/878956263 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7de80cef80 con 0x7f7de8070fe0 2024-04-25T09:02:46.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.343+0000 7f7ddf400640 1 -- 172.21.15.59:0/878956263 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13164 (secure 0 0 0) 0x7f7dd8083e20 con 0x7f7de8070fe0 2024-04-25T09:02:46.336 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:46.336 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":35,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:43.179585+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.347+0000 7f7ded400640 1 -- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7dc4066f60 msgr2=0x7f7dc4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.347+0000 7f7ded400640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7dc4066f60 0x7f7dc4069420 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7de81543d0 tx=0x7f7dd0009040 comp rx=0 tx=0).stop 2024-04-25T09:02:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.347+0000 7f7ded400640 1 -- 172.21.15.59:0/878956263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de8070fe0 msgr2=0x7f7de813b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.347+0000 7f7ded400640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de8070fe0 0x7f7de813b000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800d800 tx=0x7f7dd800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.347+0000 7f7ded400640 1 -- 172.21.15.59:0/878956263 shutdown_connections 2024-04-25T09:02:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.347+0000 7f7ded400640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7dc4066f60 0x7f7dc4069420 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.347+0000 7f7ded400640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de8071830 0x7f7de815f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.347+0000 7f7ded400640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de80713c0 0x7f7de815f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.347+0000 7f7ded400640 1 --2- 172.21.15.59:0/878956263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de8070fe0 0x7f7de813b000 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.347+0000 7f7ded400640 1 -- 172.21.15.59:0/878956263 >> 172.21.15.59:0/878956263 conn(0x7f7de80b3390 msgr2=0x7f7de80cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.347+0000 7f7ded400640 1 -- 172.21.15.59:0/878956263 shutdown_connections 2024-04-25T09:02:46.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.347+0000 7f7ded400640 1 -- 172.21.15.59:0/878956263 wait complete. 2024-04-25T09:02:46.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:02:46.358 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:02:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c2ac00640 1 Processor -- start 2024-04-25T09:02:46.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c2ac00640 1 -- start start 2024-04-25T09:02:46.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c2ac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2406fb00 0x7f7c2406fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c2ac00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c240affe0 con 0x7f7c240cc910 2024-04-25T09:02:46.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c2ac00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2406ba30 con 0x7f7c2415baa0 2024-04-25T09:02:46.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c2ac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c24070420 con 0x7f7c2406fb00 2024-04-25T09:02:46.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c28c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7c240cc910 0x7f7c2406b320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45040/0 (socket says 172.21.15.59:45040) 2024-04-25T09:02:46.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c28c00640 1 -- 172.21.15.59:0/1008190222 learned_addr learned my addr 172.21.15.59:0/1008190222 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:46.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23e00640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2406fb00 0x7f7c2406fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3051139405 0 0) 0x7f7c240affe0 con 0x7f7c240cc910 2024-04-25T09:02:46.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c08003530 con 0x7f7c240cc910 2024-04-25T09:02:46.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 196284585 0 0) 0x7f7c08003530 con 0x7f7c240cc910 2024-04-25T09:02:46.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2406fb00 msgr2=0x7f7c2406fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2406fb00 0x7f7c2406fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 >> v1:172.21.15.178:6789/0 conn(0x7f7c2415baa0 legacy=0x7f7c2406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c240cd240 con 0x7f7c240cc910 2024-04-25T09:02:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f7c1c001a00 con 0x7f7c240cc910 2024-04-25T09:02:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 >> v1:172.21.15.59:6789/0 conn(0x7f7c240cc910 legacy=0x7f7c2406b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c080039f0 0x7f7c08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c080043a0 0x7f7c08004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2406fb00 0x7f7c080050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c24070420 con 0x7f7c080043a0 2024-04-25T09:02:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0800b9d0 con 0x7f7c080039f0 2024-04-25T09:02:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.511+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0800bbd0 con 0x7f7c2406fb00 2024-04-25T09:02:46.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c1b400640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c080043a0 0x7f7c08004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c23e00640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c080039f0 0x7f7c08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c28c00640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2406fb00 0x7f7c080050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c1b400640 1 -- 172.21.15.59:0/1008190222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2406fb00 msgr2=0x7f7c080050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c1b400640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2406fb00 0x7f7c080050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c1b400640 1 -- 172.21.15.59:0/1008190222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c080039f0 msgr2=0x7f7c08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c1b400640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c080039f0 0x7f7c08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c1b400640 1 -- 172.21.15.59:0/1008190222 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08003530 con 0x7f7c080043a0 2024-04-25T09:02:46.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c23e00640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c080039f0 0x7f7c08003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:46.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c1b400640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c080043a0 0x7f7c08004870 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c001860 tx=0x7f7c0c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8be880826b4631 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0b0070 con 0x7f7c080043a0 2024-04-25T09:02:46.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c0ab600 con 0x7f7c080043a0 2024-04-25T09:02:46.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.515+0000 7f7c23400640 1 -- 172.21.15.59:0/1008190222 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c001460 con 0x7f7c080043a0 2024-04-25T09:02:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 -- 172.21.15.59:0/1008190222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c080043a0 msgr2=0x7f7c08004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 --2- 172.21.15.59:0/1008190222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c080043a0 0x7f7c08004870 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c001860 tx=0x7f7c0c01c4d0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c28c00640 1 -- 172.21.15.59:0/1008190222 reap_dead start 2024-04-25T09:02:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 -- 172.21.15.59:0/1008190222 shutdown_connections 2024-04-25T09:02:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 -- 172.21.15.59:0/1008190222 >> 172.21.15.59:0/1008190222 conn(0x7f7c240b2240 msgr2=0x7f7c240b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 -- 172.21.15.59:0/1008190222 shutdown_connections 2024-04-25T09:02:46.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 -- 172.21.15.59:0/1008190222 wait complete. 2024-04-25T09:02:46.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 Processor -- start 2024-04-25T09:02:46.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 -- start start 2024-04-25T09:02:46.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c080043a0 0x7f7c2414a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2415bea0 0x7f7c24155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c24155650 0x7f7c2406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240cce60 con 0x7f7c2415bea0 2024-04-25T09:02:46.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240cddc0 con 0x7f7c24155650 2024-04-25T09:02:46.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c2ac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240ccfe0 con 0x7f7c080043a0 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c1b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2415bea0 0x7f7c24155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c1b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2415bea0 0x7f7c24155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32974/0 (socket says 172.21.15.59:32974) 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c1b400640 1 -- 172.21.15.59:0/3662153022 learned_addr learned my addr 172.21.15.59:0/3662153022 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c23e00640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c080043a0 0x7f7c2414a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c28c00640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c24155650 0x7f7c2406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c1b400640 1 -- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c080043a0 msgr2=0x7f7c2414a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c1b400640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c080043a0 0x7f7c2414a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c1b400640 1 -- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c24155650 msgr2=0x7f7c2406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c1b400640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c24155650 0x7f7c2406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c1b400640 1 -- 172.21.15.59:0/3662153022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2414a5f0 con 0x7f7c2415bea0 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c28c00640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c24155650 0x7f7c2406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.519+0000 7f7c1b400640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2415bea0 0x7f7c24155110 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c01c300 tx=0x7f7c08005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.523+0000 7f7c20c00640 1 -- 172.21.15.59:0/3662153022 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0b9030 con 0x7f7c2415bea0 2024-04-25T09:02:46.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.523+0000 7f7c20c00640 1 -- 172.21.15.59:0/3662153022 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c001440 con 0x7f7c2415bea0 2024-04-25T09:02:46.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.523+0000 7f7c20c00640 1 -- 172.21.15.59:0/3662153022 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c0b0040 con 0x7f7c2415bea0 2024-04-25T09:02:46.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.523+0000 7f7c2ac00640 1 -- 172.21.15.59:0/3662153022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c24158d10 con 0x7f7c2415bea0 2024-04-25T09:02:46.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.523+0000 7f7c2ac00640 1 -- 172.21.15.59:0/3662153022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c24159290 con 0x7f7c2415bea0 2024-04-25T09:02:46.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.523+0000 7f7c2ac00640 1 -- 172.21.15.59:0/3662153022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c240745d0 con 0x7f7c2415bea0 2024-04-25T09:02:46.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.523+0000 7f7c20c00640 1 -- 172.21.15.59:0/3662153022 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7c0c0bc070 con 0x7f7c2415bea0 2024-04-25T09:02:46.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.523+0000 7f7c20c00640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c00066f90 0x7f7c00069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.523+0000 7f7c20c00640 1 -- 172.21.15.59:0/3662153022 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f7c0c0ab400 con 0x7f7c2415bea0 2024-04-25T09:02:46.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.523+0000 7f7c23e00640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c00066f90 0x7f7c00069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.527+0000 7f7c23e00640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c00066f90 0x7f7c00069450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7c241f59a0 tx=0x7f7c14015040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.527+0000 7f7c20c00640 1 -- 172.21.15.59:0/3662153022 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7c0c0c4020 con 0x7f7c2415bea0 2024-04-25T09:02:46.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 -- 172.21.15.59:0/3662153022 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c2415fc10 con 0x7f7c2415bea0 2024-04-25T09:02:46.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c20c00640 1 -- 172.21.15.59:0/3662153022 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c0c016210 con 0x7f7c2415bea0 2024-04-25T09:02:46.685 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:02:46.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 -- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c00066f90 msgr2=0x7f7c00069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c00066f90 0x7f7c00069450 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7c241f59a0 tx=0x7f7c14015040 comp rx=0 tx=0).stop 2024-04-25T09:02:46.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 -- 172.21.15.59:0/3662153022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2415bea0 msgr2=0x7f7c24155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2415bea0 0x7f7c24155110 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c01c300 tx=0x7f7c08005840 comp rx=0 tx=0).stop 2024-04-25T09:02:46.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 -- 172.21.15.59:0/3662153022 shutdown_connections 2024-04-25T09:02:46.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c00066f90 0x7f7c00069450 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c24155650 0x7f7c2406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2415bea0 0x7f7c24155110 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 --2- 172.21.15.59:0/3662153022 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c080043a0 0x7f7c2414a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 -- 172.21.15.59:0/3662153022 >> 172.21.15.59:0/3662153022 conn(0x7f7c240b2240 msgr2=0x7f7c240b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 -- 172.21.15.59:0/3662153022 shutdown_connections 2024-04-25T09:02:46.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.695+0000 7f7c2ac00640 1 -- 172.21.15.59:0/3662153022 wait complete. 2024-04-25T09:02:46.707 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:02:46.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.855+0000 7ff4a1200640 1 Processor -- start 2024-04-25T09:02:46.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.855+0000 7ff4a1200640 1 -- start start 2024-04-25T09:02:46.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff4a1200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c0cef30 0x7ff49c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff4a1200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff49c06e900 0x7ff49c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff4a1200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49c15ac60 con 0x7ff49c144140 2024-04-25T09:02:46.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff4a1200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49c06ed30 con 0x7ff49c06e900 2024-04-25T09:02:46.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff4a1200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c0cf3e0 con 0x7ff49c0cef30 2024-04-25T09:02:46.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff49a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff49c06e900 0x7ff49c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff499e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff49c144140 0x7ff49c0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45050/0 (socket says 172.21.15.59:45050) 2024-04-25T09:02:46.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff499e00640 1 -- 172.21.15.59:0/688438565 learned_addr learned my addr 172.21.15.59:0/688438565 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:46.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff493e00640 1 --2- 172.21.15.59:0/688438565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c0cef30 0x7ff49c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff49a800640 1 -- 172.21.15.59:0/688438565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c0cef30 msgr2=0x7ff49c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:46.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff49a800640 1 --2- 172.21.15.59:0/688438565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c0cef30 0x7ff49c06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff49a800640 1 -- 172.21.15.59:0/688438565 >> v1:172.21.15.59:6789/0 conn(0x7ff49c144140 legacy=0x7ff49c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.859+0000 7ff49a800640 1 -- 172.21.15.59:0/688438565 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c15af20 con 0x7ff49c06e900 2024-04-25T09:02:46.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff49a800640 1 --2- 172.21.15.59:0/688438565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49c06e900 0x7ff49c0b0760 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff494009d90 tx=0x7ff49401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670de427e5c61d84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff499400640 1 -- 172.21.15.59:0/688438565 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4940ad070 con 0x7ff49c06e900 2024-04-25T09:02:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff499400640 1 -- 172.21.15.59:0/688438565 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4940a9660 con 0x7ff49c06e900 2024-04-25T09:02:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff499400640 1 -- 172.21.15.59:0/688438565 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4940a9a30 con 0x7ff49c06e900 2024-04-25T09:02:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff4a1200640 1 -- 172.21.15.59:0/688438565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49c06e900 msgr2=0x7ff49c0b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff4a1200640 1 --2- 172.21.15.59:0/688438565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49c06e900 0x7ff49c0b0760 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff494009d90 tx=0x7ff49401c970 comp rx=0 tx=0).stop 2024-04-25T09:02:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff4a1200640 1 -- 172.21.15.59:0/688438565 shutdown_connections 2024-04-25T09:02:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff4a1200640 1 --2- 172.21.15.59:0/688438565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49c06e900 0x7ff49c0b0760 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff4a1200640 1 --2- 172.21.15.59:0/688438565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c0cef30 0x7ff49c06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff4a1200640 1 -- 172.21.15.59:0/688438565 >> 172.21.15.59:0/688438565 conn(0x7ff49c066fa0 msgr2=0x7ff49c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff4a1200640 1 -- 172.21.15.59:0/688438565 shutdown_connections 2024-04-25T09:02:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff4a1200640 1 -- 172.21.15.59:0/688438565 wait complete. 2024-04-25T09:02:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff4a1200640 1 Processor -- start 2024-04-25T09:02:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.863+0000 7ff4a1200640 1 -- start start 2024-04-25T09:02:46.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff4a1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49c06e900 0x7ff49c12fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff4a1200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49c0cef30 0x7ff49c159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff4a1200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c144140 0x7ff49c159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff4a1200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c15ba00 con 0x7ff49c06e900 2024-04-25T09:02:46.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff4a1200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c144520 con 0x7ff49c0cef30 2024-04-25T09:02:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff4a1200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c15bb80 con 0x7ff49c144140 2024-04-25T09:02:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff499e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49c06e900 0x7ff49c12fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff499e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49c06e900 0x7ff49c12fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32996/0 (socket says 172.21.15.59:32996) 2024-04-25T09:02:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff499e00640 1 -- 172.21.15.59:0/348446636 learned_addr learned my addr 172.21.15.59:0/348446636 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff49a800640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c144140 0x7ff49c159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff493e00640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49c0cef30 0x7ff49c159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff499e00640 1 -- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c144140 msgr2=0x7ff49c159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff499e00640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c144140 0x7ff49c159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff499e00640 1 -- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49c0cef30 msgr2=0x7ff49c159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff499e00640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49c0cef30 0x7ff49c159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff499e00640 1 -- 172.21.15.59:0/348446636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c133300 con 0x7ff49c06e900 2024-04-25T09:02:46.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff499e00640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49c06e900 0x7ff49c12fc60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c370 tx=0x7ff48c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff492000640 1 -- 172.21.15.59:0/348446636 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c017070 con 0x7ff49c06e900 2024-04-25T09:02:46.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff492000640 1 -- 172.21.15.59:0/348446636 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48c005cf0 con 0x7ff49c06e900 2024-04-25T09:02:46.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff492000640 1 -- 172.21.15.59:0/348446636 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff48c0072f0 con 0x7ff49c06e900 2024-04-25T09:02:46.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff4a1200640 1 -- 172.21.15.59:0/348446636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49c130720 con 0x7ff49c06e900 2024-04-25T09:02:46.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff4a1200640 1 -- 172.21.15.59:0/348446636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49c130ce0 con 0x7ff49c06e900 2024-04-25T09:02:46.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff4a1200640 1 -- 172.21.15.59:0/348446636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff49c0745d0 con 0x7ff49c06e900 2024-04-25T09:02:46.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.867+0000 7ff492000640 1 -- 172.21.15.59:0/348446636 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff48c01a070 con 0x7ff49c06e900 2024-04-25T09:02:46.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.871+0000 7ff492000640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff478066f60 0x7ff478069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:46.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.871+0000 7ff492000640 1 -- 172.21.15.59:0/348446636 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7ff48c0842b0 con 0x7ff49c06e900 2024-04-25T09:02:46.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.871+0000 7ff493e00640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff478066f60 0x7ff478069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:46.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.871+0000 7ff493e00640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff478066f60 0x7ff478069420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0b19c0 tx=0x7ff484008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:46.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:46.875+0000 7ff492000640 1 -- 172.21.15.59:0/348446636 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff48c0553e0 con 0x7ff49c06e900 2024-04-25T09:02:47.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.039+0000 7ff4a1200640 1 -- 172.21.15.59:0/348446636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff49c15e4e0 con 0x7ff49c06e900 2024-04-25T09:02:47.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.039+0000 7ff492000640 1 -- 172.21.15.59:0/348446636 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff48c05b0e0 con 0x7ff49c06e900 2024-04-25T09:02:47.033 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:47.033 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T09:02:47.033 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:02:47.033 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-04-25T09:02:47.033 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-04-25T09:02:47.033 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:02:47.033 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T09:02:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.043+0000 7ff4a1200640 1 -- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff478066f60 msgr2=0x7ff478069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.043+0000 7ff4a1200640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff478066f60 0x7ff478069420 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff49c0b19c0 tx=0x7ff484008040 comp rx=0 tx=0).stop 2024-04-25T09:02:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.043+0000 7ff4a1200640 1 -- 172.21.15.59:0/348446636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49c06e900 msgr2=0x7ff49c12fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.043+0000 7ff4a1200640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49c06e900 0x7ff49c12fc60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff48c00c370 tx=0x7ff48c00c830 comp rx=0 tx=0).stop 2024-04-25T09:02:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.043+0000 7ff4a1200640 1 -- 172.21.15.59:0/348446636 shutdown_connections 2024-04-25T09:02:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.043+0000 7ff4a1200640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff478066f60 0x7ff478069420 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.043+0000 7ff4a1200640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49c144140 0x7ff49c159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.043+0000 7ff4a1200640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49c0cef30 0x7ff49c159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.043+0000 7ff4a1200640 1 --2- 172.21.15.59:0/348446636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49c06e900 0x7ff49c12fc60 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.043+0000 7ff4a1200640 1 -- 172.21.15.59:0/348446636 >> 172.21.15.59:0/348446636 conn(0x7ff49c066fa0 msgr2=0x7ff49c15ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.043+0000 7ff4a1200640 1 -- 172.21.15.59:0/348446636 shutdown_connections 2024-04-25T09:02:47.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.043+0000 7ff4a1200640 1 -- 172.21.15.59:0/348446636 wait complete. 2024-04-25T09:02:47.053 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:02:47.053 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:02:47.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cbec00640 1 Processor -- start 2024-04-25T09:02:47.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cbec00640 1 -- start start 2024-04-25T09:02:47.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cbec00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9cb8066b50 0x7f9cb806e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cbec00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb8067000 con 0x7f9cb806e880 2024-04-25T09:02:47.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cbec00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb806b990 con 0x7f9cb8071b70 2024-04-25T09:02:47.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cbec00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb806dbd0 con 0x7f9cb8066b50 2024-04-25T09:02:47.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cbcc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9cb806e880 0x7f9cb806ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45060/0 (socket says 172.21.15.59:45060) 2024-04-25T09:02:47.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cbcc00640 1 -- 172.21.15.59:0/827980582 learned_addr learned my addr 172.21.15.59:0/827980582 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cafe00640 1 --2- 172.21.15.59:0/827980582 >> v2:172.21.15.178:3300/0 conn(0x7f9cb8066b50 0x7f9cb806e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cb7400640 1 -- 172.21.15.59:0/827980582 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529729263 0 0) 0x7f9cb8067000 con 0x7f9cb806e880 2024-04-25T09:02:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cb7400640 1 -- 172.21.15.59:0/827980582 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c9c003530 con 0x7f9cb806e880 2024-04-25T09:02:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cafe00640 1 -- 172.21.15.59:0/827980582 >> v1:172.21.15.178:6789/0 conn(0x7f9cb8071b70 legacy=0x7f9cb8071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cafe00640 1 -- 172.21.15.59:0/827980582 >> v1:172.21.15.59:6789/0 conn(0x7f9cb806e880 legacy=0x7f9cb806ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.207+0000 7f9cafe00640 1 -- 172.21.15.59:0/827980582 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb806bc70 con 0x7f9cb8066b50 2024-04-25T09:02:47.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.211+0000 7f9cafe00640 1 --2- 172.21.15.59:0/827980582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8066b50 0x7f9cb806e340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00097c0 tx=0x7f9ca001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1d970aa0d844259 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.211+0000 7f9cb7400640 1 -- 172.21.15.59:0/827980582 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00b2070 con 0x7f9cb8066b50 2024-04-25T09:02:47.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.211+0000 7f9cb7400640 1 -- 172.21.15.59:0/827980582 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca00ad680 con 0x7f9cb8066b50 2024-04-25T09:02:47.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.211+0000 7f9cb7400640 1 -- 172.21.15.59:0/827980582 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00ada50 con 0x7f9cb8066b50 2024-04-25T09:02:47.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.211+0000 7f9cbec00640 1 -- 172.21.15.59:0/827980582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8066b50 msgr2=0x7f9cb806e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.211+0000 7f9cbec00640 1 --2- 172.21.15.59:0/827980582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8066b50 0x7f9cb806e340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9ca00097c0 tx=0x7f9ca001c470 comp rx=0 tx=0).stop 2024-04-25T09:02:47.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.211+0000 7f9cbec00640 1 -- 172.21.15.59:0/827980582 shutdown_connections 2024-04-25T09:02:47.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.211+0000 7f9cbec00640 1 --2- 172.21.15.59:0/827980582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8066b50 0x7f9cb806e340 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.211+0000 7f9cbec00640 1 -- 172.21.15.59:0/827980582 >> 172.21.15.59:0/827980582 conn(0x7f9cb80cfd80 msgr2=0x7f9cb80d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:47.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.211+0000 7f9cbec00640 1 -- 172.21.15.59:0/827980582 shutdown_connections 2024-04-25T09:02:47.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.211+0000 7f9cbec00640 1 -- 172.21.15.59:0/827980582 wait complete. 2024-04-25T09:02:47.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbec00640 1 Processor -- start 2024-04-25T09:02:47.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbec00640 1 -- start start 2024-04-25T09:02:47.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbec00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8066b50 0x7f9cb8157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbec00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cb806e880 0x7f9cb8160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbec00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb8071b70 0x7f9cb81534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbec00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80b4e80 con 0x7f9cb8071b70 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbec00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80b4d00 con 0x7f9cb8066b50 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbec00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb815deb0 con 0x7f9cb806e880 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb8071b70 0x7f9cb81534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb8071b70 0x7f9cb81534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:32998/0 (socket says 172.21.15.59:32998) 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbcc00640 1 -- 172.21.15.59:0/1883961441 learned_addr learned my addr 172.21.15.59:0/1883961441 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cb7e00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8066b50 0x7f9cb8157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cafe00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cb806e880 0x7f9cb8160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbcc00640 1 -- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cb806e880 msgr2=0x7f9cb8160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbcc00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cb806e880 0x7f9cb8160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbcc00640 1 -- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8066b50 msgr2=0x7f9cb8157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbcc00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8066b50 0x7f9cb8157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:47.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbcc00640 1 -- 172.21.15.59:0/1883961441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8159e10 con 0x7f9cb8071b70 2024-04-25T09:02:47.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbcc00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb8071b70 0x7f9cb81534f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000cb70 tx=0x7f9cb000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cb4c00640 1 -- 172.21.15.59:0/1883961441 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0017070 con 0x7f9cb8071b70 2024-04-25T09:02:47.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cb4c00640 1 -- 172.21.15.59:0/1883961441 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb000ace0 con 0x7f9cb8071b70 2024-04-25T09:02:47.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbec00640 1 -- 172.21.15.59:0/1883961441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb815a0b0 con 0x7f9cb8071b70 2024-04-25T09:02:47.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cb4c00640 1 -- 172.21.15.59:0/1883961441 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0012620 con 0x7f9cb8071b70 2024-04-25T09:02:47.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.215+0000 7f9cbec00640 1 -- 172.21.15.59:0/1883961441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb815a670 con 0x7f9cb8071b70 2024-04-25T09:02:47.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.219+0000 7f9cbec00640 1 -- 172.21.15.59:0/1883961441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb80745d0 con 0x7f9cb8071b70 2024-04-25T09:02:47.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.219+0000 7f9cb4c00640 1 -- 172.21.15.59:0/1883961441 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9cb001a070 con 0x7f9cb8071b70 2024-04-25T09:02:47.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.219+0000 7f9cb4c00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9c94066f60 0x7f9c94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:47.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.219+0000 7f9cb4c00640 1 -- 172.21.15.59:0/1883961441 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f9cb0084bc0 con 0x7f9cb8071b70 2024-04-25T09:02:47.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.219+0000 7f9cb7e00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9c94066f60 0x7f9c94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:47.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.219+0000 7f9cb7e00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9c94066f60 0x7f9c94069420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8007fd0 tx=0x7f9ca8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:47.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.223+0000 7f9cb4c00640 1 -- 172.21.15.59:0/1883961441 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9cb0055740 con 0x7f9cb8071b70 2024-04-25T09:02:47.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:47.383+0000 7f9cbec00640 1 -- 172.21.15.59:0/1883961441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f9cb8072950 con 0x7f9cb8071b70 2024-04-25T09:02:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.199+0000 7f9cb4c00640 1 -- 172.21.15.59:0/1883961441 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9cb00597e0 con 0x7f9cb8071b70 2024-04-25T09:02:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-04-25T09:02:48.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.203+0000 7f9cbec00640 1 -- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9c94066f60 msgr2=0x7f9c94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.203+0000 7f9cbec00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9c94066f60 0x7f9c94069420 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8007fd0 tx=0x7f9ca8009040 comp rx=0 tx=0).stop 2024-04-25T09:02:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.203+0000 7f9cbec00640 1 -- 172.21.15.59:0/1883961441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb8071b70 msgr2=0x7f9cb81534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.203+0000 7f9cbec00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb8071b70 0x7f9cb81534f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9cb000cb70 tx=0x7f9cb000a430 comp rx=0 tx=0).stop 2024-04-25T09:02:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.203+0000 7f9cbec00640 1 -- 172.21.15.59:0/1883961441 shutdown_connections 2024-04-25T09:02:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.203+0000 7f9cbec00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9c94066f60 0x7f9c94069420 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.203+0000 7f9cbec00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9cb8071b70 0x7f9cb81534f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.203+0000 7f9cbec00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9cb806e880 0x7f9cb8160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.203+0000 7f9cbec00640 1 --2- 172.21.15.59:0/1883961441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9cb8066b50 0x7f9cb8157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.203+0000 7f9cbec00640 1 -- 172.21.15.59:0/1883961441 >> 172.21.15.59:0/1883961441 conn(0x7f9cb80cfd80 msgr2=0x7f9cb80d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.203+0000 7f9cbec00640 1 -- 172.21.15.59:0/1883961441 shutdown_connections 2024-04-25T09:02:48.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.203+0000 7f9cbec00640 1 -- 172.21.15.59:0/1883961441 wait complete. 2024-04-25T09:02:48.223 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:02:48.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.383+0000 7f425b000640 1 Processor -- start 2024-04-25T09:02:48.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.383+0000 7f425b000640 1 -- start start 2024-04-25T09:02:48.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f425b000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f42540cf3c0 0x7f42540cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f425b000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42540d02a0 con 0x7f425415b910 2024-04-25T09:02:48.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f425b000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42540cc350 con 0x7f42540cd370 2024-04-25T09:02:48.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f425b000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42540cc630 con 0x7f42540cf3c0 2024-04-25T09:02:48.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f4253e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f425415b910 0x7f42540cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45064/0 (socket says 172.21.15.59:45064) 2024-04-25T09:02:48.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f4253e00640 1 -- 172.21.15.59:0/2803376857 learned_addr learned my addr 172.21.15.59:0/2803376857 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:48.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f424b400640 1 --2- 172.21.15.59:0/2803376857 >> v2:172.21.15.178:3300/0 conn(0x7f42540cf3c0 0x7f42540cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f4253400640 1 -- 172.21.15.59:0/2803376857 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53167666 0 0) 0x7f42540d02a0 con 0x7f425415b910 2024-04-25T09:02:48.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f4253400640 1 -- 172.21.15.59:0/2803376857 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4238003530 con 0x7f425415b910 2024-04-25T09:02:48.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f424b400640 1 -- 172.21.15.59:0/2803376857 >> v1:172.21.15.178:6789/0 conn(0x7f42540cd370 legacy=0x7f4254099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f424b400640 1 -- 172.21.15.59:0/2803376857 >> v1:172.21.15.59:6789/0 conn(0x7f425415b910 legacy=0x7f42540cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f4253400640 1 -- 172.21.15.59:0/2803376857 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3065632931 0 0) 0x7f4238003530 con 0x7f425415b910 2024-04-25T09:02:48.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.387+0000 7f424b400640 1 -- 172.21.15.59:0/2803376857 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42540cc910 con 0x7f42540cf3c0 2024-04-25T09:02:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f424b400640 1 --2- 172.21.15.59:0/2803376857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42540cf3c0 0x7f42540cce30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f423c0097c0 tx=0x7f423c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=723f395b60a22462 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:48.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f4253400640 1 -- 172.21.15.59:0/2803376857 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c0b0070 con 0x7f42540cf3c0 2024-04-25T09:02:48.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f4253400640 1 -- 172.21.15.59:0/2803376857 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c0ab400 con 0x7f42540cf3c0 2024-04-25T09:02:48.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f4253400640 1 -- 172.21.15.59:0/2803376857 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244001680 con 0x7f42540cf3c0 2024-04-25T09:02:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 -- 172.21.15.59:0/2803376857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42540cf3c0 msgr2=0x7f42540cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 --2- 172.21.15.59:0/2803376857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42540cf3c0 0x7f42540cce30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f423c0097c0 tx=0x7f423c01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 -- 172.21.15.59:0/2803376857 shutdown_connections 2024-04-25T09:02:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 --2- 172.21.15.59:0/2803376857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f42540cf3c0 0x7f42540cce30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 -- 172.21.15.59:0/2803376857 >> 172.21.15.59:0/2803376857 conn(0x7f42540b3200 msgr2=0x7f42540b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 -- 172.21.15.59:0/2803376857 shutdown_connections 2024-04-25T09:02:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 -- 172.21.15.59:0/2803376857 wait complete. 2024-04-25T09:02:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 Processor -- start 2024-04-25T09:02:48.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 -- start start 2024-04-25T09:02:48.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42540cd370 0x7f42540b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42540cf3c0 0x7f425414fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f425415b910 0x7f42540c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4254169b30 con 0x7f42540cf3c0 2024-04-25T09:02:48.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42541699b0 con 0x7f425415b910 2024-04-25T09:02:48.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.391+0000 7f425b000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4254169cb0 con 0x7f42540cd370 2024-04-25T09:02:48.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f424b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42540cf3c0 0x7f425414fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f424b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42540cf3c0 0x7f425414fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33000/0 (socket says 172.21.15.59:33000) 2024-04-25T09:02:48.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f424b400640 1 -- 172.21.15.59:0/151093600 learned_addr learned my addr 172.21.15.59:0/151093600 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:48.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f4253e00640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42540cd370 0x7f42540b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f4259000640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f425415b910 0x7f42540c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f424b400640 1 -- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42540cd370 msgr2=0x7f42540b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f424b400640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42540cd370 0x7f42540b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f424b400640 1 -- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f425415b910 msgr2=0x7f42540c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f424b400640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f425415b910 0x7f42540c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f424b400640 1 -- 172.21.15.59:0/151093600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425415ef30 con 0x7f42540cf3c0 2024-04-25T09:02:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f4253e00640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42540cd370 0x7f42540b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f424b400640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42540cf3c0 0x7f425414fe10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f423c0ae040 tx=0x7f423c019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f4250c00640 1 -- 172.21.15.59:0/151093600 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c0b8070 con 0x7f42540cf3c0 2024-04-25T09:02:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f4250c00640 1 -- 172.21.15.59:0/151093600 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c004020 con 0x7f42540cf3c0 2024-04-25T09:02:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f425b000640 1 -- 172.21.15.59:0/151093600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42540b49c0 con 0x7f42540cf3c0 2024-04-25T09:02:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f4250c00640 1 -- 172.21.15.59:0/151093600 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c0b0040 con 0x7f42540cf3c0 2024-04-25T09:02:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f425b000640 1 -- 172.21.15.59:0/151093600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425415d210 con 0x7f42540cf3c0 2024-04-25T09:02:48.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f425b000640 1 -- 172.21.15.59:0/151093600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42540745d0 con 0x7f42540cf3c0 2024-04-25T09:02:48.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.395+0000 7f4250c00640 1 -- 172.21.15.59:0/151093600 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f423c003620 con 0x7f42540cf3c0 2024-04-25T09:02:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.399+0000 7f4250c00640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4230066f60 0x7f4230069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.399+0000 7f4250c00640 1 -- 172.21.15.59:0/151093600 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f423c11ef30 con 0x7f42540cf3c0 2024-04-25T09:02:48.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.399+0000 7f4253e00640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4230066f60 0x7f4230069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:48.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.399+0000 7f4253e00640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4230066f60 0x7f4230069420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f42440017f0 tx=0x7f4244009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:48.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.403+0000 7f4250c00640 1 -- 172.21.15.59:0/151093600 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f423c14acb0 con 0x7f42540cf3c0 2024-04-25T09:02:48.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:48.563+0000 7f425b000640 1 -- 172.21.15.59:0/151093600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f42540c4ff0 con 0x7f42540cf3c0 2024-04-25T09:02:49.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.203+0000 7f4250c00640 1 -- 172.21.15.59:0/151093600 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7f423c015fb0 con 0x7f42540cf3c0 2024-04-25T09:02:49.195 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-04-25T09:02:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.207+0000 7f425b000640 1 -- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4230066f60 msgr2=0x7f4230069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.207+0000 7f425b000640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4230066f60 0x7f4230069420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f42440017f0 tx=0x7f4244009040 comp rx=0 tx=0).stop 2024-04-25T09:02:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.207+0000 7f425b000640 1 -- 172.21.15.59:0/151093600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42540cf3c0 msgr2=0x7f425414fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.207+0000 7f425b000640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42540cf3c0 0x7f425414fe10 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f423c0ae040 tx=0x7f423c019160 comp rx=0 tx=0).stop 2024-04-25T09:02:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.207+0000 7f425b000640 1 -- 172.21.15.59:0/151093600 shutdown_connections 2024-04-25T09:02:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.207+0000 7f425b000640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4230066f60 0x7f4230069420 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.207+0000 7f425b000640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f425415b910 0x7f42540c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.207+0000 7f425b000640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42540cf3c0 0x7f425414fe10 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.207+0000 7f425b000640 1 --2- 172.21.15.59:0/151093600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f42540cd370 0x7f42540b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.207+0000 7f425b000640 1 -- 172.21.15.59:0/151093600 >> 172.21.15.59:0/151093600 conn(0x7f42540b3200 msgr2=0x7f4254099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:49.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.207+0000 7f425b000640 1 -- 172.21.15.59:0/151093600 shutdown_connections 2024-04-25T09:02:49.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.207+0000 7f425b000640 1 -- 172.21.15.59:0/151093600 wait complete. 2024-04-25T09:02:49.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:02:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.395+0000 7f57cd800640 1 Processor -- start 2024-04-25T09:02:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.395+0000 7f57cd800640 1 -- start start 2024-04-25T09:02:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.395+0000 7f57cd800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57c806cb10 0x7f57c80cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.395+0000 7f57cd800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c8099dd0 con 0x7f57c806c730 2024-04-25T09:02:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.395+0000 7f57cd800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c809a0b0 con 0x7f57c80cfcc0 2024-04-25T09:02:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.395+0000 7f57cd800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c809a9e0 con 0x7f57c806cb10 2024-04-25T09:02:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.395+0000 7f57c7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57c806cb10 0x7f57c80cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.395+0000 7f57c7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f57c806c730 0x7f57c815ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45080/0 (socket says 172.21.15.59:45080) 2024-04-25T09:02:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.395+0000 7f57c7e00640 1 -- 172.21.15.59:0/3088334701 learned_addr learned my addr 172.21.15.59:0/3088334701 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:49.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57c7400640 1 -- 172.21.15.59:0/3088334701 >> v1:172.21.15.178:6789/0 conn(0x7f57c80cfcc0 legacy=0x7f57c80d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:49.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57c7400640 1 -- 172.21.15.59:0/3088334701 >> v1:172.21.15.59:6789/0 conn(0x7f57c806c730 legacy=0x7f57c815ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57c7400640 1 -- 172.21.15.59:0/3088334701 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c809a390 con 0x7f57c806cb10 2024-04-25T09:02:49.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57c6a00640 1 -- 172.21.15.59:0/3088334701 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382167707 0 0) 0x7f57c8099dd0 con 0x7f57c806c730 2024-04-25T09:02:49.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57c7400640 1 --2- 172.21.15.59:0/3088334701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c806cb10 0x7f57c80cf780 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f57b40097c0 tx=0x7f57b401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bf56b880b343ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57c6a00640 1 -- 172.21.15.59:0/3088334701 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b40b1070 con 0x7f57c806cb10 2024-04-25T09:02:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57c6a00640 1 -- 172.21.15.59:0/3088334701 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b40ac640 con 0x7f57c806cb10 2024-04-25T09:02:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57c6a00640 1 -- 172.21.15.59:0/3088334701 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b40aca10 con 0x7f57c806cb10 2024-04-25T09:02:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57cd800640 1 -- 172.21.15.59:0/3088334701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c806cb10 msgr2=0x7f57c80cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57cd800640 1 --2- 172.21.15.59:0/3088334701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c806cb10 0x7f57c80cf780 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f57b40097c0 tx=0x7f57b401c460 comp rx=0 tx=0).stop 2024-04-25T09:02:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57cd800640 1 -- 172.21.15.59:0/3088334701 shutdown_connections 2024-04-25T09:02:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57cd800640 1 --2- 172.21.15.59:0/3088334701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c806cb10 0x7f57c80cf780 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57cd800640 1 -- 172.21.15.59:0/3088334701 >> 172.21.15.59:0/3088334701 conn(0x7f57c80b3030 msgr2=0x7f57c80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57cd800640 1 -- 172.21.15.59:0/3088334701 shutdown_connections 2024-04-25T09:02:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.399+0000 7f57cd800640 1 -- 172.21.15.59:0/3088334701 wait complete. 2024-04-25T09:02:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cd800640 1 Processor -- start 2024-04-25T09:02:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cd800640 1 -- start start 2024-04-25T09:02:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cd800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c806c730 0x7f57c815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cd800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c806cb10 0x7f57c80aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cd800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c80cfcc0 0x7f57c80aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cd800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80b08a0 con 0x7f57c80cfcc0 2024-04-25T09:02:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cd800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80b0720 con 0x7f57c806c730 2024-04-25T09:02:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cd800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c806cf50 con 0x7f57c806cb10 2024-04-25T09:02:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c80cfcc0 0x7f57c80aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c80cfcc0 0x7f57c80aefc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33026/0 (socket says 172.21.15.59:33026) 2024-04-25T09:02:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cce00640 1 -- 172.21.15.59:0/3710728785 learned_addr learned my addr 172.21.15.59:0/3710728785 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cce00640 1 -- 172.21.15.59:0/3710728785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c806cb10 msgr2=0x7f57c80aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cce00640 1 --2- 172.21.15.59:0/3710728785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c806cb10 0x7f57c80aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cce00640 1 -- 172.21.15.59:0/3710728785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c806c730 msgr2=0x7f57c815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cce00640 1 --2- 172.21.15.59:0/3710728785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c806c730 0x7f57c815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cce00640 1 -- 172.21.15.59:0/3710728785 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c8160f40 con 0x7f57c80cfcc0 2024-04-25T09:02:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cce00640 1 --2- 172.21.15.59:0/3710728785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c80cfcc0 0x7f57c80aefc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f57c000c780 tx=0x7f57c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:49.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57bfe00640 1 -- 172.21.15.59:0/3710728785 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0004b70 con 0x7f57c80cfcc0 2024-04-25T09:02:49.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57bfe00640 1 -- 172.21.15.59:0/3710728785 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c0004d10 con 0x7f57c80cfcc0 2024-04-25T09:02:49.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57bfe00640 1 -- 172.21.15.59:0/3710728785 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c000aa90 con 0x7f57c80cfcc0 2024-04-25T09:02:49.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.403+0000 7f57cd800640 1 -- 172.21.15.59:0/3710728785 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c814e640 con 0x7f57c80cfcc0 2024-04-25T09:02:49.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.407+0000 7f57cd800640 1 -- 172.21.15.59:0/3710728785 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c8160c30 con 0x7f57c80cfcc0 2024-04-25T09:02:49.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.407+0000 7f57cd800640 1 -- 172.21.15.59:0/3710728785 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c80745d0 con 0x7f57c80cfcc0 2024-04-25T09:02:49.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.407+0000 7f57bfe00640 1 -- 172.21.15.59:0/3710728785 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f57c000ac30 con 0x7f57c80cfcc0 2024-04-25T09:02:49.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.407+0000 7f57bfe00640 1 --2- 172.21.15.59:0/3710728785 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f57a8066f60 0x7f57a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:49.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.407+0000 7f57bfe00640 1 -- 172.21.15.59:0/3710728785 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f57c0085b40 con 0x7f57c80cfcc0 2024-04-25T09:02:49.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.407+0000 7f57c7e00640 1 --2- 172.21.15.59:0/3710728785 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f57a8066f60 0x7f57a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:49.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.411+0000 7f57c7e00640 1 --2- 172.21.15.59:0/3710728785 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f57a8066f60 0x7f57a8069420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f57b80015a0 tx=0x7f57b8007970 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.411+0000 7f57bfe00640 1 -- 172.21.15.59:0/3710728785 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f57c0020070 con 0x7f57c80cfcc0 2024-04-25T09:02:49.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:49.611+0000 7f57cd800640 1 -- 172.21.15.59:0/3710728785 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f57c806c510 con 0x7f57c80cfcc0 2024-04-25T09:02:50.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.227+0000 7f57bfe00640 1 -- 172.21.15.59:0/3710728785 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v15) v1 ==== 172+0+0 (secure 0 0 0) 0x7f57c0056a90 con 0x7f57c80cfcc0 2024-04-25T09:02:50.223 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 5 and data pool 6 2024-04-25T09:02:50.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.239+0000 7f57cd800640 1 -- 172.21.15.59:0/3710728785 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f57a8066f60 msgr2=0x7f57a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.239+0000 7f57cd800640 1 --2- 172.21.15.59:0/3710728785 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f57a8066f60 0x7f57a8069420 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f57b80015a0 tx=0x7f57b8007970 comp rx=0 tx=0).stop 2024-04-25T09:02:50.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.239+0000 7f57cd800640 1 -- 172.21.15.59:0/3710728785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c80cfcc0 msgr2=0x7f57c80aefc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.239+0000 7f57cd800640 1 --2- 172.21.15.59:0/3710728785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c80cfcc0 0x7f57c80aefc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f57c000c780 tx=0x7f57c000cc40 comp rx=0 tx=0).stop 2024-04-25T09:02:50.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.243+0000 7f57cd800640 1 -- 172.21.15.59:0/3710728785 shutdown_connections 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.243+0000 7f57cd800640 1 --2- 172.21.15.59:0/3710728785 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f57a8066f60 0x7f57a8069420 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.243+0000 7f57cd800640 1 --2- 172.21.15.59:0/3710728785 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c80cfcc0 0x7f57c80aefc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.243+0000 7f57cd800640 1 --2- 172.21.15.59:0/3710728785 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c806cb10 0x7f57c80aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.243+0000 7f57cd800640 1 --2- 172.21.15.59:0/3710728785 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c806c730 0x7f57c815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.243+0000 7f57cd800640 1 -- 172.21.15.59:0/3710728785 >> 172.21.15.59:0/3710728785 conn(0x7f57c80b3030 msgr2=0x7f57c80d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.251+0000 7f57cd800640 1 -- 172.21.15.59:0/3710728785 shutdown_connections 2024-04-25T09:02:50.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.251+0000 7f57cd800640 1 -- 172.21.15.59:0/3710728785 wait complete. 2024-04-25T09:02:50.274 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.423+0000 7f0261c00640 1 Processor -- start 2024-04-25T09:02:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.423+0000 7f0261c00640 1 -- start start 2024-04-25T09:02:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f0261c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f025c15fe50 0x7f025c0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f0261c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f025c0b1c90 0x7f025c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f0261c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f025c0b20a0 con 0x7f025c145270 2024-04-25T09:02:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f0261c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c145650 con 0x7f025c0b1c90 2024-04-25T09:02:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f0261c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f025c1602b0 con 0x7f025c15fe50 2024-04-25T09:02:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f025b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f025c0b1c90 0x7f025c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f025b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f025c0b1c90 0x7f025c15bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33034/0 (socket says 172.21.15.59:33034) 2024-04-25T09:02:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f025b400640 1 -- 172.21.15.59:0/652749858 learned_addr learned my addr 172.21.15.59:0/652749858 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f0252000640 1 --2- 172.21.15.59:0/652749858 >> v2:172.21.15.178:3300/0 conn(0x7f025c15fe50 0x7f025c0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f025b400640 1 -- 172.21.15.59:0/652749858 >> v2:172.21.15.178:3300/0 conn(0x7f025c15fe50 msgr2=0x7f025c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f025b400640 1 --2- 172.21.15.59:0/652749858 >> v2:172.21.15.178:3300/0 conn(0x7f025c15fe50 0x7f025c0b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f025b400640 1 -- 172.21.15.59:0/652749858 >> v1:172.21.15.178:6789/0 conn(0x7f025c145270 legacy=0x7f025c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.427+0000 7f025b400640 1 -- 172.21.15.59:0/652749858 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0cc4e0 con 0x7f025c0b1c90 2024-04-25T09:02:50.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f025b400640 1 --2- 172.21.15.59:0/652749858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0b1c90 0x7f025c15bd80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f025c0b24b0 tx=0x7f025401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5436dfe86f3ab5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f025a000640 1 -- 172.21.15.59:0/652749858 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02540a5880 con 0x7f025c0b1c90 2024-04-25T09:02:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f025a000640 1 -- 172.21.15.59:0/652749858 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02540a5a20 con 0x7f025c0b1c90 2024-04-25T09:02:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f025a000640 1 -- 172.21.15.59:0/652749858 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02540a5df0 con 0x7f025c0b1c90 2024-04-25T09:02:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 -- 172.21.15.59:0/652749858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0b1c90 msgr2=0x7f025c15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 --2- 172.21.15.59:0/652749858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0b1c90 0x7f025c15bd80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f025c0b24b0 tx=0x7f025401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 -- 172.21.15.59:0/652749858 shutdown_connections 2024-04-25T09:02:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 --2- 172.21.15.59:0/652749858 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0b1c90 0x7f025c15bd80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 --2- 172.21.15.59:0/652749858 >> v2:172.21.15.178:3300/0 conn(0x7f025c15fe50 0x7f025c0b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 -- 172.21.15.59:0/652749858 >> 172.21.15.59:0/652749858 conn(0x7f025c066fa0 msgr2=0x7f025c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 -- 172.21.15.59:0/652749858 shutdown_connections 2024-04-25T09:02:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 -- 172.21.15.59:0/652749858 wait complete. 2024-04-25T09:02:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 Processor -- start 2024-04-25T09:02:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 -- start start 2024-04-25T09:02:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0b1c90 0x7f025c13da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f025c145270 0x7f025c13dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025c15fe50 0x7f025c15ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c15f930 con 0x7f025c0b1c90 2024-04-25T09:02:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f025c15f650 con 0x7f025c145270 2024-04-25T09:02:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.431+0000 7f0261c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f025c0cdbe0 con 0x7f025c15fe50 2024-04-25T09:02:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f025aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0b1c90 0x7f025c13da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f025aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0b1c90 0x7f025c13da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33042/0 (socket says 172.21.15.59:33042) 2024-04-25T09:02:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f025aa00640 1 -- 172.21.15.59:0/4174671708 learned_addr learned my addr 172.21.15.59:0/4174671708 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f0252000640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f025c145270 0x7f025c13dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f025b400640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025c15fe50 0x7f025c15ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f025aa00640 1 -- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025c15fe50 msgr2=0x7f025c15ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f025aa00640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025c15fe50 0x7f025c15ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f025aa00640 1 -- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f025c145270 msgr2=0x7f025c13dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f025aa00640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f025c145270 0x7f025c13dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f025aa00640 1 -- 172.21.15.59:0/4174671708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c142a90 con 0x7f025c0b1c90 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f0252000640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f025c145270 0x7f025c13dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f025aa00640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0b1c90 0x7f025c13da60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f024c00c530 tx=0x7f024c00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f0253400640 1 -- 172.21.15.59:0/4174671708 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c016020 con 0x7f025c0b1c90 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f0253400640 1 -- 172.21.15.59:0/4174671708 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f024c005220 con 0x7f025c0b1c90 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f0253400640 1 -- 172.21.15.59:0/4174671708 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f024c007030 con 0x7f025c0b1c90 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f0261c00640 1 -- 172.21.15.59:0/4174671708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f025c0b0bb0 con 0x7f025c0b1c90 2024-04-25T09:02:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f0261c00640 1 -- 172.21.15.59:0/4174671708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f025c141ea0 con 0x7f025c0b1c90 2024-04-25T09:02:50.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f0261c00640 1 -- 172.21.15.59:0/4174671708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f025c0745d0 con 0x7f025c0b1c90 2024-04-25T09:02:50.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.435+0000 7f0253400640 1 -- 172.21.15.59:0/4174671708 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f024c0071d0 con 0x7f025c0b1c90 2024-04-25T09:02:50.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.439+0000 7f0253400640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0238066f60 0x7f0238069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.439+0000 7f0253400640 1 -- 172.21.15.59:0/4174671708 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f024c084a70 con 0x7f025c0b1c90 2024-04-25T09:02:50.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.439+0000 7f0252000640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0238066f60 0x7f0238069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.439+0000 7f0252000640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0238066f60 0x7f0238069420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f025c1f9d00 tx=0x7f0244009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.443+0000 7f0253400640 1 -- 172.21.15.59:0/4174671708 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f024c020020 con 0x7f025c0b1c90 2024-04-25T09:02:50.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.603+0000 7f0261c00640 1 -- 172.21.15.59:0/4174671708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f025c06b8e0 con 0x7f025c0b1c90 2024-04-25T09:02:50.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0253400640 1 -- 172.21.15.59:0/4174671708 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16955 (secure 0 0 0) 0x7f025c0b20a0 con 0x7f025c0b1c90 2024-04-25T09:02:50.597 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:50.597 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":38,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:49.613708+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:47.433966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:48.612644+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0261c00640 1 -- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0238066f60 msgr2=0x7f0238069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0261c00640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0238066f60 0x7f0238069420 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f025c1f9d00 tx=0x7f0244009190 comp rx=0 tx=0).stop 2024-04-25T09:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0261c00640 1 -- 172.21.15.59:0/4174671708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0b1c90 msgr2=0x7f025c13da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0261c00640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0b1c90 0x7f025c13da60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f024c00c530 tx=0x7f024c00c9f0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0261c00640 1 -- 172.21.15.59:0/4174671708 shutdown_connections 2024-04-25T09:02:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0261c00640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0238066f60 0x7f0238069420 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0261c00640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f025c15fe50 0x7f025c15ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0261c00640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f025c145270 0x7f025c13dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0261c00640 1 --2- 172.21.15.59:0/4174671708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f025c0b1c90 0x7f025c13da60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0261c00640 1 -- 172.21.15.59:0/4174671708 >> 172.21.15.59:0/4174671708 conn(0x7f025c066fa0 msgr2=0x7f025c13f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0261c00640 1 -- 172.21.15.59:0/4174671708 shutdown_connections 2024-04-25T09:02:50.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.607+0000 7f0261c00640 1 -- 172.21.15.59:0/4174671708 wait complete. 2024-04-25T09:02:50.619 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:50.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.767+0000 7f8407800640 1 Processor -- start 2024-04-25T09:02:50.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.767+0000 7f8407800640 1 -- start start 2024-04-25T09:02:50.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f8407800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f84000cef30 0x7f840006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f8407800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f840006e900 0x7f84000b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f8407800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840015ac60 con 0x7f8400144140 2024-04-25T09:02:50.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f8407800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840006ed50 con 0x7f840006e900 2024-04-25T09:02:50.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f8407800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84000cf3e0 con 0x7f84000cef30 2024-04-25T09:02:50.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f8405800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f840006e900 0x7f84000b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f8404e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8400144140 0x7f84000ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60034/0 (socket says 172.21.15.59:60034) 2024-04-25T09:02:50.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f8404e00640 1 -- 172.21.15.59:0/758100179 learned_addr learned my addr 172.21.15.59:0/758100179 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:50.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f83ffe00640 1 --2- 172.21.15.59:0/758100179 >> v2:172.21.15.178:3300/0 conn(0x7f84000cef30 0x7f840006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f8405800640 1 -- 172.21.15.59:0/758100179 >> v2:172.21.15.178:3300/0 conn(0x7f84000cef30 msgr2=0x7f840006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:50.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f8405800640 1 --2- 172.21.15.59:0/758100179 >> v2:172.21.15.178:3300/0 conn(0x7f84000cef30 0x7f840006e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f8405800640 1 -- 172.21.15.59:0/758100179 >> v1:172.21.15.59:6789/0 conn(0x7f8400144140 legacy=0x7f84000ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f8405800640 1 -- 172.21.15.59:0/758100179 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840015af20 con 0x7f840006e900 2024-04-25T09:02:50.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.771+0000 7f83ff400640 1 -- 172.21.15.59:0/758100179 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563140182 0 0) 0x7f840015ac60 con 0x7f8400144140 2024-04-25T09:02:50.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8405800640 1 --2- 172.21.15.59:0/758100179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840006e900 0x7f84000b0760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f840006efb0 tx=0x7f83f801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=325f1f1f3c6cd493 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f83ff400640 1 -- 172.21.15.59:0/758100179 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80ad070 con 0x7f840006e900 2024-04-25T09:02:50.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f83ff400640 1 -- 172.21.15.59:0/758100179 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f80a9620 con 0x7f840006e900 2024-04-25T09:02:50.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f83ff400640 1 -- 172.21.15.59:0/758100179 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f80a99f0 con 0x7f840006e900 2024-04-25T09:02:50.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 -- 172.21.15.59:0/758100179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840006e900 msgr2=0x7f84000b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 --2- 172.21.15.59:0/758100179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840006e900 0x7f84000b0760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f840006efb0 tx=0x7f83f801c930 comp rx=0 tx=0).stop 2024-04-25T09:02:50.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 -- 172.21.15.59:0/758100179 shutdown_connections 2024-04-25T09:02:50.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 --2- 172.21.15.59:0/758100179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840006e900 0x7f84000b0760 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 --2- 172.21.15.59:0/758100179 >> v2:172.21.15.178:3300/0 conn(0x7f84000cef30 0x7f840006e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 -- 172.21.15.59:0/758100179 >> 172.21.15.59:0/758100179 conn(0x7f8400066fa0 msgr2=0x7f840006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 -- 172.21.15.59:0/758100179 shutdown_connections 2024-04-25T09:02:50.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 -- 172.21.15.59:0/758100179 wait complete. 2024-04-25T09:02:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 Processor -- start 2024-04-25T09:02:50.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 -- start start 2024-04-25T09:02:50.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840006e900 0x7f840013e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84000cef30 0x7f84001596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8400144140 0x7f8400159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840015ba00 con 0x7f840006e900 2024-04-25T09:02:50.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8400144520 con 0x7f84000cef30 2024-04-25T09:02:50.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.775+0000 7f8407800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840015bb80 con 0x7f8400144140 2024-04-25T09:02:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8404e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840006e900 0x7f840013e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8404e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840006e900 0x7f840013e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37226/0 (socket says 172.21.15.59:37226) 2024-04-25T09:02:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8404e00640 1 -- 172.21.15.59:0/683179675 learned_addr learned my addr 172.21.15.59:0/683179675 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8405800640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8400144140 0x7f8400159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f83ffe00640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84000cef30 0x7f84001596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8404e00640 1 -- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8400144140 msgr2=0x7f8400159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8404e00640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8400144140 0x7f8400159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8404e00640 1 -- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84000cef30 msgr2=0x7f84001596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8404e00640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84000cef30 0x7f84001596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8404e00640 1 -- 172.21.15.59:0/683179675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8400151980 con 0x7f840006e900 2024-04-25T09:02:50.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f83ffe00640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84000cef30 0x7f84001596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:50.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8405800640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8400144140 0x7f8400159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:50.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8404e00640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840006e900 0x7f840013e400 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f83f400c480 tx=0x7f83f400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f83fcc00640 1 -- 172.21.15.59:0/683179675 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4018070 con 0x7f840006e900 2024-04-25T09:02:50.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f83fcc00640 1 -- 172.21.15.59:0/683179675 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4007500 con 0x7f840006e900 2024-04-25T09:02:50.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f83fcc00640 1 -- 172.21.15.59:0/683179675 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4004a30 con 0x7f840006e900 2024-04-25T09:02:50.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8407800640 1 -- 172.21.15.59:0/683179675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8400151c60 con 0x7f840006e900 2024-04-25T09:02:50.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8407800640 1 -- 172.21.15.59:0/683179675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8400152220 con 0x7f840006e900 2024-04-25T09:02:50.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f8407800640 1 -- 172.21.15.59:0/683179675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84000745d0 con 0x7f840006e900 2024-04-25T09:02:50.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f83fcc00640 1 -- 172.21.15.59:0/683179675 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f83f4004bd0 con 0x7f840006e900 2024-04-25T09:02:50.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f83fcc00640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f83e0066f60 0x7f83e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:50.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.779+0000 7f83fcc00640 1 -- 172.21.15.59:0/683179675 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f83f40843c0 con 0x7f840006e900 2024-04-25T09:02:50.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.783+0000 7f83ffe00640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f83e0066f60 0x7f83e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:50.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.783+0000 7f83ffe00640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f83e0066f60 0x7f83e0069420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f84000cd190 tx=0x7f83ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:50.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.783+0000 7f83fcc00640 1 -- 172.21.15.59:0/683179675 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f83f40552d0 con 0x7f840006e900 2024-04-25T09:02:50.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.947+0000 7f8407800640 1 -- 172.21.15.59:0/683179675 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84000ce980 con 0x7f840006e900 2024-04-25T09:02:50.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.947+0000 7f83fcc00640 1 -- 172.21.15.59:0/683179675 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16955 (secure 0 0 0) 0x7f83f4054bd0 con 0x7f840006e900 2024-04-25T09:02:50.940 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:50.941 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":38,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:49.613708+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:47.433966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:48.612644+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.951+0000 7f8407800640 1 -- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f83e0066f60 msgr2=0x7f83e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.951+0000 7f8407800640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f83e0066f60 0x7f83e0069420 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f84000cd190 tx=0x7f83ec008040 comp rx=0 tx=0).stop 2024-04-25T09:02:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.951+0000 7f8407800640 1 -- 172.21.15.59:0/683179675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840006e900 msgr2=0x7f840013e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.951+0000 7f8407800640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840006e900 0x7f840013e400 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f83f400c480 tx=0x7f83f400c940 comp rx=0 tx=0).stop 2024-04-25T09:02:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.951+0000 7f8407800640 1 -- 172.21.15.59:0/683179675 shutdown_connections 2024-04-25T09:02:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.951+0000 7f8407800640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f83e0066f60 0x7f83e0069420 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.951+0000 7f8407800640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8400144140 0x7f8400159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.951+0000 7f8407800640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84000cef30 0x7f84001596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.951+0000 7f8407800640 1 --2- 172.21.15.59:0/683179675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f840006e900 0x7f840013e400 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.951+0000 7f8407800640 1 -- 172.21.15.59:0/683179675 >> 172.21.15.59:0/683179675 conn(0x7f8400066fa0 msgr2=0x7f8400165c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.951+0000 7f8407800640 1 -- 172.21.15.59:0/683179675 shutdown_connections 2024-04-25T09:02:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:50.951+0000 7f8407800640 1 -- 172.21.15.59:0/683179675 wait complete. 2024-04-25T09:02:50.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:02:51.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee71200640 1 Processor -- start 2024-04-25T09:02:51.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee71200640 1 -- start start 2024-04-25T09:02:51.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee71200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee6c15dc60 0x7fee6c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee71200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c09a170 0x7fee6c0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee71200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6c15e040 con 0x7fee6c06bf30 2024-04-25T09:02:51.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee71200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6c0cff80 con 0x7fee6c15dc60 2024-04-25T09:02:51.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee71200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0d0260 con 0x7fee6c09a170 2024-04-25T09:02:51.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee6a800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c09a170 0x7fee6c0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee69e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee6c15dc60 0x7fee6c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee69400640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fee6c06bf30 0x7fee6c099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:56894/0 (socket says 172.21.15.59:56894) 2024-04-25T09:02:51.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee6a800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c09a170 0x7fee6c0cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:46130/0 (socket says 172.21.15.59:46130) 2024-04-25T09:02:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee69e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fee6c15dc60 0x7fee6c0d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:42320/0 (socket says 172.21.15.59:42320) 2024-04-25T09:02:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee69400640 1 -- 172.21.15.59:0/3446482925 learned_addr learned my addr 172.21.15.59:0/3446482925 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee69e00640 1 -- 172.21.15.59:0/3446482925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c09a170 msgr2=0x7fee6c0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee69e00640 1 --2- 172.21.15.59:0/3446482925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c09a170 0x7fee6c0cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee69e00640 1 -- 172.21.15.59:0/3446482925 >> v1:172.21.15.178:6789/0 conn(0x7fee6c06bf30 legacy=0x7fee6c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.115+0000 7fee69e00640 1 -- 172.21.15.59:0/3446482925 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c0d0540 con 0x7fee6c15dc60 2024-04-25T09:02:51.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.119+0000 7fee69e00640 1 --2- 172.21.15.59:0/3446482925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c15dc60 0x7fee6c0d1020 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0097c0 tx=0x7fee5c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c59ffcfd7eb834fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.119+0000 7fee68a00640 1 -- 172.21.15.59:0/3446482925 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0b1070 con 0x7fee6c15dc60 2024-04-25T09:02:51.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.119+0000 7fee68a00640 1 -- 172.21.15.59:0/3446482925 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c0a8050 con 0x7fee6c15dc60 2024-04-25T09:02:51.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.119+0000 7fee68a00640 1 -- 172.21.15.59:0/3446482925 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee5c0ac860 con 0x7fee6c15dc60 2024-04-25T09:02:51.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.119+0000 7fee71200640 1 -- 172.21.15.59:0/3446482925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c15dc60 msgr2=0x7fee6c0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.119+0000 7fee71200640 1 --2- 172.21.15.59:0/3446482925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c15dc60 0x7fee6c0d1020 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0097c0 tx=0x7fee5c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.119+0000 7fee71200640 1 -- 172.21.15.59:0/3446482925 shutdown_connections 2024-04-25T09:02:51.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.119+0000 7fee71200640 1 --2- 172.21.15.59:0/3446482925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c09a170 0x7fee6c0cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.119+0000 7fee71200640 1 --2- 172.21.15.59:0/3446482925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c15dc60 0x7fee6c0d1020 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.119+0000 7fee71200640 1 -- 172.21.15.59:0/3446482925 >> 172.21.15.59:0/3446482925 conn(0x7fee6c0b3200 msgr2=0x7fee6c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:51.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.119+0000 7fee71200640 1 -- 172.21.15.59:0/3446482925 shutdown_connections 2024-04-25T09:02:51.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.119+0000 7fee71200640 1 -- 172.21.15.59:0/3446482925 wait complete. 2024-04-25T09:02:51.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee71200640 1 Processor -- start 2024-04-25T09:02:51.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee71200640 1 -- start start 2024-04-25T09:02:51.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee71200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c06bf30 0x7fee6c14c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee71200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee6c09a170 0x7fee6c154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee71200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c15dc60 0x7fee6c155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee71200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0cc6f0 con 0x7fee6c09a170 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee71200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0cc570 con 0x7fee6c15dc60 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee71200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6c0cc870 con 0x7fee6c06bf30 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee69400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee6c09a170 0x7fee6c154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee6a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c15dc60 0x7fee6c155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee69e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c06bf30 0x7fee6c14c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee6a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c15dc60 0x7fee6c155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:42336/0 (socket says 172.21.15.59:42336) 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee6a800640 1 -- 172.21.15.59:0/3315411922 learned_addr learned my addr 172.21.15.59:0/3315411922 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee6a800640 1 -- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c06bf30 msgr2=0x7fee6c14c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee6a800640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c06bf30 0x7fee6c14c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee6a800640 1 -- 172.21.15.59:0/3315411922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee6c09a170 msgr2=0x7fee6c154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:51.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee6a800640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee6c09a170 0x7fee6c154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:51.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee6a800640 1 -- 172.21.15.59:0/3315411922 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6c14cf20 con 0x7fee6c15dc60 2024-04-25T09:02:51.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee69400640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee6c09a170 0x7fee6c154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:51.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee6a800640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c15dc60 0x7fee6c155530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fee64009e30 tx=0x7fee6400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee62000640 1 -- 172.21.15.59:0/3315411922 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64018020 con 0x7fee6c15dc60 2024-04-25T09:02:51.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee62000640 1 -- 172.21.15.59:0/3315411922 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee64014480 con 0x7fee6c15dc60 2024-04-25T09:02:51.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee62000640 1 -- 172.21.15.59:0/3315411922 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee64014870 con 0x7fee6c15dc60 2024-04-25T09:02:51.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee71200640 1 -- 172.21.15.59:0/3315411922 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee6c0b6ae0 con 0x7fee6c15dc60 2024-04-25T09:02:51.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.123+0000 7fee71200640 1 -- 172.21.15.59:0/3315411922 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee6c0b51e0 con 0x7fee6c15dc60 2024-04-25T09:02:51.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.127+0000 7fee71200640 1 -- 172.21.15.59:0/3315411922 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6c0745d0 con 0x7fee6c15dc60 2024-04-25T09:02:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.127+0000 7fee62000640 1 -- 172.21.15.59:0/3315411922 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fee6401b020 con 0x7fee6c15dc60 2024-04-25T09:02:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.127+0000 7fee62000640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee4c066f60 0x7fee4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.127+0000 7fee62000640 1 -- 172.21.15.59:0/3315411922 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fee64086250 con 0x7fee6c15dc60 2024-04-25T09:02:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.127+0000 7fee69e00640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee4c066f60 0x7fee4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:51.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.127+0000 7fee69e00640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee4c066f60 0x7fee4c069420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0ae000 tx=0x7fee5c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:51.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.131+0000 7fee62000640 1 -- 172.21.15.59:0/3315411922 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fee64022030 con 0x7fee6c15dc60 2024-04-25T09:02:51.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:51.335+0000 7fee71200640 1 -- 172.21.15.59:0/3315411922 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fee6c0b7590 con 0x7fee6c15dc60 2024-04-25T09:02:52.180 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:02:52.187+0000 7f3895600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:02:52.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.243+0000 7fee62000640 1 -- 172.21.15.59:0/3315411922 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7fee6c14cf20 con 0x7fee6c15dc60 2024-04-25T09:02:52.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.247+0000 7fee71200640 1 -- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee4c066f60 msgr2=0x7fee4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.247+0000 7fee71200640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee4c066f60 0x7fee4c069420 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0ae000 tx=0x7fee5c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:02:52.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.247+0000 7fee71200640 1 -- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c15dc60 msgr2=0x7fee6c155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.247+0000 7fee71200640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c15dc60 0x7fee6c155530 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fee64009e30 tx=0x7fee6400c490 comp rx=0 tx=0).stop 2024-04-25T09:02:52.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.247+0000 7fee71200640 1 -- 172.21.15.59:0/3315411922 shutdown_connections 2024-04-25T09:02:52.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.247+0000 7fee71200640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fee4c066f60 0x7fee4c069420 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.247+0000 7fee71200640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fee6c15dc60 0x7fee6c155530 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.247+0000 7fee71200640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee6c09a170 0x7fee6c154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.247+0000 7fee71200640 1 --2- 172.21.15.59:0/3315411922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fee6c06bf30 0x7fee6c14c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.247+0000 7fee71200640 1 -- 172.21.15.59:0/3315411922 >> 172.21.15.59:0/3315411922 conn(0x7fee6c0b3200 msgr2=0x7fee6c0ce740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:52.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.247+0000 7fee71200640 1 -- 172.21.15.59:0/3315411922 shutdown_connections 2024-04-25T09:02:52.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.247+0000 7fee71200640 1 -- 172.21.15.59:0/3315411922 wait complete. 2024-04-25T09:02:52.262 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:02:52.262 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:02:52.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f467da00640 1 Processor -- start 2024-04-25T09:02:52.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f467da00640 1 -- start start 2024-04-25T09:02:52.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f467da00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467815c9b0 0x7f467806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f467da00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f467806e010 0x7f467806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f467da00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467815fc00 con 0x7f4678159320 2024-04-25T09:02:52.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f467da00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467806d640 con 0x7f467806e010 2024-04-25T09:02:52.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f467da00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467815fee0 con 0x7f467815c9b0 2024-04-25T09:02:52.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f4676a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4678159320 0x7f467815f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60042/0 (socket says 172.21.15.59:60042) 2024-04-25T09:02:52.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f4676a00640 1 -- 172.21.15.59:0/3344687459 learned_addr learned my addr 172.21.15.59:0/3344687459 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f4677400640 1 --2- 172.21.15.59:0/3344687459 >> v2:172.21.15.178:3300/0 conn(0x7f467806e010 0x7f467806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f466fe00640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467815c9b0 0x7f467806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946578155 0 0) 0x7f467815fc00 con 0x7f4678159320 2024-04-25T09:02:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.419+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f465c003530 con 0x7f4678159320 2024-04-25T09:02:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1255001398 0 0) 0x7f465c003530 con 0x7f4678159320 2024-04-25T09:02:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467815c9b0 msgr2=0x7f467806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467815c9b0 0x7f467806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 >> v2:172.21.15.178:3300/0 conn(0x7f467806e010 msgr2=0x7f467806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:52.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 --2- 172.21.15.59:0/3344687459 >> v2:172.21.15.178:3300/0 conn(0x7f467806e010 0x7f467806e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46781601c0 con 0x7f4678159320 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f4668001680 con 0x7f4678159320 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 >> v1:172.21.15.59:6789/0 conn(0x7f4678159320 legacy=0x7f467815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f465c0039c0 0x7f465c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f465c004810 0x7f465c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467815c9b0 0x7f465c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467806d640 con 0x7f465c0039c0 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467815fee0 con 0x7f465c004810 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c00b9d0 con 0x7f467815c9b0 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676a00640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f465c0039c0 0x7f465c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f466fe00640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f465c004810 0x7f465c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4677400640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467815c9b0 0x7f465c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676a00640 1 -- 172.21.15.59:0/3344687459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467815c9b0 msgr2=0x7f465c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:52.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676a00640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467815c9b0 0x7f465c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676a00640 1 -- 172.21.15.59:0/3344687459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f465c004810 msgr2=0x7f465c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:52.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676a00640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f465c004810 0x7f465c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676a00640 1 -- 172.21.15.59:0/3344687459 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c003530 con 0x7f465c0039c0 2024-04-25T09:02:52.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f466fe00640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f465c004810 0x7f465c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:52.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676a00640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f465c0039c0 0x7f465c003de0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f466800c190 tx=0x7f466801cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a4ac265db3d791 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:52.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668007c70 con 0x7f465c0039c0 2024-04-25T09:02:52.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46680a9020 con 0x7f465c0039c0 2024-04-25T09:02:52.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.423+0000 7f4676000640 1 -- 172.21.15.59:0/3344687459 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4668005ae0 con 0x7f465c0039c0 2024-04-25T09:02:52.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 -- 172.21.15.59:0/3344687459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f465c0039c0 msgr2=0x7f465c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 --2- 172.21.15.59:0/3344687459 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f465c0039c0 0x7f465c003de0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f466800c190 tx=0x7f466801cb80 comp rx=0 tx=0).stop 2024-04-25T09:02:52.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f4677400640 1 -- 172.21.15.59:0/3344687459 reap_dead start 2024-04-25T09:02:52.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 -- 172.21.15.59:0/3344687459 shutdown_connections 2024-04-25T09:02:52.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 -- 172.21.15.59:0/3344687459 >> 172.21.15.59:0/3344687459 conn(0x7f4678067080 msgr2=0x7f467806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:52.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 -- 172.21.15.59:0/3344687459 shutdown_connections 2024-04-25T09:02:52.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 -- 172.21.15.59:0/3344687459 wait complete. 2024-04-25T09:02:52.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 Processor -- start 2024-04-25T09:02:52.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 -- start start 2024-04-25T09:02:52.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f465c0039c0 0x7f4678156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678143580 0x7f4678143a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4678159b20 0x7f4678159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46780b2700 con 0x7f4678159b20 2024-04-25T09:02:52.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467806edf0 con 0x7f4678143580 2024-04-25T09:02:52.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f467da00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46780b2880 con 0x7f465c0039c0 2024-04-25T09:02:52.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f4677400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4678159b20 0x7f4678159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f4677400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4678159b20 0x7f4678159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37258/0 (socket says 172.21.15.59:37258) 2024-04-25T09:02:52.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f4677400640 1 -- 172.21.15.59:0/1643473866 learned_addr learned my addr 172.21.15.59:0/1643473866 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:52.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f466fe00640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678143580 0x7f4678143a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f4676a00640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f465c0039c0 0x7f4678156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f4677400640 1 -- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f465c0039c0 msgr2=0x7f4678156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f4677400640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f465c0039c0 0x7f4678156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f4677400640 1 -- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678143580 msgr2=0x7f4678143a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:52.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f4677400640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678143580 0x7f4678143a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:52.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.427+0000 7f4677400640 1 -- 172.21.15.59:0/1643473866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4678142220 con 0x7f4678159b20 2024-04-25T09:02:52.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.431+0000 7f4677400640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4678159b20 0x7f4678159fa0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f46780b4c90 tx=0x7f46700115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:52.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.431+0000 7f466ea00640 1 -- 172.21.15.59:0/1643473866 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46700039a0 con 0x7f4678159b20 2024-04-25T09:02:52.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.431+0000 7f466ea00640 1 -- 172.21.15.59:0/1643473866 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467001b070 con 0x7f4678159b20 2024-04-25T09:02:52.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.431+0000 7f466ea00640 1 -- 172.21.15.59:0/1643473866 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4670003b80 con 0x7f4678159b20 2024-04-25T09:02:52.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.431+0000 7f467da00640 1 -- 172.21.15.59:0/1643473866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46781424e0 con 0x7f4678159b20 2024-04-25T09:02:52.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.431+0000 7f467da00640 1 -- 172.21.15.59:0/1643473866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4678142aa0 con 0x7f4678159b20 2024-04-25T09:02:52.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.431+0000 7f467da00640 1 -- 172.21.15.59:0/1643473866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46780745d0 con 0x7f4678159b20 2024-04-25T09:02:52.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.431+0000 7f466ea00640 1 -- 172.21.15.59:0/1643473866 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4670004030 con 0x7f4678159b20 2024-04-25T09:02:52.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.431+0000 7f466ea00640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4654066f90 0x7f4654069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:52.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.431+0000 7f466ea00640 1 -- 172.21.15.59:0/1643473866 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4670085960 con 0x7f4678159b20 2024-04-25T09:02:52.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.431+0000 7f4676a00640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4654066f90 0x7f4654069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:52.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.435+0000 7f4676a00640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4654066f90 0x7f4654069450 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f46680aa000 tx=0x7f46680b1040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:52.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.435+0000 7f466ea00640 1 -- 172.21.15.59:0/1643473866 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4670025020 con 0x7f4678159b20 2024-04-25T09:02:52.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:52.618 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:02:52.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:52.635+0000 7f467da00640 1 -- 172.21.15.59:0/1643473866 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f46780cc740 con 0x7f4678159b20 2024-04-25T09:02:53.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.243+0000 7f466ea00640 1 -- 172.21.15.59:0/1643473866 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7f46700560f0 con 0x7f4678159b20 2024-04-25T09:02:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.247+0000 7f467da00640 1 -- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4654066f90 msgr2=0x7f4654069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.247+0000 7f467da00640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4654066f90 0x7f4654069450 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f46680aa000 tx=0x7f46680b1040 comp rx=0 tx=0).stop 2024-04-25T09:02:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.247+0000 7f467da00640 1 -- 172.21.15.59:0/1643473866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4678159b20 msgr2=0x7f4678159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.247+0000 7f467da00640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4678159b20 0x7f4678159fa0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f46780b4c90 tx=0x7f46700115a0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.247+0000 7f467da00640 1 -- 172.21.15.59:0/1643473866 shutdown_connections 2024-04-25T09:02:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.247+0000 7f467da00640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4654066f90 0x7f4654069450 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.247+0000 7f467da00640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4678159b20 0x7f4678159fa0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.247+0000 7f467da00640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4678143580 0x7f4678143a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.247+0000 7f467da00640 1 --2- 172.21.15.59:0/1643473866 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f465c0039c0 0x7f4678156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.247+0000 7f467da00640 1 -- 172.21.15.59:0/1643473866 >> 172.21.15.59:0/1643473866 conn(0x7f4678067080 msgr2=0x7f46780cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.247+0000 7f467da00640 1 -- 172.21.15.59:0/1643473866 shutdown_connections 2024-04-25T09:02:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.247+0000 7f467da00640 1 -- 172.21.15.59:0/1643473866 wait complete. 2024-04-25T09:02:53.262 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:02:53.262 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.415+0000 7fa513000640 1 Processor -- start 2024-04-25T09:02:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.415+0000 7fa513000640 1 -- start start 2024-04-25T09:02:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.415+0000 7fa513000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa50c0cef30 0x7fa50c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.415+0000 7fa513000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa50c06e900 0x7fa50c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.415+0000 7fa513000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa50c15ac60 con 0x7fa50c144140 2024-04-25T09:02:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.415+0000 7fa513000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50c06ed50 con 0x7fa50c0cef30 2024-04-25T09:02:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.415+0000 7fa513000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c0cf3e0 con 0x7fa50c06e900 2024-04-25T09:02:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.415+0000 7fa503400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa50c0cef30 0x7fa50c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.415+0000 7fa503400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa50c0cef30 0x7fa50c06e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37260/0 (socket says 172.21.15.59:37260) 2024-04-25T09:02:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.415+0000 7fa503400640 1 -- 172.21.15.59:0/2490370135 learned_addr learned my addr 172.21.15.59:0/2490370135 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.415+0000 7fa511000640 1 --2- 172.21.15.59:0/2490370135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa50c06e900 0x7fa50c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa503400640 1 -- 172.21.15.59:0/2490370135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa50c06e900 msgr2=0x7fa50c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa503400640 1 --2- 172.21.15.59:0/2490370135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa50c06e900 0x7fa50c0b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa503400640 1 -- 172.21.15.59:0/2490370135 >> v1:172.21.15.178:6789/0 conn(0x7fa50c144140 legacy=0x7fa50c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa503400640 1 -- 172.21.15.59:0/2490370135 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c15af20 con 0x7fa50c0cef30 2024-04-25T09:02:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa503400640 1 --2- 172.21.15.59:0/2490370135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c0cef30 0x7fa50c06e3c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009870 tx=0x7fa4f401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c609bef23b8a6394 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa50b400640 1 -- 172.21.15.59:0/2490370135 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40b0070 con 0x7fa50c0cef30 2024-04-25T09:02:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa50b400640 1 -- 172.21.15.59:0/2490370135 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f40ab600 con 0x7fa50c0cef30 2024-04-25T09:02:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa50b400640 1 -- 172.21.15.59:0/2490370135 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40ab9d0 con 0x7fa50c0cef30 2024-04-25T09:02:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa513000640 1 -- 172.21.15.59:0/2490370135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c0cef30 msgr2=0x7fa50c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa513000640 1 --2- 172.21.15.59:0/2490370135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c0cef30 0x7fa50c06e3c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4009870 tx=0x7fa4f401c560 comp rx=0 tx=0).stop 2024-04-25T09:02:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa513000640 1 -- 172.21.15.59:0/2490370135 shutdown_connections 2024-04-25T09:02:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa513000640 1 --2- 172.21.15.59:0/2490370135 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa50c06e900 0x7fa50c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa513000640 1 --2- 172.21.15.59:0/2490370135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c0cef30 0x7fa50c06e3c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa513000640 1 -- 172.21.15.59:0/2490370135 >> 172.21.15.59:0/2490370135 conn(0x7fa50c066fa0 msgr2=0x7fa50c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa513000640 1 -- 172.21.15.59:0/2490370135 shutdown_connections 2024-04-25T09:02:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.419+0000 7fa513000640 1 -- 172.21.15.59:0/2490370135 wait complete. 2024-04-25T09:02:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa513000640 1 Processor -- start 2024-04-25T09:02:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa513000640 1 -- start start 2024-04-25T09:02:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa513000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa50c06e900 0x7fa50c1604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa513000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c0cef30 0x7fa50c135170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa513000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa50c144140 0x7fa50c1ed100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa513000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c15ba00 con 0x7fa50c0cef30 2024-04-25T09:02:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa513000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c144520 con 0x7fa50c144140 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa513000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c15bb80 con 0x7fa50c06e900 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa503400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c0cef30 0x7fa50c135170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa503400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c0cef30 0x7fa50c135170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37274/0 (socket says 172.21.15.59:37274) 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa503400640 1 -- 172.21.15.59:0/1568420589 learned_addr learned my addr 172.21.15.59:0/1568420589 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa511000640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa50c144140 0x7fa50c1ed100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa50be00640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa50c06e900 0x7fa50c1604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa503400640 1 -- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa50c06e900 msgr2=0x7fa50c1604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa503400640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa50c06e900 0x7fa50c1604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa503400640 1 -- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa50c144140 msgr2=0x7fa50c1ed100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa503400640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa50c144140 0x7fa50c1ed100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa503400640 1 -- 172.21.15.59:0/1568420589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c15f420 con 0x7fa50c0cef30 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa503400640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c0cef30 0x7fa50c135170 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40ae040 tx=0x7fa4f4019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa508c00640 1 -- 172.21.15.59:0/1568420589 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40ba070 con 0x7fa50c0cef30 2024-04-25T09:02:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa508c00640 1 -- 172.21.15.59:0/1568420589 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f40b4420 con 0x7fa50c0cef30 2024-04-25T09:02:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa508c00640 1 -- 172.21.15.59:0/1568420589 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f40b0040 con 0x7fa50c0cef30 2024-04-25T09:02:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa513000640 1 -- 172.21.15.59:0/1568420589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c15f700 con 0x7fa50c0cef30 2024-04-25T09:02:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.423+0000 7fa513000640 1 -- 172.21.15.59:0/1568420589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c15fcc0 con 0x7fa50c0cef30 2024-04-25T09:02:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.427+0000 7fa513000640 1 -- 172.21.15.59:0/1568420589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c0745d0 con 0x7fa50c0cef30 2024-04-25T09:02:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.427+0000 7fa508c00640 1 -- 172.21.15.59:0/1568420589 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa4f40bd070 con 0x7fa50c0cef30 2024-04-25T09:02:53.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.427+0000 7fa508c00640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa4e8066f60 0x7fa4e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.427+0000 7fa508c00640 1 -- 172.21.15.59:0/1568420589 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa4f411e250 con 0x7fa50c0cef30 2024-04-25T09:02:53.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.427+0000 7fa50be00640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa4e8066f60 0x7fa4e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.427+0000 7fa50be00640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa4e8066f60 0x7fa4e8069420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc001cb0 tx=0x7fa4fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.431+0000 7fa508c00640 1 -- 172.21.15.59:0/1568420589 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa4f4016150 con 0x7fa50c0cef30 2024-04-25T09:02:53.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.627+0000 7fa513000640 1 -- 172.21.15.59:0/1568420589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa50c0ceae0 con 0x7fa50c0cef30 2024-04-25T09:02:53.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.627+0000 7fa508c00640 1 -- 172.21.15.59:0/1568420589 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fa4f40ef0c0 con 0x7fa50c0cef30 2024-04-25T09:02:53.619 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:53.619 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3471177782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3471177782},{"type":"v1","addr":"172.21.15.178:6836","nonce":3471177782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3534065304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3534065304},{"type":"v1","addr":"172.21.15.178:6837","nonce":3534065304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4015865168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4015865168},{"type":"v1","addr":"172.21.15.59:6833","nonce":4015865168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:49.614073+0000","modified":"2024-04-25T09:02:52.639785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5289":{"gid":5289,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1202642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1202642229},{"type":"v1","addr":"172.21.15.59:6835","nonce":1202642229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:02:53.619 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 19 2024-04-25T09:02:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.627+0000 7fa513000640 1 -- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa4e8066f60 msgr2=0x7fa4e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.627+0000 7fa513000640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa4e8066f60 0x7fa4e8069420 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc001cb0 tx=0x7fa4fc009040 comp rx=0 tx=0).stop 2024-04-25T09:02:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.627+0000 7fa513000640 1 -- 172.21.15.59:0/1568420589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c0cef30 msgr2=0x7fa50c135170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.627+0000 7fa513000640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c0cef30 0x7fa50c135170 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa4f40ae040 tx=0x7fa4f4019300 comp rx=0 tx=0).stop 2024-04-25T09:02:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.631+0000 7fa513000640 1 -- 172.21.15.59:0/1568420589 shutdown_connections 2024-04-25T09:02:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.631+0000 7fa513000640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa4e8066f60 0x7fa4e8069420 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.631+0000 7fa513000640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa50c144140 0x7fa50c1ed100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.631+0000 7fa513000640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa50c0cef30 0x7fa50c135170 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.631+0000 7fa513000640 1 --2- 172.21.15.59:0/1568420589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa50c06e900 0x7fa50c1604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.631+0000 7fa513000640 1 -- 172.21.15.59:0/1568420589 >> 172.21.15.59:0/1568420589 conn(0x7fa50c066fa0 msgr2=0x7fa50c06ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.631+0000 7fa513000640 1 -- 172.21.15.59:0/1568420589 shutdown_connections 2024-04-25T09:02:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.631+0000 7fa513000640 1 -- 172.21.15.59:0/1568420589 wait complete. 2024-04-25T09:02:53.640 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:02:53.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.787+0000 7fba6a400640 1 Processor -- start 2024-04-25T09:02:53.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.787+0000 7fba6a400640 1 -- start start 2024-04-25T09:02:53.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.791+0000 7fba6a400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fba640cf840 0x7fba6409a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.791+0000 7fba6a400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba640cd460 con 0x7fba640cfc20 2024-04-25T09:02:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.791+0000 7fba6a400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba640cc3c0 con 0x7fba6409a9b0 2024-04-25T09:02:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.791+0000 7fba6a400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba640cc6a0 con 0x7fba640cf840 2024-04-25T09:02:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.791+0000 7fba69a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fba640cfc20 0x7fba64165700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60052/0 (socket says 172.21.15.59:60052) 2024-04-25T09:02:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.791+0000 7fba69000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fba640cf840 0x7fba6409a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.791+0000 7fba69a00640 1 -- 172.21.15.59:0/4131793118 learned_addr learned my addr 172.21.15.59:0/4131793118 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.791+0000 7fba69000640 1 -- 172.21.15.59:0/4131793118 >> v1:172.21.15.178:6789/0 conn(0x7fba6409a9b0 legacy=0x7fba6415b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.791+0000 7fba69000640 1 -- 172.21.15.59:0/4131793118 >> v1:172.21.15.59:6789/0 conn(0x7fba640cfc20 legacy=0x7fba64165700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.791+0000 7fba69000640 1 -- 172.21.15.59:0/4131793118 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba640cc980 con 0x7fba640cf840 2024-04-25T09:02:53.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba69000640 1 --2- 172.21.15.59:0/4131793118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba640cf840 0x7fba6409a470 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fba580097c0 tx=0x7fba5801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db1102bb07590d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:53.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba63400640 1 -- 172.21.15.59:0/4131793118 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba580b5070 con 0x7fba640cf840 2024-04-25T09:02:53.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba63400640 1 -- 172.21.15.59:0/4131793118 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba580a8950 con 0x7fba640cf840 2024-04-25T09:02:53.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba63400640 1 -- 172.21.15.59:0/4131793118 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba580a8d20 con 0x7fba640cf840 2024-04-25T09:02:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 -- 172.21.15.59:0/4131793118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba640cf840 msgr2=0x7fba6409a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 --2- 172.21.15.59:0/4131793118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba640cf840 0x7fba6409a470 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fba580097c0 tx=0x7fba5801ec50 comp rx=0 tx=0).stop 2024-04-25T09:02:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 -- 172.21.15.59:0/4131793118 shutdown_connections 2024-04-25T09:02:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 --2- 172.21.15.59:0/4131793118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba640cf840 0x7fba6409a470 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 -- 172.21.15.59:0/4131793118 >> 172.21.15.59:0/4131793118 conn(0x7fba640b3050 msgr2=0x7fba640b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 -- 172.21.15.59:0/4131793118 shutdown_connections 2024-04-25T09:02:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 -- 172.21.15.59:0/4131793118 wait complete. 2024-04-25T09:02:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 Processor -- start 2024-04-25T09:02:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 -- start start 2024-04-25T09:02:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba6409a9b0 0x7fba641f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba640cf840 0x7fba6415e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba640cfc20 0x7fba6414e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640cc070 con 0x7fba640cf840 2024-04-25T09:02:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640ccf40 con 0x7fba640cfc20 2024-04-25T09:02:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.795+0000 7fba6a400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba6415b8c0 con 0x7fba6409a9b0 2024-04-25T09:02:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba63e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba640cf840 0x7fba6415e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba63e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba640cf840 0x7fba6415e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37290/0 (socket says 172.21.15.59:37290) 2024-04-25T09:02:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba63e00640 1 -- 172.21.15.59:0/171639333 learned_addr learned my addr 172.21.15.59:0/171639333 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba69000640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba6409a9b0 0x7fba641f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba69a00640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba640cfc20 0x7fba6414e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba63e00640 1 -- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba6409a9b0 msgr2=0x7fba641f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba63e00640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba6409a9b0 0x7fba641f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba63e00640 1 -- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba640cfc20 msgr2=0x7fba6414e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba63e00640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba640cfc20 0x7fba6414e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba63e00640 1 -- 172.21.15.59:0/171639333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba640c5920 con 0x7fba640cf840 2024-04-25T09:02:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba69a00640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba640cfc20 0x7fba6414e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba63e00640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba640cf840 0x7fba6415e5d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fba5000c450 tx=0x7fba5000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:53.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba60c00640 1 -- 172.21.15.59:0/171639333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50012830 con 0x7fba640cf840 2024-04-25T09:02:53.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba60c00640 1 -- 172.21.15.59:0/171639333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba50017070 con 0x7fba640cf840 2024-04-25T09:02:53.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba60c00640 1 -- 172.21.15.59:0/171639333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50012c30 con 0x7fba640cf840 2024-04-25T09:02:53.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba6a400640 1 -- 172.21.15.59:0/171639333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba640c5c00 con 0x7fba640cf840 2024-04-25T09:02:53.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba6a400640 1 -- 172.21.15.59:0/171639333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba640c61c0 con 0x7fba640cf840 2024-04-25T09:02:53.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba6a400640 1 -- 172.21.15.59:0/171639333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6404efa0 con 0x7fba640cf840 2024-04-25T09:02:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba60c00640 1 -- 172.21.15.59:0/171639333 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fba5001c460 con 0x7fba640cf840 2024-04-25T09:02:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.799+0000 7fba60c00640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fba44066f60 0x7fba44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.803+0000 7fba60c00640 1 -- 172.21.15.59:0/171639333 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fba50085000 con 0x7fba640cf840 2024-04-25T09:02:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.803+0000 7fba69000640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fba44066f60 0x7fba44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.803+0000 7fba69000640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fba44066f60 0x7fba44069420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fba580b2000 tx=0x7fba58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.803+0000 7fba60c00640 1 -- 172.21.15.59:0/171639333 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fba50055e80 con 0x7fba640cf840 2024-04-25T09:02:53.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.967+0000 7fba6a400640 1 -- 172.21.15.59:0/171639333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba640b3ef0 con 0x7fba640cf840 2024-04-25T09:02:53.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba60c00640 1 -- 172.21.15.59:0/171639333 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16942 (secure 0 0 0) 0x7fba50055780 con 0x7fba640cf840 2024-04-25T09:02:53.962 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:53.962 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":39,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:51.230318+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:47.433966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:48.612644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:02:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba6a400640 1 -- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fba44066f60 msgr2=0x7fba44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba6a400640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fba44066f60 0x7fba44069420 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fba580b2000 tx=0x7fba58008040 comp rx=0 tx=0).stop 2024-04-25T09:02:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba6a400640 1 -- 172.21.15.59:0/171639333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba640cf840 msgr2=0x7fba6415e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba6a400640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba640cf840 0x7fba6415e5d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fba5000c450 tx=0x7fba5000c910 comp rx=0 tx=0).stop 2024-04-25T09:02:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba6a400640 1 -- 172.21.15.59:0/171639333 shutdown_connections 2024-04-25T09:02:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba6a400640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fba44066f60 0x7fba44069420 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba6a400640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fba640cfc20 0x7fba6414e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba6a400640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba640cf840 0x7fba6415e5d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba6a400640 1 --2- 172.21.15.59:0/171639333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fba6409a9b0 0x7fba641f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba6a400640 1 -- 172.21.15.59:0/171639333 >> 172.21.15.59:0/171639333 conn(0x7fba640b3050 msgr2=0x7fba640cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba6a400640 1 -- 172.21.15.59:0/171639333 shutdown_connections 2024-04-25T09:02:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:53.971+0000 7fba6a400640 1 -- 172.21.15.59:0/171639333 wait complete. 2024-04-25T09:02:53.984 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:02:53.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:02:54.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5ff3800640 1 Processor -- start 2024-04-25T09:02:54.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5ff3800640 1 -- start start 2024-04-25T09:02:54.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5ff3800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5fec070fe0 0x7f5fec161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5ff3800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5fec0713c0 0x7f5fec143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5ff3800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fec071830 0x7f5fec15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5ff3800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec06d090 con 0x7f5fec0713c0 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5ff3800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fec162390 con 0x7f5fec070fe0 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5ff3800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec161af0 con 0x7f5fec071830 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5febe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5fec0713c0 0x7f5fec143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5febe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5fec0713c0 0x7f5fec143080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37304/0 (socket says 172.21.15.59:37304) 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5ff0e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5fec070fe0 0x7f5fec161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5febe00640 1 -- 172.21.15.59:0/1801209225 learned_addr learned my addr 172.21.15.59:0/1801209225 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5ff1800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fec071830 0x7f5fec15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5febe00640 1 -- 172.21.15.59:0/1801209225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fec071830 msgr2=0x7f5fec15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5febe00640 1 --2- 172.21.15.59:0/1801209225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fec071830 0x7f5fec15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5febe00640 1 -- 172.21.15.59:0/1801209225 >> v2:172.21.15.178:3300/0 conn(0x7f5fec070fe0 msgr2=0x7f5fec161510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:54.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5febe00640 1 --2- 172.21.15.59:0/1801209225 >> v2:172.21.15.178:3300/0 conn(0x7f5fec070fe0 0x7f5fec161510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.135+0000 7f5febe00640 1 -- 172.21.15.59:0/1801209225 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec161dd0 con 0x7f5fec0713c0 2024-04-25T09:02:54.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5febe00640 1 --2- 172.21.15.59:0/1801209225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fec0713c0 0x7f5fec143080 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5fec072ce0 tx=0x7f5fd801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c3ab92135baa48 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:54.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5feb400640 1 -- 172.21.15.59:0/1801209225 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80aa610 con 0x7f5fec0713c0 2024-04-25T09:02:54.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5feb400640 1 -- 172.21.15.59:0/1801209225 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd80af070 con 0x7f5fec0713c0 2024-04-25T09:02:54.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5feb400640 1 -- 172.21.15.59:0/1801209225 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd80aa9d0 con 0x7f5fec0713c0 2024-04-25T09:02:54.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5ff3800640 1 -- 172.21.15.59:0/1801209225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fec0713c0 msgr2=0x7f5fec143080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5ff3800640 1 --2- 172.21.15.59:0/1801209225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fec0713c0 0x7f5fec143080 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5fec072ce0 tx=0x7f5fd801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5ff3800640 1 -- 172.21.15.59:0/1801209225 shutdown_connections 2024-04-25T09:02:54.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5ff3800640 1 --2- 172.21.15.59:0/1801209225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fec071830 0x7f5fec15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5ff3800640 1 --2- 172.21.15.59:0/1801209225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fec0713c0 0x7f5fec143080 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5ff3800640 1 --2- 172.21.15.59:0/1801209225 >> v2:172.21.15.178:3300/0 conn(0x7f5fec070fe0 0x7f5fec161510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5ff3800640 1 -- 172.21.15.59:0/1801209225 >> 172.21.15.59:0/1801209225 conn(0x7f5fec0b3390 msgr2=0x7f5fec0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:54.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5ff3800640 1 -- 172.21.15.59:0/1801209225 shutdown_connections 2024-04-25T09:02:54.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.139+0000 7f5ff3800640 1 -- 172.21.15.59:0/1801209225 wait complete. 2024-04-25T09:02:54.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff3800640 1 Processor -- start 2024-04-25T09:02:54.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff3800640 1 -- start start 2024-04-25T09:02:54.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff3800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fec070fe0 0x7f5fec13d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff3800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fec0713c0 0x7f5fec0b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff3800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fec071830 0x7f5fec141520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff3800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0b06c0 con 0x7f5fec070fe0 2024-04-25T09:02:54.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff3800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0b0540 con 0x7f5fec0713c0 2024-04-25T09:02:54.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff3800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fec0b0840 con 0x7f5fec071830 2024-04-25T09:02:54.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fec070fe0 0x7f5fec13d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fec070fe0 0x7f5fec13d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37314/0 (socket says 172.21.15.59:37314) 2024-04-25T09:02:54.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff0e00640 1 -- 172.21.15.59:0/1089963579 learned_addr learned my addr 172.21.15.59:0/1089963579 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:54.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff0e00640 1 -- 172.21.15.59:0/1089963579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fec071830 msgr2=0x7f5fec141520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff0e00640 1 --2- 172.21.15.59:0/1089963579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fec071830 0x7f5fec141520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff0e00640 1 -- 172.21.15.59:0/1089963579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fec0713c0 msgr2=0x7f5fec0b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff0e00640 1 --2- 172.21.15.59:0/1089963579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fec0713c0 0x7f5fec0b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff0e00640 1 -- 172.21.15.59:0/1089963579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec1f7a40 con 0x7f5fec070fe0 2024-04-25T09:02:54.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff0e00640 1 --2- 172.21.15.59:0/1089963579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fec070fe0 0x7f5fec13d140 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000e8b0 tx=0x7f5fe000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:54.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5fe8c00640 1 -- 172.21.15.59:0/1089963579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0017070 con 0x7f5fec070fe0 2024-04-25T09:02:54.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5fe8c00640 1 -- 172.21.15.59:0/1089963579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe000c860 con 0x7f5fec070fe0 2024-04-25T09:02:54.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5fe8c00640 1 -- 172.21.15.59:0/1089963579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fe000cc30 con 0x7f5fec070fe0 2024-04-25T09:02:54.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff3800640 1 -- 172.21.15.59:0/1089963579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fec1f7d20 con 0x7f5fec070fe0 2024-04-25T09:02:54.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff3800640 1 -- 172.21.15.59:0/1089963579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fec0b10d0 con 0x7f5fec070fe0 2024-04-25T09:02:54.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.143+0000 7f5ff3800640 1 -- 172.21.15.59:0/1089963579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fec0745d0 con 0x7f5fec070fe0 2024-04-25T09:02:54.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.147+0000 7f5fe8c00640 1 -- 172.21.15.59:0/1089963579 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5fe001a070 con 0x7f5fec070fe0 2024-04-25T09:02:54.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.147+0000 7f5fe8c00640 1 --2- 172.21.15.59:0/1089963579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5fcc066f60 0x7f5fcc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.147+0000 7f5fe8c00640 1 -- 172.21.15.59:0/1089963579 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5fe0085060 con 0x7f5fec070fe0 2024-04-25T09:02:54.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.147+0000 7f5febe00640 1 --2- 172.21.15.59:0/1089963579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5fcc066f60 0x7f5fcc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.147+0000 7f5febe00640 1 --2- 172.21.15.59:0/1089963579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5fcc066f60 0x7f5fcc069420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80ae000 tx=0x7f5fd8004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:54.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.151+0000 7f5fe8c00640 1 -- 172.21.15.59:0/1089963579 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5fe0055f70 con 0x7f5fec070fe0 2024-04-25T09:02:54.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.319+0000 7f5ff3800640 1 -- 172.21.15.59:0/1089963579 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5fec169690 con 0x7f5fcc066f60 2024-04-25T09:02:54.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.323+0000 7f5fe8c00640 1 -- 172.21.15.59:0/1089963579 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246635 (secure 0 0 0) 0x7f5fec169690 con 0x7f5fcc066f60 2024-04-25T09:02:54.319 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:54.321 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:02:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.327+0000 7f5ff3800640 1 -- 172.21.15.59:0/1089963579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5fcc066f60 msgr2=0x7f5fcc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.327+0000 7f5ff3800640 1 --2- 172.21.15.59:0/1089963579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5fcc066f60 0x7f5fcc069420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80ae000 tx=0x7f5fd8004740 comp rx=0 tx=0).stop 2024-04-25T09:02:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.327+0000 7f5ff3800640 1 -- 172.21.15.59:0/1089963579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fec070fe0 msgr2=0x7f5fec13d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.327+0000 7f5ff3800640 1 --2- 172.21.15.59:0/1089963579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fec070fe0 0x7f5fec13d140 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000e8b0 tx=0x7f5fe000ed70 comp rx=0 tx=0).stop 2024-04-25T09:02:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.327+0000 7f5ff3800640 1 -- 172.21.15.59:0/1089963579 shutdown_connections 2024-04-25T09:02:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.327+0000 7f5ff3800640 1 --2- 172.21.15.59:0/1089963579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5fcc066f60 0x7f5fcc069420 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.327+0000 7f5ff3800640 1 --2- 172.21.15.59:0/1089963579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5fec071830 0x7f5fec141520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.327+0000 7f5ff3800640 1 --2- 172.21.15.59:0/1089963579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5fec0713c0 0x7f5fec0b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.327+0000 7f5ff3800640 1 --2- 172.21.15.59:0/1089963579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5fec070fe0 0x7f5fec13d140 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.327+0000 7f5ff3800640 1 -- 172.21.15.59:0/1089963579 >> 172.21.15.59:0/1089963579 conn(0x7f5fec0b3390 msgr2=0x7f5fec13fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.327+0000 7f5ff3800640 1 -- 172.21.15.59:0/1089963579 shutdown_connections 2024-04-25T09:02:54.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.327+0000 7f5ff3800640 1 -- 172.21.15.59:0/1089963579 wait complete. 2024-04-25T09:02:54.339 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-04-25T09:02:53.669714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237204,"kb_used_data":4404,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737516,"statfs":{"total":773094113280,"available":772851216384,"internally_reserved":0,"allocated":4509696,"data_stored":2591795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.464205"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220189+0000","last_change":"2024-04-25T09:02:49.220189+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220189+0000","last_undegraded":"2024-04-25T09:02:49.220189+0000","last_fullsized":"2024-04-25T09:02:49.220189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.217156+0000","last_change":"2024-04-25T09:02:49.217156+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.217156+0000","last_undegraded":"2024-04-25T09:02:49.217156+0000","last_fullsized":"2024-04-25T09:02:49.217156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216620+0000","last_change":"2024-04-25T09:02:49.216620+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216620+0000","last_undegraded":"2024-04-25T09:02:49.216620+0000","last_fullsized":"2024-04-25T09:02:49.216620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215100+0000","last_change":"2024-04-25T09:02:49.215100+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215100+0000","last_undegraded":"2024-04-25T09:02:49.215100+0000","last_fullsized":"2024-04-25T09:02:49.215100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.218269+0000","last_change":"2024-04-25T09:02:49.218269+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.218269+0000","last_undegraded":"2024-04-25T09:02:49.218269+0000","last_fullsized":"2024-04-25T09:02:49.218269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216613+0000","last_change":"2024-04-25T09:02:49.216613+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216613+0000","last_undegraded":"2024-04-25T09:02:49.216613+0000","last_fullsized":"2024-04-25T09:02:49.216613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214144+0000","last_change":"2024-04-25T09:02:49.214144+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214144+0000","last_undegraded":"2024-04-25T09:02:49.214144+0000","last_fullsized":"2024-04-25T09:02:49.214144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216867+0000","last_change":"2024-04-25T09:02:49.216867+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216867+0000","last_undegraded":"2024-04-25T09:02:49.216867+0000","last_fullsized":"2024-04-25T09:02:49.216867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216262+0000","last_change":"2024-04-25T09:02:49.216262+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216262+0000","last_undegraded":"2024-04-25T09:02:49.216262+0000","last_fullsized":"2024-04-25T09:02:49.216262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.217223+0000","last_change":"2024-04-25T09:02:49.217223+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.217223+0000","last_undegraded":"2024-04-25T09:02:49.217223+0000","last_fullsized":"2024-04-25T09:02:49.217223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214201+0000","last_change":"2024-04-25T09:02:49.214201+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214201+0000","last_undegraded":"2024-04-25T09:02:49.214201+0000","last_fullsized":"2024-04-25T09:02:49.214201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.222641+0000","last_change":"2024-04-25T09:02:49.222641+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.222641+0000","last_undegraded":"2024-04-25T09:02:49.222641+0000","last_fullsized":"2024-04-25T09:02:49.222641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213317+0000","last_change":"2024-04-25T09:02:49.213317+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213317+0000","last_undegraded":"2024-04-25T09:02:49.213317+0000","last_fullsized":"2024-04-25T09:02:49.213317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223913+0000","last_change":"2024-04-25T09:02:49.223913+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223913+0000","last_undegraded":"2024-04-25T09:02:49.223913+0000","last_fullsized":"2024-04-25T09:02:49.223913+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213249+0000","last_change":"2024-04-25T09:02:49.213249+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213249+0000","last_undegraded":"2024-04-25T09:02:49.213249+0000","last_fullsized":"2024-04-25T09:02:49.213249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.225394+0000","last_change":"2024-04-25T09:02:49.225394+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.225394+0000","last_undegraded":"2024-04-25T09:02:49.225394+0000","last_fullsized":"2024-04-25T09:02:49.225394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.225285+0000","last_change":"2024-04-25T09:02:49.225285+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.225285+0000","last_undegraded":"2024-04-25T09:02:49.225285+0000","last_fullsized":"2024-04-25T09:02:49.225285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213336+0000","last_change":"2024-04-25T09:02:49.213336+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213336+0000","last_undegraded":"2024-04-25T09:02:49.213336+0000","last_fullsized":"2024-04-25T09:02:49.213336+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214453+0000","last_change":"2024-04-25T09:02:49.214453+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214453+0000","last_undegraded":"2024-04-25T09:02:49.214453+0000","last_fullsized":"2024-04-25T09:02:49.214453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215405+0000","last_change":"2024-04-25T09:02:49.215405+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215405+0000","last_undegraded":"2024-04-25T09:02:49.215405+0000","last_fullsized":"2024-04-25T09:02:49.215405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.212787+0000","last_change":"2024-04-25T09:02:49.212787+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.212787+0000","last_undegraded":"2024-04-25T09:02:49.212787+0000","last_fullsized":"2024-04-25T09:02:49.212787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223103+0000","last_change":"2024-04-25T09:02:49.223103+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223103+0000","last_undegraded":"2024-04-25T09:02:49.223103+0000","last_fullsized":"2024-04-25T09:02:49.223103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223938+0000","last_change":"2024-04-25T09:02:49.223938+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223938+0000","last_undegraded":"2024-04-25T09:02:49.223938+0000","last_fullsized":"2024-04-25T09:02:49.223938+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214375+0000","last_change":"2024-04-25T09:02:49.214375+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214375+0000","last_undegraded":"2024-04-25T09:02:49.214375+0000","last_fullsized":"2024-04-25T09:02:49.214375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213872+0000","last_change":"2024-04-25T09:02:49.213872+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213872+0000","last_undegraded":"2024-04-25T09:02:49.213872+0000","last_fullsized":"2024-04-25T09:02:49.213872+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215292+0000","last_change":"2024-04-25T09:02:49.215292+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215292+0000","last_undegraded":"2024-04-25T09:02:49.215292+0000","last_fullsized":"2024-04-25T09:02:49.215292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213401+0000","last_change":"2024-04-25T09:02:49.213401+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213401+0000","last_undegraded":"2024-04-25T09:02:49.213401+0000","last_fullsized":"2024-04-25T09:02:49.213401+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213871+0000","last_change":"2024-04-25T09:02:49.213871+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213871+0000","last_undegraded":"2024-04-25T09:02:49.213871+0000","last_fullsized":"2024-04-25T09:02:49.213871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214190+0000","last_change":"2024-04-25T09:02:49.214190+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214190+0000","last_undegraded":"2024-04-25T09:02:49.214190+0000","last_fullsized":"2024-04-25T09:02:49.214190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213670+0000","last_change":"2024-04-25T09:02:49.213670+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213670+0000","last_undegraded":"2024-04-25T09:02:49.213670+0000","last_fullsized":"2024-04-25T09:02:49.213670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223355+0000","last_change":"2024-04-25T09:02:49.223355+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223355+0000","last_undegraded":"2024-04-25T09:02:49.223355+0000","last_fullsized":"2024-04-25T09:02:49.223355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215368+0000","last_change":"2024-04-25T09:02:49.215368+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215368+0000","last_undegraded":"2024-04-25T09:02:49.215368+0000","last_fullsized":"2024-04-25T09:02:49.215368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.226523+0000","last_change":"2024-04-25T09:02:49.226523+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.226523+0000","last_undegraded":"2024-04-25T09:02:49.226523+0000","last_fullsized":"2024-04-25T09:02:49.226523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235911+0000","last_change":"2024-04-25T09:02:49.232545+0000","last_active":"2024-04-25T09:02:49.235911+0000","last_peered":"2024-04-25T09:02:49.235911+0000","last_clean":"2024-04-25T09:02:49.235911+0000","last_became_active":"2024-04-25T09:02:49.232210+0000","last_became_peered":"2024-04-25T09:02:49.232210+0000","last_unstale":"2024-04-25T09:02:49.235911+0000","last_undegraded":"2024-04-25T09:02:49.235911+0000","last_fullsized":"2024-04-25T09:02:49.235911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:31.325674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215865+0000","last_change":"2024-04-25T09:02:49.215865+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215865+0000","last_undegraded":"2024-04-25T09:02:49.215865+0000","last_fullsized":"2024-04-25T09:02:49.215865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240662+0000","last_change":"2024-04-25T09:02:49.235883+0000","last_active":"2024-04-25T09:02:49.240662+0000","last_peered":"2024-04-25T09:02:49.240662+0000","last_clean":"2024-04-25T09:02:49.240662+0000","last_became_active":"2024-04-25T09:02:49.235596+0000","last_became_peered":"2024-04-25T09:02:49.235596+0000","last_unstale":"2024-04-25T09:02:49.240662+0000","last_undegraded":"2024-04-25T09:02:49.240662+0000","last_fullsized":"2024-04-25T09:02:49.240662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:18.835228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220757+0000","last_change":"2024-04-25T09:02:49.220757+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220757+0000","last_undegraded":"2024-04-25T09:02:49.220757+0000","last_fullsized":"2024-04-25T09:02:49.220757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238238+0000","last_change":"2024-04-25T09:02:49.229405+0000","last_active":"2024-04-25T09:02:49.238238+0000","last_peered":"2024-04-25T09:02:49.238238+0000","last_clean":"2024-04-25T09:02:49.238238+0000","last_became_active":"2024-04-25T09:02:49.228291+0000","last_became_peered":"2024-04-25T09:02:49.228291+0000","last_unstale":"2024-04-25T09:02:49.238238+0000","last_undegraded":"2024-04-25T09:02:49.238238+0000","last_fullsized":"2024-04-25T09:02:49.238238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:38.302888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220690+0000","last_change":"2024-04-25T09:02:49.220690+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220690+0000","last_undegraded":"2024-04-25T09:02:49.220690+0000","last_fullsized":"2024-04-25T09:02:49.220690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235071+0000","last_change":"2024-04-25T09:02:49.231000+0000","last_active":"2024-04-25T09:02:49.235071+0000","last_peered":"2024-04-25T09:02:49.235071+0000","last_clean":"2024-04-25T09:02:49.235071+0000","last_became_active":"2024-04-25T09:02:49.230712+0000","last_became_peered":"2024-04-25T09:02:49.230712+0000","last_unstale":"2024-04-25T09:02:49.235071+0000","last_undegraded":"2024-04-25T09:02:49.235071+0000","last_fullsized":"2024-04-25T09:02:49.235071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:31.325674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.226115+0000","last_change":"2024-04-25T09:02:49.226115+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.226115+0000","last_undegraded":"2024-04-25T09:02:49.226115+0000","last_fullsized":"2024-04-25T09:02:49.226115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235629+0000","last_change":"2024-04-25T09:02:49.233023+0000","last_active":"2024-04-25T09:02:49.235629+0000","last_peered":"2024-04-25T09:02:49.235629+0000","last_clean":"2024-04-25T09:02:49.235629+0000","last_became_active":"2024-04-25T09:02:49.232394+0000","last_became_peered":"2024-04-25T09:02:49.232394+0000","last_unstale":"2024-04-25T09:02:49.235629+0000","last_undegraded":"2024-04-25T09:02:49.235629+0000","last_fullsized":"2024-04-25T09:02:49.235629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:01.239512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.212491+0000","last_change":"2024-04-25T09:02:49.212491+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.212491+0000","last_undegraded":"2024-04-25T09:02:49.212491+0000","last_fullsized":"2024-04-25T09:02:49.212491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.239960+0000","last_change":"2024-04-25T09:02:49.236881+0000","last_active":"2024-04-25T09:02:49.239960+0000","last_peered":"2024-04-25T09:02:49.239960+0000","last_clean":"2024-04-25T09:02:49.239960+0000","last_became_active":"2024-04-25T09:02:49.236588+0000","last_became_peered":"2024-04-25T09:02:49.236588+0000","last_unstale":"2024-04-25T09:02:49.239960+0000","last_undegraded":"2024-04-25T09:02:49.239960+0000","last_fullsized":"2024-04-25T09:02:49.239960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:11.020739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220996+0000","last_change":"2024-04-25T09:02:49.220996+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220996+0000","last_undegraded":"2024-04-25T09:02:49.220996+0000","last_fullsized":"2024-04-25T09:02:49.220996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240388+0000","last_change":"2024-04-25T09:02:49.236095+0000","last_active":"2024-04-25T09:02:49.240388+0000","last_peered":"2024-04-25T09:02:49.240388+0000","last_clean":"2024-04-25T09:02:49.240388+0000","last_became_active":"2024-04-25T09:02:49.235806+0000","last_became_peered":"2024-04-25T09:02:49.235806+0000","last_unstale":"2024-04-25T09:02:49.240388+0000","last_undegraded":"2024-04-25T09:02:49.240388+0000","last_fullsized":"2024-04-25T09:02:49.240388+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:34.838771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.222341+0000","last_change":"2024-04-25T09:02:49.222341+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.222341+0000","last_undegraded":"2024-04-25T09:02:49.222341+0000","last_fullsized":"2024-04-25T09:02:49.222341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.232315+0000","last_change":"2024-04-25T09:02:49.230266+0000","last_active":"2024-04-25T09:02:49.232315+0000","last_peered":"2024-04-25T09:02:49.232315+0000","last_clean":"2024-04-25T09:02:49.232315+0000","last_became_active":"2024-04-25T09:02:49.230000+0000","last_became_peered":"2024-04-25T09:02:49.230000+0000","last_unstale":"2024-04-25T09:02:49.232315+0000","last_undegraded":"2024-04-25T09:02:49.232315+0000","last_fullsized":"2024-04-25T09:02:49.232315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:57.434431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214213+0000","last_change":"2024-04-25T09:02:49.214213+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214213+0000","last_undegraded":"2024-04-25T09:02:49.214213+0000","last_fullsized":"2024-04-25T09:02:49.214213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.239785+0000","last_change":"2024-04-25T09:02:49.232268+0000","last_active":"2024-04-25T09:02:49.239785+0000","last_peered":"2024-04-25T09:02:49.239785+0000","last_clean":"2024-04-25T09:02:49.239785+0000","last_became_active":"2024-04-25T09:02:49.232019+0000","last_became_peered":"2024-04-25T09:02:49.232019+0000","last_unstale":"2024-04-25T09:02:49.239785+0000","last_undegraded":"2024-04-25T09:02:49.239785+0000","last_fullsized":"2024-04-25T09:02:49.239785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:51.351917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.226032+0000","last_change":"2024-04-25T09:02:49.226032+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.226032+0000","last_undegraded":"2024-04-25T09:02:49.226032+0000","last_fullsized":"2024-04-25T09:02:49.226032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235731+0000","last_change":"2024-04-25T09:02:49.233904+0000","last_active":"2024-04-25T09:02:49.235731+0000","last_peered":"2024-04-25T09:02:49.235731+0000","last_clean":"2024-04-25T09:02:49.235731+0000","last_became_active":"2024-04-25T09:02:49.233609+0000","last_became_peered":"2024-04-25T09:02:49.233609+0000","last_unstale":"2024-04-25T09:02:49.235731+0000","last_undegraded":"2024-04-25T09:02:49.235731+0000","last_fullsized":"2024-04-25T09:02:49.235731+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:11.835993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.217021+0000","last_change":"2024-04-25T09:02:49.217021+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.217021+0000","last_undegraded":"2024-04-25T09:02:49.217021+0000","last_fullsized":"2024-04-25T09:02:49.217021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238063+0000","last_change":"2024-04-25T09:02:49.236426+0000","last_active":"2024-04-25T09:02:49.238063+0000","last_peered":"2024-04-25T09:02:49.238063+0000","last_clean":"2024-04-25T09:02:49.238063+0000","last_became_active":"2024-04-25T09:02:49.236159+0000","last_became_peered":"2024-04-25T09:02:49.236159+0000","last_unstale":"2024-04-25T09:02:49.238063+0000","last_undegraded":"2024-04-25T09:02:49.238063+0000","last_fullsized":"2024-04-25T09:02:49.238063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:44.833258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.222767+0000","last_change":"2024-04-25T09:02:49.222767+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.222767+0000","last_undegraded":"2024-04-25T09:02:49.222767+0000","last_fullsized":"2024-04-25T09:02:49.222767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240838+0000","last_change":"2024-04-25T09:02:49.237214+0000","last_active":"2024-04-25T09:02:49.240838+0000","last_peered":"2024-04-25T09:02:49.240838+0000","last_clean":"2024-04-25T09:02:49.240838+0000","last_became_active":"2024-04-25T09:02:49.236915+0000","last_became_peered":"2024-04-25T09:02:49.236915+0000","last_unstale":"2024-04-25T09:02:49.240838+0000","last_undegraded":"2024-04-25T09:02:49.240838+0000","last_fullsized":"2024-04-25T09:02:49.240838+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:11.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.225471+0000","last_change":"2024-04-25T09:02:49.225471+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.225471+0000","last_undegraded":"2024-04-25T09:02:49.225471+0000","last_fullsized":"2024-04-25T09:02:49.225471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240808+0000","last_change":"2024-04-25T09:02:49.237173+0000","last_active":"2024-04-25T09:02:49.240808+0000","last_peered":"2024-04-25T09:02:49.240808+0000","last_clean":"2024-04-25T09:02:49.240808+0000","last_became_active":"2024-04-25T09:02:49.236852+0000","last_became_peered":"2024-04-25T09:02:49.236852+0000","last_unstale":"2024-04-25T09:02:49.240808+0000","last_undegraded":"2024-04-25T09:02:49.240808+0000","last_fullsized":"2024-04-25T09:02:49.240808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:03.259110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.217224+0000","last_change":"2024-04-25T09:02:49.217224+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.217224+0000","last_undegraded":"2024-04-25T09:02:49.217224+0000","last_fullsized":"2024-04-25T09:02:49.217224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240371+0000","last_change":"2024-04-25T09:02:49.235898+0000","last_active":"2024-04-25T09:02:49.240371+0000","last_peered":"2024-04-25T09:02:49.240371+0000","last_clean":"2024-04-25T09:02:49.240371+0000","last_became_active":"2024-04-25T09:02:49.235616+0000","last_became_peered":"2024-04-25T09:02:49.235616+0000","last_unstale":"2024-04-25T09:02:49.240371+0000","last_undegraded":"2024-04-25T09:02:49.240371+0000","last_fullsized":"2024-04-25T09:02:49.240371+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:36.529344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.224342+0000","last_change":"2024-04-25T09:02:49.224342+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.224342+0000","last_undegraded":"2024-04-25T09:02:49.224342+0000","last_fullsized":"2024-04-25T09:02:49.224342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.233015+0000","last_change":"2024-04-25T09:02:49.227991+0000","last_active":"2024-04-25T09:02:49.233015+0000","last_peered":"2024-04-25T09:02:49.233015+0000","last_clean":"2024-04-25T09:02:49.233015+0000","last_became_active":"2024-04-25T09:02:49.227654+0000","last_became_peered":"2024-04-25T09:02:49.227654+0000","last_unstale":"2024-04-25T09:02:49.233015+0000","last_undegraded":"2024-04-25T09:02:49.233015+0000","last_fullsized":"2024-04-25T09:02:49.233015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:59.351527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.221987+0000","last_change":"2024-04-25T09:02:49.221987+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.221987+0000","last_undegraded":"2024-04-25T09:02:49.221987+0000","last_fullsized":"2024-04-25T09:02:49.221987+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240012+0000","last_change":"2024-04-25T09:02:49.238444+0000","last_active":"2024-04-25T09:02:49.240012+0000","last_peered":"2024-04-25T09:02:49.240012+0000","last_clean":"2024-04-25T09:02:49.240012+0000","last_became_active":"2024-04-25T09:02:49.238101+0000","last_became_peered":"2024-04-25T09:02:49.238101+0000","last_unstale":"2024-04-25T09:02:49.240012+0000","last_undegraded":"2024-04-25T09:02:49.240012+0000","last_fullsized":"2024-04-25T09:02:49.240012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:44.833258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.218027+0000","last_change":"2024-04-25T09:02:49.218027+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.218027+0000","last_undegraded":"2024-04-25T09:02:49.218027+0000","last_fullsized":"2024-04-25T09:02:49.218027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235138+0000","last_change":"2024-04-25T09:02:49.231946+0000","last_active":"2024-04-25T09:02:49.235138+0000","last_peered":"2024-04-25T09:02:49.235138+0000","last_clean":"2024-04-25T09:02:49.235138+0000","last_became_active":"2024-04-25T09:02:49.231493+0000","last_became_peered":"2024-04-25T09:02:49.231493+0000","last_unstale":"2024-04-25T09:02:49.235138+0000","last_undegraded":"2024-04-25T09:02:49.235138+0000","last_fullsized":"2024-04-25T09:02:49.235138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:11.020739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213700+0000","last_change":"2024-04-25T09:02:49.213700+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213700+0000","last_undegraded":"2024-04-25T09:02:49.213700+0000","last_fullsized":"2024-04-25T09:02:49.213700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.239287+0000","last_change":"2024-04-25T09:02:49.235760+0000","last_active":"2024-04-25T09:02:49.239287+0000","last_peered":"2024-04-25T09:02:49.239287+0000","last_clean":"2024-04-25T09:02:49.239287+0000","last_became_active":"2024-04-25T09:02:49.235503+0000","last_became_peered":"2024-04-25T09:02:49.235503+0000","last_unstale":"2024-04-25T09:02:49.239287+0000","last_undegraded":"2024-04-25T09:02:49.239287+0000","last_fullsized":"2024-04-25T09:02:49.239287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:38.302888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.221236+0000","last_change":"2024-04-25T09:02:49.221236+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.221236+0000","last_undegraded":"2024-04-25T09:02:49.221236+0000","last_fullsized":"2024-04-25T09:02:49.221236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238127+0000","last_change":"2024-04-25T09:02:49.234792+0000","last_active":"2024-04-25T09:02:49.238127+0000","last_peered":"2024-04-25T09:02:49.238127+0000","last_clean":"2024-04-25T09:02:49.238127+0000","last_became_active":"2024-04-25T09:02:49.234481+0000","last_became_peered":"2024-04-25T09:02:49.234481+0000","last_unstale":"2024-04-25T09:02:49.238127+0000","last_undegraded":"2024-04-25T09:02:49.238127+0000","last_fullsized":"2024-04-25T09:02:49.238127+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:46.878761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214188+0000","last_change":"2024-04-25T09:02:49.214188+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214188+0000","last_undegraded":"2024-04-25T09:02:49.214188+0000","last_fullsized":"2024-04-25T09:02:49.214188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.237494+0000","last_change":"2024-04-25T09:02:49.229398+0000","last_active":"2024-04-25T09:02:49.237494+0000","last_peered":"2024-04-25T09:02:49.237494+0000","last_clean":"2024-04-25T09:02:49.237494+0000","last_became_active":"2024-04-25T09:02:49.229026+0000","last_became_peered":"2024-04-25T09:02:49.229026+0000","last_unstale":"2024-04-25T09:02:49.237494+0000","last_undegraded":"2024-04-25T09:02:49.237494+0000","last_fullsized":"2024-04-25T09:02:49.237494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:31.325674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.224827+0000","last_change":"2024-04-25T09:02:49.224827+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.224827+0000","last_undegraded":"2024-04-25T09:02:49.224827+0000","last_fullsized":"2024-04-25T09:02:49.224827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238080+0000","last_change":"2024-04-25T09:02:49.234652+0000","last_active":"2024-04-25T09:02:49.238080+0000","last_peered":"2024-04-25T09:02:49.238080+0000","last_clean":"2024-04-25T09:02:49.238080+0000","last_became_active":"2024-04-25T09:02:49.234331+0000","last_became_peered":"2024-04-25T09:02:49.234331+0000","last_unstale":"2024-04-25T09:02:49.238080+0000","last_undegraded":"2024-04-25T09:02:49.238080+0000","last_fullsized":"2024-04-25T09:02:49.238080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:39.441161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223831+0000","last_change":"2024-04-25T09:02:49.223831+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223831+0000","last_undegraded":"2024-04-25T09:02:49.223831+0000","last_fullsized":"2024-04-25T09:02:49.223831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238084+0000","last_change":"2024-04-25T09:02:49.234855+0000","last_active":"2024-04-25T09:02:49.238084+0000","last_peered":"2024-04-25T09:02:49.238084+0000","last_clean":"2024-04-25T09:02:49.238084+0000","last_became_active":"2024-04-25T09:02:49.234276+0000","last_became_peered":"2024-04-25T09:02:49.234276+0000","last_unstale":"2024-04-25T09:02:49.238084+0000","last_undegraded":"2024-04-25T09:02:49.238084+0000","last_fullsized":"2024-04-25T09:02:49.238084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:32.463422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.212562+0000","last_change":"2024-04-25T09:02:49.212562+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.212562+0000","last_undegraded":"2024-04-25T09:02:49.212562+0000","last_fullsized":"2024-04-25T09:02:49.212562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240003+0000","last_change":"2024-04-25T09:02:49.237611+0000","last_active":"2024-04-25T09:02:49.240003+0000","last_peered":"2024-04-25T09:02:49.240003+0000","last_clean":"2024-04-25T09:02:49.240003+0000","last_became_active":"2024-04-25T09:02:49.237238+0000","last_became_peered":"2024-04-25T09:02:49.237238+0000","last_unstale":"2024-04-25T09:02:49.240003+0000","last_undegraded":"2024-04-25T09:02:49.240003+0000","last_fullsized":"2024-04-25T09:02:49.240003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:11.835993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220390+0000","last_change":"2024-04-25T09:02:49.220390+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220390+0000","last_undegraded":"2024-04-25T09:02:49.220390+0000","last_fullsized":"2024-04-25T09:02:49.220390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.232749+0000","last_change":"2024-04-25T09:02:49.228571+0000","last_active":"2024-04-25T09:02:49.232749+0000","last_peered":"2024-04-25T09:02:49.232749+0000","last_clean":"2024-04-25T09:02:49.232749+0000","last_became_active":"2024-04-25T09:02:49.228289+0000","last_became_peered":"2024-04-25T09:02:49.228289+0000","last_unstale":"2024-04-25T09:02:49.232749+0000","last_undegraded":"2024-04-25T09:02:49.232749+0000","last_fullsized":"2024-04-25T09:02:49.232749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:42.456851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215473+0000","last_change":"2024-04-25T09:02:49.215473+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215473+0000","last_undegraded":"2024-04-25T09:02:49.215473+0000","last_fullsized":"2024-04-25T09:02:49.215473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238377+0000","last_change":"2024-04-25T09:02:49.236567+0000","last_active":"2024-04-25T09:02:49.238377+0000","last_peered":"2024-04-25T09:02:49.238377+0000","last_clean":"2024-04-25T09:02:49.238377+0000","last_became_active":"2024-04-25T09:02:49.236293+0000","last_became_peered":"2024-04-25T09:02:49.236293+0000","last_unstale":"2024-04-25T09:02:49.238377+0000","last_undegraded":"2024-04-25T09:02:49.238377+0000","last_fullsized":"2024-04-25T09:02:49.238377+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:51.351917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.225563+0000","last_change":"2024-04-25T09:02:49.225563+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.225563+0000","last_undegraded":"2024-04-25T09:02:49.225563+0000","last_fullsized":"2024-04-25T09:02:49.225563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.230874+0000","last_change":"2024-04-25T09:02:49.222270+0000","last_active":"2024-04-25T09:02:49.230874+0000","last_peered":"2024-04-25T09:02:49.230874+0000","last_clean":"2024-04-25T09:02:49.230874+0000","last_became_active":"2024-04-25T09:02:49.221997+0000","last_became_peered":"2024-04-25T09:02:49.221997+0000","last_unstale":"2024-04-25T09:02:49.230874+0000","last_undegraded":"2024-04-25T09:02:49.230874+0000","last_fullsized":"2024-04-25T09:02:49.230874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:24.686425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216556+0000","last_change":"2024-04-25T09:02:49.216556+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216556+0000","last_undegraded":"2024-04-25T09:02:49.216556+0000","last_fullsized":"2024-04-25T09:02:49.216556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240086+0000","last_change":"2024-04-25T09:02:49.232993+0000","last_active":"2024-04-25T09:02:49.240086+0000","last_peered":"2024-04-25T09:02:49.240086+0000","last_clean":"2024-04-25T09:02:49.240086+0000","last_became_active":"2024-04-25T09:02:49.232717+0000","last_became_peered":"2024-04-25T09:02:49.232717+0000","last_unstale":"2024-04-25T09:02:49.240086+0000","last_undegraded":"2024-04-25T09:02:49.240086+0000","last_fullsized":"2024-04-25T09:02:49.240086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:49.487103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223489+0000","last_change":"2024-04-25T09:02:49.223489+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223489+0000","last_undegraded":"2024-04-25T09:02:49.223489+0000","last_fullsized":"2024-04-25T09:02:49.223489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.231306+0000","last_change":"2024-04-25T09:02:49.226736+0000","last_active":"2024-04-25T09:02:49.231306+0000","last_peered":"2024-04-25T09:02:49.231306+0000","last_clean":"2024-04-25T09:02:49.231306+0000","last_became_active":"2024-04-25T09:02:49.226454+0000","last_became_peered":"2024-04-25T09:02:49.226454+0000","last_unstale":"2024-04-25T09:02:49.231306+0000","last_undegraded":"2024-04-25T09:02:49.231306+0000","last_fullsized":"2024-04-25T09:02:49.231306+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:34.838771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215575+0000","last_change":"2024-04-25T09:02:49.215575+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215575+0000","last_undegraded":"2024-04-25T09:02:49.215575+0000","last_fullsized":"2024-04-25T09:02:49.215575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.234433+0000","last_change":"2024-04-25T09:02:49.229299+0000","last_active":"2024-04-25T09:02:49.234433+0000","last_peered":"2024-04-25T09:02:49.234433+0000","last_clean":"2024-04-25T09:02:49.234433+0000","last_became_active":"2024-04-25T09:02:49.228960+0000","last_became_peered":"2024-04-25T09:02:49.228960+0000","last_unstale":"2024-04-25T09:02:49.234433+0000","last_undegraded":"2024-04-25T09:02:49.234433+0000","last_fullsized":"2024-04-25T09:02:49.234433+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:57.434431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223569+0000","last_change":"2024-04-25T09:02:49.223569+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223569+0000","last_undegraded":"2024-04-25T09:02:49.223569+0000","last_fullsized":"2024-04-25T09:02:49.223569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.231662+0000","last_change":"2024-04-25T09:02:49.228645+0000","last_active":"2024-04-25T09:02:49.231662+0000","last_peered":"2024-04-25T09:02:49.231662+0000","last_clean":"2024-04-25T09:02:49.231662+0000","last_became_active":"2024-04-25T09:02:49.228210+0000","last_became_peered":"2024-04-25T09:02:49.228210+0000","last_unstale":"2024-04-25T09:02:49.231662+0000","last_undegraded":"2024-04-25T09:02:49.231662+0000","last_fullsized":"2024-04-25T09:02:49.231662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:59.351527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.224426+0000","last_change":"2024-04-25T09:02:49.224426+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.224426+0000","last_undegraded":"2024-04-25T09:02:49.224426+0000","last_fullsized":"2024-04-25T09:02:49.224426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240031+0000","last_change":"2024-04-25T09:02:49.233077+0000","last_active":"2024-04-25T09:02:49.240031+0000","last_peered":"2024-04-25T09:02:49.240031+0000","last_clean":"2024-04-25T09:02:49.240031+0000","last_became_active":"2024-04-25T09:02:49.232847+0000","last_became_peered":"2024-04-25T09:02:49.232847+0000","last_unstale":"2024-04-25T09:02:49.240031+0000","last_undegraded":"2024-04-25T09:02:49.240031+0000","last_fullsized":"2024-04-25T09:02:49.240031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:33.718367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215392+0000","last_change":"2024-04-25T09:02:49.215392+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215392+0000","last_undegraded":"2024-04-25T09:02:49.215392+0000","last_fullsized":"2024-04-25T09:02:49.215392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.239988+0000","last_change":"2024-04-25T09:02:49.237540+0000","last_active":"2024-04-25T09:02:49.239988+0000","last_peered":"2024-04-25T09:02:49.239988+0000","last_clean":"2024-04-25T09:02:49.239988+0000","last_became_active":"2024-04-25T09:02:49.237260+0000","last_became_peered":"2024-04-25T09:02:49.237260+0000","last_unstale":"2024-04-25T09:02:49.239988+0000","last_undegraded":"2024-04-25T09:02:49.239988+0000","last_fullsized":"2024-04-25T09:02:49.239988+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:01.239512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.227348+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:02:49.227348+0000","last_peered":"2024-04-25T09:02:49.227348+0000","last_clean":"2024-04-25T09:02:49.227348+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:02:49.227348+0000","last_undegraded":"2024-04-25T09:02:49.227348+0000","last_fullsized":"2024-04-25T09:02:49.227348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1007616,"data_stored":765917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":425984,"data_stored":182216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":765917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:02:54.346 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:02:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.527+0000 7fdf0fc00640 1 Processor -- start 2024-04-25T09:02:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.527+0000 7fdf0fc00640 1 -- start start 2024-04-25T09:02:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf0fc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdf08144140 0x7fdf080ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf0fc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf0806ead0 0x7fdf080b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf0fc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0815ac60 con 0x7fdf080ced60 2024-04-25T09:02:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf0fc00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf080cf3e0 con 0x7fdf08144140 2024-04-25T09:02:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf0fc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0815af20 con 0x7fdf0806ead0 2024-04-25T09:02:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdf080ced60 0x7fdf0806e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60060/0 (socket says 172.21.15.59:60060) 2024-04-25T09:02:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07e00640 1 -- 172.21.15.59:0/3835275889 learned_addr learned my addr 172.21.15.59:0/3835275889 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf0d200640 1 --2- 172.21.15.59:0/3835275889 >> v2:172.21.15.178:3300/0 conn(0x7fdf08144140 0x7fdf080ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf0dc00640 1 --2- 172.21.15.59:0/3835275889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf0806ead0 0x7fdf080b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205098581 0 0) 0x7fdf0815ac60 con 0x7fdf080ced60 2024-04-25T09:02:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdef0005740 con 0x7fdf080ced60 2024-04-25T09:02:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4227583914 0 0) 0x7fdef0005740 con 0x7fdf080ced60 2024-04-25T09:02:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf0806ead0 msgr2=0x7fdf080b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 --2- 172.21.15.59:0/3835275889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf0806ead0 0x7fdf080b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 >> v2:172.21.15.178:3300/0 conn(0x7fdf08144140 msgr2=0x7fdf080ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 --2- 172.21.15.59:0/3835275889 >> v2:172.21.15.178:3300/0 conn(0x7fdf08144140 0x7fdf080ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0815b200 con 0x7fdf080ced60 2024-04-25T09:02:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fdef4001680 con 0x7fdf080ced60 2024-04-25T09:02:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf0d200640 1 --2- 172.21.15.59:0/3835275889 >> v2:172.21.15.178:3300/0 conn(0x7fdf08144140 0x7fdf080ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:02:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 >> v1:172.21.15.59:6789/0 conn(0x7fdf080ced60 legacy=0x7fdf0806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 --2- 172.21.15.59:0/3835275889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdef0005bd0 0x7fdef0005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 --2- 172.21.15.59:0/3835275889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef0006a20 0x7fdef0006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 --2- 172.21.15.59:0/3835275889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf0806ead0 0x7fdef00073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080cf3e0 con 0x7fdef0006a20 2024-04-25T09:02:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0815af20 con 0x7fdef0005bd0 2024-04-25T09:02:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdef000dbe0 con 0x7fdf0806ead0 2024-04-25T09:02:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07e00640 1 --2- 172.21.15.59:0/3835275889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef0006a20 0x7fdef0006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf0d200640 1 --2- 172.21.15.59:0/3835275889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdef0005bd0 0x7fdef0005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf0dc00640 1 --2- 172.21.15.59:0/3835275889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf0806ead0 0x7fdef00073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07e00640 1 -- 172.21.15.59:0/3835275889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf0806ead0 msgr2=0x7fdef00073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07e00640 1 --2- 172.21.15.59:0/3835275889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf0806ead0 0x7fdef00073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07e00640 1 -- 172.21.15.59:0/3835275889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdef0005bd0 msgr2=0x7fdef0005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07e00640 1 --2- 172.21.15.59:0/3835275889 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdef0005bd0 0x7fdef0005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.531+0000 7fdf07e00640 1 -- 172.21.15.59:0/3835275889 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef0005740 con 0x7fdef0006a20 2024-04-25T09:02:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf07e00640 1 --2- 172.21.15.59:0/3835275889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef0006a20 0x7fdef0006ea0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c2c0 tx=0x7fdef401f4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7f29e45934d91e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4007d60 con 0x7fdef0006a20 2024-04-25T09:02:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef4005b00 con 0x7fdef0006a20 2024-04-25T09:02:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf07400640 1 -- 172.21.15.59:0/3835275889 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4007070 con 0x7fdef0006a20 2024-04-25T09:02:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf0fc00640 1 -- 172.21.15.59:0/3835275889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef0006a20 msgr2=0x7fdef0006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf0fc00640 1 --2- 172.21.15.59:0/3835275889 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef0006a20 0x7fdef0006ea0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdef400c2c0 tx=0x7fdef401f4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf0dc00640 1 -- 172.21.15.59:0/3835275889 reap_dead start 2024-04-25T09:02:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf0fc00640 1 -- 172.21.15.59:0/3835275889 shutdown_connections 2024-04-25T09:02:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf0fc00640 1 -- 172.21.15.59:0/3835275889 >> 172.21.15.59:0/3835275889 conn(0x7fdf08066fa0 msgr2=0x7fdf0806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf0fc00640 1 -- 172.21.15.59:0/3835275889 shutdown_connections 2024-04-25T09:02:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf0fc00640 1 -- 172.21.15.59:0/3835275889 wait complete. 2024-04-25T09:02:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf0fc00640 1 Processor -- start 2024-04-25T09:02:54.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.535+0000 7fdf0fc00640 1 -- start start 2024-04-25T09:02:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0fc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef0006a20 0x7fdf080ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0fc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf0806e6d0 0x7fdf0806d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0fc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf08150c00 0x7fdf081510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0fc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08144520 con 0x7fdef0006a20 2024-04-25T09:02:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0fc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf080b1f30 con 0x7fdf08150c00 2024-04-25T09:02:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0fc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0815ba00 con 0x7fdf0806e6d0 2024-04-25T09:02:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef0006a20 0x7fdf080ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef0006a20 0x7fdf080ca230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37324/0 (socket says 172.21.15.59:37324) 2024-04-25T09:02:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0d200640 1 -- 172.21.15.59:0/2072241025 learned_addr learned my addr 172.21.15.59:0/2072241025 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0d200640 1 -- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf0806e6d0 msgr2=0x7fdf0806d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0d200640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf0806e6d0 0x7fdf0806d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0d200640 1 -- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf08150c00 msgr2=0x7fdf081510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0dc00640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf08150c00 0x7fdf081510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0d200640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf08150c00 0x7fdf081510b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0d200640 1 -- 172.21.15.59:0/2072241025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf081515f0 con 0x7fdef0006a20 2024-04-25T09:02:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0d200640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef0006a20 0x7fdf080ca230 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdefc011cd0 tx=0x7fdefc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf04c00640 1 -- 172.21.15.59:0/2072241025 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc00fd20 con 0x7fdef0006a20 2024-04-25T09:02:54.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf04c00640 1 -- 172.21.15.59:0/2072241025 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc004030 con 0x7fdef0006a20 2024-04-25T09:02:54.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf04c00640 1 -- 172.21.15.59:0/2072241025 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc004420 con 0x7fdef0006a20 2024-04-25T09:02:54.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0fc00640 1 -- 172.21.15.59:0/2072241025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf081f0230 con 0x7fdef0006a20 2024-04-25T09:02:54.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0fc00640 1 -- 172.21.15.59:0/2072241025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf081f07f0 con 0x7fdef0006a20 2024-04-25T09:02:54.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.539+0000 7fdf0fc00640 1 -- 172.21.15.59:0/2072241025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf080745d0 con 0x7fdef0006a20 2024-04-25T09:02:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.543+0000 7fdf04c00640 1 -- 172.21.15.59:0/2072241025 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdefc012040 con 0x7fdef0006a20 2024-04-25T09:02:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.543+0000 7fdf04c00640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdee8066ea0 0x7fdee8069360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.543+0000 7fdf04c00640 1 -- 172.21.15.59:0/2072241025 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdefc0857a0 con 0x7fdef0006a20 2024-04-25T09:02:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.543+0000 7fdf07e00640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdee8066ea0 0x7fdee8069360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.543+0000 7fdf07e00640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdee8066ea0 0x7fdee8069360 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdef40ae000 tx=0x7fdf0815b3d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:54.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.547+0000 7fdf04c00640 1 -- 172.21.15.59:0/2072241025 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdefc019070 con 0x7fdef0006a20 2024-04-25T09:02:54.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.707+0000 7fdf0fc00640 1 -- 172.21.15.59:0/2072241025 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf080ca770 con 0x7fdee8066ea0 2024-04-25T09:02:54.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.715+0000 7fdf04c00640 1 -- 172.21.15.59:0/2072241025 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246635 (secure 0 0 0) 0x7fdef40fc380 con 0x7fdee8066ea0 2024-04-25T09:02:54.709 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:54.710 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:02:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.719+0000 7fdf0fc00640 1 -- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdee8066ea0 msgr2=0x7fdee8069360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.719+0000 7fdf0fc00640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdee8066ea0 0x7fdee8069360 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdef40ae000 tx=0x7fdf0815b3d0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.719+0000 7fdf0fc00640 1 -- 172.21.15.59:0/2072241025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef0006a20 msgr2=0x7fdf080ca230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.719+0000 7fdf0fc00640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef0006a20 0x7fdf080ca230 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdefc011cd0 tx=0x7fdefc00f610 comp rx=0 tx=0).stop 2024-04-25T09:02:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.719+0000 7fdf0fc00640 1 -- 172.21.15.59:0/2072241025 shutdown_connections 2024-04-25T09:02:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.719+0000 7fdf0fc00640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdee8066ea0 0x7fdee8069360 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.719+0000 7fdf0fc00640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdf08150c00 0x7fdf081510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.719+0000 7fdf0fc00640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdf0806e6d0 0x7fdf0806d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.719+0000 7fdf0fc00640 1 --2- 172.21.15.59:0/2072241025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdef0006a20 0x7fdf080ca230 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.719+0000 7fdf0fc00640 1 -- 172.21.15.59:0/2072241025 >> 172.21.15.59:0/2072241025 conn(0x7fdf08066fa0 msgr2=0x7fdf0815d810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.719+0000 7fdf0fc00640 1 -- 172.21.15.59:0/2072241025 shutdown_connections 2024-04-25T09:02:54.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.719+0000 7fdf0fc00640 1 -- 172.21.15.59:0/2072241025 wait complete. 2024-04-25T09:02:54.728 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-04-25T09:02:53.669714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237204,"kb_used_data":4404,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737516,"statfs":{"total":773094113280,"available":772851216384,"internally_reserved":0,"allocated":4509696,"data_stored":2591795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.464205"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220189+0000","last_change":"2024-04-25T09:02:49.220189+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220189+0000","last_undegraded":"2024-04-25T09:02:49.220189+0000","last_fullsized":"2024-04-25T09:02:49.220189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.217156+0000","last_change":"2024-04-25T09:02:49.217156+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.217156+0000","last_undegraded":"2024-04-25T09:02:49.217156+0000","last_fullsized":"2024-04-25T09:02:49.217156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216620+0000","last_change":"2024-04-25T09:02:49.216620+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216620+0000","last_undegraded":"2024-04-25T09:02:49.216620+0000","last_fullsized":"2024-04-25T09:02:49.216620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215100+0000","last_change":"2024-04-25T09:02:49.215100+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215100+0000","last_undegraded":"2024-04-25T09:02:49.215100+0000","last_fullsized":"2024-04-25T09:02:49.215100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.218269+0000","last_change":"2024-04-25T09:02:49.218269+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.218269+0000","last_undegraded":"2024-04-25T09:02:49.218269+0000","last_fullsized":"2024-04-25T09:02:49.218269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216613+0000","last_change":"2024-04-25T09:02:49.216613+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216613+0000","last_undegraded":"2024-04-25T09:02:49.216613+0000","last_fullsized":"2024-04-25T09:02:49.216613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214144+0000","last_change":"2024-04-25T09:02:49.214144+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214144+0000","last_undegraded":"2024-04-25T09:02:49.214144+0000","last_fullsized":"2024-04-25T09:02:49.214144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216867+0000","last_change":"2024-04-25T09:02:49.216867+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216867+0000","last_undegraded":"2024-04-25T09:02:49.216867+0000","last_fullsized":"2024-04-25T09:02:49.216867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216262+0000","last_change":"2024-04-25T09:02:49.216262+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216262+0000","last_undegraded":"2024-04-25T09:02:49.216262+0000","last_fullsized":"2024-04-25T09:02:49.216262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.217223+0000","last_change":"2024-04-25T09:02:49.217223+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.217223+0000","last_undegraded":"2024-04-25T09:02:49.217223+0000","last_fullsized":"2024-04-25T09:02:49.217223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214201+0000","last_change":"2024-04-25T09:02:49.214201+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214201+0000","last_undegraded":"2024-04-25T09:02:49.214201+0000","last_fullsized":"2024-04-25T09:02:49.214201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.222641+0000","last_change":"2024-04-25T09:02:49.222641+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.222641+0000","last_undegraded":"2024-04-25T09:02:49.222641+0000","last_fullsized":"2024-04-25T09:02:49.222641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213317+0000","last_change":"2024-04-25T09:02:49.213317+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213317+0000","last_undegraded":"2024-04-25T09:02:49.213317+0000","last_fullsized":"2024-04-25T09:02:49.213317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223913+0000","last_change":"2024-04-25T09:02:49.223913+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223913+0000","last_undegraded":"2024-04-25T09:02:49.223913+0000","last_fullsized":"2024-04-25T09:02:49.223913+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213249+0000","last_change":"2024-04-25T09:02:49.213249+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213249+0000","last_undegraded":"2024-04-25T09:02:49.213249+0000","last_fullsized":"2024-04-25T09:02:49.213249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.225394+0000","last_change":"2024-04-25T09:02:49.225394+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.225394+0000","last_undegraded":"2024-04-25T09:02:49.225394+0000","last_fullsized":"2024-04-25T09:02:49.225394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.225285+0000","last_change":"2024-04-25T09:02:49.225285+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.225285+0000","last_undegraded":"2024-04-25T09:02:49.225285+0000","last_fullsized":"2024-04-25T09:02:49.225285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213336+0000","last_change":"2024-04-25T09:02:49.213336+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213336+0000","last_undegraded":"2024-04-25T09:02:49.213336+0000","last_fullsized":"2024-04-25T09:02:49.213336+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214453+0000","last_change":"2024-04-25T09:02:49.214453+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214453+0000","last_undegraded":"2024-04-25T09:02:49.214453+0000","last_fullsized":"2024-04-25T09:02:49.214453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215405+0000","last_change":"2024-04-25T09:02:49.215405+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215405+0000","last_undegraded":"2024-04-25T09:02:49.215405+0000","last_fullsized":"2024-04-25T09:02:49.215405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.212787+0000","last_change":"2024-04-25T09:02:49.212787+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.212787+0000","last_undegraded":"2024-04-25T09:02:49.212787+0000","last_fullsized":"2024-04-25T09:02:49.212787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223103+0000","last_change":"2024-04-25T09:02:49.223103+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223103+0000","last_undegraded":"2024-04-25T09:02:49.223103+0000","last_fullsized":"2024-04-25T09:02:49.223103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223938+0000","last_change":"2024-04-25T09:02:49.223938+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223938+0000","last_undegraded":"2024-04-25T09:02:49.223938+0000","last_fullsized":"2024-04-25T09:02:49.223938+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214375+0000","last_change":"2024-04-25T09:02:49.214375+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214375+0000","last_undegraded":"2024-04-25T09:02:49.214375+0000","last_fullsized":"2024-04-25T09:02:49.214375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213872+0000","last_change":"2024-04-25T09:02:49.213872+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213872+0000","last_undegraded":"2024-04-25T09:02:49.213872+0000","last_fullsized":"2024-04-25T09:02:49.213872+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215292+0000","last_change":"2024-04-25T09:02:49.215292+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215292+0000","last_undegraded":"2024-04-25T09:02:49.215292+0000","last_fullsized":"2024-04-25T09:02:49.215292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213401+0000","last_change":"2024-04-25T09:02:49.213401+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213401+0000","last_undegraded":"2024-04-25T09:02:49.213401+0000","last_fullsized":"2024-04-25T09:02:49.213401+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213871+0000","last_change":"2024-04-25T09:02:49.213871+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213871+0000","last_undegraded":"2024-04-25T09:02:49.213871+0000","last_fullsized":"2024-04-25T09:02:49.213871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214190+0000","last_change":"2024-04-25T09:02:49.214190+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214190+0000","last_undegraded":"2024-04-25T09:02:49.214190+0000","last_fullsized":"2024-04-25T09:02:49.214190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213670+0000","last_change":"2024-04-25T09:02:49.213670+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213670+0000","last_undegraded":"2024-04-25T09:02:49.213670+0000","last_fullsized":"2024-04-25T09:02:49.213670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223355+0000","last_change":"2024-04-25T09:02:49.223355+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223355+0000","last_undegraded":"2024-04-25T09:02:49.223355+0000","last_fullsized":"2024-04-25T09:02:49.223355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215368+0000","last_change":"2024-04-25T09:02:49.215368+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215368+0000","last_undegraded":"2024-04-25T09:02:49.215368+0000","last_fullsized":"2024-04-25T09:02:49.215368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.226523+0000","last_change":"2024-04-25T09:02:49.226523+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.226523+0000","last_undegraded":"2024-04-25T09:02:49.226523+0000","last_fullsized":"2024-04-25T09:02:49.226523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235911+0000","last_change":"2024-04-25T09:02:49.232545+0000","last_active":"2024-04-25T09:02:49.235911+0000","last_peered":"2024-04-25T09:02:49.235911+0000","last_clean":"2024-04-25T09:02:49.235911+0000","last_became_active":"2024-04-25T09:02:49.232210+0000","last_became_peered":"2024-04-25T09:02:49.232210+0000","last_unstale":"2024-04-25T09:02:49.235911+0000","last_undegraded":"2024-04-25T09:02:49.235911+0000","last_fullsized":"2024-04-25T09:02:49.235911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:31.325674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215865+0000","last_change":"2024-04-25T09:02:49.215865+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215865+0000","last_undegraded":"2024-04-25T09:02:49.215865+0000","last_fullsized":"2024-04-25T09:02:49.215865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240662+0000","last_change":"2024-04-25T09:02:49.235883+0000","last_active":"2024-04-25T09:02:49.240662+0000","last_peered":"2024-04-25T09:02:49.240662+0000","last_clean":"2024-04-25T09:02:49.240662+0000","last_became_active":"2024-04-25T09:02:49.235596+0000","last_became_peered":"2024-04-25T09:02:49.235596+0000","last_unstale":"2024-04-25T09:02:49.240662+0000","last_undegraded":"2024-04-25T09:02:49.240662+0000","last_fullsized":"2024-04-25T09:02:49.240662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:18.835228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220757+0000","last_change":"2024-04-25T09:02:49.220757+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220757+0000","last_undegraded":"2024-04-25T09:02:49.220757+0000","last_fullsized":"2024-04-25T09:02:49.220757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238238+0000","last_change":"2024-04-25T09:02:49.229405+0000","last_active":"2024-04-25T09:02:49.238238+0000","last_peered":"2024-04-25T09:02:49.238238+0000","last_clean":"2024-04-25T09:02:49.238238+0000","last_became_active":"2024-04-25T09:02:49.228291+0000","last_became_peered":"2024-04-25T09:02:49.228291+0000","last_unstale":"2024-04-25T09:02:49.238238+0000","last_undegraded":"2024-04-25T09:02:49.238238+0000","last_fullsized":"2024-04-25T09:02:49.238238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:38.302888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220690+0000","last_change":"2024-04-25T09:02:49.220690+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220690+0000","last_undegraded":"2024-04-25T09:02:49.220690+0000","last_fullsized":"2024-04-25T09:02:49.220690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235071+0000","last_change":"2024-04-25T09:02:49.231000+0000","last_active":"2024-04-25T09:02:49.235071+0000","last_peered":"2024-04-25T09:02:49.235071+0000","last_clean":"2024-04-25T09:02:49.235071+0000","last_became_active":"2024-04-25T09:02:49.230712+0000","last_became_peered":"2024-04-25T09:02:49.230712+0000","last_unstale":"2024-04-25T09:02:49.235071+0000","last_undegraded":"2024-04-25T09:02:49.235071+0000","last_fullsized":"2024-04-25T09:02:49.235071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:31.325674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.226115+0000","last_change":"2024-04-25T09:02:49.226115+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.226115+0000","last_undegraded":"2024-04-25T09:02:49.226115+0000","last_fullsized":"2024-04-25T09:02:49.226115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235629+0000","last_change":"2024-04-25T09:02:49.233023+0000","last_active":"2024-04-25T09:02:49.235629+0000","last_peered":"2024-04-25T09:02:49.235629+0000","last_clean":"2024-04-25T09:02:49.235629+0000","last_became_active":"2024-04-25T09:02:49.232394+0000","last_became_peered":"2024-04-25T09:02:49.232394+0000","last_unstale":"2024-04-25T09:02:49.235629+0000","last_undegraded":"2024-04-25T09:02:49.235629+0000","last_fullsized":"2024-04-25T09:02:49.235629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:01.239512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.212491+0000","last_change":"2024-04-25T09:02:49.212491+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.212491+0000","last_undegraded":"2024-04-25T09:02:49.212491+0000","last_fullsized":"2024-04-25T09:02:49.212491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.239960+0000","last_change":"2024-04-25T09:02:49.236881+0000","last_active":"2024-04-25T09:02:49.239960+0000","last_peered":"2024-04-25T09:02:49.239960+0000","last_clean":"2024-04-25T09:02:49.239960+0000","last_became_active":"2024-04-25T09:02:49.236588+0000","last_became_peered":"2024-04-25T09:02:49.236588+0000","last_unstale":"2024-04-25T09:02:49.239960+0000","last_undegraded":"2024-04-25T09:02:49.239960+0000","last_fullsized":"2024-04-25T09:02:49.239960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:11.020739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220996+0000","last_change":"2024-04-25T09:02:49.220996+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220996+0000","last_undegraded":"2024-04-25T09:02:49.220996+0000","last_fullsized":"2024-04-25T09:02:49.220996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240388+0000","last_change":"2024-04-25T09:02:49.236095+0000","last_active":"2024-04-25T09:02:49.240388+0000","last_peered":"2024-04-25T09:02:49.240388+0000","last_clean":"2024-04-25T09:02:49.240388+0000","last_became_active":"2024-04-25T09:02:49.235806+0000","last_became_peered":"2024-04-25T09:02:49.235806+0000","last_unstale":"2024-04-25T09:02:49.240388+0000","last_undegraded":"2024-04-25T09:02:49.240388+0000","last_fullsized":"2024-04-25T09:02:49.240388+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:34.838771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.222341+0000","last_change":"2024-04-25T09:02:49.222341+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.222341+0000","last_undegraded":"2024-04-25T09:02:49.222341+0000","last_fullsized":"2024-04-25T09:02:49.222341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.232315+0000","last_change":"2024-04-25T09:02:49.230266+0000","last_active":"2024-04-25T09:02:49.232315+0000","last_peered":"2024-04-25T09:02:49.232315+0000","last_clean":"2024-04-25T09:02:49.232315+0000","last_became_active":"2024-04-25T09:02:49.230000+0000","last_became_peered":"2024-04-25T09:02:49.230000+0000","last_unstale":"2024-04-25T09:02:49.232315+0000","last_undegraded":"2024-04-25T09:02:49.232315+0000","last_fullsized":"2024-04-25T09:02:49.232315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:57.434431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214213+0000","last_change":"2024-04-25T09:02:49.214213+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214213+0000","last_undegraded":"2024-04-25T09:02:49.214213+0000","last_fullsized":"2024-04-25T09:02:49.214213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.239785+0000","last_change":"2024-04-25T09:02:49.232268+0000","last_active":"2024-04-25T09:02:49.239785+0000","last_peered":"2024-04-25T09:02:49.239785+0000","last_clean":"2024-04-25T09:02:49.239785+0000","last_became_active":"2024-04-25T09:02:49.232019+0000","last_became_peered":"2024-04-25T09:02:49.232019+0000","last_unstale":"2024-04-25T09:02:49.239785+0000","last_undegraded":"2024-04-25T09:02:49.239785+0000","last_fullsized":"2024-04-25T09:02:49.239785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:51.351917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.226032+0000","last_change":"2024-04-25T09:02:49.226032+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.226032+0000","last_undegraded":"2024-04-25T09:02:49.226032+0000","last_fullsized":"2024-04-25T09:02:49.226032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235731+0000","last_change":"2024-04-25T09:02:49.233904+0000","last_active":"2024-04-25T09:02:49.235731+0000","last_peered":"2024-04-25T09:02:49.235731+0000","last_clean":"2024-04-25T09:02:49.235731+0000","last_became_active":"2024-04-25T09:02:49.233609+0000","last_became_peered":"2024-04-25T09:02:49.233609+0000","last_unstale":"2024-04-25T09:02:49.235731+0000","last_undegraded":"2024-04-25T09:02:49.235731+0000","last_fullsized":"2024-04-25T09:02:49.235731+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:11.835993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.217021+0000","last_change":"2024-04-25T09:02:49.217021+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.217021+0000","last_undegraded":"2024-04-25T09:02:49.217021+0000","last_fullsized":"2024-04-25T09:02:49.217021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238063+0000","last_change":"2024-04-25T09:02:49.236426+0000","last_active":"2024-04-25T09:02:49.238063+0000","last_peered":"2024-04-25T09:02:49.238063+0000","last_clean":"2024-04-25T09:02:49.238063+0000","last_became_active":"2024-04-25T09:02:49.236159+0000","last_became_peered":"2024-04-25T09:02:49.236159+0000","last_unstale":"2024-04-25T09:02:49.238063+0000","last_undegraded":"2024-04-25T09:02:49.238063+0000","last_fullsized":"2024-04-25T09:02:49.238063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:44.833258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.222767+0000","last_change":"2024-04-25T09:02:49.222767+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.222767+0000","last_undegraded":"2024-04-25T09:02:49.222767+0000","last_fullsized":"2024-04-25T09:02:49.222767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240838+0000","last_change":"2024-04-25T09:02:49.237214+0000","last_active":"2024-04-25T09:02:49.240838+0000","last_peered":"2024-04-25T09:02:49.240838+0000","last_clean":"2024-04-25T09:02:49.240838+0000","last_became_active":"2024-04-25T09:02:49.236915+0000","last_became_peered":"2024-04-25T09:02:49.236915+0000","last_unstale":"2024-04-25T09:02:49.240838+0000","last_undegraded":"2024-04-25T09:02:49.240838+0000","last_fullsized":"2024-04-25T09:02:49.240838+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:11.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.225471+0000","last_change":"2024-04-25T09:02:49.225471+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.225471+0000","last_undegraded":"2024-04-25T09:02:49.225471+0000","last_fullsized":"2024-04-25T09:02:49.225471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240808+0000","last_change":"2024-04-25T09:02:49.237173+0000","last_active":"2024-04-25T09:02:49.240808+0000","last_peered":"2024-04-25T09:02:49.240808+0000","last_clean":"2024-04-25T09:02:49.240808+0000","last_became_active":"2024-04-25T09:02:49.236852+0000","last_became_peered":"2024-04-25T09:02:49.236852+0000","last_unstale":"2024-04-25T09:02:49.240808+0000","last_undegraded":"2024-04-25T09:02:49.240808+0000","last_fullsized":"2024-04-25T09:02:49.240808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:03.259110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.217224+0000","last_change":"2024-04-25T09:02:49.217224+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.217224+0000","last_undegraded":"2024-04-25T09:02:49.217224+0000","last_fullsized":"2024-04-25T09:02:49.217224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240371+0000","last_change":"2024-04-25T09:02:49.235898+0000","last_active":"2024-04-25T09:02:49.240371+0000","last_peered":"2024-04-25T09:02:49.240371+0000","last_clean":"2024-04-25T09:02:49.240371+0000","last_became_active":"2024-04-25T09:02:49.235616+0000","last_became_peered":"2024-04-25T09:02:49.235616+0000","last_unstale":"2024-04-25T09:02:49.240371+0000","last_undegraded":"2024-04-25T09:02:49.240371+0000","last_fullsized":"2024-04-25T09:02:49.240371+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:36.529344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.224342+0000","last_change":"2024-04-25T09:02:49.224342+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.224342+0000","last_undegraded":"2024-04-25T09:02:49.224342+0000","last_fullsized":"2024-04-25T09:02:49.224342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.233015+0000","last_change":"2024-04-25T09:02:49.227991+0000","last_active":"2024-04-25T09:02:49.233015+0000","last_peered":"2024-04-25T09:02:49.233015+0000","last_clean":"2024-04-25T09:02:49.233015+0000","last_became_active":"2024-04-25T09:02:49.227654+0000","last_became_peered":"2024-04-25T09:02:49.227654+0000","last_unstale":"2024-04-25T09:02:49.233015+0000","last_undegraded":"2024-04-25T09:02:49.233015+0000","last_fullsized":"2024-04-25T09:02:49.233015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:59.351527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.221987+0000","last_change":"2024-04-25T09:02:49.221987+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.221987+0000","last_undegraded":"2024-04-25T09:02:49.221987+0000","last_fullsized":"2024-04-25T09:02:49.221987+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240012+0000","last_change":"2024-04-25T09:02:49.238444+0000","last_active":"2024-04-25T09:02:49.240012+0000","last_peered":"2024-04-25T09:02:49.240012+0000","last_clean":"2024-04-25T09:02:49.240012+0000","last_became_active":"2024-04-25T09:02:49.238101+0000","last_became_peered":"2024-04-25T09:02:49.238101+0000","last_unstale":"2024-04-25T09:02:49.240012+0000","last_undegraded":"2024-04-25T09:02:49.240012+0000","last_fullsized":"2024-04-25T09:02:49.240012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:44.833258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.218027+0000","last_change":"2024-04-25T09:02:49.218027+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.218027+0000","last_undegraded":"2024-04-25T09:02:49.218027+0000","last_fullsized":"2024-04-25T09:02:49.218027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235138+0000","last_change":"2024-04-25T09:02:49.231946+0000","last_active":"2024-04-25T09:02:49.235138+0000","last_peered":"2024-04-25T09:02:49.235138+0000","last_clean":"2024-04-25T09:02:49.235138+0000","last_became_active":"2024-04-25T09:02:49.231493+0000","last_became_peered":"2024-04-25T09:02:49.231493+0000","last_unstale":"2024-04-25T09:02:49.235138+0000","last_undegraded":"2024-04-25T09:02:49.235138+0000","last_fullsized":"2024-04-25T09:02:49.235138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:11.020739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213700+0000","last_change":"2024-04-25T09:02:49.213700+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213700+0000","last_undegraded":"2024-04-25T09:02:49.213700+0000","last_fullsized":"2024-04-25T09:02:49.213700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.239287+0000","last_change":"2024-04-25T09:02:49.235760+0000","last_active":"2024-04-25T09:02:49.239287+0000","last_peered":"2024-04-25T09:02:49.239287+0000","last_clean":"2024-04-25T09:02:49.239287+0000","last_became_active":"2024-04-25T09:02:49.235503+0000","last_became_peered":"2024-04-25T09:02:49.235503+0000","last_unstale":"2024-04-25T09:02:49.239287+0000","last_undegraded":"2024-04-25T09:02:49.239287+0000","last_fullsized":"2024-04-25T09:02:49.239287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:38.302888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.221236+0000","last_change":"2024-04-25T09:02:49.221236+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.221236+0000","last_undegraded":"2024-04-25T09:02:49.221236+0000","last_fullsized":"2024-04-25T09:02:49.221236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238127+0000","last_change":"2024-04-25T09:02:49.234792+0000","last_active":"2024-04-25T09:02:49.238127+0000","last_peered":"2024-04-25T09:02:49.238127+0000","last_clean":"2024-04-25T09:02:49.238127+0000","last_became_active":"2024-04-25T09:02:49.234481+0000","last_became_peered":"2024-04-25T09:02:49.234481+0000","last_unstale":"2024-04-25T09:02:49.238127+0000","last_undegraded":"2024-04-25T09:02:49.238127+0000","last_fullsized":"2024-04-25T09:02:49.238127+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:46.878761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214188+0000","last_change":"2024-04-25T09:02:49.214188+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214188+0000","last_undegraded":"2024-04-25T09:02:49.214188+0000","last_fullsized":"2024-04-25T09:02:49.214188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.237494+0000","last_change":"2024-04-25T09:02:49.229398+0000","last_active":"2024-04-25T09:02:49.237494+0000","last_peered":"2024-04-25T09:02:49.237494+0000","last_clean":"2024-04-25T09:02:49.237494+0000","last_became_active":"2024-04-25T09:02:49.229026+0000","last_became_peered":"2024-04-25T09:02:49.229026+0000","last_unstale":"2024-04-25T09:02:49.237494+0000","last_undegraded":"2024-04-25T09:02:49.237494+0000","last_fullsized":"2024-04-25T09:02:49.237494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:31.325674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.224827+0000","last_change":"2024-04-25T09:02:49.224827+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.224827+0000","last_undegraded":"2024-04-25T09:02:49.224827+0000","last_fullsized":"2024-04-25T09:02:49.224827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238080+0000","last_change":"2024-04-25T09:02:49.234652+0000","last_active":"2024-04-25T09:02:49.238080+0000","last_peered":"2024-04-25T09:02:49.238080+0000","last_clean":"2024-04-25T09:02:49.238080+0000","last_became_active":"2024-04-25T09:02:49.234331+0000","last_became_peered":"2024-04-25T09:02:49.234331+0000","last_unstale":"2024-04-25T09:02:49.238080+0000","last_undegraded":"2024-04-25T09:02:49.238080+0000","last_fullsized":"2024-04-25T09:02:49.238080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:39.441161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223831+0000","last_change":"2024-04-25T09:02:49.223831+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223831+0000","last_undegraded":"2024-04-25T09:02:49.223831+0000","last_fullsized":"2024-04-25T09:02:49.223831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238084+0000","last_change":"2024-04-25T09:02:49.234855+0000","last_active":"2024-04-25T09:02:49.238084+0000","last_peered":"2024-04-25T09:02:49.238084+0000","last_clean":"2024-04-25T09:02:49.238084+0000","last_became_active":"2024-04-25T09:02:49.234276+0000","last_became_peered":"2024-04-25T09:02:49.234276+0000","last_unstale":"2024-04-25T09:02:49.238084+0000","last_undegraded":"2024-04-25T09:02:49.238084+0000","last_fullsized":"2024-04-25T09:02:49.238084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:32.463422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.212562+0000","last_change":"2024-04-25T09:02:49.212562+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.212562+0000","last_undegraded":"2024-04-25T09:02:49.212562+0000","last_fullsized":"2024-04-25T09:02:49.212562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240003+0000","last_change":"2024-04-25T09:02:49.237611+0000","last_active":"2024-04-25T09:02:49.240003+0000","last_peered":"2024-04-25T09:02:49.240003+0000","last_clean":"2024-04-25T09:02:49.240003+0000","last_became_active":"2024-04-25T09:02:49.237238+0000","last_became_peered":"2024-04-25T09:02:49.237238+0000","last_unstale":"2024-04-25T09:02:49.240003+0000","last_undegraded":"2024-04-25T09:02:49.240003+0000","last_fullsized":"2024-04-25T09:02:49.240003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:11.835993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220390+0000","last_change":"2024-04-25T09:02:49.220390+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220390+0000","last_undegraded":"2024-04-25T09:02:49.220390+0000","last_fullsized":"2024-04-25T09:02:49.220390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.232749+0000","last_change":"2024-04-25T09:02:49.228571+0000","last_active":"2024-04-25T09:02:49.232749+0000","last_peered":"2024-04-25T09:02:49.232749+0000","last_clean":"2024-04-25T09:02:49.232749+0000","last_became_active":"2024-04-25T09:02:49.228289+0000","last_became_peered":"2024-04-25T09:02:49.228289+0000","last_unstale":"2024-04-25T09:02:49.232749+0000","last_undegraded":"2024-04-25T09:02:49.232749+0000","last_fullsized":"2024-04-25T09:02:49.232749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:42.456851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215473+0000","last_change":"2024-04-25T09:02:49.215473+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215473+0000","last_undegraded":"2024-04-25T09:02:49.215473+0000","last_fullsized":"2024-04-25T09:02:49.215473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238377+0000","last_change":"2024-04-25T09:02:49.236567+0000","last_active":"2024-04-25T09:02:49.238377+0000","last_peered":"2024-04-25T09:02:49.238377+0000","last_clean":"2024-04-25T09:02:49.238377+0000","last_became_active":"2024-04-25T09:02:49.236293+0000","last_became_peered":"2024-04-25T09:02:49.236293+0000","last_unstale":"2024-04-25T09:02:49.238377+0000","last_undegraded":"2024-04-25T09:02:49.238377+0000","last_fullsized":"2024-04-25T09:02:49.238377+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:51.351917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.225563+0000","last_change":"2024-04-25T09:02:49.225563+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.225563+0000","last_undegraded":"2024-04-25T09:02:49.225563+0000","last_fullsized":"2024-04-25T09:02:49.225563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.230874+0000","last_change":"2024-04-25T09:02:49.222270+0000","last_active":"2024-04-25T09:02:49.230874+0000","last_peered":"2024-04-25T09:02:49.230874+0000","last_clean":"2024-04-25T09:02:49.230874+0000","last_became_active":"2024-04-25T09:02:49.221997+0000","last_became_peered":"2024-04-25T09:02:49.221997+0000","last_unstale":"2024-04-25T09:02:49.230874+0000","last_undegraded":"2024-04-25T09:02:49.230874+0000","last_fullsized":"2024-04-25T09:02:49.230874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:24.686425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216556+0000","last_change":"2024-04-25T09:02:49.216556+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216556+0000","last_undegraded":"2024-04-25T09:02:49.216556+0000","last_fullsized":"2024-04-25T09:02:49.216556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240086+0000","last_change":"2024-04-25T09:02:49.232993+0000","last_active":"2024-04-25T09:02:49.240086+0000","last_peered":"2024-04-25T09:02:49.240086+0000","last_clean":"2024-04-25T09:02:49.240086+0000","last_became_active":"2024-04-25T09:02:49.232717+0000","last_became_peered":"2024-04-25T09:02:49.232717+0000","last_unstale":"2024-04-25T09:02:49.240086+0000","last_undegraded":"2024-04-25T09:02:49.240086+0000","last_fullsized":"2024-04-25T09:02:49.240086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:49.487103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223489+0000","last_change":"2024-04-25T09:02:49.223489+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223489+0000","last_undegraded":"2024-04-25T09:02:49.223489+0000","last_fullsized":"2024-04-25T09:02:49.223489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.231306+0000","last_change":"2024-04-25T09:02:49.226736+0000","last_active":"2024-04-25T09:02:49.231306+0000","last_peered":"2024-04-25T09:02:49.231306+0000","last_clean":"2024-04-25T09:02:49.231306+0000","last_became_active":"2024-04-25T09:02:49.226454+0000","last_became_peered":"2024-04-25T09:02:49.226454+0000","last_unstale":"2024-04-25T09:02:49.231306+0000","last_undegraded":"2024-04-25T09:02:49.231306+0000","last_fullsized":"2024-04-25T09:02:49.231306+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:34.838771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215575+0000","last_change":"2024-04-25T09:02:49.215575+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215575+0000","last_undegraded":"2024-04-25T09:02:49.215575+0000","last_fullsized":"2024-04-25T09:02:49.215575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.234433+0000","last_change":"2024-04-25T09:02:49.229299+0000","last_active":"2024-04-25T09:02:49.234433+0000","last_peered":"2024-04-25T09:02:49.234433+0000","last_clean":"2024-04-25T09:02:49.234433+0000","last_became_active":"2024-04-25T09:02:49.228960+0000","last_became_peered":"2024-04-25T09:02:49.228960+0000","last_unstale":"2024-04-25T09:02:49.234433+0000","last_undegraded":"2024-04-25T09:02:49.234433+0000","last_fullsized":"2024-04-25T09:02:49.234433+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:57.434431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223569+0000","last_change":"2024-04-25T09:02:49.223569+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223569+0000","last_undegraded":"2024-04-25T09:02:49.223569+0000","last_fullsized":"2024-04-25T09:02:49.223569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.231662+0000","last_change":"2024-04-25T09:02:49.228645+0000","last_active":"2024-04-25T09:02:49.231662+0000","last_peered":"2024-04-25T09:02:49.231662+0000","last_clean":"2024-04-25T09:02:49.231662+0000","last_became_active":"2024-04-25T09:02:49.228210+0000","last_became_peered":"2024-04-25T09:02:49.228210+0000","last_unstale":"2024-04-25T09:02:49.231662+0000","last_undegraded":"2024-04-25T09:02:49.231662+0000","last_fullsized":"2024-04-25T09:02:49.231662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:59.351527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.224426+0000","last_change":"2024-04-25T09:02:49.224426+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.224426+0000","last_undegraded":"2024-04-25T09:02:49.224426+0000","last_fullsized":"2024-04-25T09:02:49.224426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240031+0000","last_change":"2024-04-25T09:02:49.233077+0000","last_active":"2024-04-25T09:02:49.240031+0000","last_peered":"2024-04-25T09:02:49.240031+0000","last_clean":"2024-04-25T09:02:49.240031+0000","last_became_active":"2024-04-25T09:02:49.232847+0000","last_became_peered":"2024-04-25T09:02:49.232847+0000","last_unstale":"2024-04-25T09:02:49.240031+0000","last_undegraded":"2024-04-25T09:02:49.240031+0000","last_fullsized":"2024-04-25T09:02:49.240031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:33.718367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215392+0000","last_change":"2024-04-25T09:02:49.215392+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215392+0000","last_undegraded":"2024-04-25T09:02:49.215392+0000","last_fullsized":"2024-04-25T09:02:49.215392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.239988+0000","last_change":"2024-04-25T09:02:49.237540+0000","last_active":"2024-04-25T09:02:49.239988+0000","last_peered":"2024-04-25T09:02:49.239988+0000","last_clean":"2024-04-25T09:02:49.239988+0000","last_became_active":"2024-04-25T09:02:49.237260+0000","last_became_peered":"2024-04-25T09:02:49.237260+0000","last_unstale":"2024-04-25T09:02:49.239988+0000","last_undegraded":"2024-04-25T09:02:49.239988+0000","last_fullsized":"2024-04-25T09:02:49.239988+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:01.239512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.227348+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:02:49.227348+0000","last_peered":"2024-04-25T09:02:49.227348+0000","last_clean":"2024-04-25T09:02:49.227348+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:02:49.227348+0000","last_undegraded":"2024-04-25T09:02:49.227348+0000","last_fullsized":"2024-04-25T09:02:49.227348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1007616,"data_stored":765917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":425984,"data_stored":182216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":765917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:02:54.732 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:02:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.919+0000 7f44a2400640 1 Processor -- start 2024-04-25T09:02:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.919+0000 7f44a2400640 1 -- start start 2024-04-25T09:02:54.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f44a2400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f449c0d0f40 0x7f449c1689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f44a2400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c06c650 con 0x7f449c099a60 2024-04-25T09:02:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f44a2400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449c06c930 con 0x7f449c15ee00 2024-04-25T09:02:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f44a2400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449c06c430 con 0x7f449c0d0f40 2024-04-25T09:02:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f449c099a60 0x7f449c099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60064/0 (socket says 172.21.15.59:60064) 2024-04-25T09:02:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449b400640 1 -- 172.21.15.59:0/1108535606 learned_addr learned my addr 172.21.15.59:0/1108535606 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449be00640 1 --2- 172.21.15.59:0/1108535606 >> v2:172.21.15.178:3300/0 conn(0x7f449c0d0f40 0x7f449c1689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214214908 0 0) 0x7f449c06c650 con 0x7f449c099a60 2024-04-25T09:02:54.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4480003530 con 0x7f449c099a60 2024-04-25T09:02:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 225991968 0 0) 0x7f4480003530 con 0x7f449c099a60 2024-04-25T09:02:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 >> v2:172.21.15.178:3300/0 conn(0x7f449c0d0f40 msgr2=0x7f449c1689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 --2- 172.21.15.59:0/1108535606 >> v2:172.21.15.178:3300/0 conn(0x7f449c0d0f40 0x7f449c1689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 >> v1:172.21.15.178:6789/0 conn(0x7f449c15ee00 legacy=0x7f449c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c06cc10 con 0x7f449c099a60 2024-04-25T09:02:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f448c001680 con 0x7f449c099a60 2024-04-25T09:02:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 >> v1:172.21.15.59:6789/0 conn(0x7f449c099a60 legacy=0x7f449c099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 --2- 172.21.15.59:0/1108535606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44800039c0 0x7f4480003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 --2- 172.21.15.59:0/1108535606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44800043c0 0x7f4480004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 --2- 172.21.15.59:0/1108535606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4480005090 0x7f448000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c06c430 con 0x7f44800043c0 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448000bff0 con 0x7f4480005090 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448000c1f0 con 0x7f44800039c0 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f4493e00640 1 --2- 172.21.15.59:0/1108535606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44800043c0 0x7f4480004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449b400640 1 --2- 172.21.15.59:0/1108535606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44800039c0 0x7f4480003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449be00640 1 --2- 172.21.15.59:0/1108535606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4480005090 0x7f448000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f4493e00640 1 -- 172.21.15.59:0/1108535606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44800039c0 msgr2=0x7f4480003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f4493e00640 1 --2- 172.21.15.59:0/1108535606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f44800039c0 0x7f4480003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f4493e00640 1 -- 172.21.15.59:0/1108535606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4480005090 msgr2=0x7f448000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f4493e00640 1 --2- 172.21.15.59:0/1108535606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4480005090 0x7f448000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f4493e00640 1 -- 172.21.15.59:0/1108535606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4480003530 con 0x7f44800043c0 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449be00640 1 --2- 172.21.15.59:0/1108535606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4480005090 0x7f448000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:54.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.923+0000 7f449be00640 1 -- 172.21.15.59:0/1108535606 reap_dead start 2024-04-25T09:02:54.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.927+0000 7f4493e00640 1 --2- 172.21.15.59:0/1108535606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44800043c0 0x7f4480004890 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f449c15f260 tx=0x7f448401ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93f102eb18533bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:54.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.927+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840b5070 con 0x7f44800043c0 2024-04-25T09:02:54.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.927+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44840a8830 con 0x7f44800043c0 2024-04-25T09:02:54.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.927+0000 7f449aa00640 1 -- 172.21.15.59:0/1108535606 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484001460 con 0x7f44800043c0 2024-04-25T09:02:54.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.927+0000 7f44a2400640 1 -- 172.21.15.59:0/1108535606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44800043c0 msgr2=0x7f4480004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.927+0000 7f44a2400640 1 --2- 172.21.15.59:0/1108535606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44800043c0 0x7f4480004890 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f449c15f260 tx=0x7f448401ec10 comp rx=0 tx=0).stop 2024-04-25T09:02:54.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.927+0000 7f44a2400640 1 -- 172.21.15.59:0/1108535606 shutdown_connections 2024-04-25T09:02:54.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.927+0000 7f44a2400640 1 --2- 172.21.15.59:0/1108535606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44800043c0 0x7f4480004890 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.927+0000 7f44a2400640 1 -- 172.21.15.59:0/1108535606 >> 172.21.15.59:0/1108535606 conn(0x7f449c0d17a0 msgr2=0x7f449c0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:54.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.927+0000 7f44a2400640 1 -- 172.21.15.59:0/1108535606 shutdown_connections 2024-04-25T09:02:54.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.927+0000 7f44a2400640 1 -- 172.21.15.59:0/1108535606 wait complete. 2024-04-25T09:02:54.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.927+0000 7f44a2400640 1 Processor -- start 2024-04-25T09:02:54.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f44a2400640 1 -- start start 2024-04-25T09:02:54.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f44a2400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44800043c0 0x7f449c0c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f44a2400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c155140 0x7f449c0ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f44a2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cad80 0x7f449c0b6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f44a2400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c15de80 con 0x7f449c0cad80 2024-04-25T09:02:54.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f44a2400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c0cf9e0 con 0x7f44800043c0 2024-04-25T09:02:54.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f44a2400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c15e000 con 0x7f449c155140 2024-04-25T09:02:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f449be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cad80 0x7f449c0b6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f449be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cad80 0x7f449c0b6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37342/0 (socket says 172.21.15.59:37342) 2024-04-25T09:02:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f449be00640 1 -- 172.21.15.59:0/4109053668 learned_addr learned my addr 172.21.15.59:0/4109053668 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f449b400640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44800043c0 0x7f449c0c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f4493e00640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c155140 0x7f449c0ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f449be00640 1 -- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c155140 msgr2=0x7f449c0ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f449be00640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c155140 0x7f449c0ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f449be00640 1 -- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44800043c0 msgr2=0x7f449c0c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f449be00640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44800043c0 0x7f449c0c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f449be00640 1 -- 172.21.15.59:0/4109053668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449c0b5910 con 0x7f449c0cad80 2024-04-25T09:02:54.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f449be00640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cad80 0x7f449c0b6970 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f449c06dd30 tx=0x7f4494010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f4493400640 1 -- 172.21.15.59:0/4109053668 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494010da0 con 0x7f449c0cad80 2024-04-25T09:02:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f4493400640 1 -- 172.21.15.59:0/4109053668 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44940039a0 con 0x7f449c0cad80 2024-04-25T09:02:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f4493400640 1 -- 172.21.15.59:0/4109053668 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494003d90 con 0x7f449c0cad80 2024-04-25T09:02:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f44a2400640 1 -- 172.21.15.59:0/4109053668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c0b5bb0 con 0x7f449c0cad80 2024-04-25T09:02:54.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f44a2400640 1 -- 172.21.15.59:0/4109053668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c0b6170 con 0x7f449c0cad80 2024-04-25T09:02:54.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.931+0000 7f44a2400640 1 -- 172.21.15.59:0/4109053668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c0745d0 con 0x7f449c0cad80 2024-04-25T09:02:54.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.935+0000 7f4493400640 1 -- 172.21.15.59:0/4109053668 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f449401e020 con 0x7f449c0cad80 2024-04-25T09:02:54.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.935+0000 7f4493400640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4478066f60 0x7f4478069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:54.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.935+0000 7f4493400640 1 -- 172.21.15.59:0/4109053668 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f44940857f0 con 0x7f449c0cad80 2024-04-25T09:02:54.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.935+0000 7f449b400640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4478066f60 0x7f4478069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:54.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.935+0000 7f449b400640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4478066f60 0x7f4478069420 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f448c000c10 tx=0x7f448c001c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:54.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:54.939+0000 7f4493400640 1 -- 172.21.15.59:0/4109053668 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4494055f80 con 0x7f449c0cad80 2024-04-25T09:02:55.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.099+0000 7f44a2400640 1 -- 172.21.15.59:0/4109053668 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f449c0736e0 con 0x7f4478066f60 2024-04-25T09:02:55.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.107+0000 7f4493400640 1 -- 172.21.15.59:0/4109053668 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246635 (secure 0 0 0) 0x7f449c0736e0 con 0x7f4478066f60 2024-04-25T09:02:55.101 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:55.102 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:02:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.111+0000 7f44a2400640 1 -- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4478066f60 msgr2=0x7f4478069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.111+0000 7f44a2400640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4478066f60 0x7f4478069420 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f448c000c10 tx=0x7f448c001c40 comp rx=0 tx=0).stop 2024-04-25T09:02:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.111+0000 7f44a2400640 1 -- 172.21.15.59:0/4109053668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cad80 msgr2=0x7f449c0b6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.111+0000 7f44a2400640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cad80 0x7f449c0b6970 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f449c06dd30 tx=0x7f4494010590 comp rx=0 tx=0).stop 2024-04-25T09:02:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.111+0000 7f44a2400640 1 -- 172.21.15.59:0/4109053668 shutdown_connections 2024-04-25T09:02:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.111+0000 7f44a2400640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4478066f60 0x7f4478069420 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.111+0000 7f44a2400640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f449c0cad80 0x7f449c0b6970 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.111+0000 7f44a2400640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f449c155140 0x7f449c0ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.111+0000 7f44a2400640 1 --2- 172.21.15.59:0/4109053668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f44800043c0 0x7f449c0c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.111+0000 7f44a2400640 1 -- 172.21.15.59:0/4109053668 >> 172.21.15.59:0/4109053668 conn(0x7f449c0d17a0 msgr2=0x7f449c156e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.111+0000 7f44a2400640 1 -- 172.21.15.59:0/4109053668 shutdown_connections 2024-04-25T09:02:55.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.111+0000 7f44a2400640 1 -- 172.21.15.59:0/4109053668 wait complete. 2024-04-25T09:02:55.122 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-04-25T09:02:53.669714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237204,"kb_used_data":4404,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737516,"statfs":{"total":773094113280,"available":772851216384,"internally_reserved":0,"allocated":4509696,"data_stored":2591795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.464205"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220189+0000","last_change":"2024-04-25T09:02:49.220189+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220189+0000","last_undegraded":"2024-04-25T09:02:49.220189+0000","last_fullsized":"2024-04-25T09:02:49.220189+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.217156+0000","last_change":"2024-04-25T09:02:49.217156+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.217156+0000","last_undegraded":"2024-04-25T09:02:49.217156+0000","last_fullsized":"2024-04-25T09:02:49.217156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216620+0000","last_change":"2024-04-25T09:02:49.216620+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216620+0000","last_undegraded":"2024-04-25T09:02:49.216620+0000","last_fullsized":"2024-04-25T09:02:49.216620+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215100+0000","last_change":"2024-04-25T09:02:49.215100+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215100+0000","last_undegraded":"2024-04-25T09:02:49.215100+0000","last_fullsized":"2024-04-25T09:02:49.215100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.218269+0000","last_change":"2024-04-25T09:02:49.218269+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.218269+0000","last_undegraded":"2024-04-25T09:02:49.218269+0000","last_fullsized":"2024-04-25T09:02:49.218269+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216613+0000","last_change":"2024-04-25T09:02:49.216613+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216613+0000","last_undegraded":"2024-04-25T09:02:49.216613+0000","last_fullsized":"2024-04-25T09:02:49.216613+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214144+0000","last_change":"2024-04-25T09:02:49.214144+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214144+0000","last_undegraded":"2024-04-25T09:02:49.214144+0000","last_fullsized":"2024-04-25T09:02:49.214144+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216867+0000","last_change":"2024-04-25T09:02:49.216867+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216867+0000","last_undegraded":"2024-04-25T09:02:49.216867+0000","last_fullsized":"2024-04-25T09:02:49.216867+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216262+0000","last_change":"2024-04-25T09:02:49.216262+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216262+0000","last_undegraded":"2024-04-25T09:02:49.216262+0000","last_fullsized":"2024-04-25T09:02:49.216262+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.217223+0000","last_change":"2024-04-25T09:02:49.217223+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.217223+0000","last_undegraded":"2024-04-25T09:02:49.217223+0000","last_fullsized":"2024-04-25T09:02:49.217223+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214201+0000","last_change":"2024-04-25T09:02:49.214201+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214201+0000","last_undegraded":"2024-04-25T09:02:49.214201+0000","last_fullsized":"2024-04-25T09:02:49.214201+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.222641+0000","last_change":"2024-04-25T09:02:49.222641+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.222641+0000","last_undegraded":"2024-04-25T09:02:49.222641+0000","last_fullsized":"2024-04-25T09:02:49.222641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213317+0000","last_change":"2024-04-25T09:02:49.213317+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213317+0000","last_undegraded":"2024-04-25T09:02:49.213317+0000","last_fullsized":"2024-04-25T09:02:49.213317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223913+0000","last_change":"2024-04-25T09:02:49.223913+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223913+0000","last_undegraded":"2024-04-25T09:02:49.223913+0000","last_fullsized":"2024-04-25T09:02:49.223913+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213249+0000","last_change":"2024-04-25T09:02:49.213249+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213249+0000","last_undegraded":"2024-04-25T09:02:49.213249+0000","last_fullsized":"2024-04-25T09:02:49.213249+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.225394+0000","last_change":"2024-04-25T09:02:49.225394+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.225394+0000","last_undegraded":"2024-04-25T09:02:49.225394+0000","last_fullsized":"2024-04-25T09:02:49.225394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.225285+0000","last_change":"2024-04-25T09:02:49.225285+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.225285+0000","last_undegraded":"2024-04-25T09:02:49.225285+0000","last_fullsized":"2024-04-25T09:02:49.225285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213336+0000","last_change":"2024-04-25T09:02:49.213336+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213336+0000","last_undegraded":"2024-04-25T09:02:49.213336+0000","last_fullsized":"2024-04-25T09:02:49.213336+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214453+0000","last_change":"2024-04-25T09:02:49.214453+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214453+0000","last_undegraded":"2024-04-25T09:02:49.214453+0000","last_fullsized":"2024-04-25T09:02:49.214453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215405+0000","last_change":"2024-04-25T09:02:49.215405+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215405+0000","last_undegraded":"2024-04-25T09:02:49.215405+0000","last_fullsized":"2024-04-25T09:02:49.215405+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.212787+0000","last_change":"2024-04-25T09:02:49.212787+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.212787+0000","last_undegraded":"2024-04-25T09:02:49.212787+0000","last_fullsized":"2024-04-25T09:02:49.212787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223103+0000","last_change":"2024-04-25T09:02:49.223103+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223103+0000","last_undegraded":"2024-04-25T09:02:49.223103+0000","last_fullsized":"2024-04-25T09:02:49.223103+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223938+0000","last_change":"2024-04-25T09:02:49.223938+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223938+0000","last_undegraded":"2024-04-25T09:02:49.223938+0000","last_fullsized":"2024-04-25T09:02:49.223938+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214375+0000","last_change":"2024-04-25T09:02:49.214375+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214375+0000","last_undegraded":"2024-04-25T09:02:49.214375+0000","last_fullsized":"2024-04-25T09:02:49.214375+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213872+0000","last_change":"2024-04-25T09:02:49.213872+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213872+0000","last_undegraded":"2024-04-25T09:02:49.213872+0000","last_fullsized":"2024-04-25T09:02:49.213872+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215292+0000","last_change":"2024-04-25T09:02:49.215292+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215292+0000","last_undegraded":"2024-04-25T09:02:49.215292+0000","last_fullsized":"2024-04-25T09:02:49.215292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213401+0000","last_change":"2024-04-25T09:02:49.213401+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213401+0000","last_undegraded":"2024-04-25T09:02:49.213401+0000","last_fullsized":"2024-04-25T09:02:49.213401+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213871+0000","last_change":"2024-04-25T09:02:49.213871+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213871+0000","last_undegraded":"2024-04-25T09:02:49.213871+0000","last_fullsized":"2024-04-25T09:02:49.213871+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214190+0000","last_change":"2024-04-25T09:02:49.214190+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214190+0000","last_undegraded":"2024-04-25T09:02:49.214190+0000","last_fullsized":"2024-04-25T09:02:49.214190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213670+0000","last_change":"2024-04-25T09:02:49.213670+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213670+0000","last_undegraded":"2024-04-25T09:02:49.213670+0000","last_fullsized":"2024-04-25T09:02:49.213670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223355+0000","last_change":"2024-04-25T09:02:49.223355+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223355+0000","last_undegraded":"2024-04-25T09:02:49.223355+0000","last_fullsized":"2024-04-25T09:02:49.223355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215368+0000","last_change":"2024-04-25T09:02:49.215368+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215368+0000","last_undegraded":"2024-04-25T09:02:49.215368+0000","last_fullsized":"2024-04-25T09:02:49.215368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.226523+0000","last_change":"2024-04-25T09:02:49.226523+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.226523+0000","last_undegraded":"2024-04-25T09:02:49.226523+0000","last_fullsized":"2024-04-25T09:02:49.226523+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235911+0000","last_change":"2024-04-25T09:02:49.232545+0000","last_active":"2024-04-25T09:02:49.235911+0000","last_peered":"2024-04-25T09:02:49.235911+0000","last_clean":"2024-04-25T09:02:49.235911+0000","last_became_active":"2024-04-25T09:02:49.232210+0000","last_became_peered":"2024-04-25T09:02:49.232210+0000","last_unstale":"2024-04-25T09:02:49.235911+0000","last_undegraded":"2024-04-25T09:02:49.235911+0000","last_fullsized":"2024-04-25T09:02:49.235911+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:31.325674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215865+0000","last_change":"2024-04-25T09:02:49.215865+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215865+0000","last_undegraded":"2024-04-25T09:02:49.215865+0000","last_fullsized":"2024-04-25T09:02:49.215865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240662+0000","last_change":"2024-04-25T09:02:49.235883+0000","last_active":"2024-04-25T09:02:49.240662+0000","last_peered":"2024-04-25T09:02:49.240662+0000","last_clean":"2024-04-25T09:02:49.240662+0000","last_became_active":"2024-04-25T09:02:49.235596+0000","last_became_peered":"2024-04-25T09:02:49.235596+0000","last_unstale":"2024-04-25T09:02:49.240662+0000","last_undegraded":"2024-04-25T09:02:49.240662+0000","last_fullsized":"2024-04-25T09:02:49.240662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:18.835228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220757+0000","last_change":"2024-04-25T09:02:49.220757+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220757+0000","last_undegraded":"2024-04-25T09:02:49.220757+0000","last_fullsized":"2024-04-25T09:02:49.220757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238238+0000","last_change":"2024-04-25T09:02:49.229405+0000","last_active":"2024-04-25T09:02:49.238238+0000","last_peered":"2024-04-25T09:02:49.238238+0000","last_clean":"2024-04-25T09:02:49.238238+0000","last_became_active":"2024-04-25T09:02:49.228291+0000","last_became_peered":"2024-04-25T09:02:49.228291+0000","last_unstale":"2024-04-25T09:02:49.238238+0000","last_undegraded":"2024-04-25T09:02:49.238238+0000","last_fullsized":"2024-04-25T09:02:49.238238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:38.302888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220690+0000","last_change":"2024-04-25T09:02:49.220690+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220690+0000","last_undegraded":"2024-04-25T09:02:49.220690+0000","last_fullsized":"2024-04-25T09:02:49.220690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235071+0000","last_change":"2024-04-25T09:02:49.231000+0000","last_active":"2024-04-25T09:02:49.235071+0000","last_peered":"2024-04-25T09:02:49.235071+0000","last_clean":"2024-04-25T09:02:49.235071+0000","last_became_active":"2024-04-25T09:02:49.230712+0000","last_became_peered":"2024-04-25T09:02:49.230712+0000","last_unstale":"2024-04-25T09:02:49.235071+0000","last_undegraded":"2024-04-25T09:02:49.235071+0000","last_fullsized":"2024-04-25T09:02:49.235071+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:31.325674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.226115+0000","last_change":"2024-04-25T09:02:49.226115+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.226115+0000","last_undegraded":"2024-04-25T09:02:49.226115+0000","last_fullsized":"2024-04-25T09:02:49.226115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235629+0000","last_change":"2024-04-25T09:02:49.233023+0000","last_active":"2024-04-25T09:02:49.235629+0000","last_peered":"2024-04-25T09:02:49.235629+0000","last_clean":"2024-04-25T09:02:49.235629+0000","last_became_active":"2024-04-25T09:02:49.232394+0000","last_became_peered":"2024-04-25T09:02:49.232394+0000","last_unstale":"2024-04-25T09:02:49.235629+0000","last_undegraded":"2024-04-25T09:02:49.235629+0000","last_fullsized":"2024-04-25T09:02:49.235629+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:01.239512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.212491+0000","last_change":"2024-04-25T09:02:49.212491+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.212491+0000","last_undegraded":"2024-04-25T09:02:49.212491+0000","last_fullsized":"2024-04-25T09:02:49.212491+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.239960+0000","last_change":"2024-04-25T09:02:49.236881+0000","last_active":"2024-04-25T09:02:49.239960+0000","last_peered":"2024-04-25T09:02:49.239960+0000","last_clean":"2024-04-25T09:02:49.239960+0000","last_became_active":"2024-04-25T09:02:49.236588+0000","last_became_peered":"2024-04-25T09:02:49.236588+0000","last_unstale":"2024-04-25T09:02:49.239960+0000","last_undegraded":"2024-04-25T09:02:49.239960+0000","last_fullsized":"2024-04-25T09:02:49.239960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:11.020739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220996+0000","last_change":"2024-04-25T09:02:49.220996+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220996+0000","last_undegraded":"2024-04-25T09:02:49.220996+0000","last_fullsized":"2024-04-25T09:02:49.220996+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240388+0000","last_change":"2024-04-25T09:02:49.236095+0000","last_active":"2024-04-25T09:02:49.240388+0000","last_peered":"2024-04-25T09:02:49.240388+0000","last_clean":"2024-04-25T09:02:49.240388+0000","last_became_active":"2024-04-25T09:02:49.235806+0000","last_became_peered":"2024-04-25T09:02:49.235806+0000","last_unstale":"2024-04-25T09:02:49.240388+0000","last_undegraded":"2024-04-25T09:02:49.240388+0000","last_fullsized":"2024-04-25T09:02:49.240388+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:34.838771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.222341+0000","last_change":"2024-04-25T09:02:49.222341+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.222341+0000","last_undegraded":"2024-04-25T09:02:49.222341+0000","last_fullsized":"2024-04-25T09:02:49.222341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.232315+0000","last_change":"2024-04-25T09:02:49.230266+0000","last_active":"2024-04-25T09:02:49.232315+0000","last_peered":"2024-04-25T09:02:49.232315+0000","last_clean":"2024-04-25T09:02:49.232315+0000","last_became_active":"2024-04-25T09:02:49.230000+0000","last_became_peered":"2024-04-25T09:02:49.230000+0000","last_unstale":"2024-04-25T09:02:49.232315+0000","last_undegraded":"2024-04-25T09:02:49.232315+0000","last_fullsized":"2024-04-25T09:02:49.232315+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:57.434431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214213+0000","last_change":"2024-04-25T09:02:49.214213+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214213+0000","last_undegraded":"2024-04-25T09:02:49.214213+0000","last_fullsized":"2024-04-25T09:02:49.214213+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.239785+0000","last_change":"2024-04-25T09:02:49.232268+0000","last_active":"2024-04-25T09:02:49.239785+0000","last_peered":"2024-04-25T09:02:49.239785+0000","last_clean":"2024-04-25T09:02:49.239785+0000","last_became_active":"2024-04-25T09:02:49.232019+0000","last_became_peered":"2024-04-25T09:02:49.232019+0000","last_unstale":"2024-04-25T09:02:49.239785+0000","last_undegraded":"2024-04-25T09:02:49.239785+0000","last_fullsized":"2024-04-25T09:02:49.239785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:51.351917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.226032+0000","last_change":"2024-04-25T09:02:49.226032+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.226032+0000","last_undegraded":"2024-04-25T09:02:49.226032+0000","last_fullsized":"2024-04-25T09:02:49.226032+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235731+0000","last_change":"2024-04-25T09:02:49.233904+0000","last_active":"2024-04-25T09:02:49.235731+0000","last_peered":"2024-04-25T09:02:49.235731+0000","last_clean":"2024-04-25T09:02:49.235731+0000","last_became_active":"2024-04-25T09:02:49.233609+0000","last_became_peered":"2024-04-25T09:02:49.233609+0000","last_unstale":"2024-04-25T09:02:49.235731+0000","last_undegraded":"2024-04-25T09:02:49.235731+0000","last_fullsized":"2024-04-25T09:02:49.235731+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:11.835993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.217021+0000","last_change":"2024-04-25T09:02:49.217021+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.217021+0000","last_undegraded":"2024-04-25T09:02:49.217021+0000","last_fullsized":"2024-04-25T09:02:49.217021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238063+0000","last_change":"2024-04-25T09:02:49.236426+0000","last_active":"2024-04-25T09:02:49.238063+0000","last_peered":"2024-04-25T09:02:49.238063+0000","last_clean":"2024-04-25T09:02:49.238063+0000","last_became_active":"2024-04-25T09:02:49.236159+0000","last_became_peered":"2024-04-25T09:02:49.236159+0000","last_unstale":"2024-04-25T09:02:49.238063+0000","last_undegraded":"2024-04-25T09:02:49.238063+0000","last_fullsized":"2024-04-25T09:02:49.238063+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:44.833258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.222767+0000","last_change":"2024-04-25T09:02:49.222767+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.222767+0000","last_undegraded":"2024-04-25T09:02:49.222767+0000","last_fullsized":"2024-04-25T09:02:49.222767+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240838+0000","last_change":"2024-04-25T09:02:49.237214+0000","last_active":"2024-04-25T09:02:49.240838+0000","last_peered":"2024-04-25T09:02:49.240838+0000","last_clean":"2024-04-25T09:02:49.240838+0000","last_became_active":"2024-04-25T09:02:49.236915+0000","last_became_peered":"2024-04-25T09:02:49.236915+0000","last_unstale":"2024-04-25T09:02:49.240838+0000","last_undegraded":"2024-04-25T09:02:49.240838+0000","last_fullsized":"2024-04-25T09:02:49.240838+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:11.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.225471+0000","last_change":"2024-04-25T09:02:49.225471+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.225471+0000","last_undegraded":"2024-04-25T09:02:49.225471+0000","last_fullsized":"2024-04-25T09:02:49.225471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240808+0000","last_change":"2024-04-25T09:02:49.237173+0000","last_active":"2024-04-25T09:02:49.240808+0000","last_peered":"2024-04-25T09:02:49.240808+0000","last_clean":"2024-04-25T09:02:49.240808+0000","last_became_active":"2024-04-25T09:02:49.236852+0000","last_became_peered":"2024-04-25T09:02:49.236852+0000","last_unstale":"2024-04-25T09:02:49.240808+0000","last_undegraded":"2024-04-25T09:02:49.240808+0000","last_fullsized":"2024-04-25T09:02:49.240808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:03.259110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.217224+0000","last_change":"2024-04-25T09:02:49.217224+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.217224+0000","last_undegraded":"2024-04-25T09:02:49.217224+0000","last_fullsized":"2024-04-25T09:02:49.217224+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240371+0000","last_change":"2024-04-25T09:02:49.235898+0000","last_active":"2024-04-25T09:02:49.240371+0000","last_peered":"2024-04-25T09:02:49.240371+0000","last_clean":"2024-04-25T09:02:49.240371+0000","last_became_active":"2024-04-25T09:02:49.235616+0000","last_became_peered":"2024-04-25T09:02:49.235616+0000","last_unstale":"2024-04-25T09:02:49.240371+0000","last_undegraded":"2024-04-25T09:02:49.240371+0000","last_fullsized":"2024-04-25T09:02:49.240371+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:36.529344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.224342+0000","last_change":"2024-04-25T09:02:49.224342+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.224342+0000","last_undegraded":"2024-04-25T09:02:49.224342+0000","last_fullsized":"2024-04-25T09:02:49.224342+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.233015+0000","last_change":"2024-04-25T09:02:49.227991+0000","last_active":"2024-04-25T09:02:49.233015+0000","last_peered":"2024-04-25T09:02:49.233015+0000","last_clean":"2024-04-25T09:02:49.233015+0000","last_became_active":"2024-04-25T09:02:49.227654+0000","last_became_peered":"2024-04-25T09:02:49.227654+0000","last_unstale":"2024-04-25T09:02:49.233015+0000","last_undegraded":"2024-04-25T09:02:49.233015+0000","last_fullsized":"2024-04-25T09:02:49.233015+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:59.351527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.221987+0000","last_change":"2024-04-25T09:02:49.221987+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.221987+0000","last_undegraded":"2024-04-25T09:02:49.221987+0000","last_fullsized":"2024-04-25T09:02:49.221987+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240012+0000","last_change":"2024-04-25T09:02:49.238444+0000","last_active":"2024-04-25T09:02:49.240012+0000","last_peered":"2024-04-25T09:02:49.240012+0000","last_clean":"2024-04-25T09:02:49.240012+0000","last_became_active":"2024-04-25T09:02:49.238101+0000","last_became_peered":"2024-04-25T09:02:49.238101+0000","last_unstale":"2024-04-25T09:02:49.240012+0000","last_undegraded":"2024-04-25T09:02:49.240012+0000","last_fullsized":"2024-04-25T09:02:49.240012+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:08:44.833258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.218027+0000","last_change":"2024-04-25T09:02:49.218027+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.218027+0000","last_undegraded":"2024-04-25T09:02:49.218027+0000","last_fullsized":"2024-04-25T09:02:49.218027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.235138+0000","last_change":"2024-04-25T09:02:49.231946+0000","last_active":"2024-04-25T09:02:49.235138+0000","last_peered":"2024-04-25T09:02:49.235138+0000","last_clean":"2024-04-25T09:02:49.235138+0000","last_became_active":"2024-04-25T09:02:49.231493+0000","last_became_peered":"2024-04-25T09:02:49.231493+0000","last_unstale":"2024-04-25T09:02:49.235138+0000","last_undegraded":"2024-04-25T09:02:49.235138+0000","last_fullsized":"2024-04-25T09:02:49.235138+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:11.020739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.213700+0000","last_change":"2024-04-25T09:02:49.213700+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.213700+0000","last_undegraded":"2024-04-25T09:02:49.213700+0000","last_fullsized":"2024-04-25T09:02:49.213700+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.239287+0000","last_change":"2024-04-25T09:02:49.235760+0000","last_active":"2024-04-25T09:02:49.239287+0000","last_peered":"2024-04-25T09:02:49.239287+0000","last_clean":"2024-04-25T09:02:49.239287+0000","last_became_active":"2024-04-25T09:02:49.235503+0000","last_became_peered":"2024-04-25T09:02:49.235503+0000","last_unstale":"2024-04-25T09:02:49.239287+0000","last_undegraded":"2024-04-25T09:02:49.239287+0000","last_fullsized":"2024-04-25T09:02:49.239287+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:38.302888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.221236+0000","last_change":"2024-04-25T09:02:49.221236+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.221236+0000","last_undegraded":"2024-04-25T09:02:49.221236+0000","last_fullsized":"2024-04-25T09:02:49.221236+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238127+0000","last_change":"2024-04-25T09:02:49.234792+0000","last_active":"2024-04-25T09:02:49.238127+0000","last_peered":"2024-04-25T09:02:49.238127+0000","last_clean":"2024-04-25T09:02:49.238127+0000","last_became_active":"2024-04-25T09:02:49.234481+0000","last_became_peered":"2024-04-25T09:02:49.234481+0000","last_unstale":"2024-04-25T09:02:49.238127+0000","last_undegraded":"2024-04-25T09:02:49.238127+0000","last_fullsized":"2024-04-25T09:02:49.238127+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:36:46.878761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.214188+0000","last_change":"2024-04-25T09:02:49.214188+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.214188+0000","last_undegraded":"2024-04-25T09:02:49.214188+0000","last_fullsized":"2024-04-25T09:02:49.214188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.237494+0000","last_change":"2024-04-25T09:02:49.229398+0000","last_active":"2024-04-25T09:02:49.237494+0000","last_peered":"2024-04-25T09:02:49.237494+0000","last_clean":"2024-04-25T09:02:49.237494+0000","last_became_active":"2024-04-25T09:02:49.229026+0000","last_became_peered":"2024-04-25T09:02:49.229026+0000","last_unstale":"2024-04-25T09:02:49.237494+0000","last_undegraded":"2024-04-25T09:02:49.237494+0000","last_fullsized":"2024-04-25T09:02:49.237494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:31.325674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.224827+0000","last_change":"2024-04-25T09:02:49.224827+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.224827+0000","last_undegraded":"2024-04-25T09:02:49.224827+0000","last_fullsized":"2024-04-25T09:02:49.224827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238080+0000","last_change":"2024-04-25T09:02:49.234652+0000","last_active":"2024-04-25T09:02:49.238080+0000","last_peered":"2024-04-25T09:02:49.238080+0000","last_clean":"2024-04-25T09:02:49.238080+0000","last_became_active":"2024-04-25T09:02:49.234331+0000","last_became_peered":"2024-04-25T09:02:49.234331+0000","last_unstale":"2024-04-25T09:02:49.238080+0000","last_undegraded":"2024-04-25T09:02:49.238080+0000","last_fullsized":"2024-04-25T09:02:49.238080+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:39.441161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223831+0000","last_change":"2024-04-25T09:02:49.223831+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223831+0000","last_undegraded":"2024-04-25T09:02:49.223831+0000","last_fullsized":"2024-04-25T09:02:49.223831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238084+0000","last_change":"2024-04-25T09:02:49.234855+0000","last_active":"2024-04-25T09:02:49.238084+0000","last_peered":"2024-04-25T09:02:49.238084+0000","last_clean":"2024-04-25T09:02:49.238084+0000","last_became_active":"2024-04-25T09:02:49.234276+0000","last_became_peered":"2024-04-25T09:02:49.234276+0000","last_unstale":"2024-04-25T09:02:49.238084+0000","last_undegraded":"2024-04-25T09:02:49.238084+0000","last_fullsized":"2024-04-25T09:02:49.238084+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:32.463422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.212562+0000","last_change":"2024-04-25T09:02:49.212562+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.212562+0000","last_undegraded":"2024-04-25T09:02:49.212562+0000","last_fullsized":"2024-04-25T09:02:49.212562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240003+0000","last_change":"2024-04-25T09:02:49.237611+0000","last_active":"2024-04-25T09:02:49.240003+0000","last_peered":"2024-04-25T09:02:49.240003+0000","last_clean":"2024-04-25T09:02:49.240003+0000","last_became_active":"2024-04-25T09:02:49.237238+0000","last_became_peered":"2024-04-25T09:02:49.237238+0000","last_unstale":"2024-04-25T09:02:49.240003+0000","last_undegraded":"2024-04-25T09:02:49.240003+0000","last_fullsized":"2024-04-25T09:02:49.240003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:11.835993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.220390+0000","last_change":"2024-04-25T09:02:49.220390+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.220390+0000","last_undegraded":"2024-04-25T09:02:49.220390+0000","last_fullsized":"2024-04-25T09:02:49.220390+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.232749+0000","last_change":"2024-04-25T09:02:49.228571+0000","last_active":"2024-04-25T09:02:49.232749+0000","last_peered":"2024-04-25T09:02:49.232749+0000","last_clean":"2024-04-25T09:02:49.232749+0000","last_became_active":"2024-04-25T09:02:49.228289+0000","last_became_peered":"2024-04-25T09:02:49.228289+0000","last_unstale":"2024-04-25T09:02:49.232749+0000","last_undegraded":"2024-04-25T09:02:49.232749+0000","last_fullsized":"2024-04-25T09:02:49.232749+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:42.456851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215473+0000","last_change":"2024-04-25T09:02:49.215473+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215473+0000","last_undegraded":"2024-04-25T09:02:49.215473+0000","last_fullsized":"2024-04-25T09:02:49.215473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.238377+0000","last_change":"2024-04-25T09:02:49.236567+0000","last_active":"2024-04-25T09:02:49.238377+0000","last_peered":"2024-04-25T09:02:49.238377+0000","last_clean":"2024-04-25T09:02:49.238377+0000","last_became_active":"2024-04-25T09:02:49.236293+0000","last_became_peered":"2024-04-25T09:02:49.236293+0000","last_unstale":"2024-04-25T09:02:49.238377+0000","last_undegraded":"2024-04-25T09:02:49.238377+0000","last_fullsized":"2024-04-25T09:02:49.238377+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:51.351917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.225563+0000","last_change":"2024-04-25T09:02:49.225563+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.225563+0000","last_undegraded":"2024-04-25T09:02:49.225563+0000","last_fullsized":"2024-04-25T09:02:49.225563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.230874+0000","last_change":"2024-04-25T09:02:49.222270+0000","last_active":"2024-04-25T09:02:49.230874+0000","last_peered":"2024-04-25T09:02:49.230874+0000","last_clean":"2024-04-25T09:02:49.230874+0000","last_became_active":"2024-04-25T09:02:49.221997+0000","last_became_peered":"2024-04-25T09:02:49.221997+0000","last_unstale":"2024-04-25T09:02:49.230874+0000","last_undegraded":"2024-04-25T09:02:49.230874+0000","last_fullsized":"2024-04-25T09:02:49.230874+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:24.686425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.216556+0000","last_change":"2024-04-25T09:02:49.216556+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.216556+0000","last_undegraded":"2024-04-25T09:02:49.216556+0000","last_fullsized":"2024-04-25T09:02:49.216556+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240086+0000","last_change":"2024-04-25T09:02:49.232993+0000","last_active":"2024-04-25T09:02:49.240086+0000","last_peered":"2024-04-25T09:02:49.240086+0000","last_clean":"2024-04-25T09:02:49.240086+0000","last_became_active":"2024-04-25T09:02:49.232717+0000","last_became_peered":"2024-04-25T09:02:49.232717+0000","last_unstale":"2024-04-25T09:02:49.240086+0000","last_undegraded":"2024-04-25T09:02:49.240086+0000","last_fullsized":"2024-04-25T09:02:49.240086+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:49.487103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223489+0000","last_change":"2024-04-25T09:02:49.223489+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223489+0000","last_undegraded":"2024-04-25T09:02:49.223489+0000","last_fullsized":"2024-04-25T09:02:49.223489+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.231306+0000","last_change":"2024-04-25T09:02:49.226736+0000","last_active":"2024-04-25T09:02:49.231306+0000","last_peered":"2024-04-25T09:02:49.231306+0000","last_clean":"2024-04-25T09:02:49.231306+0000","last_became_active":"2024-04-25T09:02:49.226454+0000","last_became_peered":"2024-04-25T09:02:49.226454+0000","last_unstale":"2024-04-25T09:02:49.231306+0000","last_undegraded":"2024-04-25T09:02:49.231306+0000","last_fullsized":"2024-04-25T09:02:49.231306+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:34.838771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215575+0000","last_change":"2024-04-25T09:02:49.215575+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215575+0000","last_undegraded":"2024-04-25T09:02:49.215575+0000","last_fullsized":"2024-04-25T09:02:49.215575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.234433+0000","last_change":"2024-04-25T09:02:49.229299+0000","last_active":"2024-04-25T09:02:49.234433+0000","last_peered":"2024-04-25T09:02:49.234433+0000","last_clean":"2024-04-25T09:02:49.234433+0000","last_became_active":"2024-04-25T09:02:49.228960+0000","last_became_peered":"2024-04-25T09:02:49.228960+0000","last_unstale":"2024-04-25T09:02:49.234433+0000","last_undegraded":"2024-04-25T09:02:49.234433+0000","last_fullsized":"2024-04-25T09:02:49.234433+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:57.434431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.223569+0000","last_change":"2024-04-25T09:02:49.223569+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.223569+0000","last_undegraded":"2024-04-25T09:02:49.223569+0000","last_fullsized":"2024-04-25T09:02:49.223569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.231662+0000","last_change":"2024-04-25T09:02:49.228645+0000","last_active":"2024-04-25T09:02:49.231662+0000","last_peered":"2024-04-25T09:02:49.231662+0000","last_clean":"2024-04-25T09:02:49.231662+0000","last_became_active":"2024-04-25T09:02:49.228210+0000","last_became_peered":"2024-04-25T09:02:49.228210+0000","last_unstale":"2024-04-25T09:02:49.231662+0000","last_undegraded":"2024-04-25T09:02:49.231662+0000","last_fullsized":"2024-04-25T09:02:49.231662+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:59.351527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.224426+0000","last_change":"2024-04-25T09:02:49.224426+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.224426+0000","last_undegraded":"2024-04-25T09:02:49.224426+0000","last_fullsized":"2024-04-25T09:02:49.224426+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.240031+0000","last_change":"2024-04-25T09:02:49.233077+0000","last_active":"2024-04-25T09:02:49.240031+0000","last_peered":"2024-04-25T09:02:49.240031+0000","last_clean":"2024-04-25T09:02:49.240031+0000","last_became_active":"2024-04-25T09:02:49.232847+0000","last_became_peered":"2024-04-25T09:02:49.232847+0000","last_unstale":"2024-04-25T09:02:49.240031+0000","last_undegraded":"2024-04-25T09:02:49.240031+0000","last_fullsized":"2024-04-25T09:02:49.240031+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:33.718367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-04-25T09:02:49.215392+0000","last_change":"2024-04-25T09:02:49.215392+0000","last_active":"2024-04-25T09:02:49.203836+0000","last_peered":"2024-04-25T09:02:49.203836+0000","last_clean":"2024-04-25T09:02:49.203836+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:02:49.215392+0000","last_undegraded":"2024-04-25T09:02:49.215392+0000","last_fullsized":"2024-04-25T09:02:49.215392+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.239988+0000","last_change":"2024-04-25T09:02:49.237540+0000","last_active":"2024-04-25T09:02:49.239988+0000","last_peered":"2024-04-25T09:02:49.239988+0000","last_clean":"2024-04-25T09:02:49.239988+0000","last_became_active":"2024-04-25T09:02:49.237260+0000","last_became_peered":"2024-04-25T09:02:49.237260+0000","last_unstale":"2024-04-25T09:02:49.239988+0000","last_undegraded":"2024-04-25T09:02:49.239988+0000","last_fullsized":"2024-04-25T09:02:49.239988+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:01.239512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-04-25T09:02:49.227348+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:02:49.227348+0000","last_peered":"2024-04-25T09:02:49.227348+0000","last_clean":"2024-04-25T09:02:49.227348+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:02:49.227348+0000","last_undegraded":"2024-04-25T09:02:49.227348+0000","last_fullsized":"2024-04-25T09:02:49.227348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1007616,"data_stored":765917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31596,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":425984,"data_stored":182216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31584,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340256,"statfs":{"total":96636764160,"available":96604422144,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":413696,"data_stored":175549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1007616,"data_stored":765917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:02:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2024-04-25T09:02:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.220189+0000', 'last_change': '2024-04-25T09:02:49.220189+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.220189+0000', 'last_undegraded': '2024-04-25T09:02:49.220189+0000', 'last_fullsized': '2024-04-25T09:02:49.220189+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2024-04-25T09:02:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.217156+0000', 'last_change': '2024-04-25T09:02:49.217156+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.217156+0000', 'last_undegraded': '2024-04-25T09:02:49.217156+0000', 'last_fullsized': '2024-04-25T09:02:49.217156+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2024-04-25T09:02:55.126 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.216620+0000', 'last_change': '2024-04-25T09:02:49.216620+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.216620+0000', 'last_undegraded': '2024-04-25T09:02:49.216620+0000', 'last_fullsized': '2024-04-25T09:02:49.216620+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:02:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2024-04-25T09:02:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.215100+0000', 'last_change': '2024-04-25T09:02:49.215100+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.215100+0000', 'last_undegraded': '2024-04-25T09:02:49.215100+0000', 'last_fullsized': '2024-04-25T09:02:49.215100+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2024-04-25T09:02:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.218269+0000', 'last_change': '2024-04-25T09:02:49.218269+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.218269+0000', 'last_undegraded': '2024-04-25T09:02:49.218269+0000', 'last_fullsized': '2024-04-25T09:02:49.218269+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3a is not active+clean 2024-04-25T09:02:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.216613+0000', 'last_change': '2024-04-25T09:02:49.216613+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.216613+0000', 'last_undegraded': '2024-04-25T09:02:49.216613+0000', 'last_fullsized': '2024-04-25T09:02:49.216613+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2024-04-25T09:02:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.214144+0000', 'last_change': '2024-04-25T09:02:49.214144+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.214144+0000', 'last_undegraded': '2024-04-25T09:02:49.214144+0000', 'last_fullsized': '2024-04-25T09:02:49.214144+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2024-04-25T09:02:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.216867+0000', 'last_change': '2024-04-25T09:02:49.216867+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.216867+0000', 'last_undegraded': '2024-04-25T09:02:49.216867+0000', 'last_fullsized': '2024-04-25T09:02:49.216867+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:55.127 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2024-04-25T09:02:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.216262+0000', 'last_change': '2024-04-25T09:02:49.216262+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.216262+0000', 'last_undegraded': '2024-04-25T09:02:49.216262+0000', 'last_fullsized': '2024-04-25T09:02:49.216262+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:02:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2024-04-25T09:02:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.217223+0000', 'last_change': '2024-04-25T09:02:49.217223+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.217223+0000', 'last_undegraded': '2024-04-25T09:02:49.217223+0000', 'last_fullsized': '2024-04-25T09:02:49.217223+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2024-04-25T09:02:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.214201+0000', 'last_change': '2024-04-25T09:02:49.214201+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.214201+0000', 'last_undegraded': '2024-04-25T09:02:49.214201+0000', 'last_fullsized': '2024-04-25T09:02:49.214201+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2024-04-25T09:02:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.222641+0000', 'last_change': '2024-04-25T09:02:49.222641+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.222641+0000', 'last_undegraded': '2024-04-25T09:02:49.222641+0000', 'last_fullsized': '2024-04-25T09:02:49.222641+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:02:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2024-04-25T09:02:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.213317+0000', 'last_change': '2024-04-25T09:02:49.213317+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.213317+0000', 'last_undegraded': '2024-04-25T09:02:49.213317+0000', 'last_fullsized': '2024-04-25T09:02:49.213317+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2024-04-25T09:02:55.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.223913+0000', 'last_change': '2024-04-25T09:02:49.223913+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.223913+0000', 'last_undegraded': '2024-04-25T09:02:49.223913+0000', 'last_fullsized': '2024-04-25T09:02:49.223913+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2024-04-25T09:02:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.213249+0000', 'last_change': '2024-04-25T09:02:49.213249+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.213249+0000', 'last_undegraded': '2024-04-25T09:02:49.213249+0000', 'last_fullsized': '2024-04-25T09:02:49.213249+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2024-04-25T09:02:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.225394+0000', 'last_change': '2024-04-25T09:02:49.225394+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.225394+0000', 'last_undegraded': '2024-04-25T09:02:49.225394+0000', 'last_fullsized': '2024-04-25T09:02:49.225394+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2024-04-25T09:02:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.225285+0000', 'last_change': '2024-04-25T09:02:49.225285+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.225285+0000', 'last_undegraded': '2024-04-25T09:02:49.225285+0000', 'last_fullsized': '2024-04-25T09:02:49.225285+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2024-04-25T09:02:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.213336+0000', 'last_change': '2024-04-25T09:02:49.213336+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.213336+0000', 'last_undegraded': '2024-04-25T09:02:49.213336+0000', 'last_fullsized': '2024-04-25T09:02:49.213336+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2024-04-25T09:02:55.129 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.214453+0000', 'last_change': '2024-04-25T09:02:49.214453+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.214453+0000', 'last_undegraded': '2024-04-25T09:02:49.214453+0000', 'last_fullsized': '2024-04-25T09:02:49.214453+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2024-04-25T09:02:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.215405+0000', 'last_change': '2024-04-25T09:02:49.215405+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.215405+0000', 'last_undegraded': '2024-04-25T09:02:49.215405+0000', 'last_fullsized': '2024-04-25T09:02:49.215405+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2024-04-25T09:02:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.212787+0000', 'last_change': '2024-04-25T09:02:49.212787+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.212787+0000', 'last_undegraded': '2024-04-25T09:02:49.212787+0000', 'last_fullsized': '2024-04-25T09:02:49.212787+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2024-04-25T09:02:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.223103+0000', 'last_change': '2024-04-25T09:02:49.223103+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.223103+0000', 'last_undegraded': '2024-04-25T09:02:49.223103+0000', 'last_fullsized': '2024-04-25T09:02:49.223103+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2024-04-25T09:02:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.223938+0000', 'last_change': '2024-04-25T09:02:49.223938+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.223938+0000', 'last_undegraded': '2024-04-25T09:02:49.223938+0000', 'last_fullsized': '2024-04-25T09:02:49.223938+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2024-04-25T09:02:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.214375+0000', 'last_change': '2024-04-25T09:02:49.214375+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.214375+0000', 'last_undegraded': '2024-04-25T09:02:49.214375+0000', 'last_fullsized': '2024-04-25T09:02:49.214375+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:55.130 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2024-04-25T09:02:55.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.213872+0000', 'last_change': '2024-04-25T09:02:49.213872+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.213872+0000', 'last_undegraded': '2024-04-25T09:02:49.213872+0000', 'last_fullsized': '2024-04-25T09:02:49.213872+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:55.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.26 is not active+clean 2024-04-25T09:02:55.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.215292+0000', 'last_change': '2024-04-25T09:02:49.215292+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.215292+0000', 'last_undegraded': '2024-04-25T09:02:49.215292+0000', 'last_fullsized': '2024-04-25T09:02:49.215292+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:55.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2024-04-25T09:02:55.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.213401+0000', 'last_change': '2024-04-25T09:02:49.213401+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.213401+0000', 'last_undegraded': '2024-04-25T09:02:49.213401+0000', 'last_fullsized': '2024-04-25T09:02:49.213401+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:55.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2024-04-25T09:02:55.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.213871+0000', 'last_change': '2024-04-25T09:02:49.213871+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.213871+0000', 'last_undegraded': '2024-04-25T09:02:49.213871+0000', 'last_fullsized': '2024-04-25T09:02:49.213871+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:55.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2024-04-25T09:02:55.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.214190+0000', 'last_change': '2024-04-25T09:02:49.214190+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.214190+0000', 'last_undegraded': '2024-04-25T09:02:49.214190+0000', 'last_fullsized': '2024-04-25T09:02:49.214190+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:55.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2024-04-25T09:02:55.131 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.213670+0000', 'last_change': '2024-04-25T09:02:49.213670+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.213670+0000', 'last_undegraded': '2024-04-25T09:02:49.213670+0000', 'last_fullsized': '2024-04-25T09:02:49.213670+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-04-25T09:02:55.131 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2024-04-25T09:02:55.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.223355+0000', 'last_change': '2024-04-25T09:02:49.223355+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.223355+0000', 'last_undegraded': '2024-04-25T09:02:49.223355+0000', 'last_fullsized': '2024-04-25T09:02:49.223355+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:55.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.20 is not active+clean 2024-04-25T09:02:55.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.215368+0000', 'last_change': '2024-04-25T09:02:49.215368+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.215368+0000', 'last_undegraded': '2024-04-25T09:02:49.215368+0000', 'last_fullsized': '2024-04-25T09:02:49.215368+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:55.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-04-25T09:02:55.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.226523+0000', 'last_change': '2024-04-25T09:02:49.226523+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.226523+0000', 'last_undegraded': '2024-04-25T09:02:49.226523+0000', 'last_fullsized': '2024-04-25T09:02:49.226523+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:55.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-04-25T09:02:55.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.215865+0000', 'last_change': '2024-04-25T09:02:49.215865+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.215865+0000', 'last_undegraded': '2024-04-25T09:02:49.215865+0000', 'last_fullsized': '2024-04-25T09:02:49.215865+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:55.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-04-25T09:02:55.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.220757+0000', 'last_change': '2024-04-25T09:02:49.220757+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.220757+0000', 'last_undegraded': '2024-04-25T09:02:49.220757+0000', 'last_fullsized': '2024-04-25T09:02:49.220757+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:55.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-04-25T09:02:55.132 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.220690+0000', 'last_change': '2024-04-25T09:02:49.220690+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.220690+0000', 'last_undegraded': '2024-04-25T09:02:49.220690+0000', 'last_fullsized': '2024-04-25T09:02:49.220690+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:55.132 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-04-25T09:02:55.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.226115+0000', 'last_change': '2024-04-25T09:02:49.226115+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.226115+0000', 'last_undegraded': '2024-04-25T09:02:49.226115+0000', 'last_fullsized': '2024-04-25T09:02:49.226115+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:02:55.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-04-25T09:02:55.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.212491+0000', 'last_change': '2024-04-25T09:02:49.212491+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.212491+0000', 'last_undegraded': '2024-04-25T09:02:49.212491+0000', 'last_fullsized': '2024-04-25T09:02:49.212491+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:55.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-04-25T09:02:55.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.220996+0000', 'last_change': '2024-04-25T09:02:49.220996+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.220996+0000', 'last_undegraded': '2024-04-25T09:02:49.220996+0000', 'last_fullsized': '2024-04-25T09:02:49.220996+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:55.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-04-25T09:02:55.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.222341+0000', 'last_change': '2024-04-25T09:02:49.222341+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.222341+0000', 'last_undegraded': '2024-04-25T09:02:49.222341+0000', 'last_fullsized': '2024-04-25T09:02:49.222341+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:55.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-04-25T09:02:55.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.214213+0000', 'last_change': '2024-04-25T09:02:49.214213+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.214213+0000', 'last_undegraded': '2024-04-25T09:02:49.214213+0000', 'last_fullsized': '2024-04-25T09:02:49.214213+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:55.133 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-04-25T09:02:55.133 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.226032+0000', 'last_change': '2024-04-25T09:02:49.226032+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.226032+0000', 'last_undegraded': '2024-04-25T09:02:49.226032+0000', 'last_fullsized': '2024-04-25T09:02:49.226032+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:55.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-04-25T09:02:55.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.217021+0000', 'last_change': '2024-04-25T09:02:49.217021+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.217021+0000', 'last_undegraded': '2024-04-25T09:02:49.217021+0000', 'last_fullsized': '2024-04-25T09:02:49.217021+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:02:55.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-04-25T09:02:55.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.222767+0000', 'last_change': '2024-04-25T09:02:49.222767+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.222767+0000', 'last_undegraded': '2024-04-25T09:02:49.222767+0000', 'last_fullsized': '2024-04-25T09:02:49.222767+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:55.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-04-25T09:02:55.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.225471+0000', 'last_change': '2024-04-25T09:02:49.225471+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.225471+0000', 'last_undegraded': '2024-04-25T09:02:49.225471+0000', 'last_fullsized': '2024-04-25T09:02:49.225471+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:02:55.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-04-25T09:02:55.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.217224+0000', 'last_change': '2024-04-25T09:02:49.217224+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.217224+0000', 'last_undegraded': '2024-04-25T09:02:49.217224+0000', 'last_fullsized': '2024-04-25T09:02:49.217224+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:55.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-04-25T09:02:55.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.224342+0000', 'last_change': '2024-04-25T09:02:49.224342+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.224342+0000', 'last_undegraded': '2024-04-25T09:02:49.224342+0000', 'last_fullsized': '2024-04-25T09:02:49.224342+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:55.134 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-04-25T09:02:55.134 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.221987+0000', 'last_change': '2024-04-25T09:02:49.221987+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.221987+0000', 'last_undegraded': '2024-04-25T09:02:49.221987+0000', 'last_fullsized': '2024-04-25T09:02:49.221987+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:55.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-04-25T09:02:55.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.218027+0000', 'last_change': '2024-04-25T09:02:49.218027+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.218027+0000', 'last_undegraded': '2024-04-25T09:02:49.218027+0000', 'last_fullsized': '2024-04-25T09:02:49.218027+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:55.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-04-25T09:02:55.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.213700+0000', 'last_change': '2024-04-25T09:02:49.213700+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.213700+0000', 'last_undegraded': '2024-04-25T09:02:49.213700+0000', 'last_fullsized': '2024-04-25T09:02:49.213700+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:55.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-04-25T09:02:55.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.221236+0000', 'last_change': '2024-04-25T09:02:49.221236+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.221236+0000', 'last_undegraded': '2024-04-25T09:02:49.221236+0000', 'last_fullsized': '2024-04-25T09:02:49.221236+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:55.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-04-25T09:02:55.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.214188+0000', 'last_change': '2024-04-25T09:02:49.214188+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.214188+0000', 'last_undegraded': '2024-04-25T09:02:49.214188+0000', 'last_fullsized': '2024-04-25T09:02:49.214188+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-25T09:02:55.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-04-25T09:02:55.135 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.224827+0000', 'last_change': '2024-04-25T09:02:49.224827+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.224827+0000', 'last_undegraded': '2024-04-25T09:02:49.224827+0000', 'last_fullsized': '2024-04-25T09:02:49.224827+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:55.135 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-04-25T09:02:55.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.223831+0000', 'last_change': '2024-04-25T09:02:49.223831+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.223831+0000', 'last_undegraded': '2024-04-25T09:02:49.223831+0000', 'last_fullsized': '2024-04-25T09:02:49.223831+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:02:55.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-04-25T09:02:55.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.212562+0000', 'last_change': '2024-04-25T09:02:49.212562+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.212562+0000', 'last_undegraded': '2024-04-25T09:02:49.212562+0000', 'last_fullsized': '2024-04-25T09:02:49.212562+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:55.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-04-25T09:02:55.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.220390+0000', 'last_change': '2024-04-25T09:02:49.220390+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.220390+0000', 'last_undegraded': '2024-04-25T09:02:49.220390+0000', 'last_fullsized': '2024-04-25T09:02:49.220390+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:55.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-04-25T09:02:55.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.215473+0000', 'last_change': '2024-04-25T09:02:49.215473+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.215473+0000', 'last_undegraded': '2024-04-25T09:02:49.215473+0000', 'last_fullsized': '2024-04-25T09:02:49.215473+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:55.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-04-25T09:02:55.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.225563+0000', 'last_change': '2024-04-25T09:02:49.225563+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.225563+0000', 'last_undegraded': '2024-04-25T09:02:49.225563+0000', 'last_fullsized': '2024-04-25T09:02:49.225563+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:55.136 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-04-25T09:02:55.136 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.216556+0000', 'last_change': '2024-04-25T09:02:49.216556+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.216556+0000', 'last_undegraded': '2024-04-25T09:02:49.216556+0000', 'last_fullsized': '2024-04-25T09:02:49.216556+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-25T09:02:55.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-04-25T09:02:55.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.223489+0000', 'last_change': '2024-04-25T09:02:49.223489+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.223489+0000', 'last_undegraded': '2024-04-25T09:02:49.223489+0000', 'last_fullsized': '2024-04-25T09:02:49.223489+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-25T09:02:55.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-04-25T09:02:55.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.215575+0000', 'last_change': '2024-04-25T09:02:49.215575+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.215575+0000', 'last_undegraded': '2024-04-25T09:02:49.215575+0000', 'last_fullsized': '2024-04-25T09:02:49.215575+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-25T09:02:55.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-04-25T09:02:55.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.223569+0000', 'last_change': '2024-04-25T09:02:49.223569+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.223569+0000', 'last_undegraded': '2024-04-25T09:02:49.223569+0000', 'last_fullsized': '2024-04-25T09:02:49.223569+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-25T09:02:55.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-04-25T09:02:55.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.224426+0000', 'last_change': '2024-04-25T09:02:49.224426+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.224426+0000', 'last_undegraded': '2024-04-25T09:02:49.224426+0000', 'last_fullsized': '2024-04-25T09:02:49.224426+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-25T09:02:55.137 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-04-25T09:02:55.137 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-04-25T09:02:49.215392+0000', 'last_change': '2024-04-25T09:02:49.215392+0000', 'last_active': '2024-04-25T09:02:49.203836+0000', 'last_peered': '2024-04-25T09:02:49.203836+0000', 'last_clean': '2024-04-25T09:02:49.203836+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-25T09:02:49.215392+0000', 'last_undegraded': '2024-04-25T09:02:49.215392+0000', 'last_fullsized': '2024-04-25T09:02:49.215392+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'last_clean_scrub_stamp': '2024-04-25T09:02:49.203836+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-25T09:02:55.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-25T09:02:55.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1ade600640 1 Processor -- start 2024-04-25T09:02:55.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1ade600640 1 -- start start 2024-04-25T09:02:55.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1ade600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ad8072c70 0x7f1ad80cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1ade600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1ad80cd540 0x7f1ad806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1ade600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad815c430 con 0x7f1ad815b860 2024-04-25T09:02:55.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1ade600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad815f4e0 con 0x7f1ad8072c70 2024-04-25T09:02:55.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1ade600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ad815c710 con 0x7f1ad80cd540 2024-04-25T09:02:55.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1acea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ad8072c70 0x7f1ad80cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1ad7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1ad815b860 0x7f1ad815bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60068/0 (socket says 172.21.15.59:60068) 2024-04-25T09:02:55.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1ad7400640 1 -- 172.21.15.59:0/2102420038 learned_addr learned my addr 172.21.15.59:0/2102420038 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:55.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1acea00640 1 -- 172.21.15.59:0/2102420038 >> v2:172.21.15.178:3300/0 conn(0x7f1ad80cd540 msgr2=0x7f1ad806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:55.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1acea00640 1 --2- 172.21.15.59:0/2102420038 >> v2:172.21.15.178:3300/0 conn(0x7f1ad80cd540 0x7f1ad806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1acea00640 1 -- 172.21.15.59:0/2102420038 >> v1:172.21.15.59:6789/0 conn(0x7f1ad815b860 legacy=0x7f1ad815bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.315+0000 7f1acea00640 1 -- 172.21.15.59:0/2102420038 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad815c9f0 con 0x7f1ad8072c70 2024-04-25T09:02:55.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.319+0000 7f1acea00640 1 --2- 172.21.15.59:0/2102420038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad8072c70 0x7f1ad80cd000 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80cd920 tx=0x7f1ac001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e740bed9fa64785c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:55.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.319+0000 7f1ad6a00640 1 -- 172.21.15.59:0/2102420038 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00b2070 con 0x7f1ad8072c70 2024-04-25T09:02:55.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.319+0000 7f1ad6a00640 1 -- 172.21.15.59:0/2102420038 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac00a5880 con 0x7f1ad8072c70 2024-04-25T09:02:55.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.319+0000 7f1ad6a00640 1 -- 172.21.15.59:0/2102420038 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00a5c50 con 0x7f1ad8072c70 2024-04-25T09:02:55.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.319+0000 7f1ade600640 1 -- 172.21.15.59:0/2102420038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad8072c70 msgr2=0x7f1ad80cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.319+0000 7f1ade600640 1 --2- 172.21.15.59:0/2102420038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad8072c70 0x7f1ad80cd000 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1ad80cd920 tx=0x7f1ac001c930 comp rx=0 tx=0).stop 2024-04-25T09:02:55.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.319+0000 7f1ade600640 1 -- 172.21.15.59:0/2102420038 shutdown_connections 2024-04-25T09:02:55.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.319+0000 7f1ade600640 1 --2- 172.21.15.59:0/2102420038 >> v2:172.21.15.178:3300/0 conn(0x7f1ad80cd540 0x7f1ad806ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.319+0000 7f1ade600640 1 --2- 172.21.15.59:0/2102420038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad8072c70 0x7f1ad80cd000 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.319+0000 7f1ade600640 1 -- 172.21.15.59:0/2102420038 >> 172.21.15.59:0/2102420038 conn(0x7f1ad80b2400 msgr2=0x7f1ad80b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:55.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.319+0000 7f1ade600640 1 -- 172.21.15.59:0/2102420038 shutdown_connections 2024-04-25T09:02:55.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.319+0000 7f1ade600640 1 -- 172.21.15.59:0/2102420038 wait complete. 2024-04-25T09:02:55.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ade600640 1 Processor -- start 2024-04-25T09:02:55.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ade600640 1 -- start start 2024-04-25T09:02:55.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ade600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad8072c70 0x7f1ad8143210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ade600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ad80cd540 0x7f1ad80b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ade600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ad815b860 0x7f1ad80b13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ade600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8168ae0 con 0x7f1ad8072c70 2024-04-25T09:02:55.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ade600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8168960 con 0x7f1ad815b860 2024-04-25T09:02:55.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ade600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad8168c60 con 0x7f1ad80cd540 2024-04-25T09:02:55.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ad7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad8072c70 0x7f1ad8143210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ad7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad8072c70 0x7f1ad8143210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37352/0 (socket says 172.21.15.59:37352) 2024-04-25T09:02:55.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ad7400640 1 -- 172.21.15.59:0/1435919392 learned_addr learned my addr 172.21.15.59:0/1435919392 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:55.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ad7e00640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ad815b860 0x7f1ad80b13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1acea00640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ad80cd540 0x7f1ad80b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ad7400640 1 -- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ad80cd540 msgr2=0x7f1ad80b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ad7400640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ad80cd540 0x7f1ad80b3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ad7400640 1 -- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ad815b860 msgr2=0x7f1ad80b13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ad7400640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ad815b860 0x7f1ad80b13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ad7400640 1 -- 172.21.15.59:0/1435919392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad8150760 con 0x7f1ad8072c70 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ad7e00640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ad815b860 0x7f1ad80b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1acea00640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ad80cd540 0x7f1ad80b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ad7400640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad8072c70 0x7f1ad8143210 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800c3a0 tx=0x7f1ac800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1acfe00640 1 -- 172.21.15.59:0/1435919392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8017070 con 0x7f1ad8072c70 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1acfe00640 1 -- 172.21.15.59:0/1435919392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac8005cf0 con 0x7f1ad8072c70 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ade600640 1 -- 172.21.15.59:0/1435919392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad81518a0 con 0x7f1ad8072c70 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1acfe00640 1 -- 172.21.15.59:0/1435919392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac80072f0 con 0x7f1ad8072c70 2024-04-25T09:02:55.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ade600640 1 -- 172.21.15.59:0/1435919392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad8151e60 con 0x7f1ad8072c70 2024-04-25T09:02:55.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.323+0000 7f1ade600640 1 -- 172.21.15.59:0/1435919392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad80745d0 con 0x7f1ad8072c70 2024-04-25T09:02:55.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.327+0000 7f1acfe00640 1 -- 172.21.15.59:0/1435919392 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1ac801a070 con 0x7f1ad8072c70 2024-04-25T09:02:55.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.327+0000 7f1acfe00640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ab4066f60 0x7f1ab4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.327+0000 7f1acfe00640 1 -- 172.21.15.59:0/1435919392 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1ac80844d0 con 0x7f1ad8072c70 2024-04-25T09:02:55.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.327+0000 7f1acea00640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ab4066f60 0x7f1ab4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.327+0000 7f1acea00640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ab4066f60 0x7f1ab4069420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00af000 tx=0x7f1ac00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:55.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.331+0000 7f1acfe00640 1 -- 172.21.15.59:0/1435919392 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1ac80553e0 con 0x7f1ad8072c70 2024-04-25T09:02:55.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.551+0000 7f1ade600640 1 -- 172.21.15.59:0/1435919392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1ad80d1140 con 0x7f1ad8072c70 2024-04-25T09:02:55.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.551+0000 7f1acfe00640 1 -- 172.21.15.59:0/1435919392 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1034 (secure 0 0 0) 0x7f1ac8054ce0 con 0x7f1ad8072c70 2024-04-25T09:02:55.543 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:55.543 INFO:teuthology.orchestra.run.smithi059.stdout:{"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":113,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1714035674,"num_in_osds":8,"osd_in_since":1714035665,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":242896896,"bytes_avail":772851216384,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":19,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5289}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-04-25T09:02:31.664646+0000","services":{}},"progress_events":{}} 2024-04-25T09:02:55.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.555+0000 7f1ade600640 1 -- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ab4066f60 msgr2=0x7f1ab4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.555+0000 7f1ade600640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ab4066f60 0x7f1ab4069420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00af000 tx=0x7f1ac00a7070 comp rx=0 tx=0).stop 2024-04-25T09:02:55.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.555+0000 7f1ade600640 1 -- 172.21.15.59:0/1435919392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad8072c70 msgr2=0x7f1ad8143210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.555+0000 7f1ade600640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad8072c70 0x7f1ad8143210 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800c3a0 tx=0x7f1ac800c860 comp rx=0 tx=0).stop 2024-04-25T09:02:55.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.555+0000 7f1ade600640 1 -- 172.21.15.59:0/1435919392 shutdown_connections 2024-04-25T09:02:55.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.555+0000 7f1ade600640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ab4066f60 0x7f1ab4069420 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.555+0000 7f1ade600640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1ad815b860 0x7f1ad80b13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.555+0000 7f1ade600640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1ad80cd540 0x7f1ad80b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.555+0000 7f1ade600640 1 --2- 172.21.15.59:0/1435919392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ad8072c70 0x7f1ad8143210 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.555+0000 7f1ade600640 1 -- 172.21.15.59:0/1435919392 >> 172.21.15.59:0/1435919392 conn(0x7f1ad80b2400 msgr2=0x7f1ad80cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.555+0000 7f1ade600640 1 -- 172.21.15.59:0/1435919392 shutdown_connections 2024-04-25T09:02:55.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.555+0000 7f1ade600640 1 -- 172.21.15.59:0/1435919392 wait complete. 2024-04-25T09:02:55.564 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-25T09:02:55.564 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:02:55.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1ff400640 1 Processor -- start 2024-04-25T09:02:55.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1ff400640 1 -- start start 2024-04-25T09:02:55.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1ff400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1f806ac10 0x7ff1f806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1ff400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f80cd4e0 con 0x7ff1f80af670 2024-04-25T09:02:55.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1ff400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f80cd7a0 con 0x7ff1f806fb20 2024-04-25T09:02:55.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1ff400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f80cda80 con 0x7ff1f806ac10 2024-04-25T09:02:55.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1efe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1f806ac10 0x7ff1f806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1fca00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff1f80af670 0x7ff1f80afa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60070/0 (socket says 172.21.15.59:60070) 2024-04-25T09:02:55.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1fca00640 1 -- 172.21.15.59:0/3684462308 learned_addr learned my addr 172.21.15.59:0/3684462308 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:55.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1efe00640 1 -- 172.21.15.59:0/3684462308 >> v1:172.21.15.178:6789/0 conn(0x7ff1f806fb20 legacy=0x7ff1f806ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1efe00640 1 -- 172.21.15.59:0/3684462308 >> v1:172.21.15.59:6789/0 conn(0x7ff1f80af670 legacy=0x7ff1f80afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1efe00640 1 -- 172.21.15.59:0/3684462308 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f80cdd60 con 0x7ff1f806ac10 2024-04-25T09:02:55.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.715+0000 7ff1f7e00640 1 -- 172.21.15.59:0/3684462308 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192557689 0 0) 0x7ff1f80cd4e0 con 0x7ff1f80af670 2024-04-25T09:02:55.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.719+0000 7ff1efe00640 1 --2- 172.21.15.59:0/3684462308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1f806ac10 0x7ff1f806b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00097c0 tx=0x7ff1e001c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99167758bff6b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:55.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.719+0000 7ff1f7e00640 1 -- 172.21.15.59:0/3684462308 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00a8680 con 0x7ff1f806ac10 2024-04-25T09:02:55.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.719+0000 7ff1f7e00640 1 -- 172.21.15.59:0/3684462308 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e00a8820 con 0x7ff1f806ac10 2024-04-25T09:02:55.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.719+0000 7ff1f7e00640 1 -- 172.21.15.59:0/3684462308 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00a8bf0 con 0x7ff1f806ac10 2024-04-25T09:02:55.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.719+0000 7ff1ff400640 1 -- 172.21.15.59:0/3684462308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1f806ac10 msgr2=0x7ff1f806b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.719+0000 7ff1ff400640 1 --2- 172.21.15.59:0/3684462308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1f806ac10 0x7ff1f806b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ff1e00097c0 tx=0x7ff1e001c060 comp rx=0 tx=0).stop 2024-04-25T09:02:55.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.719+0000 7ff1ff400640 1 -- 172.21.15.59:0/3684462308 shutdown_connections 2024-04-25T09:02:55.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.719+0000 7ff1ff400640 1 --2- 172.21.15.59:0/3684462308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1f806ac10 0x7ff1f806b0a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.719+0000 7ff1ff400640 1 -- 172.21.15.59:0/3684462308 >> 172.21.15.59:0/3684462308 conn(0x7ff1f80b2400 msgr2=0x7ff1f80b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:55.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.719+0000 7ff1ff400640 1 -- 172.21.15.59:0/3684462308 shutdown_connections 2024-04-25T09:02:55.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.719+0000 7ff1ff400640 1 -- 172.21.15.59:0/3684462308 wait complete. 2024-04-25T09:02:55.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1ff400640 1 Processor -- start 2024-04-25T09:02:55.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1ff400640 1 -- start start 2024-04-25T09:02:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1ff400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f806ac10 0x7ff1f8153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1ff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1f806fb20 0x7ff1f815df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1ff400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f80af670 0x7ff1f81394d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1ff400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f816a1c0 con 0x7ff1f806fb20 2024-04-25T09:02:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1ff400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f8070c60 con 0x7ff1f806ac10 2024-04-25T09:02:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1ff400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f816a340 con 0x7ff1f80af670 2024-04-25T09:02:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1f806fb20 0x7ff1f815df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1f806fb20 0x7ff1f815df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37372/0 (socket says 172.21.15.59:37372) 2024-04-25T09:02:55.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1efe00640 1 -- 172.21.15.59:0/38044656 learned_addr learned my addr 172.21.15.59:0/38044656 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1fca00640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f806ac10 0x7ff1f8153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1fd400640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f80af670 0x7ff1f81394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1efe00640 1 -- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f80af670 msgr2=0x7ff1f81394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1efe00640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f80af670 0x7ff1f81394d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1efe00640 1 -- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f806ac10 msgr2=0x7ff1f8153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1efe00640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f806ac10 0x7ff1f8153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1efe00640 1 -- 172.21.15.59:0/38044656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f815e6c0 con 0x7ff1f806fb20 2024-04-25T09:02:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1fca00640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f806ac10 0x7ff1f8153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1fd400640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f80af670 0x7ff1f81394d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:55.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1efe00640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1f806fb20 0x7ff1f815df30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0019ea0 tx=0x7ff1e00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1f5600640 1 -- 172.21.15.59:0/38044656 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00bd070 con 0x7ff1f806fb20 2024-04-25T09:02:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1f5600640 1 -- 172.21.15.59:0/38044656 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e0004230 con 0x7ff1f806fb20 2024-04-25T09:02:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1ff400640 1 -- 172.21.15.59:0/38044656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f815e9a0 con 0x7ff1f806fb20 2024-04-25T09:02:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1f5600640 1 -- 172.21.15.59:0/38044656 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0003620 con 0x7ff1f806fb20 2024-04-25T09:02:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.723+0000 7ff1ff400640 1 -- 172.21.15.59:0/38044656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f8150e60 con 0x7ff1f806fb20 2024-04-25T09:02:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.727+0000 7ff1ff400640 1 -- 172.21.15.59:0/38044656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f80745d0 con 0x7ff1f806fb20 2024-04-25T09:02:55.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.727+0000 7ff1f5600640 1 -- 172.21.15.59:0/38044656 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff1e00c0070 con 0x7ff1f806fb20 2024-04-25T09:02:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.727+0000 7ff1f5600640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1d4066f60 0x7ff1d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.727+0000 7ff1f5600640 1 -- 172.21.15.59:0/38044656 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff1e011e810 con 0x7ff1f806fb20 2024-04-25T09:02:55.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.727+0000 7ff1fca00640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1d4066f60 0x7ff1d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:55.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.727+0000 7ff1fca00640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1d4066f60 0x7ff1d4069420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8000f70 tx=0x7ff1e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:55.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.731+0000 7ff1f5600640 1 -- 172.21.15.59:0/38044656 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff1e00ac020 con 0x7ff1f806fb20 2024-04-25T09:02:55.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.891+0000 7ff1ff400640 1 -- 172.21.15.59:0/38044656 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1f815e470 con 0x7ff1d4066f60 2024-04-25T09:02:55.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.899+0000 7ff1f5600640 1 -- 172.21.15.59:0/38044656 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251959 (secure 0 0 0) 0x7ff1f815e470 con 0x7ff1d4066f60 2024-04-25T09:02:55.892 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:55.893 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:02:55.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.903+0000 7ff1ff400640 1 -- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1d4066f60 msgr2=0x7ff1d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.903+0000 7ff1ff400640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1d4066f60 0x7ff1d4069420 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff1e8000f70 tx=0x7ff1e8009040 comp rx=0 tx=0).stop 2024-04-25T09:02:55.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.903+0000 7ff1ff400640 1 -- 172.21.15.59:0/38044656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1f806fb20 msgr2=0x7ff1f815df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.903+0000 7ff1ff400640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1f806fb20 0x7ff1f815df30 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff1e0019ea0 tx=0x7ff1e00046d0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.903+0000 7ff1ff400640 1 -- 172.21.15.59:0/38044656 shutdown_connections 2024-04-25T09:02:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.903+0000 7ff1ff400640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1d4066f60 0x7ff1d4069420 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.903+0000 7ff1ff400640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff1f80af670 0x7ff1f81394d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.903+0000 7ff1ff400640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1f806fb20 0x7ff1f815df30 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.903+0000 7ff1ff400640 1 --2- 172.21.15.59:0/38044656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff1f806ac10 0x7ff1f8153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.903+0000 7ff1ff400640 1 -- 172.21.15.59:0/38044656 >> 172.21.15.59:0/38044656 conn(0x7ff1f80b2400 msgr2=0x7ff1f80b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.903+0000 7ff1ff400640 1 -- 172.21.15.59:0/38044656 shutdown_connections 2024-04-25T09:02:55.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:55.903+0000 7ff1ff400640 1 -- 172.21.15.59:0/38044656 wait complete. 2024-04-25T09:02:55.912 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-04-25T09:02:55.670112+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237604,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737116,"statfs":{"total":773094113280,"available":772850806784,"internally_reserved":0,"allocated":4857856,"data_stored":2754156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.460849"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235513+0000","last_change":"2024-04-25T09:02:50.247526+0000","last_active":"2024-04-25T09:02:51.235513+0000","last_peered":"2024-04-25T09:02:51.235513+0000","last_clean":"2024-04-25T09:02:51.235513+0000","last_became_active":"2024-04-25T09:02:50.247177+0000","last_became_peered":"2024-04-25T09:02:50.247177+0000","last_unstale":"2024-04-25T09:02:51.235513+0000","last_undegraded":"2024-04-25T09:02:51.235513+0000","last_fullsized":"2024-04-25T09:02:51.235513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:53.371096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235353+0000","last_change":"2024-04-25T09:02:50.236782+0000","last_active":"2024-04-25T09:02:51.235353+0000","last_peered":"2024-04-25T09:02:51.235353+0000","last_clean":"2024-04-25T09:02:51.235353+0000","last_became_active":"2024-04-25T09:02:50.236498+0000","last_became_peered":"2024-04-25T09:02:50.236498+0000","last_unstale":"2024-04-25T09:02:51.235353+0000","last_undegraded":"2024-04-25T09:02:51.235353+0000","last_fullsized":"2024-04-25T09:02:51.235353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:40.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315670+0000","last_change":"2024-04-25T09:02:50.258294+0000","last_active":"2024-04-25T09:02:51.315670+0000","last_peered":"2024-04-25T09:02:51.315670+0000","last_clean":"2024-04-25T09:02:51.315670+0000","last_became_active":"2024-04-25T09:02:50.258069+0000","last_became_peered":"2024-04-25T09:02:50.258069+0000","last_unstale":"2024-04-25T09:02:51.315670+0000","last_undegraded":"2024-04-25T09:02:51.315670+0000","last_fullsized":"2024-04-25T09:02:51.315670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:47.424704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.242022+0000","last_change":"2024-04-25T09:02:50.241607+0000","last_active":"2024-04-25T09:02:51.242022+0000","last_peered":"2024-04-25T09:02:51.242022+0000","last_clean":"2024-04-25T09:02:51.242022+0000","last_became_active":"2024-04-25T09:02:50.234815+0000","last_became_peered":"2024-04-25T09:02:50.234815+0000","last_unstale":"2024-04-25T09:02:51.242022+0000","last_undegraded":"2024-04-25T09:02:51.242022+0000","last_fullsized":"2024-04-25T09:02:51.242022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:35.845853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.241885+0000","last_change":"2024-04-25T09:02:50.235190+0000","last_active":"2024-04-25T09:02:51.241885+0000","last_peered":"2024-04-25T09:02:51.241885+0000","last_clean":"2024-04-25T09:02:51.241885+0000","last_became_active":"2024-04-25T09:02:50.234867+0000","last_became_peered":"2024-04-25T09:02:50.234867+0000","last_unstale":"2024-04-25T09:02:51.241885+0000","last_undegraded":"2024-04-25T09:02:51.241885+0000","last_fullsized":"2024-04-25T09:02:51.241885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:37.536427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315003+0000","last_change":"2024-04-25T09:02:50.251982+0000","last_active":"2024-04-25T09:02:51.315003+0000","last_peered":"2024-04-25T09:02:51.315003+0000","last_clean":"2024-04-25T09:02:51.315003+0000","last_became_active":"2024-04-25T09:02:50.251662+0000","last_became_peered":"2024-04-25T09:02:50.251662+0000","last_unstale":"2024-04-25T09:02:51.315003+0000","last_undegraded":"2024-04-25T09:02:51.315003+0000","last_fullsized":"2024-04-25T09:02:51.315003+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:40.755865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235603+0000","last_change":"2024-04-25T09:02:50.237500+0000","last_active":"2024-04-25T09:02:51.235603+0000","last_peered":"2024-04-25T09:02:51.235603+0000","last_clean":"2024-04-25T09:02:51.235603+0000","last_became_active":"2024-04-25T09:02:50.237209+0000","last_became_peered":"2024-04-25T09:02:50.237209+0000","last_unstale":"2024-04-25T09:02:51.235603+0000","last_undegraded":"2024-04-25T09:02:51.235603+0000","last_fullsized":"2024-04-25T09:02:51.235603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:29.959421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.234681+0000","last_change":"2024-04-25T09:02:50.247875+0000","last_active":"2024-04-25T09:02:51.234681+0000","last_peered":"2024-04-25T09:02:51.234681+0000","last_clean":"2024-04-25T09:02:51.234681+0000","last_became_active":"2024-04-25T09:02:50.247602+0000","last_became_peered":"2024-04-25T09:02:50.247602+0000","last_unstale":"2024-04-25T09:02:51.234681+0000","last_undegraded":"2024-04-25T09:02:51.234681+0000","last_fullsized":"2024-04-25T09:02:51.234681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:48.931852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315959+0000","last_change":"2024-04-25T09:02:50.242566+0000","last_active":"2024-04-25T09:02:51.315959+0000","last_peered":"2024-04-25T09:02:51.315959+0000","last_clean":"2024-04-25T09:02:51.315959+0000","last_became_active":"2024-04-25T09:02:50.242233+0000","last_became_peered":"2024-04-25T09:02:50.242233+0000","last_unstale":"2024-04-25T09:02:51.315959+0000","last_undegraded":"2024-04-25T09:02:51.315959+0000","last_fullsized":"2024-04-25T09:02:51.315959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.436435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236363+0000","last_change":"2024-04-25T09:02:50.249373+0000","last_active":"2024-04-25T09:02:51.236363+0000","last_peered":"2024-04-25T09:02:51.236363+0000","last_clean":"2024-04-25T09:02:51.236363+0000","last_became_active":"2024-04-25T09:02:50.249163+0000","last_became_peered":"2024-04-25T09:02:50.249163+0000","last_unstale":"2024-04-25T09:02:51.236363+0000","last_undegraded":"2024-04-25T09:02:51.236363+0000","last_fullsized":"2024-04-25T09:02:51.236363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:40.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236373+0000","last_change":"2024-04-25T09:02:50.231362+0000","last_active":"2024-04-25T09:02:51.236373+0000","last_peered":"2024-04-25T09:02:51.236373+0000","last_clean":"2024-04-25T09:02:51.236373+0000","last_became_active":"2024-04-25T09:02:50.231100+0000","last_became_peered":"2024-04-25T09:02:50.231100+0000","last_unstale":"2024-04-25T09:02:51.236373+0000","last_undegraded":"2024-04-25T09:02:51.236373+0000","last_fullsized":"2024-04-25T09:02:51.236373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:58.168185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315493+0000","last_change":"2024-04-25T09:02:50.256297+0000","last_active":"2024-04-25T09:02:51.315493+0000","last_peered":"2024-04-25T09:02:51.315493+0000","last_clean":"2024-04-25T09:02:51.315493+0000","last_became_active":"2024-04-25T09:02:50.256008+0000","last_became_peered":"2024-04-25T09:02:50.256008+0000","last_unstale":"2024-04-25T09:02:51.315493+0000","last_undegraded":"2024-04-25T09:02:51.315493+0000","last_fullsized":"2024-04-25T09:02:51.315493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:51.139755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235877+0000","last_change":"2024-04-25T09:02:50.259534+0000","last_active":"2024-04-25T09:02:51.235877+0000","last_peered":"2024-04-25T09:02:51.235877+0000","last_clean":"2024-04-25T09:02:51.235877+0000","last_became_active":"2024-04-25T09:02:50.259234+0000","last_became_peered":"2024-04-25T09:02:50.259234+0000","last_unstale":"2024-04-25T09:02:51.235877+0000","last_undegraded":"2024-04-25T09:02:51.235877+0000","last_fullsized":"2024-04-25T09:02:51.235877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:39.197119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236937+0000","last_change":"2024-04-25T09:02:50.244396+0000","last_active":"2024-04-25T09:02:51.236937+0000","last_peered":"2024-04-25T09:02:51.236937+0000","last_clean":"2024-04-25T09:02:51.236937+0000","last_became_active":"2024-04-25T09:02:50.244142+0000","last_became_peered":"2024-04-25T09:02:50.244142+0000","last_unstale":"2024-04-25T09:02:51.236937+0000","last_undegraded":"2024-04-25T09:02:51.236937+0000","last_fullsized":"2024-04-25T09:02:51.236937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:10.397533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235638+0000","last_change":"2024-04-25T09:02:50.237385+0000","last_active":"2024-04-25T09:02:51.235638+0000","last_peered":"2024-04-25T09:02:51.235638+0000","last_clean":"2024-04-25T09:02:51.235638+0000","last_became_active":"2024-04-25T09:02:50.236873+0000","last_became_peered":"2024-04-25T09:02:50.236873+0000","last_unstale":"2024-04-25T09:02:51.235638+0000","last_undegraded":"2024-04-25T09:02:51.235638+0000","last_fullsized":"2024-04-25T09:02:51.235638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:22.294075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316537+0000","last_change":"2024-04-25T09:02:50.256558+0000","last_active":"2024-04-25T09:02:51.316537+0000","last_peered":"2024-04-25T09:02:51.316537+0000","last_clean":"2024-04-25T09:02:51.316537+0000","last_became_active":"2024-04-25T09:02:50.256276+0000","last_became_peered":"2024-04-25T09:02:50.256276+0000","last_unstale":"2024-04-25T09:02:51.316537+0000","last_undegraded":"2024-04-25T09:02:51.316537+0000","last_fullsized":"2024-04-25T09:02:51.316537+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:39.197119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316558+0000","last_change":"2024-04-25T09:02:50.250389+0000","last_active":"2024-04-25T09:02:51.316558+0000","last_peered":"2024-04-25T09:02:51.316558+0000","last_clean":"2024-04-25T09:02:51.316558+0000","last_became_active":"2024-04-25T09:02:50.248939+0000","last_became_peered":"2024-04-25T09:02:50.248939+0000","last_unstale":"2024-04-25T09:02:51.316558+0000","last_undegraded":"2024-04-25T09:02:51.316558+0000","last_fullsized":"2024-04-25T09:02:51.316558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:05.422996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316934+0000","last_change":"2024-04-25T09:02:50.244387+0000","last_active":"2024-04-25T09:02:51.316934+0000","last_peered":"2024-04-25T09:02:51.316934+0000","last_clean":"2024-04-25T09:02:51.316934+0000","last_became_active":"2024-04-25T09:02:50.244129+0000","last_became_peered":"2024-04-25T09:02:50.244129+0000","last_unstale":"2024-04-25T09:02:51.316934+0000","last_undegraded":"2024-04-25T09:02:51.316934+0000","last_fullsized":"2024-04-25T09:02:51.316934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:10.397533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.242091+0000","last_change":"2024-04-25T09:02:50.261714+0000","last_active":"2024-04-25T09:02:51.242091+0000","last_peered":"2024-04-25T09:02:51.242091+0000","last_clean":"2024-04-25T09:02:51.242091+0000","last_became_active":"2024-04-25T09:02:50.261360+0000","last_became_peered":"2024-04-25T09:02:50.261360+0000","last_unstale":"2024-04-25T09:02:51.242091+0000","last_undegraded":"2024-04-25T09:02:51.242091+0000","last_fullsized":"2024-04-25T09:02:51.242091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:50.494186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316965+0000","last_change":"2024-04-25T09:02:50.245103+0000","last_active":"2024-04-25T09:02:51.316965+0000","last_peered":"2024-04-25T09:02:51.316965+0000","last_clean":"2024-04-25T09:02:51.316965+0000","last_became_active":"2024-04-25T09:02:50.244849+0000","last_became_peered":"2024-04-25T09:02:50.244849+0000","last_unstale":"2024-04-25T09:02:51.316965+0000","last_undegraded":"2024-04-25T09:02:51.316965+0000","last_fullsized":"2024-04-25T09:02:51.316965+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:40.755865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236069+0000","last_change":"2024-04-25T09:02:50.252574+0000","last_active":"2024-04-25T09:02:51.236069+0000","last_peered":"2024-04-25T09:02:51.236069+0000","last_clean":"2024-04-25T09:02:51.236069+0000","last_became_active":"2024-04-25T09:02:50.252339+0000","last_became_peered":"2024-04-25T09:02:50.252339+0000","last_unstale":"2024-04-25T09:02:51.236069+0000","last_undegraded":"2024-04-25T09:02:51.236069+0000","last_fullsized":"2024-04-25T09:02:51.236069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:27.529710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237459+0000","last_change":"2024-04-25T09:02:50.241887+0000","last_active":"2024-04-25T09:02:51.237459+0000","last_peered":"2024-04-25T09:02:51.237459+0000","last_clean":"2024-04-25T09:02:51.237459+0000","last_became_active":"2024-04-25T09:02:50.241624+0000","last_became_peered":"2024-04-25T09:02:50.241624+0000","last_unstale":"2024-04-25T09:02:51.237459+0000","last_undegraded":"2024-04-25T09:02:51.237459+0000","last_fullsized":"2024-04-25T09:02:51.237459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:39.824663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316939+0000","last_change":"2024-04-25T09:02:50.257049+0000","last_active":"2024-04-25T09:02:51.316939+0000","last_peered":"2024-04-25T09:02:51.316939+0000","last_clean":"2024-04-25T09:02:51.316939+0000","last_became_active":"2024-04-25T09:02:50.256449+0000","last_became_peered":"2024-04-25T09:02:50.256449+0000","last_unstale":"2024-04-25T09:02:51.316939+0000","last_undegraded":"2024-04-25T09:02:51.316939+0000","last_fullsized":"2024-04-25T09:02:51.316939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:52.065013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.241737+0000","last_change":"2024-04-25T09:02:50.244062+0000","last_active":"2024-04-25T09:02:51.241737+0000","last_peered":"2024-04-25T09:02:51.241737+0000","last_clean":"2024-04-25T09:02:51.241737+0000","last_became_active":"2024-04-25T09:02:50.242935+0000","last_became_peered":"2024-04-25T09:02:50.242935+0000","last_unstale":"2024-04-25T09:02:51.241737+0000","last_undegraded":"2024-04-25T09:02:51.241737+0000","last_fullsized":"2024-04-25T09:02:51.241737+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:39.309971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.317046+0000","last_change":"2024-04-25T09:02:50.253153+0000","last_active":"2024-04-25T09:02:51.317046+0000","last_peered":"2024-04-25T09:02:51.317046+0000","last_clean":"2024-04-25T09:02:51.317046+0000","last_became_active":"2024-04-25T09:02:50.252886+0000","last_became_peered":"2024-04-25T09:02:50.252886+0000","last_unstale":"2024-04-25T09:02:51.317046+0000","last_undegraded":"2024-04-25T09:02:51.317046+0000","last_fullsized":"2024-04-25T09:02:51.317046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:06.873106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316177+0000","last_change":"2024-04-25T09:02:50.259979+0000","last_active":"2024-04-25T09:02:51.316177+0000","last_peered":"2024-04-25T09:02:51.316177+0000","last_clean":"2024-04-25T09:02:51.316177+0000","last_became_active":"2024-04-25T09:02:50.259250+0000","last_became_peered":"2024-04-25T09:02:50.259250+0000","last_unstale":"2024-04-25T09:02:51.316177+0000","last_undegraded":"2024-04-25T09:02:51.316177+0000","last_fullsized":"2024-04-25T09:02:51.316177+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:51.139755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316859+0000","last_change":"2024-04-25T09:02:50.251132+0000","last_active":"2024-04-25T09:02:51.316859+0000","last_peered":"2024-04-25T09:02:51.316859+0000","last_clean":"2024-04-25T09:02:51.316859+0000","last_became_active":"2024-04-25T09:02:50.250842+0000","last_became_peered":"2024-04-25T09:02:50.250842+0000","last_unstale":"2024-04-25T09:02:51.316859+0000","last_undegraded":"2024-04-25T09:02:51.316859+0000","last_fullsized":"2024-04-25T09:02:51.316859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:12.613008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236011+0000","last_change":"2024-04-25T09:02:50.238634+0000","last_active":"2024-04-25T09:02:51.236011+0000","last_peered":"2024-04-25T09:02:51.236011+0000","last_clean":"2024-04-25T09:02:51.236011+0000","last_became_active":"2024-04-25T09:02:50.238332+0000","last_became_peered":"2024-04-25T09:02:50.238332+0000","last_unstale":"2024-04-25T09:02:51.236011+0000","last_undegraded":"2024-04-25T09:02:51.236011+0000","last_fullsized":"2024-04-25T09:02:51.236011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:39.037987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316763+0000","last_change":"2024-04-25T09:02:50.251851+0000","last_active":"2024-04-25T09:02:51.316763+0000","last_peered":"2024-04-25T09:02:51.316763+0000","last_clean":"2024-04-25T09:02:51.316763+0000","last_became_active":"2024-04-25T09:02:50.250492+0000","last_became_peered":"2024-04-25T09:02:50.250492+0000","last_unstale":"2024-04-25T09:02:51.316763+0000","last_undegraded":"2024-04-25T09:02:51.316763+0000","last_fullsized":"2024-04-25T09:02:51.316763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:04.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316188+0000","last_change":"2024-04-25T09:02:50.241045+0000","last_active":"2024-04-25T09:02:51.316188+0000","last_peered":"2024-04-25T09:02:51.316188+0000","last_clean":"2024-04-25T09:02:51.316188+0000","last_became_active":"2024-04-25T09:02:50.240478+0000","last_became_peered":"2024-04-25T09:02:50.240478+0000","last_unstale":"2024-04-25T09:02:51.316188+0000","last_undegraded":"2024-04-25T09:02:51.316188+0000","last_fullsized":"2024-04-25T09:02:51.316188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:34.725450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316701+0000","last_change":"2024-04-25T09:02:50.257310+0000","last_active":"2024-04-25T09:02:51.316701+0000","last_peered":"2024-04-25T09:02:51.316701+0000","last_clean":"2024-04-25T09:02:51.316701+0000","last_became_active":"2024-04-25T09:02:50.256720+0000","last_became_peered":"2024-04-25T09:02:50.256720+0000","last_unstale":"2024-04-25T09:02:51.316701+0000","last_undegraded":"2024-04-25T09:02:51.316701+0000","last_fullsized":"2024-04-25T09:02:51.316701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:39.037987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315055+0000","last_change":"2024-04-25T09:02:50.250530+0000","last_active":"2024-04-25T09:02:51.315055+0000","last_peered":"2024-04-25T09:02:51.315055+0000","last_clean":"2024-04-25T09:02:51.315055+0000","last_became_active":"2024-04-25T09:02:50.250231+0000","last_became_peered":"2024-04-25T09:02:50.250231+0000","last_unstale":"2024-04-25T09:02:51.315055+0000","last_undegraded":"2024-04-25T09:02:51.315055+0000","last_fullsized":"2024-04-25T09:02:51.315055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:06.873106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316309+0000","last_change":"2024-04-25T09:02:50.258157+0000","last_active":"2024-04-25T09:02:51.316309+0000","last_peered":"2024-04-25T09:02:51.316309+0000","last_clean":"2024-04-25T09:02:51.316309+0000","last_became_active":"2024-04-25T09:02:50.257857+0000","last_became_peered":"2024-04-25T09:02:50.257857+0000","last_unstale":"2024-04-25T09:02:51.316309+0000","last_undegraded":"2024-04-25T09:02:51.316309+0000","last_fullsized":"2024-04-25T09:02:51.316309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:37.777098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316974+0000","last_change":"2024-04-25T09:02:49.232545+0000","last_active":"2024-04-25T09:02:51.316974+0000","last_peered":"2024-04-25T09:02:51.316974+0000","last_clean":"2024-04-25T09:02:51.316974+0000","last_became_active":"2024-04-25T09:02:49.232210+0000","last_became_peered":"2024-04-25T09:02:49.232210+0000","last_unstale":"2024-04-25T09:02:51.316974+0000","last_undegraded":"2024-04-25T09:02:51.316974+0000","last_fullsized":"2024-04-25T09:02:51.316974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:49.487103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316118+0000","last_change":"2024-04-25T09:02:50.259567+0000","last_active":"2024-04-25T09:02:51.316118+0000","last_peered":"2024-04-25T09:02:51.316118+0000","last_clean":"2024-04-25T09:02:51.316118+0000","last_became_active":"2024-04-25T09:02:50.259150+0000","last_became_peered":"2024-04-25T09:02:50.259150+0000","last_unstale":"2024-04-25T09:02:51.316118+0000","last_undegraded":"2024-04-25T09:02:51.316118+0000","last_fullsized":"2024-04-25T09:02:51.316118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:39.437873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315829+0000","last_change":"2024-04-25T09:02:49.235883+0000","last_active":"2024-04-25T09:02:51.315829+0000","last_peered":"2024-04-25T09:02:51.315829+0000","last_clean":"2024-04-25T09:02:51.315829+0000","last_became_active":"2024-04-25T09:02:49.235596+0000","last_became_peered":"2024-04-25T09:02:49.235596+0000","last_unstale":"2024-04-25T09:02:51.315829+0000","last_undegraded":"2024-04-25T09:02:51.315829+0000","last_fullsized":"2024-04-25T09:02:51.315829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:01.239512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237388+0000","last_change":"2024-04-25T09:02:50.244387+0000","last_active":"2024-04-25T09:02:51.237388+0000","last_peered":"2024-04-25T09:02:51.237388+0000","last_clean":"2024-04-25T09:02:51.237388+0000","last_became_active":"2024-04-25T09:02:50.244110+0000","last_became_peered":"2024-04-25T09:02:50.244110+0000","last_unstale":"2024-04-25T09:02:51.237388+0000","last_undegraded":"2024-04-25T09:02:51.237388+0000","last_fullsized":"2024-04-25T09:02:51.237388+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:51.139755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316194+0000","last_change":"2024-04-25T09:02:49.229405+0000","last_active":"2024-04-25T09:02:51.316194+0000","last_peered":"2024-04-25T09:02:51.316194+0000","last_clean":"2024-04-25T09:02:51.316194+0000","last_became_active":"2024-04-25T09:02:49.228291+0000","last_became_peered":"2024-04-25T09:02:49.228291+0000","last_unstale":"2024-04-25T09:02:51.316194+0000","last_undegraded":"2024-04-25T09:02:51.316194+0000","last_fullsized":"2024-04-25T09:02:51.316194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:51.351917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235511+0000","last_change":"2024-04-25T09:02:50.240592+0000","last_active":"2024-04-25T09:02:51.235511+0000","last_peered":"2024-04-25T09:02:51.235511+0000","last_clean":"2024-04-25T09:02:51.235511+0000","last_became_active":"2024-04-25T09:02:50.240356+0000","last_became_peered":"2024-04-25T09:02:50.240356+0000","last_unstale":"2024-04-25T09:02:51.235511+0000","last_undegraded":"2024-04-25T09:02:51.235511+0000","last_fullsized":"2024-04-25T09:02:51.235511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.888999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237843+0000","last_change":"2024-04-25T09:02:49.231000+0000","last_active":"2024-04-25T09:02:51.237843+0000","last_peered":"2024-04-25T09:02:51.237843+0000","last_clean":"2024-04-25T09:02:51.237843+0000","last_became_active":"2024-04-25T09:02:49.230712+0000","last_became_peered":"2024-04-25T09:02:49.230712+0000","last_unstale":"2024-04-25T09:02:51.237843+0000","last_undegraded":"2024-04-25T09:02:51.237843+0000","last_fullsized":"2024-04-25T09:02:51.237843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:36.529344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315463+0000","last_change":"2024-04-25T09:02:50.246208+0000","last_active":"2024-04-25T09:02:51.315463+0000","last_peered":"2024-04-25T09:02:51.315463+0000","last_clean":"2024-04-25T09:02:51.315463+0000","last_became_active":"2024-04-25T09:02:50.245883+0000","last_became_peered":"2024-04-25T09:02:50.245883+0000","last_unstale":"2024-04-25T09:02:51.315463+0000","last_undegraded":"2024-04-25T09:02:51.315463+0000","last_fullsized":"2024-04-25T09:02:51.315463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:39.437873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236213+0000","last_change":"2024-04-25T09:02:49.233023+0000","last_active":"2024-04-25T09:02:51.236213+0000","last_peered":"2024-04-25T09:02:51.236213+0000","last_clean":"2024-04-25T09:02:51.236213+0000","last_became_active":"2024-04-25T09:02:49.232394+0000","last_became_peered":"2024-04-25T09:02:49.232394+0000","last_unstale":"2024-04-25T09:02:51.236213+0000","last_undegraded":"2024-04-25T09:02:51.236213+0000","last_fullsized":"2024-04-25T09:02:51.236213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:33.718367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235854+0000","last_change":"2024-04-25T09:02:50.253833+0000","last_active":"2024-04-25T09:02:51.235854+0000","last_peered":"2024-04-25T09:02:51.235854+0000","last_clean":"2024-04-25T09:02:51.235854+0000","last_became_active":"2024-04-25T09:02:50.253548+0000","last_became_peered":"2024-04-25T09:02:50.253548+0000","last_unstale":"2024-04-25T09:02:51.235854+0000","last_undegraded":"2024-04-25T09:02:51.235854+0000","last_fullsized":"2024-04-25T09:02:51.235854+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:48.931852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316294+0000","last_change":"2024-04-25T09:02:49.236881+0000","last_active":"2024-04-25T09:02:51.316294+0000","last_peered":"2024-04-25T09:02:51.316294+0000","last_clean":"2024-04-25T09:02:51.316294+0000","last_became_active":"2024-04-25T09:02:49.236588+0000","last_became_peered":"2024-04-25T09:02:49.236588+0000","last_unstale":"2024-04-25T09:02:51.316294+0000","last_undegraded":"2024-04-25T09:02:51.316294+0000","last_fullsized":"2024-04-25T09:02:51.316294+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:03.259110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237240+0000","last_change":"2024-04-25T09:02:50.235971+0000","last_active":"2024-04-25T09:02:51.237240+0000","last_peered":"2024-04-25T09:02:51.237240+0000","last_clean":"2024-04-25T09:02:51.237240+0000","last_became_active":"2024-04-25T09:02:50.235720+0000","last_became_peered":"2024-04-25T09:02:50.235720+0000","last_unstale":"2024-04-25T09:02:51.237240+0000","last_undegraded":"2024-04-25T09:02:51.237240+0000","last_fullsized":"2024-04-25T09:02:51.237240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:01.641921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315026+0000","last_change":"2024-04-25T09:02:49.236095+0000","last_active":"2024-04-25T09:02:51.315026+0000","last_peered":"2024-04-25T09:02:51.315026+0000","last_clean":"2024-04-25T09:02:51.315026+0000","last_became_active":"2024-04-25T09:02:49.235806+0000","last_became_peered":"2024-04-25T09:02:49.235806+0000","last_unstale":"2024-04-25T09:02:51.315026+0000","last_undegraded":"2024-04-25T09:02:51.315026+0000","last_fullsized":"2024-04-25T09:02:51.315026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:49.487103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.234869+0000","last_change":"2024-04-25T09:02:50.261806+0000","last_active":"2024-04-25T09:02:51.234869+0000","last_peered":"2024-04-25T09:02:51.234869+0000","last_clean":"2024-04-25T09:02:51.234869+0000","last_became_active":"2024-04-25T09:02:50.260186+0000","last_became_peered":"2024-04-25T09:02:50.260186+0000","last_unstale":"2024-04-25T09:02:51.234869+0000","last_undegraded":"2024-04-25T09:02:51.234869+0000","last_fullsized":"2024-04-25T09:02:51.234869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:05.422996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236795+0000","last_change":"2024-04-25T09:02:49.230266+0000","last_active":"2024-04-25T09:02:51.236795+0000","last_peered":"2024-04-25T09:02:51.236795+0000","last_clean":"2024-04-25T09:02:51.236795+0000","last_became_active":"2024-04-25T09:02:49.230000+0000","last_became_peered":"2024-04-25T09:02:49.230000+0000","last_unstale":"2024-04-25T09:02:51.236795+0000","last_undegraded":"2024-04-25T09:02:51.236795+0000","last_fullsized":"2024-04-25T09:02:51.236795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:49.487103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.242097+0000","last_change":"2024-04-25T09:02:50.240131+0000","last_active":"2024-04-25T09:02:51.242097+0000","last_peered":"2024-04-25T09:02:51.242097+0000","last_clean":"2024-04-25T09:02:51.242097+0000","last_became_active":"2024-04-25T09:02:50.239876+0000","last_became_peered":"2024-04-25T09:02:50.239876+0000","last_unstale":"2024-04-25T09:02:51.242097+0000","last_undegraded":"2024-04-25T09:02:51.242097+0000","last_fullsized":"2024-04-25T09:02:51.242097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:19.842311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235603+0000","last_change":"2024-04-25T09:02:49.232268+0000","last_active":"2024-04-25T09:02:51.235603+0000","last_peered":"2024-04-25T09:02:51.235603+0000","last_clean":"2024-04-25T09:02:51.235603+0000","last_became_active":"2024-04-25T09:02:49.232019+0000","last_became_peered":"2024-04-25T09:02:49.232019+0000","last_unstale":"2024-04-25T09:02:51.235603+0000","last_undegraded":"2024-04-25T09:02:51.235603+0000","last_fullsized":"2024-04-25T09:02:51.235603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:05.866023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316324+0000","last_change":"2024-04-25T09:02:50.247028+0000","last_active":"2024-04-25T09:02:51.316324+0000","last_peered":"2024-04-25T09:02:51.316324+0000","last_clean":"2024-04-25T09:02:51.316324+0000","last_became_active":"2024-04-25T09:02:50.246742+0000","last_became_peered":"2024-04-25T09:02:50.246742+0000","last_unstale":"2024-04-25T09:02:51.316324+0000","last_undegraded":"2024-04-25T09:02:51.316324+0000","last_fullsized":"2024-04-25T09:02:51.316324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:29.959421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236290+0000","last_change":"2024-04-25T09:02:49.233904+0000","last_active":"2024-04-25T09:02:51.236290+0000","last_peered":"2024-04-25T09:02:51.236290+0000","last_clean":"2024-04-25T09:02:51.236290+0000","last_became_active":"2024-04-25T09:02:49.233609+0000","last_became_peered":"2024-04-25T09:02:49.233609+0000","last_unstale":"2024-04-25T09:02:51.236290+0000","last_undegraded":"2024-04-25T09:02:51.236290+0000","last_fullsized":"2024-04-25T09:02:51.236290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:11.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315713+0000","last_change":"2024-04-25T09:02:50.263197+0000","last_active":"2024-04-25T09:02:51.315713+0000","last_peered":"2024-04-25T09:02:51.315713+0000","last_clean":"2024-04-25T09:02:51.315713+0000","last_became_active":"2024-04-25T09:02:50.262912+0000","last_became_peered":"2024-04-25T09:02:50.262912+0000","last_unstale":"2024-04-25T09:02:51.315713+0000","last_undegraded":"2024-04-25T09:02:51.315713+0000","last_fullsized":"2024-04-25T09:02:51.315713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:45.748241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236494+0000","last_change":"2024-04-25T09:02:49.236426+0000","last_active":"2024-04-25T09:02:51.236494+0000","last_peered":"2024-04-25T09:02:51.236494+0000","last_clean":"2024-04-25T09:02:51.236494+0000","last_became_active":"2024-04-25T09:02:49.236159+0000","last_became_peered":"2024-04-25T09:02:49.236159+0000","last_unstale":"2024-04-25T09:02:51.236494+0000","last_undegraded":"2024-04-25T09:02:51.236494+0000","last_fullsized":"2024-04-25T09:02:51.236494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:09.390450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237232+0000","last_change":"2024-04-25T09:02:50.242937+0000","last_active":"2024-04-25T09:02:51.237232+0000","last_peered":"2024-04-25T09:02:51.237232+0000","last_clean":"2024-04-25T09:02:51.237232+0000","last_became_active":"2024-04-25T09:02:50.242702+0000","last_became_peered":"2024-04-25T09:02:50.242702+0000","last_unstale":"2024-04-25T09:02:51.237232+0000","last_undegraded":"2024-04-25T09:02:51.237232+0000","last_fullsized":"2024-04-25T09:02:51.237232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:06.873106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.234991+0000","last_change":"2024-04-25T09:02:49.237214+0000","last_active":"2024-04-25T09:02:51.234991+0000","last_peered":"2024-04-25T09:02:51.234991+0000","last_clean":"2024-04-25T09:02:51.234991+0000","last_became_active":"2024-04-25T09:02:49.236915+0000","last_became_peered":"2024-04-25T09:02:49.236915+0000","last_unstale":"2024-04-25T09:02:51.234991+0000","last_undegraded":"2024-04-25T09:02:51.234991+0000","last_fullsized":"2024-04-25T09:02:51.234991+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:00.634838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315379+0000","last_change":"2024-04-25T09:02:50.259533+0000","last_active":"2024-04-25T09:02:51.315379+0000","last_peered":"2024-04-25T09:02:51.315379+0000","last_clean":"2024-04-25T09:02:51.315379+0000","last_became_active":"2024-04-25T09:02:50.259274+0000","last_became_peered":"2024-04-25T09:02:50.259274+0000","last_unstale":"2024-04-25T09:02:51.315379+0000","last_undegraded":"2024-04-25T09:02:51.315379+0000","last_fullsized":"2024-04-25T09:02:51.315379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:01.641921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235126+0000","last_change":"2024-04-25T09:02:49.237173+0000","last_active":"2024-04-25T09:02:51.235126+0000","last_peered":"2024-04-25T09:02:51.235126+0000","last_clean":"2024-04-25T09:02:51.235126+0000","last_became_active":"2024-04-25T09:02:49.236852+0000","last_became_peered":"2024-04-25T09:02:49.236852+0000","last_unstale":"2024-04-25T09:02:51.235126+0000","last_undegraded":"2024-04-25T09:02:51.235126+0000","last_fullsized":"2024-04-25T09:02:51.235126+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:39.748782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.234811+0000","last_change":"2024-04-25T09:02:50.248514+0000","last_active":"2024-04-25T09:02:51.234811+0000","last_peered":"2024-04-25T09:02:51.234811+0000","last_clean":"2024-04-25T09:02:51.234811+0000","last_became_active":"2024-04-25T09:02:50.248247+0000","last_became_peered":"2024-04-25T09:02:50.248247+0000","last_unstale":"2024-04-25T09:02:51.234811+0000","last_undegraded":"2024-04-25T09:02:51.234811+0000","last_fullsized":"2024-04-25T09:02:51.234811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:39.197119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315132+0000","last_change":"2024-04-25T09:02:49.235898+0000","last_active":"2024-04-25T09:02:51.315132+0000","last_peered":"2024-04-25T09:02:51.315132+0000","last_clean":"2024-04-25T09:02:51.315132+0000","last_became_active":"2024-04-25T09:02:49.235616+0000","last_became_peered":"2024-04-25T09:02:49.235616+0000","last_unstale":"2024-04-25T09:02:51.315132+0000","last_undegraded":"2024-04-25T09:02:51.315132+0000","last_fullsized":"2024-04-25T09:02:51.315132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:11.020739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316253+0000","last_change":"2024-04-25T09:02:50.252442+0000","last_active":"2024-04-25T09:02:51.316253+0000","last_peered":"2024-04-25T09:02:51.316253+0000","last_clean":"2024-04-25T09:02:51.316253+0000","last_became_active":"2024-04-25T09:02:50.252201+0000","last_became_peered":"2024-04-25T09:02:50.252201+0000","last_unstale":"2024-04-25T09:02:51.316253+0000","last_undegraded":"2024-04-25T09:02:51.316253+0000","last_fullsized":"2024-04-25T09:02:51.316253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:48.931852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316056+0000","last_change":"2024-04-25T09:02:49.227991+0000","last_active":"2024-04-25T09:02:51.316056+0000","last_peered":"2024-04-25T09:02:51.316056+0000","last_clean":"2024-04-25T09:02:51.316056+0000","last_became_active":"2024-04-25T09:02:49.227654+0000","last_became_peered":"2024-04-25T09:02:49.227654+0000","last_unstale":"2024-04-25T09:02:51.316056+0000","last_undegraded":"2024-04-25T09:02:51.316056+0000","last_fullsized":"2024-04-25T09:02:51.316056+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:36.529344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235089+0000","last_change":"2024-04-25T09:02:50.249981+0000","last_active":"2024-04-25T09:02:51.235089+0000","last_peered":"2024-04-25T09:02:51.235089+0000","last_clean":"2024-04-25T09:02:51.235089+0000","last_became_active":"2024-04-25T09:02:50.249744+0000","last_became_peered":"2024-04-25T09:02:50.249744+0000","last_unstale":"2024-04-25T09:02:51.235089+0000","last_undegraded":"2024-04-25T09:02:51.235089+0000","last_fullsized":"2024-04-25T09:02:51.235089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:52.065013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316081+0000","last_change":"2024-04-25T09:02:49.238444+0000","last_active":"2024-04-25T09:02:51.316081+0000","last_peered":"2024-04-25T09:02:51.316081+0000","last_clean":"2024-04-25T09:02:51.316081+0000","last_became_active":"2024-04-25T09:02:49.238101+0000","last_became_peered":"2024-04-25T09:02:49.238101+0000","last_unstale":"2024-04-25T09:02:51.316081+0000","last_undegraded":"2024-04-25T09:02:51.316081+0000","last_fullsized":"2024-04-25T09:02:51.316081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:51.351917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235011+0000","last_change":"2024-04-25T09:02:50.241678+0000","last_active":"2024-04-25T09:02:51.235011+0000","last_peered":"2024-04-25T09:02:51.235011+0000","last_clean":"2024-04-25T09:02:51.235011+0000","last_became_active":"2024-04-25T09:02:50.241410+0000","last_became_peered":"2024-04-25T09:02:50.241410+0000","last_unstale":"2024-04-25T09:02:51.235011+0000","last_undegraded":"2024-04-25T09:02:51.235011+0000","last_fullsized":"2024-04-25T09:02:51.235011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:39.037987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236206+0000","last_change":"2024-04-25T09:02:49.231946+0000","last_active":"2024-04-25T09:02:51.236206+0000","last_peered":"2024-04-25T09:02:51.236206+0000","last_clean":"2024-04-25T09:02:51.236206+0000","last_became_active":"2024-04-25T09:02:49.231493+0000","last_became_peered":"2024-04-25T09:02:49.231493+0000","last_unstale":"2024-04-25T09:02:51.236206+0000","last_undegraded":"2024-04-25T09:02:51.236206+0000","last_fullsized":"2024-04-25T09:02:51.236206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:03.259110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236430+0000","last_change":"2024-04-25T09:02:50.254009+0000","last_active":"2024-04-25T09:02:51.236430+0000","last_peered":"2024-04-25T09:02:51.236430+0000","last_clean":"2024-04-25T09:02:51.236430+0000","last_became_active":"2024-04-25T09:02:50.253741+0000","last_became_peered":"2024-04-25T09:02:50.253741+0000","last_unstale":"2024-04-25T09:02:51.236430+0000","last_undegraded":"2024-04-25T09:02:51.236430+0000","last_fullsized":"2024-04-25T09:02:51.236430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.888999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237451+0000","last_change":"2024-04-25T09:02:49.235760+0000","last_active":"2024-04-25T09:02:51.237451+0000","last_peered":"2024-04-25T09:02:51.237451+0000","last_clean":"2024-04-25T09:02:51.237451+0000","last_became_active":"2024-04-25T09:02:49.235503+0000","last_became_peered":"2024-04-25T09:02:49.235503+0000","last_unstale":"2024-04-25T09:02:51.237451+0000","last_undegraded":"2024-04-25T09:02:51.237451+0000","last_fullsized":"2024-04-25T09:02:51.237451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:18.835228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237297+0000","last_change":"2024-04-25T09:02:50.250988+0000","last_active":"2024-04-25T09:02:51.237297+0000","last_peered":"2024-04-25T09:02:51.237297+0000","last_clean":"2024-04-25T09:02:51.237297+0000","last_became_active":"2024-04-25T09:02:50.250732+0000","last_became_peered":"2024-04-25T09:02:50.250732+0000","last_unstale":"2024-04-25T09:02:51.237297+0000","last_undegraded":"2024-04-25T09:02:51.237297+0000","last_fullsized":"2024-04-25T09:02:51.237297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:39.437873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.242059+0000","last_change":"2024-04-25T09:02:49.234792+0000","last_active":"2024-04-25T09:02:51.242059+0000","last_peered":"2024-04-25T09:02:51.242059+0000","last_clean":"2024-04-25T09:02:51.242059+0000","last_became_active":"2024-04-25T09:02:49.234481+0000","last_became_peered":"2024-04-25T09:02:49.234481+0000","last_unstale":"2024-04-25T09:02:51.242059+0000","last_undegraded":"2024-04-25T09:02:51.242059+0000","last_fullsized":"2024-04-25T09:02:51.242059+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:45.412628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.242303+0000","last_change":"2024-04-25T09:02:50.239124+0000","last_active":"2024-04-25T09:02:51.242303+0000","last_peered":"2024-04-25T09:02:51.242303+0000","last_clean":"2024-04-25T09:02:51.242303+0000","last_became_active":"2024-04-25T09:02:50.238938+0000","last_became_peered":"2024-04-25T09:02:50.238938+0000","last_unstale":"2024-04-25T09:02:51.242303+0000","last_undegraded":"2024-04-25T09:02:51.242303+0000","last_fullsized":"2024-04-25T09:02:51.242303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:12.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315343+0000","last_change":"2024-04-25T09:02:49.229398+0000","last_active":"2024-04-25T09:02:51.315343+0000","last_peered":"2024-04-25T09:02:51.315343+0000","last_clean":"2024-04-25T09:02:51.315343+0000","last_became_active":"2024-04-25T09:02:49.229026+0000","last_became_peered":"2024-04-25T09:02:49.229026+0000","last_unstale":"2024-04-25T09:02:51.315343+0000","last_undegraded":"2024-04-25T09:02:51.315343+0000","last_fullsized":"2024-04-25T09:02:51.315343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:01.239512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316271+0000","last_change":"2024-04-25T09:02:50.249345+0000","last_active":"2024-04-25T09:02:51.316271+0000","last_peered":"2024-04-25T09:02:51.316271+0000","last_clean":"2024-04-25T09:02:51.316271+0000","last_became_active":"2024-04-25T09:02:50.249043+0000","last_became_peered":"2024-04-25T09:02:50.249043+0000","last_unstale":"2024-04-25T09:02:51.316271+0000","last_undegraded":"2024-04-25T09:02:51.316271+0000","last_fullsized":"2024-04-25T09:02:51.316271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:44.640559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.241825+0000","last_change":"2024-04-25T09:02:49.234652+0000","last_active":"2024-04-25T09:02:51.241825+0000","last_peered":"2024-04-25T09:02:51.241825+0000","last_clean":"2024-04-25T09:02:51.241825+0000","last_became_active":"2024-04-25T09:02:49.234331+0000","last_became_peered":"2024-04-25T09:02:49.234331+0000","last_unstale":"2024-04-25T09:02:51.241825+0000","last_undegraded":"2024-04-25T09:02:51.241825+0000","last_fullsized":"2024-04-25T09:02:51.241825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:54.120331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315583+0000","last_change":"2024-04-25T09:02:50.263469+0000","last_active":"2024-04-25T09:02:51.315583+0000","last_peered":"2024-04-25T09:02:51.315583+0000","last_clean":"2024-04-25T09:02:51.315583+0000","last_became_active":"2024-04-25T09:02:50.262128+0000","last_became_peered":"2024-04-25T09:02:50.262128+0000","last_unstale":"2024-04-25T09:02:51.315583+0000","last_undegraded":"2024-04-25T09:02:51.315583+0000","last_fullsized":"2024-04-25T09:02:51.315583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:39.824663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.241868+0000","last_change":"2024-04-25T09:02:49.234855+0000","last_active":"2024-04-25T09:02:51.241868+0000","last_peered":"2024-04-25T09:02:51.241868+0000","last_clean":"2024-04-25T09:02:51.241868+0000","last_became_active":"2024-04-25T09:02:49.234276+0000","last_became_peered":"2024-04-25T09:02:49.234276+0000","last_unstale":"2024-04-25T09:02:51.241868+0000","last_undegraded":"2024-04-25T09:02:51.241868+0000","last_fullsized":"2024-04-25T09:02:51.241868+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:44.481682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235906+0000","last_change":"2024-04-25T09:02:50.240819+0000","last_active":"2024-04-25T09:02:51.235906+0000","last_peered":"2024-04-25T09:02:51.235906+0000","last_clean":"2024-04-25T09:02:51.235906+0000","last_became_active":"2024-04-25T09:02:50.240573+0000","last_became_peered":"2024-04-25T09:02:50.240573+0000","last_unstale":"2024-04-25T09:02:51.235906+0000","last_undegraded":"2024-04-25T09:02:51.235906+0000","last_fullsized":"2024-04-25T09:02:51.235906+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:05.422996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316795+0000","last_change":"2024-04-25T09:02:49.237611+0000","last_active":"2024-04-25T09:02:51.316795+0000","last_peered":"2024-04-25T09:02:51.316795+0000","last_clean":"2024-04-25T09:02:51.316795+0000","last_became_active":"2024-04-25T09:02:49.237238+0000","last_became_peered":"2024-04-25T09:02:49.237238+0000","last_unstale":"2024-04-25T09:02:51.316795+0000","last_undegraded":"2024-04-25T09:02:51.316795+0000","last_fullsized":"2024-04-25T09:02:51.316795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:33.718367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235035+0000","last_change":"2024-04-25T09:02:50.262028+0000","last_active":"2024-04-25T09:02:51.235035+0000","last_peered":"2024-04-25T09:02:51.235035+0000","last_clean":"2024-04-25T09:02:51.235035+0000","last_became_active":"2024-04-25T09:02:50.260037+0000","last_became_peered":"2024-04-25T09:02:50.260037+0000","last_unstale":"2024-04-25T09:02:51.235035+0000","last_undegraded":"2024-04-25T09:02:51.235035+0000","last_fullsized":"2024-04-25T09:02:51.235035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:27.529710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.241674+0000","last_change":"2024-04-25T09:02:49.228571+0000","last_active":"2024-04-25T09:02:51.241674+0000","last_peered":"2024-04-25T09:02:51.241674+0000","last_clean":"2024-04-25T09:02:51.241674+0000","last_became_active":"2024-04-25T09:02:49.228289+0000","last_became_peered":"2024-04-25T09:02:49.228289+0000","last_unstale":"2024-04-25T09:02:51.241674+0000","last_undegraded":"2024-04-25T09:02:51.241674+0000","last_fullsized":"2024-04-25T09:02:51.241674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:28.465953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315271+0000","last_change":"2024-04-25T09:02:50.259458+0000","last_active":"2024-04-25T09:02:51.315271+0000","last_peered":"2024-04-25T09:02:51.315271+0000","last_clean":"2024-04-25T09:02:51.315271+0000","last_became_active":"2024-04-25T09:02:50.259143+0000","last_became_peered":"2024-04-25T09:02:50.259143+0000","last_unstale":"2024-04-25T09:02:51.315271+0000","last_undegraded":"2024-04-25T09:02:51.315271+0000","last_fullsized":"2024-04-25T09:02:51.315271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:01.641921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236306+0000","last_change":"2024-04-25T09:02:49.236567+0000","last_active":"2024-04-25T09:02:51.236306+0000","last_peered":"2024-04-25T09:02:51.236306+0000","last_clean":"2024-04-25T09:02:51.236306+0000","last_became_active":"2024-04-25T09:02:49.236293+0000","last_became_peered":"2024-04-25T09:02:49.236293+0000","last_unstale":"2024-04-25T09:02:51.236306+0000","last_undegraded":"2024-04-25T09:02:51.236306+0000","last_fullsized":"2024-04-25T09:02:51.236306+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:39.748782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316360+0000","last_change":"2024-04-25T09:02:50.248743+0000","last_active":"2024-04-25T09:02:51.316360+0000","last_peered":"2024-04-25T09:02:51.316360+0000","last_clean":"2024-04-25T09:02:51.316360+0000","last_became_active":"2024-04-25T09:02:50.248491+0000","last_became_peered":"2024-04-25T09:02:50.248491+0000","last_unstale":"2024-04-25T09:02:51.316360+0000","last_undegraded":"2024-04-25T09:02:51.316360+0000","last_fullsized":"2024-04-25T09:02:51.316360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:22.294075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.242163+0000","last_change":"2024-04-25T09:02:49.222270+0000","last_active":"2024-04-25T09:02:51.242163+0000","last_peered":"2024-04-25T09:02:51.242163+0000","last_clean":"2024-04-25T09:02:51.242163+0000","last_became_active":"2024-04-25T09:02:49.221997+0000","last_became_peered":"2024-04-25T09:02:49.221997+0000","last_unstale":"2024-04-25T09:02:51.242163+0000","last_undegraded":"2024-04-25T09:02:51.242163+0000","last_fullsized":"2024-04-25T09:02:51.242163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:45.926115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235353+0000","last_change":"2024-04-25T09:02:50.239909+0000","last_active":"2024-04-25T09:02:51.235353+0000","last_peered":"2024-04-25T09:02:51.235353+0000","last_clean":"2024-04-25T09:02:51.235353+0000","last_became_active":"2024-04-25T09:02:50.239655+0000","last_became_peered":"2024-04-25T09:02:50.239655+0000","last_unstale":"2024-04-25T09:02:51.235353+0000","last_undegraded":"2024-04-25T09:02:51.235353+0000","last_fullsized":"2024-04-25T09:02:51.235353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:58.168185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315781+0000","last_change":"2024-04-25T09:02:49.232993+0000","last_active":"2024-04-25T09:02:51.315781+0000","last_peered":"2024-04-25T09:02:51.315781+0000","last_clean":"2024-04-25T09:02:51.315781+0000","last_became_active":"2024-04-25T09:02:49.232717+0000","last_became_peered":"2024-04-25T09:02:49.232717+0000","last_unstale":"2024-04-25T09:02:51.315781+0000","last_undegraded":"2024-04-25T09:02:51.315781+0000","last_fullsized":"2024-04-25T09:02:51.315781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:11.835993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315649+0000","last_change":"2024-04-25T09:02:50.247246+0000","last_active":"2024-04-25T09:02:51.315649+0000","last_peered":"2024-04-25T09:02:51.315649+0000","last_clean":"2024-04-25T09:02:51.315649+0000","last_became_active":"2024-04-25T09:02:50.246875+0000","last_became_peered":"2024-04-25T09:02:50.246875+0000","last_unstale":"2024-04-25T09:02:51.315649+0000","last_undegraded":"2024-04-25T09:02:51.315649+0000","last_fullsized":"2024-04-25T09:02:51.315649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:19.707073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315780+0000","last_change":"2024-04-25T09:02:49.226736+0000","last_active":"2024-04-25T09:02:51.315780+0000","last_peered":"2024-04-25T09:02:51.315780+0000","last_clean":"2024-04-25T09:02:51.315780+0000","last_became_active":"2024-04-25T09:02:49.226454+0000","last_became_peered":"2024-04-25T09:02:49.226454+0000","last_unstale":"2024-04-25T09:02:51.315780+0000","last_undegraded":"2024-04-25T09:02:51.315780+0000","last_fullsized":"2024-04-25T09:02:51.315780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:11.020739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.314994+0000","last_change":"2024-04-25T09:02:50.252297+0000","last_active":"2024-04-25T09:02:51.314994+0000","last_peered":"2024-04-25T09:02:51.314994+0000","last_clean":"2024-04-25T09:02:51.314994+0000","last_became_active":"2024-04-25T09:02:50.251947+0000","last_became_peered":"2024-04-25T09:02:50.251947+0000","last_unstale":"2024-04-25T09:02:51.314994+0000","last_undegraded":"2024-04-25T09:02:51.314994+0000","last_fullsized":"2024-04-25T09:02:51.314994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:10.397533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316291+0000","last_change":"2024-04-25T09:02:49.229299+0000","last_active":"2024-04-25T09:02:51.316291+0000","last_peered":"2024-04-25T09:02:51.316291+0000","last_clean":"2024-04-25T09:02:51.316291+0000","last_became_active":"2024-04-25T09:02:49.228960+0000","last_became_peered":"2024-04-25T09:02:49.228960+0000","last_unstale":"2024-04-25T09:02:51.316291+0000","last_undegraded":"2024-04-25T09:02:51.316291+0000","last_fullsized":"2024-04-25T09:02:51.316291+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:34.838771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237011+0000","last_change":"2024-04-25T09:02:50.242449+0000","last_active":"2024-04-25T09:02:51.237011+0000","last_peered":"2024-04-25T09:02:51.237011+0000","last_clean":"2024-04-25T09:02:51.237011+0000","last_became_active":"2024-04-25T09:02:50.242195+0000","last_became_peered":"2024-04-25T09:02:50.242195+0000","last_unstale":"2024-04-25T09:02:51.237011+0000","last_undegraded":"2024-04-25T09:02:51.237011+0000","last_fullsized":"2024-04-25T09:02:51.237011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:40.755865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236864+0000","last_change":"2024-04-25T09:02:49.228645+0000","last_active":"2024-04-25T09:02:51.236864+0000","last_peered":"2024-04-25T09:02:51.236864+0000","last_clean":"2024-04-25T09:02:51.236864+0000","last_became_active":"2024-04-25T09:02:49.228210+0000","last_became_peered":"2024-04-25T09:02:49.228210+0000","last_unstale":"2024-04-25T09:02:51.236864+0000","last_undegraded":"2024-04-25T09:02:51.236864+0000","last_fullsized":"2024-04-25T09:02:51.236864+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:34.838771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316848+0000","last_change":"2024-04-25T09:02:50.255942+0000","last_active":"2024-04-25T09:02:51.316848+0000","last_peered":"2024-04-25T09:02:51.316848+0000","last_clean":"2024-04-25T09:02:51.316848+0000","last_became_active":"2024-04-25T09:02:50.255595+0000","last_became_peered":"2024-04-25T09:02:50.255595+0000","last_unstale":"2024-04-25T09:02:51.316848+0000","last_undegraded":"2024-04-25T09:02:51.316848+0000","last_fullsized":"2024-04-25T09:02:51.316848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:27.529710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.234683+0000","last_change":"2024-04-25T09:02:49.233077+0000","last_active":"2024-04-25T09:02:51.234683+0000","last_peered":"2024-04-25T09:02:51.234683+0000","last_clean":"2024-04-25T09:02:51.234683+0000","last_became_active":"2024-04-25T09:02:49.232847+0000","last_became_peered":"2024-04-25T09:02:49.232847+0000","last_unstale":"2024-04-25T09:02:51.234683+0000","last_undegraded":"2024-04-25T09:02:51.234683+0000","last_fullsized":"2024-04-25T09:02:51.234683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:09.390450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236073+0000","last_change":"2024-04-25T09:02:50.239638+0000","last_active":"2024-04-25T09:02:51.236073+0000","last_peered":"2024-04-25T09:02:51.236073+0000","last_clean":"2024-04-25T09:02:51.236073+0000","last_became_active":"2024-04-25T09:02:50.239393+0000","last_became_peered":"2024-04-25T09:02:50.239393+0000","last_unstale":"2024-04-25T09:02:51.236073+0000","last_undegraded":"2024-04-25T09:02:51.236073+0000","last_fullsized":"2024-04-25T09:02:51.236073+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:52.065013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316439+0000","last_change":"2024-04-25T09:02:49.237540+0000","last_active":"2024-04-25T09:02:51.316439+0000","last_peered":"2024-04-25T09:02:51.316439+0000","last_clean":"2024-04-25T09:02:51.316439+0000","last_became_active":"2024-04-25T09:02:49.237260+0000","last_became_peered":"2024-04-25T09:02:49.237260+0000","last_unstale":"2024-04-25T09:02:51.316439+0000","last_undegraded":"2024-04-25T09:02:51.316439+0000","last_fullsized":"2024-04-25T09:02:51.316439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:11.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316384+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:02:51.316384+0000","last_peered":"2024-04-25T09:02:51.316384+0000","last_clean":"2024-04-25T09:02:51.316384+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:02:51.316384+0000","last_undegraded":"2024-04-25T09:02:51.316384+0000","last_fullsized":"2024-04-25T09:02:51.316384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1060864,"data_stored":788125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":454656,"data_stored":196657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":458752,"data_stored":196187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":458752,"data_stored":196679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":196145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":196165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":786477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:02:58.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:02:59.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f780ac00640 1 Processor -- start 2024-04-25T09:02:59.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f780ac00640 1 -- start start 2024-04-25T09:02:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f780ac00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f780415b860 0x7f780415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f780ac00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f780406ac10 0x7f780406b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f780ac00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780415c180 con 0x7f7804072c70 2024-04-25T09:02:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f780ac00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780415f4e0 con 0x7f780406ac10 2024-04-25T09:02:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f780ac00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780415c430 con 0x7f780415b860 2024-04-25T09:02:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f7808c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f780406ac10 0x7f780406b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f77fb400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7804072c70 0x7f78040cd000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60072/0 (socket says 172.21.15.59:60072) 2024-04-25T09:02:59.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f77fb400640 1 -- 172.21.15.59:0/79086861 learned_addr learned my addr 172.21.15.59:0/79086861 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:59.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f7803e00640 1 --2- 172.21.15.59:0/79086861 >> v2:172.21.15.178:3300/0 conn(0x7f780415b860 0x7f780415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f7808c00640 1 -- 172.21.15.59:0/79086861 >> v2:172.21.15.178:3300/0 conn(0x7f780415b860 msgr2=0x7f780415bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f7808c00640 1 --2- 172.21.15.59:0/79086861 >> v2:172.21.15.178:3300/0 conn(0x7f780415b860 0x7f780415bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f7808c00640 1 -- 172.21.15.59:0/79086861 >> v1:172.21.15.59:6789/0 conn(0x7f7804072c70 legacy=0x7f78040cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f7808c00640 1 -- 172.21.15.59:0/79086861 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780415c710 con 0x7f780406ac10 2024-04-25T09:02:59.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.079+0000 7f7803400640 1 -- 172.21.15.59:0/79086861 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743401727 0 0) 0x7f780415c180 con 0x7f7804072c70 2024-04-25T09:02:59.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.083+0000 7f7808c00640 1 --2- 172.21.15.59:0/79086861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f780406ac10 0x7f780406b0a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f78040b5ac0 tx=0x7f77fc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f662c2d5c5214f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.083+0000 7f7803400640 1 -- 172.21.15.59:0/79086861 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0b2070 con 0x7f780406ac10 2024-04-25T09:02:59.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.083+0000 7f7803400640 1 -- 172.21.15.59:0/79086861 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc0ad640 con 0x7f780406ac10 2024-04-25T09:02:59.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.083+0000 7f7803400640 1 -- 172.21.15.59:0/79086861 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc0ada10 con 0x7f780406ac10 2024-04-25T09:02:59.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.083+0000 7f780ac00640 1 -- 172.21.15.59:0/79086861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f780406ac10 msgr2=0x7f780406b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.083+0000 7f780ac00640 1 --2- 172.21.15.59:0/79086861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f780406ac10 0x7f780406b0a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f78040b5ac0 tx=0x7f77fc01c480 comp rx=0 tx=0).stop 2024-04-25T09:02:59.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.083+0000 7f780ac00640 1 -- 172.21.15.59:0/79086861 shutdown_connections 2024-04-25T09:02:59.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.083+0000 7f780ac00640 1 --2- 172.21.15.59:0/79086861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f780406ac10 0x7f780406b0a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.083+0000 7f780ac00640 1 --2- 172.21.15.59:0/79086861 >> v2:172.21.15.178:3300/0 conn(0x7f780415b860 0x7f780415bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.083+0000 7f780ac00640 1 -- 172.21.15.59:0/79086861 >> 172.21.15.59:0/79086861 conn(0x7f78040b2400 msgr2=0x7f78040b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.083+0000 7f780ac00640 1 -- 172.21.15.59:0/79086861 shutdown_connections 2024-04-25T09:02:59.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.083+0000 7f780ac00640 1 -- 172.21.15.59:0/79086861 wait complete. 2024-04-25T09:02:59.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f780ac00640 1 Processor -- start 2024-04-25T09:02:59.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f780ac00640 1 -- start start 2024-04-25T09:02:59.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f780ac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f780406ac10 0x7f7804147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f780ac00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7804072c70 0x7f780414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f780ac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f780415b860 0x7f780414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f780ac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7804073230 con 0x7f780406ac10 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f780ac00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78040730b0 con 0x7f7804072c70 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f780ac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7804168750 con 0x7f780415b860 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7803e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f780406ac10 0x7f7804147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7803e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f780406ac10 0x7f7804147590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37392/0 (socket says 172.21.15.59:37392) 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7803e00640 1 -- 172.21.15.59:0/1970966922 learned_addr learned my addr 172.21.15.59:0/1970966922 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7808c00640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f780415b860 0x7f780414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f77fb400640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7804072c70 0x7f780414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7803e00640 1 -- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f780415b860 msgr2=0x7f780414dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7803e00640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f780415b860 0x7f780414dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7803e00640 1 -- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7804072c70 msgr2=0x7f780414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7803e00640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7804072c70 0x7f780414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7803e00640 1 -- 172.21.15.59:0/1970966922 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7804149ee0 con 0x7f780406ac10 2024-04-25T09:02:59.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7808c00640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f780415b860 0x7f780414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7803e00640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f780406ac10 0x7f7804147590 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f77f4007e40 tx=0x7f77f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7800c00640 1 -- 172.21.15.59:0/1970966922 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4014620 con 0x7f780406ac10 2024-04-25T09:02:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7800c00640 1 -- 172.21.15.59:0/1970966922 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4019070 con 0x7f780406ac10 2024-04-25T09:02:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f7800c00640 1 -- 172.21.15.59:0/1970966922 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4014a00 con 0x7f780406ac10 2024-04-25T09:02:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f780ac00640 1 -- 172.21.15.59:0/1970966922 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780414a180 con 0x7f780406ac10 2024-04-25T09:02:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f780ac00640 1 -- 172.21.15.59:0/1970966922 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780414a740 con 0x7f780406ac10 2024-04-25T09:02:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.087+0000 7f780ac00640 1 -- 172.21.15.59:0/1970966922 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78040745d0 con 0x7f780406ac10 2024-04-25T09:02:59.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.091+0000 7f7800c00640 1 -- 172.21.15.59:0/1970966922 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f77f4014ba0 con 0x7f780406ac10 2024-04-25T09:02:59.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.091+0000 7f7800c00640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f77e0066f90 0x7f77e0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.091+0000 7f7800c00640 1 -- 172.21.15.59:0/1970966922 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f77f4085ac0 con 0x7f780406ac10 2024-04-25T09:02:59.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.091+0000 7f77fb400640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f77e0066f90 0x7f77e0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.091+0000 7f77fb400640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f77e0066f90 0x7f77e0069450 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f780406b4d0 tx=0x7f77ec007b60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.095+0000 7f7800c00640 1 -- 172.21.15.59:0/1970966922 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f77f40568a0 con 0x7f780406ac10 2024-04-25T09:02:59.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.251+0000 7f780ac00640 1 -- 172.21.15.59:0/1970966922 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f780414d690 con 0x7f77e0066f90 2024-04-25T09:02:59.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.259+0000 7f7800c00640 1 -- 172.21.15.59:0/1970966922 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251959 (secure 0 0 0) 0x7f780414d690 con 0x7f77e0066f90 2024-04-25T09:02:59.254 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:02:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:02:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.263+0000 7f780ac00640 1 -- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f77e0066f90 msgr2=0x7f77e0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.263+0000 7f780ac00640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f77e0066f90 0x7f77e0069450 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f780406b4d0 tx=0x7f77ec007b60 comp rx=0 tx=0).stop 2024-04-25T09:02:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.263+0000 7f780ac00640 1 -- 172.21.15.59:0/1970966922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f780406ac10 msgr2=0x7f7804147590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.263+0000 7f780ac00640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f780406ac10 0x7f7804147590 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f77f4007e40 tx=0x7f77f400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.263+0000 7f780ac00640 1 -- 172.21.15.59:0/1970966922 shutdown_connections 2024-04-25T09:02:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.263+0000 7f780ac00640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f77e0066f90 0x7f77e0069450 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.263+0000 7f780ac00640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f780415b860 0x7f780414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.263+0000 7f780ac00640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7804072c70 0x7f780414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.263+0000 7f780ac00640 1 --2- 172.21.15.59:0/1970966922 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f780406ac10 0x7f7804147590 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.263+0000 7f780ac00640 1 -- 172.21.15.59:0/1970966922 >> 172.21.15.59:0/1970966922 conn(0x7f78040b2400 msgr2=0x7f78040b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.263+0000 7f780ac00640 1 -- 172.21.15.59:0/1970966922 shutdown_connections 2024-04-25T09:02:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.263+0000 7f780ac00640 1 -- 172.21.15.59:0/1970966922 wait complete. 2024-04-25T09:02:59.276 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-04-25T09:02:57.670810+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237604,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737116,"statfs":{"total":773094113280,"available":772850806784,"internally_reserved":0,"allocated":4857856,"data_stored":2754156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002100"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235513+0000","last_change":"2024-04-25T09:02:50.247526+0000","last_active":"2024-04-25T09:02:51.235513+0000","last_peered":"2024-04-25T09:02:51.235513+0000","last_clean":"2024-04-25T09:02:51.235513+0000","last_became_active":"2024-04-25T09:02:50.247177+0000","last_became_peered":"2024-04-25T09:02:50.247177+0000","last_unstale":"2024-04-25T09:02:51.235513+0000","last_undegraded":"2024-04-25T09:02:51.235513+0000","last_fullsized":"2024-04-25T09:02:51.235513+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:23:53.371096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235353+0000","last_change":"2024-04-25T09:02:50.236782+0000","last_active":"2024-04-25T09:02:51.235353+0000","last_peered":"2024-04-25T09:02:51.235353+0000","last_clean":"2024-04-25T09:02:51.235353+0000","last_became_active":"2024-04-25T09:02:50.236498+0000","last_became_peered":"2024-04-25T09:02:50.236498+0000","last_unstale":"2024-04-25T09:02:51.235353+0000","last_undegraded":"2024-04-25T09:02:51.235353+0000","last_fullsized":"2024-04-25T09:02:51.235353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:40.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315670+0000","last_change":"2024-04-25T09:02:50.258294+0000","last_active":"2024-04-25T09:02:51.315670+0000","last_peered":"2024-04-25T09:02:51.315670+0000","last_clean":"2024-04-25T09:02:51.315670+0000","last_became_active":"2024-04-25T09:02:50.258069+0000","last_became_peered":"2024-04-25T09:02:50.258069+0000","last_unstale":"2024-04-25T09:02:51.315670+0000","last_undegraded":"2024-04-25T09:02:51.315670+0000","last_fullsized":"2024-04-25T09:02:51.315670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:47.424704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.242022+0000","last_change":"2024-04-25T09:02:50.241607+0000","last_active":"2024-04-25T09:02:51.242022+0000","last_peered":"2024-04-25T09:02:51.242022+0000","last_clean":"2024-04-25T09:02:51.242022+0000","last_became_active":"2024-04-25T09:02:50.234815+0000","last_became_peered":"2024-04-25T09:02:50.234815+0000","last_unstale":"2024-04-25T09:02:51.242022+0000","last_undegraded":"2024-04-25T09:02:51.242022+0000","last_fullsized":"2024-04-25T09:02:51.242022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:35.845853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.241885+0000","last_change":"2024-04-25T09:02:50.235190+0000","last_active":"2024-04-25T09:02:51.241885+0000","last_peered":"2024-04-25T09:02:51.241885+0000","last_clean":"2024-04-25T09:02:51.241885+0000","last_became_active":"2024-04-25T09:02:50.234867+0000","last_became_peered":"2024-04-25T09:02:50.234867+0000","last_unstale":"2024-04-25T09:02:51.241885+0000","last_undegraded":"2024-04-25T09:02:51.241885+0000","last_fullsized":"2024-04-25T09:02:51.241885+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:37.536427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315003+0000","last_change":"2024-04-25T09:02:50.251982+0000","last_active":"2024-04-25T09:02:51.315003+0000","last_peered":"2024-04-25T09:02:51.315003+0000","last_clean":"2024-04-25T09:02:51.315003+0000","last_became_active":"2024-04-25T09:02:50.251662+0000","last_became_peered":"2024-04-25T09:02:50.251662+0000","last_unstale":"2024-04-25T09:02:51.315003+0000","last_undegraded":"2024-04-25T09:02:51.315003+0000","last_fullsized":"2024-04-25T09:02:51.315003+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:40.755865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235603+0000","last_change":"2024-04-25T09:02:50.237500+0000","last_active":"2024-04-25T09:02:51.235603+0000","last_peered":"2024-04-25T09:02:51.235603+0000","last_clean":"2024-04-25T09:02:51.235603+0000","last_became_active":"2024-04-25T09:02:50.237209+0000","last_became_peered":"2024-04-25T09:02:50.237209+0000","last_unstale":"2024-04-25T09:02:51.235603+0000","last_undegraded":"2024-04-25T09:02:51.235603+0000","last_fullsized":"2024-04-25T09:02:51.235603+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:29.959421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.234681+0000","last_change":"2024-04-25T09:02:50.247875+0000","last_active":"2024-04-25T09:02:51.234681+0000","last_peered":"2024-04-25T09:02:51.234681+0000","last_clean":"2024-04-25T09:02:51.234681+0000","last_became_active":"2024-04-25T09:02:50.247602+0000","last_became_peered":"2024-04-25T09:02:50.247602+0000","last_unstale":"2024-04-25T09:02:51.234681+0000","last_undegraded":"2024-04-25T09:02:51.234681+0000","last_fullsized":"2024-04-25T09:02:51.234681+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:48.931852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315959+0000","last_change":"2024-04-25T09:02:50.242566+0000","last_active":"2024-04-25T09:02:51.315959+0000","last_peered":"2024-04-25T09:02:51.315959+0000","last_clean":"2024-04-25T09:02:51.315959+0000","last_became_active":"2024-04-25T09:02:50.242233+0000","last_became_peered":"2024-04-25T09:02:50.242233+0000","last_unstale":"2024-04-25T09:02:51.315959+0000","last_undegraded":"2024-04-25T09:02:51.315959+0000","last_fullsized":"2024-04-25T09:02:51.315959+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:17.436435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236363+0000","last_change":"2024-04-25T09:02:50.249373+0000","last_active":"2024-04-25T09:02:51.236363+0000","last_peered":"2024-04-25T09:02:51.236363+0000","last_clean":"2024-04-25T09:02:51.236363+0000","last_became_active":"2024-04-25T09:02:50.249163+0000","last_became_peered":"2024-04-25T09:02:50.249163+0000","last_unstale":"2024-04-25T09:02:51.236363+0000","last_undegraded":"2024-04-25T09:02:51.236363+0000","last_fullsized":"2024-04-25T09:02:51.236363+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:38:40.328337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236373+0000","last_change":"2024-04-25T09:02:50.231362+0000","last_active":"2024-04-25T09:02:51.236373+0000","last_peered":"2024-04-25T09:02:51.236373+0000","last_clean":"2024-04-25T09:02:51.236373+0000","last_became_active":"2024-04-25T09:02:50.231100+0000","last_became_peered":"2024-04-25T09:02:50.231100+0000","last_unstale":"2024-04-25T09:02:51.236373+0000","last_undegraded":"2024-04-25T09:02:51.236373+0000","last_fullsized":"2024-04-25T09:02:51.236373+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:58.168185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315493+0000","last_change":"2024-04-25T09:02:50.256297+0000","last_active":"2024-04-25T09:02:51.315493+0000","last_peered":"2024-04-25T09:02:51.315493+0000","last_clean":"2024-04-25T09:02:51.315493+0000","last_became_active":"2024-04-25T09:02:50.256008+0000","last_became_peered":"2024-04-25T09:02:50.256008+0000","last_unstale":"2024-04-25T09:02:51.315493+0000","last_undegraded":"2024-04-25T09:02:51.315493+0000","last_fullsized":"2024-04-25T09:02:51.315493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:51.139755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235877+0000","last_change":"2024-04-25T09:02:50.259534+0000","last_active":"2024-04-25T09:02:51.235877+0000","last_peered":"2024-04-25T09:02:51.235877+0000","last_clean":"2024-04-25T09:02:51.235877+0000","last_became_active":"2024-04-25T09:02:50.259234+0000","last_became_peered":"2024-04-25T09:02:50.259234+0000","last_unstale":"2024-04-25T09:02:51.235877+0000","last_undegraded":"2024-04-25T09:02:51.235877+0000","last_fullsized":"2024-04-25T09:02:51.235877+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:39.197119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236937+0000","last_change":"2024-04-25T09:02:50.244396+0000","last_active":"2024-04-25T09:02:51.236937+0000","last_peered":"2024-04-25T09:02:51.236937+0000","last_clean":"2024-04-25T09:02:51.236937+0000","last_became_active":"2024-04-25T09:02:50.244142+0000","last_became_peered":"2024-04-25T09:02:50.244142+0000","last_unstale":"2024-04-25T09:02:51.236937+0000","last_undegraded":"2024-04-25T09:02:51.236937+0000","last_fullsized":"2024-04-25T09:02:51.236937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:10.397533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235638+0000","last_change":"2024-04-25T09:02:50.237385+0000","last_active":"2024-04-25T09:02:51.235638+0000","last_peered":"2024-04-25T09:02:51.235638+0000","last_clean":"2024-04-25T09:02:51.235638+0000","last_became_active":"2024-04-25T09:02:50.236873+0000","last_became_peered":"2024-04-25T09:02:50.236873+0000","last_unstale":"2024-04-25T09:02:51.235638+0000","last_undegraded":"2024-04-25T09:02:51.235638+0000","last_fullsized":"2024-04-25T09:02:51.235638+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:22.294075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316537+0000","last_change":"2024-04-25T09:02:50.256558+0000","last_active":"2024-04-25T09:02:51.316537+0000","last_peered":"2024-04-25T09:02:51.316537+0000","last_clean":"2024-04-25T09:02:51.316537+0000","last_became_active":"2024-04-25T09:02:50.256276+0000","last_became_peered":"2024-04-25T09:02:50.256276+0000","last_unstale":"2024-04-25T09:02:51.316537+0000","last_undegraded":"2024-04-25T09:02:51.316537+0000","last_fullsized":"2024-04-25T09:02:51.316537+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:39.197119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316558+0000","last_change":"2024-04-25T09:02:50.250389+0000","last_active":"2024-04-25T09:02:51.316558+0000","last_peered":"2024-04-25T09:02:51.316558+0000","last_clean":"2024-04-25T09:02:51.316558+0000","last_became_active":"2024-04-25T09:02:50.248939+0000","last_became_peered":"2024-04-25T09:02:50.248939+0000","last_unstale":"2024-04-25T09:02:51.316558+0000","last_undegraded":"2024-04-25T09:02:51.316558+0000","last_fullsized":"2024-04-25T09:02:51.316558+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:05.422996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316934+0000","last_change":"2024-04-25T09:02:50.244387+0000","last_active":"2024-04-25T09:02:51.316934+0000","last_peered":"2024-04-25T09:02:51.316934+0000","last_clean":"2024-04-25T09:02:51.316934+0000","last_became_active":"2024-04-25T09:02:50.244129+0000","last_became_peered":"2024-04-25T09:02:50.244129+0000","last_unstale":"2024-04-25T09:02:51.316934+0000","last_undegraded":"2024-04-25T09:02:51.316934+0000","last_fullsized":"2024-04-25T09:02:51.316934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:10.397533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.242091+0000","last_change":"2024-04-25T09:02:50.261714+0000","last_active":"2024-04-25T09:02:51.242091+0000","last_peered":"2024-04-25T09:02:51.242091+0000","last_clean":"2024-04-25T09:02:51.242091+0000","last_became_active":"2024-04-25T09:02:50.261360+0000","last_became_peered":"2024-04-25T09:02:50.261360+0000","last_unstale":"2024-04-25T09:02:51.242091+0000","last_undegraded":"2024-04-25T09:02:51.242091+0000","last_fullsized":"2024-04-25T09:02:51.242091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:50.494186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316965+0000","last_change":"2024-04-25T09:02:50.245103+0000","last_active":"2024-04-25T09:02:51.316965+0000","last_peered":"2024-04-25T09:02:51.316965+0000","last_clean":"2024-04-25T09:02:51.316965+0000","last_became_active":"2024-04-25T09:02:50.244849+0000","last_became_peered":"2024-04-25T09:02:50.244849+0000","last_unstale":"2024-04-25T09:02:51.316965+0000","last_undegraded":"2024-04-25T09:02:51.316965+0000","last_fullsized":"2024-04-25T09:02:51.316965+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:40.755865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236069+0000","last_change":"2024-04-25T09:02:50.252574+0000","last_active":"2024-04-25T09:02:51.236069+0000","last_peered":"2024-04-25T09:02:51.236069+0000","last_clean":"2024-04-25T09:02:51.236069+0000","last_became_active":"2024-04-25T09:02:50.252339+0000","last_became_peered":"2024-04-25T09:02:50.252339+0000","last_unstale":"2024-04-25T09:02:51.236069+0000","last_undegraded":"2024-04-25T09:02:51.236069+0000","last_fullsized":"2024-04-25T09:02:51.236069+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:27.529710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237459+0000","last_change":"2024-04-25T09:02:50.241887+0000","last_active":"2024-04-25T09:02:51.237459+0000","last_peered":"2024-04-25T09:02:51.237459+0000","last_clean":"2024-04-25T09:02:51.237459+0000","last_became_active":"2024-04-25T09:02:50.241624+0000","last_became_peered":"2024-04-25T09:02:50.241624+0000","last_unstale":"2024-04-25T09:02:51.237459+0000","last_undegraded":"2024-04-25T09:02:51.237459+0000","last_fullsized":"2024-04-25T09:02:51.237459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:39.824663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316939+0000","last_change":"2024-04-25T09:02:50.257049+0000","last_active":"2024-04-25T09:02:51.316939+0000","last_peered":"2024-04-25T09:02:51.316939+0000","last_clean":"2024-04-25T09:02:51.316939+0000","last_became_active":"2024-04-25T09:02:50.256449+0000","last_became_peered":"2024-04-25T09:02:50.256449+0000","last_unstale":"2024-04-25T09:02:51.316939+0000","last_undegraded":"2024-04-25T09:02:51.316939+0000","last_fullsized":"2024-04-25T09:02:51.316939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:52.065013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.241737+0000","last_change":"2024-04-25T09:02:50.244062+0000","last_active":"2024-04-25T09:02:51.241737+0000","last_peered":"2024-04-25T09:02:51.241737+0000","last_clean":"2024-04-25T09:02:51.241737+0000","last_became_active":"2024-04-25T09:02:50.242935+0000","last_became_peered":"2024-04-25T09:02:50.242935+0000","last_unstale":"2024-04-25T09:02:51.241737+0000","last_undegraded":"2024-04-25T09:02:51.241737+0000","last_fullsized":"2024-04-25T09:02:51.241737+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:37:39.309971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.317046+0000","last_change":"2024-04-25T09:02:50.253153+0000","last_active":"2024-04-25T09:02:51.317046+0000","last_peered":"2024-04-25T09:02:51.317046+0000","last_clean":"2024-04-25T09:02:51.317046+0000","last_became_active":"2024-04-25T09:02:50.252886+0000","last_became_peered":"2024-04-25T09:02:50.252886+0000","last_unstale":"2024-04-25T09:02:51.317046+0000","last_undegraded":"2024-04-25T09:02:51.317046+0000","last_fullsized":"2024-04-25T09:02:51.317046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:06.873106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316177+0000","last_change":"2024-04-25T09:02:50.259979+0000","last_active":"2024-04-25T09:02:51.316177+0000","last_peered":"2024-04-25T09:02:51.316177+0000","last_clean":"2024-04-25T09:02:51.316177+0000","last_became_active":"2024-04-25T09:02:50.259250+0000","last_became_peered":"2024-04-25T09:02:50.259250+0000","last_unstale":"2024-04-25T09:02:51.316177+0000","last_undegraded":"2024-04-25T09:02:51.316177+0000","last_fullsized":"2024-04-25T09:02:51.316177+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:51.139755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316859+0000","last_change":"2024-04-25T09:02:50.251132+0000","last_active":"2024-04-25T09:02:51.316859+0000","last_peered":"2024-04-25T09:02:51.316859+0000","last_clean":"2024-04-25T09:02:51.316859+0000","last_became_active":"2024-04-25T09:02:50.250842+0000","last_became_peered":"2024-04-25T09:02:50.250842+0000","last_unstale":"2024-04-25T09:02:51.316859+0000","last_undegraded":"2024-04-25T09:02:51.316859+0000","last_fullsized":"2024-04-25T09:02:51.316859+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:12.613008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236011+0000","last_change":"2024-04-25T09:02:50.238634+0000","last_active":"2024-04-25T09:02:51.236011+0000","last_peered":"2024-04-25T09:02:51.236011+0000","last_clean":"2024-04-25T09:02:51.236011+0000","last_became_active":"2024-04-25T09:02:50.238332+0000","last_became_peered":"2024-04-25T09:02:50.238332+0000","last_unstale":"2024-04-25T09:02:51.236011+0000","last_undegraded":"2024-04-25T09:02:51.236011+0000","last_fullsized":"2024-04-25T09:02:51.236011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:39.037987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316763+0000","last_change":"2024-04-25T09:02:50.251851+0000","last_active":"2024-04-25T09:02:51.316763+0000","last_peered":"2024-04-25T09:02:51.316763+0000","last_clean":"2024-04-25T09:02:51.316763+0000","last_became_active":"2024-04-25T09:02:50.250492+0000","last_became_peered":"2024-04-25T09:02:50.250492+0000","last_unstale":"2024-04-25T09:02:51.316763+0000","last_undegraded":"2024-04-25T09:02:51.316763+0000","last_fullsized":"2024-04-25T09:02:51.316763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:04.266193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316188+0000","last_change":"2024-04-25T09:02:50.241045+0000","last_active":"2024-04-25T09:02:51.316188+0000","last_peered":"2024-04-25T09:02:51.316188+0000","last_clean":"2024-04-25T09:02:51.316188+0000","last_became_active":"2024-04-25T09:02:50.240478+0000","last_became_peered":"2024-04-25T09:02:50.240478+0000","last_unstale":"2024-04-25T09:02:51.316188+0000","last_undegraded":"2024-04-25T09:02:51.316188+0000","last_fullsized":"2024-04-25T09:02:51.316188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:34.725450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316701+0000","last_change":"2024-04-25T09:02:50.257310+0000","last_active":"2024-04-25T09:02:51.316701+0000","last_peered":"2024-04-25T09:02:51.316701+0000","last_clean":"2024-04-25T09:02:51.316701+0000","last_became_active":"2024-04-25T09:02:50.256720+0000","last_became_peered":"2024-04-25T09:02:50.256720+0000","last_unstale":"2024-04-25T09:02:51.316701+0000","last_undegraded":"2024-04-25T09:02:51.316701+0000","last_fullsized":"2024-04-25T09:02:51.316701+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:39.037987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315055+0000","last_change":"2024-04-25T09:02:50.250530+0000","last_active":"2024-04-25T09:02:51.315055+0000","last_peered":"2024-04-25T09:02:51.315055+0000","last_clean":"2024-04-25T09:02:51.315055+0000","last_became_active":"2024-04-25T09:02:50.250231+0000","last_became_peered":"2024-04-25T09:02:50.250231+0000","last_unstale":"2024-04-25T09:02:51.315055+0000","last_undegraded":"2024-04-25T09:02:51.315055+0000","last_fullsized":"2024-04-25T09:02:51.315055+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:06.873106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316309+0000","last_change":"2024-04-25T09:02:50.258157+0000","last_active":"2024-04-25T09:02:51.316309+0000","last_peered":"2024-04-25T09:02:51.316309+0000","last_clean":"2024-04-25T09:02:51.316309+0000","last_became_active":"2024-04-25T09:02:50.257857+0000","last_became_peered":"2024-04-25T09:02:50.257857+0000","last_unstale":"2024-04-25T09:02:51.316309+0000","last_undegraded":"2024-04-25T09:02:51.316309+0000","last_fullsized":"2024-04-25T09:02:51.316309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:37.777098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316974+0000","last_change":"2024-04-25T09:02:49.232545+0000","last_active":"2024-04-25T09:02:51.316974+0000","last_peered":"2024-04-25T09:02:51.316974+0000","last_clean":"2024-04-25T09:02:51.316974+0000","last_became_active":"2024-04-25T09:02:49.232210+0000","last_became_peered":"2024-04-25T09:02:49.232210+0000","last_unstale":"2024-04-25T09:02:51.316974+0000","last_undegraded":"2024-04-25T09:02:51.316974+0000","last_fullsized":"2024-04-25T09:02:51.316974+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:49.487103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316118+0000","last_change":"2024-04-25T09:02:50.259567+0000","last_active":"2024-04-25T09:02:51.316118+0000","last_peered":"2024-04-25T09:02:51.316118+0000","last_clean":"2024-04-25T09:02:51.316118+0000","last_became_active":"2024-04-25T09:02:50.259150+0000","last_became_peered":"2024-04-25T09:02:50.259150+0000","last_unstale":"2024-04-25T09:02:51.316118+0000","last_undegraded":"2024-04-25T09:02:51.316118+0000","last_fullsized":"2024-04-25T09:02:51.316118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:39.437873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315829+0000","last_change":"2024-04-25T09:02:49.235883+0000","last_active":"2024-04-25T09:02:51.315829+0000","last_peered":"2024-04-25T09:02:51.315829+0000","last_clean":"2024-04-25T09:02:51.315829+0000","last_became_active":"2024-04-25T09:02:49.235596+0000","last_became_peered":"2024-04-25T09:02:49.235596+0000","last_unstale":"2024-04-25T09:02:51.315829+0000","last_undegraded":"2024-04-25T09:02:51.315829+0000","last_fullsized":"2024-04-25T09:02:51.315829+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:01.239512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237388+0000","last_change":"2024-04-25T09:02:50.244387+0000","last_active":"2024-04-25T09:02:51.237388+0000","last_peered":"2024-04-25T09:02:51.237388+0000","last_clean":"2024-04-25T09:02:51.237388+0000","last_became_active":"2024-04-25T09:02:50.244110+0000","last_became_peered":"2024-04-25T09:02:50.244110+0000","last_unstale":"2024-04-25T09:02:51.237388+0000","last_undegraded":"2024-04-25T09:02:51.237388+0000","last_fullsized":"2024-04-25T09:02:51.237388+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:41:51.139755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316194+0000","last_change":"2024-04-25T09:02:49.229405+0000","last_active":"2024-04-25T09:02:51.316194+0000","last_peered":"2024-04-25T09:02:51.316194+0000","last_clean":"2024-04-25T09:02:51.316194+0000","last_became_active":"2024-04-25T09:02:49.228291+0000","last_became_peered":"2024-04-25T09:02:49.228291+0000","last_unstale":"2024-04-25T09:02:51.316194+0000","last_undegraded":"2024-04-25T09:02:51.316194+0000","last_fullsized":"2024-04-25T09:02:51.316194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:51.351917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235511+0000","last_change":"2024-04-25T09:02:50.240592+0000","last_active":"2024-04-25T09:02:51.235511+0000","last_peered":"2024-04-25T09:02:51.235511+0000","last_clean":"2024-04-25T09:02:51.235511+0000","last_became_active":"2024-04-25T09:02:50.240356+0000","last_became_peered":"2024-04-25T09:02:50.240356+0000","last_unstale":"2024-04-25T09:02:51.235511+0000","last_undegraded":"2024-04-25T09:02:51.235511+0000","last_fullsized":"2024-04-25T09:02:51.235511+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.888999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237843+0000","last_change":"2024-04-25T09:02:49.231000+0000","last_active":"2024-04-25T09:02:51.237843+0000","last_peered":"2024-04-25T09:02:51.237843+0000","last_clean":"2024-04-25T09:02:51.237843+0000","last_became_active":"2024-04-25T09:02:49.230712+0000","last_became_peered":"2024-04-25T09:02:49.230712+0000","last_unstale":"2024-04-25T09:02:51.237843+0000","last_undegraded":"2024-04-25T09:02:51.237843+0000","last_fullsized":"2024-04-25T09:02:51.237843+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:36.529344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315463+0000","last_change":"2024-04-25T09:02:50.246208+0000","last_active":"2024-04-25T09:02:51.315463+0000","last_peered":"2024-04-25T09:02:51.315463+0000","last_clean":"2024-04-25T09:02:51.315463+0000","last_became_active":"2024-04-25T09:02:50.245883+0000","last_became_peered":"2024-04-25T09:02:50.245883+0000","last_unstale":"2024-04-25T09:02:51.315463+0000","last_undegraded":"2024-04-25T09:02:51.315463+0000","last_fullsized":"2024-04-25T09:02:51.315463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:39.437873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236213+0000","last_change":"2024-04-25T09:02:49.233023+0000","last_active":"2024-04-25T09:02:51.236213+0000","last_peered":"2024-04-25T09:02:51.236213+0000","last_clean":"2024-04-25T09:02:51.236213+0000","last_became_active":"2024-04-25T09:02:49.232394+0000","last_became_peered":"2024-04-25T09:02:49.232394+0000","last_unstale":"2024-04-25T09:02:51.236213+0000","last_undegraded":"2024-04-25T09:02:51.236213+0000","last_fullsized":"2024-04-25T09:02:51.236213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:33.718367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235854+0000","last_change":"2024-04-25T09:02:50.253833+0000","last_active":"2024-04-25T09:02:51.235854+0000","last_peered":"2024-04-25T09:02:51.235854+0000","last_clean":"2024-04-25T09:02:51.235854+0000","last_became_active":"2024-04-25T09:02:50.253548+0000","last_became_peered":"2024-04-25T09:02:50.253548+0000","last_unstale":"2024-04-25T09:02:51.235854+0000","last_undegraded":"2024-04-25T09:02:51.235854+0000","last_fullsized":"2024-04-25T09:02:51.235854+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:48.931852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316294+0000","last_change":"2024-04-25T09:02:49.236881+0000","last_active":"2024-04-25T09:02:51.316294+0000","last_peered":"2024-04-25T09:02:51.316294+0000","last_clean":"2024-04-25T09:02:51.316294+0000","last_became_active":"2024-04-25T09:02:49.236588+0000","last_became_peered":"2024-04-25T09:02:49.236588+0000","last_unstale":"2024-04-25T09:02:51.316294+0000","last_undegraded":"2024-04-25T09:02:51.316294+0000","last_fullsized":"2024-04-25T09:02:51.316294+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:03.259110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237240+0000","last_change":"2024-04-25T09:02:50.235971+0000","last_active":"2024-04-25T09:02:51.237240+0000","last_peered":"2024-04-25T09:02:51.237240+0000","last_clean":"2024-04-25T09:02:51.237240+0000","last_became_active":"2024-04-25T09:02:50.235720+0000","last_became_peered":"2024-04-25T09:02:50.235720+0000","last_unstale":"2024-04-25T09:02:51.237240+0000","last_undegraded":"2024-04-25T09:02:51.237240+0000","last_fullsized":"2024-04-25T09:02:51.237240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:01.641921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315026+0000","last_change":"2024-04-25T09:02:49.236095+0000","last_active":"2024-04-25T09:02:51.315026+0000","last_peered":"2024-04-25T09:02:51.315026+0000","last_clean":"2024-04-25T09:02:51.315026+0000","last_became_active":"2024-04-25T09:02:49.235806+0000","last_became_peered":"2024-04-25T09:02:49.235806+0000","last_unstale":"2024-04-25T09:02:51.315026+0000","last_undegraded":"2024-04-25T09:02:51.315026+0000","last_fullsized":"2024-04-25T09:02:51.315026+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:49.487103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.234869+0000","last_change":"2024-04-25T09:02:50.261806+0000","last_active":"2024-04-25T09:02:51.234869+0000","last_peered":"2024-04-25T09:02:51.234869+0000","last_clean":"2024-04-25T09:02:51.234869+0000","last_became_active":"2024-04-25T09:02:50.260186+0000","last_became_peered":"2024-04-25T09:02:50.260186+0000","last_unstale":"2024-04-25T09:02:51.234869+0000","last_undegraded":"2024-04-25T09:02:51.234869+0000","last_fullsized":"2024-04-25T09:02:51.234869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:05.422996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236795+0000","last_change":"2024-04-25T09:02:49.230266+0000","last_active":"2024-04-25T09:02:51.236795+0000","last_peered":"2024-04-25T09:02:51.236795+0000","last_clean":"2024-04-25T09:02:51.236795+0000","last_became_active":"2024-04-25T09:02:49.230000+0000","last_became_peered":"2024-04-25T09:02:49.230000+0000","last_unstale":"2024-04-25T09:02:51.236795+0000","last_undegraded":"2024-04-25T09:02:51.236795+0000","last_fullsized":"2024-04-25T09:02:51.236795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:49.487103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.242097+0000","last_change":"2024-04-25T09:02:50.240131+0000","last_active":"2024-04-25T09:02:51.242097+0000","last_peered":"2024-04-25T09:02:51.242097+0000","last_clean":"2024-04-25T09:02:51.242097+0000","last_became_active":"2024-04-25T09:02:50.239876+0000","last_became_peered":"2024-04-25T09:02:50.239876+0000","last_unstale":"2024-04-25T09:02:51.242097+0000","last_undegraded":"2024-04-25T09:02:51.242097+0000","last_fullsized":"2024-04-25T09:02:51.242097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:19.842311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235603+0000","last_change":"2024-04-25T09:02:49.232268+0000","last_active":"2024-04-25T09:02:51.235603+0000","last_peered":"2024-04-25T09:02:51.235603+0000","last_clean":"2024-04-25T09:02:51.235603+0000","last_became_active":"2024-04-25T09:02:49.232019+0000","last_became_peered":"2024-04-25T09:02:49.232019+0000","last_unstale":"2024-04-25T09:02:51.235603+0000","last_undegraded":"2024-04-25T09:02:51.235603+0000","last_fullsized":"2024-04-25T09:02:51.235603+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:05.866023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316324+0000","last_change":"2024-04-25T09:02:50.247028+0000","last_active":"2024-04-25T09:02:51.316324+0000","last_peered":"2024-04-25T09:02:51.316324+0000","last_clean":"2024-04-25T09:02:51.316324+0000","last_became_active":"2024-04-25T09:02:50.246742+0000","last_became_peered":"2024-04-25T09:02:50.246742+0000","last_unstale":"2024-04-25T09:02:51.316324+0000","last_undegraded":"2024-04-25T09:02:51.316324+0000","last_fullsized":"2024-04-25T09:02:51.316324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:29.959421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236290+0000","last_change":"2024-04-25T09:02:49.233904+0000","last_active":"2024-04-25T09:02:51.236290+0000","last_peered":"2024-04-25T09:02:51.236290+0000","last_clean":"2024-04-25T09:02:51.236290+0000","last_became_active":"2024-04-25T09:02:49.233609+0000","last_became_peered":"2024-04-25T09:02:49.233609+0000","last_unstale":"2024-04-25T09:02:51.236290+0000","last_undegraded":"2024-04-25T09:02:51.236290+0000","last_fullsized":"2024-04-25T09:02:51.236290+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:11.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315713+0000","last_change":"2024-04-25T09:02:50.263197+0000","last_active":"2024-04-25T09:02:51.315713+0000","last_peered":"2024-04-25T09:02:51.315713+0000","last_clean":"2024-04-25T09:02:51.315713+0000","last_became_active":"2024-04-25T09:02:50.262912+0000","last_became_peered":"2024-04-25T09:02:50.262912+0000","last_unstale":"2024-04-25T09:02:51.315713+0000","last_undegraded":"2024-04-25T09:02:51.315713+0000","last_fullsized":"2024-04-25T09:02:51.315713+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:45.748241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236494+0000","last_change":"2024-04-25T09:02:49.236426+0000","last_active":"2024-04-25T09:02:51.236494+0000","last_peered":"2024-04-25T09:02:51.236494+0000","last_clean":"2024-04-25T09:02:51.236494+0000","last_became_active":"2024-04-25T09:02:49.236159+0000","last_became_peered":"2024-04-25T09:02:49.236159+0000","last_unstale":"2024-04-25T09:02:51.236494+0000","last_undegraded":"2024-04-25T09:02:51.236494+0000","last_fullsized":"2024-04-25T09:02:51.236494+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:09.390450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237232+0000","last_change":"2024-04-25T09:02:50.242937+0000","last_active":"2024-04-25T09:02:51.237232+0000","last_peered":"2024-04-25T09:02:51.237232+0000","last_clean":"2024-04-25T09:02:51.237232+0000","last_became_active":"2024-04-25T09:02:50.242702+0000","last_became_peered":"2024-04-25T09:02:50.242702+0000","last_unstale":"2024-04-25T09:02:51.237232+0000","last_undegraded":"2024-04-25T09:02:51.237232+0000","last_fullsized":"2024-04-25T09:02:51.237232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:06.873106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.234991+0000","last_change":"2024-04-25T09:02:49.237214+0000","last_active":"2024-04-25T09:02:51.234991+0000","last_peered":"2024-04-25T09:02:51.234991+0000","last_clean":"2024-04-25T09:02:51.234991+0000","last_became_active":"2024-04-25T09:02:49.236915+0000","last_became_peered":"2024-04-25T09:02:49.236915+0000","last_unstale":"2024-04-25T09:02:51.234991+0000","last_undegraded":"2024-04-25T09:02:51.234991+0000","last_fullsized":"2024-04-25T09:02:51.234991+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:00.634838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315379+0000","last_change":"2024-04-25T09:02:50.259533+0000","last_active":"2024-04-25T09:02:51.315379+0000","last_peered":"2024-04-25T09:02:51.315379+0000","last_clean":"2024-04-25T09:02:51.315379+0000","last_became_active":"2024-04-25T09:02:50.259274+0000","last_became_peered":"2024-04-25T09:02:50.259274+0000","last_unstale":"2024-04-25T09:02:51.315379+0000","last_undegraded":"2024-04-25T09:02:51.315379+0000","last_fullsized":"2024-04-25T09:02:51.315379+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:01.641921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235126+0000","last_change":"2024-04-25T09:02:49.237173+0000","last_active":"2024-04-25T09:02:51.235126+0000","last_peered":"2024-04-25T09:02:51.235126+0000","last_clean":"2024-04-25T09:02:51.235126+0000","last_became_active":"2024-04-25T09:02:49.236852+0000","last_became_peered":"2024-04-25T09:02:49.236852+0000","last_unstale":"2024-04-25T09:02:51.235126+0000","last_undegraded":"2024-04-25T09:02:51.235126+0000","last_fullsized":"2024-04-25T09:02:51.235126+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:39.748782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.234811+0000","last_change":"2024-04-25T09:02:50.248514+0000","last_active":"2024-04-25T09:02:51.234811+0000","last_peered":"2024-04-25T09:02:51.234811+0000","last_clean":"2024-04-25T09:02:51.234811+0000","last_became_active":"2024-04-25T09:02:50.248247+0000","last_became_peered":"2024-04-25T09:02:50.248247+0000","last_unstale":"2024-04-25T09:02:51.234811+0000","last_undegraded":"2024-04-25T09:02:51.234811+0000","last_fullsized":"2024-04-25T09:02:51.234811+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:39.197119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315132+0000","last_change":"2024-04-25T09:02:49.235898+0000","last_active":"2024-04-25T09:02:51.315132+0000","last_peered":"2024-04-25T09:02:51.315132+0000","last_clean":"2024-04-25T09:02:51.315132+0000","last_became_active":"2024-04-25T09:02:49.235616+0000","last_became_peered":"2024-04-25T09:02:49.235616+0000","last_unstale":"2024-04-25T09:02:51.315132+0000","last_undegraded":"2024-04-25T09:02:51.315132+0000","last_fullsized":"2024-04-25T09:02:51.315132+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:11.020739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316253+0000","last_change":"2024-04-25T09:02:50.252442+0000","last_active":"2024-04-25T09:02:51.316253+0000","last_peered":"2024-04-25T09:02:51.316253+0000","last_clean":"2024-04-25T09:02:51.316253+0000","last_became_active":"2024-04-25T09:02:50.252201+0000","last_became_peered":"2024-04-25T09:02:50.252201+0000","last_unstale":"2024-04-25T09:02:51.316253+0000","last_undegraded":"2024-04-25T09:02:51.316253+0000","last_fullsized":"2024-04-25T09:02:51.316253+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:48.931852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316056+0000","last_change":"2024-04-25T09:02:49.227991+0000","last_active":"2024-04-25T09:02:51.316056+0000","last_peered":"2024-04-25T09:02:51.316056+0000","last_clean":"2024-04-25T09:02:51.316056+0000","last_became_active":"2024-04-25T09:02:49.227654+0000","last_became_peered":"2024-04-25T09:02:49.227654+0000","last_unstale":"2024-04-25T09:02:51.316056+0000","last_undegraded":"2024-04-25T09:02:51.316056+0000","last_fullsized":"2024-04-25T09:02:51.316056+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:36.529344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235089+0000","last_change":"2024-04-25T09:02:50.249981+0000","last_active":"2024-04-25T09:02:51.235089+0000","last_peered":"2024-04-25T09:02:51.235089+0000","last_clean":"2024-04-25T09:02:51.235089+0000","last_became_active":"2024-04-25T09:02:50.249744+0000","last_became_peered":"2024-04-25T09:02:50.249744+0000","last_unstale":"2024-04-25T09:02:51.235089+0000","last_undegraded":"2024-04-25T09:02:51.235089+0000","last_fullsized":"2024-04-25T09:02:51.235089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:52.065013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316081+0000","last_change":"2024-04-25T09:02:49.238444+0000","last_active":"2024-04-25T09:02:51.316081+0000","last_peered":"2024-04-25T09:02:51.316081+0000","last_clean":"2024-04-25T09:02:51.316081+0000","last_became_active":"2024-04-25T09:02:49.238101+0000","last_became_peered":"2024-04-25T09:02:49.238101+0000","last_unstale":"2024-04-25T09:02:51.316081+0000","last_undegraded":"2024-04-25T09:02:51.316081+0000","last_fullsized":"2024-04-25T09:02:51.316081+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:39:51.351917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235011+0000","last_change":"2024-04-25T09:02:50.241678+0000","last_active":"2024-04-25T09:02:51.235011+0000","last_peered":"2024-04-25T09:02:51.235011+0000","last_clean":"2024-04-25T09:02:51.235011+0000","last_became_active":"2024-04-25T09:02:50.241410+0000","last_became_peered":"2024-04-25T09:02:50.241410+0000","last_unstale":"2024-04-25T09:02:51.235011+0000","last_undegraded":"2024-04-25T09:02:51.235011+0000","last_fullsized":"2024-04-25T09:02:51.235011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:27:39.037987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236206+0000","last_change":"2024-04-25T09:02:49.231946+0000","last_active":"2024-04-25T09:02:51.236206+0000","last_peered":"2024-04-25T09:02:51.236206+0000","last_clean":"2024-04-25T09:02:51.236206+0000","last_became_active":"2024-04-25T09:02:49.231493+0000","last_became_peered":"2024-04-25T09:02:49.231493+0000","last_unstale":"2024-04-25T09:02:51.236206+0000","last_undegraded":"2024-04-25T09:02:51.236206+0000","last_fullsized":"2024-04-25T09:02:51.236206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:03.259110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236430+0000","last_change":"2024-04-25T09:02:50.254009+0000","last_active":"2024-04-25T09:02:51.236430+0000","last_peered":"2024-04-25T09:02:51.236430+0000","last_clean":"2024-04-25T09:02:51.236430+0000","last_became_active":"2024-04-25T09:02:50.253741+0000","last_became_peered":"2024-04-25T09:02:50.253741+0000","last_unstale":"2024-04-25T09:02:51.236430+0000","last_undegraded":"2024-04-25T09:02:51.236430+0000","last_fullsized":"2024-04-25T09:02:51.236430+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:14.888999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237451+0000","last_change":"2024-04-25T09:02:49.235760+0000","last_active":"2024-04-25T09:02:51.237451+0000","last_peered":"2024-04-25T09:02:51.237451+0000","last_clean":"2024-04-25T09:02:51.237451+0000","last_became_active":"2024-04-25T09:02:49.235503+0000","last_became_peered":"2024-04-25T09:02:49.235503+0000","last_unstale":"2024-04-25T09:02:51.237451+0000","last_undegraded":"2024-04-25T09:02:51.237451+0000","last_fullsized":"2024-04-25T09:02:51.237451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:18.835228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237297+0000","last_change":"2024-04-25T09:02:50.250988+0000","last_active":"2024-04-25T09:02:51.237297+0000","last_peered":"2024-04-25T09:02:51.237297+0000","last_clean":"2024-04-25T09:02:51.237297+0000","last_became_active":"2024-04-25T09:02:50.250732+0000","last_became_peered":"2024-04-25T09:02:50.250732+0000","last_unstale":"2024-04-25T09:02:51.237297+0000","last_undegraded":"2024-04-25T09:02:51.237297+0000","last_fullsized":"2024-04-25T09:02:51.237297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:10:39.437873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.242059+0000","last_change":"2024-04-25T09:02:49.234792+0000","last_active":"2024-04-25T09:02:51.242059+0000","last_peered":"2024-04-25T09:02:51.242059+0000","last_clean":"2024-04-25T09:02:51.242059+0000","last_became_active":"2024-04-25T09:02:49.234481+0000","last_became_peered":"2024-04-25T09:02:49.234481+0000","last_unstale":"2024-04-25T09:02:51.242059+0000","last_undegraded":"2024-04-25T09:02:51.242059+0000","last_fullsized":"2024-04-25T09:02:51.242059+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:31:45.412628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.242303+0000","last_change":"2024-04-25T09:02:50.239124+0000","last_active":"2024-04-25T09:02:51.242303+0000","last_peered":"2024-04-25T09:02:51.242303+0000","last_clean":"2024-04-25T09:02:51.242303+0000","last_became_active":"2024-04-25T09:02:50.238938+0000","last_became_peered":"2024-04-25T09:02:50.238938+0000","last_unstale":"2024-04-25T09:02:51.242303+0000","last_undegraded":"2024-04-25T09:02:51.242303+0000","last_fullsized":"2024-04-25T09:02:51.242303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:12.027822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315343+0000","last_change":"2024-04-25T09:02:49.229398+0000","last_active":"2024-04-25T09:02:51.315343+0000","last_peered":"2024-04-25T09:02:51.315343+0000","last_clean":"2024-04-25T09:02:51.315343+0000","last_became_active":"2024-04-25T09:02:49.229026+0000","last_became_peered":"2024-04-25T09:02:49.229026+0000","last_unstale":"2024-04-25T09:02:51.315343+0000","last_undegraded":"2024-04-25T09:02:51.315343+0000","last_fullsized":"2024-04-25T09:02:51.315343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:01.239512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316271+0000","last_change":"2024-04-25T09:02:50.249345+0000","last_active":"2024-04-25T09:02:51.316271+0000","last_peered":"2024-04-25T09:02:51.316271+0000","last_clean":"2024-04-25T09:02:51.316271+0000","last_became_active":"2024-04-25T09:02:50.249043+0000","last_became_peered":"2024-04-25T09:02:50.249043+0000","last_unstale":"2024-04-25T09:02:51.316271+0000","last_undegraded":"2024-04-25T09:02:51.316271+0000","last_fullsized":"2024-04-25T09:02:51.316271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:44.640559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.241825+0000","last_change":"2024-04-25T09:02:49.234652+0000","last_active":"2024-04-25T09:02:51.241825+0000","last_peered":"2024-04-25T09:02:51.241825+0000","last_clean":"2024-04-25T09:02:51.241825+0000","last_became_active":"2024-04-25T09:02:49.234331+0000","last_became_peered":"2024-04-25T09:02:49.234331+0000","last_unstale":"2024-04-25T09:02:51.241825+0000","last_undegraded":"2024-04-25T09:02:51.241825+0000","last_fullsized":"2024-04-25T09:02:51.241825+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:54.120331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315583+0000","last_change":"2024-04-25T09:02:50.263469+0000","last_active":"2024-04-25T09:02:51.315583+0000","last_peered":"2024-04-25T09:02:51.315583+0000","last_clean":"2024-04-25T09:02:51.315583+0000","last_became_active":"2024-04-25T09:02:50.262128+0000","last_became_peered":"2024-04-25T09:02:50.262128+0000","last_unstale":"2024-04-25T09:02:51.315583+0000","last_undegraded":"2024-04-25T09:02:51.315583+0000","last_fullsized":"2024-04-25T09:02:51.315583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:25:39.824663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.241868+0000","last_change":"2024-04-25T09:02:49.234855+0000","last_active":"2024-04-25T09:02:51.241868+0000","last_peered":"2024-04-25T09:02:51.241868+0000","last_clean":"2024-04-25T09:02:51.241868+0000","last_became_active":"2024-04-25T09:02:49.234276+0000","last_became_peered":"2024-04-25T09:02:49.234276+0000","last_unstale":"2024-04-25T09:02:51.241868+0000","last_undegraded":"2024-04-25T09:02:51.241868+0000","last_fullsized":"2024-04-25T09:02:51.241868+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:45:44.481682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235906+0000","last_change":"2024-04-25T09:02:50.240819+0000","last_active":"2024-04-25T09:02:51.235906+0000","last_peered":"2024-04-25T09:02:51.235906+0000","last_clean":"2024-04-25T09:02:51.235906+0000","last_became_active":"2024-04-25T09:02:50.240573+0000","last_became_peered":"2024-04-25T09:02:50.240573+0000","last_unstale":"2024-04-25T09:02:51.235906+0000","last_undegraded":"2024-04-25T09:02:51.235906+0000","last_fullsized":"2024-04-25T09:02:51.235906+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:05.422996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316795+0000","last_change":"2024-04-25T09:02:49.237611+0000","last_active":"2024-04-25T09:02:51.316795+0000","last_peered":"2024-04-25T09:02:51.316795+0000","last_clean":"2024-04-25T09:02:51.316795+0000","last_became_active":"2024-04-25T09:02:49.237238+0000","last_became_peered":"2024-04-25T09:02:49.237238+0000","last_unstale":"2024-04-25T09:02:51.316795+0000","last_undegraded":"2024-04-25T09:02:51.316795+0000","last_fullsized":"2024-04-25T09:02:51.316795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:40:33.718367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235035+0000","last_change":"2024-04-25T09:02:50.262028+0000","last_active":"2024-04-25T09:02:51.235035+0000","last_peered":"2024-04-25T09:02:51.235035+0000","last_clean":"2024-04-25T09:02:51.235035+0000","last_became_active":"2024-04-25T09:02:50.260037+0000","last_became_peered":"2024-04-25T09:02:50.260037+0000","last_unstale":"2024-04-25T09:02:51.235035+0000","last_undegraded":"2024-04-25T09:02:51.235035+0000","last_fullsized":"2024-04-25T09:02:51.235035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:27.529710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.241674+0000","last_change":"2024-04-25T09:02:49.228571+0000","last_active":"2024-04-25T09:02:51.241674+0000","last_peered":"2024-04-25T09:02:51.241674+0000","last_clean":"2024-04-25T09:02:51.241674+0000","last_became_active":"2024-04-25T09:02:49.228289+0000","last_became_peered":"2024-04-25T09:02:49.228289+0000","last_unstale":"2024-04-25T09:02:51.241674+0000","last_undegraded":"2024-04-25T09:02:51.241674+0000","last_fullsized":"2024-04-25T09:02:51.241674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:28.465953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315271+0000","last_change":"2024-04-25T09:02:50.259458+0000","last_active":"2024-04-25T09:02:51.315271+0000","last_peered":"2024-04-25T09:02:51.315271+0000","last_clean":"2024-04-25T09:02:51.315271+0000","last_became_active":"2024-04-25T09:02:50.259143+0000","last_became_peered":"2024-04-25T09:02:50.259143+0000","last_unstale":"2024-04-25T09:02:51.315271+0000","last_undegraded":"2024-04-25T09:02:51.315271+0000","last_fullsized":"2024-04-25T09:02:51.315271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:01.641921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236306+0000","last_change":"2024-04-25T09:02:49.236567+0000","last_active":"2024-04-25T09:02:51.236306+0000","last_peered":"2024-04-25T09:02:51.236306+0000","last_clean":"2024-04-25T09:02:51.236306+0000","last_became_active":"2024-04-25T09:02:49.236293+0000","last_became_peered":"2024-04-25T09:02:49.236293+0000","last_unstale":"2024-04-25T09:02:51.236306+0000","last_undegraded":"2024-04-25T09:02:51.236306+0000","last_fullsized":"2024-04-25T09:02:51.236306+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:39.748782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316360+0000","last_change":"2024-04-25T09:02:50.248743+0000","last_active":"2024-04-25T09:02:51.316360+0000","last_peered":"2024-04-25T09:02:51.316360+0000","last_clean":"2024-04-25T09:02:51.316360+0000","last_became_active":"2024-04-25T09:02:50.248491+0000","last_became_peered":"2024-04-25T09:02:50.248491+0000","last_unstale":"2024-04-25T09:02:51.316360+0000","last_undegraded":"2024-04-25T09:02:51.316360+0000","last_fullsized":"2024-04-25T09:02:51.316360+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:23:22.294075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.242163+0000","last_change":"2024-04-25T09:02:49.222270+0000","last_active":"2024-04-25T09:02:51.242163+0000","last_peered":"2024-04-25T09:02:51.242163+0000","last_clean":"2024-04-25T09:02:51.242163+0000","last_became_active":"2024-04-25T09:02:49.221997+0000","last_became_peered":"2024-04-25T09:02:49.221997+0000","last_unstale":"2024-04-25T09:02:51.242163+0000","last_undegraded":"2024-04-25T09:02:51.242163+0000","last_fullsized":"2024-04-25T09:02:51.242163+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:06:45.926115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.235353+0000","last_change":"2024-04-25T09:02:50.239909+0000","last_active":"2024-04-25T09:02:51.235353+0000","last_peered":"2024-04-25T09:02:51.235353+0000","last_clean":"2024-04-25T09:02:51.235353+0000","last_became_active":"2024-04-25T09:02:50.239655+0000","last_became_peered":"2024-04-25T09:02:50.239655+0000","last_unstale":"2024-04-25T09:02:51.235353+0000","last_undegraded":"2024-04-25T09:02:51.235353+0000","last_fullsized":"2024-04-25T09:02:51.235353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:58.168185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315781+0000","last_change":"2024-04-25T09:02:49.232993+0000","last_active":"2024-04-25T09:02:51.315781+0000","last_peered":"2024-04-25T09:02:51.315781+0000","last_clean":"2024-04-25T09:02:51.315781+0000","last_became_active":"2024-04-25T09:02:49.232717+0000","last_became_peered":"2024-04-25T09:02:49.232717+0000","last_unstale":"2024-04-25T09:02:51.315781+0000","last_undegraded":"2024-04-25T09:02:51.315781+0000","last_fullsized":"2024-04-25T09:02:51.315781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:11.835993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315649+0000","last_change":"2024-04-25T09:02:50.247246+0000","last_active":"2024-04-25T09:02:51.315649+0000","last_peered":"2024-04-25T09:02:51.315649+0000","last_clean":"2024-04-25T09:02:51.315649+0000","last_became_active":"2024-04-25T09:02:50.246875+0000","last_became_peered":"2024-04-25T09:02:50.246875+0000","last_unstale":"2024-04-25T09:02:51.315649+0000","last_undegraded":"2024-04-25T09:02:51.315649+0000","last_fullsized":"2024-04-25T09:02:51.315649+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:19.707073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.315780+0000","last_change":"2024-04-25T09:02:49.226736+0000","last_active":"2024-04-25T09:02:51.315780+0000","last_peered":"2024-04-25T09:02:51.315780+0000","last_clean":"2024-04-25T09:02:51.315780+0000","last_became_active":"2024-04-25T09:02:49.226454+0000","last_became_peered":"2024-04-25T09:02:49.226454+0000","last_unstale":"2024-04-25T09:02:51.315780+0000","last_undegraded":"2024-04-25T09:02:51.315780+0000","last_fullsized":"2024-04-25T09:02:51.315780+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:11.020739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.314994+0000","last_change":"2024-04-25T09:02:50.252297+0000","last_active":"2024-04-25T09:02:51.314994+0000","last_peered":"2024-04-25T09:02:51.314994+0000","last_clean":"2024-04-25T09:02:51.314994+0000","last_became_active":"2024-04-25T09:02:50.251947+0000","last_became_peered":"2024-04-25T09:02:50.251947+0000","last_unstale":"2024-04-25T09:02:51.314994+0000","last_undegraded":"2024-04-25T09:02:51.314994+0000","last_fullsized":"2024-04-25T09:02:51.314994+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:10.397533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316291+0000","last_change":"2024-04-25T09:02:49.229299+0000","last_active":"2024-04-25T09:02:51.316291+0000","last_peered":"2024-04-25T09:02:51.316291+0000","last_clean":"2024-04-25T09:02:51.316291+0000","last_became_active":"2024-04-25T09:02:49.228960+0000","last_became_peered":"2024-04-25T09:02:49.228960+0000","last_unstale":"2024-04-25T09:02:51.316291+0000","last_undegraded":"2024-04-25T09:02:51.316291+0000","last_fullsized":"2024-04-25T09:02:51.316291+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:34.838771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.237011+0000","last_change":"2024-04-25T09:02:50.242449+0000","last_active":"2024-04-25T09:02:51.237011+0000","last_peered":"2024-04-25T09:02:51.237011+0000","last_clean":"2024-04-25T09:02:51.237011+0000","last_became_active":"2024-04-25T09:02:50.242195+0000","last_became_peered":"2024-04-25T09:02:50.242195+0000","last_unstale":"2024-04-25T09:02:51.237011+0000","last_undegraded":"2024-04-25T09:02:51.237011+0000","last_fullsized":"2024-04-25T09:02:51.237011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:40.755865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236864+0000","last_change":"2024-04-25T09:02:49.228645+0000","last_active":"2024-04-25T09:02:51.236864+0000","last_peered":"2024-04-25T09:02:51.236864+0000","last_clean":"2024-04-25T09:02:51.236864+0000","last_became_active":"2024-04-25T09:02:49.228210+0000","last_became_peered":"2024-04-25T09:02:49.228210+0000","last_unstale":"2024-04-25T09:02:51.236864+0000","last_undegraded":"2024-04-25T09:02:51.236864+0000","last_fullsized":"2024-04-25T09:02:51.236864+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:34.838771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316848+0000","last_change":"2024-04-25T09:02:50.255942+0000","last_active":"2024-04-25T09:02:51.316848+0000","last_peered":"2024-04-25T09:02:51.316848+0000","last_clean":"2024-04-25T09:02:51.316848+0000","last_became_active":"2024-04-25T09:02:50.255595+0000","last_became_peered":"2024-04-25T09:02:50.255595+0000","last_unstale":"2024-04-25T09:02:51.316848+0000","last_undegraded":"2024-04-25T09:02:51.316848+0000","last_fullsized":"2024-04-25T09:02:51.316848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:27.529710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.234683+0000","last_change":"2024-04-25T09:02:49.233077+0000","last_active":"2024-04-25T09:02:51.234683+0000","last_peered":"2024-04-25T09:02:51.234683+0000","last_clean":"2024-04-25T09:02:51.234683+0000","last_became_active":"2024-04-25T09:02:49.232847+0000","last_became_peered":"2024-04-25T09:02:49.232847+0000","last_unstale":"2024-04-25T09:02:51.234683+0000","last_undegraded":"2024-04-25T09:02:51.234683+0000","last_fullsized":"2024-04-25T09:02:51.234683+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:48:09.390450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.236073+0000","last_change":"2024-04-25T09:02:50.239638+0000","last_active":"2024-04-25T09:02:51.236073+0000","last_peered":"2024-04-25T09:02:51.236073+0000","last_clean":"2024-04-25T09:02:51.236073+0000","last_became_active":"2024-04-25T09:02:50.239393+0000","last_became_peered":"2024-04-25T09:02:50.239393+0000","last_unstale":"2024-04-25T09:02:51.236073+0000","last_undegraded":"2024-04-25T09:02:51.236073+0000","last_fullsized":"2024-04-25T09:02:51.236073+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:49.203836+0000","last_clean_scrub_stamp":"2024-04-25T09:02:49.203836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:20:52.065013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316439+0000","last_change":"2024-04-25T09:02:49.237540+0000","last_active":"2024-04-25T09:02:51.316439+0000","last_peered":"2024-04-25T09:02:51.316439+0000","last_clean":"2024-04-25T09:02:51.316439+0000","last_became_active":"2024-04-25T09:02:49.237260+0000","last_became_peered":"2024-04-25T09:02:49.237260+0000","last_unstale":"2024-04-25T09:02:51.316439+0000","last_undegraded":"2024-04-25T09:02:51.316439+0000","last_fullsized":"2024-04-25T09:02:51.316439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:02:48.196753+0000","last_clean_scrub_stamp":"2024-04-25T09:02:48.196753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:11.605925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":204,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T09:02:51.316384+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:02:51.316384+0000","last_peered":"2024-04-25T09:02:51.316384+0000","last_clean":"2024-04-25T09:02:51.316384+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:02:51.316384+0000","last_undegraded":"2024-04-25T09:02:51.316384+0000","last_fullsized":"2024-04-25T09:02:51.316384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1060864,"data_stored":788125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":454656,"data_stored":196657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":458752,"data_stored":196187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31636,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340204,"statfs":{"total":96636764160,"available":96604368896,"internally_reserved":0,"allocated":458752,"data_stored":196679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":197721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":196145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":196165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":786477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:02:59.281 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:02:59.282 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:02:59.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.475+0000 7f6ab7200640 1 Processor -- start 2024-04-25T09:02:59.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.475+0000 7f6ab7200640 1 -- start start 2024-04-25T09:02:59.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab7200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6ab015f220 0x7f6ab015f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab7200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab00cc1d0 0x7f6ab00cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab7200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab015fb40 con 0x7f6ab00cf1b0 2024-04-25T09:02:59.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab7200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab00d0280 con 0x7f6ab015f220 2024-04-25T09:02:59.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab7200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00cf670 con 0x7f6ab00cc1d0 2024-04-25T09:02:59.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab5400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6ab00cf1b0 0x7f6ab009a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60076/0 (socket says 172.21.15.59:60076) 2024-04-25T09:02:59.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab5400640 1 -- 172.21.15.59:0/3416250489 learned_addr learned my addr 172.21.15.59:0/3416250489 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:59.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab6800640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab00cc1d0 0x7f6ab00cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab5e00640 1 --2- 172.21.15.59:0/3416250489 >> v2:172.21.15.178:3300/0 conn(0x7f6ab015f220 0x7f6ab015f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074601302 0 0) 0x7f6ab015fb40 con 0x7f6ab00cf1b0 2024-04-25T09:02:59.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a98003530 con 0x7f6ab00cf1b0 2024-04-25T09:02:59.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2856415367 0 0) 0x7f6a98003530 con 0x7f6ab00cf1b0 2024-04-25T09:02:59.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab00cc1d0 msgr2=0x7f6ab00cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab00cc1d0 0x7f6ab00cc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 >> v2:172.21.15.178:3300/0 conn(0x7f6ab015f220 msgr2=0x7f6ab015f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 --2- 172.21.15.59:0/3416250489 >> v2:172.21.15.178:3300/0 conn(0x7f6ab015f220 0x7f6ab015f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00cf950 con 0x7f6ab00cf1b0 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f6aa0001680 con 0x7f6ab00cf1b0 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 >> v1:172.21.15.59:6789/0 conn(0x7f6ab00cf1b0 legacy=0x7f6ab009a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a980039c0 0x7f6a98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab00cc1d0 0x7f6a98004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a98004d50 0x7f6a980051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00d0280 con 0x7f6a980039c0 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00cf670 con 0x7f6a98004d50 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9800b9d0 con 0x7f6ab00cc1d0 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab5e00640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a980039c0 0x7f6a98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab5400640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab00cc1d0 0x7f6a98004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab6800640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a98004d50 0x7f6a980051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab5e00640 1 -- 172.21.15.59:0/3416250489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab00cc1d0 msgr2=0x7f6a98004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab5e00640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab00cc1d0 0x7f6a98004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab5e00640 1 -- 172.21.15.59:0/3416250489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a98004d50 msgr2=0x7f6a980051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab5e00640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a98004d50 0x7f6a980051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab5e00640 1 -- 172.21.15.59:0/3416250489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a98003530 con 0x7f6a980039c0 2024-04-25T09:02:59.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.479+0000 7f6ab6800640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a98004d50 0x7f6a980051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:02:59.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.483+0000 7f6ab5e00640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a980039c0 0x7f6a98003de0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009ae0 tx=0x7f6aa401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ce53be40801242 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.483+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40b2070 con 0x7f6a980039c0 2024-04-25T09:02:59.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.483+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa40a5650 con 0x7f6a980039c0 2024-04-25T09:02:59.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.483+0000 7f6ab4a00640 1 -- 172.21.15.59:0/3416250489 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40096b0 con 0x7f6a980039c0 2024-04-25T09:02:59.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.483+0000 7f6ab7200640 1 -- 172.21.15.59:0/3416250489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a980039c0 msgr2=0x7f6a98003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.483+0000 7f6ab7200640 1 --2- 172.21.15.59:0/3416250489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a980039c0 0x7f6a98003de0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4009ae0 tx=0x7f6aa401ca40 comp rx=0 tx=0).stop 2024-04-25T09:02:59.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.483+0000 7f6ab6800640 1 -- 172.21.15.59:0/3416250489 reap_dead start 2024-04-25T09:02:59.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.483+0000 7f6ab7200640 1 -- 172.21.15.59:0/3416250489 shutdown_connections 2024-04-25T09:02:59.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.483+0000 7f6ab7200640 1 -- 172.21.15.59:0/3416250489 >> 172.21.15.59:0/3416250489 conn(0x7f6ab00b30d0 msgr2=0x7f6ab00b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.483+0000 7f6ab7200640 1 -- 172.21.15.59:0/3416250489 shutdown_connections 2024-04-25T09:02:59.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.483+0000 7f6ab7200640 1 -- 172.21.15.59:0/3416250489 wait complete. 2024-04-25T09:02:59.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab7200640 1 Processor -- start 2024-04-25T09:02:59.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab7200640 1 -- start start 2024-04-25T09:02:59.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a980039c0 0x7f6ab00cb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab7200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ab00c9200 0x7f6ab0152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab7200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab00c9680 0x7f6ab0155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab01595f0 con 0x7f6a980039c0 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab7200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab0159470 con 0x7f6ab00c9200 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab7200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab00ccdf0 con 0x7f6ab00c9680 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a980039c0 0x7f6ab00cb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a980039c0 0x7f6ab00cb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37414/0 (socket says 172.21.15.59:37414) 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab5e00640 1 -- 172.21.15.59:0/4141581507 learned_addr learned my addr 172.21.15.59:0/4141581507 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab5e00640 1 -- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab00c9680 msgr2=0x7f6ab0155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab5e00640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab00c9680 0x7f6ab0155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab5e00640 1 -- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ab00c9200 msgr2=0x7f6ab0152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab5400640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ab00c9200 0x7f6ab0152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab5e00640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ab00c9200 0x7f6ab0152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab5e00640 1 -- 172.21.15.59:0/4141581507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab00cb5b0 con 0x7f6a980039c0 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab5400640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ab00c9200 0x7f6ab0152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab5e00640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a980039c0 0x7f6ab00cb070 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40b0040 tx=0x7f6a98005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6aaa000640 1 -- 172.21.15.59:0/4141581507 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40bc030 con 0x7f6a980039c0 2024-04-25T09:02:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6aaa000640 1 -- 172.21.15.59:0/4141581507 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa400f000 con 0x7f6a980039c0 2024-04-25T09:02:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6aaa000640 1 -- 172.21.15.59:0/4141581507 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40b2040 con 0x7f6a980039c0 2024-04-25T09:02:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab7200640 1 -- 172.21.15.59:0/4141581507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab0151cb0 con 0x7f6a980039c0 2024-04-25T09:02:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab7200640 1 -- 172.21.15.59:0/4141581507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab0152270 con 0x7f6a980039c0 2024-04-25T09:02:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.487+0000 7f6ab7200640 1 -- 172.21.15.59:0/4141581507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab004efa0 con 0x7f6a980039c0 2024-04-25T09:02:59.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.491+0000 7f6aaa000640 1 -- 172.21.15.59:0/4141581507 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6aa40bf070 con 0x7f6a980039c0 2024-04-25T09:02:59.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.491+0000 7f6aaa000640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a94066f60 0x7f6a94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.491+0000 7f6aaa000640 1 -- 172.21.15.59:0/4141581507 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6aa411ef30 con 0x7f6a980039c0 2024-04-25T09:02:59.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.491+0000 7f6ab5400640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a94066f60 0x7f6a94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.491+0000 7f6ab5400640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a94066f60 0x7f6a94069420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6ab015b210 tx=0x7f6aa0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.495+0000 7f6aaa000640 1 -- 172.21.15.59:0/4141581507 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6aa40c7020 con 0x7f6a980039c0 2024-04-25T09:02:59.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.715+0000 7f6ab7200640 1 -- 172.21.15.59:0/4141581507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6ab00b3cc0 con 0x7f6a980039c0 2024-04-25T09:02:59.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.719+0000 7f6aaa000640 1 -- 172.21.15.59:0/4141581507 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6aa40167c0 con 0x7f6a980039c0 2024-04-25T09:02:59.711 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-04-25T09:02:59.711 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg== 2024-04-25T09:02:59.711 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-04-25T09:02:59.711 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-04-25T09:02:59.711 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:02:59.712 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-04-25T09:02:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.723+0000 7f6ab7200640 1 -- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a94066f60 msgr2=0x7f6a94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.723+0000 7f6ab7200640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a94066f60 0x7f6a94069420 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6ab015b210 tx=0x7f6aa0009040 comp rx=0 tx=0).stop 2024-04-25T09:02:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.723+0000 7f6ab7200640 1 -- 172.21.15.59:0/4141581507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a980039c0 msgr2=0x7f6ab00cb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.723+0000 7f6ab7200640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a980039c0 0x7f6ab00cb070 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40b0040 tx=0x7f6a98005840 comp rx=0 tx=0).stop 2024-04-25T09:02:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.723+0000 7f6ab7200640 1 -- 172.21.15.59:0/4141581507 shutdown_connections 2024-04-25T09:02:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.723+0000 7f6ab7200640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a94066f60 0x7f6a94069420 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.723+0000 7f6ab7200640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ab00c9680 0x7f6ab0155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.723+0000 7f6ab7200640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ab00c9200 0x7f6ab0152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.723+0000 7f6ab7200640 1 --2- 172.21.15.59:0/4141581507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a980039c0 0x7f6ab00cb070 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.723+0000 7f6ab7200640 1 -- 172.21.15.59:0/4141581507 >> 172.21.15.59:0/4141581507 conn(0x7f6ab00b30d0 msgr2=0x7f6ab0070970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.723+0000 7f6ab7200640 1 -- 172.21.15.59:0/4141581507 shutdown_connections 2024-04-25T09:02:59.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.723+0000 7f6ab7200640 1 -- 172.21.15.59:0/4141581507 wait complete. 2024-04-25T09:02:59.734 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:02:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29e0400640 1 Processor -- start 2024-04-25T09:02:59.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29e0400640 1 -- start start 2024-04-25T09:02:59.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29e0400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d8144140 0x7f29d80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29e0400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f29d806ead0 0x7f29d80b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29e0400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d815ac60 con 0x7f29d80ced60 2024-04-25T09:02:59.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29e0400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d80cf3e0 con 0x7f29d806ead0 2024-04-25T09:02:59.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29e0400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d815af20 con 0x7f29d8144140 2024-04-25T09:02:59.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29dd000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f29d80ced60 0x7f29d806e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60080/0 (socket says 172.21.15.59:60080) 2024-04-25T09:02:59.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29dd000640 1 -- 172.21.15.59:0/2717457767 learned_addr learned my addr 172.21.15.59:0/2717457767 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:02:59.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29de400640 1 --2- 172.21.15.59:0/2717457767 >> v2:172.21.15.178:3300/0 conn(0x7f29d806ead0 0x7f29d80b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29dda00640 1 --2- 172.21.15.59:0/2717457767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d8144140 0x7f29d80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856455035 0 0) 0x7f29d815ac60 con 0x7f29d80ced60 2024-04-25T09:02:59.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.883+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29c0003530 con 0x7f29d80ced60 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2825715230 0 0) 0x7f29c0003530 con 0x7f29d80ced60 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d8144140 msgr2=0x7f29d80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 --2- 172.21.15.59:0/2717457767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d8144140 0x7f29d80ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 >> v2:172.21.15.178:3300/0 conn(0x7f29d806ead0 msgr2=0x7f29d80b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 --2- 172.21.15.59:0/2717457767 >> v2:172.21.15.178:3300/0 conn(0x7f29d806ead0 0x7f29d80b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d815b200 con 0x7f29d80ced60 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f29c4001680 con 0x7f29d80ced60 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 >> v1:172.21.15.59:6789/0 conn(0x7f29d80ced60 legacy=0x7f29d806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 --2- 172.21.15.59:0/2717457767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d8144140 0x7f29c00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 --2- 172.21.15.59:0/2717457767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c0003f90 0x7f29c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 --2- 172.21.15.59:0/2717457767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0004d50 0x7f29c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80cf3e0 con 0x7f29c0004d50 2024-04-25T09:02:59.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d815af20 con 0x7f29c0003f90 2024-04-25T09:02:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29c000b9d0 con 0x7f29d8144140 2024-04-25T09:02:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29de400640 1 --2- 172.21.15.59:0/2717457767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0004d50 0x7f29c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29dda00640 1 --2- 172.21.15.59:0/2717457767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d8144140 0x7f29c00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29dd000640 1 --2- 172.21.15.59:0/2717457767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c0003f90 0x7f29c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29de400640 1 -- 172.21.15.59:0/2717457767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d8144140 msgr2=0x7f29c00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29de400640 1 --2- 172.21.15.59:0/2717457767 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d8144140 0x7f29c00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29de400640 1 -- 172.21.15.59:0/2717457767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c0003f90 msgr2=0x7f29c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:02:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29de400640 1 --2- 172.21.15.59:0/2717457767 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29c0003f90 0x7f29c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29de400640 1 -- 172.21.15.59:0/2717457767 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c0003530 con 0x7f29c0004d50 2024-04-25T09:02:59.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.887+0000 7f29de400640 1 --2- 172.21.15.59:0/2717457767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0004d50 0x7f29c00051d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009bd0 tx=0x7f29d001ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc612bd44d878969 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00b4070 con 0x7f29c0004d50 2024-04-25T09:02:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d00af440 con 0x7f29c0004d50 2024-04-25T09:02:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29d7e00640 1 -- 172.21.15.59:0/2717457767 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0009c10 con 0x7f29c0004d50 2024-04-25T09:02:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 -- 172.21.15.59:0/2717457767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0004d50 msgr2=0x7f29c00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 --2- 172.21.15.59:0/2717457767 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0004d50 0x7f29c00051d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009bd0 tx=0x7f29d001ee70 comp rx=0 tx=0).stop 2024-04-25T09:02:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29de400640 1 -- 172.21.15.59:0/2717457767 reap_dead start 2024-04-25T09:02:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 -- 172.21.15.59:0/2717457767 shutdown_connections 2024-04-25T09:02:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 -- 172.21.15.59:0/2717457767 >> 172.21.15.59:0/2717457767 conn(0x7f29d8066fa0 msgr2=0x7f29d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:02:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 -- 172.21.15.59:0/2717457767 shutdown_connections 2024-04-25T09:02:59.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 -- 172.21.15.59:0/2717457767 wait complete. 2024-04-25T09:02:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 Processor -- start 2024-04-25T09:02:59.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 -- start start 2024-04-25T09:02:59.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0004d50 0x7f29d81f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29d80ca460 0x7f29d80ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d813f130 0x7f29d813f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8144520 con 0x7f29c0004d50 2024-04-25T09:02:59.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d80b1f30 con 0x7f29d80ca460 2024-04-25T09:02:59.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29e0400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d815ba00 con 0x7f29d813f130 2024-04-25T09:02:59.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0004d50 0x7f29d81f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0004d50 0x7f29d81f3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37434/0 (socket says 172.21.15.59:37434) 2024-04-25T09:02:59.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29dda00640 1 -- 172.21.15.59:0/111236646 learned_addr learned my addr 172.21.15.59:0/111236646 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:02:59.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.891+0000 7f29dd000640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29d80ca460 0x7f29d80ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29de400640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d813f130 0x7f29d813f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29dda00640 1 -- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d813f130 msgr2=0x7f29d813f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29dda00640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d813f130 0x7f29d813f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29dda00640 1 -- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29d80ca460 msgr2=0x7f29d80ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:02:59.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29dda00640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29d80ca460 0x7f29d80ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:02:59.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29dda00640 1 -- 172.21.15.59:0/111236646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d80caf20 con 0x7f29c0004d50 2024-04-25T09:02:59.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29dda00640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0004d50 0x7f29d81f3130 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0119d0 tx=0x7f29cc011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29d5600640 1 -- 172.21.15.59:0/111236646 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc00faf0 con 0x7f29c0004d50 2024-04-25T09:02:59.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29d5600640 1 -- 172.21.15.59:0/111236646 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc00fc90 con 0x7f29c0004d50 2024-04-25T09:02:59.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29d5600640 1 -- 172.21.15.59:0/111236646 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29cc014440 con 0x7f29c0004d50 2024-04-25T09:02:59.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29e0400640 1 -- 172.21.15.59:0/111236646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d80cb200 con 0x7f29c0004d50 2024-04-25T09:02:59.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29e0400640 1 -- 172.21.15.59:0/111236646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d812d150 con 0x7f29c0004d50 2024-04-25T09:02:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29e0400640 1 -- 172.21.15.59:0/111236646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d813faf0 con 0x7f29c0004d50 2024-04-25T09:02:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29d5600640 1 -- 172.21.15.59:0/111236646 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f29cc012040 con 0x7f29c0004d50 2024-04-25T09:02:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29d5600640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f29b8066f90 0x7f29b8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:02:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.895+0000 7f29d5600640 1 -- 172.21.15.59:0/111236646 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f29cc085670 con 0x7f29c0004d50 2024-04-25T09:02:59.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.899+0000 7f29dd000640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f29b8066f90 0x7f29b8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:02:59.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.899+0000 7f29dd000640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f29b8066f90 0x7f29b8069450 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f29d8133730 tx=0x7f29c4001e10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:02:59.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:02:59.899+0000 7f29d5600640 1 -- 172.21.15.59:0/111236646 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f29cc019030 con 0x7f29c0004d50 2024-04-25T09:03:00.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.095+0000 7f29e0400640 1 -- 172.21.15.59:0/111236646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29d80745d0 con 0x7f29c0004d50 2024-04-25T09:03:00.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.095+0000 7f29d5600640 1 -- 172.21.15.59:0/111236646 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f29cc055f50 con 0x7f29c0004d50 2024-04-25T09:03:00.089 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:00.089 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3471177782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3471177782},{"type":"v1","addr":"172.21.15.178:6836","nonce":3471177782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3534065304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3534065304},{"type":"v1","addr":"172.21.15.178:6837","nonce":3534065304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4015865168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4015865168},{"type":"v1","addr":"172.21.15.59:6833","nonce":4015865168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:49.614073+0000","modified":"2024-04-25T09:02:52.639785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5289":{"gid":5289,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1202642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1202642229},{"type":"v1","addr":"172.21.15.59:6835","nonce":1202642229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:03:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 19 2024-04-25T09:03:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.099+0000 7f29e0400640 1 -- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f29b8066f90 msgr2=0x7f29b8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.099+0000 7f29e0400640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f29b8066f90 0x7f29b8069450 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f29d8133730 tx=0x7f29c4001e10 comp rx=0 tx=0).stop 2024-04-25T09:03:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.099+0000 7f29e0400640 1 -- 172.21.15.59:0/111236646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0004d50 msgr2=0x7f29d81f3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.099+0000 7f29e0400640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0004d50 0x7f29d81f3130 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f29cc0119d0 tx=0x7f29cc011e90 comp rx=0 tx=0).stop 2024-04-25T09:03:00.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.099+0000 7f29e0400640 1 -- 172.21.15.59:0/111236646 shutdown_connections 2024-04-25T09:03:00.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.099+0000 7f29e0400640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f29b8066f90 0x7f29b8069450 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.099+0000 7f29e0400640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d813f130 0x7f29d813f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.099+0000 7f29e0400640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29d80ca460 0x7f29d80ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.099+0000 7f29e0400640 1 --2- 172.21.15.59:0/111236646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29c0004d50 0x7f29d81f3130 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.099+0000 7f29e0400640 1 -- 172.21.15.59:0/111236646 >> 172.21.15.59:0/111236646 conn(0x7f29d8066fa0 msgr2=0x7f29d8142480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:00.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.099+0000 7f29e0400640 1 -- 172.21.15.59:0/111236646 shutdown_connections 2024-04-25T09:03:00.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.099+0000 7f29e0400640 1 -- 172.21.15.59:0/111236646 wait complete. 2024-04-25T09:03:00.512 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:02:49.614073+0000', 'modified': '2024-04-25T09:02:52.639785+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5289}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5289': {'gid': 5289, 'name': 'a', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.59:6835/1202642229', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6834', 'nonce': 1202642229}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 1202642229}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:03:00.512 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:03:00.512 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:03:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a11400640 1 Processor -- start 2024-04-25T09:03:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a11400640 1 -- start start 2024-04-25T09:03:00.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a11400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c0cf3c0 0x7f9a0c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a11400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0d02a0 con 0x7f9a0c0cd370 2024-04-25T09:03:00.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a11400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0cc350 con 0x7f9a0c15b910 2024-04-25T09:03:00.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a11400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0cc630 con 0x7f9a0c0cf3c0 2024-04-25T09:03:00.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a0b200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9a0c0cd370 0x7f9a0c099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60476/0 (socket says 172.21.15.59:60476) 2024-04-25T09:03:00.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a0b200640 1 -- 172.21.15.59:0/1508932829 learned_addr learned my addr 172.21.15.59:0/1508932829 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:00.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a01e00640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c0cf3c0 0x7f9a0c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200405348 0 0) 0x7f9a0c0d02a0 con 0x7f9a0c0cd370 2024-04-25T09:03:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99f0003530 con 0x7f9a0c0cd370 2024-04-25T09:03:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233832663 0 0) 0x7f9a0c0cc350 con 0x7f9a0c15b910 2024-04-25T09:03:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a0c0d02a0 con 0x7f9a0c15b910 2024-04-25T09:03:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3959120429 0 0) 0x7f99f0003530 con 0x7f9a0c0cd370 2024-04-25T09:03:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c0cf3c0 msgr2=0x7f9a0c0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a09e00640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c0cf3c0 0x7f9a0c0cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 >> v1:172.21.15.178:6789/0 conn(0x7f9a0c15b910 legacy=0x7f9a0c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0cc910 con 0x7f9a0c0cd370 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f9a04001a00 con 0x7f9a0c0cd370 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 >> v1:172.21.15.59:6789/0 conn(0x7f9a0c0cd370 legacy=0x7f9a0c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.663+0000 7f9a09e00640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c0cf3c0 0x7f99f0003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a09e00640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99f00040e0 0x7f99f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a09e00640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99f0004d50 0x7f99f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0cc630 con 0x7f99f0004d50 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f000bab0 con 0x7f99f00040e0 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f000bcb0 con 0x7f9a0c0cf3c0 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a0b200640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99f0004d50 0x7f99f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a0a800640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c0cf3c0 0x7f99f0003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a01e00640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99f00040e0 0x7f99f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a0b200640 1 -- 172.21.15.59:0/1508932829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c0cf3c0 msgr2=0x7f99f0003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a0b200640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c0cf3c0 0x7f99f0003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a0b200640 1 -- 172.21.15.59:0/1508932829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99f00040e0 msgr2=0x7f99f0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a0b200640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99f00040e0 0x7f99f0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a0b200640 1 -- 172.21.15.59:0/1508932829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0003530 con 0x7f99f0004d50 2024-04-25T09:03:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a01e00640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f99f00040e0 0x7f99f0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a0b200640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99f0004d50 0x7f99f00051d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0cbd10 tx=0x7f9a0401fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d729dd1a9e681c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0400a430 con 0x7f99f0004d50 2024-04-25T09:03:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a040aa630 con 0x7f99f0004d50 2024-04-25T09:03:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.667+0000 7f9a09e00640 1 -- 172.21.15.59:0/1508932829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a040aaa60 con 0x7f99f0004d50 2024-04-25T09:03:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 -- 172.21.15.59:0/1508932829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99f0004d50 msgr2=0x7f99f00051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 --2- 172.21.15.59:0/1508932829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99f0004d50 0x7f99f00051d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0cbd10 tx=0x7f9a0401fa00 comp rx=0 tx=0).stop 2024-04-25T09:03:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a0b200640 1 -- 172.21.15.59:0/1508932829 reap_dead start 2024-04-25T09:03:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 -- 172.21.15.59:0/1508932829 shutdown_connections 2024-04-25T09:03:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 -- 172.21.15.59:0/1508932829 >> 172.21.15.59:0/1508932829 conn(0x7f9a0c0b3200 msgr2=0x7f9a0c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 -- 172.21.15.59:0/1508932829 shutdown_connections 2024-04-25T09:03:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 -- 172.21.15.59:0/1508932829 wait complete. 2024-04-25T09:03:00.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 Processor -- start 2024-04-25T09:03:00.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 -- start start 2024-04-25T09:03:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99f0004d50 0x7f9a0c09ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a0c1f6c20 0x7f9a0c1f70a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c1f75e0 0x7f9a0c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c09a2f0 con 0x7f99f0004d50 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c09a170 con 0x7f9a0c1f6c20 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a11400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c15bcf0 con 0x7f9a0c1f75e0 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a0a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99f0004d50 0x7f9a0c09ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a0a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99f0004d50 0x7f9a0c09ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55526/0 (socket says 172.21.15.59:55526) 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a0a800640 1 -- 172.21.15.59:0/37556232 learned_addr learned my addr 172.21.15.59:0/37556232 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a0b200640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c1f75e0 0x7f9a0c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a01e00640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a0c1f6c20 0x7f9a0c1f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a0a800640 1 -- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c1f75e0 msgr2=0x7f9a0c15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a0a800640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c1f75e0 0x7f9a0c15d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a0a800640 1 -- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a0c1f6c20 msgr2=0x7f9a0c1f70a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a0a800640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a0c1f6c20 0x7f9a0c1f70a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a0a800640 1 -- 172.21.15.59:0/37556232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0c95d0 con 0x7f99f0004d50 2024-04-25T09:03:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a01e00640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a0c1f6c20 0x7f9a0c1f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.671+0000 7f9a0a800640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99f0004d50 0x7f9a0c09ee60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00f770 tx=0x7f99fc00fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.675+0000 7f9a03400640 1 -- 172.21.15.59:0/37556232 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00fe80 con 0x7f99f0004d50 2024-04-25T09:03:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.675+0000 7f9a03400640 1 -- 172.21.15.59:0/37556232 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc018070 con 0x7f99f0004d50 2024-04-25T09:03:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.675+0000 7f9a03400640 1 -- 172.21.15.59:0/37556232 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc00d730 con 0x7f99f0004d50 2024-04-25T09:03:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.675+0000 7f9a11400640 1 -- 172.21.15.59:0/37556232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c0c98b0 con 0x7f99f0004d50 2024-04-25T09:03:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.675+0000 7f9a11400640 1 -- 172.21.15.59:0/37556232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c15e8c0 con 0x7f99f0004d50 2024-04-25T09:03:00.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.675+0000 7f9a03400640 1 -- 172.21.15.59:0/37556232 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f99fc00d8d0 con 0x7f99f0004d50 2024-04-25T09:03:00.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.675+0000 7f9a03400640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f99e8066f90 0x7f99e8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.675+0000 7f9a03400640 1 -- 172.21.15.59:0/37556232 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f99fc085160 con 0x7f99f0004d50 2024-04-25T09:03:00.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.675+0000 7f9a01e00640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f99e8066f90 0x7f99e8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.675+0000 7f9a14846000 1 Processor -- start 2024-04-25T09:03:00.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 -- start start 2024-04-25T09:03:00.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a01e00640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f99e8066f90 0x7f99e8069450 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0cf260 tx=0x7f99f4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:00.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50de920 0x55edf50ded00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf50949f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 0x55edf5095310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf4f7c5f0 con 0x55edf5094f30 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf4ee3da0 con 0x55edf50df240 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edf4e6c150 con 0x55edf50de920 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a0b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 0x55edf5095310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a0b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 0x55edf5095310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55540/0 (socket says 172.21.15.59:55540) 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a0b200640 1 -- 172.21.15.59:0/227424431 learned_addr learned my addr 172.21.15.59:0/227424431 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a01e00640 1 --2- 172.21.15.59:0/227424431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf50949f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a0a800640 1 --2- 172.21.15.59:0/227424431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50de920 0x55edf50ded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a0b200640 1 -- 172.21.15.59:0/227424431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50de920 msgr2=0x55edf50ded00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a0b200640 1 --2- 172.21.15.59:0/227424431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50de920 0x55edf50ded00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a0b200640 1 -- 172.21.15.59:0/227424431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 msgr2=0x55edf50949f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a0b200640 1 --2- 172.21.15.59:0/227424431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf50949f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a0b200640 1 -- 172.21.15.59:0/227424431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edf4e85ca0 con 0x55edf5094f30 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a0b200640 1 --2- 172.21.15.59:0/227424431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 0x55edf5095310 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400a6f0 tx=0x7f9a04007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6d9ecae5f4223e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f99fb400640 1 -- 172.21.15.59:0/227424431 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04001fa0 con 0x55edf5094f30 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f99fb400640 1 -- 172.21.15.59:0/227424431 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04001800 con 0x55edf5094f30 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f99fb400640 1 -- 172.21.15.59:0/227424431 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a040011d0 con 0x55edf5094f30 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 -- 172.21.15.59:0/227424431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 msgr2=0x55edf5095310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 --2- 172.21.15.59:0/227424431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 0x55edf5095310 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9a0400a6f0 tx=0x7f9a04007040 comp rx=0 tx=0).stop 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 -- 172.21.15.59:0/227424431 shutdown_connections 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 --2- 172.21.15.59:0/227424431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 0x55edf5095310 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 --2- 172.21.15.59:0/227424431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf50949f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 --2- 172.21.15.59:0/227424431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50de920 0x55edf50ded00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 -- 172.21.15.59:0/227424431 >> 172.21.15.59:0/227424431 conn(0x55edf509b2a0 msgr2=0x55edf50932d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 -- 172.21.15.59:0/227424431 shutdown_connections 2024-04-25T09:03:00.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 -- 172.21.15.59:0/227424431 wait complete. 2024-04-25T09:03:00.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.679+0000 7f9a14846000 1 -- start start 2024-04-25T09:03:00.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 1 Processor -- start 2024-04-25T09:03:00.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf5094f30 0x55edf50e5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 0x55edf50e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50df240 0x55edf5098aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf4e9e990 con 0x55edf50de920 2024-04-25T09:03:00.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf4edfe40 con 0x55edf5094f30 2024-04-25T09:03:00.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edf4e6f900 con 0x55edf50df240 2024-04-25T09:03:00.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 10 client.0 _ll_register_callbacks cb 0x55edf4f971c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:00.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a01e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 0x55edf50e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a01e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 0x55edf50e61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55548/0 (socket says 172.21.15.59:55548) 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a01e00640 1 -- 172.21.15.59:0/62275654 learned_addr learned my addr 172.21.15.59:0/62275654 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a0b200640 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50df240 0x55edf5098aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a01e00640 1 -- 172.21.15.59:0/62275654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50df240 msgr2=0x55edf5098aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a0a800640 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf5094f30 0x55edf50e5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a01e00640 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50df240 0x55edf5098aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a01e00640 1 -- 172.21.15.59:0/62275654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf5094f30 msgr2=0x55edf50e5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a01e00640 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf5094f30 0x55edf50e5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a01e00640 1 -- 172.21.15.59:0/62275654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edf4e9c630 con 0x55edf50de920 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a0a800640 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf5094f30 0x55edf50e5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a0b200640 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50df240 0x55edf5098aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a01e00640 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 0x55edf50e61c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f99f40159d0 tx=0x7f99f4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c316f8c1287110 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f99efe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f99efe00640 1 -- 172.21.15.59:0/62275654 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4014b30 con 0x55edf50de920 2024-04-25T09:03:00.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f99efe00640 1 -- 172.21.15.59:0/62275654 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f99f4014cd0 con 0x55edf50de920 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 1 -- 172.21.15.59:0/62275654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9a04001800 con 0x55edf50de920 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f99efe00640 1 -- 172.21.15.59:0/62275654 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99f40059a0 con 0x55edf50de920 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 10 client.5499 fetch_fsmap learned FSMap version 19 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 1 -- 172.21.15.59:0/62275654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55edf4e6c3a0 con 0x55edf50de920 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f99efe00640 1 -- 172.21.15.59:0/62275654 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04001800 con 0x55edf50de920 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f99efe00640 1 -- 172.21.15.59:0/62275654 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f99f4005b40 con 0x55edf50de920 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 10 client.5499 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 10 client.5499 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 20 client.5499 populate_metadata read hostname 'smithi059' 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.59:6834/1202642229,v1:172.21.15.59:6835/1202642229] conn(0x55edf509faf0 0x55edf50994b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 4 client.5499 mds_command: new command op to 5289 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a14846000 1 -- 172.21.15.59:0/62275654 --> [v2:172.21.15.59:6834/1202642229,v1:172.21.15.59:6835/1202642229] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55edf4e7fa50 con 0x55edf509faf0 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a0a800640 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.59:6834/1202642229,v1:172.21.15.59:6835/1202642229] conn(0x55edf509faf0 0x55edf50994b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f99efe00640 10 client.5499 ms_handle_connect on v2:172.21.15.59:6834/1202642229 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.683+0000 7f9a0a800640 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.59:6834/1202642229,v1:172.21.15.59:6835/1202642229] conn(0x55edf509faf0 0x55edf50994b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95aa0b0f46d2860b server_cookie=4566e507b6f5adf in_seq=0 out_seq=0 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f99efe00640 1 -- 172.21.15.59:0/62275654 <== mds.0 v2:172.21.15.59:6834/1202642229 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x7f99fc07ce50 con 0x55edf509faf0 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f99efe00640 10 client.5499 handle_command_reply: tid=0 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f9a14846000 1 client.5499 shutdown 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f9a14846000 1 -- 172.21.15.59:0/62275654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 msgr2=0x55edf50e61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f9a14846000 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 0x55edf50e61c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f99f40159d0 tx=0x7f99f4004740 comp rx=0 tx=0).stop 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f9a14846000 1 -- 172.21.15.59:0/62275654 shutdown_connections 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f9a14846000 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.59:6834/1202642229,v1:172.21.15.59:6835/1202642229] conn(0x55edf509faf0 0x55edf50994b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f9a14846000 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50df240 0x55edf5098aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f9a14846000 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 0x55edf50e61c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f9a14846000 1 --2- 172.21.15.59:0/62275654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf5094f30 0x55edf50e5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f99efe00640 0 client.5499 ms_handle_reset on v2:172.21.15.59:6834/1202642229 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f9a14846000 1 -- 172.21.15.59:0/62275654 >> 172.21.15.59:0/62275654 conn(0x55edf509b2a0 msgr2=0x55edf50939e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f9a14846000 1 -- 172.21.15.59:0/62275654 shutdown_connections 2024-04-25T09:03:00.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f9a14846000 1 -- 172.21.15.59:0/62275654 wait complete. 2024-04-25T09:03:00.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.687+0000 7f9a14846000 20 client.5499 trim_cache size 0 max 16384 2024-04-25T09:03:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 Processor -- start 2024-04-25T09:03:00.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 -- start start 2024-04-25T09:03:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf5094f30 0x55edf5097320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 0x55edf5097860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf5097da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1ff9e0 con 0x55edf50de920 2024-04-25T09:03:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0c7230 con 0x55edf50df240 2024-04-25T09:03:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c1ff3e0 con 0x55edf5094f30 2024-04-25T09:03:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a01e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 0x55edf5097860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a01e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 0x55edf5097860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55560/0 (socket says 172.21.15.59:55560) 2024-04-25T09:03:00.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a01e00640 1 -- 172.21.15.59:0/1825299025 learned_addr learned my addr 172.21.15.59:0/1825299025 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a0a800640 1 --2- 172.21.15.59:0/1825299025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf5094f30 0x55edf5097320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a0b200640 1 --2- 172.21.15.59:0/1825299025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf5097da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a01e00640 1 -- 172.21.15.59:0/1825299025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf5094f30 msgr2=0x55edf5097320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a01e00640 1 --2- 172.21.15.59:0/1825299025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf5094f30 0x55edf5097320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a01e00640 1 -- 172.21.15.59:0/1825299025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 msgr2=0x55edf5097da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a01e00640 1 --2- 172.21.15.59:0/1825299025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf5097da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a01e00640 1 -- 172.21.15.59:0/1825299025 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edf50df070 con 0x55edf50de920 2024-04-25T09:03:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a0b200640 1 --2- 172.21.15.59:0/1825299025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf5097da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a01e00640 1 --2- 172.21.15.59:0/1825299025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 0x55edf5097860 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f99f4015720 tx=0x7f99f4024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120a83499838e3e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f99faa00640 1 -- 172.21.15.59:0/1825299025 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4005b40 con 0x55edf50de920 2024-04-25T09:03:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f99faa00640 1 -- 172.21.15.59:0/1825299025 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f401b030 con 0x55edf50de920 2024-04-25T09:03:00.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f99faa00640 1 -- 172.21.15.59:0/1825299025 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f4014980 con 0x55edf50de920 2024-04-25T09:03:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 -- 172.21.15.59:0/1825299025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 msgr2=0x55edf5097860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 --2- 172.21.15.59:0/1825299025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 0x55edf5097860 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f99f4015720 tx=0x7f99f4024000 comp rx=0 tx=0).stop 2024-04-25T09:03:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 -- 172.21.15.59:0/1825299025 shutdown_connections 2024-04-25T09:03:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 --2- 172.21.15.59:0/1825299025 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf5097da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 --2- 172.21.15.59:0/1825299025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf50de920 0x55edf5097860 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 --2- 172.21.15.59:0/1825299025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf5094f30 0x55edf5097320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 -- 172.21.15.59:0/1825299025 >> 172.21.15.59:0/1825299025 conn(0x55edf509b2a0 msgr2=0x55edf50ca900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:00.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 -- 172.21.15.59:0/1825299025 shutdown_connections 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 -- 172.21.15.59:0/1825299025 wait complete. 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.703+0000 7f9a14846000 1 -- start start 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 Processor -- start 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 0x55edf50ea560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50de920 0x55edf5126800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf5126d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf4ee83d0 con 0x55edf5094f30 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edf4f9fd50 con 0x55edf50df240 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edf4e7e980 con 0x55edf50de920 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 10 client.0 _ll_register_callbacks cb 0x7f99f0003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a0a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 0x55edf50ea560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a0a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 0x55edf50ea560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55562/0 (socket says 172.21.15.59:55562) 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a0a800640 1 -- 172.21.15.59:0/2810906844 learned_addr learned my addr 172.21.15.59:0/2810906844 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a01e00640 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50de920 0x55edf5126800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a0b200640 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf5126d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a0a800640 1 -- 172.21.15.59:0/2810906844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50de920 msgr2=0x55edf5126800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a0a800640 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50de920 0x55edf5126800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a0a800640 1 -- 172.21.15.59:0/2810906844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 msgr2=0x55edf5126d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a0a800640 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf5126d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a0a800640 1 -- 172.21.15.59:0/2810906844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edf4f65600 con 0x55edf5094f30 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a0b200640 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf5126d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a0a800640 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 0x55edf50ea560 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00d520 tx=0x7f99fc055510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317e0b0ace16883f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f99efe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f99efe00640 1 -- 172.21.15.59:0/2810906844 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc05dfe0 con 0x55edf5094f30 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f99efe00640 1 -- 172.21.15.59:0/2810906844 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f99fc051f40 con 0x55edf5094f30 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 -- 172.21.15.59:0/2810906844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99f401b030 con 0x55edf5094f30 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f99efe00640 1 -- 172.21.15.59:0/2810906844 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99fc0830b0 con 0x55edf5094f30 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 10 client.5505 fetch_fsmap learned FSMap version 19 2024-04-25T09:03:00.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 -- 172.21.15.59:0/2810906844 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55edf4e789b0 con 0x55edf5094f30 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f99efe00640 1 -- 172.21.15.59:0/2810906844 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f401b030 con 0x55edf5094f30 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f99efe00640 1 -- 172.21.15.59:0/2810906844 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 19) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f99fc00dbc0 con 0x55edf5094f30 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 10 client.5505 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 10 client.5505 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 20 client.5505 populate_metadata read hostname 'smithi059' 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.59:6834/1202642229,v1:172.21.15.59:6835/1202642229] conn(0x55edf509aa70 0x55edf5127280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 4 client.5505 mds_command: new command op to 5289 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 -- 172.21.15.59:0/2810906844 --> [v2:172.21.15.59:6834/1202642229,v1:172.21.15.59:6835/1202642229] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55edf4ef12e0 con 0x55edf509aa70 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a01e00640 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.59:6834/1202642229,v1:172.21.15.59:6835/1202642229] conn(0x55edf509aa70 0x55edf5127280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f99efe00640 10 client.5505 ms_handle_connect on v2:172.21.15.59:6834/1202642229 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a01e00640 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.59:6834/1202642229,v1:172.21.15.59:6835/1202642229] conn(0x55edf509aa70 0x55edf5127280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e7d35d462bfbb0a server_cookie=fe8ffacb42f87894 in_seq=0 out_seq=0 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f99efe00640 1 -- 172.21.15.59:0/2810906844 <== mds.0 v2:172.21.15.59:6834/1202642229 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55edf4ef12e0 con 0x55edf509aa70 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f99efe00640 10 client.5505 handle_command_reply: tid=0 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 client.5505 shutdown 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 -- 172.21.15.59:0/2810906844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 msgr2=0x55edf50ea560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.707+0000 7f9a14846000 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 0x55edf50ea560 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00d520 tx=0x7f99fc055510 comp rx=0 tx=0).stop 2024-04-25T09:03:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a14846000 1 -- 172.21.15.59:0/2810906844 shutdown_connections 2024-04-25T09:03:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a14846000 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.59:6834/1202642229,v1:172.21.15.59:6835/1202642229] conn(0x55edf509aa70 0x55edf5127280 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a14846000 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edf50df240 0x55edf5126d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a14846000 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edf50de920 0x55edf5126800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a14846000 1 --2- 172.21.15.59:0/2810906844 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edf5094f30 0x55edf50ea560 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f99efe00640 0 client.5505 ms_handle_reset on v2:172.21.15.59:6834/1202642229 2024-04-25T09:03:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a14846000 1 -- 172.21.15.59:0/2810906844 >> 172.21.15.59:0/2810906844 conn(0x55edf509b2a0 msgr2=0x55edf50cb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a14846000 1 -- 172.21.15.59:0/2810906844 shutdown_connections 2024-04-25T09:03:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a14846000 1 -- 172.21.15.59:0/2810906844 wait complete. 2024-04-25T09:03:00.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a14846000 20 client.5505 trim_cache size 0 max 16384 2024-04-25T09:03:00.706 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:03:00.706 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:03:00.706 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:03:00.707 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5289, 2024-04-25T09:03:00.707 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:03:00.707 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:03:00.707 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:03:00.707 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 10.481159334000001, 2024-04-25T09:03:00.707 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 19, 2024-04-25T09:03:00.707 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 39, 2024-04-25T09:03:00.707 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 39, 2024-04-25T09:03:00.707 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 19.422516295000001 2024-04-25T09:03:00.707 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:03:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a11400640 1 -- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f99e8066f90 msgr2=0x7f99e8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a11400640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f99e8066f90 0x7f99e8069450 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0cf260 tx=0x7f99f4008040 comp rx=0 tx=0).stop 2024-04-25T09:03:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a11400640 1 -- 172.21.15.59:0/37556232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99f0004d50 msgr2=0x7f9a0c09ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a11400640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99f0004d50 0x7f9a0c09ee60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00f770 tx=0x7f99fc00fc30 comp rx=0 tx=0).stop 2024-04-25T09:03:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a11400640 1 -- 172.21.15.59:0/37556232 shutdown_connections 2024-04-25T09:03:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a11400640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f99e8066f90 0x7f99e8069450 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a11400640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a0c1f75e0 0x7f9a0c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a11400640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a0c1f6c20 0x7f9a0c1f70a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a11400640 1 --2- 172.21.15.59:0/37556232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99f0004d50 0x7f9a0c09ee60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a11400640 1 -- 172.21.15.59:0/37556232 >> 172.21.15.59:0/37556232 conn(0x7f9a0c0b3200 msgr2=0x7f9a0c06d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a11400640 1 -- 172.21.15.59:0/37556232 shutdown_connections 2024-04-25T09:03:00.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.711+0000 7f9a11400640 1 -- 172.21.15.59:0/37556232 wait complete. 2024-04-25T09:03:00.721 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:03:00.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe19d400640 1 Processor -- start 2024-04-25T09:03:00.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe19d400640 1 -- start start 2024-04-25T09:03:00.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe19d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe19809a170 0x7fe1980cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe19d400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19806d740 con 0x7fe19809a7a0 2024-04-25T09:03:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe19d400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19806cea0 con 0x7fe19815dcd0 2024-04-25T09:03:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe19d400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1980cbfc0 con 0x7fe19809a170 2024-04-25T09:03:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe18f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe19809a170 0x7fe1980cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe19ca00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe19809a7a0 0x7fe1980cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60484/0 (socket says 172.21.15.59:60484) 2024-04-25T09:03:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe19ca00640 1 -- 172.21.15.59:0/360648967 learned_addr learned my addr 172.21.15.59:0/360648967 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe18f400640 1 -- 172.21.15.59:0/360648967 >> v1:172.21.15.178:6789/0 conn(0x7fe19815dcd0 legacy=0x7fe198099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe18f400640 1 -- 172.21.15.59:0/360648967 >> v1:172.21.15.59:6789/0 conn(0x7fe19809a7a0 legacy=0x7fe1980cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe18f400640 1 -- 172.21.15.59:0/360648967 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe19806d180 con 0x7fe19809a170 2024-04-25T09:03:00.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.871+0000 7fe197400640 1 -- 172.21.15.59:0/360648967 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644951932 0 0) 0x7fe19806d740 con 0x7fe19809a7a0 2024-04-25T09:03:00.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.875+0000 7fe18f400640 1 --2- 172.21.15.59:0/360648967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe19809a170 0x7fe1980cc450 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe1800097c0 tx=0x7fe1980cd8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320acce8fdfb2cfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:00.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.875+0000 7fe197400640 1 -- 172.21.15.59:0/360648967 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800a7070 con 0x7fe19809a170 2024-04-25T09:03:00.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.875+0000 7fe197400640 1 -- 172.21.15.59:0/360648967 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1800b0070 con 0x7fe19809a170 2024-04-25T09:03:00.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.875+0000 7fe197400640 1 -- 172.21.15.59:0/360648967 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800ab890 con 0x7fe19809a170 2024-04-25T09:03:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.875+0000 7fe19d400640 1 -- 172.21.15.59:0/360648967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe19809a170 msgr2=0x7fe1980cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.875+0000 7fe19d400640 1 --2- 172.21.15.59:0/360648967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe19809a170 0x7fe1980cc450 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fe1800097c0 tx=0x7fe1980cd8b0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.875+0000 7fe19d400640 1 -- 172.21.15.59:0/360648967 shutdown_connections 2024-04-25T09:03:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.875+0000 7fe19d400640 1 --2- 172.21.15.59:0/360648967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe19809a170 0x7fe1980cc450 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.875+0000 7fe19d400640 1 -- 172.21.15.59:0/360648967 >> 172.21.15.59:0/360648967 conn(0x7fe1980b3050 msgr2=0x7fe1980b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.875+0000 7fe19d400640 1 -- 172.21.15.59:0/360648967 shutdown_connections 2024-04-25T09:03:00.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.875+0000 7fe19d400640 1 -- 172.21.15.59:0/360648967 wait complete. 2024-04-25T09:03:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19d400640 1 Processor -- start 2024-04-25T09:03:00.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19d400640 1 -- start start 2024-04-25T09:03:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19d400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe19809a170 0x7fe198158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe19809a7a0 0x7fe1981531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe19815dcd0 0x7fe1981543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19d400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19816ba30 con 0x7fe19809a7a0 2024-04-25T09:03:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19d400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19816b8b0 con 0x7fe19815dcd0 2024-04-25T09:03:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19d400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19816bbb0 con 0x7fe19809a170 2024-04-25T09:03:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe18f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe19809a7a0 0x7fe1981531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe18f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe19809a7a0 0x7fe1981531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55592/0 (socket says 172.21.15.59:55592) 2024-04-25T09:03:00.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe18f400640 1 -- 172.21.15.59:0/185696609 learned_addr learned my addr 172.21.15.59:0/185696609 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19ca00640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe19815dcd0 0x7fe1981543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe197e00640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe19809a170 0x7fe198158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe18f400640 1 -- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe19809a170 msgr2=0x7fe198158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe18f400640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe19809a170 0x7fe198158260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe18f400640 1 -- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe19815dcd0 msgr2=0x7fe1981543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe18f400640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe19815dcd0 0x7fe1981543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe18f400640 1 -- 172.21.15.59:0/185696609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe198155d50 con 0x7fe19809a7a0 2024-04-25T09:03:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe197e00640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe19809a170 0x7fe198158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19ca00640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe19815dcd0 0x7fe1981543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe18f400640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe19809a7a0 0x7fe1981531f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe180019080 tx=0x7fe18001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe194c00640 1 -- 172.21.15.59:0/185696609 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800bf610 con 0x7fe19809a7a0 2024-04-25T09:03:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe194c00640 1 -- 172.21.15.59:0/185696609 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1800bf7b0 con 0x7fe19809a7a0 2024-04-25T09:03:00.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19d400640 1 -- 172.21.15.59:0/185696609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe198154cb0 con 0x7fe19809a7a0 2024-04-25T09:03:00.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe194c00640 1 -- 172.21.15.59:0/185696609 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1800bfba0 con 0x7fe19809a7a0 2024-04-25T09:03:00.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19d400640 1 -- 172.21.15.59:0/185696609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe198155270 con 0x7fe19809a7a0 2024-04-25T09:03:00.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.879+0000 7fe19d400640 1 -- 172.21.15.59:0/185696609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19804efa0 con 0x7fe19809a7a0 2024-04-25T09:03:00.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.883+0000 7fe194c00640 1 -- 172.21.15.59:0/185696609 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe1800bd020 con 0x7fe19809a7a0 2024-04-25T09:03:00.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.883+0000 7fe194c00640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe174066f60 0x7fe174069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:00.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.883+0000 7fe194c00640 1 -- 172.21.15.59:0/185696609 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe18011f9d0 con 0x7fe19809a7a0 2024-04-25T09:03:00.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.883+0000 7fe197e00640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe174066f60 0x7fe174069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:00.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.883+0000 7fe197e00640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe174066f60 0x7fe174069420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe19815c730 tx=0x7fe188009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:00.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:00.887+0000 7fe194c00640 1 -- 172.21.15.59:0/185696609 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe198155d50 con 0x7fe19809a7a0 2024-04-25T09:03:01.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.083+0000 7fe19d400640 1 -- 172.21.15.59:0/185696609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe1980cff50 con 0x7fe19809a7a0 2024-04-25T09:03:01.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.083+0000 7fe194c00640 1 -- 172.21.15.59:0/185696609 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe180016090 con 0x7fe19809a7a0 2024-04-25T09:03:01.076 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:03:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.087+0000 7fe19d400640 1 -- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe174066f60 msgr2=0x7fe174069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.087+0000 7fe19d400640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe174066f60 0x7fe174069420 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe19815c730 tx=0x7fe188009040 comp rx=0 tx=0).stop 2024-04-25T09:03:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.087+0000 7fe19d400640 1 -- 172.21.15.59:0/185696609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe19809a7a0 msgr2=0x7fe1981531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.087+0000 7fe19d400640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe19809a7a0 0x7fe1981531f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fe180019080 tx=0x7fe18001acb0 comp rx=0 tx=0).stop 2024-04-25T09:03:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.087+0000 7fe19d400640 1 -- 172.21.15.59:0/185696609 shutdown_connections 2024-04-25T09:03:01.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.087+0000 7fe19d400640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe174066f60 0x7fe174069420 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.087+0000 7fe19d400640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe19815dcd0 0x7fe1981543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.087+0000 7fe19d400640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe19809a7a0 0x7fe1981531f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.087+0000 7fe19d400640 1 --2- 172.21.15.59:0/185696609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe19809a170 0x7fe198158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.087+0000 7fe19d400640 1 -- 172.21.15.59:0/185696609 >> 172.21.15.59:0/185696609 conn(0x7fe1980b3050 msgr2=0x7fe1980708d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.087+0000 7fe19d400640 1 -- 172.21.15.59:0/185696609 shutdown_connections 2024-04-25T09:03:01.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:01.087+0000 7fe19d400640 1 -- 172.21.15.59:0/185696609 wait complete. 2024-04-25T09:03:01.097 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:03:01.098 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:03:01.098 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:03:01.098 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:03:01.098 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:01.098 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:03:01.098 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:03:01.098 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:03:01.098 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:01.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.099 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:03:01.108 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:01.108 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:01.108 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:01.108 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:01.108 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:01.108 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42386sec preferred_lft 42386sec 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:01.109 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:01.110 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:03:01.111 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:03:01.111 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:01.111 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:01.111 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:03:01.111 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:03:01.111 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:01.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.112 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:03:01.174 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:03:01.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.176 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:03:01.229 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:03:01.229 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:03:01.229 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:03:01.229 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:03:01.229 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:03:01.229 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:03:01.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.230 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:03:01.230 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:03:01.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:03:01.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:03:01.230 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:03:01.230 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:03:01.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.323 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:03:01.333 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:03:01.333 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:03:01.333 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:01.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.333 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:03:01.401 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:01.401 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:01.452 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:01.453 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:01.453 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:01.504 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:03:01.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.504 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:01.601 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:03:01.616 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:01.616 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:01.616 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:03:01.616 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:03:01.616 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:01.627 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:01.627 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:01.627 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:03:01.627 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:03:01.627 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:01.627 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:03:01.628 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:03:01.628 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:03:01.631 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:03:01.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.631 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:01.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.652 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:01.712 INFO:teuthology.orchestra.run.smithi059.stdout:client5392 2024-04-25T09:03:01.712 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:03:01.713 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:01.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.765 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-04-25T09:03:01.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.824 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-04-25T09:03:01.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.875 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-04-25T09:03:01.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.927 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-04-25T09:03:01.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:01.982 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-04-25T09:03:02.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:02.035 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:03:02.090 INFO:teuthology.orchestra.run.smithi059.stdout:./ 2024-04-25T09:03:02.091 INFO:teuthology.orchestra.run.smithi059.stdout:./rfile 2024-04-25T09:03:02.091 INFO:teuthology.orchestra.run.smithi059.stdout:./parentdir 2024-04-25T09:03:02.091 INFO:teuthology.orchestra.run.smithi059.stdout:./parentdir/pfile 2024-04-25T09:03:02.091 INFO:teuthology.orchestra.run.smithi059.stdout:./parentdir/childdir 2024-04-25T09:03:02.091 INFO:teuthology.orchestra.run.smithi059.stdout:./parentdir/childdir/cfile 2024-04-25T09:03:02.092 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:03:02.092 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:03:02.092 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:03:02.092 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:03:02.092 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:03:02.092 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:03:02.202 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:03:02.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:02.211 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:03:02.212 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:03:02.212 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:03:02.212 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:03:02.212 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-04-25T09:03:02.212 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:03:02.322 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627778 2024-04-25T09:03:02.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:02.331 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:03:02.331 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:03:02.331 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:03:02.331 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:03:02.331 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-04-25T09:03:02.331 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:03:02.438 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627776 2024-04-25T09:03:02.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:02.448 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:03:02.448 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:03:02.448 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:03:02.448 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:03:02.448 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-04-25T09:03:02.448 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:03:02.558 INFO:teuthology.orchestra.run.smithi059.stdout:1099511628279 2024-04-25T09:03:02.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:02.567 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:03:02.567 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:03:02.567 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:03:02.567 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:03:02.567 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-04-25T09:03:02.567 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:03:02.678 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627777 2024-04-25T09:03:02.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:02.689 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:03:02.689 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:03:02.689 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:03:02.689 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:03:02.689 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-04-25T09:03:02.689 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:03:02.798 INFO:teuthology.orchestra.run.smithi059.stdout:1099511628280 2024-04-25T09:03:02.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:02.808 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:03:02.808 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:02.857 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:03:02.857 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:02.908 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.099+0000 7f75f6c00640 1 Processor -- start 2024-04-25T09:03:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.099+0000 7f75f6c00640 1 -- start start 2024-04-25T09:03:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75f6c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f75f0144140 0x7f75f00ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75f6c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75f006ead0 0x7f75f00b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75f6c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f015ac60 con 0x7f75f00ced60 2024-04-25T09:03:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75f6c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f00cf3e0 con 0x7f75f006ead0 2024-04-25T09:03:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75f6c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f015af20 con 0x7f75f0144140 2024-04-25T09:03:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75f4c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75f006ead0 0x7f75f00b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75f4c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f75f006ead0 0x7f75f00b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55596/0 (socket says 172.21.15.59:55596) 2024-04-25T09:03:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75f4c00640 1 -- 172.21.15.59:0/3284476504 learned_addr learned my addr 172.21.15.59:0/3284476504 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:03.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75efe00640 1 --2- 172.21.15.59:0/3284476504 >> v2:172.21.15.178:3300/0 conn(0x7f75f0144140 0x7f75f00ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75f4c00640 1 -- 172.21.15.59:0/3284476504 >> v2:172.21.15.178:3300/0 conn(0x7f75f0144140 msgr2=0x7f75f00ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75f4c00640 1 --2- 172.21.15.59:0/3284476504 >> v2:172.21.15.178:3300/0 conn(0x7f75f0144140 0x7f75f00ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75f4c00640 1 -- 172.21.15.59:0/3284476504 >> v1:172.21.15.178:6789/0 conn(0x7f75f00ced60 legacy=0x7f75f006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.103+0000 7f75f4c00640 1 -- 172.21.15.59:0/3284476504 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f015b200 con 0x7f75f006ead0 2024-04-25T09:03:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75f4c00640 1 --2- 172.21.15.59:0/3284476504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f006ead0 0x7f75f00b0760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f75f006eef0 tx=0x7f75e801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7770915120ea861 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75ef400640 1 -- 172.21.15.59:0/3284476504 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e80090d0 con 0x7f75f006ead0 2024-04-25T09:03:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75ef400640 1 -- 172.21.15.59:0/3284476504 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e80ae070 con 0x7f75f006ead0 2024-04-25T09:03:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75ef400640 1 -- 172.21.15.59:0/3284476504 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e8009270 con 0x7f75f006ead0 2024-04-25T09:03:03.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75f6c00640 1 -- 172.21.15.59:0/3284476504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f006ead0 msgr2=0x7f75f00b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75f6c00640 1 --2- 172.21.15.59:0/3284476504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f006ead0 0x7f75f00b0760 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f75f006eef0 tx=0x7f75e801c9f0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75f6c00640 1 -- 172.21.15.59:0/3284476504 shutdown_connections 2024-04-25T09:03:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75f6c00640 1 --2- 172.21.15.59:0/3284476504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f006ead0 0x7f75f00b0760 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75f6c00640 1 --2- 172.21.15.59:0/3284476504 >> v2:172.21.15.178:3300/0 conn(0x7f75f0144140 0x7f75f00ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75f6c00640 1 -- 172.21.15.59:0/3284476504 >> 172.21.15.59:0/3284476504 conn(0x7f75f0066fa0 msgr2=0x7f75f006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75f6c00640 1 -- 172.21.15.59:0/3284476504 shutdown_connections 2024-04-25T09:03:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75f6c00640 1 -- 172.21.15.59:0/3284476504 wait complete. 2024-04-25T09:03:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75f6c00640 1 Processor -- start 2024-04-25T09:03:03.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75f6c00640 1 -- start start 2024-04-25T09:03:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.107+0000 7f75f6c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f006ead0 0x7f75f0156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75f6c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75f00ced60 0x7f75f0142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75f6c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75f0144140 0x7f75f0157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75f6c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f015bb80 con 0x7f75f006ead0 2024-04-25T09:03:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75f6c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f015ba00 con 0x7f75f0144140 2024-04-25T09:03:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75f6c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f01673e0 con 0x7f75f00ced60 2024-04-25T09:03:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f006ead0 0x7f75f0156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f006ead0 0x7f75f0156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55610/0 (socket says 172.21.15.59:55610) 2024-04-25T09:03:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75efe00640 1 -- 172.21.15.59:0/3678331355 learned_addr learned my addr 172.21.15.59:0/3678331355 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75f4c00640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75f0144140 0x7f75f0157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75e7400640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75f00ced60 0x7f75f0142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75efe00640 1 -- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75f00ced60 msgr2=0x7f75f0142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75efe00640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75f00ced60 0x7f75f0142790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75efe00640 1 -- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75f0144140 msgr2=0x7f75f0157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75efe00640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75f0144140 0x7f75f0157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75efe00640 1 -- 172.21.15.59:0/3678331355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00c4b90 con 0x7f75f006ead0 2024-04-25T09:03:03.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75efe00640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f006ead0 0x7f75f0156980 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f75e000d5f0 tx=0x7f75e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75ecc00640 1 -- 172.21.15.59:0/3678331355 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e00125f0 con 0x7f75f006ead0 2024-04-25T09:03:03.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75ecc00640 1 -- 172.21.15.59:0/3678331355 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e0019070 con 0x7f75f006ead0 2024-04-25T09:03:03.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75ecc00640 1 -- 172.21.15.59:0/3678331355 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e00129b0 con 0x7f75f006ead0 2024-04-25T09:03:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75f6c00640 1 -- 172.21.15.59:0/3678331355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f00c4e70 con 0x7f75f006ead0 2024-04-25T09:03:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75f6c00640 1 -- 172.21.15.59:0/3678331355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f0156180 con 0x7f75f006ead0 2024-04-25T09:03:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75f6c00640 1 -- 172.21.15.59:0/3678331355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f00745d0 con 0x7f75f006ead0 2024-04-25T09:03:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.111+0000 7f75ecc00640 1 -- 172.21.15.59:0/3678331355 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f75e0012b50 con 0x7f75f006ead0 2024-04-25T09:03:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.115+0000 7f75ecc00640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f75cc066f60 0x7f75cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.115+0000 7f75ecc00640 1 -- 172.21.15.59:0/3678331355 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f75e0085490 con 0x7f75f006ead0 2024-04-25T09:03:03.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.115+0000 7f75e7400640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f75cc066f60 0x7f75cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.115+0000 7f75e7400640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f75cc066f60 0x7f75cc069420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f75f00cba40 tx=0x7f75d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.119+0000 7f75ecc00640 1 -- 172.21.15.59:0/3678331355 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f75e0055cb0 con 0x7f75f006ead0 2024-04-25T09:03:03.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.279+0000 7f75f6c00640 1 -- 172.21.15.59:0/3678331355 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75f015d040 con 0x7f75f006ead0 2024-04-25T09:03:03.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75ecc00640 1 -- 172.21.15.59:0/3678331355 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16942 (secure 0 0 0) 0x7f75e0059d50 con 0x7f75f006ead0 2024-04-25T09:03:03.274 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:03.274 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":39,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:02:51.230318+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:47.433966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:48.612644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:03.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75f6c00640 1 -- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f75cc066f60 msgr2=0x7f75cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75f6c00640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f75cc066f60 0x7f75cc069420 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f75f00cba40 tx=0x7f75d8009040 comp rx=0 tx=0).stop 2024-04-25T09:03:03.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75f6c00640 1 -- 172.21.15.59:0/3678331355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f006ead0 msgr2=0x7f75f0156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75f6c00640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f006ead0 0x7f75f0156980 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f75e000d5f0 tx=0x7f75e000dab0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75f6c00640 1 -- 172.21.15.59:0/3678331355 shutdown_connections 2024-04-25T09:03:03.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75f6c00640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f75cc066f60 0x7f75cc069420 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75f6c00640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f75f0144140 0x7f75f0157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75f6c00640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f75f00ced60 0x7f75f0142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75f6c00640 1 --2- 172.21.15.59:0/3678331355 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f006ead0 0x7f75f0156980 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75f6c00640 1 -- 172.21.15.59:0/3678331355 >> 172.21.15.59:0/3678331355 conn(0x7f75f0066fa0 msgr2=0x7f75f015c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:03.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75f6c00640 1 -- 172.21.15.59:0/3678331355 shutdown_connections 2024-04-25T09:03:03.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.283+0000 7f75f6c00640 1 -- 172.21.15.59:0/3678331355 wait complete. 2024-04-25T09:03:03.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:47.433966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:48.612644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:03.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:03.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.447+0000 7fc76ce00640 1 Processor -- start 2024-04-25T09:03:03.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.447+0000 7fc76ce00640 1 -- start start 2024-04-25T09:03:03.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.451+0000 7fc76ce00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc76809a170 0x7fc7680d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.451+0000 7fc76ce00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76815e040 con 0x7fc76815dc60 2024-04-25T09:03:03.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.451+0000 7fc76ce00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7680cff80 con 0x7fc76806bf30 2024-04-25T09:03:03.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.451+0000 7fc76ce00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7680d0260 con 0x7fc76809a170 2024-04-25T09:03:03.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.451+0000 7fc75d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc76809a170 0x7fc7680d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.451+0000 7fc765e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc76815dc60 0x7fc768099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60496/0 (socket says 172.21.15.59:60496) 2024-04-25T09:03:03.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.451+0000 7fc765e00640 1 -- 172.21.15.59:0/1169401525 learned_addr learned my addr 172.21.15.59:0/1169401525 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:03.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.451+0000 7fc75d400640 1 -- 172.21.15.59:0/1169401525 >> v1:172.21.15.178:6789/0 conn(0x7fc76806bf30 legacy=0x7fc7680cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.451+0000 7fc75d400640 1 -- 172.21.15.59:0/1169401525 >> v1:172.21.15.59:6789/0 conn(0x7fc76815dc60 legacy=0x7fc768099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.451+0000 7fc75d400640 1 -- 172.21.15.59:0/1169401525 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7680d0540 con 0x7fc76809a170 2024-04-25T09:03:03.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc75d400640 1 --2- 172.21.15.59:0/1169401525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76809a170 0x7fc7680d1020 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc7500097c0 tx=0x7fc75001c350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840ceae7c7f2b069 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc765400640 1 -- 172.21.15.59:0/1169401525 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7500b0070 con 0x7fc76809a170 2024-04-25T09:03:03.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc765400640 1 -- 172.21.15.59:0/1169401525 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc750004230 con 0x7fc76809a170 2024-04-25T09:03:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc765400640 1 -- 172.21.15.59:0/1169401525 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc750003620 con 0x7fc76809a170 2024-04-25T09:03:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc76ce00640 1 -- 172.21.15.59:0/1169401525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76809a170 msgr2=0x7fc7680d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc76ce00640 1 --2- 172.21.15.59:0/1169401525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76809a170 0x7fc7680d1020 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc7500097c0 tx=0x7fc75001c350 comp rx=0 tx=0).stop 2024-04-25T09:03:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc76ce00640 1 -- 172.21.15.59:0/1169401525 shutdown_connections 2024-04-25T09:03:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc76ce00640 1 --2- 172.21.15.59:0/1169401525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76809a170 0x7fc7680d1020 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc76ce00640 1 -- 172.21.15.59:0/1169401525 >> 172.21.15.59:0/1169401525 conn(0x7fc7680b3200 msgr2=0x7fc7680b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc76ce00640 1 -- 172.21.15.59:0/1169401525 shutdown_connections 2024-04-25T09:03:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc76ce00640 1 -- 172.21.15.59:0/1169401525 wait complete. 2024-04-25T09:03:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc76ce00640 1 Processor -- start 2024-04-25T09:03:03.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.455+0000 7fc76ce00640 1 -- start start 2024-04-25T09:03:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc76ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76806bf30 0x7fc76815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc76ce00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc76809a170 0x7fc768154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc76ce00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc76815dc60 0x7fc7680c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc76ce00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76806cfa0 con 0x7fc76806bf30 2024-04-25T09:03:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc76ce00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7680cc880 con 0x7fc76809a170 2024-04-25T09:03:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc76ce00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76815b8e0 con 0x7fc76815dc60 2024-04-25T09:03:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc765e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76806bf30 0x7fc76815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc765e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76806bf30 0x7fc76815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55636/0 (socket says 172.21.15.59:55636) 2024-04-25T09:03:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc765e00640 1 -- 172.21.15.59:0/1206408132 learned_addr learned my addr 172.21.15.59:0/1206408132 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:03.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc75d400640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc76809a170 0x7fc768154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc765e00640 1 -- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc76815dc60 msgr2=0x7fc7680c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc765e00640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc76815dc60 0x7fc7680c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc765e00640 1 -- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc76809a170 msgr2=0x7fc768154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc765e00640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc76809a170 0x7fc768154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc765e00640 1 -- 172.21.15.59:0/1206408132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc768099c70 con 0x7fc76806bf30 2024-04-25T09:03:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc75d400640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc76809a170 0x7fc768154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc765e00640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76806bf30 0x7fc76815a6f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc75800c430 tx=0x7fc75800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc75ea00640 1 -- 172.21.15.59:0/1206408132 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc758017070 con 0x7fc76806bf30 2024-04-25T09:03:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc75ea00640 1 -- 172.21.15.59:0/1206408132 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc758005cf0 con 0x7fc76806bf30 2024-04-25T09:03:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc76ce00640 1 -- 172.21.15.59:0/1206408132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76815acd0 con 0x7fc76806bf30 2024-04-25T09:03:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc75ea00640 1 -- 172.21.15.59:0/1206408132 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7580072d0 con 0x7fc76806bf30 2024-04-25T09:03:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc76ce00640 1 -- 172.21.15.59:0/1206408132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76815b290 con 0x7fc76806bf30 2024-04-25T09:03:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc76ce00640 1 -- 172.21.15.59:0/1206408132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7680745d0 con 0x7fc76806bf30 2024-04-25T09:03:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.459+0000 7fc75ea00640 1 -- 172.21.15.59:0/1206408132 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc75801a070 con 0x7fc76806bf30 2024-04-25T09:03:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.463+0000 7fc75ea00640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc744066f60 0x7fc744069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.463+0000 7fc75ea00640 1 -- 172.21.15.59:0/1206408132 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc758084440 con 0x7fc76806bf30 2024-04-25T09:03:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.463+0000 7fc75d400640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc744066f60 0x7fc744069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.463+0000 7fc75d400640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc744066f60 0x7fc744069420 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc7500ad000 tx=0x7fc7500a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.463+0000 7fc75ea00640 1 -- 172.21.15.59:0/1206408132 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc758054c70 con 0x7fc76806bf30 2024-04-25T09:03:03.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.627+0000 7fc76ce00640 1 -- 172.21.15.59:0/1206408132 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7680b7590 con 0x7fc76806bf30 2024-04-25T09:03:03.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.627+0000 7fc75ea00640 1 -- 172.21.15.59:0/1206408132 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc758058d10 con 0x7fc76806bf30 2024-04-25T09:03:03.621 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:03:03.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.631+0000 7fc76ce00640 1 -- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc744066f60 msgr2=0x7fc744069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.631+0000 7fc76ce00640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc744066f60 0x7fc744069420 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc7500ad000 tx=0x7fc7500a6000 comp rx=0 tx=0).stop 2024-04-25T09:03:03.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.631+0000 7fc76ce00640 1 -- 172.21.15.59:0/1206408132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76806bf30 msgr2=0x7fc76815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.631+0000 7fc76ce00640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76806bf30 0x7fc76815a6f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc75800c430 tx=0x7fc75800c8f0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.631+0000 7fc76ce00640 1 -- 172.21.15.59:0/1206408132 shutdown_connections 2024-04-25T09:03:03.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.631+0000 7fc76ce00640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc744066f60 0x7fc744069420 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.631+0000 7fc76ce00640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc76815dc60 0x7fc7680c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.631+0000 7fc76ce00640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc76809a170 0x7fc768154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.631+0000 7fc76ce00640 1 --2- 172.21.15.59:0/1206408132 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76806bf30 0x7fc76815a6f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.631+0000 7fc76ce00640 1 -- 172.21.15.59:0/1206408132 >> 172.21.15.59:0/1206408132 conn(0x7fc7680b3200 msgr2=0x7fc7680b6e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:03.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.631+0000 7fc76ce00640 1 -- 172.21.15.59:0/1206408132 shutdown_connections 2024-04-25T09:03:03.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.631+0000 7fc76ce00640 1 -- 172.21.15.59:0/1206408132 wait complete. 2024-04-25T09:03:03.640 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1536600640 1 Processor -- start 2024-04-25T09:03:03.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1536600640 1 -- start start 2024-04-25T09:03:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1536600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f153015fb60 0x7f1530166790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1536600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1530099c00 con 0x7f153015b770 2024-04-25T09:03:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1536600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1530099ee0 con 0x7f153015bb50 2024-04-25T09:03:03.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1536600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153009a1c0 con 0x7f153015fb60 2024-04-25T09:03:03.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1535200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f153015b770 0x7f153015f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60512/0 (socket says 172.21.15.59:60512) 2024-04-25T09:03:03.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1535200640 1 -- 172.21.15.59:0/4184472388 learned_addr learned my addr 172.21.15.59:0/4184472388 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1535c00640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f153015fb60 0x7f1530166790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341663962 0 0) 0x7f1530099c00 con 0x7f153015b770 2024-04-25T09:03:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1518003530 con 0x7f153015b770 2024-04-25T09:03:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3133749189 0 0) 0x7f1518003530 con 0x7f153015b770 2024-04-25T09:03:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f153015fb60 msgr2=0x7f1530166790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f153015fb60 0x7f1530166790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 >> v1:172.21.15.178:6789/0 conn(0x7f153015bb50 legacy=0x7f15300ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153009a4a0 con 0x7f153015b770 2024-04-25T09:03:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f1524001680 con 0x7f153015b770 2024-04-25T09:03:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 >> v1:172.21.15.59:6789/0 conn(0x7f153015b770 legacy=0x7f153015f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15180039f0 0x7f1518003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f153015fb60 0x7f1518004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1518004d50 0x7f15180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f153009a1c0 con 0x7f15180039f0 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151800ba00 con 0x7f1518004d50 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151800bc00 con 0x7f153015fb60 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1535200640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15180039f0 0x7f1518003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f152fe00640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f153015fb60 0x7f1518004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1535c00640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1518004d50 0x7f15180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1535200640 1 -- 172.21.15.59:0/4184472388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f153015fb60 msgr2=0x7f1518004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1535200640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f153015fb60 0x7f1518004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1535200640 1 -- 172.21.15.59:0/4184472388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1518004d50 msgr2=0x7f15180051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1535200640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1518004d50 0x7f15180051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1535200640 1 -- 172.21.15.59:0/4184472388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1518003530 con 0x7f15180039f0 2024-04-25T09:03:03.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.795+0000 7f1535c00640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1518004d50 0x7f15180051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.799+0000 7f1535200640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15180039f0 0x7f1518003dd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f152400c2c0 tx=0x7f152401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5144cd4eb2f3de26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.799+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524007d60 con 0x7f15180039f0 2024-04-25T09:03:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.799+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15240a9070 con 0x7f15180039f0 2024-04-25T09:03:03.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.799+0000 7f152f400640 1 -- 172.21.15.59:0/4184472388 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524005d40 con 0x7f15180039f0 2024-04-25T09:03:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.799+0000 7f1536600640 1 -- 172.21.15.59:0/4184472388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15180039f0 msgr2=0x7f1518003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.799+0000 7f1536600640 1 --2- 172.21.15.59:0/4184472388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15180039f0 0x7f1518003dd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f152400c2c0 tx=0x7f152401cc50 comp rx=0 tx=0).stop 2024-04-25T09:03:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.799+0000 7f1535c00640 1 -- 172.21.15.59:0/4184472388 reap_dead start 2024-04-25T09:03:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.799+0000 7f1536600640 1 -- 172.21.15.59:0/4184472388 shutdown_connections 2024-04-25T09:03:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.799+0000 7f1536600640 1 -- 172.21.15.59:0/4184472388 >> 172.21.15.59:0/4184472388 conn(0x7f15300b3060 msgr2=0x7f15300b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.799+0000 7f1536600640 1 -- 172.21.15.59:0/4184472388 shutdown_connections 2024-04-25T09:03:03.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.799+0000 7f1536600640 1 -- 172.21.15.59:0/4184472388 wait complete. 2024-04-25T09:03:03.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1536600640 1 Processor -- start 2024-04-25T09:03:03.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1536600640 1 -- start start 2024-04-25T09:03:03.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1536600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15180039f0 0x7f1530156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1536600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15300b0a50 0x7f15300b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1536600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15300ce980 0x7f15300cee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1536600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1530167330 con 0x7f15180039f0 2024-04-25T09:03:03.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1536600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15301671b0 con 0x7f15300ce980 2024-04-25T09:03:03.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1536600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15301674b0 con 0x7f15300b0a50 2024-04-25T09:03:03.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1535200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15180039f0 0x7f1530156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1535200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15180039f0 0x7f1530156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55660/0 (socket says 172.21.15.59:55660) 2024-04-25T09:03:03.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1535200640 1 -- 172.21.15.59:0/1324740267 learned_addr learned my addr 172.21.15.59:0/1324740267 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:03.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f152fe00640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15300b0a50 0x7f15300b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1535c00640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15300ce980 0x7f15300cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1535200640 1 -- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15300b0a50 msgr2=0x7f15300b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1535200640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15300b0a50 0x7f15300b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1535200640 1 -- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15300ce980 msgr2=0x7f15300cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1535200640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15300ce980 0x7f15300cee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1535200640 1 -- 172.21.15.59:0/1324740267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15300c95e0 con 0x7f15180039f0 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1535200640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15180039f0 0x7f1530156ac0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f152401ca80 tx=0x7f1518005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f152cc00640 1 -- 172.21.15.59:0/1324740267 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524005d20 con 0x7f15180039f0 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f152cc00640 1 -- 172.21.15.59:0/1324740267 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1524001440 con 0x7f15180039f0 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1536600640 1 -- 172.21.15.59:0/1324740267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1530157000 con 0x7f15180039f0 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f152cc00640 1 -- 172.21.15.59:0/1324740267 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15240017f0 con 0x7f15180039f0 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.803+0000 7f1536600640 1 -- 172.21.15.59:0/1324740267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15300b12f0 con 0x7f15180039f0 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.807+0000 7f1536600640 1 -- 172.21.15.59:0/1324740267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15300745d0 con 0x7f15180039f0 2024-04-25T09:03:03.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.807+0000 7f152cc00640 1 -- 172.21.15.59:0/1324740267 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f15240a57c0 con 0x7f15180039f0 2024-04-25T09:03:03.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.807+0000 7f152cc00640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1510066f90 0x7f1510069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:03.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.807+0000 7f152cc00640 1 -- 172.21.15.59:0/1324740267 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f152411ed80 con 0x7f15180039f0 2024-04-25T09:03:03.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.807+0000 7f152fe00640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1510066f90 0x7f1510069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:03.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.807+0000 7f152fe00640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1510066f90 0x7f1510069450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15300cf690 tx=0x7f151c007c60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:03.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.811+0000 7f152cc00640 1 -- 172.21.15.59:0/1324740267 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1524016990 con 0x7f15180039f0 2024-04-25T09:03:03.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.971+0000 7f1536600640 1 -- 172.21.15.59:0/1324740267 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15300b3f00 con 0x7f15180039f0 2024-04-25T09:03:03.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.971+0000 7f152cc00640 1 -- 172.21.15.59:0/1324740267 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15240efbf0 con 0x7f15180039f0 2024-04-25T09:03:03.964 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:03:03.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.975+0000 7f1536600640 1 -- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1510066f90 msgr2=0x7f1510069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.975+0000 7f1536600640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1510066f90 0x7f1510069450 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15300cf690 tx=0x7f151c007c60 comp rx=0 tx=0).stop 2024-04-25T09:03:03.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.975+0000 7f1536600640 1 -- 172.21.15.59:0/1324740267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15180039f0 msgr2=0x7f1530156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:03.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.975+0000 7f1536600640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15180039f0 0x7f1530156ac0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f152401ca80 tx=0x7f1518005840 comp rx=0 tx=0).stop 2024-04-25T09:03:03.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.975+0000 7f1536600640 1 -- 172.21.15.59:0/1324740267 shutdown_connections 2024-04-25T09:03:03.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.975+0000 7f1536600640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1510066f90 0x7f1510069450 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.975+0000 7f1536600640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15300ce980 0x7f15300cee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.975+0000 7f1536600640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15300b0a50 0x7f15300b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.975+0000 7f1536600640 1 --2- 172.21.15.59:0/1324740267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15180039f0 0x7f1530156ac0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:03.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.975+0000 7f1536600640 1 -- 172.21.15.59:0/1324740267 >> 172.21.15.59:0/1324740267 conn(0x7f15300b3060 msgr2=0x7f15300b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:03.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.975+0000 7f1536600640 1 -- 172.21.15.59:0/1324740267 shutdown_connections 2024-04-25T09:03:03.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:03.975+0000 7f1536600640 1 -- 172.21.15.59:0/1324740267 wait complete. 2024-04-25T09:03:03.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:04.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.135+0000 7fe3fd000640 1 Processor -- start 2024-04-25T09:03:04.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.135+0000 7fe3fd000640 1 -- start start 2024-04-25T09:03:04.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3fd000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3f815acd0 0x7fe3f815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3fd000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f815bc40 con 0x7fe3f8144120 2024-04-25T09:03:04.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3fd000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f815b3a0 con 0x7fe3f815ee60 2024-04-25T09:03:04.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3fd000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f815e490 con 0x7fe3f815acd0 2024-04-25T09:03:04.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3f5e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe3f8144120 0x7fe3f80ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60522/0 (socket says 172.21.15.59:60522) 2024-04-25T09:03:04.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3f5e00640 1 -- 172.21.15.59:0/1595663515 learned_addr learned my addr 172.21.15.59:0/1595663515 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3ed400640 1 --2- 172.21.15.59:0/1595663515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3f815acd0 0x7fe3f815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3f5400640 1 -- 172.21.15.59:0/1595663515 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109391745 0 0) 0x7fe3f815bc40 con 0x7fe3f8144120 2024-04-25T09:03:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3f5400640 1 -- 172.21.15.59:0/1595663515 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3dc003530 con 0x7fe3f8144120 2024-04-25T09:03:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3f5400640 1 -- 172.21.15.59:0/1595663515 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166552063 0 0) 0x7fe3f815b3a0 con 0x7fe3f815ee60 2024-04-25T09:03:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3f5400640 1 -- 172.21.15.59:0/1595663515 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3f815bc40 con 0x7fe3f815ee60 2024-04-25T09:03:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3f5400640 1 -- 172.21.15.59:0/1595663515 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2427155149 0 0) 0x7fe3dc003530 con 0x7fe3f8144120 2024-04-25T09:03:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3ed400640 1 -- 172.21.15.59:0/1595663515 >> v1:172.21.15.178:6789/0 conn(0x7fe3f815ee60 legacy=0x7fe3f80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3ed400640 1 -- 172.21.15.59:0/1595663515 >> v1:172.21.15.59:6789/0 conn(0x7fe3f8144120 legacy=0x7fe3f80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.139+0000 7fe3ed400640 1 -- 172.21.15.59:0/1595663515 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f815b680 con 0x7fe3f815acd0 2024-04-25T09:03:04.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.143+0000 7fe3ed400640 1 --2- 172.21.15.59:0/1595663515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3f815acd0 0x7fe3f815e920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00097f0 tx=0x7fe3e001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f13528b8ed383a08 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.143+0000 7fe3f5400640 1 -- 172.21.15.59:0/1595663515 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e00b0070 con 0x7fe3f815acd0 2024-04-25T09:03:04.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.143+0000 7fe3f5400640 1 -- 172.21.15.59:0/1595663515 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e00ab400 con 0x7fe3f815acd0 2024-04-25T09:03:04.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.143+0000 7fe3f5400640 1 -- 172.21.15.59:0/1595663515 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8001680 con 0x7fe3f815acd0 2024-04-25T09:03:04.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.143+0000 7fe3fd000640 1 -- 172.21.15.59:0/1595663515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3f815acd0 msgr2=0x7fe3f815e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.143+0000 7fe3fd000640 1 --2- 172.21.15.59:0/1595663515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3f815acd0 0x7fe3f815e920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00097f0 tx=0x7fe3e001c370 comp rx=0 tx=0).stop 2024-04-25T09:03:04.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.143+0000 7fe3fd000640 1 -- 172.21.15.59:0/1595663515 shutdown_connections 2024-04-25T09:03:04.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.143+0000 7fe3fd000640 1 --2- 172.21.15.59:0/1595663515 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3f815acd0 0x7fe3f815e920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.143+0000 7fe3fd000640 1 -- 172.21.15.59:0/1595663515 >> 172.21.15.59:0/1595663515 conn(0x7fe3f8067080 msgr2=0x7fe3f806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:04.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.143+0000 7fe3fd000640 1 -- 172.21.15.59:0/1595663515 shutdown_connections 2024-04-25T09:03:04.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.143+0000 7fe3fd000640 1 -- 172.21.15.59:0/1595663515 wait complete. 2024-04-25T09:03:04.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.143+0000 7fe3fd000640 1 Processor -- start 2024-04-25T09:03:04.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3fd000640 1 -- start start 2024-04-25T09:03:04.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3fd000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3f8144120 0x7fe3f8142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3fd000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3f815acd0 0x7fe3f81430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3fd000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3f815ee60 0x7fe3f80ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3fd000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f806deb0 con 0x7fe3f8144120 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3fd000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f806dd30 con 0x7fe3f815acd0 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3fd000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f806e030 con 0x7fe3f815ee60 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3f5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3f8144120 0x7fe3f8142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3f5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3f8144120 0x7fe3f8142b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55670/0 (socket says 172.21.15.59:55670) 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3f5e00640 1 -- 172.21.15.59:0/2721291539 learned_addr learned my addr 172.21.15.59:0/2721291539 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3ed400640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3f815acd0 0x7fe3f81430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3f5e00640 1 -- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3f815ee60 msgr2=0x7fe3f80ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3f6800640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3f815ee60 0x7fe3f80ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3f5e00640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3f815ee60 0x7fe3f80ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3f5e00640 1 -- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3f815acd0 msgr2=0x7fe3f81430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3f5e00640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3f815acd0 0x7fe3f81430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3f5e00640 1 -- 172.21.15.59:0/2721291539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f8143730 con 0x7fe3f8144120 2024-04-25T09:03:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3ed400640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3f815acd0 0x7fe3f81430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3f6800640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3f815ee60 0x7fe3f80ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3f5e00640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3f8144120 0x7fe3f8142b70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800c780 tx=0x7fe3e800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3eea00640 1 -- 172.21.15.59:0/2721291539 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8017070 con 0x7fe3f8144120 2024-04-25T09:03:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3eea00640 1 -- 172.21.15.59:0/2721291539 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e8005d10 con 0x7fe3f8144120 2024-04-25T09:03:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3eea00640 1 -- 172.21.15.59:0/2721291539 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e80072b0 con 0x7fe3f8144120 2024-04-25T09:03:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3fd000640 1 -- 172.21.15.59:0/2721291539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f81397e0 con 0x7fe3f8144120 2024-04-25T09:03:04.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3fd000640 1 -- 172.21.15.59:0/2721291539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f815a660 con 0x7fe3f8144120 2024-04-25T09:03:04.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.147+0000 7fe3fd000640 1 -- 172.21.15.59:0/2721291539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f80745d0 con 0x7fe3f8144120 2024-04-25T09:03:04.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.151+0000 7fe3eea00640 1 -- 172.21.15.59:0/2721291539 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe3e801a070 con 0x7fe3f8144120 2024-04-25T09:03:04.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.151+0000 7fe3eea00640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe3d4066f60 0x7fe3d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.151+0000 7fe3eea00640 1 -- 172.21.15.59:0/2721291539 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe3e8084950 con 0x7fe3f8144120 2024-04-25T09:03:04.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.151+0000 7fe3ed400640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe3d4066f60 0x7fe3d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.151+0000 7fe3ed400640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe3d4066f60 0x7fe3d4069420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00ad000 tx=0x7fe3e0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.155+0000 7fe3eea00640 1 -- 172.21.15.59:0/2721291539 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe3e80556b0 con 0x7fe3f8144120 2024-04-25T09:03:04.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.315+0000 7fe3fd000640 1 -- 172.21.15.59:0/2721291539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3f813d990 con 0x7fe3f8144120 2024-04-25T09:03:04.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.315+0000 7fe3eea00640 1 -- 172.21.15.59:0/2721291539 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3e8054fb0 con 0x7fe3f8144120 2024-04-25T09:03:04.308 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:03:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.319+0000 7fe3fd000640 1 -- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe3d4066f60 msgr2=0x7fe3d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.319+0000 7fe3fd000640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe3d4066f60 0x7fe3d4069420 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00ad000 tx=0x7fe3e0008040 comp rx=0 tx=0).stop 2024-04-25T09:03:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.319+0000 7fe3fd000640 1 -- 172.21.15.59:0/2721291539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3f8144120 msgr2=0x7fe3f8142b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.319+0000 7fe3fd000640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3f8144120 0x7fe3f8142b70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800c780 tx=0x7fe3e800cc40 comp rx=0 tx=0).stop 2024-04-25T09:03:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.319+0000 7fe3fd000640 1 -- 172.21.15.59:0/2721291539 shutdown_connections 2024-04-25T09:03:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.319+0000 7fe3fd000640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe3d4066f60 0x7fe3d4069420 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.319+0000 7fe3fd000640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3f815ee60 0x7fe3f80ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.319+0000 7fe3fd000640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3f815acd0 0x7fe3f81430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.319+0000 7fe3fd000640 1 --2- 172.21.15.59:0/2721291539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3f8144120 0x7fe3f8142b70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.319+0000 7fe3fd000640 1 -- 172.21.15.59:0/2721291539 >> 172.21.15.59:0/2721291539 conn(0x7fe3f8067080 msgr2=0x7fe3f813c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.319+0000 7fe3fd000640 1 -- 172.21.15.59:0/2721291539 shutdown_connections 2024-04-25T09:03:04.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.319+0000 7fe3fd000640 1 -- 172.21.15.59:0/2721291539 wait complete. 2024-04-25T09:03:04.330 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:03:04.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.479+0000 7f6fdb400640 1 Processor -- start 2024-04-25T09:03:04.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.479+0000 7f6fdb400640 1 -- start start 2024-04-25T09:03:04.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fdb400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6fd4144120 0x7f6fd415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fdb400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40b3090 0x7f6fd40b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fdb400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd415bc40 con 0x7f6fd40ccbf0 2024-04-25T09:03:04.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fdb400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd415e490 con 0x7f6fd4144120 2024-04-25T09:03:04.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fdb400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd415b3a0 con 0x7f6fd40b3090 2024-04-25T09:03:04.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fd9400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40b3090 0x7f6fd40b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fd9400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40b3090 0x7f6fd40b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:42804/0 (socket says 172.21.15.59:42804) 2024-04-25T09:03:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fcbe00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f6fd40ccbf0 0x7f6fd415e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:43732/0 (socket says 172.21.15.59:43732) 2024-04-25T09:03:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fcbe00640 1 -- 172.21.15.59:0/2650553391 learned_addr learned my addr 172.21.15.59:0/2650553391 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fd8a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6fd4144120 0x7f6fd415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fd9400640 1 -- 172.21.15.59:0/2650553391 >> v2:172.21.15.178:3300/0 conn(0x7f6fd4144120 msgr2=0x7f6fd415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fd9400640 1 --2- 172.21.15.59:0/2650553391 >> v2:172.21.15.178:3300/0 conn(0x7f6fd4144120 0x7f6fd415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fd9400640 1 -- 172.21.15.59:0/2650553391 >> v1:172.21.15.178:6789/0 conn(0x7f6fd40ccbf0 legacy=0x7f6fd415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.483+0000 7f6fd9400640 1 -- 172.21.15.59:0/2650553391 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd415b680 con 0x7f6fd40b3090 2024-04-25T09:03:04.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fd9400640 1 --2- 172.21.15.59:0/2650553391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40b3090 0x7f6fd40b3520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00bfa0 tx=0x7f6fcc01eae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca31e9947cf7e251 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fd3e00640 1 -- 172.21.15.59:0/2650553391 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc00b2d0 con 0x7f6fd40b3090 2024-04-25T09:03:04.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fd3e00640 1 -- 172.21.15.59:0/2650553391 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fcc0a77c0 con 0x7f6fd40b3090 2024-04-25T09:03:04.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fd3e00640 1 -- 172.21.15.59:0/2650553391 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc0a7b90 con 0x7f6fd40b3090 2024-04-25T09:03:04.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 -- 172.21.15.59:0/2650553391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40b3090 msgr2=0x7f6fd40b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 --2- 172.21.15.59:0/2650553391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40b3090 0x7f6fd40b3520 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc00bfa0 tx=0x7f6fcc01eae0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 -- 172.21.15.59:0/2650553391 shutdown_connections 2024-04-25T09:03:04.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 --2- 172.21.15.59:0/2650553391 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd40b3090 0x7f6fd40b3520 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 --2- 172.21.15.59:0/2650553391 >> v2:172.21.15.178:3300/0 conn(0x7f6fd4144120 0x7f6fd415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 -- 172.21.15.59:0/2650553391 >> 172.21.15.59:0/2650553391 conn(0x7f6fd4067080 msgr2=0x7f6fd406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:04.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 -- 172.21.15.59:0/2650553391 shutdown_connections 2024-04-25T09:03:04.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 -- 172.21.15.59:0/2650553391 wait complete. 2024-04-25T09:03:04.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 Processor -- start 2024-04-25T09:03:04.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 -- start start 2024-04-25T09:03:04.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fd40b3090 0x7f6fd413c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd40ccbf0 0x7f6fd40b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd4144120 0x7f6fd4142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd406dc60 con 0x7f6fd40b3090 2024-04-25T09:03:04.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd406dae0 con 0x7f6fd40ccbf0 2024-04-25T09:03:04.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.487+0000 7f6fdb400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd406dde0 con 0x7f6fd4144120 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd8a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fd40b3090 0x7f6fd413c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd8a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fd40b3090 0x7f6fd413c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55674/0 (socket says 172.21.15.59:55674) 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd8a00640 1 -- 172.21.15.59:0/3725619811 learned_addr learned my addr 172.21.15.59:0/3725619811 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fcbe00640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd40ccbf0 0x7f6fd40b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd9400640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd4144120 0x7f6fd4142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd8a00640 1 -- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd4144120 msgr2=0x7f6fd4142d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd8a00640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd4144120 0x7f6fd4142d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd8a00640 1 -- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd40ccbf0 msgr2=0x7f6fd40b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd8a00640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd40ccbf0 0x7f6fd40b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd8a00640 1 -- 172.21.15.59:0/3725619811 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd4141310 con 0x7f6fd40b3090 2024-04-25T09:03:04.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd8a00640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fd40b3090 0x7f6fd413c950 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400e8a0 tx=0x7f6fc400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd1600640 1 -- 172.21.15.59:0/3725619811 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4017070 con 0x7f6fd40b3090 2024-04-25T09:03:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd1600640 1 -- 172.21.15.59:0/3725619811 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc400c940 con 0x7f6fd40b3090 2024-04-25T09:03:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd1600640 1 -- 172.21.15.59:0/3725619811 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc400ccf0 con 0x7f6fd40b3090 2024-04-25T09:03:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fdb400640 1 -- 172.21.15.59:0/3725619811 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd413e0f0 con 0x7f6fd40b3090 2024-04-25T09:03:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fdb400640 1 -- 172.21.15.59:0/3725619811 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd413d330 con 0x7f6fd40b3090 2024-04-25T09:03:04.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fdb400640 1 -- 172.21.15.59:0/3725619811 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd40745d0 con 0x7f6fd40b3090 2024-04-25T09:03:04.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.491+0000 7f6fd1600640 1 -- 172.21.15.59:0/3725619811 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6fc401a070 con 0x7f6fd40b3090 2024-04-25T09:03:04.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.495+0000 7f6fd1600640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fb0066f60 0x7f6fb0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.495+0000 7f6fd1600640 1 -- 172.21.15.59:0/3725619811 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6fc4084fe0 con 0x7f6fd40b3090 2024-04-25T09:03:04.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.495+0000 7f6fcbe00640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fb0066f60 0x7f6fb0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.495+0000 7f6fcbe00640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fb0066f60 0x7f6fb0069420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc000f70 tx=0x7f6fbc007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.499+0000 7f6fd1600640 1 -- 172.21.15.59:0/3725619811 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6fc4055840 con 0x7f6fd40b3090 2024-04-25T09:03:04.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.671+0000 7f6fdb400640 1 -- 172.21.15.59:0/3725619811 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6fd4140f30 con 0x7f6fd40b3090 2024-04-25T09:03:04.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.671+0000 7f6fd1600640 1 -- 172.21.15.59:0/3725619811 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6fc40598e0 con 0x7f6fd40b3090 2024-04-25T09:03:04.664 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:03:04.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.675+0000 7f6fdb400640 1 -- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fb0066f60 msgr2=0x7f6fb0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.675+0000 7f6fdb400640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fb0066f60 0x7f6fb0069420 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc000f70 tx=0x7f6fbc007e90 comp rx=0 tx=0).stop 2024-04-25T09:03:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.675+0000 7f6fdb400640 1 -- 172.21.15.59:0/3725619811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fd40b3090 msgr2=0x7f6fd413c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.675+0000 7f6fdb400640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fd40b3090 0x7f6fd413c950 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400e8a0 tx=0x7f6fc400eca0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.675+0000 7f6fdb400640 1 -- 172.21.15.59:0/3725619811 shutdown_connections 2024-04-25T09:03:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.675+0000 7f6fdb400640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fb0066f60 0x7f6fb0069420 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.675+0000 7f6fdb400640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6fd4144120 0x7f6fd4142d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.675+0000 7f6fdb400640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6fd40ccbf0 0x7f6fd40b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.675+0000 7f6fdb400640 1 --2- 172.21.15.59:0/3725619811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6fd40b3090 0x7f6fd413c950 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.675+0000 7f6fdb400640 1 -- 172.21.15.59:0/3725619811 >> 172.21.15.59:0/3725619811 conn(0x7f6fd4067080 msgr2=0x7f6fd40b35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.675+0000 7f6fdb400640 1 -- 172.21.15.59:0/3725619811 shutdown_connections 2024-04-25T09:03:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.675+0000 7f6fdb400640 1 -- 172.21.15.59:0/3725619811 wait complete. 2024-04-25T09:03:04.686 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:03:04.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:04.686 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:04.749 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:03:04.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:04.750 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:03:04.768 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:04.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8bbe00640 1 Processor -- start 2024-04-25T09:03:04.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8bbe00640 1 -- start start 2024-04-25T09:03:04.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8bbe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8bc15b5d0 0x7ff8bc0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8bbe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff8bc0d0010 0x7ff8bc0cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8bbe00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8bc0b13b0 con 0x7ff8bc0cc410 2024-04-25T09:03:04.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8bbe00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8bc0b1690 con 0x7ff8bc0d0010 2024-04-25T09:03:04.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8bbe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc0b1970 con 0x7ff8bc15b5d0 2024-04-25T09:03:04.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8b3e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff8bc0d0010 0x7ff8bc0cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8baa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8bc15b5d0 0x7ff8bc0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8baa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8bc15b5d0 0x7ff8bc0cfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:42822/0 (socket says 172.21.15.59:42822) 2024-04-25T09:03:04.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8baa00640 1 -- 172.21.15.59:0/1972854911 learned_addr learned my addr 172.21.15.59:0/1972854911 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:04.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8bb400640 1 --1- 172.21.15.59:0/1972854911 >> v1:172.21.15.178:6789/0 conn(0x7ff8bc0cc410 0x7ff8bc0b2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:43736/0 (socket says 172.21.15.59:43736) 2024-04-25T09:03:04.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8baa00640 1 -- 172.21.15.59:0/1972854911 >> v2:172.21.15.178:3300/0 conn(0x7ff8bc0d0010 msgr2=0x7ff8bc0cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:04.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8baa00640 1 --2- 172.21.15.59:0/1972854911 >> v2:172.21.15.178:3300/0 conn(0x7ff8bc0d0010 0x7ff8bc0cbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8baa00640 1 -- 172.21.15.59:0/1972854911 >> v1:172.21.15.178:6789/0 conn(0x7ff8bc0cc410 legacy=0x7ff8bc0b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.963+0000 7ff8baa00640 1 -- 172.21.15.59:0/1972854911 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc0b1c50 con 0x7ff8bc15b5d0 2024-04-25T09:03:04.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.967+0000 7ff8baa00640 1 --2- 172.21.15.59:0/1972854911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8bc15b5d0 0x7ff8bc0cfad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009870 tx=0x7ff8ac01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf68f42209470b01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.967+0000 7ff8ba000640 1 -- 172.21.15.59:0/1972854911 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0aa430 con 0x7ff8bc15b5d0 2024-04-25T09:03:04.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.967+0000 7ff8ba000640 1 -- 172.21.15.59:0/1972854911 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0af070 con 0x7ff8bc15b5d0 2024-04-25T09:03:04.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.967+0000 7ff8ba000640 1 -- 172.21.15.59:0/1972854911 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0aa7f0 con 0x7ff8bc15b5d0 2024-04-25T09:03:04.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.967+0000 7ff8bbe00640 1 -- 172.21.15.59:0/1972854911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8bc15b5d0 msgr2=0x7ff8bc0cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.967+0000 7ff8bbe00640 1 --2- 172.21.15.59:0/1972854911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8bc15b5d0 0x7ff8bc0cfad0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac009870 tx=0x7ff8ac01c530 comp rx=0 tx=0).stop 2024-04-25T09:03:04.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.967+0000 7ff8bbe00640 1 -- 172.21.15.59:0/1972854911 shutdown_connections 2024-04-25T09:03:04.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.967+0000 7ff8bbe00640 1 --2- 172.21.15.59:0/1972854911 >> v2:172.21.15.178:3300/0 conn(0x7ff8bc0d0010 0x7ff8bc0cbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.967+0000 7ff8bbe00640 1 --2- 172.21.15.59:0/1972854911 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8bc15b5d0 0x7ff8bc0cfad0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.967+0000 7ff8bbe00640 1 -- 172.21.15.59:0/1972854911 >> 172.21.15.59:0/1972854911 conn(0x7ff8bc0d14f0 msgr2=0x7ff8bc0d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:04.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.967+0000 7ff8bbe00640 1 -- 172.21.15.59:0/1972854911 shutdown_connections 2024-04-25T09:03:04.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.967+0000 7ff8bbe00640 1 -- 172.21.15.59:0/1972854911 wait complete. 2024-04-25T09:03:04.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8bbe00640 1 Processor -- start 2024-04-25T09:03:04.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8bbe00640 1 -- start start 2024-04-25T09:03:04.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8bbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc0cc410 0x7ff8bc151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8bbe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8bc0d0010 0x7ff8bc153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8bbe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8bc15b5d0 0x7ff8bc153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8bbe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc1685a0 con 0x7ff8bc0cc410 2024-04-25T09:03:04.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8bbe00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc15bbc0 con 0x7ff8bc0d0010 2024-04-25T09:03:04.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8bbe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8bc168720 con 0x7ff8bc15b5d0 2024-04-25T09:03:04.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8baa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc0cc410 0x7ff8bc151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8baa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc0cc410 0x7ff8bc151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55678/0 (socket says 172.21.15.59:55678) 2024-04-25T09:03:04.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8baa00640 1 -- 172.21.15.59:0/245146823 learned_addr learned my addr 172.21.15.59:0/245146823 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:04.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8b3e00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8bc0d0010 0x7ff8bc153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8bb400640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8bc15b5d0 0x7ff8bc153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8baa00640 1 -- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8bc15b5d0 msgr2=0x7ff8bc153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8baa00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8bc15b5d0 0x7ff8bc153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8baa00640 1 -- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8bc0d0010 msgr2=0x7ff8bc153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:04.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8baa00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8bc0d0010 0x7ff8bc153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:04.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8baa00640 1 -- 172.21.15.59:0/245146823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8bc0c8760 con 0x7ff8bc0cc410 2024-04-25T09:03:04.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8b3e00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8bc0d0010 0x7ff8bc153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:04.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8baa00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc0cc410 0x7ff8bc151e60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac01abe0 tx=0x7ff8ac0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8b2a00640 1 -- 172.21.15.59:0/245146823 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0be610 con 0x7ff8bc0cc410 2024-04-25T09:03:04.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8b2a00640 1 -- 172.21.15.59:0/245146823 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ac0be7d0 con 0x7ff8bc0cc410 2024-04-25T09:03:04.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8bbe00640 1 -- 172.21.15.59:0/245146823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8bc0c8a40 con 0x7ff8bc0cc410 2024-04-25T09:03:04.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8b2a00640 1 -- 172.21.15.59:0/245146823 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac0bebc0 con 0x7ff8bc0cc410 2024-04-25T09:03:04.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.971+0000 7ff8bbe00640 1 -- 172.21.15.59:0/245146823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8bc1523a0 con 0x7ff8bc0cc410 2024-04-25T09:03:04.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.975+0000 7ff8bbe00640 1 -- 172.21.15.59:0/245146823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8bc04efa0 con 0x7ff8bc0cc410 2024-04-25T09:03:04.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.975+0000 7ff8b2a00640 1 -- 172.21.15.59:0/245146823 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff8ac0bc020 con 0x7ff8bc0cc410 2024-04-25T09:03:04.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.975+0000 7ff8b2a00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff898066f90 0x7ff898069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:04.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.975+0000 7ff8b2a00640 1 -- 172.21.15.59:0/245146823 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff8ac11fac0 con 0x7ff8bc0cc410 2024-04-25T09:03:04.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.975+0000 7ff8b3e00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff898066f90 0x7ff898069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:04.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.975+0000 7ff8b3e00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff898066f90 0x7ff898069450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc1542c0 tx=0x7ff8a4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:04.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:04.979+0000 7ff8b2a00640 1 -- 172.21.15.59:0/245146823 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff8ac016150 con 0x7ff8bc0cc410 2024-04-25T09:03:05.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.171+0000 7ff8bbe00640 1 -- 172.21.15.59:0/245146823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8bc0b7470 con 0x7ff8bc0cc410 2024-04-25T09:03:05.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8b2a00640 1 -- 172.21.15.59:0/245146823 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7ff8ac0f02e0 con 0x7ff8bc0cc410 2024-04-25T09:03:05.166 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:05.166 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3471177782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3471177782},{"type":"v1","addr":"172.21.15.178:6836","nonce":3471177782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3534065304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3534065304},{"type":"v1","addr":"172.21.15.178:6837","nonce":3534065304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4015865168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4015865168},{"type":"v1","addr":"172.21.15.59:6833","nonce":4015865168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:49.614073+0000","modified":"2024-04-25T09:02:52.639785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5289":{"gid":5289,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1202642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1202642229},{"type":"v1","addr":"172.21.15.59:6835","nonce":1202642229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:03:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 19 2024-04-25T09:03:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8bbe00640 1 -- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff898066f90 msgr2=0x7ff898069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8bbe00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff898066f90 0x7ff898069450 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc1542c0 tx=0x7ff8a4009190 comp rx=0 tx=0).stop 2024-04-25T09:03:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8bbe00640 1 -- 172.21.15.59:0/245146823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc0cc410 msgr2=0x7ff8bc151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8bbe00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc0cc410 0x7ff8bc151e60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff8ac01abe0 tx=0x7ff8ac0192d0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8bbe00640 1 -- 172.21.15.59:0/245146823 shutdown_connections 2024-04-25T09:03:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8bbe00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff898066f90 0x7ff898069450 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8bbe00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8bc15b5d0 0x7ff8bc153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8bbe00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8bc0d0010 0x7ff8bc153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8bbe00640 1 --2- 172.21.15.59:0/245146823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8bc0cc410 0x7ff8bc151e60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8bbe00640 1 -- 172.21.15.59:0/245146823 >> 172.21.15.59:0/245146823 conn(0x7ff8bc0d14f0 msgr2=0x7ff8bc06f310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8bbe00640 1 -- 172.21.15.59:0/245146823 shutdown_connections 2024-04-25T09:03:05.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.175+0000 7ff8bbe00640 1 -- 172.21.15.59:0/245146823 wait complete. 2024-04-25T09:03:05.187 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:03:05.360 INFO:teuthology.orchestra.run.smithi059.stdout:{"message":"","return_code":0} 2024-04-25T09:03:05.360 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:03:05.361 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:05.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f280ba00640 1 Processor -- start 2024-04-25T09:03:05.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f280ba00640 1 -- start start 2024-04-25T09:03:05.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f280ba00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f280415dad0 0x7f28041621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f280ba00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f280415deb0 0x7f28040d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f280ba00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28040ce250 0x7f28040d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f280ba00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28040d1be0 con 0x7f28040ce250 2024-04-25T09:03:05.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f280ba00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2804162720 con 0x7f280415deb0 2024-04-25T09:03:05.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f280ba00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28040ce810 con 0x7f280415dad0 2024-04-25T09:03:05.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f2809a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28040ce250 0x7f28040d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f2809a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28040ce250 0x7f28040d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55686/0 (socket says 172.21.15.59:55686) 2024-04-25T09:03:05.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f2809a00640 1 -- 172.21.15.59:0/713706678 learned_addr learned my addr 172.21.15.59:0/713706678 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:05.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f2809000640 1 --2- 172.21.15.59:0/713706678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f280415dad0 0x7f28041621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f2803e00640 1 --2- 172.21.15.59:0/713706678 >> v2:172.21.15.178:3300/0 conn(0x7f280415deb0 0x7f28040d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f2809a00640 1 -- 172.21.15.59:0/713706678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f280415dad0 msgr2=0x7f28041621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:05.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f2809a00640 1 --2- 172.21.15.59:0/713706678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f280415dad0 0x7f28041621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f2809a00640 1 -- 172.21.15.59:0/713706678 >> v2:172.21.15.178:3300/0 conn(0x7f280415deb0 msgr2=0x7f28040d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:05.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f2809a00640 1 --2- 172.21.15.59:0/713706678 >> v2:172.21.15.178:3300/0 conn(0x7f280415deb0 0x7f28040d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.511+0000 7f2809a00640 1 -- 172.21.15.59:0/713706678 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28040ceaf0 con 0x7f28040ce250 2024-04-25T09:03:05.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f2809a00640 1 --2- 172.21.15.59:0/713706678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28040ce250 0x7f28040d0cb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f28040d4a50 tx=0x7f27fc01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e72378b9f8f03d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:05.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f2803400640 1 -- 172.21.15.59:0/713706678 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc0a5840 con 0x7f28040ce250 2024-04-25T09:03:05.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f2803400640 1 -- 172.21.15.59:0/713706678 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc0a59e0 con 0x7f28040ce250 2024-04-25T09:03:05.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f2803400640 1 -- 172.21.15.59:0/713706678 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc0a5db0 con 0x7f28040ce250 2024-04-25T09:03:05.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f280ba00640 1 -- 172.21.15.59:0/713706678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28040ce250 msgr2=0x7f28040d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f280ba00640 1 --2- 172.21.15.59:0/713706678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28040ce250 0x7f28040d0cb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f28040d4a50 tx=0x7f27fc01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f280ba00640 1 -- 172.21.15.59:0/713706678 shutdown_connections 2024-04-25T09:03:05.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f280ba00640 1 --2- 172.21.15.59:0/713706678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28040ce250 0x7f28040d0cb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f280ba00640 1 --2- 172.21.15.59:0/713706678 >> v2:172.21.15.178:3300/0 conn(0x7f280415deb0 0x7f28040d0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f280ba00640 1 --2- 172.21.15.59:0/713706678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f280415dad0 0x7f28041621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f280ba00640 1 -- 172.21.15.59:0/713706678 >> 172.21.15.59:0/713706678 conn(0x7f28040b5900 msgr2=0x7f28040b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:05.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f280ba00640 1 -- 172.21.15.59:0/713706678 shutdown_connections 2024-04-25T09:03:05.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.515+0000 7f280ba00640 1 -- 172.21.15.59:0/713706678 wait complete. 2024-04-25T09:03:05.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f280ba00640 1 Processor -- start 2024-04-25T09:03:05.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f280ba00640 1 -- start start 2024-04-25T09:03:05.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f280ba00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28040ce250 0x7f2804156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f280ba00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f280415dad0 0x7f2804157800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f280ba00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f280415deb0 0x7f28040c8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f280ba00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280406ccc0 con 0x7f28040ce250 2024-04-25T09:03:05.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f280ba00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280406cb40 con 0x7f280415deb0 2024-04-25T09:03:05.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f280ba00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280406ce40 con 0x7f280415dad0 2024-04-25T09:03:05.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2809000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28040ce250 0x7f2804156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2809000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28040ce250 0x7f2804156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55702/0 (socket says 172.21.15.59:55702) 2024-04-25T09:03:05.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2809000640 1 -- 172.21.15.59:0/1299034818 learned_addr learned my addr 172.21.15.59:0/1299034818 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:05.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2809a00640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f280415deb0 0x7f28040c8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2803e00640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f280415dad0 0x7f2804157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2809000640 1 -- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f280415dad0 msgr2=0x7f2804157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2809000640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f280415dad0 0x7f2804157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2809000640 1 -- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f280415deb0 msgr2=0x7f28040c8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2809000640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f280415deb0 0x7f28040c8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2809000640 1 -- 172.21.15.59:0/1299034818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28041582c0 con 0x7f28040ce250 2024-04-25T09:03:05.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2809000640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28040ce250 0x7f2804156780 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f27f800d800 tx=0x7f27f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:05.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2800c00640 1 -- 172.21.15.59:0/1299034818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800b6c0 con 0x7f28040ce250 2024-04-25T09:03:05.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2800c00640 1 -- 172.21.15.59:0/1299034818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27f8019070 con 0x7f28040ce250 2024-04-25T09:03:05.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f2800c00640 1 -- 172.21.15.59:0/1299034818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27f800ba60 con 0x7f28040ce250 2024-04-25T09:03:05.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f280ba00640 1 -- 172.21.15.59:0/1299034818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28041585a0 con 0x7f28040ce250 2024-04-25T09:03:05.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.519+0000 7f280ba00640 1 -- 172.21.15.59:0/1299034818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2804158b60 con 0x7f28040ce250 2024-04-25T09:03:05.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.523+0000 7f280ba00640 1 -- 172.21.15.59:0/1299034818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28040745d0 con 0x7f28040ce250 2024-04-25T09:03:05.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.523+0000 7f2800c00640 1 -- 172.21.15.59:0/1299034818 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f27f800bc00 con 0x7f28040ce250 2024-04-25T09:03:05.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.523+0000 7f2800c00640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f27e4066f60 0x7f27e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:05.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.523+0000 7f2800c00640 1 -- 172.21.15.59:0/1299034818 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f27f8085570 con 0x7f28040ce250 2024-04-25T09:03:05.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.523+0000 7f2803e00640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f27e4066f60 0x7f27e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:05.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.523+0000 7f2803e00640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f27e4066f60 0x7f27e4069420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f28040c9910 tx=0x7f27f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:05.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.527+0000 7f2800c00640 1 -- 172.21.15.59:0/1299034818 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f27f8055d00 con 0x7f28040ce250 2024-04-25T09:03:05.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.723+0000 7f280ba00640 1 -- 172.21.15.59:0/1299034818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28040d1700 con 0x7f28040ce250 2024-04-25T09:03:05.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.723+0000 7f2800c00640 1 -- 172.21.15.59:0/1299034818 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f27f8059da0 con 0x7f28040ce250 2024-04-25T09:03:05.717 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:05.717 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3471177782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3471177782},{"type":"v1","addr":"172.21.15.178:6836","nonce":3471177782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3534065304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3534065304},{"type":"v1","addr":"172.21.15.178:6837","nonce":3534065304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4015865168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4015865168},{"type":"v1","addr":"172.21.15.59:6833","nonce":4015865168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:49.614073+0000","modified":"2024-04-25T09:02:52.639785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5289":{"gid":5289,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1202642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1202642229},{"type":"v1","addr":"172.21.15.59:6835","nonce":1202642229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:03:05.717 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 19 2024-04-25T09:03:05.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.727+0000 7f280ba00640 1 -- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f27e4066f60 msgr2=0x7f27e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.727+0000 7f280ba00640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f27e4066f60 0x7f27e4069420 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f28040c9910 tx=0x7f27f0008040 comp rx=0 tx=0).stop 2024-04-25T09:03:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.727+0000 7f280ba00640 1 -- 172.21.15.59:0/1299034818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28040ce250 msgr2=0x7f2804156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.727+0000 7f280ba00640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28040ce250 0x7f2804156780 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f27f800d800 tx=0x7f27f800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.727+0000 7f280ba00640 1 -- 172.21.15.59:0/1299034818 shutdown_connections 2024-04-25T09:03:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.727+0000 7f280ba00640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f27e4066f60 0x7f27e4069420 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.727+0000 7f280ba00640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f280415deb0 0x7f28040c8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.727+0000 7f280ba00640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f280415dad0 0x7f2804157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.727+0000 7f280ba00640 1 --2- 172.21.15.59:0/1299034818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28040ce250 0x7f2804156780 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.727+0000 7f280ba00640 1 -- 172.21.15.59:0/1299034818 >> 172.21.15.59:0/1299034818 conn(0x7f28040b5900 msgr2=0x7f28040b8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.727+0000 7f280ba00640 1 -- 172.21.15.59:0/1299034818 shutdown_connections 2024-04-25T09:03:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:05.727+0000 7f280ba00640 1 -- 172.21.15.59:0/1299034818 wait complete. 2024-04-25T09:03:05.738 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parentdir mytag 2024-04-25T09:03:05.900 INFO:teuthology.orchestra.run.smithi059.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-04-25T09:03:05.900 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-04-25T09:03:15.901 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-04-25T09:03:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.963+0000 7f6042c69080 1 Processor -- start 2024-04-25T09:03:15.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.963+0000 7f6042c69080 1 -- start start 2024-04-25T09:03:15.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d77ad3c700 0x55d77aea16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d77ad81130 0x55d77ae08b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ae0e350 0x55d77ae13a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77ae0f9d0 con 0x55d77ae0e350 2024-04-25T09:03:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77acdf9f0 con 0x55d77ad3c700 2024-04-25T09:03:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d77ae0fb50 con 0x55d77ad81130 2024-04-25T09:03:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6040800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ae0e350 0x55d77ae13a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6040800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ae0e350 0x55d77ae13a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51324/0 (socket says 172.21.15.59:51324) 2024-04-25T09:03:15.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6040800640 1 -- 172.21.15.59:0/2913998846 learned_addr learned my addr 172.21.15.59:0/2913998846 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f603f400640 1 --2- 172.21.15.59:0/2913998846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d77ad81130 0x55d77ae08b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f603fe00640 1 --2- 172.21.15.59:0/2913998846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d77ad3c700 0x55d77aea16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6040800640 1 -- 172.21.15.59:0/2913998846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d77ad81130 msgr2=0x55d77ae08b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6040800640 1 --2- 172.21.15.59:0/2913998846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d77ad81130 0x55d77ae08b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6040800640 1 -- 172.21.15.59:0/2913998846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d77ad3c700 msgr2=0x55d77aea16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6040800640 1 --2- 172.21.15.59:0/2913998846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d77ad3c700 0x55d77aea16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6040800640 1 -- 172.21.15.59:0/2913998846 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d77aea07b0 con 0x55d77ae0e350 2024-04-25T09:03:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6040800640 1 --2- 172.21.15.59:0/2913998846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ae0e350 0x55d77ae13a70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6038002870 tx=0x7f6038002d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2fa09350f1fcc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f603e000640 1 -- 172.21.15.59:0/2913998846 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6038016020 con 0x55d77ae0e350 2024-04-25T09:03:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f603e000640 1 -- 172.21.15.59:0/2913998846 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603800d9c0 con 0x55d77ae0e350 2024-04-25T09:03:15.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f603e000640 1 -- 172.21.15.59:0/2913998846 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603800dd90 con 0x55d77ae0e350 2024-04-25T09:03:15.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 -- 172.21.15.59:0/2913998846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ae0e350 msgr2=0x55d77ae13a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 --2- 172.21.15.59:0/2913998846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ae0e350 0x55d77ae13a70 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6038002870 tx=0x7f6038002d30 comp rx=0 tx=0).stop 2024-04-25T09:03:15.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 -- 172.21.15.59:0/2913998846 shutdown_connections 2024-04-25T09:03:15.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 --2- 172.21.15.59:0/2913998846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ae0e350 0x55d77ae13a70 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 --2- 172.21.15.59:0/2913998846 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d77ad81130 0x55d77ae08b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 --2- 172.21.15.59:0/2913998846 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d77ad3c700 0x55d77aea16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 -- 172.21.15.59:0/2913998846 >> 172.21.15.59:0/2913998846 conn(0x55d77ad39c80 msgr2=0x55d77ad650c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 -- 172.21.15.59:0/2913998846 shutdown_connections 2024-04-25T09:03:15.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 -- 172.21.15.59:0/2913998846 wait complete. 2024-04-25T09:03:15.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 Processor -- start 2024-04-25T09:03:15.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.967+0000 7f6042c69080 1 -- start start 2024-04-25T09:03:15.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f6042c69080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ad3c700 0x55d77ae082e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f6042c69080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d77ad81130 0x55d77ae0aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f6042c69080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d77ae0e350 0x55d77ae0cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f6042c69080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77aea0a50 con 0x55d77ad3c700 2024-04-25T09:03:15.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f6042c69080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77aea1c10 con 0x55d77ad81130 2024-04-25T09:03:15.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f6042c69080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d77aea0cf0 con 0x55d77ae0e350 2024-04-25T09:03:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ad3c700 0x55d77ae082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ad3c700 0x55d77ae082e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51332/0 (socket says 172.21.15.59:51332) 2024-04-25T09:03:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603fe00640 1 -- 172.21.15.59:0/3523954204 learned_addr learned my addr 172.21.15.59:0/3523954204 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603f400640 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d77ad81130 0x55d77ae0aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f6040800640 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d77ae0e350 0x55d77ae0cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603fe00640 1 -- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d77ae0e350 msgr2=0x55d77ae0cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603fe00640 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d77ae0e350 0x55d77ae0cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603fe00640 1 -- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d77ad81130 msgr2=0x55d77ae0aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603fe00640 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d77ad81130 0x55d77ae0aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603fe00640 1 -- 172.21.15.59:0/3523954204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d77ae07120 con 0x55d77ad3c700 2024-04-25T09:03:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603fe00640 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ad3c700 0x55d77ae082e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f603000a450 tx=0x7f60300180c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603cc00640 1 -- 172.21.15.59:0/3523954204 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300b9020 con 0x55d77ad3c700 2024-04-25T09:03:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603cc00640 1 -- 172.21.15.59:0/3523954204 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60300b4440 con 0x55d77ad3c700 2024-04-25T09:03:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f6042c69080 1 -- 172.21.15.59:0/3523954204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d77ae073c0 con 0x55d77ad3c700 2024-04-25T09:03:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f603cc00640 1 -- 172.21.15.59:0/3523954204 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60300af040 con 0x55d77ad3c700 2024-04-25T09:03:15.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.971+0000 7f6042c69080 1 -- 172.21.15.59:0/3523954204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d77ae07900 con 0x55d77ad3c700 2024-04-25T09:03:15.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f603cc00640 1 -- 172.21.15.59:0/3523954204 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f60300bc020 con 0x55d77ad3c700 2024-04-25T09:03:15.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f603cc00640 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6020065940 0x7f6020067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f603cc00640 1 -- 172.21.15.59:0/3523954204 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f603011e5d0 con 0x55d77ad3c700 2024-04-25T09:03:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f603f400640 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6020065940 0x7f6020067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6042c69080 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55d77ae0af90 0x55d77ae05a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6042c69080 1 -- 172.21.15.59:0/3523954204 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:1 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v9 -- 0x55d77aea9810 con 0x55d77ae0af90 2024-04-25T09:03:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6040800640 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55d77ae0af90 0x55d77ae05a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f603f400640 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6020065940 0x7f6020067e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f602c000c10 tx=0x7f602c001800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6040800640 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55d77ae0af90 0x55d77ae05a30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6040800640 1 -- 172.21.15.59:0/3523954204 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f6038012470 con 0x55d77ae0af90 2024-04-25T09:03:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6042c69080 1 -- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55d77ae0af90 msgr2=0x55d77ae05a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6042c69080 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55d77ae0af90 0x55d77ae05a30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6042c69080 1 -- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6020065940 msgr2=0x7f6020067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6042c69080 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6020065940 0x7f6020067e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f602c000c10 tx=0x7f602c001800 comp rx=0 tx=0).stop 2024-04-25T09:03:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6042c69080 1 -- 172.21.15.59:0/3523954204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ad3c700 msgr2=0x55d77ae082e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6042c69080 1 --2- 172.21.15.59:0/3523954204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d77ad3c700 0x55d77ae082e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f603000a450 tx=0x7f60300180c0 comp rx=0 tx=0).stop 2024-04-25T09:03:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6040800640 1 -- 172.21.15.59:0/3523954204 reap_dead start 2024-04-25T09:03:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6042c69080 1 -- 172.21.15.59:0/3523954204 shutdown_connections 2024-04-25T09:03:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6042c69080 1 -- 172.21.15.59:0/3523954204 >> 172.21.15.59:0/3523954204 conn(0x55d77ad39c80 msgr2=0x55d77ae9fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6042c69080 1 -- 172.21.15.59:0/3523954204 shutdown_connections 2024-04-25T09:03:15.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:15.975+0000 7f6042c69080 1 -- 172.21.15.59:0/3523954204 wait complete. 2024-04-25T09:03:15.982 INFO:teuthology.orchestra.run.smithi059.stdout:mytag 2024-04-25T09:03:15.983 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-04-25T09:03:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.039+0000 7f7bc0b7e080 1 Processor -- start 2024-04-25T09:03:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.039+0000 7f7bc0b7e080 1 -- start start 2024-04-25T09:03:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bffbd1b770 0x55bffbdd2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbdd3930 0x55bffbdd1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bffbdd6d00 0x55bffbd43270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffbdd4b30 con 0x55bffbdd3930 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffbdd4890 con 0x55bffbd1b770 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bffbdd4dd0 con 0x55bffbdd6d00 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bbd400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbdd3930 0x55bffbdd1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bbd400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbdd3930 0x55bffbdd1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51348/0 (socket says 172.21.15.59:51348) 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bbd400640 1 -- 172.21.15.59:0/605869940 learned_addr learned my addr 172.21.15.59:0/605869940 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bbde00640 1 --2- 172.21.15.59:0/605869940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bffbd1b770 0x55bffbdd2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bbe800640 1 --2- 172.21.15.59:0/605869940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bffbdd6d00 0x55bffbd43270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bbd400640 1 -- 172.21.15.59:0/605869940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bffbdd6d00 msgr2=0x55bffbd43270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bbd400640 1 --2- 172.21.15.59:0/605869940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bffbdd6d00 0x55bffbd43270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bbd400640 1 -- 172.21.15.59:0/605869940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bffbd1b770 msgr2=0x55bffbdd2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bbd400640 1 --2- 172.21.15.59:0/605869940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bffbd1b770 0x55bffbdd2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bbd400640 1 -- 172.21.15.59:0/605869940 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bffbd5eba0 con 0x55bffbdd3930 2024-04-25T09:03:16.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bbd400640 1 --2- 172.21.15.59:0/605869940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbdd3930 0x55bffbdd1490 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00a7e0 tx=0x7f7bac00aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63bfa78be85cea1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bb7e00640 1 -- 172.21.15.59:0/605869940 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac008ba0 con 0x55bffbdd3930 2024-04-25T09:03:16.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bb7e00640 1 -- 172.21.15.59:0/605869940 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac008d40 con 0x55bffbdd3930 2024-04-25T09:03:16.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bb7e00640 1 -- 172.21.15.59:0/605869940 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac013610 con 0x55bffbdd3930 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/605869940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbdd3930 msgr2=0x55bffbdd1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 --2- 172.21.15.59:0/605869940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbdd3930 0x55bffbdd1490 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00a7e0 tx=0x7f7bac00aca0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/605869940 shutdown_connections 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 --2- 172.21.15.59:0/605869940 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bffbdd6d00 0x55bffbd43270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 --2- 172.21.15.59:0/605869940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbdd3930 0x55bffbdd1490 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 --2- 172.21.15.59:0/605869940 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bffbd1b770 0x55bffbdd2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/605869940 >> 172.21.15.59:0/605869940 conn(0x55bffbd19400 msgr2=0x55bffbdd5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/605869940 shutdown_connections 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/605869940 wait complete. 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 Processor -- start 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.043+0000 7f7bc0b7e080 1 -- start start 2024-04-25T09:03:16.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bc0b7e080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbd1b770 0x55bffbd43450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bc0b7e080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bffbdd3930 0x55bffbdd1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bc0b7e080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bffbdd6d00 0x55bffbdd1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bc0b7e080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffbd5f0e0 con 0x55bffbd1b770 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bc0b7e080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bffbd5ee40 con 0x55bffbdd3930 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bc0b7e080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bffbd5f380 con 0x55bffbdd6d00 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bbde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbd1b770 0x55bffbd43450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bbde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbd1b770 0x55bffbd43450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51352/0 (socket says 172.21.15.59:51352) 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bbde00640 1 -- 172.21.15.59:0/857095651 learned_addr learned my addr 172.21.15.59:0/857095651 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bbe800640 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bffbdd6d00 0x55bffbdd1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bbd400640 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bffbdd3930 0x55bffbdd1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bbde00640 1 -- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bffbdd6d00 msgr2=0x55bffbdd1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bbde00640 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bffbdd6d00 0x55bffbdd1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bbde00640 1 -- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bffbdd3930 msgr2=0x55bffbdd1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bbde00640 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bffbdd3930 0x55bffbdd1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bbde00640 1 -- 172.21.15.59:0/857095651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bffbd499e0 con 0x55bffbd1b770 2024-04-25T09:03:16.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bbde00640 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbd1b770 0x55bffbd43450 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00ad040 tx=0x7f7bb0018140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bb6a00640 1 -- 172.21.15.59:0/857095651 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00af040 con 0x55bffbd1b770 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bb6a00640 1 -- 172.21.15.59:0/857095651 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb00b5630 con 0x55bffbd1b770 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bb6a00640 1 -- 172.21.15.59:0/857095651 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00b5a00 con 0x55bffbd1b770 2024-04-25T09:03:16.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/857095651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bffbd49200 con 0x55bffbd1b770 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/857095651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bffbd49740 con 0x55bffbd1b770 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.047+0000 7f7bb6a00640 1 -- 172.21.15.59:0/857095651 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7bb00bd020 con 0x55bffbd1b770 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bb6a00640 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7ba0065940 0x7f7ba0067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bb6a00640 1 -- 172.21.15.59:0/857095651 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f7bb011f230 con 0x55bffbd1b770 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bc0b7e080 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55bffbd43990 0x55bffbd47ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/857095651 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:1 5.7 5:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v9 -- 0x55bffbe8ac10 con 0x55bffbd43990 2024-04-25T09:03:16.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bbd400640 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7ba0065940 0x7f7ba0067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bbe800640 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55bffbd43990 0x55bffbd47ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bbd400640 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7ba0065940 0x7f7ba0067e00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7bac000c10 tx=0x7f7bac00c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bbe800640 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55bffbd43990 0x55bffbd47ee0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bbe800640 1 -- 172.21.15.59:0/857095651 <== osd.5 v2:172.21.15.178:6802/3576783051 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f7bb800e8a0 con 0x55bffbd43990 2024-04-25T09:03:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55bffbd43990 msgr2=0x55bffbd47ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bc0b7e080 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55bffbd43990 0x55bffbd47ee0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7ba0065940 msgr2=0x7f7ba0067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bc0b7e080 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7ba0065940 0x7f7ba0067e00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7bac000c10 tx=0x7f7bac00c000 comp rx=0 tx=0).stop 2024-04-25T09:03:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/857095651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbd1b770 msgr2=0x55bffbd43450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bc0b7e080 1 --2- 172.21.15.59:0/857095651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bffbd1b770 0x55bffbd43450 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00ad040 tx=0x7f7bb0018140 comp rx=0 tx=0).stop 2024-04-25T09:03:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bbe800640 1 -- 172.21.15.59:0/857095651 reap_dead start 2024-04-25T09:03:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/857095651 shutdown_connections 2024-04-25T09:03:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/857095651 >> 172.21.15.59:0/857095651 conn(0x55bffbd19400 msgr2=0x55bffbdd5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/857095651 shutdown_connections 2024-04-25T09:03:16.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.051+0000 7f7bc0b7e080 1 -- 172.21.15.59:0/857095651 wait complete. 2024-04-25T09:03:16.048 INFO:teuthology.orchestra.run.smithi059.stdout:mytag 2024-04-25T09:03:16.048 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-25T09:03:16.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 Processor -- start 2024-04-25T09:03:16.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 -- start start 2024-04-25T09:03:16.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564003ac0 0x557302af9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302af6af0 0x557302afbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557302a6e760 0x557302afc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573029c99f0 con 0x557302af6af0 2024-04-25T09:03:16.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5573029cd950 con 0x7f0564003ac0 2024-04-25T09:03:16.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557302b058f0 con 0x557302a6e760 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f057d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302af6af0 0x557302afbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f057d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302af6af0 0x557302afbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51370/0 (socket says 172.21.15.59:51370) 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f057d400640 1 -- 172.21.15.59:0/3483487288 learned_addr learned my addr 172.21.15.59:0/3483487288 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f057de00640 1 --2- 172.21.15.59:0/3483487288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564003ac0 0x557302af9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f057e800640 1 --2- 172.21.15.59:0/3483487288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557302a6e760 0x557302afc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f057d400640 1 -- 172.21.15.59:0/3483487288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557302a6e760 msgr2=0x557302afc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f057d400640 1 --2- 172.21.15.59:0/3483487288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557302a6e760 0x557302afc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f057d400640 1 -- 172.21.15.59:0/3483487288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564003ac0 msgr2=0x557302af9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f057d400640 1 --2- 172.21.15.59:0/3483487288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564003ac0 0x557302af9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f057d400640 1 -- 172.21.15.59:0/3483487288 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557302a50db0 con 0x557302af6af0 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f057d400640 1 --2- 172.21.15.59:0/3483487288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302af6af0 0x557302afbb70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f056c009710 tx=0x7f056c005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5e6e602fca6ae5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0577e00640 1 -- 172.21.15.59:0/3483487288 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c008b90 con 0x557302af6af0 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0577e00640 1 -- 172.21.15.59:0/3483487288 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c01a070 con 0x557302af6af0 2024-04-25T09:03:16.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0577e00640 1 -- 172.21.15.59:0/3483487288 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c015460 con 0x557302af6af0 2024-04-25T09:03:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 -- 172.21.15.59:0/3483487288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302af6af0 msgr2=0x557302afbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 --2- 172.21.15.59:0/3483487288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302af6af0 0x557302afbb70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f056c009710 tx=0x7f056c005a10 comp rx=0 tx=0).stop 2024-04-25T09:03:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 -- 172.21.15.59:0/3483487288 shutdown_connections 2024-04-25T09:03:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 --2- 172.21.15.59:0/3483487288 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557302a6e760 0x557302afc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 --2- 172.21.15.59:0/3483487288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302af6af0 0x557302afbb70 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 --2- 172.21.15.59:0/3483487288 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564003ac0 0x557302af9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 -- 172.21.15.59:0/3483487288 >> 172.21.15.59:0/3483487288 conn(0x557302a23440 msgr2=0x557302a51830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 -- 172.21.15.59:0/3483487288 shutdown_connections 2024-04-25T09:03:16.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.107+0000 7f0580c4e080 1 -- 172.21.15.59:0/3483487288 wait complete. 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0580c4e080 1 Processor -- start 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0580c4e080 1 -- start start 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0580c4e080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564003ac0 0x557302a545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0580c4e080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302a54b20 0x557302afec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0580c4e080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557302aff160 0x557302aff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0580c4e080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557302b04180 con 0x557302a54b20 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0580c4e080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557302a52c00 con 0x7f0564003ac0 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0580c4e080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557302afcc20 con 0x557302aff160 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f057d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302a54b20 0x557302afec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f057d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302a54b20 0x557302afec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51380/0 (socket says 172.21.15.59:51380) 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f057d400640 1 -- 172.21.15.59:0/2887778251 learned_addr learned my addr 172.21.15.59:0/2887778251 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f057de00640 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564003ac0 0x557302a545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f057e800640 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557302aff160 0x557302aff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f057d400640 1 -- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557302aff160 msgr2=0x557302aff570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f057d400640 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557302aff160 0x557302aff570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f057d400640 1 -- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564003ac0 msgr2=0x557302a545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f057d400640 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564003ac0 0x557302a545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f057d400640 1 -- 172.21.15.59:0/2887778251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557302a67b10 con 0x557302a54b20 2024-04-25T09:03:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f057d400640 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302a54b20 0x557302afec20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f056c017040 tx=0x7f056c002fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0576a00640 1 -- 172.21.15.59:0/2887778251 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c015ca0 con 0x557302a54b20 2024-04-25T09:03:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0576a00640 1 -- 172.21.15.59:0/2887778251 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c015e40 con 0x557302a54b20 2024-04-25T09:03:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0576a00640 1 -- 172.21.15.59:0/2887778251 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c029650 con 0x557302a54b20 2024-04-25T09:03:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0580c4e080 1 -- 172.21.15.59:0/2887778251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557302a67db0 con 0x557302a54b20 2024-04-25T09:03:16.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.111+0000 7f0580c4e080 1 -- 172.21.15.59:0/2887778251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557302a682f0 con 0x557302a54b20 2024-04-25T09:03:16.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0576a00640 1 -- 172.21.15.59:0/2887778251 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f056c027020 con 0x557302a54b20 2024-04-25T09:03:16.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0576a00640 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0560065970 0x7f0560067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0576a00640 1 -- 172.21.15.59:0/2887778251 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f056c086570 con 0x557302a54b20 2024-04-25T09:03:16.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0580c4e080 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x557302b955b0 0x557302a66cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0580c4e080 1 -- 172.21.15.59:0/2887778251 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:1 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v9 -- 0x557302a671f0 con 0x557302b955b0 2024-04-25T09:03:16.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f057de00640 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0560065970 0x7f0560067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f057e800640 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x557302b955b0 0x557302a66cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f057de00640 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0560065970 0x7f0560067e30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0570001ec0 tx=0x7f0570010040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f057e800640 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x557302b955b0 0x557302a66cb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f057e800640 1 -- 172.21.15.59:0/2887778251 <== osd.5 v2:172.21.15.178:6802/3576783051 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f05780b2040 con 0x557302b955b0 2024-04-25T09:03:16.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0580c4e080 1 -- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x557302b955b0 msgr2=0x557302a66cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0580c4e080 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x557302b955b0 0x557302a66cb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0580c4e080 1 -- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0560065970 msgr2=0x7f0560067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0580c4e080 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0560065970 0x7f0560067e30 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0570001ec0 tx=0x7f0570010040 comp rx=0 tx=0).stop 2024-04-25T09:03:16.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0580c4e080 1 -- 172.21.15.59:0/2887778251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302a54b20 msgr2=0x557302afec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0580c4e080 1 --2- 172.21.15.59:0/2887778251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557302a54b20 0x557302afec20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f056c017040 tx=0x7f056c002fc0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f057e800640 1 -- 172.21.15.59:0/2887778251 reap_dead start 2024-04-25T09:03:16.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0580c4e080 1 -- 172.21.15.59:0/2887778251 shutdown_connections 2024-04-25T09:03:16.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0580c4e080 1 -- 172.21.15.59:0/2887778251 >> 172.21.15.59:0/2887778251 conn(0x557302a23440 msgr2=0x557302a51830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0580c4e080 1 -- 172.21.15.59:0/2887778251 shutdown_connections 2024-04-25T09:03:16.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.115+0000 7f0580c4e080 1 -- 172.21.15.59:0/2887778251 wait complete. 2024-04-25T09:03:16.112 INFO:teuthology.orchestra.run.smithi059.stdout:mytag 2024-04-25T09:03:16.113 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-25T09:03:16.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.167+0000 7fbffc566080 1 Processor -- start 2024-04-25T09:03:16.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.167+0000 7fbffc566080 1 -- start start 2024-04-25T09:03:16.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.167+0000 7fbffc566080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564138d91000 0x564138dbc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.167+0000 7fbffc566080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138dd5e20 0x564138e63d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.167+0000 7fbffc566080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564138e62230 0x564138e64240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.167+0000 7fbffc566080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564138d339f0 con 0x564138dd5e20 2024-04-25T09:03:16.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.167+0000 7fbffc566080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564138d37950 con 0x564138d91000 2024-04-25T09:03:16.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.167+0000 7fbffc566080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564138d90b60 con 0x564138e62230 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138dd5e20 0x564138e63d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138dd5e20 0x564138e63d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51390/0 (socket says 172.21.15.59:51390) 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff8e00640 1 -- 172.21.15.59:0/3050730228 learned_addr learned my addr 172.21.15.59:0/3050730228 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff9800640 1 --2- 172.21.15.59:0/3050730228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564138d91000 0x564138dbc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffa200640 1 --2- 172.21.15.59:0/3050730228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564138e62230 0x564138e64240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff8e00640 1 -- 172.21.15.59:0/3050730228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564138e62230 msgr2=0x564138e64240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff8e00640 1 --2- 172.21.15.59:0/3050730228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564138e62230 0x564138e64240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff8e00640 1 -- 172.21.15.59:0/3050730228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564138d91000 msgr2=0x564138dbc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff8e00640 1 --2- 172.21.15.59:0/3050730228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564138d91000 0x564138dbc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff8e00640 1 -- 172.21.15.59:0/3050730228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564138e61140 con 0x564138dd5e20 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff9800640 1 --2- 172.21.15.59:0/3050730228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564138d91000 0x564138dbc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff8e00640 1 --2- 172.21.15.59:0/3050730228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138dd5e20 0x564138e63d00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbfe800a530 tx=0x7fbfe8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21b68eea2a1b809 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff3400640 1 -- 172.21.15.59:0/3050730228 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80af040 con 0x564138dd5e20 2024-04-25T09:03:16.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff3400640 1 -- 172.21.15.59:0/3050730228 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe80b9070 con 0x564138dd5e20 2024-04-25T09:03:16.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff3400640 1 -- 172.21.15.59:0/3050730228 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe80aa9d0 con 0x564138dd5e20 2024-04-25T09:03:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 -- 172.21.15.59:0/3050730228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138dd5e20 msgr2=0x564138e63d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 --2- 172.21.15.59:0/3050730228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138dd5e20 0x564138e63d00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbfe800a530 tx=0x7fbfe8003030 comp rx=0 tx=0).stop 2024-04-25T09:03:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 -- 172.21.15.59:0/3050730228 shutdown_connections 2024-04-25T09:03:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 --2- 172.21.15.59:0/3050730228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564138e62230 0x564138e64240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 --2- 172.21.15.59:0/3050730228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138dd5e20 0x564138e63d00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 --2- 172.21.15.59:0/3050730228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564138d91000 0x564138dbc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 -- 172.21.15.59:0/3050730228 >> 172.21.15.59:0/3050730228 conn(0x564138db9f60 msgr2=0x564138dba340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 -- 172.21.15.59:0/3050730228 shutdown_connections 2024-04-25T09:03:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 -- 172.21.15.59:0/3050730228 wait complete. 2024-04-25T09:03:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 Processor -- start 2024-04-25T09:03:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 -- start start 2024-04-25T09:03:16.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564138d91000 0x564138e5b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564138dd5e20 0x564138e638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138e62230 0x564138e63de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564138e61680 con 0x564138e62230 2024-04-25T09:03:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564138e613e0 con 0x564138dd5e20 2024-04-25T09:03:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffc566080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564138e61920 con 0x564138d91000 2024-04-25T09:03:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffa200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138e62230 0x564138e63de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffa200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138e62230 0x564138e63de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51400/0 (socket says 172.21.15.59:51400) 2024-04-25T09:03:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbffa200640 1 -- 172.21.15.59:0/3272737907 learned_addr learned my addr 172.21.15.59:0/3272737907 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff9800640 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564138d91000 0x564138e5b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.171+0000 7fbff8e00640 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564138dd5e20 0x564138e638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbffa200640 1 -- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564138d91000 msgr2=0x564138e5b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbffa200640 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564138d91000 0x564138e5b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbffa200640 1 -- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564138dd5e20 msgr2=0x564138e638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbffa200640 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564138dd5e20 0x564138e638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbffa200640 1 -- 172.21.15.59:0/3272737907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564138e5ecd0 con 0x564138e62230 2024-04-25T09:03:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbffa200640 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138e62230 0x564138e63de0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbff400d190 tx=0x7fbff400d650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbff2000640 1 -- 172.21.15.59:0/3272737907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4018070 con 0x564138e62230 2024-04-25T09:03:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbff2000640 1 -- 172.21.15.59:0/3272737907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff400de80 con 0x564138e62230 2024-04-25T09:03:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbffc566080 1 -- 172.21.15.59:0/3272737907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564138e5ef70 con 0x564138e62230 2024-04-25T09:03:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbff2000640 1 -- 172.21.15.59:0/3272737907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4003110 con 0x564138e62230 2024-04-25T09:03:16.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbffc566080 1 -- 172.21.15.59:0/3272737907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564138e59740 con 0x564138e62230 2024-04-25T09:03:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbff2000640 1 -- 172.21.15.59:0/3272737907 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbff401b070 con 0x564138e62230 2024-04-25T09:03:16.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbff2000640 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbfdc065940 0x7fbfdc067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbff2000640 1 -- 172.21.15.59:0/3272737907 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fbff4083020 con 0x564138e62230 2024-04-25T09:03:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbff9800640 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbfdc065940 0x7fbfdc067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.175+0000 7fbffc566080 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x564138e59be0 0x564138e59fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbffc566080 1 -- 172.21.15.59:0/3272737907 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:1 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v9 -- 0x564138e5a500 con 0x564138e59be0 2024-04-25T09:03:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbff8e00640 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x564138e59be0 0x564138e59fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbff9800640 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbfdc065940 0x7fbfdc067e00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbfec004180 tx=0x7fbfec000bd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbff8e00640 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x564138e59be0 0x564138e59fc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbff8e00640 1 -- 172.21.15.59:0/3272737907 <== osd.5 v2:172.21.15.178:6802/3576783051 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fbfe80b2040 con 0x564138e59be0 2024-04-25T09:03:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbffc566080 1 -- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x564138e59be0 msgr2=0x564138e59fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbffc566080 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x564138e59be0 0x564138e59fc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbffc566080 1 -- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbfdc065940 msgr2=0x7fbfdc067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbffc566080 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbfdc065940 0x7fbfdc067e00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbfec004180 tx=0x7fbfec000bd0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbffc566080 1 -- 172.21.15.59:0/3272737907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138e62230 msgr2=0x564138e63de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbffc566080 1 --2- 172.21.15.59:0/3272737907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564138e62230 0x564138e63de0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbff400d190 tx=0x7fbff400d650 comp rx=0 tx=0).stop 2024-04-25T09:03:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbffa200640 1 -- 172.21.15.59:0/3272737907 reap_dead start 2024-04-25T09:03:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbffc566080 1 -- 172.21.15.59:0/3272737907 shutdown_connections 2024-04-25T09:03:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbffc566080 1 -- 172.21.15.59:0/3272737907 >> 172.21.15.59:0/3272737907 conn(0x564138db9f60 msgr2=0x564138dba340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbffc566080 1 -- 172.21.15.59:0/3272737907 shutdown_connections 2024-04-25T09:03:16.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.179+0000 7fbffc566080 1 -- 172.21.15.59:0/3272737907 wait complete. 2024-04-25T09:03:16.176 INFO:teuthology.orchestra.run.smithi059.stdout:mytag 2024-04-25T09:03:16.176 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-25T09:03:16.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89ddd68080 1 Processor -- start 2024-04-25T09:03:16.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89ddd68080 1 -- start start 2024-04-25T09:03:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89ddd68080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 0x55bcec0f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89ddd68080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bcec06f170 0x55bcec068900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89ddd68080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bcec0fb570 0x55bcec0f9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89ddd68080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcebfca9f0 con 0x55bcec057d50 2024-04-25T09:03:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89ddd68080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcebfce950 con 0x55bcec06f170 2024-04-25T09:03:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89ddd68080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bcec057610 con 0x55bcec0fb570 2024-04-25T09:03:16.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89db000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 0x55bcec0f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89db000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 0x55bcec0f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51412/0 (socket says 172.21.15.59:51412) 2024-04-25T09:03:16.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89db000640 1 -- 172.21.15.59:0/63627211 learned_addr learned my addr 172.21.15.59:0/63627211 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:16.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89da600640 1 --2- 172.21.15.59:0/63627211 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bcec06f170 0x55bcec068900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89dba00640 1 --2- 172.21.15.59:0/63627211 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bcec0fb570 0x55bcec0f9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89db000640 1 -- 172.21.15.59:0/63627211 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bcec0fb570 msgr2=0x55bcec0f9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89db000640 1 --2- 172.21.15.59:0/63627211 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bcec0fb570 0x55bcec0f9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89db000640 1 -- 172.21.15.59:0/63627211 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bcec06f170 msgr2=0x55bcec068900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89db000640 1 --2- 172.21.15.59:0/63627211 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bcec06f170 0x55bcec068900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89db000640 1 -- 172.21.15.59:0/63627211 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcec0f9240 con 0x55bcec057d50 2024-04-25T09:03:16.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89db000640 1 --2- 172.21.15.59:0/63627211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 0x55bcec0f4cf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00a500 tx=0x7f89cc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ecf84d2392fcad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89d9200640 1 -- 172.21.15.59:0/63627211 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0af040 con 0x55bcec057d50 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89d9200640 1 -- 172.21.15.59:0/63627211 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc0b9070 con 0x55bcec057d50 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.275+0000 7f89d9200640 1 -- 172.21.15.59:0/63627211 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0b4410 con 0x55bcec057d50 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 -- 172.21.15.59:0/63627211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 msgr2=0x55bcec0f4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 --2- 172.21.15.59:0/63627211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 0x55bcec0f4cf0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00a500 tx=0x7f89cc003030 comp rx=0 tx=0).stop 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 -- 172.21.15.59:0/63627211 shutdown_connections 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 --2- 172.21.15.59:0/63627211 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bcec0fb570 0x55bcec0f9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 --2- 172.21.15.59:0/63627211 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bcec06f170 0x55bcec068900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 --2- 172.21.15.59:0/63627211 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 0x55bcec0f4cf0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 -- 172.21.15.59:0/63627211 >> 172.21.15.59:0/63627211 conn(0x55bcec024440 msgr2=0x55bcec067360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 -- 172.21.15.59:0/63627211 shutdown_connections 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 -- 172.21.15.59:0/63627211 wait complete. 2024-04-25T09:03:16.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 Processor -- start 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 -- start start 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 0x55bcec06a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bcec06f170 0x55bcec06baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bcec0fb570 0x55bcec049590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcec0f94e0 con 0x55bcec057d50 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bcec0f9780 con 0x55bcec0fb570 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bcec068e40 con 0x55bcec06f170 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89db000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 0x55bcec06a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89db000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 0x55bcec06a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51418/0 (socket says 172.21.15.59:51418) 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89db000640 1 -- 172.21.15.59:0/955967765 learned_addr learned my addr 172.21.15.59:0/955967765 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89dba00640 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bcec0fb570 0x55bcec049590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89da600640 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bcec06f170 0x55bcec06baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89db000640 1 -- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bcec06f170 msgr2=0x55bcec06baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89db000640 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55bcec06f170 0x55bcec06baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89db000640 1 -- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bcec0fb570 msgr2=0x55bcec049590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89db000640 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55bcec0fb570 0x55bcec049590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89db000640 1 -- 172.21.15.59:0/955967765 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bcec069d20 con 0x55bcec057d50 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89db000640 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 0x55bcec06a9a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00a500 tx=0x7f89cc018030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89d3400640 1 -- 172.21.15.59:0/955967765 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0af040 con 0x55bcec057d50 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89d3400640 1 -- 172.21.15.59:0/955967765 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc0b4c00 con 0x55bcec057d50 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89d3400640 1 -- 172.21.15.59:0/955967765 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0c6480 con 0x55bcec057d50 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 -- 172.21.15.59:0/955967765 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bcec069fc0 con 0x55bcec057d50 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.279+0000 7f89ddd68080 1 -- 172.21.15.59:0/955967765 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bcec06a500 con 0x55bcec057d50 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89d3400640 1 -- 172.21.15.59:0/955967765 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f89cc0cf3f0 con 0x55bcec057d50 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89d3400640 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89bc065970 0x7f89bc067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89d3400640 1 -- 172.21.15.59:0/955967765 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f89cc1203e0 con 0x55bcec057d50 2024-04-25T09:03:16.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89ddd68080 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55bcec06bfe0 0x55bcec1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89ddd68080 1 -- 172.21.15.59:0/955967765 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:1 6.12 6:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41) v9 -- 0x55bcec0678a0 con 0x55bcec06bfe0 2024-04-25T09:03:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89da600640 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89bc065970 0x7f89bc067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89dba00640 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55bcec06bfe0 0x55bcec1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89da600640 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89bc065970 0x7f89bc067e30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f89c8003490 tx=0x7f89c8003050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89dba00640 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55bcec06bfe0 0x55bcec1979a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89dba00640 1 -- 172.21.15.59:0/955967765 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f89d4010680 con 0x55bcec06bfe0 2024-04-25T09:03:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-04-25T09:03:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89ddd68080 1 -- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55bcec06bfe0 msgr2=0x55bcec1979a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89ddd68080 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55bcec06bfe0 0x55bcec1979a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89ddd68080 1 -- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89bc065970 msgr2=0x7f89bc067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89ddd68080 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89bc065970 0x7f89bc067e30 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f89c8003490 tx=0x7f89c8003050 comp rx=0 tx=0).stop 2024-04-25T09:03:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89ddd68080 1 -- 172.21.15.59:0/955967765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 msgr2=0x55bcec06a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89ddd68080 1 --2- 172.21.15.59:0/955967765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55bcec057d50 0x55bcec06a9a0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00a500 tx=0x7f89cc018030 comp rx=0 tx=0).stop 2024-04-25T09:03:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89dba00640 1 -- 172.21.15.59:0/955967765 reap_dead start 2024-04-25T09:03:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89ddd68080 1 -- 172.21.15.59:0/955967765 shutdown_connections 2024-04-25T09:03:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.283+0000 7f89ddd68080 1 -- 172.21.15.59:0/955967765 >> 172.21.15.59:0/955967765 conn(0x55bcec024440 msgr2=0x55bcec0f8720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.287+0000 7f89ddd68080 1 -- 172.21.15.59:0/955967765 shutdown_connections 2024-04-25T09:03:16.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.287+0000 7f89ddd68080 1 -- 172.21.15.59:0/955967765 wait complete. 2024-04-25T09:03:16.284 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:03:16.284 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:03:16.284 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:16.387 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:16.443 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:03:16.443 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:03:16.443 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:16.452 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:03:16.452 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:03:16.452 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:16.462 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:03:16.462 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:03:16.462 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:16.506 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:03:16.506 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:03:16.507 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:16.515 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:03:16.516 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49b1400640 1 Processor -- start 2024-04-25T09:03:16.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49b1400640 1 -- start start 2024-04-25T09:03:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49b1400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f49ac15b5a0 0x7f49ac0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49b1400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49ac0cc440 0x7f49ac0d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49b1400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49ac0ce7f0 con 0x7f49ac15b980 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49b1400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ac0cfcd0 con 0x7f49ac0cc440 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49b1400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49ac0cead0 con 0x7f49ac15b5a0 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49ab200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49ac0cc440 0x7f49ac0d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49a1e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f49ac15b980 0x7f49ac0cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55588/0 (socket says 172.21.15.59:55588) 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49a1e00640 1 -- 172.21.15.59:0/2437080431 learned_addr learned my addr 172.21.15.59:0/2437080431 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49aa800640 1 --2- 172.21.15.59:0/2437080431 >> v2:172.21.15.178:3300/0 conn(0x7f49ac15b5a0 0x7f49ac0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49ab200640 1 -- 172.21.15.59:0/2437080431 >> v2:172.21.15.178:3300/0 conn(0x7f49ac15b5a0 msgr2=0x7f49ac0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49ab200640 1 --2- 172.21.15.59:0/2437080431 >> v2:172.21.15.178:3300/0 conn(0x7f49ac15b5a0 0x7f49ac0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49ab200640 1 -- 172.21.15.59:0/2437080431 >> v1:172.21.15.59:6789/0 conn(0x7f49ac15b980 legacy=0x7f49ac0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49ab200640 1 -- 172.21.15.59:0/2437080431 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac0cf960 con 0x7f49ac0cc440 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49aa800640 1 --2- 172.21.15.59:0/2437080431 >> v2:172.21.15.178:3300/0 conn(0x7f49ac15b5a0 0x7f49ac0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:16.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.699+0000 7f49a9e00640 1 -- 172.21.15.59:0/2437080431 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1054246537 0 0) 0x7f49ac0ce7f0 con 0x7f49ac15b980 2024-04-25T09:03:16.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.703+0000 7f49ab200640 1 --2- 172.21.15.59:0/2437080431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49ac0cc440 0x7f49ac0d0160 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f49ac072e00 tx=0x7f49a401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6662ccd8278e430 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.703+0000 7f49a9e00640 1 -- 172.21.15.59:0/2437080431 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a40b2070 con 0x7f49ac0cc440 2024-04-25T09:03:16.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.703+0000 7f49a9e00640 1 -- 172.21.15.59:0/2437080431 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a40a5a10 con 0x7f49ac0cc440 2024-04-25T09:03:16.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.703+0000 7f49a9e00640 1 -- 172.21.15.59:0/2437080431 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a40a5de0 con 0x7f49ac0cc440 2024-04-25T09:03:16.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.703+0000 7f49b1400640 1 -- 172.21.15.59:0/2437080431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49ac0cc440 msgr2=0x7f49ac0d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.703+0000 7f49b1400640 1 --2- 172.21.15.59:0/2437080431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49ac0cc440 0x7f49ac0d0160 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f49ac072e00 tx=0x7f49a401c930 comp rx=0 tx=0).stop 2024-04-25T09:03:16.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.703+0000 7f49b1400640 1 -- 172.21.15.59:0/2437080431 shutdown_connections 2024-04-25T09:03:16.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.703+0000 7f49b1400640 1 --2- 172.21.15.59:0/2437080431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49ac0cc440 0x7f49ac0d0160 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.703+0000 7f49b1400640 1 --2- 172.21.15.59:0/2437080431 >> v2:172.21.15.178:3300/0 conn(0x7f49ac15b5a0 0x7f49ac0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.703+0000 7f49b1400640 1 -- 172.21.15.59:0/2437080431 >> 172.21.15.59:0/2437080431 conn(0x7f49ac0b3390 msgr2=0x7f49ac0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.703+0000 7f49b1400640 1 -- 172.21.15.59:0/2437080431 shutdown_connections 2024-04-25T09:03:16.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.703+0000 7f49b1400640 1 -- 172.21.15.59:0/2437080431 wait complete. 2024-04-25T09:03:16.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49b1400640 1 Processor -- start 2024-04-25T09:03:16.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49b1400640 1 -- start start 2024-04-25T09:03:16.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49b1400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49ac0cc440 0x7f49ac14fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49b1400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49ac15b5a0 0x7f49ac15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49b1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49ac15b980 0x7f49ac1f66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49b1400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0d1240 con 0x7f49ac15b980 2024-04-25T09:03:16.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49b1400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0d10c0 con 0x7f49ac0cc440 2024-04-25T09:03:16.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49b1400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49ac0d13c0 con 0x7f49ac15b5a0 2024-04-25T09:03:16.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49ab200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49ac15b980 0x7f49ac1f66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49ab200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49ac15b980 0x7f49ac1f66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51434/0 (socket says 172.21.15.59:51434) 2024-04-25T09:03:16.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49ab200640 1 -- 172.21.15.59:0/3656071444 learned_addr learned my addr 172.21.15.59:0/3656071444 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:16.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49aa800640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49ac0cc440 0x7f49ac14fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49a1e00640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49ac15b5a0 0x7f49ac15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49ab200640 1 -- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49ac15b5a0 msgr2=0x7f49ac15c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49ab200640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49ac15b5a0 0x7f49ac15c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49ab200640 1 -- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49ac0cc440 msgr2=0x7f49ac14fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49ab200640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49ac0cc440 0x7f49ac14fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49ab200640 1 -- 172.21.15.59:0/3656071444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49ac15d250 con 0x7f49ac15b980 2024-04-25T09:03:16.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49ab200640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49ac15b980 0x7f49ac1f66f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f49a40b0040 tx=0x7f49a40196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49a3400640 1 -- 172.21.15.59:0/3656071444 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a40b2050 con 0x7f49ac15b980 2024-04-25T09:03:16.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49a3400640 1 -- 172.21.15.59:0/3656071444 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a40b3040 con 0x7f49ac15b980 2024-04-25T09:03:16.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49b1400640 1 -- 172.21.15.59:0/3656071444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49ac15d530 con 0x7f49ac15b980 2024-04-25T09:03:16.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49a3400640 1 -- 172.21.15.59:0/3656071444 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a40adc80 con 0x7f49ac15b980 2024-04-25T09:03:16.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49b1400640 1 -- 172.21.15.59:0/3656071444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49ac15daf0 con 0x7f49ac15b980 2024-04-25T09:03:16.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.707+0000 7f49b1400640 1 -- 172.21.15.59:0/3656071444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49ac0745d0 con 0x7f49ac15b980 2024-04-25T09:03:16.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.711+0000 7f49a3400640 1 -- 172.21.15.59:0/3656071444 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f49a40c0020 con 0x7f49ac15b980 2024-04-25T09:03:16.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.711+0000 7f49a3400640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4988066f60 0x7f4988069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:16.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.711+0000 7f49a3400640 1 -- 172.21.15.59:0/3656071444 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f49a411fd00 con 0x7f49ac15b980 2024-04-25T09:03:16.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.711+0000 7f49aa800640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4988066f60 0x7f4988069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:16.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.711+0000 7f49aa800640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4988066f60 0x7f4988069420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f499c006e90 tx=0x7f499c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:16.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.715+0000 7f49a3400640 1 -- 172.21.15.59:0/3656071444 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f49a4016520 con 0x7f49ac15b980 2024-04-25T09:03:16.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.911+0000 7f49b1400640 1 -- 172.21.15.59:0/3656071444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49ac15ad50 con 0x7f49ac15b980 2024-04-25T09:03:16.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.911+0000 7f49a3400640 1 -- 172.21.15.59:0/3656071444 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f49a40ade20 con 0x7f49ac15b980 2024-04-25T09:03:16.904 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:16.904 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3471177782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3471177782},{"type":"v1","addr":"172.21.15.178:6836","nonce":3471177782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3534065304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3534065304},{"type":"v1","addr":"172.21.15.178:6837","nonce":3534065304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4015865168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4015865168},{"type":"v1","addr":"172.21.15.59:6833","nonce":4015865168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:49.614073+0000","modified":"2024-04-25T09:02:52.639785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5289":{"gid":5289,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1202642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1202642229},{"type":"v1","addr":"172.21.15.59:6835","nonce":1202642229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:03:16.904 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 19 2024-04-25T09:03:16.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.915+0000 7f49b1400640 1 -- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4988066f60 msgr2=0x7f4988069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.915+0000 7f49b1400640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4988066f60 0x7f4988069420 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f499c006e90 tx=0x7f499c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:16.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.915+0000 7f49b1400640 1 -- 172.21.15.59:0/3656071444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49ac15b980 msgr2=0x7f49ac1f66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:16.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.915+0000 7f49b1400640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49ac15b980 0x7f49ac1f66f0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f49a40b0040 tx=0x7f49a40196d0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.915+0000 7f49b1400640 1 -- 172.21.15.59:0/3656071444 shutdown_connections 2024-04-25T09:03:16.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.915+0000 7f49b1400640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4988066f60 0x7f4988069420 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.915+0000 7f49b1400640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49ac15b980 0x7f49ac1f66f0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.915+0000 7f49b1400640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49ac15b5a0 0x7f49ac15c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.915+0000 7f49b1400640 1 --2- 172.21.15.59:0/3656071444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49ac0cc440 0x7f49ac14fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:16.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.915+0000 7f49b1400640 1 -- 172.21.15.59:0/3656071444 >> 172.21.15.59:0/3656071444 conn(0x7f49ac0b3390 msgr2=0x7f49ac0caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:16.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.915+0000 7f49b1400640 1 -- 172.21.15.59:0/3656071444 shutdown_connections 2024-04-25T09:03:16.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:16.915+0000 7f49b1400640 1 -- 172.21.15.59:0/3656071444 wait complete. 2024-04-25T09:03:16.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:17.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.075+0000 7f885fe00640 1 Processor -- start 2024-04-25T09:03:17.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.075+0000 7f885fe00640 1 -- start start 2024-04-25T09:03:17.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.075+0000 7f885fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f885815a7e0 0x7f885815e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.075+0000 7f885fe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f88580d05f0 0x7f88580b2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.075+0000 7f885fe00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885806f440 con 0x7f885815a400 2024-04-25T09:03:17.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.075+0000 7f885fe00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885806e680 con 0x7f885815a7e0 2024-04-25T09:03:17.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.075+0000 7f885fe00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885806e960 con 0x7f88580d05f0 2024-04-25T09:03:17.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.075+0000 7f885ca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f885815a7e0 0x7f885815e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.075+0000 7f885ca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f885815a7e0 0x7f885815e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51444/0 (socket says 172.21.15.59:51444) 2024-04-25T09:03:17.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.075+0000 7f885ca00640 1 -- 172.21.15.59:0/3364766137 learned_addr learned my addr 172.21.15.59:0/3364766137 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:17.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.075+0000 7f885de00640 1 --2- 172.21.15.59:0/3364766137 >> v2:172.21.15.178:3300/0 conn(0x7f88580d05f0 0x7f88580b2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885ca00640 1 -- 172.21.15.59:0/3364766137 >> v2:172.21.15.178:3300/0 conn(0x7f88580d05f0 msgr2=0x7f88580b2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885ca00640 1 --2- 172.21.15.59:0/3364766137 >> v2:172.21.15.178:3300/0 conn(0x7f88580d05f0 0x7f88580b2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885ca00640 1 -- 172.21.15.59:0/3364766137 >> v1:172.21.15.178:6789/0 conn(0x7f885815a400 legacy=0x7f885815e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885ca00640 1 -- 172.21.15.59:0/3364766137 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885806ec40 con 0x7f885815a7e0 2024-04-25T09:03:17.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885ca00640 1 --2- 172.21.15.59:0/3364766137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f885815a7e0 0x7f885815e940 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f88580d0e30 tx=0x7f884401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8249cf1cee53c4ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f8857e00640 1 -- 172.21.15.59:0/3364766137 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88440b0070 con 0x7f885815a7e0 2024-04-25T09:03:17.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f8857e00640 1 -- 172.21.15.59:0/3364766137 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88440ab600 con 0x7f885815a7e0 2024-04-25T09:03:17.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f8857e00640 1 -- 172.21.15.59:0/3364766137 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88440ab9d0 con 0x7f885815a7e0 2024-04-25T09:03:17.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885fe00640 1 -- 172.21.15.59:0/3364766137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f885815a7e0 msgr2=0x7f885815e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885fe00640 1 --2- 172.21.15.59:0/3364766137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f885815a7e0 0x7f885815e940 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f88580d0e30 tx=0x7f884401c520 comp rx=0 tx=0).stop 2024-04-25T09:03:17.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885fe00640 1 -- 172.21.15.59:0/3364766137 shutdown_connections 2024-04-25T09:03:17.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885fe00640 1 --2- 172.21.15.59:0/3364766137 >> v2:172.21.15.178:3300/0 conn(0x7f88580d05f0 0x7f88580b2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885fe00640 1 --2- 172.21.15.59:0/3364766137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f885815a7e0 0x7f885815e940 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885fe00640 1 -- 172.21.15.59:0/3364766137 >> 172.21.15.59:0/3364766137 conn(0x7f88580b23b0 msgr2=0x7f88580cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885fe00640 1 -- 172.21.15.59:0/3364766137 shutdown_connections 2024-04-25T09:03:17.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.079+0000 7f885fe00640 1 -- 172.21.15.59:0/3364766137 wait complete. 2024-04-25T09:03:17.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885fe00640 1 Processor -- start 2024-04-25T09:03:17.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885fe00640 1 -- start start 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88580d05f0 0x7f885815add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885fe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f885815a400 0x7f885814da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885815a7e0 0x7f885813a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b3b10 con 0x7f88580d05f0 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885fe00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885809df20 con 0x7f885815a7e0 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885fe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88580b3c90 con 0x7f885815a400 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88580d05f0 0x7f885815add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88580d05f0 0x7f885815add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51454/0 (socket says 172.21.15.59:51454) 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885d400640 1 -- 172.21.15.59:0/3323470764 learned_addr learned my addr 172.21.15.59:0/3323470764 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885de00640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885815a7e0 0x7f885813a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885ca00640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f885815a400 0x7f885814da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885d400640 1 -- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f885815a400 msgr2=0x7f885814da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885d400640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f885815a400 0x7f885814da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885d400640 1 -- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885815a7e0 msgr2=0x7f885813a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885d400640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885815a7e0 0x7f885813a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885d400640 1 -- 172.21.15.59:0/3323470764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885814e120 con 0x7f88580d05f0 2024-04-25T09:03:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885de00640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885815a7e0 0x7f885813a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885d400640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88580d05f0 0x7f885815add0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c790 tx=0x7f884c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f8855600640 1 -- 172.21.15.59:0/3323470764 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c016020 con 0x7f88580d05f0 2024-04-25T09:03:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f8855600640 1 -- 172.21.15.59:0/3323470764 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c006d60 con 0x7f88580d05f0 2024-04-25T09:03:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f8855600640 1 -- 172.21.15.59:0/3323470764 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c003bc0 con 0x7f88580d05f0 2024-04-25T09:03:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885fe00640 1 -- 172.21.15.59:0/3323470764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885814e450 con 0x7f88580d05f0 2024-04-25T09:03:17.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.083+0000 7f885fe00640 1 -- 172.21.15.59:0/3323470764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885814ea10 con 0x7f88580d05f0 2024-04-25T09:03:17.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.087+0000 7f885fe00640 1 -- 172.21.15.59:0/3323470764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88580745d0 con 0x7f88580d05f0 2024-04-25T09:03:17.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.087+0000 7f8855600640 1 -- 172.21.15.59:0/3323470764 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f884c00a850 con 0x7f88580d05f0 2024-04-25T09:03:17.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.087+0000 7f8855600640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8838066f60 0x7f8838069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.087+0000 7f8855600640 1 -- 172.21.15.59:0/3323470764 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f884c084e60 con 0x7f88580d05f0 2024-04-25T09:03:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.087+0000 7f885ca00640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8838066f60 0x7f8838069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.087+0000 7f885ca00640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8838066f60 0x7f8838069420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f88440ad000 tx=0x7f88440a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.091+0000 7f8855600640 1 -- 172.21.15.59:0/3323470764 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f884c020020 con 0x7f88580d05f0 2024-04-25T09:03:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.255+0000 7f885fe00640 1 -- 172.21.15.59:0/3323470764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88580ad3c0 con 0x7f88580d05f0 2024-04-25T09:03:17.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f8855600640 1 -- 172.21.15.59:0/3323470764 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16991 (secure 0 0 0) 0x7f884c055cb0 con 0x7f88580d05f0 2024-04-25T09:03:17.250 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:17.250 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":41,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:03:09.300265+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:47.433966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:48.612644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f885fe00640 1 -- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8838066f60 msgr2=0x7f8838069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f885fe00640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8838066f60 0x7f8838069420 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f88440ad000 tx=0x7f88440a6000 comp rx=0 tx=0).stop 2024-04-25T09:03:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f885fe00640 1 -- 172.21.15.59:0/3323470764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88580d05f0 msgr2=0x7f885815add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f885fe00640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88580d05f0 0x7f885815add0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c790 tx=0x7f884c00cc50 comp rx=0 tx=0).stop 2024-04-25T09:03:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f885fe00640 1 -- 172.21.15.59:0/3323470764 shutdown_connections 2024-04-25T09:03:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f885fe00640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8838066f60 0x7f8838069420 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f885fe00640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f885815a7e0 0x7f885813a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f885fe00640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f885815a400 0x7f885814da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f885fe00640 1 --2- 172.21.15.59:0/3323470764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88580d05f0 0x7f885815add0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f885fe00640 1 -- 172.21.15.59:0/3323470764 >> 172.21.15.59:0/3323470764 conn(0x7f88580b23b0 msgr2=0x7f8858157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f885fe00640 1 -- 172.21.15.59:0/3323470764 shutdown_connections 2024-04-25T09:03:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.259+0000 7f885fe00640 1 -- 172.21.15.59:0/3323470764 wait complete. 2024-04-25T09:03:17.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:02:47.433966+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:02:48.612644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:17.271 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaf1000640 1 Processor -- start 2024-04-25T09:03:17.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaf1000640 1 -- start start 2024-04-25T09:03:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaf1000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feaec144e20 0x7feaec06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaf1000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaec0b30f0 con 0x7feaec06d900 2024-04-25T09:03:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaf1000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaec0b33d0 con 0x7feaec0b0e60 2024-04-25T09:03:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaf1000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec0b36b0 con 0x7feaec144e20 2024-04-25T09:03:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feae3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7feaec06d900 0x7feaec0b0750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55602/0 (socket says 172.21.15.59:55602) 2024-04-25T09:03:17.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feae3e00640 1 -- 172.21.15.59:0/95517225 learned_addr learned my addr 172.21.15.59:0/95517225 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968932874 0 0) 0x7feaec0b30f0 con 0x7feaec06d900 2024-04-25T09:03:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead0003530 con 0x7feaec06d900 2024-04-25T09:03:17.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeb400640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feaec144e20 0x7feaec06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3117720766 0 0) 0x7fead0003530 con 0x7feaec06d900 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feaec144e20 msgr2=0x7feaec06d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feaec144e20 0x7feaec06d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 >> v1:172.21.15.178:6789/0 conn(0x7feaec0b0e60 legacy=0x7feaec15bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec0b3990 con 0x7feaec06d900 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fead4001680 con 0x7feaec06d900 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 >> v1:172.21.15.59:6789/0 conn(0x7feaec06d900 legacy=0x7feaec0b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fead00039f0 0x7fead0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fead0004810 0x7fead0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feaec144e20 0x7fead00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec0b36b0 con 0x7fead00039f0 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead000ba80 con 0x7fead0004810 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead000bc80 con 0x7feaec144e20 2024-04-25T09:03:17.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeb400640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fead00039f0 0x7fead0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feae3e00640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fead0004810 0x7fead0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaebe00640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feaec144e20 0x7fead00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeb400640 1 -- 172.21.15.59:0/95517225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feaec144e20 msgr2=0x7fead00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeb400640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feaec144e20 0x7fead00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeb400640 1 -- 172.21.15.59:0/95517225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fead0004810 msgr2=0x7fead0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeb400640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fead0004810 0x7fead0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaeb400640 1 -- 172.21.15.59:0/95517225 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead0003530 con 0x7fead00039f0 2024-04-25T09:03:17.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.427+0000 7feaebe00640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feaec144e20 0x7fead00051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.431+0000 7feaeb400640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fead00039f0 0x7fead0003e10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7feadc009ab0 tx=0x7feadc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d379c28b6fc3083c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.431+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0096b0 con 0x7fead00039f0 2024-04-25T09:03:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.431+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc0a64f0 con 0x7fead00039f0 2024-04-25T09:03:17.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.431+0000 7feaeaa00640 1 -- 172.21.15.59:0/95517225 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc0a68e0 con 0x7fead00039f0 2024-04-25T09:03:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.431+0000 7feaf1000640 1 -- 172.21.15.59:0/95517225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fead00039f0 msgr2=0x7fead0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.431+0000 7feaf1000640 1 --2- 172.21.15.59:0/95517225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fead00039f0 0x7fead0003e10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7feadc009ab0 tx=0x7feadc01ca00 comp rx=0 tx=0).stop 2024-04-25T09:03:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.431+0000 7feaebe00640 1 -- 172.21.15.59:0/95517225 reap_dead start 2024-04-25T09:03:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.431+0000 7feaf1000640 1 -- 172.21.15.59:0/95517225 shutdown_connections 2024-04-25T09:03:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.431+0000 7feaf1000640 1 -- 172.21.15.59:0/95517225 >> 172.21.15.59:0/95517225 conn(0x7feaec066fa0 msgr2=0x7feaec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.431+0000 7feaf1000640 1 -- 172.21.15.59:0/95517225 shutdown_connections 2024-04-25T09:03:17.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.431+0000 7feaf1000640 1 -- 172.21.15.59:0/95517225 wait complete. 2024-04-25T09:03:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaf1000640 1 Processor -- start 2024-04-25T09:03:17.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaf1000640 1 -- start start 2024-04-25T09:03:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaf1000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fead00039f0 0x7feaec13fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaf1000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feaec13c700 0x7feaec12f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaf1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaec15e120 0x7feaec15e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaf1000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec145410 con 0x7feaec15e120 2024-04-25T09:03:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaf1000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec167370 con 0x7feaec13c700 2024-04-25T09:03:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaf1000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec159a20 con 0x7fead00039f0 2024-04-25T09:03:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaec15e120 0x7feaec15e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaebe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaec15e120 0x7feaec15e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51470/0 (socket says 172.21.15.59:51470) 2024-04-25T09:03:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaebe00640 1 -- 172.21.15.59:0/32743245 learned_addr learned my addr 172.21.15.59:0/32743245 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaeb400640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fead00039f0 0x7feaec13fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feae3e00640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feaec13c700 0x7feaec12f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaebe00640 1 -- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fead00039f0 msgr2=0x7feaec13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaebe00640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fead00039f0 0x7feaec13fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaebe00640 1 -- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feaec13c700 msgr2=0x7feaec12f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaebe00640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feaec13c700 0x7feaec12f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaebe00640 1 -- 172.21.15.59:0/32743245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec12f5c0 con 0x7feaec15e120 2024-04-25T09:03:17.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaebe00640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaec15e120 0x7feaec15e5a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7feaec0b22d0 tx=0x7feae400eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feae3400640 1 -- 172.21.15.59:0/32743245 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4006b60 con 0x7feaec15e120 2024-04-25T09:03:17.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feae3400640 1 -- 172.21.15.59:0/32743245 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae4006d20 con 0x7feaec15e120 2024-04-25T09:03:17.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaf1000640 1 -- 172.21.15.59:0/32743245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaec13cfb0 con 0x7feaec15e120 2024-04-25T09:03:17.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feae3400640 1 -- 172.21.15.59:0/32743245 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4003980 con 0x7feaec15e120 2024-04-25T09:03:17.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.435+0000 7feaf1000640 1 -- 172.21.15.59:0/32743245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaec13d570 con 0x7feaec15e120 2024-04-25T09:03:17.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.439+0000 7feaf1000640 1 -- 172.21.15.59:0/32743245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaec0745d0 con 0x7feaec15e120 2024-04-25T09:03:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.439+0000 7feae3400640 1 -- 172.21.15.59:0/32743245 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feae401a020 con 0x7feaec15e120 2024-04-25T09:03:17.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.439+0000 7feae3400640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feac8066f60 0x7feac8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.439+0000 7feae3400640 1 -- 172.21.15.59:0/32743245 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7feae4084720 con 0x7feaec15e120 2024-04-25T09:03:17.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.439+0000 7feaeb400640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feac8066f60 0x7feac8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.439+0000 7feaeb400640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feac8066f60 0x7feac8069420 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feadc0af000 tx=0x7feadc0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.443+0000 7feae3400640 1 -- 172.21.15.59:0/32743245 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feae4054f20 con 0x7feaec15e120 2024-04-25T09:03:17.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 -- 172.21.15.59:0/32743245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feaec0b08d0 con 0x7feaec15e120 2024-04-25T09:03:17.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feae3400640 1 -- 172.21.15.59:0/32743245 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7feae4082e20 con 0x7feaec15e120 2024-04-25T09:03:17.598 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:03:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 -- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feac8066f60 msgr2=0x7feac8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feac8066f60 0x7feac8069420 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feadc0af000 tx=0x7feadc0046d0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 -- 172.21.15.59:0/32743245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaec15e120 msgr2=0x7feaec15e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaec15e120 0x7feaec15e5a0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7feaec0b22d0 tx=0x7feae400eb90 comp rx=0 tx=0).stop 2024-04-25T09:03:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 -- 172.21.15.59:0/32743245 shutdown_connections 2024-04-25T09:03:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feac8066f60 0x7feac8069420 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feaec15e120 0x7feaec15e5a0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feaec13c700 0x7feaec12f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 --2- 172.21.15.59:0/32743245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fead00039f0 0x7feaec13fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 -- 172.21.15.59:0/32743245 >> 172.21.15.59:0/32743245 conn(0x7feaec066fa0 msgr2=0x7feaec15b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 -- 172.21.15.59:0/32743245 shutdown_connections 2024-04-25T09:03:17.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.607+0000 7feaf1000640 1 -- 172.21.15.59:0/32743245 wait complete. 2024-04-25T09:03:17.620 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:03:17.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.771+0000 7f10c1800640 1 Processor -- start 2024-04-25T09:03:17.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.771+0000 7f10c1800640 1 -- start start 2024-04-25T09:03:17.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10c1800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f10bc15dc60 0x7f10bc0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10c1800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10bc06bf30 0x7f10bc0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10c1800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc15e040 con 0x7f10bc099a60 2024-04-25T09:03:17.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10c1800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0cff80 con 0x7f10bc06bf30 2024-04-25T09:03:17.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10c1800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0d0260 con 0x7f10bc15dc60 2024-04-25T09:03:17.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10b3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10bc06bf30 0x7f10bc0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10b3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10bc06bf30 0x7f10bc0cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51476/0 (socket says 172.21.15.59:51476) 2024-04-25T09:03:17.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10b3e00640 1 -- 172.21.15.59:0/1331295968 learned_addr learned my addr 172.21.15.59:0/1331295968 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:17.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10baa00640 1 --2- 172.21.15.59:0/1331295968 >> v2:172.21.15.178:3300/0 conn(0x7f10bc15dc60 0x7f10bc0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10b3e00640 1 -- 172.21.15.59:0/1331295968 >> v2:172.21.15.178:3300/0 conn(0x7f10bc15dc60 msgr2=0x7f10bc0d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:17.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10b3e00640 1 --2- 172.21.15.59:0/1331295968 >> v2:172.21.15.178:3300/0 conn(0x7f10bc15dc60 0x7f10bc0d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10b3e00640 1 -- 172.21.15.59:0/1331295968 >> v1:172.21.15.178:6789/0 conn(0x7f10bc099a60 legacy=0x7f10bc0cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.775+0000 7f10b3e00640 1 -- 172.21.15.59:0/1331295968 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0d0540 con 0x7f10bc06bf30 2024-04-25T09:03:17.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10b3e00640 1 --2- 172.21.15.59:0/1331295968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc06bf30 0x7f10bc0cf8a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f10bc09a6b0 tx=0x7f10a401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb1d179a7996406 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10ba000640 1 -- 172.21.15.59:0/1331295968 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a40ab660 con 0x7f10bc06bf30 2024-04-25T09:03:17.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10ba000640 1 -- 172.21.15.59:0/1331295968 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a40b0070 con 0x7f10bc06bf30 2024-04-25T09:03:17.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10ba000640 1 -- 172.21.15.59:0/1331295968 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a40aba20 con 0x7f10bc06bf30 2024-04-25T09:03:17.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10c1800640 1 -- 172.21.15.59:0/1331295968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc06bf30 msgr2=0x7f10bc0cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10c1800640 1 --2- 172.21.15.59:0/1331295968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc06bf30 0x7f10bc0cf8a0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f10bc09a6b0 tx=0x7f10a401c460 comp rx=0 tx=0).stop 2024-04-25T09:03:17.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10c1800640 1 -- 172.21.15.59:0/1331295968 shutdown_connections 2024-04-25T09:03:17.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10c1800640 1 --2- 172.21.15.59:0/1331295968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc06bf30 0x7f10bc0cf8a0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10c1800640 1 --2- 172.21.15.59:0/1331295968 >> v2:172.21.15.178:3300/0 conn(0x7f10bc15dc60 0x7f10bc0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10c1800640 1 -- 172.21.15.59:0/1331295968 >> 172.21.15.59:0/1331295968 conn(0x7f10bc0b3200 msgr2=0x7f10bc0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10c1800640 1 -- 172.21.15.59:0/1331295968 shutdown_connections 2024-04-25T09:03:17.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10c1800640 1 -- 172.21.15.59:0/1331295968 wait complete. 2024-04-25T09:03:17.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10c1800640 1 Processor -- start 2024-04-25T09:03:17.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10c1800640 1 -- start start 2024-04-25T09:03:17.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10c1800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10bc06bf30 0x7f10bc153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.779+0000 7f10c1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc099a60 0x7f10bc15e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10c1800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10bc15dc60 0x7f10bc0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10c1800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc09a280 con 0x7f10bc099a60 2024-04-25T09:03:17.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10c1800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc0cc880 con 0x7f10bc06bf30 2024-04-25T09:03:17.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10c1800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc15cf10 con 0x7f10bc15dc60 2024-04-25T09:03:17.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc099a60 0x7f10bc15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc099a60 0x7f10bc15e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51480/0 (socket says 172.21.15.59:51480) 2024-04-25T09:03:17.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b3e00640 1 -- 172.21.15.59:0/700891424 learned_addr learned my addr 172.21.15.59:0/700891424 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:17.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10baa00640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10bc06bf30 0x7f10bc153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10bb400640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10bc15dc60 0x7f10bc0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b3e00640 1 -- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10bc15dc60 msgr2=0x7f10bc0c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b3e00640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10bc15dc60 0x7f10bc0c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b3e00640 1 -- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10bc06bf30 msgr2=0x7f10bc153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b3e00640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10bc06bf30 0x7f10bc153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b3e00640 1 -- 172.21.15.59:0/700891424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0cb200 con 0x7f10bc099a60 2024-04-25T09:03:17.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b3e00640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc099a60 0x7f10bc15e210 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f10a4019070 tx=0x7f10a401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b2a00640 1 -- 172.21.15.59:0/700891424 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a40be5f0 con 0x7f10bc099a60 2024-04-25T09:03:17.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b2a00640 1 -- 172.21.15.59:0/700891424 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a40be790 con 0x7f10bc099a60 2024-04-25T09:03:17.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10c1800640 1 -- 172.21.15.59:0/700891424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc0cb4e0 con 0x7f10bc099a60 2024-04-25T09:03:17.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b2a00640 1 -- 172.21.15.59:0/700891424 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a40beb40 con 0x7f10bc099a60 2024-04-25T09:03:17.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10c1800640 1 -- 172.21.15.59:0/700891424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc0b4f40 con 0x7f10bc099a60 2024-04-25T09:03:17.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10c1800640 1 -- 172.21.15.59:0/700891424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc0745d0 con 0x7f10bc099a60 2024-04-25T09:03:17.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b2a00640 1 -- 172.21.15.59:0/700891424 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f10a40b43f0 con 0x7f10bc099a60 2024-04-25T09:03:17.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.783+0000 7f10b2a00640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1098066f60 0x7f1098069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:17.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.787+0000 7f10b2a00640 1 -- 172.21.15.59:0/700891424 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f10a4120130 con 0x7f10bc099a60 2024-04-25T09:03:17.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.787+0000 7f10baa00640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1098066f60 0x7f1098069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:17.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.787+0000 7f10baa00640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1098066f60 0x7f1098069420 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0079c0 tx=0x7f10ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:17.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.791+0000 7f10b2a00640 1 -- 172.21.15.59:0/700891424 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f10a40c4060 con 0x7f10bc099a60 2024-04-25T09:03:17.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.951+0000 7f10c1800640 1 -- 172.21.15.59:0/700891424 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f10bc0b7590 con 0x7f10bc099a60 2024-04-25T09:03:17.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.951+0000 7f10b2a00640 1 -- 172.21.15.59:0/700891424 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10a4016110 con 0x7f10bc099a60 2024-04-25T09:03:17.943 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:03:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.951+0000 7f10c1800640 1 -- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1098066f60 msgr2=0x7f1098069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.951+0000 7f10c1800640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1098066f60 0x7f1098069420 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0079c0 tx=0x7f10ac008040 comp rx=0 tx=0).stop 2024-04-25T09:03:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.951+0000 7f10c1800640 1 -- 172.21.15.59:0/700891424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc099a60 msgr2=0x7f10bc15e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.951+0000 7f10c1800640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc099a60 0x7f10bc15e210 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f10a4019070 tx=0x7f10a401aca0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.955+0000 7f10c1800640 1 -- 172.21.15.59:0/700891424 shutdown_connections 2024-04-25T09:03:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.955+0000 7f10c1800640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1098066f60 0x7f1098069420 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.955+0000 7f10c1800640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10bc15dc60 0x7f10bc0c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.955+0000 7f10c1800640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc099a60 0x7f10bc15e210 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.955+0000 7f10c1800640 1 --2- 172.21.15.59:0/700891424 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10bc06bf30 0x7f10bc153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.955+0000 7f10c1800640 1 -- 172.21.15.59:0/700891424 >> 172.21.15.59:0/700891424 conn(0x7f10bc0b3200 msgr2=0x7f10bc0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.955+0000 7f10c1800640 1 -- 172.21.15.59:0/700891424 shutdown_connections 2024-04-25T09:03:17.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:17.955+0000 7f10c1800640 1 -- 172.21.15.59:0/700891424 wait complete. 2024-04-25T09:03:17.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:03:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.115+0000 7f1d08000640 1 Processor -- start 2024-04-25T09:03:18.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.115+0000 7f1d08000640 1 -- start start 2024-04-25T09:03:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.115+0000 7f1d08000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d000d0150 0x7f1d000af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.115+0000 7f1d08000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d000c72a0 0x7f1d000c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.115+0000 7f1d08000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d000b30d0 con 0x7f1d0015dc00 2024-04-25T09:03:18.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.115+0000 7f1d08000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d000cd860 con 0x7f1d000c72a0 2024-04-25T09:03:18.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.115+0000 7f1d08000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d000ccf30 con 0x7f1d000d0150 2024-04-25T09:03:18.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.119+0000 7f1d06000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d000c72a0 0x7f1d000c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.119+0000 7f1d06000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d000c72a0 0x7f1d000c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:60914/0 (socket says 172.21.15.59:60914) 2024-04-25T09:03:18.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.119+0000 7f1d06000640 1 -- 172.21.15.59:0/193631368 learned_addr learned my addr 172.21.15.59:0/193631368 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:18.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.119+0000 7f1d04c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d000d0150 0x7f1d000af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.119+0000 7f1d06000640 1 -- 172.21.15.59:0/193631368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d000d0150 msgr2=0x7f1d000af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.119+0000 7f1d06000640 1 --2- 172.21.15.59:0/193631368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d000d0150 0x7f1d000af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.119+0000 7f1d06000640 1 -- 172.21.15.59:0/193631368 >> v1:172.21.15.178:6789/0 conn(0x7f1d0015dc00 legacy=0x7f1d000c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.119+0000 7f1d06000640 1 -- 172.21.15.59:0/193631368 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d000cd210 con 0x7f1d000c72a0 2024-04-25T09:03:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.119+0000 7f1d06000640 1 --2- 172.21.15.59:0/193631368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d000c72a0 0x7f1d000c54b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009e80 tx=0x7f1cf801ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbbb345b8feac2b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.119+0000 7f1cffe00640 1 -- 172.21.15.59:0/193631368 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80ac020 con 0x7f1d000c72a0 2024-04-25T09:03:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.119+0000 7f1cffe00640 1 -- 172.21.15.59:0/193631368 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf80a6430 con 0x7f1d000c72a0 2024-04-25T09:03:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.119+0000 7f1cffe00640 1 -- 172.21.15.59:0/193631368 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf80a6800 con 0x7f1d000c72a0 2024-04-25T09:03:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 -- 172.21.15.59:0/193631368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d000c72a0 msgr2=0x7f1d000c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 --2- 172.21.15.59:0/193631368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d000c72a0 0x7f1d000c54b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8009e80 tx=0x7f1cf801ca10 comp rx=0 tx=0).stop 2024-04-25T09:03:18.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 -- 172.21.15.59:0/193631368 shutdown_connections 2024-04-25T09:03:18.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 --2- 172.21.15.59:0/193631368 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d000c72a0 0x7f1d000c54b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 --2- 172.21.15.59:0/193631368 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d000d0150 0x7f1d000af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 -- 172.21.15.59:0/193631368 >> 172.21.15.59:0/193631368 conn(0x7f1d000b2240 msgr2=0x7f1d000b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 -- 172.21.15.59:0/193631368 shutdown_connections 2024-04-25T09:03:18.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 -- 172.21.15.59:0/193631368 wait complete. 2024-04-25T09:03:18.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 Processor -- start 2024-04-25T09:03:18.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 -- start start 2024-04-25T09:03:18.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d000c72a0 0x7f1d00153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d000d0150 0x7f1d000b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0015dc00 0x7f1d00142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0016a640 con 0x7f1d000c72a0 2024-04-25T09:03:18.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d000cdee0 con 0x7f1d0015dc00 2024-04-25T09:03:18.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d08000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d0016a7c0 con 0x7f1d000d0150 2024-04-25T09:03:18.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d05600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d000c72a0 0x7f1d00153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d05600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d000c72a0 0x7f1d00153920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51484/0 (socket says 172.21.15.59:51484) 2024-04-25T09:03:18.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d05600640 1 -- 172.21.15.59:0/868135618 learned_addr learned my addr 172.21.15.59:0/868135618 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:18.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d04c00640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d000d0150 0x7f1d000b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d06000640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0015dc00 0x7f1d00142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d05600640 1 -- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d000d0150 msgr2=0x7f1d000b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d05600640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d000d0150 0x7f1d000b1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d05600640 1 -- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0015dc00 msgr2=0x7f1d00142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d05600640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0015dc00 0x7f1d00142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d05600640 1 -- 172.21.15.59:0/868135618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d000b34b0 con 0x7f1d000c72a0 2024-04-25T09:03:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.123+0000 7f1d06000640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0015dc00 0x7f1d00142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.127+0000 7f1d05600640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d000c72a0 0x7f1d00153920 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400c3a0 tx=0x7f1cf400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.127+0000 7f1cfd600640 1 -- 172.21.15.59:0/868135618 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40052d0 con 0x7f1d000c72a0 2024-04-25T09:03:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.127+0000 7f1cfd600640 1 -- 172.21.15.59:0/868135618 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf4005470 con 0x7f1d000c72a0 2024-04-25T09:03:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.127+0000 7f1cfd600640 1 -- 172.21.15.59:0/868135618 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf4007260 con 0x7f1d000c72a0 2024-04-25T09:03:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.127+0000 7f1d08000640 1 -- 172.21.15.59:0/868135618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d000b3790 con 0x7f1d000c72a0 2024-04-25T09:03:18.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.127+0000 7f1d08000640 1 -- 172.21.15.59:0/868135618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d000b3d50 con 0x7f1d000c72a0 2024-04-25T09:03:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.127+0000 7f1d08000640 1 -- 172.21.15.59:0/868135618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d000745d0 con 0x7f1d000c72a0 2024-04-25T09:03:18.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.127+0000 7f1cfd600640 1 -- 172.21.15.59:0/868135618 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1cf4007400 con 0x7f1d000c72a0 2024-04-25T09:03:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.127+0000 7f1cfd600640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ce0066f60 0x7f1ce0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.127+0000 7f1cfd600640 1 -- 172.21.15.59:0/868135618 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f1cf4084530 con 0x7f1d000c72a0 2024-04-25T09:03:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.127+0000 7f1d04c00640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ce0066f60 0x7f1ce0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.131+0000 7f1d04c00640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ce0066f60 0x7f1ce0069420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1d000b1ec0 tx=0x7f1cec009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.131+0000 7f1cfd600640 1 -- 172.21.15.59:0/868135618 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1cf4054dd0 con 0x7f1d000c72a0 2024-04-25T09:03:18.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.295+0000 7f1d08000640 1 -- 172.21.15.59:0/868135618 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d001581b0 con 0x7f1d000c72a0 2024-04-25T09:03:18.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.295+0000 7f1cfd600640 1 -- 172.21.15.59:0/868135618 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1cf4058e70 con 0x7f1d000c72a0 2024-04-25T09:03:18.287 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:03:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.299+0000 7f1d08000640 1 -- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ce0066f60 msgr2=0x7f1ce0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.299+0000 7f1d08000640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ce0066f60 0x7f1ce0069420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1d000b1ec0 tx=0x7f1cec009190 comp rx=0 tx=0).stop 2024-04-25T09:03:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.299+0000 7f1d08000640 1 -- 172.21.15.59:0/868135618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d000c72a0 msgr2=0x7f1d00153920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.299+0000 7f1d08000640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d000c72a0 0x7f1d00153920 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1cf400c3a0 tx=0x7f1cf400c860 comp rx=0 tx=0).stop 2024-04-25T09:03:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.299+0000 7f1d08000640 1 -- 172.21.15.59:0/868135618 shutdown_connections 2024-04-25T09:03:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.299+0000 7f1d08000640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ce0066f60 0x7f1ce0069420 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.299+0000 7f1d08000640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d0015dc00 0x7f1d00142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.299+0000 7f1d08000640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d000d0150 0x7f1d000b1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.299+0000 7f1d08000640 1 --2- 172.21.15.59:0/868135618 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d000c72a0 0x7f1d00153920 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.299+0000 7f1d08000640 1 -- 172.21.15.59:0/868135618 >> 172.21.15.59:0/868135618 conn(0x7f1d000b2240 msgr2=0x7f1d000c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.299+0000 7f1d08000640 1 -- 172.21.15.59:0/868135618 shutdown_connections 2024-04-25T09:03:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.299+0000 7f1d08000640 1 -- 172.21.15.59:0/868135618 wait complete. 2024-04-25T09:03:18.310 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:18.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.459+0000 7ff623600640 1 Processor -- start 2024-04-25T09:03:18.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.459+0000 7ff623600640 1 -- start start 2024-04-25T09:03:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.459+0000 7ff623600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff61c15b5a0 0x7ff61c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.459+0000 7ff623600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff61c0cc440 0x7ff61c0d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.459+0000 7ff623600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61c0ce7f0 con 0x7ff61c15b980 2024-04-25T09:03:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.459+0000 7ff623600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61c0cfcd0 con 0x7ff61c0cc440 2024-04-25T09:03:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.459+0000 7ff623600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61c0cead0 con 0x7ff61c15b5a0 2024-04-25T09:03:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.459+0000 7ff61be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff61c15b980 0x7ff61c0cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55618/0 (socket says 172.21.15.59:55618) 2024-04-25T09:03:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.459+0000 7ff61be00640 1 -- 172.21.15.59:0/3523935314 learned_addr learned my addr 172.21.15.59:0/3523935314 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:18.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.459+0000 7ff621600640 1 --2- 172.21.15.59:0/3523935314 >> v2:172.21.15.59:3300/0 conn(0x7ff61c0cc440 0x7ff61c0d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.459+0000 7ff620c00640 1 --2- 172.21.15.59:0/3523935314 >> v2:172.21.15.178:3300/0 conn(0x7ff61c15b5a0 0x7ff61c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff621600640 1 -- 172.21.15.59:0/3523935314 >> v2:172.21.15.178:3300/0 conn(0x7ff61c15b5a0 msgr2=0x7ff61c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff621600640 1 --2- 172.21.15.59:0/3523935314 >> v2:172.21.15.178:3300/0 conn(0x7ff61c15b5a0 0x7ff61c0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff621600640 1 -- 172.21.15.59:0/3523935314 >> v1:172.21.15.59:6789/0 conn(0x7ff61c15b980 legacy=0x7ff61c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff621600640 1 -- 172.21.15.59:0/3523935314 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c0cf960 con 0x7ff61c0cc440 2024-04-25T09:03:18.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff621600640 1 --2- 172.21.15.59:0/3523935314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff61c0cc440 0x7ff61c0d0160 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff61c072e00 tx=0x7ff61401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00062e2d2ba2477 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff61b400640 1 -- 172.21.15.59:0/3523935314 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6140b2070 con 0x7ff61c0cc440 2024-04-25T09:03:18.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff61b400640 1 -- 172.21.15.59:0/3523935314 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6140a5a10 con 0x7ff61c0cc440 2024-04-25T09:03:18.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff61b400640 1 -- 172.21.15.59:0/3523935314 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6140a5de0 con 0x7ff61c0cc440 2024-04-25T09:03:18.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff623600640 1 -- 172.21.15.59:0/3523935314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff61c0cc440 msgr2=0x7ff61c0d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff623600640 1 --2- 172.21.15.59:0/3523935314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff61c0cc440 0x7ff61c0d0160 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff61c072e00 tx=0x7ff61401c930 comp rx=0 tx=0).stop 2024-04-25T09:03:18.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff623600640 1 -- 172.21.15.59:0/3523935314 shutdown_connections 2024-04-25T09:03:18.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff623600640 1 --2- 172.21.15.59:0/3523935314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff61c0cc440 0x7ff61c0d0160 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff623600640 1 --2- 172.21.15.59:0/3523935314 >> v2:172.21.15.178:3300/0 conn(0x7ff61c15b5a0 0x7ff61c0cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff623600640 1 -- 172.21.15.59:0/3523935314 >> 172.21.15.59:0/3523935314 conn(0x7ff61c0b3390 msgr2=0x7ff61c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff623600640 1 -- 172.21.15.59:0/3523935314 shutdown_connections 2024-04-25T09:03:18.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.463+0000 7ff623600640 1 -- 172.21.15.59:0/3523935314 wait complete. 2024-04-25T09:03:18.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff623600640 1 Processor -- start 2024-04-25T09:03:18.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff623600640 1 -- start start 2024-04-25T09:03:18.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff623600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff61c0cc440 0x7ff61c15c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff623600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff61c15b5a0 0x7ff61c0caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff623600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff61c15b980 0x7ff61c0caf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff623600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c0d1280 con 0x7ff61c0cc440 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff623600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c0d1100 con 0x7ff61c15b980 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff623600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c0d1400 con 0x7ff61c15b5a0 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff620c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff61c0cc440 0x7ff61c15c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff620c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff61c0cc440 0x7ff61c15c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51508/0 (socket says 172.21.15.59:51508) 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff620c00640 1 -- 172.21.15.59:0/2281936784 learned_addr learned my addr 172.21.15.59:0/2281936784 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff61be00640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff61c15b5a0 0x7ff61c0caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff620c00640 1 -- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff61c15b5a0 msgr2=0x7ff61c0caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff621600640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff61c15b980 0x7ff61c0caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff620c00640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff61c15b5a0 0x7ff61c0caa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff620c00640 1 -- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff61c15b980 msgr2=0x7ff61c0caf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff620c00640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff61c15b980 0x7ff61c0caf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff620c00640 1 -- 172.21.15.59:0/2281936784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c15c8c0 con 0x7ff61c0cc440 2024-04-25T09:03:18.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff61be00640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff61c15b5a0 0x7ff61c0caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:18.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff621600640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff61c15b980 0x7ff61c0caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:18.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff620c00640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff61c0cc440 0x7ff61c15c380 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff61000d620 tx=0x7ff61000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff618c00640 1 -- 172.21.15.59:0/2281936784 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61000b620 con 0x7ff61c0cc440 2024-04-25T09:03:18.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff618c00640 1 -- 172.21.15.59:0/2281936784 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff610019070 con 0x7ff61c0cc440 2024-04-25T09:03:18.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff618c00640 1 -- 172.21.15.59:0/2281936784 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61000b9e0 con 0x7ff61c0cc440 2024-04-25T09:03:18.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff623600640 1 -- 172.21.15.59:0/2281936784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c1f82a0 con 0x7ff61c0cc440 2024-04-25T09:03:18.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.467+0000 7ff623600640 1 -- 172.21.15.59:0/2281936784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c06c250 con 0x7ff61c0cc440 2024-04-25T09:03:18.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.471+0000 7ff623600640 1 -- 172.21.15.59:0/2281936784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61c0745d0 con 0x7ff61c0cc440 2024-04-25T09:03:18.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.471+0000 7ff618c00640 1 -- 172.21.15.59:0/2281936784 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff61000bb80 con 0x7ff61c0cc440 2024-04-25T09:03:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.471+0000 7ff618c00640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff5fc066f60 0x7ff5fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.471+0000 7ff618c00640 1 -- 172.21.15.59:0/2281936784 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7ff610085540 con 0x7ff61c0cc440 2024-04-25T09:03:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.471+0000 7ff61be00640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff5fc066f60 0x7ff5fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.471+0000 7ff61be00640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff5fc066f60 0x7ff5fc069420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff608007fd0 tx=0x7ff608009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.475+0000 7ff618c00640 1 -- 172.21.15.59:0/2281936784 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff610056430 con 0x7ff61c0cc440 2024-04-25T09:03:18.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 -- 172.21.15.59:0/2281936784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff61c0d0260 con 0x7ff61c0cc440 2024-04-25T09:03:18.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff618c00640 1 -- 172.21.15.59:0/2281936784 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7ff610055d30 con 0x7ff61c0cc440 2024-04-25T09:03:18.662 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:18.662 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3471177782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3471177782},{"type":"v1","addr":"172.21.15.178:6836","nonce":3471177782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3534065304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3534065304},{"type":"v1","addr":"172.21.15.178:6837","nonce":3534065304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4015865168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4015865168},{"type":"v1","addr":"172.21.15.59:6833","nonce":4015865168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:49.614073+0000","modified":"2024-04-25T09:02:52.639785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5289":{"gid":5289,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1202642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1202642229},{"type":"v1","addr":"172.21.15.59:6835","nonce":1202642229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:03:18.663 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 19 2024-04-25T09:03:18.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 -- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff5fc066f60 msgr2=0x7ff5fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff5fc066f60 0x7ff5fc069420 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff608007fd0 tx=0x7ff608009040 comp rx=0 tx=0).stop 2024-04-25T09:03:18.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 -- 172.21.15.59:0/2281936784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff61c0cc440 msgr2=0x7ff61c15c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff61c0cc440 0x7ff61c15c380 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff61000d620 tx=0x7ff61000dae0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 -- 172.21.15.59:0/2281936784 shutdown_connections 2024-04-25T09:03:18.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff5fc066f60 0x7ff5fc069420 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff61c15b980 0x7ff61c0caf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff61c15b5a0 0x7ff61c0caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 --2- 172.21.15.59:0/2281936784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff61c0cc440 0x7ff61c15c380 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 -- 172.21.15.59:0/2281936784 >> 172.21.15.59:0/2281936784 conn(0x7ff61c0b3390 msgr2=0x7ff61c0b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 -- 172.21.15.59:0/2281936784 shutdown_connections 2024-04-25T09:03:18.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.671+0000 7ff623600640 1 -- 172.21.15.59:0/2281936784 wait complete. 2024-04-25T09:03:18.684 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:18.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.831+0000 7f3c0f000640 1 Processor -- start 2024-04-25T09:03:18.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.831+0000 7f3c0f000640 1 -- start start 2024-04-25T09:03:18.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3c0f000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0815fe50 0x7f3c080b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3c0f000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c080b1c90 0x7f3c0815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3c0f000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c080cc4e0 con 0x7f3c08145270 2024-04-25T09:03:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3c0f000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c080b20e0 con 0x7f3c080b1c90 2024-04-25T09:03:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3c0f000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c08145650 con 0x7f3c0815fe50 2024-04-25T09:03:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3c0d000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c080b1c90 0x7f3c0815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3c0d000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3c080b1c90 0x7f3c0815bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51522/0 (socket says 172.21.15.59:51522) 2024-04-25T09:03:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3c0d000640 1 -- 172.21.15.59:0/1124195962 learned_addr learned my addr 172.21.15.59:0/1124195962 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:18.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3bffe00640 1 --2- 172.21.15.59:0/1124195962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0815fe50 0x7f3c080b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3c0d000640 1 -- 172.21.15.59:0/1124195962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0815fe50 msgr2=0x7f3c080b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3c0d000640 1 --2- 172.21.15.59:0/1124195962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0815fe50 0x7f3c080b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3c0d000640 1 -- 172.21.15.59:0/1124195962 >> v1:172.21.15.178:6789/0 conn(0x7f3c08145270 legacy=0x7f3c080cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.835+0000 7f3c0d000640 1 -- 172.21.15.59:0/1124195962 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c080ce040 con 0x7f3c080b1c90 2024-04-25T09:03:18.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0d000640 1 --2- 172.21.15.59:0/1124195962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c080b1c90 0x7f3c0815bd80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009e80 tx=0x7f3c0001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8447611ac38d5f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c07400640 1 -- 172.21.15.59:0/1124195962 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c000a57d0 con 0x7f3c080b1c90 2024-04-25T09:03:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c07400640 1 -- 172.21.15.59:0/1124195962 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c000a5970 con 0x7f3c080b1c90 2024-04-25T09:03:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c07400640 1 -- 172.21.15.59:0/1124195962 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c000a5d40 con 0x7f3c080b1c90 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 -- 172.21.15.59:0/1124195962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c080b1c90 msgr2=0x7f3c0815bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 --2- 172.21.15.59:0/1124195962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c080b1c90 0x7f3c0815bd80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3c00009e80 tx=0x7f3c0001ca10 comp rx=0 tx=0).stop 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 -- 172.21.15.59:0/1124195962 shutdown_connections 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 --2- 172.21.15.59:0/1124195962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c080b1c90 0x7f3c0815bd80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 --2- 172.21.15.59:0/1124195962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0815fe50 0x7f3c080b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 -- 172.21.15.59:0/1124195962 >> 172.21.15.59:0/1124195962 conn(0x7f3c08066fa0 msgr2=0x7f3c0806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 -- 172.21.15.59:0/1124195962 shutdown_connections 2024-04-25T09:03:18.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 -- 172.21.15.59:0/1124195962 wait complete. 2024-04-25T09:03:18.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 Processor -- start 2024-04-25T09:03:18.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 -- start start 2024-04-25T09:03:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c080b1c90 0x7f3c081604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c08145270 0x7f3c081414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0815fe50 0x7f3c0815ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080cdbe0 con 0x7f3c080b1c90 2024-04-25T09:03:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0815f930 con 0x7f3c08145270 2024-04-25T09:03:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.839+0000 7f3c0f000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c080cdd60 con 0x7f3c0815fe50 2024-04-25T09:03:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c07e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c080b1c90 0x7f3c081604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c07e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c080b1c90 0x7f3c081604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51534/0 (socket says 172.21.15.59:51534) 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c07e00640 1 -- 172.21.15.59:0/3218843528 learned_addr learned my addr 172.21.15.59:0/3218843528 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c0d000640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0815fe50 0x7f3c0815ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3bffe00640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c08145270 0x7f3c081414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c07e00640 1 -- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0815fe50 msgr2=0x7f3c0815ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c07e00640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0815fe50 0x7f3c0815ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c07e00640 1 -- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c08145270 msgr2=0x7f3c081414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c07e00640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c08145270 0x7f3c081414b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c07e00640 1 -- 172.21.15.59:0/3218843528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c081595a0 con 0x7f3c080b1c90 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c07e00640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c080b1c90 0x7f3c081604c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800c420 tx=0x7f3bf800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c04c00640 1 -- 172.21.15.59:0/3218843528 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80052d0 con 0x7f3c080b1c90 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c04c00640 1 -- 172.21.15.59:0/3218843528 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf8005470 con 0x7f3c080b1c90 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c04c00640 1 -- 172.21.15.59:0/3218843528 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8007260 con 0x7f3c080b1c90 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c0f000640 1 -- 172.21.15.59:0/3218843528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c08159880 con 0x7f3c080b1c90 2024-04-25T09:03:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c0f000640 1 -- 172.21.15.59:0/3218843528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c08159e40 con 0x7f3c080b1c90 2024-04-25T09:03:18.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c0f000640 1 -- 172.21.15.59:0/3218843528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c080745d0 con 0x7f3c080b1c90 2024-04-25T09:03:18.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.843+0000 7f3c04c00640 1 -- 172.21.15.59:0/3218843528 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3bf8007400 con 0x7f3c080b1c90 2024-04-25T09:03:18.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.847+0000 7f3c04c00640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3be4066f90 0x7f3be4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.847+0000 7f3c04c00640 1 -- 172.21.15.59:0/3218843528 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f3bf80845f0 con 0x7f3c080b1c90 2024-04-25T09:03:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.847+0000 7f3bffe00640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3be4066f90 0x7f3be4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.847+0000 7f3bffe00640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3be4066f90 0x7f3be4069450 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3c0813c0b0 tx=0x7f3bf0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:18.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:18.851+0000 7f3c04c00640 1 -- 172.21.15.59:0/3218843528 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3bf8054df0 con 0x7f3c080b1c90 2024-04-25T09:03:19.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.011+0000 7f3c0f000640 1 -- 172.21.15.59:0/3218843528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c080ae8e0 con 0x7f3c080b1c90 2024-04-25T09:03:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c04c00640 1 -- 172.21.15.59:0/3218843528 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16991 (secure 0 0 0) 0x7f3bf8058e90 con 0x7f3c080b1c90 2024-04-25T09:03:19.005 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:19.005 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":41,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:03:09.300265+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:47.433966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:48.612644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:19.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c0f000640 1 -- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3be4066f90 msgr2=0x7f3be4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c0f000640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3be4066f90 0x7f3be4069450 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3c0813c0b0 tx=0x7f3bf0009190 comp rx=0 tx=0).stop 2024-04-25T09:03:19.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c0f000640 1 -- 172.21.15.59:0/3218843528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c080b1c90 msgr2=0x7f3c081604c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c0f000640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c080b1c90 0x7f3c081604c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3bf800c420 tx=0x7f3bf800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c0f000640 1 -- 172.21.15.59:0/3218843528 shutdown_connections 2024-04-25T09:03:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c0f000640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3be4066f90 0x7f3be4069450 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c0f000640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c0815fe50 0x7f3c0815ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c0f000640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c08145270 0x7f3c081414b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c0f000640 1 --2- 172.21.15.59:0/3218843528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c080b1c90 0x7f3c081604c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c0f000640 1 -- 172.21.15.59:0/3218843528 >> 172.21.15.59:0/3218843528 conn(0x7f3c08066fa0 msgr2=0x7f3c08142900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c0f000640 1 -- 172.21.15.59:0/3218843528 shutdown_connections 2024-04-25T09:03:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.015+0000 7f3c0f000640 1 -- 172.21.15.59:0/3218843528 wait complete. 2024-04-25T09:03:19.027 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:03:19.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:19.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.175+0000 7f09c4200640 1 Processor -- start 2024-04-25T09:03:19.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.175+0000 7f09c4200640 1 -- start start 2024-04-25T09:03:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.175+0000 7f09c4200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09bc15b5a0 0x7f09bc0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.175+0000 7f09c4200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0cc440 0x7f09bc0d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.175+0000 7f09c4200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc0ce7f0 con 0x7f09bc15b980 2024-04-25T09:03:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.175+0000 7f09c4200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc0cfcd0 con 0x7f09bc15b5a0 2024-04-25T09:03:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.175+0000 7f09c4200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0cead0 con 0x7f09bc0cc440 2024-04-25T09:03:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.175+0000 7f09c1800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09bc15b5a0 0x7f09bc0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.175+0000 7f09c1800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09bc15b5a0 0x7f09bc0cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51548/0 (socket says 172.21.15.59:51548) 2024-04-25T09:03:19.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.175+0000 7f09c1800640 1 -- 172.21.15.59:0/2595954333 learned_addr learned my addr 172.21.15.59:0/2595954333 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:19.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.175+0000 7f09c2200640 1 --2- 172.21.15.59:0/2595954333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0cc440 0x7f09bc0d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09c1800640 1 -- 172.21.15.59:0/2595954333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0cc440 msgr2=0x7f09bc0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09c1800640 1 --2- 172.21.15.59:0/2595954333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0cc440 0x7f09bc0d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09c1800640 1 -- 172.21.15.59:0/2595954333 >> v1:172.21.15.178:6789/0 conn(0x7f09bc15b980 legacy=0x7f09bc0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09c1800640 1 -- 172.21.15.59:0/2595954333 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc0cf960 con 0x7f09bc15b5a0 2024-04-25T09:03:19.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09c2200640 1 --2- 172.21.15.59:0/2595954333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0cc440 0x7f09bc0d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:19.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09c1800640 1 --2- 172.21.15.59:0/2595954333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc15b5a0 0x7f09bc0cdea0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009870 tx=0x7f09b001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4fdb462a4d474f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09bbe00640 1 -- 172.21.15.59:0/2595954333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b00a9640 con 0x7f09bc15b5a0 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09bbe00640 1 -- 172.21.15.59:0/2595954333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b00a97e0 con 0x7f09bc15b5a0 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09bbe00640 1 -- 172.21.15.59:0/2595954333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b00a9bb0 con 0x7f09bc15b5a0 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09c4200640 1 -- 172.21.15.59:0/2595954333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc15b5a0 msgr2=0x7f09bc0cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09c4200640 1 --2- 172.21.15.59:0/2595954333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc15b5a0 0x7f09bc0cdea0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f09b0009870 tx=0x7f09b001c560 comp rx=0 tx=0).stop 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09c4200640 1 -- 172.21.15.59:0/2595954333 shutdown_connections 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09c4200640 1 --2- 172.21.15.59:0/2595954333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc0cc440 0x7f09bc0d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09c4200640 1 --2- 172.21.15.59:0/2595954333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc15b5a0 0x7f09bc0cdea0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.179+0000 7f09c4200640 1 -- 172.21.15.59:0/2595954333 >> 172.21.15.59:0/2595954333 conn(0x7f09bc0b3390 msgr2=0x7f09bc0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c4200640 1 -- 172.21.15.59:0/2595954333 shutdown_connections 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c4200640 1 -- 172.21.15.59:0/2595954333 wait complete. 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c4200640 1 Processor -- start 2024-04-25T09:03:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c4200640 1 -- start start 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c4200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc0cc440 0x7f09bc15a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c4200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc15b5a0 0x7f09bc153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c4200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15b980 0x7f09bc1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c4200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0d1280 con 0x7f09bc0cc440 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c4200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0d1100 con 0x7f09bc15b980 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c4200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0d1400 con 0x7f09bc15b5a0 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc0cc440 0x7f09bc15a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc0cc440 0x7f09bc15a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51562/0 (socket says 172.21.15.59:51562) 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c1800640 1 -- 172.21.15.59:0/4130129912 learned_addr learned my addr 172.21.15.59:0/4130129912 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c2200640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15b980 0x7f09bc1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c0e00640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc15b5a0 0x7f09bc153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c1800640 1 -- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc15b5a0 msgr2=0x7f09bc153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c1800640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc15b5a0 0x7f09bc153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c1800640 1 -- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15b980 msgr2=0x7f09bc1544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c1800640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15b980 0x7f09bc1544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c1800640 1 -- 172.21.15.59:0/4130129912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc14ab70 con 0x7f09bc0cc440 2024-04-25T09:03:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c2200640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15b980 0x7f09bc1544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c1800640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc0cc440 0x7f09bc15a750 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f09b00ab040 tx=0x7f09b001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09b9600640 1 -- 172.21.15.59:0/4130129912 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b00b1980 con 0x7f09bc0cc440 2024-04-25T09:03:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09b9600640 1 -- 172.21.15.59:0/4130129912 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b00b1b20 con 0x7f09bc0cc440 2024-04-25T09:03:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09b9600640 1 -- 172.21.15.59:0/4130129912 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b00bc450 con 0x7f09bc0cc440 2024-04-25T09:03:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.183+0000 7f09c4200640 1 -- 172.21.15.59:0/4130129912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc14ae50 con 0x7f09bc0cc440 2024-04-25T09:03:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.187+0000 7f09c4200640 1 -- 172.21.15.59:0/4130129912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc135df0 con 0x7f09bc0cc440 2024-04-25T09:03:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.187+0000 7f09c4200640 1 -- 172.21.15.59:0/4130129912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc0745d0 con 0x7f09bc0cc440 2024-04-25T09:03:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.187+0000 7f09b9600640 1 -- 172.21.15.59:0/4130129912 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f09b00bc5f0 con 0x7f09bc0cc440 2024-04-25T09:03:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.187+0000 7f09b9600640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f099c066f60 0x7f099c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.187+0000 7f09b9600640 1 -- 172.21.15.59:0/4130129912 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f09b011fef0 con 0x7f09bc0cc440 2024-04-25T09:03:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.187+0000 7f09c0e00640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f099c066f60 0x7f099c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.187+0000 7f09c0e00640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f099c066f60 0x7f099c069420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f09bc150c80 tx=0x7f09a8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.191+0000 7f09b9600640 1 -- 172.21.15.59:0/4130129912 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f09b00ad020 con 0x7f09bc0cc440 2024-04-25T09:03:19.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.391+0000 7f09c4200640 1 -- 172.21.15.59:0/4130129912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09bc0cc960 con 0x7f09bc0cc440 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.391+0000 7f09b9600640 1 -- 172.21.15.59:0/4130129912 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7f09b0016150 con 0x7f09bc0cc440 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3471177782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3471177782},{"type":"v1","addr":"172.21.15.178:6836","nonce":3471177782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3534065304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3534065304},{"type":"v1","addr":"172.21.15.178:6837","nonce":3534065304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4015865168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4015865168},{"type":"v1","addr":"172.21.15.59:6833","nonce":4015865168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:49.614073+0000","modified":"2024-04-25T09:02:52.639785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5289":{"gid":5289,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1202642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1202642229},{"type":"v1","addr":"172.21.15.59:6835","nonce":1202642229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:03:19.384 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 19 2024-04-25T09:03:19.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.395+0000 7f09c4200640 1 -- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f099c066f60 msgr2=0x7f099c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.395+0000 7f09c4200640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f099c066f60 0x7f099c069420 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f09bc150c80 tx=0x7f09a8009040 comp rx=0 tx=0).stop 2024-04-25T09:03:19.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.395+0000 7f09c4200640 1 -- 172.21.15.59:0/4130129912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc0cc440 msgr2=0x7f09bc15a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.395+0000 7f09c4200640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc0cc440 0x7f09bc15a750 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f09b00ab040 tx=0x7f09b001ada0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.395+0000 7f09c4200640 1 -- 172.21.15.59:0/4130129912 shutdown_connections 2024-04-25T09:03:19.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.395+0000 7f09c4200640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f099c066f60 0x7f099c069420 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.395+0000 7f09c4200640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09bc15b980 0x7f09bc1544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.395+0000 7f09c4200640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09bc15b5a0 0x7f09bc153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.395+0000 7f09c4200640 1 --2- 172.21.15.59:0/4130129912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09bc0cc440 0x7f09bc15a750 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.395+0000 7f09c4200640 1 -- 172.21.15.59:0/4130129912 >> 172.21.15.59:0/4130129912 conn(0x7f09bc0b3390 msgr2=0x7f09bc0b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.395+0000 7f09c4200640 1 -- 172.21.15.59:0/4130129912 shutdown_connections 2024-04-25T09:03:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.395+0000 7f09c4200640 1 -- 172.21.15.59:0/4130129912 wait complete. 2024-04-25T09:03:19.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:19.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.555+0000 7fd3c1200640 1 Processor -- start 2024-04-25T09:03:19.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.555+0000 7fd3c1200640 1 -- start start 2024-04-25T09:03:19.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.555+0000 7fd3c1200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc15daf0 0x7fd3bc0ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.555+0000 7fd3c1200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd3bc0cf9f0 0x7fd3bc0ca150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.555+0000 7fd3c1200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3bc0b2870 con 0x7fd3bc06ac10 2024-04-25T09:03:19.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.555+0000 7fd3c1200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3bc15ded0 con 0x7fd3bc0cf9f0 2024-04-25T09:03:19.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.555+0000 7fd3c1200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0b2ae0 con 0x7fd3bc15daf0 2024-04-25T09:03:19.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.555+0000 7fd3bbe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd3bc06ac10 0x7fd3bc0cea10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55628/0 (socket says 172.21.15.59:55628) 2024-04-25T09:03:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.555+0000 7fd3bbe00640 1 -- 172.21.15.59:0/8712171 learned_addr learned my addr 172.21.15.59:0/8712171 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.555+0000 7fd3b2a00640 1 --2- 172.21.15.59:0/8712171 >> v2:172.21.15.178:3300/0 conn(0x7fd3bc0cf9f0 0x7fd3bc0ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.555+0000 7fd3bb400640 1 --2- 172.21.15.59:0/8712171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc15daf0 0x7fd3bc0ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.555+0000 7fd3baa00640 1 -- 172.21.15.59:0/8712171 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877968616 0 0) 0x7fd3bc0b2870 con 0x7fd3bc06ac10 2024-04-25T09:03:19.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.559+0000 7fd3baa00640 1 -- 172.21.15.59:0/8712171 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3a0003530 con 0x7fd3bc06ac10 2024-04-25T09:03:19.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.559+0000 7fd3baa00640 1 -- 172.21.15.59:0/8712171 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4145980004 0 0) 0x7fd3a0003530 con 0x7fd3bc06ac10 2024-04-25T09:03:19.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.559+0000 7fd3bb400640 1 -- 172.21.15.59:0/8712171 >> v2:172.21.15.178:3300/0 conn(0x7fd3bc0cf9f0 msgr2=0x7fd3bc0ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.559+0000 7fd3bb400640 1 --2- 172.21.15.59:0/8712171 >> v2:172.21.15.178:3300/0 conn(0x7fd3bc0cf9f0 0x7fd3bc0ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.559+0000 7fd3bb400640 1 -- 172.21.15.59:0/8712171 >> v1:172.21.15.59:6789/0 conn(0x7fd3bc06ac10 legacy=0x7fd3bc0cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.559+0000 7fd3bb400640 1 -- 172.21.15.59:0/8712171 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc0b2dc0 con 0x7fd3bc15daf0 2024-04-25T09:03:19.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.559+0000 7fd3b2a00640 1 --2- 172.21.15.59:0/8712171 >> v2:172.21.15.178:3300/0 conn(0x7fd3bc0cf9f0 0x7fd3bc0ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:19.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.559+0000 7fd3bb400640 1 --2- 172.21.15.59:0/8712171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc15daf0 0x7fd3bc0ad3a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009d90 tx=0x7fd3ac01c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74d52722d8a7418 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.559+0000 7fd3baa00640 1 -- 172.21.15.59:0/8712171 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0b2070 con 0x7fd3bc15daf0 2024-04-25T09:03:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.559+0000 7fd3baa00640 1 -- 172.21.15.59:0/8712171 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac0a5660 con 0x7fd3bc15daf0 2024-04-25T09:03:19.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.559+0000 7fd3baa00640 1 -- 172.21.15.59:0/8712171 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4001680 con 0x7fd3bc15daf0 2024-04-25T09:03:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 -- 172.21.15.59:0/8712171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc15daf0 msgr2=0x7fd3bc0ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 --2- 172.21.15.59:0/8712171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc15daf0 0x7fd3bc0ad3a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009d90 tx=0x7fd3ac01c860 comp rx=0 tx=0).stop 2024-04-25T09:03:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 -- 172.21.15.59:0/8712171 shutdown_connections 2024-04-25T09:03:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 --2- 172.21.15.59:0/8712171 >> v2:172.21.15.178:3300/0 conn(0x7fd3bc0cf9f0 0x7fd3bc0ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 --2- 172.21.15.59:0/8712171 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc15daf0 0x7fd3bc0ad3a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 -- 172.21.15.59:0/8712171 >> 172.21.15.59:0/8712171 conn(0x7fd3bc099a60 msgr2=0x7fd3bc0b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 -- 172.21.15.59:0/8712171 shutdown_connections 2024-04-25T09:03:19.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 -- 172.21.15.59:0/8712171 wait complete. 2024-04-25T09:03:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 Processor -- start 2024-04-25T09:03:19.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 -- start start 2024-04-25T09:03:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc06ac10 0x7fd3bc0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc0cf9f0 0x7fd3bc0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3bc15daf0 0x7fd3bc0b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0ce1a0 con 0x7fd3bc15daf0 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc06b4b0 con 0x7fd3bc06ac10 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3c1200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3bc0ca690 con 0x7fd3bc0cf9f0 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3bbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3bc15daf0 0x7fd3bc0b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3bbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3bc15daf0 0x7fd3bc0b4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51566/0 (socket says 172.21.15.59:51566) 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3bbe00640 1 -- 172.21.15.59:0/4182997598 learned_addr learned my addr 172.21.15.59:0/4182997598 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3b2a00640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc0cf9f0 0x7fd3bc0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3bb400640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc06ac10 0x7fd3bc0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3bbe00640 1 -- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc0cf9f0 msgr2=0x7fd3bc0ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3bbe00640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc0cf9f0 0x7fd3bc0ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3bbe00640 1 -- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc06ac10 msgr2=0x7fd3bc0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3bbe00640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc06ac10 0x7fd3bc0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3bbe00640 1 -- 172.21.15.59:0/4182997598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3bc0b4830 con 0x7fd3bc15daf0 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.563+0000 7fd3bbe00640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3bc15daf0 0x7fd3bc0b4000 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c730 tx=0x7fd3b400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.567+0000 7fd3b3e00640 1 -- 172.21.15.59:0/4182997598 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4005ae0 con 0x7fd3bc15daf0 2024-04-25T09:03:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.567+0000 7fd3b3e00640 1 -- 172.21.15.59:0/4182997598 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b4005c80 con 0x7fd3bc15daf0 2024-04-25T09:03:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.567+0000 7fd3c1200640 1 -- 172.21.15.59:0/4182997598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3bc0caae0 con 0x7fd3bc15daf0 2024-04-25T09:03:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.567+0000 7fd3b3e00640 1 -- 172.21.15.59:0/4182997598 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b4007270 con 0x7fd3bc15daf0 2024-04-25T09:03:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.567+0000 7fd3c1200640 1 -- 172.21.15.59:0/4182997598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3bc0cb0a0 con 0x7fd3bc15daf0 2024-04-25T09:03:19.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.567+0000 7fd3c1200640 1 -- 172.21.15.59:0/4182997598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3bc0cb2a0 con 0x7fd3bc15daf0 2024-04-25T09:03:19.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.567+0000 7fd3b3e00640 1 -- 172.21.15.59:0/4182997598 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd3b4007410 con 0x7fd3bc15daf0 2024-04-25T09:03:19.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.567+0000 7fd3b3e00640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd398066f60 0x7fd398069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.567+0000 7fd3b3e00640 1 -- 172.21.15.59:0/4182997598 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fd3b4084e60 con 0x7fd3bc15daf0 2024-04-25T09:03:19.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.567+0000 7fd3bb400640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd398066f60 0x7fd398069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.571+0000 7fd3bb400640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd398066f60 0x7fd398069420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0af000 tx=0x7fd3ac0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.571+0000 7fd3b3e00640 1 -- 172.21.15.59:0/4182997598 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd3b4055660 con 0x7fd3bc15daf0 2024-04-25T09:03:19.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.767+0000 7fd3c1200640 1 -- 172.21.15.59:0/4182997598 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3bc04efa0 con 0x7fd3bc15daf0 2024-04-25T09:03:19.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.767+0000 7fd3b3e00640 1 -- 172.21.15.59:0/4182997598 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4944 (secure 0 0 0) 0x7fd3b4059700 con 0x7fd3bc15daf0 2024-04-25T09:03:19.760 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:19.760 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":19,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3471177782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3471177782},{"type":"v1","addr":"172.21.15.178:6836","nonce":3471177782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3534065304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3534065304},{"type":"v1","addr":"172.21.15.178:6837","nonce":3534065304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4015865168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4015865168},{"type":"v1","addr":"172.21.15.59:6833","nonce":4015865168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:02:49.614073+0000","modified":"2024-04-25T09:02:52.639785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5289},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5289":{"gid":5289,"name":"a","rank":0,"incarnation":15,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1202642229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":1202642229},{"type":"v1","addr":"172.21.15.59:6835","nonce":1202642229}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-25T09:03:19.760 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 19 2024-04-25T09:03:19.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.771+0000 7fd3c1200640 1 -- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd398066f60 msgr2=0x7fd398069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.771+0000 7fd3c1200640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd398066f60 0x7fd398069420 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0af000 tx=0x7fd3ac0a7070 comp rx=0 tx=0).stop 2024-04-25T09:03:19.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.771+0000 7fd3c1200640 1 -- 172.21.15.59:0/4182997598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3bc15daf0 msgr2=0x7fd3bc0b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.771+0000 7fd3c1200640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3bc15daf0 0x7fd3bc0b4000 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd3b400c730 tx=0x7fd3b400cbf0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.771+0000 7fd3c1200640 1 -- 172.21.15.59:0/4182997598 shutdown_connections 2024-04-25T09:03:19.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.771+0000 7fd3c1200640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd398066f60 0x7fd398069420 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.771+0000 7fd3c1200640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3bc15daf0 0x7fd3bc0b4000 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.771+0000 7fd3c1200640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3bc0cf9f0 0x7fd3bc0ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.771+0000 7fd3c1200640 1 --2- 172.21.15.59:0/4182997598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3bc06ac10 0x7fd3bc0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.771+0000 7fd3c1200640 1 -- 172.21.15.59:0/4182997598 >> 172.21.15.59:0/4182997598 conn(0x7fd3bc099a60 msgr2=0x7fd3bc06e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.771+0000 7fd3c1200640 1 -- 172.21.15.59:0/4182997598 shutdown_connections 2024-04-25T09:03:19.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.771+0000 7fd3c1200640 1 -- 172.21.15.59:0/4182997598 wait complete. 2024-04-25T09:03:19.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:19.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f0726800640 1 Processor -- start 2024-04-25T09:03:19.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f0726800640 1 -- start start 2024-04-25T09:03:19.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f0726800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07200cef30 0x7f072006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f0726800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f072006e900 0x7f07200b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f0726800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f072015ac60 con 0x7f0720144140 2024-04-25T09:03:19.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f0726800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f072006ed30 con 0x7f072006e900 2024-04-25T09:03:19.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f0726800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07200cf3e0 con 0x7f07200cef30 2024-04-25T09:03:19.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f071fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f072006e900 0x7f07200b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f071fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f072006e900 0x7f07200b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51582/0 (socket says 172.21.15.59:51582) 2024-04-25T09:03:19.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f071fe00640 1 -- 172.21.15.59:0/621383238 learned_addr learned my addr 172.21.15.59:0/621383238 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:19.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f0716a00640 1 --2- 172.21.15.59:0/621383238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07200cef30 0x7f072006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f071fe00640 1 -- 172.21.15.59:0/621383238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07200cef30 msgr2=0x7f072006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:19.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f071fe00640 1 --2- 172.21.15.59:0/621383238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07200cef30 0x7f072006e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f071fe00640 1 -- 172.21.15.59:0/621383238 >> v1:172.21.15.178:6789/0 conn(0x7f0720144140 legacy=0x7f07200ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.935+0000 7f071fe00640 1 -- 172.21.15.59:0/621383238 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f072015af20 con 0x7f072006e900 2024-04-25T09:03:19.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.939+0000 7f071fe00640 1 --2- 172.21.15.59:0/621383238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072006e900 0x7f07200b0760 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0718009e50 tx=0x7f071801ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec5a46088429c0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.939+0000 7f071ea00640 1 -- 172.21.15.59:0/621383238 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07180a7630 con 0x7f072006e900 2024-04-25T09:03:19.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.939+0000 7f071ea00640 1 -- 172.21.15.59:0/621383238 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07180a77d0 con 0x7f072006e900 2024-04-25T09:03:19.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.939+0000 7f071ea00640 1 -- 172.21.15.59:0/621383238 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07180a7ba0 con 0x7f072006e900 2024-04-25T09:03:19.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.939+0000 7f0726800640 1 -- 172.21.15.59:0/621383238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072006e900 msgr2=0x7f07200b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.939+0000 7f0726800640 1 --2- 172.21.15.59:0/621383238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072006e900 0x7f07200b0760 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0718009e50 tx=0x7f071801ec40 comp rx=0 tx=0).stop 2024-04-25T09:03:19.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.939+0000 7f0726800640 1 -- 172.21.15.59:0/621383238 shutdown_connections 2024-04-25T09:03:19.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.939+0000 7f0726800640 1 --2- 172.21.15.59:0/621383238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f072006e900 0x7f07200b0760 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.939+0000 7f0726800640 1 --2- 172.21.15.59:0/621383238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f07200cef30 0x7f072006e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.939+0000 7f0726800640 1 -- 172.21.15.59:0/621383238 >> 172.21.15.59:0/621383238 conn(0x7f0720066fa0 msgr2=0x7f072006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.939+0000 7f0726800640 1 -- 172.21.15.59:0/621383238 shutdown_connections 2024-04-25T09:03:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.939+0000 7f0726800640 1 -- 172.21.15.59:0/621383238 wait complete. 2024-04-25T09:03:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0726800640 1 Processor -- start 2024-04-25T09:03:19.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0726800640 1 -- start start 2024-04-25T09:03:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0726800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f072006e900 0x7f072013f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0726800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07200cef30 0x7f072014ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0726800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0720144140 0x7f072013d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0726800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072015ba00 con 0x7f07200cef30 2024-04-25T09:03:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0726800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0720144520 con 0x7f072006e900 2024-04-25T09:03:19.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0726800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072015bb80 con 0x7f0720144140 2024-04-25T09:03:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0716a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07200cef30 0x7f072014ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0716a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07200cef30 0x7f072014ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51592/0 (socket says 172.21.15.59:51592) 2024-04-25T09:03:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0716a00640 1 -- 172.21.15.59:0/2099286401 learned_addr learned my addr 172.21.15.59:0/2099286401 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f071f400640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f072006e900 0x7f072013f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f071fe00640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0720144140 0x7f072013d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0716a00640 1 -- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0720144140 msgr2=0x7f072013d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0716a00640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0720144140 0x7f072013d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0716a00640 1 -- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f072006e900 msgr2=0x7f072013f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0716a00640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f072006e900 0x7f072013f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0716a00640 1 -- 172.21.15.59:0/2099286401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0720139af0 con 0x7f07200cef30 2024-04-25T09:03:19.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0716a00640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07200cef30 0x7f072014ac50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f070800e900 tx=0x7f070800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0717e00640 1 -- 172.21.15.59:0/2099286401 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0708017070 con 0x7f07200cef30 2024-04-25T09:03:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0717e00640 1 -- 172.21.15.59:0/2099286401 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070800ca00 con 0x7f07200cef30 2024-04-25T09:03:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0717e00640 1 -- 172.21.15.59:0/2099286401 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070800cdf0 con 0x7f07200cef30 2024-04-25T09:03:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0726800640 1 -- 172.21.15.59:0/2099286401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072013fdf0 con 0x7f07200cef30 2024-04-25T09:03:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.943+0000 7f0726800640 1 -- 172.21.15.59:0/2099286401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07201403b0 con 0x7f07200cef30 2024-04-25T09:03:19.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.947+0000 7f0726800640 1 -- 172.21.15.59:0/2099286401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07200745d0 con 0x7f07200cef30 2024-04-25T09:03:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.947+0000 7f0717e00640 1 -- 172.21.15.59:0/2099286401 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f070801a070 con 0x7f07200cef30 2024-04-25T09:03:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.947+0000 7f0717e00640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f06fc066f60 0x7f06fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:19.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.947+0000 7f0717e00640 1 -- 172.21.15.59:0/2099286401 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7f0708085140 con 0x7f07200cef30 2024-04-25T09:03:19.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.947+0000 7f071f400640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f06fc066f60 0x7f06fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:19.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.947+0000 7f071f400640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f06fc066f60 0x7f06fc069420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f07201f5690 tx=0x7f0710009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:19.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:19.951+0000 7f0717e00640 1 -- 172.21.15.59:0/2099286401 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0708055940 con 0x7f07200cef30 2024-04-25T09:03:20.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.119+0000 7f0726800640 1 -- 172.21.15.59:0/2099286401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0720073a20 con 0x7f07200cef30 2024-04-25T09:03:20.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.119+0000 7f0717e00640 1 -- 172.21.15.59:0/2099286401 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16991 (secure 0 0 0) 0x7f07080599e0 con 0x7f07200cef30 2024-04-25T09:03:20.111 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:20.111 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":41,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:03:09.300265+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:02:47.433966+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-25T09:02:48.612644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.123+0000 7f0726800640 1 -- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f06fc066f60 msgr2=0x7f06fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.123+0000 7f0726800640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f06fc066f60 0x7f06fc069420 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f07201f5690 tx=0x7f0710009040 comp rx=0 tx=0).stop 2024-04-25T09:03:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.123+0000 7f0726800640 1 -- 172.21.15.59:0/2099286401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07200cef30 msgr2=0x7f072014ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.123+0000 7f0726800640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07200cef30 0x7f072014ac50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f070800e900 tx=0x7f070800edc0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.123+0000 7f0726800640 1 -- 172.21.15.59:0/2099286401 shutdown_connections 2024-04-25T09:03:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.123+0000 7f0726800640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f06fc066f60 0x7f06fc069420 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.123+0000 7f0726800640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0720144140 0x7f072013d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.123+0000 7f0726800640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07200cef30 0x7f072014ac50 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.123+0000 7f0726800640 1 --2- 172.21.15.59:0/2099286401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f072006e900 0x7f072013f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.123+0000 7f0726800640 1 -- 172.21.15.59:0/2099286401 >> 172.21.15.59:0/2099286401 conn(0x7f0720066fa0 msgr2=0x7f072015cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.123+0000 7f0726800640 1 -- 172.21.15.59:0/2099286401 shutdown_connections 2024-04-25T09:03:20.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.123+0000 7f0726800640 1 -- 172.21.15.59:0/2099286401 wait complete. 2024-04-25T09:03:20.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:03:20.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb4da00640 1 Processor -- start 2024-04-25T09:03:20.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb4da00640 1 -- start start 2024-04-25T09:03:20.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb4da00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdb4809a170 0x7fdb480d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb4da00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb4806bf30 0x7fdb480cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb4da00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4815e040 con 0x7fdb4815dc60 2024-04-25T09:03:20.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb4da00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb480cff80 con 0x7fdb4806bf30 2024-04-25T09:03:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb4da00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb480d0260 con 0x7fdb4809a170 2024-04-25T09:03:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb47400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb4806bf30 0x7fdb480cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb47400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb4806bf30 0x7fdb480cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51606/0 (socket says 172.21.15.59:51606) 2024-04-25T09:03:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb47400640 1 -- 172.21.15.59:0/2936872928 learned_addr learned my addr 172.21.15.59:0/2936872928 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb3e000640 1 --2- 172.21.15.59:0/2936872928 >> v2:172.21.15.178:3300/0 conn(0x7fdb4809a170 0x7fdb480d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb47400640 1 -- 172.21.15.59:0/2936872928 >> v2:172.21.15.178:3300/0 conn(0x7fdb4809a170 msgr2=0x7fdb480d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb47400640 1 --2- 172.21.15.59:0/2936872928 >> v2:172.21.15.178:3300/0 conn(0x7fdb4809a170 0x7fdb480d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb47400640 1 -- 172.21.15.59:0/2936872928 >> v1:172.21.15.178:6789/0 conn(0x7fdb4815dc60 legacy=0x7fdb48099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb47400640 1 -- 172.21.15.59:0/2936872928 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb480d0540 con 0x7fdb4806bf30 2024-04-25T09:03:20.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.283+0000 7fdb3e000640 1 --2- 172.21.15.59:0/2936872928 >> v2:172.21.15.178:3300/0 conn(0x7fdb4809a170 0x7fdb480d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:20.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb47400640 1 --2- 172.21.15.59:0/2936872928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb4806bf30 0x7fdb480cf8a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdb480d2810 tx=0x7fdb4001c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36351d3e59522a78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb46000640 1 -- 172.21.15.59:0/2936872928 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400a5720 con 0x7fdb4806bf30 2024-04-25T09:03:20.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb46000640 1 -- 172.21.15.59:0/2936872928 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb400a58c0 con 0x7fdb4806bf30 2024-04-25T09:03:20.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb46000640 1 -- 172.21.15.59:0/2936872928 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400a5c90 con 0x7fdb4806bf30 2024-04-25T09:03:20.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb4da00640 1 -- 172.21.15.59:0/2936872928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb4806bf30 msgr2=0x7fdb480cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb4da00640 1 --2- 172.21.15.59:0/2936872928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb4806bf30 0x7fdb480cf8a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fdb480d2810 tx=0x7fdb4001c860 comp rx=0 tx=0).stop 2024-04-25T09:03:20.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb4da00640 1 -- 172.21.15.59:0/2936872928 shutdown_connections 2024-04-25T09:03:20.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb4da00640 1 --2- 172.21.15.59:0/2936872928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb4806bf30 0x7fdb480cf8a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb4da00640 1 --2- 172.21.15.59:0/2936872928 >> v2:172.21.15.178:3300/0 conn(0x7fdb4809a170 0x7fdb480d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb4da00640 1 -- 172.21.15.59:0/2936872928 >> 172.21.15.59:0/2936872928 conn(0x7fdb480b3200 msgr2=0x7fdb480b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb4da00640 1 -- 172.21.15.59:0/2936872928 shutdown_connections 2024-04-25T09:03:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb4da00640 1 -- 172.21.15.59:0/2936872928 wait complete. 2024-04-25T09:03:20.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb4da00640 1 Processor -- start 2024-04-25T09:03:20.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.287+0000 7fdb4da00640 1 -- start start 2024-04-25T09:03:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb4da00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb4806bf30 0x7fdb48157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb4da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb4809a170 0x7fdb480ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb4da00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb4815dc60 0x7fdb480caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb4da00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480cc6f0 con 0x7fdb4809a170 2024-04-25T09:03:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb4da00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480cc570 con 0x7fdb4806bf30 2024-04-25T09:03:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb4da00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb480cc870 con 0x7fdb4815dc60 2024-04-25T09:03:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb4809a170 0x7fdb480ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb4809a170 0x7fdb480ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51616/0 (socket says 172.21.15.59:51616) 2024-04-25T09:03:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3e000640 1 -- 172.21.15.59:0/4166218696 learned_addr learned my addr 172.21.15.59:0/4166218696 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb47400640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb4815dc60 0x7fdb480caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb46a00640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb4806bf30 0x7fdb48157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3e000640 1 -- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb4815dc60 msgr2=0x7fdb480caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3e000640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb4815dc60 0x7fdb480caee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3e000640 1 -- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb4806bf30 msgr2=0x7fdb48157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3e000640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb4806bf30 0x7fdb48157870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3e000640 1 -- 172.21.15.59:0/4166218696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48158730 con 0x7fdb4809a170 2024-04-25T09:03:20.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3e000640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb4809a170 0x7fdb480ca140 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c7c0 tx=0x7fdb3000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3f400640 1 -- 172.21.15.59:0/4166218696 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb30007a30 con 0x7fdb4809a170 2024-04-25T09:03:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3f400640 1 -- 172.21.15.59:0/4166218696 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb30007bd0 con 0x7fdb4809a170 2024-04-25T09:03:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3f400640 1 -- 172.21.15.59:0/4166218696 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb300113f0 con 0x7fdb4809a170 2024-04-25T09:03:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb4da00640 1 -- 172.21.15.59:0/4166218696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb48158170 con 0x7fdb4809a170 2024-04-25T09:03:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb4da00640 1 -- 172.21.15.59:0/4166218696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb48153a80 con 0x7fdb4809a170 2024-04-25T09:03:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb4da00640 1 -- 172.21.15.59:0/4166218696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb480745d0 con 0x7fdb4809a170 2024-04-25T09:03:20.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.291+0000 7fdb3f400640 1 -- 172.21.15.59:0/4166218696 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdb30011590 con 0x7fdb4809a170 2024-04-25T09:03:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.295+0000 7fdb3f400640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb24066f60 0x7fdb24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.295+0000 7fdb3f400640 1 -- 172.21.15.59:0/4166218696 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6130+0+0 (secure 0 0 0) 0x7fdb30085350 con 0x7fdb4809a170 2024-04-25T09:03:20.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.295+0000 7fdb46a00640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb24066f60 0x7fdb24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.295+0000 7fdb46a00640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb24066f60 0x7fdb24069420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdb38003d60 tx=0x7fdb38009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.299+0000 7fdb3f400640 1 -- 172.21.15.59:0/4166218696 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdb30015020 con 0x7fdb4809a170 2024-04-25T09:03:20.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.495+0000 7fdb4da00640 1 -- 172.21.15.59:0/4166218696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdb480b7590 con 0x7fdb4809a170 2024-04-25T09:03:20.486 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:03:20.495+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:03:20.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb3f400640 1 -- 172.21.15.59:0/4166218696 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdb30056240 con 0x7fdb4809a170 2024-04-25T09:03:20.489 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:03:20.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb4da00640 1 -- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb24066f60 msgr2=0x7fdb24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb4da00640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb24066f60 0x7fdb24069420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdb38003d60 tx=0x7fdb38009040 comp rx=0 tx=0).stop 2024-04-25T09:03:20.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb4da00640 1 -- 172.21.15.59:0/4166218696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb4809a170 msgr2=0x7fdb480ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb4da00640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb4809a170 0x7fdb480ca140 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdb3000c7c0 tx=0x7fdb3000cc80 comp rx=0 tx=0).stop 2024-04-25T09:03:20.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb4da00640 1 -- 172.21.15.59:0/4166218696 shutdown_connections 2024-04-25T09:03:20.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb4da00640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb24066f60 0x7fdb24069420 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb4da00640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb4815dc60 0x7fdb480caee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb4da00640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb4809a170 0x7fdb480ca140 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb4da00640 1 --2- 172.21.15.59:0/4166218696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb4806bf30 0x7fdb48157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb4da00640 1 -- 172.21.15.59:0/4166218696 >> 172.21.15.59:0/4166218696 conn(0x7fdb480b3200 msgr2=0x7fdb480b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb4da00640 1 -- 172.21.15.59:0/4166218696 shutdown_connections 2024-04-25T09:03:20.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.499+0000 7fdb4da00640 1 -- 172.21.15.59:0/4166218696 wait complete. 2024-04-25T09:03:20.503 INFO:tasks.ceph.mds.a.smithi059.stderr: -6679> 2024-04-25T09:02:52.187+0000 7f3895600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:03:20.513 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:03:20.556 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:03:20.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f1812200640 1 Processor -- start 2024-04-25T09:03:20.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f1812200640 1 -- start start 2024-04-25T09:03:20.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f1812200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f180c144120 0x7f180c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f1812200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f180c0b3090 0x7f180c0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f1812200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c15bc40 con 0x7f180c0ccbf0 2024-04-25T09:03:20.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f1812200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c15e490 con 0x7f180c0b3090 2024-04-25T09:03:20.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f1812200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c15b3a0 con 0x7f180c144120 2024-04-25T09:03:20.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f180be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f180c0b3090 0x7f180c0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f1802a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f180c0ccbf0 0x7f180c15e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46670/0 (socket says 172.21.15.59:46670) 2024-04-25T09:03:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f1802a00640 1 -- 172.21.15.59:0/868536414 learned_addr learned my addr 172.21.15.59:0/868536414 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f180b400640 1 --2- 172.21.15.59:0/868536414 >> v2:172.21.15.178:3300/0 conn(0x7f180c144120 0x7f180c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f180be00640 1 -- 172.21.15.59:0/868536414 >> v2:172.21.15.178:3300/0 conn(0x7f180c144120 msgr2=0x7f180c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f180be00640 1 --2- 172.21.15.59:0/868536414 >> v2:172.21.15.178:3300/0 conn(0x7f180c144120 0x7f180c15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f180be00640 1 -- 172.21.15.59:0/868536414 >> v1:172.21.15.59:6789/0 conn(0x7f180c0ccbf0 legacy=0x7f180c15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f180be00640 1 -- 172.21.15.59:0/868536414 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c15b680 con 0x7f180c0b3090 2024-04-25T09:03:20.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.671+0000 7f180aa00640 1 -- 172.21.15.59:0/868536414 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886503615 0 0) 0x7f180c15bc40 con 0x7f180c0ccbf0 2024-04-25T09:03:20.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.675+0000 7f180be00640 1 --2- 172.21.15.59:0/868536414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f180c0b3090 0x7f180c0b3520 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f180c06b9b0 tx=0x7f180401c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2dad7108f525082 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.675+0000 7f180aa00640 1 -- 172.21.15.59:0/868536414 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040b2070 con 0x7f180c0b3090 2024-04-25T09:03:20.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.675+0000 7f180aa00640 1 -- 172.21.15.59:0/868536414 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18040a57b0 con 0x7f180c0b3090 2024-04-25T09:03:20.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.675+0000 7f180aa00640 1 -- 172.21.15.59:0/868536414 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040a5b80 con 0x7f180c0b3090 2024-04-25T09:03:20.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.675+0000 7f1812200640 1 -- 172.21.15.59:0/868536414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f180c0b3090 msgr2=0x7f180c0b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.675+0000 7f1812200640 1 --2- 172.21.15.59:0/868536414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f180c0b3090 0x7f180c0b3520 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f180c06b9b0 tx=0x7f180401c8a0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.675+0000 7f1812200640 1 -- 172.21.15.59:0/868536414 shutdown_connections 2024-04-25T09:03:20.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.675+0000 7f1812200640 1 --2- 172.21.15.59:0/868536414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f180c0b3090 0x7f180c0b3520 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.675+0000 7f1812200640 1 --2- 172.21.15.59:0/868536414 >> v2:172.21.15.178:3300/0 conn(0x7f180c144120 0x7f180c15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.675+0000 7f1812200640 1 -- 172.21.15.59:0/868536414 >> 172.21.15.59:0/868536414 conn(0x7f180c067080 msgr2=0x7f180c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:20.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.675+0000 7f1812200640 1 -- 172.21.15.59:0/868536414 shutdown_connections 2024-04-25T09:03:20.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.675+0000 7f1812200640 1 -- 172.21.15.59:0/868536414 wait complete. 2024-04-25T09:03:20.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1812200640 1 Processor -- start 2024-04-25T09:03:20.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1812200640 1 -- start start 2024-04-25T09:03:20.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1812200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f180c0b3090 0x7f180c159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1812200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f180c0ccbf0 0x7f180c13d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1812200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f180c144120 0x7f180c0ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1812200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c1675c0 con 0x7f180c144120 2024-04-25T09:03:20.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1812200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c167440 con 0x7f180c0b3090 2024-04-25T09:03:20.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1812200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c167740 con 0x7f180c0ccbf0 2024-04-25T09:03:20.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f180be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f180c144120 0x7f180c0ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f180be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f180c144120 0x7f180c0ad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45896/0 (socket says 172.21.15.59:45896) 2024-04-25T09:03:20.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f180be00640 1 -- 172.21.15.59:0/821488839 learned_addr learned my addr 172.21.15.59:0/821488839 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f180b400640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f180c0b3090 0x7f180c159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1802a00640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f180c0ccbf0 0x7f180c13d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f180be00640 1 -- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f180c0ccbf0 msgr2=0x7f180c13d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f180be00640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f180c0ccbf0 0x7f180c13d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f180be00640 1 -- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f180c0b3090 msgr2=0x7f180c159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f180be00640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f180c0b3090 0x7f180c159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f180be00640 1 -- 172.21.15.59:0/821488839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c13e2a0 con 0x7f180c144120 2024-04-25T09:03:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f180b400640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f180c0b3090 0x7f180c159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1802a00640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f180c0ccbf0 0x7f180c13d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:20.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f180be00640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f180c144120 0x7f180c0ad920 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f18040b0040 tx=0x7f1804019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1803e00640 1 -- 172.21.15.59:0/821488839 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040bd020 con 0x7f180c144120 2024-04-25T09:03:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1803e00640 1 -- 172.21.15.59:0/821488839 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18040b8670 con 0x7f180c144120 2024-04-25T09:03:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1812200640 1 -- 172.21.15.59:0/821488839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c13e580 con 0x7f180c144120 2024-04-25T09:03:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1803e00640 1 -- 172.21.15.59:0/821488839 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040b2040 con 0x7f180c144120 2024-04-25T09:03:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1812200640 1 -- 172.21.15.59:0/821488839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c13eb40 con 0x7f180c144120 2024-04-25T09:03:20.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.679+0000 7f1812200640 1 -- 172.21.15.59:0/821488839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f180c0745d0 con 0x7f180c144120 2024-04-25T09:03:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.683+0000 7f1803e00640 1 -- 172.21.15.59:0/821488839 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f18040c0020 con 0x7f180c144120 2024-04-25T09:03:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.683+0000 7f1803e00640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f17e8066f60 0x7f17e8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.683+0000 7f1803e00640 1 -- 172.21.15.59:0/821488839 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6216+0+0 (secure 0 0 0) 0x7f1804120150 con 0x7f180c144120 2024-04-25T09:03:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.683+0000 7f180b400640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f17e8066f60 0x7f17e8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.683+0000 7f180b400640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f17e8066f60 0x7f17e8069420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0097a0 tx=0x7f17fc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:20.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.687+0000 7f1803e00640 1 -- 172.21.15.59:0/821488839 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f18040c7030 con 0x7f180c144120 2024-04-25T09:03:20.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:20.891+0000 7f1812200640 1 -- 172.21.15.59:0/821488839 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f180c1651f0 con 0x7f180c144120 2024-04-25T09:03:21.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.499+0000 7f1803e00640 1 -- 172.21.15.59:0/821488839 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1804016520 con 0x7f180c144120 2024-04-25T09:03:21.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.503+0000 7f1812200640 1 -- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f17e8066f60 msgr2=0x7f17e8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.503+0000 7f1812200640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f17e8066f60 0x7f17e8069420 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0097a0 tx=0x7f17fc008040 comp rx=0 tx=0).stop 2024-04-25T09:03:21.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.503+0000 7f1812200640 1 -- 172.21.15.59:0/821488839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f180c144120 msgr2=0x7f180c0ad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.503+0000 7f1812200640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f180c144120 0x7f180c0ad920 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f18040b0040 tx=0x7f1804019640 comp rx=0 tx=0).stop 2024-04-25T09:03:21.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.503+0000 7f1812200640 1 -- 172.21.15.59:0/821488839 shutdown_connections 2024-04-25T09:03:21.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.503+0000 7f1812200640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f17e8066f60 0x7f17e8069420 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.503+0000 7f1812200640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f180c144120 0x7f180c0ad920 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.503+0000 7f1812200640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f180c0ccbf0 0x7f180c13d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.503+0000 7f1812200640 1 --2- 172.21.15.59:0/821488839 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f180c0b3090 0x7f180c159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.503+0000 7f1812200640 1 -- 172.21.15.59:0/821488839 >> 172.21.15.59:0/821488839 conn(0x7f180c067080 msgr2=0x7f180c141150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:21.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.503+0000 7f1812200640 1 -- 172.21.15.59:0/821488839 shutdown_connections 2024-04-25T09:03:21.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.503+0000 7f1812200640 1 -- 172.21.15.59:0/821488839 wait complete. 2024-04-25T09:03:21.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:03:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.715+0000 7fc8aa800640 1 Processor -- start 2024-04-25T09:03:21.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.715+0000 7fc8aa800640 1 -- start start 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8aa800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a40713c0 0x7fc8a40b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8aa800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a415de90 con 0x7fc8a40b0c00 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8aa800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8a4071a70 con 0x7fc8a415dab0 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8aa800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40b57a0 con 0x7fc8a40713c0 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc8a40b0c00 0x7fc8a406c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46674/0 (socket says 172.21.15.59:46674) 2024-04-25T09:03:21.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a3e00640 1 -- 172.21.15.59:0/1814066140 learned_addr learned my addr 172.21.15.59:0/1814066140 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:21.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc89be00640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a40713c0 0x7fc8a40b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748833458 0 0) 0x7fc8a415de90 con 0x7fc8a40b0c00 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc888003530 con 0x7fc8a40b0c00 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 621056227 0 0) 0x7fc888003530 con 0x7fc8a40b0c00 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a40713c0 msgr2=0x7fc8a40b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a40713c0 0x7fc8a40b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 >> v1:172.21.15.178:6789/0 conn(0x7fc8a415dab0 legacy=0x7fc8a4070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a406bec0 con 0x7fc8a40b0c00 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fc89c001a00 con 0x7fc8a40b0c00 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 >> v1:172.21.15.59:6789/0 conn(0x7fc8a40b0c00 legacy=0x7fc8a406c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8880039f0 0x7fc888003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc888004810 0x7fc888004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a40713c0 0x7fc8880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40b57a0 con 0x7fc8880039f0 2024-04-25T09:03:21.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88800ba80 con 0x7fc888004810 2024-04-25T09:03:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88800bc80 con 0x7fc8a40713c0 2024-04-25T09:03:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a3400640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8880039f0 0x7fc888003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc89be00640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc888004810 0x7fc888004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a3e00640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a40713c0 0x7fc8880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a3400640 1 -- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a40713c0 msgr2=0x7fc8880051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a3400640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a40713c0 0x7fc8880051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a3400640 1 -- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc888004810 msgr2=0x7fc888004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a3400640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc888004810 0x7fc888004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a3400640 1 -- 172.21.15.59:0/1814066140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888003530 con 0x7fc8880039f0 2024-04-25T09:03:21.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc8a3e00640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a40713c0 0x7fc8880051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:21.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.719+0000 7fc89be00640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc888004810 0x7fc888004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8a3400640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8880039f0 0x7fc888003e10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4071c40 tx=0x7fc89401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4643c9377f90df37 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8940013a0 con 0x7fc8880039f0 2024-04-25T09:03:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8940052d0 con 0x7fc8880039f0 2024-04-25T09:03:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8a2a00640 1 -- 172.21.15.59:0/1814066140 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894003820 con 0x7fc8880039f0 2024-04-25T09:03:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8aa800640 1 -- 172.21.15.59:0/1814066140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8880039f0 msgr2=0x7fc888003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8aa800640 1 --2- 172.21.15.59:0/1814066140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8880039f0 0x7fc888003e10 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4071c40 tx=0x7fc89401c370 comp rx=0 tx=0).stop 2024-04-25T09:03:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8a3e00640 1 -- 172.21.15.59:0/1814066140 reap_dead start 2024-04-25T09:03:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8aa800640 1 -- 172.21.15.59:0/1814066140 shutdown_connections 2024-04-25T09:03:21.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8aa800640 1 -- 172.21.15.59:0/1814066140 >> 172.21.15.59:0/1814066140 conn(0x7fc8a406f510 msgr2=0x7fc8a406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:21.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8aa800640 1 -- 172.21.15.59:0/1814066140 shutdown_connections 2024-04-25T09:03:21.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8aa800640 1 -- 172.21.15.59:0/1814066140 wait complete. 2024-04-25T09:03:21.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8aa800640 1 Processor -- start 2024-04-25T09:03:21.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.723+0000 7fc8aa800640 1 -- start start 2024-04-25T09:03:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8aa800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8880039f0 0x7fc8a415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8aa800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a414a3a0 0x7fc8a415a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8aa800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a41606b0 0x7fc8a40cf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8aa800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a406dc50 con 0x7fc8880039f0 2024-04-25T09:03:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8aa800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a406dad0 con 0x7fc8a41606b0 2024-04-25T09:03:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8aa800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a40b5520 con 0x7fc8a414a3a0 2024-04-25T09:03:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8a3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8880039f0 0x7fc8a415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8a3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8880039f0 0x7fc8a415efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45914/0 (socket says 172.21.15.59:45914) 2024-04-25T09:03:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8a3400640 1 -- 172.21.15.59:0/1209215910 learned_addr learned my addr 172.21.15.59:0/1209215910 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc89be00640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a414a3a0 0x7fc8a415a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8a3e00640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a41606b0 0x7fc8a40cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8a3400640 1 -- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a414a3a0 msgr2=0x7fc8a415a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8a3400640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a414a3a0 0x7fc8a415a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8a3400640 1 -- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a41606b0 msgr2=0x7fc8a40cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8a3400640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a41606b0 0x7fc8a40cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:21.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8a3400640 1 -- 172.21.15.59:0/1209215910 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a415f8f0 con 0x7fc8880039f0 2024-04-25T09:03:21.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8a3e00640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a41606b0 0x7fc8a40cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:21.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8a3400640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8880039f0 0x7fc8a415efc0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc894005040 tx=0x7fc888005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc89b400640 1 -- 172.21.15.59:0/1209215910 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8940013a0 con 0x7fc8880039f0 2024-04-25T09:03:21.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc89b400640 1 -- 172.21.15.59:0/1209215910 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc894005480 con 0x7fc8880039f0 2024-04-25T09:03:21.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8aa800640 1 -- 172.21.15.59:0/1209215910 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a415fbd0 con 0x7fc8880039f0 2024-04-25T09:03:21.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc89b400640 1 -- 172.21.15.59:0/1209215910 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc894007a60 con 0x7fc8880039f0 2024-04-25T09:03:21.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8aa800640 1 -- 172.21.15.59:0/1209215910 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a4160190 con 0x7fc8880039f0 2024-04-25T09:03:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc8aa800640 1 -- 172.21.15.59:0/1209215910 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a40745d0 con 0x7fc8880039f0 2024-04-25T09:03:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.727+0000 7fc89b400640 1 -- 172.21.15.59:0/1209215910 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc8940067e0 con 0x7fc8880039f0 2024-04-25T09:03:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.731+0000 7fc89b400640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc880066f90 0x7fc880069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.731+0000 7fc89b400640 1 -- 172.21.15.59:0/1209215910 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6216+0+0 (secure 0 0 0) 0x7fc89411fca0 con 0x7fc8880039f0 2024-04-25T09:03:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.731+0000 7fc89be00640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc880066f90 0x7fc880069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:21.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.731+0000 7fc89be00640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc880066f90 0x7fc880069450 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40d00e0 tx=0x7fc88c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:21.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.735+0000 7fc89b400640 1 -- 172.21.15.59:0/1209215910 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc8940160b0 con 0x7fc8880039f0 2024-04-25T09:03:21.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:21.899+0000 7fc8aa800640 1 -- 172.21.15.59:0/1209215910 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc8a40745d0 con 0x7fc8880039f0 2024-04-25T09:03:22.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.503+0000 7fc89b400640 1 -- 172.21.15.59:0/1209215910 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc8940f0bc0 con 0x7fc8880039f0 2024-04-25T09:03:22.494 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:03:22.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.503+0000 7fc8aa800640 1 -- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc880066f90 msgr2=0x7fc880069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.503+0000 7fc8aa800640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc880066f90 0x7fc880069450 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc8a40d00e0 tx=0x7fc88c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:22.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.503+0000 7fc8aa800640 1 -- 172.21.15.59:0/1209215910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8880039f0 msgr2=0x7fc8a415efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.503+0000 7fc8aa800640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8880039f0 0x7fc8a415efc0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc894005040 tx=0x7fc888005840 comp rx=0 tx=0).stop 2024-04-25T09:03:22.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.503+0000 7fc8aa800640 1 -- 172.21.15.59:0/1209215910 shutdown_connections 2024-04-25T09:03:22.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.503+0000 7fc8aa800640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc880066f90 0x7fc880069450 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.503+0000 7fc8aa800640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8a41606b0 0x7fc8a40cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.503+0000 7fc8aa800640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8a414a3a0 0x7fc8a415a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.503+0000 7fc8aa800640 1 --2- 172.21.15.59:0/1209215910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8880039f0 0x7fc8a415efc0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.503+0000 7fc8aa800640 1 -- 172.21.15.59:0/1209215910 >> 172.21.15.59:0/1209215910 conn(0x7fc8a406f510 msgr2=0x7fc8a41ecc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:22.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.507+0000 7fc8aa800640 1 -- 172.21.15.59:0/1209215910 shutdown_connections 2024-04-25T09:03:22.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.507+0000 7fc8aa800640 1 -- 172.21.15.59:0/1209215910 wait complete. 2024-04-25T09:03:22.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:03:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.679+0000 7f6bcd600640 1 Processor -- start 2024-04-25T09:03:22.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.679+0000 7f6bcd600640 1 -- start start 2024-04-25T09:03:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.679+0000 7f6bcd600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bc8071e40 0x7f6bc806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.679+0000 7f6bcd600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6bc806e900 0x7f6bc815e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.679+0000 7f6bcd600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc80cf490 con 0x7f6bc8144080 2024-04-25T09:03:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.679+0000 7f6bcd600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc80719b0 con 0x7f6bc806e900 2024-04-25T09:03:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.679+0000 7f6bcd600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80cf1b0 con 0x7f6bc8071e40 2024-04-25T09:03:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.679+0000 7f6bc7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6bc806e900 0x7f6bc815e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.679+0000 7f6bc7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6bc806e900 0x7f6bc815e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45922/0 (socket says 172.21.15.59:45922) 2024-04-25T09:03:22.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.679+0000 7f6bc7400640 1 -- 172.21.15.59:0/661747297 learned_addr learned my addr 172.21.15.59:0/661747297 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.679+0000 7f6bbe000640 1 --2- 172.21.15.59:0/661747297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bc8071e40 0x7f6bc806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bc7400640 1 -- 172.21.15.59:0/661747297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bc8071e40 msgr2=0x7f6bc806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bc7400640 1 --2- 172.21.15.59:0/661747297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bc8071e40 0x7f6bc806e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bc7400640 1 -- 172.21.15.59:0/661747297 >> v1:172.21.15.178:6789/0 conn(0x7f6bc8144080 legacy=0x7f6bc80ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bc7400640 1 -- 172.21.15.59:0/661747297 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc8071360 con 0x7f6bc806e900 2024-04-25T09:03:22.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bbe000640 1 --2- 172.21.15.59:0/661747297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bc8071e40 0x7f6bc806e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bc7400640 1 --2- 172.21.15.59:0/661747297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e900 0x7f6bc815e200 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009e50 tx=0x7f6bc001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a538e303def172 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bc6000640 1 -- 172.21.15.59:0/661747297 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00a57d0 con 0x7f6bc806e900 2024-04-25T09:03:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bc6000640 1 -- 172.21.15.59:0/661747297 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bc00a5970 con 0x7f6bc806e900 2024-04-25T09:03:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bc6000640 1 -- 172.21.15.59:0/661747297 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bc00a5d40 con 0x7f6bc806e900 2024-04-25T09:03:22.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bcd600640 1 -- 172.21.15.59:0/661747297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e900 msgr2=0x7f6bc815e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bcd600640 1 --2- 172.21.15.59:0/661747297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e900 0x7f6bc815e200 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009e50 tx=0x7f6bc001ca30 comp rx=0 tx=0).stop 2024-04-25T09:03:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bcd600640 1 -- 172.21.15.59:0/661747297 shutdown_connections 2024-04-25T09:03:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bcd600640 1 --2- 172.21.15.59:0/661747297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e900 0x7f6bc815e200 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bcd600640 1 --2- 172.21.15.59:0/661747297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bc8071e40 0x7f6bc806e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bcd600640 1 -- 172.21.15.59:0/661747297 >> 172.21.15.59:0/661747297 conn(0x7f6bc806ac10 msgr2=0x7f6bc806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:22.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bcd600640 1 -- 172.21.15.59:0/661747297 shutdown_connections 2024-04-25T09:03:22.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.683+0000 7f6bcd600640 1 -- 172.21.15.59:0/661747297 wait complete. 2024-04-25T09:03:22.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bcd600640 1 Processor -- start 2024-04-25T09:03:22.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bcd600640 1 -- start start 2024-04-25T09:03:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bcd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e900 0x7f6bc815cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bcd600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8071e40 0x7f6bc815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bcd600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bc8144080 0x7f6bc813a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bcd600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80ceef0 con 0x7f6bc806e900 2024-04-25T09:03:22.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bcd600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80ced70 con 0x7f6bc8071e40 2024-04-25T09:03:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bcd600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc81675a0 con 0x7f6bc8144080 2024-04-25T09:03:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bc6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e900 0x7f6bc815cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bc6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e900 0x7f6bc815cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45928/0 (socket says 172.21.15.59:45928) 2024-04-25T09:03:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bc6a00640 1 -- 172.21.15.59:0/2343026720 learned_addr learned my addr 172.21.15.59:0/2343026720 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bbe000640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8071e40 0x7f6bc815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bc7400640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bc8144080 0x7f6bc813a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bc6a00640 1 -- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bc8144080 msgr2=0x7f6bc813a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bc6a00640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bc8144080 0x7f6bc813a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bc6a00640 1 -- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8071e40 msgr2=0x7f6bc815c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:22.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bc6a00640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8071e40 0x7f6bc815c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:22.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bc6a00640 1 -- 172.21.15.59:0/2343026720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc815cd70 con 0x7f6bc806e900 2024-04-25T09:03:22.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bc6a00640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e900 0x7f6bc815cfa0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800c370 tx=0x7f6bb800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:22.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bbf400640 1 -- 172.21.15.59:0/2343026720 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb80052d0 con 0x7f6bc806e900 2024-04-25T09:03:22.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bbf400640 1 -- 172.21.15.59:0/2343026720 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8005470 con 0x7f6bc806e900 2024-04-25T09:03:22.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bbf400640 1 -- 172.21.15.59:0/2343026720 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8007260 con 0x7f6bc806e900 2024-04-25T09:03:22.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.687+0000 7f6bcd600640 1 -- 172.21.15.59:0/2343026720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc81393f0 con 0x7f6bc806e900 2024-04-25T09:03:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.691+0000 7f6bcd600640 1 -- 172.21.15.59:0/2343026720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc81384d0 con 0x7f6bc806e900 2024-04-25T09:03:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.691+0000 7f6bcd600640 1 -- 172.21.15.59:0/2343026720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc80745d0 con 0x7f6bc806e900 2024-04-25T09:03:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.691+0000 7f6bbf400640 1 -- 172.21.15.59:0/2343026720 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6bb8007400 con 0x7f6bc806e900 2024-04-25T09:03:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.691+0000 7f6bbf400640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ba4066f60 0x7f6ba4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.691+0000 7f6bbf400640 1 -- 172.21.15.59:0/2343026720 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5778+0+0 (secure 0 0 0) 0x7f6bb8084440 con 0x7f6bc806e900 2024-04-25T09:03:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.691+0000 7f6bbe000640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ba4066f60 0x7f6ba4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:22.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.691+0000 7f6bbe000640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ba4066f60 0x7f6ba4069420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6bc813bb50 tx=0x7f6bb0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:22.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.695+0000 7f6bbf400640 1 -- 172.21.15.59:0/2343026720 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6bb8054da0 con 0x7f6bc806e900 2024-04-25T09:03:22.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:22.791 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:22.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:22.863+0000 7f6bcd600640 1 -- 172.21.15.59:0/2343026720 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6bc813cdd0 con 0x7f6bc806e900 2024-04-25T09:03:23.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.507+0000 7f6bbf400640 1 -- 172.21.15.59:0/2343026720 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7f6bb8058e40 con 0x7f6bc806e900 2024-04-25T09:03:23.500 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-04-25T09:03:23.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.515+0000 7f6bcd600640 1 -- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ba4066f60 msgr2=0x7f6ba4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.515+0000 7f6bcd600640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ba4066f60 0x7f6ba4069420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f6bc813bb50 tx=0x7f6bb0008040 comp rx=0 tx=0).stop 2024-04-25T09:03:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.515+0000 7f6bcd600640 1 -- 172.21.15.59:0/2343026720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e900 msgr2=0x7f6bc815cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.515+0000 7f6bcd600640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e900 0x7f6bc815cfa0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800c370 tx=0x7f6bb800c830 comp rx=0 tx=0).stop 2024-04-25T09:03:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.515+0000 7f6bcd600640 1 -- 172.21.15.59:0/2343026720 shutdown_connections 2024-04-25T09:03:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.515+0000 7f6bcd600640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ba4066f60 0x7f6ba4069420 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.515+0000 7f6bcd600640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6bc8144080 0x7f6bc813a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.515+0000 7f6bcd600640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6bc8071e40 0x7f6bc815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.515+0000 7f6bcd600640 1 --2- 172.21.15.59:0/2343026720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e900 0x7f6bc815cfa0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.515+0000 7f6bcd600640 1 -- 172.21.15.59:0/2343026720 >> 172.21.15.59:0/2343026720 conn(0x7f6bc806ac10 msgr2=0x7f6bc8163950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.515+0000 7f6bcd600640 1 -- 172.21.15.59:0/2343026720 shutdown_connections 2024-04-25T09:03:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.515+0000 7f6bcd600640 1 -- 172.21.15.59:0/2343026720 wait complete. 2024-04-25T09:03:23.531 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:03:23.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.735+0000 7f09f3200640 1 Processor -- start 2024-04-25T09:03:23.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.735+0000 7f09f3200640 1 -- start start 2024-04-25T09:03:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.739+0000 7f09f3200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f09ec0cf3c0 0x7f09ec0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.739+0000 7f09f3200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ec0d02a0 con 0x7f09ec0cd370 2024-04-25T09:03:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.739+0000 7f09f3200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ec0cc350 con 0x7f09ec15b910 2024-04-25T09:03:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.739+0000 7f09f3200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ec0cc630 con 0x7f09ec0cf3c0 2024-04-25T09:03:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.739+0000 7f09f1200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f09ec0cd370 0x7f09ec099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46684/0 (socket says 172.21.15.59:46684) 2024-04-25T09:03:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.739+0000 7f09f1200640 1 -- 172.21.15.59:0/2963127475 learned_addr learned my addr 172.21.15.59:0/2963127475 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.739+0000 7f09eb400640 1 --2- 172.21.15.59:0/2963127475 >> v2:172.21.15.178:3300/0 conn(0x7f09ec0cf3c0 0x7f09ec0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.739+0000 7f09eaa00640 1 -- 172.21.15.59:0/2963127475 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386835718 0 0) 0x7f09ec0d02a0 con 0x7f09ec0cd370 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.739+0000 7f09eaa00640 1 -- 172.21.15.59:0/2963127475 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09d0003530 con 0x7f09ec0cd370 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.739+0000 7f09eb400640 1 -- 172.21.15.59:0/2963127475 >> v1:172.21.15.178:6789/0 conn(0x7f09ec15b910 legacy=0x7f09ec0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.739+0000 7f09eb400640 1 -- 172.21.15.59:0/2963127475 >> v1:172.21.15.59:6789/0 conn(0x7f09ec0cd370 legacy=0x7f09ec099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.739+0000 7f09eb400640 1 -- 172.21.15.59:0/2963127475 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec0cc910 con 0x7f09ec0cf3c0 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09eb400640 1 --2- 172.21.15.59:0/2963127475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09ec0cf3c0 0x7f09ec0cce30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0097c0 tx=0x7f09dc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15e554c22eaa5fd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09eaa00640 1 -- 172.21.15.59:0/2963127475 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0b1070 con 0x7f09ec0cf3c0 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09eaa00640 1 -- 172.21.15.59:0/2963127475 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09dc0ac410 con 0x7f09ec0cf3c0 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09eaa00640 1 -- 172.21.15.59:0/2963127475 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09dc0ac7e0 con 0x7f09ec0cf3c0 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09f3200640 1 -- 172.21.15.59:0/2963127475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09ec0cf3c0 msgr2=0x7f09ec0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09f3200640 1 --2- 172.21.15.59:0/2963127475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09ec0cf3c0 0x7f09ec0cce30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f09dc0097c0 tx=0x7f09dc01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09f3200640 1 -- 172.21.15.59:0/2963127475 shutdown_connections 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09f3200640 1 --2- 172.21.15.59:0/2963127475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09ec0cf3c0 0x7f09ec0cce30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09f3200640 1 -- 172.21.15.59:0/2963127475 >> 172.21.15.59:0/2963127475 conn(0x7f09ec0b3200 msgr2=0x7f09ec0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:23.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09f3200640 1 -- 172.21.15.59:0/2963127475 shutdown_connections 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09f3200640 1 -- 172.21.15.59:0/2963127475 wait complete. 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09f3200640 1 Processor -- start 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.743+0000 7f09f3200640 1 -- start start 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f3200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09ec0cd370 0x7f09ec0c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f3200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09ec0cf3c0 0x7f09ec15e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f3200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09ec15b910 0x7f09ec1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f3200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec169b30 con 0x7f09ec15b910 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f3200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec1699b0 con 0x7f09ec0cf3c0 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f3200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ec169cb0 con 0x7f09ec0cd370 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09ec15b910 0x7f09ec1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09ec15b910 0x7f09ec1428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45932/0 (socket says 172.21.15.59:45932) 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f1200640 1 -- 172.21.15.59:0/350239570 learned_addr learned my addr 172.21.15.59:0/350239570 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:23.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09eb400640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09ec0cf3c0 0x7f09ec15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09ebe00640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09ec0cd370 0x7f09ec0c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f1200640 1 -- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09ec0cd370 msgr2=0x7f09ec0c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f1200640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09ec0cd370 0x7f09ec0c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f1200640 1 -- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09ec0cf3c0 msgr2=0x7f09ec15e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f1200640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09ec0cf3c0 0x7f09ec15e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f1200640 1 -- 172.21.15.59:0/350239570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec0c7620 con 0x7f09ec15b910 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09eb400640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09ec0cf3c0 0x7f09ec15e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09ebe00640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09ec0cd370 0x7f09ec0c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f1200640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09ec15b910 0x7f09ec1428a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f09e400cb40 tx=0x7f09e400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09e3e00640 1 -- 172.21.15.59:0/350239570 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4017070 con 0x7f09ec15b910 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09e3e00640 1 -- 172.21.15.59:0/350239570 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e400aca0 con 0x7f09ec15b910 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09e3e00640 1 -- 172.21.15.59:0/350239570 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4012620 con 0x7f09ec15b910 2024-04-25T09:03:23.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f3200640 1 -- 172.21.15.59:0/350239570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ec0c6580 con 0x7f09ec15b910 2024-04-25T09:03:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f3200640 1 -- 172.21.15.59:0/350239570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ec0c6b40 con 0x7f09ec15b910 2024-04-25T09:03:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09f3200640 1 -- 172.21.15.59:0/350239570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ec0745d0 con 0x7f09ec15b910 2024-04-25T09:03:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.747+0000 7f09e3e00640 1 -- 172.21.15.59:0/350239570 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f09e401a070 con 0x7f09ec15b910 2024-04-25T09:03:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.751+0000 7f09e3e00640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09c8066f60 0x7f09c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.751+0000 7f09e3e00640 1 -- 172.21.15.59:0/350239570 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f09e4084d70 con 0x7f09ec15b910 2024-04-25T09:03:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.751+0000 7f09ebe00640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09c8066f60 0x7f09c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.751+0000 7f09ebe00640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09c8066f60 0x7f09c8069420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f09d4000f70 tx=0x7f09d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:23.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.755+0000 7f09e3e00640 1 -- 172.21.15.59:0/350239570 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f09e4055e50 con 0x7f09ec15b910 2024-04-25T09:03:23.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.915+0000 7f09f3200640 1 -- 172.21.15.59:0/350239570 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f09ec0cdcd0 con 0x7f09ec15b910 2024-04-25T09:03:23.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.919+0000 7f09e3e00640 1 -- 172.21.15.59:0/350239570 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f09e4055750 con 0x7f09ec15b910 2024-04-25T09:03:23.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.919+0000 7f09f3200640 1 -- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09c8066f60 msgr2=0x7f09c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.919+0000 7f09f3200640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09c8066f60 0x7f09c8069420 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f09d4000f70 tx=0x7f09d4009040 comp rx=0 tx=0).stop 2024-04-25T09:03:23.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.919+0000 7f09f3200640 1 -- 172.21.15.59:0/350239570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09ec15b910 msgr2=0x7f09ec1428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.919+0000 7f09f3200640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09ec15b910 0x7f09ec1428a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f09e400cb40 tx=0x7f09e400a060 comp rx=0 tx=0).stop 2024-04-25T09:03:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.919+0000 7f09f3200640 1 -- 172.21.15.59:0/350239570 shutdown_connections 2024-04-25T09:03:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.919+0000 7f09f3200640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09c8066f60 0x7f09c8069420 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.919+0000 7f09f3200640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09ec15b910 0x7f09ec1428a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.919+0000 7f09f3200640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09ec0cf3c0 0x7f09ec15e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.919+0000 7f09f3200640 1 --2- 172.21.15.59:0/350239570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09ec0cd370 0x7f09ec0c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.919+0000 7f09f3200640 1 -- 172.21.15.59:0/350239570 >> 172.21.15.59:0/350239570 conn(0x7f09ec0b3200 msgr2=0x7f09ec0cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.923+0000 7f09f3200640 1 -- 172.21.15.59:0/350239570 shutdown_connections 2024-04-25T09:03:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:23.923+0000 7f09f3200640 1 -- 172.21.15.59:0/350239570 wait complete. 2024-04-25T09:03:23.932 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-25T09:03:24.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.079+0000 7f7b46600640 1 Processor -- start 2024-04-25T09:03:24.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.079+0000 7f7b46600640 1 -- start start 2024-04-25T09:03:24.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b46600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7b4015b2f0 0x7f7b400b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b46600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b400b2dc0 0x7f7b400b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b46600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7b4006dad0 0x7f7b4006dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b46600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4015def0 con 0x7f7b4015b2f0 2024-04-25T09:03:24.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b46600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4015e1b0 con 0x7f7b4006dad0 2024-04-25T09:03:24.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b46600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4015e490 con 0x7f7b400b2dc0 2024-04-25T09:03:24.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b3f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7b4015b2f0 0x7f7b400b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b3f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7b4015b2f0 0x7f7b400b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45936/0 (socket says 172.21.15.59:45936) 2024-04-25T09:03:24.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b3f400640 1 -- 172.21.15.59:0/976701961 learned_addr learned my addr 172.21.15.59:0/976701961 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:24.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b36a00640 1 --2- 172.21.15.59:0/976701961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b400b2dc0 0x7f7b400b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b3fe00640 1 --2- 172.21.15.59:0/976701961 >> v2:172.21.15.178:3300/0 conn(0x7f7b4006dad0 0x7f7b4006dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b3f400640 1 -- 172.21.15.59:0/976701961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b400b2dc0 msgr2=0x7f7b400b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:24.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b3f400640 1 --2- 172.21.15.59:0/976701961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b400b2dc0 0x7f7b400b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b3f400640 1 -- 172.21.15.59:0/976701961 >> v2:172.21.15.178:3300/0 conn(0x7f7b4006dad0 msgr2=0x7f7b4006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:24.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b3f400640 1 --2- 172.21.15.59:0/976701961 >> v2:172.21.15.178:3300/0 conn(0x7f7b4006dad0 0x7f7b4006dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b3f400640 1 -- 172.21.15.59:0/976701961 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4015e770 con 0x7f7b4015b2f0 2024-04-25T09:03:24.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.083+0000 7f7b3fe00640 1 --2- 172.21.15.59:0/976701961 >> v2:172.21.15.178:3300/0 conn(0x7f7b4006dad0 0x7f7b4006dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b3f400640 1 --2- 172.21.15.59:0/976701961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4015b2f0 0x7f7b400b3240 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009870 tx=0x7f7b3001c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c893b0bc8e24ea38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b3ea00640 1 -- 172.21.15.59:0/976701961 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300b0070 con 0x7f7b4015b2f0 2024-04-25T09:03:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b3ea00640 1 -- 172.21.15.59:0/976701961 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b300ab600 con 0x7f7b4015b2f0 2024-04-25T09:03:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b3ea00640 1 -- 172.21.15.59:0/976701961 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b4015b8e0 con 0x7f7b4015b2f0 2024-04-25T09:03:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b46600640 1 -- 172.21.15.59:0/976701961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4015b2f0 msgr2=0x7f7b400b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b46600640 1 --2- 172.21.15.59:0/976701961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4015b2f0 0x7f7b400b3240 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7b30009870 tx=0x7f7b3001c230 comp rx=0 tx=0).stop 2024-04-25T09:03:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b46600640 1 -- 172.21.15.59:0/976701961 shutdown_connections 2024-04-25T09:03:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b46600640 1 --2- 172.21.15.59:0/976701961 >> v2:172.21.15.178:3300/0 conn(0x7f7b4006dad0 0x7f7b4006dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b46600640 1 --2- 172.21.15.59:0/976701961 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b400b2dc0 0x7f7b400b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b46600640 1 --2- 172.21.15.59:0/976701961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4015b2f0 0x7f7b400b3240 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b46600640 1 -- 172.21.15.59:0/976701961 >> 172.21.15.59:0/976701961 conn(0x7f7b400b23b0 msgr2=0x7f7b400cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b46600640 1 -- 172.21.15.59:0/976701961 shutdown_connections 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b46600640 1 -- 172.21.15.59:0/976701961 wait complete. 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b46600640 1 Processor -- start 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.087+0000 7f7b46600640 1 -- start start 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b46600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006dad0 0x7f7b4015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b46600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b400b2dc0 0x7f7b40146750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b46600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b4015b2f0 0x7f7b400ce450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b46600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4006ac10 con 0x7f7b4006dad0 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b46600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b401616f0 con 0x7f7b4015b2f0 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b46600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4006ad90 con 0x7f7b400b2dc0 2024-04-25T09:03:24.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b3f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006dad0 0x7f7b4015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b3f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006dad0 0x7f7b4015a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45952/0 (socket says 172.21.15.59:45952) 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b3f400640 1 -- 172.21.15.59:0/899183907 learned_addr learned my addr 172.21.15.59:0/899183907 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b36a00640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b400b2dc0 0x7f7b40146750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b3fe00640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b4015b2f0 0x7f7b400ce450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b3f400640 1 -- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b400b2dc0 msgr2=0x7f7b40146750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b3f400640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b400b2dc0 0x7f7b40146750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b3f400640 1 -- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b4015b2f0 msgr2=0x7f7b400ce450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b3f400640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b4015b2f0 0x7f7b400ce450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b3f400640 1 -- 172.21.15.59:0/899183907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b401594e0 con 0x7f7b4006dad0 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b3fe00640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b4015b2f0 0x7f7b400ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:24.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b3f400640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006dad0 0x7f7b4015a860 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7b300ae040 tx=0x7f7b30018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b37e00640 1 -- 172.21.15.59:0/899183907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300ba070 con 0x7f7b4006dad0 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b37e00640 1 -- 172.21.15.59:0/899183907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b300b4640 con 0x7f7b4006dad0 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b37e00640 1 -- 172.21.15.59:0/899183907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b300b0040 con 0x7f7b4006dad0 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b46600640 1 -- 172.21.15.59:0/899183907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b401597c0 con 0x7f7b4006dad0 2024-04-25T09:03:24.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b46600640 1 -- 172.21.15.59:0/899183907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b40159d80 con 0x7f7b4006dad0 2024-04-25T09:03:24.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b46600640 1 -- 172.21.15.59:0/899183907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b400745d0 con 0x7f7b4006dad0 2024-04-25T09:03:24.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.091+0000 7f7b37e00640 1 -- 172.21.15.59:0/899183907 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7b300bd070 con 0x7f7b4006dad0 2024-04-25T09:03:24.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.095+0000 7f7b37e00640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7b1c066f60 0x7f7b1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.095+0000 7f7b37e00640 1 -- 172.21.15.59:0/899183907 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f7b3011dec0 con 0x7f7b4006dad0 2024-04-25T09:03:24.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.095+0000 7f7b36a00640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7b1c066f60 0x7f7b1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.095+0000 7f7b36a00640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7b1c066f60 0x7f7b1c069420 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7b401f9fa0 tx=0x7f7b28008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.099+0000 7f7b37e00640 1 -- 172.21.15.59:0/899183907 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7b30016110 con 0x7f7b4006dad0 2024-04-25T09:03:24.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.315+0000 7f7b46600640 1 -- 172.21.15.59:0/899183907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f7b400b1730 con 0x7f7b4006dad0 2024-04-25T09:03:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b37e00640 1 -- 172.21.15.59:0/899183907 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v129) v1 ==== 142+0+0 (secure 0 0 0) 0x7f7b300ee9f0 con 0x7f7b4006dad0 2024-04-25T09:03:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b46600640 1 -- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7b1c066f60 msgr2=0x7f7b1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b46600640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7b1c066f60 0x7f7b1c069420 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7b401f9fa0 tx=0x7f7b28008040 comp rx=0 tx=0).stop 2024-04-25T09:03:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b46600640 1 -- 172.21.15.59:0/899183907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006dad0 msgr2=0x7f7b4015a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b46600640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006dad0 0x7f7b4015a860 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f7b300ae040 tx=0x7f7b30018fd0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b46600640 1 -- 172.21.15.59:0/899183907 shutdown_connections 2024-04-25T09:03:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b46600640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7b1c066f60 0x7f7b1c069420 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b46600640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b4015b2f0 0x7f7b400ce450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b46600640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b400b2dc0 0x7f7b40146750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b46600640 1 --2- 172.21.15.59:0/899183907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b4006dad0 0x7f7b4015a860 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b46600640 1 -- 172.21.15.59:0/899183907 >> 172.21.15.59:0/899183907 conn(0x7f7b400b23b0 msgr2=0x7f7b400acf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b46600640 1 -- 172.21.15.59:0/899183907 shutdown_connections 2024-04-25T09:03:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.515+0000 7f7b46600640 1 -- 172.21.15.59:0/899183907 wait complete. 2024-04-25T09:03:24.528 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T09:03:24.529 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-04-25T09:03:24.529 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:03:24.529 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:24.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.679+0000 7ff56ba00640 1 Processor -- start 2024-04-25T09:03:24.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.679+0000 7ff56ba00640 1 -- start start 2024-04-25T09:03:24.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.679+0000 7ff56ba00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff564144140 0x7ff5640ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.679+0000 7ff56ba00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff56415ac60 con 0x7ff56406ead0 2024-04-25T09:03:24.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.679+0000 7ff56ba00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5640cf3e0 con 0x7ff5640ced60 2024-04-25T09:03:24.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.679+0000 7ff56ba00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff56415af20 con 0x7ff564144140 2024-04-25T09:03:24.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.679+0000 7ff569a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff56406ead0 0x7ff5640b0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46694/0 (socket says 172.21.15.59:46694) 2024-04-25T09:03:24.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.679+0000 7ff569a00640 1 -- 172.21.15.59:0/209859524 learned_addr learned my addr 172.21.15.59:0/209859524 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:24.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.679+0000 7ff569000640 1 --2- 172.21.15.59:0/209859524 >> v2:172.21.15.178:3300/0 conn(0x7ff564144140 0x7ff5640ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.683+0000 7ff563e00640 1 -- 172.21.15.59:0/209859524 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513334874 0 0) 0x7ff56415ac60 con 0x7ff56406ead0 2024-04-25T09:03:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.683+0000 7ff563e00640 1 -- 172.21.15.59:0/209859524 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff548003530 con 0x7ff56406ead0 2024-04-25T09:03:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.683+0000 7ff569000640 1 -- 172.21.15.59:0/209859524 >> v1:172.21.15.178:6789/0 conn(0x7ff5640ced60 legacy=0x7ff56406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.683+0000 7ff569000640 1 -- 172.21.15.59:0/209859524 >> v1:172.21.15.59:6789/0 conn(0x7ff56406ead0 legacy=0x7ff5640b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.683+0000 7ff569000640 1 -- 172.21.15.59:0/209859524 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56415b200 con 0x7ff564144140 2024-04-25T09:03:24.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.683+0000 7ff569000640 1 --2- 172.21.15.59:0/209859524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff564144140 0x7ff5640ce820 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff5540097c0 tx=0x7ff55401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28983d5823667060 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.683+0000 7ff563e00640 1 -- 172.21.15.59:0/209859524 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5540b0070 con 0x7ff564144140 2024-04-25T09:03:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.683+0000 7ff563e00640 1 -- 172.21.15.59:0/209859524 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5540ab400 con 0x7ff564144140 2024-04-25T09:03:24.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.683+0000 7ff563e00640 1 -- 172.21.15.59:0/209859524 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5540ab7d0 con 0x7ff564144140 2024-04-25T09:03:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 -- 172.21.15.59:0/209859524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff564144140 msgr2=0x7ff5640ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 --2- 172.21.15.59:0/209859524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff564144140 0x7ff5640ce820 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff5540097c0 tx=0x7ff55401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 -- 172.21.15.59:0/209859524 shutdown_connections 2024-04-25T09:03:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 --2- 172.21.15.59:0/209859524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff564144140 0x7ff5640ce820 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 -- 172.21.15.59:0/209859524 >> 172.21.15.59:0/209859524 conn(0x7ff564066fa0 msgr2=0x7ff56406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 -- 172.21.15.59:0/209859524 shutdown_connections 2024-04-25T09:03:24.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 -- 172.21.15.59:0/209859524 wait complete. 2024-04-25T09:03:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 Processor -- start 2024-04-25T09:03:24.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 -- start start 2024-04-25T09:03:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff56406ead0 0x7ff5641596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5640ced60 0x7ff564159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff564144140 0x7ff56413a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56415bb80 con 0x7ff564144140 2024-04-25T09:03:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff56415ba00 con 0x7ff56406ead0 2024-04-25T09:03:24.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff56ba00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5641683f0 con 0x7ff5640ced60 2024-04-25T09:03:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff569a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff564144140 0x7ff56413a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff569a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff564144140 0x7ff56413a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45968/0 (socket says 172.21.15.59:45968) 2024-04-25T09:03:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff569a00640 1 -- 172.21.15.59:0/3204283953 learned_addr learned my addr 172.21.15.59:0/3204283953 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff569000640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff56406ead0 0x7ff5641596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff55be00640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5640ced60 0x7ff564159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff569a00640 1 -- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5640ced60 msgr2=0x7ff564159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff569a00640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5640ced60 0x7ff564159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff569a00640 1 -- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff56406ead0 msgr2=0x7ff5641596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff569a00640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff56406ead0 0x7ff5641596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff569a00640 1 -- 172.21.15.59:0/3204283953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff56415e980 con 0x7ff564144140 2024-04-25T09:03:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff569000640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff56406ead0 0x7ff5641596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:24.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff55be00640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5640ced60 0x7ff564159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:24.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.687+0000 7ff569a00640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff564144140 0x7ff56413a810 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00cb40 tx=0x7ff55c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.691+0000 7ff561600640 1 -- 172.21.15.59:0/3204283953 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c017070 con 0x7ff564144140 2024-04-25T09:03:24.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.691+0000 7ff561600640 1 -- 172.21.15.59:0/3204283953 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff55c00aca0 con 0x7ff564144140 2024-04-25T09:03:24.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.691+0000 7ff56ba00640 1 -- 172.21.15.59:0/3204283953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff56415ec60 con 0x7ff564144140 2024-04-25T09:03:24.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.691+0000 7ff561600640 1 -- 172.21.15.59:0/3204283953 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c012620 con 0x7ff564144140 2024-04-25T09:03:24.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.691+0000 7ff56ba00640 1 -- 172.21.15.59:0/3204283953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56415c1f0 con 0x7ff564144140 2024-04-25T09:03:24.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.691+0000 7ff56ba00640 1 -- 172.21.15.59:0/3204283953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5640745d0 con 0x7ff564144140 2024-04-25T09:03:24.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.691+0000 7ff561600640 1 -- 172.21.15.59:0/3204283953 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff55c01a070 con 0x7ff564144140 2024-04-25T09:03:24.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.691+0000 7ff561600640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff540066f60 0x7ff540069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:24.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.691+0000 7ff561600640 1 -- 172.21.15.59:0/3204283953 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ff55c084d70 con 0x7ff564144140 2024-04-25T09:03:24.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.691+0000 7ff569000640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff540066f60 0x7ff540069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:24.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.695+0000 7ff569000640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff540066f60 0x7ff540069420 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff5540ad000 tx=0x7ff554008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:24.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.695+0000 7ff561600640 1 -- 172.21.15.59:0/3204283953 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff55c055e50 con 0x7ff564144140 2024-04-25T09:03:24.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 -- 172.21.15.59:0/3204283953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5640b1880 con 0x7ff564144140 2024-04-25T09:03:24.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff561600640 1 -- 172.21.15.59:0/3204283953 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13293 (secure 0 0 0) 0x7ff55c055750 con 0x7ff564144140 2024-04-25T09:03:24.854 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:24.854 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":44,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:03:23.511209+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/1202642229":"2024-04-26T09:03:20.498455+0000","172.21.15.59:6834/1202642229":"2024-04-26T09:03:20.498455+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:24.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 -- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff540066f60 msgr2=0x7ff540069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff540066f60 0x7ff540069420 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff5540ad000 tx=0x7ff554008040 comp rx=0 tx=0).stop 2024-04-25T09:03:24.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 -- 172.21.15.59:0/3204283953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff564144140 msgr2=0x7ff56413a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:24.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff564144140 0x7ff56413a810 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00cb40 tx=0x7ff55c00a060 comp rx=0 tx=0).stop 2024-04-25T09:03:24.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 -- 172.21.15.59:0/3204283953 shutdown_connections 2024-04-25T09:03:24.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff540066f60 0x7ff540069420 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff564144140 0x7ff56413a810 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff5640ced60 0x7ff564159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 --2- 172.21.15.59:0/3204283953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff56406ead0 0x7ff5641596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:24.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 -- 172.21.15.59:0/3204283953 >> 172.21.15.59:0/3204283953 conn(0x7ff564066fa0 msgr2=0x7ff56413c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:24.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 -- 172.21.15.59:0/3204283953 shutdown_connections 2024-04-25T09:03:24.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:24.863+0000 7ff56ba00640 1 -- 172.21.15.59:0/3204283953 wait complete. 2024-04-25T09:03:24.876 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:24.877 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:25.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa3a5600640 1 Processor -- start 2024-04-25T09:03:25.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa3a5600640 1 -- start start 2024-04-25T09:03:25.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa3a5600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3a015e770 0x7fa3a015eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa3a5600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa3a006d2d0 0x7fa3a015f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa3a5600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3a0071270 0x7fa3a0071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa3a5600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a015f090 con 0x7fa3a0071270 2024-04-25T09:03:25.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa3a5600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3a006db20 con 0x7fa3a006d2d0 2024-04-25T09:03:25.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa3a5600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a006de00 con 0x7fa3a015e770 2024-04-25T09:03:25.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa39f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3a0071270 0x7fa3a0071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa39f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3a0071270 0x7fa3a0071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45972/0 (socket says 172.21.15.59:45972) 2024-04-25T09:03:25.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa39f400640 1 -- 172.21.15.59:0/1144128181 learned_addr learned my addr 172.21.15.59:0/1144128181 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:25.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa39ea00640 1 --2- 172.21.15.59:0/1144128181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3a015e770 0x7fa3a015eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa39f400640 1 -- 172.21.15.59:0/1144128181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3a015e770 msgr2=0x7fa3a015eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa39e000640 1 --2- 172.21.15.59:0/1144128181 >> v2:172.21.15.178:3300/0 conn(0x7fa3a006d2d0 0x7fa3a015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa39f400640 1 --2- 172.21.15.59:0/1144128181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3a015e770 0x7fa3a015eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa39f400640 1 -- 172.21.15.59:0/1144128181 >> v2:172.21.15.178:3300/0 conn(0x7fa3a006d2d0 msgr2=0x7fa3a015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa39f400640 1 --2- 172.21.15.59:0/1144128181 >> v2:172.21.15.178:3300/0 conn(0x7fa3a006d2d0 0x7fa3a015f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa39f400640 1 -- 172.21.15.59:0/1144128181 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a006e0e0 con 0x7fa3a0071270 2024-04-25T09:03:25.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa39ea00640 1 --2- 172.21.15.59:0/1144128181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3a015e770 0x7fa3a015eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:25.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.031+0000 7fa39e000640 1 --2- 172.21.15.59:0/1144128181 >> v2:172.21.15.178:3300/0 conn(0x7fa3a006d2d0 0x7fa3a015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:25.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa39f400640 1 --2- 172.21.15.59:0/1144128181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3a0071270 0x7fa3a0071700 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa3a006b9b0 tx=0x7fa39801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f757c6cd6bf2b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa39d600640 1 -- 172.21.15.59:0/1144128181 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980a56f0 con 0x7fa3a0071270 2024-04-25T09:03:25.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa39d600640 1 -- 172.21.15.59:0/1144128181 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3980a5890 con 0x7fa3a0071270 2024-04-25T09:03:25.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa39d600640 1 -- 172.21.15.59:0/1144128181 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980a5c60 con 0x7fa3a0071270 2024-04-25T09:03:25.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa3a5600640 1 -- 172.21.15.59:0/1144128181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3a0071270 msgr2=0x7fa3a0071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa3a5600640 1 --2- 172.21.15.59:0/1144128181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3a0071270 0x7fa3a0071700 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fa3a006b9b0 tx=0x7fa39801c960 comp rx=0 tx=0).stop 2024-04-25T09:03:25.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa3a5600640 1 -- 172.21.15.59:0/1144128181 shutdown_connections 2024-04-25T09:03:25.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa3a5600640 1 --2- 172.21.15.59:0/1144128181 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3a0071270 0x7fa3a0071700 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa3a5600640 1 --2- 172.21.15.59:0/1144128181 >> v2:172.21.15.178:3300/0 conn(0x7fa3a006d2d0 0x7fa3a015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa3a5600640 1 --2- 172.21.15.59:0/1144128181 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3a015e770 0x7fa3a015eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa3a5600640 1 -- 172.21.15.59:0/1144128181 >> 172.21.15.59:0/1144128181 conn(0x7fa3a0067080 msgr2=0x7fa3a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa3a5600640 1 -- 172.21.15.59:0/1144128181 shutdown_connections 2024-04-25T09:03:25.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.035+0000 7fa3a5600640 1 -- 172.21.15.59:0/1144128181 wait complete. 2024-04-25T09:03:25.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa3a5600640 1 Processor -- start 2024-04-25T09:03:25.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa3a5600640 1 -- start start 2024-04-25T09:03:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa3a5600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3a006d2d0 0x7fa3a014e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa3a5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3a0071270 0x7fa3a014bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa3a5600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3a015e770 0x7fa3a014ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa3a5600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a006d830 con 0x7fa3a0071270 2024-04-25T09:03:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa3a5600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a006d6b0 con 0x7fa3a015e770 2024-04-25T09:03:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa3a5600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3a00aed70 con 0x7fa3a006d2d0 2024-04-25T09:03:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa39e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3a0071270 0x7fa3a014bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa39e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3a0071270 0x7fa3a014bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45974/0 (socket says 172.21.15.59:45974) 2024-04-25T09:03:25.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa39e000640 1 -- 172.21.15.59:0/174626875 learned_addr learned my addr 172.21.15.59:0/174626875 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:25.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa39ea00640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3a006d2d0 0x7fa3a014e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa39f400640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3a015e770 0x7fa3a014ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa39e000640 1 -- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3a006d2d0 msgr2=0x7fa3a014e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa39e000640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3a006d2d0 0x7fa3a014e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa39e000640 1 -- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3a015e770 msgr2=0x7fa3a014ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa39e000640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3a015e770 0x7fa3a014ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa39e000640 1 -- 172.21.15.59:0/174626875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a014c450 con 0x7fa3a0071270 2024-04-25T09:03:25.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa39e000640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3a0071270 0x7fa3a014bf10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00c7c0 tx=0x7fa38c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa396a00640 1 -- 172.21.15.59:0/174626875 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c007a30 con 0x7fa3a0071270 2024-04-25T09:03:25.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa396a00640 1 -- 172.21.15.59:0/174626875 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c007bd0 con 0x7fa3a0071270 2024-04-25T09:03:25.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa396a00640 1 -- 172.21.15.59:0/174626875 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0113f0 con 0x7fa3a0071270 2024-04-25T09:03:25.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa3a5600640 1 -- 172.21.15.59:0/174626875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3a00b1230 con 0x7fa3a0071270 2024-04-25T09:03:25.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa3a5600640 1 -- 172.21.15.59:0/174626875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3a00b17f0 con 0x7fa3a0071270 2024-04-25T09:03:25.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.039+0000 7fa3a5600640 1 -- 172.21.15.59:0/174626875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3a00745d0 con 0x7fa3a0071270 2024-04-25T09:03:25.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.043+0000 7fa396a00640 1 -- 172.21.15.59:0/174626875 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa38c011590 con 0x7fa3a0071270 2024-04-25T09:03:25.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.043+0000 7fa396a00640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa380066f90 0x7fa380069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.043+0000 7fa396a00640 1 -- 172.21.15.59:0/174626875 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fa38c084f80 con 0x7fa3a0071270 2024-04-25T09:03:25.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.043+0000 7fa39ea00640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa380066f90 0x7fa380069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.043+0000 7fa39ea00640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa380066f90 0x7fa380069450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa390006fd0 tx=0x7fa390008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.047+0000 7fa396a00640 1 -- 172.21.15.59:0/174626875 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa38c015020 con 0x7fa3a0071270 2024-04-25T09:03:25.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.211+0000 7fa3a5600640 1 -- 172.21.15.59:0/174626875 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3a0156590 con 0x7fa3a0071270 2024-04-25T09:03:25.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.211+0000 7fa396a00640 1 -- 172.21.15.59:0/174626875 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa38c055b40 con 0x7fa3a0071270 2024-04-25T09:03:25.204 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:03:25.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.215+0000 7fa3a5600640 1 -- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa380066f90 msgr2=0x7fa380069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.215+0000 7fa3a5600640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa380066f90 0x7fa380069450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa390006fd0 tx=0x7fa390008040 comp rx=0 tx=0).stop 2024-04-25T09:03:25.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.215+0000 7fa3a5600640 1 -- 172.21.15.59:0/174626875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3a0071270 msgr2=0x7fa3a014bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.215+0000 7fa3a5600640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3a0071270 0x7fa3a014bf10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00c7c0 tx=0x7fa38c00cc80 comp rx=0 tx=0).stop 2024-04-25T09:03:25.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.215+0000 7fa3a5600640 1 -- 172.21.15.59:0/174626875 shutdown_connections 2024-04-25T09:03:25.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.215+0000 7fa3a5600640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa380066f90 0x7fa380069450 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.215+0000 7fa3a5600640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3a015e770 0x7fa3a014ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.215+0000 7fa3a5600640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3a0071270 0x7fa3a014bf10 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.215+0000 7fa3a5600640 1 --2- 172.21.15.59:0/174626875 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3a006d2d0 0x7fa3a014e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.215+0000 7fa3a5600640 1 -- 172.21.15.59:0/174626875 >> 172.21.15.59:0/174626875 conn(0x7fa3a0067080 msgr2=0x7fa3a0154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.215+0000 7fa3a5600640 1 -- 172.21.15.59:0/174626875 shutdown_connections 2024-04-25T09:03:25.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.215+0000 7fa3a5600640 1 -- 172.21.15.59:0/174626875 wait complete. 2024-04-25T09:03:25.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-25T09:03:25.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc09ca00640 1 Processor -- start 2024-04-25T09:03:25.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc09ca00640 1 -- start start 2024-04-25T09:03:25.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc09ca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc098145270 0x7fc09815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc09ca00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc0980b1e60 0x7fc0980cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc09ca00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0980cc4e0 con 0x7fc0980cd4d0 2024-04-25T09:03:25.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc09ca00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc098145650 con 0x7fc098145270 2024-04-25T09:03:25.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc09ca00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0980ce040 con 0x7fc0980b1e60 2024-04-25T09:03:25.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc095e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc098145270 0x7fc09815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc08fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc0980cd4d0 0x7fc0980b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46708/0 (socket says 172.21.15.59:46708) 2024-04-25T09:03:25.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc08fe00640 1 -- 172.21.15.59:0/1559316337 learned_addr learned my addr 172.21.15.59:0/1559316337 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:25.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc096800640 1 --2- 172.21.15.59:0/1559316337 >> v2:172.21.15.178:3300/0 conn(0x7fc0980b1e60 0x7fc0980cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc095e00640 1 -- 172.21.15.59:0/1559316337 >> v2:172.21.15.178:3300/0 conn(0x7fc0980b1e60 msgr2=0x7fc0980cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:25.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc095e00640 1 --2- 172.21.15.59:0/1559316337 >> v2:172.21.15.178:3300/0 conn(0x7fc0980b1e60 0x7fc0980cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc095e00640 1 -- 172.21.15.59:0/1559316337 >> v1:172.21.15.59:6789/0 conn(0x7fc0980cd4d0 legacy=0x7fc0980b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.375+0000 7fc095e00640 1 -- 172.21.15.59:0/1559316337 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0980ce320 con 0x7fc098145270 2024-04-25T09:03:25.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.379+0000 7fc095e00640 1 --2- 172.21.15.59:0/1559316337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc098145270 0x7fc09815fe50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc0980b4b90 tx=0x7fc08801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5ca6f65c3927f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.379+0000 7fc095400640 1 -- 172.21.15.59:0/1559316337 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880b0070 con 0x7fc098145270 2024-04-25T09:03:25.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.379+0000 7fc095400640 1 -- 172.21.15.59:0/1559316337 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0880ab600 con 0x7fc098145270 2024-04-25T09:03:25.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.379+0000 7fc095400640 1 -- 172.21.15.59:0/1559316337 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880ab9d0 con 0x7fc098145270 2024-04-25T09:03:25.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.379+0000 7fc09ca00640 1 -- 172.21.15.59:0/1559316337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc098145270 msgr2=0x7fc09815fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.379+0000 7fc09ca00640 1 --2- 172.21.15.59:0/1559316337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc098145270 0x7fc09815fe50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fc0980b4b90 tx=0x7fc08801c480 comp rx=0 tx=0).stop 2024-04-25T09:03:25.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.379+0000 7fc09ca00640 1 -- 172.21.15.59:0/1559316337 shutdown_connections 2024-04-25T09:03:25.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.379+0000 7fc09ca00640 1 --2- 172.21.15.59:0/1559316337 >> v2:172.21.15.178:3300/0 conn(0x7fc0980b1e60 0x7fc0980cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.379+0000 7fc09ca00640 1 --2- 172.21.15.59:0/1559316337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc098145270 0x7fc09815fe50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.379+0000 7fc09ca00640 1 -- 172.21.15.59:0/1559316337 >> 172.21.15.59:0/1559316337 conn(0x7fc098066fa0 msgr2=0x7fc09806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:25.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.379+0000 7fc09ca00640 1 -- 172.21.15.59:0/1559316337 shutdown_connections 2024-04-25T09:03:25.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.379+0000 7fc09ca00640 1 -- 172.21.15.59:0/1559316337 wait complete. 2024-04-25T09:03:25.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc09ca00640 1 Processor -- start 2024-04-25T09:03:25.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc09ca00640 1 -- start start 2024-04-25T09:03:25.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc09ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0980b1e60 0x7fc098158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc09ca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0980cd4d0 0x7fc0980addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc09ca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc098145270 0x7fc0980afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc09ca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09815c710 con 0x7fc0980b1e60 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc09ca00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09815c590 con 0x7fc0980cd4d0 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc09ca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09815c890 con 0x7fc098145270 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc095e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0980b1e60 0x7fc098158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc095e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0980b1e60 0x7fc098158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45988/0 (socket says 172.21.15.59:45988) 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc095e00640 1 -- 172.21.15.59:0/4152431854 learned_addr learned my addr 172.21.15.59:0/4152431854 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc096800640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc098145270 0x7fc0980afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc08fe00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0980cd4d0 0x7fc0980addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc095e00640 1 -- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc098145270 msgr2=0x7fc0980afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc095e00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc098145270 0x7fc0980afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc095e00640 1 -- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0980cd4d0 msgr2=0x7fc0980addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc095e00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0980cd4d0 0x7fc0980addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc095e00640 1 -- 172.21.15.59:0/4152431854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0980aca70 con 0x7fc0980b1e60 2024-04-25T09:03:25.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc096800640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc098145270 0x7fc0980afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc08fe00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0980cd4d0 0x7fc0980addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc095e00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0980b1e60 0x7fc098158490 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc08801a0b0 tx=0x7fc088019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc08e000640 1 -- 172.21.15.59:0/4152431854 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880b0040 con 0x7fc0980b1e60 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc08e000640 1 -- 172.21.15.59:0/4152431854 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0880ba070 con 0x7fc0980b1e60 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc08e000640 1 -- 172.21.15.59:0/4152431854 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880b4870 con 0x7fc0980b1e60 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc09ca00640 1 -- 172.21.15.59:0/4152431854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0980acd50 con 0x7fc0980b1e60 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.383+0000 7fc09ca00640 1 -- 172.21.15.59:0/4152431854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0980ad310 con 0x7fc0980b1e60 2024-04-25T09:03:25.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.387+0000 7fc09ca00640 1 -- 172.21.15.59:0/4152431854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0980745d0 con 0x7fc0980b1e60 2024-04-25T09:03:25.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.387+0000 7fc08e000640 1 -- 172.21.15.59:0/4152431854 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc0880ab4c0 con 0x7fc0980b1e60 2024-04-25T09:03:25.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.387+0000 7fc08e000640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc074066f90 0x7fc074069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:25.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.387+0000 7fc08e000640 1 -- 172.21.15.59:0/4152431854 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc08811ece0 con 0x7fc0980b1e60 2024-04-25T09:03:25.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.387+0000 7fc08fe00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc074066f90 0x7fc074069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:25.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.387+0000 7fc08fe00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc074066f90 0x7fc074069450 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc080007fd0 tx=0x7fc080009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:25.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.391+0000 7fc08e000640 1 -- 172.21.15.59:0/4152431854 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc088016070 con 0x7fc0980b1e60 2024-04-25T09:03:25.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:25.611+0000 7fc09ca00640 1 -- 172.21.15.59:0/4152431854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7fc09806b8e0 con 0x7fc0980b1e60 2024-04-25T09:03:26.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc08e000640 1 -- 172.21.15.59:0/4152431854 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v131) v1 ==== 152+0+0 (secure 0 0 0) 0x7fc0880efe50 con 0x7fc0980b1e60 2024-04-25T09:03:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc09ca00640 1 -- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc074066f90 msgr2=0x7fc074069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc09ca00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc074066f90 0x7fc074069450 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fc080007fd0 tx=0x7fc080009040 comp rx=0 tx=0).stop 2024-04-25T09:03:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc09ca00640 1 -- 172.21.15.59:0/4152431854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0980b1e60 msgr2=0x7fc098158490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc09ca00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0980b1e60 0x7fc098158490 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc08801a0b0 tx=0x7fc088019220 comp rx=0 tx=0).stop 2024-04-25T09:03:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc09ca00640 1 -- 172.21.15.59:0/4152431854 shutdown_connections 2024-04-25T09:03:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc09ca00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc074066f90 0x7fc074069450 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc09ca00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc098145270 0x7fc0980afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc09ca00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0980cd4d0 0x7fc0980addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc09ca00640 1 --2- 172.21.15.59:0/4152431854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0980b1e60 0x7fc098158490 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc09ca00640 1 -- 172.21.15.59:0/4152431854 >> 172.21.15.59:0/4152431854 conn(0x7fc098066fa0 msgr2=0x7fc0980b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc09ca00640 1 -- 172.21.15.59:0/4152431854 shutdown_connections 2024-04-25T09:03:26.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.523+0000 7fc09ca00640 1 -- 172.21.15.59:0/4152431854 wait complete. 2024-04-25T09:03:26.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:03:26.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7eb0200640 1 Processor -- start 2024-04-25T09:03:26.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7eb0200640 1 -- start start 2024-04-25T09:03:26.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7eb0200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7ea815acd0 0x7f7ea815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7eb0200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea815bc40 con 0x7f7ea815ee60 2024-04-25T09:03:26.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7eb0200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ea815b3a0 con 0x7f7ea8144120 2024-04-25T09:03:26.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7eb0200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ea815e490 con 0x7f7ea815acd0 2024-04-25T09:03:26.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7eae200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7ea815ee60 0x7f7ea80b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46720/0 (socket says 172.21.15.59:46720) 2024-04-25T09:03:26.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7eae200640 1 -- 172.21.15.59:0/3167235013 learned_addr learned my addr 172.21.15.59:0/3167235013 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:26.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7eace00640 1 --2- 172.21.15.59:0/3167235013 >> v2:172.21.15.178:3300/0 conn(0x7f7ea815acd0 0x7f7ea815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244866403 0 0) 0x7f7ea815bc40 con 0x7f7ea815ee60 2024-04-25T09:03:26.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e90003530 con 0x7f7ea815ee60 2024-04-25T09:03:26.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1288817000 0 0) 0x7f7e90003530 con 0x7f7ea815ee60 2024-04-25T09:03:26.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 >> v2:172.21.15.178:3300/0 conn(0x7f7ea815acd0 msgr2=0x7f7ea815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 --2- 172.21.15.59:0/3167235013 >> v2:172.21.15.178:3300/0 conn(0x7f7ea815acd0 0x7f7ea815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 >> v1:172.21.15.178:6789/0 conn(0x7f7ea8144120 legacy=0x7f7ea80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea815b680 con 0x7f7ea815ee60 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f7ea0001a00 con 0x7f7ea815ee60 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 >> v1:172.21.15.59:6789/0 conn(0x7f7ea815ee60 legacy=0x7f7ea80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 --2- 172.21.15.59:0/3167235013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 0x7f7e90003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 --2- 172.21.15.59:0/3167235013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e90004810 0x7f7e90004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 --2- 172.21.15.59:0/3167235013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e900051d0 0x7f7e9000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea815e490 con 0x7f7e900039c0 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9000c170 con 0x7f7e90004810 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9000c370 con 0x7f7e900051d0 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ead800640 1 --2- 172.21.15.59:0/3167235013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 0x7f7e90003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7eace00640 1 --2- 172.21.15.59:0/3167235013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e90004810 0x7f7e90004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7eae200640 1 --2- 172.21.15.59:0/3167235013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e900051d0 0x7f7e9000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ead800640 1 -- 172.21.15.59:0/3167235013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e900051d0 msgr2=0x7f7e9000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:26.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ead800640 1 --2- 172.21.15.59:0/3167235013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e900051d0 0x7f7e9000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ead800640 1 -- 172.21.15.59:0/3167235013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e90004810 msgr2=0x7f7e90004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:26.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ead800640 1 --2- 172.21.15.59:0/3167235013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e90004810 0x7f7e90004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7ead800640 1 -- 172.21.15.59:0/3167235013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90003530 con 0x7f7e900039c0 2024-04-25T09:03:26.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.699+0000 7f7eae200640 1 -- 172.21.15.59:0/3167235013 reap_dead start 2024-04-25T09:03:26.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.703+0000 7f7ead800640 1 --2- 172.21.15.59:0/3167235013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 0x7f7e90003de0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c001780 tx=0x7f7e9c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55694a259161fd8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:26.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.703+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0013a0 con 0x7f7e900039c0 2024-04-25T09:03:26.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.703+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c0052f0 con 0x7f7e900039c0 2024-04-25T09:03:26.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.703+0000 7f7ea7e00640 1 -- 172.21.15.59:0/3167235013 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c003840 con 0x7f7e900039c0 2024-04-25T09:03:26.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.703+0000 7f7eb0200640 1 -- 172.21.15.59:0/3167235013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 msgr2=0x7f7e90003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.703+0000 7f7eb0200640 1 --2- 172.21.15.59:0/3167235013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 0x7f7e90003de0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c001780 tx=0x7f7e9c01c400 comp rx=0 tx=0).stop 2024-04-25T09:03:26.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.703+0000 7f7eb0200640 1 -- 172.21.15.59:0/3167235013 shutdown_connections 2024-04-25T09:03:26.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.703+0000 7f7eb0200640 1 --2- 172.21.15.59:0/3167235013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 0x7f7e90003de0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.703+0000 7f7eb0200640 1 -- 172.21.15.59:0/3167235013 >> 172.21.15.59:0/3167235013 conn(0x7f7ea8067080 msgr2=0x7f7ea806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:26.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.703+0000 7f7eb0200640 1 -- 172.21.15.59:0/3167235013 shutdown_connections 2024-04-25T09:03:26.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.703+0000 7f7eb0200640 1 -- 172.21.15.59:0/3167235013 wait complete. 2024-04-25T09:03:26.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eb0200640 1 Processor -- start 2024-04-25T09:03:26.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eb0200640 1 -- start start 2024-04-25T09:03:26.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eb0200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 0x7f7ea813f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eb0200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea813f540 0x7f7ea815c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eb0200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea815caf0 0x7f7ea80cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eb0200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea80cd180 con 0x7f7e900039c0 2024-04-25T09:03:26.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eb0200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea80cd000 con 0x7f7ea813f540 2024-04-25T09:03:26.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eb0200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea806e3e0 con 0x7f7ea815caf0 2024-04-25T09:03:26.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7ead800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 0x7f7ea813f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7ead800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 0x7f7ea813f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46018/0 (socket says 172.21.15.59:46018) 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7ead800640 1 -- 172.21.15.59:0/4051830803 learned_addr learned my addr 172.21.15.59:0/4051830803 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eace00640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea813f540 0x7f7ea815c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eae200640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea815caf0 0x7f7ea80cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7ead800640 1 -- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea815caf0 msgr2=0x7f7ea80cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7ead800640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea815caf0 0x7f7ea80cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7ead800640 1 -- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea813f540 msgr2=0x7f7ea815c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7ead800640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea813f540 0x7f7ea815c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7ead800640 1 -- 172.21.15.59:0/4051830803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea815d750 con 0x7f7e900039c0 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7ead800640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 0x7f7ea813f000 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c000c10 tx=0x7f7e90005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7ea5600640 1 -- 172.21.15.59:0/4051830803 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c0013a0 con 0x7f7e900039c0 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7ea5600640 1 -- 172.21.15.59:0/4051830803 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e9c0054a0 con 0x7f7e900039c0 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7ea5600640 1 -- 172.21.15.59:0/4051830803 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e9c007a40 con 0x7f7e900039c0 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eb0200640 1 -- 172.21.15.59:0/4051830803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea815d190 con 0x7f7e900039c0 2024-04-25T09:03:26.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eb0200640 1 -- 172.21.15.59:0/4051830803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea80ca610 con 0x7f7e900039c0 2024-04-25T09:03:26.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.707+0000 7f7eb0200640 1 -- 172.21.15.59:0/4051830803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea815cf00 con 0x7f7e900039c0 2024-04-25T09:03:26.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.711+0000 7f7ea5600640 1 -- 172.21.15.59:0/4051830803 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7e9c0bc020 con 0x7f7e900039c0 2024-04-25T09:03:26.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.711+0000 7f7ea5600640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e88066f60 0x7f7e88069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:26.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.711+0000 7f7ea5600640 1 -- 172.21.15.59:0/4051830803 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f7e9c11e520 con 0x7f7e900039c0 2024-04-25T09:03:26.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.711+0000 7f7eace00640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e88066f60 0x7f7e88069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:26.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.711+0000 7f7eace00640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e88066f60 0x7f7e88069420 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7ea815a820 tx=0x7f7e94009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:26.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.715+0000 7f7ea5600640 1 -- 172.21.15.59:0/4051830803 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7e9c0c3020 con 0x7f7e900039c0 2024-04-25T09:03:26.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.879+0000 7f7eb0200640 1 -- 172.21.15.59:0/4051830803 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7ea80745d0 con 0x7f7e900039c0 2024-04-25T09:03:26.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7ea5600640 1 -- 172.21.15.59:0/4051830803 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7e9c016110 con 0x7f7e900039c0 2024-04-25T09:03:26.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7eb0200640 1 -- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e88066f60 msgr2=0x7f7e88069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7eb0200640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e88066f60 0x7f7e88069420 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7ea815a820 tx=0x7f7e94009190 comp rx=0 tx=0).stop 2024-04-25T09:03:26.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7eb0200640 1 -- 172.21.15.59:0/4051830803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 msgr2=0x7f7ea813f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:26.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7eb0200640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 0x7f7ea813f000 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c000c10 tx=0x7f7e90005840 comp rx=0 tx=0).stop 2024-04-25T09:03:26.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7eb0200640 1 -- 172.21.15.59:0/4051830803 shutdown_connections 2024-04-25T09:03:26.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7eb0200640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e88066f60 0x7f7e88069420 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7eb0200640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7ea815caf0 0x7f7ea80cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7eb0200640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7ea813f540 0x7f7ea815c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7eb0200640 1 --2- 172.21.15.59:0/4051830803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e900039c0 0x7f7ea813f000 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:26.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7eb0200640 1 -- 172.21.15.59:0/4051830803 >> 172.21.15.59:0/4051830803 conn(0x7f7ea8067080 msgr2=0x7f7ea806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:26.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7eb0200640 1 -- 172.21.15.59:0/4051830803 shutdown_connections 2024-04-25T09:03:26.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:26.883+0000 7f7eb0200640 1 -- 172.21.15.59:0/4051830803 wait complete. 2024-04-25T09:03:26.894 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:03:26.894 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:26.983 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:03:27.047 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:03:27.048 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:03:27.048 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:27.056 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:03:27.056 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:03:27.056 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:27.066 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:03:27.066 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:03:27.066 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:27.108 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:03:27.108 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:03:27.108 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:27.121 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:03:27.121 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:03:27.121 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:27.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.299+0000 7f6da8e00640 1 Processor -- start 2024-04-25T09:03:27.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6da8e00640 1 -- start start 2024-04-25T09:03:27.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6da8e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6da4161510 0x7f6da4143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6da8e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6da41435c0 0x7f6da415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6da8e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da406d090 con 0x7f6da4070fe0 2024-04-25T09:03:27.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6da8e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da4071ad0 con 0x7f6da4161510 2024-04-25T09:03:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6da8e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da4162390 con 0x7f6da41435c0 2024-04-25T09:03:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6d99400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6da4161510 0x7f6da4143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6d99400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6da4161510 0x7f6da4143080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46020/0 (socket says 172.21.15.59:46020) 2024-04-25T09:03:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6d99400640 1 -- 172.21.15.59:0/2369353157 learned_addr learned my addr 172.21.15.59:0/2369353157 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6da2800640 1 --2- 172.21.15.59:0/2369353157 >> v2:172.21.15.178:3300/0 conn(0x7f6da41435c0 0x7f6da415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6d99400640 1 -- 172.21.15.59:0/2369353157 >> v2:172.21.15.178:3300/0 conn(0x7f6da41435c0 msgr2=0x7f6da415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6d99400640 1 --2- 172.21.15.59:0/2369353157 >> v2:172.21.15.178:3300/0 conn(0x7f6da41435c0 0x7f6da415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6d99400640 1 -- 172.21.15.59:0/2369353157 >> v1:172.21.15.178:6789/0 conn(0x7f6da4070fe0 legacy=0x7f6da40713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.303+0000 7f6d99400640 1 -- 172.21.15.59:0/2369353157 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4161af0 con 0x7f6da4161510 2024-04-25T09:03:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6d99400640 1 --2- 172.21.15.59:0/2369353157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da4161510 0x7f6da4143080 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6da406ee80 tx=0x7f6d8c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b427e8c4ffa8ddee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da1400640 1 -- 172.21.15.59:0/2369353157 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0ab600 con 0x7f6da4161510 2024-04-25T09:03:27.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da1400640 1 -- 172.21.15.59:0/2369353157 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c0b0070 con 0x7f6da4161510 2024-04-25T09:03:27.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da1400640 1 -- 172.21.15.59:0/2369353157 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0ab9c0 con 0x7f6da4161510 2024-04-25T09:03:27.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da8e00640 1 -- 172.21.15.59:0/2369353157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da4161510 msgr2=0x7f6da4143080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da8e00640 1 --2- 172.21.15.59:0/2369353157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da4161510 0x7f6da4143080 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6da406ee80 tx=0x7f6d8c01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da8e00640 1 -- 172.21.15.59:0/2369353157 shutdown_connections 2024-04-25T09:03:27.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da8e00640 1 --2- 172.21.15.59:0/2369353157 >> v2:172.21.15.178:3300/0 conn(0x7f6da41435c0 0x7f6da415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da8e00640 1 --2- 172.21.15.59:0/2369353157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da4161510 0x7f6da4143080 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da8e00640 1 -- 172.21.15.59:0/2369353157 >> 172.21.15.59:0/2369353157 conn(0x7f6da40b3390 msgr2=0x7f6da40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:27.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da8e00640 1 -- 172.21.15.59:0/2369353157 shutdown_connections 2024-04-25T09:03:27.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da8e00640 1 -- 172.21.15.59:0/2369353157 wait complete. 2024-04-25T09:03:27.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da8e00640 1 Processor -- start 2024-04-25T09:03:27.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.307+0000 7f6da8e00640 1 -- start start 2024-04-25T09:03:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da4070fe0 0x7f6da4157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da8e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da41435c0 0x7f6da41557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da8e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6da4161510 0x7f6da40cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da8e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40b06c0 con 0x7f6da4070fe0 2024-04-25T09:03:27.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da8e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40b0540 con 0x7f6da4161510 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da8e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da40b0840 con 0x7f6da41435c0 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da4070fe0 0x7f6da4157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da4070fe0 0x7f6da4157900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46036/0 (socket says 172.21.15.59:46036) 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da1e00640 1 -- 172.21.15.59:0/2790798651 learned_addr learned my addr 172.21.15.59:0/2790798651 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da2800640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6da4161510 0x7f6da40cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6d99400640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da41435c0 0x7f6da41557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da1e00640 1 -- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da41435c0 msgr2=0x7f6da41557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da1e00640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da41435c0 0x7f6da41557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da1e00640 1 -- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6da4161510 msgr2=0x7f6da40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da1e00640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6da4161510 0x7f6da40cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da1e00640 1 -- 172.21.15.59:0/2790798651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da413b7b0 con 0x7f6da4070fe0 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6d99400640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da41435c0 0x7f6da41557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:27.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da2800640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6da4161510 0x7f6da40cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da1e00640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da4070fe0 0x7f6da4157900 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400c790 tx=0x7f6d9400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6d9aa00640 1 -- 172.21.15.59:0/2790798651 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94016020 con 0x7f6da4070fe0 2024-04-25T09:03:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6d9aa00640 1 -- 172.21.15.59:0/2790798651 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d94006d60 con 0x7f6da4070fe0 2024-04-25T09:03:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da8e00640 1 -- 172.21.15.59:0/2790798651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da413ba90 con 0x7f6da4070fe0 2024-04-25T09:03:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6d9aa00640 1 -- 172.21.15.59:0/2790798651 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94003bc0 con 0x7f6da4070fe0 2024-04-25T09:03:27.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da8e00640 1 -- 172.21.15.59:0/2790798651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da413c050 con 0x7f6da4070fe0 2024-04-25T09:03:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6da8e00640 1 -- 172.21.15.59:0/2790798651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da40745d0 con 0x7f6da4070fe0 2024-04-25T09:03:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.311+0000 7f6d9aa00640 1 -- 172.21.15.59:0/2790798651 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d9400a850 con 0x7f6da4070fe0 2024-04-25T09:03:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.315+0000 7f6d9aa00640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d80066f60 0x7f6d80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.315+0000 7f6d9aa00640 1 -- 172.21.15.59:0/2790798651 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f6d94084b70 con 0x7f6da4070fe0 2024-04-25T09:03:27.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.315+0000 7f6d99400640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d80066f60 0x7f6d80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.315+0000 7f6d99400640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d80066f60 0x7f6d80069420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0af000 tx=0x7f6d8c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.319+0000 7f6d9aa00640 1 -- 172.21.15.59:0/2790798651 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6d94020020 con 0x7f6da4070fe0 2024-04-25T09:03:27.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.511+0000 7f6da8e00640 1 -- 172.21.15.59:0/2790798651 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6da40cef80 con 0x7f6da4070fe0 2024-04-25T09:03:27.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.511+0000 7f6d9aa00640 1 -- 172.21.15.59:0/2790798651 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f6da406d090 con 0x7f6da4070fe0 2024-04-25T09:03:27.504 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:27.504 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4970,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3471177782","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3471177782},{"type":"v1","addr":"172.21.15.178:6836","nonce":3471177782}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5224,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3534065304","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3534065304},{"type":"v1","addr":"172.21.15.178:6837","nonce":3534065304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5283,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/4015865168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4015865168},{"type":"v1","addr":"172.21.15.59:6833","nonce":4015865168}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/439896127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":439896127},{"type":"v1","addr":"172.21.15.59:6835","nonce":439896127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":21}],"filesystems":[]} 2024-04-25T09:03:27.504 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 21 2024-04-25T09:03:27.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.515+0000 7f6da8e00640 1 -- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d80066f60 msgr2=0x7f6d80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.515+0000 7f6da8e00640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d80066f60 0x7f6d80069420 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0af000 tx=0x7f6d8c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:27.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.515+0000 7f6da8e00640 1 -- 172.21.15.59:0/2790798651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da4070fe0 msgr2=0x7f6da4157900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.515+0000 7f6da8e00640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da4070fe0 0x7f6da4157900 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6d9400c790 tx=0x7f6d9400cc50 comp rx=0 tx=0).stop 2024-04-25T09:03:27.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.515+0000 7f6da8e00640 1 -- 172.21.15.59:0/2790798651 shutdown_connections 2024-04-25T09:03:27.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.515+0000 7f6da8e00640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d80066f60 0x7f6d80069420 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.515+0000 7f6da8e00640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6da4161510 0x7f6da40cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.515+0000 7f6da8e00640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6da41435c0 0x7f6da41557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.515+0000 7f6da8e00640 1 --2- 172.21.15.59:0/2790798651 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6da4070fe0 0x7f6da4157900 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.515+0000 7f6da8e00640 1 -- 172.21.15.59:0/2790798651 >> 172.21.15.59:0/2790798651 conn(0x7f6da40b3390 msgr2=0x7f6da40713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:27.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.515+0000 7f6da8e00640 1 -- 172.21.15.59:0/2790798651 shutdown_connections 2024-04-25T09:03:27.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.515+0000 7f6da8e00640 1 -- 172.21.15.59:0/2790798651 wait complete. 2024-04-25T09:03:27.527 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:03:27.527 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:03:27.527 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:03:27.527 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:27.527 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:03:27.527 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:03:27.528 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:03:27.528 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:27.528 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:03:27.528 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:03:27.528 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:03:27.528 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:27.528 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:03:27.529 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:03:27.529 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:03:27.529 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:03:27.543 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:03:27.543 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:03:27.544 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:03:27.544 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:03:27.545 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:03:27.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:03:27.546 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:03:27.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:03:27.587 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:03:27.587 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:27.588 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:03:27.588 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:27.594 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:03:27.595 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:27.596 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:03:27.596 DEBUG:teuthology.parallel:result is None 2024-04-25T09:03:27.596 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:03:27.678 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-04-25T09:03:27.678 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-04-25T09:03:27.682 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T09:03:27.682 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:03:27.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf3e00640 1 Processor -- start 2024-04-25T09:03:27.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf3e00640 1 -- start start 2024-04-25T09:03:27.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf3e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf415e980 0x7f9bf406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bf406b150 0x7f9bf40af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf3e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf40aefa0 con 0x7f9bf40aebc0 2024-04-25T09:03:27.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf3e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf40b5a00 con 0x7f9bf406b150 2024-04-25T09:03:27.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf3e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf40b3620 con 0x7f9bf415e980 2024-04-25T09:03:27.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf2a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9bf40aebc0 0x7f9bf40b51f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46732/0 (socket says 172.21.15.59:46732) 2024-04-25T09:03:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf2a00640 1 -- 172.21.15.59:0/566038040 learned_addr learned my addr 172.21.15.59:0/566038040 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf3400640 1 --2- 172.21.15.59:0/566038040 >> v2:172.21.15.59:3300/0 conn(0x7f9bf406b150 0x7f9bf40af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bebe00640 1 --2- 172.21.15.59:0/566038040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf415e980 0x7f9bf406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf2000640 1 -- 172.21.15.59:0/566038040 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832820822 0 0) 0x7f9bf40aefa0 con 0x7f9bf40aebc0 2024-04-25T09:03:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf2000640 1 -- 172.21.15.59:0/566038040 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bd8003530 con 0x7f9bf40aebc0 2024-04-25T09:03:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf3400640 1 -- 172.21.15.59:0/566038040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf415e980 msgr2=0x7f9bf406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf3400640 1 --2- 172.21.15.59:0/566038040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf415e980 0x7f9bf406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf3400640 1 -- 172.21.15.59:0/566038040 >> v1:172.21.15.59:6789/0 conn(0x7f9bf40aebc0 legacy=0x7f9bf40b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bf3400640 1 -- 172.21.15.59:0/566038040 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40b3900 con 0x7f9bf406b150 2024-04-25T09:03:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.751+0000 7f9bebe00640 1 --2- 172.21.15.59:0/566038040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf415e980 0x7f9bf406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.755+0000 7f9bf3400640 1 --2- 172.21.15.59:0/566038040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf406b150 0x7f9bf40af3b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009d90 tx=0x7f9bec01c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da3366c56094bb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.755+0000 7f9bf2000640 1 -- 172.21.15.59:0/566038040 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0b2070 con 0x7f9bf406b150 2024-04-25T09:03:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.755+0000 7f9bf2000640 1 -- 172.21.15.59:0/566038040 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec0a57f0 con 0x7f9bf406b150 2024-04-25T09:03:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.755+0000 7f9bf2000640 1 -- 172.21.15.59:0/566038040 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0a5bc0 con 0x7f9bf406b150 2024-04-25T09:03:27.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.755+0000 7f9bf3e00640 1 -- 172.21.15.59:0/566038040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf406b150 msgr2=0x7f9bf40af3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.755+0000 7f9bf3e00640 1 --2- 172.21.15.59:0/566038040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf406b150 0x7f9bf40af3b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009d90 tx=0x7f9bec01c820 comp rx=0 tx=0).stop 2024-04-25T09:03:27.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.755+0000 7f9bf3e00640 1 -- 172.21.15.59:0/566038040 shutdown_connections 2024-04-25T09:03:27.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.755+0000 7f9bf3e00640 1 --2- 172.21.15.59:0/566038040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf406b150 0x7f9bf40af3b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.755+0000 7f9bf3e00640 1 --2- 172.21.15.59:0/566038040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf415e980 0x7f9bf406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.755+0000 7f9bf3e00640 1 -- 172.21.15.59:0/566038040 >> 172.21.15.59:0/566038040 conn(0x7f9bf40b5c30 msgr2=0x7f9bf4099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:27.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.755+0000 7f9bf3e00640 1 -- 172.21.15.59:0/566038040 shutdown_connections 2024-04-25T09:03:27.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.755+0000 7f9bf3e00640 1 -- 172.21.15.59:0/566038040 wait complete. 2024-04-25T09:03:27.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3e00640 1 Processor -- start 2024-04-25T09:03:27.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3e00640 1 -- start start 2024-04-25T09:03:27.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf40aebc0 0x7f9bf415d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bf415e980 0x7f9bf40d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf4150060 0x7f9bf4140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf416a9f0 con 0x7f9bf4150060 2024-04-25T09:03:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf416a870 con 0x7f9bf415e980 2024-04-25T09:03:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf416ab70 con 0x7f9bf40aebc0 2024-04-25T09:03:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf4150060 0x7f9bf4140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf4150060 0x7f9bf4140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46088/0 (socket says 172.21.15.59:46088) 2024-04-25T09:03:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3400640 1 -- 172.21.15.59:0/2217903696 learned_addr learned my addr 172.21.15.59:0/2217903696 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf2a00640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf40aebc0 0x7f9bf415d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bebe00640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bf415e980 0x7f9bf40d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3400640 1 -- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf40aebc0 msgr2=0x7f9bf415d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3400640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf40aebc0 0x7f9bf415d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3400640 1 -- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bf415e980 msgr2=0x7f9bf40d0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3400640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bf415e980 0x7f9bf40d0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3400640 1 -- 172.21.15.59:0/2217903696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf40d0fb0 con 0x7f9bf4150060 2024-04-25T09:03:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bebe00640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bf415e980 0x7f9bf40d0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3400640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf4150060 0x7f9bf4140e20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0b0040 tx=0x7f9bec0195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9beaa00640 1 -- 172.21.15.59:0/2217903696 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0b2050 con 0x7f9bf4150060 2024-04-25T09:03:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9beaa00640 1 -- 172.21.15.59:0/2217903696 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec0be070 con 0x7f9bf4150060 2024-04-25T09:03:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9beaa00640 1 -- 172.21.15.59:0/2217903696 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec0ad890 con 0x7f9bf4150060 2024-04-25T09:03:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3e00640 1 -- 172.21.15.59:0/2217903696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf414f2a0 con 0x7f9bf4150060 2024-04-25T09:03:27.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.759+0000 7f9bf3e00640 1 -- 172.21.15.59:0/2217903696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf414f860 con 0x7f9bf4150060 2024-04-25T09:03:27.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.763+0000 7f9bf3e00640 1 -- 172.21.15.59:0/2217903696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf40b12a0 con 0x7f9bf4150060 2024-04-25T09:03:27.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.763+0000 7f9beaa00640 1 -- 172.21.15.59:0/2217903696 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9bec0ada30 con 0x7f9bf4150060 2024-04-25T09:03:27.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.763+0000 7f9beaa00640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9bd0066f90 0x7f9bd0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.763+0000 7f9beaa00640 1 -- 172.21.15.59:0/2217903696 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f9bec11fda0 con 0x7f9bf4150060 2024-04-25T09:03:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.763+0000 7f9bf2a00640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9bd0066f90 0x7f9bd0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:27.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.763+0000 7f9bf2a00640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9bd0066f90 0x7f9bd0069450 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9be4007fd0 tx=0x7f9be4000bd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:27.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.767+0000 7f9beaa00640 1 -- 172.21.15.59:0/2217903696 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9bec016560 con 0x7f9bf4150060 2024-04-25T09:03:27.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:27.939+0000 7f9bf3e00640 1 -- 172.21.15.59:0/2217903696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9bf40d02b0 con 0x7f9bf4150060 2024-04-25T09:03:28.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.535+0000 7f9beaa00640 1 -- 172.21.15.59:0/2217903696 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v46) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9bec0f0840 con 0x7f9bf4150060 2024-04-25T09:03:28.527 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-04-25T09:03:28.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.539+0000 7f9bf3e00640 1 -- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9bd0066f90 msgr2=0x7f9bd0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.539+0000 7f9bf3e00640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9bd0066f90 0x7f9bd0069450 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9be4007fd0 tx=0x7f9be4000bd0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.539+0000 7f9bf3e00640 1 -- 172.21.15.59:0/2217903696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf4150060 msgr2=0x7f9bf4140e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.539+0000 7f9bf3e00640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf4150060 0x7f9bf4140e20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0b0040 tx=0x7f9bec0195c0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.539+0000 7f9bf3e00640 1 -- 172.21.15.59:0/2217903696 shutdown_connections 2024-04-25T09:03:28.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.539+0000 7f9bf3e00640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9bd0066f90 0x7f9bd0069450 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.539+0000 7f9bf3e00640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bf4150060 0x7f9bf4140e20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.539+0000 7f9bf3e00640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bf415e980 0x7f9bf40d0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.539+0000 7f9bf3e00640 1 --2- 172.21.15.59:0/2217903696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bf40aebc0 0x7f9bf415d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.539+0000 7f9bf3e00640 1 -- 172.21.15.59:0/2217903696 >> 172.21.15.59:0/2217903696 conn(0x7f9bf40b5c30 msgr2=0x7f9bf40736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:28.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.539+0000 7f9bf3e00640 1 -- 172.21.15.59:0/2217903696 shutdown_connections 2024-04-25T09:03:28.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.539+0000 7f9bf3e00640 1 -- 172.21.15.59:0/2217903696 wait complete. 2024-04-25T09:03:28.554 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:03:28.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.703+0000 7f3825a00640 1 Processor -- start 2024-04-25T09:03:28.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f3825a00640 1 -- start start 2024-04-25T09:03:28.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f3825a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f38200cef30 0x7f382006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f3825a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f382015ac60 con 0x7f382006e900 2024-04-25T09:03:28.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f3825a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38200cf3e0 con 0x7f3820144140 2024-04-25T09:03:28.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f3825a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382006ed50 con 0x7f38200cef30 2024-04-25T09:03:28.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f382006e900 0x7f38200b0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46744/0 (socket says 172.21.15.59:46744) 2024-04-25T09:03:28.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381f400640 1 -- 172.21.15.59:0/3537566656 learned_addr learned my addr 172.21.15.59:0/3537566656 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:28.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f3817e00640 1 --2- 172.21.15.59:0/3537566656 >> v2:172.21.15.178:3300/0 conn(0x7f38200cef30 0x7f382006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208808321 0 0) 0x7f382015ac60 con 0x7f382006e900 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3804003530 con 0x7f382006e900 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2594139035 0 0) 0x7f3804003530 con 0x7f382006e900 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 >> v2:172.21.15.178:3300/0 conn(0x7f38200cef30 msgr2=0x7f382006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 --2- 172.21.15.59:0/3537566656 >> v2:172.21.15.178:3300/0 conn(0x7f38200cef30 0x7f382006e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 >> v1:172.21.15.178:6789/0 conn(0x7f3820144140 legacy=0x7f38200ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382015af20 con 0x7f382006e900 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f3818001a00 con 0x7f382006e900 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 >> v1:172.21.15.59:6789/0 conn(0x7f382006e900 legacy=0x7f38200b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 --2- 172.21.15.59:0/3537566656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38040039c0 0x7f3804003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 --2- 172.21.15.59:0/3537566656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3804004810 0x7f3804004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 --2- 172.21.15.59:0/3537566656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38040051d0 0x7f380400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382006ed50 con 0x7f38040039c0 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380400c020 con 0x7f38040051d0 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380400c220 con 0x7f3804004810 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381ea00640 1 --2- 172.21.15.59:0/3537566656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38040039c0 0x7f3804003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f3817e00640 1 --2- 172.21.15.59:0/3537566656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3804004810 0x7f3804004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381f400640 1 --2- 172.21.15.59:0/3537566656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38040051d0 0x7f380400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381ea00640 1 -- 172.21.15.59:0/3537566656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3804004810 msgr2=0x7f3804004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381ea00640 1 --2- 172.21.15.59:0/3537566656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3804004810 0x7f3804004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381ea00640 1 -- 172.21.15.59:0/3537566656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38040051d0 msgr2=0x7f380400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381ea00640 1 --2- 172.21.15.59:0/3537566656 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38040051d0 0x7f380400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381ea00640 1 -- 172.21.15.59:0/3537566656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3804003530 con 0x7f38040039c0 2024-04-25T09:03:28.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.707+0000 7f381f400640 1 -- 172.21.15.59:0/3537566656 reap_dead start 2024-04-25T09:03:28.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.711+0000 7f381ea00640 1 --2- 172.21.15.59:0/3537566656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38040039c0 0x7f3804003da0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3810001860 tx=0x7f381001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac41b0bb6886995 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:28.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.711+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38100b0070 con 0x7f38040039c0 2024-04-25T09:03:28.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.711+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38100ab600 con 0x7f38040039c0 2024-04-25T09:03:28.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.711+0000 7f381e000640 1 -- 172.21.15.59:0/3537566656 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3810001460 con 0x7f38040039c0 2024-04-25T09:03:28.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.711+0000 7f3825a00640 1 -- 172.21.15.59:0/3537566656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38040039c0 msgr2=0x7f3804003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.711+0000 7f3825a00640 1 --2- 172.21.15.59:0/3537566656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38040039c0 0x7f3804003da0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3810001860 tx=0x7f381001c500 comp rx=0 tx=0).stop 2024-04-25T09:03:28.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.711+0000 7f3825a00640 1 -- 172.21.15.59:0/3537566656 shutdown_connections 2024-04-25T09:03:28.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.711+0000 7f3825a00640 1 --2- 172.21.15.59:0/3537566656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38040039c0 0x7f3804003da0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.711+0000 7f3825a00640 1 -- 172.21.15.59:0/3537566656 >> 172.21.15.59:0/3537566656 conn(0x7f3820066fa0 msgr2=0x7f382006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:28.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.711+0000 7f3825a00640 1 -- 172.21.15.59:0/3537566656 shutdown_connections 2024-04-25T09:03:28.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.711+0000 7f3825a00640 1 -- 172.21.15.59:0/3537566656 wait complete. 2024-04-25T09:03:28.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3825a00640 1 Processor -- start 2024-04-25T09:03:28.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3825a00640 1 -- start start 2024-04-25T09:03:28.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3825a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38040039c0 0x7f3820135f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3825a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38201e89f0 0x7f38201e7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3825a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38201e81a0 0x7f3820152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3825a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3820144520 con 0x7f38201e81a0 2024-04-25T09:03:28.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3825a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38200b1f30 con 0x7f38040039c0 2024-04-25T09:03:28.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3825a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382015ba00 con 0x7f38201e89f0 2024-04-25T09:03:28.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f381f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38201e81a0 0x7f3820152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f381f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38201e81a0 0x7f3820152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46098/0 (socket says 172.21.15.59:46098) 2024-04-25T09:03:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f381f400640 1 -- 172.21.15.59:0/3969502617 learned_addr learned my addr 172.21.15.59:0/3969502617 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f381ea00640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38040039c0 0x7f3820135f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3817e00640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38201e89f0 0x7f38201e7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f381f400640 1 -- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38201e89f0 msgr2=0x7f38201e7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f381f400640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38201e89f0 0x7f38201e7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f381f400640 1 -- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38040039c0 msgr2=0x7f3820135f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f381f400640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38040039c0 0x7f3820135f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f381f400640 1 -- 172.21.15.59:0/3969502617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820137130 con 0x7f38201e81a0 2024-04-25T09:03:28.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f381f400640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38201e81a0 0x7f3820152b70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f38200b2620 tx=0x7f3818007b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:28.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3816a00640 1 -- 172.21.15.59:0/3969502617 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800aa90 con 0x7f38201e81a0 2024-04-25T09:03:28.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3816a00640 1 -- 172.21.15.59:0/3969502617 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3818018070 con 0x7f38201e81a0 2024-04-25T09:03:28.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3816a00640 1 -- 172.21.15.59:0/3969502617 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800ae50 con 0x7f38201e81a0 2024-04-25T09:03:28.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3825a00640 1 -- 172.21.15.59:0/3969502617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38201e8fb0 con 0x7f38201e81a0 2024-04-25T09:03:28.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.715+0000 7f3825a00640 1 -- 172.21.15.59:0/3969502617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3820136e50 con 0x7f38201e81a0 2024-04-25T09:03:28.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.719+0000 7f3825a00640 1 -- 172.21.15.59:0/3969502617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38200745d0 con 0x7f38201e81a0 2024-04-25T09:03:28.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.719+0000 7f3816a00640 1 -- 172.21.15.59:0/3969502617 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f381801d460 con 0x7f38201e81a0 2024-04-25T09:03:28.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.719+0000 7f3816a00640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f37fc067130 0x7f37fc0695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:28.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.719+0000 7f3816a00640 1 -- 172.21.15.59:0/3969502617 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f3818085230 con 0x7f38201e81a0 2024-04-25T09:03:28.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.719+0000 7f381ea00640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f37fc067130 0x7f37fc0695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:28.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.719+0000 7f381ea00640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f37fc067130 0x7f37fc0695f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f38100ad000 tx=0x7f38100a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:28.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.723+0000 7f3816a00640 1 -- 172.21.15.59:0/3969502617 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3818056360 con 0x7f38201e81a0 2024-04-25T09:03:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.943+0000 7f3825a00640 1 -- 172.21.15.59:0/3969502617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f382015ac60 con 0x7f38201e81a0 2024-04-25T09:03:28.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.943+0000 7f3816a00640 1 -- 172.21.15.59:0/3969502617 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3818055c60 con 0x7f38201e81a0 2024-04-25T09:03:28.935 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:28.935 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:03:28.935 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-04-25T09:03:28.935 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.935 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-04-25T09:03:28.935 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmefAMLRAAyOhrYPGN2IYchV7wMDkkTQ==", 2024-04-25T09:03:28.935 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.935 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:03:28.935 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:03:28.935 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:03:28.935 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.935 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmcZtGORAA9RU5OkQHTCXe5nkpEp77Fw==", 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-04-25T09:03:28.936 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmF3skNBAAcKEUsLnvjEY8fz59SnjWtg==", 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm95/1BBAAsIbA6GBVS4dl7sZ8CoZoLA==", 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:03:28.937 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCsGypmmikBDRAAcxA0eWyo/w0bALsf4Fb3KQ==", 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-04-25T09:03:28.938 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCvGypm66dNFxAAzl06IBbHoxHorB3FuCFNOQ==", 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCyGypmQrwdIhAAyF53f8p7/vnJ6L4ZjXcKhQ==", 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.939 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC1GypmtETmLBAAM4p1FOPAiB0aOcdfIcl6vg==", 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC6GypmyXGCAhAAKJ2Yh0lezpRfFMPXjN4Asg==", 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.940 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC9GypmmfZZDBAAzw9IygUbRErERr2lXEfutA==", 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.941 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDAGypmS4KRFRAAXrvA1QNbuWF6+ln+cz6orQ==", 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDDGypmruPJHRAAWFONkZiSsYgvsr04uO9J9A==", 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:03:28.942 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg==", 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm8NCkEhAAEELIQ7EAUFHsANHAa5EnTA==", 2024-04-25T09:03:28.943 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.944 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:03:28.944 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:03:28.944 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:03:28.944 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:03:28.944 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.944 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.944 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.944 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmdosADxAAxmQqp2O5lT5XenyqxyyMKw==", 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmsqWgGBAAIXaSazGZkKiY2hqcC+WApA==", 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:03:28.945 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypm5ldPEBAAepEqWPcDy8atp78XxKERYg==", 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.946 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmwOe7KBAAIvO6OJiUeb5hRdu9VX11cA==", 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmX2GpJBAA8RvpxNpdPFExISwQzT56fA==", 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:03:28.947 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:03:28.948 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:03:28.948 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:03:28.948 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.948 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:28.948 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-25T09:03:28.948 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:03:28.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.947+0000 7f3825a00640 1 -- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f37fc067130 msgr2=0x7f37fc0695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.947+0000 7f3825a00640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f37fc067130 0x7f37fc0695f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f38100ad000 tx=0x7f38100a6000 comp rx=0 tx=0).stop 2024-04-25T09:03:28.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.947+0000 7f3825a00640 1 -- 172.21.15.59:0/3969502617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38201e81a0 msgr2=0x7f3820152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:28.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.947+0000 7f3825a00640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38201e81a0 0x7f3820152b70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f38200b2620 tx=0x7f3818007b10 comp rx=0 tx=0).stop 2024-04-25T09:03:28.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.947+0000 7f3825a00640 1 -- 172.21.15.59:0/3969502617 shutdown_connections 2024-04-25T09:03:28.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.947+0000 7f3825a00640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f37fc067130 0x7f37fc0695f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.947+0000 7f3825a00640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38201e81a0 0x7f3820152b70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.947+0000 7f3825a00640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38201e89f0 0x7f38201e7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.947+0000 7f3825a00640 1 --2- 172.21.15.59:0/3969502617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38040039c0 0x7f3820135f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:28.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.947+0000 7f3825a00640 1 -- 172.21.15.59:0/3969502617 >> 172.21.15.59:0/3969502617 conn(0x7f3820066fa0 msgr2=0x7f38200b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:28.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.947+0000 7f3825a00640 1 -- 172.21.15.59:0/3969502617 shutdown_connections 2024-04-25T09:03:28.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:28.947+0000 7f3825a00640 1 -- 172.21.15.59:0/3969502617 wait complete. 2024-04-25T09:03:28.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f4565e00640 1 Processor -- start 2024-04-25T09:03:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f4565e00640 1 -- start start 2024-04-25T09:03:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f4565e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4560145270 0x7f456015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f4565e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45600b1e60 0x7f45600cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f4565e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45600cc4e0 con 0x7f45600cd4d0 2024-04-25T09:03:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f4565e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4560145650 con 0x7f45600b1e60 2024-04-25T09:03:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f4565e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45600ce040 con 0x7f4560145270 2024-04-25T09:03:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f455f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45600b1e60 0x7f45600cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f4556000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f45600cd4d0 0x7f45600b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46754/0 (socket says 172.21.15.59:46754) 2024-04-25T09:03:29.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f4556000640 1 -- 172.21.15.59:0/2927292602 learned_addr learned my addr 172.21.15.59:0/2927292602 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:29.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f455ea00640 1 --2- 172.21.15.59:0/2927292602 >> v2:172.21.15.178:3300/0 conn(0x7f4560145270 0x7f456015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f455f400640 1 -- 172.21.15.59:0/2927292602 >> v2:172.21.15.178:3300/0 conn(0x7f4560145270 msgr2=0x7f456015fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:29.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f455f400640 1 --2- 172.21.15.59:0/2927292602 >> v2:172.21.15.178:3300/0 conn(0x7f4560145270 0x7f456015fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f455f400640 1 -- 172.21.15.59:0/2927292602 >> v1:172.21.15.59:6789/0 conn(0x7f45600cd4d0 legacy=0x7f45600b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f455f400640 1 -- 172.21.15.59:0/2927292602 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45600ce320 con 0x7f45600b1e60 2024-04-25T09:03:29.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.107+0000 7f455ea00640 1 --2- 172.21.15.59:0/2927292602 >> v2:172.21.15.178:3300/0 conn(0x7f4560145270 0x7f456015fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.111+0000 7f455f400640 1 --2- 172.21.15.59:0/2927292602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45600b1e60 0x7f45600cd930 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f456006f3a0 tx=0x7f455801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21da5a8a85babb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.111+0000 7f455e000640 1 -- 172.21.15.59:0/2927292602 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45580b2070 con 0x7f45600b1e60 2024-04-25T09:03:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.111+0000 7f455e000640 1 -- 172.21.15.59:0/2927292602 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45580a58e0 con 0x7f45600b1e60 2024-04-25T09:03:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.111+0000 7f455e000640 1 -- 172.21.15.59:0/2927292602 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45580a5cb0 con 0x7f45600b1e60 2024-04-25T09:03:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.111+0000 7f4565e00640 1 -- 172.21.15.59:0/2927292602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45600b1e60 msgr2=0x7f45600cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.111+0000 7f4565e00640 1 --2- 172.21.15.59:0/2927292602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45600b1e60 0x7f45600cd930 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f456006f3a0 tx=0x7f455801c930 comp rx=0 tx=0).stop 2024-04-25T09:03:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.111+0000 7f4565e00640 1 -- 172.21.15.59:0/2927292602 shutdown_connections 2024-04-25T09:03:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.111+0000 7f4565e00640 1 --2- 172.21.15.59:0/2927292602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45600b1e60 0x7f45600cd930 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.111+0000 7f4565e00640 1 --2- 172.21.15.59:0/2927292602 >> v2:172.21.15.178:3300/0 conn(0x7f4560145270 0x7f456015fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.111+0000 7f4565e00640 1 -- 172.21.15.59:0/2927292602 >> 172.21.15.59:0/2927292602 conn(0x7f4560066fa0 msgr2=0x7f456006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.111+0000 7f4565e00640 1 -- 172.21.15.59:0/2927292602 shutdown_connections 2024-04-25T09:03:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.111+0000 7f4565e00640 1 -- 172.21.15.59:0/2927292602 wait complete. 2024-04-25T09:03:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4565e00640 1 Processor -- start 2024-04-25T09:03:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4565e00640 1 -- start start 2024-04-25T09:03:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4565e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45600b1e60 0x7f456015b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4565e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45600cd4d0 0x7f4560143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4565e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4560145270 0x7f45601442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4565e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456015c710 con 0x7f45600cd4d0 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4565e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456015c590 con 0x7f4560145270 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4565e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456015c890 con 0x7f45600b1e60 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4556000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45600cd4d0 0x7f4560143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4556000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45600cd4d0 0x7f4560143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46124/0 (socket says 172.21.15.59:46124) 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4556000640 1 -- 172.21.15.59:0/1726965499 learned_addr learned my addr 172.21.15.59:0/1726965499 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f455ea00640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45600b1e60 0x7f456015b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4556000640 1 -- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45600b1e60 msgr2=0x7f456015b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4556000640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45600b1e60 0x7f456015b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4556000640 1 -- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4560145270 msgr2=0x7f45601442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f455f400640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4560145270 0x7f45601442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4556000640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4560145270 0x7f45601442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4556000640 1 -- 172.21.15.59:0/1726965499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45601fa0e0 con 0x7f45600cd4d0 2024-04-25T09:03:29.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f455ea00640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45600b1e60 0x7f456015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:29.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f455f400640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4560145270 0x7f45601442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:29.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4556000640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45600cd4d0 0x7f4560143d60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f454800c420 tx=0x7f454800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4557e00640 1 -- 172.21.15.59:0/1726965499 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548017070 con 0x7f45600cd4d0 2024-04-25T09:03:29.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4557e00640 1 -- 172.21.15.59:0/1726965499 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4548005cf0 con 0x7f45600cd4d0 2024-04-25T09:03:29.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4565e00640 1 -- 172.21.15.59:0/1726965499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45601fa3c0 con 0x7f45600cd4d0 2024-04-25T09:03:29.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4557e00640 1 -- 172.21.15.59:0/1726965499 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45480072f0 con 0x7f45600cd4d0 2024-04-25T09:03:29.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.115+0000 7f4565e00640 1 -- 172.21.15.59:0/1726965499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45601fa980 con 0x7f45600cd4d0 2024-04-25T09:03:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.119+0000 7f4565e00640 1 -- 172.21.15.59:0/1726965499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45600745d0 con 0x7f45600cd4d0 2024-04-25T09:03:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.119+0000 7f4557e00640 1 -- 172.21.15.59:0/1726965499 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f454801a070 con 0x7f45600cd4d0 2024-04-25T09:03:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.119+0000 7f4557e00640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f453c066f60 0x7f453c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.119+0000 7f4557e00640 1 -- 172.21.15.59:0/1726965499 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f45480842d0 con 0x7f45600cd4d0 2024-04-25T09:03:29.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.119+0000 7f455ea00640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f453c066f60 0x7f453c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.119+0000 7f455ea00640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f453c066f60 0x7f453c069420 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f45500097a0 tx=0x7f4550008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.123+0000 7f4557e00640 1 -- 172.21.15.59:0/1726965499 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4548055400 con 0x7f45600cd4d0 2024-04-25T09:03:29.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.287+0000 7f4565e00640 1 -- 172.21.15.59:0/1726965499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f456006b8e0 con 0x7f45600cd4d0 2024-04-25T09:03:29.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4557e00640 1 -- 172.21.15.59:0/1726965499 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+13164 (secure 0 0 0) 0x7f4548054d00 con 0x7f45600cd4d0 2024-04-25T09:03:29.281 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:29.281 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":48,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:03:28.545953+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4565e00640 1 -- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f453c066f60 msgr2=0x7f453c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4565e00640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f453c066f60 0x7f453c069420 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f45500097a0 tx=0x7f4550008040 comp rx=0 tx=0).stop 2024-04-25T09:03:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4565e00640 1 -- 172.21.15.59:0/1726965499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45600cd4d0 msgr2=0x7f4560143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4565e00640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45600cd4d0 0x7f4560143d60 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f454800c420 tx=0x7f454800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4565e00640 1 -- 172.21.15.59:0/1726965499 shutdown_connections 2024-04-25T09:03:29.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4565e00640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f453c066f60 0x7f453c069420 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4565e00640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4560145270 0x7f45601442a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4565e00640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45600cd4d0 0x7f4560143d60 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4565e00640 1 --2- 172.21.15.59:0/1726965499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45600b1e60 0x7f456015b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4565e00640 1 -- 172.21.15.59:0/1726965499 >> 172.21.15.59:0/1726965499 conn(0x7f4560066fa0 msgr2=0x7f456015cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4565e00640 1 -- 172.21.15.59:0/1726965499 shutdown_connections 2024-04-25T09:03:29.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.291+0000 7f4565e00640 1 -- 172.21.15.59:0/1726965499 wait complete. 2024-04-25T09:03:29.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:03:29.302 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:03:29.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.455+0000 7f4f32a00640 1 Processor -- start 2024-04-25T09:03:29.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.455+0000 7f4f32a00640 1 -- start start 2024-04-25T09:03:29.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.455+0000 7f4f32a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4f2c06e4a0 0x7f4f2c06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.455+0000 7f4f32a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c15fc00 con 0x7f4f2c15c9b0 2024-04-25T09:03:29.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.455+0000 7f4f32a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c15fee0 con 0x7f4f2c159320 2024-04-25T09:03:29.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.455+0000 7f4f32a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2c06d640 con 0x7f4f2c06e4a0 2024-04-25T09:03:29.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.455+0000 7f4f2b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4f2c15c9b0 0x7f4f2c06dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46758/0 (socket says 172.21.15.59:46758) 2024-04-25T09:03:29.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.455+0000 7f4f2b400640 1 -- 172.21.15.59:0/2627180071 learned_addr learned my addr 172.21.15.59:0/2627180071 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:29.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f30a00640 1 --2- 172.21.15.59:0/2627180071 >> v2:172.21.15.178:3300/0 conn(0x7f4f2c06e4a0 0x7f4f2c06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283383272 0 0) 0x7f4f2c15fc00 con 0x7f4f2c15c9b0 2024-04-25T09:03:29.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f10003530 con 0x7f4f2c15c9b0 2024-04-25T09:03:29.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 432729067 0 0) 0x7f4f10003530 con 0x7f4f2c15c9b0 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 >> v2:172.21.15.178:3300/0 conn(0x7f4f2c06e4a0 msgr2=0x7f4f2c06e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 --2- 172.21.15.59:0/2627180071 >> v2:172.21.15.178:3300/0 conn(0x7f4f2c06e4a0 0x7f4f2c06e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 >> v1:172.21.15.178:6789/0 conn(0x7f4f2c159320 legacy=0x7f4f2c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c1601c0 con 0x7f4f2c15c9b0 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f4f18001680 con 0x7f4f2c15c9b0 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 >> v1:172.21.15.59:6789/0 conn(0x7f4f2c15c9b0 legacy=0x7f4f2c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 --2- 172.21.15.59:0/2627180071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f10003a10 0x7f4f10003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 --2- 172.21.15.59:0/2627180071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f10004810 0x7f4f10004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 --2- 172.21.15.59:0/2627180071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f100051d0 0x7f4f1000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c06d640 con 0x7f4f10004810 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1000c100 con 0x7f4f100051d0 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1000c300 con 0x7f4f10003a10 2024-04-25T09:03:29.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2b400640 1 --2- 172.21.15.59:0/2627180071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f10004810 0x7f4f10004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f30a00640 1 --2- 172.21.15.59:0/2627180071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f100051d0 0x7f4f1000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2be00640 1 --2- 172.21.15.59:0/2627180071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f10003a10 0x7f4f10003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2b400640 1 -- 172.21.15.59:0/2627180071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f10003a10 msgr2=0x7f4f10003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2b400640 1 --2- 172.21.15.59:0/2627180071 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f10003a10 0x7f4f10003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2b400640 1 -- 172.21.15.59:0/2627180071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f100051d0 msgr2=0x7f4f1000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2b400640 1 --2- 172.21.15.59:0/2627180071 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f100051d0 0x7f4f1000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f2b400640 1 -- 172.21.15.59:0/2627180071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f10003530 con 0x7f4f10004810 2024-04-25T09:03:29.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.459+0000 7f4f30a00640 1 -- 172.21.15.59:0/2627180071 reap_dead start 2024-04-25T09:03:29.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f2b400640 1 --2- 172.21.15.59:0/2627180071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f10004810 0x7f4f10004c90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c110 tx=0x7f4f1801f2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5840043a44db78 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18007c30 con 0x7f4f10004810 2024-04-25T09:03:29.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f180ac020 con 0x7f4f10004810 2024-04-25T09:03:29.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f2aa00640 1 -- 172.21.15.59:0/2627180071 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f180058e0 con 0x7f4f10004810 2024-04-25T09:03:29.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 -- 172.21.15.59:0/2627180071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f10004810 msgr2=0x7f4f10004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 --2- 172.21.15.59:0/2627180071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f10004810 0x7f4f10004c90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c110 tx=0x7f4f1801f2b0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 -- 172.21.15.59:0/2627180071 shutdown_connections 2024-04-25T09:03:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 --2- 172.21.15.59:0/2627180071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f10004810 0x7f4f10004c90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 -- 172.21.15.59:0/2627180071 >> 172.21.15.59:0/2627180071 conn(0x7f4f2c067080 msgr2=0x7f4f2c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 -- 172.21.15.59:0/2627180071 shutdown_connections 2024-04-25T09:03:29.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 -- 172.21.15.59:0/2627180071 wait complete. 2024-04-25T09:03:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 Processor -- start 2024-04-25T09:03:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 -- start start 2024-04-25T09:03:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f10004810 0x7f4f2c0b0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2c158290 0x7f4f2c0b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c0b31a0 0x7f4f2c0b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c06e8d0 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c159700 con 0x7f4f10004810 2024-04-25T09:03:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f32a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c06ea50 con 0x7f4f2c158290 2024-04-25T09:03:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f30a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c0b31a0 0x7f4f2c0b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f30a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c0b31a0 0x7f4f2c0b3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46142/0 (socket says 172.21.15.59:46142) 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f30a00640 1 -- 172.21.15.59:0/931687415 learned_addr learned my addr 172.21.15.59:0/931687415 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.463+0000 7f4f2b400640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2c158290 0x7f4f2c0b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f2be00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f10004810 0x7f4f2c0b0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f30a00640 1 -- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2c158290 msgr2=0x7f4f2c0b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f30a00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2c158290 0x7f4f2c0b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f30a00640 1 -- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f10004810 msgr2=0x7f4f2c0b0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f30a00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f10004810 0x7f4f2c0b0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f30a00640 1 -- 172.21.15.59:0/931687415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c0b1400 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f30a00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c0b31a0 0x7f4f2c0b3620 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0aeed0 tx=0x7f4f240115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f23e00640 1 -- 172.21.15.59:0/931687415 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f24011db0 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f23e00640 1 -- 172.21.15.59:0/931687415 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2401b070 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f32a00640 1 -- 172.21.15.59:0/931687415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c0b16e0 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f23e00640 1 -- 172.21.15.59:0/931687415 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f240039a0 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f32a00640 1 -- 172.21.15.59:0/931687415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c1e53e0 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f32a00640 1 -- 172.21.15.59:0/931687415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2c1e55e0 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f23e00640 1 -- 172.21.15.59:0/931687415 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4f24003b40 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.467+0000 7f4f23e00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4f0c066f90 0x7f4f0c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.471+0000 7f4f23e00640 1 -- 172.21.15.59:0/931687415 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f4f24085750 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.471+0000 7f4f2be00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4f0c066f90 0x7f4f0c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.471+0000 7f4f2be00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4f0c066f90 0x7f4f0c069450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c007fd0 tx=0x7f4f1c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.475+0000 7f4f23e00640 1 -- 172.21.15.59:0/931687415 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4f2c1e55e0 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 -- 172.21.15.59:0/931687415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f2c072200 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f23e00640 1 -- 172.21.15.59:0/931687415 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f24056880 con 0x7f4f2c0b31a0 2024-04-25T09:03:29.629 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:03:29.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 -- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4f0c066f90 msgr2=0x7f4f0c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4f0c066f90 0x7f4f0c069450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c007fd0 tx=0x7f4f1c009040 comp rx=0 tx=0).stop 2024-04-25T09:03:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 -- 172.21.15.59:0/931687415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c0b31a0 msgr2=0x7f4f2c0b3620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c0b31a0 0x7f4f2c0b3620 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c0aeed0 tx=0x7f4f240115a0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 -- 172.21.15.59:0/931687415 shutdown_connections 2024-04-25T09:03:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4f0c066f90 0x7f4f0c069450 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f2c0b31a0 0x7f4f2c0b3620 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f2c158290 0x7f4f2c0b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 --2- 172.21.15.59:0/931687415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f10004810 0x7f4f2c0b0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 -- 172.21.15.59:0/931687415 >> 172.21.15.59:0/931687415 conn(0x7f4f2c067080 msgr2=0x7f4f2c0adf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 -- 172.21.15.59:0/931687415 shutdown_connections 2024-04-25T09:03:29.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.639+0000 7f4f32a00640 1 -- 172.21.15.59:0/931687415 wait complete. 2024-04-25T09:03:29.650 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:03:29.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.799+0000 7fb26b800640 1 Processor -- start 2024-04-25T09:03:29.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.799+0000 7fb26b800640 1 -- start start 2024-04-25T09:03:29.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb26b800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb264141d20 0x7fb26415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb26b800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb2640af140 0x7fb26406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb26b800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb26406ae60 con 0x7fb26406e010 2024-04-25T09:03:29.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb26b800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26406ac10 con 0x7fb264141d20 2024-04-25T09:03:29.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb26b800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb26406b140 con 0x7fb2640af140 2024-04-25T09:03:29.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb269800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb26406e010 0x7fb2640acda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46760/0 (socket says 172.21.15.59:46760) 2024-04-25T09:03:29.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb269800640 1 -- 172.21.15.59:0/3616201948 learned_addr learned my addr 172.21.15.59:0/3616201948 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:29.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb268e00640 1 --2- 172.21.15.59:0/3616201948 >> v2:172.21.15.59:3300/0 conn(0x7fb264141d20 0x7fb26415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb25be00640 1 --2- 172.21.15.59:0/3616201948 >> v2:172.21.15.178:3300/0 conn(0x7fb2640af140 0x7fb26406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb268e00640 1 -- 172.21.15.59:0/3616201948 >> v2:172.21.15.178:3300/0 conn(0x7fb2640af140 msgr2=0x7fb26406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb268e00640 1 --2- 172.21.15.59:0/3616201948 >> v2:172.21.15.178:3300/0 conn(0x7fb2640af140 0x7fb26406dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb268e00640 1 -- 172.21.15.59:0/3616201948 >> v1:172.21.15.59:6789/0 conn(0x7fb26406e010 legacy=0x7fb2640acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.803+0000 7fb268e00640 1 -- 172.21.15.59:0/3616201948 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26406b420 con 0x7fb264141d20 2024-04-25T09:03:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb268e00640 1 --2- 172.21.15.59:0/3616201948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb264141d20 0x7fb26415c8a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb2540097c0 tx=0x7fb25401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4364e0ee1a441a86 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb263e00640 1 -- 172.21.15.59:0/3616201948 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540b0070 con 0x7fb264141d20 2024-04-25T09:03:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb263e00640 1 -- 172.21.15.59:0/3616201948 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2540ab600 con 0x7fb264141d20 2024-04-25T09:03:29.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb263e00640 1 -- 172.21.15.59:0/3616201948 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2640af730 con 0x7fb264141d20 2024-04-25T09:03:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb26b800640 1 -- 172.21.15.59:0/3616201948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb264141d20 msgr2=0x7fb26415c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb26b800640 1 --2- 172.21.15.59:0/3616201948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb264141d20 0x7fb26415c8a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb2540097c0 tx=0x7fb25401c3d0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb26b800640 1 -- 172.21.15.59:0/3616201948 shutdown_connections 2024-04-25T09:03:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb26b800640 1 --2- 172.21.15.59:0/3616201948 >> v2:172.21.15.178:3300/0 conn(0x7fb2640af140 0x7fb26406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb26b800640 1 --2- 172.21.15.59:0/3616201948 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb264141d20 0x7fb26415c8a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb26b800640 1 -- 172.21.15.59:0/3616201948 >> 172.21.15.59:0/3616201948 conn(0x7fb2640b23b0 msgr2=0x7fb2640cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb26b800640 1 -- 172.21.15.59:0/3616201948 shutdown_connections 2024-04-25T09:03:29.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb26b800640 1 -- 172.21.15.59:0/3616201948 wait complete. 2024-04-25T09:03:29.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb26b800640 1 Processor -- start 2024-04-25T09:03:29.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.807+0000 7fb26b800640 1 -- start start 2024-04-25T09:03:29.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb26b800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2640af140 0x7fb264159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb26b800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb264141d20 0x7fb264157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb26b800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2641448a0 0x7fb26406e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb26b800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640ad4b0 con 0x7fb2640af140 2024-04-25T09:03:29.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb26b800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26406c640 con 0x7fb2641448a0 2024-04-25T09:03:29.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb26b800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640ad630 con 0x7fb264141d20 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb268e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2640af140 0x7fb264159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb268e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2640af140 0x7fb264159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46168/0 (socket says 172.21.15.59:46168) 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb268e00640 1 -- 172.21.15.59:0/4286386414 learned_addr learned my addr 172.21.15.59:0/4286386414 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb25be00640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb264141d20 0x7fb264157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb269800640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2641448a0 0x7fb26406e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb268e00640 1 -- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb264141d20 msgr2=0x7fb264157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb268e00640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb264141d20 0x7fb264157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb268e00640 1 -- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2641448a0 msgr2=0x7fb26406e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb268e00640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2641448a0 0x7fb26406e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb268e00640 1 -- 172.21.15.59:0/4286386414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2640cc5c0 con 0x7fb2640af140 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb269800640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2641448a0 0x7fb26406e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb268e00640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2640af140 0x7fb264159010 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb2540ae040 tx=0x7fb25401ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb261600640 1 -- 172.21.15.59:0/4286386414 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540b0050 con 0x7fb2640af140 2024-04-25T09:03:29.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb261600640 1 -- 172.21.15.59:0/4286386414 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2540bc070 con 0x7fb2640af140 2024-04-25T09:03:29.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb261600640 1 -- 172.21.15.59:0/4286386414 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540b5870 con 0x7fb2640af140 2024-04-25T09:03:29.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb26b800640 1 -- 172.21.15.59:0/4286386414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2641450f0 con 0x7fb2640af140 2024-04-25T09:03:29.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb26b800640 1 -- 172.21.15.59:0/4286386414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2640ccb60 con 0x7fb2640af140 2024-04-25T09:03:29.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb26b800640 1 -- 172.21.15.59:0/4286386414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2640745d0 con 0x7fb2640af140 2024-04-25T09:03:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.811+0000 7fb261600640 1 -- 172.21.15.59:0/4286386414 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb2540b5a10 con 0x7fb2640af140 2024-04-25T09:03:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.815+0000 7fb261600640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb240066f60 0x7fb240069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.815+0000 7fb261600640 1 -- 172.21.15.59:0/4286386414 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb25411f6a0 con 0x7fb2640af140 2024-04-25T09:03:29.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.815+0000 7fb25be00640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb240066f60 0x7fb240069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:29.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.815+0000 7fb25be00640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb240066f60 0x7fb240069420 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb26406f870 tx=0x7fb24c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:29.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.819+0000 7fb261600640 1 -- 172.21.15.59:0/4286386414 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb254016050 con 0x7fb2640af140 2024-04-25T09:03:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.983+0000 7fb26b800640 1 -- 172.21.15.59:0/4286386414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb2640d0960 con 0x7fb2640af140 2024-04-25T09:03:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.983+0000 7fb261600640 1 -- 172.21.15.59:0/4286386414 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb2540f07d0 con 0x7fb2640af140 2024-04-25T09:03:29.976 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:29.976 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T09:03:29.976 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:29.977 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-04-25T09:03:29.977 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-04-25T09:03:29.977 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:29.977 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T09:03:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.987+0000 7fb26b800640 1 -- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb240066f60 msgr2=0x7fb240069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.987+0000 7fb26b800640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb240066f60 0x7fb240069420 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb26406f870 tx=0x7fb24c008040 comp rx=0 tx=0).stop 2024-04-25T09:03:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.987+0000 7fb26b800640 1 -- 172.21.15.59:0/4286386414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2640af140 msgr2=0x7fb264159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.987+0000 7fb26b800640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2640af140 0x7fb264159010 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fb2540ae040 tx=0x7fb25401ac10 comp rx=0 tx=0).stop 2024-04-25T09:03:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.987+0000 7fb26b800640 1 -- 172.21.15.59:0/4286386414 shutdown_connections 2024-04-25T09:03:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.987+0000 7fb26b800640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb240066f60 0x7fb240069420 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.987+0000 7fb26b800640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2641448a0 0x7fb26406e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.987+0000 7fb26b800640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb264141d20 0x7fb264157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.987+0000 7fb26b800640 1 --2- 172.21.15.59:0/4286386414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2640af140 0x7fb264159010 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.987+0000 7fb26b800640 1 -- 172.21.15.59:0/4286386414 >> 172.21.15.59:0/4286386414 conn(0x7fb2640b23b0 msgr2=0x7fb2641378e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.987+0000 7fb26b800640 1 -- 172.21.15.59:0/4286386414 shutdown_connections 2024-04-25T09:03:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:29.987+0000 7fb26b800640 1 -- 172.21.15.59:0/4286386414 wait complete. 2024-04-25T09:03:29.999 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:03:30.000 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:03:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.151+0000 7f83c0800640 1 Processor -- start 2024-04-25T09:03:30.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.151+0000 7f83c0800640 1 -- start start 2024-04-25T09:03:30.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.155+0000 7f83c0800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83b8071250 0x7f83b80cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.155+0000 7f83c0800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b815ccc0 con 0x7f83b815c4a0 2024-04-25T09:03:30.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.155+0000 7f83c0800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b8160200 con 0x7f83b8071630 2024-04-25T09:03:30.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.155+0000 7f83c0800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b815c9e0 con 0x7f83b8071250 2024-04-25T09:03:30.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.155+0000 7f83be800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f83b815c4a0 0x7f83b815cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46768/0 (socket says 172.21.15.59:46768) 2024-04-25T09:03:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.155+0000 7f83be800640 1 -- 172.21.15.59:0/74500368 learned_addr learned my addr 172.21.15.59:0/74500368 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.155+0000 7f83bde00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f83b8071250 0x7f83b80cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.155+0000 7f83bca00640 1 -- 172.21.15.59:0/74500368 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1377571696 0 0) 0x7f83b815ccc0 con 0x7f83b815c4a0 2024-04-25T09:03:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.155+0000 7f83bca00640 1 -- 172.21.15.59:0/74500368 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a0003530 con 0x7f83b815c4a0 2024-04-25T09:03:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.155+0000 7f83bde00640 1 -- 172.21.15.59:0/74500368 >> v1:172.21.15.178:6789/0 conn(0x7f83b8071630 legacy=0x7f83b815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.155+0000 7f83bde00640 1 -- 172.21.15.59:0/74500368 >> v1:172.21.15.59:6789/0 conn(0x7f83b815c4a0 legacy=0x7f83b815cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.155+0000 7f83bde00640 1 -- 172.21.15.59:0/74500368 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b80cd4b0 con 0x7f83b8071250 2024-04-25T09:03:30.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83bde00640 1 --2- 172.21.15.59:0/74500368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b8071250 0x7f83b80cdf90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0097c0 tx=0x7f83ac01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0c16b3b71d0867 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83bca00640 1 -- 172.21.15.59:0/74500368 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac0b0070 con 0x7f83b8071250 2024-04-25T09:03:30.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83bca00640 1 -- 172.21.15.59:0/74500368 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac0ab600 con 0x7f83b8071250 2024-04-25T09:03:30.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83bca00640 1 -- 172.21.15.59:0/74500368 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac0ab9d0 con 0x7f83b8071250 2024-04-25T09:03:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83c0800640 1 -- 172.21.15.59:0/74500368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b8071250 msgr2=0x7f83b80cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83c0800640 1 --2- 172.21.15.59:0/74500368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b8071250 0x7f83b80cdf90 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0097c0 tx=0x7f83ac01c380 comp rx=0 tx=0).stop 2024-04-25T09:03:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83c0800640 1 -- 172.21.15.59:0/74500368 shutdown_connections 2024-04-25T09:03:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83c0800640 1 --2- 172.21.15.59:0/74500368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b8071250 0x7f83b80cdf90 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83c0800640 1 -- 172.21.15.59:0/74500368 >> 172.21.15.59:0/74500368 conn(0x7f83b806ac10 msgr2=0x7f83b806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83c0800640 1 -- 172.21.15.59:0/74500368 shutdown_connections 2024-04-25T09:03:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83c0800640 1 -- 172.21.15.59:0/74500368 wait complete. 2024-04-25T09:03:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83c0800640 1 Processor -- start 2024-04-25T09:03:30.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.159+0000 7f83c0800640 1 -- start start 2024-04-25T09:03:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83c0800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b8071250 0x7f83b81475c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83c0800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b8071630 0x7f83b814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83c0800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b815c4a0 0x7f83b8147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83c0800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b8169630 con 0x7f83b815c4a0 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83c0800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b81694b0 con 0x7f83b8071250 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83c0800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b81697b0 con 0x7f83b8071630 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83be800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b815c4a0 0x7f83b8147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83bde00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b8071250 0x7f83b81475c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83be800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b815c4a0 0x7f83b8147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46192/0 (socket says 172.21.15.59:46192) 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83bde00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b8071250 0x7f83b81475c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:42096/0 (socket says 172.21.15.59:42096) 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83be800640 1 -- 172.21.15.59:0/2121314484 learned_addr learned my addr 172.21.15.59:0/2121314484 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83bd400640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b8071630 0x7f83b814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83be800640 1 -- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b8071630 msgr2=0x7f83b814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83be800640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b8071630 0x7f83b814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83be800640 1 -- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b8071250 msgr2=0x7f83b81475c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83be800640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b8071250 0x7f83b81475c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83be800640 1 -- 172.21.15.59:0/2121314484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8147b00 con 0x7f83b815c4a0 2024-04-25T09:03:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83be800640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b815c4a0 0x7f83b8147d00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f83b400cae0 tx=0x7f83b400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83b2000640 1 -- 172.21.15.59:0/2121314484 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4017070 con 0x7f83b815c4a0 2024-04-25T09:03:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83b2000640 1 -- 172.21.15.59:0/2121314484 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b400ac40 con 0x7f83b815c4a0 2024-04-25T09:03:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83b2000640 1 -- 172.21.15.59:0/2121314484 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b4012600 con 0x7f83b815c4a0 2024-04-25T09:03:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83c0800640 1 -- 172.21.15.59:0/2121314484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b8155dc0 con 0x7f83b815c4a0 2024-04-25T09:03:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83c0800640 1 -- 172.21.15.59:0/2121314484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b814c330 con 0x7f83b815c4a0 2024-04-25T09:03:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83c0800640 1 -- 172.21.15.59:0/2121314484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b80745d0 con 0x7f83b815c4a0 2024-04-25T09:03:30.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.163+0000 7f83b2000640 1 -- 172.21.15.59:0/2121314484 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f83b401a070 con 0x7f83b815c4a0 2024-04-25T09:03:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.167+0000 7f83b2000640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f839c066f60 0x7f839c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.167+0000 7f83b2000640 1 -- 172.21.15.59:0/2121314484 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f83b4084b10 con 0x7f83b815c4a0 2024-04-25T09:03:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.167+0000 7f83bde00640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f839c066f60 0x7f839c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.167+0000 7f83bde00640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f839c066f60 0x7f839c069420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0ad000 tx=0x7f83ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.171+0000 7f83b2000640 1 -- 172.21.15.59:0/2121314484 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f83b8147b00 con 0x7f83b815c4a0 2024-04-25T09:03:30.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.335+0000 7f83c0800640 1 -- 172.21.15.59:0/2121314484 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f83b80ae020 con 0x7f83b815c4a0 2024-04-25T09:03:30.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.543+0000 7f83b2000640 1 -- 172.21.15.59:0/2121314484 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) v1 ==== 138+0+0 (secure 0 0 0) 0x7f83b40555f0 con 0x7f83b815c4a0 2024-04-25T09:03:30.535 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-04-25T09:03:30.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.547+0000 7f83c0800640 1 -- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f839c066f60 msgr2=0x7f839c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.547+0000 7f83c0800640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f839c066f60 0x7f839c069420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0ad000 tx=0x7f83ac008040 comp rx=0 tx=0).stop 2024-04-25T09:03:30.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.547+0000 7f83c0800640 1 -- 172.21.15.59:0/2121314484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b815c4a0 msgr2=0x7f83b8147d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.547+0000 7f83c0800640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b815c4a0 0x7f83b8147d00 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f83b400cae0 tx=0x7f83b400a060 comp rx=0 tx=0).stop 2024-04-25T09:03:30.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.547+0000 7f83c0800640 1 -- 172.21.15.59:0/2121314484 shutdown_connections 2024-04-25T09:03:30.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.547+0000 7f83c0800640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f839c066f60 0x7f839c069420 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.547+0000 7f83c0800640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83b815c4a0 0x7f83b8147d00 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.547+0000 7f83c0800640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83b8071630 0x7f83b814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.547+0000 7f83c0800640 1 --2- 172.21.15.59:0/2121314484 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83b8071250 0x7f83b81475c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.547+0000 7f83c0800640 1 -- 172.21.15.59:0/2121314484 >> 172.21.15.59:0/2121314484 conn(0x7f83b806ac10 msgr2=0x7f83b806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.547+0000 7f83c0800640 1 -- 172.21.15.59:0/2121314484 shutdown_connections 2024-04-25T09:03:30.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.547+0000 7f83c0800640 1 -- 172.21.15.59:0/2121314484 wait complete. 2024-04-25T09:03:30.563 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:03:30.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.719+0000 7fdd17e00640 1 Processor -- start 2024-04-25T09:03:30.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.719+0000 7fdd17e00640 1 -- start start 2024-04-25T09:03:30.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd17e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdd1815eff0 0x7fdd180b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd17e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd180cf800 0x7fdd180cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd17e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd180cc150 con 0x7fdd1815fed0 2024-04-25T09:03:30.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd17e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180ccd00 con 0x7fdd180cf800 2024-04-25T09:03:30.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd17e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180d0150 con 0x7fdd1815eff0 2024-04-25T09:03:30.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd17400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd180cf800 0x7fdd180cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd17400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd180cf800 0x7fdd180cfc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47666/0 (socket says 172.21.15.59:47666) 2024-04-25T09:03:30.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd17400640 1 -- 172.21.15.59:0/3640121573 learned_addr learned my addr 172.21.15.59:0/3640121573 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:30.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd16a00640 1 --2- 172.21.15.59:0/3640121573 >> v2:172.21.15.178:3300/0 conn(0x7fdd1815eff0 0x7fdd180b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd17400640 1 -- 172.21.15.59:0/3640121573 >> v2:172.21.15.178:3300/0 conn(0x7fdd1815eff0 msgr2=0x7fdd180b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:30.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd17400640 1 --2- 172.21.15.59:0/3640121573 >> v2:172.21.15.178:3300/0 conn(0x7fdd1815eff0 0x7fdd180b0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd17400640 1 -- 172.21.15.59:0/3640121573 >> v1:172.21.15.178:6789/0 conn(0x7fdd1815fed0 legacy=0x7fdd180cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd17400640 1 -- 172.21.15.59:0/3640121573 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd180cc3d0 con 0x7fdd180cf800 2024-04-25T09:03:30.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.723+0000 7fdd16a00640 1 --2- 172.21.15.59:0/3640121573 >> v2:172.21.15.178:3300/0 conn(0x7fdd1815eff0 0x7fdd180b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:30.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd17400640 1 --2- 172.21.15.59:0/3640121573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180cf800 0x7fdd180cfc10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdd18067980 tx=0x7fdd1001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304e2ff7f9267a89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd16000640 1 -- 172.21.15.59:0/3640121573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd100a57a0 con 0x7fdd180cf800 2024-04-25T09:03:30.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd16000640 1 -- 172.21.15.59:0/3640121573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd100a5940 con 0x7fdd180cf800 2024-04-25T09:03:30.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd16000640 1 -- 172.21.15.59:0/3640121573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd100a5d10 con 0x7fdd180cf800 2024-04-25T09:03:30.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd17e00640 1 -- 172.21.15.59:0/3640121573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180cf800 msgr2=0x7fdd180cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd17e00640 1 --2- 172.21.15.59:0/3640121573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180cf800 0x7fdd180cfc10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdd18067980 tx=0x7fdd1001c9f0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd17e00640 1 -- 172.21.15.59:0/3640121573 shutdown_connections 2024-04-25T09:03:30.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd17e00640 1 --2- 172.21.15.59:0/3640121573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180cf800 0x7fdd180cfc10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd17e00640 1 --2- 172.21.15.59:0/3640121573 >> v2:172.21.15.178:3300/0 conn(0x7fdd1815eff0 0x7fdd180b0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd17e00640 1 -- 172.21.15.59:0/3640121573 >> 172.21.15.59:0/3640121573 conn(0x7fdd180d1540 msgr2=0x7fdd180d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:30.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd17e00640 1 -- 172.21.15.59:0/3640121573 shutdown_connections 2024-04-25T09:03:30.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd17e00640 1 -- 172.21.15.59:0/3640121573 wait complete. 2024-04-25T09:03:30.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd17e00640 1 Processor -- start 2024-04-25T09:03:30.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.727+0000 7fdd17e00640 1 -- start start 2024-04-25T09:03:30.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd17e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd180cf800 0x7fdd18157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd17e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd1815eff0 0x7fdd1815b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd17e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd1815fed0 0x7fdd180b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd17e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180b1830 con 0x7fdd1815eff0 2024-04-25T09:03:30.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd17e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180b16b0 con 0x7fdd1815fed0 2024-04-25T09:03:30.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd17e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180b19b0 con 0x7fdd180cf800 2024-04-25T09:03:30.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd1815eff0 0x7fdd1815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd1815eff0 0x7fdd1815b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47672/0 (socket says 172.21.15.59:47672) 2024-04-25T09:03:30.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0e000640 1 -- 172.21.15.59:0/3616572112 learned_addr learned my addr 172.21.15.59:0/3616572112 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:30.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd16a00640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd180cf800 0x7fdd18157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd17400640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd1815fed0 0x7fdd180b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0e000640 1 -- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd180cf800 msgr2=0x7fdd18157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0e000640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd180cf800 0x7fdd18157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0e000640 1 -- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd1815fed0 msgr2=0x7fdd180b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:30.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0e000640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd1815fed0 0x7fdd180b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:30.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0e000640 1 -- 172.21.15.59:0/3616572112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd181596b0 con 0x7fdd1815eff0 2024-04-25T09:03:30.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0e000640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd1815eff0 0x7fdd1815b360 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c420 tx=0x7fdd0000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0f400640 1 -- 172.21.15.59:0/3616572112 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000052d0 con 0x7fdd1815eff0 2024-04-25T09:03:30.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0f400640 1 -- 172.21.15.59:0/3616572112 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd00005470 con 0x7fdd1815eff0 2024-04-25T09:03:30.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0f400640 1 -- 172.21.15.59:0/3616572112 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00007260 con 0x7fdd1815eff0 2024-04-25T09:03:30.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd17e00640 1 -- 172.21.15.59:0/3616572112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd18158e10 con 0x7fdd1815eff0 2024-04-25T09:03:30.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd17e00640 1 -- 172.21.15.59:0/3616572112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd181593d0 con 0x7fdd1815eff0 2024-04-25T09:03:30.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd17e00640 1 -- 172.21.15.59:0/3616572112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd1804efa0 con 0x7fdd1815eff0 2024-04-25T09:03:30.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.730+0000 7fdd0f400640 1 -- 172.21.15.59:0/3616572112 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdd00007400 con 0x7fdd1815eff0 2024-04-25T09:03:30.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.734+0000 7fdd0f400640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdcf4066f60 0x7fdcf4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:30.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.734+0000 7fdd0f400640 1 -- 172.21.15.59:0/3616572112 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fdd00084bc0 con 0x7fdd1815eff0 2024-04-25T09:03:30.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.734+0000 7fdd16a00640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdcf4066f60 0x7fdcf4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:30.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.734+0000 7fdd16a00640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdcf4066f60 0x7fdcf4069420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdd180b7490 tx=0x7fdd08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:30.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.738+0000 7fdd0f400640 1 -- 172.21.15.59:0/3616572112 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd180cc150 con 0x7fdd1815eff0 2024-04-25T09:03:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:30.902+0000 7fdd17e00640 1 -- 172.21.15.59:0/3616572112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdd1806f010 con 0x7fdd1815eff0 2024-04-25T09:03:31.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.550+0000 7fdd0f400640 1 -- 172.21.15.59:0/3616572112 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdd000556b0 con 0x7fdd1815eff0 2024-04-25T09:03:31.543 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-04-25T09:03:31.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.554+0000 7fdd17e00640 1 -- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdcf4066f60 msgr2=0x7fdcf4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.554+0000 7fdd17e00640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdcf4066f60 0x7fdcf4069420 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdd180b7490 tx=0x7fdd08008040 comp rx=0 tx=0).stop 2024-04-25T09:03:31.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.554+0000 7fdd17e00640 1 -- 172.21.15.59:0/3616572112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd1815eff0 msgr2=0x7fdd1815b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.554+0000 7fdd17e00640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd1815eff0 0x7fdd1815b360 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c420 tx=0x7fdd0000c8e0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.554+0000 7fdd17e00640 1 -- 172.21.15.59:0/3616572112 shutdown_connections 2024-04-25T09:03:31.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.554+0000 7fdd17e00640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdcf4066f60 0x7fdcf4069420 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.554+0000 7fdd17e00640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd1815fed0 0x7fdd180b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.554+0000 7fdd17e00640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd1815eff0 0x7fdd1815b360 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.554+0000 7fdd17e00640 1 --2- 172.21.15.59:0/3616572112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd180cf800 0x7fdd18157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.554+0000 7fdd17e00640 1 -- 172.21.15.59:0/3616572112 >> 172.21.15.59:0/3616572112 conn(0x7fdd180d1540 msgr2=0x7fdd1806fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.554+0000 7fdd17e00640 1 -- 172.21.15.59:0/3616572112 shutdown_connections 2024-04-25T09:03:31.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.554+0000 7fdd17e00640 1 -- 172.21.15.59:0/3616572112 wait complete. 2024-04-25T09:03:31.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:03:31.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a3600640 1 Processor -- start 2024-04-25T09:03:31.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a3600640 1 -- start start 2024-04-25T09:03:31.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a3600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c159320 0x7f509c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a3600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f509c06e4a0 0x7f509c06e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a3600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c15fc00 con 0x7f509c15f440 2024-04-25T09:03:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a3600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c06d640 con 0x7f509c06e4a0 2024-04-25T09:03:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a3600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c15fee0 con 0x7f509c159320 2024-04-25T09:03:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f509be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f509c15f440 0x7f509c06dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45952/0 (socket says 172.21.15.59:45952) 2024-04-25T09:03:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f509be00640 1 -- 172.21.15.59:0/4276584105 learned_addr learned my addr 172.21.15.59:0/4276584105 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a0c00640 1 --2- 172.21.15.59:0/4276584105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c159320 0x7f509c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a1600640 1 --2- 172.21.15.59:0/4276584105 >> v2:172.21.15.178:3300/0 conn(0x7f509c06e4a0 0x7f509c06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f509b400640 1 -- 172.21.15.59:0/4276584105 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1190849110 0 0) 0x7f509c15fc00 con 0x7f509c15f440 2024-04-25T09:03:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f509b400640 1 -- 172.21.15.59:0/4276584105 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5084003530 con 0x7f509c15f440 2024-04-25T09:03:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a0c00640 1 -- 172.21.15.59:0/4276584105 >> v2:172.21.15.178:3300/0 conn(0x7f509c06e4a0 msgr2=0x7f509c06e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a0c00640 1 --2- 172.21.15.59:0/4276584105 >> v2:172.21.15.178:3300/0 conn(0x7f509c06e4a0 0x7f509c06e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a0c00640 1 -- 172.21.15.59:0/4276584105 >> v1:172.21.15.59:6789/0 conn(0x7f509c15f440 legacy=0x7f509c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.742+0000 7f50a0c00640 1 -- 172.21.15.59:0/4276584105 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c1601c0 con 0x7f509c159320 2024-04-25T09:03:31.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.746+0000 7f50a0c00640 1 --2- 172.21.15.59:0/4276584105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c159320 0x7f509c15c9b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f50900097c0 tx=0x7f509001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a85af8973783da87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.746+0000 7f509b400640 1 -- 172.21.15.59:0/4276584105 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900b0070 con 0x7f509c159320 2024-04-25T09:03:31.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.746+0000 7f509b400640 1 -- 172.21.15.59:0/4276584105 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50900ab600 con 0x7f509c159320 2024-04-25T09:03:31.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.746+0000 7f509b400640 1 -- 172.21.15.59:0/4276584105 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900ab9d0 con 0x7f509c159320 2024-04-25T09:03:31.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.746+0000 7f50a3600640 1 -- 172.21.15.59:0/4276584105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c159320 msgr2=0x7f509c15c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.746+0000 7f50a3600640 1 --2- 172.21.15.59:0/4276584105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c159320 0x7f509c15c9b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f50900097c0 tx=0x7f509001c410 comp rx=0 tx=0).stop 2024-04-25T09:03:31.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.746+0000 7f50a3600640 1 -- 172.21.15.59:0/4276584105 shutdown_connections 2024-04-25T09:03:31.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.746+0000 7f50a3600640 1 --2- 172.21.15.59:0/4276584105 >> v2:172.21.15.178:3300/0 conn(0x7f509c06e4a0 0x7f509c06e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.746+0000 7f50a3600640 1 --2- 172.21.15.59:0/4276584105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c159320 0x7f509c15c9b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.746+0000 7f50a3600640 1 -- 172.21.15.59:0/4276584105 >> 172.21.15.59:0/4276584105 conn(0x7f509c067080 msgr2=0x7f509c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:31.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.746+0000 7f50a3600640 1 -- 172.21.15.59:0/4276584105 shutdown_connections 2024-04-25T09:03:31.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.746+0000 7f50a3600640 1 -- 172.21.15.59:0/4276584105 wait complete. 2024-04-25T09:03:31.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f50a3600640 1 Processor -- start 2024-04-25T09:03:31.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f50a3600640 1 -- start start 2024-04-25T09:03:31.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f50a3600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f509c06e4a0 0x7f509c144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f50a3600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f509c159320 0x7f509c144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f50a3600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c15f440 0x7f509c0b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f50a3600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c15f9a0 con 0x7f509c159320 2024-04-25T09:03:31.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f50a3600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c15f820 con 0x7f509c06e4a0 2024-04-25T09:03:31.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f50a3600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c168590 con 0x7f509c15f440 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f509be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f509c159320 0x7f509c144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f509be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f509c159320 0x7f509c144ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47688/0 (socket says 172.21.15.59:47688) 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f509be00640 1 -- 172.21.15.59:0/1138727949 learned_addr learned my addr 172.21.15.59:0/1138727949 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f50a1600640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c15f440 0x7f509c0b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f50a0c00640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f509c06e4a0 0x7f509c144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f509be00640 1 -- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c15f440 msgr2=0x7f509c0b02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f509be00640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c15f440 0x7f509c0b02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f509be00640 1 -- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f509c06e4a0 msgr2=0x7f509c144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f509be00640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f509c06e4a0 0x7f509c144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f509be00640 1 -- 172.21.15.59:0/1138727949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c1450e0 con 0x7f509c159320 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f509be00640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f509c159320 0x7f509c144ab0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f508800c450 tx=0x7f508800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f5098c00640 1 -- 172.21.15.59:0/1138727949 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088017070 con 0x7f509c159320 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f5098c00640 1 -- 172.21.15.59:0/1138727949 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5088005cf0 con 0x7f509c159320 2024-04-25T09:03:31.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f50a3600640 1 -- 172.21.15.59:0/1138727949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509c1453c0 con 0x7f509c159320 2024-04-25T09:03:31.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f5098c00640 1 -- 172.21.15.59:0/1138727949 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088007290 con 0x7f509c159320 2024-04-25T09:03:31.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.750+0000 7f50a3600640 1 -- 172.21.15.59:0/1138727949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c13cc10 con 0x7f509c159320 2024-04-25T09:03:31.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.754+0000 7f50a3600640 1 -- 172.21.15.59:0/1138727949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509c0745d0 con 0x7f509c159320 2024-04-25T09:03:31.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.754+0000 7f5098c00640 1 -- 172.21.15.59:0/1138727949 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f508801a070 con 0x7f509c159320 2024-04-25T09:03:31.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.754+0000 7f5098c00640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f507c066f60 0x7f507c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:31.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.754+0000 7f5098c00640 1 -- 172.21.15.59:0/1138727949 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f5088084630 con 0x7f509c159320 2024-04-25T09:03:31.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.754+0000 7f50a0c00640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f507c066f60 0x7f507c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:31.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.754+0000 7f50a0c00640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f507c066f60 0x7f507c069420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f50900ad000 tx=0x7f50900a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:31.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.758+0000 7f5098c00640 1 -- 172.21.15.59:0/1138727949 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f50880553f0 con 0x7f509c159320 2024-04-25T09:03:31.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:31.954+0000 7f50a3600640 1 -- 172.21.15.59:0/1138727949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f509c06f2a0 con 0x7f509c159320 2024-04-25T09:03:32.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.566+0000 7f5098c00640 1 -- 172.21.15.59:0/1138727949 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v24) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5088054cf0 con 0x7f509c159320 2024-04-25T09:03:32.563 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 7 and data pool 8 2024-04-25T09:03:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.574+0000 7f50a3600640 1 -- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f507c066f60 msgr2=0x7f507c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.574+0000 7f50a3600640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f507c066f60 0x7f507c069420 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f50900ad000 tx=0x7f50900a6000 comp rx=0 tx=0).stop 2024-04-25T09:03:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.574+0000 7f50a3600640 1 -- 172.21.15.59:0/1138727949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f509c159320 msgr2=0x7f509c144ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.574+0000 7f50a3600640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f509c159320 0x7f509c144ab0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f508800c450 tx=0x7f508800c910 comp rx=0 tx=0).stop 2024-04-25T09:03:32.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.582+0000 7f50a3600640 1 -- 172.21.15.59:0/1138727949 shutdown_connections 2024-04-25T09:03:32.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.582+0000 7f50a3600640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f507c066f60 0x7f507c069420 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.582+0000 7f50a3600640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f509c15f440 0x7f509c0b02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.582+0000 7f50a3600640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f509c159320 0x7f509c144ab0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.582+0000 7f50a3600640 1 --2- 172.21.15.59:0/1138727949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f509c06e4a0 0x7f509c144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.582+0000 7f50a3600640 1 -- 172.21.15.59:0/1138727949 >> 172.21.15.59:0/1138727949 conn(0x7f509c067080 msgr2=0x7f509c1599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:32.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.582+0000 7f50a3600640 1 -- 172.21.15.59:0/1138727949 shutdown_connections 2024-04-25T09:03:32.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.582+0000 7f50a3600640 1 -- 172.21.15.59:0/1138727949 wait complete. 2024-04-25T09:03:32.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:32.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.762+0000 7fca81800640 1 Processor -- start 2024-04-25T09:03:32.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.762+0000 7fca81800640 1 -- start start 2024-04-25T09:03:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca81800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca7c145270 0x7fca7c15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca81800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fca7c0b1e60 0x7fca7c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca81800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c0cc4e0 con 0x7fca7c0cd4d0 2024-04-25T09:03:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca81800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c145650 con 0x7fca7c145270 2024-04-25T09:03:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca81800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c0ce040 con 0x7fca7c0b1e60 2024-04-25T09:03:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca7aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca7c145270 0x7fca7c15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca7aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca7c145270 0x7fca7c15fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47704/0 (socket says 172.21.15.59:47704) 2024-04-25T09:03:32.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca7aa00640 1 -- 172.21.15.59:0/3822849580 learned_addr learned my addr 172.21.15.59:0/3822849580 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca7aa00640 1 -- 172.21.15.59:0/3822849580 >> v2:172.21.15.178:3300/0 conn(0x7fca7c0b1e60 msgr2=0x7fca7c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca7b400640 1 --2- 172.21.15.59:0/3822849580 >> v2:172.21.15.178:3300/0 conn(0x7fca7c0b1e60 0x7fca7c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca7aa00640 1 --2- 172.21.15.59:0/3822849580 >> v2:172.21.15.178:3300/0 conn(0x7fca7c0b1e60 0x7fca7c0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca7aa00640 1 -- 172.21.15.59:0/3822849580 >> v1:172.21.15.178:6789/0 conn(0x7fca7c0cd4d0 legacy=0x7fca7c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca7aa00640 1 -- 172.21.15.59:0/3822849580 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c0ce320 con 0x7fca7c145270 2024-04-25T09:03:32.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.766+0000 7fca7b400640 1 --2- 172.21.15.59:0/3822849580 >> v2:172.21.15.178:3300/0 conn(0x7fca7c0b1e60 0x7fca7c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:32.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca7aa00640 1 --2- 172.21.15.59:0/3822849580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7c145270 0x7fca7c15fe50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0b4b90 tx=0x7fca6c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec999f82010b6668 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca7a000640 1 -- 172.21.15.59:0/3822849580 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0b1070 con 0x7fca7c145270 2024-04-25T09:03:32.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca7a000640 1 -- 172.21.15.59:0/3822849580 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c0ac630 con 0x7fca7c145270 2024-04-25T09:03:32.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca7a000640 1 -- 172.21.15.59:0/3822849580 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0a8050 con 0x7fca7c145270 2024-04-25T09:03:32.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca81800640 1 -- 172.21.15.59:0/3822849580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7c145270 msgr2=0x7fca7c15fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca81800640 1 --2- 172.21.15.59:0/3822849580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7c145270 0x7fca7c15fe50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0b4b90 tx=0x7fca6c01c4e0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca81800640 1 -- 172.21.15.59:0/3822849580 shutdown_connections 2024-04-25T09:03:32.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca81800640 1 --2- 172.21.15.59:0/3822849580 >> v2:172.21.15.178:3300/0 conn(0x7fca7c0b1e60 0x7fca7c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca81800640 1 --2- 172.21.15.59:0/3822849580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7c145270 0x7fca7c15fe50 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca81800640 1 -- 172.21.15.59:0/3822849580 >> 172.21.15.59:0/3822849580 conn(0x7fca7c066fa0 msgr2=0x7fca7c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:32.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca81800640 1 -- 172.21.15.59:0/3822849580 shutdown_connections 2024-04-25T09:03:32.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca81800640 1 -- 172.21.15.59:0/3822849580 wait complete. 2024-04-25T09:03:32.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca81800640 1 Processor -- start 2024-04-25T09:03:32.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.770+0000 7fca81800640 1 -- start start 2024-04-25T09:03:32.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca81800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7c0b1e60 0x7fca7c0b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca81800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca7c0cd4d0 0x7fca7c15ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca81800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c145270 0x7fca7c15b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca81800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c15c710 con 0x7fca7c0b1e60 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca81800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c15c590 con 0x7fca7c145270 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca81800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c15c890 con 0x7fca7c0cd4d0 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca7aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7c0b1e60 0x7fca7c0b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca7aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7c0b1e60 0x7fca7c0b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47714/0 (socket says 172.21.15.59:47714) 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca7aa00640 1 -- 172.21.15.59:0/2253785662 learned_addr learned my addr 172.21.15.59:0/2253785662 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca72000640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca7c0cd4d0 0x7fca7c15ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca7b400640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c145270 0x7fca7c15b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca7aa00640 1 -- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca7c0cd4d0 msgr2=0x7fca7c15ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca7aa00640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca7c0cd4d0 0x7fca7c15ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca7aa00640 1 -- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c145270 msgr2=0x7fca7c15b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca7aa00640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c145270 0x7fca7c15b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca7aa00640 1 -- 172.21.15.59:0/2253785662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c13fee0 con 0x7fca7c0b1e60 2024-04-25T09:03:32.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca7aa00640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7c0b1e60 0x7fca7c0b29e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca6c01a110 tx=0x7fca6c019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca73400640 1 -- 172.21.15.59:0/2253785662 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0bc070 con 0x7fca7c0b1e60 2024-04-25T09:03:32.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca73400640 1 -- 172.21.15.59:0/2253785662 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c0ab800 con 0x7fca7c0b1e60 2024-04-25T09:03:32.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca81800640 1 -- 172.21.15.59:0/2253785662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c1401c0 con 0x7fca7c0b1e60 2024-04-25T09:03:32.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca73400640 1 -- 172.21.15.59:0/2253785662 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0b1070 con 0x7fca7c0b1e60 2024-04-25T09:03:32.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca81800640 1 -- 172.21.15.59:0/2253785662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c140780 con 0x7fca7c0b1e60 2024-04-25T09:03:32.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca81800640 1 -- 172.21.15.59:0/2253785662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c0745d0 con 0x7fca7c0b1e60 2024-04-25T09:03:32.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.774+0000 7fca73400640 1 -- 172.21.15.59:0/2253785662 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fca6c0bf070 con 0x7fca7c0b1e60 2024-04-25T09:03:32.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.778+0000 7fca73400640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca58066f60 0x7fca58069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:32.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.778+0000 7fca73400640 1 -- 172.21.15.59:0/2253785662 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fca6c11eab0 con 0x7fca7c0b1e60 2024-04-25T09:03:32.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.778+0000 7fca72000640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca58066f60 0x7fca58069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:32.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.778+0000 7fca72000640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca58066f60 0x7fca58069420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0ae9d0 tx=0x7fca64007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:32.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.782+0000 7fca73400640 1 -- 172.21.15.59:0/2253785662 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fca6c0160d0 con 0x7fca7c0b1e60 2024-04-25T09:03:32.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 -- 172.21.15.59:0/2253785662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca7c141ca0 con 0x7fca7c0b1e60 2024-04-25T09:03:32.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca73400640 1 -- 172.21.15.59:0/2253785662 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16955 (secure 0 0 0) 0x7fca6c0ef250 con 0x7fca7c0b1e60 2024-04-25T09:03:32.942 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:32.942 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":51,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:03:31.959453+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.385704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:30.953332+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 -- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca58066f60 msgr2=0x7fca58069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca58066f60 0x7fca58069420 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0ae9d0 tx=0x7fca64007e40 comp rx=0 tx=0).stop 2024-04-25T09:03:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 -- 172.21.15.59:0/2253785662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7c0b1e60 msgr2=0x7fca7c0b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7c0b1e60 0x7fca7c0b29e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca6c01a110 tx=0x7fca6c019280 comp rx=0 tx=0).stop 2024-04-25T09:03:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 -- 172.21.15.59:0/2253785662 shutdown_connections 2024-04-25T09:03:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fca58066f60 0x7fca58069420 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca7c145270 0x7fca7c15b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca7c0cd4d0 0x7fca7c15ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 --2- 172.21.15.59:0/2253785662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca7c0b1e60 0x7fca7c0b29e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 -- 172.21.15.59:0/2253785662 >> 172.21.15.59:0/2253785662 conn(0x7fca7c066fa0 msgr2=0x7fca7c0b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:32.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 -- 172.21.15.59:0/2253785662 shutdown_connections 2024-04-25T09:03:32.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:32.950+0000 7fca81800640 1 -- 172.21.15.59:0/2253785662 wait complete. 2024-04-25T09:03:32.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:33.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.110+0000 7fc9ef800640 1 Processor -- start 2024-04-25T09:03:33.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.110+0000 7fc9ef800640 1 -- start start 2024-04-25T09:03:33.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9ef800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc9e8144140 0x7fc9e80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9ef800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9e80ced60 0x7fc9e806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9ef800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e806e900 0x7fc9e815e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9ef800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e806ed70 con 0x7fc9e80ced60 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9ef800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9e815ac60 con 0x7fc9e8144140 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9ef800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e80cf3e0 con 0x7fc9e806e900 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9e7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9e80ced60 0x7fc9e806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9e7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc9e80ced60 0x7fc9e806e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47724/0 (socket says 172.21.15.59:47724) 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9e7e00640 1 -- 172.21.15.59:0/537134805 learned_addr learned my addr 172.21.15.59:0/537134805 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9ece00640 1 --2- 172.21.15.59:0/537134805 >> v2:172.21.15.178:3300/0 conn(0x7fc9e8144140 0x7fc9e80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9ed800640 1 --2- 172.21.15.59:0/537134805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e806e900 0x7fc9e815e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9e7e00640 1 -- 172.21.15.59:0/537134805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e806e900 msgr2=0x7fc9e815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9e7e00640 1 --2- 172.21.15.59:0/537134805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e806e900 0x7fc9e815e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9e7e00640 1 -- 172.21.15.59:0/537134805 >> v2:172.21.15.178:3300/0 conn(0x7fc9e8144140 msgr2=0x7fc9e80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9e7e00640 1 --2- 172.21.15.59:0/537134805 >> v2:172.21.15.178:3300/0 conn(0x7fc9e8144140 0x7fc9e80ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.114+0000 7fc9e7e00640 1 -- 172.21.15.59:0/537134805 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e815af20 con 0x7fc9e80ced60 2024-04-25T09:03:33.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9e7e00640 1 --2- 172.21.15.59:0/537134805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ced60 0x7fc9e806e3c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc9e806eef0 tx=0x7fc9d401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbceea99abebfd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9e7400640 1 -- 172.21.15.59:0/537134805 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40b0070 con 0x7fc9e80ced60 2024-04-25T09:03:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9e7400640 1 -- 172.21.15.59:0/537134805 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d40ab600 con 0x7fc9e80ced60 2024-04-25T09:03:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9e7400640 1 -- 172.21.15.59:0/537134805 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40ab9d0 con 0x7fc9e80ced60 2024-04-25T09:03:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 -- 172.21.15.59:0/537134805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ced60 msgr2=0x7fc9e806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 --2- 172.21.15.59:0/537134805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ced60 0x7fc9e806e3c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc9e806eef0 tx=0x7fc9d401c260 comp rx=0 tx=0).stop 2024-04-25T09:03:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 -- 172.21.15.59:0/537134805 shutdown_connections 2024-04-25T09:03:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 --2- 172.21.15.59:0/537134805 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e806e900 0x7fc9e815e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 --2- 172.21.15.59:0/537134805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ced60 0x7fc9e806e3c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 --2- 172.21.15.59:0/537134805 >> v2:172.21.15.178:3300/0 conn(0x7fc9e8144140 0x7fc9e80ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 -- 172.21.15.59:0/537134805 >> 172.21.15.59:0/537134805 conn(0x7fc9e8066fa0 msgr2=0x7fc9e806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 -- 172.21.15.59:0/537134805 shutdown_connections 2024-04-25T09:03:33.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 -- 172.21.15.59:0/537134805 wait complete. 2024-04-25T09:03:33.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 Processor -- start 2024-04-25T09:03:33.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 -- start start 2024-04-25T09:03:33.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9e806e900 0x7fc9e8150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ced60 0x7fc9e813c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e8144140 0x7fc9e813cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e815ba00 con 0x7fc9e80ced60 2024-04-25T09:03:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e8144520 con 0x7fc9e806e900 2024-04-25T09:03:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9ef800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9e815bb80 con 0x7fc9e8144140 2024-04-25T09:03:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.118+0000 7fc9e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ced60 0x7fc9e813c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ced60 0x7fc9e813c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47734/0 (socket says 172.21.15.59:47734) 2024-04-25T09:03:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9e7e00640 1 -- 172.21.15.59:0/177237841 learned_addr learned my addr 172.21.15.59:0/177237841 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9ece00640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9e806e900 0x7fc9e8150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9ed800640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e8144140 0x7fc9e813cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9e7e00640 1 -- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e8144140 msgr2=0x7fc9e813cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9e7e00640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e8144140 0x7fc9e813cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9e7e00640 1 -- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9e806e900 msgr2=0x7fc9e8150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9e7e00640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9e806e900 0x7fc9e8150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9e7e00640 1 -- 172.21.15.59:0/177237841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e813f0d0 con 0x7fc9e80ced60 2024-04-25T09:03:33.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9ece00640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9e806e900 0x7fc9e8150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9e7e00640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ced60 0x7fc9e813c660 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40ae040 tx=0x7fc9d4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9e4c00640 1 -- 172.21.15.59:0/177237841 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40ba070 con 0x7fc9e80ced60 2024-04-25T09:03:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9e4c00640 1 -- 172.21.15.59:0/177237841 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9d40b4420 con 0x7fc9e80ced60 2024-04-25T09:03:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9ef800640 1 -- 172.21.15.59:0/177237841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9e813f3b0 con 0x7fc9e80ced60 2024-04-25T09:03:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9e4c00640 1 -- 172.21.15.59:0/177237841 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9d40b0040 con 0x7fc9e80ced60 2024-04-25T09:03:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9ef800640 1 -- 172.21.15.59:0/177237841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9e813f970 con 0x7fc9e80ced60 2024-04-25T09:03:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9ef800640 1 -- 172.21.15.59:0/177237841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9e80745d0 con 0x7fc9e80ced60 2024-04-25T09:03:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.122+0000 7fc9e4c00640 1 -- 172.21.15.59:0/177237841 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc9d40bd070 con 0x7fc9e80ced60 2024-04-25T09:03:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.126+0000 7fc9e4c00640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc9c8066f60 0x7fc9c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.126+0000 7fc9e4c00640 1 -- 172.21.15.59:0/177237841 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc9d411e320 con 0x7fc9e80ced60 2024-04-25T09:03:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.126+0000 7fc9ece00640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc9c8066f60 0x7fc9c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.126+0000 7fc9ece00640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc9c8066f60 0x7fc9c8069420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8140290 tx=0x7fc9dc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.130+0000 7fc9e4c00640 1 -- 172.21.15.59:0/177237841 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc9d4016110 con 0x7fc9e80ced60 2024-04-25T09:03:33.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.290+0000 7fc9ef800640 1 -- 172.21.15.59:0/177237841 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9e8143950 con 0x7fc9e80ced60 2024-04-25T09:03:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9e4c00640 1 -- 172.21.15.59:0/177237841 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16955 (secure 0 0 0) 0x7fc9d411e0e0 con 0x7fc9e80ced60 2024-04-25T09:03:33.285 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:33.285 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":51,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:03:31.959453+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.385704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:30.953332+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9ef800640 1 -- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc9c8066f60 msgr2=0x7fc9c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9ef800640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc9c8066f60 0x7fc9c8069420 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc9e8140290 tx=0x7fc9dc009190 comp rx=0 tx=0).stop 2024-04-25T09:03:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9ef800640 1 -- 172.21.15.59:0/177237841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ced60 msgr2=0x7fc9e813c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9ef800640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ced60 0x7fc9e813c660 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40ae040 tx=0x7fc9d4019000 comp rx=0 tx=0).stop 2024-04-25T09:03:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9ef800640 1 -- 172.21.15.59:0/177237841 shutdown_connections 2024-04-25T09:03:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9ef800640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc9c8066f60 0x7fc9c8069420 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9ef800640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9e8144140 0x7fc9e813cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9ef800640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9e80ced60 0x7fc9e813c660 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9ef800640 1 --2- 172.21.15.59:0/177237841 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9e806e900 0x7fc9e8150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9ef800640 1 -- 172.21.15.59:0/177237841 >> 172.21.15.59:0/177237841 conn(0x7fc9e8066fa0 msgr2=0x7fc9e815cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9ef800640 1 -- 172.21.15.59:0/177237841 shutdown_connections 2024-04-25T09:03:33.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.294+0000 7fc9ef800640 1 -- 172.21.15.59:0/177237841 wait complete. 2024-04-25T09:03:33.307 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:03:33.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.458+0000 7f4676c00640 1 Processor -- start 2024-04-25T09:03:33.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.458+0000 7f4676c00640 1 -- start start 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.458+0000 7f4676c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4670159320 0x7f467015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.458+0000 7f4676c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467015f440 0x7f467006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.458+0000 7f4676c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f467015fc00 con 0x7f467006e010 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.458+0000 7f4676c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467006d640 con 0x7f4670159320 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.458+0000 7f4676c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467015fee0 con 0x7f467015f440 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.458+0000 7f466fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4670159320 0x7f467015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.458+0000 7f466fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4670159320 0x7f467015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47746/0 (socket says 172.21.15.59:47746) 2024-04-25T09:03:33.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.458+0000 7f466fe00640 1 -- 172.21.15.59:0/3266337956 learned_addr learned my addr 172.21.15.59:0/3266337956 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:33.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.458+0000 7f4667400640 1 --2- 172.21.15.59:0/3266337956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467015f440 0x7f467006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f466fe00640 1 -- 172.21.15.59:0/3266337956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467015f440 msgr2=0x7f467006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:33.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f466fe00640 1 --2- 172.21.15.59:0/3266337956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467015f440 0x7f467006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f466fe00640 1 -- 172.21.15.59:0/3266337956 >> v1:172.21.15.178:6789/0 conn(0x7f467006e010 legacy=0x7f467006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:33.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f466fe00640 1 -- 172.21.15.59:0/3266337956 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46701601c0 con 0x7f4670159320 2024-04-25T09:03:33.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f4667400640 1 --2- 172.21.15.59:0/3266337956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467015f440 0x7f467006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:33.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f466fe00640 1 --2- 172.21.15.59:0/3266337956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4670159320 0x7f467015c9b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4660009870 tx=0x7f466001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ec37650ca46f26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f466f400640 1 -- 172.21.15.59:0/3266337956 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46600ab640 con 0x7f4670159320 2024-04-25T09:03:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f466f400640 1 -- 172.21.15.59:0/3266337956 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46600b0070 con 0x7f4670159320 2024-04-25T09:03:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f466f400640 1 -- 172.21.15.59:0/3266337956 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46600aba00 con 0x7f4670159320 2024-04-25T09:03:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f4676c00640 1 -- 172.21.15.59:0/3266337956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4670159320 msgr2=0x7f467015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f4676c00640 1 --2- 172.21.15.59:0/3266337956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4670159320 0x7f467015c9b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4660009870 tx=0x7f466001c460 comp rx=0 tx=0).stop 2024-04-25T09:03:33.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f4676c00640 1 -- 172.21.15.59:0/3266337956 shutdown_connections 2024-04-25T09:03:33.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f4676c00640 1 --2- 172.21.15.59:0/3266337956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467015f440 0x7f467006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f4676c00640 1 --2- 172.21.15.59:0/3266337956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4670159320 0x7f467015c9b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f4676c00640 1 -- 172.21.15.59:0/3266337956 >> 172.21.15.59:0/3266337956 conn(0x7f4670067080 msgr2=0x7f467006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:33.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f4676c00640 1 -- 172.21.15.59:0/3266337956 shutdown_connections 2024-04-25T09:03:33.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.462+0000 7f4676c00640 1 -- 172.21.15.59:0/3266337956 wait complete. 2024-04-25T09:03:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4676c00640 1 Processor -- start 2024-04-25T09:03:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4676c00640 1 -- start start 2024-04-25T09:03:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4676c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467006e010 0x7f4670157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4676c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4670159320 0x7f46700b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4676c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467015f440 0x7f46700b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4676c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467015f9a0 con 0x7f4670159320 2024-04-25T09:03:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4676c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467015f820 con 0x7f467015f440 2024-04-25T09:03:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4676c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467006ebb0 con 0x7f467006e010 2024-04-25T09:03:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4667400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4670159320 0x7f46700b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4667400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4670159320 0x7f46700b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47752/0 (socket says 172.21.15.59:47752) 2024-04-25T09:03:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4667400640 1 -- 172.21.15.59:0/2426733017 learned_addr learned my addr 172.21.15.59:0/2426733017 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f466fe00640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467006e010 0x7f4670157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4674c00640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467015f440 0x7f46700b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4667400640 1 -- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467006e010 msgr2=0x7f4670157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4667400640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467006e010 0x7f4670157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4667400640 1 -- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467015f440 msgr2=0x7f46700b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4667400640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467015f440 0x7f46700b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4667400640 1 -- 172.21.15.59:0/2426733017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46701579c0 con 0x7f4670159320 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f4667400640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4670159320 0x7f46700b3220 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f465800c7c0 tx=0x7f465800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f466cc00640 1 -- 172.21.15.59:0/2426733017 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658007a30 con 0x7f4670159320 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f466cc00640 1 -- 172.21.15.59:0/2426733017 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4658007bd0 con 0x7f4670159320 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.466+0000 7f466cc00640 1 -- 172.21.15.59:0/2426733017 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46580113f0 con 0x7f4670159320 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.470+0000 7f4676c00640 1 -- 172.21.15.59:0/2426733017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4670145000 con 0x7f4670159320 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.470+0000 7f4676c00640 1 -- 172.21.15.59:0/2426733017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467013d620 con 0x7f4670159320 2024-04-25T09:03:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.470+0000 7f4676c00640 1 -- 172.21.15.59:0/2426733017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46700745d0 con 0x7f4670159320 2024-04-25T09:03:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.470+0000 7f466cc00640 1 -- 172.21.15.59:0/2426733017 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4658011590 con 0x7f4670159320 2024-04-25T09:03:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.470+0000 7f466cc00640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f464c066f60 0x7f464c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.470+0000 7f466cc00640 1 -- 172.21.15.59:0/2426733017 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4658085390 con 0x7f4670159320 2024-04-25T09:03:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.470+0000 7f466fe00640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f464c066f60 0x7f464c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:33.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.474+0000 7f466fe00640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f464c066f60 0x7f464c069420 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f46600af000 tx=0x7f46600a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.474+0000 7f466cc00640 1 -- 172.21.15.59:0/2426733017 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4658015020 con 0x7f4670159320 2024-04-25T09:03:33.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:33.674+0000 7f4676c00640 1 -- 172.21.15.59:0/2426733017 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4670158a50 con 0x7f4670159320 2024-04-25T09:03:34.535 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:03:34.542+0000 7f7360400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:03:34.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.578+0000 7f466cc00640 1 -- 172.21.15.59:0/2426733017 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4658055b20 con 0x7f4670159320 2024-04-25T09:03:34.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.582+0000 7f4676c00640 1 -- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f464c066f60 msgr2=0x7f464c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.582+0000 7f4676c00640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f464c066f60 0x7f464c069420 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f46600af000 tx=0x7f46600a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:34.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.582+0000 7f4676c00640 1 -- 172.21.15.59:0/2426733017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4670159320 msgr2=0x7f46700b3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.582+0000 7f4676c00640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4670159320 0x7f46700b3220 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f465800c7c0 tx=0x7f465800cc80 comp rx=0 tx=0).stop 2024-04-25T09:03:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.582+0000 7f4676c00640 1 -- 172.21.15.59:0/2426733017 shutdown_connections 2024-04-25T09:03:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.582+0000 7f4676c00640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f464c066f60 0x7f464c069420 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.582+0000 7f4676c00640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467015f440 0x7f46700b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.582+0000 7f4676c00640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4670159320 0x7f46700b3220 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.582+0000 7f4676c00640 1 --2- 172.21.15.59:0/2426733017 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467006e010 0x7f4670157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.582+0000 7f4676c00640 1 -- 172.21.15.59:0/2426733017 >> 172.21.15.59:0/2426733017 conn(0x7f4670067080 msgr2=0x7f4670142390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.582+0000 7f4676c00640 1 -- 172.21.15.59:0/2426733017 shutdown_connections 2024-04-25T09:03:34.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.582+0000 7f4676c00640 1 -- 172.21.15.59:0/2426733017 wait complete. 2024-04-25T09:03:34.599 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:03:34.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:03:34.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.754+0000 7f0c77800640 1 Processor -- start 2024-04-25T09:03:34.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c77800640 1 -- start start 2024-04-25T09:03:34.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c77800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0c7015dd90 0x7f0c70071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c77800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c70072460 con 0x7f0c70072040 2024-04-25T09:03:34.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c77800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7006ac10 con 0x7f0c70161e90 2024-04-25T09:03:34.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c77800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c700b2dc0 con 0x7f0c7015dd90 2024-04-25T09:03:34.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c67e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0c70072040 0x7f0c70161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45956/0 (socket says 172.21.15.59:45956) 2024-04-25T09:03:34.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c67e00640 1 -- 172.21.15.59:0/774454231 learned_addr learned my addr 172.21.15.59:0/774454231 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:34.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c74e00640 1 --2- 172.21.15.59:0/774454231 >> v2:172.21.15.178:3300/0 conn(0x7f0c7015dd90 0x7f0c70071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c6fe00640 1 -- 172.21.15.59:0/774454231 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429540185 0 0) 0x7f0c70072460 con 0x7f0c70072040 2024-04-25T09:03:34.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c6fe00640 1 -- 172.21.15.59:0/774454231 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c54003530 con 0x7f0c70072040 2024-04-25T09:03:34.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c6fe00640 1 -- 172.21.15.59:0/774454231 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280414280 0 0) 0x7f0c7006ac10 con 0x7f0c70161e90 2024-04-25T09:03:34.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c6fe00640 1 -- 172.21.15.59:0/774454231 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c70072460 con 0x7f0c70161e90 2024-04-25T09:03:34.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c6fe00640 1 -- 172.21.15.59:0/774454231 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 729787144 0 0) 0x7f0c54003530 con 0x7f0c70072040 2024-04-25T09:03:34.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c74e00640 1 -- 172.21.15.59:0/774454231 >> v1:172.21.15.178:6789/0 conn(0x7f0c70161e90 legacy=0x7f0c700ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c74e00640 1 -- 172.21.15.59:0/774454231 >> v1:172.21.15.59:6789/0 conn(0x7f0c70072040 legacy=0x7f0c70161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.758+0000 7f0c74e00640 1 -- 172.21.15.59:0/774454231 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7006aeb0 con 0x7f0c7015dd90 2024-04-25T09:03:34.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.762+0000 7f0c74e00640 1 --2- 172.21.15.59:0/774454231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7015dd90 0x7f0c70071b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c600097c0 tx=0x7f0c6001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed336a26e03269b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.762+0000 7f0c6fe00640 1 -- 172.21.15.59:0/774454231 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c600b0070 con 0x7f0c7015dd90 2024-04-25T09:03:34.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.762+0000 7f0c6fe00640 1 -- 172.21.15.59:0/774454231 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c600ab400 con 0x7f0c7015dd90 2024-04-25T09:03:34.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.762+0000 7f0c6fe00640 1 -- 172.21.15.59:0/774454231 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58001680 con 0x7f0c7015dd90 2024-04-25T09:03:34.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.762+0000 7f0c77800640 1 -- 172.21.15.59:0/774454231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7015dd90 msgr2=0x7f0c70071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.762+0000 7f0c77800640 1 --2- 172.21.15.59:0/774454231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7015dd90 0x7f0c70071b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0c600097c0 tx=0x7f0c6001c330 comp rx=0 tx=0).stop 2024-04-25T09:03:34.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.762+0000 7f0c77800640 1 -- 172.21.15.59:0/774454231 shutdown_connections 2024-04-25T09:03:34.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.762+0000 7f0c77800640 1 --2- 172.21.15.59:0/774454231 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7015dd90 0x7f0c70071b00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.762+0000 7f0c77800640 1 -- 172.21.15.59:0/774454231 >> 172.21.15.59:0/774454231 conn(0x7f0c700cfd90 msgr2=0x7f0c700d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:34.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.762+0000 7f0c77800640 1 -- 172.21.15.59:0/774454231 shutdown_connections 2024-04-25T09:03:34.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.762+0000 7f0c77800640 1 -- 172.21.15.59:0/774454231 wait complete. 2024-04-25T09:03:34.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c77800640 1 Processor -- start 2024-04-25T09:03:34.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c77800640 1 -- start start 2024-04-25T09:03:34.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c77800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c70072040 0x7f0c7014dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c77800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7015dd90 0x7f0c70156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c77800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c70161e90 0x7f0c7015a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c77800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7016bc50 con 0x7f0c70161e90 2024-04-25T09:03:34.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c77800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7016bad0 con 0x7f0c7015dd90 2024-04-25T09:03:34.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c77800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7016bdd0 con 0x7f0c70072040 2024-04-25T09:03:34.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c75800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c70161e90 0x7f0c7015a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c75800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c70161e90 0x7f0c7015a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47754/0 (socket says 172.21.15.59:47754) 2024-04-25T09:03:34.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c75800640 1 -- 172.21.15.59:0/2542638838 learned_addr learned my addr 172.21.15.59:0/2542638838 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:34.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c74e00640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c70072040 0x7f0c7014dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c67e00640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7015dd90 0x7f0c70156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c75800640 1 -- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c70072040 msgr2=0x7f0c7014dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c75800640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c70072040 0x7f0c7014dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c75800640 1 -- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7015dd90 msgr2=0x7f0c70156310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c75800640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7015dd90 0x7f0c70156310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c75800640 1 -- 172.21.15.59:0/2542638838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7015bd90 con 0x7f0c70161e90 2024-04-25T09:03:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c75800640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c70161e90 0x7f0c7015a040 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800c7c0 tx=0x7f0c6800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c6d600640 1 -- 172.21.15.59:0/2542638838 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c68003b80 con 0x7f0c70161e90 2024-04-25T09:03:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c6d600640 1 -- 172.21.15.59:0/2542638838 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c68003d20 con 0x7f0c70161e90 2024-04-25T09:03:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c77800640 1 -- 172.21.15.59:0/2542638838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c701518c0 con 0x7f0c70161e90 2024-04-25T09:03:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c6d600640 1 -- 172.21.15.59:0/2542638838 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6800aa50 con 0x7f0c70161e90 2024-04-25T09:03:34.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c77800640 1 -- 172.21.15.59:0/2542638838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c701515e0 con 0x7f0c70161e90 2024-04-25T09:03:34.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.766+0000 7f0c77800640 1 -- 172.21.15.59:0/2542638838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c700745d0 con 0x7f0c70161e90 2024-04-25T09:03:34.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.770+0000 7f0c6d600640 1 -- 172.21.15.59:0/2542638838 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0c6800abf0 con 0x7f0c70161e90 2024-04-25T09:03:34.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.770+0000 7f0c6d600640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0c4c066f60 0x7f0c4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:34.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.770+0000 7f0c6d600640 1 -- 172.21.15.59:0/2542638838 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0c68085220 con 0x7f0c70161e90 2024-04-25T09:03:34.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.770+0000 7f0c74e00640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0c4c066f60 0x7f0c4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:34.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.770+0000 7f0c74e00640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0c4c066f60 0x7f0c4c069420 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0c600ad000 tx=0x7f0c60008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:34.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.774+0000 7f0c6d600640 1 -- 172.21.15.59:0/2542638838 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0c68056000 con 0x7f0c70161e90 2024-04-25T09:03:34.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:34.970+0000 7f0c77800640 1 -- 172.21.15.59:0/2542638838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0c700b0e50 con 0x7f0c70161e90 2024-04-25T09:03:35.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.586+0000 7f0c6d600640 1 -- 172.21.15.59:0/2542638838 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0c68055900 con 0x7f0c70161e90 2024-04-25T09:03:35.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.586+0000 7f0c77800640 1 -- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0c4c066f60 msgr2=0x7f0c4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.586+0000 7f0c77800640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0c4c066f60 0x7f0c4c069420 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0c600ad000 tx=0x7f0c60008040 comp rx=0 tx=0).stop 2024-04-25T09:03:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.586+0000 7f0c77800640 1 -- 172.21.15.59:0/2542638838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c70161e90 msgr2=0x7f0c7015a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.586+0000 7f0c77800640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c70161e90 0x7f0c7015a040 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0c6800c7c0 tx=0x7f0c6800cc80 comp rx=0 tx=0).stop 2024-04-25T09:03:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.586+0000 7f0c77800640 1 -- 172.21.15.59:0/2542638838 shutdown_connections 2024-04-25T09:03:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.586+0000 7f0c77800640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0c4c066f60 0x7f0c4c069420 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.586+0000 7f0c77800640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c70161e90 0x7f0c7015a040 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.586+0000 7f0c77800640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0c7015dd90 0x7f0c70156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.590+0000 7f0c77800640 1 --2- 172.21.15.59:0/2542638838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0c70072040 0x7f0c7014dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.590+0000 7f0c77800640 1 -- 172.21.15.59:0/2542638838 >> 172.21.15.59:0/2542638838 conn(0x7f0c700cfd90 msgr2=0x7f0c7015e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.590+0000 7f0c77800640 1 -- 172.21.15.59:0/2542638838 shutdown_connections 2024-04-25T09:03:35.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.590+0000 7f0c77800640 1 -- 172.21.15.59:0/2542638838 wait complete. 2024-04-25T09:03:35.602 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:03:35.602 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2f200640 1 Processor -- start 2024-04-25T09:03:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2f200640 1 -- start start 2024-04-25T09:03:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2f200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e300cdb70 0x7f1e300b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e300cd6c0 con 0x7f1e3009a170 2024-04-25T09:03:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2f200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e300cce20 con 0x7f1e3015efa0 2024-04-25T09:03:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2f200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e300b3fe0 con 0x7f1e300cdb70 2024-04-25T09:03:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2d400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1e3009a170 0x7f1e300b11a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45966/0 (socket says 172.21.15.59:45966) 2024-04-25T09:03:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2d400640 1 -- 172.21.15.59:0/1160089202 learned_addr learned my addr 172.21.15.59:0/1160089202 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2e800640 1 --2- 172.21.15.59:0/1160089202 >> v2:172.21.15.59:3300/0 conn(0x7f1e300cdb70 0x7f1e300b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2ca00640 1 -- 172.21.15.59:0/1160089202 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1342998810 0 0) 0x7f1e300cd6c0 con 0x7f1e3009a170 2024-04-25T09:03:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2ca00640 1 -- 172.21.15.59:0/1160089202 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e14003530 con 0x7f1e3009a170 2024-04-25T09:03:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2e800640 1 -- 172.21.15.59:0/1160089202 >> v1:172.21.15.178:6789/0 conn(0x7f1e3015efa0 legacy=0x7f1e30099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2e800640 1 -- 172.21.15.59:0/1160089202 >> v1:172.21.15.59:6789/0 conn(0x7f1e3009a170 legacy=0x7f1e300b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.754+0000 7f1e2e800640 1 -- 172.21.15.59:0/1160089202 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e300cd100 con 0x7f1e300cdb70 2024-04-25T09:03:35.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2e800640 1 --2- 172.21.15.59:0/1160089202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e300cdb70 0x7f1e300b18b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009d90 tx=0x7f1e300b2600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489f930fa662c212 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2ca00640 1 -- 172.21.15.59:0/1160089202 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e280b2070 con 0x7f1e300cdb70 2024-04-25T09:03:35.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2ca00640 1 -- 172.21.15.59:0/1160089202 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e280a5830 con 0x7f1e300cdb70 2024-04-25T09:03:35.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2ca00640 1 -- 172.21.15.59:0/1160089202 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e280a5c00 con 0x7f1e300cdb70 2024-04-25T09:03:35.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2f200640 1 -- 172.21.15.59:0/1160089202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e300cdb70 msgr2=0x7f1e300b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2f200640 1 --2- 172.21.15.59:0/1160089202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e300cdb70 0x7f1e300b18b0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f1e28009d90 tx=0x7f1e300b2600 comp rx=0 tx=0).stop 2024-04-25T09:03:35.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2f200640 1 -- 172.21.15.59:0/1160089202 shutdown_connections 2024-04-25T09:03:35.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2f200640 1 --2- 172.21.15.59:0/1160089202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e300cdb70 0x7f1e300b18b0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2f200640 1 -- 172.21.15.59:0/1160089202 >> 172.21.15.59:0/1160089202 conn(0x7f1e300b3050 msgr2=0x7f1e300b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2f200640 1 -- 172.21.15.59:0/1160089202 shutdown_connections 2024-04-25T09:03:35.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2f200640 1 -- 172.21.15.59:0/1160089202 wait complete. 2024-04-25T09:03:35.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2f200640 1 Processor -- start 2024-04-25T09:03:35.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.758+0000 7f1e2f200640 1 -- start start 2024-04-25T09:03:35.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2f200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e3009a170 0x7f1e3014abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e300cdb70 0x7f1e300c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2f200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e3015efa0 0x7f1e30152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301696b0 con 0x7f1e300cdb70 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2f200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300b3dc0 con 0x7f1e3009a170 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2f200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30169830 con 0x7f1e3015efa0 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e300cdb70 0x7f1e300c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e300cdb70 0x7f1e300c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47768/0 (socket says 172.21.15.59:47768) 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2d400640 1 -- 172.21.15.59:0/1591238882 learned_addr learned my addr 172.21.15.59:0/1591238882 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2e800640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e3015efa0 0x7f1e30152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2de00640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e3009a170 0x7f1e3014abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2d400640 1 -- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e3015efa0 msgr2=0x7f1e30152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2d400640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e3015efa0 0x7f1e30152f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2d400640 1 -- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e3009a170 msgr2=0x7f1e3014abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2d400640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e3009a170 0x7f1e3014abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2d400640 1 -- 172.21.15.59:0/1591238882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3014b640 con 0x7f1e300cdb70 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2d400640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e300cdb70 0x7f1e300c49e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00c4d0 tx=0x7f1e1c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e26000640 1 -- 172.21.15.59:0/1591238882 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c017070 con 0x7f1e300cdb70 2024-04-25T09:03:35.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e26000640 1 -- 172.21.15.59:0/1591238882 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c005cf0 con 0x7f1e300cdb70 2024-04-25T09:03:35.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e26000640 1 -- 172.21.15.59:0/1591238882 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c007270 con 0x7f1e300cdb70 2024-04-25T09:03:35.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2f200640 1 -- 172.21.15.59:0/1591238882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3014c1f0 con 0x7f1e300cdb70 2024-04-25T09:03:35.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2f200640 1 -- 172.21.15.59:0/1591238882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e3014c7b0 con 0x7f1e300cdb70 2024-04-25T09:03:35.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.762+0000 7f1e2f200640 1 -- 172.21.15.59:0/1591238882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e3004efa0 con 0x7f1e300cdb70 2024-04-25T09:03:35.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.766+0000 7f1e26000640 1 -- 172.21.15.59:0/1591238882 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1e1c01a070 con 0x7f1e300cdb70 2024-04-25T09:03:35.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.766+0000 7f1e26000640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e10066f60 0x7f1e10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:35.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.766+0000 7f1e26000640 1 -- 172.21.15.59:0/1591238882 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1e1c084520 con 0x7f1e300cdb70 2024-04-25T09:03:35.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.766+0000 7f1e2de00640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e10066f60 0x7f1e10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:35.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.766+0000 7f1e2de00640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e10066f60 0x7f1e10069420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e300c79c0 tx=0x7f1e20009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:35.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.770+0000 7f1e26000640 1 -- 172.21.15.59:0/1591238882 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1e1c054d40 con 0x7f1e300cdb70 2024-04-25T09:03:35.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 -- 172.21.15.59:0/1591238882 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e3006e1e0 con 0x7f1e300cdb70 2024-04-25T09:03:35.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e26000640 1 -- 172.21.15.59:0/1591238882 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f1e1c058de0 con 0x7f1e300cdb70 2024-04-25T09:03:35.957 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:35.957 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2757859141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2757859141},{"type":"v1","addr":"172.21.15.178:6836","nonce":2757859141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5626,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/447455100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":447455100},{"type":"v1","addr":"172.21.15.178:6837","nonce":447455100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4008580166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4008580166},{"type":"v1","addr":"172.21.15.59:6834","nonce":4008580166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:31.959775+0000","modified":"2024-04-25T09:03:34.974887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2578168283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2578168283},{"type":"v1","addr":"172.21.15.59:6835","nonce":2578168283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:03:35.958 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-04-25T09:03:35.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 -- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e10066f60 msgr2=0x7f1e10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e10066f60 0x7f1e10069420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1e300c79c0 tx=0x7f1e20009040 comp rx=0 tx=0).stop 2024-04-25T09:03:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 -- 172.21.15.59:0/1591238882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e300cdb70 msgr2=0x7f1e300c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e300cdb70 0x7f1e300c49e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c00c4d0 tx=0x7f1e1c00c990 comp rx=0 tx=0).stop 2024-04-25T09:03:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 -- 172.21.15.59:0/1591238882 shutdown_connections 2024-04-25T09:03:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e10066f60 0x7f1e10069420 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e3015efa0 0x7f1e30152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e300cdb70 0x7f1e300c49e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 --2- 172.21.15.59:0/1591238882 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e3009a170 0x7f1e3014abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 -- 172.21.15.59:0/1591238882 >> 172.21.15.59:0/1591238882 conn(0x7f1e300b3050 msgr2=0x7f1e300cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 -- 172.21.15.59:0/1591238882 shutdown_connections 2024-04-25T09:03:35.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:35.966+0000 7f1e2f200640 1 -- 172.21.15.59:0/1591238882 wait complete. 2024-04-25T09:03:35.980 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:03:36.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f0031600640 1 Processor -- start 2024-04-25T09:03:36.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f0031600640 1 -- start start 2024-04-25T09:03:36.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f0031600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f002c15b5a0 0x7f002c0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f0031600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002c0ce7f0 con 0x7f002c15b980 2024-04-25T09:03:36.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f0031600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f002c0cead0 con 0x7f002c0cc440 2024-04-25T09:03:36.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f0031600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f002c0cfcd0 con 0x7f002c15b5a0 2024-04-25T09:03:36.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f0022000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f002c15b980 0x7f002c0cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45982/0 (socket says 172.21.15.59:45982) 2024-04-25T09:03:36.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f0022000640 1 -- 172.21.15.59:0/4148292361 learned_addr learned my addr 172.21.15.59:0/4148292361 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:36.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002aa00640 1 --2- 172.21.15.59:0/4148292361 >> v2:172.21.15.178:3300/0 conn(0x7f002c15b5a0 0x7f002c0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855134916 0 0) 0x7f002c0ce7f0 con 0x7f002c15b980 2024-04-25T09:03:36.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0010003530 con 0x7f002c15b980 2024-04-25T09:03:36.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 197060813 0 0) 0x7f0010003530 con 0x7f002c15b980 2024-04-25T09:03:36.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 >> v2:172.21.15.178:3300/0 conn(0x7f002c15b5a0 msgr2=0x7f002c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 --2- 172.21.15.59:0/4148292361 >> v2:172.21.15.178:3300/0 conn(0x7f002c15b5a0 0x7f002c0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 >> v1:172.21.15.178:6789/0 conn(0x7f002c0cc440 legacy=0x7f002c0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c0cf960 con 0x7f002c15b980 2024-04-25T09:03:36.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f0014001680 con 0x7f002c15b980 2024-04-25T09:03:36.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 >> v1:172.21.15.59:6789/0 conn(0x7f002c15b980 legacy=0x7f002c0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 --2- 172.21.15.59:0/4148292361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100039c0 0x7f0010003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 --2- 172.21.15.59:0/4148292361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100043c0 0x7f0010004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 --2- 172.21.15.59:0/4148292361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0010005090 0x7f001000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0cfcd0 con 0x7f0010005090 2024-04-25T09:03:36.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001000bff0 con 0x7f00100039c0 2024-04-25T09:03:36.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.130+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001000c1f0 con 0x7f00100043c0 2024-04-25T09:03:36.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002aa00640 1 --2- 172.21.15.59:0/4148292361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100039c0 0x7f0010003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002b400640 1 --2- 172.21.15.59:0/4148292361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0010005090 0x7f001000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f0022000640 1 --2- 172.21.15.59:0/4148292361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100043c0 0x7f0010004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002b400640 1 -- 172.21.15.59:0/4148292361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100043c0 msgr2=0x7f0010004890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002b400640 1 --2- 172.21.15.59:0/4148292361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00100043c0 0x7f0010004890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002b400640 1 -- 172.21.15.59:0/4148292361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100039c0 msgr2=0x7f0010003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002b400640 1 --2- 172.21.15.59:0/4148292361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100039c0 0x7f0010003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002b400640 1 -- 172.21.15.59:0/4148292361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0010003530 con 0x7f0010005090 2024-04-25T09:03:36.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002aa00640 1 --2- 172.21.15.59:0/4148292361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f00100039c0 0x7f0010003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002b400640 1 -- 172.21.15.59:0/4148292361 reap_dead start 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002b400640 1 --2- 172.21.15.59:0/4148292361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0010005090 0x7f001000b9d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0024002010 tx=0x7f002401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa82dd6c413a8bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001c0096b0 con 0x7f0010005090 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0024003ba0 con 0x7f0010005090 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f002a000640 1 -- 172.21.15.59:0/4148292361 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024001c10 con 0x7f0010005090 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f0031600640 1 -- 172.21.15.59:0/4148292361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0010005090 msgr2=0x7f001000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.134+0000 7f0031600640 1 --2- 172.21.15.59:0/4148292361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0010005090 0x7f001000b9d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0024002010 tx=0x7f002401c8e0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 -- 172.21.15.59:0/4148292361 shutdown_connections 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 --2- 172.21.15.59:0/4148292361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0010005090 0x7f001000b9d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 -- 172.21.15.59:0/4148292361 >> 172.21.15.59:0/4148292361 conn(0x7f002c0b3390 msgr2=0x7f002c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 -- 172.21.15.59:0/4148292361 shutdown_connections 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 -- 172.21.15.59:0/4148292361 wait complete. 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 Processor -- start 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 -- start start 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0010005090 0x7f002c1581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f002c15e9b0 0x7f002c1f4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f002c159180 0x7f002c15cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c071d00 con 0x7f002c159180 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f002c071b80 con 0x7f002c15e9b0 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0031600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f002c0cbd30 con 0x7f0010005090 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f002b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f002c159180 0x7f002c15cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f002b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f002c159180 0x7f002c15cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47782/0 (socket says 172.21.15.59:47782) 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f002b400640 1 -- 172.21.15.59:0/2035293762 learned_addr learned my addr 172.21.15.59:0/2035293762 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:36.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f0022000640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f002c15e9b0 0x7f002c1f4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f002aa00640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0010005090 0x7f002c1581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f002b400640 1 -- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0010005090 msgr2=0x7f002c1581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f002b400640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0010005090 0x7f002c1581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f002b400640 1 -- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f002c15e9b0 msgr2=0x7f002c1f4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f002b400640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f002c15e9b0 0x7f002c1f4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f002b400640 1 -- 172.21.15.59:0/2035293762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c15be60 con 0x7f002c159180 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.138+0000 7f002b400640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f002c159180 0x7f002c15cee0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f002401d180 tx=0x7f0010005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.142+0000 7f0023400640 1 -- 172.21.15.59:0/2035293762 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00240b8070 con 0x7f002c159180 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.142+0000 7f0023400640 1 -- 172.21.15.59:0/2035293762 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0024001bf0 con 0x7f002c159180 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.142+0000 7f0031600640 1 -- 172.21.15.59:0/2035293762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f002c15c120 con 0x7f002c159180 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.142+0000 7f0023400640 1 -- 172.21.15.59:0/2035293762 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0024007e00 con 0x7f002c159180 2024-04-25T09:03:36.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.142+0000 7f0031600640 1 -- 172.21.15.59:0/2035293762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f002c15c6e0 con 0x7f002c159180 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.142+0000 7f0031600640 1 -- 172.21.15.59:0/2035293762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f002c0745d0 con 0x7f002c159180 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.142+0000 7f0023400640 1 -- 172.21.15.59:0/2035293762 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f00240bb070 con 0x7f002c159180 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.142+0000 7f0023400640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0008066f90 0x7f0008069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.142+0000 7f0023400640 1 -- 172.21.15.59:0/2035293762 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f002411dfb0 con 0x7f002c159180 2024-04-25T09:03:36.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.142+0000 7f002aa00640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0008066f90 0x7f0008069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.146+0000 7f002aa00640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0008066f90 0x7f0008069450 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f001c009b60 tx=0x7f001c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.146+0000 7f0023400640 1 -- 172.21.15.59:0/2035293762 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f00240165f0 con 0x7f002c159180 2024-04-25T09:03:36.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.310+0000 7f0031600640 1 -- 172.21.15.59:0/2035293762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f002c0cc960 con 0x7f002c159180 2024-04-25T09:03:36.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.310+0000 7f0023400640 1 -- 172.21.15.59:0/2035293762 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16942 (secure 0 0 0) 0x7f00240eee60 con 0x7f002c159180 2024-04-25T09:03:36.303 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:36.304 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":52,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:03:33.570092+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.385704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:30.953332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:03:36.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.314+0000 7f0031600640 1 -- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0008066f90 msgr2=0x7f0008069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.314+0000 7f0031600640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0008066f90 0x7f0008069450 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f001c009b60 tx=0x7f001c009190 comp rx=0 tx=0).stop 2024-04-25T09:03:36.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.314+0000 7f0031600640 1 -- 172.21.15.59:0/2035293762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f002c159180 msgr2=0x7f002c15cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.314+0000 7f0031600640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f002c159180 0x7f002c15cee0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f002401d180 tx=0x7f0010005840 comp rx=0 tx=0).stop 2024-04-25T09:03:36.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.314+0000 7f0031600640 1 -- 172.21.15.59:0/2035293762 shutdown_connections 2024-04-25T09:03:36.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.314+0000 7f0031600640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0008066f90 0x7f0008069450 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.314+0000 7f0031600640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f002c159180 0x7f002c15cee0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.314+0000 7f0031600640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f002c15e9b0 0x7f002c1f4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.314+0000 7f0031600640 1 --2- 172.21.15.59:0/2035293762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0010005090 0x7f002c1581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.314+0000 7f0031600640 1 -- 172.21.15.59:0/2035293762 >> 172.21.15.59:0/2035293762 conn(0x7f002c0b3390 msgr2=0x7f002c0caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.314+0000 7f0031600640 1 -- 172.21.15.59:0/2035293762 shutdown_connections 2024-04-25T09:03:36.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.314+0000 7f0031600640 1 -- 172.21.15.59:0/2035293762 wait complete. 2024-04-25T09:03:36.325 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:03:36.325 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:03:36.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f60400640 1 Processor -- start 2024-04-25T09:03:36.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f60400640 1 -- start start 2024-04-25T09:03:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f60400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8f58161510 0x7f8f58143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f60400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f5806d090 con 0x7f8f581435c0 2024-04-25T09:03:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f60400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f58071ad0 con 0x7f8f58070fe0 2024-04-25T09:03:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f60400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f58162390 con 0x7f8f58161510 2024-04-25T09:03:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f5e400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8f581435c0 0x7f8f5815e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45988/0 (socket says 172.21.15.59:45988) 2024-04-25T09:03:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f5e400640 1 -- 172.21.15.59:0/713943224 learned_addr learned my addr 172.21.15.59:0/713943224 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f5d000640 1 --2- 172.21.15.59:0/713943224 >> v2:172.21.15.178:3300/0 conn(0x7f8f58161510 0x7f8f58143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987428151 0 0) 0x7f8f500014a0 con 0x7f8f581435c0 2024-04-25T09:03:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f40003530 con 0x7f8f581435c0 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1084018517 0 0) 0x7f8f40003530 con 0x7f8f581435c0 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 >> v2:172.21.15.178:3300/0 conn(0x7f8f58161510 msgr2=0x7f8f58143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 --2- 172.21.15.59:0/713943224 >> v2:172.21.15.178:3300/0 conn(0x7f8f58161510 0x7f8f58143080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 >> v1:172.21.15.178:6789/0 conn(0x7f8f58070fe0 legacy=0x7f8f580713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f58161af0 con 0x7f8f581435c0 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f8f50001bd0 con 0x7f8f581435c0 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 >> v1:172.21.15.59:6789/0 conn(0x7f8f581435c0 legacy=0x7f8f5815e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 --2- 172.21.15.59:0/713943224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f400039c0 0x7f8f40003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 --2- 172.21.15.59:0/713943224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f40004810 0x7f8f40004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 --2- 172.21.15.59:0/713943224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f400051d0 0x7f8f4000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f58162390 con 0x7f8f400039c0 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4000c070 con 0x7f8f40004810 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4000c270 con 0x7f8f400051d0 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f5da00640 1 --2- 172.21.15.59:0/713943224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f400039c0 0x7f8f40003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f5d000640 1 --2- 172.21.15.59:0/713943224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f40004810 0x7f8f40004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f5e400640 1 --2- 172.21.15.59:0/713943224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f400051d0 0x7f8f4000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.474+0000 7f8f5da00640 1 -- 172.21.15.59:0/713943224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f400051d0 msgr2=0x7f8f4000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f5da00640 1 --2- 172.21.15.59:0/713943224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f400051d0 0x7f8f4000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f5da00640 1 -- 172.21.15.59:0/713943224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f40004810 msgr2=0x7f8f40004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f5da00640 1 --2- 172.21.15.59:0/713943224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f40004810 0x7f8f40004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f5da00640 1 -- 172.21.15.59:0/713943224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40003530 con 0x7f8f400039c0 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f5d000640 1 --2- 172.21.15.59:0/713943224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f40004810 0x7f8f40004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f5e400640 1 -- 172.21.15.59:0/713943224 reap_dead start 2024-04-25T09:03:36.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f5da00640 1 --2- 172.21.15.59:0/713943224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f400039c0 0x7f8f40003de0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c001780 tx=0x7f8f4c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db84a69e55b275f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0013a0 con 0x7f8f400039c0 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c0052f0 con 0x7f8f400039c0 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f57e00640 1 -- 172.21.15.59:0/713943224 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c003840 con 0x7f8f400039c0 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f60400640 1 -- 172.21.15.59:0/713943224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f400039c0 msgr2=0x7f8f40003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f60400640 1 --2- 172.21.15.59:0/713943224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f400039c0 0x7f8f40003de0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c001780 tx=0x7f8f4c01c3d0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f60400640 1 -- 172.21.15.59:0/713943224 shutdown_connections 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f60400640 1 --2- 172.21.15.59:0/713943224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f400039c0 0x7f8f40003de0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f60400640 1 -- 172.21.15.59:0/713943224 >> 172.21.15.59:0/713943224 conn(0x7f8f580b3390 msgr2=0x7f8f580b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f60400640 1 -- 172.21.15.59:0/713943224 shutdown_connections 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.478+0000 7f8f60400640 1 -- 172.21.15.59:0/713943224 wait complete. 2024-04-25T09:03:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f60400640 1 Processor -- start 2024-04-25T09:03:36.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f60400640 1 -- start start 2024-04-25T09:03:36.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f60400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f400039c0 0x7f8f5813e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f60400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f580ce0f0 0x7f8f580ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f60400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b56b0 0x7f8f580b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f60400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f580717d0 con 0x7f8f580b56b0 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f60400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5815ed60 con 0x7f8f400039c0 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f60400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f58071950 con 0x7f8f580ce0f0 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f5e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b56b0 0x7f8f580b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f5e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b56b0 0x7f8f580b5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47798/0 (socket says 172.21.15.59:47798) 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f5e400640 1 -- 172.21.15.59:0/2718389702 learned_addr learned my addr 172.21.15.59:0/2718389702 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f5da00640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f400039c0 0x7f8f5813e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f5d000640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f580ce0f0 0x7f8f580ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f5e400640 1 -- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f580ce0f0 msgr2=0x7f8f580ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f5e400640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f580ce0f0 0x7f8f580ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f5e400640 1 -- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f400039c0 msgr2=0x7f8f5813e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f5e400640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f400039c0 0x7f8f5813e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f5e400640 1 -- 172.21.15.59:0/2718389702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5813e790 con 0x7f8f580b56b0 2024-04-25T09:03:36.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f5e400640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b56b0 0x7f8f580b5b30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8f580b3320 tx=0x7f8f50007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f55600640 1 -- 172.21.15.59:0/2718389702 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f50017020 con 0x7f8f580b56b0 2024-04-25T09:03:36.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f55600640 1 -- 172.21.15.59:0/2718389702 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5000eaa0 con 0x7f8f580b56b0 2024-04-25T09:03:36.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f60400640 1 -- 172.21.15.59:0/2718389702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f580b6470 con 0x7f8f580b56b0 2024-04-25T09:03:36.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f55600640 1 -- 172.21.15.59:0/2718389702 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5000ee70 con 0x7f8f580b56b0 2024-04-25T09:03:36.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.482+0000 7f8f60400640 1 -- 172.21.15.59:0/2718389702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f580b6a30 con 0x7f8f580b56b0 2024-04-25T09:03:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.486+0000 7f8f60400640 1 -- 172.21.15.59:0/2718389702 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f580745d0 con 0x7f8f580b56b0 2024-04-25T09:03:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.486+0000 7f8f55600640 1 -- 172.21.15.59:0/2718389702 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8f5001a020 con 0x7f8f580b56b0 2024-04-25T09:03:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.486+0000 7f8f55600640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f38066f90 0x7f8f38069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.486+0000 7f8f55600640 1 -- 172.21.15.59:0/2718389702 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8f500853d0 con 0x7f8f580b56b0 2024-04-25T09:03:36.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.486+0000 7f8f5da00640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f38066f90 0x7f8f38069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.486+0000 7f8f5da00640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f38066f90 0x7f8f38069450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c001750 tx=0x7f8f4c0011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.490+0000 7f8f55600640 1 -- 172.21.15.59:0/2718389702 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8f50021020 con 0x7f8f580b56b0 2024-04-25T09:03:36.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.654+0000 7f8f60400640 1 -- 172.21.15.59:0/2718389702 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f580cea90 con 0x7f8f38066f90 2024-04-25T09:03:36.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.662+0000 7f8f55600640 1 -- 172.21.15.59:0/2718389702 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251957 (secure 0 0 0) 0x7f8f4c005250 con 0x7f8f38066f90 2024-04-25T09:03:36.656 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:36.658 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.662+0000 7f8f60400640 1 -- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f38066f90 msgr2=0x7f8f38069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.662+0000 7f8f60400640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f38066f90 0x7f8f38069450 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c001750 tx=0x7f8f4c0011a0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.662+0000 7f8f60400640 1 -- 172.21.15.59:0/2718389702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b56b0 msgr2=0x7f8f580b5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.662+0000 7f8f60400640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b56b0 0x7f8f580b5b30 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8f580b3320 tx=0x7f8f50007bc0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.666+0000 7f8f60400640 1 -- 172.21.15.59:0/2718389702 shutdown_connections 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.666+0000 7f8f60400640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f38066f90 0x7f8f38069450 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.666+0000 7f8f60400640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f580b56b0 0x7f8f580b5b30 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.666+0000 7f8f60400640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f580ce0f0 0x7f8f580ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.666+0000 7f8f60400640 1 --2- 172.21.15.59:0/2718389702 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f400039c0 0x7f8f5813e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.666+0000 7f8f60400640 1 -- 172.21.15.59:0/2718389702 >> 172.21.15.59:0/2718389702 conn(0x7f8f580b3390 msgr2=0x7f8f58140000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.666+0000 7f8f60400640 1 -- 172.21.15.59:0/2718389702 shutdown_connections 2024-04-25T09:03:36.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.666+0000 7f8f60400640 1 -- 172.21.15.59:0/2718389702 wait complete. 2024-04-25T09:03:36.676 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2024-04-25T09:03:35.679627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238868,"kb_used_data":6020,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735852,"statfs":{"total":773094113280,"available":772849512448,"internally_reserved":0,"allocated":6164480,"data_stored":3376352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.130736"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577410+0000","last_change":"2024-04-25T09:03:32.579947+0000","last_active":"2024-04-25T09:03:33.577410+0000","last_peered":"2024-04-25T09:03:33.577410+0000","last_clean":"2024-04-25T09:03:33.577410+0000","last_became_active":"2024-04-25T09:03:32.579602+0000","last_became_peered":"2024-04-25T09:03:32.579602+0000","last_unstale":"2024-04-25T09:03:33.577410+0000","last_undegraded":"2024-04-25T09:03:33.577410+0000","last_fullsized":"2024-04-25T09:03:33.577410+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:58.771174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583979+0000","last_change":"2024-04-25T09:03:32.580011+0000","last_active":"2024-04-25T09:03:33.583979+0000","last_peered":"2024-04-25T09:03:33.583979+0000","last_clean":"2024-04-25T09:03:33.583979+0000","last_became_active":"2024-04-25T09:03:32.579698+0000","last_became_peered":"2024-04-25T09:03:32.579698+0000","last_unstale":"2024-04-25T09:03:33.583979+0000","last_undegraded":"2024-04-25T09:03:33.583979+0000","last_fullsized":"2024-04-25T09:03:33.583979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:33.397775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580521+0000","last_change":"2024-04-25T09:03:32.590997+0000","last_active":"2024-04-25T09:03:33.580521+0000","last_peered":"2024-04-25T09:03:33.580521+0000","last_clean":"2024-04-25T09:03:33.580521+0000","last_became_active":"2024-04-25T09:03:32.589933+0000","last_became_peered":"2024-04-25T09:03:32.589933+0000","last_unstale":"2024-04-25T09:03:33.580521+0000","last_undegraded":"2024-04-25T09:03:33.580521+0000","last_fullsized":"2024-04-25T09:03:33.580521+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:33.103450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583723+0000","last_change":"2024-04-25T09:03:32.600851+0000","last_active":"2024-04-25T09:03:33.583723+0000","last_peered":"2024-04-25T09:03:33.583723+0000","last_clean":"2024-04-25T09:03:33.583723+0000","last_became_active":"2024-04-25T09:03:32.600594+0000","last_became_peered":"2024-04-25T09:03:32.600594+0000","last_unstale":"2024-04-25T09:03:33.583723+0000","last_undegraded":"2024-04-25T09:03:33.583723+0000","last_fullsized":"2024-04-25T09:03:33.583723+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:39.729827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123573+0000","last_change":"2024-04-25T09:03:32.582250+0000","last_active":"2024-04-25T09:03:34.123573+0000","last_peered":"2024-04-25T09:03:34.123573+0000","last_clean":"2024-04-25T09:03:34.123573+0000","last_became_active":"2024-04-25T09:03:32.581803+0000","last_became_peered":"2024-04-25T09:03:32.581803+0000","last_unstale":"2024-04-25T09:03:34.123573+0000","last_undegraded":"2024-04-25T09:03:34.123573+0000","last_fullsized":"2024-04-25T09:03:34.123573+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:23.304684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577110+0000","last_change":"2024-04-25T09:03:32.586900+0000","last_active":"2024-04-25T09:03:33.577110+0000","last_peered":"2024-04-25T09:03:33.577110+0000","last_clean":"2024-04-25T09:03:33.577110+0000","last_became_active":"2024-04-25T09:03:32.582168+0000","last_became_peered":"2024-04-25T09:03:32.582168+0000","last_unstale":"2024-04-25T09:03:33.577110+0000","last_undegraded":"2024-04-25T09:03:33.577110+0000","last_fullsized":"2024-04-25T09:03:33.577110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:49.453628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579941+0000","last_change":"2024-04-25T09:03:32.590470+0000","last_active":"2024-04-25T09:03:33.579941+0000","last_peered":"2024-04-25T09:03:33.579941+0000","last_clean":"2024-04-25T09:03:33.579941+0000","last_became_active":"2024-04-25T09:03:32.590182+0000","last_became_peered":"2024-04-25T09:03:32.590182+0000","last_unstale":"2024-04-25T09:03:33.579941+0000","last_undegraded":"2024-04-25T09:03:33.579941+0000","last_fullsized":"2024-04-25T09:03:33.579941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:33.397775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123709+0000","last_change":"2024-04-25T09:03:32.594085+0000","last_active":"2024-04-25T09:03:34.123709+0000","last_peered":"2024-04-25T09:03:34.123709+0000","last_clean":"2024-04-25T09:03:34.123709+0000","last_became_active":"2024-04-25T09:03:32.593615+0000","last_became_peered":"2024-04-25T09:03:32.593615+0000","last_unstale":"2024-04-25T09:03:34.123709+0000","last_undegraded":"2024-04-25T09:03:34.123709+0000","last_fullsized":"2024-04-25T09:03:34.123709+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:37.540308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124524+0000","last_change":"2024-04-25T09:03:32.602560+0000","last_active":"2024-04-25T09:03:34.124524+0000","last_peered":"2024-04-25T09:03:34.124524+0000","last_clean":"2024-04-25T09:03:34.124524+0000","last_became_active":"2024-04-25T09:03:32.598074+0000","last_became_peered":"2024-04-25T09:03:32.598074+0000","last_unstale":"2024-04-25T09:03:34.124524+0000","last_undegraded":"2024-04-25T09:03:34.124524+0000","last_fullsized":"2024-04-25T09:03:34.124524+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:49.246271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577137+0000","last_change":"2024-04-25T09:03:32.587315+0000","last_active":"2024-04-25T09:03:33.577137+0000","last_peered":"2024-04-25T09:03:33.577137+0000","last_clean":"2024-04-25T09:03:33.577137+0000","last_became_active":"2024-04-25T09:03:32.586959+0000","last_became_peered":"2024-04-25T09:03:32.586959+0000","last_unstale":"2024-04-25T09:03:33.577137+0000","last_undegraded":"2024-04-25T09:03:33.577137+0000","last_fullsized":"2024-04-25T09:03:33.577137+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:15.542055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124389+0000","last_change":"2024-04-25T09:03:32.582222+0000","last_active":"2024-04-25T09:03:34.124389+0000","last_peered":"2024-04-25T09:03:34.124389+0000","last_clean":"2024-04-25T09:03:34.124389+0000","last_became_active":"2024-04-25T09:03:32.581869+0000","last_became_peered":"2024-04-25T09:03:32.581869+0000","last_unstale":"2024-04-25T09:03:34.124389+0000","last_undegraded":"2024-04-25T09:03:34.124389+0000","last_fullsized":"2024-04-25T09:03:34.124389+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:31.275735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124166+0000","last_change":"2024-04-25T09:03:32.594515+0000","last_active":"2024-04-25T09:03:34.124166+0000","last_peered":"2024-04-25T09:03:34.124166+0000","last_clean":"2024-04-25T09:03:34.124166+0000","last_became_active":"2024-04-25T09:03:32.594207+0000","last_became_peered":"2024-04-25T09:03:32.594207+0000","last_unstale":"2024-04-25T09:03:34.124166+0000","last_undegraded":"2024-04-25T09:03:34.124166+0000","last_fullsized":"2024-04-25T09:03:34.124166+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:29.297272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577067+0000","last_change":"2024-04-25T09:03:32.583116+0000","last_active":"2024-04-25T09:03:33.577067+0000","last_peered":"2024-04-25T09:03:33.577067+0000","last_clean":"2024-04-25T09:03:33.577067+0000","last_became_active":"2024-04-25T09:03:32.582856+0000","last_became_peered":"2024-04-25T09:03:32.582856+0000","last_unstale":"2024-04-25T09:03:33.577067+0000","last_undegraded":"2024-04-25T09:03:33.577067+0000","last_fullsized":"2024-04-25T09:03:33.577067+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:10.469896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580182+0000","last_change":"2024-04-25T09:03:32.586095+0000","last_active":"2024-04-25T09:03:33.580182+0000","last_peered":"2024-04-25T09:03:33.580182+0000","last_clean":"2024-04-25T09:03:33.580182+0000","last_became_active":"2024-04-25T09:03:32.585784+0000","last_became_peered":"2024-04-25T09:03:32.585784+0000","last_unstale":"2024-04-25T09:03:33.580182+0000","last_undegraded":"2024-04-25T09:03:33.580182+0000","last_fullsized":"2024-04-25T09:03:33.580182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.096246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583629+0000","last_change":"2024-04-25T09:03:32.583258+0000","last_active":"2024-04-25T09:03:33.583629+0000","last_peered":"2024-04-25T09:03:33.583629+0000","last_clean":"2024-04-25T09:03:33.583629+0000","last_became_active":"2024-04-25T09:03:32.582962+0000","last_became_peered":"2024-04-25T09:03:32.582962+0000","last_unstale":"2024-04-25T09:03:33.583629+0000","last_undegraded":"2024-04-25T09:03:33.583629+0000","last_fullsized":"2024-04-25T09:03:33.583629+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:58.528329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577323+0000","last_change":"2024-04-25T09:03:32.583673+0000","last_active":"2024-04-25T09:03:33.577323+0000","last_peered":"2024-04-25T09:03:33.577323+0000","last_clean":"2024-04-25T09:03:33.577323+0000","last_became_active":"2024-04-25T09:03:32.583420+0000","last_became_peered":"2024-04-25T09:03:32.583420+0000","last_unstale":"2024-04-25T09:03:33.577323+0000","last_undegraded":"2024-04-25T09:03:33.577323+0000","last_fullsized":"2024-04-25T09:03:33.577323+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:48.632294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580845+0000","last_change":"2024-04-25T09:03:32.583091+0000","last_active":"2024-04-25T09:03:33.580845+0000","last_peered":"2024-04-25T09:03:33.580845+0000","last_clean":"2024-04-25T09:03:33.580845+0000","last_became_active":"2024-04-25T09:03:32.582681+0000","last_became_peered":"2024-04-25T09:03:32.582681+0000","last_unstale":"2024-04-25T09:03:33.580845+0000","last_undegraded":"2024-04-25T09:03:33.580845+0000","last_fullsized":"2024-04-25T09:03:33.580845+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:00.688658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.584049+0000","last_change":"2024-04-25T09:03:32.583993+0000","last_active":"2024-04-25T09:03:33.584049+0000","last_peered":"2024-04-25T09:03:33.584049+0000","last_clean":"2024-04-25T09:03:33.584049+0000","last_became_active":"2024-04-25T09:03:32.583634+0000","last_became_peered":"2024-04-25T09:03:32.583634+0000","last_unstale":"2024-04-25T09:03:33.584049+0000","last_undegraded":"2024-04-25T09:03:33.584049+0000","last_fullsized":"2024-04-25T09:03:33.584049+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.096246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580550+0000","last_change":"2024-04-25T09:03:32.581152+0000","last_active":"2024-04-25T09:03:33.580550+0000","last_peered":"2024-04-25T09:03:33.580550+0000","last_clean":"2024-04-25T09:03:33.580550+0000","last_became_active":"2024-04-25T09:03:32.580583+0000","last_became_peered":"2024-04-25T09:03:32.580583+0000","last_unstale":"2024-04-25T09:03:33.580550+0000","last_undegraded":"2024-04-25T09:03:33.580550+0000","last_fullsized":"2024-04-25T09:03:33.580550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:37.540308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579856+0000","last_change":"2024-04-25T09:03:32.576861+0000","last_active":"2024-04-25T09:03:33.579856+0000","last_peered":"2024-04-25T09:03:33.579856+0000","last_clean":"2024-04-25T09:03:33.579856+0000","last_became_active":"2024-04-25T09:03:32.576072+0000","last_became_peered":"2024-04-25T09:03:32.576072+0000","last_unstale":"2024-04-25T09:03:33.579856+0000","last_undegraded":"2024-04-25T09:03:33.579856+0000","last_fullsized":"2024-04-25T09:03:33.579856+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:15.542055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579537+0000","last_change":"2024-04-25T09:03:32.579100+0000","last_active":"2024-04-25T09:03:33.579537+0000","last_peered":"2024-04-25T09:03:33.579537+0000","last_clean":"2024-04-25T09:03:33.579537+0000","last_became_active":"2024-04-25T09:03:32.578838+0000","last_became_peered":"2024-04-25T09:03:32.578838+0000","last_unstale":"2024-04-25T09:03:33.579537+0000","last_undegraded":"2024-04-25T09:03:33.579537+0000","last_fullsized":"2024-04-25T09:03:33.579537+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:10.469896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124001+0000","last_change":"2024-04-25T09:03:32.602406+0000","last_active":"2024-04-25T09:03:34.124001+0000","last_peered":"2024-04-25T09:03:34.124001+0000","last_clean":"2024-04-25T09:03:34.124001+0000","last_became_active":"2024-04-25T09:03:32.597291+0000","last_became_peered":"2024-04-25T09:03:32.597291+0000","last_unstale":"2024-04-25T09:03:34.124001+0000","last_undegraded":"2024-04-25T09:03:34.124001+0000","last_fullsized":"2024-04-25T09:03:34.124001+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:10.351894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123573+0000","last_change":"2024-04-25T09:03:32.584312+0000","last_active":"2024-04-25T09:03:34.123573+0000","last_peered":"2024-04-25T09:03:34.123573+0000","last_clean":"2024-04-25T09:03:34.123573+0000","last_became_active":"2024-04-25T09:03:32.583996+0000","last_became_peered":"2024-04-25T09:03:32.583996+0000","last_unstale":"2024-04-25T09:03:34.123573+0000","last_undegraded":"2024-04-25T09:03:34.123573+0000","last_fullsized":"2024-04-25T09:03:34.123573+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:04.637959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579933+0000","last_change":"2024-04-25T09:03:32.590559+0000","last_active":"2024-04-25T09:03:33.579933+0000","last_peered":"2024-04-25T09:03:33.579933+0000","last_clean":"2024-04-25T09:03:33.579933+0000","last_became_active":"2024-04-25T09:03:32.589608+0000","last_became_peered":"2024-04-25T09:03:32.589608+0000","last_unstale":"2024-04-25T09:03:33.579933+0000","last_undegraded":"2024-04-25T09:03:33.579933+0000","last_fullsized":"2024-04-25T09:03:33.579933+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:07.492678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580824+0000","last_change":"2024-04-25T09:03:32.601340+0000","last_active":"2024-04-25T09:03:33.580824+0000","last_peered":"2024-04-25T09:03:33.580824+0000","last_clean":"2024-04-25T09:03:33.580824+0000","last_became_active":"2024-04-25T09:03:32.600382+0000","last_became_peered":"2024-04-25T09:03:32.600382+0000","last_unstale":"2024-04-25T09:03:33.580824+0000","last_undegraded":"2024-04-25T09:03:33.580824+0000","last_fullsized":"2024-04-25T09:03:33.580824+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:21.209576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124352+0000","last_change":"2024-04-25T09:03:32.596844+0000","last_active":"2024-04-25T09:03:34.124352+0000","last_peered":"2024-04-25T09:03:34.124352+0000","last_clean":"2024-04-25T09:03:34.124352+0000","last_became_active":"2024-04-25T09:03:32.595207+0000","last_became_peered":"2024-04-25T09:03:32.595207+0000","last_unstale":"2024-04-25T09:03:34.124352+0000","last_undegraded":"2024-04-25T09:03:34.124352+0000","last_fullsized":"2024-04-25T09:03:34.124352+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:00.688658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577636+0000","last_change":"2024-04-25T09:03:32.599526+0000","last_active":"2024-04-25T09:03:33.577636+0000","last_peered":"2024-04-25T09:03:33.577636+0000","last_clean":"2024-04-25T09:03:33.577636+0000","last_became_active":"2024-04-25T09:03:32.596182+0000","last_became_peered":"2024-04-25T09:03:32.596182+0000","last_unstale":"2024-04-25T09:03:33.577636+0000","last_undegraded":"2024-04-25T09:03:33.577636+0000","last_fullsized":"2024-04-25T09:03:33.577636+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:04.851454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580008+0000","last_change":"2024-04-25T09:03:32.586609+0000","last_active":"2024-04-25T09:03:33.580008+0000","last_peered":"2024-04-25T09:03:33.580008+0000","last_clean":"2024-04-25T09:03:33.580008+0000","last_became_active":"2024-04-25T09:03:32.586232+0000","last_became_peered":"2024-04-25T09:03:32.586232+0000","last_unstale":"2024-04-25T09:03:33.580008+0000","last_undegraded":"2024-04-25T09:03:33.580008+0000","last_fullsized":"2024-04-25T09:03:33.580008+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:59.043158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580246+0000","last_change":"2024-04-25T09:03:32.584405+0000","last_active":"2024-04-25T09:03:33.580246+0000","last_peered":"2024-04-25T09:03:33.580246+0000","last_clean":"2024-04-25T09:03:33.580246+0000","last_became_active":"2024-04-25T09:03:32.584067+0000","last_became_peered":"2024-04-25T09:03:32.584067+0000","last_unstale":"2024-04-25T09:03:33.580246+0000","last_undegraded":"2024-04-25T09:03:33.580246+0000","last_fullsized":"2024-04-25T09:03:33.580246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:51.219471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583646+0000","last_change":"2024-04-25T09:03:32.581463+0000","last_active":"2024-04-25T09:03:33.583646+0000","last_peered":"2024-04-25T09:03:33.583646+0000","last_clean":"2024-04-25T09:03:33.583646+0000","last_became_active":"2024-04-25T09:03:32.580194+0000","last_became_peered":"2024-04-25T09:03:32.580194+0000","last_unstale":"2024-04-25T09:03:33.583646+0000","last_undegraded":"2024-04-25T09:03:33.583646+0000","last_fullsized":"2024-04-25T09:03:33.583646+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:07.712612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580088+0000","last_change":"2024-04-25T09:03:32.590152+0000","last_active":"2024-04-25T09:03:33.580088+0000","last_peered":"2024-04-25T09:03:33.580088+0000","last_clean":"2024-04-25T09:03:33.580088+0000","last_became_active":"2024-04-25T09:03:32.589786+0000","last_became_peered":"2024-04-25T09:03:32.589786+0000","last_unstale":"2024-04-25T09:03:33.580088+0000","last_undegraded":"2024-04-25T09:03:33.580088+0000","last_fullsized":"2024-04-25T09:03:33.580088+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:43.897067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.578730+0000","last_change":"2024-04-25T09:03:32.597975+0000","last_active":"2024-04-25T09:03:33.578730+0000","last_peered":"2024-04-25T09:03:33.578730+0000","last_clean":"2024-04-25T09:03:33.578730+0000","last_became_active":"2024-04-25T09:03:32.597708+0000","last_became_peered":"2024-04-25T09:03:32.597708+0000","last_unstale":"2024-04-25T09:03:33.578730+0000","last_undegraded":"2024-04-25T09:03:33.578730+0000","last_fullsized":"2024-04-25T09:03:33.578730+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:07.712612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583458+0000","last_change":"2024-04-25T09:03:32.579927+0000","last_active":"2024-04-25T09:03:33.583458+0000","last_peered":"2024-04-25T09:03:33.583458+0000","last_clean":"2024-04-25T09:03:33.583458+0000","last_became_active":"2024-04-25T09:03:32.579506+0000","last_became_peered":"2024-04-25T09:03:32.579506+0000","last_unstale":"2024-04-25T09:03:33.583458+0000","last_undegraded":"2024-04-25T09:03:33.583458+0000","last_fullsized":"2024-04-25T09:03:33.583458+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:48.605326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579268+0000","last_change":"2024-04-25T09:03:31.573055+0000","last_active":"2024-04-25T09:03:33.579268+0000","last_peered":"2024-04-25T09:03:33.579268+0000","last_clean":"2024-04-25T09:03:33.579268+0000","last_became_active":"2024-04-25T09:03:31.572714+0000","last_became_peered":"2024-04-25T09:03:31.572714+0000","last_unstale":"2024-04-25T09:03:33.579268+0000","last_undegraded":"2024-04-25T09:03:33.579268+0000","last_fullsized":"2024-04-25T09:03:33.579268+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:52.862962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579039+0000","last_change":"2024-04-25T09:03:32.576904+0000","last_active":"2024-04-25T09:03:33.579039+0000","last_peered":"2024-04-25T09:03:33.579039+0000","last_clean":"2024-04-25T09:03:33.579039+0000","last_became_active":"2024-04-25T09:03:32.576329+0000","last_became_peered":"2024-04-25T09:03:32.576329+0000","last_unstale":"2024-04-25T09:03:33.579039+0000","last_undegraded":"2024-04-25T09:03:33.579039+0000","last_fullsized":"2024-04-25T09:03:33.579039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:39.729827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577217+0000","last_change":"2024-04-25T09:03:31.583039+0000","last_active":"2024-04-25T09:03:33.577217+0000","last_peered":"2024-04-25T09:03:33.577217+0000","last_clean":"2024-04-25T09:03:33.577217+0000","last_became_active":"2024-04-25T09:03:31.582787+0000","last_became_peered":"2024-04-25T09:03:31.582787+0000","last_unstale":"2024-04-25T09:03:33.577217+0000","last_undegraded":"2024-04-25T09:03:33.577217+0000","last_fullsized":"2024-04-25T09:03:33.577217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:37.863718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579507+0000","last_change":"2024-04-25T09:03:32.578196+0000","last_active":"2024-04-25T09:03:33.579507+0000","last_peered":"2024-04-25T09:03:33.579507+0000","last_clean":"2024-04-25T09:03:33.579507+0000","last_became_active":"2024-04-25T09:03:32.577931+0000","last_became_peered":"2024-04-25T09:03:32.577931+0000","last_unstale":"2024-04-25T09:03:33.579507+0000","last_undegraded":"2024-04-25T09:03:33.579507+0000","last_fullsized":"2024-04-25T09:03:33.579507+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:20.105332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577639+0000","last_change":"2024-04-25T09:03:31.575875+0000","last_active":"2024-04-25T09:03:33.577639+0000","last_peered":"2024-04-25T09:03:33.577639+0000","last_clean":"2024-04-25T09:03:33.577639+0000","last_became_active":"2024-04-25T09:03:31.575460+0000","last_became_peered":"2024-04-25T09:03:31.575460+0000","last_unstale":"2024-04-25T09:03:33.577639+0000","last_undegraded":"2024-04-25T09:03:33.577639+0000","last_fullsized":"2024-04-25T09:03:33.577639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.666496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123698+0000","last_change":"2024-04-25T09:03:32.603494+0000","last_active":"2024-04-25T09:03:34.123698+0000","last_peered":"2024-04-25T09:03:34.123698+0000","last_clean":"2024-04-25T09:03:34.123698+0000","last_became_active":"2024-04-25T09:03:32.603222+0000","last_became_peered":"2024-04-25T09:03:32.603222+0000","last_unstale":"2024-04-25T09:03:34.123698+0000","last_undegraded":"2024-04-25T09:03:34.123698+0000","last_fullsized":"2024-04-25T09:03:34.123698+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.951048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579504+0000","last_change":"2024-04-25T09:03:31.572946+0000","last_active":"2024-04-25T09:03:33.579504+0000","last_peered":"2024-04-25T09:03:33.579504+0000","last_clean":"2024-04-25T09:03:33.579504+0000","last_became_active":"2024-04-25T09:03:31.572621+0000","last_became_peered":"2024-04-25T09:03:31.572621+0000","last_unstale":"2024-04-25T09:03:33.579504+0000","last_undegraded":"2024-04-25T09:03:33.579504+0000","last_fullsized":"2024-04-25T09:03:33.579504+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:14.535629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123951+0000","last_change":"2024-04-25T09:03:32.580601+0000","last_active":"2024-04-25T09:03:34.123951+0000","last_peered":"2024-04-25T09:03:34.123951+0000","last_clean":"2024-04-25T09:03:34.123951+0000","last_became_active":"2024-04-25T09:03:32.580290+0000","last_became_peered":"2024-04-25T09:03:32.580290+0000","last_unstale":"2024-04-25T09:03:34.123951+0000","last_undegraded":"2024-04-25T09:03:34.123951+0000","last_fullsized":"2024-04-25T09:03:34.123951+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:21.221029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580329+0000","last_change":"2024-04-25T09:03:31.582647+0000","last_active":"2024-04-25T09:03:33.580329+0000","last_peered":"2024-04-25T09:03:33.580329+0000","last_clean":"2024-04-25T09:03:33.580329+0000","last_became_active":"2024-04-25T09:03:31.582391+0000","last_became_peered":"2024-04-25T09:03:31.582391+0000","last_unstale":"2024-04-25T09:03:33.580329+0000","last_undegraded":"2024-04-25T09:03:33.580329+0000","last_fullsized":"2024-04-25T09:03:33.580329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:59.477348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583821+0000","last_change":"2024-04-25T09:03:32.582073+0000","last_active":"2024-04-25T09:03:33.583821+0000","last_peered":"2024-04-25T09:03:33.583821+0000","last_clean":"2024-04-25T09:03:33.583821+0000","last_became_active":"2024-04-25T09:03:32.581708+0000","last_became_peered":"2024-04-25T09:03:32.581708+0000","last_unstale":"2024-04-25T09:03:33.583821+0000","last_undegraded":"2024-04-25T09:03:33.583821+0000","last_fullsized":"2024-04-25T09:03:33.583821+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:07.492678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123469+0000","last_change":"2024-04-25T09:03:31.568403+0000","last_active":"2024-04-25T09:03:34.123469+0000","last_peered":"2024-04-25T09:03:34.123469+0000","last_clean":"2024-04-25T09:03:34.123469+0000","last_became_active":"2024-04-25T09:03:31.567932+0000","last_became_peered":"2024-04-25T09:03:31.567932+0000","last_unstale":"2024-04-25T09:03:34.123469+0000","last_undegraded":"2024-04-25T09:03:34.123469+0000","last_fullsized":"2024-04-25T09:03:34.123469+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:03.144882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124467+0000","last_change":"2024-04-25T09:03:32.595469+0000","last_active":"2024-04-25T09:03:34.124467+0000","last_peered":"2024-04-25T09:03:34.124467+0000","last_clean":"2024-04-25T09:03:34.124467+0000","last_became_active":"2024-04-25T09:03:32.594544+0000","last_became_peered":"2024-04-25T09:03:32.594544+0000","last_unstale":"2024-04-25T09:03:34.124467+0000","last_undegraded":"2024-04-25T09:03:34.124467+0000","last_fullsized":"2024-04-25T09:03:34.124467+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:10.882865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.578933+0000","last_change":"2024-04-25T09:03:31.579603+0000","last_active":"2024-04-25T09:03:33.578933+0000","last_peered":"2024-04-25T09:03:33.578933+0000","last_clean":"2024-04-25T09:03:33.578933+0000","last_became_active":"2024-04-25T09:03:31.578991+0000","last_became_peered":"2024-04-25T09:03:31.578991+0000","last_unstale":"2024-04-25T09:03:33.578933+0000","last_undegraded":"2024-04-25T09:03:33.578933+0000","last_fullsized":"2024-04-25T09:03:33.578933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:07.925299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.584003+0000","last_change":"2024-04-25T09:03:32.584073+0000","last_active":"2024-04-25T09:03:33.584003+0000","last_peered":"2024-04-25T09:03:33.584003+0000","last_clean":"2024-04-25T09:03:33.584003+0000","last_became_active":"2024-04-25T09:03:32.583668+0000","last_became_peered":"2024-04-25T09:03:32.583668+0000","last_unstale":"2024-04-25T09:03:33.584003+0000","last_undegraded":"2024-04-25T09:03:33.584003+0000","last_fullsized":"2024-04-25T09:03:33.584003+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:43.897067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579933+0000","last_change":"2024-04-25T09:03:31.575927+0000","last_active":"2024-04-25T09:03:33.579933+0000","last_peered":"2024-04-25T09:03:33.579933+0000","last_clean":"2024-04-25T09:03:33.579933+0000","last_became_active":"2024-04-25T09:03:31.575655+0000","last_became_peered":"2024-04-25T09:03:31.575655+0000","last_unstale":"2024-04-25T09:03:33.579933+0000","last_undegraded":"2024-04-25T09:03:33.579933+0000","last_fullsized":"2024-04-25T09:03:33.579933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:01.272870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123580+0000","last_change":"2024-04-25T09:03:32.605509+0000","last_active":"2024-04-25T09:03:34.123580+0000","last_peered":"2024-04-25T09:03:34.123580+0000","last_clean":"2024-04-25T09:03:34.123580+0000","last_became_active":"2024-04-25T09:03:32.605197+0000","last_became_peered":"2024-04-25T09:03:32.605197+0000","last_unstale":"2024-04-25T09:03:34.123580+0000","last_undegraded":"2024-04-25T09:03:34.123580+0000","last_fullsized":"2024-04-25T09:03:34.123580+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:50.717791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583942+0000","last_change":"2024-04-25T09:03:31.579577+0000","last_active":"2024-04-25T09:03:33.583942+0000","last_peered":"2024-04-25T09:03:33.583942+0000","last_clean":"2024-04-25T09:03:33.583942+0000","last_became_active":"2024-04-25T09:03:31.579281+0000","last_became_peered":"2024-04-25T09:03:31.579281+0000","last_unstale":"2024-04-25T09:03:33.583942+0000","last_undegraded":"2024-04-25T09:03:33.583942+0000","last_fullsized":"2024-04-25T09:03:33.583942+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:12.919085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579330+0000","last_change":"2024-04-25T09:03:32.577265+0000","last_active":"2024-04-25T09:03:33.579330+0000","last_peered":"2024-04-25T09:03:33.579330+0000","last_clean":"2024-04-25T09:03:33.579330+0000","last_became_active":"2024-04-25T09:03:32.576960+0000","last_became_peered":"2024-04-25T09:03:32.576960+0000","last_unstale":"2024-04-25T09:03:33.579330+0000","last_undegraded":"2024-04-25T09:03:33.579330+0000","last_fullsized":"2024-04-25T09:03:33.579330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:43.897067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123946+0000","last_change":"2024-04-25T09:03:31.574188+0000","last_active":"2024-04-25T09:03:34.123946+0000","last_peered":"2024-04-25T09:03:34.123946+0000","last_clean":"2024-04-25T09:03:34.123946+0000","last_became_active":"2024-04-25T09:03:31.573856+0000","last_became_peered":"2024-04-25T09:03:31.573856+0000","last_unstale":"2024-04-25T09:03:34.123946+0000","last_undegraded":"2024-04-25T09:03:34.123946+0000","last_fullsized":"2024-04-25T09:03:34.123946+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:37.863718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580220+0000","last_change":"2024-04-25T09:03:32.585440+0000","last_active":"2024-04-25T09:03:33.580220+0000","last_peered":"2024-04-25T09:03:33.580220+0000","last_clean":"2024-04-25T09:03:33.580220+0000","last_became_active":"2024-04-25T09:03:32.583932+0000","last_became_peered":"2024-04-25T09:03:32.583932+0000","last_unstale":"2024-04-25T09:03:33.580220+0000","last_undegraded":"2024-04-25T09:03:33.580220+0000","last_fullsized":"2024-04-25T09:03:33.580220+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:55.719444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583908+0000","last_change":"2024-04-25T09:03:31.584946+0000","last_active":"2024-04-25T09:03:33.583908+0000","last_peered":"2024-04-25T09:03:33.583908+0000","last_clean":"2024-04-25T09:03:33.583908+0000","last_became_active":"2024-04-25T09:03:31.584523+0000","last_became_peered":"2024-04-25T09:03:31.584523+0000","last_unstale":"2024-04-25T09:03:33.583908+0000","last_undegraded":"2024-04-25T09:03:33.583908+0000","last_fullsized":"2024-04-25T09:03:33.583908+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:20.214602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123637+0000","last_change":"2024-04-25T09:03:32.588761+0000","last_active":"2024-04-25T09:03:34.123637+0000","last_peered":"2024-04-25T09:03:34.123637+0000","last_clean":"2024-04-25T09:03:34.123637+0000","last_became_active":"2024-04-25T09:03:32.588460+0000","last_became_peered":"2024-04-25T09:03:32.588460+0000","last_unstale":"2024-04-25T09:03:34.123637+0000","last_undegraded":"2024-04-25T09:03:34.123637+0000","last_fullsized":"2024-04-25T09:03:34.123637+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:21.884484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124219+0000","last_change":"2024-04-25T09:03:31.582044+0000","last_active":"2024-04-25T09:03:34.124219+0000","last_peered":"2024-04-25T09:03:34.124219+0000","last_clean":"2024-04-25T09:03:34.124219+0000","last_became_active":"2024-04-25T09:03:31.581677+0000","last_became_peered":"2024-04-25T09:03:31.581677+0000","last_unstale":"2024-04-25T09:03:34.124219+0000","last_undegraded":"2024-04-25T09:03:34.124219+0000","last_fullsized":"2024-04-25T09:03:34.124219+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:03.845028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579238+0000","last_change":"2024-04-25T09:03:32.576664+0000","last_active":"2024-04-25T09:03:33.579238+0000","last_peered":"2024-04-25T09:03:33.579238+0000","last_clean":"2024-04-25T09:03:33.579238+0000","last_became_active":"2024-04-25T09:03:32.576368+0000","last_became_peered":"2024-04-25T09:03:32.576368+0000","last_unstale":"2024-04-25T09:03:33.579238+0000","last_undegraded":"2024-04-25T09:03:33.579238+0000","last_fullsized":"2024-04-25T09:03:33.579238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:33.397775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580411+0000","last_change":"2024-04-25T09:03:31.577590+0000","last_active":"2024-04-25T09:03:33.580411+0000","last_peered":"2024-04-25T09:03:33.580411+0000","last_clean":"2024-04-25T09:03:33.580411+0000","last_became_active":"2024-04-25T09:03:31.577312+0000","last_became_peered":"2024-04-25T09:03:31.577312+0000","last_unstale":"2024-04-25T09:03:33.580411+0000","last_undegraded":"2024-04-25T09:03:33.580411+0000","last_fullsized":"2024-04-25T09:03:33.580411+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:18.942139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580641+0000","last_change":"2024-04-25T09:03:32.585621+0000","last_active":"2024-04-25T09:03:33.580641+0000","last_peered":"2024-04-25T09:03:33.580641+0000","last_clean":"2024-04-25T09:03:33.580641+0000","last_became_active":"2024-04-25T09:03:32.585395+0000","last_became_peered":"2024-04-25T09:03:32.585395+0000","last_unstale":"2024-04-25T09:03:33.580641+0000","last_undegraded":"2024-04-25T09:03:33.580641+0000","last_fullsized":"2024-04-25T09:03:33.580641+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:02.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579669+0000","last_change":"2024-04-25T09:03:31.577671+0000","last_active":"2024-04-25T09:03:33.579669+0000","last_peered":"2024-04-25T09:03:33.579669+0000","last_clean":"2024-04-25T09:03:33.579669+0000","last_became_active":"2024-04-25T09:03:31.577400+0000","last_became_peered":"2024-04-25T09:03:31.577400+0000","last_unstale":"2024-04-25T09:03:33.579669+0000","last_undegraded":"2024-04-25T09:03:33.579669+0000","last_fullsized":"2024-04-25T09:03:33.579669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.666496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124394+0000","last_change":"2024-04-25T09:03:32.596570+0000","last_active":"2024-04-25T09:03:34.124394+0000","last_peered":"2024-04-25T09:03:34.124394+0000","last_clean":"2024-04-25T09:03:34.124394+0000","last_became_active":"2024-04-25T09:03:32.594896+0000","last_became_peered":"2024-04-25T09:03:32.594896+0000","last_unstale":"2024-04-25T09:03:34.124394+0000","last_undegraded":"2024-04-25T09:03:34.124394+0000","last_fullsized":"2024-04-25T09:03:34.124394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:11.675064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583606+0000","last_change":"2024-04-25T09:03:31.579538+0000","last_active":"2024-04-25T09:03:33.583606+0000","last_peered":"2024-04-25T09:03:33.583606+0000","last_clean":"2024-04-25T09:03:33.583606+0000","last_became_active":"2024-04-25T09:03:31.579261+0000","last_became_peered":"2024-04-25T09:03:31.579261+0000","last_unstale":"2024-04-25T09:03:33.583606+0000","last_undegraded":"2024-04-25T09:03:33.583606+0000","last_fullsized":"2024-04-25T09:03:33.583606+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:20.878058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580689+0000","last_change":"2024-04-25T09:03:32.583584+0000","last_active":"2024-04-25T09:03:33.580689+0000","last_peered":"2024-04-25T09:03:33.580689+0000","last_clean":"2024-04-25T09:03:33.580689+0000","last_became_active":"2024-04-25T09:03:32.583307+0000","last_became_peered":"2024-04-25T09:03:32.583307+0000","last_unstale":"2024-04-25T09:03:33.580689+0000","last_undegraded":"2024-04-25T09:03:33.580689+0000","last_fullsized":"2024-04-25T09:03:33.580689+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:29.297272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":22,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123876+0000","last_change":"2024-04-25T09:03:31.579063+0000","last_active":"2024-04-25T09:03:34.123876+0000","last_peered":"2024-04-25T09:03:34.123876+0000","last_clean":"2024-04-25T09:03:34.123876+0000","last_became_active":"2024-04-25T09:03:31.578701+0000","last_became_peered":"2024-04-25T09:03:31.578701+0000","last_unstale":"2024-04-25T09:03:34.123876+0000","last_undegraded":"2024-04-25T09:03:34.123876+0000","last_fullsized":"2024-04-25T09:03:34.123876+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:57.764748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123861+0000","last_change":"2024-04-25T09:03:32.603839+0000","last_active":"2024-04-25T09:03:34.123861+0000","last_peered":"2024-04-25T09:03:34.123861+0000","last_clean":"2024-04-25T09:03:34.123861+0000","last_became_active":"2024-04-25T09:03:32.597633+0000","last_became_peered":"2024-04-25T09:03:32.597633+0000","last_unstale":"2024-04-25T09:03:34.123861+0000","last_undegraded":"2024-04-25T09:03:34.123861+0000","last_fullsized":"2024-04-25T09:03:34.123861+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:02.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580885+0000","last_change":"2024-04-25T09:03:31.584014+0000","last_active":"2024-04-25T09:03:33.580885+0000","last_peered":"2024-04-25T09:03:33.580885+0000","last_clean":"2024-04-25T09:03:33.580885+0000","last_became_active":"2024-04-25T09:03:31.583714+0000","last_became_peered":"2024-04-25T09:03:31.583714+0000","last_unstale":"2024-04-25T09:03:33.580885+0000","last_undegraded":"2024-04-25T09:03:33.580885+0000","last_fullsized":"2024-04-25T09:03:33.580885+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:20.878058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577068+0000","last_change":"2024-04-25T09:03:32.574835+0000","last_active":"2024-04-25T09:03:33.577068+0000","last_peered":"2024-04-25T09:03:33.577068+0000","last_clean":"2024-04-25T09:03:33.577068+0000","last_became_active":"2024-04-25T09:03:32.574552+0000","last_became_peered":"2024-04-25T09:03:32.574552+0000","last_unstale":"2024-04-25T09:03:33.577068+0000","last_undegraded":"2024-04-25T09:03:33.577068+0000","last_fullsized":"2024-04-25T09:03:33.577068+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:20.105332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124231+0000","last_change":"2024-04-25T09:03:31.575566+0000","last_active":"2024-04-25T09:03:34.124231+0000","last_peered":"2024-04-25T09:03:34.124231+0000","last_clean":"2024-04-25T09:03:34.124231+0000","last_became_active":"2024-04-25T09:03:31.575279+0000","last_became_peered":"2024-04-25T09:03:31.575279+0000","last_unstale":"2024-04-25T09:03:34.124231+0000","last_undegraded":"2024-04-25T09:03:34.124231+0000","last_fullsized":"2024-04-25T09:03:34.124231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:58.773892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123678+0000","last_change":"2024-04-25T09:03:32.574174+0000","last_active":"2024-04-25T09:03:34.123678+0000","last_peered":"2024-04-25T09:03:34.123678+0000","last_clean":"2024-04-25T09:03:34.123678+0000","last_became_active":"2024-04-25T09:03:32.573863+0000","last_became_peered":"2024-04-25T09:03:32.573863+0000","last_unstale":"2024-04-25T09:03:34.123678+0000","last_undegraded":"2024-04-25T09:03:34.123678+0000","last_fullsized":"2024-04-25T09:03:34.123678+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:13.925511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579037+0000","last_change":"2024-04-25T09:03:31.579622+0000","last_active":"2024-04-25T09:03:33.579037+0000","last_peered":"2024-04-25T09:03:33.579037+0000","last_clean":"2024-04-25T09:03:33.579037+0000","last_became_active":"2024-04-25T09:03:31.579295+0000","last_became_peered":"2024-04-25T09:03:31.579295+0000","last_unstale":"2024-04-25T09:03:33.579037+0000","last_undegraded":"2024-04-25T09:03:33.579037+0000","last_fullsized":"2024-04-25T09:03:33.579037+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:09.860173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577205+0000","last_change":"2024-04-25T09:03:32.580251+0000","last_active":"2024-04-25T09:03:33.577205+0000","last_peered":"2024-04-25T09:03:33.577205+0000","last_clean":"2024-04-25T09:03:33.577205+0000","last_became_active":"2024-04-25T09:03:32.579992+0000","last_became_peered":"2024-04-25T09:03:32.579992+0000","last_unstale":"2024-04-25T09:03:33.577205+0000","last_undegraded":"2024-04-25T09:03:33.577205+0000","last_fullsized":"2024-04-25T09:03:33.577205+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:59.043158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580102+0000","last_change":"2024-04-25T09:03:31.584444+0000","last_active":"2024-04-25T09:03:33.580102+0000","last_peered":"2024-04-25T09:03:33.580102+0000","last_clean":"2024-04-25T09:03:33.580102+0000","last_became_active":"2024-04-25T09:03:31.584132+0000","last_became_peered":"2024-04-25T09:03:31.584132+0000","last_unstale":"2024-04-25T09:03:33.580102+0000","last_undegraded":"2024-04-25T09:03:33.580102+0000","last_fullsized":"2024-04-25T09:03:33.580102+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:01.272870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579414+0000","last_change":"2024-04-25T09:03:32.576056+0000","last_active":"2024-04-25T09:03:33.579414+0000","last_peered":"2024-04-25T09:03:33.579414+0000","last_clean":"2024-04-25T09:03:33.579414+0000","last_became_active":"2024-04-25T09:03:32.575769+0000","last_became_peered":"2024-04-25T09:03:32.575769+0000","last_unstale":"2024-04-25T09:03:33.579414+0000","last_undegraded":"2024-04-25T09:03:33.579414+0000","last_fullsized":"2024-04-25T09:03:33.579414+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.096246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577261+0000","last_change":"2024-04-25T09:03:31.577314+0000","last_active":"2024-04-25T09:03:33.577261+0000","last_peered":"2024-04-25T09:03:33.577261+0000","last_clean":"2024-04-25T09:03:33.577261+0000","last_became_active":"2024-04-25T09:03:31.577034+0000","last_became_peered":"2024-04-25T09:03:31.577034+0000","last_unstale":"2024-04-25T09:03:33.577261+0000","last_undegraded":"2024-04-25T09:03:33.577261+0000","last_fullsized":"2024-04-25T09:03:33.577261+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:52.862962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579352+0000","last_change":"2024-04-25T09:03:32.575898+0000","last_active":"2024-04-25T09:03:33.579352+0000","last_peered":"2024-04-25T09:03:33.579352+0000","last_clean":"2024-04-25T09:03:33.579352+0000","last_became_active":"2024-04-25T09:03:32.575573+0000","last_became_peered":"2024-04-25T09:03:32.575573+0000","last_unstale":"2024-04-25T09:03:33.579352+0000","last_undegraded":"2024-04-25T09:03:33.579352+0000","last_fullsized":"2024-04-25T09:03:33.579352+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:21.221029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124113+0000","last_change":"2024-04-25T09:03:31.582005+0000","last_active":"2024-04-25T09:03:34.124113+0000","last_peered":"2024-04-25T09:03:34.124113+0000","last_clean":"2024-04-25T09:03:34.124113+0000","last_became_active":"2024-04-25T09:03:31.581708+0000","last_became_peered":"2024-04-25T09:03:31.581708+0000","last_unstale":"2024-04-25T09:03:34.124113+0000","last_undegraded":"2024-04-25T09:03:34.124113+0000","last_fullsized":"2024-04-25T09:03:34.124113+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:47.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580550+0000","last_change":"2024-04-25T09:03:32.584789+0000","last_active":"2024-04-25T09:03:33.580550+0000","last_peered":"2024-04-25T09:03:33.580550+0000","last_clean":"2024-04-25T09:03:33.580550+0000","last_became_active":"2024-04-25T09:03:32.584477+0000","last_became_peered":"2024-04-25T09:03:32.584477+0000","last_unstale":"2024-04-25T09:03:33.580550+0000","last_undegraded":"2024-04-25T09:03:33.580550+0000","last_fullsized":"2024-04-25T09:03:33.580550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.951048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580060+0000","last_change":"2024-04-25T09:03:31.578469+0000","last_active":"2024-04-25T09:03:33.580060+0000","last_peered":"2024-04-25T09:03:33.580060+0000","last_clean":"2024-04-25T09:03:33.580060+0000","last_became_active":"2024-04-25T09:03:31.578199+0000","last_became_peered":"2024-04-25T09:03:31.578199+0000","last_unstale":"2024-04-25T09:03:33.580060+0000","last_undegraded":"2024-04-25T09:03:33.580060+0000","last_fullsized":"2024-04-25T09:03:33.580060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:09.860173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577438+0000","last_change":"2024-04-25T09:03:32.603880+0000","last_active":"2024-04-25T09:03:33.577438+0000","last_peered":"2024-04-25T09:03:33.577438+0000","last_clean":"2024-04-25T09:03:33.577438+0000","last_became_active":"2024-04-25T09:03:32.603214+0000","last_became_peered":"2024-04-25T09:03:32.603214+0000","last_unstale":"2024-04-25T09:03:33.577438+0000","last_undegraded":"2024-04-25T09:03:33.577438+0000","last_fullsized":"2024-04-25T09:03:33.577438+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:20.202455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123430+0000","last_change":"2024-04-25T09:03:31.579787+0000","last_active":"2024-04-25T09:03:34.123430+0000","last_peered":"2024-04-25T09:03:34.123430+0000","last_clean":"2024-04-25T09:03:34.123430+0000","last_became_active":"2024-04-25T09:03:31.579208+0000","last_became_peered":"2024-04-25T09:03:31.579208+0000","last_unstale":"2024-04-25T09:03:34.123430+0000","last_undegraded":"2024-04-25T09:03:34.123430+0000","last_fullsized":"2024-04-25T09:03:34.123430+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:27.085699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579611+0000","last_change":"2024-04-25T09:03:32.597762+0000","last_active":"2024-04-25T09:03:33.579611+0000","last_peered":"2024-04-25T09:03:33.579611+0000","last_clean":"2024-04-25T09:03:33.579611+0000","last_became_active":"2024-04-25T09:03:32.597516+0000","last_became_peered":"2024-04-25T09:03:32.597516+0000","last_unstale":"2024-04-25T09:03:33.579611+0000","last_undegraded":"2024-04-25T09:03:33.579611+0000","last_fullsized":"2024-04-25T09:03:33.579611+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:55.719444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579386+0000","last_change":"2024-04-25T09:03:31.578252+0000","last_active":"2024-04-25T09:03:33.579386+0000","last_peered":"2024-04-25T09:03:33.579386+0000","last_clean":"2024-04-25T09:03:33.579386+0000","last_became_active":"2024-04-25T09:03:31.577995+0000","last_became_peered":"2024-04-25T09:03:31.577995+0000","last_unstale":"2024-04-25T09:03:33.579386+0000","last_undegraded":"2024-04-25T09:03:33.579386+0000","last_fullsized":"2024-04-25T09:03:33.579386+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:37.863718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577287+0000","last_change":"2024-04-25T09:03:32.586525+0000","last_active":"2024-04-25T09:03:33.577287+0000","last_peered":"2024-04-25T09:03:33.577287+0000","last_clean":"2024-04-25T09:03:33.577287+0000","last_became_active":"2024-04-25T09:03:32.586243+0000","last_became_peered":"2024-04-25T09:03:32.586243+0000","last_unstale":"2024-04-25T09:03:33.577287+0000","last_undegraded":"2024-04-25T09:03:33.577287+0000","last_fullsized":"2024-04-25T09:03:33.577287+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:30.209192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583949+0000","last_change":"2024-04-25T09:03:31.582406+0000","last_active":"2024-04-25T09:03:33.583949+0000","last_peered":"2024-04-25T09:03:33.583949+0000","last_clean":"2024-04-25T09:03:33.583949+0000","last_became_active":"2024-04-25T09:03:31.582128+0000","last_became_peered":"2024-04-25T09:03:31.582128+0000","last_unstale":"2024-04-25T09:03:33.583949+0000","last_undegraded":"2024-04-25T09:03:33.583949+0000","last_fullsized":"2024-04-25T09:03:33.583949+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:19.098906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124342+0000","last_change":"2024-04-25T09:03:32.597021+0000","last_active":"2024-04-25T09:03:34.124342+0000","last_peered":"2024-04-25T09:03:34.124342+0000","last_clean":"2024-04-25T09:03:34.124342+0000","last_became_active":"2024-04-25T09:03:32.596844+0000","last_became_peered":"2024-04-25T09:03:32.596844+0000","last_unstale":"2024-04-25T09:03:34.124342+0000","last_undegraded":"2024-04-25T09:03:34.124342+0000","last_fullsized":"2024-04-25T09:03:34.124342+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:21.209576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580418+0000","last_change":"2024-04-25T09:03:31.575054+0000","last_active":"2024-04-25T09:03:33.580418+0000","last_peered":"2024-04-25T09:03:33.580418+0000","last_clean":"2024-04-25T09:03:33.580418+0000","last_became_active":"2024-04-25T09:03:31.574792+0000","last_became_peered":"2024-04-25T09:03:31.574792+0000","last_unstale":"2024-04-25T09:03:33.580418+0000","last_undegraded":"2024-04-25T09:03:33.580418+0000","last_fullsized":"2024-04-25T09:03:33.580418+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:22.298258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580383+0000","last_change":"2024-04-25T09:03:32.600747+0000","last_active":"2024-04-25T09:03:33.580383+0000","last_peered":"2024-04-25T09:03:33.580383+0000","last_clean":"2024-04-25T09:03:33.580383+0000","last_became_active":"2024-04-25T09:03:32.600462+0000","last_became_peered":"2024-04-25T09:03:32.600462+0000","last_unstale":"2024-04-25T09:03:33.580383+0000","last_undegraded":"2024-04-25T09:03:33.580383+0000","last_fullsized":"2024-04-25T09:03:33.580383+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:58.221449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124046+0000","last_change":"2024-04-25T09:03:31.580977+0000","last_active":"2024-04-25T09:03:34.124046+0000","last_peered":"2024-04-25T09:03:34.124046+0000","last_clean":"2024-04-25T09:03:34.124046+0000","last_became_active":"2024-04-25T09:03:31.580652+0000","last_became_peered":"2024-04-25T09:03:31.580652+0000","last_unstale":"2024-04-25T09:03:34.124046+0000","last_undegraded":"2024-04-25T09:03:34.124046+0000","last_fullsized":"2024-04-25T09:03:34.124046+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:06.486252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579183+0000","last_change":"2024-04-25T09:03:32.576572+0000","last_active":"2024-04-25T09:03:33.579183+0000","last_peered":"2024-04-25T09:03:33.579183+0000","last_clean":"2024-04-25T09:03:33.579183+0000","last_became_active":"2024-04-25T09:03:32.576013+0000","last_became_peered":"2024-04-25T09:03:32.576013+0000","last_unstale":"2024-04-25T09:03:33.579183+0000","last_undegraded":"2024-04-25T09:03:33.579183+0000","last_fullsized":"2024-04-25T09:03:33.579183+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:07.492678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124225+0000","last_change":"2024-04-25T09:03:31.572954+0000","last_active":"2024-04-25T09:03:34.124225+0000","last_peered":"2024-04-25T09:03:34.124225+0000","last_clean":"2024-04-25T09:03:34.124225+0000","last_became_active":"2024-04-25T09:03:31.572647+0000","last_became_peered":"2024-04-25T09:03:31.572647+0000","last_unstale":"2024-04-25T09:03:34.124225+0000","last_undegraded":"2024-04-25T09:03:34.124225+0000","last_fullsized":"2024-04-25T09:03:34.124225+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:19.196029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580684+0000","last_change":"2024-04-25T09:03:32.592262+0000","last_active":"2024-04-25T09:03:33.580684+0000","last_peered":"2024-04-25T09:03:33.580684+0000","last_clean":"2024-04-25T09:03:33.580684+0000","last_became_active":"2024-04-25T09:03:32.589711+0000","last_became_peered":"2024-04-25T09:03:32.589711+0000","last_unstale":"2024-04-25T09:03:33.580684+0000","last_undegraded":"2024-04-25T09:03:33.580684+0000","last_fullsized":"2024-04-25T09:03:33.580684+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:10.351894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123471+0000","last_change":"2024-04-25T09:03:31.574156+0000","last_active":"2024-04-25T09:03:34.123471+0000","last_peered":"2024-04-25T09:03:34.123471+0000","last_clean":"2024-04-25T09:03:34.123471+0000","last_became_active":"2024-04-25T09:03:31.573837+0000","last_became_peered":"2024-04-25T09:03:31.573837+0000","last_unstale":"2024-04-25T09:03:34.123471+0000","last_undegraded":"2024-04-25T09:03:34.123471+0000","last_fullsized":"2024-04-25T09:03:34.123471+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:52.862962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124641+0000","last_change":"2024-04-25T09:03:32.597823+0000","last_active":"2024-04-25T09:03:34.124641+0000","last_peered":"2024-04-25T09:03:34.124641+0000","last_clean":"2024-04-25T09:03:34.124641+0000","last_became_active":"2024-04-25T09:03:32.597504+0000","last_became_peered":"2024-04-25T09:03:32.597504+0000","last_unstale":"2024-04-25T09:03:34.124641+0000","last_undegraded":"2024-04-25T09:03:34.124641+0000","last_fullsized":"2024-04-25T09:03:34.124641+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:50.597260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579117+0000","last_change":"2024-04-25T09:03:31.578445+0000","last_active":"2024-04-25T09:03:33.579117+0000","last_peered":"2024-04-25T09:03:33.579117+0000","last_clean":"2024-04-25T09:03:33.579117+0000","last_became_active":"2024-04-25T09:03:31.578156+0000","last_became_peered":"2024-04-25T09:03:31.578156+0000","last_unstale":"2024-04-25T09:03:33.579117+0000","last_undegraded":"2024-04-25T09:03:33.579117+0000","last_fullsized":"2024-04-25T09:03:33.579117+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:48.447202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579680+0000","last_change":"2024-04-25T09:03:32.572564+0000","last_active":"2024-04-25T09:03:33.579680+0000","last_peered":"2024-04-25T09:03:33.579680+0000","last_clean":"2024-04-25T09:03:33.579680+0000","last_became_active":"2024-04-25T09:03:32.572279+0000","last_became_peered":"2024-04-25T09:03:32.572279+0000","last_unstale":"2024-04-25T09:03:33.579680+0000","last_undegraded":"2024-04-25T09:03:33.579680+0000","last_fullsized":"2024-04-25T09:03:33.579680+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:49.453628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.582382+0000","last_change":"2024-04-25T09:03:31.578467+0000","last_active":"2024-04-25T09:03:33.582382+0000","last_peered":"2024-04-25T09:03:33.582382+0000","last_clean":"2024-04-25T09:03:33.582382+0000","last_became_active":"2024-04-25T09:03:31.577996+0000","last_became_peered":"2024-04-25T09:03:31.577996+0000","last_unstale":"2024-04-25T09:03:33.582382+0000","last_undegraded":"2024-04-25T09:03:33.582382+0000","last_fullsized":"2024-04-25T09:03:33.582382+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:49.711365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":229,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583347+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:03:33.583347+0000","last_peered":"2024-04-25T09:03:33.583347+0000","last_clean":"2024-04-25T09:03:33.583347+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:03:33.583347+0000","last_undegraded":"2024-04-25T09:03:33.583347+0000","last_fullsized":"2024-04-25T09:03:33.583347+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1220608,"data_stored":866851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":626688,"data_stored":277011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31792,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":618496,"data_stored":276359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":610304,"data_stored":270249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":271301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":271279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":626688,"data_stored":276519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1220608,"data_stored":866783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:03:36.681 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:03:36.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.866+0000 7efea5c00640 1 Processor -- start 2024-04-25T09:03:36.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efea5c00640 1 -- start start 2024-04-25T09:03:36.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efea5c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efea015b980 0x7efea00cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efea5c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efea0071970 0x7efea00cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efea5c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea00ce7f0 con 0x7efea015b5a0 2024-04-25T09:03:36.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efea5c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea00ce5b0 con 0x7efea0071970 2024-04-25T09:03:36.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efea5c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea00cfcd0 con 0x7efea015b980 2024-04-25T09:03:36.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efe9f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efea0071970 0x7efea00cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efe9f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efea0071970 0x7efea00cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47808/0 (socket says 172.21.15.59:47808) 2024-04-25T09:03:36.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efe9f400640 1 -- 172.21.15.59:0/1840739024 learned_addr learned my addr 172.21.15.59:0/1840739024 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:36.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efe96000640 1 --2- 172.21.15.59:0/1840739024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efea015b980 0x7efea00cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efe9f400640 1 -- 172.21.15.59:0/1840739024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efea015b980 msgr2=0x7efea00cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:36.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efe9f400640 1 --2- 172.21.15.59:0/1840739024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efea015b980 0x7efea00cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efe9f400640 1 -- 172.21.15.59:0/1840739024 >> v1:172.21.15.178:6789/0 conn(0x7efea015b5a0 legacy=0x7efea00cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.870+0000 7efe9f400640 1 -- 172.21.15.59:0/1840739024 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea00cead0 con 0x7efea0071970 2024-04-25T09:03:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efe9f400640 1 --2- 172.21.15.59:0/1840739024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea0071970 0x7efea00cc270 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7efe98009e50 tx=0x7efe9801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df86258a4210da8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efe9e000640 1 -- 172.21.15.59:0/1840739024 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe980a58f0 con 0x7efea0071970 2024-04-25T09:03:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efe9e000640 1 -- 172.21.15.59:0/1840739024 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe980a5a90 con 0x7efea0071970 2024-04-25T09:03:36.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efe9e000640 1 -- 172.21.15.59:0/1840739024 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe980a5e60 con 0x7efea0071970 2024-04-25T09:03:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efea5c00640 1 -- 172.21.15.59:0/1840739024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea0071970 msgr2=0x7efea00cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efea5c00640 1 --2- 172.21.15.59:0/1840739024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea0071970 0x7efea00cc270 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7efe98009e50 tx=0x7efe9801ca00 comp rx=0 tx=0).stop 2024-04-25T09:03:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efea5c00640 1 -- 172.21.15.59:0/1840739024 shutdown_connections 2024-04-25T09:03:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efea5c00640 1 --2- 172.21.15.59:0/1840739024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea0071970 0x7efea00cc270 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efea5c00640 1 --2- 172.21.15.59:0/1840739024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efea015b980 0x7efea00cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efea5c00640 1 -- 172.21.15.59:0/1840739024 >> 172.21.15.59:0/1840739024 conn(0x7efea00b3390 msgr2=0x7efea00b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:36.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efea5c00640 1 -- 172.21.15.59:0/1840739024 shutdown_connections 2024-04-25T09:03:36.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efea5c00640 1 -- 172.21.15.59:0/1840739024 wait complete. 2024-04-25T09:03:36.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efea5c00640 1 Processor -- start 2024-04-25T09:03:36.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.874+0000 7efea5c00640 1 -- start start 2024-04-25T09:03:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efea5c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efea0071970 0x7efea0143f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efea5c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efea015b5a0 0x7efea014d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efea5c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea015b980 0x7efea014d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efea5c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea00d0d20 con 0x7efea015b980 2024-04-25T09:03:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efea5c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea00d0ba0 con 0x7efea015b5a0 2024-04-25T09:03:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efea5c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea00d0ea0 con 0x7efea0071970 2024-04-25T09:03:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe9f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea015b980 0x7efea014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe9f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea015b980 0x7efea014d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47812/0 (socket says 172.21.15.59:47812) 2024-04-25T09:03:36.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe9f400640 1 -- 172.21.15.59:0/1707851566 learned_addr learned my addr 172.21.15.59:0/1707851566 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe9ea00640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efea0071970 0x7efea0143f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe96000640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efea015b5a0 0x7efea014d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe9f400640 1 -- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efea0071970 msgr2=0x7efea0143f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe9f400640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efea0071970 0x7efea0143f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe9f400640 1 -- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efea015b5a0 msgr2=0x7efea014d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe9f400640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efea015b5a0 0x7efea014d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe9f400640 1 -- 172.21.15.59:0/1707851566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea0153d90 con 0x7efea015b980 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe9ea00640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efea0071970 0x7efea0143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe96000640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efea015b5a0 0x7efea014d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe9f400640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea015b980 0x7efea014d700 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efe980af040 tx=0x7efe980197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe97400640 1 -- 172.21.15.59:0/1707851566 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe980a58f0 con 0x7efea015b980 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe97400640 1 -- 172.21.15.59:0/1707851566 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe980be070 con 0x7efea015b980 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe97400640 1 -- 172.21.15.59:0/1707851566 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe98009510 con 0x7efea015b980 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efea5c00640 1 -- 172.21.15.59:0/1707851566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea0154070 con 0x7efea015b980 2024-04-25T09:03:36.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efea5c00640 1 -- 172.21.15.59:0/1707851566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea01449d0 con 0x7efea015b980 2024-04-25T09:03:36.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efea5c00640 1 -- 172.21.15.59:0/1707851566 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efea00745d0 con 0x7efea015b980 2024-04-25T09:03:36.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.878+0000 7efe97400640 1 -- 172.21.15.59:0/1707851566 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efe980b88d0 con 0x7efea015b980 2024-04-25T09:03:36.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.882+0000 7efe97400640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efe7c066f60 0x7efe7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:36.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.882+0000 7efe97400640 1 -- 172.21.15.59:0/1707851566 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7efe98120b60 con 0x7efea015b980 2024-04-25T09:03:36.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.882+0000 7efe9ea00640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efe7c066f60 0x7efe7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:36.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.882+0000 7efe9ea00640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efe7c066f60 0x7efe7c069420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efea015af60 tx=0x7efe90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:36.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:36.886+0000 7efe97400640 1 -- 172.21.15.59:0/1707851566 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efe98016620 con 0x7efea015b980 2024-04-25T09:03:37.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.042+0000 7efea5c00640 1 -- 172.21.15.59:0/1707851566 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efea014dd30 con 0x7efe7c066f60 2024-04-25T09:03:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.050+0000 7efe97400640 1 -- 172.21.15.59:0/1707851566 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251957 (secure 0 0 0) 0x7efea014dd30 con 0x7efe7c066f60 2024-04-25T09:03:37.044 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:37.045 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:03:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.054+0000 7efea5c00640 1 -- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efe7c066f60 msgr2=0x7efe7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.054+0000 7efea5c00640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efe7c066f60 0x7efe7c069420 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7efea015af60 tx=0x7efe90009040 comp rx=0 tx=0).stop 2024-04-25T09:03:37.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.054+0000 7efea5c00640 1 -- 172.21.15.59:0/1707851566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea015b980 msgr2=0x7efea014d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.054+0000 7efea5c00640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea015b980 0x7efea014d700 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efe980af040 tx=0x7efe980197a0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.054+0000 7efea5c00640 1 -- 172.21.15.59:0/1707851566 shutdown_connections 2024-04-25T09:03:37.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.054+0000 7efea5c00640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efe7c066f60 0x7efe7c069420 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.054+0000 7efea5c00640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efea015b980 0x7efea014d700 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.054+0000 7efea5c00640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efea015b5a0 0x7efea014d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.054+0000 7efea5c00640 1 --2- 172.21.15.59:0/1707851566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efea0071970 0x7efea0143f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.054+0000 7efea5c00640 1 -- 172.21.15.59:0/1707851566 >> 172.21.15.59:0/1707851566 conn(0x7efea00b3390 msgr2=0x7efea00b28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.054+0000 7efea5c00640 1 -- 172.21.15.59:0/1707851566 shutdown_connections 2024-04-25T09:03:37.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.054+0000 7efea5c00640 1 -- 172.21.15.59:0/1707851566 wait complete. 2024-04-25T09:03:37.064 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":116,"stamp":"2024-04-25T09:03:35.679627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238868,"kb_used_data":6020,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735852,"statfs":{"total":773094113280,"available":772849512448,"internally_reserved":0,"allocated":6164480,"data_stored":3376352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.130736"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577410+0000","last_change":"2024-04-25T09:03:32.579947+0000","last_active":"2024-04-25T09:03:33.577410+0000","last_peered":"2024-04-25T09:03:33.577410+0000","last_clean":"2024-04-25T09:03:33.577410+0000","last_became_active":"2024-04-25T09:03:32.579602+0000","last_became_peered":"2024-04-25T09:03:32.579602+0000","last_unstale":"2024-04-25T09:03:33.577410+0000","last_undegraded":"2024-04-25T09:03:33.577410+0000","last_fullsized":"2024-04-25T09:03:33.577410+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:58.771174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583979+0000","last_change":"2024-04-25T09:03:32.580011+0000","last_active":"2024-04-25T09:03:33.583979+0000","last_peered":"2024-04-25T09:03:33.583979+0000","last_clean":"2024-04-25T09:03:33.583979+0000","last_became_active":"2024-04-25T09:03:32.579698+0000","last_became_peered":"2024-04-25T09:03:32.579698+0000","last_unstale":"2024-04-25T09:03:33.583979+0000","last_undegraded":"2024-04-25T09:03:33.583979+0000","last_fullsized":"2024-04-25T09:03:33.583979+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:33.397775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580521+0000","last_change":"2024-04-25T09:03:32.590997+0000","last_active":"2024-04-25T09:03:33.580521+0000","last_peered":"2024-04-25T09:03:33.580521+0000","last_clean":"2024-04-25T09:03:33.580521+0000","last_became_active":"2024-04-25T09:03:32.589933+0000","last_became_peered":"2024-04-25T09:03:32.589933+0000","last_unstale":"2024-04-25T09:03:33.580521+0000","last_undegraded":"2024-04-25T09:03:33.580521+0000","last_fullsized":"2024-04-25T09:03:33.580521+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:33.103450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583723+0000","last_change":"2024-04-25T09:03:32.600851+0000","last_active":"2024-04-25T09:03:33.583723+0000","last_peered":"2024-04-25T09:03:33.583723+0000","last_clean":"2024-04-25T09:03:33.583723+0000","last_became_active":"2024-04-25T09:03:32.600594+0000","last_became_peered":"2024-04-25T09:03:32.600594+0000","last_unstale":"2024-04-25T09:03:33.583723+0000","last_undegraded":"2024-04-25T09:03:33.583723+0000","last_fullsized":"2024-04-25T09:03:33.583723+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:39.729827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123573+0000","last_change":"2024-04-25T09:03:32.582250+0000","last_active":"2024-04-25T09:03:34.123573+0000","last_peered":"2024-04-25T09:03:34.123573+0000","last_clean":"2024-04-25T09:03:34.123573+0000","last_became_active":"2024-04-25T09:03:32.581803+0000","last_became_peered":"2024-04-25T09:03:32.581803+0000","last_unstale":"2024-04-25T09:03:34.123573+0000","last_undegraded":"2024-04-25T09:03:34.123573+0000","last_fullsized":"2024-04-25T09:03:34.123573+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:23.304684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577110+0000","last_change":"2024-04-25T09:03:32.586900+0000","last_active":"2024-04-25T09:03:33.577110+0000","last_peered":"2024-04-25T09:03:33.577110+0000","last_clean":"2024-04-25T09:03:33.577110+0000","last_became_active":"2024-04-25T09:03:32.582168+0000","last_became_peered":"2024-04-25T09:03:32.582168+0000","last_unstale":"2024-04-25T09:03:33.577110+0000","last_undegraded":"2024-04-25T09:03:33.577110+0000","last_fullsized":"2024-04-25T09:03:33.577110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:49.453628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579941+0000","last_change":"2024-04-25T09:03:32.590470+0000","last_active":"2024-04-25T09:03:33.579941+0000","last_peered":"2024-04-25T09:03:33.579941+0000","last_clean":"2024-04-25T09:03:33.579941+0000","last_became_active":"2024-04-25T09:03:32.590182+0000","last_became_peered":"2024-04-25T09:03:32.590182+0000","last_unstale":"2024-04-25T09:03:33.579941+0000","last_undegraded":"2024-04-25T09:03:33.579941+0000","last_fullsized":"2024-04-25T09:03:33.579941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:33.397775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123709+0000","last_change":"2024-04-25T09:03:32.594085+0000","last_active":"2024-04-25T09:03:34.123709+0000","last_peered":"2024-04-25T09:03:34.123709+0000","last_clean":"2024-04-25T09:03:34.123709+0000","last_became_active":"2024-04-25T09:03:32.593615+0000","last_became_peered":"2024-04-25T09:03:32.593615+0000","last_unstale":"2024-04-25T09:03:34.123709+0000","last_undegraded":"2024-04-25T09:03:34.123709+0000","last_fullsized":"2024-04-25T09:03:34.123709+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:37.540308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124524+0000","last_change":"2024-04-25T09:03:32.602560+0000","last_active":"2024-04-25T09:03:34.124524+0000","last_peered":"2024-04-25T09:03:34.124524+0000","last_clean":"2024-04-25T09:03:34.124524+0000","last_became_active":"2024-04-25T09:03:32.598074+0000","last_became_peered":"2024-04-25T09:03:32.598074+0000","last_unstale":"2024-04-25T09:03:34.124524+0000","last_undegraded":"2024-04-25T09:03:34.124524+0000","last_fullsized":"2024-04-25T09:03:34.124524+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:37:49.246271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577137+0000","last_change":"2024-04-25T09:03:32.587315+0000","last_active":"2024-04-25T09:03:33.577137+0000","last_peered":"2024-04-25T09:03:33.577137+0000","last_clean":"2024-04-25T09:03:33.577137+0000","last_became_active":"2024-04-25T09:03:32.586959+0000","last_became_peered":"2024-04-25T09:03:32.586959+0000","last_unstale":"2024-04-25T09:03:33.577137+0000","last_undegraded":"2024-04-25T09:03:33.577137+0000","last_fullsized":"2024-04-25T09:03:33.577137+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:15.542055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124389+0000","last_change":"2024-04-25T09:03:32.582222+0000","last_active":"2024-04-25T09:03:34.124389+0000","last_peered":"2024-04-25T09:03:34.124389+0000","last_clean":"2024-04-25T09:03:34.124389+0000","last_became_active":"2024-04-25T09:03:32.581869+0000","last_became_peered":"2024-04-25T09:03:32.581869+0000","last_unstale":"2024-04-25T09:03:34.124389+0000","last_undegraded":"2024-04-25T09:03:34.124389+0000","last_fullsized":"2024-04-25T09:03:34.124389+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:31.275735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124166+0000","last_change":"2024-04-25T09:03:32.594515+0000","last_active":"2024-04-25T09:03:34.124166+0000","last_peered":"2024-04-25T09:03:34.124166+0000","last_clean":"2024-04-25T09:03:34.124166+0000","last_became_active":"2024-04-25T09:03:32.594207+0000","last_became_peered":"2024-04-25T09:03:32.594207+0000","last_unstale":"2024-04-25T09:03:34.124166+0000","last_undegraded":"2024-04-25T09:03:34.124166+0000","last_fullsized":"2024-04-25T09:03:34.124166+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:29.297272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577067+0000","last_change":"2024-04-25T09:03:32.583116+0000","last_active":"2024-04-25T09:03:33.577067+0000","last_peered":"2024-04-25T09:03:33.577067+0000","last_clean":"2024-04-25T09:03:33.577067+0000","last_became_active":"2024-04-25T09:03:32.582856+0000","last_became_peered":"2024-04-25T09:03:32.582856+0000","last_unstale":"2024-04-25T09:03:33.577067+0000","last_undegraded":"2024-04-25T09:03:33.577067+0000","last_fullsized":"2024-04-25T09:03:33.577067+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:10.469896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580182+0000","last_change":"2024-04-25T09:03:32.586095+0000","last_active":"2024-04-25T09:03:33.580182+0000","last_peered":"2024-04-25T09:03:33.580182+0000","last_clean":"2024-04-25T09:03:33.580182+0000","last_became_active":"2024-04-25T09:03:32.585784+0000","last_became_peered":"2024-04-25T09:03:32.585784+0000","last_unstale":"2024-04-25T09:03:33.580182+0000","last_undegraded":"2024-04-25T09:03:33.580182+0000","last_fullsized":"2024-04-25T09:03:33.580182+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.096246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583629+0000","last_change":"2024-04-25T09:03:32.583258+0000","last_active":"2024-04-25T09:03:33.583629+0000","last_peered":"2024-04-25T09:03:33.583629+0000","last_clean":"2024-04-25T09:03:33.583629+0000","last_became_active":"2024-04-25T09:03:32.582962+0000","last_became_peered":"2024-04-25T09:03:32.582962+0000","last_unstale":"2024-04-25T09:03:33.583629+0000","last_undegraded":"2024-04-25T09:03:33.583629+0000","last_fullsized":"2024-04-25T09:03:33.583629+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:58.528329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577323+0000","last_change":"2024-04-25T09:03:32.583673+0000","last_active":"2024-04-25T09:03:33.577323+0000","last_peered":"2024-04-25T09:03:33.577323+0000","last_clean":"2024-04-25T09:03:33.577323+0000","last_became_active":"2024-04-25T09:03:32.583420+0000","last_became_peered":"2024-04-25T09:03:32.583420+0000","last_unstale":"2024-04-25T09:03:33.577323+0000","last_undegraded":"2024-04-25T09:03:33.577323+0000","last_fullsized":"2024-04-25T09:03:33.577323+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:48.632294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580845+0000","last_change":"2024-04-25T09:03:32.583091+0000","last_active":"2024-04-25T09:03:33.580845+0000","last_peered":"2024-04-25T09:03:33.580845+0000","last_clean":"2024-04-25T09:03:33.580845+0000","last_became_active":"2024-04-25T09:03:32.582681+0000","last_became_peered":"2024-04-25T09:03:32.582681+0000","last_unstale":"2024-04-25T09:03:33.580845+0000","last_undegraded":"2024-04-25T09:03:33.580845+0000","last_fullsized":"2024-04-25T09:03:33.580845+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:00.688658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.584049+0000","last_change":"2024-04-25T09:03:32.583993+0000","last_active":"2024-04-25T09:03:33.584049+0000","last_peered":"2024-04-25T09:03:33.584049+0000","last_clean":"2024-04-25T09:03:33.584049+0000","last_became_active":"2024-04-25T09:03:32.583634+0000","last_became_peered":"2024-04-25T09:03:32.583634+0000","last_unstale":"2024-04-25T09:03:33.584049+0000","last_undegraded":"2024-04-25T09:03:33.584049+0000","last_fullsized":"2024-04-25T09:03:33.584049+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.096246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580550+0000","last_change":"2024-04-25T09:03:32.581152+0000","last_active":"2024-04-25T09:03:33.580550+0000","last_peered":"2024-04-25T09:03:33.580550+0000","last_clean":"2024-04-25T09:03:33.580550+0000","last_became_active":"2024-04-25T09:03:32.580583+0000","last_became_peered":"2024-04-25T09:03:32.580583+0000","last_unstale":"2024-04-25T09:03:33.580550+0000","last_undegraded":"2024-04-25T09:03:33.580550+0000","last_fullsized":"2024-04-25T09:03:33.580550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:10:37.540308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579856+0000","last_change":"2024-04-25T09:03:32.576861+0000","last_active":"2024-04-25T09:03:33.579856+0000","last_peered":"2024-04-25T09:03:33.579856+0000","last_clean":"2024-04-25T09:03:33.579856+0000","last_became_active":"2024-04-25T09:03:32.576072+0000","last_became_peered":"2024-04-25T09:03:32.576072+0000","last_unstale":"2024-04-25T09:03:33.579856+0000","last_undegraded":"2024-04-25T09:03:33.579856+0000","last_fullsized":"2024-04-25T09:03:33.579856+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:15.542055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579537+0000","last_change":"2024-04-25T09:03:32.579100+0000","last_active":"2024-04-25T09:03:33.579537+0000","last_peered":"2024-04-25T09:03:33.579537+0000","last_clean":"2024-04-25T09:03:33.579537+0000","last_became_active":"2024-04-25T09:03:32.578838+0000","last_became_peered":"2024-04-25T09:03:32.578838+0000","last_unstale":"2024-04-25T09:03:33.579537+0000","last_undegraded":"2024-04-25T09:03:33.579537+0000","last_fullsized":"2024-04-25T09:03:33.579537+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:10.469896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124001+0000","last_change":"2024-04-25T09:03:32.602406+0000","last_active":"2024-04-25T09:03:34.124001+0000","last_peered":"2024-04-25T09:03:34.124001+0000","last_clean":"2024-04-25T09:03:34.124001+0000","last_became_active":"2024-04-25T09:03:32.597291+0000","last_became_peered":"2024-04-25T09:03:32.597291+0000","last_unstale":"2024-04-25T09:03:34.124001+0000","last_undegraded":"2024-04-25T09:03:34.124001+0000","last_fullsized":"2024-04-25T09:03:34.124001+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:10.351894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123573+0000","last_change":"2024-04-25T09:03:32.584312+0000","last_active":"2024-04-25T09:03:34.123573+0000","last_peered":"2024-04-25T09:03:34.123573+0000","last_clean":"2024-04-25T09:03:34.123573+0000","last_became_active":"2024-04-25T09:03:32.583996+0000","last_became_peered":"2024-04-25T09:03:32.583996+0000","last_unstale":"2024-04-25T09:03:34.123573+0000","last_undegraded":"2024-04-25T09:03:34.123573+0000","last_fullsized":"2024-04-25T09:03:34.123573+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:24:04.637959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579933+0000","last_change":"2024-04-25T09:03:32.590559+0000","last_active":"2024-04-25T09:03:33.579933+0000","last_peered":"2024-04-25T09:03:33.579933+0000","last_clean":"2024-04-25T09:03:33.579933+0000","last_became_active":"2024-04-25T09:03:32.589608+0000","last_became_peered":"2024-04-25T09:03:32.589608+0000","last_unstale":"2024-04-25T09:03:33.579933+0000","last_undegraded":"2024-04-25T09:03:33.579933+0000","last_fullsized":"2024-04-25T09:03:33.579933+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:07.492678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580824+0000","last_change":"2024-04-25T09:03:32.601340+0000","last_active":"2024-04-25T09:03:33.580824+0000","last_peered":"2024-04-25T09:03:33.580824+0000","last_clean":"2024-04-25T09:03:33.580824+0000","last_became_active":"2024-04-25T09:03:32.600382+0000","last_became_peered":"2024-04-25T09:03:32.600382+0000","last_unstale":"2024-04-25T09:03:33.580824+0000","last_undegraded":"2024-04-25T09:03:33.580824+0000","last_fullsized":"2024-04-25T09:03:33.580824+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:21.209576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124352+0000","last_change":"2024-04-25T09:03:32.596844+0000","last_active":"2024-04-25T09:03:34.124352+0000","last_peered":"2024-04-25T09:03:34.124352+0000","last_clean":"2024-04-25T09:03:34.124352+0000","last_became_active":"2024-04-25T09:03:32.595207+0000","last_became_peered":"2024-04-25T09:03:32.595207+0000","last_unstale":"2024-04-25T09:03:34.124352+0000","last_undegraded":"2024-04-25T09:03:34.124352+0000","last_fullsized":"2024-04-25T09:03:34.124352+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:00.688658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577636+0000","last_change":"2024-04-25T09:03:32.599526+0000","last_active":"2024-04-25T09:03:33.577636+0000","last_peered":"2024-04-25T09:03:33.577636+0000","last_clean":"2024-04-25T09:03:33.577636+0000","last_became_active":"2024-04-25T09:03:32.596182+0000","last_became_peered":"2024-04-25T09:03:32.596182+0000","last_unstale":"2024-04-25T09:03:33.577636+0000","last_undegraded":"2024-04-25T09:03:33.577636+0000","last_fullsized":"2024-04-25T09:03:33.577636+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:04.851454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580008+0000","last_change":"2024-04-25T09:03:32.586609+0000","last_active":"2024-04-25T09:03:33.580008+0000","last_peered":"2024-04-25T09:03:33.580008+0000","last_clean":"2024-04-25T09:03:33.580008+0000","last_became_active":"2024-04-25T09:03:32.586232+0000","last_became_peered":"2024-04-25T09:03:32.586232+0000","last_unstale":"2024-04-25T09:03:33.580008+0000","last_undegraded":"2024-04-25T09:03:33.580008+0000","last_fullsized":"2024-04-25T09:03:33.580008+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:59.043158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580246+0000","last_change":"2024-04-25T09:03:32.584405+0000","last_active":"2024-04-25T09:03:33.580246+0000","last_peered":"2024-04-25T09:03:33.580246+0000","last_clean":"2024-04-25T09:03:33.580246+0000","last_became_active":"2024-04-25T09:03:32.584067+0000","last_became_peered":"2024-04-25T09:03:32.584067+0000","last_unstale":"2024-04-25T09:03:33.580246+0000","last_undegraded":"2024-04-25T09:03:33.580246+0000","last_fullsized":"2024-04-25T09:03:33.580246+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:21:51.219471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583646+0000","last_change":"2024-04-25T09:03:32.581463+0000","last_active":"2024-04-25T09:03:33.583646+0000","last_peered":"2024-04-25T09:03:33.583646+0000","last_clean":"2024-04-25T09:03:33.583646+0000","last_became_active":"2024-04-25T09:03:32.580194+0000","last_became_peered":"2024-04-25T09:03:32.580194+0000","last_unstale":"2024-04-25T09:03:33.583646+0000","last_undegraded":"2024-04-25T09:03:33.583646+0000","last_fullsized":"2024-04-25T09:03:33.583646+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:07.712612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580088+0000","last_change":"2024-04-25T09:03:32.590152+0000","last_active":"2024-04-25T09:03:33.580088+0000","last_peered":"2024-04-25T09:03:33.580088+0000","last_clean":"2024-04-25T09:03:33.580088+0000","last_became_active":"2024-04-25T09:03:32.589786+0000","last_became_peered":"2024-04-25T09:03:32.589786+0000","last_unstale":"2024-04-25T09:03:33.580088+0000","last_undegraded":"2024-04-25T09:03:33.580088+0000","last_fullsized":"2024-04-25T09:03:33.580088+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:43.897067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.578730+0000","last_change":"2024-04-25T09:03:32.597975+0000","last_active":"2024-04-25T09:03:33.578730+0000","last_peered":"2024-04-25T09:03:33.578730+0000","last_clean":"2024-04-25T09:03:33.578730+0000","last_became_active":"2024-04-25T09:03:32.597708+0000","last_became_peered":"2024-04-25T09:03:32.597708+0000","last_unstale":"2024-04-25T09:03:33.578730+0000","last_undegraded":"2024-04-25T09:03:33.578730+0000","last_fullsized":"2024-04-25T09:03:33.578730+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:34:07.712612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583458+0000","last_change":"2024-04-25T09:03:32.579927+0000","last_active":"2024-04-25T09:03:33.583458+0000","last_peered":"2024-04-25T09:03:33.583458+0000","last_clean":"2024-04-25T09:03:33.583458+0000","last_became_active":"2024-04-25T09:03:32.579506+0000","last_became_peered":"2024-04-25T09:03:32.579506+0000","last_unstale":"2024-04-25T09:03:33.583458+0000","last_undegraded":"2024-04-25T09:03:33.583458+0000","last_fullsized":"2024-04-25T09:03:33.583458+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:26:48.605326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"51'4","reported_seq":18,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579268+0000","last_change":"2024-04-25T09:03:31.573055+0000","last_active":"2024-04-25T09:03:33.579268+0000","last_peered":"2024-04-25T09:03:33.579268+0000","last_clean":"2024-04-25T09:03:33.579268+0000","last_became_active":"2024-04-25T09:03:31.572714+0000","last_became_peered":"2024-04-25T09:03:31.572714+0000","last_unstale":"2024-04-25T09:03:33.579268+0000","last_undegraded":"2024-04-25T09:03:33.579268+0000","last_fullsized":"2024-04-25T09:03:33.579268+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:52.862962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579039+0000","last_change":"2024-04-25T09:03:32.576904+0000","last_active":"2024-04-25T09:03:33.579039+0000","last_peered":"2024-04-25T09:03:33.579039+0000","last_clean":"2024-04-25T09:03:33.579039+0000","last_became_active":"2024-04-25T09:03:32.576329+0000","last_became_peered":"2024-04-25T09:03:32.576329+0000","last_unstale":"2024-04-25T09:03:33.579039+0000","last_undegraded":"2024-04-25T09:03:33.579039+0000","last_fullsized":"2024-04-25T09:03:33.579039+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:39.729827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577217+0000","last_change":"2024-04-25T09:03:31.583039+0000","last_active":"2024-04-25T09:03:33.577217+0000","last_peered":"2024-04-25T09:03:33.577217+0000","last_clean":"2024-04-25T09:03:33.577217+0000","last_became_active":"2024-04-25T09:03:31.582787+0000","last_became_peered":"2024-04-25T09:03:31.582787+0000","last_unstale":"2024-04-25T09:03:33.577217+0000","last_undegraded":"2024-04-25T09:03:33.577217+0000","last_fullsized":"2024-04-25T09:03:33.577217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:37.863718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579507+0000","last_change":"2024-04-25T09:03:32.578196+0000","last_active":"2024-04-25T09:03:33.579507+0000","last_peered":"2024-04-25T09:03:33.579507+0000","last_clean":"2024-04-25T09:03:33.579507+0000","last_became_active":"2024-04-25T09:03:32.577931+0000","last_became_peered":"2024-04-25T09:03:32.577931+0000","last_unstale":"2024-04-25T09:03:33.579507+0000","last_undegraded":"2024-04-25T09:03:33.579507+0000","last_fullsized":"2024-04-25T09:03:33.579507+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:20.105332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577639+0000","last_change":"2024-04-25T09:03:31.575875+0000","last_active":"2024-04-25T09:03:33.577639+0000","last_peered":"2024-04-25T09:03:33.577639+0000","last_clean":"2024-04-25T09:03:33.577639+0000","last_became_active":"2024-04-25T09:03:31.575460+0000","last_became_peered":"2024-04-25T09:03:31.575460+0000","last_unstale":"2024-04-25T09:03:33.577639+0000","last_undegraded":"2024-04-25T09:03:33.577639+0000","last_fullsized":"2024-04-25T09:03:33.577639+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.666496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123698+0000","last_change":"2024-04-25T09:03:32.603494+0000","last_active":"2024-04-25T09:03:34.123698+0000","last_peered":"2024-04-25T09:03:34.123698+0000","last_clean":"2024-04-25T09:03:34.123698+0000","last_became_active":"2024-04-25T09:03:32.603222+0000","last_became_peered":"2024-04-25T09:03:32.603222+0000","last_unstale":"2024-04-25T09:03:34.123698+0000","last_undegraded":"2024-04-25T09:03:34.123698+0000","last_fullsized":"2024-04-25T09:03:34.123698+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.951048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579504+0000","last_change":"2024-04-25T09:03:31.572946+0000","last_active":"2024-04-25T09:03:33.579504+0000","last_peered":"2024-04-25T09:03:33.579504+0000","last_clean":"2024-04-25T09:03:33.579504+0000","last_became_active":"2024-04-25T09:03:31.572621+0000","last_became_peered":"2024-04-25T09:03:31.572621+0000","last_unstale":"2024-04-25T09:03:33.579504+0000","last_undegraded":"2024-04-25T09:03:33.579504+0000","last_fullsized":"2024-04-25T09:03:33.579504+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:28:14.535629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123951+0000","last_change":"2024-04-25T09:03:32.580601+0000","last_active":"2024-04-25T09:03:34.123951+0000","last_peered":"2024-04-25T09:03:34.123951+0000","last_clean":"2024-04-25T09:03:34.123951+0000","last_became_active":"2024-04-25T09:03:32.580290+0000","last_became_peered":"2024-04-25T09:03:32.580290+0000","last_unstale":"2024-04-25T09:03:34.123951+0000","last_undegraded":"2024-04-25T09:03:34.123951+0000","last_fullsized":"2024-04-25T09:03:34.123951+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:21.221029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580329+0000","last_change":"2024-04-25T09:03:31.582647+0000","last_active":"2024-04-25T09:03:33.580329+0000","last_peered":"2024-04-25T09:03:33.580329+0000","last_clean":"2024-04-25T09:03:33.580329+0000","last_became_active":"2024-04-25T09:03:31.582391+0000","last_became_peered":"2024-04-25T09:03:31.582391+0000","last_unstale":"2024-04-25T09:03:33.580329+0000","last_undegraded":"2024-04-25T09:03:33.580329+0000","last_fullsized":"2024-04-25T09:03:33.580329+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:59.477348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583821+0000","last_change":"2024-04-25T09:03:32.582073+0000","last_active":"2024-04-25T09:03:33.583821+0000","last_peered":"2024-04-25T09:03:33.583821+0000","last_clean":"2024-04-25T09:03:33.583821+0000","last_became_active":"2024-04-25T09:03:32.581708+0000","last_became_peered":"2024-04-25T09:03:32.581708+0000","last_unstale":"2024-04-25T09:03:33.583821+0000","last_undegraded":"2024-04-25T09:03:33.583821+0000","last_fullsized":"2024-04-25T09:03:33.583821+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:07.492678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123469+0000","last_change":"2024-04-25T09:03:31.568403+0000","last_active":"2024-04-25T09:03:34.123469+0000","last_peered":"2024-04-25T09:03:34.123469+0000","last_clean":"2024-04-25T09:03:34.123469+0000","last_became_active":"2024-04-25T09:03:31.567932+0000","last_became_peered":"2024-04-25T09:03:31.567932+0000","last_unstale":"2024-04-25T09:03:34.123469+0000","last_undegraded":"2024-04-25T09:03:34.123469+0000","last_fullsized":"2024-04-25T09:03:34.123469+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:22:03.144882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124467+0000","last_change":"2024-04-25T09:03:32.595469+0000","last_active":"2024-04-25T09:03:34.124467+0000","last_peered":"2024-04-25T09:03:34.124467+0000","last_clean":"2024-04-25T09:03:34.124467+0000","last_became_active":"2024-04-25T09:03:32.594544+0000","last_became_peered":"2024-04-25T09:03:32.594544+0000","last_unstale":"2024-04-25T09:03:34.124467+0000","last_undegraded":"2024-04-25T09:03:34.124467+0000","last_fullsized":"2024-04-25T09:03:34.124467+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:10.882865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.578933+0000","last_change":"2024-04-25T09:03:31.579603+0000","last_active":"2024-04-25T09:03:33.578933+0000","last_peered":"2024-04-25T09:03:33.578933+0000","last_clean":"2024-04-25T09:03:33.578933+0000","last_became_active":"2024-04-25T09:03:31.578991+0000","last_became_peered":"2024-04-25T09:03:31.578991+0000","last_unstale":"2024-04-25T09:03:33.578933+0000","last_undegraded":"2024-04-25T09:03:33.578933+0000","last_fullsized":"2024-04-25T09:03:33.578933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:07.925299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.584003+0000","last_change":"2024-04-25T09:03:32.584073+0000","last_active":"2024-04-25T09:03:33.584003+0000","last_peered":"2024-04-25T09:03:33.584003+0000","last_clean":"2024-04-25T09:03:33.584003+0000","last_became_active":"2024-04-25T09:03:32.583668+0000","last_became_peered":"2024-04-25T09:03:32.583668+0000","last_unstale":"2024-04-25T09:03:33.584003+0000","last_undegraded":"2024-04-25T09:03:33.584003+0000","last_fullsized":"2024-04-25T09:03:33.584003+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:43.897067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579933+0000","last_change":"2024-04-25T09:03:31.575927+0000","last_active":"2024-04-25T09:03:33.579933+0000","last_peered":"2024-04-25T09:03:33.579933+0000","last_clean":"2024-04-25T09:03:33.579933+0000","last_became_active":"2024-04-25T09:03:31.575655+0000","last_became_peered":"2024-04-25T09:03:31.575655+0000","last_unstale":"2024-04-25T09:03:33.579933+0000","last_undegraded":"2024-04-25T09:03:33.579933+0000","last_fullsized":"2024-04-25T09:03:33.579933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:01.272870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123580+0000","last_change":"2024-04-25T09:03:32.605509+0000","last_active":"2024-04-25T09:03:34.123580+0000","last_peered":"2024-04-25T09:03:34.123580+0000","last_clean":"2024-04-25T09:03:34.123580+0000","last_became_active":"2024-04-25T09:03:32.605197+0000","last_became_peered":"2024-04-25T09:03:32.605197+0000","last_unstale":"2024-04-25T09:03:34.123580+0000","last_undegraded":"2024-04-25T09:03:34.123580+0000","last_fullsized":"2024-04-25T09:03:34.123580+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:50.717791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583942+0000","last_change":"2024-04-25T09:03:31.579577+0000","last_active":"2024-04-25T09:03:33.583942+0000","last_peered":"2024-04-25T09:03:33.583942+0000","last_clean":"2024-04-25T09:03:33.583942+0000","last_became_active":"2024-04-25T09:03:31.579281+0000","last_became_peered":"2024-04-25T09:03:31.579281+0000","last_unstale":"2024-04-25T09:03:33.583942+0000","last_undegraded":"2024-04-25T09:03:33.583942+0000","last_fullsized":"2024-04-25T09:03:33.583942+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:12.919085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579330+0000","last_change":"2024-04-25T09:03:32.577265+0000","last_active":"2024-04-25T09:03:33.579330+0000","last_peered":"2024-04-25T09:03:33.579330+0000","last_clean":"2024-04-25T09:03:33.579330+0000","last_became_active":"2024-04-25T09:03:32.576960+0000","last_became_peered":"2024-04-25T09:03:32.576960+0000","last_unstale":"2024-04-25T09:03:33.579330+0000","last_undegraded":"2024-04-25T09:03:33.579330+0000","last_fullsized":"2024-04-25T09:03:33.579330+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:43.897067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123946+0000","last_change":"2024-04-25T09:03:31.574188+0000","last_active":"2024-04-25T09:03:34.123946+0000","last_peered":"2024-04-25T09:03:34.123946+0000","last_clean":"2024-04-25T09:03:34.123946+0000","last_became_active":"2024-04-25T09:03:31.573856+0000","last_became_peered":"2024-04-25T09:03:31.573856+0000","last_unstale":"2024-04-25T09:03:34.123946+0000","last_undegraded":"2024-04-25T09:03:34.123946+0000","last_fullsized":"2024-04-25T09:03:34.123946+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:37.863718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580220+0000","last_change":"2024-04-25T09:03:32.585440+0000","last_active":"2024-04-25T09:03:33.580220+0000","last_peered":"2024-04-25T09:03:33.580220+0000","last_clean":"2024-04-25T09:03:33.580220+0000","last_became_active":"2024-04-25T09:03:32.583932+0000","last_became_peered":"2024-04-25T09:03:32.583932+0000","last_unstale":"2024-04-25T09:03:33.580220+0000","last_undegraded":"2024-04-25T09:03:33.580220+0000","last_fullsized":"2024-04-25T09:03:33.580220+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:55.719444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"51'3","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583908+0000","last_change":"2024-04-25T09:03:31.584946+0000","last_active":"2024-04-25T09:03:33.583908+0000","last_peered":"2024-04-25T09:03:33.583908+0000","last_clean":"2024-04-25T09:03:33.583908+0000","last_became_active":"2024-04-25T09:03:31.584523+0000","last_became_peered":"2024-04-25T09:03:31.584523+0000","last_unstale":"2024-04-25T09:03:33.583908+0000","last_undegraded":"2024-04-25T09:03:33.583908+0000","last_fullsized":"2024-04-25T09:03:33.583908+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:20.214602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123637+0000","last_change":"2024-04-25T09:03:32.588761+0000","last_active":"2024-04-25T09:03:34.123637+0000","last_peered":"2024-04-25T09:03:34.123637+0000","last_clean":"2024-04-25T09:03:34.123637+0000","last_became_active":"2024-04-25T09:03:32.588460+0000","last_became_peered":"2024-04-25T09:03:32.588460+0000","last_unstale":"2024-04-25T09:03:34.123637+0000","last_undegraded":"2024-04-25T09:03:34.123637+0000","last_fullsized":"2024-04-25T09:03:34.123637+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:21.884484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"51'6","reported_seq":20,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124219+0000","last_change":"2024-04-25T09:03:31.582044+0000","last_active":"2024-04-25T09:03:34.124219+0000","last_peered":"2024-04-25T09:03:34.124219+0000","last_clean":"2024-04-25T09:03:34.124219+0000","last_became_active":"2024-04-25T09:03:31.581677+0000","last_became_peered":"2024-04-25T09:03:31.581677+0000","last_unstale":"2024-04-25T09:03:34.124219+0000","last_undegraded":"2024-04-25T09:03:34.124219+0000","last_fullsized":"2024-04-25T09:03:34.124219+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:03.845028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579238+0000","last_change":"2024-04-25T09:03:32.576664+0000","last_active":"2024-04-25T09:03:33.579238+0000","last_peered":"2024-04-25T09:03:33.579238+0000","last_clean":"2024-04-25T09:03:33.579238+0000","last_became_active":"2024-04-25T09:03:32.576368+0000","last_became_peered":"2024-04-25T09:03:32.576368+0000","last_unstale":"2024-04-25T09:03:33.579238+0000","last_undegraded":"2024-04-25T09:03:33.579238+0000","last_fullsized":"2024-04-25T09:03:33.579238+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:33.397775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580411+0000","last_change":"2024-04-25T09:03:31.577590+0000","last_active":"2024-04-25T09:03:33.580411+0000","last_peered":"2024-04-25T09:03:33.580411+0000","last_clean":"2024-04-25T09:03:33.580411+0000","last_became_active":"2024-04-25T09:03:31.577312+0000","last_became_peered":"2024-04-25T09:03:31.577312+0000","last_unstale":"2024-04-25T09:03:33.580411+0000","last_undegraded":"2024-04-25T09:03:33.580411+0000","last_fullsized":"2024-04-25T09:03:33.580411+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:36:18.942139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580641+0000","last_change":"2024-04-25T09:03:32.585621+0000","last_active":"2024-04-25T09:03:33.580641+0000","last_peered":"2024-04-25T09:03:33.580641+0000","last_clean":"2024-04-25T09:03:33.580641+0000","last_became_active":"2024-04-25T09:03:32.585395+0000","last_became_peered":"2024-04-25T09:03:32.585395+0000","last_unstale":"2024-04-25T09:03:33.580641+0000","last_undegraded":"2024-04-25T09:03:33.580641+0000","last_fullsized":"2024-04-25T09:03:33.580641+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:02.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579669+0000","last_change":"2024-04-25T09:03:31.577671+0000","last_active":"2024-04-25T09:03:33.579669+0000","last_peered":"2024-04-25T09:03:33.579669+0000","last_clean":"2024-04-25T09:03:33.579669+0000","last_became_active":"2024-04-25T09:03:31.577400+0000","last_became_peered":"2024-04-25T09:03:31.577400+0000","last_unstale":"2024-04-25T09:03:33.579669+0000","last_undegraded":"2024-04-25T09:03:33.579669+0000","last_fullsized":"2024-04-25T09:03:33.579669+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:48.666496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124394+0000","last_change":"2024-04-25T09:03:32.596570+0000","last_active":"2024-04-25T09:03:34.124394+0000","last_peered":"2024-04-25T09:03:34.124394+0000","last_clean":"2024-04-25T09:03:34.124394+0000","last_became_active":"2024-04-25T09:03:32.594896+0000","last_became_peered":"2024-04-25T09:03:32.594896+0000","last_unstale":"2024-04-25T09:03:34.124394+0000","last_undegraded":"2024-04-25T09:03:34.124394+0000","last_fullsized":"2024-04-25T09:03:34.124394+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:11.675064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583606+0000","last_change":"2024-04-25T09:03:31.579538+0000","last_active":"2024-04-25T09:03:33.583606+0000","last_peered":"2024-04-25T09:03:33.583606+0000","last_clean":"2024-04-25T09:03:33.583606+0000","last_became_active":"2024-04-25T09:03:31.579261+0000","last_became_peered":"2024-04-25T09:03:31.579261+0000","last_unstale":"2024-04-25T09:03:33.583606+0000","last_undegraded":"2024-04-25T09:03:33.583606+0000","last_fullsized":"2024-04-25T09:03:33.583606+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:20.878058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580689+0000","last_change":"2024-04-25T09:03:32.583584+0000","last_active":"2024-04-25T09:03:33.580689+0000","last_peered":"2024-04-25T09:03:33.580689+0000","last_clean":"2024-04-25T09:03:33.580689+0000","last_became_active":"2024-04-25T09:03:32.583307+0000","last_became_peered":"2024-04-25T09:03:32.583307+0000","last_unstale":"2024-04-25T09:03:33.580689+0000","last_undegraded":"2024-04-25T09:03:33.580689+0000","last_fullsized":"2024-04-25T09:03:33.580689+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:29.297272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"51'8","reported_seq":22,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123876+0000","last_change":"2024-04-25T09:03:31.579063+0000","last_active":"2024-04-25T09:03:34.123876+0000","last_peered":"2024-04-25T09:03:34.123876+0000","last_clean":"2024-04-25T09:03:34.123876+0000","last_became_active":"2024-04-25T09:03:31.578701+0000","last_became_peered":"2024-04-25T09:03:31.578701+0000","last_unstale":"2024-04-25T09:03:34.123876+0000","last_undegraded":"2024-04-25T09:03:34.123876+0000","last_fullsized":"2024-04-25T09:03:34.123876+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:01:57.764748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123861+0000","last_change":"2024-04-25T09:03:32.603839+0000","last_active":"2024-04-25T09:03:34.123861+0000","last_peered":"2024-04-25T09:03:34.123861+0000","last_clean":"2024-04-25T09:03:34.123861+0000","last_became_active":"2024-04-25T09:03:32.597633+0000","last_became_peered":"2024-04-25T09:03:32.597633+0000","last_unstale":"2024-04-25T09:03:34.123861+0000","last_undegraded":"2024-04-25T09:03:34.123861+0000","last_fullsized":"2024-04-25T09:03:34.123861+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:02:02.039484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580885+0000","last_change":"2024-04-25T09:03:31.584014+0000","last_active":"2024-04-25T09:03:33.580885+0000","last_peered":"2024-04-25T09:03:33.580885+0000","last_clean":"2024-04-25T09:03:33.580885+0000","last_became_active":"2024-04-25T09:03:31.583714+0000","last_became_peered":"2024-04-25T09:03:31.583714+0000","last_unstale":"2024-04-25T09:03:33.580885+0000","last_undegraded":"2024-04-25T09:03:33.580885+0000","last_fullsized":"2024-04-25T09:03:33.580885+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:20.878058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577068+0000","last_change":"2024-04-25T09:03:32.574835+0000","last_active":"2024-04-25T09:03:33.577068+0000","last_peered":"2024-04-25T09:03:33.577068+0000","last_clean":"2024-04-25T09:03:33.577068+0000","last_became_active":"2024-04-25T09:03:32.574552+0000","last_became_peered":"2024-04-25T09:03:32.574552+0000","last_unstale":"2024-04-25T09:03:33.577068+0000","last_undegraded":"2024-04-25T09:03:33.577068+0000","last_fullsized":"2024-04-25T09:03:33.577068+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:20.105332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124231+0000","last_change":"2024-04-25T09:03:31.575566+0000","last_active":"2024-04-25T09:03:34.124231+0000","last_peered":"2024-04-25T09:03:34.124231+0000","last_clean":"2024-04-25T09:03:34.124231+0000","last_became_active":"2024-04-25T09:03:31.575279+0000","last_became_peered":"2024-04-25T09:03:31.575279+0000","last_unstale":"2024-04-25T09:03:34.124231+0000","last_undegraded":"2024-04-25T09:03:34.124231+0000","last_fullsized":"2024-04-25T09:03:34.124231+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:43:58.773892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123678+0000","last_change":"2024-04-25T09:03:32.574174+0000","last_active":"2024-04-25T09:03:34.123678+0000","last_peered":"2024-04-25T09:03:34.123678+0000","last_clean":"2024-04-25T09:03:34.123678+0000","last_became_active":"2024-04-25T09:03:32.573863+0000","last_became_peered":"2024-04-25T09:03:32.573863+0000","last_unstale":"2024-04-25T09:03:34.123678+0000","last_undegraded":"2024-04-25T09:03:34.123678+0000","last_fullsized":"2024-04-25T09:03:34.123678+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:13.925511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"51'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579037+0000","last_change":"2024-04-25T09:03:31.579622+0000","last_active":"2024-04-25T09:03:33.579037+0000","last_peered":"2024-04-25T09:03:33.579037+0000","last_clean":"2024-04-25T09:03:33.579037+0000","last_became_active":"2024-04-25T09:03:31.579295+0000","last_became_peered":"2024-04-25T09:03:31.579295+0000","last_unstale":"2024-04-25T09:03:33.579037+0000","last_undegraded":"2024-04-25T09:03:33.579037+0000","last_fullsized":"2024-04-25T09:03:33.579037+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:09.860173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577205+0000","last_change":"2024-04-25T09:03:32.580251+0000","last_active":"2024-04-25T09:03:33.577205+0000","last_peered":"2024-04-25T09:03:33.577205+0000","last_clean":"2024-04-25T09:03:33.577205+0000","last_became_active":"2024-04-25T09:03:32.579992+0000","last_became_peered":"2024-04-25T09:03:32.579992+0000","last_unstale":"2024-04-25T09:03:33.577205+0000","last_undegraded":"2024-04-25T09:03:33.577205+0000","last_fullsized":"2024-04-25T09:03:33.577205+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:59.043158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580102+0000","last_change":"2024-04-25T09:03:31.584444+0000","last_active":"2024-04-25T09:03:33.580102+0000","last_peered":"2024-04-25T09:03:33.580102+0000","last_clean":"2024-04-25T09:03:33.580102+0000","last_became_active":"2024-04-25T09:03:31.584132+0000","last_became_peered":"2024-04-25T09:03:31.584132+0000","last_unstale":"2024-04-25T09:03:33.580102+0000","last_undegraded":"2024-04-25T09:03:33.580102+0000","last_fullsized":"2024-04-25T09:03:33.580102+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:01.272870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579414+0000","last_change":"2024-04-25T09:03:32.576056+0000","last_active":"2024-04-25T09:03:33.579414+0000","last_peered":"2024-04-25T09:03:33.579414+0000","last_clean":"2024-04-25T09:03:33.579414+0000","last_became_active":"2024-04-25T09:03:32.575769+0000","last_became_peered":"2024-04-25T09:03:32.575769+0000","last_unstale":"2024-04-25T09:03:33.579414+0000","last_undegraded":"2024-04-25T09:03:33.579414+0000","last_fullsized":"2024-04-25T09:03:33.579414+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:32:40.096246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577261+0000","last_change":"2024-04-25T09:03:31.577314+0000","last_active":"2024-04-25T09:03:33.577261+0000","last_peered":"2024-04-25T09:03:33.577261+0000","last_clean":"2024-04-25T09:03:33.577261+0000","last_became_active":"2024-04-25T09:03:31.577034+0000","last_became_peered":"2024-04-25T09:03:31.577034+0000","last_unstale":"2024-04-25T09:03:33.577261+0000","last_undegraded":"2024-04-25T09:03:33.577261+0000","last_fullsized":"2024-04-25T09:03:33.577261+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:52.862962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579352+0000","last_change":"2024-04-25T09:03:32.575898+0000","last_active":"2024-04-25T09:03:33.579352+0000","last_peered":"2024-04-25T09:03:33.579352+0000","last_clean":"2024-04-25T09:03:33.579352+0000","last_became_active":"2024-04-25T09:03:32.575573+0000","last_became_peered":"2024-04-25T09:03:32.575573+0000","last_unstale":"2024-04-25T09:03:33.579352+0000","last_undegraded":"2024-04-25T09:03:33.579352+0000","last_fullsized":"2024-04-25T09:03:33.579352+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:21.221029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124113+0000","last_change":"2024-04-25T09:03:31.582005+0000","last_active":"2024-04-25T09:03:34.124113+0000","last_peered":"2024-04-25T09:03:34.124113+0000","last_clean":"2024-04-25T09:03:34.124113+0000","last_became_active":"2024-04-25T09:03:31.581708+0000","last_became_peered":"2024-04-25T09:03:31.581708+0000","last_unstale":"2024-04-25T09:03:34.124113+0000","last_undegraded":"2024-04-25T09:03:34.124113+0000","last_fullsized":"2024-04-25T09:03:34.124113+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:47.625868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580550+0000","last_change":"2024-04-25T09:03:32.584789+0000","last_active":"2024-04-25T09:03:33.580550+0000","last_peered":"2024-04-25T09:03:33.580550+0000","last_clean":"2024-04-25T09:03:33.580550+0000","last_became_active":"2024-04-25T09:03:32.584477+0000","last_became_peered":"2024-04-25T09:03:32.584477+0000","last_unstale":"2024-04-25T09:03:33.580550+0000","last_undegraded":"2024-04-25T09:03:33.580550+0000","last_fullsized":"2024-04-25T09:03:33.580550+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:21.951048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580060+0000","last_change":"2024-04-25T09:03:31.578469+0000","last_active":"2024-04-25T09:03:33.580060+0000","last_peered":"2024-04-25T09:03:33.580060+0000","last_clean":"2024-04-25T09:03:33.580060+0000","last_became_active":"2024-04-25T09:03:31.578199+0000","last_became_peered":"2024-04-25T09:03:31.578199+0000","last_unstale":"2024-04-25T09:03:33.580060+0000","last_undegraded":"2024-04-25T09:03:33.580060+0000","last_fullsized":"2024-04-25T09:03:33.580060+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:09.860173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577438+0000","last_change":"2024-04-25T09:03:32.603880+0000","last_active":"2024-04-25T09:03:33.577438+0000","last_peered":"2024-04-25T09:03:33.577438+0000","last_clean":"2024-04-25T09:03:33.577438+0000","last_became_active":"2024-04-25T09:03:32.603214+0000","last_became_peered":"2024-04-25T09:03:32.603214+0000","last_unstale":"2024-04-25T09:03:33.577438+0000","last_undegraded":"2024-04-25T09:03:33.577438+0000","last_fullsized":"2024-04-25T09:03:33.577438+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:20.202455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123430+0000","last_change":"2024-04-25T09:03:31.579787+0000","last_active":"2024-04-25T09:03:34.123430+0000","last_peered":"2024-04-25T09:03:34.123430+0000","last_clean":"2024-04-25T09:03:34.123430+0000","last_became_active":"2024-04-25T09:03:31.579208+0000","last_became_peered":"2024-04-25T09:03:31.579208+0000","last_unstale":"2024-04-25T09:03:34.123430+0000","last_undegraded":"2024-04-25T09:03:34.123430+0000","last_fullsized":"2024-04-25T09:03:34.123430+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:27.085699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579611+0000","last_change":"2024-04-25T09:03:32.597762+0000","last_active":"2024-04-25T09:03:33.579611+0000","last_peered":"2024-04-25T09:03:33.579611+0000","last_clean":"2024-04-25T09:03:33.579611+0000","last_became_active":"2024-04-25T09:03:32.597516+0000","last_became_peered":"2024-04-25T09:03:32.597516+0000","last_unstale":"2024-04-25T09:03:33.579611+0000","last_undegraded":"2024-04-25T09:03:33.579611+0000","last_fullsized":"2024-04-25T09:03:33.579611+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:55.719444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"51'2","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579386+0000","last_change":"2024-04-25T09:03:31.578252+0000","last_active":"2024-04-25T09:03:33.579386+0000","last_peered":"2024-04-25T09:03:33.579386+0000","last_clean":"2024-04-25T09:03:33.579386+0000","last_became_active":"2024-04-25T09:03:31.577995+0000","last_became_peered":"2024-04-25T09:03:31.577995+0000","last_unstale":"2024-04-25T09:03:33.579386+0000","last_undegraded":"2024-04-25T09:03:33.579386+0000","last_fullsized":"2024-04-25T09:03:33.579386+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:01:37.863718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.577287+0000","last_change":"2024-04-25T09:03:32.586525+0000","last_active":"2024-04-25T09:03:33.577287+0000","last_peered":"2024-04-25T09:03:33.577287+0000","last_clean":"2024-04-25T09:03:33.577287+0000","last_became_active":"2024-04-25T09:03:32.586243+0000","last_became_peered":"2024-04-25T09:03:32.586243+0000","last_unstale":"2024-04-25T09:03:33.577287+0000","last_undegraded":"2024-04-25T09:03:33.577287+0000","last_fullsized":"2024-04-25T09:03:33.577287+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:08:30.209192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583949+0000","last_change":"2024-04-25T09:03:31.582406+0000","last_active":"2024-04-25T09:03:33.583949+0000","last_peered":"2024-04-25T09:03:33.583949+0000","last_clean":"2024-04-25T09:03:33.583949+0000","last_became_active":"2024-04-25T09:03:31.582128+0000","last_became_peered":"2024-04-25T09:03:31.582128+0000","last_unstale":"2024-04-25T09:03:33.583949+0000","last_undegraded":"2024-04-25T09:03:33.583949+0000","last_fullsized":"2024-04-25T09:03:33.583949+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:37:19.098906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124342+0000","last_change":"2024-04-25T09:03:32.597021+0000","last_active":"2024-04-25T09:03:34.124342+0000","last_peered":"2024-04-25T09:03:34.124342+0000","last_clean":"2024-04-25T09:03:34.124342+0000","last_became_active":"2024-04-25T09:03:32.596844+0000","last_became_peered":"2024-04-25T09:03:32.596844+0000","last_unstale":"2024-04-25T09:03:34.124342+0000","last_undegraded":"2024-04-25T09:03:34.124342+0000","last_fullsized":"2024-04-25T09:03:34.124342+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:21.209576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580418+0000","last_change":"2024-04-25T09:03:31.575054+0000","last_active":"2024-04-25T09:03:33.580418+0000","last_peered":"2024-04-25T09:03:33.580418+0000","last_clean":"2024-04-25T09:03:33.580418+0000","last_became_active":"2024-04-25T09:03:31.574792+0000","last_became_peered":"2024-04-25T09:03:31.574792+0000","last_unstale":"2024-04-25T09:03:33.580418+0000","last_undegraded":"2024-04-25T09:03:33.580418+0000","last_fullsized":"2024-04-25T09:03:33.580418+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:22.298258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580383+0000","last_change":"2024-04-25T09:03:32.600747+0000","last_active":"2024-04-25T09:03:33.580383+0000","last_peered":"2024-04-25T09:03:33.580383+0000","last_clean":"2024-04-25T09:03:33.580383+0000","last_became_active":"2024-04-25T09:03:32.600462+0000","last_became_peered":"2024-04-25T09:03:32.600462+0000","last_unstale":"2024-04-25T09:03:33.580383+0000","last_undegraded":"2024-04-25T09:03:33.580383+0000","last_fullsized":"2024-04-25T09:03:33.580383+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:58.221449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124046+0000","last_change":"2024-04-25T09:03:31.580977+0000","last_active":"2024-04-25T09:03:34.124046+0000","last_peered":"2024-04-25T09:03:34.124046+0000","last_clean":"2024-04-25T09:03:34.124046+0000","last_became_active":"2024-04-25T09:03:31.580652+0000","last_became_peered":"2024-04-25T09:03:31.580652+0000","last_unstale":"2024-04-25T09:03:34.124046+0000","last_undegraded":"2024-04-25T09:03:34.124046+0000","last_fullsized":"2024-04-25T09:03:34.124046+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:06.486252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579183+0000","last_change":"2024-04-25T09:03:32.576572+0000","last_active":"2024-04-25T09:03:33.579183+0000","last_peered":"2024-04-25T09:03:33.579183+0000","last_clean":"2024-04-25T09:03:33.579183+0000","last_became_active":"2024-04-25T09:03:32.576013+0000","last_became_peered":"2024-04-25T09:03:32.576013+0000","last_unstale":"2024-04-25T09:03:33.579183+0000","last_undegraded":"2024-04-25T09:03:33.579183+0000","last_fullsized":"2024-04-25T09:03:33.579183+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:14:07.492678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124225+0000","last_change":"2024-04-25T09:03:31.572954+0000","last_active":"2024-04-25T09:03:34.124225+0000","last_peered":"2024-04-25T09:03:34.124225+0000","last_clean":"2024-04-25T09:03:34.124225+0000","last_became_active":"2024-04-25T09:03:31.572647+0000","last_became_peered":"2024-04-25T09:03:31.572647+0000","last_unstale":"2024-04-25T09:03:34.124225+0000","last_undegraded":"2024-04-25T09:03:34.124225+0000","last_fullsized":"2024-04-25T09:03:34.124225+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:19.196029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.580684+0000","last_change":"2024-04-25T09:03:32.592262+0000","last_active":"2024-04-25T09:03:33.580684+0000","last_peered":"2024-04-25T09:03:33.580684+0000","last_clean":"2024-04-25T09:03:33.580684+0000","last_became_active":"2024-04-25T09:03:32.589711+0000","last_became_peered":"2024-04-25T09:03:32.589711+0000","last_unstale":"2024-04-25T09:03:33.580684+0000","last_undegraded":"2024-04-25T09:03:33.580684+0000","last_fullsized":"2024-04-25T09:03:33.580684+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:10.351894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.123471+0000","last_change":"2024-04-25T09:03:31.574156+0000","last_active":"2024-04-25T09:03:34.123471+0000","last_peered":"2024-04-25T09:03:34.123471+0000","last_clean":"2024-04-25T09:03:34.123471+0000","last_became_active":"2024-04-25T09:03:31.573837+0000","last_became_peered":"2024-04-25T09:03:31.573837+0000","last_unstale":"2024-04-25T09:03:34.123471+0000","last_undegraded":"2024-04-25T09:03:34.123471+0000","last_fullsized":"2024-04-25T09:03:34.123471+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:52.862962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:34.124641+0000","last_change":"2024-04-25T09:03:32.597823+0000","last_active":"2024-04-25T09:03:34.124641+0000","last_peered":"2024-04-25T09:03:34.124641+0000","last_clean":"2024-04-25T09:03:34.124641+0000","last_became_active":"2024-04-25T09:03:32.597504+0000","last_became_peered":"2024-04-25T09:03:32.597504+0000","last_unstale":"2024-04-25T09:03:34.124641+0000","last_undegraded":"2024-04-25T09:03:34.124641+0000","last_fullsized":"2024-04-25T09:03:34.124641+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:50.597260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579117+0000","last_change":"2024-04-25T09:03:31.578445+0000","last_active":"2024-04-25T09:03:33.579117+0000","last_peered":"2024-04-25T09:03:33.579117+0000","last_clean":"2024-04-25T09:03:33.579117+0000","last_became_active":"2024-04-25T09:03:31.578156+0000","last_became_peered":"2024-04-25T09:03:31.578156+0000","last_unstale":"2024-04-25T09:03:33.579117+0000","last_undegraded":"2024-04-25T09:03:33.579117+0000","last_fullsized":"2024-04-25T09:03:33.579117+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:48.447202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.579680+0000","last_change":"2024-04-25T09:03:32.572564+0000","last_active":"2024-04-25T09:03:33.579680+0000","last_peered":"2024-04-25T09:03:33.579680+0000","last_clean":"2024-04-25T09:03:33.579680+0000","last_became_active":"2024-04-25T09:03:32.572279+0000","last_became_peered":"2024-04-25T09:03:32.572279+0000","last_unstale":"2024-04-25T09:03:33.579680+0000","last_undegraded":"2024-04-25T09:03:33.579680+0000","last_fullsized":"2024-04-25T09:03:33.579680+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:31.547720+0000","last_clean_scrub_stamp":"2024-04-25T09:03:31.547720+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:18:49.453628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"52'1","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.582382+0000","last_change":"2024-04-25T09:03:31.578467+0000","last_active":"2024-04-25T09:03:33.582382+0000","last_peered":"2024-04-25T09:03:33.582382+0000","last_clean":"2024-04-25T09:03:33.582382+0000","last_became_active":"2024-04-25T09:03:31.577996+0000","last_became_peered":"2024-04-25T09:03:31.577996+0000","last_unstale":"2024-04-25T09:03:33.582382+0000","last_undegraded":"2024-04-25T09:03:33.582382+0000","last_fullsized":"2024-04-25T09:03:33.582382+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:03:30.541293+0000","last_clean_scrub_stamp":"2024-04-25T09:03:30.541293+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:49.711365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":229,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-04-25T09:03:33.583347+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:03:33.583347+0000","last_peered":"2024-04-25T09:03:33.583347+0000","last_clean":"2024-04-25T09:03:33.583347+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:03:33.583347+0000","last_undegraded":"2024-04-25T09:03:33.583347+0000","last_fullsized":"2024-04-25T09:03:33.583347+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32376,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339464,"statfs":{"total":96636764160,"available":96603611136,"internally_reserved":0,"allocated":1220608,"data_stored":866851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":626688,"data_stored":277011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31792,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":618496,"data_stored":276359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31780,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340060,"statfs":{"total":96636764160,"available":96604221440,"internally_reserved":0,"allocated":610304,"data_stored":270249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":622592,"data_stored":271301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27628,"kb_used_data":604,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344212,"statfs":{"total":96636764160,"available":96608473088,"internally_reserved":0,"allocated":618496,"data_stored":271279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27640,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344200,"statfs":{"total":96636764160,"available":96608460800,"internally_reserved":0,"allocated":626688,"data_stored":276519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1220608,"data_stored":866783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:03:37.068 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:03:37.068 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.262+0000 7f83c8600640 1 Processor -- start 2024-04-25T09:03:37.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.262+0000 7f83c8600640 1 -- start start 2024-04-25T09:03:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.262+0000 7f83c8600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f83c015dc60 0x7f83c00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.262+0000 7f83c8600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c006bf30 0x7f83c00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.262+0000 7f83c8600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c015e040 con 0x7f83c0099a60 2024-04-25T09:03:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.262+0000 7f83c8600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c00cff80 con 0x7f83c015dc60 2024-04-25T09:03:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.262+0000 7f83c8600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00d0260 con 0x7f83c006bf30 2024-04-25T09:03:37.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83c6600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f83c0099a60 0x7f83c00cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45990/0 (socket says 172.21.15.59:45990) 2024-04-25T09:03:37.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83c6600640 1 -- 172.21.15.59:0/3053400727 learned_addr learned my addr 172.21.15.59:0/3053400727 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83c5c00640 1 --2- 172.21.15.59:0/3053400727 >> v2:172.21.15.178:3300/0 conn(0x7f83c015dc60 0x7f83c00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83c5200640 1 --2- 172.21.15.59:0/3053400727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c006bf30 0x7f83c00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83bfe00640 1 -- 172.21.15.59:0/3053400727 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3618589730 0 0) 0x7f83c015e040 con 0x7f83c0099a60 2024-04-25T09:03:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83bfe00640 1 -- 172.21.15.59:0/3053400727 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a8003530 con 0x7f83c0099a60 2024-04-25T09:03:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83c5c00640 1 -- 172.21.15.59:0/3053400727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c006bf30 msgr2=0x7f83c00cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83c5c00640 1 --2- 172.21.15.59:0/3053400727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c006bf30 0x7f83c00cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83c5c00640 1 -- 172.21.15.59:0/3053400727 >> v1:172.21.15.59:6789/0 conn(0x7f83c0099a60 legacy=0x7f83c00cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83bfe00640 1 -- 172.21.15.59:0/3053400727 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1597360159 0 0) 0x7f83a8003530 con 0x7f83c0099a60 2024-04-25T09:03:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83c5c00640 1 -- 172.21.15.59:0/3053400727 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c00d0540 con 0x7f83c015dc60 2024-04-25T09:03:37.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83c5200640 1 --2- 172.21.15.59:0/3053400727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c006bf30 0x7f83c00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:37.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.266+0000 7f83c5c00640 1 --2- 172.21.15.59:0/3053400727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c015dc60 0x7f83c00d1020 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f83b40097c0 tx=0x7f83b401c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36cfbf5f26fbeba1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83bfe00640 1 -- 172.21.15.59:0/3053400727 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b40b0070 con 0x7f83c015dc60 2024-04-25T09:03:37.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83bfe00640 1 -- 172.21.15.59:0/3053400727 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b40ab400 con 0x7f83c015dc60 2024-04-25T09:03:37.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83bfe00640 1 -- 172.21.15.59:0/3053400727 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8001a00 con 0x7f83c015dc60 2024-04-25T09:03:37.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 -- 172.21.15.59:0/3053400727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c015dc60 msgr2=0x7f83c00d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 --2- 172.21.15.59:0/3053400727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c015dc60 0x7f83c00d1020 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f83b40097c0 tx=0x7f83b401c300 comp rx=0 tx=0).stop 2024-04-25T09:03:37.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 -- 172.21.15.59:0/3053400727 shutdown_connections 2024-04-25T09:03:37.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 --2- 172.21.15.59:0/3053400727 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c006bf30 0x7f83c00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 --2- 172.21.15.59:0/3053400727 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c015dc60 0x7f83c00d1020 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 -- 172.21.15.59:0/3053400727 >> 172.21.15.59:0/3053400727 conn(0x7f83c00b3200 msgr2=0x7f83c00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 -- 172.21.15.59:0/3053400727 shutdown_connections 2024-04-25T09:03:37.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 -- 172.21.15.59:0/3053400727 wait complete. 2024-04-25T09:03:37.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 Processor -- start 2024-04-25T09:03:37.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 -- start start 2024-04-25T09:03:37.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c006bf30 0x7f83c014d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83c0099a60 0x7f83c0153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c015dc60 0x7f83c00b69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c006cfa0 con 0x7f83c0099a60 2024-04-25T09:03:37.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00cc880 con 0x7f83c006bf30 2024-04-25T09:03:37.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.270+0000 7f83c8600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00b71d0 con 0x7f83c015dc60 2024-04-25T09:03:37.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83c0099a60 0x7f83c0153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83c0099a60 0x7f83c0153760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47826/0 (socket says 172.21.15.59:47826) 2024-04-25T09:03:37.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c5200640 1 -- 172.21.15.59:0/3348636696 learned_addr learned my addr 172.21.15.59:0/3348636696 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:37.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c5c00640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c006bf30 0x7f83c014d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c6600640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c015dc60 0x7f83c00b69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c5200640 1 -- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c015dc60 msgr2=0x7f83c00b69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c5200640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c015dc60 0x7f83c00b69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c5200640 1 -- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c006bf30 msgr2=0x7f83c014d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c5200640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c006bf30 0x7f83c014d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c5200640 1 -- 172.21.15.59:0/3348636696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c014c9b0 con 0x7f83c0099a60 2024-04-25T09:03:37.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c5200640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83c0099a60 0x7f83c0153760 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00ebe0 tx=0x7f83ac00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83bd600640 1 -- 172.21.15.59:0/3348636696 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac017070 con 0x7f83c0099a60 2024-04-25T09:03:37.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83bd600640 1 -- 172.21.15.59:0/3348636696 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00cc30 con 0x7f83c0099a60 2024-04-25T09:03:37.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83bd600640 1 -- 172.21.15.59:0/3348636696 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac013470 con 0x7f83c0099a60 2024-04-25T09:03:37.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c8600640 1 -- 172.21.15.59:0/3348636696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c014cc90 con 0x7f83c0099a60 2024-04-25T09:03:37.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c8600640 1 -- 172.21.15.59:0/3348636696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c00b6ee0 con 0x7f83c0099a60 2024-04-25T09:03:37.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83c8600640 1 -- 172.21.15.59:0/3348636696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c00745d0 con 0x7f83c0099a60 2024-04-25T09:03:37.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83bd600640 1 -- 172.21.15.59:0/3348636696 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f83ac01a070 con 0x7f83c0099a60 2024-04-25T09:03:37.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.274+0000 7f83bd600640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f83a0066f60 0x7f83a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.278+0000 7f83bd600640 1 -- 172.21.15.59:0/3348636696 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f83ac0854b0 con 0x7f83c0099a60 2024-04-25T09:03:37.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.278+0000 7f83c5c00640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f83a0066f60 0x7f83a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.278+0000 7f83c5c00640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f83a0066f60 0x7f83a0069420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f83b40ad000 tx=0x7f83b40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.278+0000 7f83bd600640 1 -- 172.21.15.59:0/3348636696 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f83ac055c40 con 0x7f83c0099a60 2024-04-25T09:03:37.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.502+0000 7f83c8600640 1 -- 172.21.15.59:0/3348636696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f83c00b7590 con 0x7f83c0099a60 2024-04-25T09:03:37.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.506+0000 7f83bd600640 1 -- 172.21.15.59:0/3348636696 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+147 (secure 0 0 0) 0x7f83ac059ce0 con 0x7f83c0099a60 2024-04-25T09:03:37.499 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-04-25T09:03:37.499 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg== 2024-04-25T09:03:37.499 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-04-25T09:03:37.499 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-04-25T09:03:37.499 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:03:37.499 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-04-25T09:03:37.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.510+0000 7f83c8600640 1 -- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f83a0066f60 msgr2=0x7f83a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.510+0000 7f83c8600640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f83a0066f60 0x7f83a0069420 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f83b40ad000 tx=0x7f83b40a6000 comp rx=0 tx=0).stop 2024-04-25T09:03:37.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.510+0000 7f83c8600640 1 -- 172.21.15.59:0/3348636696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83c0099a60 msgr2=0x7f83c0153760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.510+0000 7f83c8600640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83c0099a60 0x7f83c0153760 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f83ac00ebe0 tx=0x7f83ac00c520 comp rx=0 tx=0).stop 2024-04-25T09:03:37.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.510+0000 7f83c8600640 1 -- 172.21.15.59:0/3348636696 shutdown_connections 2024-04-25T09:03:37.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.510+0000 7f83c8600640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f83a0066f60 0x7f83a0069420 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.510+0000 7f83c8600640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f83c015dc60 0x7f83c00b69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.510+0000 7f83c8600640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f83c0099a60 0x7f83c0153760 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.510+0000 7f83c8600640 1 --2- 172.21.15.59:0/3348636696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f83c006bf30 0x7f83c014d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.510+0000 7f83c8600640 1 -- 172.21.15.59:0/3348636696 >> 172.21.15.59:0/3348636696 conn(0x7f83c00b3200 msgr2=0x7f83c00ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.510+0000 7f83c8600640 1 -- 172.21.15.59:0/3348636696 shutdown_connections 2024-04-25T09:03:37.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.510+0000 7f83c8600640 1 -- 172.21.15.59:0/3348636696 wait complete. 2024-04-25T09:03:37.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:37.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb69200640 1 Processor -- start 2024-04-25T09:03:37.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb69200640 1 -- start start 2024-04-25T09:03:37.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb69200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb64145270 0x7fdb6415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb69200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb640cd4d0 0x7fdb640cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb69200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb640cc4e0 con 0x7fdb640b1750 2024-04-25T09:03:37.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb69200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb64145650 con 0x7fdb64145270 2024-04-25T09:03:37.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb69200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640ce040 con 0x7fdb640cd4d0 2024-04-25T09:03:37.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb61e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb64145270 0x7fdb6415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb61e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb64145270 0x7fdb6415fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47828/0 (socket says 172.21.15.59:47828) 2024-04-25T09:03:37.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb61e00640 1 -- 172.21.15.59:0/1822963890 learned_addr learned my addr 172.21.15.59:0/1822963890 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:37.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb5be00640 1 --2- 172.21.15.59:0/1822963890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb640cd4d0 0x7fdb640cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb61e00640 1 -- 172.21.15.59:0/1822963890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb640cd4d0 msgr2=0x7fdb640cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:37.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb61e00640 1 --2- 172.21.15.59:0/1822963890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb640cd4d0 0x7fdb640cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb61e00640 1 -- 172.21.15.59:0/1822963890 >> v1:172.21.15.178:6789/0 conn(0x7fdb640b1750 legacy=0x7fdb6415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.670+0000 7fdb61e00640 1 -- 172.21.15.59:0/1822963890 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb640ce320 con 0x7fdb64145270 2024-04-25T09:03:37.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.674+0000 7fdb61e00640 1 --2- 172.21.15.59:0/1822963890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb64145270 0x7fdb6415fe50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009870 tx=0x7fdb5401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb19c5d4c5cd6c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.674+0000 7fdb61400640 1 -- 172.21.15.59:0/1822963890 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540ab650 con 0x7fdb64145270 2024-04-25T09:03:37.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.674+0000 7fdb61400640 1 -- 172.21.15.59:0/1822963890 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb540b0070 con 0x7fdb64145270 2024-04-25T09:03:37.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.674+0000 7fdb61400640 1 -- 172.21.15.59:0/1822963890 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540aba10 con 0x7fdb64145270 2024-04-25T09:03:37.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.674+0000 7fdb69200640 1 -- 172.21.15.59:0/1822963890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb64145270 msgr2=0x7fdb6415fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.674+0000 7fdb69200640 1 --2- 172.21.15.59:0/1822963890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb64145270 0x7fdb6415fe50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdb54009870 tx=0x7fdb5401c560 comp rx=0 tx=0).stop 2024-04-25T09:03:37.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.674+0000 7fdb69200640 1 -- 172.21.15.59:0/1822963890 shutdown_connections 2024-04-25T09:03:37.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.674+0000 7fdb69200640 1 --2- 172.21.15.59:0/1822963890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb640cd4d0 0x7fdb640cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.674+0000 7fdb69200640 1 --2- 172.21.15.59:0/1822963890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb64145270 0x7fdb6415fe50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.674+0000 7fdb69200640 1 -- 172.21.15.59:0/1822963890 >> 172.21.15.59:0/1822963890 conn(0x7fdb64066fa0 msgr2=0x7fdb6406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.674+0000 7fdb69200640 1 -- 172.21.15.59:0/1822963890 shutdown_connections 2024-04-25T09:03:37.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.674+0000 7fdb69200640 1 -- 172.21.15.59:0/1822963890 wait complete. 2024-04-25T09:03:37.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb69200640 1 Processor -- start 2024-04-25T09:03:37.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb69200640 1 -- start start 2024-04-25T09:03:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb69200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb640b1750 0x7fdb640b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb69200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb640cd4d0 0x7fdb64141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb69200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb64145270 0x7fdb641421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb69200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640b1f70 con 0x7fdb640cd4d0 2024-04-25T09:03:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb69200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb64168710 con 0x7fdb64145270 2024-04-25T09:03:37.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb69200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640b35a0 con 0x7fdb640b1750 2024-04-25T09:03:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb5be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb640cd4d0 0x7fdb64141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb5be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb640cd4d0 0x7fdb64141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47844/0 (socket says 172.21.15.59:47844) 2024-04-25T09:03:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb5be00640 1 -- 172.21.15.59:0/2023252722 learned_addr learned my addr 172.21.15.59:0/2023252722 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb61e00640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb640b1750 0x7fdb640b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb62800640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb64145270 0x7fdb641421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb5be00640 1 -- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb640b1750 msgr2=0x7fdb640b3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb5be00640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb640b1750 0x7fdb640b3060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb5be00640 1 -- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb64145270 msgr2=0x7fdb641421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb5be00640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb64145270 0x7fdb641421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb5be00640 1 -- 172.21.15.59:0/2023252722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb64142b60 con 0x7fdb640cd4d0 2024-04-25T09:03:37.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb5be00640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb640cd4d0 0x7fdb64141c70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00d800 tx=0x7fdb4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb5a000640 1 -- 172.21.15.59:0/2023252722 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c00b6c0 con 0x7fdb640cd4d0 2024-04-25T09:03:37.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb5a000640 1 -- 172.21.15.59:0/2023252722 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c019070 con 0x7fdb640cd4d0 2024-04-25T09:03:37.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb5a000640 1 -- 172.21.15.59:0/2023252722 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4c00bae0 con 0x7fdb640cd4d0 2024-04-25T09:03:37.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb69200640 1 -- 172.21.15.59:0/2023252722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6413e5e0 con 0x7fdb640cd4d0 2024-04-25T09:03:37.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.678+0000 7fdb69200640 1 -- 172.21.15.59:0/2023252722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb640b3ab0 con 0x7fdb640cd4d0 2024-04-25T09:03:37.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.682+0000 7fdb69200640 1 -- 172.21.15.59:0/2023252722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb640745d0 con 0x7fdb640cd4d0 2024-04-25T09:03:37.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.682+0000 7fdb5a000640 1 -- 172.21.15.59:0/2023252722 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdb4c00bc80 con 0x7fdb640cd4d0 2024-04-25T09:03:37.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.682+0000 7fdb5a000640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb40066f60 0x7fdb40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:37.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.682+0000 7fdb5a000640 1 -- 172.21.15.59:0/2023252722 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdb4c085620 con 0x7fdb640cd4d0 2024-04-25T09:03:37.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.682+0000 7fdb61e00640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb40066f60 0x7fdb40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:37.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.682+0000 7fdb61e00640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb40066f60 0x7fdb40069420 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdb540af000 tx=0x7fdb540a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:37.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.686+0000 7fdb5a000640 1 -- 172.21.15.59:0/2023252722 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdb4c055db0 con 0x7fdb640cd4d0 2024-04-25T09:03:37.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.882+0000 7fdb69200640 1 -- 172.21.15.59:0/2023252722 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb6413cbb0 con 0x7fdb640cd4d0 2024-04-25T09:03:37.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.882+0000 7fdb5a000640 1 -- 172.21.15.59:0/2023252722 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fdb4c059e50 con 0x7fdb640cd4d0 2024-04-25T09:03:37.875 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:37.875 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2757859141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2757859141},{"type":"v1","addr":"172.21.15.178:6836","nonce":2757859141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5626,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/447455100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":447455100},{"type":"v1","addr":"172.21.15.178:6837","nonce":447455100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4008580166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4008580166},{"type":"v1","addr":"172.21.15.59:6834","nonce":4008580166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:31.959775+0000","modified":"2024-04-25T09:03:34.974887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2578168283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2578168283},{"type":"v1","addr":"172.21.15.59:6835","nonce":2578168283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:03:37.876 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-04-25T09:03:37.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.886+0000 7fdb69200640 1 -- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb40066f60 msgr2=0x7fdb40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.886+0000 7fdb69200640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb40066f60 0x7fdb40069420 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fdb540af000 tx=0x7fdb540a7000 comp rx=0 tx=0).stop 2024-04-25T09:03:37.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.886+0000 7fdb69200640 1 -- 172.21.15.59:0/2023252722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb640cd4d0 msgr2=0x7fdb64141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:37.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.886+0000 7fdb69200640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb640cd4d0 0x7fdb64141c70 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00d800 tx=0x7fdb4c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.886+0000 7fdb69200640 1 -- 172.21.15.59:0/2023252722 shutdown_connections 2024-04-25T09:03:37.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.886+0000 7fdb69200640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb40066f60 0x7fdb40069420 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.886+0000 7fdb69200640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb64145270 0x7fdb641421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.886+0000 7fdb69200640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb640cd4d0 0x7fdb64141c70 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.886+0000 7fdb69200640 1 --2- 172.21.15.59:0/2023252722 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb640b1750 0x7fdb640b3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:37.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.886+0000 7fdb69200640 1 -- 172.21.15.59:0/2023252722 >> 172.21.15.59:0/2023252722 conn(0x7fdb64066fa0 msgr2=0x7fdb6415ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:37.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.886+0000 7fdb69200640 1 -- 172.21.15.59:0/2023252722 shutdown_connections 2024-04-25T09:03:37.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:37.886+0000 7fdb69200640 1 -- 172.21.15.59:0/2023252722 wait complete. 2024-04-25T09:03:38.299 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:03:31.959775+0000', 'modified': '2024-04-25T09:03:34.974887+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5769}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5769': {'gid': 5769, 'name': 'a', 'rank': 0, 'incarnation': 24, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/2578168283', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 2578168283}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2578168283}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:03:38.299 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:03:38.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:03:38.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff59e00640 1 Processor -- start 2024-04-25T09:03:38.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff59e00640 1 -- start start 2024-04-25T09:03:38.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff59e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5415dc60 0x7eff540d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff59e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7eff5406bf30 0x7eff540cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff59e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff5415e040 con 0x7eff54099a60 2024-04-25T09:03:38.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff59e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff540cff80 con 0x7eff5406bf30 2024-04-25T09:03:38.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff59e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff540d0260 con 0x7eff5415dc60 2024-04-25T09:03:38.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff53400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7eff54099a60 0x7eff540cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:45992/0 (socket says 172.21.15.59:45992) 2024-04-25T09:03:38.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff53400640 1 -- 172.21.15.59:0/107173441 learned_addr learned my addr 172.21.15.59:0/107173441 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:38.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff52a00640 1 --2- 172.21.15.59:0/107173441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5415dc60 0x7eff540d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff52000640 1 --2- 172.21.15.59:0/107173441 >> v2:172.21.15.178:3300/0 conn(0x7eff5406bf30 0x7eff540cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff51600640 1 -- 172.21.15.59:0/107173441 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346698586 0 0) 0x7eff5415e040 con 0x7eff54099a60 2024-04-25T09:03:38.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff51600640 1 -- 172.21.15.59:0/107173441 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff38003530 con 0x7eff54099a60 2024-04-25T09:03:38.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff52a00640 1 -- 172.21.15.59:0/107173441 >> v2:172.21.15.178:3300/0 conn(0x7eff5406bf30 msgr2=0x7eff540cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff52a00640 1 --2- 172.21.15.59:0/107173441 >> v2:172.21.15.178:3300/0 conn(0x7eff5406bf30 0x7eff540cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff52a00640 1 -- 172.21.15.59:0/107173441 >> v1:172.21.15.59:6789/0 conn(0x7eff54099a60 legacy=0x7eff540cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff52a00640 1 -- 172.21.15.59:0/107173441 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff540d0540 con 0x7eff5415dc60 2024-04-25T09:03:38.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.454+0000 7eff52000640 1 --2- 172.21.15.59:0/107173441 >> v2:172.21.15.178:3300/0 conn(0x7eff5406bf30 0x7eff540cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:38.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.458+0000 7eff52a00640 1 --2- 172.21.15.59:0/107173441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5415dc60 0x7eff540d1020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff440097c0 tx=0x7eff4401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c32dd35ede85b40 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.458+0000 7eff51600640 1 -- 172.21.15.59:0/107173441 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440b1070 con 0x7eff5415dc60 2024-04-25T09:03:38.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.458+0000 7eff51600640 1 -- 172.21.15.59:0/107173441 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff440a8050 con 0x7eff5415dc60 2024-04-25T09:03:38.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.458+0000 7eff51600640 1 -- 172.21.15.59:0/107173441 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440ac860 con 0x7eff5415dc60 2024-04-25T09:03:38.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.458+0000 7eff59e00640 1 -- 172.21.15.59:0/107173441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5415dc60 msgr2=0x7eff540d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.458+0000 7eff59e00640 1 --2- 172.21.15.59:0/107173441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5415dc60 0x7eff540d1020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7eff440097c0 tx=0x7eff4401c3e0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.458+0000 7eff59e00640 1 -- 172.21.15.59:0/107173441 shutdown_connections 2024-04-25T09:03:38.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.458+0000 7eff59e00640 1 --2- 172.21.15.59:0/107173441 >> v2:172.21.15.178:3300/0 conn(0x7eff5406bf30 0x7eff540cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.458+0000 7eff59e00640 1 --2- 172.21.15.59:0/107173441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5415dc60 0x7eff540d1020 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.458+0000 7eff59e00640 1 -- 172.21.15.59:0/107173441 >> 172.21.15.59:0/107173441 conn(0x7eff540b3200 msgr2=0x7eff540b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.458+0000 7eff59e00640 1 -- 172.21.15.59:0/107173441 shutdown_connections 2024-04-25T09:03:38.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.458+0000 7eff59e00640 1 -- 172.21.15.59:0/107173441 wait complete. 2024-04-25T09:03:38.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff59e00640 1 Processor -- start 2024-04-25T09:03:38.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff59e00640 1 -- start start 2024-04-25T09:03:38.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff59e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff5406bf30 0x7eff54153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff59e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff54099a60 0x7eff54158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff59e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5415dc60 0x7eff541590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff59e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5409a280 con 0x7eff5406bf30 2024-04-25T09:03:38.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff59e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540cc880 con 0x7eff54099a60 2024-04-25T09:03:38.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff59e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff540c87e0 con 0x7eff5415dc60 2024-04-25T09:03:38.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff52a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff5406bf30 0x7eff54153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff52a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff5406bf30 0x7eff54153fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47854/0 (socket says 172.21.15.59:47854) 2024-04-25T09:03:38.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff52a00640 1 -- 172.21.15.59:0/4093844165 learned_addr learned my addr 172.21.15.59:0/4093844165 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:38.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff52000640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff54099a60 0x7eff54158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff53400640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5415dc60 0x7eff541590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff52a00640 1 -- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5415dc60 msgr2=0x7eff541590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff52a00640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5415dc60 0x7eff541590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff52a00640 1 -- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff54099a60 msgr2=0x7eff54158b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff52a00640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff54099a60 0x7eff54158b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff52a00640 1 -- 172.21.15.59:0/4093844165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff540b6ef0 con 0x7eff5406bf30 2024-04-25T09:03:38.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff52a00640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff5406bf30 0x7eff54153fe0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7eff4401a010 tx=0x7eff4401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff4b400640 1 -- 172.21.15.59:0/4093844165 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440bb020 con 0x7eff5406bf30 2024-04-25T09:03:38.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff4b400640 1 -- 172.21.15.59:0/4093844165 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff440acda0 con 0x7eff5406bf30 2024-04-25T09:03:38.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff4b400640 1 -- 172.21.15.59:0/4093844165 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440b1040 con 0x7eff5406bf30 2024-04-25T09:03:38.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff59e00640 1 -- 172.21.15.59:0/4093844165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff540c8a30 con 0x7eff5406bf30 2024-04-25T09:03:38.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.462+0000 7eff59e00640 1 -- 172.21.15.59:0/4093844165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff540c8ff0 con 0x7eff5406bf30 2024-04-25T09:03:38.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff4b400640 1 -- 172.21.15.59:0/4093844165 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7eff440be020 con 0x7eff5406bf30 2024-04-25T09:03:38.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff4b400640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7eff34066f60 0x7eff34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff4b400640 1 -- 172.21.15.59:0/4093844165 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7eff4411f3c0 con 0x7eff5406bf30 2024-04-25T09:03:38.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff5d323000 1 Processor -- start 2024-04-25T09:03:38.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff5d323000 1 -- start start 2024-04-25T09:03:38.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff52000640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7eff34066f60 0x7eff34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff52000640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7eff34066f60 0x7eff34069420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7eff40009580 tx=0x7eff40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff5d323000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d799920 0x55b71d799d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff5d323000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d79a240 0x55b71d74f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff5d323000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 0x55b71d750310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff5d323000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b71d6375f0 con 0x55b71d79a240 2024-04-25T09:03:38.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff5d323000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b71d59eda0 con 0x55b71d799920 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff5d323000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b71d527150 con 0x55b71d74ff30 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff52000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d79a240 0x55b71d74f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff52000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d79a240 0x55b71d74f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47864/0 (socket says 172.21.15.59:47864) 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff52000640 1 -- 172.21.15.59:0/3857853705 learned_addr learned my addr 172.21.15.59:0/3857853705 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff52a00640 1 --2- 172.21.15.59:0/3857853705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d799920 0x55b71d799d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.466+0000 7eff53400640 1 --2- 172.21.15.59:0/3857853705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 0x55b71d750310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 -- 172.21.15.59:0/3857853705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 msgr2=0x55b71d750310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 --2- 172.21.15.59:0/3857853705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 0x55b71d750310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 -- 172.21.15.59:0/3857853705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d799920 msgr2=0x55b71d799d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 --2- 172.21.15.59:0/3857853705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d799920 0x55b71d799d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 -- 172.21.15.59:0/3857853705 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b71d540ca0 con 0x55b71d79a240 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 --2- 172.21.15.59:0/3857853705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d79a240 0x55b71d74f9f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7eff40011d30 tx=0x7eff40014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7de5e6310974f1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff3fe00640 1 -- 172.21.15.59:0/3857853705 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40011d60 con 0x55b71d79a240 2024-04-25T09:03:38.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff3fe00640 1 -- 172.21.15.59:0/3857853705 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff40026070 con 0x55b71d79a240 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff3fe00640 1 -- 172.21.15.59:0/3857853705 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40021640 con 0x55b71d79a240 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 -- 172.21.15.59:0/3857853705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d79a240 msgr2=0x55b71d74f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 --2- 172.21.15.59:0/3857853705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d79a240 0x55b71d74f9f0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7eff40011d30 tx=0x7eff40014000 comp rx=0 tx=0).stop 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 -- 172.21.15.59:0/3857853705 shutdown_connections 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 --2- 172.21.15.59:0/3857853705 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 0x55b71d750310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 --2- 172.21.15.59:0/3857853705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d79a240 0x55b71d74f9f0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 --2- 172.21.15.59:0/3857853705 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d799920 0x55b71d799d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 -- 172.21.15.59:0/3857853705 >> 172.21.15.59:0/3857853705 conn(0x55b71d7562a0 msgr2=0x55b71d74e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 -- 172.21.15.59:0/3857853705 shutdown_connections 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 -- 172.21.15.59:0/3857853705 wait complete. 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 -- start start 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 Processor -- start 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 0x55b71d7a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 0x55b71d7a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 0x55b71d753aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b71d559990 con 0x55b71d799920 2024-04-25T09:03:38.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b71d59ae40 con 0x55b71d79a240 2024-04-25T09:03:38.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b71d52a900 con 0x55b71d74ff30 2024-04-25T09:03:38.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff5d323000 10 client.0 _ll_register_callbacks cb 0x55b71d6521c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:38.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 0x55b71d7a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 0x55b71d7a11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47870/0 (socket says 172.21.15.59:47870) 2024-04-25T09:03:38.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 -- 172.21.15.59:0/3180448420 learned_addr learned my addr 172.21.15.59:0/3180448420 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:38.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 -- 172.21.15.59:0/3180448420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 msgr2=0x55b71d7a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 --2- 172.21.15.59:0/3180448420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 0x55b71d7a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 -- 172.21.15.59:0/3180448420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 msgr2=0x55b71d753aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 --2- 172.21.15.59:0/3180448420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 0x55b71d753aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.470+0000 7eff52000640 1 -- 172.21.15.59:0/3180448420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b71d557630 con 0x55b71d799920 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff52000640 1 --2- 172.21.15.59:0/3180448420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 0x55b71d7a11c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7eff40023040 tx=0x7eff400046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4451a9f009923c0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff3cc00640 1 -- 172.21.15.59:0/3180448420 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40021950 con 0x55b71d799920 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff3cc00640 1 -- 172.21.15.59:0/3180448420 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7eff40021af0 con 0x55b71d799920 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 -- 172.21.15.59:0/3180448420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff40026070 con 0x55b71d799920 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff3cc00640 1 -- 172.21.15.59:0/3180448420 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff4003d050 con 0x55b71d799920 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 10 client.5904 fetch_fsmap learned FSMap version 28 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 -- 172.21.15.59:0/3180448420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55b71d5273a0 con 0x55b71d799920 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff3cc00640 1 -- 172.21.15.59:0/3180448420 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff40026070 con 0x55b71d799920 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff3cc00640 1 -- 172.21.15.59:0/3180448420 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7eff40040020 con 0x55b71d799920 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 10 client.5904 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 10 client.5904 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 20 client.5904 populate_metadata read hostname 'smithi059' 2024-04-25T09:03:38.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 --2- 172.21.15.59:0/3180448420 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55b71d755160 0x55b71d7aace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 4 client.5904 mds_command: new command op to 5769 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 -- 172.21.15.59:0/3180448420 --> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b71d53aa50 con 0x55b71d755160 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff52a00640 1 --2- 172.21.15.59:0/3180448420 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55b71d755160 0x55b71d7aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff52a00640 1 --2- 172.21.15.59:0/3180448420 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55b71d755160 0x55b71d7aace0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74894b067115c329 server_cookie=51dae10aaa6ec718 in_seq=0 out_seq=0 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff3cc00640 10 client.5904 ms_handle_connect on v2:172.21.15.59:6833/2578168283 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff3cc00640 1 -- 172.21.15.59:0/3180448420 <== mds.0 v2:172.21.15.59:6833/2578168283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b71d53aa50 con 0x55b71d755160 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff3cc00640 10 client.5904 handle_command_reply: tid=0 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 client.5904 shutdown 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 -- 172.21.15.59:0/3180448420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 msgr2=0x55b71d7a11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 --2- 172.21.15.59:0/3180448420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 0x55b71d7a11c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7eff40023040 tx=0x7eff400046d0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 -- 172.21.15.59:0/3180448420 shutdown_connections 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 --2- 172.21.15.59:0/3180448420 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55b71d755160 0x55b71d7aace0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 --2- 172.21.15.59:0/3180448420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 0x55b71d753aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 --2- 172.21.15.59:0/3180448420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 0x55b71d7a11c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff3cc00640 0 client.5904 ms_handle_reset on v2:172.21.15.59:6833/2578168283 2024-04-25T09:03:38.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 --2- 172.21.15.59:0/3180448420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 0x55b71d7a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 -- 172.21.15.59:0/3180448420 >> 172.21.15.59:0/3180448420 conn(0x55b71d7562a0 msgr2=0x55b71d74e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 -- 172.21.15.59:0/3180448420 shutdown_connections 2024-04-25T09:03:38.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 1 -- 172.21.15.59:0/3180448420 wait complete. 2024-04-25T09:03:38.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.474+0000 7eff5d323000 20 client.5904 trim_cache size 0 max 16384 2024-04-25T09:03:38.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.490+0000 7eff5d323000 1 Processor -- start 2024-04-25T09:03:38.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.490+0000 7eff5d323000 1 -- start start 2024-04-25T09:03:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.490+0000 7eff5d323000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 0x55b71d7f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.490+0000 7eff5d323000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 0x55b71d7f4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.490+0000 7eff5d323000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 0x55b71d7f5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.490+0000 7eff5d323000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff540b5990 con 0x55b71d799920 2024-04-25T09:03:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.490+0000 7eff5d323000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff541554f0 con 0x55b71d79a240 2024-04-25T09:03:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.490+0000 7eff5d323000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff540b5390 con 0x55b71d74ff30 2024-04-25T09:03:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.490+0000 7eff52000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 0x55b71d7f4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.490+0000 7eff52000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 0x55b71d7f4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47880/0 (socket says 172.21.15.59:47880) 2024-04-25T09:03:38.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52000640 1 -- 172.21.15.59:0/1208455929 learned_addr learned my addr 172.21.15.59:0/1208455929 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52a00640 1 --2- 172.21.15.59:0/1208455929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 0x55b71d7f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff53400640 1 --2- 172.21.15.59:0/1208455929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 0x55b71d7f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52000640 1 -- 172.21.15.59:0/1208455929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 msgr2=0x55b71d7f49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52000640 1 --2- 172.21.15.59:0/1208455929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 0x55b71d7f49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52000640 1 -- 172.21.15.59:0/1208455929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 msgr2=0x55b71d7f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52000640 1 --2- 172.21.15.59:0/1208455929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 0x55b71d7f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52000640 1 -- 172.21.15.59:0/1208455929 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b71d79a070 con 0x55b71d799920 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52000640 1 --2- 172.21.15.59:0/1208455929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 0x55b71d7f4f00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7eff40015fd0 tx=0x7eff4002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d265ed5af9f5bd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff3f400640 1 -- 172.21.15.59:0/1208455929 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40021750 con 0x55b71d799920 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff3f400640 1 -- 172.21.15.59:0/1208455929 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff40046070 con 0x55b71d799920 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff3f400640 1 -- 172.21.15.59:0/1208455929 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40021b30 con 0x55b71d799920 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 -- 172.21.15.59:0/1208455929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 msgr2=0x55b71d7f4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 --2- 172.21.15.59:0/1208455929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 0x55b71d7f4f00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7eff40015fd0 tx=0x7eff4002c000 comp rx=0 tx=0).stop 2024-04-25T09:03:38.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 -- 172.21.15.59:0/1208455929 shutdown_connections 2024-04-25T09:03:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 --2- 172.21.15.59:0/1208455929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 0x55b71d7f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 --2- 172.21.15.59:0/1208455929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d799920 0x55b71d7f4f00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 --2- 172.21.15.59:0/1208455929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d74ff30 0x55b71d7f49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 -- 172.21.15.59:0/1208455929 >> 172.21.15.59:0/1208455929 conn(0x55b71d7562a0 msgr2=0x55b71d753470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 -- 172.21.15.59:0/1208455929 shutdown_connections 2024-04-25T09:03:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 -- 172.21.15.59:0/1208455929 wait complete. 2024-04-25T09:03:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 -- start start 2024-04-25T09:03:38.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 Processor -- start 2024-04-25T09:03:38.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d74ff30 0x55b71d7a6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d799920 0x55b71d7ddc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 0x55b71d7de140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b71d5a33d0 con 0x55b71d74ff30 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b71d65ad50 con 0x55b71d79a240 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b71d539980 con 0x55b71d799920 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff5d323000 10 client.0 _ll_register_callbacks cb 0x7eff40009790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d74ff30 0x55b71d7a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d74ff30 0x55b71d7a6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47890/0 (socket says 172.21.15.59:47890) 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52a00640 1 -- 172.21.15.59:0/2939787415 learned_addr learned my addr 172.21.15.59:0/2939787415 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52000640 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d799920 0x55b71d7ddc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff53400640 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 0x55b71d7de140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52a00640 1 -- 172.21.15.59:0/2939787415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d799920 msgr2=0x55b71d7ddc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52a00640 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d799920 0x55b71d7ddc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52a00640 1 -- 172.21.15.59:0/2939787415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 msgr2=0x55b71d7de140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.494+0000 7eff52a00640 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 0x55b71d7de140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff52a00640 1 -- 172.21.15.59:0/2939787415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b71d620600 con 0x55b71d74ff30 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff52a00640 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d74ff30 0x55b71d7a6570 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7eff440efac0 tx=0x7eff4411f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce28f0f28b35ccc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff3cc00640 1 -- 172.21.15.59:0/2939787415 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff440f0e60 con 0x55b71d74ff30 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff3cc00640 1 -- 172.21.15.59:0/2939787415 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7eff4411f0b0 con 0x55b71d74ff30 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 -- 172.21.15.59:0/2939787415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff40046070 con 0x55b71d74ff30 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff3cc00640 1 -- 172.21.15.59:0/2939787415 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff440efb30 con 0x55b71d74ff30 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 10 client.5910 fetch_fsmap learned FSMap version 28 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 -- 172.21.15.59:0/2939787415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55b71d5339b0 con 0x55b71d74ff30 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff3cc00640 1 -- 172.21.15.59:0/2939787415 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff40046070 con 0x55b71d74ff30 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff3cc00640 1 -- 172.21.15.59:0/2939787415 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7eff440b4030 con 0x55b71d74ff30 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 10 client.5910 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:03:38.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 10 client.5910 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 20 client.5910 populate_metadata read hostname 'smithi059' 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55b71d753b80 0x55b71d7de680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 4 client.5910 mds_command: new command op to 5769 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 -- 172.21.15.59:0/2939787415 --> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b71d5ac2e0 con 0x55b71d753b80 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff52000640 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55b71d753b80 0x55b71d7de680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff52000640 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55b71d753b80 0x55b71d7de680 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eab192c035706e5f server_cookie=7f8647d51394cf45 in_seq=0 out_seq=0 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff3cc00640 10 client.5910 ms_handle_connect on v2:172.21.15.59:6833/2578168283 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff3cc00640 1 -- 172.21.15.59:0/2939787415 <== mds.0 v2:172.21.15.59:6833/2578168283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55b71d5ac2e0 con 0x55b71d753b80 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff3cc00640 10 client.5910 handle_command_reply: tid=0 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 client.5910 shutdown 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 -- 172.21.15.59:0/2939787415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d74ff30 msgr2=0x55b71d7a6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d74ff30 0x55b71d7a6570 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7eff440efac0 tx=0x7eff4411f040 comp rx=0 tx=0).stop 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 -- 172.21.15.59:0/2939787415 shutdown_connections 2024-04-25T09:03:38.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55b71d753b80 0x55b71d7de680 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b71d79a240 0x55b71d7de140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b71d799920 0x55b71d7ddc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff3cc00640 0 client.5910 ms_handle_reset on v2:172.21.15.59:6833/2578168283 2024-04-25T09:03:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 --2- 172.21.15.59:0/2939787415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b71d74ff30 0x55b71d7a6570 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 -- 172.21.15.59:0/2939787415 >> 172.21.15.59:0/2939787415 conn(0x55b71d7562a0 msgr2=0x55b71d7a16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 -- 172.21.15.59:0/2939787415 shutdown_connections 2024-04-25T09:03:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 1 -- 172.21.15.59:0/2939787415 wait complete. 2024-04-25T09:03:38.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff5d323000 20 client.5910 trim_cache size 0 max 16384 2024-04-25T09:03:38.496 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:03:38.496 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:03:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:03:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 5769, 2024-04-25T09:03:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:03:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:03:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:03:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 5.9311954169999996, 2024-04-25T09:03:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 28, 2024-04-25T09:03:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 52, 2024-04-25T09:03:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 52, 2024-04-25T09:03:38.497 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 10.803742265 2024-04-25T09:03:38.497 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:03:38.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff59e00640 1 -- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7eff34066f60 msgr2=0x7eff34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff59e00640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7eff34066f60 0x7eff34069420 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7eff40009580 tx=0x7eff40008040 comp rx=0 tx=0).stop 2024-04-25T09:03:38.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff59e00640 1 -- 172.21.15.59:0/4093844165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff5406bf30 msgr2=0x7eff54153fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff59e00640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff5406bf30 0x7eff54153fe0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7eff4401a010 tx=0x7eff4401ac20 comp rx=0 tx=0).stop 2024-04-25T09:03:38.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff59e00640 1 -- 172.21.15.59:0/4093844165 shutdown_connections 2024-04-25T09:03:38.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff59e00640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7eff34066f60 0x7eff34069420 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff59e00640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7eff5415dc60 0x7eff541590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff59e00640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7eff54099a60 0x7eff54158b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff59e00640 1 --2- 172.21.15.59:0/4093844165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff5406bf30 0x7eff54153fe0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff59e00640 1 -- 172.21.15.59:0/4093844165 >> 172.21.15.59:0/4093844165 conn(0x7eff540b3200 msgr2=0x7eff5415a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff59e00640 1 -- 172.21.15.59:0/4093844165 shutdown_connections 2024-04-25T09:03:38.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.498+0000 7eff59e00640 1 -- 172.21.15.59:0/4093844165 wait complete. 2024-04-25T09:03:38.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa2a1000640 1 Processor -- start 2024-04-25T09:03:38.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa2a1000640 1 -- start start 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa2a1000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa29c15b5d0 0x7fa29c0cfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa2a1000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa29c0b2450 0x7fa29c0b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa2a1000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa29c0b13b0 con 0x7fa29c0d0010 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa2a1000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c0b2e20 con 0x7fa29c0b2450 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa2a1000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0b1690 con 0x7fa29c15b5d0 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa29aa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa29c0d0010 0x7fa29c0cbed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46006/0 (socket says 172.21.15.59:46006) 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa29aa00640 1 -- 172.21.15.59:0/4126692725 learned_addr learned my addr 172.21.15.59:0/4126692725 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa29be00640 1 --2- 172.21.15.59:0/4126692725 >> v2:172.21.15.178:3300/0 conn(0x7fa29c0b2450 0x7fa29c0b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa29b400640 1 --2- 172.21.15.59:0/4126692725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa29c15b5d0 0x7fa29c0cfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa29a000640 1 -- 172.21.15.59:0/4126692725 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049961321 0 0) 0x7fa29c0b13b0 con 0x7fa29c0d0010 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa29a000640 1 -- 172.21.15.59:0/4126692725 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa280003530 con 0x7fa29c0d0010 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa29b400640 1 -- 172.21.15.59:0/4126692725 >> v2:172.21.15.178:3300/0 conn(0x7fa29c0b2450 msgr2=0x7fa29c0b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa29b400640 1 --2- 172.21.15.59:0/4126692725 >> v2:172.21.15.178:3300/0 conn(0x7fa29c0b2450 0x7fa29c0b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa29b400640 1 -- 172.21.15.59:0/4126692725 >> v1:172.21.15.59:6789/0 conn(0x7fa29c0d0010 legacy=0x7fa29c0cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa29b400640 1 -- 172.21.15.59:0/4126692725 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0b1970 con 0x7fa29c15b5d0 2024-04-25T09:03:38.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.662+0000 7fa29be00640 1 --2- 172.21.15.59:0/4126692725 >> v2:172.21.15.178:3300/0 conn(0x7fa29c0b2450 0x7fa29c0b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa29b400640 1 --2- 172.21.15.59:0/4126692725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa29c15b5d0 0x7fa29c0cfad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0097c0 tx=0x7fa28c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32911afc5ec1b9a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa29a000640 1 -- 172.21.15.59:0/4126692725 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0a7070 con 0x7fa29c15b5d0 2024-04-25T09:03:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa29a000640 1 -- 172.21.15.59:0/4126692725 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c0b0070 con 0x7fa29c15b5d0 2024-04-25T09:03:38.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa29a000640 1 -- 172.21.15.59:0/4126692725 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0ab890 con 0x7fa29c15b5d0 2024-04-25T09:03:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa2a1000640 1 -- 172.21.15.59:0/4126692725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa29c15b5d0 msgr2=0x7fa29c0cfad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa2a1000640 1 --2- 172.21.15.59:0/4126692725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa29c15b5d0 0x7fa29c0cfad0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa28c0097c0 tx=0x7fa28c01c470 comp rx=0 tx=0).stop 2024-04-25T09:03:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa2a1000640 1 -- 172.21.15.59:0/4126692725 shutdown_connections 2024-04-25T09:03:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa2a1000640 1 --2- 172.21.15.59:0/4126692725 >> v2:172.21.15.178:3300/0 conn(0x7fa29c0b2450 0x7fa29c0b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa2a1000640 1 --2- 172.21.15.59:0/4126692725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa29c15b5d0 0x7fa29c0cfad0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa2a1000640 1 -- 172.21.15.59:0/4126692725 >> 172.21.15.59:0/4126692725 conn(0x7fa29c0d14f0 msgr2=0x7fa29c0d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa2a1000640 1 -- 172.21.15.59:0/4126692725 shutdown_connections 2024-04-25T09:03:38.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa2a1000640 1 -- 172.21.15.59:0/4126692725 wait complete. 2024-04-25T09:03:38.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.666+0000 7fa2a1000640 1 Processor -- start 2024-04-25T09:03:38.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa2a1000640 1 -- start start 2024-04-25T09:03:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa2a1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29c0b2450 0x7fa29c15dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa2a1000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa29c0d0010 0x7fa29c0c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa2a1000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa29c15b5d0 0x7fa29c0c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa2a1000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0cc760 con 0x7fa29c0b2450 2024-04-25T09:03:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa2a1000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c0cc5e0 con 0x7fa29c15b5d0 2024-04-25T09:03:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa2a1000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c15b9b0 con 0x7fa29c0d0010 2024-04-25T09:03:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa29b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29c0b2450 0x7fa29c15dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa29b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29c0b2450 0x7fa29c15dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47898/0 (socket says 172.21.15.59:47898) 2024-04-25T09:03:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa29b400640 1 -- 172.21.15.59:0/109743638 learned_addr learned my addr 172.21.15.59:0/109743638 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa29aa00640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa29c0d0010 0x7fa29c0c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa29be00640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa29c15b5d0 0x7fa29c0c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa29b400640 1 -- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa29c0d0010 msgr2=0x7fa29c0c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa29b400640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa29c0d0010 0x7fa29c0c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa29b400640 1 -- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa29c15b5d0 msgr2=0x7fa29c0c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa29b400640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa29c15b5d0 0x7fa29c0c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa29b400640 1 -- 172.21.15.59:0/109743638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c0d23f0 con 0x7fa29c0b2450 2024-04-25T09:03:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa29b400640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29c0b2450 0x7fa29c15dd30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa28c01ab20 tx=0x7fa28c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa293400640 1 -- 172.21.15.59:0/109743638 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0abbf0 con 0x7fa29c0b2450 2024-04-25T09:03:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa293400640 1 -- 172.21.15.59:0/109743638 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c0abdb0 con 0x7fa29c0b2450 2024-04-25T09:03:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa2a1000640 1 -- 172.21.15.59:0/109743638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c15cc90 con 0x7fa29c0b2450 2024-04-25T09:03:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa293400640 1 -- 172.21.15.59:0/109743638 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c0bf690 con 0x7fa29c0b2450 2024-04-25T09:03:38.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa2a1000640 1 -- 172.21.15.59:0/109743638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c15d250 con 0x7fa29c0b2450 2024-04-25T09:03:38.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.670+0000 7fa2a1000640 1 -- 172.21.15.59:0/109743638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c04efa0 con 0x7fa29c0b2450 2024-04-25T09:03:38.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.674+0000 7fa293400640 1 -- 172.21.15.59:0/109743638 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa28c0bf830 con 0x7fa29c0b2450 2024-04-25T09:03:38.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.674+0000 7fa293400640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa27c066f60 0x7fa27c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:38.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.674+0000 7fa293400640 1 -- 172.21.15.59:0/109743638 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa28c11f9f0 con 0x7fa29c0b2450 2024-04-25T09:03:38.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.674+0000 7fa29aa00640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa27c066f60 0x7fa27c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:38.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.674+0000 7fa29aa00640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa27c066f60 0x7fa27c069420 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0cf030 tx=0x7fa288009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:38.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.678+0000 7fa293400640 1 -- 172.21.15.59:0/109743638 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa28c016090 con 0x7fa29c0b2450 2024-04-25T09:03:38.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.878+0000 7fa2a1000640 1 -- 172.21.15.59:0/109743638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa29c0c4a90 con 0x7fa29c0b2450 2024-04-25T09:03:38.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.878+0000 7fa293400640 1 -- 172.21.15.59:0/109743638 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa28c0f0860 con 0x7fa29c0b2450 2024-04-25T09:03:38.871 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:03:38.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.882+0000 7fa2a1000640 1 -- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa27c066f60 msgr2=0x7fa27c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.882+0000 7fa2a1000640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa27c066f60 0x7fa27c069420 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0cf030 tx=0x7fa288009040 comp rx=0 tx=0).stop 2024-04-25T09:03:38.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.882+0000 7fa2a1000640 1 -- 172.21.15.59:0/109743638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29c0b2450 msgr2=0x7fa29c15dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:38.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.882+0000 7fa2a1000640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29c0b2450 0x7fa29c15dd30 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa28c01ab20 tx=0x7fa28c019210 comp rx=0 tx=0).stop 2024-04-25T09:03:38.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.882+0000 7fa2a1000640 1 -- 172.21.15.59:0/109743638 shutdown_connections 2024-04-25T09:03:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.882+0000 7fa2a1000640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa27c066f60 0x7fa27c069420 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.882+0000 7fa2a1000640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa29c15b5d0 0x7fa29c0c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.882+0000 7fa2a1000640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa29c0d0010 0x7fa29c0c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.882+0000 7fa2a1000640 1 --2- 172.21.15.59:0/109743638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa29c0b2450 0x7fa29c15dd30 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.882+0000 7fa2a1000640 1 -- 172.21.15.59:0/109743638 >> 172.21.15.59:0/109743638 conn(0x7fa29c0d14f0 msgr2=0x7fa29c070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.882+0000 7fa2a1000640 1 -- 172.21.15.59:0/109743638 shutdown_connections 2024-04-25T09:03:38.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:38.882+0000 7fa2a1000640 1 -- 172.21.15.59:0/109743638 wait complete. 2024-04-25T09:03:38.892 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:03:38.892 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:03:38.892 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:03:38.892 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:03:38.892 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:38.892 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:03:38.892 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:03:38.892 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:03:38.893 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:38.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:38.893 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:03:38.902 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:03:38.902 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:03:38.902 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:03:38.902 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:38.902 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:03:38.902 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42349sec preferred_lft 42349sec 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:03:38.903 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:03:38.904 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:03:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:03:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:38.904 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:03:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:03:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:03:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:03:38.904 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:38.904 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:03:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:03:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:38.905 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:03:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:03:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:03:38.905 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:03:38.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:38.906 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:03:38.966 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:03:38.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:38.968 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:03:39.025 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:03:39.026 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:03:39.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.029 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:03:39.029 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:03:39.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:03:39.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:03:39.029 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:03:39.029 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:03:39.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.119 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:03:39.128 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:03:39.128 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:03:39.128 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:39.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.128 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:03:39.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:39.196 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:39.252 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:03:39.252 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:03:39.252 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:39.304 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:03:39.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.304 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:39.397 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:39.397 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:39.397 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:03:39.412 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:39.412 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:39.412 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:03:39.412 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:03:39.412 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:39.423 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:03:39.424 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:03:39.424 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:03:39.424 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:03:39.424 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:03:39.424 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:03:39.424 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:03:39.424 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:03:39.427 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:03:39.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.428 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:03:39.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.448 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:03:39.507 INFO:teuthology.orchestra.run.smithi059.stdout:client5351 2024-04-25T09:03:39.508 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:03:39.508 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:03:39.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.560 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-04-25T09:03:39.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:39.619 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-04-25T09:03:39.675 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:03:39.675 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:03:39.675 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:03:39.675 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:03:39.675 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-04-25T09:03:39.675 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:03:39.781 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627777 2024-04-25T09:03:39.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:03:39.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:03:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0816e00640 1 Processor -- start 2024-04-25T09:03:39.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0816e00640 1 -- start start 2024-04-25T09:03:39.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0816e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f08100cf2b0 0x7f08100cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0816e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f08100b2760 0x7f08100cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0816e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100ada40 con 0x7f081015b8d0 2024-04-25T09:03:39.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0816e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08100ccea0 con 0x7f08100cf2b0 2024-04-25T09:03:39.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0816e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081006afb0 con 0x7f08100b2760 2024-04-25T09:03:39.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0815000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f08100cf2b0 0x7f08100cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0815000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f08100cf2b0 0x7f08100cf8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47908/0 (socket says 172.21.15.59:47908) 2024-04-25T09:03:39.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0815000640 1 -- 172.21.15.59:0/1141302040 learned_addr learned my addr 172.21.15.59:0/1141302040 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:39.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0816400640 1 --2- 172.21.15.59:0/1141302040 >> v2:172.21.15.178:3300/0 conn(0x7f08100b2760 0x7f08100cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0815000640 1 -- 172.21.15.59:0/1141302040 >> v2:172.21.15.178:3300/0 conn(0x7f08100b2760 msgr2=0x7f08100cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:39.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0815000640 1 --2- 172.21.15.59:0/1141302040 >> v2:172.21.15.178:3300/0 conn(0x7f08100b2760 0x7f08100cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0815000640 1 -- 172.21.15.59:0/1141302040 >> v1:172.21.15.178:6789/0 conn(0x7f081015b8d0 legacy=0x7f08100ad330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.986+0000 7f0815000640 1 -- 172.21.15.59:0/1141302040 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081006b290 con 0x7f08100cf2b0 2024-04-25T09:03:39.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f0815000640 1 --2- 172.21.15.59:0/1141302040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100cf2b0 0x7f08100cf8b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f08100c7520 tx=0x7f07fc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc538748ce629688 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f080fe00640 1 -- 172.21.15.59:0/1141302040 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc0b0070 con 0x7f08100cf2b0 2024-04-25T09:03:39.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f080fe00640 1 -- 172.21.15.59:0/1141302040 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc0ab600 con 0x7f08100cf2b0 2024-04-25T09:03:39.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f080fe00640 1 -- 172.21.15.59:0/1141302040 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc0ab9d0 con 0x7f08100cf2b0 2024-04-25T09:03:39.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f0816e00640 1 -- 172.21.15.59:0/1141302040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100cf2b0 msgr2=0x7f08100cf8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f0816e00640 1 --2- 172.21.15.59:0/1141302040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100cf2b0 0x7f08100cf8b0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f08100c7520 tx=0x7f07fc01c520 comp rx=0 tx=0).stop 2024-04-25T09:03:39.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f0816e00640 1 -- 172.21.15.59:0/1141302040 shutdown_connections 2024-04-25T09:03:39.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f0816e00640 1 --2- 172.21.15.59:0/1141302040 >> v2:172.21.15.178:3300/0 conn(0x7f08100b2760 0x7f08100cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f0816e00640 1 --2- 172.21.15.59:0/1141302040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100cf2b0 0x7f08100cf8b0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f0816e00640 1 -- 172.21.15.59:0/1141302040 >> 172.21.15.59:0/1141302040 conn(0x7f0810099a60 msgr2=0x7f08100b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:39.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f0816e00640 1 -- 172.21.15.59:0/1141302040 shutdown_connections 2024-04-25T09:03:39.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f0816e00640 1 -- 172.21.15.59:0/1141302040 wait complete. 2024-04-25T09:03:39.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.990+0000 7f0816e00640 1 Processor -- start 2024-04-25T09:03:39.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0816e00640 1 -- start start 2024-04-25T09:03:39.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0816e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08100b2760 0x7f081014c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0816e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100cf2b0 0x7f08100b1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0816e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f081015b8d0 0x7f08100c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0816e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0810168340 con 0x7f08100cf2b0 2024-04-25T09:03:39.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0816e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08100cdd30 con 0x7f08100b2760 2024-04-25T09:03:39.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0816e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08101684c0 con 0x7f081015b8d0 2024-04-25T09:03:39.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0815000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100cf2b0 0x7f08100b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0815000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100cf2b0 0x7f08100b1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47912/0 (socket says 172.21.15.59:47912) 2024-04-25T09:03:39.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0815000640 1 -- 172.21.15.59:0/2314072965 learned_addr learned my addr 172.21.15.59:0/2314072965 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:39.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0815a00640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08100b2760 0x7f081014c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0816400640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f081015b8d0 0x7f08100c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0815000640 1 -- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f081015b8d0 msgr2=0x7f08100c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0815000640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f081015b8d0 0x7f08100c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0815000640 1 -- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08100b2760 msgr2=0x7f081014c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:39.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0815000640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08100b2760 0x7f081014c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:39.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0815000640 1 -- 172.21.15.59:0/2314072965 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08100c8560 con 0x7f08100cf2b0 2024-04-25T09:03:39.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0815000640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100cf2b0 0x7f08100b1050 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f07fc01ca00 tx=0x7f07fc0192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f080d600640 1 -- 172.21.15.59:0/2314072965 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc0b8020 con 0x7f08100cf2b0 2024-04-25T09:03:39.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f080d600640 1 -- 172.21.15.59:0/2314072965 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc0b4630 con 0x7f08100cf2b0 2024-04-25T09:03:39.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0816e00640 1 -- 172.21.15.59:0/2314072965 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08100c8840 con 0x7f08100cf2b0 2024-04-25T09:03:39.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f080d600640 1 -- 172.21.15.59:0/2314072965 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc0b0040 con 0x7f08100cf2b0 2024-04-25T09:03:39.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0816e00640 1 -- 172.21.15.59:0/2314072965 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08100c8e00 con 0x7f08100cf2b0 2024-04-25T09:03:39.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.994+0000 7f0816e00640 1 -- 172.21.15.59:0/2314072965 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081004efa0 con 0x7f08100cf2b0 2024-04-25T09:03:39.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.998+0000 7f080d600640 1 -- 172.21.15.59:0/2314072965 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f07fc0bb020 con 0x7f08100cf2b0 2024-04-25T09:03:39.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.998+0000 7f080d600640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f07f0066f90 0x7f07f0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:39.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.998+0000 7f080d600640 1 -- 172.21.15.59:0/2314072965 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f07fc11ed20 con 0x7f08100cf2b0 2024-04-25T09:03:39.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.998+0000 7f0815a00640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f07f0066f90 0x7f07f0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:39.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:39.998+0000 7f0815a00640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f07f0066f90 0x7f07f0069450 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f08100b0080 tx=0x7f0804009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:39.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.002+0000 7f080d600640 1 -- 172.21.15.59:0/2314072965 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f07fc0c2030 con 0x7f08100cf2b0 2024-04-25T09:03:40.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.198+0000 7f0816e00640 1 -- 172.21.15.59:0/2314072965 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0810156610 con 0x7f08100cf2b0 2024-04-25T09:03:40.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.198+0000 7f080d600640 1 -- 172.21.15.59:0/2314072965 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f07fc016110 con 0x7f08100cf2b0 2024-04-25T09:03:40.191 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:40.191 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2757859141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2757859141},{"type":"v1","addr":"172.21.15.178:6836","nonce":2757859141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5626,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/447455100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":447455100},{"type":"v1","addr":"172.21.15.178:6837","nonce":447455100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4008580166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4008580166},{"type":"v1","addr":"172.21.15.59:6834","nonce":4008580166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:31.959775+0000","modified":"2024-04-25T09:03:34.974887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2578168283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2578168283},{"type":"v1","addr":"172.21.15.59:6835","nonce":2578168283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:03:40.191 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-04-25T09:03:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.202+0000 7f0816e00640 1 -- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f07f0066f90 msgr2=0x7f07f0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.202+0000 7f0816e00640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f07f0066f90 0x7f07f0069450 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f08100b0080 tx=0x7f0804009040 comp rx=0 tx=0).stop 2024-04-25T09:03:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.202+0000 7f0816e00640 1 -- 172.21.15.59:0/2314072965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100cf2b0 msgr2=0x7f08100b1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.202+0000 7f0816e00640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100cf2b0 0x7f08100b1050 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f07fc01ca00 tx=0x7f07fc0192c0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.202+0000 7f0816e00640 1 -- 172.21.15.59:0/2314072965 shutdown_connections 2024-04-25T09:03:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.202+0000 7f0816e00640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f07f0066f90 0x7f07f0069450 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.202+0000 7f0816e00640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f081015b8d0 0x7f08100c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.202+0000 7f0816e00640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08100cf2b0 0x7f08100b1050 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.202+0000 7f0816e00640 1 --2- 172.21.15.59:0/2314072965 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f08100b2760 0x7f081014c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.202+0000 7f0816e00640 1 -- 172.21.15.59:0/2314072965 >> 172.21.15.59:0/2314072965 conn(0x7f0810099a60 msgr2=0x7f08100af360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.202+0000 7f0816e00640 1 -- 172.21.15.59:0/2314072965 shutdown_connections 2024-04-25T09:03:40.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.202+0000 7f0816e00640 1 -- 172.21.15.59:0/2314072965 wait complete. 2024-04-25T09:03:40.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:03:40.382 INFO:teuthology.orchestra.run.smithi059.stdout:{"message":"","return_code":0} 2024-04-25T09:03:40.383 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:03:40.383 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T09:03:40.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 Processor -- start 2024-04-25T09:03:40.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 -- start start 2024-04-25T09:03:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56451bb52410 0x56451bbe08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56451bb54440 0x56451bbdbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bbde250 0x56451bbd9d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56451bbdf050 con 0x56451bbde250 2024-04-25T09:03:40.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56451baaf9f0 con 0x56451bb52410 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56451bbdf1d0 con 0x56451bb54440 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bbde250 0x56451bbd9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc249800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56451bb52410 0x56451bbe08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bbde250 0x56451bbd9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51958/0 (socket says 172.21.15.59:51958) 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24a200640 1 -- 172.21.15.59:0/1509952770 learned_addr learned my addr 172.21.15.59:0/1509952770 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc243e00640 1 --2- 172.21.15.59:0/1509952770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56451bb54440 0x56451bbdbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24a200640 1 -- 172.21.15.59:0/1509952770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56451bb54440 msgr2=0x56451bbdbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24a200640 1 --2- 172.21.15.59:0/1509952770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56451bb54440 0x56451bbdbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24a200640 1 -- 172.21.15.59:0/1509952770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56451bb52410 msgr2=0x56451bbe08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24a200640 1 --2- 172.21.15.59:0/1509952770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56451bb52410 0x56451bbe08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24a200640 1 -- 172.21.15.59:0/1509952770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56451bbddb70 con 0x56451bbde250 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc243e00640 1 --2- 172.21.15.59:0/1509952770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56451bb54440 0x56451bbdbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24a200640 1 --2- 172.21.15.59:0/1509952770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bbde250 0x56451bbd9d90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc24400a560 tx=0x7fc2440033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114d28487beb11db server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc243400640 1 -- 172.21.15.59:0/1509952770 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2440b9070 con 0x56451bbde250 2024-04-25T09:03:40.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc243400640 1 -- 172.21.15.59:0/1509952770 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2440ab410 con 0x56451bbde250 2024-04-25T09:03:40.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc243400640 1 -- 172.21.15.59:0/1509952770 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2440ab7c0 con 0x56451bbde250 2024-04-25T09:03:40.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 -- 172.21.15.59:0/1509952770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bbde250 msgr2=0x56451bbd9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 --2- 172.21.15.59:0/1509952770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bbde250 0x56451bbd9d90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fc24400a560 tx=0x7fc2440033b0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 -- 172.21.15.59:0/1509952770 shutdown_connections 2024-04-25T09:03:40.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 --2- 172.21.15.59:0/1509952770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bbde250 0x56451bbd9d90 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 --2- 172.21.15.59:0/1509952770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56451bb54440 0x56451bbdbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 --2- 172.21.15.59:0/1509952770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56451bb52410 0x56451bbe08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 -- 172.21.15.59:0/1509952770 >> 172.21.15.59:0/1509952770 conn(0x56451bb34da0 msgr2=0x56451bb38bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 -- 172.21.15.59:0/1509952770 shutdown_connections 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.438+0000 7fc24c570080 1 -- 172.21.15.59:0/1509952770 wait complete. 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc24c570080 1 Processor -- start 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc24c570080 1 -- start start 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc24c570080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bb52410 0x56451bc71ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc24c570080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56451bb54440 0x56451bbd9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc24c570080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56451bbde250 0x56451bbda120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc24c570080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56451bbe0180 con 0x56451bb52410 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc24c570080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56451bbe0420 con 0x56451bb54440 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc24c570080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56451bbe0e00 con 0x56451bbde250 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc249800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bb52410 0x56451bc71ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc249800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bb52410 0x56451bc71ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51966/0 (socket says 172.21.15.59:51966) 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc249800640 1 -- 172.21.15.59:0/206596687 learned_addr learned my addr 172.21.15.59:0/206596687 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc243e00640 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56451bb54440 0x56451bbd9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc24a200640 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56451bbde250 0x56451bbda120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc249800640 1 -- 172.21.15.59:0/206596687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56451bbde250 msgr2=0x56451bbda120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc249800640 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56451bbde250 0x56451bbda120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc249800640 1 -- 172.21.15.59:0/206596687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56451bb54440 msgr2=0x56451bbd9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc249800640 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56451bb54440 0x56451bbd9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc249800640 1 -- 172.21.15.59:0/206596687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56451bbd66b0 con 0x56451bb52410 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc249800640 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bb52410 0x56451bc71ff0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc23c002f90 tx=0x7fc23c00c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc242000640 1 -- 172.21.15.59:0/206596687 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c015020 con 0x56451bb52410 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc242000640 1 -- 172.21.15.59:0/206596687 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c011660 con 0x56451bb52410 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc24c570080 1 -- 172.21.15.59:0/206596687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56451bbd6950 con 0x56451bb52410 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc242000640 1 -- 172.21.15.59:0/206596687 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00a040 con 0x56451bb52410 2024-04-25T09:03:40.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.442+0000 7fc24c570080 1 -- 172.21.15.59:0/206596687 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56451bbd6e90 con 0x56451bb52410 2024-04-25T09:03:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc242000640 1 -- 172.21.15.59:0/206596687 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc23c018020 con 0x56451bb52410 2024-04-25T09:03:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc242000640 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc228065970 0x7fc228067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc242000640 1 -- 172.21.15.59:0/206596687 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc23c084030 con 0x56451bb52410 2024-04-25T09:03:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24c570080 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56451bc72530 0x56451bbd7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc243e00640 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc228065970 0x7fc228067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24c570080 1 -- 172.21.15.59:0/206596687 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e52) v9 -- 0x56451bbd7870 con 0x56451bc72530 2024-04-25T09:03:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24a200640 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56451bc72530 0x56451bbd7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24a200640 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56451bc72530 0x56451bbd7330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc243e00640 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc228065970 0x7fc228067e30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc234009690 tx=0x7fc234005c40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24a200640 1 -- 172.21.15.59:0/206596687 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7fc2440bc070 con 0x56451bc72530 2024-04-25T09:03:40.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24c570080 1 -- 172.21.15.59:0/206596687 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56451bc72530 msgr2=0x56451bbd7330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24c570080 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56451bc72530 0x56451bbd7330 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24c570080 1 -- 172.21.15.59:0/206596687 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc228065970 msgr2=0x7fc228067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24c570080 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc228065970 0x7fc228067e30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc234009690 tx=0x7fc234005c40 comp rx=0 tx=0).stop 2024-04-25T09:03:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24c570080 1 -- 172.21.15.59:0/206596687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bb52410 msgr2=0x56451bc71ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24c570080 1 --2- 172.21.15.59:0/206596687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56451bb52410 0x56451bc71ff0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fc23c002f90 tx=0x7fc23c00c630 comp rx=0 tx=0).stop 2024-04-25T09:03:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24a200640 1 -- 172.21.15.59:0/206596687 reap_dead start 2024-04-25T09:03:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24c570080 1 -- 172.21.15.59:0/206596687 shutdown_connections 2024-04-25T09:03:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24c570080 1 -- 172.21.15.59:0/206596687 >> 172.21.15.59:0/206596687 conn(0x56451bb34da0 msgr2=0x56451bbdf6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24c570080 1 -- 172.21.15.59:0/206596687 shutdown_connections 2024-04-25T09:03:40.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.446+0000 7fc24c570080 1 -- 172.21.15.59:0/206596687 wait complete. 2024-04-25T09:03:40.445 INFO:teuthology.orchestra.run.smithi059.stdout:Yalphaparent_a 2024-04-25T09:03:40.445 DEBUG:teuthology.orchestra.run.smithi059:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T09:03:40.501 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:03:40.501 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 1099511627777, 2024-04-25T09:03:40.501 INFO:teuthology.orchestra.run.smithi059.stdout: "ancestors": [ 2024-04-25T09:03:40.501 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:40.502 INFO:teuthology.orchestra.run.smithi059.stdout: "dirino": 1099511627776, 2024-04-25T09:03:40.502 INFO:teuthology.orchestra.run.smithi059.stdout: "dname": "alpha", 2024-04-25T09:03:40.502 INFO:teuthology.orchestra.run.smithi059.stdout: "version": 2 2024-04-25T09:03:40.502 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:03:40.502 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:03:40.502 INFO:teuthology.orchestra.run.smithi059.stdout: "dirino": 1, 2024-04-25T09:03:40.503 INFO:teuthology.orchestra.run.smithi059.stdout: "dname": "parent_a", 2024-04-25T09:03:40.503 INFO:teuthology.orchestra.run.smithi059.stdout: "version": 4 2024-04-25T09:03:40.503 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:40.503 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-04-25T09:03:40.503 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 8, 2024-04-25T09:03:40.503 INFO:teuthology.orchestra.run.smithi059.stdout: "old_pools": [] 2024-04-25T09:03:40.504 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:03:40.504 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:40.506 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-04-25T09:03:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 Processor -- start 2024-04-25T09:03:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 -- start start 2024-04-25T09:03:40.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b45763d50 0x555b457615e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555b4577b880 0x555b45761b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b45807570 0x555b457eb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b45808370 con 0x555b45763d50 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b456d69f0 con 0x555b45807570 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b458084f0 con 0x555b4577b880 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb053000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b45763d50 0x555b457615e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb052600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555b4577b880 0x555b45761b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb053000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b45763d50 0x555b457615e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51982/0 (socket says 172.21.15.59:51982) 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb053000640 1 -- 172.21.15.59:0/3074652455 learned_addr learned my addr 172.21.15.59:0/3074652455 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb053a00640 1 --2- 172.21.15.59:0/3074652455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b45807570 0x555b457eb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb053000640 1 -- 172.21.15.59:0/3074652455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555b4577b880 msgr2=0x555b45761b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb053000640 1 --2- 172.21.15.59:0/3074652455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555b4577b880 0x555b45761b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb053000640 1 -- 172.21.15.59:0/3074652455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b45807570 msgr2=0x555b457eb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb053000640 1 --2- 172.21.15.59:0/3074652455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b45807570 0x555b457eb400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb053000640 1 -- 172.21.15.59:0/3074652455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b45773b90 con 0x555b45763d50 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb053000640 1 --2- 172.21.15.59:0/3074652455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b45763d50 0x555b457615e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb044006f00 tx=0x7fb04400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbd311814d453f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb051200640 1 -- 172.21.15.59:0/3074652455 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044012070 con 0x555b45763d50 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb051200640 1 -- 172.21.15.59:0/3074652455 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04400e690 con 0x555b45763d50 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb051200640 1 -- 172.21.15.59:0/3074652455 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04400ea80 con 0x555b45763d50 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 -- 172.21.15.59:0/3074652455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b45763d50 msgr2=0x555b457615e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 --2- 172.21.15.59:0/3074652455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b45763d50 0x555b457615e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb044006f00 tx=0x7fb04400b6d0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 -- 172.21.15.59:0/3074652455 shutdown_connections 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 --2- 172.21.15.59:0/3074652455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b45807570 0x555b457eb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 --2- 172.21.15.59:0/3074652455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555b4577b880 0x555b45761b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 --2- 172.21.15.59:0/3074652455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b45763d50 0x555b457615e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 -- 172.21.15.59:0/3074652455 >> 172.21.15.59:0/3074652455 conn(0x555b45730440 msgr2=0x555b45762830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 -- 172.21.15.59:0/3074652455 shutdown_connections 2024-04-25T09:03:40.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.610+0000 7fb055de8080 1 -- 172.21.15.59:0/3074652455 wait complete. 2024-04-25T09:03:40.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb055de8080 1 Processor -- start 2024-04-25T09:03:40.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb055de8080 1 -- start start 2024-04-25T09:03:40.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb055de8080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555b45763d50 0x555b45778dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb055de8080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b4577b880 0x555b45811a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb055de8080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b45807570 0x555b45776720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb055de8080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b45806160 con 0x555b4577b880 2024-04-25T09:03:40.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb055de8080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b45806400 con 0x555b45807570 2024-04-25T09:03:40.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb055de8080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x555b45805e60 con 0x555b45763d50 2024-04-25T09:03:40.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb052600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b4577b880 0x555b45811a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb052600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b4577b880 0x555b45811a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51988/0 (socket says 172.21.15.59:51988) 2024-04-25T09:03:40.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb052600640 1 -- 172.21.15.59:0/2833712892 learned_addr learned my addr 172.21.15.59:0/2833712892 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:40.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb053000640 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555b45763d50 0x555b45778dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb053a00640 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b45807570 0x555b45776720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb052600640 1 -- 172.21.15.59:0/2833712892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555b45763d50 msgr2=0x555b45778dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb052600640 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555b45763d50 0x555b45778dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb052600640 1 -- 172.21.15.59:0/2833712892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b45807570 msgr2=0x555b45776720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb052600640 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555b45807570 0x555b45776720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb052600640 1 -- 172.21.15.59:0/2833712892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b45776f60 con 0x555b4577b880 2024-04-25T09:03:40.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb052600640 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b4577b880 0x555b45811a30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb0400087f0 tx=0x7fb040008cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb04b400640 1 -- 172.21.15.59:0/2833712892 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040019070 con 0x555b4577b880 2024-04-25T09:03:40.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb04b400640 1 -- 172.21.15.59:0/2833712892 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb040010ba0 con 0x555b4577b880 2024-04-25T09:03:40.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb04b400640 1 -- 172.21.15.59:0/2833712892 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb040015450 con 0x555b4577b880 2024-04-25T09:03:40.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb055de8080 1 -- 172.21.15.59:0/2833712892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555b45777200 con 0x555b4577b880 2024-04-25T09:03:40.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.614+0000 7fb055de8080 1 -- 172.21.15.59:0/2833712892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b45776c60 con 0x555b4577b880 2024-04-25T09:03:40.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.618+0000 7fb04b400640 1 -- 172.21.15.59:0/2833712892 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb04001c070 con 0x555b4577b880 2024-04-25T09:03:40.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.618+0000 7fb04b400640 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb034065970 0x7fb034067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.618+0000 7fb04b400640 1 -- 172.21.15.59:0/2833712892 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb0400849b0 con 0x555b4577b880 2024-04-25T09:03:40.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.618+0000 7fb055de8080 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x555b458a19a0 0x555b458ac900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.618+0000 7fb053000640 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb034065970 0x7fb034067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.618+0000 7fb055de8080 1 -- 172.21.15.59:0/2833712892 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52) v9 -- 0x555b458ace40 con 0x555b458a19a0 2024-04-25T09:03:40.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.618+0000 7fb053a00640 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x555b458a19a0 0x555b458ac900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.618+0000 7fb053a00640 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x555b458a19a0 0x555b458ac900 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.618+0000 7fb053000640 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb034065970 0x7fb034067e30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb044006340 tx=0x7fb04400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.622+0000 7fb053a00640 1 -- 172.21.15.59:0/2833712892 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v52'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb04c0b2040 con 0x555b458a19a0 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.622+0000 7fb055de8080 1 -- 172.21.15.59:0/2833712892 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x555b458a19a0 msgr2=0x555b458ac900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.622+0000 7fb055de8080 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x555b458a19a0 0x555b458ac900 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.622+0000 7fb055de8080 1 -- 172.21.15.59:0/2833712892 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb034065970 msgr2=0x7fb034067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.622+0000 7fb055de8080 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb034065970 0x7fb034067e30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb044006340 tx=0x7fb04400f000 comp rx=0 tx=0).stop 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.622+0000 7fb055de8080 1 -- 172.21.15.59:0/2833712892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b4577b880 msgr2=0x555b45811a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.622+0000 7fb055de8080 1 --2- 172.21.15.59:0/2833712892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555b4577b880 0x555b45811a30 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fb0400087f0 tx=0x7fb040008cb0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.622+0000 7fb053a00640 1 -- 172.21.15.59:0/2833712892 reap_dead start 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.622+0000 7fb055de8080 1 -- 172.21.15.59:0/2833712892 shutdown_connections 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.622+0000 7fb055de8080 1 -- 172.21.15.59:0/2833712892 >> 172.21.15.59:0/2833712892 conn(0x555b45730440 msgr2=0x555b45773f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.622+0000 7fb055de8080 1 -- 172.21.15.59:0/2833712892 shutdown_connections 2024-04-25T09:03:40.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.622+0000 7fb055de8080 1 -- 172.21.15.59:0/2833712892 wait complete. 2024-04-25T09:03:40.618 DEBUG:teuthology.orchestra.run.smithi059:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T09:03:40.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:40.621 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-04-25T09:03:40.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.774+0000 7f58dfa00640 1 Processor -- start 2024-04-25T09:03:40.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.774+0000 7f58dfa00640 1 -- start start 2024-04-25T09:03:40.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.774+0000 7f58dfa00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f58d815dab0 0x7f58d80b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.774+0000 7f58dfa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d80b0c00 0x7f58d8070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.774+0000 7f58dfa00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d815de90 con 0x7f58d80711f0 2024-04-25T09:03:40.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.774+0000 7f58dfa00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d8071650 con 0x7f58d815dab0 2024-04-25T09:03:40.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.774+0000 7f58dfa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8071a70 con 0x7f58d80b0c00 2024-04-25T09:03:40.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.774+0000 7f58dda00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f58d80711f0 0x7f58d8161590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44008/0 (socket says 172.21.15.59:44008) 2024-04-25T09:03:40.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.774+0000 7f58dda00640 1 -- 172.21.15.59:0/1970316591 learned_addr learned my addr 172.21.15.59:0/1970316591 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58dd000640 1 --2- 172.21.15.59:0/1970316591 >> v2:172.21.15.178:3300/0 conn(0x7f58d815dab0 0x7f58d80b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58d7e00640 1 --2- 172.21.15.59:0/1970316591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d80b0c00 0x7f58d8070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58d7400640 1 -- 172.21.15.59:0/1970316591 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629204224 0 0) 0x7f58d815de90 con 0x7f58d80711f0 2024-04-25T09:03:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58d7400640 1 -- 172.21.15.59:0/1970316591 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58c0003530 con 0x7f58d80711f0 2024-04-25T09:03:40.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58d7400640 1 -- 172.21.15.59:0/1970316591 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3264067720 0 0) 0x7f58c0003530 con 0x7f58d80711f0 2024-04-25T09:03:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58dd000640 1 -- 172.21.15.59:0/1970316591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d80b0c00 msgr2=0x7f58d8070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58dd000640 1 --2- 172.21.15.59:0/1970316591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d80b0c00 0x7f58d8070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58dd000640 1 -- 172.21.15.59:0/1970316591 >> v1:172.21.15.59:6789/0 conn(0x7f58d80711f0 legacy=0x7f58d8161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58dd000640 1 -- 172.21.15.59:0/1970316591 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d80b57a0 con 0x7f58d815dab0 2024-04-25T09:03:40.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58dd000640 1 --2- 172.21.15.59:0/1970316591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d815dab0 0x7f58d80b5110 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0097c0 tx=0x7f58cc01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd6938f9989535bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58d7400640 1 -- 172.21.15.59:0/1970316591 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0b0070 con 0x7f58d815dab0 2024-04-25T09:03:40.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58d7400640 1 -- 172.21.15.59:0/1970316591 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc0ab400 con 0x7f58d815dab0 2024-04-25T09:03:40.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.778+0000 7f58d7400640 1 -- 172.21.15.59:0/1970316591 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0001a00 con 0x7f58d815dab0 2024-04-25T09:03:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 -- 172.21.15.59:0/1970316591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d815dab0 msgr2=0x7f58d80b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 --2- 172.21.15.59:0/1970316591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d815dab0 0x7f58d80b5110 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0097c0 tx=0x7f58cc01c390 comp rx=0 tx=0).stop 2024-04-25T09:03:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 -- 172.21.15.59:0/1970316591 shutdown_connections 2024-04-25T09:03:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 --2- 172.21.15.59:0/1970316591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d80b0c00 0x7f58d8070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 --2- 172.21.15.59:0/1970316591 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d815dab0 0x7f58d80b5110 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 -- 172.21.15.59:0/1970316591 >> 172.21.15.59:0/1970316591 conn(0x7f58d806f510 msgr2=0x7f58d806f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 -- 172.21.15.59:0/1970316591 shutdown_connections 2024-04-25T09:03:40.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 -- 172.21.15.59:0/1970316591 wait complete. 2024-04-25T09:03:40.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 Processor -- start 2024-04-25T09:03:40.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 -- start start 2024-04-25T09:03:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d80711f0 0x7f58d8150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d80b0c00 0x7f58d80ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d815dab0 0x7f58d80cd490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d816aab0 con 0x7f58d80711f0 2024-04-25T09:03:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d816a930 con 0x7f58d815dab0 2024-04-25T09:03:40.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dfa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d816ac30 con 0x7f58d80b0c00 2024-04-25T09:03:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dd000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d80711f0 0x7f58d8150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dd000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d80711f0 0x7f58d8150350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51990/0 (socket says 172.21.15.59:51990) 2024-04-25T09:03:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58dd000640 1 -- 172.21.15.59:0/1698118178 learned_addr learned my addr 172.21.15.59:0/1698118178 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.782+0000 7f58d7e00640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d80b0c00 0x7f58d80ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58dda00640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d815dab0 0x7f58d80cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58dd000640 1 -- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d80b0c00 msgr2=0x7f58d80ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58dd000640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d80b0c00 0x7f58d80ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58dd000640 1 -- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d815dab0 msgr2=0x7f58d80cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58dd000640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d815dab0 0x7f58d80cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58dd000640 1 -- 172.21.15.59:0/1698118178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d8150dd0 con 0x7f58d80711f0 2024-04-25T09:03:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58dda00640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d815dab0 0x7f58d80cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58dd000640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d80711f0 0x7f58d8150350 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0097c0 tx=0x7f58cc01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58d4c00640 1 -- 172.21.15.59:0/1698118178 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0b0050 con 0x7f58d80711f0 2024-04-25T09:03:40.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58d4c00640 1 -- 172.21.15.59:0/1698118178 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc0bc070 con 0x7f58d80711f0 2024-04-25T09:03:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58d4c00640 1 -- 172.21.15.59:0/1698118178 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0b78b0 con 0x7f58d80711f0 2024-04-25T09:03:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58dfa00640 1 -- 172.21.15.59:0/1698118178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d8150890 con 0x7f58d80711f0 2024-04-25T09:03:40.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58dfa00640 1 -- 172.21.15.59:0/1698118178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d8153480 con 0x7f58d80711f0 2024-04-25T09:03:40.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.786+0000 7f58d4c00640 1 -- 172.21.15.59:0/1698118178 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f58cc0b7a50 con 0x7f58d80711f0 2024-04-25T09:03:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58d4c00640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f58b8066f60 0x7f58b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58d4c00640 1 -- 172.21.15.59:0/1698118178 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f58cc11f820 con 0x7f58d80711f0 2024-04-25T09:03:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58d7e00640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f58b8066f60 0x7f58b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58e2f91000 1 Processor -- start 2024-04-25T09:03:40.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58e2f91000 1 -- start start 2024-04-25T09:03:40.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58d7e00640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f58b8066f60 0x7f58b8069420 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f58d8156340 tx=0x7f58c4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58e2f91000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e45c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58e2f91000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e45c65b0 0x5601e457bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58e2f91000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e457c290 0x5601e457c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58e2f91000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e4462f40 con 0x5601e457c290 2024-04-25T09:03:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58e2f91000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e43ca070 con 0x5601e45c65b0 2024-04-25T09:03:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58e2f91000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5601e43521a0 con 0x5601e45c5c90 2024-04-25T09:03:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e457c290 0x5601e457c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e457c290 0x5601e457c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52002/0 (socket says 172.21.15.59:52002) 2024-04-25T09:03:40.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58dda00640 1 -- 172.21.15.59:0/3200335813 learned_addr learned my addr 172.21.15.59:0/3200335813 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58d7e00640 1 --2- 172.21.15.59:0/3200335813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e45c65b0 0x5601e457bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58dd000640 1 --2- 172.21.15.59:0/3200335813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e45c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58dda00640 1 -- 172.21.15.59:0/3200335813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 msgr2=0x5601e45c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58dda00640 1 --2- 172.21.15.59:0/3200335813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e45c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58dda00640 1 -- 172.21.15.59:0/3200335813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e45c65b0 msgr2=0x5601e457bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58dda00640 1 --2- 172.21.15.59:0/3200335813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e45c65b0 0x5601e457bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58dda00640 1 -- 172.21.15.59:0/3200335813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601e4350510 con 0x5601e457c290 2024-04-25T09:03:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58dd000640 1 --2- 172.21.15.59:0/3200335813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e45c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58d7e00640 1 --2- 172.21.15.59:0/3200335813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e45c65b0 0x5601e457bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58dda00640 1 --2- 172.21.15.59:0/3200335813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e457c290 0x5601e457c670 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f58d000e160 tx=0x7f58d000e620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1288970740f0eee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58c9600640 1 -- 172.21.15.59:0/3200335813 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0019070 con 0x5601e457c290 2024-04-25T09:03:40.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58c9600640 1 -- 172.21.15.59:0/3200335813 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d000ee50 con 0x5601e457c290 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.790+0000 7f58c9600640 1 -- 172.21.15.59:0/3200335813 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d00074e0 con 0x5601e457c290 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 -- 172.21.15.59:0/3200335813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e457c290 msgr2=0x5601e457c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 --2- 172.21.15.59:0/3200335813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e457c290 0x5601e457c670 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f58d000e160 tx=0x7f58d000e620 comp rx=0 tx=0).stop 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 -- 172.21.15.59:0/3200335813 shutdown_connections 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 --2- 172.21.15.59:0/3200335813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e457c290 0x5601e457c670 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 --2- 172.21.15.59:0/3200335813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e45c65b0 0x5601e457bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 --2- 172.21.15.59:0/3200335813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e45c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 -- 172.21.15.59:0/3200335813 >> 172.21.15.59:0/3200335813 conn(0x5601e4578240 msgr2=0x5601e457a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 -- 172.21.15.59:0/3200335813 shutdown_connections 2024-04-25T09:03:40.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 -- 172.21.15.59:0/3200335813 wait complete. 2024-04-25T09:03:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 -- start start 2024-04-25T09:03:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 Processor -- start 2024-04-25T09:03:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e457c290 0x5601e4586e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e4587370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45878b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e43846c0 con 0x5601e45c65b0 2024-04-25T09:03:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e43c6110 con 0x5601e457c290 2024-04-25T09:03:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5601e43c9380 con 0x5601e45c5c90 2024-04-25T09:03:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 10 client.0 _ll_register_callbacks cb 0x5601e4567570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:40.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45878b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52014/0 (socket says 172.21.15.59:52014) 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58dda00640 1 -- 172.21.15.59:0/3442326020 learned_addr learned my addr 172.21.15.59:0/3442326020 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58dd000640 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e457c290 0x5601e4586e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58d7e00640 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e4587370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58dda00640 1 -- 172.21.15.59:0/3442326020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 msgr2=0x5601e4587370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58dda00640 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e4587370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58dda00640 1 -- 172.21.15.59:0/3442326020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e457c290 msgr2=0x5601e4586e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58dda00640 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e457c290 0x5601e4586e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58dda00640 1 -- 172.21.15.59:0/3442326020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601e43523b0 con 0x5601e45c65b0 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58dda00640 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45878b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f58d0005c10 tx=0x7f58d00018a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38836c6396a804a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58be000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58be000640 1 -- 172.21.15.59:0/3442326020 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0023020 con 0x5601e45c65b0 2024-04-25T09:03:40.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58be000640 1 -- 172.21.15.59:0/3442326020 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f58d0007920 con 0x5601e45c65b0 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.794+0000 7f58e2f91000 1 -- 172.21.15.59:0/3442326020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58d000ee50 con 0x5601e45c65b0 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58be000640 1 -- 172.21.15.59:0/3442326020 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58d002d050 con 0x5601e45c65b0 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 10 client.5952 fetch_fsmap learned FSMap version 28 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 -- 172.21.15.59:0/3442326020 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x5601e444be00 con 0x5601e45c65b0 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58be000640 1 -- 172.21.15.59:0/3442326020 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d000ee50 con 0x5601e45c65b0 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58be000640 1 -- 172.21.15.59:0/3442326020 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f58d0030020 con 0x5601e45c65b0 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 10 client.5952 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 10 client.5952 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 20 client.5952 populate_metadata read hostname 'smithi059' 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x5601e4588150 0x5601e45d7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 4 client.5952 mds_command: new command op to 5769 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 -- 172.21.15.59:0/3442326020 --> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5601e4365d60 con 0x5601e4588150 2024-04-25T09:03:40.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58dd000640 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x5601e4588150 0x5601e45d7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58dd000640 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x5601e4588150 0x5601e45d7410 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1c51a70ff84df53 server_cookie=f9de972921b5c0f0 in_seq=0 out_seq=0 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58be000640 10 client.5952 ms_handle_connect on v2:172.21.15.59:6833/2578168283 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58be000640 1 -- 172.21.15.59:0/3442326020 <== mds.0 v2:172.21.15.59:6833/2578168283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5601e4365d60 con 0x5601e4588150 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58be000640 10 client.5952 handle_command_reply: tid=0 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 client.5952 shutdown 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 -- 172.21.15.59:0/3442326020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 msgr2=0x5601e45878b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45878b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f58d0005c10 tx=0x7f58d00018a0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 -- 172.21.15.59:0/3442326020 shutdown_connections 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x5601e4588150 0x5601e45d7410 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45878b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e4587370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 --2- 172.21.15.59:0/3442326020 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e457c290 0x5601e4586e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58be000640 0 client.5952 ms_handle_reset on v2:172.21.15.59:6833/2578168283 2024-04-25T09:03:40.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 -- 172.21.15.59:0/3442326020 >> 172.21.15.59:0/3442326020 conn(0x5601e4578240 msgr2=0x5601e457aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 -- 172.21.15.59:0/3442326020 shutdown_connections 2024-04-25T09:03:40.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 1 -- 172.21.15.59:0/3442326020 wait complete. 2024-04-25T09:03:40.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f58e2f91000 20 client.5952 trim_cache size 0 max 16384 2024-04-25T09:03:40.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f9741c00640 1 Processor -- start 2024-04-25T09:03:40.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.798+0000 7f9741c00640 1 -- start start 2024-04-25T09:03:40.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f9741c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f973c0d11a0 0x7f973c0cfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f9741c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c0d0100 con 0x7f973c1617d0 2024-04-25T09:03:40.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f9741c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c0d03e0 con 0x7f973c15db80 2024-04-25T09:03:40.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f9741c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c06d190 con 0x7f973c0d11a0 2024-04-25T09:03:40.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f973b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f973c1617d0 0x7f973c0ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44010/0 (socket says 172.21.15.59:44010) 2024-04-25T09:03:40.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f973b400640 1 -- 172.21.15.59:0/3393429763 learned_addr learned my addr 172.21.15.59:0/3393429763 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:40.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f973a000640 1 --2- 172.21.15.59:0/3393429763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f973c0d11a0 0x7f973c0cfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f9739600640 1 -- 172.21.15.59:0/3393429763 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306781105 0 0) 0x7f973c0d0100 con 0x7f973c1617d0 2024-04-25T09:03:40.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f9739600640 1 -- 172.21.15.59:0/3393429763 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9720003530 con 0x7f973c1617d0 2024-04-25T09:03:40.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f9739600640 1 -- 172.21.15.59:0/3393429763 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3574306650 0 0) 0x7f973c0d03e0 con 0x7f973c15db80 2024-04-25T09:03:40.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f973a000640 1 -- 172.21.15.59:0/3393429763 >> v1:172.21.15.178:6789/0 conn(0x7f973c15db80 legacy=0x7f973c06ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f973a000640 1 -- 172.21.15.59:0/3393429763 >> v1:172.21.15.59:6789/0 conn(0x7f973c1617d0 legacy=0x7f973c0ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.802+0000 7f973a000640 1 -- 172.21.15.59:0/3393429763 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0d06c0 con 0x7f973c0d11a0 2024-04-25T09:03:40.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f973a000640 1 --2- 172.21.15.59:0/3393429763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f973c0d11a0 0x7f973c0cfaa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f97280097f0 tx=0x7f972801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68a1c73487b5263f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9739600640 1 -- 172.21.15.59:0/3393429763 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97280b0070 con 0x7f973c0d11a0 2024-04-25T09:03:40.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9739600640 1 -- 172.21.15.59:0/3393429763 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97280ab600 con 0x7f973c0d11a0 2024-04-25T09:03:40.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9739600640 1 -- 172.21.15.59:0/3393429763 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97280ab9d0 con 0x7f973c0d11a0 2024-04-25T09:03:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 -- 172.21.15.59:0/3393429763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f973c0d11a0 msgr2=0x7f973c0cfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 --2- 172.21.15.59:0/3393429763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f973c0d11a0 0x7f973c0cfaa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f97280097f0 tx=0x7f972801c450 comp rx=0 tx=0).stop 2024-04-25T09:03:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 -- 172.21.15.59:0/3393429763 shutdown_connections 2024-04-25T09:03:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 --2- 172.21.15.59:0/3393429763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f973c0d11a0 0x7f973c0cfaa0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 -- 172.21.15.59:0/3393429763 >> 172.21.15.59:0/3393429763 conn(0x7f973c0b3350 msgr2=0x7f973c0b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 -- 172.21.15.59:0/3393429763 shutdown_connections 2024-04-25T09:03:40.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 -- 172.21.15.59:0/3393429763 wait complete. 2024-04-25T09:03:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 Processor -- start 2024-04-25T09:03:40.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 -- start start 2024-04-25T09:03:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f973c0d11a0 0x7f973c0c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f973c15db80 0x7f973c155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f973c1617d0 0x7f973c160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.806+0000 7f9741c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c15e0e0 con 0x7f973c1617d0 2024-04-25T09:03:40.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f9741c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c15df60 con 0x7f973c15db80 2024-04-25T09:03:40.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f9741c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0cdaf0 con 0x7f973c0d11a0 2024-04-25T09:03:40.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f973b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f973c1617d0 0x7f973c160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f973b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f973c1617d0 0x7f973c160430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52028/0 (socket says 172.21.15.59:52028) 2024-04-25T09:03:40.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f973b400640 1 -- 172.21.15.59:0/1898801416 learned_addr learned my addr 172.21.15.59:0/1898801416 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:40.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f973a000640 1 --2- 172.21.15.59:0/1898801416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f973c15db80 0x7f973c155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f973aa00640 1 --2- 172.21.15.59:0/1898801416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f973c0d11a0 0x7f973c0c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f973b400640 1 -- 172.21.15.59:0/1898801416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f973c0d11a0 msgr2=0x7f973c0c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f973b400640 1 --2- 172.21.15.59:0/1898801416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f973c0d11a0 0x7f973c0c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f973b400640 1 -- 172.21.15.59:0/1898801416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f973c15db80 msgr2=0x7f973c155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f973b400640 1 --2- 172.21.15.59:0/1898801416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f973c15db80 0x7f973c155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f973b400640 1 -- 172.21.15.59:0/1898801416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0b45d0 con 0x7f973c1617d0 2024-04-25T09:03:40.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f973b400640 1 --2- 172.21.15.59:0/1898801416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f973c1617d0 0x7f973c160430 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f973400caa0 tx=0x7f973400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f9732a00640 1 -- 172.21.15.59:0/1898801416 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734017070 con 0x7f973c1617d0 2024-04-25T09:03:40.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f9732a00640 1 -- 172.21.15.59:0/1898801416 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973400ac00 con 0x7f973c1617d0 2024-04-25T09:03:40.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f9732a00640 1 -- 172.21.15.59:0/1898801416 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734012400 con 0x7f973c1617d0 2024-04-25T09:03:40.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f9741c00640 1 -- 172.21.15.59:0/1898801416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c0b4d30 con 0x7f973c1617d0 2024-04-25T09:03:40.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f9741c00640 1 -- 172.21.15.59:0/1898801416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c1562e0 con 0x7f973c1617d0 2024-04-25T09:03:40.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.810+0000 7f9741c00640 1 -- 172.21.15.59:0/1898801416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f973c09aea0 con 0x7f973c1617d0 2024-04-25T09:03:40.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.814+0000 7f9732a00640 1 -- 172.21.15.59:0/1898801416 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f973401a070 con 0x7f973c1617d0 2024-04-25T09:03:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.814+0000 7f9732a00640 1 --2- 172.21.15.59:0/1898801416 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f971c066f60 0x7f971c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.814+0000 7f9732a00640 1 -- 172.21.15.59:0/1898801416 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9734085620 con 0x7f973c1617d0 2024-04-25T09:03:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.814+0000 7f9732a00640 1 -- 172.21.15.59:0/1898801416 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+501 (secure 0 0 0) 0x7f9734021070 con 0x7f973c1617d0 2024-04-25T09:03:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.814+0000 7f973aa00640 1 --2- 172.21.15.59:0/1898801416 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f971c066f60 0x7f971c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.814+0000 7f9741c00640 1 -- 172.21.15.59:0/1898801416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f973c06f700 con 0x7f973c1617d0 2024-04-25T09:03:40.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.814+0000 7f973aa00640 1 --2- 172.21.15.59:0/1898801416 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f971c066f60 0x7f971c069420 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f972c007fd0 tx=0x7f972c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 Processor -- start 2024-04-25T09:03:40.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 -- start start 2024-04-25T09:03:40.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e457c290 0x5601e457b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e45c5c90 0x5601e457bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45d7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8203340 con 0x5601e45c65b0 2024-04-25T09:03:40.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d8202530 con 0x5601e45c5c90 2024-04-25T09:03:40.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d80cbae0 con 0x5601e457c290 2024-04-25T09:03:40.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45d7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45d7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52036/0 (socket says 172.21.15.59:52036) 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58dda00640 1 -- 172.21.15.59:0/468273663 learned_addr learned my addr 172.21.15.59:0/468273663 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58dd000640 1 --2- 172.21.15.59:0/468273663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e457c290 0x5601e457b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58d7e00640 1 --2- 172.21.15.59:0/468273663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e45c5c90 0x5601e457bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58dda00640 1 -- 172.21.15.59:0/468273663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e457c290 msgr2=0x5601e457b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58dda00640 1 --2- 172.21.15.59:0/468273663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e457c290 0x5601e457b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58dda00640 1 -- 172.21.15.59:0/468273663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e45c5c90 msgr2=0x5601e457bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58dda00640 1 --2- 172.21.15.59:0/468273663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e45c5c90 0x5601e457bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58dda00640 1 -- 172.21.15.59:0/468273663 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601e4421c50 con 0x5601e45c65b0 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58dd000640 1 --2- 172.21.15.59:0/468273663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e457c290 0x5601e457b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58dda00640 1 --2- 172.21.15.59:0/468273663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45d7410 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f58d0000f90 tx=0x7f58d001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c567e62abad3a2c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58c8c00640 1 -- 172.21.15.59:0/468273663 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0036070 con 0x5601e45c65b0 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58c8c00640 1 -- 172.21.15.59:0/468273663 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d001a040 con 0x5601e45c65b0 2024-04-25T09:03:40.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58c8c00640 1 -- 172.21.15.59:0/468273663 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0023040 con 0x5601e45c65b0 2024-04-25T09:03:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 -- 172.21.15.59:0/468273663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 msgr2=0x5601e45d7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 --2- 172.21.15.59:0/468273663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45d7410 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f58d0000f90 tx=0x7f58d001d000 comp rx=0 tx=0).stop 2024-04-25T09:03:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 -- 172.21.15.59:0/468273663 shutdown_connections 2024-04-25T09:03:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 --2- 172.21.15.59:0/468273663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45d7410 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 --2- 172.21.15.59:0/468273663 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e45c5c90 0x5601e457bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 --2- 172.21.15.59:0/468273663 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e457c290 0x5601e457b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 -- 172.21.15.59:0/468273663 >> 172.21.15.59:0/468273663 conn(0x5601e4578240 msgr2=0x5601e4580d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 -- 172.21.15.59:0/468273663 shutdown_connections 2024-04-25T09:03:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.818+0000 7f58e2f91000 1 -- 172.21.15.59:0/468273663 wait complete. 2024-04-25T09:03:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 1 -- start start 2024-04-25T09:03:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 1 Processor -- start 2024-04-25T09:03:40.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e457c290 0x5601e4626260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e46267a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45e0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e436cbd0 con 0x5601e45c65b0 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d80cc0e0 con 0x5601e457c290 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5601e45780c0 con 0x5601e45c5c90 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 10 client.0 _ll_register_callbacks cb 0x7f58d0001d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45e0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45e0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52044/0 (socket says 172.21.15.59:52044) 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58dda00640 1 -- 172.21.15.59:0/394480342 learned_addr learned my addr 172.21.15.59:0/394480342 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58dd000640 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e457c290 0x5601e4626260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58d7e00640 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e46267a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58dda00640 1 -- 172.21.15.59:0/394480342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 msgr2=0x5601e46267a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58dda00640 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e46267a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58dda00640 1 -- 172.21.15.59:0/394480342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e457c290 msgr2=0x5601e4626260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58dda00640 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e457c290 0x5601e4626260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58dda00640 1 -- 172.21.15.59:0/394480342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5601e4392120 con 0x5601e45c65b0 2024-04-25T09:03:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58dd000640 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e457c290 0x5601e4626260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58d7e00640 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e46267a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58dda00640 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45e0e90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f58d0005c10 tx=0x7f58d0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58694b95704b183 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58be000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58be000640 1 -- 172.21.15.59:0/394480342 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d003f060 con 0x5601e45c65b0 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 1 -- 172.21.15.59:0/394480342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58d001a040 con 0x5601e45c65b0 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58be000640 1 -- 172.21.15.59:0/394480342 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f58d0007920 con 0x5601e45c65b0 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58be000640 1 -- 172.21.15.59:0/394480342 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58d0045050 con 0x5601e45c65b0 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 10 client.5964 fetch_fsmap learned FSMap version 28 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 1 -- 172.21.15.59:0/394480342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x5601e4371170 con 0x5601e45c65b0 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58be000640 1 -- 172.21.15.59:0/394480342 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d001a040 con 0x5601e45c65b0 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58be000640 1 -- 172.21.15.59:0/394480342 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f58d0048020 con 0x5601e45c65b0 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 10 client.5964 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:03:40.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 10 client.5964 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:03:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 20 client.5964 populate_metadata read hostname 'smithi059' 2024-04-25T09:03:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x5601e45e18b0 0x5601e45e1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 4 client.5964 mds_command: new command op to 5769 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T09:03:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58e2f91000 1 -- 172.21.15.59:0/394480342 --> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x5601e43d75b0 con 0x5601e45e18b0 2024-04-25T09:03:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.822+0000 7f58dd000640 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x5601e45e18b0 0x5601e45e1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58be000640 10 client.5964 ms_handle_connect on v2:172.21.15.59:6833/2578168283 2024-04-25T09:03:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dd000640 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x5601e45e18b0 0x5601e45e1c90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe5cd7a78935259d server_cookie=8aa839de2a3fadf1 in_seq=0 out_seq=0 2024-04-25T09:03:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58be000640 1 -- 172.21.15.59:0/394480342 <== mds.0 v2:172.21.15.59:6833/2578168283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5601e43d75b0 con 0x5601e45e18b0 2024-04-25T09:03:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58be000640 10 client.5964 handle_command_reply: tid=0 2024-04-25T09:03:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58e2f91000 1 client.5964 shutdown 2024-04-25T09:03:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58e2f91000 1 -- 172.21.15.59:0/394480342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 msgr2=0x5601e45e0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58e2f91000 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45e0e90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f58d0005c10 tx=0x7f58d0009040 comp rx=0 tx=0).stop 2024-04-25T09:03:40.821 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f735b400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5351=0-4194304@1} caps={5351=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5351 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55c1168c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:03:40.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58e2f91000 1 -- 172.21.15.59:0/394480342 shutdown_connections 2024-04-25T09:03:40.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58e2f91000 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x5601e45e18b0 0x5601e45e1c90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58e2f91000 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5601e45c65b0 0x5601e45e0e90 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58e2f91000 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5601e45c5c90 0x5601e46267a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58e2f91000 1 --2- 172.21.15.59:0/394480342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5601e457c290 0x5601e4626260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58be000640 0 client.5964 ms_handle_reset on v2:172.21.15.59:6833/2578168283 2024-04-25T09:03:40.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58e2f91000 1 -- 172.21.15.59:0/394480342 >> 172.21.15.59:0/394480342 conn(0x5601e4578240 msgr2=0x5601e4581450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58e2f91000 1 -- 172.21.15.59:0/394480342 shutdown_connections 2024-04-25T09:03:40.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58e2f91000 1 -- 172.21.15.59:0/394480342 wait complete. 2024-04-25T09:03:40.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58e2f91000 20 client.5964 trim_cache size 0 max 16384 2024-04-25T09:03:40.822 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:03:40.822 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-04-25T09:03:40.822 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "eece72dd-1148-4b21-80d4-9294f7e7df13", 2024-04-25T09:03:40.823 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-04-25T09:03:40.823 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:03:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dfa00640 1 -- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f58b8066f60 msgr2=0x7f58b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dfa00640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f58b8066f60 0x7f58b8069420 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f58d8156340 tx=0x7f58c4009190 comp rx=0 tx=0).stop 2024-04-25T09:03:40.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dfa00640 1 -- 172.21.15.59:0/1698118178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d80711f0 msgr2=0x7f58d8150350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dfa00640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d80711f0 0x7f58d8150350 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0097c0 tx=0x7f58cc01abd0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dfa00640 1 -- 172.21.15.59:0/1698118178 shutdown_connections 2024-04-25T09:03:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dfa00640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f58b8066f60 0x7f58b8069420 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dfa00640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f58d815dab0 0x7f58d80cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dfa00640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f58d80b0c00 0x7f58d80ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dfa00640 1 --2- 172.21.15.59:0/1698118178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58d80711f0 0x7f58d8150350 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dfa00640 1 -- 172.21.15.59:0/1698118178 >> 172.21.15.59:0/1698118178 conn(0x7f58d806f510 msgr2=0x7f58d80ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dfa00640 1 -- 172.21.15.59:0/1698118178 shutdown_connections 2024-04-25T09:03:40.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.826+0000 7f58dfa00640 1 -- 172.21.15.59:0/1698118178 wait complete. 2024-04-25T09:03:40.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:03:40.839 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T09:03:40.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.990+0000 7f86b2a00640 1 Processor -- start 2024-04-25T09:03:40.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.990+0000 7f86b2a00640 1 -- start start 2024-04-25T09:03:40.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.990+0000 7f86b2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86ac072210 0x7f86ac0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.990+0000 7f86b2a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ac06ac10 con 0x7f86ac15dd90 2024-04-25T09:03:40.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.990+0000 7f86b2a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ac06aeb0 con 0x7f86ac0ce1d0 2024-04-25T09:03:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.990+0000 7f86b2a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ac0b2dc0 con 0x7f86ac072210 2024-04-25T09:03:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.990+0000 7f86abe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f86ac15dd90 0x7f86ac071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:44016/0 (socket says 172.21.15.59:44016) 2024-04-25T09:03:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.990+0000 7f86a3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86ac072210 0x7f86ac0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.990+0000 7f86abe00640 1 -- 172.21.15.59:0/1345662049 learned_addr learned my addr 172.21.15.59:0/1345662049 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:03:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.990+0000 7f86a3e00640 1 -- 172.21.15.59:0/1345662049 >> v1:172.21.15.178:6789/0 conn(0x7f86ac0ce1d0 legacy=0x7f86ac0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.990+0000 7f86a3e00640 1 -- 172.21.15.59:0/1345662049 >> v1:172.21.15.59:6789/0 conn(0x7f86ac15dd90 legacy=0x7f86ac071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.990+0000 7f86ab400640 1 -- 172.21.15.59:0/1345662049 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1162806477 0 0) 0x7f86ac06ac10 con 0x7f86ac15dd90 2024-04-25T09:03:40.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.994+0000 7f86a3e00640 1 -- 172.21.15.59:0/1345662049 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac06b190 con 0x7f86ac072210 2024-04-25T09:03:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.994+0000 7f86a3e00640 1 --2- 172.21.15.59:0/1345662049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86ac072210 0x7f86ac0cdc90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f86940097c0 tx=0x7f869401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8cd10387a96f84b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.994+0000 7f86ab400640 1 -- 172.21.15.59:0/1345662049 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940b0070 con 0x7f86ac072210 2024-04-25T09:03:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.994+0000 7f86ab400640 1 -- 172.21.15.59:0/1345662049 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86940ab600 con 0x7f86ac072210 2024-04-25T09:03:40.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.994+0000 7f86ab400640 1 -- 172.21.15.59:0/1345662049 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940ab9d0 con 0x7f86ac072210 2024-04-25T09:03:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.994+0000 7f86b2a00640 1 -- 172.21.15.59:0/1345662049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86ac072210 msgr2=0x7f86ac0cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.994+0000 7f86b2a00640 1 --2- 172.21.15.59:0/1345662049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86ac072210 0x7f86ac0cdc90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f86940097c0 tx=0x7f869401c410 comp rx=0 tx=0).stop 2024-04-25T09:03:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.994+0000 7f86b2a00640 1 -- 172.21.15.59:0/1345662049 shutdown_connections 2024-04-25T09:03:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.994+0000 7f86b2a00640 1 --2- 172.21.15.59:0/1345662049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86ac072210 0x7f86ac0cdc90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.994+0000 7f86b2a00640 1 -- 172.21.15.59:0/1345662049 >> 172.21.15.59:0/1345662049 conn(0x7f86ac0cfd90 msgr2=0x7f86ac0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.994+0000 7f86b2a00640 1 -- 172.21.15.59:0/1345662049 shutdown_connections 2024-04-25T09:03:40.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.994+0000 7f86b2a00640 1 -- 172.21.15.59:0/1345662049 wait complete. 2024-04-25T09:03:40.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86b2a00640 1 Processor -- start 2024-04-25T09:03:40.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86b2a00640 1 -- start start 2024-04-25T09:03:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86b2a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ac072210 0x7f86ac163d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86b2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86ac0ce1d0 0x7f86ac164290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86b2a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86ac15dd90 0x7f86ac1465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86b2a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0cf950 con 0x7f86ac0ce1d0 2024-04-25T09:03:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86b2a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac0cf7d0 con 0x7f86ac072210 2024-04-25T09:03:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86b2a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac16bad0 con 0x7f86ac15dd90 2024-04-25T09:03:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86a3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86ac0ce1d0 0x7f86ac164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86a3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86ac0ce1d0 0x7f86ac164290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52060/0 (socket says 172.21.15.59:52060) 2024-04-25T09:03:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86a3e00640 1 -- 172.21.15.59:0/3309753253 learned_addr learned my addr 172.21.15.59:0/3309753253 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86b0a00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86ac15dd90 0x7f86ac1465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86a3e00640 1 -- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86ac15dd90 msgr2=0x7f86ac1465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86abe00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ac072210 0x7f86ac163d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86a3e00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86ac15dd90 0x7f86ac1465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86a3e00640 1 -- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ac072210 msgr2=0x7f86ac163d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86a3e00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ac072210 0x7f86ac163d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86a3e00640 1 -- 172.21.15.59:0/3309753253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ac162ba0 con 0x7f86ac0ce1d0 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86b0a00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86ac15dd90 0x7f86ac1465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86abe00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ac072210 0x7f86ac163d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86a3e00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86ac0ce1d0 0x7f86ac164290 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8694019020 tx=0x7f86940191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86a8c00640 1 -- 172.21.15.59:0/3309753253 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940b8020 con 0x7f86ac0ce1d0 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86a8c00640 1 -- 172.21.15.59:0/3309753253 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86940b4610 con 0x7f86ac0ce1d0 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86a8c00640 1 -- 172.21.15.59:0/3309753253 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940b0040 con 0x7f86ac0ce1d0 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86b2a00640 1 -- 172.21.15.59:0/3309753253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ac147180 con 0x7f86ac0ce1d0 2024-04-25T09:03:40.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:40.998+0000 7f86b2a00640 1 -- 172.21.15.59:0/3309753253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ac147740 con 0x7f86ac0ce1d0 2024-04-25T09:03:40.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.002+0000 7f86a8c00640 1 -- 172.21.15.59:0/3309753253 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f86940bb020 con 0x7f86ac0ce1d0 2024-04-25T09:03:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.002+0000 7f86a8c00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8688066f90 0x7f8688069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.002+0000 7f86a8c00640 1 -- 172.21.15.59:0/3309753253 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f869411eda0 con 0x7f86ac0ce1d0 2024-04-25T09:03:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.002+0000 7f86b5f29000 1 Processor -- start 2024-04-25T09:03:40.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.002+0000 7f86b5f29000 1 -- start start 2024-04-25T09:03:40.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.002+0000 7f86abe00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8688066f90 0x7f8688069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.002+0000 7f86b5f29000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0d9d0 0x555786e0ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.002+0000 7f86b5f29000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0e2f0 0x555786dc3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.002+0000 7f86b5f29000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786dc4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.002+0000 7f86b5f29000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555786c10ff0 con 0x555786e0e2f0 2024-04-25T09:03:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.002+0000 7f86b5f29000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555786b99150 con 0x555786e0d9d0 2024-04-25T09:03:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.002+0000 7f86b5f29000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x555786c0d090 con 0x555786dc40a0 2024-04-25T09:03:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86a3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0e2f0 0x555786dc3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86abe00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8688066f90 0x7f8688069450 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f869c000f70 tx=0x7f869c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86a3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0e2f0 0x555786dc3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52076/0 (socket says 172.21.15.59:52076) 2024-04-25T09:03:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86a3e00640 1 -- 172.21.15.59:0/830836365 learned_addr learned my addr 172.21.15.59:0/830836365 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86abe00640 1 --2- 172.21.15.59:0/830836365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0d9d0 0x555786e0ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b0a00640 1 --2- 172.21.15.59:0/830836365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786dc4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86a3e00640 1 -- 172.21.15.59:0/830836365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 msgr2=0x555786dc4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86a3e00640 1 --2- 172.21.15.59:0/830836365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786dc4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86a3e00640 1 -- 172.21.15.59:0/830836365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0d9d0 msgr2=0x555786e0ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86a3e00640 1 --2- 172.21.15.59:0/830836365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0d9d0 0x555786e0ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86a3e00640 1 -- 172.21.15.59:0/830836365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555786da70d0 con 0x555786e0e2f0 2024-04-25T09:03:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86a3e00640 1 --2- 172.21.15.59:0/830836365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0e2f0 0x555786dc3b60 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f86940ef4a0 tx=0x7f86940eef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6e50ed6950526a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86a0c00640 1 -- 172.21.15.59:0/830836365 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694107070 con 0x555786e0e2f0 2024-04-25T09:03:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86a0c00640 1 -- 172.21.15.59:0/830836365 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86940f3660 con 0x555786e0e2f0 2024-04-25T09:03:40.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86a0c00640 1 -- 172.21.15.59:0/830836365 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940f7c20 con 0x555786e0e2f0 2024-04-25T09:03:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 -- 172.21.15.59:0/830836365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0e2f0 msgr2=0x555786dc3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 --2- 172.21.15.59:0/830836365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0e2f0 0x555786dc3b60 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f86940ef4a0 tx=0x7f86940eef30 comp rx=0 tx=0).stop 2024-04-25T09:03:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 -- 172.21.15.59:0/830836365 shutdown_connections 2024-04-25T09:03:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 --2- 172.21.15.59:0/830836365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786dc4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 --2- 172.21.15.59:0/830836365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0e2f0 0x555786dc3b60 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 --2- 172.21.15.59:0/830836365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0d9d0 0x555786e0ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 -- 172.21.15.59:0/830836365 >> 172.21.15.59:0/830836365 conn(0x555786dc0020 msgr2=0x555786dc2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 -- 172.21.15.59:0/830836365 shutdown_connections 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 -- 172.21.15.59:0/830836365 wait complete. 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 -- start start 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 Processor -- start 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786df27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786df2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786df3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555786bd5250 con 0x555786e0d9d0 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555786bcb690 con 0x555786e0e2f0 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x555786b99a40 con 0x555786dc40a0 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.006+0000 7f86b5f29000 10 client.0 _ll_register_callbacks cb 0x555786daee90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:41.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86a3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786df2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86a3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786df2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52086/0 (socket says 172.21.15.59:52086) 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86a3e00640 1 -- 172.21.15.59:0/3246071669 learned_addr learned my addr 172.21.15.59:0/3246071669 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b0a00640 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786df3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86abe00640 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786df27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86a3e00640 1 -- 172.21.15.59:0/3246071669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 msgr2=0x555786df27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86a3e00640 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786df27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86a3e00640 1 -- 172.21.15.59:0/3246071669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 msgr2=0x555786df3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86a3e00640 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786df3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86a3e00640 1 -- 172.21.15.59:0/3246071669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555786cbe1c0 con 0x555786e0d9d0 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86abe00640 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786df27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86a3e00640 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786df2d30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f86940ef4a0 tx=0x7f86940bffb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1837fbe026130ae4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f8699600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f8699600640 1 -- 172.21.15.59:0/3246071669 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694107040 con 0x555786e0d9d0 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f8699600640 1 -- 172.21.15.59:0/3246071669 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f86940ef770 con 0x555786e0d9d0 2024-04-25T09:03:41.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 -- 172.21.15.59:0/3246071669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86940f3660 con 0x555786e0d9d0 2024-04-25T09:03:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f8699600640 1 -- 172.21.15.59:0/3246071669 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86940f7c20 con 0x555786e0d9d0 2024-04-25T09:03:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 10 client.5979 fetch_fsmap learned FSMap version 28 2024-04-25T09:03:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 -- 172.21.15.59:0/3246071669 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x555786cba170 con 0x555786e0d9d0 2024-04-25T09:03:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f8699600640 1 -- 172.21.15.59:0/3246071669 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86940f3660 con 0x555786e0d9d0 2024-04-25T09:03:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f8699600640 1 -- 172.21.15.59:0/3246071669 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8694109030 con 0x555786e0d9d0 2024-04-25T09:03:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 10 client.5979 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:03:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 10 client.5979 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:03:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 20 client.5979 populate_metadata read hostname 'smithi059' 2024-04-25T09:03:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x555786e1dc80 0x555786e20070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 4 client.5979 mds_command: new command op to 5769 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:03:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 -- 172.21.15.59:0/3246071669 --> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555786bacc60 con 0x555786e1dc80 2024-04-25T09:03:41.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86abe00640 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x555786e1dc80 0x555786e20070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86abe00640 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x555786e1dc80 0x555786e20070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a901f0acd8ba505 server_cookie=e874354828deff63 in_seq=0 out_seq=0 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f8699600640 10 client.5979 ms_handle_connect on v2:172.21.15.59:6833/2578168283 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f8699600640 1 -- 172.21.15.59:0/3246071669 <== mds.0 v2:172.21.15.59:6833/2578168283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x555786bacc60 con 0x555786e1dc80 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f8699600640 10 client.5979 handle_command_reply: tid=0 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 client.5979 shutdown 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 -- 172.21.15.59:0/3246071669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 msgr2=0x555786df2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786df2d30 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f86940ef4a0 tx=0x7f86940bffb0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 -- 172.21.15.59:0/3246071669 shutdown_connections 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x555786e1dc80 0x555786e20070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786df3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786df2d30 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 --2- 172.21.15.59:0/3246071669 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786df27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f8699600640 0 client.5979 ms_handle_reset on v2:172.21.15.59:6833/2578168283 2024-04-25T09:03:41.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 -- 172.21.15.59:0/3246071669 >> 172.21.15.59:0/3246071669 conn(0x555786dc0020 msgr2=0x555786dc2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 -- 172.21.15.59:0/3246071669 shutdown_connections 2024-04-25T09:03:41.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.010+0000 7f86b5f29000 1 -- 172.21.15.59:0/3246071669 wait complete. 2024-04-25T09:03:41.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.014+0000 7f86b5f29000 20 client.5979 trim_cache size 0 max 16384 2024-04-25T09:03:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.026+0000 7f86b5f29000 1 Processor -- start 2024-04-25T09:03:41.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.026+0000 7f86b5f29000 1 -- start start 2024-04-25T09:03:41.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.026+0000 7f86b5f29000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786e0cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.026+0000 7f86b5f29000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786dc3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.026+0000 7f86b5f29000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786dc3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.026+0000 7f86b5f29000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac2030a0 con 0x555786e0d9d0 2024-04-25T09:03:41.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.026+0000 7f86b5f29000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac202260 con 0x555786e0e2f0 2024-04-25T09:03:41.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.026+0000 7f86b5f29000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac148f70 con 0x555786dc40a0 2024-04-25T09:03:41.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86a3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786dc3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86a3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786dc3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52094/0 (socket says 172.21.15.59:52094) 2024-04-25T09:03:41.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86a3e00640 1 -- 172.21.15.59:0/2648339328 learned_addr learned my addr 172.21.15.59:0/2648339328 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:41.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b0a00640 1 --2- 172.21.15.59:0/2648339328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786dc3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86abe00640 1 --2- 172.21.15.59:0/2648339328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786e0cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86a3e00640 1 -- 172.21.15.59:0/2648339328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 msgr2=0x555786e0cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:41.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86a3e00640 1 --2- 172.21.15.59:0/2648339328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786e0cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86a3e00640 1 -- 172.21.15.59:0/2648339328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 msgr2=0x555786dc3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:41.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86a3e00640 1 --2- 172.21.15.59:0/2648339328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786dc3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86a3e00640 1 -- 172.21.15.59:0/2648339328 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555786c57de0 con 0x555786e0d9d0 2024-04-25T09:03:41.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86a3e00640 1 --2- 172.21.15.59:0/2648339328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786dc3420 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f86940abfd0 tx=0x7f8694105000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60cdece35bc04e28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f869be00640 1 -- 172.21.15.59:0/2648339328 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694107040 con 0x555786e0d9d0 2024-04-25T09:03:41.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f869be00640 1 -- 172.21.15.59:0/2648339328 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86940ef510 con 0x555786e0d9d0 2024-04-25T09:03:41.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f869be00640 1 -- 172.21.15.59:0/2648339328 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86940f77e0 con 0x555786e0d9d0 2024-04-25T09:03:41.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 -- 172.21.15.59:0/2648339328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 msgr2=0x555786dc3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 --2- 172.21.15.59:0/2648339328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786dc3420 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f86940abfd0 tx=0x7f8694105000 comp rx=0 tx=0).stop 2024-04-25T09:03:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 -- 172.21.15.59:0/2648339328 shutdown_connections 2024-04-25T09:03:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 --2- 172.21.15.59:0/2648339328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786dc3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 --2- 172.21.15.59:0/2648339328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786dc3420 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 --2- 172.21.15.59:0/2648339328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786e0cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 -- 172.21.15.59:0/2648339328 >> 172.21.15.59:0/2648339328 conn(0x555786dc0020 msgr2=0x555786e0c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 -- 172.21.15.59:0/2648339328 shutdown_connections 2024-04-25T09:03:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 -- 172.21.15.59:0/2648339328 wait complete. 2024-04-25T09:03:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 -- start start 2024-04-25T09:03:41.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 Processor -- start 2024-04-25T09:03:41.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786e6e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786e6ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786e20380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555786babe00 con 0x555786e0d9d0 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ac201db0 con 0x555786e0e2f0 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x555786c10300 con 0x555786dc40a0 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.030+0000 7f86b5f29000 10 client.0 _ll_register_callbacks cb 0x555786d8f040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86a3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786e6ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86a3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786e6ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52100/0 (socket says 172.21.15.59:52100) 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86a3e00640 1 -- 172.21.15.59:0/4087862341 learned_addr learned my addr 172.21.15.59:0/4087862341 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b0a00640 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786e20380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86abe00640 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786e6e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86a3e00640 1 -- 172.21.15.59:0/4087862341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 msgr2=0x555786e6e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86a3e00640 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786e6e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86a3e00640 1 -- 172.21.15.59:0/4087862341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 msgr2=0x555786e20380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86a3e00640 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786e20380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86a3e00640 1 -- 172.21.15.59:0/4087862341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555786bb28e0 con 0x555786e0d9d0 2024-04-25T09:03:41.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b0a00640 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786e20380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86abe00640 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786e6e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86a3e00640 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786e6ea60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f86940ebe90 tx=0x7f869401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda83051835b0f80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f8699600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f8699600640 1 -- 172.21.15.59:0/4087862341 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8694107040 con 0x555786e0d9d0 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f8699600640 1 -- 172.21.15.59:0/4087862341 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f86940f79a0 con 0x555786e0d9d0 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 -- 172.21.15.59:0/4087862341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86940ef510 con 0x555786e0d9d0 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f8699600640 1 -- 172.21.15.59:0/4087862341 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86940f3660 con 0x555786e0d9d0 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 10 client.5985 fetch_fsmap learned FSMap version 28 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 -- 172.21.15.59:0/4087862341 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x555786c6a8f0 con 0x555786e0d9d0 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f8699600640 1 -- 172.21.15.59:0/4087862341 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86940ef510 con 0x555786e0d9d0 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f8699600640 1 -- 172.21.15.59:0/4087862341 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8694109070 con 0x555786e0d9d0 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 10 client.5985 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 10 client.5985 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:03:41.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 20 client.5985 populate_metadata read hostname 'smithi059' 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x555786e20d40 0x555786e21120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 4 client.5985 mds_command: new command op to 5769 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 -- 172.21.15.59:0/4087862341 --> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555786c1e530 con 0x555786e20d40 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86abe00640 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x555786e20d40 0x555786e21120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86abe00640 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x555786e20d40 0x555786e21120 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7c1082664fbdee6 server_cookie=f85c78b01c80c3c4 in_seq=0 out_seq=0 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f8699600640 10 client.5985 ms_handle_connect on v2:172.21.15.59:6833/2578168283 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f8699600640 1 -- 172.21.15.59:0/4087862341 <== mds.0 v2:172.21.15.59:6833/2578168283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x555786c1e530 con 0x555786e20d40 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f8699600640 10 client.5985 handle_command_reply: tid=0 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 client.5985 shutdown 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 -- 172.21.15.59:0/4087862341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 msgr2=0x555786e6ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786e6ea60 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f86940ebe90 tx=0x7f869401c410 comp rx=0 tx=0).stop 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 -- 172.21.15.59:0/4087862341 shutdown_connections 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x555786e20d40 0x555786e21120 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555786e0e2f0 0x555786e20380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555786e0d9d0 0x555786e6ea60 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f8699600640 0 client.5985 ms_handle_reset on v2:172.21.15.59:6833/2578168283 2024-04-25T09:03:41.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 --2- 172.21.15.59:0/4087862341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555786dc40a0 0x555786e6e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 -- 172.21.15.59:0/4087862341 >> 172.21.15.59:0/4087862341 conn(0x555786dc0020 msgr2=0x555786e0c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 -- 172.21.15.59:0/4087862341 shutdown_connections 2024-04-25T09:03:41.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 1 -- 172.21.15.59:0/4087862341 wait complete. 2024-04-25T09:03:41.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b5f29000 20 client.5985 trim_cache size 0 max 16384 2024-04-25T09:03:41.032 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:03:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:03:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-04-25T09:03:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "eece72dd-1148-4b21-80d4-9294f7e7df13": { 2024-04-25T09:03:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-04-25T09:03:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "eece72dd-1148-4b21-80d4-9294f7e7df13", 2024-04-25T09:03:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,repair" 2024-04-25T09:03:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:41.032 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:03:41.032 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:03:41.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b2a00640 1 -- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8688066f90 msgr2=0x7f8688069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b2a00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8688066f90 0x7f8688069450 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f869c000f70 tx=0x7f869c009040 comp rx=0 tx=0).stop 2024-04-25T09:03:41.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b2a00640 1 -- 172.21.15.59:0/3309753253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86ac0ce1d0 msgr2=0x7f86ac164290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:03:41.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b2a00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86ac0ce1d0 0x7f86ac164290 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8694019020 tx=0x7f86940191b0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b2a00640 1 -- 172.21.15.59:0/3309753253 shutdown_connections 2024-04-25T09:03:41.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b2a00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8688066f90 0x7f8688069450 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b2a00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86ac15dd90 0x7f86ac1465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b2a00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86ac0ce1d0 0x7f86ac164290 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b2a00640 1 --2- 172.21.15.59:0/3309753253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f86ac072210 0x7f86ac163d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:03:41.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b2a00640 1 -- 172.21.15.59:0/3309753253 >> 172.21.15.59:0/3309753253 conn(0x7f86ac0cfd90 msgr2=0x7f86ac0ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:03:41.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b2a00640 1 -- 172.21.15.59:0/3309753253 shutdown_connections 2024-04-25T09:03:41.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:41.034+0000 7f86b2a00640 1 -- 172.21.15.59:0/3309753253 wait complete. 2024-04-25T09:03:41.046 INFO:tasks.cephfs.filesystem:scrub status for tag:eece72dd-1148-4b21-80d4-9294f7e7df13 - {'path': '/', 'tag': 'eece72dd-1148-4b21-80d4-9294f7e7df13', 'options': 'recursive,repair'} 2024-04-25T09:03:42.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:42.614+0000 7f9732a00640 1 -- 172.21.15.59:0/1898801416 <== mon.0 v2:172.21.15.59:3300/0 7 ==== log(6 entries from seq 1 at 2024-04-25T09:03:40.829979+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7f973405c0d0 con 0x7f973c1617d0 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi059.stdout: cluster: 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi059.stdout: id: fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi059.stdout: health: HEALTH_OK 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi059.stdout: services: 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi059.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi059.stdout: mgr: x(active, since 2m), standbys: y 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi059.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T09:03:42.607 INFO:teuthology.orchestra.run.smithi059.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout: data: 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout: volumes: 1/1 healthy 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout: pools: 3 pools, 97 pgs 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout: objects: 24 objects, 579 KiB 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout: usage: 233 MiB used, 720 GiB / 720 GiB avail 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout: pgs: 97 active+clean 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout: io: 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout: client: 1.7 KiB/s wr, 0 op/s rd, 5 op/s wr 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:03:40.829979+0000 mds.a [INF] scrub queued for path: / 2024-04-25T09:03:42.608 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:03:40.829982+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:03:42.609 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:03:40.829986+0000 mds.a [INF] scrub summary: active paths [/] 2024-04-25T09:03:42.609 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:03:40.830776+0000 mds.a [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-04-25T09:03:42.609 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:03:40.830789+0000 mds.a [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-04-25T09:03:42.609 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:03:40.831561+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:03:43.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:03:43.750+0000 7f9732a00640 1 -- 172.21.15.59:0/1898801416 <== mon.0 v2:172.21.15.59:3300/0 8 ==== log(1 entries from seq 7 at 2024-04-25T09:03:42.702525+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f9734053e60 con 0x7f973c1617d0 2024-04-25T09:03:43.743 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:03:42.702525+0000 mds.a [INF] scrub summary: idle 2024-04-25T09:03:52.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:03:52.853 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:08.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:08.806+0000 7f9732a00640 1 -- 172.21.15.59:0/1898801416 <== mon.0 v2:172.21.15.59:3300/0 9 ==== log(4 entries from seq 117 at 2024-04-25T09:04:08.314001+0000) v1 ==== 1122+0+0 (secure 0 0 0) 0x7f97340540c0 con 0x7f973c1617d0 2024-04-25T09:04:09.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:09.810+0000 7f9732a00640 1 -- 172.21.15.59:0/1898801416 <== mon.0 v2:172.21.15.59:3300/0 10 ==== log(2 entries from seq 494 at 2024-04-25T09:04:08.803273+0000) v1 ==== 558+0+0 (secure 0 0 0) 0x7f9734083a30 con 0x7f973c1617d0 2024-04-25T09:04:11.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:11.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-25T09:04:11.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.210+0000 7f6f0a600640 1 Processor -- start 2024-04-25T09:04:11.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.210+0000 7f6f0a600640 1 -- start start 2024-04-25T09:04:11.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.210+0000 7f6f0a600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f040b4190 0x7f6f040b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.210+0000 7f6f0a600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f040b0c90 0x7f6f0415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.210+0000 7f6f0a600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f040b30f0 con 0x7f6f04144e20 2024-04-25T09:04:11.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.210+0000 7f6f0a600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f040b1100 con 0x7f6f040b0c90 2024-04-25T09:04:11.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.210+0000 7f6f0a600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040b33d0 con 0x7f6f040b4190 2024-04-25T09:04:11.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f09c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f040b0c90 0x7f6f0415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f09200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6f04144e20 0x7f6f0406d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54592/0 (socket says 172.21.15.59:54592) 2024-04-25T09:04:11.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f09200640 1 -- 172.21.15.59:0/2904086204 learned_addr learned my addr 172.21.15.59:0/2904086204 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:11.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f03e00640 1 --2- 172.21.15.59:0/2904086204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f040b4190 0x7f6f040b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f09c00640 1 -- 172.21.15.59:0/2904086204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f040b4190 msgr2=0x7f6f040b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f09c00640 1 --2- 172.21.15.59:0/2904086204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f040b4190 0x7f6f040b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f09c00640 1 -- 172.21.15.59:0/2904086204 >> v1:172.21.15.59:6789/0 conn(0x7f6f04144e20 legacy=0x7f6f0406d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f03400640 1 -- 172.21.15.59:0/2904086204 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89849888 0 0) 0x7f6f040b30f0 con 0x7f6f04144e20 2024-04-25T09:04:11.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f09c00640 1 -- 172.21.15.59:0/2904086204 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f040b36b0 con 0x7f6f040b0c90 2024-04-25T09:04:11.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f09c00640 1 --2- 172.21.15.59:0/2904086204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f040b0c90 0x7f6f0415bdb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009d90 tx=0x7f6efc01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9310060735b9f710 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f03400640 1 -- 172.21.15.59:0/2904086204 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0b2070 con 0x7f6f040b0c90 2024-04-25T09:04:11.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f03400640 1 -- 172.21.15.59:0/2904086204 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc0a5a00 con 0x7f6f040b0c90 2024-04-25T09:04:11.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.214+0000 7f6f03400640 1 -- 172.21.15.59:0/2904086204 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0a5dd0 con 0x7f6f040b0c90 2024-04-25T09:04:11.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 -- 172.21.15.59:0/2904086204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f040b0c90 msgr2=0x7f6f0415bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 --2- 172.21.15.59:0/2904086204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f040b0c90 0x7f6f0415bdb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009d90 tx=0x7f6efc01c940 comp rx=0 tx=0).stop 2024-04-25T09:04:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 -- 172.21.15.59:0/2904086204 shutdown_connections 2024-04-25T09:04:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 --2- 172.21.15.59:0/2904086204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f040b0c90 0x7f6f0415bdb0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 --2- 172.21.15.59:0/2904086204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f040b4190 0x7f6f040b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 -- 172.21.15.59:0/2904086204 >> 172.21.15.59:0/2904086204 conn(0x7f6f04066fa0 msgr2=0x7f6f0406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 -- 172.21.15.59:0/2904086204 shutdown_connections 2024-04-25T09:04:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 -- 172.21.15.59:0/2904086204 wait complete. 2024-04-25T09:04:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 Processor -- start 2024-04-25T09:04:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 -- start start 2024-04-25T09:04:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f040b0c90 0x7f6f0413cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f040b4190 0x7f6f04155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f04144e20 0x7f6f040cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040b2eb0 con 0x7f6f040b0c90 2024-04-25T09:04:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f040b2d30 con 0x7f6f04144e20 2024-04-25T09:04:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f0a600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f04145200 con 0x7f6f040b4190 2024-04-25T09:04:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f09200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f040b0c90 0x7f6f0413cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f09200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f040b0c90 0x7f6f0413cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46794/0 (socket says 172.21.15.59:46794) 2024-04-25T09:04:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f09200640 1 -- 172.21.15.59:0/3267377388 learned_addr learned my addr 172.21.15.59:0/3267377388 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f03e00640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f040b4190 0x7f6f04155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f09c00640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f04144e20 0x7f6f040cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f09200640 1 -- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f040b4190 msgr2=0x7f6f04155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f09200640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f040b4190 0x7f6f04155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f09200640 1 -- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f04144e20 msgr2=0x7f6f040cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f09200640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f04144e20 0x7f6f040cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.218+0000 7f6f09200640 1 -- 172.21.15.59:0/3267377388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f0413b5d0 con 0x7f6f040b0c90 2024-04-25T09:04:11.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.222+0000 7f6f09200640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f040b0c90 0x7f6f0413cc90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800c4b0 tx=0x7f6ef800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.222+0000 7f6f00c00640 1 -- 172.21.15.59:0/3267377388 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8018070 con 0x7f6f040b0c90 2024-04-25T09:04:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.222+0000 7f6f00c00640 1 -- 172.21.15.59:0/3267377388 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8007500 con 0x7f6f040b0c90 2024-04-25T09:04:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.222+0000 7f6f00c00640 1 -- 172.21.15.59:0/3267377388 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8004a30 con 0x7f6f040b0c90 2024-04-25T09:04:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.222+0000 7f6f0a600640 1 -- 172.21.15.59:0/3267377388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f0413b8b0 con 0x7f6f040b0c90 2024-04-25T09:04:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.222+0000 7f6f0a600640 1 -- 172.21.15.59:0/3267377388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f04157ca0 con 0x7f6f040b0c90 2024-04-25T09:04:11.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.222+0000 7f6f00c00640 1 -- 172.21.15.59:0/3267377388 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6ef801b070 con 0x7f6f040b0c90 2024-04-25T09:04:11.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.222+0000 7f6f00c00640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ee4066f60 0x7f6ee4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.222+0000 7f6f00c00640 1 -- 172.21.15.59:0/3267377388 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6ef8084580 con 0x7f6f040b0c90 2024-04-25T09:04:11.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.222+0000 7f6f0f17d000 1 Processor -- start 2024-04-25T09:04:11.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.222+0000 7f6f03e00640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ee4066f60 0x7f6ee4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.222+0000 7f6f0f17d000 1 -- start start 2024-04-25T09:04:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f03e00640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ee4066f60 0x7f6ee4069420 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6f041f7730 tx=0x7f6ef0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 0x55df73b85210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b85750 0x55df73b3af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b3b4b0 0x55df73b3b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df73983ff0 con 0x55df73b84e30 2024-04-25T09:04:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df7390c150 con 0x55df73b3b4b0 2024-04-25T09:04:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df73980090 con 0x55df73b85750 2024-04-25T09:04:11.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f09200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 0x55df73b85210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f09200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 0x55df73b85210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46798/0 (socket says 172.21.15.59:46798) 2024-04-25T09:04:11.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f09200640 1 -- 172.21.15.59:0/258511560 learned_addr learned my addr 172.21.15.59:0/258511560 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:11.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f03e00640 1 --2- 172.21.15.59:0/258511560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b85750 0x55df73b3af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f09c00640 1 --2- 172.21.15.59:0/258511560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b3b4b0 0x55df73b3b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f09200640 1 -- 172.21.15.59:0/258511560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b85750 msgr2=0x55df73b3af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f09200640 1 --2- 172.21.15.59:0/258511560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b85750 0x55df73b3af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f09200640 1 -- 172.21.15.59:0/258511560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b3b4b0 msgr2=0x55df73b3b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f09200640 1 --2- 172.21.15.59:0/258511560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b3b4b0 0x55df73b3b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f09200640 1 -- 172.21.15.59:0/258511560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df73b1a0d0 con 0x55df73b84e30 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f09200640 1 --2- 172.21.15.59:0/258511560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 0x55df73b85210 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8054bc0 tx=0x7f6ef8054d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab1369d863024e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6ef5600640 1 -- 172.21.15.59:0/258511560 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef8052f30 con 0x55df73b84e30 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6ef5600640 1 -- 172.21.15.59:0/258511560 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8001050 con 0x55df73b84e30 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6ef5600640 1 -- 172.21.15.59:0/258511560 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef805ceb0 con 0x55df73b84e30 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 -- 172.21.15.59:0/258511560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 msgr2=0x55df73b85210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/258511560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 0x55df73b85210 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6ef8054bc0 tx=0x7f6ef8054d70 comp rx=0 tx=0).stop 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 -- 172.21.15.59:0/258511560 shutdown_connections 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/258511560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b3b4b0 0x55df73b3b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/258511560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b85750 0x55df73b3af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/258511560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 0x55df73b85210 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 -- 172.21.15.59:0/258511560 >> 172.21.15.59:0/258511560 conn(0x55df73b33020 msgr2=0x55df73b35440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 -- 172.21.15.59:0/258511560 shutdown_connections 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 -- 172.21.15.59:0/258511560 wait complete. 2024-04-25T09:04:11.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 -- start start 2024-04-25T09:04:11.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.226+0000 7f6f0f17d000 1 Processor -- start 2024-04-25T09:04:11.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b84810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b84e30 0x55df73b41360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 0x55df73b418a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df73988620 con 0x55df73b85750 2024-04-25T09:04:11.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df7393e690 con 0x55df73b84e30 2024-04-25T09:04:11.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df7390ca40 con 0x55df73b3b4b0 2024-04-25T09:04:11.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 10 client.0 _ll_register_callbacks cb 0x55df73b21e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f09c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 0x55df73b418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f09c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 0x55df73b418a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46814/0 (socket says 172.21.15.59:46814) 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f09c00640 1 -- 172.21.15.59:0/1858443283 learned_addr learned my addr 172.21.15.59:0/1858443283 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f09200640 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b84810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f03e00640 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b84e30 0x55df73b41360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f09c00640 1 -- 172.21.15.59:0/1858443283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 msgr2=0x55df73b84810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f09c00640 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b84810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f09c00640 1 -- 172.21.15.59:0/1858443283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b84e30 msgr2=0x55df73b41360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f09c00640 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b84e30 0x55df73b41360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f09c00640 1 -- 172.21.15.59:0/1858443283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df73a311c0 con 0x55df73b85750 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f09c00640 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 0x55df73b418a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6efc01c980 tx=0x7f6efc01b180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7236ea151e4f8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6eea000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6eea000640 1 -- 172.21.15.59:0/1858443283 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0b2040 con 0x55df73b85750 2024-04-25T09:04:11.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6eea000640 1 -- 172.21.15.59:0/1858443283 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6efc0ad640 con 0x55df73b85750 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1858443283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ef8001050 con 0x55df73b85750 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6eea000640 1 -- 172.21.15.59:0/1858443283 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6efc0cb050 con 0x55df73b85750 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 10 client.6000 fetch_fsmap learned FSMap version 28 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1858443283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55df73a2d170 con 0x55df73b85750 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6eea000640 1 -- 172.21.15.59:0/1858443283 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef8001050 con 0x55df73b85750 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6eea000640 1 -- 172.21.15.59:0/1858443283 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6efc0ad840 con 0x55df73b85750 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 10 client.6000 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 10 client.6000 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 20 client.6000 populate_metadata read hostname 'smithi059' 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55df73b425e0 0x55df73b970f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 4 client.6000 mds_command: new command op to 5769 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1858443283 --> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df7391fc60 con 0x55df73b425e0 2024-04-25T09:04:11.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f09200640 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55df73b425e0 0x55df73b970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6f09200640 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55df73b425e0 0x55df73b970f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=922ed2ba3760bae7 server_cookie=bce481f3888ff9d5 in_seq=0 out_seq=0 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.230+0000 7f6eea000640 10 client.6000 ms_handle_connect on v2:172.21.15.59:6833/2578168283 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6eea000640 1 -- 172.21.15.59:0/1858443283 <== mds.0 v2:172.21.15.59:6833/2578168283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55df7391fc60 con 0x55df73b425e0 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6eea000640 10 client.6000 handle_command_reply: tid=0 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6f0f17d000 1 client.6000 shutdown 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1858443283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 msgr2=0x55df73b418a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 0x55df73b418a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6efc01c980 tx=0x7f6efc01b180 comp rx=0 tx=0).stop 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1858443283 shutdown_connections 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55df73b425e0 0x55df73b970f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 0x55df73b418a0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6eea000640 0 client.6000 ms_handle_reset on v2:172.21.15.59:6833/2578168283 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b84e30 0x55df73b41360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/1858443283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b84810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1858443283 >> 172.21.15.59:0/1858443283 conn(0x55df73b33020 msgr2=0x55df73b3c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1858443283 shutdown_connections 2024-04-25T09:04:11.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1858443283 wait complete. 2024-04-25T09:04:11.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.234+0000 7f6f0f17d000 20 client.6000 trim_cache size 0 max 16384 2024-04-25T09:04:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.246+0000 7f6f0f17d000 1 Processor -- start 2024-04-25T09:04:11.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.246+0000 7f6f0f17d000 1 -- start start 2024-04-25T09:04:11.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b63ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b84e30 0x55df73b64010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 0x55df73b922a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f041fecc0 con 0x55df73b85750 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f04072950 con 0x55df73b84e30 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0415abd0 con 0x55df73b3b4b0 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f09c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 0x55df73b922a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f09c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 0x55df73b922a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46826/0 (socket says 172.21.15.59:46826) 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f09c00640 1 -- 172.21.15.59:0/1882924402 learned_addr learned my addr 172.21.15.59:0/1882924402 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f03e00640 1 --2- 172.21.15.59:0/1882924402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b84e30 0x55df73b64010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f09200640 1 --2- 172.21.15.59:0/1882924402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b63ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f09c00640 1 -- 172.21.15.59:0/1882924402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 msgr2=0x55df73b63ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f09c00640 1 --2- 172.21.15.59:0/1882924402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b63ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f09c00640 1 -- 172.21.15.59:0/1882924402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b84e30 msgr2=0x55df73b64010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f09c00640 1 --2- 172.21.15.59:0/1882924402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b84e30 0x55df73b64010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f09c00640 1 -- 172.21.15.59:0/1882924402 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df739cade0 con 0x55df73b85750 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f09200640 1 --2- 172.21.15.59:0/1882924402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b63ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f09c00640 1 --2- 172.21.15.59:0/1882924402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 0x55df73b922a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6efc01aff0 tx=0x7f6efc0bb070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7470a2e54c4585 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6ef4c00640 1 -- 172.21.15.59:0/1882924402 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc0b2070 con 0x55df73b85750 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6ef4c00640 1 -- 172.21.15.59:0/1882924402 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc0c8070 con 0x55df73b85750 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6ef4c00640 1 -- 172.21.15.59:0/1882924402 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6efc009450 con 0x55df73b85750 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1882924402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 msgr2=0x55df73b922a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/1882924402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 0x55df73b922a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6efc01aff0 tx=0x7f6efc0bb070 comp rx=0 tx=0).stop 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1882924402 shutdown_connections 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/1882924402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b85750 0x55df73b922a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/1882924402 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b84e30 0x55df73b64010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/1882924402 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b63ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1882924402 >> 172.21.15.59:0/1882924402 conn(0x55df73b33020 msgr2=0x55df73b91b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1882924402 shutdown_connections 2024-04-25T09:04:11.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 -- 172.21.15.59:0/1882924402 wait complete. 2024-04-25T09:04:11.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 -- start start 2024-04-25T09:04:11.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.250+0000 7f6f0f17d000 1 Processor -- start 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b972d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 0x55df73b97810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b85750 0x55df73b97d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df7391ee00 con 0x55df73b84e30 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f04072350 con 0x55df73b85750 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55df73983300 con 0x55df73b3b4b0 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 10 client.0 _ll_register_callbacks cb 0x55df73b02040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f03e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 0x55df73b97810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f03e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 0x55df73b97810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46830/0 (socket says 172.21.15.59:46830) 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f03e00640 1 -- 172.21.15.59:0/3115482169 learned_addr learned my addr 172.21.15.59:0/3115482169 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f09c00640 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b85750 0x55df73b97d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f09200640 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f03e00640 1 -- 172.21.15.59:0/3115482169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 msgr2=0x55df73b972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f03e00640 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b972d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f03e00640 1 -- 172.21.15.59:0/3115482169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b85750 msgr2=0x55df73b97d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f03e00640 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b85750 0x55df73b97d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f03e00640 1 -- 172.21.15.59:0/3115482169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55df739258e0 con 0x55df73b84e30 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f09200640 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f03e00640 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 0x55df73b97810 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00144e0 tx=0x7f6ef0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f935352943996c42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6eea000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6eea000640 1 -- 172.21.15.59:0/3115482169 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef001b040 con 0x55df73b84e30 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6eea000640 1 -- 172.21.15.59:0/3115482169 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6ef0024920 con 0x55df73b84e30 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 -- 172.21.15.59:0/3115482169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6efc0c8070 con 0x55df73b84e30 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6eea000640 1 -- 172.21.15.59:0/3115482169 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ef0035050 con 0x55df73b84e30 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 10 client.6006 fetch_fsmap learned FSMap version 28 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 -- 172.21.15.59:0/3115482169 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) v3 -- 0x55df739dd8f0 con 0x55df73b84e30 2024-04-25T09:04:11.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6eea000640 1 -- 172.21.15.59:0/3115482169 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6efc0c8070 con 0x55df73b84e30 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6eea000640 1 -- 172.21.15.59:0/3115482169 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 28) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6ef0038020 con 0x55df73b84e30 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 10 client.6006 fetch_fsmap finished waiting for FSMap version 28 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 10 client.6006 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 20 client.6006 populate_metadata read hostname 'smithi059' 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55df73b98740 0x55df73becfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 4 client.6006 mds_command: new command op to 5769 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 -- 172.21.15.59:0/3115482169 --> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55df73991530 con 0x55df73b98740 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f09200640 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55df73b98740 0x55df73becfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f09200640 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55df73b98740 0x55df73becfe0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=738f2d722ba637bb server_cookie=6bab6407d3bcb900 in_seq=0 out_seq=0 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6eea000640 10 client.6006 ms_handle_connect on v2:172.21.15.59:6833/2578168283 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6eea000640 1 -- 172.21.15.59:0/3115482169 <== mds.0 v2:172.21.15.59:6833/2578168283 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55df73991530 con 0x55df73b98740 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6eea000640 10 client.6006 handle_command_reply: tid=0 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 client.6006 shutdown 2024-04-25T09:04:11.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 -- 172.21.15.59:0/3115482169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 msgr2=0x55df73b97810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 0x55df73b97810 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6ef00144e0 tx=0x7f6ef0004740 comp rx=0 tx=0).stop 2024-04-25T09:04:11.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 -- 172.21.15.59:0/3115482169 shutdown_connections 2024-04-25T09:04:11.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.59:6833/2578168283,v1:172.21.15.59:6835/2578168283] conn(0x55df73b98740 0x55df73becfe0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55df73b85750 0x55df73b97d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55df73b84e30 0x55df73b97810 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6eea000640 0 client.6006 ms_handle_reset on v2:172.21.15.59:6833/2578168283 2024-04-25T09:04:11.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 --2- 172.21.15.59:0/3115482169 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55df73b3b4b0 0x55df73b972d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 -- 172.21.15.59:0/3115482169 >> 172.21.15.59:0/3115482169 conn(0x55df73b33020 msgr2=0x55df73b92420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 -- 172.21.15.59:0/3115482169 shutdown_connections 2024-04-25T09:04:11.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.254+0000 7f6f0f17d000 1 -- 172.21.15.59:0/3115482169 wait complete. 2024-04-25T09:04:11.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0f17d000 20 client.6006 trim_cache size 0 max 16384 2024-04-25T09:04:11.253 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:04:11.253 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-04-25T09:04:11.253 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2024-04-25T09:04:11.253 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:04:11.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0a600640 1 -- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ee4066f60 msgr2=0x7f6ee4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0a600640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ee4066f60 0x7f6ee4069420 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6f041f7730 tx=0x7f6ef0008040 comp rx=0 tx=0).stop 2024-04-25T09:04:11.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0a600640 1 -- 172.21.15.59:0/3267377388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f040b0c90 msgr2=0x7f6f0413cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0a600640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f040b0c90 0x7f6f0413cc90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6ef800c4b0 tx=0x7f6ef800c970 comp rx=0 tx=0).stop 2024-04-25T09:04:11.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0a600640 1 -- 172.21.15.59:0/3267377388 shutdown_connections 2024-04-25T09:04:11.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0a600640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ee4066f60 0x7f6ee4069420 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0a600640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f04144e20 0x7f6f040cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0a600640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f040b4190 0x7f6f04155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0a600640 1 --2- 172.21.15.59:0/3267377388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f040b0c90 0x7f6f0413cc90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0a600640 1 -- 172.21.15.59:0/3267377388 >> 172.21.15.59:0/3267377388 conn(0x7f6f04066fa0 msgr2=0x7f6f04155060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0a600640 1 -- 172.21.15.59:0/3267377388 shutdown_connections 2024-04-25T09:04:11.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.258+0000 7f6f0a600640 1 -- 172.21.15.59:0/3267377388 wait complete. 2024-04-25T09:04:11.268 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:04:11.370 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:11.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.518+0000 7fc7fd600640 1 Processor -- start 2024-04-25T09:04:11.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.518+0000 7fc7fd600640 1 -- start start 2024-04-25T09:04:11.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.518+0000 7fc7fd600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7f8145270 0x7fc7f815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.518+0000 7fc7fd600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc7f80cd4d0 0x7fc7f80cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.518+0000 7fc7fd600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f80cc4e0 con 0x7fc7f80b1750 2024-04-25T09:04:11.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.518+0000 7fc7fd600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f8145650 con 0x7fc7f80cd4d0 2024-04-25T09:04:11.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.518+0000 7fc7fd600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80ce040 con 0x7fc7f8145270 2024-04-25T09:04:11.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7f6a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7f8145270 0x7fc7f815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7ee000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc7f80cd4d0 0x7fc7f80cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7ee000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc7f80cd4d0 0x7fc7f80cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:55006/0 (socket says 172.21.15.59:55006) 2024-04-25T09:04:11.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7ee000640 1 -- 172.21.15.59:0/2405396266 learned_addr learned my addr 172.21.15.59:0/2405396266 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:11.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7f6a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7f8145270 0x7fc7f815fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:35656/0 (socket says 172.21.15.59:35656) 2024-04-25T09:04:11.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7f7400640 1 --1- 172.21.15.59:0/2405396266 >> v1:172.21.15.178:6789/0 conn(0x7fc7f80b1750 0x7fc7f815bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:40220/0 (socket says 172.21.15.59:40220) 2024-04-25T09:04:11.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7ee000640 1 -- 172.21.15.59:0/2405396266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7f8145270 msgr2=0x7fc7f815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7ee000640 1 --2- 172.21.15.59:0/2405396266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7f8145270 0x7fc7f815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7ee000640 1 -- 172.21.15.59:0/2405396266 >> v1:172.21.15.178:6789/0 conn(0x7fc7f80b1750 legacy=0x7fc7f815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7ee000640 1 -- 172.21.15.59:0/2405396266 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80ce320 con 0x7fc7f80cd4d0 2024-04-25T09:04:11.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7ee000640 1 --2- 172.21.15.59:0/2405396266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7f80cd4d0 0x7fc7f80cd930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009e50 tx=0x7fc7e001ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cda5c1d8c41f3583 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7f6000640 1 -- 172.21.15.59:0/2405396266 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00a57f0 con 0x7fc7f80cd4d0 2024-04-25T09:04:11.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7f6000640 1 -- 172.21.15.59:0/2405396266 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e00a5990 con 0x7fc7f80cd4d0 2024-04-25T09:04:11.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.522+0000 7fc7f6000640 1 -- 172.21.15.59:0/2405396266 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00a5d60 con 0x7fc7f80cd4d0 2024-04-25T09:04:11.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 -- 172.21.15.59:0/2405396266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7f80cd4d0 msgr2=0x7fc7f80cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 --2- 172.21.15.59:0/2405396266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7f80cd4d0 0x7fc7f80cd930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009e50 tx=0x7fc7e001ca30 comp rx=0 tx=0).stop 2024-04-25T09:04:11.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 -- 172.21.15.59:0/2405396266 shutdown_connections 2024-04-25T09:04:11.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 --2- 172.21.15.59:0/2405396266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7f80cd4d0 0x7fc7f80cd930 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 --2- 172.21.15.59:0/2405396266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7f8145270 0x7fc7f815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 -- 172.21.15.59:0/2405396266 >> 172.21.15.59:0/2405396266 conn(0x7fc7f8066fa0 msgr2=0x7fc7f806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 -- 172.21.15.59:0/2405396266 shutdown_connections 2024-04-25T09:04:11.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 -- 172.21.15.59:0/2405396266 wait complete. 2024-04-25T09:04:11.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 Processor -- start 2024-04-25T09:04:11.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 -- start start 2024-04-25T09:04:11.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7f80b1750 0x7fc7f80b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7f80cd4d0 0x7fc7f814bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7f8145270 0x7fc7f80b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80b1f70 con 0x7fc7f80b1750 2024-04-25T09:04:11.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8168710 con 0x7fc7f8145270 2024-04-25T09:04:11.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7fd600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f81401c0 con 0x7fc7f80cd4d0 2024-04-25T09:04:11.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7f6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7f80b1750 0x7fc7f80b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7f6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7f80b1750 0x7fc7f80b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46846/0 (socket says 172.21.15.59:46846) 2024-04-25T09:04:11.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7f6a00640 1 -- 172.21.15.59:0/523084110 learned_addr learned my addr 172.21.15.59:0/523084110 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:11.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7ee000640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7f80cd4d0 0x7fc7f814bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.526+0000 7fc7f7400640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7f8145270 0x7fc7f80b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7f6a00640 1 -- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7f80cd4d0 msgr2=0x7fc7f814bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7f6a00640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7f80cd4d0 0x7fc7f814bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7f6a00640 1 -- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7f8145270 msgr2=0x7fc7f80b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7f6a00640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7f8145270 0x7fc7f80b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7f6a00640 1 -- 172.21.15.59:0/523084110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f81404a0 con 0x7fc7f80b1750 2024-04-25T09:04:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7f7400640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7f8145270 0x7fc7f80b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7f6a00640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7f80b1750 0x7fc7f80b45f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800e8a0 tx=0x7fc7e800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7ef400640 1 -- 172.21.15.59:0/523084110 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8017070 con 0x7fc7f80b1750 2024-04-25T09:04:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7ef400640 1 -- 172.21.15.59:0/523084110 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e800c940 con 0x7fc7f80b1750 2024-04-25T09:04:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7fd600640 1 -- 172.21.15.59:0/523084110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f8140780 con 0x7fc7f80b1750 2024-04-25T09:04:11.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7ef400640 1 -- 172.21.15.59:0/523084110 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e800ccf0 con 0x7fc7f80b1750 2024-04-25T09:04:11.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7fd600640 1 -- 172.21.15.59:0/523084110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f8140d40 con 0x7fc7f80b1750 2024-04-25T09:04:11.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7fd600640 1 -- 172.21.15.59:0/523084110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f80745d0 con 0x7fc7f80b1750 2024-04-25T09:04:11.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7ef400640 1 -- 172.21.15.59:0/523084110 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc7e801a070 con 0x7fc7f80b1750 2024-04-25T09:04:11.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7ef400640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc7d4066f60 0x7fc7d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7ef400640 1 -- 172.21.15.59:0/523084110 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc7e80851a0 con 0x7fc7f80b1750 2024-04-25T09:04:11.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.530+0000 7fc7ee000640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc7d4066f60 0x7fc7d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.534+0000 7fc7ee000640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc7d4066f60 0x7fc7d4069420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00ae000 tx=0x7fc7e00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.534+0000 7fc7ef400640 1 -- 172.21.15.59:0/523084110 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc7e8055870 con 0x7fc7f80b1750 2024-04-25T09:04:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.734+0000 7fc7fd600640 1 -- 172.21.15.59:0/523084110 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7f806b8e0 con 0x7fc7f80b1750 2024-04-25T09:04:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.734+0000 7fc7ef400640 1 -- 172.21.15.59:0/523084110 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fc7e8059910 con 0x7fc7f80b1750 2024-04-25T09:04:11.728 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:11.728 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2757859141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2757859141},{"type":"v1","addr":"172.21.15.178:6836","nonce":2757859141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5626,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/447455100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":447455100},{"type":"v1","addr":"172.21.15.178:6837","nonce":447455100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4008580166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4008580166},{"type":"v1","addr":"172.21.15.59:6834","nonce":4008580166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:31.959775+0000","modified":"2024-04-25T09:03:34.974887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2578168283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2578168283},{"type":"v1","addr":"172.21.15.59:6835","nonce":2578168283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:04:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-04-25T09:04:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.738+0000 7fc7fd600640 1 -- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc7d4066f60 msgr2=0x7fc7d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.738+0000 7fc7fd600640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc7d4066f60 0x7fc7d4069420 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00ae000 tx=0x7fc7e00a7070 comp rx=0 tx=0).stop 2024-04-25T09:04:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.738+0000 7fc7fd600640 1 -- 172.21.15.59:0/523084110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7f80b1750 msgr2=0x7fc7f80b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.738+0000 7fc7fd600640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7f80b1750 0x7fc7f80b45f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800e8a0 tx=0x7fc7e800eca0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.738+0000 7fc7fd600640 1 -- 172.21.15.59:0/523084110 shutdown_connections 2024-04-25T09:04:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.738+0000 7fc7fd600640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc7d4066f60 0x7fc7d4069420 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.738+0000 7fc7fd600640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc7f8145270 0x7fc7f80b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.738+0000 7fc7fd600640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc7f80cd4d0 0x7fc7f814bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.738+0000 7fc7fd600640 1 --2- 172.21.15.59:0/523084110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7f80b1750 0x7fc7f80b45f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.738+0000 7fc7fd600640 1 -- 172.21.15.59:0/523084110 >> 172.21.15.59:0/523084110 conn(0x7fc7f8066fa0 msgr2=0x7fc7f813f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.738+0000 7fc7fd600640 1 -- 172.21.15.59:0/523084110 shutdown_connections 2024-04-25T09:04:11.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.738+0000 7fc7fd600640 1 -- 172.21.15.59:0/523084110 wait complete. 2024-04-25T09:04:11.750 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:04:11.923 INFO:teuthology.orchestra.run.smithi059.stdout:{"message":"","return_code":0} 2024-04-25T09:04:11.924 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:04:11.924 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T09:04:11.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f84449d0080 1 Processor -- start 2024-04-25T09:04:11.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f84449d0080 1 -- start start 2024-04-25T09:04:11.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f84449d0080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3dad50 0x5613ea47afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f84449d0080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613ea3f2170 0x5613ea477320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f84449d0080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5613ea47e570 0x5613ea3d85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f84449d0080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ea34d9f0 con 0x5613ea3dad50 2024-04-25T09:04:11.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f84449d0080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ea351950 con 0x5613ea3f2170 2024-04-25T09:04:11.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f84449d0080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613ea3da610 con 0x5613ea47e570 2024-04-25T09:04:11.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f8441c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3dad50 0x5613ea47afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f8441c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3dad50 0x5613ea47afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46852/0 (socket says 172.21.15.59:46852) 2024-04-25T09:04:11.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f8441c00640 1 -- 172.21.15.59:0/761794510 learned_addr learned my addr 172.21.15.59:0/761794510 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f8441200640 1 --2- 172.21.15.59:0/761794510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613ea3f2170 0x5613ea477320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f8442600640 1 --2- 172.21.15.59:0/761794510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5613ea47e570 0x5613ea3d85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f8441c00640 1 -- 172.21.15.59:0/761794510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5613ea47e570 msgr2=0x5613ea3d85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f8441c00640 1 --2- 172.21.15.59:0/761794510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5613ea47e570 0x5613ea3d85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f8441c00640 1 -- 172.21.15.59:0/761794510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613ea3f2170 msgr2=0x5613ea477320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f8441c00640 1 --2- 172.21.15.59:0/761794510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613ea3f2170 0x5613ea477320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f8441c00640 1 -- 172.21.15.59:0/761794510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613ea47b870 con 0x5613ea3dad50 2024-04-25T09:04:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f8442600640 1 --2- 172.21.15.59:0/761794510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5613ea47e570 0x5613ea3d85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.978+0000 7f8441200640 1 --2- 172.21.15.59:0/761794510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613ea3f2170 0x5613ea477320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441c00640 1 --2- 172.21.15.59:0/761794510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3dad50 0x5613ea47afd0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8434001e80 tx=0x7f843400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2c539ce399a77d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f843b400640 1 -- 172.21.15.59:0/761794510 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434012020 con 0x5613ea3dad50 2024-04-25T09:04:11.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f843b400640 1 -- 172.21.15.59:0/761794510 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843400e690 con 0x5613ea3dad50 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f843b400640 1 -- 172.21.15.59:0/761794510 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843400ea60 con 0x5613ea3dad50 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 -- 172.21.15.59:0/761794510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3dad50 msgr2=0x5613ea47afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 --2- 172.21.15.59:0/761794510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3dad50 0x5613ea47afd0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8434001e80 tx=0x7f843400b790 comp rx=0 tx=0).stop 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 -- 172.21.15.59:0/761794510 shutdown_connections 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 --2- 172.21.15.59:0/761794510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5613ea47e570 0x5613ea3d85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 --2- 172.21.15.59:0/761794510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613ea3f2170 0x5613ea477320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 --2- 172.21.15.59:0/761794510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3dad50 0x5613ea47afd0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 -- 172.21.15.59:0/761794510 >> 172.21.15.59:0/761794510 conn(0x5613ea3a7440 msgr2=0x5613ea3d9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 -- 172.21.15.59:0/761794510 shutdown_connections 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 -- 172.21.15.59:0/761794510 wait complete. 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 Processor -- start 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 -- start start 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613ea3dad50 0x5613ea476320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3f2170 0x5613ea3ed2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5613ea47e570 0x5613ea3eb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ea3ea4c0 con 0x5613ea3f2170 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613ea3ea260 con 0x5613ea3dad50 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f84449d0080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613ea3ea760 con 0x5613ea47e570 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3f2170 0x5613ea3ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613ea3dad50 0x5613ea476320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8442600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5613ea47e570 0x5613ea3eb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613ea3dad50 0x5613ea476320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:55036/0 (socket says 172.21.15.59:55036) 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441c00640 1 -- 172.21.15.59:0/2903587458 learned_addr learned my addr 172.21.15.59:0/2903587458 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3f2170 0x5613ea3ed2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46868/0 (socket says 172.21.15.59:46868) 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441200640 1 -- 172.21.15.59:0/2903587458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5613ea47e570 msgr2=0x5613ea3eb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441200640 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5613ea47e570 0x5613ea3eb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441200640 1 -- 172.21.15.59:0/2903587458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613ea3dad50 msgr2=0x5613ea476320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441200640 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613ea3dad50 0x5613ea476320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441200640 1 -- 172.21.15.59:0/2903587458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613ea3efe10 con 0x5613ea3f2170 2024-04-25T09:04:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441c00640 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5613ea3dad50 0x5613ea476320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.982+0000 7f8441200640 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3f2170 0x5613ea3ed2b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x5613ea3ae4b0 tx=0x7f8430018030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f843a000640 1 -- 172.21.15.59:0/2903587458 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300b9030 con 0x5613ea3f2170 2024-04-25T09:04:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f843a000640 1 -- 172.21.15.59:0/2903587458 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84300aa400 con 0x5613ea3f2170 2024-04-25T09:04:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f843a000640 1 -- 172.21.15.59:0/2903587458 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300af040 con 0x5613ea3f2170 2024-04-25T09:04:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f84449d0080 1 -- 172.21.15.59:0/2903587458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613ea3f00b0 con 0x5613ea3f2170 2024-04-25T09:04:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f84449d0080 1 -- 172.21.15.59:0/2903587458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613ea3f05f0 con 0x5613ea3f2170 2024-04-25T09:04:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f843a000640 1 -- 172.21.15.59:0/2903587458 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f84300bc030 con 0x5613ea3f2170 2024-04-25T09:04:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f843a000640 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8424065970 0x7f8424067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f843a000640 1 -- 172.21.15.59:0/2903587458 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f843011e540 con 0x5613ea3f2170 2024-04-25T09:04:11.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f84449d0080 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5613ea3ed7f0 0x5613ea3d4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:11.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f84449d0080 1 -- 172.21.15.59:0/2903587458 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:1 8.7 8:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e54) v9 -- 0x5613ea3d5320 con 0x5613ea3ed7f0 2024-04-25T09:04:11.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f8441c00640 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8424065970 0x7f8424067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f8442600640 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5613ea3ed7f0 0x5613ea3d4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:11.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.986+0000 7f8442600640 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5613ea3ed7f0 0x5613ea3d4de0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f8441c00640 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8424065970 0x7f8424067e30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8434011040 tx=0x7f843401b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:11.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f8442600640 1 -- 172.21.15.59:0/2903587458 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f843c0026c0 con 0x5613ea3ed7f0 2024-04-25T09:04:11.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f84449d0080 1 -- 172.21.15.59:0/2903587458 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5613ea3ed7f0 msgr2=0x5613ea3d4de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f84449d0080 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5613ea3ed7f0 0x5613ea3d4de0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:11.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f84449d0080 1 -- 172.21.15.59:0/2903587458 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8424065970 msgr2=0x7f8424067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f84449d0080 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8424065970 0x7f8424067e30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f8434011040 tx=0x7f843401b040 comp rx=0 tx=0).stop 2024-04-25T09:04:11.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f84449d0080 1 -- 172.21.15.59:0/2903587458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3f2170 msgr2=0x5613ea3ed2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:11.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f84449d0080 1 --2- 172.21.15.59:0/2903587458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5613ea3f2170 0x5613ea3ed2b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x5613ea3ae4b0 tx=0x7f8430018030 comp rx=0 tx=0).stop 2024-04-25T09:04:11.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f8442600640 1 -- 172.21.15.59:0/2903587458 reap_dead start 2024-04-25T09:04:11.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f84449d0080 1 -- 172.21.15.59:0/2903587458 shutdown_connections 2024-04-25T09:04:11.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f84449d0080 1 -- 172.21.15.59:0/2903587458 >> 172.21.15.59:0/2903587458 conn(0x5613ea3a7440 msgr2=0x5613ea47a570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:11.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f84449d0080 1 -- 172.21.15.59:0/2903587458 shutdown_connections 2024-04-25T09:04:11.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:11.990+0000 7f84449d0080 1 -- 172.21.15.59:0/2903587458 wait complete. 2024-04-25T09:04:11.988 INFO:teuthology.orchestra.run.smithi059.stdout:Yalphaparent_a 2024-04-25T09:04:11.988 DEBUG:teuthology.orchestra.run.smithi059:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T09:04:12.081 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:04:12.081 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 1099511627777, 2024-04-25T09:04:12.081 INFO:teuthology.orchestra.run.smithi059.stdout: "ancestors": [ 2024-04-25T09:04:12.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:12.081 INFO:teuthology.orchestra.run.smithi059.stdout: "dirino": 1099511627776, 2024-04-25T09:04:12.081 INFO:teuthology.orchestra.run.smithi059.stdout: "dname": "alpha", 2024-04-25T09:04:12.081 INFO:teuthology.orchestra.run.smithi059.stdout: "version": 2 2024-04-25T09:04:12.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:12.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:12.082 INFO:teuthology.orchestra.run.smithi059.stdout: "dirino": 1, 2024-04-25T09:04:12.082 INFO:teuthology.orchestra.run.smithi059.stdout: "dname": "parent_a", 2024-04-25T09:04:12.082 INFO:teuthology.orchestra.run.smithi059.stdout: "version": 4 2024-04-25T09:04:12.082 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:12.082 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-04-25T09:04:12.082 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 8, 2024-04-25T09:04:12.082 INFO:teuthology.orchestra.run.smithi059.stdout: "old_pools": [] 2024-04-25T09:04:12.082 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:04:12.082 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:12.087 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:04:12.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:12.179 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:12.286 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:04:12.286 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:04:12.286 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:12.295 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:04:12.295 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:12.344 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb749c00640 1 Processor -- start 2024-04-25T09:04:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb749c00640 1 -- start start 2024-04-25T09:04:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb749c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74415b5a0 0x7fb7440cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb749c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb7440cc440 0x7fb7440d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb749c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7440ce7f0 con 0x7fb74415b980 2024-04-25T09:04:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb749c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7440cfcd0 con 0x7fb7440cc440 2024-04-25T09:04:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb749c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440cead0 con 0x7fb74415b5a0 2024-04-25T09:04:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb742000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb74415b980 0x7fb7440cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54610/0 (socket says 172.21.15.59:54610) 2024-04-25T09:04:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb742000640 1 -- 172.21.15.59:0/4267371087 learned_addr learned my addr 172.21.15.59:0/4267371087 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb743400640 1 --2- 172.21.15.59:0/4267371087 >> v2:172.21.15.178:3300/0 conn(0x7fb7440cc440 0x7fb7440d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb742a00640 1 --2- 172.21.15.59:0/4267371087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74415b5a0 0x7fb7440cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb741600640 1 -- 172.21.15.59:0/4267371087 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3319747492 0 0) 0x7fb7440ce7f0 con 0x7fb74415b980 2024-04-25T09:04:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb741600640 1 -- 172.21.15.59:0/4267371087 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb728003530 con 0x7fb74415b980 2024-04-25T09:04:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb743400640 1 -- 172.21.15.59:0/4267371087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74415b5a0 msgr2=0x7fb7440cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb743400640 1 --2- 172.21.15.59:0/4267371087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74415b5a0 0x7fb7440cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb743400640 1 -- 172.21.15.59:0/4267371087 >> v1:172.21.15.59:6789/0 conn(0x7fb74415b980 legacy=0x7fb7440cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.538+0000 7fb743400640 1 -- 172.21.15.59:0/4267371087 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440cf960 con 0x7fb7440cc440 2024-04-25T09:04:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.542+0000 7fb743400640 1 --2- 172.21.15.59:0/4267371087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7440cc440 0x7fb7440d0160 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009d90 tx=0x7fb73c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5511ac46a281812 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.542+0000 7fb741600640 1 -- 172.21.15.59:0/4267371087 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0b2070 con 0x7fb7440cc440 2024-04-25T09:04:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.542+0000 7fb741600640 1 -- 172.21.15.59:0/4267371087 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c0a5a50 con 0x7fb7440cc440 2024-04-25T09:04:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.542+0000 7fb741600640 1 -- 172.21.15.59:0/4267371087 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0a5e00 con 0x7fb7440cc440 2024-04-25T09:04:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.542+0000 7fb749c00640 1 -- 172.21.15.59:0/4267371087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7440cc440 msgr2=0x7fb7440d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.542+0000 7fb749c00640 1 --2- 172.21.15.59:0/4267371087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7440cc440 0x7fb7440d0160 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009d90 tx=0x7fb73c01c970 comp rx=0 tx=0).stop 2024-04-25T09:04:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.542+0000 7fb749c00640 1 -- 172.21.15.59:0/4267371087 shutdown_connections 2024-04-25T09:04:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.542+0000 7fb749c00640 1 --2- 172.21.15.59:0/4267371087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb7440cc440 0x7fb7440d0160 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.542+0000 7fb749c00640 1 --2- 172.21.15.59:0/4267371087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74415b5a0 0x7fb7440cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.542+0000 7fb749c00640 1 -- 172.21.15.59:0/4267371087 >> 172.21.15.59:0/4267371087 conn(0x7fb7440b3390 msgr2=0x7fb7440b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.542+0000 7fb749c00640 1 -- 172.21.15.59:0/4267371087 shutdown_connections 2024-04-25T09:04:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.542+0000 7fb749c00640 1 -- 172.21.15.59:0/4267371087 wait complete. 2024-04-25T09:04:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb749c00640 1 Processor -- start 2024-04-25T09:04:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb749c00640 1 -- start start 2024-04-25T09:04:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb749c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7440cc440 0x7fb744145ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb749c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74415b5a0 0x7fb744146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb749c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb74415b980 0x7fb74415e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb749c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440d1240 con 0x7fb7440cc440 2024-04-25T09:04:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb749c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440d10c0 con 0x7fb74415b980 2024-04-25T09:04:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb749c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440d13c0 con 0x7fb74415b5a0 2024-04-25T09:04:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb742a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7440cc440 0x7fb744145ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb742a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7440cc440 0x7fb744145ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46884/0 (socket says 172.21.15.59:46884) 2024-04-25T09:04:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb742a00640 1 -- 172.21.15.59:0/3403272462 learned_addr learned my addr 172.21.15.59:0/3403272462 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb743400640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb74415b980 0x7fb74415e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb742000640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74415b5a0 0x7fb744146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb742a00640 1 -- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74415b5a0 msgr2=0x7fb744146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb742a00640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74415b5a0 0x7fb744146db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb742a00640 1 -- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb74415b980 msgr2=0x7fb74415e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb742a00640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb74415b980 0x7fb74415e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb742a00640 1 -- 172.21.15.59:0/3403272462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440d0160 con 0x7fb7440cc440 2024-04-25T09:04:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb742000640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74415b5a0 0x7fb744146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb743400640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb74415b980 0x7fb74415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb742a00640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7440cc440 0x7fb744145ac0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb73400e930 tx=0x7fb73400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb73aa00640 1 -- 172.21.15.59:0/3403272462 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734017070 con 0x7fb7440cc440 2024-04-25T09:04:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb73aa00640 1 -- 172.21.15.59:0/3403272462 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73400ca00 con 0x7fb7440cc440 2024-04-25T09:04:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb749c00640 1 -- 172.21.15.59:0/3403272462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb744147f80 con 0x7fb7440cc440 2024-04-25T09:04:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb73aa00640 1 -- 172.21.15.59:0/3403272462 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73400cdb0 con 0x7fb7440cc440 2024-04-25T09:04:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb749c00640 1 -- 172.21.15.59:0/3403272462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb744148540 con 0x7fb7440cc440 2024-04-25T09:04:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.546+0000 7fb749c00640 1 -- 172.21.15.59:0/3403272462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7440745d0 con 0x7fb7440cc440 2024-04-25T09:04:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.550+0000 7fb73aa00640 1 -- 172.21.15.59:0/3403272462 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb73401a070 con 0x7fb7440cc440 2024-04-25T09:04:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.550+0000 7fb73aa00640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb724066f90 0x7fb724069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.550+0000 7fb73aa00640 1 -- 172.21.15.59:0/3403272462 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb734085670 con 0x7fb7440cc440 2024-04-25T09:04:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.550+0000 7fb742000640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb724066f90 0x7fb724069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.550+0000 7fb742000640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb724066f90 0x7fb724069450 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb7441501b0 tx=0x7fb730009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.554+0000 7fb73aa00640 1 -- 172.21.15.59:0/3403272462 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb7340564e0 con 0x7fb7440cc440 2024-04-25T09:04:12.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 -- 172.21.15.59:0/3403272462 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7440cc960 con 0x7fb7440cc440 2024-04-25T09:04:12.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb73aa00640 1 -- 172.21.15.59:0/3403272462 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17038 (secure 0 0 0) 0x7fb734055de0 con 0x7fb7440cc440 2024-04-25T09:04:12.714 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:12.714 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":54,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:04:09.803369+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.385704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:30.953332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.21","mappings":[{"from":0,"to":6}]},{"pgid":"8.23","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 -- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb724066f90 msgr2=0x7fb724069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb724066f90 0x7fb724069450 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb7441501b0 tx=0x7fb730009040 comp rx=0 tx=0).stop 2024-04-25T09:04:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 -- 172.21.15.59:0/3403272462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7440cc440 msgr2=0x7fb744145ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7440cc440 0x7fb744145ac0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb73400e930 tx=0x7fb73400edf0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 -- 172.21.15.59:0/3403272462 shutdown_connections 2024-04-25T09:04:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb724066f90 0x7fb724069450 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb74415b980 0x7fb74415e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74415b5a0 0x7fb744146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 --2- 172.21.15.59:0/3403272462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7440cc440 0x7fb744145ac0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 -- 172.21.15.59:0/3403272462 >> 172.21.15.59:0/3403272462 conn(0x7fb7440b3390 msgr2=0x7fb7440b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 -- 172.21.15.59:0/3403272462 shutdown_connections 2024-04-25T09:04:12.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.722+0000 7fb749c00640 1 -- 172.21.15.59:0/3403272462 wait complete. 2024-04-25T09:04:12.735 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:03:30.385704+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:03:30.953332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:12.736 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.886+0000 7fa9cd800640 1 Processor -- start 2024-04-25T09:04:12.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.886+0000 7fa9cd800640 1 -- start start 2024-04-25T09:04:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.886+0000 7fa9cd800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9c8144120 0x7fa9c815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.886+0000 7fa9cd800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9c80ccbf0 0x7fa9c815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.886+0000 7fa9cd800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9c815bc40 con 0x7fa9c815ee60 2024-04-25T09:04:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.886+0000 7fa9cd800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c815e490 con 0x7fa9c80ccbf0 2024-04-25T09:04:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.886+0000 7fa9cd800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c815b3a0 con 0x7fa9c8144120 2024-04-25T09:04:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.890+0000 7fa9be000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9c80ccbf0 0x7fa9c815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.890+0000 7fa9be000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa9c80ccbf0 0x7fa9c815e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46890/0 (socket says 172.21.15.59:46890) 2024-04-25T09:04:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.890+0000 7fa9be000640 1 -- 172.21.15.59:0/1568200126 learned_addr learned my addr 172.21.15.59:0/1568200126 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.890+0000 7fa9c6a00640 1 --2- 172.21.15.59:0/1568200126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9c8144120 0x7fa9c815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.890+0000 7fa9be000640 1 -- 172.21.15.59:0/1568200126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9c8144120 msgr2=0x7fa9c815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.890+0000 7fa9be000640 1 --2- 172.21.15.59:0/1568200126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9c8144120 0x7fa9c815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.890+0000 7fa9be000640 1 -- 172.21.15.59:0/1568200126 >> v1:172.21.15.178:6789/0 conn(0x7fa9c815ee60 legacy=0x7fa9c80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.890+0000 7fa9be000640 1 -- 172.21.15.59:0/1568200126 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c815b680 con 0x7fa9c80ccbf0 2024-04-25T09:04:12.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.890+0000 7fa9be000640 1 --2- 172.21.15.59:0/1568200126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9c80ccbf0 0x7fa9c815e920 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000bb10 tx=0x7fa9b001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a2e13a0256872f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.890+0000 7fa9c6000640 1 -- 172.21.15.59:0/1568200126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00b4070 con 0x7fa9c80ccbf0 2024-04-25T09:04:12.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.890+0000 7fa9c6000640 1 -- 172.21.15.59:0/1568200126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b00a7a70 con 0x7fa9c80ccbf0 2024-04-25T09:04:12.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.890+0000 7fa9c6000640 1 -- 172.21.15.59:0/1568200126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00a7e40 con 0x7fa9c80ccbf0 2024-04-25T09:04:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 -- 172.21.15.59:0/1568200126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9c80ccbf0 msgr2=0x7fa9c815e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 --2- 172.21.15.59:0/1568200126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9c80ccbf0 0x7fa9c815e920 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000bb10 tx=0x7fa9b001eba0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 -- 172.21.15.59:0/1568200126 shutdown_connections 2024-04-25T09:04:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 --2- 172.21.15.59:0/1568200126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9c80ccbf0 0x7fa9c815e920 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 --2- 172.21.15.59:0/1568200126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9c8144120 0x7fa9c815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 -- 172.21.15.59:0/1568200126 >> 172.21.15.59:0/1568200126 conn(0x7fa9c8067080 msgr2=0x7fa9c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 -- 172.21.15.59:0/1568200126 shutdown_connections 2024-04-25T09:04:12.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 -- 172.21.15.59:0/1568200126 wait complete. 2024-04-25T09:04:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 Processor -- start 2024-04-25T09:04:12.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 -- start start 2024-04-25T09:04:12.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9c80ccbf0 0x7fa9c8159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9c8144120 0x7fa9c8159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9c815ee60 0x7fa9c80af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c806dc60 con 0x7fa9c8144120 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c806dae0 con 0x7fa9c815ee60 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9cd800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c806dde0 con 0x7fa9c80ccbf0 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9be000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9c8144120 0x7fa9c8159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9be000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9c8144120 0x7fa9c8159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46906/0 (socket says 172.21.15.59:46906) 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9be000640 1 -- 172.21.15.59:0/656418000 learned_addr learned my addr 172.21.15.59:0/656418000 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9c6a00640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9c80ccbf0 0x7fa9c8159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9c7400640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9c815ee60 0x7fa9c80af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9be000640 1 -- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9c80ccbf0 msgr2=0x7fa9c8159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9be000640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9c80ccbf0 0x7fa9c8159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9be000640 1 -- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9c815ee60 msgr2=0x7fa9c80af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9be000640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9c815ee60 0x7fa9c80af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9be000640 1 -- 172.21.15.59:0/656418000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c815d4a0 con 0x7fa9c8144120 2024-04-25T09:04:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.894+0000 7fa9c7400640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9c815ee60 0x7fa9c80af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.898+0000 7fa9be000640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9c8144120 0x7fa9c8159f80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000b2c0 tx=0x7fa9b001b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.898+0000 7fa9bf400640 1 -- 172.21.15.59:0/656418000 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00be020 con 0x7fa9c8144120 2024-04-25T09:04:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.898+0000 7fa9bf400640 1 -- 172.21.15.59:0/656418000 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b00afcc0 con 0x7fa9c8144120 2024-04-25T09:04:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.898+0000 7fa9bf400640 1 -- 172.21.15.59:0/656418000 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b00b4040 con 0x7fa9c8144120 2024-04-25T09:04:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.898+0000 7fa9cd800640 1 -- 172.21.15.59:0/656418000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c815a4c0 con 0x7fa9c8144120 2024-04-25T09:04:12.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.898+0000 7fa9cd800640 1 -- 172.21.15.59:0/656418000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c813cd30 con 0x7fa9c8144120 2024-04-25T09:04:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.898+0000 7fa9cd800640 1 -- 172.21.15.59:0/656418000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c80745d0 con 0x7fa9c8144120 2024-04-25T09:04:12.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.898+0000 7fa9bf400640 1 -- 172.21.15.59:0/656418000 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa9b00c1020 con 0x7fa9c8144120 2024-04-25T09:04:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.898+0000 7fa9bf400640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa9a4066f60 0x7fa9a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.898+0000 7fa9bf400640 1 -- 172.21.15.59:0/656418000 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa9b01221b0 con 0x7fa9c8144120 2024-04-25T09:04:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.898+0000 7fa9c6a00640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa9a4066f60 0x7fa9a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:12.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.902+0000 7fa9c6a00640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa9a4066f60 0x7fa9a4069420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80b1e40 tx=0x7fa9b80098a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:12.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:12.902+0000 7fa9bf400640 1 -- 172.21.15.59:0/656418000 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa9b00c8030 con 0x7fa9c8144120 2024-04-25T09:04:13.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.066+0000 7fa9cd800640 1 -- 172.21.15.59:0/656418000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9c81412f0 con 0x7fa9c8144120 2024-04-25T09:04:13.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.066+0000 7fa9bf400640 1 -- 172.21.15.59:0/656418000 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9b0018820 con 0x7fa9c8144120 2024-04-25T09:04:13.059 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:04:13.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.066+0000 7fa9cd800640 1 -- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa9a4066f60 msgr2=0x7fa9a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.066+0000 7fa9cd800640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa9a4066f60 0x7fa9a4069420 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa9c80b1e40 tx=0x7fa9b80098a0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.066+0000 7fa9cd800640 1 -- 172.21.15.59:0/656418000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9c8144120 msgr2=0x7fa9c8159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.066+0000 7fa9cd800640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9c8144120 0x7fa9c8159f80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fa9b000b2c0 tx=0x7fa9b001b940 comp rx=0 tx=0).stop 2024-04-25T09:04:13.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.070+0000 7fa9cd800640 1 -- 172.21.15.59:0/656418000 shutdown_connections 2024-04-25T09:04:13.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.070+0000 7fa9cd800640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa9a4066f60 0x7fa9a4069420 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.070+0000 7fa9cd800640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa9c815ee60 0x7fa9c80af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.070+0000 7fa9cd800640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9c8144120 0x7fa9c8159f80 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.070+0000 7fa9cd800640 1 --2- 172.21.15.59:0/656418000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa9c80ccbf0 0x7fa9c8159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.070+0000 7fa9cd800640 1 -- 172.21.15.59:0/656418000 >> 172.21.15.59:0/656418000 conn(0x7fa9c8067080 msgr2=0x7fa9c806e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.070+0000 7fa9cd800640 1 -- 172.21.15.59:0/656418000 shutdown_connections 2024-04-25T09:04:13.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.070+0000 7fa9cd800640 1 -- 172.21.15.59:0/656418000 wait complete. 2024-04-25T09:04:13.080 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:13.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.230+0000 7f6c3d600640 1 Processor -- start 2024-04-25T09:04:13.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.230+0000 7f6c3d600640 1 -- start start 2024-04-25T09:04:13.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.234+0000 7f6c3d600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c38099a60 0x7f6c3806c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.234+0000 7f6c3d600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3806ca00 con 0x7f6c380cf350 2024-04-25T09:04:13.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.234+0000 7f6c3d600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3806cce0 con 0x7f6c3815ddb0 2024-04-25T09:04:13.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.234+0000 7f6c3d600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3806cfc0 con 0x7f6c38099a60 2024-04-25T09:04:13.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.234+0000 7f6c37e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c38099a60 0x7f6c3806c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.234+0000 7f6c3cc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6c380cf350 0x7f6c380cf780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54614/0 (socket says 172.21.15.59:54614) 2024-04-25T09:04:13.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.234+0000 7f6c3cc00640 1 -- 172.21.15.59:0/4162176964 learned_addr learned my addr 172.21.15.59:0/4162176964 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:13.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.234+0000 7f6c37e00640 1 -- 172.21.15.59:0/4162176964 >> v1:172.21.15.178:6789/0 conn(0x7f6c3815ddb0 legacy=0x7f6c38099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.234+0000 7f6c37e00640 1 -- 172.21.15.59:0/4162176964 >> v1:172.21.15.59:6789/0 conn(0x7f6c380cf350 legacy=0x7f6c380cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.234+0000 7f6c37e00640 1 -- 172.21.15.59:0/4162176964 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3806d2a0 con 0x7f6c38099a60 2024-04-25T09:04:13.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c37e00640 1 --2- 172.21.15.59:0/4162176964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c38099a60 0x7f6c3806c320 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097f0 tx=0x7f6c2801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe025d06a3de3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c37400640 1 -- 172.21.15.59:0/4162176964 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280aa5f0 con 0x7f6c38099a60 2024-04-25T09:04:13.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c37400640 1 -- 172.21.15.59:0/4162176964 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c280af070 con 0x7f6c38099a60 2024-04-25T09:04:13.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c37400640 1 -- 172.21.15.59:0/4162176964 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280aa9b0 con 0x7f6c38099a60 2024-04-25T09:04:13.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c3d600640 1 -- 172.21.15.59:0/4162176964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c38099a60 msgr2=0x7f6c3806c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c3d600640 1 --2- 172.21.15.59:0/4162176964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c38099a60 0x7f6c3806c320 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6c280097f0 tx=0x7f6c2801c470 comp rx=0 tx=0).stop 2024-04-25T09:04:13.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c3d600640 1 -- 172.21.15.59:0/4162176964 shutdown_connections 2024-04-25T09:04:13.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c3d600640 1 --2- 172.21.15.59:0/4162176964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c38099a60 0x7f6c3806c320 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c3d600640 1 -- 172.21.15.59:0/4162176964 >> 172.21.15.59:0/4162176964 conn(0x7f6c380d15d0 msgr2=0x7f6c380d19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c3d600640 1 -- 172.21.15.59:0/4162176964 shutdown_connections 2024-04-25T09:04:13.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c3d600640 1 -- 172.21.15.59:0/4162176964 wait complete. 2024-04-25T09:04:13.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c3d600640 1 Processor -- start 2024-04-25T09:04:13.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.238+0000 7f6c3d600640 1 -- start start 2024-04-25T09:04:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c3d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c38099a60 0x7f6c380c5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c3d600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c380cf350 0x7f6c38159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c3d600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c3815ddb0 0x7f6c38150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c3d600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3816b9a0 con 0x7f6c38099a60 2024-04-25T09:04:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c3d600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3816b820 con 0x7f6c3815ddb0 2024-04-25T09:04:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c3d600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3816bb20 con 0x7f6c380cf350 2024-04-25T09:04:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c38099a60 0x7f6c380c5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c38099a60 0x7f6c380c5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46918/0 (socket says 172.21.15.59:46918) 2024-04-25T09:04:13.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c37e00640 1 -- 172.21.15.59:0/1870721626 learned_addr learned my addr 172.21.15.59:0/1870721626 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c2f400640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c380cf350 0x7f6c38159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c3cc00640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c3815ddb0 0x7f6c38150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c37e00640 1 -- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c380cf350 msgr2=0x7f6c38159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c37e00640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c380cf350 0x7f6c38159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c37e00640 1 -- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c3815ddb0 msgr2=0x7f6c38150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c37e00640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c3815ddb0 0x7f6c38150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c37e00640 1 -- 172.21.15.59:0/1870721626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c38154ec0 con 0x7f6c38099a60 2024-04-25T09:04:13.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c2f400640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c380cf350 0x7f6c38159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c37e00640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c38099a60 0x7f6c380c5170 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6c280ac040 tx=0x7f6c2801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c34c00640 1 -- 172.21.15.59:0/1870721626 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280be610 con 0x7f6c38099a60 2024-04-25T09:04:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c34c00640 1 -- 172.21.15.59:0/1870721626 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c280be7b0 con 0x7f6c38099a60 2024-04-25T09:04:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c34c00640 1 -- 172.21.15.59:0/1870721626 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c280beba0 con 0x7f6c38099a60 2024-04-25T09:04:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c3d600640 1 -- 172.21.15.59:0/1870721626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c381551a0 con 0x7f6c38099a60 2024-04-25T09:04:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c3d600640 1 -- 172.21.15.59:0/1870721626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c38155760 con 0x7f6c38099a60 2024-04-25T09:04:13.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c3d600640 1 -- 172.21.15.59:0/1870721626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c38068670 con 0x7f6c38099a60 2024-04-25T09:04:13.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.242+0000 7f6c34c00640 1 -- 172.21.15.59:0/1870721626 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6c280bc020 con 0x7f6c38099a60 2024-04-25T09:04:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.246+0000 7f6c34c00640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c14066f60 0x7f6c14069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.246+0000 7f6c34c00640 1 -- 172.21.15.59:0/1870721626 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6c2811f780 con 0x7f6c38099a60 2024-04-25T09:04:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.246+0000 7f6c2f400640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c14066f60 0x7f6c14069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.246+0000 7f6c2f400640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c14066f60 0x7f6c14069420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6c38070ff0 tx=0x7f6c20009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.250+0000 7f6c34c00640 1 -- 172.21.15.59:0/1870721626 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6c28016090 con 0x7f6c38099a60 2024-04-25T09:04:13.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.410+0000 7f6c3d600640 1 -- 172.21.15.59:0/1870721626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c380745d0 con 0x7f6c38099a60 2024-04-25T09:04:13.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.410+0000 7f6c34c00640 1 -- 172.21.15.59:0/1870721626 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c280efee0 con 0x7f6c38099a60 2024-04-25T09:04:13.406 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:04:13.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.414+0000 7f6c3d600640 1 -- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c14066f60 msgr2=0x7f6c14069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.414+0000 7f6c3d600640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c14066f60 0x7f6c14069420 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6c38070ff0 tx=0x7f6c20009040 comp rx=0 tx=0).stop 2024-04-25T09:04:13.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.414+0000 7f6c3d600640 1 -- 172.21.15.59:0/1870721626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c38099a60 msgr2=0x7f6c380c5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.414+0000 7f6c3d600640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c38099a60 0x7f6c380c5170 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6c280ac040 tx=0x7f6c2801acb0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.414+0000 7f6c3d600640 1 -- 172.21.15.59:0/1870721626 shutdown_connections 2024-04-25T09:04:13.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.414+0000 7f6c3d600640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c14066f60 0x7f6c14069420 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.414+0000 7f6c3d600640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c3815ddb0 0x7f6c38150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.414+0000 7f6c3d600640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c380cf350 0x7f6c38159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.414+0000 7f6c3d600640 1 --2- 172.21.15.59:0/1870721626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c38099a60 0x7f6c380c5170 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.414+0000 7f6c3d600640 1 -- 172.21.15.59:0/1870721626 >> 172.21.15.59:0/1870721626 conn(0x7f6c380d15d0 msgr2=0x7f6c380736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.414+0000 7f6c3d600640 1 -- 172.21.15.59:0/1870721626 shutdown_connections 2024-04-25T09:04:13.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.414+0000 7f6c3d600640 1 -- 172.21.15.59:0/1870721626 wait complete. 2024-04-25T09:04:13.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:13.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.574+0000 7effc7c00640 1 Processor -- start 2024-04-25T09:04:13.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.574+0000 7effc7c00640 1 -- start start 2024-04-25T09:04:13.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effc7c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effc009a170 0x7effc00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effc7c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7effc006bf30 0x7effc00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effc7c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc015e040 con 0x7effc015dc60 2024-04-25T09:04:13.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effc7c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc00cff80 con 0x7effc009a170 2024-04-25T09:04:13.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effc7c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc00d0260 con 0x7effc006bf30 2024-04-25T09:04:13.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effbfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effc009a170 0x7effc00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effc5200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7effc015dc60 0x7effc0099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54616/0 (socket says 172.21.15.59:54616) 2024-04-25T09:04:13.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effc5200640 1 -- 172.21.15.59:0/1340281280 learned_addr learned my addr 172.21.15.59:0/1340281280 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:13.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effc5c00640 1 --2- 172.21.15.59:0/1340281280 >> v2:172.21.15.178:3300/0 conn(0x7effc006bf30 0x7effc00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effbfe00640 1 -- 172.21.15.59:0/1340281280 >> v2:172.21.15.178:3300/0 conn(0x7effc006bf30 msgr2=0x7effc00cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:13.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effbfe00640 1 --2- 172.21.15.59:0/1340281280 >> v2:172.21.15.178:3300/0 conn(0x7effc006bf30 0x7effc00cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effbfe00640 1 -- 172.21.15.59:0/1340281280 >> v1:172.21.15.59:6789/0 conn(0x7effc015dc60 legacy=0x7effc0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.578+0000 7effbfe00640 1 -- 172.21.15.59:0/1340281280 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc00d0540 con 0x7effc009a170 2024-04-25T09:04:13.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effbfe00640 1 --2- 172.21.15.59:0/1340281280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc009a170 0x7effc00d1020 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7effc0071e60 tx=0x7effac01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56465578ee12ff12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effbf400640 1 -- 172.21.15.59:0/1340281280 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0b0070 con 0x7effc009a170 2024-04-25T09:04:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effbf400640 1 -- 172.21.15.59:0/1340281280 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0ab600 con 0x7effc009a170 2024-04-25T09:04:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effbf400640 1 -- 172.21.15.59:0/1340281280 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0ab9d0 con 0x7effc009a170 2024-04-25T09:04:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effc7c00640 1 -- 172.21.15.59:0/1340281280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc009a170 msgr2=0x7effc00d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effc7c00640 1 --2- 172.21.15.59:0/1340281280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc009a170 0x7effc00d1020 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7effc0071e60 tx=0x7effac01c330 comp rx=0 tx=0).stop 2024-04-25T09:04:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effc7c00640 1 -- 172.21.15.59:0/1340281280 shutdown_connections 2024-04-25T09:04:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effc7c00640 1 --2- 172.21.15.59:0/1340281280 >> v2:172.21.15.178:3300/0 conn(0x7effc006bf30 0x7effc00cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effc7c00640 1 --2- 172.21.15.59:0/1340281280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc009a170 0x7effc00d1020 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effc7c00640 1 -- 172.21.15.59:0/1340281280 >> 172.21.15.59:0/1340281280 conn(0x7effc00b3200 msgr2=0x7effc00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effc7c00640 1 -- 172.21.15.59:0/1340281280 shutdown_connections 2024-04-25T09:04:13.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effc7c00640 1 -- 172.21.15.59:0/1340281280 wait complete. 2024-04-25T09:04:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effc7c00640 1 Processor -- start 2024-04-25T09:04:13.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.582+0000 7effc7c00640 1 -- start start 2024-04-25T09:04:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effc7c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effc006bf30 0x7effc0153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effc7c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc009a170 0x7effc015f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effc7c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effc015dc60 0x7effc00caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effc7c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc00cc6f0 con 0x7effc009a170 2024-04-25T09:04:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effc7c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc00cc570 con 0x7effc006bf30 2024-04-25T09:04:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effc7c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc00cc870 con 0x7effc015dc60 2024-04-25T09:04:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc009a170 0x7effc015f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc009a170 0x7effc015f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46932/0 (socket says 172.21.15.59:46932) 2024-04-25T09:04:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbfe00640 1 -- 172.21.15.59:0/949412681 learned_addr learned my addr 172.21.15.59:0/949412681 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effc5c00640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effc015dc60 0x7effc00caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effc5200640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effc006bf30 0x7effc0153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbfe00640 1 -- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effc015dc60 msgr2=0x7effc00caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbfe00640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effc015dc60 0x7effc00caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbfe00640 1 -- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effc006bf30 msgr2=0x7effc0153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbfe00640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effc006bf30 0x7effc0153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbfe00640 1 -- 172.21.15.59:0/949412681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc00c9e50 con 0x7effc009a170 2024-04-25T09:04:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effc5200640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effc006bf30 0x7effc0153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbfe00640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc009a170 0x7effc015f520 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7effac0ae040 tx=0x7effac0190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbcc00640 1 -- 172.21.15.59:0/949412681 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0b8020 con 0x7effc009a170 2024-04-25T09:04:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbcc00640 1 -- 172.21.15.59:0/949412681 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0b4630 con 0x7effc009a170 2024-04-25T09:04:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effc7c00640 1 -- 172.21.15.59:0/949412681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc00ca130 con 0x7effc009a170 2024-04-25T09:04:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbcc00640 1 -- 172.21.15.59:0/949412681 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac0b0040 con 0x7effc009a170 2024-04-25T09:04:13.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effc7c00640 1 -- 172.21.15.59:0/949412681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc00ca6f0 con 0x7effc009a170 2024-04-25T09:04:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effc7c00640 1 -- 172.21.15.59:0/949412681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc00745d0 con 0x7effc009a170 2024-04-25T09:04:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbcc00640 1 -- 172.21.15.59:0/949412681 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7effac0bb020 con 0x7effc009a170 2024-04-25T09:04:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.586+0000 7effbcc00640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effa0066f60 0x7effa0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.590+0000 7effbcc00640 1 -- 172.21.15.59:0/949412681 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7effac11eee0 con 0x7effc009a170 2024-04-25T09:04:13.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.590+0000 7effc5200640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effa0066f60 0x7effa0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.590+0000 7effc5200640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effa0066f60 0x7effa0069420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7effc009e890 tx=0x7effb4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.590+0000 7effbcc00640 1 -- 172.21.15.59:0/949412681 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7effac0c2030 con 0x7effc009a170 2024-04-25T09:04:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.754+0000 7effc7c00640 1 -- 172.21.15.59:0/949412681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effc00b7590 con 0x7effc009a170 2024-04-25T09:04:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.754+0000 7effbcc00640 1 -- 172.21.15.59:0/949412681 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7effac016070 con 0x7effc009a170 2024-04-25T09:04:13.748 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:04:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.758+0000 7effc7c00640 1 -- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effa0066f60 msgr2=0x7effa0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.758+0000 7effc7c00640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effa0066f60 0x7effa0069420 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7effc009e890 tx=0x7effb4009040 comp rx=0 tx=0).stop 2024-04-25T09:04:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.758+0000 7effc7c00640 1 -- 172.21.15.59:0/949412681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc009a170 msgr2=0x7effc015f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.758+0000 7effc7c00640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc009a170 0x7effc015f520 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7effac0ae040 tx=0x7effac0190d0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.758+0000 7effc7c00640 1 -- 172.21.15.59:0/949412681 shutdown_connections 2024-04-25T09:04:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.758+0000 7effc7c00640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effa0066f60 0x7effa0069420 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.758+0000 7effc7c00640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effc015dc60 0x7effc00caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.758+0000 7effc7c00640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc009a170 0x7effc015f520 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.758+0000 7effc7c00640 1 --2- 172.21.15.59:0/949412681 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effc006bf30 0x7effc0153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.758+0000 7effc7c00640 1 -- 172.21.15.59:0/949412681 >> 172.21.15.59:0/949412681 conn(0x7effc00b3200 msgr2=0x7effc00ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.758+0000 7effc7c00640 1 -- 172.21.15.59:0/949412681 shutdown_connections 2024-04-25T09:04:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.758+0000 7effc7c00640 1 -- 172.21.15.59:0/949412681 wait complete. 2024-04-25T09:04:13.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:04:13.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.918+0000 7f1fef800640 1 Processor -- start 2024-04-25T09:04:13.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.918+0000 7f1fef800640 1 -- start start 2024-04-25T09:04:13.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.918+0000 7f1fef800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fe80d0150 0x7f1fe80af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fef800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe80b30d0 con 0x7f1fe815dc00 2024-04-25T09:04:13.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fef800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe80ccf30 con 0x7f1fe80c72a0 2024-04-25T09:04:13.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fef800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80cd860 con 0x7f1fe80d0150 2024-04-25T09:04:13.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fece00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1fe815dc00 0x7f1fe80c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54630/0 (socket says 172.21.15.59:54630) 2024-04-25T09:04:13.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fece00640 1 -- 172.21.15.59:0/2104185025 learned_addr learned my addr 172.21.15.59:0/2104185025 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fdfe00640 1 --2- 172.21.15.59:0/2104185025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fe80d0150 0x7f1fe80af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fe7e00640 1 -- 172.21.15.59:0/2104185025 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728047032 0 0) 0x7f1fe80b30d0 con 0x7f1fe815dc00 2024-04-25T09:04:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fe7e00640 1 -- 172.21.15.59:0/2104185025 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fcc003530 con 0x7f1fe815dc00 2024-04-25T09:04:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fe7e00640 1 -- 172.21.15.59:0/2104185025 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139514330 0 0) 0x7f1fe80ccf30 con 0x7f1fe80c72a0 2024-04-25T09:04:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fe7e00640 1 -- 172.21.15.59:0/2104185025 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe80b30d0 con 0x7f1fe80c72a0 2024-04-25T09:04:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fdfe00640 1 -- 172.21.15.59:0/2104185025 >> v1:172.21.15.178:6789/0 conn(0x7f1fe80c72a0 legacy=0x7f1fe80c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fdfe00640 1 -- 172.21.15.59:0/2104185025 >> v1:172.21.15.59:6789/0 conn(0x7f1fe815dc00 legacy=0x7f1fe80c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fdfe00640 1 -- 172.21.15.59:0/2104185025 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80cd210 con 0x7f1fe80d0150 2024-04-25T09:04:13.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.922+0000 7f1fdfe00640 1 --2- 172.21.15.59:0/2104185025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fe80d0150 0x7f1fe80af770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009820 tx=0x7f1fd001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=620341d07fa0648d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fe7e00640 1 -- 172.21.15.59:0/2104185025 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd00b1070 con 0x7f1fe80d0150 2024-04-25T09:04:13.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fe7e00640 1 -- 172.21.15.59:0/2104185025 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd00ac430 con 0x7f1fe80d0150 2024-04-25T09:04:13.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fe7e00640 1 -- 172.21.15.59:0/2104185025 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd00a8050 con 0x7f1fe80d0150 2024-04-25T09:04:13.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 -- 172.21.15.59:0/2104185025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fe80d0150 msgr2=0x7f1fe80af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 --2- 172.21.15.59:0/2104185025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fe80d0150 0x7f1fe80af770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1fd0009820 tx=0x7f1fd001c4c0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 -- 172.21.15.59:0/2104185025 shutdown_connections 2024-04-25T09:04:13.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 --2- 172.21.15.59:0/2104185025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fe80d0150 0x7f1fe80af770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 -- 172.21.15.59:0/2104185025 >> 172.21.15.59:0/2104185025 conn(0x7f1fe80b2240 msgr2=0x7f1fe80b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:13.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 -- 172.21.15.59:0/2104185025 shutdown_connections 2024-04-25T09:04:13.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 -- 172.21.15.59:0/2104185025 wait complete. 2024-04-25T09:04:13.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 Processor -- start 2024-04-25T09:04:13.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 -- start start 2024-04-25T09:04:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe80c72a0 0x7f1fe8160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fe80d0150 0x7f1fe8156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fe815dc00 0x7f1fe80b5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe816b650 con 0x7f1fe80c72a0 2024-04-25T09:04:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe80cdf20 con 0x7f1fe815dc00 2024-04-25T09:04:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fef800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe816b7d0 con 0x7f1fe80d0150 2024-04-25T09:04:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fece00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe80c72a0 0x7f1fe8160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fece00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe80c72a0 0x7f1fe8160de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46944/0 (socket says 172.21.15.59:46944) 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fece00640 1 -- 172.21.15.59:0/466080886 learned_addr learned my addr 172.21.15.59:0/466080886 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.926+0000 7f1fdfe00640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fe80d0150 0x7f1fe8156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fed800640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fe815dc00 0x7f1fe80b5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fece00640 1 -- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fe80d0150 msgr2=0x7f1fe8156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fece00640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fe80d0150 0x7f1fe8156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fece00640 1 -- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fe815dc00 msgr2=0x7f1fe80b5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fece00640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fe815dc00 0x7f1fe80b5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fece00640 1 -- 172.21.15.59:0/466080886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80b2070 con 0x7f1fe80c72a0 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fed800640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fe815dc00 0x7f1fe80b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fece00640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe80c72a0 0x7f1fe8160de0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800c420 tx=0x7f1fd800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fe5600640 1 -- 172.21.15.59:0/466080886 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8017070 con 0x7f1fe80c72a0 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fe5600640 1 -- 172.21.15.59:0/466080886 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd8005cf0 con 0x7f1fe80c72a0 2024-04-25T09:04:13.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fe5600640 1 -- 172.21.15.59:0/466080886 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8007310 con 0x7f1fe80c72a0 2024-04-25T09:04:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fef800640 1 -- 172.21.15.59:0/466080886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe8066df0 con 0x7f1fe80c72a0 2024-04-25T09:04:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fef800640 1 -- 172.21.15.59:0/466080886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe815fd40 con 0x7f1fe80c72a0 2024-04-25T09:04:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fef800640 1 -- 172.21.15.59:0/466080886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fe806ccb0 con 0x7f1fe80c72a0 2024-04-25T09:04:13.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.930+0000 7f1fe5600640 1 -- 172.21.15.59:0/466080886 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1fd801a070 con 0x7f1fe80c72a0 2024-04-25T09:04:13.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.934+0000 7f1fe5600640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1fc4066f90 0x7f1fc4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:13.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.934+0000 7f1fe5600640 1 -- 172.21.15.59:0/466080886 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1fd8084510 con 0x7f1fe80c72a0 2024-04-25T09:04:13.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.934+0000 7f1fdfe00640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1fc4066f90 0x7f1fc4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:13.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.934+0000 7f1fdfe00640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1fc4066f90 0x7f1fc4069450 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00ae000 tx=0x7f1fd0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:13.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:13.938+0000 7f1fe5600640 1 -- 172.21.15.59:0/466080886 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1fd8054d10 con 0x7f1fe80c72a0 2024-04-25T09:04:14.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.110+0000 7f1fef800640 1 -- 172.21.15.59:0/466080886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1fe8160a10 con 0x7f1fe80c72a0 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.110+0000 7f1fe5600640 1 -- 172.21.15.59:0/466080886 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1fd8058db0 con 0x7f1fe80c72a0 2024-04-25T09:04:14.102 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:04:14.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.110+0000 7f1fef800640 1 -- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1fc4066f90 msgr2=0x7f1fc4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.110+0000 7f1fef800640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1fc4066f90 0x7f1fc4069450 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f1fd00ae000 tx=0x7f1fd0008040 comp rx=0 tx=0).stop 2024-04-25T09:04:14.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.110+0000 7f1fef800640 1 -- 172.21.15.59:0/466080886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe80c72a0 msgr2=0x7f1fe8160de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.110+0000 7f1fef800640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe80c72a0 0x7f1fe8160de0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800c420 tx=0x7f1fd800c8e0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.110+0000 7f1fef800640 1 -- 172.21.15.59:0/466080886 shutdown_connections 2024-04-25T09:04:14.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.110+0000 7f1fef800640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1fc4066f90 0x7f1fc4069450 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.110+0000 7f1fef800640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1fe815dc00 0x7f1fe80b5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.110+0000 7f1fef800640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1fe80d0150 0x7f1fe8156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.110+0000 7f1fef800640 1 --2- 172.21.15.59:0/466080886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1fe80c72a0 0x7f1fe8160de0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.114+0000 7f1fef800640 1 -- 172.21.15.59:0/466080886 >> 172.21.15.59:0/466080886 conn(0x7f1fe80b2240 msgr2=0x7f1fe80aed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.114+0000 7f1fef800640 1 -- 172.21.15.59:0/466080886 shutdown_connections 2024-04-25T09:04:14.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.114+0000 7f1fef800640 1 -- 172.21.15.59:0/466080886 wait complete. 2024-04-25T09:04:14.123 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:04:14.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:14.123 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:14.173 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:04:14.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:14.174 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:04:14.194 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:04:14.194 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:14.204 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:14.204 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:04:14.204 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:14.244 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:04:14.245 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:04:14.245 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:14.255 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:14.256 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc5d400640 1 Processor -- start 2024-04-25T09:04:14.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc5d400640 1 -- start start 2024-04-25T09:04:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc5d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc580cf370 0x7fdc58099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc5d400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdc5809a600 0x7fdc580cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc5d400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5809a380 con 0x7fdc58099a60 2024-04-25T09:04:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc5d400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc580d0410 con 0x7fdc580cf370 2024-04-25T09:04:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc5d400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc580cf800 con 0x7fdc5809a600 2024-04-25T09:04:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc55e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc580cf370 0x7fdc58099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc55e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc580cf370 0x7fdc58099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46954/0 (socket says 172.21.15.59:46954) 2024-04-25T09:04:14.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc55e00640 1 -- 172.21.15.59:0/4107709957 learned_addr learned my addr 172.21.15.59:0/4107709957 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:14.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc57200640 1 --2- 172.21.15.59:0/4107709957 >> v2:172.21.15.178:3300/0 conn(0x7fdc5809a600 0x7fdc580cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc55e00640 1 -- 172.21.15.59:0/4107709957 >> v2:172.21.15.178:3300/0 conn(0x7fdc5809a600 msgr2=0x7fdc580cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc55e00640 1 --2- 172.21.15.59:0/4107709957 >> v2:172.21.15.178:3300/0 conn(0x7fdc5809a600 0x7fdc580cc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc55e00640 1 -- 172.21.15.59:0/4107709957 >> v1:172.21.15.178:6789/0 conn(0x7fdc58099a60 legacy=0x7fdc5815bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.438+0000 7fdc55e00640 1 -- 172.21.15.59:0/4107709957 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc580cfae0 con 0x7fdc580cf370 2024-04-25T09:04:14.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.442+0000 7fdc55e00640 1 --2- 172.21.15.59:0/4107709957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc580cf370 0x7fdc58099e40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdc580729c0 tx=0x7fdc4401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6eda690fcf121be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.442+0000 7fdc55400640 1 -- 172.21.15.59:0/4107709957 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc440b1070 con 0x7fdc580cf370 2024-04-25T09:04:14.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.442+0000 7fdc55400640 1 -- 172.21.15.59:0/4107709957 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc440a8050 con 0x7fdc580cf370 2024-04-25T09:04:14.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.442+0000 7fdc55400640 1 -- 172.21.15.59:0/4107709957 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc440ac860 con 0x7fdc580cf370 2024-04-25T09:04:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.442+0000 7fdc5d400640 1 -- 172.21.15.59:0/4107709957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc580cf370 msgr2=0x7fdc58099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.442+0000 7fdc5d400640 1 --2- 172.21.15.59:0/4107709957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc580cf370 0x7fdc58099e40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fdc580729c0 tx=0x7fdc4401c460 comp rx=0 tx=0).stop 2024-04-25T09:04:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.442+0000 7fdc5d400640 1 -- 172.21.15.59:0/4107709957 shutdown_connections 2024-04-25T09:04:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.442+0000 7fdc5d400640 1 --2- 172.21.15.59:0/4107709957 >> v2:172.21.15.178:3300/0 conn(0x7fdc5809a600 0x7fdc580cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.442+0000 7fdc5d400640 1 --2- 172.21.15.59:0/4107709957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc580cf370 0x7fdc58099e40 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.442+0000 7fdc5d400640 1 -- 172.21.15.59:0/4107709957 >> 172.21.15.59:0/4107709957 conn(0x7fdc580d17a0 msgr2=0x7fdc580d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.442+0000 7fdc5d400640 1 -- 172.21.15.59:0/4107709957 shutdown_connections 2024-04-25T09:04:14.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.442+0000 7fdc5d400640 1 -- 172.21.15.59:0/4107709957 wait complete. 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc5d400640 1 Processor -- start 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc5d400640 1 -- start start 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc5d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58099a60 0x7fdc580cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc5d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc5809a600 0x7fdc580cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc5d400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc58151fc0 0x7fdc580705c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc5d400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580cd390 con 0x7fdc58099a60 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc5d400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580cd210 con 0x7fdc5809a600 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc5d400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580cd510 con 0x7fdc58151fc0 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc56800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58099a60 0x7fdc580cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc56800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58099a60 0x7fdc580cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46962/0 (socket says 172.21.15.59:46962) 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc56800640 1 -- 172.21.15.59:0/3168541723 learned_addr learned my addr 172.21.15.59:0/3168541723 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc55e00640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc5809a600 0x7fdc580cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc57200640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc58151fc0 0x7fdc580705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc56800640 1 -- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc58151fc0 msgr2=0x7fdc580705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc56800640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc58151fc0 0x7fdc580705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc56800640 1 -- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc5809a600 msgr2=0x7fdc580cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc56800640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc5809a600 0x7fdc580cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc56800640 1 -- 172.21.15.59:0/3168541723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc580b0b50 con 0x7fdc58099a60 2024-04-25T09:04:14.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc56800640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58099a60 0x7fdc580cad80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800c3a0 tx=0x7fdc4800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc4ea00640 1 -- 172.21.15.59:0/3168541723 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc480052d0 con 0x7fdc58099a60 2024-04-25T09:04:14.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc4ea00640 1 -- 172.21.15.59:0/3168541723 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc48005470 con 0x7fdc58099a60 2024-04-25T09:04:14.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc5d400640 1 -- 172.21.15.59:0/3168541723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc580ae540 con 0x7fdc58099a60 2024-04-25T09:04:14.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc4ea00640 1 -- 172.21.15.59:0/3168541723 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc48007260 con 0x7fdc58099a60 2024-04-25T09:04:14.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.446+0000 7fdc5d400640 1 -- 172.21.15.59:0/3168541723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc580aeb00 con 0x7fdc58099a60 2024-04-25T09:04:14.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.450+0000 7fdc5d400640 1 -- 172.21.15.59:0/3168541723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc580745d0 con 0x7fdc58099a60 2024-04-25T09:04:14.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.450+0000 7fdc4ea00640 1 -- 172.21.15.59:0/3168541723 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdc48007400 con 0x7fdc58099a60 2024-04-25T09:04:14.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.450+0000 7fdc4ea00640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdc38066f90 0x7fdc38069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.450+0000 7fdc4ea00640 1 -- 172.21.15.59:0/3168541723 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fdc480846b0 con 0x7fdc58099a60 2024-04-25T09:04:14.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.450+0000 7fdc55e00640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdc38066f90 0x7fdc38069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.450+0000 7fdc55e00640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdc38066f90 0x7fdc38069450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdc440ae000 tx=0x7fdc440a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.458+0000 7fdc4ea00640 1 -- 172.21.15.59:0/3168541723 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdc48055460 con 0x7fdc58099a60 2024-04-25T09:04:14.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.654+0000 7fdc5d400640 1 -- 172.21.15.59:0/3168541723 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc580d2620 con 0x7fdc58099a60 2024-04-25T09:04:14.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.654+0000 7fdc4ea00640 1 -- 172.21.15.59:0/3168541723 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fdc48054d60 con 0x7fdc58099a60 2024-04-25T09:04:14.647 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:14.647 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2757859141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2757859141},{"type":"v1","addr":"172.21.15.178:6836","nonce":2757859141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5626,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/447455100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":447455100},{"type":"v1","addr":"172.21.15.178:6837","nonce":447455100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4008580166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4008580166},{"type":"v1","addr":"172.21.15.59:6834","nonce":4008580166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:31.959775+0000","modified":"2024-04-25T09:03:34.974887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2578168283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2578168283},{"type":"v1","addr":"172.21.15.59:6835","nonce":2578168283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:04:14.647 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-04-25T09:04:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.658+0000 7fdc5d400640 1 -- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdc38066f90 msgr2=0x7fdc38069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.658+0000 7fdc5d400640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdc38066f90 0x7fdc38069450 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdc440ae000 tx=0x7fdc440a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.658+0000 7fdc5d400640 1 -- 172.21.15.59:0/3168541723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58099a60 msgr2=0x7fdc580cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.658+0000 7fdc5d400640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58099a60 0x7fdc580cad80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fdc4800c3a0 tx=0x7fdc4800c860 comp rx=0 tx=0).stop 2024-04-25T09:04:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.658+0000 7fdc5d400640 1 -- 172.21.15.59:0/3168541723 shutdown_connections 2024-04-25T09:04:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.658+0000 7fdc5d400640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdc38066f90 0x7fdc38069450 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.658+0000 7fdc5d400640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdc58151fc0 0x7fdc580705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.658+0000 7fdc5d400640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdc5809a600 0x7fdc580cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.658+0000 7fdc5d400640 1 --2- 172.21.15.59:0/3168541723 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58099a60 0x7fdc580cad80 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.658+0000 7fdc5d400640 1 -- 172.21.15.59:0/3168541723 >> 172.21.15.59:0/3168541723 conn(0x7fdc580d17a0 msgr2=0x7fdc580b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.658+0000 7fdc5d400640 1 -- 172.21.15.59:0/3168541723 shutdown_connections 2024-04-25T09:04:14.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.658+0000 7fdc5d400640 1 -- 172.21.15.59:0/3168541723 wait complete. 2024-04-25T09:04:14.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:14.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f2742000640 1 Processor -- start 2024-04-25T09:04:14.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f2742000640 1 -- start start 2024-04-25T09:04:14.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f2742000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f273c145020 0x7f273c072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f2742000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f273c145400 0x7f273c06fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f2742000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c0ce130 con 0x7f273c06ac10 2024-04-25T09:04:14.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f2742000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c0cd360 con 0x7f273c145020 2024-04-25T09:04:14.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f2742000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c073200 con 0x7f273c145400 2024-04-25T09:04:14.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f273b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f273c145020 0x7f273c072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f273b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f273c145020 0x7f273c072cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46968/0 (socket says 172.21.15.59:46968) 2024-04-25T09:04:14.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f273b400640 1 -- 172.21.15.59:0/2742439412 learned_addr learned my addr 172.21.15.59:0/2742439412 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:14.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f2732a00640 1 --2- 172.21.15.59:0/2742439412 >> v2:172.21.15.178:3300/0 conn(0x7f273c145400 0x7f273c06fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f273b400640 1 -- 172.21.15.59:0/2742439412 >> v2:172.21.15.178:3300/0 conn(0x7f273c145400 msgr2=0x7f273c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:14.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f273b400640 1 --2- 172.21.15.59:0/2742439412 >> v2:172.21.15.178:3300/0 conn(0x7f273c145400 0x7f273c06fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f273b400640 1 -- 172.21.15.59:0/2742439412 >> v1:172.21.15.178:6789/0 conn(0x7f273c06ac10 legacy=0x7f273c15f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.818+0000 7f273b400640 1 -- 172.21.15.59:0/2742439412 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c0cd5b0 con 0x7f273c145020 2024-04-25T09:04:14.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.822+0000 7f273b400640 1 --2- 172.21.15.59:0/2742439412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c145020 0x7f273c072cc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f273c06d750 tx=0x7f272c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee82f097f2fb1aba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.822+0000 7f273aa00640 1 -- 172.21.15.59:0/2742439412 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c0ab600 con 0x7f273c145020 2024-04-25T09:04:14.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.822+0000 7f273aa00640 1 -- 172.21.15.59:0/2742439412 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c0b0070 con 0x7f273c145020 2024-04-25T09:04:14.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.822+0000 7f273aa00640 1 -- 172.21.15.59:0/2742439412 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c0ab9c0 con 0x7f273c145020 2024-04-25T09:04:14.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.822+0000 7f2742000640 1 -- 172.21.15.59:0/2742439412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c145020 msgr2=0x7f273c072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.822+0000 7f2742000640 1 --2- 172.21.15.59:0/2742439412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c145020 0x7f273c072cc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f273c06d750 tx=0x7f272c01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.822+0000 7f2742000640 1 -- 172.21.15.59:0/2742439412 shutdown_connections 2024-04-25T09:04:14.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.822+0000 7f2742000640 1 --2- 172.21.15.59:0/2742439412 >> v2:172.21.15.178:3300/0 conn(0x7f273c145400 0x7f273c06fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.822+0000 7f2742000640 1 --2- 172.21.15.59:0/2742439412 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c145020 0x7f273c072cc0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.822+0000 7f2742000640 1 -- 172.21.15.59:0/2742439412 >> 172.21.15.59:0/2742439412 conn(0x7f273c0b2400 msgr2=0x7f273c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.822+0000 7f2742000640 1 -- 172.21.15.59:0/2742439412 shutdown_connections 2024-04-25T09:04:14.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.822+0000 7f2742000640 1 -- 172.21.15.59:0/2742439412 wait complete. 2024-04-25T09:04:14.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2742000640 1 Processor -- start 2024-04-25T09:04:14.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2742000640 1 -- start start 2024-04-25T09:04:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2742000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f273c06ac10 0x7f273c165720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2742000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c145020 0x7f273c0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2742000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c145400 0x7f273c15e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2742000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c06b450 con 0x7f273c145400 2024-04-25T09:04:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2742000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c070060 con 0x7f273c06ac10 2024-04-25T09:04:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2742000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c0d01e0 con 0x7f273c145020 2024-04-25T09:04:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f273be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c145400 0x7f273c15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f273be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c145400 0x7f273c15e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46978/0 (socket says 172.21.15.59:46978) 2024-04-25T09:04:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f273be00640 1 -- 172.21.15.59:0/2658158500 learned_addr learned my addr 172.21.15.59:0/2658158500 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f273b400640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f273c06ac10 0x7f273c165720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2732a00640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c145020 0x7f273c0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f273be00640 1 -- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c145020 msgr2=0x7f273c0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f273be00640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c145020 0x7f273c0b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f273be00640 1 -- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f273c06ac10 msgr2=0x7f273c165720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f273be00640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f273c06ac10 0x7f273c165720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f273be00640 1 -- 172.21.15.59:0/2658158500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c0b3f30 con 0x7f273c145400 2024-04-25T09:04:14.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f273be00640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c145400 0x7f273c15e490 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f273400c730 tx=0x7f273400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2733e00640 1 -- 172.21.15.59:0/2658158500 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2734003b80 con 0x7f273c145400 2024-04-25T09:04:14.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2733e00640 1 -- 172.21.15.59:0/2658158500 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2734003d20 con 0x7f273c145400 2024-04-25T09:04:14.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2733e00640 1 -- 172.21.15.59:0/2658158500 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273400aa30 con 0x7f273c145400 2024-04-25T09:04:14.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2742000640 1 -- 172.21.15.59:0/2658158500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c0b4210 con 0x7f273c145400 2024-04-25T09:04:14.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.826+0000 7f2742000640 1 -- 172.21.15.59:0/2658158500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c0b47d0 con 0x7f273c145400 2024-04-25T09:04:14.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.830+0000 7f2742000640 1 -- 172.21.15.59:0/2658158500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c0745d0 con 0x7f273c145400 2024-04-25T09:04:14.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.830+0000 7f2733e00640 1 -- 172.21.15.59:0/2658158500 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f273400abd0 con 0x7f273c145400 2024-04-25T09:04:14.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.830+0000 7f2733e00640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2718066f60 0x7f2718069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:14.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.830+0000 7f2733e00640 1 -- 172.21.15.59:0/2658158500 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f2734084fa0 con 0x7f273c145400 2024-04-25T09:04:14.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.830+0000 7f273b400640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2718066f60 0x7f2718069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:14.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.830+0000 7f273b400640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2718066f60 0x7f2718069420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f272c0af000 tx=0x7f272c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:14.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.834+0000 7f2733e00640 1 -- 172.21.15.59:0/2658158500 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2734055710 con 0x7f273c145400 2024-04-25T09:04:14.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.998+0000 7f2742000640 1 -- 172.21.15.59:0/2658158500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f273c1665d0 con 0x7f273c145400 2024-04-25T09:04:14.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:14.998+0000 7f2733e00640 1 -- 172.21.15.59:0/2658158500 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17038 (secure 0 0 0) 0x7f27340597b0 con 0x7f273c145400 2024-04-25T09:04:14.991 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:14.991 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":54,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:04:09.803369+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.385704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:30.953332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.21","mappings":[{"from":0,"to":6}]},{"pgid":"8.23","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.002+0000 7f2742000640 1 -- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2718066f60 msgr2=0x7f2718069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.002+0000 7f2742000640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2718066f60 0x7f2718069420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f272c0af000 tx=0x7f272c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.002+0000 7f2742000640 1 -- 172.21.15.59:0/2658158500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c145400 msgr2=0x7f273c15e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.002+0000 7f2742000640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c145400 0x7f273c15e490 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f273400c730 tx=0x7f273400cbf0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.002+0000 7f2742000640 1 -- 172.21.15.59:0/2658158500 shutdown_connections 2024-04-25T09:04:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.002+0000 7f2742000640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2718066f60 0x7f2718069420 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.002+0000 7f2742000640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c145400 0x7f273c15e490 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.002+0000 7f2742000640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c145020 0x7f273c0b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.002+0000 7f2742000640 1 --2- 172.21.15.59:0/2658158500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f273c06ac10 0x7f273c165720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:14.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.002+0000 7f2742000640 1 -- 172.21.15.59:0/2658158500 >> 172.21.15.59:0/2658158500 conn(0x7f273c0b2400 msgr2=0x7f273c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:14.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.002+0000 7f2742000640 1 -- 172.21.15.59:0/2658158500 shutdown_connections 2024-04-25T09:04:14.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.002+0000 7f2742000640 1 -- 172.21.15.59:0/2658158500 wait complete. 2024-04-25T09:04:15.013 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:03:30.385704+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:03:30.953332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:15.014 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:15.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.166+0000 7fcda1600640 1 Processor -- start 2024-04-25T09:04:15.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.166+0000 7fcda1600640 1 -- start start 2024-04-25T09:04:15.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcda1600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcd9c159320 0x7fcd9c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcda1600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd9c15f440 0x7fcd9c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcda1600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c15fc00 con 0x7fcd9c06e010 2024-04-25T09:04:15.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcda1600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c06d640 con 0x7fcd9c159320 2024-04-25T09:04:15.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcda1600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c15fee0 con 0x7fcd9c15f440 2024-04-25T09:04:15.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcd9b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcd9c06e010 0x7fcd9c06e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54634/0 (socket says 172.21.15.59:54634) 2024-04-25T09:04:15.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcd9b400640 1 -- 172.21.15.59:0/1972058161 learned_addr learned my addr 172.21.15.59:0/1972058161 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:15.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcd9aa00640 1 --2- 172.21.15.59:0/1972058161 >> v2:172.21.15.178:3300/0 conn(0x7fcd9c159320 0x7fcd9c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcd93e00640 1 --2- 172.21.15.59:0/1972058161 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd9c15f440 0x7fcd9c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcd9a000640 1 -- 172.21.15.59:0/1972058161 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454921284 0 0) 0x7fcd9c15fc00 con 0x7fcd9c06e010 2024-04-25T09:04:15.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcd9a000640 1 -- 172.21.15.59:0/1972058161 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd80003530 con 0x7fcd9c06e010 2024-04-25T09:04:15.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcd9aa00640 1 -- 172.21.15.59:0/1972058161 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd9c15f440 msgr2=0x7fcd9c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:15.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcd9aa00640 1 --2- 172.21.15.59:0/1972058161 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd9c15f440 0x7fcd9c06dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcd9aa00640 1 -- 172.21.15.59:0/1972058161 >> v1:172.21.15.59:6789/0 conn(0x7fcd9c06e010 legacy=0x7fcd9c06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcd9aa00640 1 -- 172.21.15.59:0/1972058161 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c1601c0 con 0x7fcd9c159320 2024-04-25T09:04:15.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.170+0000 7fcd9aa00640 1 --2- 172.21.15.59:0/1972058161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd9c159320 0x7fcd9c15c9b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0097c0 tx=0x7fcd8c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c392177d4a431a3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcd9a000640 1 -- 172.21.15.59:0/1972058161 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0ab600 con 0x7fcd9c159320 2024-04-25T09:04:15.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcd9a000640 1 -- 172.21.15.59:0/1972058161 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0b0070 con 0x7fcd9c159320 2024-04-25T09:04:15.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcd9a000640 1 -- 172.21.15.59:0/1972058161 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0ab9c0 con 0x7fcd9c159320 2024-04-25T09:04:15.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 -- 172.21.15.59:0/1972058161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd9c159320 msgr2=0x7fcd9c15c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 --2- 172.21.15.59:0/1972058161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd9c159320 0x7fcd9c15c9b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0097c0 tx=0x7fcd8c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 -- 172.21.15.59:0/1972058161 shutdown_connections 2024-04-25T09:04:15.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 --2- 172.21.15.59:0/1972058161 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd9c15f440 0x7fcd9c06dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 --2- 172.21.15.59:0/1972058161 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd9c159320 0x7fcd9c15c9b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 -- 172.21.15.59:0/1972058161 >> 172.21.15.59:0/1972058161 conn(0x7fcd9c067080 msgr2=0x7fcd9c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 -- 172.21.15.59:0/1972058161 shutdown_connections 2024-04-25T09:04:15.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 -- 172.21.15.59:0/1972058161 wait complete. 2024-04-25T09:04:15.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 Processor -- start 2024-04-25T09:04:15.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 -- start start 2024-04-25T09:04:15.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd9c06e010 0x7fcd9c140e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd9c159320 0x7fcd9c158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd9c15f440 0x7fcd9c1f66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c15f9a0 con 0x7fcd9c06e010 2024-04-25T09:04:15.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c15f820 con 0x7fcd9c159320 2024-04-25T09:04:15.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcda1600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c06ebb0 con 0x7fcd9c15f440 2024-04-25T09:04:15.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.174+0000 7fcd9aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd9c06e010 0x7fcd9c140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd9aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd9c06e010 0x7fcd9c140e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46990/0 (socket says 172.21.15.59:46990) 2024-04-25T09:04:15.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd9aa00640 1 -- 172.21.15.59:0/117301128 learned_addr learned my addr 172.21.15.59:0/117301128 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:15.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd93e00640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd9c159320 0x7fcd9c158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd9b400640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd9c15f440 0x7fcd9c1f66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd9aa00640 1 -- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd9c15f440 msgr2=0x7fcd9c1f66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd9aa00640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd9c15f440 0x7fcd9c1f66d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd9aa00640 1 -- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd9c159320 msgr2=0x7fcd9c158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd9aa00640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd9c159320 0x7fcd9c158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd9aa00640 1 -- 172.21.15.59:0/117301128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c158640 con 0x7fcd9c06e010 2024-04-25T09:04:15.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd9aa00640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd9c06e010 0x7fcd9c140e40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0ad040 tx=0x7fcd8c01ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd92a00640 1 -- 172.21.15.59:0/117301128 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0bf410 con 0x7fcd9c06e010 2024-04-25T09:04:15.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd92a00640 1 -- 172.21.15.59:0/117301128 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c0bf5b0 con 0x7fcd9c06e010 2024-04-25T09:04:15.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd92a00640 1 -- 172.21.15.59:0/117301128 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c0bf9a0 con 0x7fcd9c06e010 2024-04-25T09:04:15.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcda1600640 1 -- 172.21.15.59:0/117301128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c13e4b0 con 0x7fcd9c06e010 2024-04-25T09:04:15.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcda1600640 1 -- 172.21.15.59:0/117301128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c13c730 con 0x7fcd9c06e010 2024-04-25T09:04:15.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcda1600640 1 -- 172.21.15.59:0/117301128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c0745d0 con 0x7fcd9c06e010 2024-04-25T09:04:15.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd92a00640 1 -- 172.21.15.59:0/117301128 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd8c0bd020 con 0x7fcd9c06e010 2024-04-25T09:04:15.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.178+0000 7fcd92a00640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcd78066f60 0x7fcd78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.182+0000 7fcd92a00640 1 -- 172.21.15.59:0/117301128 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fcd8c11f3c0 con 0x7fcd9c06e010 2024-04-25T09:04:15.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.182+0000 7fcd93e00640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcd78066f60 0x7fcd78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.182+0000 7fcd93e00640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcd78066f60 0x7fcd78069420 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c13e9b0 tx=0x7fcd84009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.182+0000 7fcd92a00640 1 -- 172.21.15.59:0/117301128 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd8c0c6030 con 0x7fcd9c06e010 2024-04-25T09:04:15.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.346+0000 7fcda1600640 1 -- 172.21.15.59:0/117301128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd9c145270 con 0x7fcd9c06e010 2024-04-25T09:04:15.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.346+0000 7fcd92a00640 1 -- 172.21.15.59:0/117301128 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd8c016090 con 0x7fcd9c06e010 2024-04-25T09:04:15.338 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:04:15.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.346+0000 7fcda1600640 1 -- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcd78066f60 msgr2=0x7fcd78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.346+0000 7fcda1600640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcd78066f60 0x7fcd78069420 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c13e9b0 tx=0x7fcd84009190 comp rx=0 tx=0).stop 2024-04-25T09:04:15.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.346+0000 7fcda1600640 1 -- 172.21.15.59:0/117301128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd9c06e010 msgr2=0x7fcd9c140e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.346+0000 7fcda1600640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd9c06e010 0x7fcd9c140e40 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0ad040 tx=0x7fcd8c01ac20 comp rx=0 tx=0).stop 2024-04-25T09:04:15.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.346+0000 7fcda1600640 1 -- 172.21.15.59:0/117301128 shutdown_connections 2024-04-25T09:04:15.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.346+0000 7fcda1600640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcd78066f60 0x7fcd78069420 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.346+0000 7fcda1600640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd9c15f440 0x7fcd9c1f66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.346+0000 7fcda1600640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd9c159320 0x7fcd9c158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.346+0000 7fcda1600640 1 --2- 172.21.15.59:0/117301128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd9c06e010 0x7fcd9c140e40 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.346+0000 7fcda1600640 1 -- 172.21.15.59:0/117301128 >> 172.21.15.59:0/117301128 conn(0x7fcd9c067080 msgr2=0x7fcd9c15d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.350+0000 7fcda1600640 1 -- 172.21.15.59:0/117301128 shutdown_connections 2024-04-25T09:04:15.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.350+0000 7fcda1600640 1 -- 172.21.15.59:0/117301128 wait complete. 2024-04-25T09:04:15.359 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:04:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f1861400640 1 Processor -- start 2024-04-25T09:04:15.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f1861400640 1 -- start start 2024-04-25T09:04:15.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f1861400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f185c15b910 0x7f185c0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f1861400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f185c0cf3c0 0x7f185c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f1861400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c0d02a0 con 0x7f185c0cd370 2024-04-25T09:04:15.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f1861400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c0cc350 con 0x7f185c15b910 2024-04-25T09:04:15.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f1861400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c0cc630 con 0x7f185c0cf3c0 2024-04-25T09:04:15.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f185a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f185c15b910 0x7f185c0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f185a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f185c15b910 0x7f185c0cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47004/0 (socket says 172.21.15.59:47004) 2024-04-25T09:04:15.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f185a800640 1 -- 172.21.15.59:0/1087788444 learned_addr learned my addr 172.21.15.59:0/1087788444 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:15.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f1851e00640 1 --2- 172.21.15.59:0/1087788444 >> v2:172.21.15.178:3300/0 conn(0x7f185c0cf3c0 0x7f185c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f185a800640 1 -- 172.21.15.59:0/1087788444 >> v2:172.21.15.178:3300/0 conn(0x7f185c0cf3c0 msgr2=0x7f185c0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:15.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.510+0000 7f185a800640 1 --2- 172.21.15.59:0/1087788444 >> v2:172.21.15.178:3300/0 conn(0x7f185c0cf3c0 0x7f185c0cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f185a800640 1 -- 172.21.15.59:0/1087788444 >> v1:172.21.15.178:6789/0 conn(0x7f185c0cd370 legacy=0x7f185c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f185a800640 1 -- 172.21.15.59:0/1087788444 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c0cc910 con 0x7f185c15b910 2024-04-25T09:04:15.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f185a800640 1 --2- 172.21.15.59:0/1087788444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f185c15b910 0x7f185c0cf9a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f185c072e20 tx=0x7f184c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a084972e424058 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f1859e00640 1 -- 172.21.15.59:0/1087788444 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c0ab430 con 0x7f185c15b910 2024-04-25T09:04:15.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f1859e00640 1 -- 172.21.15.59:0/1087788444 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c0b0070 con 0x7f185c15b910 2024-04-25T09:04:15.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f1859e00640 1 -- 172.21.15.59:0/1087788444 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c0ab7f0 con 0x7f185c15b910 2024-04-25T09:04:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f1861400640 1 -- 172.21.15.59:0/1087788444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f185c15b910 msgr2=0x7f185c0cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f1861400640 1 --2- 172.21.15.59:0/1087788444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f185c15b910 0x7f185c0cf9a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f185c072e20 tx=0x7f184c01c520 comp rx=0 tx=0).stop 2024-04-25T09:04:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f1861400640 1 -- 172.21.15.59:0/1087788444 shutdown_connections 2024-04-25T09:04:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f1861400640 1 --2- 172.21.15.59:0/1087788444 >> v2:172.21.15.178:3300/0 conn(0x7f185c0cf3c0 0x7f185c0cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f1861400640 1 --2- 172.21.15.59:0/1087788444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f185c15b910 0x7f185c0cf9a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f1861400640 1 -- 172.21.15.59:0/1087788444 >> 172.21.15.59:0/1087788444 conn(0x7f185c0b3200 msgr2=0x7f185c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f1861400640 1 -- 172.21.15.59:0/1087788444 shutdown_connections 2024-04-25T09:04:15.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.514+0000 7f1861400640 1 -- 172.21.15.59:0/1087788444 wait complete. 2024-04-25T09:04:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1861400640 1 Processor -- start 2024-04-25T09:04:15.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1861400640 1 -- start start 2024-04-25T09:04:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1861400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f185c0cd370 0x7f185c152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1861400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f185c0cf3c0 0x7f185c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1861400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f185c15b910 0x7f185c15cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1861400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c09a2f0 con 0x7f185c15b910 2024-04-25T09:04:15.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1861400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c09a170 con 0x7f185c0cd370 2024-04-25T09:04:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1861400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c15bcf0 con 0x7f185c0cf3c0 2024-04-25T09:04:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f185b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f185c15b910 0x7f185c15cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f185a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f185c0cd370 0x7f185c152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f185b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f185c15b910 0x7f185c15cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47020/0 (socket says 172.21.15.59:47020) 2024-04-25T09:04:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f185b200640 1 -- 172.21.15.59:0/424006084 learned_addr learned my addr 172.21.15.59:0/424006084 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1851e00640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f185c0cf3c0 0x7f185c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f185b200640 1 -- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f185c0cf3c0 msgr2=0x7f185c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f185b200640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f185c0cf3c0 0x7f185c06bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f185b200640 1 -- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f185c0cd370 msgr2=0x7f185c152fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f185b200640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f185c0cd370 0x7f185c152fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f185b200640 1 -- 172.21.15.59:0/424006084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c06c6e0 con 0x7f185c15b910 2024-04-25T09:04:15.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f185b200640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f185c15b910 0x7f185c15cdc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f185400c770 tx=0x7f185400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1853400640 1 -- 172.21.15.59:0/424006084 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854003b80 con 0x7f185c15b910 2024-04-25T09:04:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1853400640 1 -- 172.21.15.59:0/424006084 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854003d20 con 0x7f185c15b910 2024-04-25T09:04:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1861400640 1 -- 172.21.15.59:0/424006084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c06c9c0 con 0x7f185c15b910 2024-04-25T09:04:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1853400640 1 -- 172.21.15.59:0/424006084 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400aa90 con 0x7f185c15b910 2024-04-25T09:04:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.518+0000 7f1861400640 1 -- 172.21.15.59:0/424006084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c06cf80 con 0x7f185c15b910 2024-04-25T09:04:15.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.522+0000 7f1861400640 1 -- 172.21.15.59:0/424006084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c0745d0 con 0x7f185c15b910 2024-04-25T09:04:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.522+0000 7f1853400640 1 -- 172.21.15.59:0/424006084 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f185400ac30 con 0x7f185c15b910 2024-04-25T09:04:15.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.522+0000 7f1853400640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1838066f60 0x7f1838069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.522+0000 7f1853400640 1 -- 172.21.15.59:0/424006084 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1854084ff0 con 0x7f185c15b910 2024-04-25T09:04:15.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.522+0000 7f185a800640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1838066f60 0x7f1838069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.522+0000 7f185a800640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1838066f60 0x7f1838069420 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f184c0af000 tx=0x7f184c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.526+0000 7f1853400640 1 -- 172.21.15.59:0/424006084 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f18540557e0 con 0x7f185c15b910 2024-04-25T09:04:15.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.690+0000 7f1861400640 1 -- 172.21.15.59:0/424006084 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f185c0cdcd0 con 0x7f185c15b910 2024-04-25T09:04:15.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.690+0000 7f1853400640 1 -- 172.21.15.59:0/424006084 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1854059880 con 0x7f185c15b910 2024-04-25T09:04:15.683 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:04:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.694+0000 7f1861400640 1 -- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1838066f60 msgr2=0x7f1838069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.694+0000 7f1861400640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1838066f60 0x7f1838069420 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f184c0af000 tx=0x7f184c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.694+0000 7f1861400640 1 -- 172.21.15.59:0/424006084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f185c15b910 msgr2=0x7f185c15cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.694+0000 7f1861400640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f185c15b910 0x7f185c15cdc0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f185400c770 tx=0x7f185400cc30 comp rx=0 tx=0).stop 2024-04-25T09:04:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.694+0000 7f1861400640 1 -- 172.21.15.59:0/424006084 shutdown_connections 2024-04-25T09:04:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.694+0000 7f1861400640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1838066f60 0x7f1838069420 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.694+0000 7f1861400640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f185c15b910 0x7f185c15cdc0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.694+0000 7f1861400640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f185c0cf3c0 0x7f185c06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.694+0000 7f1861400640 1 --2- 172.21.15.59:0/424006084 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f185c0cd370 0x7f185c152fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.694+0000 7f1861400640 1 -- 172.21.15.59:0/424006084 >> 172.21.15.59:0/424006084 conn(0x7f185c0b3200 msgr2=0x7f185c099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.694+0000 7f1861400640 1 -- 172.21.15.59:0/424006084 shutdown_connections 2024-04-25T09:04:15.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.694+0000 7f1861400640 1 -- 172.21.15.59:0/424006084 wait complete. 2024-04-25T09:04:15.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:04:15.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.854+0000 7f6384000640 1 Processor -- start 2024-04-25T09:04:15.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.854+0000 7f6384000640 1 -- start start 2024-04-25T09:04:15.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f6384000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f637c144120 0x7f637c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f6384000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637c15bc40 con 0x7f637c0b3090 2024-04-25T09:04:15.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f6384000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637c15b3a0 con 0x7f637c0ccbf0 2024-04-25T09:04:15.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f6384000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c15e490 con 0x7f637c144120 2024-04-25T09:04:15.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f6382000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f637c0b3090 0x7f637c06e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54650/0 (socket says 172.21.15.59:54650) 2024-04-25T09:04:15.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f6382000640 1 -- 172.21.15.59:0/3039241968 learned_addr learned my addr 172.21.15.59:0/3039241968 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:15.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f6381600640 1 --2- 172.21.15.59:0/3039241968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f637c144120 0x7f637c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f637be00640 1 -- 172.21.15.59:0/3039241968 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881631336 0 0) 0x7f637c15bc40 con 0x7f637c0b3090 2024-04-25T09:04:15.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f637be00640 1 -- 172.21.15.59:0/3039241968 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6364003530 con 0x7f637c0b3090 2024-04-25T09:04:15.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f637be00640 1 -- 172.21.15.59:0/3039241968 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657923984 0 0) 0x7f637c15b3a0 con 0x7f637c0ccbf0 2024-04-25T09:04:15.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f637be00640 1 -- 172.21.15.59:0/3039241968 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f637c15bc40 con 0x7f637c0ccbf0 2024-04-25T09:04:15.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f6381600640 1 -- 172.21.15.59:0/3039241968 >> v1:172.21.15.178:6789/0 conn(0x7f637c0ccbf0 legacy=0x7f637c15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f6381600640 1 -- 172.21.15.59:0/3039241968 >> v1:172.21.15.59:6789/0 conn(0x7f637c0b3090 legacy=0x7f637c06e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.858+0000 7f6381600640 1 -- 172.21.15.59:0/3039241968 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c15b680 con 0x7f637c144120 2024-04-25T09:04:15.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6381600640 1 --2- 172.21.15.59:0/3039241968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f637c144120 0x7f637c15acd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f63700097f0 tx=0x7f637001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d904ac161f70069 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f637be00640 1 -- 172.21.15.59:0/3039241968 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63700b0070 con 0x7f637c144120 2024-04-25T09:04:15.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f637be00640 1 -- 172.21.15.59:0/3039241968 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63700ab600 con 0x7f637c144120 2024-04-25T09:04:15.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f637be00640 1 -- 172.21.15.59:0/3039241968 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63700ab9d0 con 0x7f637c144120 2024-04-25T09:04:15.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 -- 172.21.15.59:0/3039241968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f637c144120 msgr2=0x7f637c15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 --2- 172.21.15.59:0/3039241968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f637c144120 0x7f637c15acd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f63700097f0 tx=0x7f637001c450 comp rx=0 tx=0).stop 2024-04-25T09:04:15.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 -- 172.21.15.59:0/3039241968 shutdown_connections 2024-04-25T09:04:15.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 --2- 172.21.15.59:0/3039241968 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f637c144120 0x7f637c15acd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 -- 172.21.15.59:0/3039241968 >> 172.21.15.59:0/3039241968 conn(0x7f637c067080 msgr2=0x7f637c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:15.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 -- 172.21.15.59:0/3039241968 shutdown_connections 2024-04-25T09:04:15.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 -- 172.21.15.59:0/3039241968 wait complete. 2024-04-25T09:04:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 Processor -- start 2024-04-25T09:04:15.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 -- start start 2024-04-25T09:04:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f637c0b3090 0x7f637c162230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637c0ccbf0 0x7f637c159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f637c144120 0x7f637c0b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c06ec70 con 0x7f637c0ccbf0 2024-04-25T09:04:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c06eaf0 con 0x7f637c144120 2024-04-25T09:04:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.862+0000 7f6384000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c0b3470 con 0x7f637c0b3090 2024-04-25T09:04:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6380c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637c0ccbf0 0x7f637c159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6380c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637c0ccbf0 0x7f637c159f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47022/0 (socket says 172.21.15.59:47022) 2024-04-25T09:04:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6380c00640 1 -- 172.21.15.59:0/1939722439 learned_addr learned my addr 172.21.15.59:0/1939722439 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6382000640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f637c144120 0x7f637c0b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6381600640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f637c0b3090 0x7f637c162230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6380c00640 1 -- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f637c0b3090 msgr2=0x7f637c162230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6380c00640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f637c0b3090 0x7f637c162230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6380c00640 1 -- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f637c144120 msgr2=0x7f637c0b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6380c00640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f637c144120 0x7f637c0b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6380c00640 1 -- 172.21.15.59:0/1939722439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c0a89c0 con 0x7f637c0ccbf0 2024-04-25T09:04:15.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6380c00640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637c0ccbf0 0x7f637c159f10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f636800c500 tx=0x7f636800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6379600640 1 -- 172.21.15.59:0/1939722439 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63680052d0 con 0x7f637c0ccbf0 2024-04-25T09:04:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6379600640 1 -- 172.21.15.59:0/1939722439 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6368005490 con 0x7f637c0ccbf0 2024-04-25T09:04:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6379600640 1 -- 172.21.15.59:0/1939722439 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6368012850 con 0x7f637c0ccbf0 2024-04-25T09:04:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6384000640 1 -- 172.21.15.59:0/1939722439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c0a8ca0 con 0x7f637c0ccbf0 2024-04-25T09:04:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6384000640 1 -- 172.21.15.59:0/1939722439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c0a9260 con 0x7f637c0ccbf0 2024-04-25T09:04:15.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6384000640 1 -- 172.21.15.59:0/1939722439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637c0745d0 con 0x7f637c0ccbf0 2024-04-25T09:04:15.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6379600640 1 -- 172.21.15.59:0/1939722439 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f63680129f0 con 0x7f637c0ccbf0 2024-04-25T09:04:15.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.866+0000 7f6379600640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f635c066f60 0x7f635c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:15.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.870+0000 7f6379600640 1 -- 172.21.15.59:0/1939722439 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6368084f50 con 0x7f637c0ccbf0 2024-04-25T09:04:15.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.870+0000 7f6381600640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f635c066f60 0x7f635c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:15.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.870+0000 7f6381600640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f635c066f60 0x7f635c069420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f63700ad000 tx=0x7f63700a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:15.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:15.870+0000 7f6379600640 1 -- 172.21.15.59:0/1939722439 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f63680556c0 con 0x7f637c0ccbf0 2024-04-25T09:04:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6384000640 1 -- 172.21.15.59:0/1939722439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f637c0cd400 con 0x7f637c0ccbf0 2024-04-25T09:04:16.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6379600640 1 -- 172.21.15.59:0/1939722439 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6368059760 con 0x7f637c0ccbf0 2024-04-25T09:04:16.026 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:04:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6384000640 1 -- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f635c066f60 msgr2=0x7f635c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6384000640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f635c066f60 0x7f635c069420 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f63700ad000 tx=0x7f63700a6000 comp rx=0 tx=0).stop 2024-04-25T09:04:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6384000640 1 -- 172.21.15.59:0/1939722439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637c0ccbf0 msgr2=0x7f637c159f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6384000640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637c0ccbf0 0x7f637c159f10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f636800c500 tx=0x7f636800c9c0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6384000640 1 -- 172.21.15.59:0/1939722439 shutdown_connections 2024-04-25T09:04:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6384000640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f635c066f60 0x7f635c069420 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6384000640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f637c144120 0x7f637c0b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6384000640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f637c0ccbf0 0x7f637c159f10 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6384000640 1 --2- 172.21.15.59:0/1939722439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f637c0b3090 0x7f637c162230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6384000640 1 -- 172.21.15.59:0/1939722439 >> 172.21.15.59:0/1939722439 conn(0x7f637c067080 msgr2=0x7f637c071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.034+0000 7f6384000640 1 -- 172.21.15.59:0/1939722439 shutdown_connections 2024-04-25T09:04:16.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.038+0000 7f6384000640 1 -- 172.21.15.59:0/1939722439 wait complete. 2024-04-25T09:04:16.048 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.194+0000 7fdb7d600640 1 Processor -- start 2024-04-25T09:04:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.194+0000 7fdb7d600640 1 -- start start 2024-04-25T09:04:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb7d600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdb78145270 0x7fdb7815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb7d600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb780cc4e0 con 0x7fdb780b1e60 2024-04-25T09:04:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb7d600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb780ce040 con 0x7fdb780cd4d0 2024-04-25T09:04:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb7d600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb78145650 con 0x7fdb78145270 2024-04-25T09:04:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb77400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdb780b1e60 0x7fdb7815bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54652/0 (socket says 172.21.15.59:54652) 2024-04-25T09:04:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb77400640 1 -- 172.21.15.59:0/3809837045 learned_addr learned my addr 172.21.15.59:0/3809837045 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:16.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb76a00640 1 --2- 172.21.15.59:0/3809837045 >> v2:172.21.15.178:3300/0 conn(0x7fdb78145270 0x7fdb7815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb76000640 1 -- 172.21.15.59:0/3809837045 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188675090 0 0) 0x7fdb780cc4e0 con 0x7fdb780b1e60 2024-04-25T09:04:16.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb76000640 1 -- 172.21.15.59:0/3809837045 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb5c003530 con 0x7fdb780b1e60 2024-04-25T09:04:16.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb76000640 1 -- 172.21.15.59:0/3809837045 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834227732 0 0) 0x7fdb780ce040 con 0x7fdb780cd4d0 2024-04-25T09:04:16.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb76a00640 1 -- 172.21.15.59:0/3809837045 >> v1:172.21.15.178:6789/0 conn(0x7fdb780cd4d0 legacy=0x7fdb780b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb76a00640 1 -- 172.21.15.59:0/3809837045 >> v1:172.21.15.59:6789/0 conn(0x7fdb780b1e60 legacy=0x7fdb7815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.198+0000 7fdb76a00640 1 -- 172.21.15.59:0/3809837045 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780ce320 con 0x7fdb78145270 2024-04-25T09:04:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb76a00640 1 --2- 172.21.15.59:0/3809837045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb78145270 0x7fdb7815fe50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009d90 tx=0x7fdb6801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a157d88297320fe9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb76000640 1 -- 172.21.15.59:0/3809837045 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680b2070 con 0x7fdb78145270 2024-04-25T09:04:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb76000640 1 -- 172.21.15.59:0/3809837045 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb680a5a00 con 0x7fdb78145270 2024-04-25T09:04:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb76000640 1 -- 172.21.15.59:0/3809837045 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb680a5dd0 con 0x7fdb78145270 2024-04-25T09:04:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb7d600640 1 -- 172.21.15.59:0/3809837045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb78145270 msgr2=0x7fdb7815fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb7d600640 1 --2- 172.21.15.59:0/3809837045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb78145270 0x7fdb7815fe50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009d90 tx=0x7fdb6801c940 comp rx=0 tx=0).stop 2024-04-25T09:04:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb7d600640 1 -- 172.21.15.59:0/3809837045 shutdown_connections 2024-04-25T09:04:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb7d600640 1 --2- 172.21.15.59:0/3809837045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb78145270 0x7fdb7815fe50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb7d600640 1 -- 172.21.15.59:0/3809837045 >> 172.21.15.59:0/3809837045 conn(0x7fdb78066fa0 msgr2=0x7fdb7806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb7d600640 1 -- 172.21.15.59:0/3809837045 shutdown_connections 2024-04-25T09:04:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb7d600640 1 -- 172.21.15.59:0/3809837045 wait complete. 2024-04-25T09:04:16.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb7d600640 1 Processor -- start 2024-04-25T09:04:16.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.202+0000 7fdb7d600640 1 -- start start 2024-04-25T09:04:16.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb7d600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb780b1e60 0x7fdb781409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb7d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb780cd4d0 0x7fdb78140f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb7d600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb78145270 0x7fdb781fa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb7d600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb78169720 con 0x7fdb780cd4d0 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb7d600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780cdd00 con 0x7fdb78145270 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb7d600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb781698a0 con 0x7fdb780b1e60 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb6e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb780cd4d0 0x7fdb78140f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb6e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb780cd4d0 0x7fdb78140f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47038/0 (socket says 172.21.15.59:47038) 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb6e000640 1 -- 172.21.15.59:0/1783559126 learned_addr learned my addr 172.21.15.59:0/1783559126 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb77400640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb78145270 0x7fdb781fa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb76a00640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb780b1e60 0x7fdb781409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb6e000640 1 -- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb780b1e60 msgr2=0x7fdb781409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb6e000640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb780b1e60 0x7fdb781409e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb6e000640 1 -- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb78145270 msgr2=0x7fdb781fa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb6e000640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb78145270 0x7fdb781fa200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb6e000640 1 -- 172.21.15.59:0/1783559126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb78141460 con 0x7fdb780cd4d0 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb76a00640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb780b1e60 0x7fdb781409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb6e000640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb780cd4d0 0x7fdb78140f20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c480 tx=0x7fdb6000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb6f400640 1 -- 172.21.15.59:0/1783559126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb60005480 con 0x7fdb780cd4d0 2024-04-25T09:04:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb6f400640 1 -- 172.21.15.59:0/1783559126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb60003600 con 0x7fdb780cd4d0 2024-04-25T09:04:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb7d600640 1 -- 172.21.15.59:0/1783559126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb781419f0 con 0x7fdb780cd4d0 2024-04-25T09:04:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb6f400640 1 -- 172.21.15.59:0/1783559126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb600039f0 con 0x7fdb780cd4d0 2024-04-25T09:04:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb7d600640 1 -- 172.21.15.59:0/1783559126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb78141fb0 con 0x7fdb780cd4d0 2024-04-25T09:04:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.206+0000 7fdb7d600640 1 -- 172.21.15.59:0/1783559126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb780745d0 con 0x7fdb780cd4d0 2024-04-25T09:04:16.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.210+0000 7fdb6f400640 1 -- 172.21.15.59:0/1783559126 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdb60003b90 con 0x7fdb780cd4d0 2024-04-25T09:04:16.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.210+0000 7fdb6f400640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb54066f60 0x7fdb54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.210+0000 7fdb6f400640 1 -- 172.21.15.59:0/1783559126 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fdb60084d90 con 0x7fdb780cd4d0 2024-04-25T09:04:16.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.210+0000 7fdb76a00640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb54066f60 0x7fdb54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.210+0000 7fdb76a00640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb54066f60 0x7fdb54069420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdb680af000 tx=0x7fdb680a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.214+0000 7fdb6f400640 1 -- 172.21.15.59:0/1783559126 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdb60055c70 con 0x7fdb780cd4d0 2024-04-25T09:04:16.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.410+0000 7fdb7d600640 1 -- 172.21.15.59:0/1783559126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb7806b8e0 con 0x7fdb780cd4d0 2024-04-25T09:04:16.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.410+0000 7fdb6f400640 1 -- 172.21.15.59:0/1783559126 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fdb60055570 con 0x7fdb780cd4d0 2024-04-25T09:04:16.404 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:16.404 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2757859141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2757859141},{"type":"v1","addr":"172.21.15.178:6836","nonce":2757859141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5626,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/447455100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":447455100},{"type":"v1","addr":"172.21.15.178:6837","nonce":447455100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4008580166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4008580166},{"type":"v1","addr":"172.21.15.59:6834","nonce":4008580166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:31.959775+0000","modified":"2024-04-25T09:03:34.974887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2578168283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2578168283},{"type":"v1","addr":"172.21.15.59:6835","nonce":2578168283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:04:16.404 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-04-25T09:04:16.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.414+0000 7fdb7d600640 1 -- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb54066f60 msgr2=0x7fdb54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.414+0000 7fdb7d600640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb54066f60 0x7fdb54069420 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdb680af000 tx=0x7fdb680a7070 comp rx=0 tx=0).stop 2024-04-25T09:04:16.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.414+0000 7fdb7d600640 1 -- 172.21.15.59:0/1783559126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb780cd4d0 msgr2=0x7fdb78140f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.414+0000 7fdb7d600640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb780cd4d0 0x7fdb78140f20 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdb6000c480 tx=0x7fdb6000c940 comp rx=0 tx=0).stop 2024-04-25T09:04:16.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.414+0000 7fdb7d600640 1 -- 172.21.15.59:0/1783559126 shutdown_connections 2024-04-25T09:04:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.414+0000 7fdb7d600640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb54066f60 0x7fdb54069420 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.414+0000 7fdb7d600640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb78145270 0x7fdb781fa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.414+0000 7fdb7d600640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb780cd4d0 0x7fdb78140f20 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.414+0000 7fdb7d600640 1 --2- 172.21.15.59:0/1783559126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb780b1e60 0x7fdb781409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.414+0000 7fdb7d600640 1 -- 172.21.15.59:0/1783559126 >> 172.21.15.59:0/1783559126 conn(0x7fdb78066fa0 msgr2=0x7fdb7806e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.414+0000 7fdb7d600640 1 -- 172.21.15.59:0/1783559126 shutdown_connections 2024-04-25T09:04:16.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.414+0000 7fdb7d600640 1 -- 172.21.15.59:0/1783559126 wait complete. 2024-04-25T09:04:16.425 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:16.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6387200640 1 Processor -- start 2024-04-25T09:04:16.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6387200640 1 -- start start 2024-04-25T09:04:16.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6387200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f638015dcd0 0x7f6380099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6387200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f638009a7a0 0x7f6380099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6387200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638006d740 con 0x7f63800b06c0 2024-04-25T09:04:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6387200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63800cbfc0 con 0x7f638015dcd0 2024-04-25T09:04:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6387200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638006cea0 con 0x7f638009a7a0 2024-04-25T09:04:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6386800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f63800b06c0 0x7f63800cf460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54654/0 (socket says 172.21.15.59:54654) 2024-04-25T09:04:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6386800640 1 -- 172.21.15.59:0/1640858861 learned_addr learned my addr 172.21.15.59:0/1640858861 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6385400640 1 --2- 172.21.15.59:0/1640858861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f638009a7a0 0x7f6380099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6385e00640 1 --2- 172.21.15.59:0/1640858861 >> v2:172.21.15.178:3300/0 conn(0x7f638015dcd0 0x7f6380099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6384a00640 1 -- 172.21.15.59:0/1640858861 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949649499 0 0) 0x7f638006d740 con 0x7f63800b06c0 2024-04-25T09:04:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6384a00640 1 -- 172.21.15.59:0/1640858861 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6368003530 con 0x7f63800b06c0 2024-04-25T09:04:16.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6385e00640 1 -- 172.21.15.59:0/1640858861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f638009a7a0 msgr2=0x7f6380099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:16.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6385e00640 1 --2- 172.21.15.59:0/1640858861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f638009a7a0 0x7f6380099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6385e00640 1 -- 172.21.15.59:0/1640858861 >> v1:172.21.15.59:6789/0 conn(0x7f63800b06c0 legacy=0x7f63800cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.574+0000 7f6385e00640 1 -- 172.21.15.59:0/1640858861 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638006d180 con 0x7f638015dcd0 2024-04-25T09:04:16.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.578+0000 7f6385e00640 1 --2- 172.21.15.59:0/1640858861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f638015dcd0 0x7f6380099a60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f63740097c0 tx=0x7f637401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a23d4fcbc590e6ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.578+0000 7f6384a00640 1 -- 172.21.15.59:0/1640858861 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63740a7070 con 0x7f638015dcd0 2024-04-25T09:04:16.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.578+0000 7f6384a00640 1 -- 172.21.15.59:0/1640858861 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63740b0070 con 0x7f638015dcd0 2024-04-25T09:04:16.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.578+0000 7f6384a00640 1 -- 172.21.15.59:0/1640858861 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63740ab870 con 0x7f638015dcd0 2024-04-25T09:04:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.578+0000 7f6387200640 1 -- 172.21.15.59:0/1640858861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f638015dcd0 msgr2=0x7f6380099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.578+0000 7f6387200640 1 --2- 172.21.15.59:0/1640858861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f638015dcd0 0x7f6380099a60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f63740097c0 tx=0x7f637401c470 comp rx=0 tx=0).stop 2024-04-25T09:04:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.578+0000 7f6387200640 1 -- 172.21.15.59:0/1640858861 shutdown_connections 2024-04-25T09:04:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.578+0000 7f6387200640 1 --2- 172.21.15.59:0/1640858861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f638009a7a0 0x7f6380099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.578+0000 7f6387200640 1 --2- 172.21.15.59:0/1640858861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f638015dcd0 0x7f6380099a60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.578+0000 7f6387200640 1 -- 172.21.15.59:0/1640858861 >> 172.21.15.59:0/1640858861 conn(0x7f63800b3050 msgr2=0x7f63800b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.578+0000 7f6387200640 1 -- 172.21.15.59:0/1640858861 shutdown_connections 2024-04-25T09:04:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.578+0000 7f6387200640 1 -- 172.21.15.59:0/1640858861 wait complete. 2024-04-25T09:04:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6387200640 1 Processor -- start 2024-04-25T09:04:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6387200640 1 -- start start 2024-04-25T09:04:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6387200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009a7a0 0x7f6380155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6387200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63800b06c0 0x7f638015bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6387200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f638015dcd0 0x7f638015c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6387200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638016aa20 con 0x7f638009a7a0 2024-04-25T09:04:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6387200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638016a8a0 con 0x7f63800b06c0 2024-04-25T09:04:16.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6387200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638016aba0 con 0x7f638015dcd0 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6385e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009a7a0 0x7f6380155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6385e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009a7a0 0x7f6380155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47042/0 (socket says 172.21.15.59:47042) 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6385e00640 1 -- 172.21.15.59:0/3357254475 learned_addr learned my addr 172.21.15.59:0/3357254475 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6385400640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63800b06c0 0x7f638015bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6386800640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f638015dcd0 0x7f638015c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6385e00640 1 -- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f638015dcd0 msgr2=0x7f638015c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6385e00640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f638015dcd0 0x7f638015c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6385e00640 1 -- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63800b06c0 msgr2=0x7f638015bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6385e00640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63800b06c0 0x7f638015bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6385e00640 1 -- 172.21.15.59:0/3357254475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380160550 con 0x7f638009a7a0 2024-04-25T09:04:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f6385e00640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009a7a0 0x7f6380155c30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f63740ad040 tx=0x7f637401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.582+0000 7f637a000640 1 -- 172.21.15.59:0/3357254475 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6374006e20 con 0x7f638009a7a0 2024-04-25T09:04:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.586+0000 7f637a000640 1 -- 172.21.15.59:0/3357254475 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63740bf410 con 0x7f638009a7a0 2024-04-25T09:04:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.586+0000 7f637a000640 1 -- 172.21.15.59:0/3357254475 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63740bf7c0 con 0x7f638009a7a0 2024-04-25T09:04:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.586+0000 7f6387200640 1 -- 172.21.15.59:0/3357254475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6380160830 con 0x7f638009a7a0 2024-04-25T09:04:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.586+0000 7f6387200640 1 -- 172.21.15.59:0/3357254475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6380160df0 con 0x7f638009a7a0 2024-04-25T09:04:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.586+0000 7f6387200640 1 -- 172.21.15.59:0/3357254475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638004efa0 con 0x7f638009a7a0 2024-04-25T09:04:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.586+0000 7f637a000640 1 -- 172.21.15.59:0/3357254475 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f63740bd020 con 0x7f638009a7a0 2024-04-25T09:04:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.586+0000 7f637a000640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6364066f60 0x7f6364069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.586+0000 7f637a000640 1 -- 172.21.15.59:0/3357254475 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f637411f500 con 0x7f638009a7a0 2024-04-25T09:04:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.586+0000 7f6385400640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6364066f60 0x7f6364069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.590+0000 7f6385400640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6364066f60 0x7f6364069420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f63801f9e90 tx=0x7f6370009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.590+0000 7f637a000640 1 -- 172.21.15.59:0/3357254475 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f63740c6030 con 0x7f638009a7a0 2024-04-25T09:04:16.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.754+0000 7f6387200640 1 -- 172.21.15.59:0/3357254475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6380157630 con 0x7f638009a7a0 2024-04-25T09:04:16.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.754+0000 7f637a000640 1 -- 172.21.15.59:0/3357254475 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17038 (secure 0 0 0) 0x7f6374016090 con 0x7f638009a7a0 2024-04-25T09:04:16.747 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:16.747 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":54,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:04:09.803369+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.385704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:30.953332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.21","mappings":[{"from":0,"to":6}]},{"pgid":"8.23","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:16.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.758+0000 7f6387200640 1 -- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6364066f60 msgr2=0x7f6364069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.758+0000 7f6387200640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6364066f60 0x7f6364069420 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f63801f9e90 tx=0x7f6370009190 comp rx=0 tx=0).stop 2024-04-25T09:04:16.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.758+0000 7f6387200640 1 -- 172.21.15.59:0/3357254475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009a7a0 msgr2=0x7f6380155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.758+0000 7f6387200640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009a7a0 0x7f6380155c30 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f63740ad040 tx=0x7f637401acb0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.758+0000 7f6387200640 1 -- 172.21.15.59:0/3357254475 shutdown_connections 2024-04-25T09:04:16.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.758+0000 7f6387200640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6364066f60 0x7f6364069420 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.758+0000 7f6387200640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f638015dcd0 0x7f638015c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.758+0000 7f6387200640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63800b06c0 0x7f638015bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.758+0000 7f6387200640 1 --2- 172.21.15.59:0/3357254475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f638009a7a0 0x7f6380155c30 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.758+0000 7f6387200640 1 -- 172.21.15.59:0/3357254475 >> 172.21.15.59:0/3357254475 conn(0x7f63800b3050 msgr2=0x7f6380070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.758+0000 7f6387200640 1 -- 172.21.15.59:0/3357254475 shutdown_connections 2024-04-25T09:04:16.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.758+0000 7f6387200640 1 -- 172.21.15.59:0/3357254475 wait complete. 2024-04-25T09:04:16.768 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:04:16.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:16.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.918+0000 7f4f73000640 1 Processor -- start 2024-04-25T09:04:16.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.918+0000 7f4f73000640 1 -- start start 2024-04-25T09:04:16.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.918+0000 7f4f73000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4f6c144140 0x7f4f6c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.918+0000 7f4f73000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c15ac60 con 0x7f4f6c0ced60 2024-04-25T09:04:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.918+0000 7f4f73000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c0cf3e0 con 0x7f4f6c06ead0 2024-04-25T09:04:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.918+0000 7f4f73000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c15af20 con 0x7f4f6c144140 2024-04-25T09:04:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.918+0000 7f4f63e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4f6c0ced60 0x7f4f6c06e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54662/0 (socket says 172.21.15.59:54662) 2024-04-25T09:04:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.918+0000 7f4f63e00640 1 -- 172.21.15.59:0/584545309 learned_addr learned my addr 172.21.15.59:0/584545309 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.918+0000 7f4f6be00640 1 --2- 172.21.15.59:0/584545309 >> v2:172.21.15.178:3300/0 conn(0x7f4f6c144140 0x7f4f6c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.922+0000 7f4f6b400640 1 -- 172.21.15.59:0/584545309 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873026590 0 0) 0x7f4f6c15ac60 con 0x7f4f6c0ced60 2024-04-25T09:04:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.922+0000 7f4f6b400640 1 -- 172.21.15.59:0/584545309 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f50003530 con 0x7f4f6c0ced60 2024-04-25T09:04:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.922+0000 7f4f6b400640 1 -- 172.21.15.59:0/584545309 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3065591571 0 0) 0x7f4f6c0cf3e0 con 0x7f4f6c06ead0 2024-04-25T09:04:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.922+0000 7f4f6b400640 1 -- 172.21.15.59:0/584545309 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f6c15ac60 con 0x7f4f6c06ead0 2024-04-25T09:04:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.922+0000 7f4f6be00640 1 -- 172.21.15.59:0/584545309 >> v1:172.21.15.178:6789/0 conn(0x7f4f6c06ead0 legacy=0x7f4f6c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.922+0000 7f4f6be00640 1 -- 172.21.15.59:0/584545309 >> v1:172.21.15.59:6789/0 conn(0x7f4f6c0ced60 legacy=0x7f4f6c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.922+0000 7f4f6be00640 1 -- 172.21.15.59:0/584545309 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c15b200 con 0x7f4f6c144140 2024-04-25T09:04:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.922+0000 7f4f6be00640 1 --2- 172.21.15.59:0/584545309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c144140 0x7f4f6c0ce820 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0097c0 tx=0x7f4f5c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d441c410825a887b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.922+0000 7f4f6b400640 1 -- 172.21.15.59:0/584545309 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0b0070 con 0x7f4f6c144140 2024-04-25T09:04:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.922+0000 7f4f6b400640 1 -- 172.21.15.59:0/584545309 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c0ab400 con 0x7f4f6c144140 2024-04-25T09:04:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.922+0000 7f4f6b400640 1 -- 172.21.15.59:0/584545309 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0ab7d0 con 0x7f4f6c144140 2024-04-25T09:04:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 -- 172.21.15.59:0/584545309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c144140 msgr2=0x7f4f6c0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 --2- 172.21.15.59:0/584545309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c144140 0x7f4f6c0ce820 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0097c0 tx=0x7f4f5c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 -- 172.21.15.59:0/584545309 shutdown_connections 2024-04-25T09:04:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 --2- 172.21.15.59:0/584545309 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c144140 0x7f4f6c0ce820 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 -- 172.21.15.59:0/584545309 >> 172.21.15.59:0/584545309 conn(0x7f4f6c066fa0 msgr2=0x7f4f6c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 -- 172.21.15.59:0/584545309 shutdown_connections 2024-04-25T09:04:16.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 -- 172.21.15.59:0/584545309 wait complete. 2024-04-25T09:04:16.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 Processor -- start 2024-04-25T09:04:16.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 -- start start 2024-04-25T09:04:16.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f6c06ead0 0x7f4f6c165400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c0ced60 0x7f4f6c135e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c144140 0x7f4f6c1609d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c15bb80 con 0x7f4f6c0ced60 2024-04-25T09:04:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c15ba00 con 0x7f4f6c144140 2024-04-25T09:04:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f73000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c06d2b0 con 0x7f4f6c06ead0 2024-04-25T09:04:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f63e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c0ced60 0x7f4f6c135e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f63e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c0ced60 0x7f4f6c135e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47048/0 (socket says 172.21.15.59:47048) 2024-04-25T09:04:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f63e00640 1 -- 172.21.15.59:0/23425446 learned_addr learned my addr 172.21.15.59:0/23425446 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f6be00640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f6c06ead0 0x7f4f6c165400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.926+0000 7f4f71000640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c144140 0x7f4f6c1609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f63e00640 1 -- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f6c06ead0 msgr2=0x7f4f6c165400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f63e00640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f6c06ead0 0x7f4f6c165400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f63e00640 1 -- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c144140 msgr2=0x7f4f6c1609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:16.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f63e00640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c144140 0x7f4f6c1609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:16.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f63e00640 1 -- 172.21.15.59:0/23425446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c15ff10 con 0x7f4f6c0ced60 2024-04-25T09:04:16.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f71000640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c144140 0x7f4f6c1609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:16.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f63e00640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c0ced60 0x7f4f6c135e50 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400c4d0 tx=0x7f4f5400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f68c00640 1 -- 172.21.15.59:0/23425446 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54017070 con 0x7f4f6c0ced60 2024-04-25T09:04:16.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f68c00640 1 -- 172.21.15.59:0/23425446 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f54005cf0 con 0x7f4f6c0ced60 2024-04-25T09:04:16.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f68c00640 1 -- 172.21.15.59:0/23425446 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f540072b0 con 0x7f4f6c0ced60 2024-04-25T09:04:16.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f73000640 1 -- 172.21.15.59:0/23425446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c162620 con 0x7f4f6c0ced60 2024-04-25T09:04:16.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f73000640 1 -- 172.21.15.59:0/23425446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c136390 con 0x7f4f6c0ced60 2024-04-25T09:04:16.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f73000640 1 -- 172.21.15.59:0/23425446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c0745d0 con 0x7f4f6c0ced60 2024-04-25T09:04:16.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f68c00640 1 -- 172.21.15.59:0/23425446 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4f5401a070 con 0x7f4f6c0ced60 2024-04-25T09:04:16.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f68c00640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4f48066f60 0x7f4f48069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:16.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f68c00640 1 -- 172.21.15.59:0/23425446 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4f54084550 con 0x7f4f6c0ced60 2024-04-25T09:04:16.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.930+0000 7f4f6be00640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4f48066f60 0x7f4f48069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:16.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.934+0000 7f4f6be00640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4f48066f60 0x7f4f48069420 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0ad000 tx=0x7f4f5c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:16.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:16.934+0000 7f4f68c00640 1 -- 172.21.15.59:0/23425446 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4f54054d50 con 0x7f4f6c0ced60 2024-04-25T09:04:17.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 -- 172.21.15.59:0/23425446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f6c15ed40 con 0x7f4f6c0ced60 2024-04-25T09:04:17.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f68c00640 1 -- 172.21.15.59:0/23425446 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4941 (secure 0 0 0) 0x7f4f54058df0 con 0x7f4f6c0ced60 2024-04-25T09:04:17.122 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:17.122 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2757859141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2757859141},{"type":"v1","addr":"172.21.15.178:6836","nonce":2757859141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5626,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/447455100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":447455100},{"type":"v1","addr":"172.21.15.178:6837","nonce":447455100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4008580166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4008580166},{"type":"v1","addr":"172.21.15.59:6834","nonce":4008580166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:31.959775+0000","modified":"2024-04-25T09:03:34.974887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2578168283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2578168283},{"type":"v1","addr":"172.21.15.59:6835","nonce":2578168283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:04:17.122 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-04-25T09:04:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 -- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4f48066f60 msgr2=0x7f4f48069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4f48066f60 0x7f4f48069420 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0ad000 tx=0x7f4f5c008040 comp rx=0 tx=0).stop 2024-04-25T09:04:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 -- 172.21.15.59:0/23425446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c0ced60 msgr2=0x7f4f6c135e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c0ced60 0x7f4f6c135e50 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400c4d0 tx=0x7f4f5400c990 comp rx=0 tx=0).stop 2024-04-25T09:04:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 -- 172.21.15.59:0/23425446 shutdown_connections 2024-04-25T09:04:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4f48066f60 0x7f4f48069420 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f6c144140 0x7f4f6c1609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6c0ced60 0x7f4f6c135e50 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 --2- 172.21.15.59:0/23425446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f6c06ead0 0x7f4f6c165400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 -- 172.21.15.59:0/23425446 >> 172.21.15.59:0/23425446 conn(0x7f4f6c066fa0 msgr2=0x7f4f6c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 -- 172.21.15.59:0/23425446 shutdown_connections 2024-04-25T09:04:17.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.130+0000 7f4f73000640 1 -- 172.21.15.59:0/23425446 wait complete. 2024-04-25T09:04:17.144 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:17.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.290+0000 7fddab400640 1 Processor -- start 2024-04-25T09:04:17.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.294+0000 7fddab400640 1 -- start start 2024-04-25T09:04:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.294+0000 7fddab400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdda40d0f40 0x7fdda41689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.294+0000 7fddab400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda406c650 con 0x7fdda415ee00 2024-04-25T09:04:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.294+0000 7fddab400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda406c930 con 0x7fdda4099a60 2024-04-25T09:04:17.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.294+0000 7fddab400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda406c430 con 0x7fdda40d0f40 2024-04-25T09:04:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.294+0000 7fdda9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdda40d0f40 0x7fdda41689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.294+0000 7fdd9be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdda415ee00 0x7fdda406bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54676/0 (socket says 172.21.15.59:54676) 2024-04-25T09:04:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.294+0000 7fdd9be00640 1 -- 172.21.15.59:0/968056470 learned_addr learned my addr 172.21.15.59:0/968056470 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.294+0000 7fdda9400640 1 -- 172.21.15.59:0/968056470 >> v1:172.21.15.178:6789/0 conn(0x7fdda4099a60 legacy=0x7fdda4099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.294+0000 7fdda9400640 1 -- 172.21.15.59:0/968056470 >> v1:172.21.15.59:6789/0 conn(0x7fdda415ee00 legacy=0x7fdda406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.294+0000 7fdda9400640 1 -- 172.21.15.59:0/968056470 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda406cc10 con 0x7fdda40d0f40 2024-04-25T09:04:17.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.294+0000 7fdda3e00640 1 -- 172.21.15.59:0/968056470 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636381674 0 0) 0x7fdda406c650 con 0x7fdda415ee00 2024-04-25T09:04:17.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fdda9400640 1 --2- 172.21.15.59:0/968056470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda40d0f40 0x7fdda41689f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009d90 tx=0x7fdd9c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701bb72e96c17a2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fdda3e00640 1 -- 172.21.15.59:0/968056470 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0b2070 con 0x7fdda40d0f40 2024-04-25T09:04:17.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fdda3e00640 1 -- 172.21.15.59:0/968056470 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c0a58a0 con 0x7fdda40d0f40 2024-04-25T09:04:17.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fdda3e00640 1 -- 172.21.15.59:0/968056470 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0a5c70 con 0x7fdda40d0f40 2024-04-25T09:04:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fddab400640 1 -- 172.21.15.59:0/968056470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda40d0f40 msgr2=0x7fdda41689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fddab400640 1 --2- 172.21.15.59:0/968056470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda40d0f40 0x7fdda41689f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c009d90 tx=0x7fdd9c01c930 comp rx=0 tx=0).stop 2024-04-25T09:04:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fddab400640 1 -- 172.21.15.59:0/968056470 shutdown_connections 2024-04-25T09:04:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fddab400640 1 --2- 172.21.15.59:0/968056470 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda40d0f40 0x7fdda41689f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fddab400640 1 -- 172.21.15.59:0/968056470 >> 172.21.15.59:0/968056470 conn(0x7fdda40d17a0 msgr2=0x7fdda40d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fddab400640 1 -- 172.21.15.59:0/968056470 shutdown_connections 2024-04-25T09:04:17.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fddab400640 1 -- 172.21.15.59:0/968056470 wait complete. 2024-04-25T09:04:17.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fddab400640 1 Processor -- start 2024-04-25T09:04:17.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.298+0000 7fddab400640 1 -- start start 2024-04-25T09:04:17.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fddab400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdda4099a60 0x7fdda4156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fddab400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda40d0f40 0x7fdda40b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fddab400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdda415ee00 0x7fdda40b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fddab400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda416b8d0 con 0x7fdda40d0f40 2024-04-25T09:04:17.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fddab400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda416b750 con 0x7fdda4099a60 2024-04-25T09:04:17.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fddab400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda416ba50 con 0x7fdda415ee00 2024-04-25T09:04:17.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdd9be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda40d0f40 0x7fdda40b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdd9be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda40d0f40 0x7fdda40b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47066/0 (socket says 172.21.15.59:47066) 2024-04-25T09:04:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdd9be00640 1 -- 172.21.15.59:0/2350350693 learned_addr learned my addr 172.21.15.59:0/2350350693 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdda9400640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdda415ee00 0x7fdda40b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdda8a00640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdda4099a60 0x7fdda4156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdd9be00640 1 -- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdda415ee00 msgr2=0x7fdda40b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdd9be00640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdda415ee00 0x7fdda40b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdd9be00640 1 -- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdda4099a60 msgr2=0x7fdda4156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdd9be00640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdda4099a60 0x7fdda4156dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdd9be00640 1 -- 172.21.15.59:0/2350350693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda40b7300 con 0x7fdda40d0f40 2024-04-25T09:04:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdda8a00640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdda4099a60 0x7fdda4156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:17.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdd9be00640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda40d0f40 0x7fdda40b45f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c450 tx=0x7fdd8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdda1600640 1 -- 172.21.15.59:0/2350350693 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c018070 con 0x7fdda40d0f40 2024-04-25T09:04:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdda1600640 1 -- 172.21.15.59:0/2350350693 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c0074e0 con 0x7fdda40d0f40 2024-04-25T09:04:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdda1600640 1 -- 172.21.15.59:0/2350350693 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0049f0 con 0x7fdda40d0f40 2024-04-25T09:04:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fddab400640 1 -- 172.21.15.59:0/2350350693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda4150d50 con 0x7fdda40d0f40 2024-04-25T09:04:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fddab400640 1 -- 172.21.15.59:0/2350350693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda4151310 con 0x7fdda40d0f40 2024-04-25T09:04:17.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fddab400640 1 -- 172.21.15.59:0/2350350693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda40745d0 con 0x7fdda40d0f40 2024-04-25T09:04:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.302+0000 7fdda1600640 1 -- 172.21.15.59:0/2350350693 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdd8c01b070 con 0x7fdda40d0f40 2024-04-25T09:04:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.306+0000 7fdda1600640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd80066f60 0x7fdd80069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.306+0000 7fdda1600640 1 -- 172.21.15.59:0/2350350693 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fdd8c0845d0 con 0x7fdda40d0f40 2024-04-25T09:04:17.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.306+0000 7fdda8a00640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd80066f60 0x7fdd80069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.306+0000 7fdda8a00640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd80066f60 0x7fdd80069420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdda41fa240 tx=0x7fdd94009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.310+0000 7fdda1600640 1 -- 172.21.15.59:0/2350350693 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd8c055380 con 0x7fdda40d0f40 2024-04-25T09:04:17.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 -- 172.21.15.59:0/2350350693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdda409ae10 con 0x7fdda40d0f40 2024-04-25T09:04:17.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fdda1600640 1 -- 172.21.15.59:0/2350350693 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4941 (secure 0 0 0) 0x7fdd8c054c80 con 0x7fdda40d0f40 2024-04-25T09:04:17.497 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:17.498 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":28,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2757859141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2757859141},{"type":"v1","addr":"172.21.15.178:6836","nonce":2757859141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5626,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/447455100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":447455100},{"type":"v1","addr":"172.21.15.178:6837","nonce":447455100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4008580166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4008580166},{"type":"v1","addr":"172.21.15.59:6834","nonce":4008580166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:03:31.959775+0000","modified":"2024-04-25T09:03:34.974887+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5769":{"gid":5769,"name":"a","rank":0,"incarnation":24,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2578168283","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2578168283},{"type":"v1","addr":"172.21.15.59:6835","nonce":2578168283}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-25T09:04:17.498 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 28 2024-04-25T09:04:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 -- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd80066f60 msgr2=0x7fdd80069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd80066f60 0x7fdd80069420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdda41fa240 tx=0x7fdd94009040 comp rx=0 tx=0).stop 2024-04-25T09:04:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 -- 172.21.15.59:0/2350350693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda40d0f40 msgr2=0x7fdda40b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda40d0f40 0x7fdda40b45f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c00c450 tx=0x7fdd8c00c910 comp rx=0 tx=0).stop 2024-04-25T09:04:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 -- 172.21.15.59:0/2350350693 shutdown_connections 2024-04-25T09:04:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd80066f60 0x7fdd80069420 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdda415ee00 0x7fdda40b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdda40d0f40 0x7fdda40b45f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 --2- 172.21.15.59:0/2350350693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdda4099a60 0x7fdda4156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 -- 172.21.15.59:0/2350350693 >> 172.21.15.59:0/2350350693 conn(0x7fdda40d17a0 msgr2=0x7fdda40cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 -- 172.21.15.59:0/2350350693 shutdown_connections 2024-04-25T09:04:17.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.506+0000 7fddab400640 1 -- 172.21.15.59:0/2350350693 wait complete. 2024-04-25T09:04:17.522 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.670+0000 7fd36da00640 1 Processor -- start 2024-04-25T09:04:17.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.670+0000 7fd36da00640 1 -- start start 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.670+0000 7fd36da00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd368146740 0x7fd36806d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.670+0000 7fd36da00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd3680aeb50 0x7fd3680aef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.670+0000 7fd36da00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3680af4a0 con 0x7fd3680af840 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.670+0000 7fd36da00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd368146b20 con 0x7fd368146740 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.670+0000 7fd36da00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3680b23e0 con 0x7fd3680aeb50 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd35fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd3680af840 0x7fd3680b19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54688/0 (socket says 172.21.15.59:54688) 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd35fe00640 1 -- 172.21.15.59:0/716892829 learned_addr learned my addr 172.21.15.59:0/716892829 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd366a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd368146740 0x7fd36806d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd367400640 1 --2- 172.21.15.59:0/716892829 >> v2:172.21.15.178:3300/0 conn(0x7fd3680aeb50 0x7fd3680aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd366000640 1 -- 172.21.15.59:0/716892829 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950287267 0 0) 0x7fd350001120 con 0x7fd3680af840 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd366000640 1 -- 172.21.15.59:0/716892829 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd34c003530 con 0x7fd3680af840 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd366a00640 1 -- 172.21.15.59:0/716892829 >> v2:172.21.15.178:3300/0 conn(0x7fd3680aeb50 msgr2=0x7fd3680aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:17.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd366a00640 1 --2- 172.21.15.59:0/716892829 >> v2:172.21.15.178:3300/0 conn(0x7fd3680aeb50 0x7fd3680aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd366a00640 1 -- 172.21.15.59:0/716892829 >> v1:172.21.15.59:6789/0 conn(0x7fd3680af840 legacy=0x7fd3680b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd366a00640 1 -- 172.21.15.59:0/716892829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3680acb80 con 0x7fd368146740 2024-04-25T09:04:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd366a00640 1 --2- 172.21.15.59:0/716892829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd368146740 0x7fd36806d2b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd368147700 tx=0x7fd35801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77fecbff120c380a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd366000640 1 -- 172.21.15.59:0/716892829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580ab650 con 0x7fd368146740 2024-04-25T09:04:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd366000640 1 -- 172.21.15.59:0/716892829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3580b0070 con 0x7fd368146740 2024-04-25T09:04:17.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.674+0000 7fd366000640 1 -- 172.21.15.59:0/716892829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3580aba10 con 0x7fd368146740 2024-04-25T09:04:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 -- 172.21.15.59:0/716892829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd368146740 msgr2=0x7fd36806d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 --2- 172.21.15.59:0/716892829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd368146740 0x7fd36806d2b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd368147700 tx=0x7fd35801c450 comp rx=0 tx=0).stop 2024-04-25T09:04:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 -- 172.21.15.59:0/716892829 shutdown_connections 2024-04-25T09:04:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 --2- 172.21.15.59:0/716892829 >> v2:172.21.15.178:3300/0 conn(0x7fd3680aeb50 0x7fd3680aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 --2- 172.21.15.59:0/716892829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd368146740 0x7fd36806d2b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 -- 172.21.15.59:0/716892829 >> 172.21.15.59:0/716892829 conn(0x7fd368066fa0 msgr2=0x7fd36806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 -- 172.21.15.59:0/716892829 shutdown_connections 2024-04-25T09:04:17.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 -- 172.21.15.59:0/716892829 wait complete. 2024-04-25T09:04:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 Processor -- start 2024-04-25T09:04:17.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 -- start start 2024-04-25T09:04:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3680aeb50 0x7fd36806e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3680af840 0x7fd3681590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd368146740 0x7fd368159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36806d7f0 con 0x7fd368146740 2024-04-25T09:04:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3680b20f0 con 0x7fd3680af840 2024-04-25T09:04:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd36da00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36806d970 con 0x7fd3680aeb50 2024-04-25T09:04:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd367400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd368146740 0x7fd368159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd367400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd368146740 0x7fd368159630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47086/0 (socket says 172.21.15.59:47086) 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd367400640 1 -- 172.21.15.59:0/357523871 learned_addr learned my addr 172.21.15.59:0/357523871 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd35fe00640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3680af840 0x7fd3681590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.678+0000 7fd366a00640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3680aeb50 0x7fd36806e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd367400640 1 -- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3680aeb50 msgr2=0x7fd36806e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd367400640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3680aeb50 0x7fd36806e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd367400640 1 -- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3680af840 msgr2=0x7fd3681590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd367400640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3680af840 0x7fd3681590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd367400640 1 -- 172.21.15.59:0/357523871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36815a9c0 con 0x7fd368146740 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd367400640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd368146740 0x7fd368159630 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd36000efc0 tx=0x7fd36000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd35ea00640 1 -- 172.21.15.59:0/357523871 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360018020 con 0x7fd368146740 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd35ea00640 1 -- 172.21.15.59:0/357523871 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd360014480 con 0x7fd368146740 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd35ea00640 1 -- 172.21.15.59:0/357523871 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd360014870 con 0x7fd368146740 2024-04-25T09:04:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd36da00640 1 -- 172.21.15.59:0/357523871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd368159bd0 con 0x7fd368146740 2024-04-25T09:04:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd36da00640 1 -- 172.21.15.59:0/357523871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36815a400 con 0x7fd368146740 2024-04-25T09:04:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd36da00640 1 -- 172.21.15.59:0/357523871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3680745d0 con 0x7fd368146740 2024-04-25T09:04:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.682+0000 7fd35ea00640 1 -- 172.21.15.59:0/357523871 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd36001b020 con 0x7fd368146740 2024-04-25T09:04:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.686+0000 7fd35ea00640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd344066f60 0x7fd344069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.686+0000 7fd35ea00640 1 -- 172.21.15.59:0/357523871 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd360085bf0 con 0x7fd368146740 2024-04-25T09:04:17.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.686+0000 7fd366a00640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd344066f60 0x7fd344069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.686+0000 7fd366a00640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd344066f60 0x7fd344069420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd3580af000 tx=0x7fd3580a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:17.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.690+0000 7fd35ea00640 1 -- 172.21.15.59:0/357523871 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd360022070 con 0x7fd368146740 2024-04-25T09:04:17.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.850+0000 7fd36da00640 1 -- 172.21.15.59:0/357523871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd36806b870 con 0x7fd368146740 2024-04-25T09:04:17.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd35ea00640 1 -- 172.21.15.59:0/357523871 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+17038 (secure 0 0 0) 0x7fd360010040 con 0x7fd368146740 2024-04-25T09:04:17.845 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:17.845 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":54,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:04:09.803369+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:03:30.385704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-04-25T09:03:30.953332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.21","mappings":[{"from":0,"to":6}]},{"pgid":"8.23","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd36da00640 1 -- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd344066f60 msgr2=0x7fd344069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd36da00640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd344066f60 0x7fd344069420 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd3580af000 tx=0x7fd3580a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd36da00640 1 -- 172.21.15.59:0/357523871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd368146740 msgr2=0x7fd368159630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd36da00640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd368146740 0x7fd368159630 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fd36000efc0 tx=0x7fd36000c490 comp rx=0 tx=0).stop 2024-04-25T09:04:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd36da00640 1 -- 172.21.15.59:0/357523871 shutdown_connections 2024-04-25T09:04:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd36da00640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd344066f60 0x7fd344069420 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd36da00640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd368146740 0x7fd368159630 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd36da00640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd3680af840 0x7fd3681590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd36da00640 1 --2- 172.21.15.59:0/357523871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd3680aeb50 0x7fd36806e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd36da00640 1 -- 172.21.15.59:0/357523871 >> 172.21.15.59:0/357523871 conn(0x7fd368066fa0 msgr2=0x7fd3680b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd36da00640 1 -- 172.21.15.59:0/357523871 shutdown_connections 2024-04-25T09:04:17.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:17.854+0000 7fd36da00640 1 -- 172.21.15.59:0/357523871 wait complete. 2024-04-25T09:04:17.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:04:18.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.014+0000 7fe92d200640 1 Processor -- start 2024-04-25T09:04:18.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe92d200640 1 -- start start 2024-04-25T09:04:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe92d200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9280d0150 0x7fe9280af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe92d200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe9280c72a0 0x7fe9280c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe92d200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280b30d0 con 0x7fe92815dc00 2024-04-25T09:04:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe92d200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9280cd860 con 0x7fe9280d0150 2024-04-25T09:04:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe92d200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9280ccf30 con 0x7fe9280c72a0 2024-04-25T09:04:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe91fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9280d0150 0x7fe9280af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe91fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9280d0150 0x7fe9280af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47096/0 (socket says 172.21.15.59:47096) 2024-04-25T09:04:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe91fe00640 1 -- 172.21.15.59:0/3514612648 learned_addr learned my addr 172.21.15.59:0/3514612648 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe91fe00640 1 -- 172.21.15.59:0/3514612648 >> v2:172.21.15.178:3300/0 conn(0x7fe9280c72a0 msgr2=0x7fe9280c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe926800640 1 --2- 172.21.15.59:0/3514612648 >> v2:172.21.15.178:3300/0 conn(0x7fe9280c72a0 0x7fe9280c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe91fe00640 1 --2- 172.21.15.59:0/3514612648 >> v2:172.21.15.178:3300/0 conn(0x7fe9280c72a0 0x7fe9280c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe91fe00640 1 -- 172.21.15.59:0/3514612648 >> v1:172.21.15.178:6789/0 conn(0x7fe92815dc00 legacy=0x7fe9280c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe91fe00640 1 -- 172.21.15.59:0/3514612648 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280cd210 con 0x7fe9280d0150 2024-04-25T09:04:18.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.018+0000 7fe926800640 1 --2- 172.21.15.59:0/3514612648 >> v2:172.21.15.178:3300/0 conn(0x7fe9280c72a0 0x7fe9280c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:18.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe91fe00640 1 --2- 172.21.15.59:0/3514612648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9280d0150 0x7fe9280af770 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe9280c6980 tx=0x7fe91001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ca520ff67c4abd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe925400640 1 -- 172.21.15.59:0/3514612648 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9100b0070 con 0x7fe9280d0150 2024-04-25T09:04:18.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe925400640 1 -- 172.21.15.59:0/3514612648 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9100ab600 con 0x7fe9280d0150 2024-04-25T09:04:18.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe925400640 1 -- 172.21.15.59:0/3514612648 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9100ab9d0 con 0x7fe9280d0150 2024-04-25T09:04:18.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe92d200640 1 -- 172.21.15.59:0/3514612648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9280d0150 msgr2=0x7fe9280af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe92d200640 1 --2- 172.21.15.59:0/3514612648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9280d0150 0x7fe9280af770 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe9280c6980 tx=0x7fe91001c4e0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe92d200640 1 -- 172.21.15.59:0/3514612648 shutdown_connections 2024-04-25T09:04:18.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe92d200640 1 --2- 172.21.15.59:0/3514612648 >> v2:172.21.15.178:3300/0 conn(0x7fe9280c72a0 0x7fe9280c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe92d200640 1 --2- 172.21.15.59:0/3514612648 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9280d0150 0x7fe9280af770 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe92d200640 1 -- 172.21.15.59:0/3514612648 >> 172.21.15.59:0/3514612648 conn(0x7fe9280b2240 msgr2=0x7fe9280b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe92d200640 1 -- 172.21.15.59:0/3514612648 shutdown_connections 2024-04-25T09:04:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe92d200640 1 -- 172.21.15.59:0/3514612648 wait complete. 2024-04-25T09:04:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe92d200640 1 Processor -- start 2024-04-25T09:04:18.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.022+0000 7fe92d200640 1 -- start start 2024-04-25T09:04:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe92d200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9280c72a0 0x7fe928145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe92d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9280d0150 0x7fe9280b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe92d200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe92815dc00 0x7fe928152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe92d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92816a7c0 con 0x7fe9280d0150 2024-04-25T09:04:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe92d200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92816a640 con 0x7fe9280c72a0 2024-04-25T09:04:18.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe92d200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92816a940 con 0x7fe92815dc00 2024-04-25T09:04:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9280d0150 0x7fe9280b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9280d0150 0x7fe9280b5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47108/0 (socket says 172.21.15.59:47108) 2024-04-25T09:04:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91fe00640 1 -- 172.21.15.59:0/510964369 learned_addr learned my addr 172.21.15.59:0/510964369 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe926800640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe92815dc00 0x7fe928152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe925e00640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9280c72a0 0x7fe928145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91fe00640 1 -- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe92815dc00 msgr2=0x7fe928152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91fe00640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe92815dc00 0x7fe928152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91fe00640 1 -- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9280c72a0 msgr2=0x7fe928145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91fe00640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9280c72a0 0x7fe928145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91fe00640 1 -- 172.21.15.59:0/510964369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe928146530 con 0x7fe9280d0150 2024-04-25T09:04:18.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91fe00640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9280d0150 0x7fe9280b5a20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe91001a110 tx=0x7fe910019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91e000640 1 -- 172.21.15.59:0/510964369 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9100b9070 con 0x7fe9280d0150 2024-04-25T09:04:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91e000640 1 -- 172.21.15.59:0/510964369 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9100b4600 con 0x7fe9280d0150 2024-04-25T09:04:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe92d200640 1 -- 172.21.15.59:0/510964369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9280b4160 con 0x7fe9280d0150 2024-04-25T09:04:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91e000640 1 -- 172.21.15.59:0/510964369 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9100b0040 con 0x7fe9280d0150 2024-04-25T09:04:18.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe92d200640 1 -- 172.21.15.59:0/510964369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92814db10 con 0x7fe9280d0150 2024-04-25T09:04:18.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe92d200640 1 -- 172.21.15.59:0/510964369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9280745d0 con 0x7fe9280d0150 2024-04-25T09:04:18.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.026+0000 7fe91e000640 1 -- 172.21.15.59:0/510964369 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe9100bc070 con 0x7fe9280d0150 2024-04-25T09:04:18.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.030+0000 7fe91e000640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe904066f90 0x7fe904069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.030+0000 7fe91e000640 1 -- 172.21.15.59:0/510964369 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe91011e0d0 con 0x7fe9280d0150 2024-04-25T09:04:18.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.030+0000 7fe925e00640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe904066f90 0x7fe904069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.030+0000 7fe925e00640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe904066f90 0x7fe904069450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe928153f90 tx=0x7fe918008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.034+0000 7fe91e000640 1 -- 172.21.15.59:0/510964369 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe9100160d0 con 0x7fe9280d0150 2024-04-25T09:04:18.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.230+0000 7fe92d200640 1 -- 172.21.15.59:0/510964369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe9280adfd0 con 0x7fe9280d0150 2024-04-25T09:04:18.223 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:04:18.230+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:04:18.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.234+0000 7fe91e000640 1 -- 172.21.15.59:0/510964369 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe9100ef0d0 con 0x7fe9280d0150 2024-04-25T09:04:18.226 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:04:18.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.238+0000 7fe92d200640 1 -- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe904066f90 msgr2=0x7fe904069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.238+0000 7fe92d200640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe904066f90 0x7fe904069450 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe928153f90 tx=0x7fe918008040 comp rx=0 tx=0).stop 2024-04-25T09:04:18.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.238+0000 7fe92d200640 1 -- 172.21.15.59:0/510964369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9280d0150 msgr2=0x7fe9280b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.238+0000 7fe92d200640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9280d0150 0x7fe9280b5a20 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe91001a110 tx=0x7fe910019280 comp rx=0 tx=0).stop 2024-04-25T09:04:18.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.238+0000 7fe92d200640 1 -- 172.21.15.59:0/510964369 shutdown_connections 2024-04-25T09:04:18.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.238+0000 7fe92d200640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe904066f90 0x7fe904069450 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.238+0000 7fe92d200640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe92815dc00 0x7fe928152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.238+0000 7fe92d200640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9280d0150 0x7fe9280b5a20 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.238+0000 7fe92d200640 1 --2- 172.21.15.59:0/510964369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9280c72a0 0x7fe928145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.238+0000 7fe92d200640 1 -- 172.21.15.59:0/510964369 >> 172.21.15.59:0/510964369 conn(0x7fe9280b2240 msgr2=0x7fe928154a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.238+0000 7fe92d200640 1 -- 172.21.15.59:0/510964369 shutdown_connections 2024-04-25T09:04:18.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.238+0000 7fe92d200640 1 -- 172.21.15.59:0/510964369 wait complete. 2024-04-25T09:04:18.239 INFO:tasks.ceph.mds.a.smithi059.stderr: -5888> 2024-04-25T09:03:34.542+0000 7f7360400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:04:18.244 INFO:tasks.ceph.mds.a.smithi059.stderr: -3182> 2024-04-25T09:03:40.826+0000 7f735b400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5351=0-4194304@1} caps={5351=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5351 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55c1168c7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:04:18.249 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:04:18.289 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:04:18.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.402+0000 7fcfade00640 1 Processor -- start 2024-04-25T09:04:18.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.402+0000 7fcfade00640 1 -- start start 2024-04-25T09:04:18.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcfade00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcfa815acd0 0x7fcfa815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcfade00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcfa815ee60 0x7fcfa80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcfade00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa815bc40 con 0x7fcfa8144120 2024-04-25T09:04:18.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcfade00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa815e490 con 0x7fcfa815acd0 2024-04-25T09:04:18.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcfade00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa815b150 con 0x7fcfa815ee60 2024-04-25T09:04:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcfa6a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcfa8144120 0x7fcfa80ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54706/0 (socket says 172.21.15.59:54706) 2024-04-25T09:04:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcfa6a00640 1 -- 172.21.15.59:0/3634829701 learned_addr learned my addr 172.21.15.59:0/3634829701 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcf9fe00640 1 --2- 172.21.15.59:0/3634829701 >> v2:172.21.15.59:3300/0 conn(0x7fcfa815acd0 0x7fcfa815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcfa7400640 1 --2- 172.21.15.59:0/3634829701 >> v2:172.21.15.178:3300/0 conn(0x7fcfa815ee60 0x7fcfa80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcfa6000640 1 -- 172.21.15.59:0/3634829701 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 826850011 0 0) 0x7fcfa815bc40 con 0x7fcfa8144120 2024-04-25T09:04:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcfa6000640 1 -- 172.21.15.59:0/3634829701 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf8c003530 con 0x7fcfa8144120 2024-04-25T09:04:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcf9fe00640 1 -- 172.21.15.59:0/3634829701 >> v2:172.21.15.178:3300/0 conn(0x7fcfa815ee60 msgr2=0x7fcfa80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcf9fe00640 1 --2- 172.21.15.59:0/3634829701 >> v2:172.21.15.178:3300/0 conn(0x7fcfa815ee60 0x7fcfa80b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcf9fe00640 1 -- 172.21.15.59:0/3634829701 >> v1:172.21.15.59:6789/0 conn(0x7fcfa8144120 legacy=0x7fcfa80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcf9fe00640 1 -- 172.21.15.59:0/3634829701 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa815b3a0 con 0x7fcfa815acd0 2024-04-25T09:04:18.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.406+0000 7fcfa7400640 1 --2- 172.21.15.59:0/3634829701 >> v2:172.21.15.178:3300/0 conn(0x7fcfa815ee60 0x7fcfa80b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:18.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcf9fe00640 1 --2- 172.21.15.59:0/3634829701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa815acd0 0x7fcfa815e920 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcfa806bb20 tx=0x7fcf9001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d65b577eb4432ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfa6000640 1 -- 172.21.15.59:0/3634829701 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf900b0070 con 0x7fcfa815acd0 2024-04-25T09:04:18.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfa6000640 1 -- 172.21.15.59:0/3634829701 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf900ab600 con 0x7fcfa815acd0 2024-04-25T09:04:18.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfa6000640 1 -- 172.21.15.59:0/3634829701 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf900ab9d0 con 0x7fcfa815acd0 2024-04-25T09:04:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 -- 172.21.15.59:0/3634829701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa815acd0 msgr2=0x7fcfa815e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 --2- 172.21.15.59:0/3634829701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa815acd0 0x7fcfa815e920 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fcfa806bb20 tx=0x7fcf9001c3f0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 -- 172.21.15.59:0/3634829701 shutdown_connections 2024-04-25T09:04:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 --2- 172.21.15.59:0/3634829701 >> v2:172.21.15.178:3300/0 conn(0x7fcfa815ee60 0x7fcfa80b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 --2- 172.21.15.59:0/3634829701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa815acd0 0x7fcfa815e920 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 -- 172.21.15.59:0/3634829701 >> 172.21.15.59:0/3634829701 conn(0x7fcfa8067080 msgr2=0x7fcfa806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 -- 172.21.15.59:0/3634829701 shutdown_connections 2024-04-25T09:04:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 -- 172.21.15.59:0/3634829701 wait complete. 2024-04-25T09:04:18.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 Processor -- start 2024-04-25T09:04:18.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 -- start start 2024-04-25T09:04:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa8144120 0x7fcfa8139180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa815acd0 0x7fcfa815d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfa815ee60 0x7fcfa813c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa806d450 con 0x7fcfa8144120 2024-04-25T09:04:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa806d2d0 con 0x7fcfa815ee60 2024-04-25T09:04:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfade00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa806d5d0 con 0x7fcfa815acd0 2024-04-25T09:04:18.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfa6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa8144120 0x7fcfa8139180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfa6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa8144120 0x7fcfa8139180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47146/0 (socket says 172.21.15.59:47146) 2024-04-25T09:04:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.410+0000 7fcfa6a00640 1 -- 172.21.15.59:0/2177766303 learned_addr learned my addr 172.21.15.59:0/2177766303 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcfa7400640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfa815ee60 0x7fcfa813c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcf9fe00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa815acd0 0x7fcfa815d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcfa6a00640 1 -- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa815acd0 msgr2=0x7fcfa815d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcfa6a00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa815acd0 0x7fcfa815d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcfa6a00640 1 -- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfa815ee60 msgr2=0x7fcfa813c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcfa6a00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfa815ee60 0x7fcfa813c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcfa6a00640 1 -- 172.21.15.59:0/2177766303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa815d950 con 0x7fcfa8144120 2024-04-25T09:04:18.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcf9fe00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa815acd0 0x7fcfa815d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcfa6a00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa8144120 0x7fcfa8139180 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c450 tx=0x7fcf9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcf9f400640 1 -- 172.21.15.59:0/2177766303 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98017070 con 0x7fcfa8144120 2024-04-25T09:04:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcf9f400640 1 -- 172.21.15.59:0/2177766303 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf98005cf0 con 0x7fcfa8144120 2024-04-25T09:04:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcf9f400640 1 -- 172.21.15.59:0/2177766303 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980072f0 con 0x7fcfa8144120 2024-04-25T09:04:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcfade00640 1 -- 172.21.15.59:0/2177766303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa80af110 con 0x7fcfa8144120 2024-04-25T09:04:18.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcfade00640 1 -- 172.21.15.59:0/2177766303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa80af6d0 con 0x7fcfa8144120 2024-04-25T09:04:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcfade00640 1 -- 172.21.15.59:0/2177766303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa80745d0 con 0x7fcfa8144120 2024-04-25T09:04:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.414+0000 7fcf9f400640 1 -- 172.21.15.59:0/2177766303 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcf9801a070 con 0x7fcfa8144120 2024-04-25T09:04:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.418+0000 7fcf9f400640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf84066f60 0x7fcf84069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:18.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.418+0000 7fcf9f400640 1 -- 172.21.15.59:0/2177766303 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6245+0+0 (secure 0 0 0) 0x7fcf980846a0 con 0x7fcfa8144120 2024-04-25T09:04:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.418+0000 7fcf9fe00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf84066f60 0x7fcf84069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:18.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.418+0000 7fcf9fe00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf84066f60 0x7fcf84069420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcf900ad000 tx=0x7fcf90008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:18.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.422+0000 7fcf9f400640 1 -- 172.21.15.59:0/2177766303 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcf98055480 con 0x7fcfa8144120 2024-04-25T09:04:18.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:18.622+0000 7fcfade00640 1 -- 172.21.15.59:0/2177766303 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcfa80b20e0 con 0x7fcfa8144120 2024-04-25T09:04:19.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.238+0000 7fcf9f400640 1 -- 172.21.15.59:0/2177766303 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcf98054d80 con 0x7fcfa8144120 2024-04-25T09:04:19.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.242+0000 7fcfade00640 1 -- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf84066f60 msgr2=0x7fcf84069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.242+0000 7fcfade00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf84066f60 0x7fcf84069420 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcf900ad000 tx=0x7fcf90008040 comp rx=0 tx=0).stop 2024-04-25T09:04:19.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.242+0000 7fcfade00640 1 -- 172.21.15.59:0/2177766303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa8144120 msgr2=0x7fcfa8139180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.242+0000 7fcfade00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa8144120 0x7fcfa8139180 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcf9800c450 tx=0x7fcf9800c910 comp rx=0 tx=0).stop 2024-04-25T09:04:19.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.242+0000 7fcfade00640 1 -- 172.21.15.59:0/2177766303 shutdown_connections 2024-04-25T09:04:19.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.242+0000 7fcfade00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf84066f60 0x7fcf84069420 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.242+0000 7fcfade00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfa815ee60 0x7fcfa813c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.242+0000 7fcfade00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfa815acd0 0x7fcfa815d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.242+0000 7fcfade00640 1 --2- 172.21.15.59:0/2177766303 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfa8144120 0x7fcfa8139180 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.242+0000 7fcfade00640 1 -- 172.21.15.59:0/2177766303 >> 172.21.15.59:0/2177766303 conn(0x7fcfa8067080 msgr2=0x7fcfa8140ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.242+0000 7fcfade00640 1 -- 172.21.15.59:0/2177766303 shutdown_connections 2024-04-25T09:04:19.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.242+0000 7fcfade00640 1 -- 172.21.15.59:0/2177766303 wait complete. 2024-04-25T09:04:19.257 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:04:19.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.458+0000 7f8141a00640 1 Processor -- start 2024-04-25T09:04:19.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.458+0000 7f8141a00640 1 -- start start 2024-04-25T09:04:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.462+0000 7f8141a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f813c15dab0 0x7f813c0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.462+0000 7f8141a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c15de90 con 0x7f813c0b0c00 2024-04-25T09:04:19.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.462+0000 7f8141a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f813c071a70 con 0x7f813c0713c0 2024-04-25T09:04:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.462+0000 7f8141a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813c0b57a0 con 0x7f813c15dab0 2024-04-25T09:04:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.462+0000 7f813aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f813c15dab0 0x7f813c0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.462+0000 7f8132000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f813c0b0c00 0x7f813c070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54714/0 (socket says 172.21.15.59:54714) 2024-04-25T09:04:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.462+0000 7f813aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f813c15dab0 0x7f813c0b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47158/0 (socket says 172.21.15.59:47158) 2024-04-25T09:04:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.462+0000 7f8132000640 1 -- 172.21.15.59:0/4049152709 learned_addr learned my addr 172.21.15.59:0/4049152709 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.462+0000 7f813aa00640 1 -- 172.21.15.59:0/4049152709 >> v1:172.21.15.178:6789/0 conn(0x7f813c0713c0 legacy=0x7f813c06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:19.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.462+0000 7f813aa00640 1 -- 172.21.15.59:0/4049152709 >> v1:172.21.15.59:6789/0 conn(0x7f813c0b0c00 legacy=0x7f813c070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.462+0000 7f813aa00640 1 -- 172.21.15.59:0/4049152709 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c06bec0 con 0x7f813c15dab0 2024-04-25T09:04:19.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f813aa00640 1 --2- 172.21.15.59:0/4049152709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c15dab0 0x7f813c0b5110 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f812c009d90 tx=0x7f812c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95f7a983158e90b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f813a000640 1 -- 172.21.15.59:0/4049152709 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0b2070 con 0x7f813c15dab0 2024-04-25T09:04:19.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f813a000640 1 -- 172.21.15.59:0/4049152709 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c0a58d0 con 0x7f813c15dab0 2024-04-25T09:04:19.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f813a000640 1 -- 172.21.15.59:0/4049152709 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0a5ca0 con 0x7f813c15dab0 2024-04-25T09:04:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f8141a00640 1 -- 172.21.15.59:0/4049152709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c15dab0 msgr2=0x7f813c0b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f8141a00640 1 --2- 172.21.15.59:0/4049152709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c15dab0 0x7f813c0b5110 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f812c009d90 tx=0x7f812c01c900 comp rx=0 tx=0).stop 2024-04-25T09:04:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f8141a00640 1 -- 172.21.15.59:0/4049152709 shutdown_connections 2024-04-25T09:04:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f8141a00640 1 --2- 172.21.15.59:0/4049152709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c15dab0 0x7f813c0b5110 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f8141a00640 1 -- 172.21.15.59:0/4049152709 >> 172.21.15.59:0/4049152709 conn(0x7f813c06f510 msgr2=0x7f813c06f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f8141a00640 1 -- 172.21.15.59:0/4049152709 shutdown_connections 2024-04-25T09:04:19.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f8141a00640 1 -- 172.21.15.59:0/4049152709 wait complete. 2024-04-25T09:04:19.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f8141a00640 1 Processor -- start 2024-04-25T09:04:19.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.466+0000 7f8141a00640 1 -- start start 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8141a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f813c0713c0 0x7f813c15e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8141a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c0b0c00 0x7f813c160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8141a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f813c15dab0 0x7f813c160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8141a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c06dc50 con 0x7f813c0b0c00 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8141a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813c06dad0 con 0x7f813c15dab0 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8141a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813c16b940 con 0x7f813c0713c0 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8132000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c0b0c00 0x7f813c160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8132000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c0b0c00 0x7f813c160240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47170/0 (socket says 172.21.15.59:47170) 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8132000640 1 -- 172.21.15.59:0/1942528861 learned_addr learned my addr 172.21.15.59:0/1942528861 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f813aa00640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f813c0713c0 0x7f813c15e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f813b400640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f813c15dab0 0x7f813c160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8132000640 1 -- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f813c0713c0 msgr2=0x7f813c15e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8132000640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f813c0713c0 0x7f813c15e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8132000640 1 -- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f813c15dab0 msgr2=0x7f813c160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8132000640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f813c15dab0 0x7f813c160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8132000640 1 -- 172.21.15.59:0/1942528861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813c15edc0 con 0x7f813c0b0c00 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f813aa00640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f813c0713c0 0x7f813c15e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8132000640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c0b0c00 0x7f813c160240 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f812400c450 tx=0x7f812400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8133400640 1 -- 172.21.15.59:0/1942528861 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124017070 con 0x7f813c0b0c00 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8133400640 1 -- 172.21.15.59:0/1942528861 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8124005cf0 con 0x7f813c0b0c00 2024-04-25T09:04:19.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8133400640 1 -- 172.21.15.59:0/1942528861 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8124007290 con 0x7f813c0b0c00 2024-04-25T09:04:19.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8141a00640 1 -- 172.21.15.59:0/1942528861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813c15eae0 con 0x7f813c0b0c00 2024-04-25T09:04:19.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8141a00640 1 -- 172.21.15.59:0/1942528861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813c153d60 con 0x7f813c0b0c00 2024-04-25T09:04:19.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8141a00640 1 -- 172.21.15.59:0/1942528861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813c0745d0 con 0x7f813c0b0c00 2024-04-25T09:04:19.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.470+0000 7f8133400640 1 -- 172.21.15.59:0/1942528861 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f812401a070 con 0x7f813c0b0c00 2024-04-25T09:04:19.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.474+0000 7f8133400640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8118066f60 0x7f8118069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:19.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.474+0000 7f8133400640 1 -- 172.21.15.59:0/1942528861 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f81240844b0 con 0x7f813c0b0c00 2024-04-25T09:04:19.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.474+0000 7f813aa00640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8118066f60 0x7f8118069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:19.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.474+0000 7f813aa00640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8118066f60 0x7f8118069420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f812c0af000 tx=0x7f812c0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:19.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.478+0000 7f8133400640 1 -- 172.21.15.59:0/1942528861 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8124054c40 con 0x7f813c0b0c00 2024-04-25T09:04:19.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:19.642+0000 7f8141a00640 1 -- 172.21.15.59:0/1942528861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f813c0b1650 con 0x7f813c0b0c00 2024-04-25T09:04:20.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.246+0000 7f8133400640 1 -- 172.21.15.59:0/1942528861 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8124058ce0 con 0x7f813c0b0c00 2024-04-25T09:04:20.237 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:04:20.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.246+0000 7f8141a00640 1 -- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8118066f60 msgr2=0x7f8118069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.246+0000 7f8141a00640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8118066f60 0x7f8118069420 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f812c0af000 tx=0x7f812c0a7070 comp rx=0 tx=0).stop 2024-04-25T09:04:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.246+0000 7f8141a00640 1 -- 172.21.15.59:0/1942528861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c0b0c00 msgr2=0x7f813c160240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.246+0000 7f8141a00640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c0b0c00 0x7f813c160240 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f812400c450 tx=0x7f812400c910 comp rx=0 tx=0).stop 2024-04-25T09:04:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.250+0000 7f8141a00640 1 -- 172.21.15.59:0/1942528861 shutdown_connections 2024-04-25T09:04:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.250+0000 7f8141a00640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8118066f60 0x7f8118069420 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.250+0000 7f8141a00640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f813c15dab0 0x7f813c160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.250+0000 7f8141a00640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f813c0b0c00 0x7f813c160240 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.250+0000 7f8141a00640 1 --2- 172.21.15.59:0/1942528861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f813c0713c0 0x7f813c15e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.250+0000 7f8141a00640 1 -- 172.21.15.59:0/1942528861 >> 172.21.15.59:0/1942528861 conn(0x7f813c06f510 msgr2=0x7f813c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.250+0000 7f8141a00640 1 -- 172.21.15.59:0/1942528861 shutdown_connections 2024-04-25T09:04:20.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.250+0000 7f8141a00640 1 -- 172.21.15.59:0/1942528861 wait complete. 2024-04-25T09:04:20.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:04:20.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa448800640 1 Processor -- start 2024-04-25T09:04:20.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa448800640 1 -- start start 2024-04-25T09:04:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa448800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4400cdf90 0x7fa44015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa448800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44015ccc0 con 0x7fa440071250 2024-04-25T09:04:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa448800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa44015c720 con 0x7fa44015c2d0 2024-04-25T09:04:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa448800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa440160200 con 0x7fa4400cdf90 2024-04-25T09:04:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa445400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa4400cdf90 0x7fa44015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa445e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa440071250 0x7fa440071630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54716/0 (socket says 172.21.15.59:54716) 2024-04-25T09:04:20.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa445e00640 1 -- 172.21.15.59:0/4282352826 learned_addr learned my addr 172.21.15.59:0/4282352826 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:20.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa445400640 1 -- 172.21.15.59:0/4282352826 >> v1:172.21.15.178:6789/0 conn(0x7fa44015c2d0 legacy=0x7fa44015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa445400640 1 -- 172.21.15.59:0/4282352826 >> v1:172.21.15.59:6789/0 conn(0x7fa440071250 legacy=0x7fa440071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa445400640 1 -- 172.21.15.59:0/4282352826 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa44015c9e0 con 0x7fa4400cdf90 2024-04-25T09:04:20.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.422+0000 7fa444a00640 1 -- 172.21.15.59:0/4282352826 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807047557 0 0) 0x7fa44015ccc0 con 0x7fa440071250 2024-04-25T09:04:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.426+0000 7fa445400640 1 --2- 172.21.15.59:0/4282352826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4400cdf90 0x7fa44015bd90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa4300097c0 tx=0x7fa43001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d53d4c1602feb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.426+0000 7fa444a00640 1 -- 172.21.15.59:0/4282352826 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4300b0070 con 0x7fa4400cdf90 2024-04-25T09:04:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.426+0000 7fa444a00640 1 -- 172.21.15.59:0/4282352826 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4300ab600 con 0x7fa4400cdf90 2024-04-25T09:04:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.426+0000 7fa444a00640 1 -- 172.21.15.59:0/4282352826 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4300ab9d0 con 0x7fa4400cdf90 2024-04-25T09:04:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.426+0000 7fa448800640 1 -- 172.21.15.59:0/4282352826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4400cdf90 msgr2=0x7fa44015bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.426+0000 7fa448800640 1 --2- 172.21.15.59:0/4282352826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4400cdf90 0x7fa44015bd90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa4300097c0 tx=0x7fa43001c410 comp rx=0 tx=0).stop 2024-04-25T09:04:20.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.426+0000 7fa448800640 1 -- 172.21.15.59:0/4282352826 shutdown_connections 2024-04-25T09:04:20.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.426+0000 7fa448800640 1 --2- 172.21.15.59:0/4282352826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4400cdf90 0x7fa44015bd90 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.426+0000 7fa448800640 1 -- 172.21.15.59:0/4282352826 >> 172.21.15.59:0/4282352826 conn(0x7fa44006ac10 msgr2=0x7fa44006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:20.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.426+0000 7fa448800640 1 -- 172.21.15.59:0/4282352826 shutdown_connections 2024-04-25T09:04:20.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.426+0000 7fa448800640 1 -- 172.21.15.59:0/4282352826 wait complete. 2024-04-25T09:04:20.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa448800640 1 Processor -- start 2024-04-25T09:04:20.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa448800640 1 -- start start 2024-04-25T09:04:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa448800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa440071250 0x7fa4400b3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa448800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cdf90 0x7fa440149590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa448800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa44015c2d0 0x7fa4400b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa448800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa440169630 con 0x7fa44015c2d0 2024-04-25T09:04:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa448800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4401694b0 con 0x7fa440071250 2024-04-25T09:04:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa448800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4401697b0 con 0x7fa4400cdf90 2024-04-25T09:04:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa446800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa44015c2d0 0x7fa4400b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa446800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa44015c2d0 0x7fa4400b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47182/0 (socket says 172.21.15.59:47182) 2024-04-25T09:04:20.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa446800640 1 -- 172.21.15.59:0/1664895117 learned_addr learned my addr 172.21.15.59:0/1664895117 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa445400640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cdf90 0x7fa440149590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa445e00640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa440071250 0x7fa4400b3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa446800640 1 -- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cdf90 msgr2=0x7fa440149590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa446800640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cdf90 0x7fa440149590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa446800640 1 -- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa440071250 msgr2=0x7fa4400b3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa446800640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa440071250 0x7fa4400b3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa446800640 1 -- 172.21.15.59:0/1664895117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa440153990 con 0x7fa44015c2d0 2024-04-25T09:04:20.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa446800640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa44015c2d0 0x7fa4400b2420 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c7a0 tx=0x7fa43c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa43a000640 1 -- 172.21.15.59:0/1664895117 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c003ba0 con 0x7fa44015c2d0 2024-04-25T09:04:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa43a000640 1 -- 172.21.15.59:0/1664895117 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43c003d40 con 0x7fa44015c2d0 2024-04-25T09:04:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa448800640 1 -- 172.21.15.59:0/1664895117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa440153c00 con 0x7fa44015c2d0 2024-04-25T09:04:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa43a000640 1 -- 172.21.15.59:0/1664895117 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43c00aa30 con 0x7fa44015c2d0 2024-04-25T09:04:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa448800640 1 -- 172.21.15.59:0/1664895117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa440149ad0 con 0x7fa44015c2d0 2024-04-25T09:04:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.430+0000 7fa448800640 1 -- 172.21.15.59:0/1664895117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4400b3420 con 0x7fa44015c2d0 2024-04-25T09:04:20.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.434+0000 7fa43a000640 1 -- 172.21.15.59:0/1664895117 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa43c00abd0 con 0x7fa44015c2d0 2024-04-25T09:04:20.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.434+0000 7fa43a000640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa424066f60 0x7fa424069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:20.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.434+0000 7fa43a000640 1 -- 172.21.15.59:0/1664895117 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5807+0+0 (secure 0 0 0) 0x7fa43c085080 con 0x7fa44015c2d0 2024-04-25T09:04:20.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.434+0000 7fa445e00640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa424066f60 0x7fa424069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:20.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.434+0000 7fa445e00640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa424066f60 0x7fa424069420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa434000f70 tx=0x7fa434007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:20.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.438+0000 7fa43a000640 1 -- 172.21.15.59:0/1664895117 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa43c055f90 con 0x7fa44015c2d0 2024-04-25T09:04:20.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:20.614+0000 7fa448800640 1 -- 172.21.15.59:0/1664895117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa4400745d0 con 0x7fa44015c2d0 2024-04-25T09:04:21.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.250+0000 7fa43a000640 1 -- 172.21.15.59:0/1664895117 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa43c055890 con 0x7fa44015c2d0 2024-04-25T09:04:21.243 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-04-25T09:04:21.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.254+0000 7fa448800640 1 -- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa424066f60 msgr2=0x7fa424069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.254+0000 7fa448800640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa424066f60 0x7fa424069420 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fa434000f70 tx=0x7fa434007d10 comp rx=0 tx=0).stop 2024-04-25T09:04:21.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.254+0000 7fa448800640 1 -- 172.21.15.59:0/1664895117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa44015c2d0 msgr2=0x7fa4400b2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.254+0000 7fa448800640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa44015c2d0 0x7fa4400b2420 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00c7a0 tx=0x7fa43c00cc60 comp rx=0 tx=0).stop 2024-04-25T09:04:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.254+0000 7fa448800640 1 -- 172.21.15.59:0/1664895117 shutdown_connections 2024-04-25T09:04:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.254+0000 7fa448800640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa424066f60 0x7fa424069420 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.254+0000 7fa448800640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa44015c2d0 0x7fa4400b2420 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.254+0000 7fa448800640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4400cdf90 0x7fa440149590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.254+0000 7fa448800640 1 --2- 172.21.15.59:0/1664895117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa440071250 0x7fa4400b3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.254+0000 7fa448800640 1 -- 172.21.15.59:0/1664895117 >> 172.21.15.59:0/1664895117 conn(0x7fa44006ac10 msgr2=0x7fa44015ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.254+0000 7fa448800640 1 -- 172.21.15.59:0/1664895117 shutdown_connections 2024-04-25T09:04:21.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.254+0000 7fa448800640 1 -- 172.21.15.59:0/1664895117 wait complete. 2024-04-25T09:04:21.272 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:04:21.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.438+0000 7f49eca00640 1 Processor -- start 2024-04-25T09:04:21.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.438+0000 7f49eca00640 1 -- start start 2024-04-25T09:04:21.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.438+0000 7f49eca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e806c730 0x7f49e815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.438+0000 7f49eca00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f49e80d0790 0x7f49e8161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.438+0000 7f49eca00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e815ef90 con 0x7f49e806cb10 2024-04-25T09:04:21.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.438+0000 7f49eca00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e809a9e0 con 0x7f49e80d0790 2024-04-25T09:04:21.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.438+0000 7f49eca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e809ae70 con 0x7f49e806c730 2024-04-25T09:04:21.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.438+0000 7f49e7400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e806c730 0x7f49e815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.438+0000 7f49e7400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e806c730 0x7f49e815ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:40232/0 (socket says 172.21.15.59:40232) 2024-04-25T09:04:21.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.438+0000 7f49e7400640 1 -- 172.21.15.59:0/3549547931 learned_addr learned my addr 172.21.15.59:0/3549547931 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:21.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.438+0000 7f49e6a00640 1 --1- 172.21.15.59:0/3549547931 >> v1:172.21.15.178:6789/0 conn(0x7f49e806cb10 0x7f49e8161590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:55250/0 (socket says 172.21.15.59:55250) 2024-04-25T09:04:21.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.438+0000 7f49e7e00640 1 --2- 172.21.15.59:0/3549547931 >> v2:172.21.15.178:3300/0 conn(0x7f49e80d0790 0x7f49e8161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49e7400640 1 -- 172.21.15.59:0/3549547931 >> v2:172.21.15.178:3300/0 conn(0x7f49e80d0790 msgr2=0x7f49e8161ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:21.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49e7400640 1 --2- 172.21.15.59:0/3549547931 >> v2:172.21.15.178:3300/0 conn(0x7f49e80d0790 0x7f49e8161ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49e7400640 1 -- 172.21.15.59:0/3549547931 >> v1:172.21.15.178:6789/0 conn(0x7f49e806cb10 legacy=0x7f49e8161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49e7400640 1 -- 172.21.15.59:0/3549547931 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8099dd0 con 0x7f49e806c730 2024-04-25T09:04:21.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49e7400640 1 --2- 172.21.15.59:0/3549547931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e806c730 0x7f49e815ea50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009870 tx=0x7f49d801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=254319b31b8cb043 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49e6000640 1 -- 172.21.15.59:0/3549547931 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d80a95f0 con 0x7f49e806c730 2024-04-25T09:04:21.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49e6000640 1 -- 172.21.15.59:0/3549547931 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d80a9790 con 0x7f49e806c730 2024-04-25T09:04:21.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49e6000640 1 -- 172.21.15.59:0/3549547931 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d80a9b60 con 0x7f49e806c730 2024-04-25T09:04:21.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49eca00640 1 -- 172.21.15.59:0/3549547931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e806c730 msgr2=0x7f49e815ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49eca00640 1 --2- 172.21.15.59:0/3549547931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e806c730 0x7f49e815ea50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f49d8009870 tx=0x7f49d801c530 comp rx=0 tx=0).stop 2024-04-25T09:04:21.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49eca00640 1 -- 172.21.15.59:0/3549547931 shutdown_connections 2024-04-25T09:04:21.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49eca00640 1 --2- 172.21.15.59:0/3549547931 >> v2:172.21.15.178:3300/0 conn(0x7f49e80d0790 0x7f49e8161ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49eca00640 1 --2- 172.21.15.59:0/3549547931 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e806c730 0x7f49e815ea50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49eca00640 1 -- 172.21.15.59:0/3549547931 >> 172.21.15.59:0/3549547931 conn(0x7f49e80b3030 msgr2=0x7f49e80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49eca00640 1 -- 172.21.15.59:0/3549547931 shutdown_connections 2024-04-25T09:04:21.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.442+0000 7f49eca00640 1 -- 172.21.15.59:0/3549547931 wait complete. 2024-04-25T09:04:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49eca00640 1 Processor -- start 2024-04-25T09:04:21.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49eca00640 1 -- start start 2024-04-25T09:04:21.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49eca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e806c730 0x7f49e81fa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49eca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e806cb10 0x7f49e815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49eca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49e80d0790 0x7f49e8151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49eca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8099a60 con 0x7f49e806cb10 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49eca00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e815de20 con 0x7f49e80d0790 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49eca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80b0720 con 0x7f49e806c730 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49e6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e806cb10 0x7f49e815cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49e6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e806cb10 0x7f49e815cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34008/0 (socket says 172.21.15.59:34008) 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49e6a00640 1 -- 172.21.15.59:0/3829291059 learned_addr learned my addr 172.21.15.59:0/3829291059 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49e7400640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e806c730 0x7f49e81fa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49e7e00640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49e80d0790 0x7f49e8151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49e6a00640 1 -- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e806c730 msgr2=0x7f49e81fa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49e6a00640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e806c730 0x7f49e81fa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49e6a00640 1 -- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49e80d0790 msgr2=0x7f49e8151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49e6a00640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49e80d0790 0x7f49e8151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49e6a00640 1 -- 172.21.15.59:0/3829291059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e81fac50 con 0x7f49e806cb10 2024-04-25T09:04:21.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49e7e00640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49e80d0790 0x7f49e8151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:21.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49e6a00640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e806cb10 0x7f49e815cca0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f49d400c450 tx=0x7f49d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.446+0000 7f49df400640 1 -- 172.21.15.59:0/3829291059 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4018070 con 0x7f49e806cb10 2024-04-25T09:04:21.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.450+0000 7f49df400640 1 -- 172.21.15.59:0/3829291059 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4007480 con 0x7f49e806cb10 2024-04-25T09:04:21.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.450+0000 7f49df400640 1 -- 172.21.15.59:0/3829291059 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40047f0 con 0x7f49e806cb10 2024-04-25T09:04:21.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.450+0000 7f49eca00640 1 -- 172.21.15.59:0/3829291059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e80b6260 con 0x7f49e806cb10 2024-04-25T09:04:21.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.450+0000 7f49eca00640 1 -- 172.21.15.59:0/3829291059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e80b6820 con 0x7f49e806cb10 2024-04-25T09:04:21.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.450+0000 7f49eca00640 1 -- 172.21.15.59:0/3829291059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e80745d0 con 0x7f49e806cb10 2024-04-25T09:04:21.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.450+0000 7f49df400640 1 -- 172.21.15.59:0/3829291059 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f49d4004990 con 0x7f49e806cb10 2024-04-25T09:04:21.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.450+0000 7f49df400640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f49c8066f90 0x7f49c8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.450+0000 7f49df400640 1 -- 172.21.15.59:0/3829291059 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f49d4084060 con 0x7f49e806cb10 2024-04-25T09:04:21.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.450+0000 7f49e7400640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f49c8066f90 0x7f49c8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.450+0000 7f49e7400640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f49c8066f90 0x7f49c8069450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f49d80ae000 tx=0x7f49d80b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.454+0000 7f49df400640 1 -- 172.21.15.59:0/3829291059 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f49e81fac50 con 0x7f49e806cb10 2024-04-25T09:04:21.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.618+0000 7f49eca00640 1 -- 172.21.15.59:0/3829291059 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f49e806c510 con 0x7f49e806cb10 2024-04-25T09:04:21.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.622+0000 7f49df400640 1 -- 172.21.15.59:0/3829291059 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f49d40551d0 con 0x7f49e806cb10 2024-04-25T09:04:21.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.626+0000 7f49eca00640 1 -- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f49c8066f90 msgr2=0x7f49c8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.626+0000 7f49eca00640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f49c8066f90 0x7f49c8069450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f49d80ae000 tx=0x7f49d80b3040 comp rx=0 tx=0).stop 2024-04-25T09:04:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.626+0000 7f49eca00640 1 -- 172.21.15.59:0/3829291059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e806cb10 msgr2=0x7f49e815cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.626+0000 7f49eca00640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e806cb10 0x7f49e815cca0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f49d400c450 tx=0x7f49d400c910 comp rx=0 tx=0).stop 2024-04-25T09:04:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.626+0000 7f49eca00640 1 -- 172.21.15.59:0/3829291059 shutdown_connections 2024-04-25T09:04:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.626+0000 7f49eca00640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f49c8066f90 0x7f49c8069450 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.626+0000 7f49eca00640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f49e80d0790 0x7f49e8151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.626+0000 7f49eca00640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49e806cb10 0x7f49e815cca0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.626+0000 7f49eca00640 1 --2- 172.21.15.59:0/3829291059 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f49e806c730 0x7f49e81fa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.626+0000 7f49eca00640 1 -- 172.21.15.59:0/3829291059 >> 172.21.15.59:0/3829291059 conn(0x7f49e80b3030 msgr2=0x7f49e8153160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.626+0000 7f49eca00640 1 -- 172.21.15.59:0/3829291059 shutdown_connections 2024-04-25T09:04:21.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.626+0000 7f49eca00640 1 -- 172.21.15.59:0/3829291059 wait complete. 2024-04-25T09:04:21.638 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-25T09:04:21.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.786+0000 7fc895e00640 1 Processor -- start 2024-04-25T09:04:21.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.786+0000 7fc895e00640 1 -- start start 2024-04-25T09:04:21.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc895e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc89015da10 0x7fc8900afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc895e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc8900d11b0 0x7fc89006ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc895e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8900b4210 0x7fc8900b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc895e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8900b4ba0 con 0x7fc89015da10 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc895e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89015ddf0 con 0x7fc8900d11b0 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc895e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89006b480 con 0x7fc8900b4210 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc88ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc89015da10 0x7fc8900afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc88ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc89015da10 0x7fc8900afe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34014/0 (socket says 172.21.15.59:34014) 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc88ea00640 1 -- 172.21.15.59:0/3848492830 learned_addr learned my addr 172.21.15.59:0/3848492830 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc88f400640 1 --2- 172.21.15.59:0/3848492830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8900b4210 0x7fc8900b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc887e00640 1 --2- 172.21.15.59:0/3848492830 >> v2:172.21.15.178:3300/0 conn(0x7fc8900d11b0 0x7fc89006ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc88ea00640 1 -- 172.21.15.59:0/3848492830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8900b4210 msgr2=0x7fc8900b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc88ea00640 1 --2- 172.21.15.59:0/3848492830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8900b4210 0x7fc8900b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc88ea00640 1 -- 172.21.15.59:0/3848492830 >> v2:172.21.15.178:3300/0 conn(0x7fc8900d11b0 msgr2=0x7fc89006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:21.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc88ea00640 1 --2- 172.21.15.59:0/3848492830 >> v2:172.21.15.178:3300/0 conn(0x7fc8900d11b0 0x7fc89006ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.790+0000 7fc88ea00640 1 -- 172.21.15.59:0/3848492830 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8900d06d0 con 0x7fc89015da10 2024-04-25T09:04:21.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc88ea00640 1 --2- 172.21.15.59:0/3848492830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89015da10 0x7fc8900afe20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc890071d40 tx=0x7fc88001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab06251394c26ec1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc88e000640 1 -- 172.21.15.59:0/3848492830 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8800b0070 con 0x7fc89015da10 2024-04-25T09:04:21.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc88e000640 1 -- 172.21.15.59:0/3848492830 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8800ab600 con 0x7fc89015da10 2024-04-25T09:04:21.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc88e000640 1 -- 172.21.15.59:0/3848492830 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8800ab9d0 con 0x7fc89015da10 2024-04-25T09:04:21.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 -- 172.21.15.59:0/3848492830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89015da10 msgr2=0x7fc8900afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 --2- 172.21.15.59:0/3848492830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89015da10 0x7fc8900afe20 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc890071d40 tx=0x7fc88001c490 comp rx=0 tx=0).stop 2024-04-25T09:04:21.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 -- 172.21.15.59:0/3848492830 shutdown_connections 2024-04-25T09:04:21.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 --2- 172.21.15.59:0/3848492830 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8900b4210 0x7fc8900b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 --2- 172.21.15.59:0/3848492830 >> v2:172.21.15.178:3300/0 conn(0x7fc8900d11b0 0x7fc89006ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 --2- 172.21.15.59:0/3848492830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89015da10 0x7fc8900afe20 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 -- 172.21.15.59:0/3848492830 >> 172.21.15.59:0/3848492830 conn(0x7fc8900b2400 msgr2=0x7fc8900b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:21.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 -- 172.21.15.59:0/3848492830 shutdown_connections 2024-04-25T09:04:21.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 -- 172.21.15.59:0/3848492830 wait complete. 2024-04-25T09:04:21.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 Processor -- start 2024-04-25T09:04:21.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 -- start start 2024-04-25T09:04:21.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8900b4210 0x7fc89013afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8900d11b0 0x7fc8901554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89015da10 0x7fc89014ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900704b0 con 0x7fc89015da10 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc890070330 con 0x7fc8900b4210 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.794+0000 7fc895e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc890070630 con 0x7fc8900d11b0 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc88f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89015da10 0x7fc89014ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc88f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89015da10 0x7fc89014ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34024/0 (socket says 172.21.15.59:34024) 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc88f400640 1 -- 172.21.15.59:0/2961812431 learned_addr learned my addr 172.21.15.59:0/2961812431 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc887e00640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8900d11b0 0x7fc8901554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc88ea00640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8900b4210 0x7fc89013afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc88f400640 1 -- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8900d11b0 msgr2=0x7fc8901554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc88f400640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8900d11b0 0x7fc8901554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc88f400640 1 -- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8900b4210 msgr2=0x7fc89013afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc88f400640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8900b4210 0x7fc89013afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc88f400640 1 -- 172.21.15.59:0/2961812431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc890155de0 con 0x7fc89015da10 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc88f400640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89015da10 0x7fc89014ed60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc888007e90 tx=0x7fc88800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc887400640 1 -- 172.21.15.59:0/2961812431 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888014420 con 0x7fc89015da10 2024-04-25T09:04:21.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc887400640 1 -- 172.21.15.59:0/2961812431 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc888019070 con 0x7fc89015da10 2024-04-25T09:04:21.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc887400640 1 -- 172.21.15.59:0/2961812431 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888014820 con 0x7fc89015da10 2024-04-25T09:04:21.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc895e00640 1 -- 172.21.15.59:0/2961812431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8901560c0 con 0x7fc89015da10 2024-04-25T09:04:21.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc895e00640 1 -- 172.21.15.59:0/2961812431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8900cd490 con 0x7fc89015da10 2024-04-25T09:04:21.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc895e00640 1 -- 172.21.15.59:0/2961812431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8900745d0 con 0x7fc89015da10 2024-04-25T09:04:21.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.798+0000 7fc887400640 1 -- 172.21.15.59:0/2961812431 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc8880149c0 con 0x7fc89015da10 2024-04-25T09:04:21.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.802+0000 7fc887400640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc86c066f60 0x7fc86c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:21.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.802+0000 7fc887400640 1 -- 172.21.15.59:0/2961812431 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fc8880855f0 con 0x7fc89015da10 2024-04-25T09:04:21.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.802+0000 7fc88ea00640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc86c066f60 0x7fc86c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:21.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.802+0000 7fc88ea00640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc86c066f60 0x7fc86c069420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc8900684f0 tx=0x7fc880008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:21.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:21.806+0000 7fc887400640 1 -- 172.21.15.59:0/2961812431 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc888056110 con 0x7fc89015da10 2024-04-25T09:04:22.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.026+0000 7fc895e00640 1 -- 172.21.15.59:0/2961812431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7fc8900b0a60 con 0x7fc89015da10 2024-04-25T09:04:22.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.254+0000 7fc887400640 1 -- 172.21.15.59:0/2961812431 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v174) v1 ==== 149+0+0 (secure 0 0 0) 0x7fc88805a1b0 con 0x7fc89015da10 2024-04-25T09:04:22.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.254+0000 7fc895e00640 1 -- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc86c066f60 msgr2=0x7fc86c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.254+0000 7fc895e00640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc86c066f60 0x7fc86c069420 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc8900684f0 tx=0x7fc880008040 comp rx=0 tx=0).stop 2024-04-25T09:04:22.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.254+0000 7fc895e00640 1 -- 172.21.15.59:0/2961812431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89015da10 msgr2=0x7fc89014ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.254+0000 7fc895e00640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89015da10 0x7fc89014ed60 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fc888007e90 tx=0x7fc88800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.258+0000 7fc895e00640 1 -- 172.21.15.59:0/2961812431 shutdown_connections 2024-04-25T09:04:22.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.258+0000 7fc895e00640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc86c066f60 0x7fc86c069420 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.258+0000 7fc895e00640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc89015da10 0x7fc89014ed60 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.258+0000 7fc895e00640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8900d11b0 0x7fc8901554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.258+0000 7fc895e00640 1 --2- 172.21.15.59:0/2961812431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8900b4210 0x7fc89013afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.258+0000 7fc895e00640 1 -- 172.21.15.59:0/2961812431 >> 172.21.15.59:0/2961812431 conn(0x7fc8900b2400 msgr2=0x7fc89015f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.258+0000 7fc895e00640 1 -- 172.21.15.59:0/2961812431 shutdown_connections 2024-04-25T09:04:22.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.258+0000 7fc895e00640 1 -- 172.21.15.59:0/2961812431 wait complete. 2024-04-25T09:04:22.268 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-04-25T09:04:22.269 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T09:04:22.269 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:04:22.269 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.418+0000 7fe2c8e00640 1 Processor -- start 2024-04-25T09:04:22.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.418+0000 7fe2c8e00640 1 -- start start 2024-04-25T09:04:22.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.418+0000 7fe2c8e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe2c4144140 0x7fe2c40ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.418+0000 7fe2c8e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c415ac60 con 0x7fe2c40ced60 2024-04-25T09:04:22.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.418+0000 7fe2c8e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c40cf3e0 con 0x7fe2c406ead0 2024-04-25T09:04:22.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.418+0000 7fe2c8e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c415af20 con 0x7fe2c4144140 2024-04-25T09:04:22.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.418+0000 7fe2b9400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe2c40ced60 0x7fe2c406e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50496/0 (socket says 172.21.15.59:50496) 2024-04-25T09:04:22.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.418+0000 7fe2b9400640 1 -- 172.21.15.59:0/1591037652 learned_addr learned my addr 172.21.15.59:0/1591037652 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:22.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.418+0000 7fe2c1e00640 1 --2- 172.21.15.59:0/1591037652 >> v2:172.21.15.178:3300/0 conn(0x7fe2c4144140 0x7fe2c40ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948175736 0 0) 0x7fe2c415ac60 con 0x7fe2c40ced60 2024-04-25T09:04:22.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2a8003530 con 0x7fe2c40ced60 2024-04-25T09:04:22.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 907552211 0 0) 0x7fe2a8003530 con 0x7fe2c40ced60 2024-04-25T09:04:22.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 >> v2:172.21.15.178:3300/0 conn(0x7fe2c4144140 msgr2=0x7fe2c40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:22.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 --2- 172.21.15.59:0/1591037652 >> v2:172.21.15.178:3300/0 conn(0x7fe2c4144140 0x7fe2c40ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 >> v1:172.21.15.178:6789/0 conn(0x7fe2c406ead0 legacy=0x7fe2c40b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c415b200 con 0x7fe2c40ced60 2024-04-25T09:04:22.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fe2ac001a00 con 0x7fe2c40ced60 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 >> v1:172.21.15.59:6789/0 conn(0x7fe2c40ced60 legacy=0x7fe2c406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 --2- 172.21.15.59:0/1591037652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2a80039c0 0x7fe2a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 --2- 172.21.15.59:0/1591037652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 0x7fe2a8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 --2- 172.21.15.59:0/1591037652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2a8005090 0x7fe2a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c415af20 con 0x7fe2a80043c0 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a800bff0 con 0x7fe2a80039c0 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a800c1f0 con 0x7fe2a8005090 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2b9400640 1 --2- 172.21.15.59:0/1591037652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 0x7fe2a8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c1e00640 1 --2- 172.21.15.59:0/1591037652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2a80039c0 0x7fe2a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c2800640 1 --2- 172.21.15.59:0/1591037652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2a8005090 0x7fe2a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2b9400640 1 -- 172.21.15.59:0/1591037652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2a8005090 msgr2=0x7fe2a800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2b9400640 1 --2- 172.21.15.59:0/1591037652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2a8005090 0x7fe2a800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2b9400640 1 -- 172.21.15.59:0/1591037652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2a80039c0 msgr2=0x7fe2a8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2b9400640 1 --2- 172.21.15.59:0/1591037652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2a80039c0 0x7fe2a8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2b9400640 1 -- 172.21.15.59:0/1591037652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a8003530 con 0x7fe2a80043c0 2024-04-25T09:04:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c2800640 1 --2- 172.21.15.59:0/1591037652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2a8005090 0x7fe2a800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.422+0000 7fe2c2800640 1 -- 172.21.15.59:0/1591037652 reap_dead start 2024-04-25T09:04:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2b9400640 1 --2- 172.21.15.59:0/1591037652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 0x7fe2a8004890 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00a800 tx=0x7fe2ac01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2570b17a7d65a69d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac00a450 con 0x7fe2a80043c0 2024-04-25T09:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac0ad650 con 0x7fe2a80043c0 2024-04-25T09:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c1400640 1 -- 172.21.15.59:0/1591037652 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac0ada80 con 0x7fe2a80043c0 2024-04-25T09:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 -- 172.21.15.59:0/1591037652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 msgr2=0x7fe2a8004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 --2- 172.21.15.59:0/1591037652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 0x7fe2a8004890 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00a800 tx=0x7fe2ac01d300 comp rx=0 tx=0).stop 2024-04-25T09:04:22.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 -- 172.21.15.59:0/1591037652 shutdown_connections 2024-04-25T09:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 --2- 172.21.15.59:0/1591037652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 0x7fe2a8004890 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 -- 172.21.15.59:0/1591037652 >> 172.21.15.59:0/1591037652 conn(0x7fe2c4066fa0 msgr2=0x7fe2c406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 -- 172.21.15.59:0/1591037652 shutdown_connections 2024-04-25T09:04:22.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 -- 172.21.15.59:0/1591037652 wait complete. 2024-04-25T09:04:22.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 Processor -- start 2024-04-25T09:04:22.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 -- start start 2024-04-25T09:04:22.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 0x7fe2c413e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2c413edc0 0x7fe2c413f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2c413f220 0x7fe2c40af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c415bb80 con 0x7fe2a80043c0 2024-04-25T09:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c415ba00 con 0x7fe2c413edc0 2024-04-25T09:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c8e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c415ea60 con 0x7fe2c413f220 2024-04-25T09:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 0x7fe2c413e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 0x7fe2c413e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34036/0 (socket says 172.21.15.59:34036) 2024-04-25T09:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.426+0000 7fe2c1e00640 1 -- 172.21.15.59:0/279725248 learned_addr learned my addr 172.21.15.59:0/279725248 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2c1e00640 1 -- 172.21.15.59:0/279725248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2c413f220 msgr2=0x7fe2c40af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2c1e00640 1 --2- 172.21.15.59:0/279725248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2c413f220 0x7fe2c40af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2c1e00640 1 -- 172.21.15.59:0/279725248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2c413edc0 msgr2=0x7fe2c413f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2c1e00640 1 --2- 172.21.15.59:0/279725248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2c413edc0 0x7fe2c413f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2c1e00640 1 -- 172.21.15.59:0/279725248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c4140310 con 0x7fe2a80043c0 2024-04-25T09:04:22.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2c1e00640 1 --2- 172.21.15.59:0/279725248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 0x7fe2c413e110 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4011900 tx=0x7fe2b4011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2baa00640 1 -- 172.21.15.59:0/279725248 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4019070 con 0x7fe2a80043c0 2024-04-25T09:04:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2baa00640 1 -- 172.21.15.59:0/279725248 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b4004240 con 0x7fe2a80043c0 2024-04-25T09:04:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2c8e00640 1 -- 172.21.15.59:0/279725248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c413d350 con 0x7fe2a80043c0 2024-04-25T09:04:22.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2baa00640 1 -- 172.21.15.59:0/279725248 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400f7c0 con 0x7fe2a80043c0 2024-04-25T09:04:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2c8e00640 1 -- 172.21.15.59:0/279725248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c413d910 con 0x7fe2a80043c0 2024-04-25T09:04:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2c8e00640 1 -- 172.21.15.59:0/279725248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c40745d0 con 0x7fe2a80043c0 2024-04-25T09:04:22.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2baa00640 1 -- 172.21.15.59:0/279725248 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe2b401c070 con 0x7fe2a80043c0 2024-04-25T09:04:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.430+0000 7fe2baa00640 1 --2- 172.21.15.59:0/279725248 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2a0066f90 0x7fe2a0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.434+0000 7fe2baa00640 1 -- 172.21.15.59:0/279725248 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe2b40852d0 con 0x7fe2a80043c0 2024-04-25T09:04:22.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.434+0000 7fe2b9400640 1 --2- 172.21.15.59:0/279725248 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2a0066f90 0x7fe2a0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.434+0000 7fe2b9400640 1 --2- 172.21.15.59:0/279725248 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2a0066f90 0x7fe2a0069450 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0ad000 tx=0x7fe2c40cf5b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.438+0000 7fe2baa00640 1 -- 172.21.15.59:0/279725248 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe2b40563b0 con 0x7fe2a80043c0 2024-04-25T09:04:22.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.598+0000 7fe2c8e00640 1 -- 172.21.15.59:0/279725248 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2c415c1c0 con 0x7fe2a80043c0 2024-04-25T09:04:22.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2baa00640 1 -- 172.21.15.59:0/279725248 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+13293 (secure 0 0 0) 0x7fe2b4055cb0 con 0x7fe2a80043c0 2024-04-25T09:04:22.592 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:22.592 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":57,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:04:21.249929+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/2578168283":"2024-04-26T09:04:18.235568+0000","172.21.15.59:6833/2578168283":"2024-04-26T09:04:18.235568+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:22.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2c8e00640 1 -- 172.21.15.59:0/279725248 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2a0066f90 msgr2=0x7fe2a0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2c8e00640 1 --2- 172.21.15.59:0/279725248 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2a0066f90 0x7fe2a0069450 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0ad000 tx=0x7fe2c40cf5b0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2c8e00640 1 -- 172.21.15.59:0/279725248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 msgr2=0x7fe2c413e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2c8e00640 1 --2- 172.21.15.59:0/279725248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 0x7fe2c413e110 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4011900 tx=0x7fe2b4011dc0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2c8e00640 1 -- 172.21.15.59:0/279725248 shutdown_connections 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2c8e00640 1 --2- 172.21.15.59:0/279725248 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2a0066f90 0x7fe2a0069450 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2c8e00640 1 --2- 172.21.15.59:0/279725248 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2c413f220 0x7fe2c40af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2c8e00640 1 --2- 172.21.15.59:0/279725248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2c413edc0 0x7fe2c413f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2c8e00640 1 --2- 172.21.15.59:0/279725248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2a80043c0 0x7fe2c413e110 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2c8e00640 1 -- 172.21.15.59:0/279725248 >> 172.21.15.59:0/279725248 conn(0x7fe2c4066fa0 msgr2=0x7fe2c40b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2c8e00640 1 -- 172.21.15.59:0/279725248 shutdown_connections 2024-04-25T09:04:22.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.602+0000 7fe2c8e00640 1 -- 172.21.15.59:0/279725248 wait complete. 2024-04-25T09:04:22.615 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:22.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:22.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.766+0000 7fcf53c00640 1 Processor -- start 2024-04-25T09:04:22.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.766+0000 7fcf53c00640 1 -- start start 2024-04-25T09:04:22.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.766+0000 7fcf53c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf4c159320 0x7fcf4c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.766+0000 7fcf53c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c15fc00 con 0x7fcf4c15f440 2024-04-25T09:04:22.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.766+0000 7fcf53c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4c15fee0 con 0x7fcf4c06e4a0 2024-04-25T09:04:22.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.766+0000 7fcf53c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf4c06d640 con 0x7fcf4c159320 2024-04-25T09:04:22.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.766+0000 7fcf43e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcf4c15f440 0x7fcf4c06dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50506/0 (socket says 172.21.15.59:50506) 2024-04-25T09:04:22.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.766+0000 7fcf43e00640 1 -- 172.21.15.59:0/208463538 learned_addr learned my addr 172.21.15.59:0/208463538 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:22.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.766+0000 7fcf51200640 1 --2- 172.21.15.59:0/208463538 >> v2:172.21.15.178:3300/0 conn(0x7fcf4c159320 0x7fcf4c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.770+0000 7fcf4be00640 1 -- 172.21.15.59:0/208463538 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3542943749 0 0) 0x7fcf4c15fc00 con 0x7fcf4c15f440 2024-04-25T09:04:22.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.770+0000 7fcf4be00640 1 -- 172.21.15.59:0/208463538 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf30003530 con 0x7fcf4c15f440 2024-04-25T09:04:22.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.770+0000 7fcf4be00640 1 -- 172.21.15.59:0/208463538 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 997591095 0 0) 0x7fcf4c15fee0 con 0x7fcf4c06e4a0 2024-04-25T09:04:22.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.770+0000 7fcf4be00640 1 -- 172.21.15.59:0/208463538 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf4c15fc00 con 0x7fcf4c06e4a0 2024-04-25T09:04:22.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.770+0000 7fcf51200640 1 -- 172.21.15.59:0/208463538 >> v1:172.21.15.178:6789/0 conn(0x7fcf4c06e4a0 legacy=0x7fcf4c071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.770+0000 7fcf51200640 1 -- 172.21.15.59:0/208463538 >> v1:172.21.15.59:6789/0 conn(0x7fcf4c15f440 legacy=0x7fcf4c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.770+0000 7fcf51200640 1 -- 172.21.15.59:0/208463538 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c1601c0 con 0x7fcf4c159320 2024-04-25T09:04:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.770+0000 7fcf51200640 1 --2- 172.21.15.59:0/208463538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf4c159320 0x7fcf4c15c9b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c06d7c0 tx=0x7fcf3c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9246ecee93c0ea07 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.770+0000 7fcf4be00640 1 -- 172.21.15.59:0/208463538 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0b2070 con 0x7fcf4c159320 2024-04-25T09:04:22.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.770+0000 7fcf4be00640 1 -- 172.21.15.59:0/208463538 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c0ad680 con 0x7fcf4c159320 2024-04-25T09:04:22.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.770+0000 7fcf4be00640 1 -- 172.21.15.59:0/208463538 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c0ada50 con 0x7fcf4c159320 2024-04-25T09:04:22.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 -- 172.21.15.59:0/208463538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf4c159320 msgr2=0x7fcf4c15c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 --2- 172.21.15.59:0/208463538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf4c159320 0x7fcf4c15c9b0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c06d7c0 tx=0x7fcf3c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 -- 172.21.15.59:0/208463538 shutdown_connections 2024-04-25T09:04:22.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 --2- 172.21.15.59:0/208463538 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf4c159320 0x7fcf4c15c9b0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 -- 172.21.15.59:0/208463538 >> 172.21.15.59:0/208463538 conn(0x7fcf4c067080 msgr2=0x7fcf4c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 -- 172.21.15.59:0/208463538 shutdown_connections 2024-04-25T09:04:22.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 -- 172.21.15.59:0/208463538 wait complete. 2024-04-25T09:04:22.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 Processor -- start 2024-04-25T09:04:22.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 -- start start 2024-04-25T09:04:22.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf4c06e4a0 0x7fcf4c152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4c159320 0x7fcf4c140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf4c15f440 0x7fcf4c13d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c15f9a0 con 0x7fcf4c159320 2024-04-25T09:04:22.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c15f820 con 0x7fcf4c06e4a0 2024-04-25T09:04:22.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf53c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4c071980 con 0x7fcf4c15f440 2024-04-25T09:04:22.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf43e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4c159320 0x7fcf4c140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf43e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4c159320 0x7fcf4c140a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34042/0 (socket says 172.21.15.59:34042) 2024-04-25T09:04:22.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf43e00640 1 -- 172.21.15.59:0/1089137783 learned_addr learned my addr 172.21.15.59:0/1089137783 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:22.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf51200640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf4c06e4a0 0x7fcf4c152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf51c00640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf4c15f440 0x7fcf4c13d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf43e00640 1 -- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf4c15f440 msgr2=0x7fcf4c13d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf43e00640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf4c15f440 0x7fcf4c13d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf43e00640 1 -- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf4c06e4a0 msgr2=0x7fcf4c152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf43e00640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf4c06e4a0 0x7fcf4c152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.774+0000 7fcf43e00640 1 -- 172.21.15.59:0/1089137783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c152730 con 0x7fcf4c159320 2024-04-25T09:04:22.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.778+0000 7fcf43e00640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4c159320 0x7fcf4c140a40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400c420 tx=0x7fcf3400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.778+0000 7fcf49600640 1 -- 172.21.15.59:0/1089137783 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34017070 con 0x7fcf4c159320 2024-04-25T09:04:22.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.778+0000 7fcf49600640 1 -- 172.21.15.59:0/1089137783 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf34005cf0 con 0x7fcf4c159320 2024-04-25T09:04:22.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.778+0000 7fcf49600640 1 -- 172.21.15.59:0/1089137783 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34007310 con 0x7fcf4c159320 2024-04-25T09:04:22.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.778+0000 7fcf53c00640 1 -- 172.21.15.59:0/1089137783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf4c152a10 con 0x7fcf4c159320 2024-04-25T09:04:22.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.778+0000 7fcf53c00640 1 -- 172.21.15.59:0/1089137783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4c152fd0 con 0x7fcf4c159320 2024-04-25T09:04:22.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.778+0000 7fcf53c00640 1 -- 172.21.15.59:0/1089137783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf4c0745d0 con 0x7fcf4c159320 2024-04-25T09:04:22.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.778+0000 7fcf49600640 1 -- 172.21.15.59:0/1089137783 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcf3401a070 con 0x7fcf4c159320 2024-04-25T09:04:22.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.778+0000 7fcf49600640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf28066f60 0x7fcf28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:22.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.778+0000 7fcf49600640 1 -- 172.21.15.59:0/1089137783 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fcf340842a0 con 0x7fcf4c159320 2024-04-25T09:04:22.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.778+0000 7fcf51200640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf28066f60 0x7fcf28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:22.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.782+0000 7fcf51200640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf28066f60 0x7fcf28069420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0af000 tx=0x7fcf3c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:22.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.782+0000 7fcf49600640 1 -- 172.21.15.59:0/1089137783 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcf34054d30 con 0x7fcf4c159320 2024-04-25T09:04:22.927 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:22.931 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.946+0000 7fcf53c00640 1 -- 172.21.15.59:0/1089137783 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf4c15d770 con 0x7fcf4c159320 2024-04-25T09:04:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.946+0000 7fcf49600640 1 -- 172.21.15.59:0/1089137783 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf34058dd0 con 0x7fcf4c159320 2024-04-25T09:04:22.937 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:04:22.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.950+0000 7fcf53c00640 1 -- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf28066f60 msgr2=0x7fcf28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.950+0000 7fcf53c00640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf28066f60 0x7fcf28069420 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0af000 tx=0x7fcf3c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:04:22.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.950+0000 7fcf53c00640 1 -- 172.21.15.59:0/1089137783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4c159320 msgr2=0x7fcf4c140a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:22.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.950+0000 7fcf53c00640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4c159320 0x7fcf4c140a40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400c420 tx=0x7fcf3400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.950+0000 7fcf53c00640 1 -- 172.21.15.59:0/1089137783 shutdown_connections 2024-04-25T09:04:22.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.950+0000 7fcf53c00640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf28066f60 0x7fcf28069420 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.950+0000 7fcf53c00640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf4c15f440 0x7fcf4c13d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.950+0000 7fcf53c00640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf4c159320 0x7fcf4c140a40 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.950+0000 7fcf53c00640 1 --2- 172.21.15.59:0/1089137783 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf4c06e4a0 0x7fcf4c152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:22.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.950+0000 7fcf53c00640 1 -- 172.21.15.59:0/1089137783 >> 172.21.15.59:0/1089137783 conn(0x7fcf4c067080 msgr2=0x7fcf4c157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:22.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.950+0000 7fcf53c00640 1 -- 172.21.15.59:0/1089137783 shutdown_connections 2024-04-25T09:04:22.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:22.950+0000 7fcf53c00640 1 -- 172.21.15.59:0/1089137783 wait complete. 2024-04-25T09:04:22.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-25T09:04:23.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.174+0000 7feee7600640 1 Processor -- start 2024-04-25T09:04:23.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.174+0000 7feee7600640 1 -- start start 2024-04-25T09:04:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.178+0000 7feee7600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feee0145270 0x7feee015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.178+0000 7feee7600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feee00b1e60 0x7feee00cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.178+0000 7feee7600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee00cc4e0 con 0x7feee00cd4d0 2024-04-25T09:04:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.178+0000 7feee7600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee0145650 con 0x7feee0145270 2024-04-25T09:04:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.178+0000 7feee7600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee00ce040 con 0x7feee00b1e60 2024-04-25T09:04:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.178+0000 7feee4c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feee0145270 0x7feee015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.178+0000 7feee4c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feee0145270 0x7feee015fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34050/0 (socket says 172.21.15.59:34050) 2024-04-25T09:04:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.178+0000 7feee4c00640 1 -- 172.21.15.59:0/3042479591 learned_addr learned my addr 172.21.15.59:0/3042479591 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.178+0000 7feee4c00640 1 -- 172.21.15.59:0/3042479591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feee00b1e60 msgr2=0x7feee00cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.178+0000 7feee4c00640 1 --2- 172.21.15.59:0/3042479591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feee00b1e60 0x7feee00cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.178+0000 7feee4c00640 1 -- 172.21.15.59:0/3042479591 >> v1:172.21.15.178:6789/0 conn(0x7feee00cd4d0 legacy=0x7feee00b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:23.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.178+0000 7feee4c00640 1 -- 172.21.15.59:0/3042479591 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee00ce320 con 0x7feee0145270 2024-04-25T09:04:23.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feee4c00640 1 --2- 172.21.15.59:0/3042479591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee0145270 0x7feee015fe50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7feed0009870 tx=0x7feed001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f294dd4f4c4b7272 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feedfe00640 1 -- 172.21.15.59:0/3042479591 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed00b1070 con 0x7feee0145270 2024-04-25T09:04:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feedfe00640 1 -- 172.21.15.59:0/3042479591 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed00ac630 con 0x7feee0145270 2024-04-25T09:04:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feedfe00640 1 -- 172.21.15.59:0/3042479591 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed00a8050 con 0x7feee0145270 2024-04-25T09:04:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feee7600640 1 -- 172.21.15.59:0/3042479591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee0145270 msgr2=0x7feee015fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feee7600640 1 --2- 172.21.15.59:0/3042479591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee0145270 0x7feee015fe50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7feed0009870 tx=0x7feed001c520 comp rx=0 tx=0).stop 2024-04-25T09:04:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feee7600640 1 -- 172.21.15.59:0/3042479591 shutdown_connections 2024-04-25T09:04:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feee7600640 1 --2- 172.21.15.59:0/3042479591 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feee00b1e60 0x7feee00cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feee7600640 1 --2- 172.21.15.59:0/3042479591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee0145270 0x7feee015fe50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feee7600640 1 -- 172.21.15.59:0/3042479591 >> 172.21.15.59:0/3042479591 conn(0x7feee0066fa0 msgr2=0x7feee006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feee7600640 1 -- 172.21.15.59:0/3042479591 shutdown_connections 2024-04-25T09:04:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feee7600640 1 -- 172.21.15.59:0/3042479591 wait complete. 2024-04-25T09:04:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feee7600640 1 Processor -- start 2024-04-25T09:04:23.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.182+0000 7feee7600640 1 -- start start 2024-04-25T09:04:23.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feee7600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feee00b1e60 0x7feee0139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feee7600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee00cd4d0 0x7feee00b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feee7600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee0145270 0x7feee00adc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feee7600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee015c710 con 0x7feee00cd4d0 2024-04-25T09:04:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feee7600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee015c590 con 0x7feee0145270 2024-04-25T09:04:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feee7600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee015c890 con 0x7feee00b1e60 2024-04-25T09:04:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feed7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee00cd4d0 0x7feee00b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feed7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee00cd4d0 0x7feee00b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34060/0 (socket says 172.21.15.59:34060) 2024-04-25T09:04:23.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feed7e00640 1 -- 172.21.15.59:0/682275684 learned_addr learned my addr 172.21.15.59:0/682275684 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feed7e00640 1 -- 172.21.15.59:0/682275684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feee00b1e60 msgr2=0x7feee0139750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feed7e00640 1 --2- 172.21.15.59:0/682275684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feee00b1e60 0x7feee0139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feed7e00640 1 -- 172.21.15.59:0/682275684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee0145270 msgr2=0x7feee00adc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feed7e00640 1 --2- 172.21.15.59:0/682275684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee0145270 0x7feee00adc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feed7e00640 1 -- 172.21.15.59:0/682275684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee013ef80 con 0x7feee00cd4d0 2024-04-25T09:04:23.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feed7e00640 1 --2- 172.21.15.59:0/682275684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee00cd4d0 0x7feee00b3a20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7feec800c450 tx=0x7feec800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feedd600640 1 -- 172.21.15.59:0/682275684 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8012830 con 0x7feee00cd4d0 2024-04-25T09:04:23.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feedd600640 1 -- 172.21.15.59:0/682275684 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec8017070 con 0x7feee00cd4d0 2024-04-25T09:04:23.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feedd600640 1 -- 172.21.15.59:0/682275684 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8012c30 con 0x7feee00cd4d0 2024-04-25T09:04:23.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feee7600640 1 -- 172.21.15.59:0/682275684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee013f260 con 0x7feee00cd4d0 2024-04-25T09:04:23.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feee7600640 1 -- 172.21.15.59:0/682275684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee0137aa0 con 0x7feee00cd4d0 2024-04-25T09:04:23.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feee7600640 1 -- 172.21.15.59:0/682275684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee0137d60 con 0x7feee00cd4d0 2024-04-25T09:04:23.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.186+0000 7feedd600640 1 -- 172.21.15.59:0/682275684 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feec801c460 con 0x7feee00cd4d0 2024-04-25T09:04:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.190+0000 7feedd600640 1 --2- 172.21.15.59:0/682275684 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feebc066f60 0x7feebc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.190+0000 7feedd600640 1 -- 172.21.15.59:0/682275684 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7feec8084ca0 con 0x7feee00cd4d0 2024-04-25T09:04:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.190+0000 7feee4c00640 1 --2- 172.21.15.59:0/682275684 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feebc066f60 0x7feebc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.190+0000 7feee4c00640 1 --2- 172.21.15.59:0/682275684 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feebc066f60 0x7feebc069420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feed00ae000 tx=0x7feed0004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:23.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.194+0000 7feedd600640 1 -- 172.21.15.59:0/682275684 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feec8055e10 con 0x7feee00cd4d0 2024-04-25T09:04:23.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:23.414+0000 7feee7600640 1 -- 172.21.15.59:0/682275684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7feee00745d0 con 0x7feee00cd4d0 2024-04-25T09:04:24.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.262+0000 7feedd600640 1 -- 172.21.15.59:0/682275684 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v176) v1 ==== 172+0+0 (secure 0 0 0) 0x7feec8055710 con 0x7feee00cd4d0 2024-04-25T09:04:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.262+0000 7feee7600640 1 -- 172.21.15.59:0/682275684 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feebc066f60 msgr2=0x7feebc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.262+0000 7feee7600640 1 --2- 172.21.15.59:0/682275684 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feebc066f60 0x7feebc069420 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feed00ae000 tx=0x7feed0004740 comp rx=0 tx=0).stop 2024-04-25T09:04:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.262+0000 7feee7600640 1 -- 172.21.15.59:0/682275684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee00cd4d0 msgr2=0x7feee00b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.262+0000 7feee7600640 1 --2- 172.21.15.59:0/682275684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee00cd4d0 0x7feee00b3a20 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7feec800c450 tx=0x7feec800c910 comp rx=0 tx=0).stop 2024-04-25T09:04:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.262+0000 7feee7600640 1 -- 172.21.15.59:0/682275684 shutdown_connections 2024-04-25T09:04:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.262+0000 7feee7600640 1 --2- 172.21.15.59:0/682275684 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feebc066f60 0x7feebc069420 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.262+0000 7feee7600640 1 --2- 172.21.15.59:0/682275684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feee0145270 0x7feee00adc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.262+0000 7feee7600640 1 --2- 172.21.15.59:0/682275684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee00cd4d0 0x7feee00b3a20 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.262+0000 7feee7600640 1 --2- 172.21.15.59:0/682275684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feee00b1e60 0x7feee0139750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.266+0000 7feee7600640 1 -- 172.21.15.59:0/682275684 >> 172.21.15.59:0/682275684 conn(0x7feee0066fa0 msgr2=0x7feee0144590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.266+0000 7feee7600640 1 -- 172.21.15.59:0/682275684 shutdown_connections 2024-04-25T09:04:24.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.266+0000 7feee7600640 1 -- 172.21.15.59:0/682275684 wait complete. 2024-04-25T09:04:24.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:04:24.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.434+0000 7f014cc00640 1 Processor -- start 2024-04-25T09:04:24.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f014cc00640 1 -- start start 2024-04-25T09:04:24.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f014cc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0148144120 0x7f014815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f014cc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01480b3090 0x7f01480b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f014cc00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014815bc40 con 0x7f01480ccbf0 2024-04-25T09:04:24.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f014cc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014815e490 con 0x7f01480b3090 2024-04-25T09:04:24.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f014cc00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014815b3a0 con 0x7f0148144120 2024-04-25T09:04:24.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f0146800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01480b3090 0x7f01480b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f0146800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01480b3090 0x7f01480b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34076/0 (socket says 172.21.15.59:34076) 2024-04-25T09:04:24.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f0146800640 1 -- 172.21.15.59:0/3744386727 learned_addr learned my addr 172.21.15.59:0/3744386727 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:24.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f0146800640 1 -- 172.21.15.59:0/3744386727 >> v2:172.21.15.178:3300/0 conn(0x7f0148144120 msgr2=0x7f014815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f0145e00640 1 --2- 172.21.15.59:0/3744386727 >> v2:172.21.15.178:3300/0 conn(0x7f0148144120 0x7f014815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f0146800640 1 --2- 172.21.15.59:0/3744386727 >> v2:172.21.15.178:3300/0 conn(0x7f0148144120 0x7f014815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f0146800640 1 -- 172.21.15.59:0/3744386727 >> v1:172.21.15.178:6789/0 conn(0x7f01480ccbf0 legacy=0x7f014815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:24.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f0146800640 1 -- 172.21.15.59:0/3744386727 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014815b680 con 0x7f01480b3090 2024-04-25T09:04:24.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.438+0000 7f0145e00640 1 --2- 172.21.15.59:0/3744386727 >> v2:172.21.15.178:3300/0 conn(0x7f0148144120 0x7f014815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:24.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f0146800640 1 --2- 172.21.15.59:0/3744386727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01480b3090 0x7f01480b3520 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f014806b9b0 tx=0x7f014001eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c1dd8d286b8787 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f0145400640 1 -- 172.21.15.59:0/3744386727 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014000b2d0 con 0x7f01480b3090 2024-04-25T09:04:24.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f0145400640 1 -- 172.21.15.59:0/3744386727 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014000b470 con 0x7f01480b3090 2024-04-25T09:04:24.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f0145400640 1 -- 172.21.15.59:0/3744386727 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400a7aa0 con 0x7f01480b3090 2024-04-25T09:04:24.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f014cc00640 1 -- 172.21.15.59:0/3744386727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01480b3090 msgr2=0x7f01480b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f014cc00640 1 --2- 172.21.15.59:0/3744386727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01480b3090 0x7f01480b3520 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f014806b9b0 tx=0x7f014001eb20 comp rx=0 tx=0).stop 2024-04-25T09:04:24.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f014cc00640 1 -- 172.21.15.59:0/3744386727 shutdown_connections 2024-04-25T09:04:24.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f014cc00640 1 --2- 172.21.15.59:0/3744386727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01480b3090 0x7f01480b3520 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f014cc00640 1 --2- 172.21.15.59:0/3744386727 >> v2:172.21.15.178:3300/0 conn(0x7f0148144120 0x7f014815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f014cc00640 1 -- 172.21.15.59:0/3744386727 >> 172.21.15.59:0/3744386727 conn(0x7f0148067080 msgr2=0x7f014806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f014cc00640 1 -- 172.21.15.59:0/3744386727 shutdown_connections 2024-04-25T09:04:24.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f014cc00640 1 -- 172.21.15.59:0/3744386727 wait complete. 2024-04-25T09:04:24.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f014cc00640 1 Processor -- start 2024-04-25T09:04:24.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.442+0000 7f014cc00640 1 -- start start 2024-04-25T09:04:24.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f014cc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01480b3090 0x7f014813f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f014cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01480ccbf0 0x7f014815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f014cc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0148144120 0x7f01481637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f014cc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014806dc60 con 0x7f01480ccbf0 2024-04-25T09:04:24.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f014cc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014806dae0 con 0x7f0148144120 2024-04-25T09:04:24.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f014cc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014806dde0 con 0x7f01480b3090 2024-04-25T09:04:24.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01480ccbf0 0x7f014815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01480ccbf0 0x7f014815a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34084/0 (socket says 172.21.15.59:34084) 2024-04-25T09:04:24.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013d400640 1 -- 172.21.15.59:0/499930642 learned_addr learned my addr 172.21.15.59:0/499930642 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:24.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f0146800640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0148144120 0x7f01481637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f0145e00640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01480b3090 0x7f014813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013d400640 1 -- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01480b3090 msgr2=0x7f014813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013d400640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01480b3090 0x7f014813f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013d400640 1 -- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0148144120 msgr2=0x7f01481637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013d400640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0148144120 0x7f01481637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013d400640 1 -- 172.21.15.59:0/499930642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014813e2f0 con 0x7f01480ccbf0 2024-04-25T09:04:24.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013d400640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01480ccbf0 0x7f014815a1d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f013000c450 tx=0x7f013000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013ea00640 1 -- 172.21.15.59:0/499930642 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130012830 con 0x7f01480ccbf0 2024-04-25T09:04:24.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013ea00640 1 -- 172.21.15.59:0/499930642 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0130017070 con 0x7f01480ccbf0 2024-04-25T09:04:24.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f014cc00640 1 -- 172.21.15.59:0/499930642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014813e5d0 con 0x7f01480ccbf0 2024-04-25T09:04:24.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013ea00640 1 -- 172.21.15.59:0/499930642 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130012c30 con 0x7f01480ccbf0 2024-04-25T09:04:24.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f014cc00640 1 -- 172.21.15.59:0/499930642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014813eb90 con 0x7f01480ccbf0 2024-04-25T09:04:24.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f014cc00640 1 -- 172.21.15.59:0/499930642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01480745d0 con 0x7f01480ccbf0 2024-04-25T09:04:24.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.446+0000 7f013ea00640 1 -- 172.21.15.59:0/499930642 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f013001c460 con 0x7f01480ccbf0 2024-04-25T09:04:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.450+0000 7f013ea00640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0124066f60 0x7f0124069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.450+0000 7f013ea00640 1 -- 172.21.15.59:0/499930642 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f0130084cb0 con 0x7f01480ccbf0 2024-04-25T09:04:24.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.450+0000 7f0145e00640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0124066f60 0x7f0124069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:24.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.450+0000 7f0145e00640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0124066f60 0x7f0124069420 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0138006fd0 tx=0x7f0138008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:24.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.454+0000 7f013ea00640 1 -- 172.21.15.59:0/499930642 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0130055d90 con 0x7f01480ccbf0 2024-04-25T09:04:24.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.614+0000 7f014cc00640 1 -- 172.21.15.59:0/499930642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f01480b4830 con 0x7f01480ccbf0 2024-04-25T09:04:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.618+0000 7f013ea00640 1 -- 172.21.15.59:0/499930642 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0130055690 con 0x7f01480ccbf0 2024-04-25T09:04:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.622+0000 7f014cc00640 1 -- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0124066f60 msgr2=0x7f0124069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.622+0000 7f014cc00640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0124066f60 0x7f0124069420 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0138006fd0 tx=0x7f0138008040 comp rx=0 tx=0).stop 2024-04-25T09:04:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.622+0000 7f014cc00640 1 -- 172.21.15.59:0/499930642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01480ccbf0 msgr2=0x7f014815a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.622+0000 7f014cc00640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01480ccbf0 0x7f014815a1d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f013000c450 tx=0x7f013000c910 comp rx=0 tx=0).stop 2024-04-25T09:04:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.622+0000 7f014cc00640 1 -- 172.21.15.59:0/499930642 shutdown_connections 2024-04-25T09:04:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.622+0000 7f014cc00640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0124066f60 0x7f0124069420 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.622+0000 7f014cc00640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0148144120 0x7f01481637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.622+0000 7f014cc00640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01480ccbf0 0x7f014815a1d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.622+0000 7f014cc00640 1 --2- 172.21.15.59:0/499930642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f01480b3090 0x7f014813f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:24.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.622+0000 7f014cc00640 1 -- 172.21.15.59:0/499930642 >> 172.21.15.59:0/499930642 conn(0x7f0148067080 msgr2=0x7f014806e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:24.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.622+0000 7f014cc00640 1 -- 172.21.15.59:0/499930642 shutdown_connections 2024-04-25T09:04:24.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:24.622+0000 7f014cc00640 1 -- 172.21.15.59:0/499930642 wait complete. 2024-04-25T09:04:24.632 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:04:24.633 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:24.735 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:04:24.787 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:04:24.787 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:04:24.787 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:24.796 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:04:24.796 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:04:24.797 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:24.840 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:24.840 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:04:24.840 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:24.849 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:04:24.849 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:04:24.849 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:24.891 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:04:24.892 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:04:24.892 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:25.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef8d800640 1 Processor -- start 2024-04-25T09:04:25.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef8d800640 1 -- start start 2024-04-25T09:04:25.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef8d800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef88145270 0x7fef8815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:25.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef8d800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fef880b1e60 0x7fef880cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:25.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef8d800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef880cc4e0 con 0x7fef880cd4d0 2024-04-25T09:04:25.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef8d800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef88145650 con 0x7fef88145270 2024-04-25T09:04:25.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef8d800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef880ce040 con 0x7fef880b1e60 2024-04-25T09:04:25.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef86a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef88145270 0x7fef8815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:25.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef86a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef88145270 0x7fef8815fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34090/0 (socket says 172.21.15.59:34090) 2024-04-25T09:04:25.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef86a00640 1 -- 172.21.15.59:0/3041716714 learned_addr learned my addr 172.21.15.59:0/3041716714 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:25.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef86a00640 1 -- 172.21.15.59:0/3041716714 >> v2:172.21.15.178:3300/0 conn(0x7fef880b1e60 msgr2=0x7fef880cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:25.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef86a00640 1 --2- 172.21.15.59:0/3041716714 >> v2:172.21.15.178:3300/0 conn(0x7fef880b1e60 0x7fef880cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef86a00640 1 -- 172.21.15.59:0/3041716714 >> v1:172.21.15.178:6789/0 conn(0x7fef880cd4d0 legacy=0x7fef880b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:25.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.042+0000 7fef86a00640 1 -- 172.21.15.59:0/3041716714 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef880ce320 con 0x7fef88145270 2024-04-25T09:04:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.046+0000 7fef86a00640 1 --2- 172.21.15.59:0/3041716714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88145270 0x7fef8815fe50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fef880b4b90 tx=0x7fef7801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f9c952a23a22fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.046+0000 7fef86000640 1 -- 172.21.15.59:0/3041716714 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef780b1070 con 0x7fef88145270 2024-04-25T09:04:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.046+0000 7fef86000640 1 -- 172.21.15.59:0/3041716714 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef780ac630 con 0x7fef88145270 2024-04-25T09:04:25.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.046+0000 7fef86000640 1 -- 172.21.15.59:0/3041716714 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef780a8050 con 0x7fef88145270 2024-04-25T09:04:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.046+0000 7fef8d800640 1 -- 172.21.15.59:0/3041716714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88145270 msgr2=0x7fef8815fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.046+0000 7fef8d800640 1 --2- 172.21.15.59:0/3041716714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88145270 0x7fef8815fe50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fef880b4b90 tx=0x7fef7801c4e0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.046+0000 7fef8d800640 1 -- 172.21.15.59:0/3041716714 shutdown_connections 2024-04-25T09:04:25.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.046+0000 7fef8d800640 1 --2- 172.21.15.59:0/3041716714 >> v2:172.21.15.178:3300/0 conn(0x7fef880b1e60 0x7fef880cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.046+0000 7fef8d800640 1 --2- 172.21.15.59:0/3041716714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88145270 0x7fef8815fe50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.046+0000 7fef8d800640 1 -- 172.21.15.59:0/3041716714 >> 172.21.15.59:0/3041716714 conn(0x7fef88066fa0 msgr2=0x7fef8806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:25.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.046+0000 7fef8d800640 1 -- 172.21.15.59:0/3041716714 shutdown_connections 2024-04-25T09:04:25.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.046+0000 7fef8d800640 1 -- 172.21.15.59:0/3041716714 wait complete. 2024-04-25T09:04:25.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef8d800640 1 Processor -- start 2024-04-25T09:04:25.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef8d800640 1 -- start start 2024-04-25T09:04:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef8d800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef880b1e60 0x7fef88143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef8d800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef880cd4d0 0x7fef88143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef8d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88145270 0x7fef880a8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef8d800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8815c710 con 0x7fef88145270 2024-04-25T09:04:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef8d800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8815c590 con 0x7fef880cd4d0 2024-04-25T09:04:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef8d800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8815c890 con 0x7fef880b1e60 2024-04-25T09:04:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef87400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88145270 0x7fef880a8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:25.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef87400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88145270 0x7fef880a8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34106/0 (socket says 172.21.15.59:34106) 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef87400640 1 -- 172.21.15.59:0/947409165 learned_addr learned my addr 172.21.15.59:0/947409165 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef7fe00640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef880cd4d0 0x7fef88143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef86a00640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef880b1e60 0x7fef88143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef87400640 1 -- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef880b1e60 msgr2=0x7fef88143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef87400640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef880b1e60 0x7fef88143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef87400640 1 -- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef880cd4d0 msgr2=0x7fef88143950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef87400640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef880cd4d0 0x7fef88143950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef87400640 1 -- 172.21.15.59:0/947409165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef88143e90 con 0x7fef88145270 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef87400640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88145270 0x7fef880a8c80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fef8000b970 tx=0x7fef8000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef7ea00640 1 -- 172.21.15.59:0/947409165 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef80019070 con 0x7fef88145270 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef7ea00640 1 -- 172.21.15.59:0/947409165 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8000cb60 con 0x7fef88145270 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef8d800640 1 -- 172.21.15.59:0/947409165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef88144160 con 0x7fef88145270 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef7ea00640 1 -- 172.21.15.59:0/947409165 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef80014440 con 0x7fef88145270 2024-04-25T09:04:25.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.050+0000 7fef8d800640 1 -- 172.21.15.59:0/947409165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef88144a00 con 0x7fef88145270 2024-04-25T09:04:25.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.054+0000 7fef8d800640 1 -- 172.21.15.59:0/947409165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef880745d0 con 0x7fef88145270 2024-04-25T09:04:25.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.054+0000 7fef7ea00640 1 -- 172.21.15.59:0/947409165 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fef8001c070 con 0x7fef88145270 2024-04-25T09:04:25.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.054+0000 7fef7ea00640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef64066f60 0x7fef64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.054+0000 7fef7ea00640 1 -- 172.21.15.59:0/947409165 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fef80084bb0 con 0x7fef88145270 2024-04-25T09:04:25.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.054+0000 7fef86a00640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef64066f60 0x7fef64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:25.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.054+0000 7fef86a00640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef64066f60 0x7fef64069420 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fef780ae000 tx=0x7fef78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:25.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.058+0000 7fef7ea00640 1 -- 172.21.15.59:0/947409165 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fef80055650 con 0x7fef88145270 2024-04-25T09:04:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.254+0000 7fef8d800640 1 -- 172.21.15.59:0/947409165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef8806b8e0 con 0x7fef88145270 2024-04-25T09:04:25.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef7ea00640 1 -- 172.21.15.59:0/947409165 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+3702 (secure 0 0 0) 0x7fef800596f0 con 0x7fef88145270 2024-04-25T09:04:25.248 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:25.249 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":30,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5623,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2757859141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2757859141},{"type":"v1","addr":"172.21.15.178:6836","nonce":2757859141}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":5626,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/447455100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":447455100},{"type":"v1","addr":"172.21.15.178:6837","nonce":447455100}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":5766,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4008580166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4008580166},{"type":"v1","addr":"172.21.15.59:6834","nonce":4008580166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23},{"gid":6138,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1865064354","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1865064354},{"type":"v1","addr":"172.21.15.59:6835","nonce":1865064354}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[]} 2024-04-25T09:04:25.249 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 30 2024-04-25T09:04:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef8d800640 1 -- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef64066f60 msgr2=0x7fef64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef8d800640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef64066f60 0x7fef64069420 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fef780ae000 tx=0x7fef78008040 comp rx=0 tx=0).stop 2024-04-25T09:04:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef8d800640 1 -- 172.21.15.59:0/947409165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88145270 msgr2=0x7fef880a8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef8d800640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88145270 0x7fef880a8c80 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fef8000b970 tx=0x7fef8000be30 comp rx=0 tx=0).stop 2024-04-25T09:04:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef8d800640 1 -- 172.21.15.59:0/947409165 shutdown_connections 2024-04-25T09:04:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef8d800640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fef64066f60 0x7fef64069420 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef8d800640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef88145270 0x7fef880a8c80 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef8d800640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fef880cd4d0 0x7fef88143950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef8d800640 1 --2- 172.21.15.59:0/947409165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fef880b1e60 0x7fef88143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef8d800640 1 -- 172.21.15.59:0/947409165 >> 172.21.15.59:0/947409165 conn(0x7fef88066fa0 msgr2=0x7fef880b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef8d800640 1 -- 172.21.15.59:0/947409165 shutdown_connections 2024-04-25T09:04:25.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:25.258+0000 7fef8d800640 1 -- 172.21.15.59:0/947409165 wait complete. 2024-04-25T09:04:25.270 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:04:25.271 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:04:25.271 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:04:25.271 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:25.271 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:04:25.271 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:04:25.271 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:04:25.272 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:25.272 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:04:25.272 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:04:25.272 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:04:25.272 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:25.272 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:04:25.272 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:04:25.273 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:04:25.273 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:04:25.288 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:04:25.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:04:25.292 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:04:25.292 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:04:25.293 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:04:25.293 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:04:25.338 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:04:25.339 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:25.339 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:04:25.339 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:25.340 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:04:25.340 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:25.425 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T09:04:25.430 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-04-25T09:04:25.430 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-04-25T09:04:31.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-25T09:04:31.288 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:04:31.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:04:31.292 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:04:31.293 DEBUG:teuthology.parallel:result is None 2024-04-25T09:04:31.293 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:04:31.389 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:04:31.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.454+0000 7fe890600640 1 Processor -- start 2024-04-25T09:04:31.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.454+0000 7fe890600640 1 -- start start 2024-04-25T09:04:31.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.454+0000 7fe890600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe888144120 0x7fe88815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:31.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.454+0000 7fe890600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8880b3090 0x7fe8880b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:31.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.454+0000 7fe890600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88815bc40 con 0x7fe8880ccbf0 2024-04-25T09:04:31.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.454+0000 7fe890600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88815e490 con 0x7fe888144120 2024-04-25T09:04:31.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.454+0000 7fe890600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe88815b3a0 con 0x7fe8880b3090 2024-04-25T09:04:31.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.454+0000 7fe88dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe888144120 0x7fe88815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:31.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.454+0000 7fe88d200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe8880ccbf0 0x7fe88815e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41422/0 (socket says 172.21.15.59:41422) 2024-04-25T09:04:31.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.458+0000 7fe88d200640 1 -- 172.21.15.59:0/80018733 learned_addr learned my addr 172.21.15.59:0/80018733 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:31.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.458+0000 7fe88e600640 1 --2- 172.21.15.59:0/80018733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8880b3090 0x7fe8880b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:31.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.458+0000 7fe887e00640 1 -- 172.21.15.59:0/80018733 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3194861880 0 0) 0x7fe88815bc40 con 0x7fe8880ccbf0 2024-04-25T09:04:31.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.458+0000 7fe887e00640 1 -- 172.21.15.59:0/80018733 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe870003530 con 0x7fe8880ccbf0 2024-04-25T09:04:31.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.458+0000 7fe88dc00640 1 -- 172.21.15.59:0/80018733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8880b3090 msgr2=0x7fe8880b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:31.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.458+0000 7fe88dc00640 1 --2- 172.21.15.59:0/80018733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8880b3090 0x7fe8880b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.458+0000 7fe88dc00640 1 -- 172.21.15.59:0/80018733 >> v1:172.21.15.59:6789/0 conn(0x7fe8880ccbf0 legacy=0x7fe88815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:31.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.458+0000 7fe88dc00640 1 -- 172.21.15.59:0/80018733 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88815b680 con 0x7fe888144120 2024-04-25T09:04:31.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.458+0000 7fe88dc00640 1 --2- 172.21.15.59:0/80018733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe888144120 0x7fe88815acd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0097c0 tx=0x7fe87c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1288ee576dc8858 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:31.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.458+0000 7fe887e00640 1 -- 172.21.15.59:0/80018733 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0b0070 con 0x7fe888144120 2024-04-25T09:04:31.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.458+0000 7fe887e00640 1 -- 172.21.15.59:0/80018733 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c0ab600 con 0x7fe888144120 2024-04-25T09:04:31.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.458+0000 7fe887e00640 1 -- 172.21.15.59:0/80018733 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0ab9d0 con 0x7fe888144120 2024-04-25T09:04:31.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 -- 172.21.15.59:0/80018733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe888144120 msgr2=0x7fe88815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:31.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 --2- 172.21.15.59:0/80018733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe888144120 0x7fe88815acd0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0097c0 tx=0x7fe87c01c410 comp rx=0 tx=0).stop 2024-04-25T09:04:31.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 -- 172.21.15.59:0/80018733 shutdown_connections 2024-04-25T09:04:31.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 --2- 172.21.15.59:0/80018733 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8880b3090 0x7fe8880b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 --2- 172.21.15.59:0/80018733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe888144120 0x7fe88815acd0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 -- 172.21.15.59:0/80018733 >> 172.21.15.59:0/80018733 conn(0x7fe888067080 msgr2=0x7fe88806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:31.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 -- 172.21.15.59:0/80018733 shutdown_connections 2024-04-25T09:04:31.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 -- 172.21.15.59:0/80018733 wait complete. 2024-04-25T09:04:31.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 Processor -- start 2024-04-25T09:04:31.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 -- start start 2024-04-25T09:04:31.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8880b3090 0x7fe88815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:31.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8880ccbf0 0x7fe88812e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:31.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe888144120 0x7fe88813f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:31.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8881675c0 con 0x7fe8880b3090 2024-04-25T09:04:31.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe888167440 con 0x7fe8880ccbf0 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe890600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe888167740 con 0x7fe888144120 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe88dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8880b3090 0x7fe88815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe88dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8880b3090 0x7fe88815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52932/0 (socket says 172.21.15.59:52932) 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe88dc00640 1 -- 172.21.15.59:0/849668861 learned_addr learned my addr 172.21.15.59:0/849668861 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe88d200640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8880ccbf0 0x7fe88812e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe88e600640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe888144120 0x7fe88813f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe88dc00640 1 -- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe888144120 msgr2=0x7fe88813f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe88dc00640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe888144120 0x7fe88813f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe88dc00640 1 -- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8880ccbf0 msgr2=0x7fe88812e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe88dc00640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8880ccbf0 0x7fe88812e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe88dc00640 1 -- 172.21.15.59:0/849668861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88813e7e0 con 0x7fe8880b3090 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe88e600640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe888144120 0x7fe88813f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.462+0000 7fe88dc00640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8880b3090 0x7fe88815be00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe87c01a040 tx=0x7fe87c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:31.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.466+0000 7fe885600640 1 -- 172.21.15.59:0/849668861 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0b0050 con 0x7fe8880b3090 2024-04-25T09:04:31.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.466+0000 7fe885600640 1 -- 172.21.15.59:0/849668861 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c0bc070 con 0x7fe8880b3090 2024-04-25T09:04:31.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.466+0000 7fe890600640 1 -- 172.21.15.59:0/849668861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88813eac0 con 0x7fe8880b3090 2024-04-25T09:04:31.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.466+0000 7fe885600640 1 -- 172.21.15.59:0/849668861 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0b5830 con 0x7fe8880b3090 2024-04-25T09:04:31.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.466+0000 7fe890600640 1 -- 172.21.15.59:0/849668861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88813f080 con 0x7fe8880b3090 2024-04-25T09:04:31.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.466+0000 7fe890600640 1 -- 172.21.15.59:0/849668861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8880745d0 con 0x7fe8880b3090 2024-04-25T09:04:31.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.466+0000 7fe885600640 1 -- 172.21.15.59:0/849668861 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe87c0b59d0 con 0x7fe8880b3090 2024-04-25T09:04:31.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.466+0000 7fe885600640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe868066f60 0x7fe868069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:31.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.466+0000 7fe885600640 1 -- 172.21.15.59:0/849668861 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe87c11f610 con 0x7fe8880b3090 2024-04-25T09:04:31.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.466+0000 7fe88d200640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe868066f60 0x7fe868069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:31.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.470+0000 7fe88d200640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe868066f60 0x7fe868069420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe8880ae400 tx=0x7fe874009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:31.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.470+0000 7fe885600640 1 -- 172.21.15.59:0/849668861 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe87c016090 con 0x7fe8880b3090 2024-04-25T09:04:31.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:31.650+0000 7fe890600640 1 -- 172.21.15.59:0/849668861 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe8880cc600 con 0x7fe8880b3090 2024-04-25T09:04:33.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.290+0000 7fe885600640 1 -- 172.21.15.59:0/849668861 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v62) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe87c0f0780 con 0x7fe8880b3090 2024-04-25T09:04:33.282 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-04-25T09:04:33.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.294+0000 7fe890600640 1 -- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe868066f60 msgr2=0x7fe868069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.294+0000 7fe890600640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe868066f60 0x7fe868069420 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe8880ae400 tx=0x7fe874009040 comp rx=0 tx=0).stop 2024-04-25T09:04:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.294+0000 7fe890600640 1 -- 172.21.15.59:0/849668861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8880b3090 msgr2=0x7fe88815be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.294+0000 7fe890600640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8880b3090 0x7fe88815be00 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe87c01a040 tx=0x7fe87c01ac50 comp rx=0 tx=0).stop 2024-04-25T09:04:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.294+0000 7fe890600640 1 -- 172.21.15.59:0/849668861 shutdown_connections 2024-04-25T09:04:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.294+0000 7fe890600640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe868066f60 0x7fe868069420 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.294+0000 7fe890600640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe888144120 0x7fe88813f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.294+0000 7fe890600640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8880ccbf0 0x7fe88812e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.294+0000 7fe890600640 1 --2- 172.21.15.59:0/849668861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8880b3090 0x7fe88815be00 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.294+0000 7fe890600640 1 -- 172.21.15.59:0/849668861 >> 172.21.15.59:0/849668861 conn(0x7fe888067080 msgr2=0x7fe888164cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.294+0000 7fe890600640 1 -- 172.21.15.59:0/849668861 shutdown_connections 2024-04-25T09:04:33.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.294+0000 7fe890600640 1 -- 172.21.15.59:0/849668861 wait complete. 2024-04-25T09:04:33.309 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:04:33.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.462+0000 7f38dbe00640 1 Processor -- start 2024-04-25T09:04:33.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.462+0000 7f38dbe00640 1 -- start start 2024-04-25T09:04:33.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38dbe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0cce20 0x7f38dc1661b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38dbe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38dc15cb00 con 0x7f38dc15b710 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38dbe00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38dc06e030 con 0x7f38dc071b90 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38dbe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc06e310 con 0x7f38dc0cce20 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38daa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f38dc15b710 0x7f38dc071480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41434/0 (socket says 172.21.15.59:41434) 2024-04-25T09:04:33.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38daa00640 1 -- 172.21.15.59:0/4211361657 learned_addr learned my addr 172.21.15.59:0/4211361657 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38db400640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0cce20 0x7f38dc1661b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818886244 0 0) 0x7f38dc15cb00 con 0x7f38dc15b710 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38c0003530 con 0x7f38dc15b710 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892716306 0 0) 0x7f38dc06e030 con 0x7f38dc071b90 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38dc15cb00 con 0x7f38dc071b90 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 624037302 0 0) 0x7f38c0003530 con 0x7f38dc15b710 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0cce20 msgr2=0x7f38dc1661b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0cce20 0x7f38dc1661b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 >> v1:172.21.15.178:6789/0 conn(0x7f38dc071b90 legacy=0x7f38dc0cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc06e5f0 con 0x7f38dc15b710 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f38cc001a00 con 0x7f38dc15b710 2024-04-25T09:04:33.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38db400640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0cce20 0x7f38dc1661b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 >> v1:172.21.15.59:6789/0 conn(0x7f38dc15b710 legacy=0x7f38dc071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0003b80 0x7f38c0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0cce20 0x7f38c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38c0004d50 0x7f38c00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc06e310 con 0x7f38c0003b80 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38c000bae0 con 0x7f38c0004d50 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38c000bce0 con 0x7f38dc0cce20 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38daa00640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0003b80 0x7f38c0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38db400640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38c0004d50 0x7f38c00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38d2000640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0cce20 0x7f38c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38daa00640 1 -- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0cce20 msgr2=0x7f38c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38daa00640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0cce20 0x7f38c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38daa00640 1 -- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38c0004d50 msgr2=0x7f38c00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38daa00640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38c0004d50 0x7f38c00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38daa00640 1 -- 172.21.15.59:0/4211361657 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38c0003530 con 0x7f38c0003b80 2024-04-25T09:04:33.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.466+0000 7f38d2000640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0cce20 0x7f38c0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:33.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38daa00640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0003b80 0x7f38c0003f80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00a750 tx=0x7f38cc01d260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de8b342b8ff7ab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc00a370 con 0x7f38c0003b80 2024-04-25T09:04:33.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc0ad630 con 0x7f38c0003b80 2024-04-25T09:04:33.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38da000640 1 -- 172.21.15.59:0/4211361657 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0ada20 con 0x7f38c0003b80 2024-04-25T09:04:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38dbe00640 1 -- 172.21.15.59:0/4211361657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0003b80 msgr2=0x7f38c0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38dbe00640 1 --2- 172.21.15.59:0/4211361657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0003b80 0x7f38c0003f80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00a750 tx=0x7f38cc01d260 comp rx=0 tx=0).stop 2024-04-25T09:04:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38db400640 1 -- 172.21.15.59:0/4211361657 reap_dead start 2024-04-25T09:04:33.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38dbe00640 1 -- 172.21.15.59:0/4211361657 shutdown_connections 2024-04-25T09:04:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38dbe00640 1 -- 172.21.15.59:0/4211361657 >> 172.21.15.59:0/4211361657 conn(0x7f38dc0cfdc0 msgr2=0x7f38dc0b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38dbe00640 1 -- 172.21.15.59:0/4211361657 shutdown_connections 2024-04-25T09:04:33.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38dbe00640 1 -- 172.21.15.59:0/4211361657 wait complete. 2024-04-25T09:04:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38dbe00640 1 Processor -- start 2024-04-25T09:04:33.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.470+0000 7f38dbe00640 1 -- start start 2024-04-25T09:04:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38dbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0003b80 0x7f38dc141250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38dbe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38dc157ea0 0x7f38dc158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38dbe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0aeec0 0x7f38dc0af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38dbe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc1669c0 con 0x7f38c0003b80 2024-04-25T09:04:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38dbe00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc06f2e0 con 0x7f38dc157ea0 2024-04-25T09:04:33.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38dbe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc166b40 con 0x7f38dc0aeec0 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38daa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0003b80 0x7f38dc141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38daa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0003b80 0x7f38dc141250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52948/0 (socket says 172.21.15.59:52948) 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38daa00640 1 -- 172.21.15.59:0/2899572189 learned_addr learned my addr 172.21.15.59:0/2899572189 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38db400640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0aeec0 0x7f38dc0af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38d2000640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38dc157ea0 0x7f38dc158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38daa00640 1 -- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0aeec0 msgr2=0x7f38dc0af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38daa00640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0aeec0 0x7f38dc0af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38daa00640 1 -- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38dc157ea0 msgr2=0x7f38dc158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38daa00640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38dc157ea0 0x7f38dc158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38daa00640 1 -- 172.21.15.59:0/2899572189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc0afbf0 con 0x7f38c0003b80 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38daa00640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0003b80 0x7f38dc141250 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f38cc000f90 tx=0x7f38c0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38d3400640 1 -- 172.21.15.59:0/2899572189 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc00a370 con 0x7f38c0003b80 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38d3400640 1 -- 172.21.15.59:0/2899572189 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc0bc070 con 0x7f38c0003b80 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38d3400640 1 -- 172.21.15.59:0/2899572189 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc001800 con 0x7f38c0003b80 2024-04-25T09:04:33.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38dbe00640 1 -- 172.21.15.59:0/2899572189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38dc0afed0 con 0x7f38c0003b80 2024-04-25T09:04:33.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38dbe00640 1 -- 172.21.15.59:0/2899572189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc0b0490 con 0x7f38c0003b80 2024-04-25T09:04:33.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.474+0000 7f38dbe00640 1 -- 172.21.15.59:0/2899572189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc04efa0 con 0x7f38c0003b80 2024-04-25T09:04:33.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.478+0000 7f38d3400640 1 -- 172.21.15.59:0/2899572189 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f38cc0b5070 con 0x7f38c0003b80 2024-04-25T09:04:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.478+0000 7f38d3400640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f38b8066f90 0x7f38b8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.478+0000 7f38d3400640 1 -- 172.21.15.59:0/2899572189 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f38cc11f610 con 0x7f38c0003b80 2024-04-25T09:04:33.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.478+0000 7f38d2000640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f38b8066f90 0x7f38b8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.478+0000 7f38d2000640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f38b8066f90 0x7f38b8069450 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f38dc144dd0 tx=0x7f38c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.482+0000 7f38d3400640 1 -- 172.21.15.59:0/2899572189 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f38cc016f70 con 0x7f38c0003b80 2024-04-25T09:04:33.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.698+0000 7f38dbe00640 1 -- 172.21.15.59:0/2899572189 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f38dc0cf0a0 con 0x7f38c0003b80 2024-04-25T09:04:33.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38d3400640 1 -- 172.21.15.59:0/2899572189 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f38cc0f0750 con 0x7f38c0003b80 2024-04-25T09:04:33.692 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:33.692 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmefAMLRAAyOhrYPGN2IYchV7wMDkkTQ==", 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmcZtGORAA9RU5OkQHTCXe5nkpEp77Fw==", 2024-04-25T09:04:33.693 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:04:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:04:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:04:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-04-25T09:04:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmF3skNBAAcKEUsLnvjEY8fz59SnjWtg==", 2024-04-25T09:04:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:04:33.694 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm95/1BBAAsIbA6GBVS4dl7sZ8CoZoLA==", 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.695 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCsGypmmikBDRAAcxA0eWyo/w0bALsf4Fb3KQ==", 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCvGypm66dNFxAAzl06IBbHoxHorB3FuCFNOQ==", 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.696 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCyGypmQrwdIhAAyF53f8p7/vnJ6L4ZjXcKhQ==", 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC1GypmtETmLBAAM4p1FOPAiB0aOcdfIcl6vg==", 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:33.697 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:04:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-04-25T09:04:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC6GypmyXGCAhAAKJ2Yh0lezpRfFMPXjN4Asg==", 2024-04-25T09:04:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:04:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.698 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC9GypmmfZZDBAAzw9IygUbRErERr2lXEfutA==", 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDAGypmS4KRFRAAXrvA1QNbuWF6+ln+cz6orQ==", 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:33.699 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDDGypmruPJHRAAWFONkZiSsYgvsr04uO9J9A==", 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.700 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg==", 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm8NCkEhAAEELIQ7EAUFHsANHAa5EnTA==", 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:04:33.701 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmdosADxAAxmQqp2O5lT5XenyqxyyMKw==", 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.702 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmsqWgGBAAIXaSazGZkKiY2hqcC+WApA==", 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypm5ldPEBAAepEqWPcDy8atp78XxKERYg==", 2024-04-25T09:04:33.703 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmwOe7KBAAIvO6OJiUeb5hRdu9VX11cA==", 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.704 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-04-25T09:04:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmX2GpJBAA8RvpxNpdPFExISwQzT56fA==", 2024-04-25T09:04:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:04:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:04:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:04:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:04:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:33.705 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-25T09:04:33.705 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:04:33.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38dbe00640 1 -- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f38b8066f90 msgr2=0x7f38b8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38dbe00640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f38b8066f90 0x7f38b8069450 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f38dc144dd0 tx=0x7f38c4009040 comp rx=0 tx=0).stop 2024-04-25T09:04:33.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38dbe00640 1 -- 172.21.15.59:0/2899572189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0003b80 msgr2=0x7f38dc141250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38dbe00640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0003b80 0x7f38dc141250 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f38cc000f90 tx=0x7f38c0005840 comp rx=0 tx=0).stop 2024-04-25T09:04:33.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38dbe00640 1 -- 172.21.15.59:0/2899572189 shutdown_connections 2024-04-25T09:04:33.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38dbe00640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f38b8066f90 0x7f38b8069450 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38dbe00640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f38dc0aeec0 0x7f38dc0af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38dbe00640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38dc157ea0 0x7f38dc158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38dbe00640 1 --2- 172.21.15.59:0/2899572189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f38c0003b80 0x7f38dc141250 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38dbe00640 1 -- 172.21.15.59:0/2899572189 >> 172.21.15.59:0/2899572189 conn(0x7f38dc0cfdc0 msgr2=0x7f38dc071480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:33.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38dbe00640 1 -- 172.21.15.59:0/2899572189 shutdown_connections 2024-04-25T09:04:33.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.702+0000 7f38dbe00640 1 -- 172.21.15.59:0/2899572189 wait complete. 2024-04-25T09:04:33.715 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:33.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.862+0000 7fc58b000640 1 Processor -- start 2024-04-25T09:04:33.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.862+0000 7fc58b000640 1 -- start start 2024-04-25T09:04:33.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc58b000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5840b3950 0x7fc58406b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc58b000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58415def0 con 0x7fc58415b2f0 2024-04-25T09:04:33.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc58b000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58415e1b0 con 0x7fc5840b2dc0 2024-04-25T09:04:33.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc58b000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58415e490 con 0x7fc5840b3950 2024-04-25T09:04:33.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc583e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc58415b2f0 0x7fc5840b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41438/0 (socket says 172.21.15.59:41438) 2024-04-25T09:04:33.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc583e00640 1 -- 172.21.15.59:0/2944757783 learned_addr learned my addr 172.21.15.59:0/2944757783 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:33.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc589000640 1 --2- 172.21.15.59:0/2944757783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5840b3950 0x7fc58406b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc583400640 1 -- 172.21.15.59:0/2944757783 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2728798732 0 0) 0x7fc58415def0 con 0x7fc58415b2f0 2024-04-25T09:04:33.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc583400640 1 -- 172.21.15.59:0/2944757783 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc568003530 con 0x7fc58415b2f0 2024-04-25T09:04:33.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc583400640 1 -- 172.21.15.59:0/2944757783 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2490258847 0 0) 0x7fc58415e1b0 con 0x7fc5840b2dc0 2024-04-25T09:04:33.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc583400640 1 -- 172.21.15.59:0/2944757783 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc58415def0 con 0x7fc5840b2dc0 2024-04-25T09:04:33.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc583400640 1 -- 172.21.15.59:0/2944757783 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2314108605 0 0) 0x7fc568003530 con 0x7fc58415b2f0 2024-04-25T09:04:33.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc589000640 1 -- 172.21.15.59:0/2944757783 >> v1:172.21.15.178:6789/0 conn(0x7fc5840b2dc0 legacy=0x7fc58406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc589000640 1 -- 172.21.15.59:0/2944757783 >> v1:172.21.15.59:6789/0 conn(0x7fc58415b2f0 legacy=0x7fc5840b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.866+0000 7fc589000640 1 -- 172.21.15.59:0/2944757783 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58415e770 con 0x7fc5840b3950 2024-04-25T09:04:33.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc589000640 1 --2- 172.21.15.59:0/2944757783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5840b3950 0x7fc58406b320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0097f0 tx=0x7fc58406c070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e89172a727ba59f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc583400640 1 -- 172.21.15.59:0/2944757783 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c0b0070 con 0x7fc5840b3950 2024-04-25T09:04:33.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc583400640 1 -- 172.21.15.59:0/2944757783 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c0ab400 con 0x7fc5840b3950 2024-04-25T09:04:33.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc583400640 1 -- 172.21.15.59:0/2944757783 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58415b8e0 con 0x7fc5840b3950 2024-04-25T09:04:33.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc58b000640 1 -- 172.21.15.59:0/2944757783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5840b3950 msgr2=0x7fc58406b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc58b000640 1 --2- 172.21.15.59:0/2944757783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5840b3950 0x7fc58406b320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0097f0 tx=0x7fc58406c070 comp rx=0 tx=0).stop 2024-04-25T09:04:33.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc58b000640 1 -- 172.21.15.59:0/2944757783 shutdown_connections 2024-04-25T09:04:33.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc58b000640 1 --2- 172.21.15.59:0/2944757783 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5840b3950 0x7fc58406b320 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc58b000640 1 -- 172.21.15.59:0/2944757783 >> 172.21.15.59:0/2944757783 conn(0x7fc5840b23b0 msgr2=0x7fc5840cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:33.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc58b000640 1 -- 172.21.15.59:0/2944757783 shutdown_connections 2024-04-25T09:04:33.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc58b000640 1 -- 172.21.15.59:0/2944757783 wait complete. 2024-04-25T09:04:33.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc58b000640 1 Processor -- start 2024-04-25T09:04:33.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc58b000640 1 -- start start 2024-04-25T09:04:33.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc58b000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5840b2dc0 0x7fc58415c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.870+0000 7fc58b000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5840b3950 0x7fc58415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc58b000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc58415b2f0 0x7fc58413be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc58b000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58416ba10 con 0x7fc5840b3950 2024-04-25T09:04:33.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc58b000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58416b890 con 0x7fc58415b2f0 2024-04-25T09:04:33.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc58b000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58416bb90 con 0x7fc5840b2dc0 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc57b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5840b3950 0x7fc58415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc57b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5840b3950 0x7fc58415ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52960/0 (socket says 172.21.15.59:52960) 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc57b400640 1 -- 172.21.15.59:0/2931753623 learned_addr learned my addr 172.21.15.59:0/2931753623 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc583e00640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5840b2dc0 0x7fc58415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc589000640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc58415b2f0 0x7fc58413be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc57b400640 1 -- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5840b2dc0 msgr2=0x7fc58415c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc57b400640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5840b2dc0 0x7fc58415c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc57b400640 1 -- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc58415b2f0 msgr2=0x7fc58413be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc57b400640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc58415b2f0 0x7fc58413be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc57b400640 1 -- 172.21.15.59:0/2931753623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5840cdd40 con 0x7fc5840b3950 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc583e00640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5840b2dc0 0x7fc58415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc589000640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc58415b2f0 0x7fc58413be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:33.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc57b400640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5840b3950 0x7fc58415ce70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00c4c0 tx=0x7fc56c00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc580c00640 1 -- 172.21.15.59:0/2931753623 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c0052d0 con 0x7fc5840b3950 2024-04-25T09:04:33.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc580c00640 1 -- 172.21.15.59:0/2931753623 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c005470 con 0x7fc5840b3950 2024-04-25T09:04:33.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc580c00640 1 -- 172.21.15.59:0/2931753623 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c012870 con 0x7fc5840b3950 2024-04-25T09:04:33.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc58b000640 1 -- 172.21.15.59:0/2931753623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5840ce020 con 0x7fc5840b3950 2024-04-25T09:04:33.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc58b000640 1 -- 172.21.15.59:0/2931753623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc584150760 con 0x7fc5840b3950 2024-04-25T09:04:33.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc58b000640 1 -- 172.21.15.59:0/2931753623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5840745d0 con 0x7fc5840b3950 2024-04-25T09:04:33.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc580c00640 1 -- 172.21.15.59:0/2931753623 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc56c012a10 con 0x7fc5840b3950 2024-04-25T09:04:33.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.874+0000 7fc580c00640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc560066f60 0x7fc560069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:33.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.878+0000 7fc580c00640 1 -- 172.21.15.59:0/2931753623 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fc56c084b90 con 0x7fc5840b3950 2024-04-25T09:04:33.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.878+0000 7fc583e00640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc560066f60 0x7fc560069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:33.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.878+0000 7fc583e00640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc560066f60 0x7fc560069420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc574001570 tx=0x7fc574009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:33.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:33.882+0000 7fc580c00640 1 -- 172.21.15.59:0/2931753623 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc56c055cc0 con 0x7fc5840b3950 2024-04-25T09:04:34.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.042+0000 7fc58b000640 1 -- 172.21.15.59:0/2931753623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5840d0ab0 con 0x7fc5840b3950 2024-04-25T09:04:34.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.042+0000 7fc580c00640 1 -- 172.21.15.59:0/2931753623 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+13164 (secure 0 0 0) 0x7fc56c0555c0 con 0x7fc5840b3950 2024-04-25T09:04:34.036 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:34.036 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":62,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:04:33.292547+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:34.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.046+0000 7fc58b000640 1 -- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc560066f60 msgr2=0x7fc560069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.046+0000 7fc58b000640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc560066f60 0x7fc560069420 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc574001570 tx=0x7fc574009040 comp rx=0 tx=0).stop 2024-04-25T09:04:34.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.046+0000 7fc58b000640 1 -- 172.21.15.59:0/2931753623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5840b3950 msgr2=0x7fc58415ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.046+0000 7fc58b000640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5840b3950 0x7fc58415ce70 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc56c00c4c0 tx=0x7fc56c00c980 comp rx=0 tx=0).stop 2024-04-25T09:04:34.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.046+0000 7fc58b000640 1 -- 172.21.15.59:0/2931753623 shutdown_connections 2024-04-25T09:04:34.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.046+0000 7fc58b000640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc560066f60 0x7fc560069420 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.046+0000 7fc58b000640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc58415b2f0 0x7fc58413be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.046+0000 7fc58b000640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5840b3950 0x7fc58415ce70 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.046+0000 7fc58b000640 1 --2- 172.21.15.59:0/2931753623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc5840b2dc0 0x7fc58415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.046+0000 7fc58b000640 1 -- 172.21.15.59:0/2931753623 >> 172.21.15.59:0/2931753623 conn(0x7fc5840b23b0 msgr2=0x7fc584152bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:34.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.046+0000 7fc58b000640 1 -- 172.21.15.59:0/2931753623 shutdown_connections 2024-04-25T09:04:34.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.046+0000 7fc58b000640 1 -- 172.21.15.59:0/2931753623 wait complete. 2024-04-25T09:04:34.057 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:04:34.057 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:04:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2cf600640 1 Processor -- start 2024-04-25T09:04:34.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2cf600640 1 -- start start 2024-04-25T09:04:34.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2cf600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe2c815acd0 0x7fe2c815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2cf600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2c815ee60 0x7fe2c80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2cf600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c815bc40 con 0x7fe2c8144120 2024-04-25T09:04:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2cf600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c815e490 con 0x7fe2c815ee60 2024-04-25T09:04:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2cf600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2c815b150 con 0x7fe2c815acd0 2024-04-25T09:04:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2cd600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2c815ee60 0x7fe2c80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2ccc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe2c8144120 0x7fe2c80ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41440/0 (socket says 172.21.15.59:41440) 2024-04-25T09:04:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2ccc00640 1 -- 172.21.15.59:0/1437027388 learned_addr learned my addr 172.21.15.59:0/1437027388 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:34.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2bfe00640 1 --2- 172.21.15.59:0/1437027388 >> v2:172.21.15.178:3300/0 conn(0x7fe2c815acd0 0x7fe2c815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2cd600640 1 -- 172.21.15.59:0/1437027388 >> v2:172.21.15.178:3300/0 conn(0x7fe2c815acd0 msgr2=0x7fe2c815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2cd600640 1 --2- 172.21.15.59:0/1437027388 >> v2:172.21.15.178:3300/0 conn(0x7fe2c815acd0 0x7fe2c815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2cd600640 1 -- 172.21.15.59:0/1437027388 >> v1:172.21.15.59:6789/0 conn(0x7fe2c8144120 legacy=0x7fe2c80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2c7e00640 1 -- 172.21.15.59:0/1437027388 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2080304864 0 0) 0x7fe2c815bc40 con 0x7fe2c8144120 2024-04-25T09:04:34.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.210+0000 7fe2cd600640 1 -- 172.21.15.59:0/1437027388 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c815b3a0 con 0x7fe2c815ee60 2024-04-25T09:04:34.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.214+0000 7fe2cd600640 1 --2- 172.21.15.59:0/1437027388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c815ee60 0x7fe2c80b3090 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe2c806b870 tx=0x7fe2c001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e972851515515be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.214+0000 7fe2c7e00640 1 -- 172.21.15.59:0/1437027388 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00b2070 con 0x7fe2c815ee60 2024-04-25T09:04:34.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.214+0000 7fe2c7e00640 1 -- 172.21.15.59:0/1437027388 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c00a5760 con 0x7fe2c815ee60 2024-04-25T09:04:34.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.214+0000 7fe2c7e00640 1 -- 172.21.15.59:0/1437027388 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c00a5b30 con 0x7fe2c815ee60 2024-04-25T09:04:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.214+0000 7fe2cf600640 1 -- 172.21.15.59:0/1437027388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c815ee60 msgr2=0x7fe2c80b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.214+0000 7fe2cf600640 1 --2- 172.21.15.59:0/1437027388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c815ee60 0x7fe2c80b3090 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe2c806b870 tx=0x7fe2c001c8a0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.214+0000 7fe2cf600640 1 -- 172.21.15.59:0/1437027388 shutdown_connections 2024-04-25T09:04:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.214+0000 7fe2cf600640 1 --2- 172.21.15.59:0/1437027388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c815ee60 0x7fe2c80b3090 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.214+0000 7fe2cf600640 1 --2- 172.21.15.59:0/1437027388 >> v2:172.21.15.178:3300/0 conn(0x7fe2c815acd0 0x7fe2c815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.214+0000 7fe2cf600640 1 -- 172.21.15.59:0/1437027388 >> 172.21.15.59:0/1437027388 conn(0x7fe2c8067080 msgr2=0x7fe2c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.214+0000 7fe2cf600640 1 -- 172.21.15.59:0/1437027388 shutdown_connections 2024-04-25T09:04:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.214+0000 7fe2cf600640 1 -- 172.21.15.59:0/1437027388 wait complete. 2024-04-25T09:04:34.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2cf600640 1 Processor -- start 2024-04-25T09:04:34.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2cf600640 1 -- start start 2024-04-25T09:04:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2cf600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2c8144120 0x7fe2c80b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2cf600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c815acd0 0x7fe2c8142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2cf600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2c815ee60 0x7fe2c80af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2cf600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c81677d0 con 0x7fe2c815acd0 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2cf600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8167650 con 0x7fe2c8144120 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2cf600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c8167950 con 0x7fe2c815ee60 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c815acd0 0x7fe2c8142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c815acd0 0x7fe2c8142e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52968/0 (socket says 172.21.15.59:52968) 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2bfe00640 1 -- 172.21.15.59:0/2054656107 learned_addr learned my addr 172.21.15.59:0/2054656107 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2ccc00640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2c8144120 0x7fe2c80b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2cd600640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2c815ee60 0x7fe2c80af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2bfe00640 1 -- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2c815ee60 msgr2=0x7fe2c80af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2bfe00640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2c815ee60 0x7fe2c80af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2bfe00640 1 -- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2c8144120 msgr2=0x7fe2c80b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2bfe00640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2c8144120 0x7fe2c80b0bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2bfe00640 1 -- 172.21.15.59:0/2054656107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c80b07a0 con 0x7fe2c815acd0 2024-04-25T09:04:34.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2cd600640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2c815ee60 0x7fe2c80af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:34.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2ccc00640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2c8144120 0x7fe2c80b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:34.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2bfe00640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c815acd0 0x7fe2c8142e30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000e930 tx=0x7fe2b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2c5600640 1 -- 172.21.15.59:0/2054656107 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0017070 con 0x7fe2c815acd0 2024-04-25T09:04:34.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2c5600640 1 -- 172.21.15.59:0/2054656107 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b000ca00 con 0x7fe2c815acd0 2024-04-25T09:04:34.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2c5600640 1 -- 172.21.15.59:0/2054656107 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000cdb0 con 0x7fe2c815acd0 2024-04-25T09:04:34.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2cf600640 1 -- 172.21.15.59:0/2054656107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c8161af0 con 0x7fe2c815acd0 2024-04-25T09:04:34.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.218+0000 7fe2cf600640 1 -- 172.21.15.59:0/2054656107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c81620b0 con 0x7fe2c815acd0 2024-04-25T09:04:34.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.222+0000 7fe2cf600640 1 -- 172.21.15.59:0/2054656107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c80745d0 con 0x7fe2c815acd0 2024-04-25T09:04:34.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.222+0000 7fe2c5600640 1 -- 172.21.15.59:0/2054656107 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe2b001a070 con 0x7fe2c815acd0 2024-04-25T09:04:34.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.222+0000 7fe2c5600640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2a4066f90 0x7fe2a4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.222+0000 7fe2c5600640 1 -- 172.21.15.59:0/2054656107 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fe2b0084f30 con 0x7fe2c815acd0 2024-04-25T09:04:34.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.222+0000 7fe2ccc00640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2a4066f90 0x7fe2a4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.222+0000 7fe2ccc00640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2a4066f90 0x7fe2a4069450 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8007fd0 tx=0x7fe2b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.226+0000 7fe2c5600640 1 -- 172.21.15.59:0/2054656107 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe2b0056120 con 0x7fe2c815acd0 2024-04-25T09:04:34.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.390+0000 7fe2cf600640 1 -- 172.21.15.59:0/2054656107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe2c80ae930 con 0x7fe2c815acd0 2024-04-25T09:04:34.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.390+0000 7fe2c5600640 1 -- 172.21.15.59:0/2054656107 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2b0055a20 con 0x7fe2c815acd0 2024-04-25T09:04:34.382 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:04:34.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.394+0000 7fe2cf600640 1 -- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2a4066f90 msgr2=0x7fe2a4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.394+0000 7fe2cf600640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2a4066f90 0x7fe2a4069450 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8007fd0 tx=0x7fe2b8009040 comp rx=0 tx=0).stop 2024-04-25T09:04:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.394+0000 7fe2cf600640 1 -- 172.21.15.59:0/2054656107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c815acd0 msgr2=0x7fe2c8142e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.394+0000 7fe2cf600640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c815acd0 0x7fe2c8142e30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000e930 tx=0x7fe2b000edf0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.394+0000 7fe2cf600640 1 -- 172.21.15.59:0/2054656107 shutdown_connections 2024-04-25T09:04:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.394+0000 7fe2cf600640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe2a4066f90 0x7fe2a4069450 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.394+0000 7fe2cf600640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2c815ee60 0x7fe2c80af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.394+0000 7fe2cf600640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2c815acd0 0x7fe2c8142e30 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.394+0000 7fe2cf600640 1 --2- 172.21.15.59:0/2054656107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2c8144120 0x7fe2c80b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.394+0000 7fe2cf600640 1 -- 172.21.15.59:0/2054656107 >> 172.21.15.59:0/2054656107 conn(0x7fe2c8067080 msgr2=0x7fe2c80b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.394+0000 7fe2cf600640 1 -- 172.21.15.59:0/2054656107 shutdown_connections 2024-04-25T09:04:34.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.394+0000 7fe2cf600640 1 -- 172.21.15.59:0/2054656107 wait complete. 2024-04-25T09:04:34.405 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:04:34.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d4800640 1 Processor -- start 2024-04-25T09:04:34.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d4800640 1 -- start start 2024-04-25T09:04:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d4800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24cc099a60 0x7f24cc099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d4800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24cc09a380 con 0x7f24cc15ee00 2024-04-25T09:04:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d4800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24cc06c650 con 0x7f24cc0cff30 2024-04-25T09:04:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d4800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24cc06c430 con 0x7f24cc099a60 2024-04-25T09:04:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d1e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f24cc099a60 0x7f24cc099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d1400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f24cc15ee00 0x7f24cc06bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41448/0 (socket says 172.21.15.59:41448) 2024-04-25T09:04:34.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d1400640 1 -- 172.21.15.59:0/4186111099 learned_addr learned my addr 172.21.15.59:0/4186111099 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d1e00640 1 -- 172.21.15.59:0/4186111099 >> v1:172.21.15.178:6789/0 conn(0x7f24cc0cff30 legacy=0x7f24cc0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d1e00640 1 -- 172.21.15.59:0/4186111099 >> v1:172.21.15.59:6789/0 conn(0x7f24cc15ee00 legacy=0x7f24cc06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d1e00640 1 -- 172.21.15.59:0/4186111099 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc06c930 con 0x7f24cc099a60 2024-04-25T09:04:34.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.554+0000 7f24d0a00640 1 -- 172.21.15.59:0/4186111099 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036149018 0 0) 0x7f24cc09a380 con 0x7f24cc15ee00 2024-04-25T09:04:34.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.558+0000 7f24d1e00640 1 --2- 172.21.15.59:0/4186111099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24cc099a60 0x7f24cc099e40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f24c00097c0 tx=0x7f24c001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a71d5454521141 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.558+0000 7f24d0a00640 1 -- 172.21.15.59:0/4186111099 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c00b0070 con 0x7f24cc099a60 2024-04-25T09:04:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.558+0000 7f24d0a00640 1 -- 172.21.15.59:0/4186111099 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c0004230 con 0x7f24cc099a60 2024-04-25T09:04:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.558+0000 7f24d0a00640 1 -- 172.21.15.59:0/4186111099 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0003620 con 0x7f24cc099a60 2024-04-25T09:04:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.558+0000 7f24d4800640 1 -- 172.21.15.59:0/4186111099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24cc099a60 msgr2=0x7f24cc099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.558+0000 7f24d4800640 1 --2- 172.21.15.59:0/4186111099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24cc099a60 0x7f24cc099e40 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f24c00097c0 tx=0x7f24c001c460 comp rx=0 tx=0).stop 2024-04-25T09:04:34.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.558+0000 7f24d4800640 1 -- 172.21.15.59:0/4186111099 shutdown_connections 2024-04-25T09:04:34.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.558+0000 7f24d4800640 1 --2- 172.21.15.59:0/4186111099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24cc099a60 0x7f24cc099e40 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.558+0000 7f24d4800640 1 -- 172.21.15.59:0/4186111099 >> 172.21.15.59:0/4186111099 conn(0x7f24cc0d17a0 msgr2=0x7f24cc0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:34.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.558+0000 7f24d4800640 1 -- 172.21.15.59:0/4186111099 shutdown_connections 2024-04-25T09:04:34.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.558+0000 7f24d4800640 1 -- 172.21.15.59:0/4186111099 wait complete. 2024-04-25T09:04:34.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d4800640 1 Processor -- start 2024-04-25T09:04:34.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d4800640 1 -- start start 2024-04-25T09:04:34.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d4800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24cc099a60 0x7f24cc14f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d4800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24cc0cff30 0x7f24cc157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d4800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24cc15ee00 0x7f24cc0c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d4800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc15e000 con 0x7f24cc0cff30 2024-04-25T09:04:34.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d4800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc15de80 con 0x7f24cc099a60 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d4800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24cc16ba10 con 0x7f24cc15ee00 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24cc0cff30 0x7f24cc157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24cc0cff30 0x7f24cc157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:52984/0 (socket says 172.21.15.59:52984) 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d1400640 1 -- 172.21.15.59:0/1319445054 learned_addr learned my addr 172.21.15.59:0/1319445054 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d1e00640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24cc099a60 0x7f24cc14f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d1400640 1 -- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24cc15ee00 msgr2=0x7f24cc0c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d2800640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24cc15ee00 0x7f24cc0c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d1400640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24cc15ee00 0x7f24cc0c99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d1400640 1 -- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24cc099a60 msgr2=0x7f24cc14f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d1400640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24cc099a60 0x7f24cc14f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d1400640 1 -- 172.21.15.59:0/1319445054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24cc150f90 con 0x7f24cc0cff30 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d1e00640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24cc099a60 0x7f24cc14f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d2800640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24cc15ee00 0x7f24cc0c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:34.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d1400640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24cc0cff30 0x7f24cc157a80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c450 tx=0x7f24bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24c6000640 1 -- 172.21.15.59:0/1319445054 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc018070 con 0x7f24cc0cff30 2024-04-25T09:04:34.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24c6000640 1 -- 172.21.15.59:0/1319445054 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24bc0074e0 con 0x7f24cc0cff30 2024-04-25T09:04:34.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24c6000640 1 -- 172.21.15.59:0/1319445054 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24bc0049f0 con 0x7f24cc0cff30 2024-04-25T09:04:34.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d4800640 1 -- 172.21.15.59:0/1319445054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24cc151270 con 0x7f24cc0cff30 2024-04-25T09:04:34.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.562+0000 7f24d4800640 1 -- 172.21.15.59:0/1319445054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24cc151830 con 0x7f24cc0cff30 2024-04-25T09:04:34.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.566+0000 7f24d4800640 1 -- 172.21.15.59:0/1319445054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24cc150d20 con 0x7f24cc0cff30 2024-04-25T09:04:34.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.566+0000 7f24c6000640 1 -- 172.21.15.59:0/1319445054 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f24bc01b070 con 0x7f24cc0cff30 2024-04-25T09:04:34.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.566+0000 7f24c6000640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f24b0066f60 0x7f24b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.566+0000 7f24c6000640 1 -- 172.21.15.59:0/1319445054 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f24bc084120 con 0x7f24cc0cff30 2024-04-25T09:04:34.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.566+0000 7f24d1e00640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f24b0066f60 0x7f24b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.566+0000 7f24d1e00640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f24b0066f60 0x7f24b0069420 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f24c00ad000 tx=0x7f24c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.570+0000 7f24c6000640 1 -- 172.21.15.59:0/1319445054 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f24bc055380 con 0x7f24cc0cff30 2024-04-25T09:04:34.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.734+0000 7f24d4800640 1 -- 172.21.15.59:0/1319445054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f24cc0745d0 con 0x7f24cc0cff30 2024-04-25T09:04:34.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.734+0000 7f24c6000640 1 -- 172.21.15.59:0/1319445054 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v62) v1 ==== 84+0+65 (secure 0 0 0) 0x7f24bc054c80 con 0x7f24cc0cff30 2024-04-25T09:04:34.727 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:34.727 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T09:04:34.727 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:34.727 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-04-25T09:04:34.727 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-04-25T09:04:34.728 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:34.728 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T09:04:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.738+0000 7f24d4800640 1 -- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f24b0066f60 msgr2=0x7f24b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.738+0000 7f24d4800640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f24b0066f60 0x7f24b0069420 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f24c00ad000 tx=0x7f24c0008040 comp rx=0 tx=0).stop 2024-04-25T09:04:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.738+0000 7f24d4800640 1 -- 172.21.15.59:0/1319445054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24cc0cff30 msgr2=0x7f24cc157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.738+0000 7f24d4800640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24cc0cff30 0x7f24cc157a80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f24bc00c450 tx=0x7f24bc00c910 comp rx=0 tx=0).stop 2024-04-25T09:04:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.738+0000 7f24d4800640 1 -- 172.21.15.59:0/1319445054 shutdown_connections 2024-04-25T09:04:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.738+0000 7f24d4800640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f24b0066f60 0x7f24b0069420 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.738+0000 7f24d4800640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24cc15ee00 0x7f24cc0c99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.738+0000 7f24d4800640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24cc0cff30 0x7f24cc157a80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.738+0000 7f24d4800640 1 --2- 172.21.15.59:0/1319445054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24cc099a60 0x7f24cc14f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.738+0000 7f24d4800640 1 -- 172.21.15.59:0/1319445054 >> 172.21.15.59:0/1319445054 conn(0x7f24cc0d17a0 msgr2=0x7f24cc15e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.738+0000 7f24d4800640 1 -- 172.21.15.59:0/1319445054 shutdown_connections 2024-04-25T09:04:34.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.738+0000 7f24d4800640 1 -- 172.21.15.59:0/1319445054 wait complete. 2024-04-25T09:04:34.748 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:04:34.748 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:04:34.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2f7800640 1 Processor -- start 2024-04-25T09:04:34.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2f7800640 1 -- start start 2024-04-25T09:04:34.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2f7800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb2f0071b70 0x7fb2f0066b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2f7800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2f0071f50 0x7fb2f00ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2f7800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f006b990 con 0x7fb2f00cf0d0 2024-04-25T09:04:34.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2f7800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f0067090 con 0x7fb2f0071f50 2024-04-25T09:04:34.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2f7800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f006dbd0 con 0x7fb2f0071b70 2024-04-25T09:04:34.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2efe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2f0071f50 0x7fb2f00ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2efe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2f0071f50 0x7fb2f00ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53000/0 (socket says 172.21.15.59:53000) 2024-04-25T09:04:34.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2efe00640 1 -- 172.21.15.59:0/2194450810 learned_addr learned my addr 172.21.15.59:0/2194450810 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:34.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2f4e00640 1 --2- 172.21.15.59:0/2194450810 >> v2:172.21.15.178:3300/0 conn(0x7fb2f0071b70 0x7fb2f0066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2efe00640 1 -- 172.21.15.59:0/2194450810 >> v2:172.21.15.178:3300/0 conn(0x7fb2f0071b70 msgr2=0x7fb2f0066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:34.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2efe00640 1 --2- 172.21.15.59:0/2194450810 >> v2:172.21.15.178:3300/0 conn(0x7fb2f0071b70 0x7fb2f0066b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2efe00640 1 -- 172.21.15.59:0/2194450810 >> v1:172.21.15.178:6789/0 conn(0x7fb2f00cf0d0 legacy=0x7fb2f00cf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2efe00640 1 -- 172.21.15.59:0/2194450810 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f006bc70 con 0x7fb2f0071f50 2024-04-25T09:04:34.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.902+0000 7fb2f4e00640 1 --2- 172.21.15.59:0/2194450810 >> v2:172.21.15.178:3300/0 conn(0x7fb2f0071b70 0x7fb2f0066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:34.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.906+0000 7fb2efe00640 1 --2- 172.21.15.59:0/2194450810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f0071f50 0x7fb2f00ceb90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00b2980 tx=0x7fb2dc01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a59aea9224ead2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.906+0000 7fb2ef400640 1 -- 172.21.15.59:0/2194450810 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0ab600 con 0x7fb2f0071f50 2024-04-25T09:04:34.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.906+0000 7fb2ef400640 1 -- 172.21.15.59:0/2194450810 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2dc0b0070 con 0x7fb2f0071f50 2024-04-25T09:04:34.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.906+0000 7fb2ef400640 1 -- 172.21.15.59:0/2194450810 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2dc0ab9c0 con 0x7fb2f0071f50 2024-04-25T09:04:34.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.906+0000 7fb2f7800640 1 -- 172.21.15.59:0/2194450810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f0071f50 msgr2=0x7fb2f00ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.906+0000 7fb2f7800640 1 --2- 172.21.15.59:0/2194450810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f0071f50 0x7fb2f00ceb90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fb2f00b2980 tx=0x7fb2dc01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.906+0000 7fb2f7800640 1 -- 172.21.15.59:0/2194450810 shutdown_connections 2024-04-25T09:04:34.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.906+0000 7fb2f7800640 1 --2- 172.21.15.59:0/2194450810 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f0071f50 0x7fb2f00ceb90 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.906+0000 7fb2f7800640 1 --2- 172.21.15.59:0/2194450810 >> v2:172.21.15.178:3300/0 conn(0x7fb2f0071b70 0x7fb2f0066b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.906+0000 7fb2f7800640 1 -- 172.21.15.59:0/2194450810 >> 172.21.15.59:0/2194450810 conn(0x7fb2f00cfd80 msgr2=0x7fb2f00d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:34.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.906+0000 7fb2f7800640 1 -- 172.21.15.59:0/2194450810 shutdown_connections 2024-04-25T09:04:34.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.906+0000 7fb2f7800640 1 -- 172.21.15.59:0/2194450810 wait complete. 2024-04-25T09:04:34.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f7800640 1 Processor -- start 2024-04-25T09:04:34.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f7800640 1 -- start start 2024-04-25T09:04:34.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f7800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2f0071b70 0x7fb2f0148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f7800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2f0071f50 0x7fb2f01496b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f7800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f00cf0d0 0x7fb2f0154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f7800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f006b5e0 con 0x7fb2f00cf0d0 2024-04-25T09:04:34.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f7800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00b4d00 con 0x7fb2f0071f50 2024-04-25T09:04:34.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f7800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f0149480 con 0x7fb2f0071b70 2024-04-25T09:04:34.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f00cf0d0 0x7fb2f0154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f00cf0d0 0x7fb2f0154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53008/0 (socket says 172.21.15.59:53008) 2024-04-25T09:04:34.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f5800640 1 -- 172.21.15.59:0/138267190 learned_addr learned my addr 172.21.15.59:0/138267190 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:34.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2efe00640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2f0071f50 0x7fb2f01496b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f4e00640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2f0071b70 0x7fb2f0148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f5800640 1 -- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2f0071b70 msgr2=0x7fb2f0148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f5800640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2f0071b70 0x7fb2f0148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f5800640 1 -- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2f0071f50 msgr2=0x7fb2f01496b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:34.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f5800640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2f0071f50 0x7fb2f01496b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:34.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f5800640 1 -- 172.21.15.59:0/138267190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f0149f00 con 0x7fb2f00cf0d0 2024-04-25T09:04:34.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f5800640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f00cf0d0 0x7fb2f0154610 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800c760 tx=0x7fb2e800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2ecc00640 1 -- 172.21.15.59:0/138267190 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8003b80 con 0x7fb2f00cf0d0 2024-04-25T09:04:34.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2ecc00640 1 -- 172.21.15.59:0/138267190 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e8003d20 con 0x7fb2f00cf0d0 2024-04-25T09:04:34.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f7800640 1 -- 172.21.15.59:0/138267190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f014a1e0 con 0x7fb2f00cf0d0 2024-04-25T09:04:34.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2ecc00640 1 -- 172.21.15.59:0/138267190 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e800aa30 con 0x7fb2f00cf0d0 2024-04-25T09:04:34.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f7800640 1 -- 172.21.15.59:0/138267190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f014a7a0 con 0x7fb2f00cf0d0 2024-04-25T09:04:34.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.910+0000 7fb2f7800640 1 -- 172.21.15.59:0/138267190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f00745d0 con 0x7fb2f00cf0d0 2024-04-25T09:04:34.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.914+0000 7fb2ecc00640 1 -- 172.21.15.59:0/138267190 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb2e800abd0 con 0x7fb2f00cf0d0 2024-04-25T09:04:34.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.914+0000 7fb2ecc00640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb2d0066f60 0x7fb2d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:34.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.914+0000 7fb2ecc00640 1 -- 172.21.15.59:0/138267190 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb2e8084bb0 con 0x7fb2f00cf0d0 2024-04-25T09:04:34.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.914+0000 7fb2f4e00640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb2d0066f60 0x7fb2d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:34.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.914+0000 7fb2f4e00640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb2d0066f60 0x7fb2d0069420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009950 tx=0x7fb2e4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:34.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:34.918+0000 7fb2ecc00640 1 -- 172.21.15.59:0/138267190 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb2e8055720 con 0x7fb2f00cf0d0 2024-04-25T09:04:35.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.082+0000 7fb2f7800640 1 -- 172.21.15.59:0/138267190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb2f00b3cd0 con 0x7fb2f00cf0d0 2024-04-25T09:04:35.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.306+0000 7fb2ecc00640 1 -- 172.21.15.59:0/138267190 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v63) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb2e80597c0 con 0x7fb2f00cf0d0 2024-04-25T09:04:35.300 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-04-25T09:04:35.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.310+0000 7fb2f7800640 1 -- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb2d0066f60 msgr2=0x7fb2d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.310+0000 7fb2f7800640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb2d0066f60 0x7fb2d0069420 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb2e4009950 tx=0x7fb2e4008040 comp rx=0 tx=0).stop 2024-04-25T09:04:35.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.310+0000 7fb2f7800640 1 -- 172.21.15.59:0/138267190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f00cf0d0 msgr2=0x7fb2f0154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.310+0000 7fb2f7800640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f00cf0d0 0x7fb2f0154610 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fb2e800c760 tx=0x7fb2e800cc20 comp rx=0 tx=0).stop 2024-04-25T09:04:35.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.310+0000 7fb2f7800640 1 -- 172.21.15.59:0/138267190 shutdown_connections 2024-04-25T09:04:35.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.310+0000 7fb2f7800640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb2d0066f60 0x7fb2d0069420 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.310+0000 7fb2f7800640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2f00cf0d0 0x7fb2f0154610 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.310+0000 7fb2f7800640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2f0071f50 0x7fb2f01496b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.310+0000 7fb2f7800640 1 --2- 172.21.15.59:0/138267190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2f0071b70 0x7fb2f0148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.310+0000 7fb2f7800640 1 -- 172.21.15.59:0/138267190 >> 172.21.15.59:0/138267190 conn(0x7fb2f00cfd80 msgr2=0x7fb2f00d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:35.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.310+0000 7fb2f7800640 1 -- 172.21.15.59:0/138267190 shutdown_connections 2024-04-25T09:04:35.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.310+0000 7fb2f7800640 1 -- 172.21.15.59:0/138267190 wait complete. 2024-04-25T09:04:35.327 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:04:35.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a8200640 1 Processor -- start 2024-04-25T09:04:35.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a8200640 1 -- start start 2024-04-25T09:04:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a8200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06a0159320 0x7f06a015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a8200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f06a015f440 0x7f06a006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a8200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a015fc00 con 0x7f06a006e010 2024-04-25T09:04:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a8200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a006d640 con 0x7f06a0159320 2024-04-25T09:04:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a8200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a015fee0 con 0x7f06a015f440 2024-04-25T09:04:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a6200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f06a006e010 0x7f06a006e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41454/0 (socket says 172.21.15.59:41454) 2024-04-25T09:04:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a6200640 1 -- 172.21.15.59:0/2951297444 learned_addr learned my addr 172.21.15.59:0/2951297444 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:35.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a5800640 1 --2- 172.21.15.59:0/2951297444 >> v2:172.21.15.59:3300/0 conn(0x7f06a0159320 0x7f06a015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a4e00640 1 --2- 172.21.15.59:0/2951297444 >> v2:172.21.15.178:3300/0 conn(0x7f06a015f440 0x7f06a006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a5800640 1 -- 172.21.15.59:0/2951297444 >> v2:172.21.15.178:3300/0 conn(0x7f06a015f440 msgr2=0x7f06a006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:35.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a5800640 1 --2- 172.21.15.59:0/2951297444 >> v2:172.21.15.178:3300/0 conn(0x7f06a015f440 0x7f06a006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a5800640 1 -- 172.21.15.59:0/2951297444 >> v1:172.21.15.59:6789/0 conn(0x7f06a006e010 legacy=0x7f06a006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.486+0000 7f06a5800640 1 -- 172.21.15.59:0/2951297444 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a01601c0 con 0x7f06a0159320 2024-04-25T09:04:35.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f06a5800640 1 --2- 172.21.15.59:0/2951297444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a0159320 0x7f06a015c9b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f06a00b4b50 tx=0x7f069401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a529f8d43899f2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:35.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f069fe00640 1 -- 172.21.15.59:0/2951297444 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940b1070 con 0x7f06a0159320 2024-04-25T09:04:35.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f069fe00640 1 -- 172.21.15.59:0/2951297444 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06940a8050 con 0x7f06a0159320 2024-04-25T09:04:35.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f069fe00640 1 -- 172.21.15.59:0/2951297444 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940ac860 con 0x7f06a0159320 2024-04-25T09:04:35.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f06a8200640 1 -- 172.21.15.59:0/2951297444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a0159320 msgr2=0x7f06a015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f06a8200640 1 --2- 172.21.15.59:0/2951297444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a0159320 0x7f06a015c9b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f06a00b4b50 tx=0x7f069401c3c0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f06a8200640 1 -- 172.21.15.59:0/2951297444 shutdown_connections 2024-04-25T09:04:35.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f06a8200640 1 --2- 172.21.15.59:0/2951297444 >> v2:172.21.15.178:3300/0 conn(0x7f06a015f440 0x7f06a006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f06a8200640 1 --2- 172.21.15.59:0/2951297444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a0159320 0x7f06a015c9b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f06a8200640 1 -- 172.21.15.59:0/2951297444 >> 172.21.15.59:0/2951297444 conn(0x7f06a0067080 msgr2=0x7f06a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:35.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f06a8200640 1 -- 172.21.15.59:0/2951297444 shutdown_connections 2024-04-25T09:04:35.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f06a8200640 1 -- 172.21.15.59:0/2951297444 wait complete. 2024-04-25T09:04:35.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.490+0000 7f06a8200640 1 Processor -- start 2024-04-25T09:04:35.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a8200640 1 -- start start 2024-04-25T09:04:35.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a8200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a006e010 0x7f06a0156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a8200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a0159320 0x7f06a0136a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a8200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a015f440 0x7f06a013a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a8200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a015f9a0 con 0x7f06a015f440 2024-04-25T09:04:35.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a8200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a015f820 con 0x7f06a0159320 2024-04-25T09:04:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a8200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a006ebb0 con 0x7f06a006e010 2024-04-25T09:04:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a6200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a015f440 0x7f06a013a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a6200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a015f440 0x7f06a013a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53026/0 (socket says 172.21.15.59:53026) 2024-04-25T09:04:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a6200640 1 -- 172.21.15.59:0/1573929860 learned_addr learned my addr 172.21.15.59:0/1573929860 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a5800640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a006e010 0x7f06a0156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a4e00640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a0159320 0x7f06a0136a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a6200640 1 -- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a006e010 msgr2=0x7f06a0156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a6200640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a006e010 0x7f06a0156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a6200640 1 -- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a0159320 msgr2=0x7f06a0136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:35.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a6200640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a0159320 0x7f06a0136a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:35.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a6200640 1 -- 172.21.15.59:0/1573929860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a0139a40 con 0x7f06a015f440 2024-04-25T09:04:35.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a6200640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a015f440 0x7f06a013a800 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f069800cb20 tx=0x7f069800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:35.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f069d600640 1 -- 172.21.15.59:0/1573929860 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698017070 con 0x7f06a015f440 2024-04-25T09:04:35.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f069d600640 1 -- 172.21.15.59:0/1573929860 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069800aca0 con 0x7f06a015f440 2024-04-25T09:04:35.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f069d600640 1 -- 172.21.15.59:0/1573929860 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698012600 con 0x7f06a015f440 2024-04-25T09:04:35.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a8200640 1 -- 172.21.15.59:0/1573929860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a0139d20 con 0x7f06a015f440 2024-04-25T09:04:35.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a8200640 1 -- 172.21.15.59:0/1573929860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a013a2e0 con 0x7f06a015f440 2024-04-25T09:04:35.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.494+0000 7f06a8200640 1 -- 172.21.15.59:0/1573929860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a00745d0 con 0x7f06a015f440 2024-04-25T09:04:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.498+0000 7f069d600640 1 -- 172.21.15.59:0/1573929860 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f069801a070 con 0x7f06a015f440 2024-04-25T09:04:35.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.498+0000 7f069d600640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0680066f60 0x7f0680069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.498+0000 7f069d600640 1 -- 172.21.15.59:0/1573929860 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f0698085370 con 0x7f06a015f440 2024-04-25T09:04:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.498+0000 7f06a5800640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0680066f60 0x7f0680069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:35.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.498+0000 7f06a5800640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0680066f60 0x7f0680069420 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f06940ae000 tx=0x7f0694008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:35.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.502+0000 7f069d600640 1 -- 172.21.15.59:0/1573929860 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0698055ef0 con 0x7f06a015f440 2024-04-25T09:04:35.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:35.662+0000 7f06a8200640 1 -- 172.21.15.59:0/1573929860 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f06a015d400 con 0x7f06a015f440 2024-04-25T09:04:36.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.314+0000 7f069d600640 1 -- 172.21.15.59:0/1573929860 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v64) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0698059f90 con 0x7f06a015f440 2024-04-25T09:04:36.307 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-04-25T09:04:36.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.318+0000 7f06a8200640 1 -- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0680066f60 msgr2=0x7f0680069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.318+0000 7f06a8200640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0680066f60 0x7f0680069420 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f06940ae000 tx=0x7f0694008040 comp rx=0 tx=0).stop 2024-04-25T09:04:36.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.318+0000 7f06a8200640 1 -- 172.21.15.59:0/1573929860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a015f440 msgr2=0x7f06a013a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.318+0000 7f06a8200640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a015f440 0x7f06a013a800 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f069800cb20 tx=0x7f069800a060 comp rx=0 tx=0).stop 2024-04-25T09:04:36.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.318+0000 7f06a8200640 1 -- 172.21.15.59:0/1573929860 shutdown_connections 2024-04-25T09:04:36.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.318+0000 7f06a8200640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0680066f60 0x7f0680069420 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.318+0000 7f06a8200640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06a015f440 0x7f06a013a800 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.318+0000 7f06a8200640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f06a0159320 0x7f06a0136a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.318+0000 7f06a8200640 1 --2- 172.21.15.59:0/1573929860 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f06a006e010 0x7f06a0156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.318+0000 7f06a8200640 1 -- 172.21.15.59:0/1573929860 >> 172.21.15.59:0/1573929860 conn(0x7f06a0067080 msgr2=0x7f06a015bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.318+0000 7f06a8200640 1 -- 172.21.15.59:0/1573929860 shutdown_connections 2024-04-25T09:04:36.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.318+0000 7f06a8200640 1 -- 172.21.15.59:0/1573929860 wait complete. 2024-04-25T09:04:36.349 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:04:36.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.502+0000 7fece0600640 1 Processor -- start 2024-04-25T09:04:36.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.502+0000 7fece0600640 1 -- start start 2024-04-25T09:04:36.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fece0600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fecd80b3090 0x7fecd80b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fece0600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd815bc40 con 0x7fecd815acd0 2024-04-25T09:04:36.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fece0600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd815b3a0 con 0x7fecd8144120 2024-04-25T09:04:36.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fece0600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd815e490 con 0x7fecd80b3090 2024-04-25T09:04:36.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecdd200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fecd815acd0 0x7fecd815e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41462/0 (socket says 172.21.15.59:41462) 2024-04-25T09:04:36.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecdd200640 1 -- 172.21.15.59:0/2692783240 learned_addr learned my addr 172.21.15.59:0/2692783240 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecde600640 1 --2- 172.21.15.59:0/2692783240 >> v2:172.21.15.178:3300/0 conn(0x7fecd80b3090 0x7fecd80b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877286261 0 0) 0x7fecd815bc40 con 0x7fecd815acd0 2024-04-25T09:04:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc0003530 con 0x7fecd815acd0 2024-04-25T09:04:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437382447 0 0) 0x7fecc0003530 con 0x7fecd815acd0 2024-04-25T09:04:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 >> v2:172.21.15.178:3300/0 conn(0x7fecd80b3090 msgr2=0x7fecd80b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 --2- 172.21.15.59:0/2692783240 >> v2:172.21.15.178:3300/0 conn(0x7fecd80b3090 0x7fecd80b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 >> v1:172.21.15.178:6789/0 conn(0x7fecd8144120 legacy=0x7fecd80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd815b680 con 0x7fecd815acd0 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fecc4001680 con 0x7fecd815acd0 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 >> v1:172.21.15.59:6789/0 conn(0x7fecd815acd0 legacy=0x7fecd815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 --2- 172.21.15.59:0/2692783240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecc00039c0 0x7fecc0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 --2- 172.21.15.59:0/2692783240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecc0004810 0x7fecc0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 --2- 172.21.15.59:0/2692783240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc00051d0 0x7fecc000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd815e490 con 0x7fecc00051d0 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc000c170 con 0x7fecc00039c0 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc000c370 con 0x7fecc0004810 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecde600640 1 --2- 172.21.15.59:0/2692783240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc00051d0 0x7fecc000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecdd200640 1 --2- 172.21.15.59:0/2692783240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecc0004810 0x7fecc0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecddc00640 1 --2- 172.21.15.59:0/2692783240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecc00039c0 0x7fecc0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecde600640 1 -- 172.21.15.59:0/2692783240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecc0004810 msgr2=0x7fecc0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecde600640 1 --2- 172.21.15.59:0/2692783240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecc0004810 0x7fecc0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecde600640 1 -- 172.21.15.59:0/2692783240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecc00039c0 msgr2=0x7fecc0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecde600640 1 --2- 172.21.15.59:0/2692783240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecc00039c0 0x7fecc0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.506+0000 7fecde600640 1 -- 172.21.15.59:0/2692783240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc0003530 con 0x7fecc00051d0 2024-04-25T09:04:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.510+0000 7fecde600640 1 -- 172.21.15.59:0/2692783240 reap_dead start 2024-04-25T09:04:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.510+0000 7fecde600640 1 --2- 172.21.15.59:0/2692783240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc00051d0 0x7fecc000b9d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009fc0 tx=0x7fecd001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90385a9706a7d420 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.510+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0009c10 con 0x7fecc00051d0 2024-04-25T09:04:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.510+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd00a5c30 con 0x7fecc00051d0 2024-04-25T09:04:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.510+0000 7fecd7e00640 1 -- 172.21.15.59:0/2692783240 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd00039a0 con 0x7fecc00051d0 2024-04-25T09:04:36.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.510+0000 7fece0600640 1 -- 172.21.15.59:0/2692783240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc00051d0 msgr2=0x7fecc000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.510+0000 7fece0600640 1 --2- 172.21.15.59:0/2692783240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc00051d0 0x7fecc000b9d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fecd0009fc0 tx=0x7fecd001ccc0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.510+0000 7fece0600640 1 -- 172.21.15.59:0/2692783240 shutdown_connections 2024-04-25T09:04:36.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.510+0000 7fece0600640 1 --2- 172.21.15.59:0/2692783240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecc00051d0 0x7fecc000b9d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.510+0000 7fece0600640 1 -- 172.21.15.59:0/2692783240 >> 172.21.15.59:0/2692783240 conn(0x7fecd8067080 msgr2=0x7fecd806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:36.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.510+0000 7fece0600640 1 -- 172.21.15.59:0/2692783240 shutdown_connections 2024-04-25T09:04:36.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.510+0000 7fece0600640 1 -- 172.21.15.59:0/2692783240 wait complete. 2024-04-25T09:04:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fece0600640 1 Processor -- start 2024-04-25T09:04:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fece0600640 1 -- start start 2024-04-25T09:04:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fece0600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecc00051d0 0x7fecd815a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fece0600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecd8159d20 0x7fecd8152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fece0600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8138800 0x7fecd8138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fece0600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80b3520 con 0x7fecd8138800 2024-04-25T09:04:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fece0600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd815b150 con 0x7fecd8159d20 2024-04-25T09:04:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fece0600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80b36a0 con 0x7fecc00051d0 2024-04-25T09:04:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecde600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8138800 0x7fecd8138c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecde600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8138800 0x7fecd8138c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53044/0 (socket says 172.21.15.59:53044) 2024-04-25T09:04:36.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecde600640 1 -- 172.21.15.59:0/2850796691 learned_addr learned my addr 172.21.15.59:0/2850796691 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecddc00640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecc00051d0 0x7fecd815a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecdd200640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecd8159d20 0x7fecd8152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecde600640 1 -- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecc00051d0 msgr2=0x7fecd815a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecde600640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecc00051d0 0x7fecd815a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecde600640 1 -- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecd8159d20 msgr2=0x7fecd8152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecde600640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecd8159d20 0x7fecd8152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecde600640 1 -- 172.21.15.59:0/2850796691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80a9df0 con 0x7fecd8138800 2024-04-25T09:04:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecde600640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8138800 0x7fecd8138c80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fecd001c730 tx=0x7fecd0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecd5600640 1 -- 172.21.15.59:0/2850796691 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0009c10 con 0x7fecd8138800 2024-04-25T09:04:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecd5600640 1 -- 172.21.15.59:0/2850796691 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd00be070 con 0x7fecd8138800 2024-04-25T09:04:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fecd5600640 1 -- 172.21.15.59:0/2850796691 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0004220 con 0x7fecd8138800 2024-04-25T09:04:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fece0600640 1 -- 172.21.15.59:0/2850796691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd80a9270 con 0x7fecd8138800 2024-04-25T09:04:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.514+0000 7fece0600640 1 -- 172.21.15.59:0/2850796691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd80a9830 con 0x7fecd8138800 2024-04-25T09:04:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.518+0000 7fece0600640 1 -- 172.21.15.59:0/2850796691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd80745d0 con 0x7fecd8138800 2024-04-25T09:04:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.518+0000 7fecd5600640 1 -- 172.21.15.59:0/2850796691 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fecd00043c0 con 0x7fecd8138800 2024-04-25T09:04:36.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.518+0000 7fecd5600640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecb8066f90 0x7fecb8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:36.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.518+0000 7fecd5600640 1 -- 172.21.15.59:0/2850796691 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fecd01203d0 con 0x7fecd8138800 2024-04-25T09:04:36.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.518+0000 7fecddc00640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecb8066f90 0x7fecb8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.518+0000 7fecddc00640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecb8066f90 0x7fecb8069450 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7feccc000c10 tx=0x7feccc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:36.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.522+0000 7fecd5600640 1 -- 172.21.15.59:0/2850796691 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fecd00169d0 con 0x7fecd8138800 2024-04-25T09:04:36.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:36.722+0000 7fece0600640 1 -- 172.21.15.59:0/2850796691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fecd80b1e70 con 0x7fecd8138800 2024-04-25T09:04:37.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.318+0000 7fecd5600640 1 -- 172.21.15.59:0/2850796691 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v34) v1 ==== 173+0+0 (secure 0 0 0) 0x7fecd00f1210 con 0x7fecd8138800 2024-04-25T09:04:37.310 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 9 and data pool 10 2024-04-25T09:04:37.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.322+0000 7fece0600640 1 -- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecb8066f90 msgr2=0x7fecb8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.322+0000 7fece0600640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecb8066f90 0x7fecb8069450 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7feccc000c10 tx=0x7feccc009040 comp rx=0 tx=0).stop 2024-04-25T09:04:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.322+0000 7fece0600640 1 -- 172.21.15.59:0/2850796691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8138800 msgr2=0x7fecd8138c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.322+0000 7fece0600640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8138800 0x7fecd8138c80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fecd001c730 tx=0x7fecd0009750 comp rx=0 tx=0).stop 2024-04-25T09:04:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.322+0000 7fece0600640 1 -- 172.21.15.59:0/2850796691 shutdown_connections 2024-04-25T09:04:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.322+0000 7fece0600640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fecb8066f90 0x7fecb8069450 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.322+0000 7fece0600640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecd8138800 0x7fecd8138c80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.322+0000 7fece0600640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fecd8159d20 0x7fecd8152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.322+0000 7fece0600640 1 --2- 172.21.15.59:0/2850796691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fecc00051d0 0x7fecd815a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.322+0000 7fece0600640 1 -- 172.21.15.59:0/2850796691 >> 172.21.15.59:0/2850796691 conn(0x7fecd8067080 msgr2=0x7fecd80b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.322+0000 7fece0600640 1 -- 172.21.15.59:0/2850796691 shutdown_connections 2024-04-25T09:04:37.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.322+0000 7fece0600640 1 -- 172.21.15.59:0/2850796691 wait complete. 2024-04-25T09:04:37.363 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:37.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.514+0000 7f3030000640 1 Processor -- start 2024-04-25T09:04:37.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.514+0000 7f3030000640 1 -- start start 2024-04-25T09:04:37.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f3030000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3028144140 0x7f30280ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f3030000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f302806ead0 0x7f30280b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f3030000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f302815ac60 con 0x7f30280ced60 2024-04-25T09:04:37.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f3030000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30280cf3e0 con 0x7f302806ead0 2024-04-25T09:04:37.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f3030000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f302815af20 con 0x7f3028144140 2024-04-25T09:04:37.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f302cc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f30280ced60 0x7f302806e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41474/0 (socket says 172.21.15.59:41474) 2024-04-25T09:04:37.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f302cc00640 1 -- 172.21.15.59:0/650992678 learned_addr learned my addr 172.21.15.59:0/650992678 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:37.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f302d600640 1 --2- 172.21.15.59:0/650992678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3028144140 0x7f30280ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f302e000640 1 --2- 172.21.15.59:0/650992678 >> v2:172.21.15.178:3300/0 conn(0x7f302806ead0 0x7f30280b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f3027e00640 1 -- 172.21.15.59:0/650992678 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973326679 0 0) 0x7f302815ac60 con 0x7f30280ced60 2024-04-25T09:04:37.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f3027e00640 1 -- 172.21.15.59:0/650992678 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3010003530 con 0x7f30280ced60 2024-04-25T09:04:37.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f302d600640 1 -- 172.21.15.59:0/650992678 >> v2:172.21.15.178:3300/0 conn(0x7f302806ead0 msgr2=0x7f30280b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f302d600640 1 --2- 172.21.15.59:0/650992678 >> v2:172.21.15.178:3300/0 conn(0x7f302806ead0 0x7f30280b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f3027e00640 1 -- 172.21.15.59:0/650992678 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2596857474 0 0) 0x7f3010003530 con 0x7f30280ced60 2024-04-25T09:04:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f302d600640 1 -- 172.21.15.59:0/650992678 >> v1:172.21.15.59:6789/0 conn(0x7f30280ced60 legacy=0x7f302806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.518+0000 7f302d600640 1 -- 172.21.15.59:0/650992678 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f302815b200 con 0x7f3028144140 2024-04-25T09:04:37.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f302d600640 1 --2- 172.21.15.59:0/650992678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3028144140 0x7f30280ce820 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f301c0097c0 tx=0x7f301c01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcd5e176483642c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3027e00640 1 -- 172.21.15.59:0/650992678 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0b1070 con 0x7f3028144140 2024-04-25T09:04:37.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3027e00640 1 -- 172.21.15.59:0/650992678 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c0a4ae0 con 0x7f3028144140 2024-04-25T09:04:37.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3027e00640 1 -- 172.21.15.59:0/650992678 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014001680 con 0x7f3028144140 2024-04-25T09:04:37.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3030000640 1 -- 172.21.15.59:0/650992678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3028144140 msgr2=0x7f30280ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3030000640 1 --2- 172.21.15.59:0/650992678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3028144140 0x7f30280ce820 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f301c0097c0 tx=0x7f301c01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3030000640 1 -- 172.21.15.59:0/650992678 shutdown_connections 2024-04-25T09:04:37.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3030000640 1 --2- 172.21.15.59:0/650992678 >> v2:172.21.15.178:3300/0 conn(0x7f302806ead0 0x7f30280b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3030000640 1 --2- 172.21.15.59:0/650992678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3028144140 0x7f30280ce820 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3030000640 1 -- 172.21.15.59:0/650992678 >> 172.21.15.59:0/650992678 conn(0x7f3028066fa0 msgr2=0x7f302806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3030000640 1 -- 172.21.15.59:0/650992678 shutdown_connections 2024-04-25T09:04:37.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3030000640 1 -- 172.21.15.59:0/650992678 wait complete. 2024-04-25T09:04:37.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3030000640 1 Processor -- start 2024-04-25T09:04:37.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.522+0000 7f3030000640 1 -- start start 2024-04-25T09:04:37.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3030000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f302806ead0 0x7f302813a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3030000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30280ced60 0x7f30280b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3030000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3028144140 0x7f30280b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3030000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302815bb80 con 0x7f30280ced60 2024-04-25T09:04:37.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3030000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f302815ba00 con 0x7f3028144140 2024-04-25T09:04:37.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3030000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30281653d0 con 0x7f302806ead0 2024-04-25T09:04:37.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f302cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30280ced60 0x7f30280b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f302cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30280ced60 0x7f30280b4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53054/0 (socket says 172.21.15.59:53054) 2024-04-25T09:04:37.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f302cc00640 1 -- 172.21.15.59:0/3641245096 learned_addr learned my addr 172.21.15.59:0/3641245096 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:37.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f302d600640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f302806ead0 0x7f302813a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f302e000640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3028144140 0x7f30280b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f302cc00640 1 -- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f302806ead0 msgr2=0x7f302813a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f302cc00640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f302806ead0 0x7f302813a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f302cc00640 1 -- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3028144140 msgr2=0x7f30280b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f302cc00640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3028144140 0x7f30280b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f302cc00640 1 -- 172.21.15.59:0/3641245096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028167080 con 0x7f30280ced60 2024-04-25T09:04:37.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f302cc00640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30280ced60 0x7f30280b4200 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f301400c730 tx=0x7f301400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3025600640 1 -- 172.21.15.59:0/3641245096 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014017070 con 0x7f30280ced60 2024-04-25T09:04:37.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3025600640 1 -- 172.21.15.59:0/3641245096 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3014005ae0 con 0x7f30280ced60 2024-04-25T09:04:37.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3025600640 1 -- 172.21.15.59:0/3641245096 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3014007070 con 0x7f30280ced60 2024-04-25T09:04:37.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3030000640 1 -- 172.21.15.59:0/3641245096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3028167360 con 0x7f30280ced60 2024-04-25T09:04:37.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3030000640 1 -- 172.21.15.59:0/3641245096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3028167920 con 0x7f30280ced60 2024-04-25T09:04:37.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3030000640 1 -- 172.21.15.59:0/3641245096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30280745d0 con 0x7f30280ced60 2024-04-25T09:04:37.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.526+0000 7f3025600640 1 -- 172.21.15.59:0/3641245096 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f301401a070 con 0x7f30280ced60 2024-04-25T09:04:37.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.530+0000 7f3025600640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3008066f60 0x7f3008069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.530+0000 7f3025600640 1 -- 172.21.15.59:0/3641245096 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3014084670 con 0x7f30280ced60 2024-04-25T09:04:37.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.530+0000 7f302d600640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3008066f60 0x7f3008069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.530+0000 7f302d600640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3008066f60 0x7f3008069420 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f301c0ae000 tx=0x7f301c0a6070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.534+0000 7f3025600640 1 -- 172.21.15.59:0/3641245096 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3014054e90 con 0x7f30280ced60 2024-04-25T09:04:37.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.698+0000 7f3030000640 1 -- 172.21.15.59:0/3641245096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30280cdaa0 con 0x7f30280ced60 2024-04-25T09:04:37.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3025600640 1 -- 172.21.15.59:0/3641245096 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16897 (secure 0 0 0) 0x7f3014058f30 con 0x7f30280ced60 2024-04-25T09:04:37.693 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:37.693 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":65,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:04:36.727326+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:35.130789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:35.714100+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:37.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3030000640 1 -- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3008066f60 msgr2=0x7f3008069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3030000640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3008066f60 0x7f3008069420 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f301c0ae000 tx=0x7f301c0a6070 comp rx=0 tx=0).stop 2024-04-25T09:04:37.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3030000640 1 -- 172.21.15.59:0/3641245096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30280ced60 msgr2=0x7f30280b4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3030000640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30280ced60 0x7f30280b4200 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f301400c730 tx=0x7f301400cbf0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3030000640 1 -- 172.21.15.59:0/3641245096 shutdown_connections 2024-04-25T09:04:37.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3030000640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3008066f60 0x7f3008069420 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3030000640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3028144140 0x7f30280b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3030000640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30280ced60 0x7f30280b4200 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3030000640 1 --2- 172.21.15.59:0/3641245096 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f302806ead0 0x7f302813a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3030000640 1 -- 172.21.15.59:0/3641245096 >> 172.21.15.59:0/3641245096 conn(0x7f3028066fa0 msgr2=0x7f302815c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3030000640 1 -- 172.21.15.59:0/3641245096 shutdown_connections 2024-04-25T09:04:37.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.702+0000 7f3030000640 1 -- 172.21.15.59:0/3641245096 wait complete. 2024-04-25T09:04:37.714 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:37.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-25T09:04:37.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.862+0000 7f6820800640 1 Processor -- start 2024-04-25T09:04:37.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.862+0000 7f6820800640 1 -- start start 2024-04-25T09:04:37.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.862+0000 7f6820800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6818144140 0x7f68180ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.862+0000 7f6820800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f681815ac60 con 0x7f681806ead0 2024-04-25T09:04:37.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.862+0000 7f6820800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68180cf3e0 con 0x7f68180ced60 2024-04-25T09:04:37.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.862+0000 7f6820800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681815af20 con 0x7f6818144140 2024-04-25T09:04:37.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.862+0000 7f681e800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f681806ead0 0x7f68180b0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:41490/0 (socket says 172.21.15.59:41490) 2024-04-25T09:04:37.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.862+0000 7f681e800640 1 -- 172.21.15.59:0/1785115600 learned_addr learned my addr 172.21.15.59:0/1785115600 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:37.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.862+0000 7f681de00640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6818144140 0x7f68180ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.862+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2991150626 0 0) 0x7f681815ac60 con 0x7f681806ead0 2024-04-25T09:04:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.862+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6800005740 con 0x7f681806ead0 2024-04-25T09:04:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916386718 0 0) 0x7f68180cf3e0 con 0x7f68180ced60 2024-04-25T09:04:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f681815ac60 con 0x7f68180ced60 2024-04-25T09:04:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1906374265 0 0) 0x7f6800005740 con 0x7f681806ead0 2024-04-25T09:04:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6818144140 msgr2=0x7f68180ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6818144140 0x7f68180ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 >> v1:172.21.15.178:6789/0 conn(0x7f68180ced60 legacy=0x7f681806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681815b200 con 0x7f681806ead0 2024-04-25T09:04:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f6814001a00 con 0x7f681806ead0 2024-04-25T09:04:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 >> v1:172.21.15.59:6789/0 conn(0x7f681806ead0 legacy=0x7f68180b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6800005d90 0x7f6800006190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6818144140 0x7f6800006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6800006f60 0x7f68000073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f681815af20 con 0x7f6800006f60 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680000dc90 con 0x7f6800005d90 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680000de90 con 0x7f6818144140 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681e800640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6800006f60 0x7f68000073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681d400640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6818144140 0x7f6800006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681de00640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6800005d90 0x7f6800006190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681e800640 1 -- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6818144140 msgr2=0x7f6800006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681e800640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6818144140 0x7f6800006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681e800640 1 -- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6800005d90 msgr2=0x7f6800006190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681e800640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6800005d90 0x7f6800006190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681e800640 1 -- 172.21.15.59:0/1785115600 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6800005740 con 0x7f6800006f60 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681de00640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6800005d90 0x7f6800006190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:37.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.866+0000 7f681d400640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6818144140 0x7f6800006a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:37.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f681e800640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6800006f60 0x7f68000073e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f68180cc540 tx=0x7f681401f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818feb5b190be9bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681400a350 con 0x7f6800006f60 2024-04-25T09:04:37.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68140b1070 con 0x7f6800006f60 2024-04-25T09:04:37.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f681ca00640 1 -- 172.21.15.59:0/1785115600 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68140ac850 con 0x7f6800006f60 2024-04-25T09:04:37.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 -- 172.21.15.59:0/1785115600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6800006f60 msgr2=0x7f68000073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 --2- 172.21.15.59:0/1785115600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6800006f60 0x7f68000073e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f68180cc540 tx=0x7f681401f940 comp rx=0 tx=0).stop 2024-04-25T09:04:37.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f681e800640 1 -- 172.21.15.59:0/1785115600 reap_dead start 2024-04-25T09:04:37.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 -- 172.21.15.59:0/1785115600 shutdown_connections 2024-04-25T09:04:37.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 -- 172.21.15.59:0/1785115600 >> 172.21.15.59:0/1785115600 conn(0x7f6818066fa0 msgr2=0x7f681806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:37.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 -- 172.21.15.59:0/1785115600 shutdown_connections 2024-04-25T09:04:37.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 -- 172.21.15.59:0/1785115600 wait complete. 2024-04-25T09:04:37.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 Processor -- start 2024-04-25T09:04:37.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 -- start start 2024-04-25T09:04:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6800006f60 0x7f6818151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68180c8e80 0x7f68181f3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f681815c080 0x7f681815c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6818144520 con 0x7f68180c8e80 2024-04-25T09:04:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68180b1f30 con 0x7f6800006f60 2024-04-25T09:04:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.870+0000 7f6820800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681815ba00 con 0x7f681815c080 2024-04-25T09:04:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f681d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68180c8e80 0x7f68181f3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f681d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68180c8e80 0x7f68181f3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53080/0 (socket says 172.21.15.59:53080) 2024-04-25T09:04:37.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f681d400640 1 -- 172.21.15.59:0/1775032868 learned_addr learned my addr 172.21.15.59:0/1775032868 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f681e800640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f681815c080 0x7f681815c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f681de00640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6800006f60 0x7f6818151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f681d400640 1 -- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f681815c080 msgr2=0x7f681815c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f681d400640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f681815c080 0x7f681815c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f681d400640 1 -- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6800006f60 msgr2=0x7f6818151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f681d400640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6800006f60 0x7f6818151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f681d400640 1 -- 172.21.15.59:0/1775032868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6818130550 con 0x7f68180c8e80 2024-04-25T09:04:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f681d400640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68180c8e80 0x7f68181f3030 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f680800fb10 tx=0x7f680800ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f6812000640 1 -- 172.21.15.59:0/1775032868 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080052e0 con 0x7f68180c8e80 2024-04-25T09:04:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f6812000640 1 -- 172.21.15.59:0/1775032868 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808018070 con 0x7f68180c8e80 2024-04-25T09:04:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f6812000640 1 -- 172.21.15.59:0/1775032868 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808005480 con 0x7f68180c8e80 2024-04-25T09:04:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f6820800640 1 -- 172.21.15.59:0/1775032868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6818130830 con 0x7f68180c8e80 2024-04-25T09:04:37.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f6820800640 1 -- 172.21.15.59:0/1775032868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6818130df0 con 0x7f68180c8e80 2024-04-25T09:04:37.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f6820800640 1 -- 172.21.15.59:0/1775032868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68180745d0 con 0x7f68180c8e80 2024-04-25T09:04:37.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.874+0000 7f6812000640 1 -- 172.21.15.59:0/1775032868 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f680800d970 con 0x7f68180c8e80 2024-04-25T09:04:37.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.878+0000 7f6812000640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f67fc066f60 0x7f67fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:37.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.878+0000 7f6812000640 1 -- 172.21.15.59:0/1775032868 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6808085220 con 0x7f68180c8e80 2024-04-25T09:04:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.878+0000 7f681de00640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f67fc066f60 0x7f67fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:37.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.878+0000 7f681de00640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f67fc066f60 0x7f67fc069420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f680c009d80 tx=0x7f680c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:37.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:37.882+0000 7f6812000640 1 -- 172.21.15.59:0/1775032868 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6808056090 con 0x7f68180c8e80 2024-04-25T09:04:38.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.046+0000 7f6820800640 1 -- 172.21.15.59:0/1775032868 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68181439c0 con 0x7f68180c8e80 2024-04-25T09:04:38.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.046+0000 7f6812000640 1 -- 172.21.15.59:0/1775032868 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16897 (secure 0 0 0) 0x7f6808055990 con 0x7f68180c8e80 2024-04-25T09:04:38.040 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:38.040 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":65,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:04:36.727326+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:35.130789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:35.714100+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:38.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.050+0000 7f6820800640 1 -- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f67fc066f60 msgr2=0x7f67fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.050+0000 7f6820800640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f67fc066f60 0x7f67fc069420 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f680c009d80 tx=0x7f680c009190 comp rx=0 tx=0).stop 2024-04-25T09:04:38.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.050+0000 7f6820800640 1 -- 172.21.15.59:0/1775032868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68180c8e80 msgr2=0x7f68181f3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.050+0000 7f6820800640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68180c8e80 0x7f68181f3030 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f680800fb10 tx=0x7f680800ff10 comp rx=0 tx=0).stop 2024-04-25T09:04:38.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.050+0000 7f6820800640 1 -- 172.21.15.59:0/1775032868 shutdown_connections 2024-04-25T09:04:38.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.050+0000 7f6820800640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f67fc066f60 0x7f67fc069420 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.050+0000 7f6820800640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f681815c080 0x7f681815c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.050+0000 7f6820800640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68180c8e80 0x7f68181f3030 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.050+0000 7f6820800640 1 --2- 172.21.15.59:0/1775032868 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6800006f60 0x7f6818151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.050+0000 7f6820800640 1 -- 172.21.15.59:0/1775032868 >> 172.21.15.59:0/1775032868 conn(0x7f6818066fa0 msgr2=0x7f68180cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:38.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.050+0000 7f6820800640 1 -- 172.21.15.59:0/1775032868 shutdown_connections 2024-04-25T09:04:38.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.050+0000 7f6820800640 1 -- 172.21.15.59:0/1775032868 wait complete. 2024-04-25T09:04:38.062 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:04:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f8875800640 1 Processor -- start 2024-04-25T09:04:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f8875800640 1 -- start start 2024-04-25T09:04:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f8875800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f88701433e0 0x7f887006d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f8875800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f887006d6b0 0x7f88700b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f8875800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88700b4290 0x7f887015e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f8875800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887006db10 con 0x7f88700b4290 2024-04-25T09:04:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f8875800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88701437c0 con 0x7f88701433e0 2024-04-25T09:04:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f8875800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88700710e0 con 0x7f887006d6b0 2024-04-25T09:04:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f8874e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88700b4290 0x7f887015e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f8874e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88700b4290 0x7f887015e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53092/0 (socket says 172.21.15.59:53092) 2024-04-25T09:04:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f8874e00640 1 -- 172.21.15.59:0/3371161286 learned_addr learned my addr 172.21.15.59:0/3371161286 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f886fe00640 1 --2- 172.21.15.59:0/3371161286 >> v2:172.21.15.178:3300/0 conn(0x7f88701433e0 0x7f887006d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.214+0000 7f8867e00640 1 --2- 172.21.15.59:0/3371161286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f887006d6b0 0x7f88700b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8874e00640 1 -- 172.21.15.59:0/3371161286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f887006d6b0 msgr2=0x7f88700b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:38.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8874e00640 1 --2- 172.21.15.59:0/3371161286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f887006d6b0 0x7f88700b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8874e00640 1 -- 172.21.15.59:0/3371161286 >> v2:172.21.15.178:3300/0 conn(0x7f88701433e0 msgr2=0x7f887006d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:38.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8874e00640 1 --2- 172.21.15.59:0/3371161286 >> v2:172.21.15.178:3300/0 conn(0x7f88701433e0 0x7f887006d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8874e00640 1 -- 172.21.15.59:0/3371161286 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88700713c0 con 0x7f88700b4290 2024-04-25T09:04:38.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f886fe00640 1 --2- 172.21.15.59:0/3371161286 >> v2:172.21.15.178:3300/0 conn(0x7f88701433e0 0x7f887006d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:38.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8874e00640 1 --2- 172.21.15.59:0/3371161286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88700b4290 0x7f887015e2e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f887006f240 tx=0x7f886801e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ad0ed708a1b9ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:38.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f886f400640 1 -- 172.21.15.59:0/3371161286 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886800b2d0 con 0x7f88700b4290 2024-04-25T09:04:38.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f886f400640 1 -- 172.21.15.59:0/3371161286 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886800b470 con 0x7f88700b4290 2024-04-25T09:04:38.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f886f400640 1 -- 172.21.15.59:0/3371161286 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88680a79b0 con 0x7f88700b4290 2024-04-25T09:04:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8875800640 1 -- 172.21.15.59:0/3371161286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88700b4290 msgr2=0x7f887015e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8875800640 1 --2- 172.21.15.59:0/3371161286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88700b4290 0x7f887015e2e0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f887006f240 tx=0x7f886801e900 comp rx=0 tx=0).stop 2024-04-25T09:04:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8875800640 1 -- 172.21.15.59:0/3371161286 shutdown_connections 2024-04-25T09:04:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8875800640 1 --2- 172.21.15.59:0/3371161286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88700b4290 0x7f887015e2e0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8875800640 1 --2- 172.21.15.59:0/3371161286 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f887006d6b0 0x7f88700b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8875800640 1 --2- 172.21.15.59:0/3371161286 >> v2:172.21.15.178:3300/0 conn(0x7f88701433e0 0x7f887006d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.218+0000 7f8875800640 1 -- 172.21.15.59:0/3371161286 >> 172.21.15.59:0/3371161286 conn(0x7f8870066fa0 msgr2=0x7f887006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:38.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8875800640 1 -- 172.21.15.59:0/3371161286 shutdown_connections 2024-04-25T09:04:38.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8875800640 1 -- 172.21.15.59:0/3371161286 wait complete. 2024-04-25T09:04:38.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8875800640 1 Processor -- start 2024-04-25T09:04:38.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8875800640 1 -- start start 2024-04-25T09:04:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8875800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f887006d6b0 0x7f88701fab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8875800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88700b4290 0x7f887015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8875800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88701433e0 0x7f8870163a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8875800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870072180 con 0x7f88700b4290 2024-04-25T09:04:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8875800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88700b4720 con 0x7f887006d6b0 2024-04-25T09:04:38.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8875800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887014ad50 con 0x7f88701433e0 2024-04-25T09:04:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8867e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88700b4290 0x7f887015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8867e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88700b4290 0x7f887015d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53108/0 (socket says 172.21.15.59:53108) 2024-04-25T09:04:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8867e00640 1 -- 172.21.15.59:0/3186232317 learned_addr learned my addr 172.21.15.59:0/3186232317 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f886fe00640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f887006d6b0 0x7f88701fab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8874e00640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88701433e0 0x7f8870163a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8867e00640 1 -- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88701433e0 msgr2=0x7f8870163a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8867e00640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88701433e0 0x7f8870163a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8867e00640 1 -- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f887006d6b0 msgr2=0x7f88701fab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8867e00640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f887006d6b0 0x7f88701fab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8867e00640 1 -- 172.21.15.59:0/3186232317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887013f340 con 0x7f88700b4290 2024-04-25T09:04:38.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f886fe00640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f887006d6b0 0x7f88701fab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f8867e00640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88700b4290 0x7f887015d6e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f885800d830 tx=0x7f885800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.222+0000 7f886cc00640 1 -- 172.21.15.59:0/3186232317 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8858018030 con 0x7f88700b4290 2024-04-25T09:04:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.226+0000 7f886cc00640 1 -- 172.21.15.59:0/3186232317 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885800be10 con 0x7f88700b4290 2024-04-25T09:04:38.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.226+0000 7f8875800640 1 -- 172.21.15.59:0/3186232317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887013f8c0 con 0x7f88700b4290 2024-04-25T09:04:38.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.226+0000 7f886cc00640 1 -- 172.21.15.59:0/3186232317 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88580098b0 con 0x7f88700b4290 2024-04-25T09:04:38.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.226+0000 7f8875800640 1 -- 172.21.15.59:0/3186232317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887015ba50 con 0x7f88700b4290 2024-04-25T09:04:38.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.226+0000 7f8875800640 1 -- 172.21.15.59:0/3186232317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88700745d0 con 0x7f88700b4290 2024-04-25T09:04:38.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.226+0000 7f886cc00640 1 -- 172.21.15.59:0/3186232317 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f885801b070 con 0x7f88700b4290 2024-04-25T09:04:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.226+0000 7f886cc00640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f884c066f60 0x7f884c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.226+0000 7f886cc00640 1 -- 172.21.15.59:0/3186232317 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f88580852e0 con 0x7f88700b4290 2024-04-25T09:04:38.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.226+0000 7f886fe00640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f884c066f60 0x7f884c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:38.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.230+0000 7f886fe00640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f884c066f60 0x7f884c069420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f88701fa070 tx=0x7f8860008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.230+0000 7f886cc00640 1 -- 172.21.15.59:0/3186232317 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8858056160 con 0x7f88700b4290 2024-04-25T09:04:38.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:38.438+0000 7f8875800640 1 -- 172.21.15.59:0/3186232317 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f887015e050 con 0x7f88700b4290 2024-04-25T09:04:39.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.342+0000 7f886cc00640 1 -- 172.21.15.59:0/3186232317 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8858085100 con 0x7f88700b4290 2024-04-25T09:04:39.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.346+0000 7f8875800640 1 -- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f884c066f60 msgr2=0x7f884c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.346+0000 7f8875800640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f884c066f60 0x7f884c069420 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f88701fa070 tx=0x7f8860008040 comp rx=0 tx=0).stop 2024-04-25T09:04:39.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.346+0000 7f8875800640 1 -- 172.21.15.59:0/3186232317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88700b4290 msgr2=0x7f887015d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.346+0000 7f8875800640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88700b4290 0x7f887015d6e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f885800d830 tx=0x7f885800dcf0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.346+0000 7f8875800640 1 -- 172.21.15.59:0/3186232317 shutdown_connections 2024-04-25T09:04:39.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.346+0000 7f8875800640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f884c066f60 0x7f884c069420 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.346+0000 7f8875800640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88701433e0 0x7f8870163a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.346+0000 7f8875800640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88700b4290 0x7f887015d6e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.346+0000 7f8875800640 1 --2- 172.21.15.59:0/3186232317 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f887006d6b0 0x7f88701fab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.346+0000 7f8875800640 1 -- 172.21.15.59:0/3186232317 >> 172.21.15.59:0/3186232317 conn(0x7f8870066fa0 msgr2=0x7f88700ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:39.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.346+0000 7f8875800640 1 -- 172.21.15.59:0/3186232317 shutdown_connections 2024-04-25T09:04:39.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.346+0000 7f8875800640 1 -- 172.21.15.59:0/3186232317 wait complete. 2024-04-25T09:04:39.362 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:04:39.362 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:04:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.518+0000 7f3d46600640 1 Processor -- start 2024-04-25T09:04:39.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.518+0000 7f3d46600640 1 -- start start 2024-04-25T09:04:39.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d46600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d4006c730 0x7f3d4015ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d46600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d4006cb10 0x7f3d40161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d46600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d4015ef90 con 0x7f3d40161ad0 2024-04-25T09:04:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d46600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d4009a9e0 con 0x7f3d4006cb10 2024-04-25T09:04:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d46600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4009ae70 con 0x7f3d4006c730 2024-04-25T09:04:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d37e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d4006cb10 0x7f3d40161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d37e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d4006cb10 0x7f3d40161590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53120/0 (socket says 172.21.15.59:53120) 2024-04-25T09:04:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d37e00640 1 -- 172.21.15.59:0/1120204179 learned_addr learned my addr 172.21.15.59:0/1120204179 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d45200640 1 --2- 172.21.15.59:0/1120204179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d4006c730 0x7f3d4015ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d37e00640 1 -- 172.21.15.59:0/1120204179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d4006c730 msgr2=0x7f3d4015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d37e00640 1 --2- 172.21.15.59:0/1120204179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d4006c730 0x7f3d4015ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d37e00640 1 -- 172.21.15.59:0/1120204179 >> v1:172.21.15.178:6789/0 conn(0x7f3d40161ad0 legacy=0x7f3d400cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d37e00640 1 -- 172.21.15.59:0/1120204179 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40099dd0 con 0x7f3d4006cb10 2024-04-25T09:04:39.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.522+0000 7f3d37e00640 1 --2- 172.21.15.59:0/1120204179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4006cb10 0x7f3d40161590 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009870 tx=0x7f3d2801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ece8da5da31a7b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d3fe00640 1 -- 172.21.15.59:0/1120204179 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d280a95f0 con 0x7f3d4006cb10 2024-04-25T09:04:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d3fe00640 1 -- 172.21.15.59:0/1120204179 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d280a9790 con 0x7f3d4006cb10 2024-04-25T09:04:39.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d3fe00640 1 -- 172.21.15.59:0/1120204179 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d280a9b60 con 0x7f3d4006cb10 2024-04-25T09:04:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 -- 172.21.15.59:0/1120204179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4006cb10 msgr2=0x7f3d40161590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 --2- 172.21.15.59:0/1120204179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4006cb10 0x7f3d40161590 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f3d28009870 tx=0x7f3d2801c530 comp rx=0 tx=0).stop 2024-04-25T09:04:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 -- 172.21.15.59:0/1120204179 shutdown_connections 2024-04-25T09:04:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 --2- 172.21.15.59:0/1120204179 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4006cb10 0x7f3d40161590 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 --2- 172.21.15.59:0/1120204179 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d4006c730 0x7f3d4015ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 -- 172.21.15.59:0/1120204179 >> 172.21.15.59:0/1120204179 conn(0x7f3d400b3030 msgr2=0x7f3d400b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 -- 172.21.15.59:0/1120204179 shutdown_connections 2024-04-25T09:04:39.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 -- 172.21.15.59:0/1120204179 wait complete. 2024-04-25T09:04:39.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 Processor -- start 2024-04-25T09:04:39.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 -- start start 2024-04-25T09:04:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4006c730 0x7f3d40156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d4006cb10 0x7f3d40157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d40161ad0 0x7f3d401f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d401622f0 con 0x7f3d4006c730 2024-04-25T09:04:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4015de20 con 0x7f3d40161ad0 2024-04-25T09:04:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d46600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d40099a60 con 0x7f3d4006cb10 2024-04-25T09:04:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d45200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4006c730 0x7f3d40156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d45200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4006c730 0x7f3d40156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53130/0 (socket says 172.21.15.59:53130) 2024-04-25T09:04:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d45200640 1 -- 172.21.15.59:0/185342950 learned_addr learned my addr 172.21.15.59:0/185342950 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d45c00640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d40161ad0 0x7f3d401f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.526+0000 7f3d37e00640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d4006cb10 0x7f3d40157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d45200640 1 -- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d4006cb10 msgr2=0x7f3d40157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d45200640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d4006cb10 0x7f3d40157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d45200640 1 -- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d40161ad0 msgr2=0x7f3d401f6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d45200640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d40161ad0 0x7f3d401f6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d45200640 1 -- 172.21.15.59:0/185342950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40156ff0 con 0x7f3d4006c730 2024-04-25T09:04:39.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d45200640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4006c730 0x7f3d40156ab0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000e870 tx=0x7f3d3000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d3d600640 1 -- 172.21.15.59:0/185342950 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d30017070 con 0x7f3d4006c730 2024-04-25T09:04:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d3d600640 1 -- 172.21.15.59:0/185342950 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3000c940 con 0x7f3d4006c730 2024-04-25T09:04:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d46600640 1 -- 172.21.15.59:0/185342950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d401583b0 con 0x7f3d4006c730 2024-04-25T09:04:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d3d600640 1 -- 172.21.15.59:0/185342950 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3000ccf0 con 0x7f3d4006c730 2024-04-25T09:04:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d46600640 1 -- 172.21.15.59:0/185342950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d400b61f0 con 0x7f3d4006c730 2024-04-25T09:04:39.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d46600640 1 -- 172.21.15.59:0/185342950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d400b5d40 con 0x7f3d4006c730 2024-04-25T09:04:39.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.530+0000 7f3d3d600640 1 -- 172.21.15.59:0/185342950 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3d3001a070 con 0x7f3d4006c730 2024-04-25T09:04:39.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.534+0000 7f3d3d600640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d1c066f60 0x7f3d1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:39.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.534+0000 7f3d3d600640 1 -- 172.21.15.59:0/185342950 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f3d30084fa0 con 0x7f3d4006c730 2024-04-25T09:04:39.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.534+0000 7f3d37e00640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d1c066f60 0x7f3d1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:39.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.534+0000 7f3d37e00640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d1c066f60 0x7f3d1c069420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3d280ae000 tx=0x7f3d280b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.538+0000 7f3d3d600640 1 -- 172.21.15.59:0/185342950 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3d401583b0 con 0x7f3d4006c730 2024-04-25T09:04:39.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:39.734+0000 7f3d46600640 1 -- 172.21.15.59:0/185342950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3d400745d0 con 0x7f3d4006c730 2024-04-25T09:04:40.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.350+0000 7f3d3d600640 1 -- 172.21.15.59:0/185342950 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d30055860 con 0x7f3d4006c730 2024-04-25T09:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.354+0000 7f3d46600640 1 -- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d1c066f60 msgr2=0x7f3d1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.354+0000 7f3d46600640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d1c066f60 0x7f3d1c069420 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3d280ae000 tx=0x7f3d280b3040 comp rx=0 tx=0).stop 2024-04-25T09:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.354+0000 7f3d46600640 1 -- 172.21.15.59:0/185342950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4006c730 msgr2=0x7f3d40156ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.354+0000 7f3d46600640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4006c730 0x7f3d40156ab0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3d3000e870 tx=0x7f3d3000ec70 comp rx=0 tx=0).stop 2024-04-25T09:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.354+0000 7f3d46600640 1 -- 172.21.15.59:0/185342950 shutdown_connections 2024-04-25T09:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.354+0000 7f3d46600640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d1c066f60 0x7f3d1c069420 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.354+0000 7f3d46600640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d40161ad0 0x7f3d401f6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.354+0000 7f3d46600640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d4006cb10 0x7f3d40157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.354+0000 7f3d46600640 1 --2- 172.21.15.59:0/185342950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d4006c730 0x7f3d40156ab0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.354+0000 7f3d46600640 1 -- 172.21.15.59:0/185342950 >> 172.21.15.59:0/185342950 conn(0x7f3d400b3030 msgr2=0x7f3d40070b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.354+0000 7f3d46600640 1 -- 172.21.15.59:0/185342950 shutdown_connections 2024-04-25T09:04:40.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.354+0000 7f3d46600640 1 -- 172.21.15.59:0/185342950 wait complete. 2024-04-25T09:04:40.367 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:04:40.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:40.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f6c00640 1 Processor -- start 2024-04-25T09:04:40.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f6c00640 1 -- start start 2024-04-25T09:04:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f6c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f85f015efa0 0x7f85f0099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f6c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f85f00cdb70 0x7f85f0099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f6c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f00cd6c0 con 0x7f85f00b04b0 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f6c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f00b3fe0 con 0x7f85f00cdb70 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f6c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f00cce20 con 0x7f85f015efa0 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f4e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f85f00cdb70 0x7f85f0099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f4e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f85f00cdb70 0x7f85f0099fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60570/0 (socket says 172.21.15.59:60570) 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f4e00640 1 -- 172.21.15.59:0/1779476669 learned_addr learned my addr 172.21.15.59:0/1779476669 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f5800640 1 --2- 172.21.15.59:0/1779476669 >> v2:172.21.15.178:3300/0 conn(0x7f85f015efa0 0x7f85f0099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f4e00640 1 -- 172.21.15.59:0/1779476669 >> v2:172.21.15.178:3300/0 conn(0x7f85f015efa0 msgr2=0x7f85f0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f4e00640 1 --2- 172.21.15.59:0/1779476669 >> v2:172.21.15.178:3300/0 conn(0x7f85f015efa0 0x7f85f0099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f4e00640 1 -- 172.21.15.59:0/1779476669 >> v1:172.21.15.178:6789/0 conn(0x7f85f00b04b0 legacy=0x7f85f00cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.522+0000 7f85f4e00640 1 -- 172.21.15.59:0/1779476669 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f00cd100 con 0x7f85f00cdb70 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85f4e00640 1 --2- 172.21.15.59:0/1779476669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f00cdb70 0x7f85f0099fa0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f85f006f090 tx=0x7f85dc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de1f3fc432b1ccb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85efe00640 1 -- 172.21.15.59:0/1779476669 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0b0070 con 0x7f85f00cdb70 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85efe00640 1 -- 172.21.15.59:0/1779476669 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc0ab600 con 0x7f85f00cdb70 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85efe00640 1 -- 172.21.15.59:0/1779476669 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0ab9d0 con 0x7f85f00cdb70 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85f6c00640 1 -- 172.21.15.59:0/1779476669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f00cdb70 msgr2=0x7f85f0099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85f6c00640 1 --2- 172.21.15.59:0/1779476669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f00cdb70 0x7f85f0099fa0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f85f006f090 tx=0x7f85dc01c520 comp rx=0 tx=0).stop 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85f6c00640 1 -- 172.21.15.59:0/1779476669 shutdown_connections 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85f6c00640 1 --2- 172.21.15.59:0/1779476669 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f00cdb70 0x7f85f0099fa0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85f6c00640 1 --2- 172.21.15.59:0/1779476669 >> v2:172.21.15.178:3300/0 conn(0x7f85f015efa0 0x7f85f0099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85f6c00640 1 -- 172.21.15.59:0/1779476669 >> 172.21.15.59:0/1779476669 conn(0x7f85f00b3050 msgr2=0x7f85f00b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85f6c00640 1 -- 172.21.15.59:0/1779476669 shutdown_connections 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85f6c00640 1 -- 172.21.15.59:0/1779476669 wait complete. 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85f6c00640 1 Processor -- start 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.526+0000 7f85f6c00640 1 -- start start 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f6c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f00b04b0 0x7f85f00c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f6c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85f00cdb70 0x7f85f0153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f6c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85f015efa0 0x7f85f0154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f6c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f0168820 con 0x7f85f00b04b0 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f6c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f01686a0 con 0x7f85f00cdb70 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f6c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f01689a0 con 0x7f85f015efa0 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f00b04b0 0x7f85f00c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f00b04b0 0x7f85f00c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60586/0 (socket says 172.21.15.59:60586) 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f5800640 1 -- 172.21.15.59:0/514998764 learned_addr learned my addr 172.21.15.59:0/514998764 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f4e00640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85f00cdb70 0x7f85f0153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f6200640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85f015efa0 0x7f85f0154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f5800640 1 -- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85f015efa0 msgr2=0x7f85f0154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f5800640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85f015efa0 0x7f85f0154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f5800640 1 -- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85f00cdb70 msgr2=0x7f85f0153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f5800640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85f00cdb70 0x7f85f0153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f5800640 1 -- 172.21.15.59:0/514998764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f00c6180 con 0x7f85f00b04b0 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f6200640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85f015efa0 0x7f85f0154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:40.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f5800640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f00b04b0 0x7f85f00c8630 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f85e400d800 tx=0x7f85e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85ed600640 1 -- 172.21.15.59:0/514998764 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e400b6c0 con 0x7f85f00b04b0 2024-04-25T09:04:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85ed600640 1 -- 172.21.15.59:0/514998764 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e4019070 con 0x7f85f00b04b0 2024-04-25T09:04:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f6c00640 1 -- 172.21.15.59:0/514998764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f00c6460 con 0x7f85f00b04b0 2024-04-25T09:04:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85ed600640 1 -- 172.21.15.59:0/514998764 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e400bae0 con 0x7f85f00b04b0 2024-04-25T09:04:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f6c00640 1 -- 172.21.15.59:0/514998764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f00c6a20 con 0x7f85f00b04b0 2024-04-25T09:04:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.530+0000 7f85f6c00640 1 -- 172.21.15.59:0/514998764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f004efa0 con 0x7f85f00b04b0 2024-04-25T09:04:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.534+0000 7f85ed600640 1 -- 172.21.15.59:0/514998764 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f85e400bc80 con 0x7f85f00b04b0 2024-04-25T09:04:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.534+0000 7f85ed600640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f85d0066f60 0x7f85d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.534+0000 7f85ed600640 1 -- 172.21.15.59:0/514998764 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f85e4085720 con 0x7f85f00b04b0 2024-04-25T09:04:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.534+0000 7f85f4e00640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f85d0066f60 0x7f85d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.534+0000 7f85f4e00640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f85d0066f60 0x7f85d0069420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0ad000 tx=0x7f85dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.538+0000 7f85ed600640 1 -- 172.21.15.59:0/514998764 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f85e4056500 con 0x7f85f00b04b0 2024-04-25T09:04:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.730+0000 7f85f6c00640 1 -- 172.21.15.59:0/514998764 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85f006e1e0 con 0x7f85f00b04b0 2024-04-25T09:04:40.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85ed600640 1 -- 172.21.15.59:0/514998764 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4936 (secure 0 0 0) 0x7f85e4055e00 con 0x7f85f00b04b0 2024-04-25T09:04:40.725 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:40.725 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2580922028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2580922028},{"type":"v1","addr":"172.21.15.178:6837","nonce":2580922028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/126805970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":126805970},{"type":"v1","addr":"172.21.15.178:6836","nonce":126805970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/402319604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":402319604},{"type":"v1","addr":"172.21.15.59:6833","nonce":402319604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:36.727681+0000","modified":"2024-04-25T09:04:39.739856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/686404516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":686404516},{"type":"v1","addr":"172.21.15.59:6835","nonce":686404516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:04:40.725 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 38 2024-04-25T09:04:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85f6c00640 1 -- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f85d0066f60 msgr2=0x7f85d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85f6c00640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f85d0066f60 0x7f85d0069420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0ad000 tx=0x7f85dc008040 comp rx=0 tx=0).stop 2024-04-25T09:04:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85f6c00640 1 -- 172.21.15.59:0/514998764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f00b04b0 msgr2=0x7f85f00c8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85f6c00640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f00b04b0 0x7f85f00c8630 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f85e400d800 tx=0x7f85e400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85f6c00640 1 -- 172.21.15.59:0/514998764 shutdown_connections 2024-04-25T09:04:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85f6c00640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f85d0066f60 0x7f85d0069420 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85f6c00640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f85f015efa0 0x7f85f0154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85f6c00640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f85f00cdb70 0x7f85f0153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85f6c00640 1 --2- 172.21.15.59:0/514998764 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f00b04b0 0x7f85f00c8630 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85f6c00640 1 -- 172.21.15.59:0/514998764 >> 172.21.15.59:0/514998764 conn(0x7f85f00b3050 msgr2=0x7f85f00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:40.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85f6c00640 1 -- 172.21.15.59:0/514998764 shutdown_connections 2024-04-25T09:04:40.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.734+0000 7f85f6c00640 1 -- 172.21.15.59:0/514998764 wait complete. 2024-04-25T09:04:40.746 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:04:40.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.894+0000 7fa420e00640 1 Processor -- start 2024-04-25T09:04:40.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.894+0000 7fa420e00640 1 -- start start 2024-04-25T09:04:40.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.894+0000 7fa420e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa41c0b1e60 0x7fa41c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.894+0000 7fa420e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41c0cc4e0 con 0x7fa41c15fe50 2024-04-25T09:04:40.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.894+0000 7fa420e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41c0ce040 con 0x7fa41c145270 2024-04-25T09:04:40.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.894+0000 7fa420e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c145650 con 0x7fa41c0b1e60 2024-04-25T09:04:40.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.894+0000 7fa41a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa41c0b1e60 0x7fa41c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.894+0000 7fa411400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa41c15fe50 0x7fa41c0b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33864/0 (socket says 172.21.15.59:33864) 2024-04-25T09:04:40.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.894+0000 7fa411400640 1 -- 172.21.15.59:0/845804902 learned_addr learned my addr 172.21.15.59:0/845804902 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:40.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.898+0000 7fa41a800640 1 -- 172.21.15.59:0/845804902 >> v1:172.21.15.178:6789/0 conn(0x7fa41c145270 legacy=0x7fa41c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.898+0000 7fa41a800640 1 -- 172.21.15.59:0/845804902 >> v1:172.21.15.59:6789/0 conn(0x7fa41c15fe50 legacy=0x7fa41c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.898+0000 7fa41a800640 1 -- 172.21.15.59:0/845804902 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c0ce320 con 0x7fa41c0b1e60 2024-04-25T09:04:40.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.898+0000 7fa41a800640 1 --2- 172.21.15.59:0/845804902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa41c0b1e60 0x7fa41c15bd80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa4140097c0 tx=0x7fa41401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6ca605865e3277 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.898+0000 7fa419400640 1 -- 172.21.15.59:0/845804902 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4140b1070 con 0x7fa41c0b1e60 2024-04-25T09:04:40.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.898+0000 7fa419400640 1 -- 172.21.15.59:0/845804902 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4140ac5f0 con 0x7fa41c0b1e60 2024-04-25T09:04:40.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.898+0000 7fa419400640 1 -- 172.21.15.59:0/845804902 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4140ac9c0 con 0x7fa41c0b1e60 2024-04-25T09:04:40.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.898+0000 7fa420e00640 1 -- 172.21.15.59:0/845804902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa41c0b1e60 msgr2=0x7fa41c15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.898+0000 7fa420e00640 1 --2- 172.21.15.59:0/845804902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa41c0b1e60 0x7fa41c15bd80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fa4140097c0 tx=0x7fa41401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.898+0000 7fa420e00640 1 -- 172.21.15.59:0/845804902 shutdown_connections 2024-04-25T09:04:40.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.898+0000 7fa420e00640 1 --2- 172.21.15.59:0/845804902 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa41c0b1e60 0x7fa41c15bd80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.898+0000 7fa420e00640 1 -- 172.21.15.59:0/845804902 >> 172.21.15.59:0/845804902 conn(0x7fa41c066fa0 msgr2=0x7fa41c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:40.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa420e00640 1 -- 172.21.15.59:0/845804902 shutdown_connections 2024-04-25T09:04:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa420e00640 1 -- 172.21.15.59:0/845804902 wait complete. 2024-04-25T09:04:40.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa420e00640 1 Processor -- start 2024-04-25T09:04:40.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa420e00640 1 -- start start 2024-04-25T09:04:40.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa420e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa41c0b1e60 0x7fa41c0b0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa420e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa41c145270 0x7fa41c13f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa420e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa41c15fe50 0x7fa41c13d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa420e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0cdd60 con 0x7fa41c145270 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa420e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0cdbe0 con 0x7fa41c0b1e60 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa420e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c169720 con 0x7fa41c15fe50 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa411400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa41c145270 0x7fa41c13f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa411400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa41c145270 0x7fa41c13f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60604/0 (socket says 172.21.15.59:60604) 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa411400640 1 -- 172.21.15.59:0/4152793748 learned_addr learned my addr 172.21.15.59:0/4152793748 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa419e00640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa41c0b1e60 0x7fa41c0b0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa41a800640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa41c15fe50 0x7fa41c13d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa411400640 1 -- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa41c15fe50 msgr2=0x7fa41c13d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa411400640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa41c15fe50 0x7fa41c13d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa411400640 1 -- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa41c0b1e60 msgr2=0x7fa41c0b0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa411400640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa41c0b1e60 0x7fa41c0b0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa411400640 1 -- 172.21.15.59:0/4152793748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c14d810 con 0x7fa41c145270 2024-04-25T09:04:40.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa419e00640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa41c0b1e60 0x7fa41c0b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:40.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.902+0000 7fa411400640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa41c145270 0x7fa41c13f7c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa40400cbc0 tx=0x7fa40400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.906+0000 7fa412a00640 1 -- 172.21.15.59:0/4152793748 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404017070 con 0x7fa41c145270 2024-04-25T09:04:40.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.906+0000 7fa412a00640 1 -- 172.21.15.59:0/4152793748 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40400aca0 con 0x7fa41c145270 2024-04-25T09:04:40.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.906+0000 7fa412a00640 1 -- 172.21.15.59:0/4152793748 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa404012600 con 0x7fa41c145270 2024-04-25T09:04:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.906+0000 7fa420e00640 1 -- 172.21.15.59:0/4152793748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c13cdf0 con 0x7fa41c145270 2024-04-25T09:04:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.906+0000 7fa420e00640 1 -- 172.21.15.59:0/4152793748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c0b3e10 con 0x7fa41c145270 2024-04-25T09:04:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.906+0000 7fa420e00640 1 -- 172.21.15.59:0/4152793748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c0745d0 con 0x7fa41c145270 2024-04-25T09:04:40.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.906+0000 7fa412a00640 1 -- 172.21.15.59:0/4152793748 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa40401a070 con 0x7fa41c145270 2024-04-25T09:04:40.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.906+0000 7fa412a00640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa3f8066f60 0x7fa3f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:40.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.906+0000 7fa412a00640 1 -- 172.21.15.59:0/4152793748 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa404084da0 con 0x7fa41c145270 2024-04-25T09:04:40.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.906+0000 7fa419e00640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa3f8066f60 0x7fa3f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:40.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.910+0000 7fa419e00640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa3f8066f60 0x7fa3f8069420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa40c001710 tx=0x7fa40c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:40.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:40.910+0000 7fa412a00640 1 -- 172.21.15.59:0/4152793748 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa4040555c0 con 0x7fa41c145270 2024-04-25T09:04:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.070+0000 7fa420e00640 1 -- 172.21.15.59:0/4152793748 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa41c144aa0 con 0x7fa41c145270 2024-04-25T09:04:41.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa412a00640 1 -- 172.21.15.59:0/4152793748 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+16884 (secure 0 0 0) 0x7fa404059660 con 0x7fa41c145270 2024-04-25T09:04:41.065 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:41.065 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":66,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:04:38.322273+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:35.130789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:35.714100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:04:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa420e00640 1 -- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa3f8066f60 msgr2=0x7fa3f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa420e00640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa3f8066f60 0x7fa3f8069420 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa40c001710 tx=0x7fa40c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa420e00640 1 -- 172.21.15.59:0/4152793748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa41c145270 msgr2=0x7fa41c13f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa420e00640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa41c145270 0x7fa41c13f7c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa40400cbc0 tx=0x7fa40400a060 comp rx=0 tx=0).stop 2024-04-25T09:04:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa420e00640 1 -- 172.21.15.59:0/4152793748 shutdown_connections 2024-04-25T09:04:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa420e00640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa3f8066f60 0x7fa3f8069420 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa420e00640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa41c15fe50 0x7fa41c13d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa420e00640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa41c145270 0x7fa41c13f7c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa420e00640 1 --2- 172.21.15.59:0/4152793748 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa41c0b1e60 0x7fa41c0b0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa420e00640 1 -- 172.21.15.59:0/4152793748 >> 172.21.15.59:0/4152793748 conn(0x7fa41c066fa0 msgr2=0x7fa41c15d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa420e00640 1 -- 172.21.15.59:0/4152793748 shutdown_connections 2024-04-25T09:04:41.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.074+0000 7fa420e00640 1 -- 172.21.15.59:0/4152793748 wait complete. 2024-04-25T09:04:41.086 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:04:41.086 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:41.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.234+0000 7f8aff200640 1 Processor -- start 2024-04-25T09:04:41.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.234+0000 7f8aff200640 1 -- start start 2024-04-25T09:04:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.234+0000 7f8aff200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8af8145270 0x7f8af815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.234+0000 7f8aff200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80cd4d0 0x7f8af80cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.234+0000 7f8aff200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8af80b1750 0x7f8af80b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.234+0000 7f8aff200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af80b20e0 con 0x7f8af80b1750 2024-04-25T09:04:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.234+0000 7f8aff200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af8145650 con 0x7f8af8145270 2024-04-25T09:04:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.234+0000 7f8aff200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80cc4e0 con 0x7f8af80cd4d0 2024-04-25T09:04:41.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8afd200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8af80b1750 0x7f8af80b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8afd200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8af80b1750 0x7f8af80b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60620/0 (socket says 172.21.15.59:60620) 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8afd200640 1 -- 172.21.15.59:0/3215255801 learned_addr learned my addr 172.21.15.59:0/3215255801 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8af7e00640 1 --2- 172.21.15.59:0/3215255801 >> v2:172.21.15.178:3300/0 conn(0x7f8af8145270 0x7f8af815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8aefe00640 1 --2- 172.21.15.59:0/3215255801 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80cd4d0 0x7f8af80cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8afd200640 1 -- 172.21.15.59:0/3215255801 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80cd4d0 msgr2=0x7f8af80cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8afd200640 1 --2- 172.21.15.59:0/3215255801 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80cd4d0 0x7f8af80cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8afd200640 1 -- 172.21.15.59:0/3215255801 >> v2:172.21.15.178:3300/0 conn(0x7f8af8145270 msgr2=0x7f8af815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:41.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8afd200640 1 --2- 172.21.15.59:0/3215255801 >> v2:172.21.15.178:3300/0 conn(0x7f8af8145270 0x7f8af815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8afd200640 1 -- 172.21.15.59:0/3215255801 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af80ce040 con 0x7f8af80b1750 2024-04-25T09:04:41.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8afd200640 1 --2- 172.21.15.59:0/3215255801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af80b1750 0x7f8af80b1ba0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8af806f3a0 tx=0x7f8af001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd220425b3f7c63e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8af7400640 1 -- 172.21.15.59:0/3215255801 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00a5760 con 0x7f8af80b1750 2024-04-25T09:04:41.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8af7400640 1 -- 172.21.15.59:0/3215255801 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af00a5900 con 0x7f8af80b1750 2024-04-25T09:04:41.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.238+0000 7f8af7400640 1 -- 172.21.15.59:0/3215255801 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00a5cd0 con 0x7f8af80b1750 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 -- 172.21.15.59:0/3215255801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af80b1750 msgr2=0x7f8af80b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 --2- 172.21.15.59:0/3215255801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af80b1750 0x7f8af80b1ba0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f8af806f3a0 tx=0x7f8af001c9f0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 -- 172.21.15.59:0/3215255801 shutdown_connections 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 --2- 172.21.15.59:0/3215255801 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af80b1750 0x7f8af80b1ba0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 --2- 172.21.15.59:0/3215255801 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80cd4d0 0x7f8af80cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 --2- 172.21.15.59:0/3215255801 >> v2:172.21.15.178:3300/0 conn(0x7f8af8145270 0x7f8af815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 -- 172.21.15.59:0/3215255801 >> 172.21.15.59:0/3215255801 conn(0x7f8af8066fa0 msgr2=0x7f8af806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 -- 172.21.15.59:0/3215255801 shutdown_connections 2024-04-25T09:04:41.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 -- 172.21.15.59:0/3215255801 wait complete. 2024-04-25T09:04:41.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 Processor -- start 2024-04-25T09:04:41.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 -- start start 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80b1750 0x7f8af813dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80cd4d0 0x7f8af8142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 0x7f8af81442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af815c590 con 0x7f8af8145270 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af815f930 con 0x7f8af80b1750 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aff200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af815c710 con 0x7f8af80cd4d0 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8afd200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 0x7f8af81442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8afd200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 0x7f8af81442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60630/0 (socket says 172.21.15.59:60630) 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8afd200640 1 -- 172.21.15.59:0/402091989 learned_addr learned my addr 172.21.15.59:0/402091989 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8af7e00640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80b1750 0x7f8af813dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.242+0000 7f8aefe00640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80cd4d0 0x7f8af8142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8afd200640 1 -- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80cd4d0 msgr2=0x7f8af8142870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8afd200640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80cd4d0 0x7f8af8142870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8afd200640 1 -- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80b1750 msgr2=0x7f8af813dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8afd200640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80b1750 0x7f8af813dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8afd200640 1 -- 172.21.15.59:0/402091989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af8143250 con 0x7f8af8145270 2024-04-25T09:04:41.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8afd200640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 0x7f8af81442f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8af001b0a0 tx=0x7f8af0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8af4c00640 1 -- 172.21.15.59:0/402091989 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0009510 con 0x7f8af8145270 2024-04-25T09:04:41.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8af4c00640 1 -- 172.21.15.59:0/402091989 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af00be070 con 0x7f8af8145270 2024-04-25T09:04:41.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8af4c00640 1 -- 172.21.15.59:0/402091989 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00b8890 con 0x7f8af8145270 2024-04-25T09:04:41.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8aff200640 1 -- 172.21.15.59:0/402091989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af8143530 con 0x7f8af8145270 2024-04-25T09:04:41.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8aff200640 1 -- 172.21.15.59:0/402091989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af8143af0 con 0x7f8af8145270 2024-04-25T09:04:41.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8aff200640 1 -- 172.21.15.59:0/402091989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af80745d0 con 0x7f8af8145270 2024-04-25T09:04:41.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8af4c00640 1 -- 172.21.15.59:0/402091989 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8af00b8a30 con 0x7f8af8145270 2024-04-25T09:04:41.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8af4c00640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad4066f60 0x7f8ad4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8af4c00640 1 -- 172.21.15.59:0/402091989 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8af0120100 con 0x7f8af8145270 2024-04-25T09:04:41.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.246+0000 7f8af7e00640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad4066f60 0x7f8ad4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.250+0000 7f8af7e00640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad4066f60 0x7f8ad4069420 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8af80b16f0 tx=0x7f8ae8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.250+0000 7f8af4c00640 1 -- 172.21.15.59:0/402091989 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8af00c8020 con 0x7f8af8145270 2024-04-25T09:04:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.410+0000 7f8aff200640 1 -- 172.21.15.59:0/402091989 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8af8142040 con 0x7f8ad4066f60 2024-04-25T09:04:41.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8af4c00640 1 -- 172.21.15.59:0/402091989 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+248465 (secure 0 0 0) 0x7f8af8142040 con 0x7f8ad4066f60 2024-04-25T09:04:41.414 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:41.416 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:04:41.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8aff200640 1 -- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad4066f60 msgr2=0x7f8ad4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8aff200640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad4066f60 0x7f8ad4069420 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8af80b16f0 tx=0x7f8ae8009190 comp rx=0 tx=0).stop 2024-04-25T09:04:41.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8aff200640 1 -- 172.21.15.59:0/402091989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 msgr2=0x7f8af81442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8aff200640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 0x7f8af81442f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8af001b0a0 tx=0x7f8af0019790 comp rx=0 tx=0).stop 2024-04-25T09:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8aff200640 1 -- 172.21.15.59:0/402091989 shutdown_connections 2024-04-25T09:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8aff200640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad4066f60 0x7f8ad4069420 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8aff200640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 0x7f8af81442f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8aff200640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80cd4d0 0x7f8af8142870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8aff200640 1 --2- 172.21.15.59:0/402091989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80b1750 0x7f8af813dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8aff200640 1 -- 172.21.15.59:0/402091989 >> 172.21.15.59:0/402091989 conn(0x7f8af8066fa0 msgr2=0x7f8af806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8aff200640 1 -- 172.21.15.59:0/402091989 shutdown_connections 2024-04-25T09:04:41.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.422+0000 7f8aff200640 1 -- 172.21.15.59:0/402091989 wait complete. 2024-04-25T09:04:41.434 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2024-04-25T09:04:39.696016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":197,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":148,"acting":148,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":240152,"kb_used_data":7332,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754734568,"statfs":{"total":773094113280,"available":772848197632,"internally_reserved":0,"allocated":7507968,"data_stored":4012122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.381412"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538038+0000","last_change":"2024-04-25T09:04:37.358052+0000","last_active":"2024-04-25T09:04:39.538038+0000","last_peered":"2024-04-25T09:04:39.538038+0000","last_clean":"2024-04-25T09:04:39.538038+0000","last_became_active":"2024-04-25T09:04:37.357075+0000","last_became_peered":"2024-04-25T09:04:37.357075+0000","last_unstale":"2024-04-25T09:04:39.538038+0000","last_undegraded":"2024-04-25T09:04:39.538038+0000","last_fullsized":"2024-04-25T09:04:39.538038+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:02.628890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537667+0000","last_change":"2024-04-25T09:04:37.356178+0000","last_active":"2024-04-25T09:04:39.537667+0000","last_peered":"2024-04-25T09:04:39.537667+0000","last_clean":"2024-04-25T09:04:39.537667+0000","last_became_active":"2024-04-25T09:04:37.355878+0000","last_became_peered":"2024-04-25T09:04:37.355878+0000","last_unstale":"2024-04-25T09:04:39.537667+0000","last_undegraded":"2024-04-25T09:04:39.537667+0000","last_fullsized":"2024-04-25T09:04:39.537667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:37.746122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538500+0000","last_change":"2024-04-25T09:04:37.359184+0000","last_active":"2024-04-25T09:04:39.538500+0000","last_peered":"2024-04-25T09:04:39.538500+0000","last_clean":"2024-04-25T09:04:39.538500+0000","last_became_active":"2024-04-25T09:04:37.358908+0000","last_became_peered":"2024-04-25T09:04:37.358908+0000","last_unstale":"2024-04-25T09:04:39.538500+0000","last_undegraded":"2024-04-25T09:04:39.538500+0000","last_fullsized":"2024-04-25T09:04:39.538500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:45.691235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328869+0000","last_change":"2024-04-25T09:04:37.339697+0000","last_active":"2024-04-25T09:04:38.328869+0000","last_peered":"2024-04-25T09:04:38.328869+0000","last_clean":"2024-04-25T09:04:38.328869+0000","last_became_active":"2024-04-25T09:04:37.339374+0000","last_became_peered":"2024-04-25T09:04:37.339374+0000","last_unstale":"2024-04-25T09:04:38.328869+0000","last_undegraded":"2024-04-25T09:04:38.328869+0000","last_fullsized":"2024-04-25T09:04:38.328869+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:07.139628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990028+0000","last_change":"2024-04-25T09:04:37.357877+0000","last_active":"2024-04-25T09:04:38.990028+0000","last_peered":"2024-04-25T09:04:38.990028+0000","last_clean":"2024-04-25T09:04:38.990028+0000","last_became_active":"2024-04-25T09:04:37.357284+0000","last_became_peered":"2024-04-25T09:04:37.357284+0000","last_unstale":"2024-04-25T09:04:38.990028+0000","last_undegraded":"2024-04-25T09:04:38.990028+0000","last_fullsized":"2024-04-25T09:04:38.990028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:15.321716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:36.313588+0000","last_change":"2024-04-25T09:04:36.313588+0000","last_active":"2024-04-25T09:04:36.313588+0000","last_peered":"2024-04-25T09:04:36.313588+0000","last_clean":"2024-04-25T09:04:36.313588+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:36.313588+0000","last_undegraded":"2024-04-25T09:04:36.313588+0000","last_fullsized":"2024-04-25T09:04:36.313588+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.752767+0000","last_change":"2024-04-25T09:04:37.360665+0000","last_active":"2024-04-25T09:04:38.752767+0000","last_peered":"2024-04-25T09:04:38.752767+0000","last_clean":"2024-04-25T09:04:38.752767+0000","last_became_active":"2024-04-25T09:04:37.360225+0000","last_became_peered":"2024-04-25T09:04:37.360225+0000","last_unstale":"2024-04-25T09:04:38.752767+0000","last_undegraded":"2024-04-25T09:04:38.752767+0000","last_fullsized":"2024-04-25T09:04:38.752767+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:03.809027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328272+0000","last_change":"2024-04-25T09:04:37.362946+0000","last_active":"2024-04-25T09:04:38.328272+0000","last_peered":"2024-04-25T09:04:38.328272+0000","last_clean":"2024-04-25T09:04:38.328272+0000","last_became_active":"2024-04-25T09:04:37.362686+0000","last_became_peered":"2024-04-25T09:04:37.362686+0000","last_unstale":"2024-04-25T09:04:38.328272+0000","last_undegraded":"2024-04-25T09:04:38.328272+0000","last_fullsized":"2024-04-25T09:04:38.328272+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:52.290727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538847+0000","last_change":"2024-04-25T09:04:37.361357+0000","last_active":"2024-04-25T09:04:39.538847+0000","last_peered":"2024-04-25T09:04:39.538847+0000","last_clean":"2024-04-25T09:04:39.538847+0000","last_became_active":"2024-04-25T09:04:37.361076+0000","last_became_peered":"2024-04-25T09:04:37.361076+0000","last_unstale":"2024-04-25T09:04:39.538847+0000","last_undegraded":"2024-04-25T09:04:39.538847+0000","last_fullsized":"2024-04-25T09:04:39.538847+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:05.082632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538574+0000","last_change":"2024-04-25T09:04:37.346796+0000","last_active":"2024-04-25T09:04:39.538574+0000","last_peered":"2024-04-25T09:04:39.538574+0000","last_clean":"2024-04-25T09:04:39.538574+0000","last_became_active":"2024-04-25T09:04:37.346475+0000","last_became_peered":"2024-04-25T09:04:37.346475+0000","last_unstale":"2024-04-25T09:04:39.538574+0000","last_undegraded":"2024-04-25T09:04:39.538574+0000","last_fullsized":"2024-04-25T09:04:39.538574+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:42.888119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328828+0000","last_change":"2024-04-25T09:04:37.350262+0000","last_active":"2024-04-25T09:04:38.328828+0000","last_peered":"2024-04-25T09:04:38.328828+0000","last_clean":"2024-04-25T09:04:38.328828+0000","last_became_active":"2024-04-25T09:04:37.347134+0000","last_became_peered":"2024-04-25T09:04:37.347134+0000","last_unstale":"2024-04-25T09:04:38.328828+0000","last_undegraded":"2024-04-25T09:04:38.328828+0000","last_fullsized":"2024-04-25T09:04:38.328828+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:28.394744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329600+0000","last_change":"2024-04-25T09:04:37.347079+0000","last_active":"2024-04-25T09:04:38.329600+0000","last_peered":"2024-04-25T09:04:38.329600+0000","last_clean":"2024-04-25T09:04:38.329600+0000","last_became_active":"2024-04-25T09:04:37.346813+0000","last_became_peered":"2024-04-25T09:04:37.346813+0000","last_unstale":"2024-04-25T09:04:38.329600+0000","last_undegraded":"2024-04-25T09:04:38.329600+0000","last_fullsized":"2024-04-25T09:04:38.329600+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:31.625853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329793+0000","last_change":"2024-04-25T09:04:37.335924+0000","last_active":"2024-04-25T09:04:38.329793+0000","last_peered":"2024-04-25T09:04:38.329793+0000","last_clean":"2024-04-25T09:04:38.329793+0000","last_became_active":"2024-04-25T09:04:37.335604+0000","last_became_peered":"2024-04-25T09:04:37.335604+0000","last_unstale":"2024-04-25T09:04:38.329793+0000","last_undegraded":"2024-04-25T09:04:38.329793+0000","last_fullsized":"2024-04-25T09:04:38.329793+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:05.082632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538643+0000","last_change":"2024-04-25T09:04:37.353522+0000","last_active":"2024-04-25T09:04:39.538643+0000","last_peered":"2024-04-25T09:04:39.538643+0000","last_clean":"2024-04-25T09:04:39.538643+0000","last_became_active":"2024-04-25T09:04:37.351341+0000","last_became_peered":"2024-04-25T09:04:37.351341+0000","last_unstale":"2024-04-25T09:04:39.538643+0000","last_undegraded":"2024-04-25T09:04:39.538643+0000","last_fullsized":"2024-04-25T09:04:39.538643+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:01.937640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538704+0000","last_change":"2024-04-25T09:04:37.354514+0000","last_active":"2024-04-25T09:04:39.538704+0000","last_peered":"2024-04-25T09:04:39.538704+0000","last_clean":"2024-04-25T09:04:39.538704+0000","last_became_active":"2024-04-25T09:04:37.354234+0000","last_became_peered":"2024-04-25T09:04:37.354234+0000","last_unstale":"2024-04-25T09:04:39.538704+0000","last_undegraded":"2024-04-25T09:04:39.538704+0000","last_fullsized":"2024-04-25T09:04:39.538704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:28.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.752818+0000","last_change":"2024-04-25T09:04:37.358110+0000","last_active":"2024-04-25T09:04:38.752818+0000","last_peered":"2024-04-25T09:04:38.752818+0000","last_clean":"2024-04-25T09:04:38.752818+0000","last_became_active":"2024-04-25T09:04:37.357389+0000","last_became_peered":"2024-04-25T09:04:37.357389+0000","last_unstale":"2024-04-25T09:04:38.752818+0000","last_undegraded":"2024-04-25T09:04:38.752818+0000","last_fullsized":"2024-04-25T09:04:38.752818+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:53.398163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538140+0000","last_change":"2024-04-25T09:04:37.359815+0000","last_active":"2024-04-25T09:04:39.538140+0000","last_peered":"2024-04-25T09:04:39.538140+0000","last_clean":"2024-04-25T09:04:39.538140+0000","last_became_active":"2024-04-25T09:04:37.359494+0000","last_became_peered":"2024-04-25T09:04:37.359494+0000","last_unstale":"2024-04-25T09:04:39.538140+0000","last_undegraded":"2024-04-25T09:04:39.538140+0000","last_fullsized":"2024-04-25T09:04:39.538140+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:16.550296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329074+0000","last_change":"2024-04-25T09:04:37.338663+0000","last_active":"2024-04-25T09:04:38.329074+0000","last_peered":"2024-04-25T09:04:38.329074+0000","last_clean":"2024-04-25T09:04:38.329074+0000","last_became_active":"2024-04-25T09:04:37.338374+0000","last_became_peered":"2024-04-25T09:04:37.338374+0000","last_unstale":"2024-04-25T09:04:38.329074+0000","last_undegraded":"2024-04-25T09:04:38.329074+0000","last_fullsized":"2024-04-25T09:04:38.329074+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:04.559616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990230+0000","last_change":"2024-04-25T09:04:37.367539+0000","last_active":"2024-04-25T09:04:38.990230+0000","last_peered":"2024-04-25T09:04:38.990230+0000","last_clean":"2024-04-25T09:04:38.990230+0000","last_became_active":"2024-04-25T09:04:37.367223+0000","last_became_peered":"2024-04-25T09:04:37.367223+0000","last_unstale":"2024-04-25T09:04:38.990230+0000","last_undegraded":"2024-04-25T09:04:38.990230+0000","last_fullsized":"2024-04-25T09:04:38.990230+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:47.342815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:36.313588+0000","last_change":"2024-04-25T09:04:36.313588+0000","last_active":"2024-04-25T09:04:36.313588+0000","last_peered":"2024-04-25T09:04:36.313588+0000","last_clean":"2024-04-25T09:04:36.313588+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:36.313588+0000","last_undegraded":"2024-04-25T09:04:36.313588+0000","last_fullsized":"2024-04-25T09:04:36.313588+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329881+0000","last_change":"2024-04-25T09:04:37.349938+0000","last_active":"2024-04-25T09:04:38.329881+0000","last_peered":"2024-04-25T09:04:38.329881+0000","last_clean":"2024-04-25T09:04:38.329881+0000","last_became_active":"2024-04-25T09:04:37.349608+0000","last_became_peered":"2024-04-25T09:04:37.349608+0000","last_unstale":"2024-04-25T09:04:38.329881+0000","last_undegraded":"2024-04-25T09:04:38.329881+0000","last_fullsized":"2024-04-25T09:04:38.329881+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.482619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:36.313588+0000","last_change":"2024-04-25T09:04:36.313588+0000","last_active":"2024-04-25T09:04:36.313588+0000","last_peered":"2024-04-25T09:04:36.313588+0000","last_clean":"2024-04-25T09:04:36.313588+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:36.313588+0000","last_undegraded":"2024-04-25T09:04:36.313588+0000","last_fullsized":"2024-04-25T09:04:36.313588+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:36.313588+0000","last_change":"2024-04-25T09:04:36.313588+0000","last_active":"2024-04-25T09:04:36.313588+0000","last_peered":"2024-04-25T09:04:36.313588+0000","last_clean":"2024-04-25T09:04:36.313588+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:36.313588+0000","last_undegraded":"2024-04-25T09:04:36.313588+0000","last_fullsized":"2024-04-25T09:04:36.313588+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538590+0000","last_change":"2024-04-25T09:04:37.354655+0000","last_active":"2024-04-25T09:04:39.538590+0000","last_peered":"2024-04-25T09:04:39.538590+0000","last_clean":"2024-04-25T09:04:39.538590+0000","last_became_active":"2024-04-25T09:04:37.354373+0000","last_became_peered":"2024-04-25T09:04:37.354373+0000","last_unstale":"2024-04-25T09:04:39.538590+0000","last_undegraded":"2024-04-25T09:04:39.538590+0000","last_fullsized":"2024-04-25T09:04:39.538590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:31.625853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329907+0000","last_change":"2024-04-25T09:04:37.353606+0000","last_active":"2024-04-25T09:04:38.329907+0000","last_peered":"2024-04-25T09:04:38.329907+0000","last_clean":"2024-04-25T09:04:38.329907+0000","last_became_active":"2024-04-25T09:04:37.353309+0000","last_became_peered":"2024-04-25T09:04:37.353309+0000","last_unstale":"2024-04-25T09:04:38.329907+0000","last_undegraded":"2024-04-25T09:04:38.329907+0000","last_fullsized":"2024-04-25T09:04:38.329907+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:24.769393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329694+0000","last_change":"2024-04-25T09:04:37.350619+0000","last_active":"2024-04-25T09:04:38.329694+0000","last_peered":"2024-04-25T09:04:38.329694+0000","last_clean":"2024-04-25T09:04:38.329694+0000","last_became_active":"2024-04-25T09:04:37.350384+0000","last_became_peered":"2024-04-25T09:04:37.350384+0000","last_unstale":"2024-04-25T09:04:38.329694+0000","last_undegraded":"2024-04-25T09:04:38.329694+0000","last_fullsized":"2024-04-25T09:04:38.329694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:28.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328809+0000","last_change":"2024-04-25T09:04:37.365688+0000","last_active":"2024-04-25T09:04:38.328809+0000","last_peered":"2024-04-25T09:04:38.328809+0000","last_clean":"2024-04-25T09:04:38.328809+0000","last_became_active":"2024-04-25T09:04:37.365393+0000","last_became_peered":"2024-04-25T09:04:37.365393+0000","last_unstale":"2024-04-25T09:04:38.328809+0000","last_undegraded":"2024-04-25T09:04:38.328809+0000","last_fullsized":"2024-04-25T09:04:38.328809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:20.870831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537340+0000","last_change":"2024-04-25T09:04:37.356127+0000","last_active":"2024-04-25T09:04:39.537340+0000","last_peered":"2024-04-25T09:04:39.537340+0000","last_clean":"2024-04-25T09:04:39.537340+0000","last_became_active":"2024-04-25T09:04:37.355696+0000","last_became_peered":"2024-04-25T09:04:37.355696+0000","last_unstale":"2024-04-25T09:04:39.537340+0000","last_undegraded":"2024-04-25T09:04:39.537340+0000","last_fullsized":"2024-04-25T09:04:39.537340+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.018634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538912+0000","last_change":"2024-04-25T09:04:37.346933+0000","last_active":"2024-04-25T09:04:39.538912+0000","last_peered":"2024-04-25T09:04:39.538912+0000","last_clean":"2024-04-25T09:04:39.538912+0000","last_became_active":"2024-04-25T09:04:37.346538+0000","last_became_peered":"2024-04-25T09:04:37.346538+0000","last_unstale":"2024-04-25T09:04:39.538912+0000","last_undegraded":"2024-04-25T09:04:39.538912+0000","last_fullsized":"2024-04-25T09:04:39.538912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:24.769393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329729+0000","last_change":"2024-04-25T09:04:37.362945+0000","last_active":"2024-04-25T09:04:38.329729+0000","last_peered":"2024-04-25T09:04:38.329729+0000","last_clean":"2024-04-25T09:04:38.329729+0000","last_became_active":"2024-04-25T09:04:37.362610+0000","last_became_peered":"2024-04-25T09:04:37.362610+0000","last_unstale":"2024-04-25T09:04:38.329729+0000","last_undegraded":"2024-04-25T09:04:38.329729+0000","last_fullsized":"2024-04-25T09:04:38.329729+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:03.389766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328507+0000","last_change":"2024-04-25T09:04:37.352321+0000","last_active":"2024-04-25T09:04:38.328507+0000","last_peered":"2024-04-25T09:04:38.328507+0000","last_clean":"2024-04-25T09:04:38.328507+0000","last_became_active":"2024-04-25T09:04:37.351711+0000","last_became_peered":"2024-04-25T09:04:37.351711+0000","last_unstale":"2024-04-25T09:04:38.328507+0000","last_undegraded":"2024-04-25T09:04:38.328507+0000","last_fullsized":"2024-04-25T09:04:38.328507+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:50.082022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:36.313588+0000","last_change":"2024-04-25T09:04:36.313588+0000","last_active":"2024-04-25T09:04:36.313588+0000","last_peered":"2024-04-25T09:04:36.313588+0000","last_clean":"2024-04-25T09:04:36.313588+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:36.313588+0000","last_undegraded":"2024-04-25T09:04:36.313588+0000","last_fullsized":"2024-04-25T09:04:36.313588+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990224+0000","last_change":"2024-04-25T09:04:37.365292+0000","last_active":"2024-04-25T09:04:38.990224+0000","last_peered":"2024-04-25T09:04:38.990224+0000","last_clean":"2024-04-25T09:04:38.990224+0000","last_became_active":"2024-04-25T09:04:37.364926+0000","last_became_peered":"2024-04-25T09:04:37.364926+0000","last_unstale":"2024-04-25T09:04:38.990224+0000","last_undegraded":"2024-04-25T09:04:38.990224+0000","last_fullsized":"2024-04-25T09:04:38.990224+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:27.671043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538194+0000","last_change":"2024-04-25T09:04:36.347766+0000","last_active":"2024-04-25T09:04:39.538194+0000","last_peered":"2024-04-25T09:04:39.538194+0000","last_clean":"2024-04-25T09:04:39.538194+0000","last_became_active":"2024-04-25T09:04:36.346920+0000","last_became_peered":"2024-04-25T09:04:36.346920+0000","last_unstale":"2024-04-25T09:04:39.538194+0000","last_undegraded":"2024-04-25T09:04:39.538194+0000","last_fullsized":"2024-04-25T09:04:39.538194+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:22.787630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329059+0000","last_change":"2024-04-25T09:04:37.347747+0000","last_active":"2024-04-25T09:04:38.329059+0000","last_peered":"2024-04-25T09:04:38.329059+0000","last_clean":"2024-04-25T09:04:38.329059+0000","last_became_active":"2024-04-25T09:04:37.347485+0000","last_became_peered":"2024-04-25T09:04:37.347485+0000","last_unstale":"2024-04-25T09:04:38.329059+0000","last_undegraded":"2024-04-25T09:04:38.329059+0000","last_fullsized":"2024-04-25T09:04:38.329059+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:47.851420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:36.313588+0000","last_change":"2024-04-25T09:04:36.313588+0000","last_active":"2024-04-25T09:04:36.313588+0000","last_peered":"2024-04-25T09:04:36.313588+0000","last_clean":"2024-04-25T09:04:36.313588+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:36.313588+0000","last_undegraded":"2024-04-25T09:04:36.313588+0000","last_fullsized":"2024-04-25T09:04:36.313588+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538596+0000","last_change":"2024-04-25T09:04:37.346001+0000","last_active":"2024-04-25T09:04:39.538596+0000","last_peered":"2024-04-25T09:04:39.538596+0000","last_clean":"2024-04-25T09:04:39.538596+0000","last_became_active":"2024-04-25T09:04:37.345725+0000","last_became_peered":"2024-04-25T09:04:37.345725+0000","last_unstale":"2024-04-25T09:04:39.538596+0000","last_undegraded":"2024-04-25T09:04:39.538596+0000","last_fullsized":"2024-04-25T09:04:39.538596+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:03.389766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.752817+0000","last_change":"2024-04-25T09:04:37.358317+0000","last_active":"2024-04-25T09:04:38.752817+0000","last_peered":"2024-04-25T09:04:38.752817+0000","last_clean":"2024-04-25T09:04:38.752817+0000","last_became_active":"2024-04-25T09:04:37.357706+0000","last_became_peered":"2024-04-25T09:04:37.357706+0000","last_unstale":"2024-04-25T09:04:38.752817+0000","last_undegraded":"2024-04-25T09:04:38.752817+0000","last_fullsized":"2024-04-25T09:04:38.752817+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:34.975061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537063+0000","last_change":"2024-04-25T09:04:37.353095+0000","last_active":"2024-04-25T09:04:39.537063+0000","last_peered":"2024-04-25T09:04:39.537063+0000","last_clean":"2024-04-25T09:04:39.537063+0000","last_became_active":"2024-04-25T09:04:37.352874+0000","last_became_peered":"2024-04-25T09:04:37.352874+0000","last_unstale":"2024-04-25T09:04:39.537063+0000","last_undegraded":"2024-04-25T09:04:39.537063+0000","last_fullsized":"2024-04-25T09:04:39.537063+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:47.342815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.989939+0000","last_change":"2024-04-25T09:04:37.356214+0000","last_active":"2024-04-25T09:04:38.989939+0000","last_peered":"2024-04-25T09:04:38.989939+0000","last_clean":"2024-04-25T09:04:38.989939+0000","last_became_active":"2024-04-25T09:04:37.352941+0000","last_became_peered":"2024-04-25T09:04:37.352941+0000","last_unstale":"2024-04-25T09:04:38.989939+0000","last_undegraded":"2024-04-25T09:04:38.989939+0000","last_fullsized":"2024-04-25T09:04:38.989939+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:04.559616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:36.313588+0000","last_change":"2024-04-25T09:04:36.313588+0000","last_active":"2024-04-25T09:04:36.313588+0000","last_peered":"2024-04-25T09:04:36.313588+0000","last_clean":"2024-04-25T09:04:36.313588+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:36.313588+0000","last_undegraded":"2024-04-25T09:04:36.313588+0000","last_fullsized":"2024-04-25T09:04:36.313588+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990390+0000","last_change":"2024-04-25T09:04:36.344876+0000","last_active":"2024-04-25T09:04:38.990390+0000","last_peered":"2024-04-25T09:04:38.990390+0000","last_clean":"2024-04-25T09:04:38.990390+0000","last_became_active":"2024-04-25T09:04:36.343902+0000","last_became_peered":"2024-04-25T09:04:36.343902+0000","last_unstale":"2024-04-25T09:04:38.990390+0000","last_undegraded":"2024-04-25T09:04:38.990390+0000","last_fullsized":"2024-04-25T09:04:38.990390+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:04.445798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537416+0000","last_change":"2024-04-25T09:04:37.355904+0000","last_active":"2024-04-25T09:04:39.537416+0000","last_peered":"2024-04-25T09:04:39.537416+0000","last_clean":"2024-04-25T09:04:39.537416+0000","last_became_active":"2024-04-25T09:04:37.355485+0000","last_became_peered":"2024-04-25T09:04:37.355485+0000","last_unstale":"2024-04-25T09:04:39.537416+0000","last_undegraded":"2024-04-25T09:04:39.537416+0000","last_fullsized":"2024-04-25T09:04:39.537416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:32.137105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538939+0000","last_change":"2024-04-25T09:04:36.352488+0000","last_active":"2024-04-25T09:04:39.538939+0000","last_peered":"2024-04-25T09:04:39.538939+0000","last_clean":"2024-04-25T09:04:39.538939+0000","last_became_active":"2024-04-25T09:04:36.352201+0000","last_became_peered":"2024-04-25T09:04:36.352201+0000","last_unstale":"2024-04-25T09:04:39.538939+0000","last_undegraded":"2024-04-25T09:04:39.538939+0000","last_fullsized":"2024-04-25T09:04:39.538939+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:31.336176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:36.313588+0000","last_change":"2024-04-25T09:04:36.313588+0000","last_active":"2024-04-25T09:04:36.313588+0000","last_peered":"2024-04-25T09:04:36.313588+0000","last_clean":"2024-04-25T09:04:36.313588+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:36.313588+0000","last_undegraded":"2024-04-25T09:04:36.313588+0000","last_fullsized":"2024-04-25T09:04:36.313588+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329213+0000","last_change":"2024-04-25T09:04:36.347625+0000","last_active":"2024-04-25T09:04:38.329213+0000","last_peered":"2024-04-25T09:04:38.329213+0000","last_clean":"2024-04-25T09:04:38.329213+0000","last_became_active":"2024-04-25T09:04:36.347331+0000","last_became_peered":"2024-04-25T09:04:36.347331+0000","last_unstale":"2024-04-25T09:04:38.329213+0000","last_undegraded":"2024-04-25T09:04:38.329213+0000","last_fullsized":"2024-04-25T09:04:38.329213+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:33.054412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990228+0000","last_change":"2024-04-25T09:04:37.357919+0000","last_active":"2024-04-25T09:04:38.990228+0000","last_peered":"2024-04-25T09:04:38.990228+0000","last_clean":"2024-04-25T09:04:38.990228+0000","last_became_active":"2024-04-25T09:04:37.354654+0000","last_became_peered":"2024-04-25T09:04:37.354654+0000","last_unstale":"2024-04-25T09:04:38.990228+0000","last_undegraded":"2024-04-25T09:04:38.990228+0000","last_fullsized":"2024-04-25T09:04:38.990228+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:32.344905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"65'3","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538503+0000","last_change":"2024-04-25T09:04:36.347900+0000","last_active":"2024-04-25T09:04:39.538503+0000","last_peered":"2024-04-25T09:04:39.538503+0000","last_clean":"2024-04-25T09:04:39.538503+0000","last_became_active":"2024-04-25T09:04:36.347573+0000","last_became_peered":"2024-04-25T09:04:36.347573+0000","last_unstale":"2024-04-25T09:04:39.538503+0000","last_undegraded":"2024-04-25T09:04:39.538503+0000","last_fullsized":"2024-04-25T09:04:39.538503+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:14.312987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329314+0000","last_change":"2024-04-25T09:04:37.341070+0000","last_active":"2024-04-25T09:04:38.329314+0000","last_peered":"2024-04-25T09:04:38.329314+0000","last_clean":"2024-04-25T09:04:38.329314+0000","last_became_active":"2024-04-25T09:04:37.339875+0000","last_became_peered":"2024-04-25T09:04:37.339875+0000","last_unstale":"2024-04-25T09:04:38.329314+0000","last_undegraded":"2024-04-25T09:04:38.329314+0000","last_fullsized":"2024-04-25T09:04:38.329314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:06.409692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537400+0000","last_change":"2024-04-25T09:04:36.350305+0000","last_active":"2024-04-25T09:04:39.537400+0000","last_peered":"2024-04-25T09:04:39.537400+0000","last_clean":"2024-04-25T09:04:39.537400+0000","last_became_active":"2024-04-25T09:04:36.350028+0000","last_became_peered":"2024-04-25T09:04:36.350028+0000","last_unstale":"2024-04-25T09:04:39.537400+0000","last_undegraded":"2024-04-25T09:04:39.537400+0000","last_fullsized":"2024-04-25T09:04:39.537400+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:49.073293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328342+0000","last_change":"2024-04-25T09:04:37.342486+0000","last_active":"2024-04-25T09:04:38.328342+0000","last_peered":"2024-04-25T09:04:38.328342+0000","last_clean":"2024-04-25T09:04:38.328342+0000","last_became_active":"2024-04-25T09:04:37.342184+0000","last_became_peered":"2024-04-25T09:04:37.342184+0000","last_unstale":"2024-04-25T09:04:38.328342+0000","last_undegraded":"2024-04-25T09:04:38.328342+0000","last_fullsized":"2024-04-25T09:04:38.328342+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:55.091009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538718+0000","last_change":"2024-04-25T09:04:36.346274+0000","last_active":"2024-04-25T09:04:39.538718+0000","last_peered":"2024-04-25T09:04:39.538718+0000","last_clean":"2024-04-25T09:04:39.538718+0000","last_became_active":"2024-04-25T09:04:36.345688+0000","last_became_peered":"2024-04-25T09:04:36.345688+0000","last_unstale":"2024-04-25T09:04:39.538718+0000","last_undegraded":"2024-04-25T09:04:39.538718+0000","last_fullsized":"2024-04-25T09:04:39.538718+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:03.550887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328817+0000","last_change":"2024-04-25T09:04:37.337434+0000","last_active":"2024-04-25T09:04:38.328817+0000","last_peered":"2024-04-25T09:04:38.328817+0000","last_clean":"2024-04-25T09:04:38.328817+0000","last_became_active":"2024-04-25T09:04:37.337151+0000","last_became_peered":"2024-04-25T09:04:37.337151+0000","last_unstale":"2024-04-25T09:04:38.328817+0000","last_undegraded":"2024-04-25T09:04:38.328817+0000","last_fullsized":"2024-04-25T09:04:38.328817+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:45.691235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329434+0000","last_change":"2024-04-25T09:04:36.341352+0000","last_active":"2024-04-25T09:04:38.329434+0000","last_peered":"2024-04-25T09:04:38.329434+0000","last_clean":"2024-04-25T09:04:38.329434+0000","last_became_active":"2024-04-25T09:04:36.341071+0000","last_became_peered":"2024-04-25T09:04:36.341071+0000","last_unstale":"2024-04-25T09:04:38.329434+0000","last_undegraded":"2024-04-25T09:04:38.329434+0000","last_fullsized":"2024-04-25T09:04:38.329434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:46.842691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990353+0000","last_change":"2024-04-25T09:04:37.368519+0000","last_active":"2024-04-25T09:04:38.990353+0000","last_peered":"2024-04-25T09:04:38.990353+0000","last_clean":"2024-04-25T09:04:38.990353+0000","last_became_active":"2024-04-25T09:04:37.368298+0000","last_became_peered":"2024-04-25T09:04:37.368298+0000","last_unstale":"2024-04-25T09:04:38.990353+0000","last_undegraded":"2024-04-25T09:04:38.990353+0000","last_fullsized":"2024-04-25T09:04:38.990353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:37.746122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538419+0000","last_change":"2024-04-25T09:04:36.346746+0000","last_active":"2024-04-25T09:04:39.538419+0000","last_peered":"2024-04-25T09:04:39.538419+0000","last_clean":"2024-04-25T09:04:39.538419+0000","last_became_active":"2024-04-25T09:04:36.346418+0000","last_became_peered":"2024-04-25T09:04:36.346418+0000","last_unstale":"2024-04-25T09:04:39.538419+0000","last_undegraded":"2024-04-25T09:04:39.538419+0000","last_fullsized":"2024-04-25T09:04:39.538419+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:46.842691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537694+0000","last_change":"2024-04-25T09:04:37.348538+0000","last_active":"2024-04-25T09:04:39.537694+0000","last_peered":"2024-04-25T09:04:39.537694+0000","last_clean":"2024-04-25T09:04:39.537694+0000","last_became_active":"2024-04-25T09:04:37.348258+0000","last_became_peered":"2024-04-25T09:04:37.348258+0000","last_unstale":"2024-04-25T09:04:39.537694+0000","last_undegraded":"2024-04-25T09:04:39.537694+0000","last_fullsized":"2024-04-25T09:04:39.537694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:05.011222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328461+0000","last_change":"2024-04-25T09:04:36.335056+0000","last_active":"2024-04-25T09:04:38.328461+0000","last_peered":"2024-04-25T09:04:38.328461+0000","last_clean":"2024-04-25T09:04:38.328461+0000","last_became_active":"2024-04-25T09:04:36.334767+0000","last_became_peered":"2024-04-25T09:04:36.334767+0000","last_unstale":"2024-04-25T09:04:38.328461+0000","last_undegraded":"2024-04-25T09:04:38.328461+0000","last_fullsized":"2024-04-25T09:04:38.328461+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:14.109033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538884+0000","last_change":"2024-04-25T09:04:37.363358+0000","last_active":"2024-04-25T09:04:39.538884+0000","last_peered":"2024-04-25T09:04:39.538884+0000","last_clean":"2024-04-25T09:04:39.538884+0000","last_became_active":"2024-04-25T09:04:37.361423+0000","last_became_peered":"2024-04-25T09:04:37.361423+0000","last_unstale":"2024-04-25T09:04:39.538884+0000","last_undegraded":"2024-04-25T09:04:39.538884+0000","last_fullsized":"2024-04-25T09:04:39.538884+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.482619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329758+0000","last_change":"2024-04-25T09:04:36.343724+0000","last_active":"2024-04-25T09:04:38.329758+0000","last_peered":"2024-04-25T09:04:38.329758+0000","last_clean":"2024-04-25T09:04:38.329758+0000","last_became_active":"2024-04-25T09:04:36.343331+0000","last_became_peered":"2024-04-25T09:04:36.343331+0000","last_unstale":"2024-04-25T09:04:38.329758+0000","last_undegraded":"2024-04-25T09:04:38.329758+0000","last_fullsized":"2024-04-25T09:04:38.329758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:14.312987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990319+0000","last_change":"2024-04-25T09:04:37.356959+0000","last_active":"2024-04-25T09:04:38.990319+0000","last_peered":"2024-04-25T09:04:38.990319+0000","last_clean":"2024-04-25T09:04:38.990319+0000","last_became_active":"2024-04-25T09:04:37.356522+0000","last_became_peered":"2024-04-25T09:04:37.356522+0000","last_unstale":"2024-04-25T09:04:38.990319+0000","last_undegraded":"2024-04-25T09:04:38.990319+0000","last_fullsized":"2024-04-25T09:04:38.990319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:32.137105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538719+0000","last_change":"2024-04-25T09:04:36.343832+0000","last_active":"2024-04-25T09:04:39.538719+0000","last_peered":"2024-04-25T09:04:39.538719+0000","last_clean":"2024-04-25T09:04:39.538719+0000","last_became_active":"2024-04-25T09:04:36.343518+0000","last_became_peered":"2024-04-25T09:04:36.343518+0000","last_unstale":"2024-04-25T09:04:39.538719+0000","last_undegraded":"2024-04-25T09:04:39.538719+0000","last_fullsized":"2024-04-25T09:04:39.538719+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:26.662314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329108+0000","last_change":"2024-04-25T09:04:37.346741+0000","last_active":"2024-04-25T09:04:38.329108+0000","last_peered":"2024-04-25T09:04:38.329108+0000","last_clean":"2024-04-25T09:04:38.329108+0000","last_became_active":"2024-04-25T09:04:37.346422+0000","last_became_peered":"2024-04-25T09:04:37.346422+0000","last_unstale":"2024-04-25T09:04:38.329108+0000","last_undegraded":"2024-04-25T09:04:38.329108+0000","last_fullsized":"2024-04-25T09:04:38.329108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:15.321716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538634+0000","last_change":"2024-04-25T09:04:36.348753+0000","last_active":"2024-04-25T09:04:39.538634+0000","last_peered":"2024-04-25T09:04:39.538634+0000","last_clean":"2024-04-25T09:04:39.538634+0000","last_became_active":"2024-04-25T09:04:36.348450+0000","last_became_peered":"2024-04-25T09:04:36.348450+0000","last_unstale":"2024-04-25T09:04:39.538634+0000","last_undegraded":"2024-04-25T09:04:39.538634+0000","last_fullsized":"2024-04-25T09:04:39.538634+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:05.400963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990112+0000","last_change":"2024-04-25T09:04:37.346151+0000","last_active":"2024-04-25T09:04:38.990112+0000","last_peered":"2024-04-25T09:04:38.990112+0000","last_clean":"2024-04-25T09:04:38.990112+0000","last_became_active":"2024-04-25T09:04:37.345649+0000","last_became_peered":"2024-04-25T09:04:37.345649+0000","last_unstale":"2024-04-25T09:04:38.990112+0000","last_undegraded":"2024-04-25T09:04:38.990112+0000","last_fullsized":"2024-04-25T09:04:38.990112+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:06.409692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:36.313588+0000","last_change":"2024-04-25T09:04:36.313588+0000","last_active":"2024-04-25T09:04:36.313588+0000","last_peered":"2024-04-25T09:04:36.313588+0000","last_clean":"2024-04-25T09:04:36.313588+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:36.313588+0000","last_undegraded":"2024-04-25T09:04:36.313588+0000","last_fullsized":"2024-04-25T09:04:36.313588+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329448+0000","last_change":"2024-04-25T09:04:37.351280+0000","last_active":"2024-04-25T09:04:38.329448+0000","last_peered":"2024-04-25T09:04:38.329448+0000","last_clean":"2024-04-25T09:04:38.329448+0000","last_became_active":"2024-04-25T09:04:37.350033+0000","last_became_peered":"2024-04-25T09:04:37.350033+0000","last_unstale":"2024-04-25T09:04:38.329448+0000","last_undegraded":"2024-04-25T09:04:38.329448+0000","last_fullsized":"2024-04-25T09:04:38.329448+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:42.888119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329547+0000","last_change":"2024-04-25T09:04:36.341281+0000","last_active":"2024-04-25T09:04:38.329547+0000","last_peered":"2024-04-25T09:04:38.329547+0000","last_clean":"2024-04-25T09:04:38.329547+0000","last_became_active":"2024-04-25T09:04:36.341014+0000","last_became_peered":"2024-04-25T09:04:36.341014+0000","last_unstale":"2024-04-25T09:04:38.329547+0000","last_undegraded":"2024-04-25T09:04:38.329547+0000","last_fullsized":"2024-04-25T09:04:38.329547+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:03.550887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990292+0000","last_change":"2024-04-25T09:04:37.351829+0000","last_active":"2024-04-25T09:04:38.990292+0000","last_peered":"2024-04-25T09:04:38.990292+0000","last_clean":"2024-04-25T09:04:38.990292+0000","last_became_active":"2024-04-25T09:04:37.351559+0000","last_became_peered":"2024-04-25T09:04:37.351559+0000","last_unstale":"2024-04-25T09:04:38.990292+0000","last_undegraded":"2024-04-25T09:04:38.990292+0000","last_fullsized":"2024-04-25T09:04:38.990292+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:30.581396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:36.313588+0000","last_change":"2024-04-25T09:04:36.313588+0000","last_active":"2024-04-25T09:04:36.313588+0000","last_peered":"2024-04-25T09:04:36.313588+0000","last_clean":"2024-04-25T09:04:36.313588+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:36.313588+0000","last_undegraded":"2024-04-25T09:04:36.313588+0000","last_fullsized":"2024-04-25T09:04:36.313588+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329960+0000","last_change":"2024-04-25T09:04:36.342188+0000","last_active":"2024-04-25T09:04:38.329960+0000","last_peered":"2024-04-25T09:04:38.329960+0000","last_clean":"2024-04-25T09:04:38.329960+0000","last_became_active":"2024-04-25T09:04:36.341891+0000","last_became_peered":"2024-04-25T09:04:36.341891+0000","last_unstale":"2024-04-25T09:04:38.329960+0000","last_undegraded":"2024-04-25T09:04:38.329960+0000","last_fullsized":"2024-04-25T09:04:38.329960+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:05.400963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.752913+0000","last_change":"2024-04-25T09:04:37.354697+0000","last_active":"2024-04-25T09:04:38.752913+0000","last_peered":"2024-04-25T09:04:38.752913+0000","last_clean":"2024-04-25T09:04:38.752913+0000","last_became_active":"2024-04-25T09:04:37.354351+0000","last_became_peered":"2024-04-25T09:04:37.354351+0000","last_unstale":"2024-04-25T09:04:38.752913+0000","last_undegraded":"2024-04-25T09:04:38.752913+0000","last_fullsized":"2024-04-25T09:04:38.752913+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:03.537043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"66'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.332177+0000","last_change":"2024-04-25T09:04:36.345342+0000","last_active":"2024-04-25T09:04:39.332177+0000","last_peered":"2024-04-25T09:04:39.332177+0000","last_clean":"2024-04-25T09:04:39.332177+0000","last_became_active":"2024-04-25T09:04:36.345020+0000","last_became_peered":"2024-04-25T09:04:36.345020+0000","last_unstale":"2024-04-25T09:04:39.332177+0000","last_undegraded":"2024-04-25T09:04:39.332177+0000","last_fullsized":"2024-04-25T09:04:39.332177+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:22.787630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329658+0000","last_change":"2024-04-25T09:04:37.338105+0000","last_active":"2024-04-25T09:04:38.329658+0000","last_peered":"2024-04-25T09:04:38.329658+0000","last_clean":"2024-04-25T09:04:38.329658+0000","last_became_active":"2024-04-25T09:04:37.337838+0000","last_became_peered":"2024-04-25T09:04:37.337838+0000","last_unstale":"2024-04-25T09:04:38.329658+0000","last_undegraded":"2024-04-25T09:04:38.329658+0000","last_fullsized":"2024-04-25T09:04:38.329658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:01.937640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990083+0000","last_change":"2024-04-25T09:04:37.345919+0000","last_active":"2024-04-25T09:04:38.990083+0000","last_peered":"2024-04-25T09:04:38.990083+0000","last_clean":"2024-04-25T09:04:38.990083+0000","last_became_active":"2024-04-25T09:04:37.345256+0000","last_became_peered":"2024-04-25T09:04:37.345256+0000","last_unstale":"2024-04-25T09:04:38.990083+0000","last_undegraded":"2024-04-25T09:04:38.990083+0000","last_fullsized":"2024-04-25T09:04:38.990083+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:23.796358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537451+0000","last_change":"2024-04-25T09:04:36.350256+0000","last_active":"2024-04-25T09:04:39.537451+0000","last_peered":"2024-04-25T09:04:39.537451+0000","last_clean":"2024-04-25T09:04:39.537451+0000","last_became_active":"2024-04-25T09:04:36.349670+0000","last_became_peered":"2024-04-25T09:04:36.349670+0000","last_unstale":"2024-04-25T09:04:39.537451+0000","last_undegraded":"2024-04-25T09:04:39.537451+0000","last_fullsized":"2024-04-25T09:04:39.537451+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:19.862102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990415+0000","last_change":"2024-04-25T09:04:37.353391+0000","last_active":"2024-04-25T09:04:38.990415+0000","last_peered":"2024-04-25T09:04:38.990415+0000","last_clean":"2024-04-25T09:04:38.990415+0000","last_became_active":"2024-04-25T09:04:37.353041+0000","last_became_peered":"2024-04-25T09:04:37.353041+0000","last_unstale":"2024-04-25T09:04:38.990415+0000","last_undegraded":"2024-04-25T09:04:38.990415+0000","last_fullsized":"2024-04-25T09:04:38.990415+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:05.011222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538881+0000","last_change":"2024-04-25T09:04:36.346883+0000","last_active":"2024-04-25T09:04:39.538881+0000","last_peered":"2024-04-25T09:04:39.538881+0000","last_clean":"2024-04-25T09:04:39.538881+0000","last_became_active":"2024-04-25T09:04:36.346615+0000","last_became_peered":"2024-04-25T09:04:36.346615+0000","last_unstale":"2024-04-25T09:04:39.538881+0000","last_undegraded":"2024-04-25T09:04:39.538881+0000","last_fullsized":"2024-04-25T09:04:39.538881+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:22.787630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329151+0000","last_change":"2024-04-25T09:04:37.340315+0000","last_active":"2024-04-25T09:04:38.329151+0000","last_peered":"2024-04-25T09:04:38.329151+0000","last_clean":"2024-04-25T09:04:38.329151+0000","last_became_active":"2024-04-25T09:04:37.340007+0000","last_became_peered":"2024-04-25T09:04:37.340007+0000","last_unstale":"2024-04-25T09:04:38.329151+0000","last_undegraded":"2024-04-25T09:04:38.329151+0000","last_fullsized":"2024-04-25T09:04:38.329151+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:23.796358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537016+0000","last_change":"2024-04-25T09:04:37.352665+0000","last_active":"2024-04-25T09:04:39.537016+0000","last_peered":"2024-04-25T09:04:39.537016+0000","last_clean":"2024-04-25T09:04:39.537016+0000","last_became_active":"2024-04-25T09:04:37.352002+0000","last_became_peered":"2024-04-25T09:04:37.352002+0000","last_unstale":"2024-04-25T09:04:39.537016+0000","last_undegraded":"2024-04-25T09:04:39.537016+0000","last_fullsized":"2024-04-25T09:04:39.537016+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:30.581396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.752679+0000","last_change":"2024-04-25T09:04:37.360408+0000","last_active":"2024-04-25T09:04:38.752679+0000","last_peered":"2024-04-25T09:04:38.752679+0000","last_clean":"2024-04-25T09:04:38.752679+0000","last_became_active":"2024-04-25T09:04:37.360102+0000","last_became_peered":"2024-04-25T09:04:37.360102+0000","last_unstale":"2024-04-25T09:04:38.752679+0000","last_undegraded":"2024-04-25T09:04:38.752679+0000","last_fullsized":"2024-04-25T09:04:38.752679+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:20.307924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.536997+0000","last_change":"2024-04-25T09:04:36.343080+0000","last_active":"2024-04-25T09:04:39.536997+0000","last_peered":"2024-04-25T09:04:39.536997+0000","last_clean":"2024-04-25T09:04:39.536997+0000","last_became_active":"2024-04-25T09:04:36.342734+0000","last_became_peered":"2024-04-25T09:04:36.342734+0000","last_unstale":"2024-04-25T09:04:39.536997+0000","last_undegraded":"2024-04-25T09:04:39.536997+0000","last_fullsized":"2024-04-25T09:04:39.536997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:31.207366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990275+0000","last_change":"2024-04-25T09:04:37.353577+0000","last_active":"2024-04-25T09:04:38.990275+0000","last_peered":"2024-04-25T09:04:38.990275+0000","last_clean":"2024-04-25T09:04:38.990275+0000","last_became_active":"2024-04-25T09:04:37.353073+0000","last_became_peered":"2024-04-25T09:04:37.353073+0000","last_unstale":"2024-04-25T09:04:38.990275+0000","last_undegraded":"2024-04-25T09:04:38.990275+0000","last_fullsized":"2024-04-25T09:04:38.990275+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.018634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-25T09:04:35.304859+0000","last_change":"2024-04-25T09:04:35.304859+0000","last_active":"2024-04-25T09:04:35.304859+0000","last_peered":"2024-04-25T09:04:35.304859+0000","last_clean":"2024-04-25T09:04:35.304859+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-25T09:04:35.304859+0000","last_undegraded":"2024-04-25T09:04:35.304859+0000","last_fullsized":"2024-04-25T09:04:35.304859+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":254,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538201+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:04:39.538201+0000","last_peered":"2024-04-25T09:04:39.538201+0000","last_clean":"2024-04-25T09:04:39.538201+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:04:39.538201+0000","last_undegraded":"2024-04-25T09:04:39.538201+0000","last_fullsized":"2024-04-25T09:04:39.538201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":6},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":38,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":38,"acting":38,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1396736,"data_stored":946964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":355854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":362534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":364124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27756,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344084,"statfs":{"total":96636764160,"available":96608342016,"internally_reserved":0,"allocated":749568,"data_stored":335785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":362512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":358196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28336,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343504,"statfs":{"total":96636764160,"available":96607748096,"internally_reserved":0,"allocated":1343488,"data_stored":926153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:41.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.622+0000 7fe131400640 1 Processor -- start 2024-04-25T09:04:41.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.622+0000 7fe131400640 1 -- start start 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.626+0000 7fe131400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe12c06ead0 0x7fe12c1653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.626+0000 7fe131400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12c15ac60 con 0x7fe12c0cef30 2024-04-25T09:04:41.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.626+0000 7fe131400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe12c0cf3e0 con 0x7fe12c144140 2024-04-25T09:04:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.626+0000 7fe131400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12c15af20 con 0x7fe12c06ead0 2024-04-25T09:04:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.626+0000 7fe12b200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe12c06ead0 0x7fe12c1653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.626+0000 7fe121e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe12c0cef30 0x7fe12c06e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33876/0 (socket says 172.21.15.59:33876) 2024-04-25T09:04:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.626+0000 7fe121e00640 1 -- 172.21.15.59:0/3507397458 learned_addr learned my addr 172.21.15.59:0/3507397458 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.626+0000 7fe12b200640 1 -- 172.21.15.59:0/3507397458 >> v1:172.21.15.178:6789/0 conn(0x7fe12c144140 legacy=0x7fe12c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.626+0000 7fe12b200640 1 -- 172.21.15.59:0/3507397458 >> v1:172.21.15.59:6789/0 conn(0x7fe12c0cef30 legacy=0x7fe12c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.626+0000 7fe12b200640 1 -- 172.21.15.59:0/3507397458 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c15b200 con 0x7fe12c06ead0 2024-04-25T09:04:41.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.626+0000 7fe129e00640 1 -- 172.21.15.59:0/3507397458 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834868746 0 0) 0x7fe12c15ac60 con 0x7fe12c0cef30 2024-04-25T09:04:41.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.626+0000 7fe12b200640 1 --2- 172.21.15.59:0/3507397458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c06ead0 0x7fe12c1653d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe124009dc0 tx=0x7fe12401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdc93aa5755ad4a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe129e00640 1 -- 172.21.15.59:0/3507397458 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1240b2070 con 0x7fe12c06ead0 2024-04-25T09:04:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe129e00640 1 -- 172.21.15.59:0/3507397458 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1240a5810 con 0x7fe12c06ead0 2024-04-25T09:04:41.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe129e00640 1 -- 172.21.15.59:0/3507397458 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1240a5be0 con 0x7fe12c06ead0 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 -- 172.21.15.59:0/3507397458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c06ead0 msgr2=0x7fe12c1653d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 --2- 172.21.15.59:0/3507397458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c06ead0 0x7fe12c1653d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe124009dc0 tx=0x7fe12401c950 comp rx=0 tx=0).stop 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 -- 172.21.15.59:0/3507397458 shutdown_connections 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 --2- 172.21.15.59:0/3507397458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c06ead0 0x7fe12c1653d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 -- 172.21.15.59:0/3507397458 >> 172.21.15.59:0/3507397458 conn(0x7fe12c066fa0 msgr2=0x7fe12c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 -- 172.21.15.59:0/3507397458 shutdown_connections 2024-04-25T09:04:41.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 -- 172.21.15.59:0/3507397458 wait complete. 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 Processor -- start 2024-04-25T09:04:41.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 -- start start 2024-04-25T09:04:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe12c06ead0 0x7fe12c13a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe12c0cef30 0x7fe12c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c144140 0x7fe12c06d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c15bb80 con 0x7fe12c144140 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c15ba00 con 0x7fe12c06ead0 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe131400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c168540 con 0x7fe12c0cef30 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe12b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c144140 0x7fe12c06d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe12b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c144140 0x7fe12c06d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60638/0 (socket says 172.21.15.59:60638) 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe12b200640 1 -- 172.21.15.59:0/2686215694 learned_addr learned my addr 172.21.15.59:0/2686215694 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe121e00640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe12c0cef30 0x7fe12c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.630+0000 7fe12a800640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe12c06ead0 0x7fe12c13a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe12b200640 1 -- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe12c0cef30 msgr2=0x7fe12c06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe12b200640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe12c0cef30 0x7fe12c06d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe12b200640 1 -- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe12c06ead0 msgr2=0x7fe12c13a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe12b200640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe12c06ead0 0x7fe12c13a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe12b200640 1 -- 172.21.15.59:0/2686215694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c1415d0 con 0x7fe12c144140 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe121e00640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe12c0cef30 0x7fe12c06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe12a800640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe12c06ead0 0x7fe12c13a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:41.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe12b200640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c144140 0x7fe12c06d7f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe12401a580 tx=0x7fe1240196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe123400640 1 -- 172.21.15.59:0/2686215694 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1240b2050 con 0x7fe12c144140 2024-04-25T09:04:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe123400640 1 -- 172.21.15.59:0/2686215694 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1240be070 con 0x7fe12c144140 2024-04-25T09:04:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe131400640 1 -- 172.21.15.59:0/2686215694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12c1418b0 con 0x7fe12c144140 2024-04-25T09:04:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe123400640 1 -- 172.21.15.59:0/2686215694 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1240ada90 con 0x7fe12c144140 2024-04-25T09:04:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe131400640 1 -- 172.21.15.59:0/2686215694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12c141e70 con 0x7fe12c144140 2024-04-25T09:04:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe131400640 1 -- 172.21.15.59:0/2686215694 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12c0745d0 con 0x7fe12c144140 2024-04-25T09:04:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe123400640 1 -- 172.21.15.59:0/2686215694 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe1240adc30 con 0x7fe12c144140 2024-04-25T09:04:41.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe123400640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe108066f60 0x7fe108069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.634+0000 7fe123400640 1 -- 172.21.15.59:0/2686215694 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe124120300 con 0x7fe12c144140 2024-04-25T09:04:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.638+0000 7fe12a800640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe108066f60 0x7fe108069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:41.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.638+0000 7fe12a800640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe108066f60 0x7fe108069420 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0b2580 tx=0x7fe11c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:41.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.638+0000 7fe123400640 1 -- 172.21.15.59:0/2686215694 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe124016540 con 0x7fe12c144140 2024-04-25T09:04:41.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.798+0000 7fe131400640 1 -- 172.21.15.59:0/2686215694 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe12c0cdb10 con 0x7fe108066f60 2024-04-25T09:04:41.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.806+0000 7fe123400640 1 -- 172.21.15.59:0/2686215694 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252018 (secure 0 0 0) 0x7fe12c0cdb10 con 0x7fe108066f60 2024-04-25T09:04:41.800 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:41.801 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:04:41.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.810+0000 7fe131400640 1 -- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe108066f60 msgr2=0x7fe108069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.810+0000 7fe131400640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe108066f60 0x7fe108069420 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0b2580 tx=0x7fe11c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:41.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.810+0000 7fe131400640 1 -- 172.21.15.59:0/2686215694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c144140 msgr2=0x7fe12c06d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:41.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.810+0000 7fe131400640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c144140 0x7fe12c06d7f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe12401a580 tx=0x7fe1240196f0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.810+0000 7fe131400640 1 -- 172.21.15.59:0/2686215694 shutdown_connections 2024-04-25T09:04:41.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.810+0000 7fe131400640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe108066f60 0x7fe108069420 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.810+0000 7fe131400640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c144140 0x7fe12c06d7f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.810+0000 7fe131400640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe12c0cef30 0x7fe12c06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.810+0000 7fe131400640 1 --2- 172.21.15.59:0/2686215694 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe12c06ead0 0x7fe12c13a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:41.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.810+0000 7fe131400640 1 -- 172.21.15.59:0/2686215694 >> 172.21.15.59:0/2686215694 conn(0x7fe12c066fa0 msgr2=0x7fe12c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:41.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.810+0000 7fe131400640 1 -- 172.21.15.59:0/2686215694 shutdown_connections 2024-04-25T09:04:41.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:41.810+0000 7fe131400640 1 -- 172.21.15.59:0/2686215694 wait complete. 2024-04-25T09:04:41.820 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":163,"stamp":"2024-04-25T09:04:41.696519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248560,"kb_used_data":7416,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726160,"statfs":{"total":773094113280,"available":772839587840,"internally_reserved":0,"allocated":7593984,"data_stored":4058884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":246795826},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001635"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538038+0000","last_change":"2024-04-25T09:04:37.358052+0000","last_active":"2024-04-25T09:04:39.538038+0000","last_peered":"2024-04-25T09:04:39.538038+0000","last_clean":"2024-04-25T09:04:39.538038+0000","last_became_active":"2024-04-25T09:04:37.357075+0000","last_became_peered":"2024-04-25T09:04:37.357075+0000","last_unstale":"2024-04-25T09:04:39.538038+0000","last_undegraded":"2024-04-25T09:04:39.538038+0000","last_fullsized":"2024-04-25T09:04:39.538038+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:02.628890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537667+0000","last_change":"2024-04-25T09:04:37.356178+0000","last_active":"2024-04-25T09:04:39.537667+0000","last_peered":"2024-04-25T09:04:39.537667+0000","last_clean":"2024-04-25T09:04:39.537667+0000","last_became_active":"2024-04-25T09:04:37.355878+0000","last_became_peered":"2024-04-25T09:04:37.355878+0000","last_unstale":"2024-04-25T09:04:39.537667+0000","last_undegraded":"2024-04-25T09:04:39.537667+0000","last_fullsized":"2024-04-25T09:04:39.537667+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:37.746122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538500+0000","last_change":"2024-04-25T09:04:37.359184+0000","last_active":"2024-04-25T09:04:39.538500+0000","last_peered":"2024-04-25T09:04:39.538500+0000","last_clean":"2024-04-25T09:04:39.538500+0000","last_became_active":"2024-04-25T09:04:37.358908+0000","last_became_peered":"2024-04-25T09:04:37.358908+0000","last_unstale":"2024-04-25T09:04:39.538500+0000","last_undegraded":"2024-04-25T09:04:39.538500+0000","last_fullsized":"2024-04-25T09:04:39.538500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:45.691235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328869+0000","last_change":"2024-04-25T09:04:37.339697+0000","last_active":"2024-04-25T09:04:38.328869+0000","last_peered":"2024-04-25T09:04:38.328869+0000","last_clean":"2024-04-25T09:04:38.328869+0000","last_became_active":"2024-04-25T09:04:37.339374+0000","last_became_peered":"2024-04-25T09:04:37.339374+0000","last_unstale":"2024-04-25T09:04:38.328869+0000","last_undegraded":"2024-04-25T09:04:38.328869+0000","last_fullsized":"2024-04-25T09:04:38.328869+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:07.139628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990028+0000","last_change":"2024-04-25T09:04:37.357877+0000","last_active":"2024-04-25T09:04:38.990028+0000","last_peered":"2024-04-25T09:04:38.990028+0000","last_clean":"2024-04-25T09:04:38.990028+0000","last_became_active":"2024-04-25T09:04:37.357284+0000","last_became_peered":"2024-04-25T09:04:37.357284+0000","last_unstale":"2024-04-25T09:04:38.990028+0000","last_undegraded":"2024-04-25T09:04:38.990028+0000","last_fullsized":"2024-04-25T09:04:38.990028+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:15.321716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.326481+0000","last_change":"2024-04-25T09:04:37.362520+0000","last_active":"2024-04-25T09:04:38.326481+0000","last_peered":"2024-04-25T09:04:38.326481+0000","last_clean":"2024-04-25T09:04:38.326481+0000","last_became_active":"2024-04-25T09:04:37.361317+0000","last_became_peered":"2024-04-25T09:04:37.361317+0000","last_unstale":"2024-04-25T09:04:38.326481+0000","last_undegraded":"2024-04-25T09:04:38.326481+0000","last_fullsized":"2024-04-25T09:04:38.326481+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:24.769393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.752767+0000","last_change":"2024-04-25T09:04:37.360665+0000","last_active":"2024-04-25T09:04:38.752767+0000","last_peered":"2024-04-25T09:04:38.752767+0000","last_clean":"2024-04-25T09:04:38.752767+0000","last_became_active":"2024-04-25T09:04:37.360225+0000","last_became_peered":"2024-04-25T09:04:37.360225+0000","last_unstale":"2024-04-25T09:04:38.752767+0000","last_undegraded":"2024-04-25T09:04:38.752767+0000","last_fullsized":"2024-04-25T09:04:38.752767+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:03.809027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328272+0000","last_change":"2024-04-25T09:04:37.362946+0000","last_active":"2024-04-25T09:04:38.328272+0000","last_peered":"2024-04-25T09:04:38.328272+0000","last_clean":"2024-04-25T09:04:38.328272+0000","last_became_active":"2024-04-25T09:04:37.362686+0000","last_became_peered":"2024-04-25T09:04:37.362686+0000","last_unstale":"2024-04-25T09:04:38.328272+0000","last_undegraded":"2024-04-25T09:04:38.328272+0000","last_fullsized":"2024-04-25T09:04:38.328272+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:52.290727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538847+0000","last_change":"2024-04-25T09:04:37.361357+0000","last_active":"2024-04-25T09:04:39.538847+0000","last_peered":"2024-04-25T09:04:39.538847+0000","last_clean":"2024-04-25T09:04:39.538847+0000","last_became_active":"2024-04-25T09:04:37.361076+0000","last_became_peered":"2024-04-25T09:04:37.361076+0000","last_unstale":"2024-04-25T09:04:39.538847+0000","last_undegraded":"2024-04-25T09:04:39.538847+0000","last_fullsized":"2024-04-25T09:04:39.538847+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:05.082632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538574+0000","last_change":"2024-04-25T09:04:37.346796+0000","last_active":"2024-04-25T09:04:39.538574+0000","last_peered":"2024-04-25T09:04:39.538574+0000","last_clean":"2024-04-25T09:04:39.538574+0000","last_became_active":"2024-04-25T09:04:37.346475+0000","last_became_peered":"2024-04-25T09:04:37.346475+0000","last_unstale":"2024-04-25T09:04:39.538574+0000","last_undegraded":"2024-04-25T09:04:39.538574+0000","last_fullsized":"2024-04-25T09:04:39.538574+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:42.888119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328828+0000","last_change":"2024-04-25T09:04:37.350262+0000","last_active":"2024-04-25T09:04:38.328828+0000","last_peered":"2024-04-25T09:04:38.328828+0000","last_clean":"2024-04-25T09:04:38.328828+0000","last_became_active":"2024-04-25T09:04:37.347134+0000","last_became_peered":"2024-04-25T09:04:37.347134+0000","last_unstale":"2024-04-25T09:04:38.328828+0000","last_undegraded":"2024-04-25T09:04:38.328828+0000","last_fullsized":"2024-04-25T09:04:38.328828+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:28.394744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329600+0000","last_change":"2024-04-25T09:04:37.347079+0000","last_active":"2024-04-25T09:04:38.329600+0000","last_peered":"2024-04-25T09:04:38.329600+0000","last_clean":"2024-04-25T09:04:38.329600+0000","last_became_active":"2024-04-25T09:04:37.346813+0000","last_became_peered":"2024-04-25T09:04:37.346813+0000","last_unstale":"2024-04-25T09:04:38.329600+0000","last_undegraded":"2024-04-25T09:04:38.329600+0000","last_fullsized":"2024-04-25T09:04:38.329600+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:31.625853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329793+0000","last_change":"2024-04-25T09:04:37.335924+0000","last_active":"2024-04-25T09:04:38.329793+0000","last_peered":"2024-04-25T09:04:38.329793+0000","last_clean":"2024-04-25T09:04:38.329793+0000","last_became_active":"2024-04-25T09:04:37.335604+0000","last_became_peered":"2024-04-25T09:04:37.335604+0000","last_unstale":"2024-04-25T09:04:38.329793+0000","last_undegraded":"2024-04-25T09:04:38.329793+0000","last_fullsized":"2024-04-25T09:04:38.329793+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:05.082632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538643+0000","last_change":"2024-04-25T09:04:37.353522+0000","last_active":"2024-04-25T09:04:39.538643+0000","last_peered":"2024-04-25T09:04:39.538643+0000","last_clean":"2024-04-25T09:04:39.538643+0000","last_became_active":"2024-04-25T09:04:37.351341+0000","last_became_peered":"2024-04-25T09:04:37.351341+0000","last_unstale":"2024-04-25T09:04:39.538643+0000","last_undegraded":"2024-04-25T09:04:39.538643+0000","last_fullsized":"2024-04-25T09:04:39.538643+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:01.937640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538704+0000","last_change":"2024-04-25T09:04:37.354514+0000","last_active":"2024-04-25T09:04:39.538704+0000","last_peered":"2024-04-25T09:04:39.538704+0000","last_clean":"2024-04-25T09:04:39.538704+0000","last_became_active":"2024-04-25T09:04:37.354234+0000","last_became_peered":"2024-04-25T09:04:37.354234+0000","last_unstale":"2024-04-25T09:04:39.538704+0000","last_undegraded":"2024-04-25T09:04:39.538704+0000","last_fullsized":"2024-04-25T09:04:39.538704+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:28.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.752818+0000","last_change":"2024-04-25T09:04:37.358110+0000","last_active":"2024-04-25T09:04:38.752818+0000","last_peered":"2024-04-25T09:04:38.752818+0000","last_clean":"2024-04-25T09:04:38.752818+0000","last_became_active":"2024-04-25T09:04:37.357389+0000","last_became_peered":"2024-04-25T09:04:37.357389+0000","last_unstale":"2024-04-25T09:04:38.752818+0000","last_undegraded":"2024-04-25T09:04:38.752818+0000","last_fullsized":"2024-04-25T09:04:38.752818+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:53.398163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538140+0000","last_change":"2024-04-25T09:04:37.359815+0000","last_active":"2024-04-25T09:04:39.538140+0000","last_peered":"2024-04-25T09:04:39.538140+0000","last_clean":"2024-04-25T09:04:39.538140+0000","last_became_active":"2024-04-25T09:04:37.359494+0000","last_became_peered":"2024-04-25T09:04:37.359494+0000","last_unstale":"2024-04-25T09:04:39.538140+0000","last_undegraded":"2024-04-25T09:04:39.538140+0000","last_fullsized":"2024-04-25T09:04:39.538140+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:16.550296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329074+0000","last_change":"2024-04-25T09:04:37.338663+0000","last_active":"2024-04-25T09:04:38.329074+0000","last_peered":"2024-04-25T09:04:38.329074+0000","last_clean":"2024-04-25T09:04:38.329074+0000","last_became_active":"2024-04-25T09:04:37.338374+0000","last_became_peered":"2024-04-25T09:04:37.338374+0000","last_unstale":"2024-04-25T09:04:38.329074+0000","last_undegraded":"2024-04-25T09:04:38.329074+0000","last_fullsized":"2024-04-25T09:04:38.329074+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:04.559616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990230+0000","last_change":"2024-04-25T09:04:37.367539+0000","last_active":"2024-04-25T09:04:38.990230+0000","last_peered":"2024-04-25T09:04:38.990230+0000","last_clean":"2024-04-25T09:04:38.990230+0000","last_became_active":"2024-04-25T09:04:37.367223+0000","last_became_peered":"2024-04-25T09:04:37.367223+0000","last_unstale":"2024-04-25T09:04:38.990230+0000","last_undegraded":"2024-04-25T09:04:38.990230+0000","last_fullsized":"2024-04-25T09:04:38.990230+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:47.342815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538202+0000","last_change":"2024-04-25T09:04:37.358070+0000","last_active":"2024-04-25T09:04:39.538202+0000","last_peered":"2024-04-25T09:04:39.538202+0000","last_clean":"2024-04-25T09:04:39.538202+0000","last_became_active":"2024-04-25T09:04:37.357696+0000","last_became_peered":"2024-04-25T09:04:37.357696+0000","last_unstale":"2024-04-25T09:04:39.538202+0000","last_undegraded":"2024-04-25T09:04:39.538202+0000","last_fullsized":"2024-04-25T09:04:39.538202+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:45:20.864447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329881+0000","last_change":"2024-04-25T09:04:37.349938+0000","last_active":"2024-04-25T09:04:38.329881+0000","last_peered":"2024-04-25T09:04:38.329881+0000","last_clean":"2024-04-25T09:04:38.329881+0000","last_became_active":"2024-04-25T09:04:37.349608+0000","last_became_peered":"2024-04-25T09:04:37.349608+0000","last_unstale":"2024-04-25T09:04:38.329881+0000","last_undegraded":"2024-04-25T09:04:38.329881+0000","last_fullsized":"2024-04-25T09:04:38.329881+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.482619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537676+0000","last_change":"2024-04-25T09:04:37.351500+0000","last_active":"2024-04-25T09:04:39.537676+0000","last_peered":"2024-04-25T09:04:39.537676+0000","last_clean":"2024-04-25T09:04:39.537676+0000","last_became_active":"2024-04-25T09:04:37.351080+0000","last_became_peered":"2024-04-25T09:04:37.351080+0000","last_unstale":"2024-04-25T09:04:39.537676+0000","last_undegraded":"2024-04-25T09:04:39.537676+0000","last_fullsized":"2024-04-25T09:04:39.537676+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:15.941209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537339+0000","last_change":"2024-04-25T09:04:37.355123+0000","last_active":"2024-04-25T09:04:39.537339+0000","last_peered":"2024-04-25T09:04:39.537339+0000","last_clean":"2024-04-25T09:04:39.537339+0000","last_became_active":"2024-04-25T09:04:37.354748+0000","last_became_peered":"2024-04-25T09:04:37.354748+0000","last_unstale":"2024-04-25T09:04:39.537339+0000","last_undegraded":"2024-04-25T09:04:39.537339+0000","last_fullsized":"2024-04-25T09:04:39.537339+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:09:09.326615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538590+0000","last_change":"2024-04-25T09:04:37.354655+0000","last_active":"2024-04-25T09:04:39.538590+0000","last_peered":"2024-04-25T09:04:39.538590+0000","last_clean":"2024-04-25T09:04:39.538590+0000","last_became_active":"2024-04-25T09:04:37.354373+0000","last_became_peered":"2024-04-25T09:04:37.354373+0000","last_unstale":"2024-04-25T09:04:39.538590+0000","last_undegraded":"2024-04-25T09:04:39.538590+0000","last_fullsized":"2024-04-25T09:04:39.538590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:31.625853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329907+0000","last_change":"2024-04-25T09:04:37.353606+0000","last_active":"2024-04-25T09:04:38.329907+0000","last_peered":"2024-04-25T09:04:38.329907+0000","last_clean":"2024-04-25T09:04:38.329907+0000","last_became_active":"2024-04-25T09:04:37.353309+0000","last_became_peered":"2024-04-25T09:04:37.353309+0000","last_unstale":"2024-04-25T09:04:38.329907+0000","last_undegraded":"2024-04-25T09:04:38.329907+0000","last_fullsized":"2024-04-25T09:04:38.329907+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:24.769393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329694+0000","last_change":"2024-04-25T09:04:37.350619+0000","last_active":"2024-04-25T09:04:38.329694+0000","last_peered":"2024-04-25T09:04:38.329694+0000","last_clean":"2024-04-25T09:04:38.329694+0000","last_became_active":"2024-04-25T09:04:37.350384+0000","last_became_peered":"2024-04-25T09:04:37.350384+0000","last_unstale":"2024-04-25T09:04:38.329694+0000","last_undegraded":"2024-04-25T09:04:38.329694+0000","last_fullsized":"2024-04-25T09:04:38.329694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:28.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328809+0000","last_change":"2024-04-25T09:04:37.365688+0000","last_active":"2024-04-25T09:04:38.328809+0000","last_peered":"2024-04-25T09:04:38.328809+0000","last_clean":"2024-04-25T09:04:38.328809+0000","last_became_active":"2024-04-25T09:04:37.365393+0000","last_became_peered":"2024-04-25T09:04:37.365393+0000","last_unstale":"2024-04-25T09:04:38.328809+0000","last_undegraded":"2024-04-25T09:04:38.328809+0000","last_fullsized":"2024-04-25T09:04:38.328809+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:20.870831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537340+0000","last_change":"2024-04-25T09:04:37.356127+0000","last_active":"2024-04-25T09:04:39.537340+0000","last_peered":"2024-04-25T09:04:39.537340+0000","last_clean":"2024-04-25T09:04:39.537340+0000","last_became_active":"2024-04-25T09:04:37.355696+0000","last_became_peered":"2024-04-25T09:04:37.355696+0000","last_unstale":"2024-04-25T09:04:39.537340+0000","last_undegraded":"2024-04-25T09:04:39.537340+0000","last_fullsized":"2024-04-25T09:04:39.537340+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.018634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538912+0000","last_change":"2024-04-25T09:04:37.346933+0000","last_active":"2024-04-25T09:04:39.538912+0000","last_peered":"2024-04-25T09:04:39.538912+0000","last_clean":"2024-04-25T09:04:39.538912+0000","last_became_active":"2024-04-25T09:04:37.346538+0000","last_became_peered":"2024-04-25T09:04:37.346538+0000","last_unstale":"2024-04-25T09:04:39.538912+0000","last_undegraded":"2024-04-25T09:04:39.538912+0000","last_fullsized":"2024-04-25T09:04:39.538912+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:24.769393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329729+0000","last_change":"2024-04-25T09:04:37.362945+0000","last_active":"2024-04-25T09:04:38.329729+0000","last_peered":"2024-04-25T09:04:38.329729+0000","last_clean":"2024-04-25T09:04:38.329729+0000","last_became_active":"2024-04-25T09:04:37.362610+0000","last_became_peered":"2024-04-25T09:04:37.362610+0000","last_unstale":"2024-04-25T09:04:38.329729+0000","last_undegraded":"2024-04-25T09:04:38.329729+0000","last_fullsized":"2024-04-25T09:04:38.329729+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:03.389766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328507+0000","last_change":"2024-04-25T09:04:37.352321+0000","last_active":"2024-04-25T09:04:38.328507+0000","last_peered":"2024-04-25T09:04:38.328507+0000","last_clean":"2024-04-25T09:04:38.328507+0000","last_became_active":"2024-04-25T09:04:37.351711+0000","last_became_peered":"2024-04-25T09:04:37.351711+0000","last_unstale":"2024-04-25T09:04:38.328507+0000","last_undegraded":"2024-04-25T09:04:38.328507+0000","last_fullsized":"2024-04-25T09:04:38.328507+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:50.082022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.326163+0000","last_change":"2024-04-25T09:04:37.368630+0000","last_active":"2024-04-25T09:04:38.326163+0000","last_peered":"2024-04-25T09:04:38.326163+0000","last_clean":"2024-04-25T09:04:38.326163+0000","last_became_active":"2024-04-25T09:04:37.368299+0000","last_became_peered":"2024-04-25T09:04:37.368299+0000","last_unstale":"2024-04-25T09:04:38.326163+0000","last_undegraded":"2024-04-25T09:04:38.326163+0000","last_fullsized":"2024-04-25T09:04:38.326163+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:28.866886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990224+0000","last_change":"2024-04-25T09:04:37.365292+0000","last_active":"2024-04-25T09:04:38.990224+0000","last_peered":"2024-04-25T09:04:38.990224+0000","last_clean":"2024-04-25T09:04:38.990224+0000","last_became_active":"2024-04-25T09:04:37.364926+0000","last_became_peered":"2024-04-25T09:04:37.364926+0000","last_unstale":"2024-04-25T09:04:38.990224+0000","last_undegraded":"2024-04-25T09:04:38.990224+0000","last_fullsized":"2024-04-25T09:04:38.990224+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:27.671043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"65'4","reported_seq":18,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538194+0000","last_change":"2024-04-25T09:04:36.347766+0000","last_active":"2024-04-25T09:04:39.538194+0000","last_peered":"2024-04-25T09:04:39.538194+0000","last_clean":"2024-04-25T09:04:39.538194+0000","last_became_active":"2024-04-25T09:04:36.346920+0000","last_became_peered":"2024-04-25T09:04:36.346920+0000","last_unstale":"2024-04-25T09:04:39.538194+0000","last_undegraded":"2024-04-25T09:04:39.538194+0000","last_fullsized":"2024-04-25T09:04:39.538194+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:22.787630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329059+0000","last_change":"2024-04-25T09:04:37.347747+0000","last_active":"2024-04-25T09:04:38.329059+0000","last_peered":"2024-04-25T09:04:38.329059+0000","last_clean":"2024-04-25T09:04:38.329059+0000","last_became_active":"2024-04-25T09:04:37.347485+0000","last_became_peered":"2024-04-25T09:04:37.347485+0000","last_unstale":"2024-04-25T09:04:38.329059+0000","last_undegraded":"2024-04-25T09:04:38.329059+0000","last_fullsized":"2024-04-25T09:04:38.329059+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:47.851420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.326958+0000","last_change":"2024-04-25T09:04:36.343383+0000","last_active":"2024-04-25T09:04:38.326958+0000","last_peered":"2024-04-25T09:04:38.326958+0000","last_clean":"2024-04-25T09:04:38.326958+0000","last_became_active":"2024-04-25T09:04:36.343053+0000","last_became_peered":"2024-04-25T09:04:36.343053+0000","last_unstale":"2024-04-25T09:04:38.326958+0000","last_undegraded":"2024-04-25T09:04:38.326958+0000","last_fullsized":"2024-04-25T09:04:38.326958+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:04.002493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.326925+0000","last_change":"2024-04-25T09:04:37.351793+0000","last_active":"2024-04-25T09:04:38.326925+0000","last_peered":"2024-04-25T09:04:38.326925+0000","last_clean":"2024-04-25T09:04:38.326925+0000","last_became_active":"2024-04-25T09:04:37.351445+0000","last_became_peered":"2024-04-25T09:04:37.351445+0000","last_unstale":"2024-04-25T09:04:38.326925+0000","last_undegraded":"2024-04-25T09:04:38.326925+0000","last_fullsized":"2024-04-25T09:04:38.326925+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:23.860053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.326740+0000","last_change":"2024-04-25T09:04:36.344974+0000","last_active":"2024-04-25T09:04:38.326740+0000","last_peered":"2024-04-25T09:04:38.326740+0000","last_clean":"2024-04-25T09:04:38.326740+0000","last_became_active":"2024-04-25T09:04:36.344311+0000","last_became_peered":"2024-04-25T09:04:36.344311+0000","last_unstale":"2024-04-25T09:04:38.326740+0000","last_undegraded":"2024-04-25T09:04:38.326740+0000","last_fullsized":"2024-04-25T09:04:38.326740+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:46:15.541567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538596+0000","last_change":"2024-04-25T09:04:37.346001+0000","last_active":"2024-04-25T09:04:39.538596+0000","last_peered":"2024-04-25T09:04:39.538596+0000","last_clean":"2024-04-25T09:04:39.538596+0000","last_became_active":"2024-04-25T09:04:37.345725+0000","last_became_peered":"2024-04-25T09:04:37.345725+0000","last_unstale":"2024-04-25T09:04:39.538596+0000","last_undegraded":"2024-04-25T09:04:39.538596+0000","last_fullsized":"2024-04-25T09:04:39.538596+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:03.389766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.326535+0000","last_change":"2024-04-25T09:04:36.346934+0000","last_active":"2024-04-25T09:04:38.326535+0000","last_peered":"2024-04-25T09:04:38.326535+0000","last_clean":"2024-04-25T09:04:38.326535+0000","last_became_active":"2024-04-25T09:04:36.344639+0000","last_became_peered":"2024-04-25T09:04:36.344639+0000","last_unstale":"2024-04-25T09:04:38.326535+0000","last_undegraded":"2024-04-25T09:04:38.326535+0000","last_fullsized":"2024-04-25T09:04:38.326535+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:36.737393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.752817+0000","last_change":"2024-04-25T09:04:37.358317+0000","last_active":"2024-04-25T09:04:38.752817+0000","last_peered":"2024-04-25T09:04:38.752817+0000","last_clean":"2024-04-25T09:04:38.752817+0000","last_became_active":"2024-04-25T09:04:37.357706+0000","last_became_peered":"2024-04-25T09:04:37.357706+0000","last_unstale":"2024-04-25T09:04:38.752817+0000","last_undegraded":"2024-04-25T09:04:38.752817+0000","last_fullsized":"2024-04-25T09:04:38.752817+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:34.975061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538418+0000","last_change":"2024-04-25T09:04:36.340458+0000","last_active":"2024-04-25T09:04:39.538418+0000","last_peered":"2024-04-25T09:04:39.538418+0000","last_clean":"2024-04-25T09:04:39.538418+0000","last_became_active":"2024-04-25T09:04:36.340184+0000","last_became_peered":"2024-04-25T09:04:36.340184+0000","last_unstale":"2024-04-25T09:04:39.538418+0000","last_undegraded":"2024-04-25T09:04:39.538418+0000","last_fullsized":"2024-04-25T09:04:39.538418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:41.879390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537063+0000","last_change":"2024-04-25T09:04:37.353095+0000","last_active":"2024-04-25T09:04:39.537063+0000","last_peered":"2024-04-25T09:04:39.537063+0000","last_clean":"2024-04-25T09:04:39.537063+0000","last_became_active":"2024-04-25T09:04:37.352874+0000","last_became_peered":"2024-04-25T09:04:37.352874+0000","last_unstale":"2024-04-25T09:04:39.537063+0000","last_undegraded":"2024-04-25T09:04:39.537063+0000","last_fullsized":"2024-04-25T09:04:39.537063+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:47.342815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537777+0000","last_change":"2024-04-25T09:04:36.343134+0000","last_active":"2024-04-25T09:04:39.537777+0000","last_peered":"2024-04-25T09:04:39.537777+0000","last_clean":"2024-04-25T09:04:39.537777+0000","last_became_active":"2024-04-25T09:04:36.342796+0000","last_became_peered":"2024-04-25T09:04:36.342796+0000","last_unstale":"2024-04-25T09:04:39.537777+0000","last_undegraded":"2024-04-25T09:04:39.537777+0000","last_fullsized":"2024-04-25T09:04:39.537777+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:02.381037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.989939+0000","last_change":"2024-04-25T09:04:37.356214+0000","last_active":"2024-04-25T09:04:38.989939+0000","last_peered":"2024-04-25T09:04:38.989939+0000","last_clean":"2024-04-25T09:04:38.989939+0000","last_became_active":"2024-04-25T09:04:37.352941+0000","last_became_peered":"2024-04-25T09:04:37.352941+0000","last_unstale":"2024-04-25T09:04:38.989939+0000","last_undegraded":"2024-04-25T09:04:38.989939+0000","last_fullsized":"2024-04-25T09:04:38.989939+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:04.559616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537428+0000","last_change":"2024-04-25T09:04:36.345626+0000","last_active":"2024-04-25T09:04:39.537428+0000","last_peered":"2024-04-25T09:04:39.537428+0000","last_clean":"2024-04-25T09:04:39.537428+0000","last_became_active":"2024-04-25T09:04:36.345115+0000","last_became_peered":"2024-04-25T09:04:36.345115+0000","last_unstale":"2024-04-25T09:04:39.537428+0000","last_undegraded":"2024-04-25T09:04:39.537428+0000","last_fullsized":"2024-04-25T09:04:39.537428+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:44.682506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538255+0000","last_change":"2024-04-25T09:04:37.339515+0000","last_active":"2024-04-25T09:04:39.538255+0000","last_peered":"2024-04-25T09:04:39.538255+0000","last_clean":"2024-04-25T09:04:39.538255+0000","last_became_active":"2024-04-25T09:04:37.339248+0000","last_became_peered":"2024-04-25T09:04:37.339248+0000","last_unstale":"2024-04-25T09:04:39.538255+0000","last_undegraded":"2024-04-25T09:04:39.538255+0000","last_fullsized":"2024-04-25T09:04:39.538255+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:28:44.187237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990390+0000","last_change":"2024-04-25T09:04:36.344876+0000","last_active":"2024-04-25T09:04:38.990390+0000","last_peered":"2024-04-25T09:04:38.990390+0000","last_clean":"2024-04-25T09:04:38.990390+0000","last_became_active":"2024-04-25T09:04:36.343902+0000","last_became_peered":"2024-04-25T09:04:36.343902+0000","last_unstale":"2024-04-25T09:04:38.990390+0000","last_undegraded":"2024-04-25T09:04:38.990390+0000","last_fullsized":"2024-04-25T09:04:38.990390+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:04.445798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537416+0000","last_change":"2024-04-25T09:04:37.355904+0000","last_active":"2024-04-25T09:04:39.537416+0000","last_peered":"2024-04-25T09:04:39.537416+0000","last_clean":"2024-04-25T09:04:39.537416+0000","last_became_active":"2024-04-25T09:04:37.355485+0000","last_became_peered":"2024-04-25T09:04:37.355485+0000","last_unstale":"2024-04-25T09:04:39.537416+0000","last_undegraded":"2024-04-25T09:04:39.537416+0000","last_fullsized":"2024-04-25T09:04:39.537416+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:32.137105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538939+0000","last_change":"2024-04-25T09:04:36.352488+0000","last_active":"2024-04-25T09:04:39.538939+0000","last_peered":"2024-04-25T09:04:39.538939+0000","last_clean":"2024-04-25T09:04:39.538939+0000","last_became_active":"2024-04-25T09:04:36.352201+0000","last_became_peered":"2024-04-25T09:04:36.352201+0000","last_unstale":"2024-04-25T09:04:39.538939+0000","last_undegraded":"2024-04-25T09:04:39.538939+0000","last_fullsized":"2024-04-25T09:04:39.538939+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:31.336176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538094+0000","last_change":"2024-04-25T09:04:37.352992+0000","last_active":"2024-04-25T09:04:39.538094+0000","last_peered":"2024-04-25T09:04:39.538094+0000","last_clean":"2024-04-25T09:04:39.538094+0000","last_became_active":"2024-04-25T09:04:37.352668+0000","last_became_peered":"2024-04-25T09:04:37.352668+0000","last_unstale":"2024-04-25T09:04:39.538094+0000","last_undegraded":"2024-04-25T09:04:39.538094+0000","last_fullsized":"2024-04-25T09:04:39.538094+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:27:33.077053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329213+0000","last_change":"2024-04-25T09:04:36.347625+0000","last_active":"2024-04-25T09:04:38.329213+0000","last_peered":"2024-04-25T09:04:38.329213+0000","last_clean":"2024-04-25T09:04:38.329213+0000","last_became_active":"2024-04-25T09:04:36.347331+0000","last_became_peered":"2024-04-25T09:04:36.347331+0000","last_unstale":"2024-04-25T09:04:38.329213+0000","last_undegraded":"2024-04-25T09:04:38.329213+0000","last_fullsized":"2024-04-25T09:04:38.329213+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:33.054412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990228+0000","last_change":"2024-04-25T09:04:37.357919+0000","last_active":"2024-04-25T09:04:38.990228+0000","last_peered":"2024-04-25T09:04:38.990228+0000","last_clean":"2024-04-25T09:04:38.990228+0000","last_became_active":"2024-04-25T09:04:37.354654+0000","last_became_peered":"2024-04-25T09:04:37.354654+0000","last_unstale":"2024-04-25T09:04:38.990228+0000","last_undegraded":"2024-04-25T09:04:38.990228+0000","last_fullsized":"2024-04-25T09:04:38.990228+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:20:32.344905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"65'3","reported_seq":17,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538503+0000","last_change":"2024-04-25T09:04:36.347900+0000","last_active":"2024-04-25T09:04:39.538503+0000","last_peered":"2024-04-25T09:04:39.538503+0000","last_clean":"2024-04-25T09:04:39.538503+0000","last_became_active":"2024-04-25T09:04:36.347573+0000","last_became_peered":"2024-04-25T09:04:36.347573+0000","last_unstale":"2024-04-25T09:04:39.538503+0000","last_undegraded":"2024-04-25T09:04:39.538503+0000","last_fullsized":"2024-04-25T09:04:39.538503+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:14.312987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329314+0000","last_change":"2024-04-25T09:04:37.341070+0000","last_active":"2024-04-25T09:04:38.329314+0000","last_peered":"2024-04-25T09:04:38.329314+0000","last_clean":"2024-04-25T09:04:38.329314+0000","last_became_active":"2024-04-25T09:04:37.339875+0000","last_became_peered":"2024-04-25T09:04:37.339875+0000","last_unstale":"2024-04-25T09:04:38.329314+0000","last_undegraded":"2024-04-25T09:04:38.329314+0000","last_fullsized":"2024-04-25T09:04:38.329314+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:06.409692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"65'6","reported_seq":20,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537400+0000","last_change":"2024-04-25T09:04:36.350305+0000","last_active":"2024-04-25T09:04:39.537400+0000","last_peered":"2024-04-25T09:04:39.537400+0000","last_clean":"2024-04-25T09:04:39.537400+0000","last_became_active":"2024-04-25T09:04:36.350028+0000","last_became_peered":"2024-04-25T09:04:36.350028+0000","last_unstale":"2024-04-25T09:04:39.537400+0000","last_undegraded":"2024-04-25T09:04:39.537400+0000","last_fullsized":"2024-04-25T09:04:39.537400+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:40:49.073293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328342+0000","last_change":"2024-04-25T09:04:37.342486+0000","last_active":"2024-04-25T09:04:38.328342+0000","last_peered":"2024-04-25T09:04:38.328342+0000","last_clean":"2024-04-25T09:04:38.328342+0000","last_became_active":"2024-04-25T09:04:37.342184+0000","last_became_peered":"2024-04-25T09:04:37.342184+0000","last_unstale":"2024-04-25T09:04:38.328342+0000","last_undegraded":"2024-04-25T09:04:38.328342+0000","last_fullsized":"2024-04-25T09:04:38.328342+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:55.091009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538718+0000","last_change":"2024-04-25T09:04:36.346274+0000","last_active":"2024-04-25T09:04:39.538718+0000","last_peered":"2024-04-25T09:04:39.538718+0000","last_clean":"2024-04-25T09:04:39.538718+0000","last_became_active":"2024-04-25T09:04:36.345688+0000","last_became_peered":"2024-04-25T09:04:36.345688+0000","last_unstale":"2024-04-25T09:04:39.538718+0000","last_undegraded":"2024-04-25T09:04:39.538718+0000","last_fullsized":"2024-04-25T09:04:39.538718+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:03.550887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328817+0000","last_change":"2024-04-25T09:04:37.337434+0000","last_active":"2024-04-25T09:04:38.328817+0000","last_peered":"2024-04-25T09:04:38.328817+0000","last_clean":"2024-04-25T09:04:38.328817+0000","last_became_active":"2024-04-25T09:04:37.337151+0000","last_became_peered":"2024-04-25T09:04:37.337151+0000","last_unstale":"2024-04-25T09:04:38.328817+0000","last_undegraded":"2024-04-25T09:04:38.328817+0000","last_fullsized":"2024-04-25T09:04:38.328817+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:45.691235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329434+0000","last_change":"2024-04-25T09:04:36.341352+0000","last_active":"2024-04-25T09:04:38.329434+0000","last_peered":"2024-04-25T09:04:38.329434+0000","last_clean":"2024-04-25T09:04:38.329434+0000","last_became_active":"2024-04-25T09:04:36.341071+0000","last_became_peered":"2024-04-25T09:04:36.341071+0000","last_unstale":"2024-04-25T09:04:38.329434+0000","last_undegraded":"2024-04-25T09:04:38.329434+0000","last_fullsized":"2024-04-25T09:04:38.329434+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:46.842691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990353+0000","last_change":"2024-04-25T09:04:37.368519+0000","last_active":"2024-04-25T09:04:38.990353+0000","last_peered":"2024-04-25T09:04:38.990353+0000","last_clean":"2024-04-25T09:04:38.990353+0000","last_became_active":"2024-04-25T09:04:37.368298+0000","last_became_peered":"2024-04-25T09:04:37.368298+0000","last_unstale":"2024-04-25T09:04:38.990353+0000","last_undegraded":"2024-04-25T09:04:38.990353+0000","last_fullsized":"2024-04-25T09:04:38.990353+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:37.746122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538419+0000","last_change":"2024-04-25T09:04:36.346746+0000","last_active":"2024-04-25T09:04:39.538419+0000","last_peered":"2024-04-25T09:04:39.538419+0000","last_clean":"2024-04-25T09:04:39.538419+0000","last_became_active":"2024-04-25T09:04:36.346418+0000","last_became_peered":"2024-04-25T09:04:36.346418+0000","last_unstale":"2024-04-25T09:04:39.538419+0000","last_undegraded":"2024-04-25T09:04:39.538419+0000","last_fullsized":"2024-04-25T09:04:39.538419+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:40:46.842691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537694+0000","last_change":"2024-04-25T09:04:37.348538+0000","last_active":"2024-04-25T09:04:39.537694+0000","last_peered":"2024-04-25T09:04:39.537694+0000","last_clean":"2024-04-25T09:04:39.537694+0000","last_became_active":"2024-04-25T09:04:37.348258+0000","last_became_peered":"2024-04-25T09:04:37.348258+0000","last_unstale":"2024-04-25T09:04:39.537694+0000","last_undegraded":"2024-04-25T09:04:39.537694+0000","last_fullsized":"2024-04-25T09:04:39.537694+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:05.011222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"65'8","reported_seq":22,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.328461+0000","last_change":"2024-04-25T09:04:36.335056+0000","last_active":"2024-04-25T09:04:38.328461+0000","last_peered":"2024-04-25T09:04:38.328461+0000","last_clean":"2024-04-25T09:04:38.328461+0000","last_became_active":"2024-04-25T09:04:36.334767+0000","last_became_peered":"2024-04-25T09:04:36.334767+0000","last_unstale":"2024-04-25T09:04:38.328461+0000","last_undegraded":"2024-04-25T09:04:38.328461+0000","last_fullsized":"2024-04-25T09:04:38.328461+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:14.109033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538884+0000","last_change":"2024-04-25T09:04:37.363358+0000","last_active":"2024-04-25T09:04:39.538884+0000","last_peered":"2024-04-25T09:04:39.538884+0000","last_clean":"2024-04-25T09:04:39.538884+0000","last_became_active":"2024-04-25T09:04:37.361423+0000","last_became_peered":"2024-04-25T09:04:37.361423+0000","last_unstale":"2024-04-25T09:04:39.538884+0000","last_undegraded":"2024-04-25T09:04:39.538884+0000","last_fullsized":"2024-04-25T09:04:39.538884+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.482619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329758+0000","last_change":"2024-04-25T09:04:36.343724+0000","last_active":"2024-04-25T09:04:38.329758+0000","last_peered":"2024-04-25T09:04:38.329758+0000","last_clean":"2024-04-25T09:04:38.329758+0000","last_became_active":"2024-04-25T09:04:36.343331+0000","last_became_peered":"2024-04-25T09:04:36.343331+0000","last_unstale":"2024-04-25T09:04:38.329758+0000","last_undegraded":"2024-04-25T09:04:38.329758+0000","last_fullsized":"2024-04-25T09:04:38.329758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:14.312987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990319+0000","last_change":"2024-04-25T09:04:37.356959+0000","last_active":"2024-04-25T09:04:38.990319+0000","last_peered":"2024-04-25T09:04:38.990319+0000","last_clean":"2024-04-25T09:04:38.990319+0000","last_became_active":"2024-04-25T09:04:37.356522+0000","last_became_peered":"2024-04-25T09:04:37.356522+0000","last_unstale":"2024-04-25T09:04:38.990319+0000","last_undegraded":"2024-04-25T09:04:38.990319+0000","last_fullsized":"2024-04-25T09:04:38.990319+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:39:32.137105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538719+0000","last_change":"2024-04-25T09:04:36.343832+0000","last_active":"2024-04-25T09:04:39.538719+0000","last_peered":"2024-04-25T09:04:39.538719+0000","last_clean":"2024-04-25T09:04:39.538719+0000","last_became_active":"2024-04-25T09:04:36.343518+0000","last_became_peered":"2024-04-25T09:04:36.343518+0000","last_unstale":"2024-04-25T09:04:39.538719+0000","last_undegraded":"2024-04-25T09:04:39.538719+0000","last_fullsized":"2024-04-25T09:04:39.538719+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:26.662314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329108+0000","last_change":"2024-04-25T09:04:37.346741+0000","last_active":"2024-04-25T09:04:38.329108+0000","last_peered":"2024-04-25T09:04:38.329108+0000","last_clean":"2024-04-25T09:04:38.329108+0000","last_became_active":"2024-04-25T09:04:37.346422+0000","last_became_peered":"2024-04-25T09:04:37.346422+0000","last_unstale":"2024-04-25T09:04:38.329108+0000","last_undegraded":"2024-04-25T09:04:38.329108+0000","last_fullsized":"2024-04-25T09:04:38.329108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:15.321716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"65'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538634+0000","last_change":"2024-04-25T09:04:36.348753+0000","last_active":"2024-04-25T09:04:39.538634+0000","last_peered":"2024-04-25T09:04:39.538634+0000","last_clean":"2024-04-25T09:04:39.538634+0000","last_became_active":"2024-04-25T09:04:36.348450+0000","last_became_peered":"2024-04-25T09:04:36.348450+0000","last_unstale":"2024-04-25T09:04:39.538634+0000","last_undegraded":"2024-04-25T09:04:39.538634+0000","last_fullsized":"2024-04-25T09:04:39.538634+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:05.400963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990112+0000","last_change":"2024-04-25T09:04:37.346151+0000","last_active":"2024-04-25T09:04:38.990112+0000","last_peered":"2024-04-25T09:04:38.990112+0000","last_clean":"2024-04-25T09:04:38.990112+0000","last_became_active":"2024-04-25T09:04:37.345649+0000","last_became_peered":"2024-04-25T09:04:37.345649+0000","last_unstale":"2024-04-25T09:04:38.990112+0000","last_undegraded":"2024-04-25T09:04:38.990112+0000","last_fullsized":"2024-04-25T09:04:38.990112+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:06.409692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538290+0000","last_change":"2024-04-25T09:04:36.339613+0000","last_active":"2024-04-25T09:04:39.538290+0000","last_peered":"2024-04-25T09:04:39.538290+0000","last_clean":"2024-04-25T09:04:39.538290+0000","last_became_active":"2024-04-25T09:04:36.339308+0000","last_became_peered":"2024-04-25T09:04:36.339308+0000","last_unstale":"2024-04-25T09:04:39.538290+0000","last_undegraded":"2024-04-25T09:04:39.538290+0000","last_fullsized":"2024-04-25T09:04:39.538290+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:06:30.617124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.326173+0000","last_change":"2024-04-25T09:04:37.351562+0000","last_active":"2024-04-25T09:04:38.326173+0000","last_peered":"2024-04-25T09:04:38.326173+0000","last_clean":"2024-04-25T09:04:38.326173+0000","last_became_active":"2024-04-25T09:04:37.351054+0000","last_became_peered":"2024-04-25T09:04:37.351054+0000","last_unstale":"2024-04-25T09:04:38.326173+0000","last_undegraded":"2024-04-25T09:04:38.326173+0000","last_fullsized":"2024-04-25T09:04:38.326173+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:05.082632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.326391+0000","last_change":"2024-04-25T09:04:36.346826+0000","last_active":"2024-04-25T09:04:38.326391+0000","last_peered":"2024-04-25T09:04:38.326391+0000","last_clean":"2024-04-25T09:04:38.326391+0000","last_became_active":"2024-04-25T09:04:36.346570+0000","last_became_peered":"2024-04-25T09:04:36.346570+0000","last_unstale":"2024-04-25T09:04:38.326391+0000","last_undegraded":"2024-04-25T09:04:38.326391+0000","last_fullsized":"2024-04-25T09:04:38.326391+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:51.281998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329448+0000","last_change":"2024-04-25T09:04:37.351280+0000","last_active":"2024-04-25T09:04:38.329448+0000","last_peered":"2024-04-25T09:04:38.329448+0000","last_clean":"2024-04-25T09:04:38.329448+0000","last_became_active":"2024-04-25T09:04:37.350033+0000","last_became_peered":"2024-04-25T09:04:37.350033+0000","last_unstale":"2024-04-25T09:04:38.329448+0000","last_undegraded":"2024-04-25T09:04:38.329448+0000","last_fullsized":"2024-04-25T09:04:38.329448+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:42.888119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329547+0000","last_change":"2024-04-25T09:04:36.341281+0000","last_active":"2024-04-25T09:04:38.329547+0000","last_peered":"2024-04-25T09:04:38.329547+0000","last_clean":"2024-04-25T09:04:38.329547+0000","last_became_active":"2024-04-25T09:04:36.341014+0000","last_became_peered":"2024-04-25T09:04:36.341014+0000","last_unstale":"2024-04-25T09:04:38.329547+0000","last_undegraded":"2024-04-25T09:04:38.329547+0000","last_fullsized":"2024-04-25T09:04:38.329547+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:03.550887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990292+0000","last_change":"2024-04-25T09:04:37.351829+0000","last_active":"2024-04-25T09:04:38.990292+0000","last_peered":"2024-04-25T09:04:38.990292+0000","last_clean":"2024-04-25T09:04:38.990292+0000","last_became_active":"2024-04-25T09:04:37.351559+0000","last_became_peered":"2024-04-25T09:04:37.351559+0000","last_unstale":"2024-04-25T09:04:38.990292+0000","last_undegraded":"2024-04-25T09:04:38.990292+0000","last_fullsized":"2024-04-25T09:04:38.990292+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:30.581396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.326179+0000","last_change":"2024-04-25T09:04:36.344348+0000","last_active":"2024-04-25T09:04:38.326179+0000","last_peered":"2024-04-25T09:04:38.326179+0000","last_clean":"2024-04-25T09:04:38.326179+0000","last_became_active":"2024-04-25T09:04:36.343838+0000","last_became_peered":"2024-04-25T09:04:36.343838+0000","last_unstale":"2024-04-25T09:04:38.326179+0000","last_undegraded":"2024-04-25T09:04:38.326179+0000","last_fullsized":"2024-04-25T09:04:38.326179+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:45:01.752046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.326429+0000","last_change":"2024-04-25T09:04:37.333885+0000","last_active":"2024-04-25T09:04:38.326429+0000","last_peered":"2024-04-25T09:04:38.326429+0000","last_clean":"2024-04-25T09:04:38.326429+0000","last_became_active":"2024-04-25T09:04:37.333318+0000","last_became_peered":"2024-04-25T09:04:37.333318+0000","last_unstale":"2024-04-25T09:04:38.326429+0000","last_undegraded":"2024-04-25T09:04:38.326429+0000","last_fullsized":"2024-04-25T09:04:38.326429+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:51:48.482619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"65'2","reported_seq":16,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329960+0000","last_change":"2024-04-25T09:04:36.342188+0000","last_active":"2024-04-25T09:04:38.329960+0000","last_peered":"2024-04-25T09:04:38.329960+0000","last_clean":"2024-04-25T09:04:38.329960+0000","last_became_active":"2024-04-25T09:04:36.341891+0000","last_became_peered":"2024-04-25T09:04:36.341891+0000","last_unstale":"2024-04-25T09:04:38.329960+0000","last_undegraded":"2024-04-25T09:04:38.329960+0000","last_fullsized":"2024-04-25T09:04:38.329960+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:05.400963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.752913+0000","last_change":"2024-04-25T09:04:37.354697+0000","last_active":"2024-04-25T09:04:38.752913+0000","last_peered":"2024-04-25T09:04:38.752913+0000","last_clean":"2024-04-25T09:04:38.752913+0000","last_became_active":"2024-04-25T09:04:37.354351+0000","last_became_peered":"2024-04-25T09:04:37.354351+0000","last_unstale":"2024-04-25T09:04:38.752913+0000","last_undegraded":"2024-04-25T09:04:38.752913+0000","last_fullsized":"2024-04-25T09:04:38.752913+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:03:03.537043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"66'1","reported_seq":15,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.332177+0000","last_change":"2024-04-25T09:04:36.345342+0000","last_active":"2024-04-25T09:04:39.332177+0000","last_peered":"2024-04-25T09:04:39.332177+0000","last_clean":"2024-04-25T09:04:39.332177+0000","last_became_active":"2024-04-25T09:04:36.345020+0000","last_became_peered":"2024-04-25T09:04:36.345020+0000","last_unstale":"2024-04-25T09:04:39.332177+0000","last_undegraded":"2024-04-25T09:04:39.332177+0000","last_fullsized":"2024-04-25T09:04:39.332177+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:22.787630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329658+0000","last_change":"2024-04-25T09:04:37.338105+0000","last_active":"2024-04-25T09:04:38.329658+0000","last_peered":"2024-04-25T09:04:38.329658+0000","last_clean":"2024-04-25T09:04:38.329658+0000","last_became_active":"2024-04-25T09:04:37.337838+0000","last_became_peered":"2024-04-25T09:04:37.337838+0000","last_unstale":"2024-04-25T09:04:38.329658+0000","last_undegraded":"2024-04-25T09:04:38.329658+0000","last_fullsized":"2024-04-25T09:04:38.329658+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:01.937640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.326777+0000","last_change":"2024-04-25T09:04:36.345965+0000","last_active":"2024-04-25T09:04:38.326777+0000","last_peered":"2024-04-25T09:04:38.326777+0000","last_clean":"2024-04-25T09:04:38.326777+0000","last_became_active":"2024-04-25T09:04:36.344665+0000","last_became_peered":"2024-04-25T09:04:36.344665+0000","last_unstale":"2024-04-25T09:04:38.326777+0000","last_undegraded":"2024-04-25T09:04:38.326777+0000","last_fullsized":"2024-04-25T09:04:38.326777+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:38:01.620162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990083+0000","last_change":"2024-04-25T09:04:37.345919+0000","last_active":"2024-04-25T09:04:38.990083+0000","last_peered":"2024-04-25T09:04:38.990083+0000","last_clean":"2024-04-25T09:04:38.990083+0000","last_became_active":"2024-04-25T09:04:37.345256+0000","last_became_peered":"2024-04-25T09:04:37.345256+0000","last_unstale":"2024-04-25T09:04:38.990083+0000","last_undegraded":"2024-04-25T09:04:38.990083+0000","last_fullsized":"2024-04-25T09:04:38.990083+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:23.796358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537451+0000","last_change":"2024-04-25T09:04:36.350256+0000","last_active":"2024-04-25T09:04:39.537451+0000","last_peered":"2024-04-25T09:04:39.537451+0000","last_clean":"2024-04-25T09:04:39.537451+0000","last_became_active":"2024-04-25T09:04:36.349670+0000","last_became_peered":"2024-04-25T09:04:36.349670+0000","last_unstale":"2024-04-25T09:04:39.537451+0000","last_undegraded":"2024-04-25T09:04:39.537451+0000","last_fullsized":"2024-04-25T09:04:39.537451+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:28:19.862102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990415+0000","last_change":"2024-04-25T09:04:37.353391+0000","last_active":"2024-04-25T09:04:38.990415+0000","last_peered":"2024-04-25T09:04:38.990415+0000","last_clean":"2024-04-25T09:04:38.990415+0000","last_became_active":"2024-04-25T09:04:37.353041+0000","last_became_peered":"2024-04-25T09:04:37.353041+0000","last_unstale":"2024-04-25T09:04:38.990415+0000","last_undegraded":"2024-04-25T09:04:38.990415+0000","last_fullsized":"2024-04-25T09:04:38.990415+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:53:05.011222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538881+0000","last_change":"2024-04-25T09:04:36.346883+0000","last_active":"2024-04-25T09:04:39.538881+0000","last_peered":"2024-04-25T09:04:39.538881+0000","last_clean":"2024-04-25T09:04:39.538881+0000","last_became_active":"2024-04-25T09:04:36.346615+0000","last_became_peered":"2024-04-25T09:04:36.346615+0000","last_unstale":"2024-04-25T09:04:39.538881+0000","last_undegraded":"2024-04-25T09:04:39.538881+0000","last_fullsized":"2024-04-25T09:04:39.538881+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:22.787630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.329151+0000","last_change":"2024-04-25T09:04:37.340315+0000","last_active":"2024-04-25T09:04:38.329151+0000","last_peered":"2024-04-25T09:04:38.329151+0000","last_clean":"2024-04-25T09:04:38.329151+0000","last_became_active":"2024-04-25T09:04:37.340007+0000","last_became_peered":"2024-04-25T09:04:37.340007+0000","last_unstale":"2024-04-25T09:04:38.329151+0000","last_undegraded":"2024-04-25T09:04:38.329151+0000","last_fullsized":"2024-04-25T09:04:38.329151+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:23.796358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537866+0000","last_change":"2024-04-25T09:04:36.348240+0000","last_active":"2024-04-25T09:04:39.537866+0000","last_peered":"2024-04-25T09:04:39.537866+0000","last_clean":"2024-04-25T09:04:39.537866+0000","last_became_active":"2024-04-25T09:04:36.347523+0000","last_became_peered":"2024-04-25T09:04:36.347523+0000","last_unstale":"2024-04-25T09:04:39.537866+0000","last_undegraded":"2024-04-25T09:04:39.537866+0000","last_fullsized":"2024-04-25T09:04:39.537866+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:14:00.928911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537016+0000","last_change":"2024-04-25T09:04:37.352665+0000","last_active":"2024-04-25T09:04:39.537016+0000","last_peered":"2024-04-25T09:04:39.537016+0000","last_clean":"2024-04-25T09:04:39.537016+0000","last_became_active":"2024-04-25T09:04:37.352002+0000","last_became_peered":"2024-04-25T09:04:37.352002+0000","last_unstale":"2024-04-25T09:04:39.537016+0000","last_undegraded":"2024-04-25T09:04:39.537016+0000","last_fullsized":"2024-04-25T09:04:39.537016+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:31:30.581396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537580+0000","last_change":"2024-04-25T09:04:36.345392+0000","last_active":"2024-04-25T09:04:39.537580+0000","last_peered":"2024-04-25T09:04:39.537580+0000","last_clean":"2024-04-25T09:04:39.537580+0000","last_became_active":"2024-04-25T09:04:36.344773+0000","last_became_peered":"2024-04-25T09:04:36.344773+0000","last_unstale":"2024-04-25T09:04:39.537580+0000","last_undegraded":"2024-04-25T09:04:39.537580+0000","last_fullsized":"2024-04-25T09:04:39.537580+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:27.858158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.752679+0000","last_change":"2024-04-25T09:04:37.360408+0000","last_active":"2024-04-25T09:04:38.752679+0000","last_peered":"2024-04-25T09:04:38.752679+0000","last_clean":"2024-04-25T09:04:38.752679+0000","last_became_active":"2024-04-25T09:04:37.360102+0000","last_became_peered":"2024-04-25T09:04:37.360102+0000","last_unstale":"2024-04-25T09:04:38.752679+0000","last_undegraded":"2024-04-25T09:04:38.752679+0000","last_fullsized":"2024-04-25T09:04:38.752679+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:20.307924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.536997+0000","last_change":"2024-04-25T09:04:36.343080+0000","last_active":"2024-04-25T09:04:39.536997+0000","last_peered":"2024-04-25T09:04:39.536997+0000","last_clean":"2024-04-25T09:04:39.536997+0000","last_became_active":"2024-04-25T09:04:36.342734+0000","last_became_peered":"2024-04-25T09:04:36.342734+0000","last_unstale":"2024-04-25T09:04:39.536997+0000","last_undegraded":"2024-04-25T09:04:39.536997+0000","last_fullsized":"2024-04-25T09:04:39.536997+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:56:31.207366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":12,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:38.990275+0000","last_change":"2024-04-25T09:04:37.353577+0000","last_active":"2024-04-25T09:04:38.990275+0000","last_peered":"2024-04-25T09:04:38.990275+0000","last_clean":"2024-04-25T09:04:38.990275+0000","last_became_active":"2024-04-25T09:04:37.353073+0000","last_became_peered":"2024-04-25T09:04:37.353073+0000","last_unstale":"2024-04-25T09:04:38.990275+0000","last_undegraded":"2024-04-25T09:04:38.990275+0000","last_fullsized":"2024-04-25T09:04:38.990275+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:36.313588+0000","last_clean_scrub_stamp":"2024-04-25T09:04:36.313588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:45:59.018634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.537212+0000","last_change":"2024-04-25T09:04:36.346545+0000","last_active":"2024-04-25T09:04:39.537212+0000","last_peered":"2024-04-25T09:04:39.537212+0000","last_clean":"2024-04-25T09:04:39.537212+0000","last_became_active":"2024-04-25T09:04:36.346227+0000","last_became_peered":"2024-04-25T09:04:36.346227+0000","last_unstale":"2024-04-25T09:04:39.537212+0000","last_undegraded":"2024-04-25T09:04:39.537212+0000","last_fullsized":"2024-04-25T09:04:39.537212+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:04:35.304859+0000","last_clean_scrub_stamp":"2024-04-25T09:04:35.304859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:34:51.281998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":254,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-25T09:04:39.538201+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:04:39.538201+0000","last_peered":"2024-04-25T09:04:39.538201+0000","last_clean":"2024-04-25T09:04:39.538201+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:04:39.538201+0000","last_undegraded":"2024-04-25T09:04:39.538201+0000","last_fullsized":"2024-04-25T09:04:39.538201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1396736,"data_stored":946964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":790528,"data_stored":355854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":802816,"data_stored":362534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":811008,"data_stored":364124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574892,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31956,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339884,"statfs":{"total":96636764160,"available":96604041216,"internally_reserved":0,"allocated":786432,"data_stored":355820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":798720,"data_stored":362512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":358196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1392640,"data_stored":952880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:04:41.824 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:04:41.825 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:04:42.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.018+0000 7f10aea00640 1 Processor -- start 2024-04-25T09:04:42.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.018+0000 7f10aea00640 1 -- start start 2024-04-25T09:04:42.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aea00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f10a8159320 0x7f10a815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aea00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a815f440 0x7f10a806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10a806e010 0x7f10a806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aea00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a806d640 con 0x7f10a806e010 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aea00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a815fc00 con 0x7f10a8159320 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aea00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a815fee0 con 0x7f10a815f440 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10a806e010 0x7f10a806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10a806e010 0x7f10a806e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60652/0 (socket says 172.21.15.59:60652) 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aca00640 1 -- 172.21.15.59:0/3621019909 learned_addr learned my addr 172.21.15.59:0/3621019909 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f109f400640 1 --2- 172.21.15.59:0/3621019909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a815f440 0x7f10a806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10a7e00640 1 --2- 172.21.15.59:0/3621019909 >> v2:172.21.15.178:3300/0 conn(0x7f10a8159320 0x7f10a815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aca00640 1 -- 172.21.15.59:0/3621019909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a815f440 msgr2=0x7f10a806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aca00640 1 --2- 172.21.15.59:0/3621019909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a815f440 0x7f10a806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aca00640 1 -- 172.21.15.59:0/3621019909 >> v2:172.21.15.178:3300/0 conn(0x7f10a8159320 msgr2=0x7f10a815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aca00640 1 --2- 172.21.15.59:0/3621019909 >> v2:172.21.15.178:3300/0 conn(0x7f10a8159320 0x7f10a815c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.022+0000 7f10aca00640 1 -- 172.21.15.59:0/3621019909 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a81601c0 con 0x7f10a806e010 2024-04-25T09:04:42.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aca00640 1 --2- 172.21.15.59:0/3621019909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a806e010 0x7f10a806e4a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f10a806e470 tx=0x7f10a001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9695902614048d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10a7400640 1 -- 172.21.15.59:0/3621019909 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00a56c0 con 0x7f10a806e010 2024-04-25T09:04:42.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10a7400640 1 -- 172.21.15.59:0/3621019909 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a00a5860 con 0x7f10a806e010 2024-04-25T09:04:42.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10a7400640 1 -- 172.21.15.59:0/3621019909 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a00a5c30 con 0x7f10a806e010 2024-04-25T09:04:42.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 -- 172.21.15.59:0/3621019909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a806e010 msgr2=0x7f10a806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 --2- 172.21.15.59:0/3621019909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a806e010 0x7f10a806e4a0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f10a806e470 tx=0x7f10a001c930 comp rx=0 tx=0).stop 2024-04-25T09:04:42.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 -- 172.21.15.59:0/3621019909 shutdown_connections 2024-04-25T09:04:42.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 --2- 172.21.15.59:0/3621019909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a806e010 0x7f10a806e4a0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 --2- 172.21.15.59:0/3621019909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a815f440 0x7f10a806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 --2- 172.21.15.59:0/3621019909 >> v2:172.21.15.178:3300/0 conn(0x7f10a8159320 0x7f10a815c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 -- 172.21.15.59:0/3621019909 >> 172.21.15.59:0/3621019909 conn(0x7f10a8067080 msgr2=0x7f10a806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 -- 172.21.15.59:0/3621019909 shutdown_connections 2024-04-25T09:04:42.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 -- 172.21.15.59:0/3621019909 wait complete. 2024-04-25T09:04:42.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 Processor -- start 2024-04-25T09:04:42.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 -- start start 2024-04-25T09:04:42.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a806e010 0x7f10a81422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.026+0000 7f10aea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a8159320 0x7f10a80b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10aea00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a815f440 0x7f10a80b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10aea00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80cc440 con 0x7f10a8159320 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10aea00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80cc2c0 con 0x7f10a815f440 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10aea00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a80cc5c0 con 0x7f10a806e010 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f109f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a8159320 0x7f10a80b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10a7e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a806e010 0x7f10a81422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f109f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a8159320 0x7f10a80b29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60656/0 (socket says 172.21.15.59:60656) 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f109f400640 1 -- 172.21.15.59:0/3084002098 learned_addr learned my addr 172.21.15.59:0/3084002098 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10aca00640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a815f440 0x7f10a80b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10a7e00640 1 -- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a815f440 msgr2=0x7f10a80b2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10a7e00640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a815f440 0x7f10a80b2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10a7e00640 1 -- 172.21.15.59:0/3084002098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a8159320 msgr2=0x7f10a80b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10a7e00640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a8159320 0x7f10a80b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10a7e00640 1 -- 172.21.15.59:0/3084002098 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a80b3550 con 0x7f10a806e010 2024-04-25T09:04:42.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10a7e00640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a806e010 0x7f10a81422b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f109800e7f0 tx=0x7f109800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10a4c00640 1 -- 172.21.15.59:0/3084002098 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1098017070 con 0x7f10a806e010 2024-04-25T09:04:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10a4c00640 1 -- 172.21.15.59:0/3084002098 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109800c940 con 0x7f10a806e010 2024-04-25T09:04:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10aea00640 1 -- 172.21.15.59:0/3084002098 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a80b3830 con 0x7f10a806e010 2024-04-25T09:04:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10a4c00640 1 -- 172.21.15.59:0/3084002098 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109800ccf0 con 0x7f10a806e010 2024-04-25T09:04:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10aea00640 1 -- 172.21.15.59:0/3084002098 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a80b40d0 con 0x7f10a806e010 2024-04-25T09:04:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10aea00640 1 -- 172.21.15.59:0/3084002098 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a80745d0 con 0x7f10a806e010 2024-04-25T09:04:42.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.030+0000 7f10a4c00640 1 -- 172.21.15.59:0/3084002098 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f109801a070 con 0x7f10a806e010 2024-04-25T09:04:42.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.034+0000 7f10a4c00640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1084066f60 0x7f1084069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.034+0000 7f10a4c00640 1 -- 172.21.15.59:0/3084002098 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1098085460 con 0x7f10a806e010 2024-04-25T09:04:42.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.034+0000 7f109f400640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1084066f60 0x7f1084069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.034+0000 7f109f400640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1084066f60 0x7f1084069420 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f10a80afac0 tx=0x7f1090009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.038+0000 7f10a4c00640 1 -- 172.21.15.59:0/3084002098 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1098055c70 con 0x7f10a806e010 2024-04-25T09:04:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.254+0000 7f10aea00640 1 -- 172.21.15.59:0/3084002098 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f10a815d370 con 0x7f10a806e010 2024-04-25T09:04:42.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10a4c00640 1 -- 172.21.15.59:0/3084002098 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f1098059d10 con 0x7f10a806e010 2024-04-25T09:04:42.253 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-04-25T09:04:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg== 2024-04-25T09:04:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-04-25T09:04:42.253 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-04-25T09:04:42.254 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:04:42.254 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-04-25T09:04:42.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10aea00640 1 -- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1084066f60 msgr2=0x7f1084069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10aea00640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1084066f60 0x7f1084069420 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f10a80afac0 tx=0x7f1090009190 comp rx=0 tx=0).stop 2024-04-25T09:04:42.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10aea00640 1 -- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a806e010 msgr2=0x7f10a81422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10aea00640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a806e010 0x7f10a81422b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f109800e7f0 tx=0x7f109800ecb0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10aea00640 1 -- 172.21.15.59:0/3084002098 shutdown_connections 2024-04-25T09:04:42.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10aea00640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1084066f60 0x7f1084069420 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10aea00640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f10a815f440 0x7f10a80b2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10aea00640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10a8159320 0x7f10a80b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10aea00640 1 --2- 172.21.15.59:0/3084002098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f10a806e010 0x7f10a81422b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10aea00640 1 -- 172.21.15.59:0/3084002098 >> 172.21.15.59:0/3084002098 conn(0x7f10a8067080 msgr2=0x7f10a8159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10aea00640 1 -- 172.21.15.59:0/3084002098 shutdown_connections 2024-04-25T09:04:42.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.262+0000 7f10aea00640 1 -- 172.21.15.59:0/3084002098 wait complete. 2024-04-25T09:04:42.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:42.293 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:04:42.302+0000 7f74b4600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:04:42.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa2a7e00640 1 Processor -- start 2024-04-25T09:04:42.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa2a7e00640 1 -- start start 2024-04-25T09:04:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa2a7e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa2a806ac10 0x7fa2a806b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa2a7e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a81454d0 con 0x7fa2a80b4eb0 2024-04-25T09:04:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa2a7e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a80b3e10 con 0x7fa2a81450f0 2024-04-25T09:04:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa2a7e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a806b5b0 con 0x7fa2a806ac10 2024-04-25T09:04:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa2a7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa2a80b4eb0 0x7fa2a80b5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33888/0 (socket says 172.21.15.59:33888) 2024-04-25T09:04:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa2a7400640 1 -- 172.21.15.59:0/2720639515 learned_addr learned my addr 172.21.15.59:0/2720639515 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:42.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa29fe00640 1 --2- 172.21.15.59:0/2720639515 >> v2:172.21.15.178:3300/0 conn(0x7fa2a806ac10 0x7fa2a806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa2a6000640 1 -- 172.21.15.59:0/2720639515 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 291829623 0 0) 0x7fa2a81454d0 con 0x7fa2a80b4eb0 2024-04-25T09:04:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa2a6000640 1 -- 172.21.15.59:0/2720639515 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa28c003530 con 0x7fa2a80b4eb0 2024-04-25T09:04:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa2a6000640 1 -- 172.21.15.59:0/2720639515 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611092323 0 0) 0x7fa2a80b3e10 con 0x7fa2a81450f0 2024-04-25T09:04:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa2a6000640 1 -- 172.21.15.59:0/2720639515 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2a81454d0 con 0x7fa2a81450f0 2024-04-25T09:04:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa29fe00640 1 -- 172.21.15.59:0/2720639515 >> v1:172.21.15.178:6789/0 conn(0x7fa2a81450f0 legacy=0x7fa2a80b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa29fe00640 1 -- 172.21.15.59:0/2720639515 >> v1:172.21.15.59:6789/0 conn(0x7fa2a80b4eb0 legacy=0x7fa2a80b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.426+0000 7fa29fe00640 1 -- 172.21.15.59:0/2720639515 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a80b40f0 con 0x7fa2a806ac10 2024-04-25T09:04:42.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.430+0000 7fa29fe00640 1 --2- 172.21.15.59:0/2720639515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2a806ac10 0x7fa2a806b070 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa2900097c0 tx=0x7fa29001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad2e2676ad088095 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.430+0000 7fa2a6000640 1 -- 172.21.15.59:0/2720639515 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900b1070 con 0x7fa2a806ac10 2024-04-25T09:04:42.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.430+0000 7fa2a6000640 1 -- 172.21.15.59:0/2720639515 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2900ac5f0 con 0x7fa2a806ac10 2024-04-25T09:04:42.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.430+0000 7fa2a6000640 1 -- 172.21.15.59:0/2720639515 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2900ac9c0 con 0x7fa2a806ac10 2024-04-25T09:04:42.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.430+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2720639515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2a806ac10 msgr2=0x7fa2a806b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.430+0000 7fa2a7e00640 1 --2- 172.21.15.59:0/2720639515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2a806ac10 0x7fa2a806b070 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa2900097c0 tx=0x7fa29001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.430+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2720639515 shutdown_connections 2024-04-25T09:04:42.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.430+0000 7fa2a7e00640 1 --2- 172.21.15.59:0/2720639515 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2a806ac10 0x7fa2a806b070 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.430+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2720639515 >> 172.21.15.59:0/2720639515 conn(0x7fa2a8099a60 msgr2=0x7fa2a80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.430+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2720639515 shutdown_connections 2024-04-25T09:04:42.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.430+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2720639515 wait complete. 2024-04-25T09:04:42.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.430+0000 7fa2a7e00640 1 Processor -- start 2024-04-25T09:04:42.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7e00640 1 -- start start 2024-04-25T09:04:42.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2a806ac10 0x7fa2a813eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2a80b4eb0 0x7fa2a81f9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a81450f0 0x7fa2a80d0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80cd1b0 con 0x7fa2a81450f0 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a80cd030 con 0x7fa2a806ac10 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a8169380 con 0x7fa2a80b4eb0 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a81450f0 0x7fa2a80d0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a81450f0 0x7fa2a80d0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60666/0 (socket says 172.21.15.59:60666) 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7400640 1 -- 172.21.15.59:0/2188021010 learned_addr learned my addr 172.21.15.59:0/2188021010 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa29fe00640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2a80b4eb0 0x7fa2a81f9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a6a00640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2a806ac10 0x7fa2a813eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7400640 1 -- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2a80b4eb0 msgr2=0x7fa2a81f9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7400640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2a80b4eb0 0x7fa2a81f9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7400640 1 -- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2a806ac10 msgr2=0x7fa2a813eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7400640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2a806ac10 0x7fa2a813eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7400640 1 -- 172.21.15.59:0/2188021010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a81fa2c0 con 0x7fa2a81450f0 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa29fe00640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2a80b4eb0 0x7fa2a81f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7400640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a81450f0 0x7fa2a80d0290 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000caf0 tx=0x7fa2a000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa29ea00640 1 -- 172.21.15.59:0/2188021010 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0017070 con 0x7fa2a81450f0 2024-04-25T09:04:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa29ea00640 1 -- 172.21.15.59:0/2188021010 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2a000aca0 con 0x7fa2a81450f0 2024-04-25T09:04:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa29ea00640 1 -- 172.21.15.59:0/2188021010 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a0012620 con 0x7fa2a81450f0 2024-04-25T09:04:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2188021010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a81fa5a0 con 0x7fa2a81450f0 2024-04-25T09:04:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2188021010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a813f420 con 0x7fa2a81450f0 2024-04-25T09:04:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.434+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2188021010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a804efa0 con 0x7fa2a81450f0 2024-04-25T09:04:42.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.438+0000 7fa29ea00640 1 -- 172.21.15.59:0/2188021010 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa2a001a070 con 0x7fa2a81450f0 2024-04-25T09:04:42.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.438+0000 7fa29ea00640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa284066f60 0x7fa284069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:42.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.438+0000 7fa29ea00640 1 -- 172.21.15.59:0/2188021010 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa2a0084fe0 con 0x7fa2a81450f0 2024-04-25T09:04:42.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.438+0000 7fa2a6a00640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa284066f60 0x7fa284069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:42.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.438+0000 7fa2a6a00640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa284066f60 0x7fa284069420 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa2980011f0 tx=0x7fa298009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:42.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.442+0000 7fa29ea00640 1 -- 172.21.15.59:0/2188021010 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa2a0055de0 con 0x7fa2a81450f0 2024-04-25T09:04:42.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.638+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2188021010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2a81fa770 con 0x7fa2a81450f0 2024-04-25T09:04:42.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.638+0000 7fa29ea00640 1 -- 172.21.15.59:0/2188021010 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4936 (secure 0 0 0) 0x7fa2a00556e0 con 0x7fa2a81450f0 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2580922028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2580922028},{"type":"v1","addr":"172.21.15.178:6837","nonce":2580922028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/126805970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":126805970},{"type":"v1","addr":"172.21.15.178:6836","nonce":126805970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/402319604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":402319604},{"type":"v1","addr":"172.21.15.59:6833","nonce":402319604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:36.727681+0000","modified":"2024-04-25T09:04:39.739856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/686404516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":686404516},{"type":"v1","addr":"172.21.15.59:6835","nonce":686404516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:04:42.631 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 38 2024-04-25T09:04:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.642+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa284066f60 msgr2=0x7fa284069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.642+0000 7fa2a7e00640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa284066f60 0x7fa284069420 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa2980011f0 tx=0x7fa298009040 comp rx=0 tx=0).stop 2024-04-25T09:04:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.642+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2188021010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a81450f0 msgr2=0x7fa2a80d0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.642+0000 7fa2a7e00640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a81450f0 0x7fa2a80d0290 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa2a000caf0 tx=0x7fa2a000a060 comp rx=0 tx=0).stop 2024-04-25T09:04:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.642+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2188021010 shutdown_connections 2024-04-25T09:04:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.642+0000 7fa2a7e00640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa284066f60 0x7fa284069420 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.642+0000 7fa2a7e00640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2a81450f0 0x7fa2a80d0290 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.642+0000 7fa2a7e00640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2a80b4eb0 0x7fa2a81f9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.642+0000 7fa2a7e00640 1 --2- 172.21.15.59:0/2188021010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2a806ac10 0x7fa2a813eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:42.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.642+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2188021010 >> 172.21.15.59:0/2188021010 conn(0x7fa2a8099a60 msgr2=0x7fa2a80cd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:42.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.642+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2188021010 shutdown_connections 2024-04-25T09:04:42.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:42.642+0000 7fa2a7e00640 1 -- 172.21.15.59:0/2188021010 wait complete. 2024-04-25T09:04:43.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:04:36.727681+0000', 'modified': '2024-04-25T09:04:39.739856+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6225}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6225': {'gid': 6225, 'name': 'a', 'rank': 0, 'incarnation': 34, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/686404516', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6834', 'nonce': 686404516}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 686404516}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:04:43.055 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:04:43.055 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:04:43.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b27c00640 1 Processor -- start 2024-04-25T09:04:43.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b27c00640 1 -- start start 2024-04-25T09:04:43.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b27c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b20144120 0x7f1b2015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b27c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b200b3090 0x7f1b200b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b27c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2015bc40 con 0x7f1b200ccbf0 2024-04-25T09:04:43.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b27c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2015e490 con 0x7f1b20144120 2024-04-25T09:04:43.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b27c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2015b3a0 con 0x7f1b200b3090 2024-04-25T09:04:43.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b25200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b20144120 0x7f1b2015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b25c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b200b3090 0x7f1b200b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b25200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1b20144120 0x7f1b2015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:42570/0 (socket says 172.21.15.59:42570) 2024-04-25T09:04:43.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b17e00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f1b200ccbf0 0x7f1b2015e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:33624/0 (socket says 172.21.15.59:33624) 2024-04-25T09:04:43.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b17e00640 1 -- 172.21.15.59:0/2472078802 learned_addr learned my addr 172.21.15.59:0/2472078802 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:43.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.210+0000 7f1b25c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b200b3090 0x7f1b200b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:59242/0 (socket says 172.21.15.59:59242) 2024-04-25T09:04:43.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.214+0000 7f1b25200640 1 -- 172.21.15.59:0/2472078802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b200b3090 msgr2=0x7f1b200b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.214+0000 7f1b25200640 1 --2- 172.21.15.59:0/2472078802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b200b3090 0x7f1b200b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.214+0000 7f1b25200640 1 -- 172.21.15.59:0/2472078802 >> v1:172.21.15.178:6789/0 conn(0x7f1b200ccbf0 legacy=0x7f1b2015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.214+0000 7f1b25200640 1 -- 172.21.15.59:0/2472078802 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2015b680 con 0x7f1b20144120 2024-04-25T09:04:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.214+0000 7f1b25200640 1 --2- 172.21.15.59:0/2472078802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b20144120 0x7f1b2015acd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1b100097c0 tx=0x7f1b1001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35f19b1eba386e98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.214+0000 7f1b1fe00640 1 -- 172.21.15.59:0/2472078802 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100b0070 con 0x7f1b20144120 2024-04-25T09:04:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.214+0000 7f1b1fe00640 1 -- 172.21.15.59:0/2472078802 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b100ab600 con 0x7f1b20144120 2024-04-25T09:04:43.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.214+0000 7f1b1fe00640 1 -- 172.21.15.59:0/2472078802 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100ab9d0 con 0x7f1b20144120 2024-04-25T09:04:43.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.214+0000 7f1b27c00640 1 -- 172.21.15.59:0/2472078802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b20144120 msgr2=0x7f1b2015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.214+0000 7f1b27c00640 1 --2- 172.21.15.59:0/2472078802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b20144120 0x7f1b2015acd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1b100097c0 tx=0x7f1b1001c410 comp rx=0 tx=0).stop 2024-04-25T09:04:43.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 -- 172.21.15.59:0/2472078802 shutdown_connections 2024-04-25T09:04:43.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 --2- 172.21.15.59:0/2472078802 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b200b3090 0x7f1b200b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 --2- 172.21.15.59:0/2472078802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b20144120 0x7f1b2015acd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 -- 172.21.15.59:0/2472078802 >> 172.21.15.59:0/2472078802 conn(0x7f1b20067080 msgr2=0x7f1b2006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 -- 172.21.15.59:0/2472078802 shutdown_connections 2024-04-25T09:04:43.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 -- 172.21.15.59:0/2472078802 wait complete. 2024-04-25T09:04:43.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 Processor -- start 2024-04-25T09:04:43.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 -- start start 2024-04-25T09:04:43.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b200b3090 0x7f1b20159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b200ccbf0 0x7f1b2013d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b20144120 0x7f1b2013dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b201675c0 con 0x7f1b200b3090 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20167440 con 0x7f1b200ccbf0 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b27c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20167740 con 0x7f1b20144120 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b25200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b200b3090 0x7f1b20159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b25200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b200b3090 0x7f1b20159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60680/0 (socket says 172.21.15.59:60680) 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b25200640 1 -- 172.21.15.59:0/3324269353 learned_addr learned my addr 172.21.15.59:0/3324269353 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b17e00640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b200ccbf0 0x7f1b2013d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b25c00640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b20144120 0x7f1b2013dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b25200640 1 -- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b20144120 msgr2=0x7f1b2013dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b25200640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b20144120 0x7f1b2013dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b25200640 1 -- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b200ccbf0 msgr2=0x7f1b2013d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b25200640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b200ccbf0 0x7f1b2013d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b25200640 1 -- 172.21.15.59:0/3324269353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2013e2d0 con 0x7f1b200b3090 2024-04-25T09:04:43.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b17e00640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b200ccbf0 0x7f1b2013d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:43.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b25200640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b200b3090 0x7f1b20159610 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1b100ae040 tx=0x7f1b1001ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.218+0000 7f1b1d600640 1 -- 172.21.15.59:0/3324269353 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100b0050 con 0x7f1b200b3090 2024-04-25T09:04:43.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.222+0000 7f1b1d600640 1 -- 172.21.15.59:0/3324269353 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b100bc070 con 0x7f1b200b3090 2024-04-25T09:04:43.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.222+0000 7f1b1d600640 1 -- 172.21.15.59:0/3324269353 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100b5870 con 0x7f1b200b3090 2024-04-25T09:04:43.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.222+0000 7f1b27c00640 1 -- 172.21.15.59:0/3324269353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2013e5b0 con 0x7f1b200b3090 2024-04-25T09:04:43.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.222+0000 7f1b27c00640 1 -- 172.21.15.59:0/3324269353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b200af3f0 con 0x7f1b200b3090 2024-04-25T09:04:43.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.222+0000 7f1b1d600640 1 -- 172.21.15.59:0/3324269353 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1b100b5a10 con 0x7f1b200b3090 2024-04-25T09:04:43.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.222+0000 7f1b1d600640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1afc066f60 0x7f1afc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.222+0000 7f1b1d600640 1 -- 172.21.15.59:0/3324269353 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1b1011f9a0 con 0x7f1b200b3090 2024-04-25T09:04:43.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.222+0000 7f1b17e00640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1afc066f60 0x7f1afc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.222+0000 7f1b2b0b9000 1 Processor -- start 2024-04-25T09:04:43.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.222+0000 7f1b2b0b9000 1 -- start start 2024-04-25T09:04:43.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b17e00640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1afc066f60 0x7f1afc069420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1b2013e8b0 tx=0x7f1b08009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f80920 0x55a0b5f80d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f81240 0x55a0b5f369f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f36f30 0x55a0b5f37310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b5e1e5f0 con 0x55a0b5f80920 2024-04-25T09:04:43.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b5d85da0 con 0x55a0b5f36f30 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0b5d0e150 con 0x55a0b5f81240 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b25200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f80920 0x55a0b5f80d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b25200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f80920 0x55a0b5f80d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60682/0 (socket says 172.21.15.59:60682) 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b25200640 1 -- 172.21.15.59:0/1493972813 learned_addr learned my addr 172.21.15.59:0/1493972813 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b17e00640 1 --2- 172.21.15.59:0/1493972813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f81240 0x55a0b5f369f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b25c00640 1 --2- 172.21.15.59:0/1493972813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f36f30 0x55a0b5f37310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b25200640 1 -- 172.21.15.59:0/1493972813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f81240 msgr2=0x55a0b5f369f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b25200640 1 --2- 172.21.15.59:0/1493972813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f81240 0x55a0b5f369f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b25200640 1 -- 172.21.15.59:0/1493972813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f36f30 msgr2=0x55a0b5f37310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b25200640 1 --2- 172.21.15.59:0/1493972813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f36f30 0x55a0b5f37310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b25200640 1 -- 172.21.15.59:0/1493972813 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0b5d27ca0 con 0x55a0b5f80920 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b25200640 1 --2- 172.21.15.59:0/1493972813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f80920 0x55a0b5f80d00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1b100f0010 tx=0x7f1b100eff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c6351f2c7f1f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b15600640 1 -- 172.21.15.59:0/1493972813 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100f0080 con 0x55a0b5f80920 2024-04-25T09:04:43.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b15600640 1 -- 172.21.15.59:0/1493972813 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b10107070 con 0x55a0b5f80920 2024-04-25T09:04:43.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b15600640 1 -- 172.21.15.59:0/1493972813 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100f41d0 con 0x55a0b5f80920 2024-04-25T09:04:43.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1493972813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f80920 msgr2=0x55a0b5f80d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/1493972813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f80920 0x55a0b5f80d00 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1b100f0010 tx=0x7f1b100eff10 comp rx=0 tx=0).stop 2024-04-25T09:04:43.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1493972813 shutdown_connections 2024-04-25T09:04:43.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/1493972813 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f36f30 0x55a0b5f37310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/1493972813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f81240 0x55a0b5f369f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/1493972813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f80920 0x55a0b5f80d00 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1493972813 >> 172.21.15.59:0/1493972813 conn(0x55a0b5f3d2a0 msgr2=0x55a0b5f352d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1493972813 shutdown_connections 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1493972813 wait complete. 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 -- start start 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.226+0000 7f1b2b0b9000 1 Processor -- start 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f87c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f80920 0x55a0b5f881c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f81240 0x55a0b5f3aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b5d40990 con 0x55a0b5f36f30 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b5d81e40 con 0x55a0b5f81240 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0b5d11900 con 0x55a0b5f80920 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 10 client.0 _ll_register_callbacks cb 0x55a0b5e391c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b25200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f87c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b25200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f87c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60688/0 (socket says 172.21.15.59:60688) 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b25200640 1 -- 172.21.15.59:0/442971083 learned_addr learned my addr 172.21.15.59:0/442971083 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b17e00640 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f80920 0x55a0b5f881c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b25c00640 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f81240 0x55a0b5f3aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b25200640 1 -- 172.21.15.59:0/442971083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f80920 msgr2=0x55a0b5f881c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b25200640 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f80920 0x55a0b5f881c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b25200640 1 -- 172.21.15.59:0/442971083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f81240 msgr2=0x55a0b5f3aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b25200640 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f81240 0x55a0b5f3aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b25200640 1 -- 172.21.15.59:0/442971083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0b5d3e630 con 0x55a0b5f36f30 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b25200640 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f87c80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1b100ec4e0 tx=0x7f1b100191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ac4ca92d0afb96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b0e000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b0e000640 1 -- 172.21.15.59:0/442971083 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1010c060 con 0x55a0b5f36f30 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b0e000640 1 -- 172.21.15.59:0/442971083 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1b100b5d00 con 0x55a0b5f36f30 2024-04-25T09:04:43.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/442971083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b10107070 con 0x55a0b5f36f30 2024-04-25T09:04:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b0e000640 1 -- 172.21.15.59:0/442971083 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b10113050 con 0x55a0b5f36f30 2024-04-25T09:04:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 10 client.6360 fetch_fsmap learned FSMap version 38 2024-04-25T09:04:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/442971083 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55a0b5d0e3a0 con 0x55a0b5f36f30 2024-04-25T09:04:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b0e000640 1 -- 172.21.15.59:0/442971083 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b10107070 con 0x55a0b5f36f30 2024-04-25T09:04:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b0e000640 1 -- 172.21.15.59:0/442971083 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1b2006ebf0 con 0x55a0b5f36f30 2024-04-25T09:04:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 10 client.6360 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T09:04:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 10 client.6360 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:04:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 20 client.6360 populate_metadata read hostname 'smithi059' 2024-04-25T09:04:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a0b5f3b4b0 0x55a0b5f3b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 4 client.6360 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/442971083 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a0b5d21a50 con 0x55a0b5f3b4b0 2024-04-25T09:04:43.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b17e00640 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a0b5f3b4b0 0x55a0b5f3b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b17e00640 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a0b5f3b4b0 0x55a0b5f3b890 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b03b59a9501e1b4 server_cookie=7e99acfb3bf27d4e in_seq=0 out_seq=0 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b0e000640 10 client.6360 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b0e000640 1 -- 172.21.15.59:0/442971083 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a0b5d21a50 con 0x55a0b5f3b4b0 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b0e000640 10 client.6360 handle_command_reply: tid=0 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 client.6360 shutdown 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/442971083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 msgr2=0x55a0b5f87c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f87c80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1b100ec4e0 tx=0x7f1b100191b0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/442971083 shutdown_connections 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a0b5f3b4b0 0x55a0b5f3b890 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f81240 0x55a0b5f3aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f80920 0x55a0b5f881c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b0e000640 0 client.6360 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:04:43.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/442971083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f87c80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.230+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/442971083 >> 172.21.15.59:0/442971083 conn(0x55a0b5f3d2a0 msgr2=0x55a0b5f359e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.234+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/442971083 shutdown_connections 2024-04-25T09:04:43.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.234+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/442971083 wait complete. 2024-04-25T09:04:43.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.234+0000 7f1b2b0b9000 20 client.6360 trim_cache size 0 max 16384 2024-04-25T09:04:43.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.246+0000 7f1b2b0b9000 1 Processor -- start 2024-04-25T09:04:43.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 -- start start 2024-04-25T09:04:43.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f3a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f80920 0x55a0b5f3a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f81240 0x55a0b5f8a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b202026a0 con 0x55a0b5f36f30 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b200b0a00 con 0x55a0b5f81240 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b20202140 con 0x55a0b5f80920 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b25200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f3a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b25200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f3a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60692/0 (socket says 172.21.15.59:60692) 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b25200640 1 -- 172.21.15.59:0/2346877308 learned_addr learned my addr 172.21.15.59:0/2346877308 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b25200640 1 -- 172.21.15.59:0/2346877308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f80920 msgr2=0x55a0b5f3a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b25200640 1 --2- 172.21.15.59:0/2346877308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f80920 0x55a0b5f3a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b25200640 1 -- 172.21.15.59:0/2346877308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f81240 msgr2=0x55a0b5f8a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b25200640 1 --2- 172.21.15.59:0/2346877308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f81240 0x55a0b5f8a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b25200640 1 -- 172.21.15.59:0/2346877308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a0b5f81070 con 0x55a0b5f36f30 2024-04-25T09:04:43.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b25200640 1 --2- 172.21.15.59:0/2346877308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f3a330 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1b1001aac0 tx=0x7f1b10119070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87dece3449ee8df1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b14c00640 1 -- 172.21.15.59:0/2346877308 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100f8790 con 0x55a0b5f36f30 2024-04-25T09:04:43.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b14c00640 1 -- 172.21.15.59:0/2346877308 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b10107070 con 0x55a0b5f36f30 2024-04-25T09:04:43.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b14c00640 1 -- 172.21.15.59:0/2346877308 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b100f0080 con 0x55a0b5f36f30 2024-04-25T09:04:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/2346877308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 msgr2=0x55a0b5f3a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/2346877308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f3a330 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f1b1001aac0 tx=0x7f1b10119070 comp rx=0 tx=0).stop 2024-04-25T09:04:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/2346877308 shutdown_connections 2024-04-25T09:04:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/2346877308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f81240 0x55a0b5f8a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/2346877308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f80920 0x55a0b5f3a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/2346877308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f3a330 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/2346877308 >> 172.21.15.59:0/2346877308 conn(0x55a0b5f3d2a0 msgr2=0x55a0b5f6cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/2346877308 shutdown_connections 2024-04-25T09:04:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/2346877308 wait complete. 2024-04-25T09:04:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 -- start start 2024-04-25T09:04:43.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.250+0000 7f1b2b0b9000 1 Processor -- start 2024-04-25T09:04:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f8d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f80920 0x55a0b5fe0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f81240 0x55a0b5fe12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b5d8a3d0 con 0x55a0b5f36f30 2024-04-25T09:04:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0b5e41d50 con 0x55a0b5f80920 2024-04-25T09:04:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a0b5d20980 con 0x55a0b5f81240 2024-04-25T09:04:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 10 client.0 _ll_register_callbacks cb 0x7f1b10006c40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b25200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f8d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b25200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f8d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60694/0 (socket says 172.21.15.59:60694) 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b25200640 1 -- 172.21.15.59:0/1571668474 learned_addr learned my addr 172.21.15.59:0/1571668474 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b25c00640 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f81240 0x55a0b5fe12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b17e00640 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f80920 0x55a0b5fe0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b25200640 1 -- 172.21.15.59:0/1571668474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f81240 msgr2=0x55a0b5fe12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b25200640 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f81240 0x55a0b5fe12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b25200640 1 -- 172.21.15.59:0/1571668474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f80920 msgr2=0x55a0b5fe0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b25200640 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f80920 0x55a0b5fe0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b25200640 1 -- 172.21.15.59:0/1571668474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a0b5e07600 con 0x55a0b5f36f30 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b25200640 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f8d790 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1b10006aa0 tx=0x7f1b10009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b962248ecfb712 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b0e000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b0e000640 1 -- 172.21.15.59:0/1571668474 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1010c070 con 0x55a0b5f36f30 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b0e000640 1 -- 172.21.15.59:0/1571668474 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1b100f8500 con 0x55a0b5f36f30 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1571668474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b10107070 con 0x55a0b5f36f30 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b0e000640 1 -- 172.21.15.59:0/1571668474 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b100f8790 con 0x55a0b5f36f30 2024-04-25T09:04:43.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 10 client.6366 fetch_fsmap learned FSMap version 38 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1571668474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55a0b5d1a9b0 con 0x55a0b5f36f30 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b0e000640 1 -- 172.21.15.59:0/1571668474 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b10107070 con 0x55a0b5f36f30 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b0e000640 1 -- 172.21.15.59:0/1571668474 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1b100ef4d0 con 0x55a0b5f36f30 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 10 client.6366 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 10 client.6366 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 20 client.6366 populate_metadata read hostname 'smithi059' 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a0b5fe1820 0x55a0b5fdd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 4 client.6366 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1571668474 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a0b5d932e0 con 0x55a0b5fe1820 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b17e00640 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a0b5fe1820 0x55a0b5fdd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b17e00640 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a0b5fe1820 0x55a0b5fdd740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49fbea484bb5e34c server_cookie=59b937b4b70d1bf4 in_seq=0 out_seq=0 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b0e000640 10 client.6366 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b0e000640 1 -- 172.21.15.59:0/1571668474 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a0b5d932e0 con 0x55a0b5fe1820 2024-04-25T09:04:43.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b0e000640 10 client.6366 handle_command_reply: tid=0 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 client.6366 shutdown 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1571668474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 msgr2=0x55a0b5f8d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f8d790 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1b10006aa0 tx=0x7f1b10009190 comp rx=0 tx=0).stop 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1571668474 shutdown_connections 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a0b5fe1820 0x55a0b5fdd740 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a0b5f81240 0x55a0b5fe12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a0b5f80920 0x55a0b5fe0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 --2- 172.21.15.59:0/1571668474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a0b5f36f30 0x55a0b5f8d790 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b0e000640 0 client.6366 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1571668474 >> 172.21.15.59:0/1571668474 conn(0x55a0b5f3d2a0 msgr2=0x55a0b5f39320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1571668474 shutdown_connections 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 1 -- 172.21.15.59:0/1571668474 wait complete. 2024-04-25T09:04:43.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.254+0000 7f1b2b0b9000 20 client.6366 trim_cache size 0 max 16384 2024-04-25T09:04:43.252 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:04:43.252 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:04:43.252 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:04:43.252 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6225, 2024-04-25T09:04:43.252 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:04:43.252 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:04:43.252 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:04:43.252 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 5.9369427610000001, 2024-04-25T09:04:43.252 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 38, 2024-04-25T09:04:43.252 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 66, 2024-04-25T09:04:43.252 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 66, 2024-04-25T09:04:43.252 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 11.855469254000001 2024-04-25T09:04:43.253 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:04:43.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.258+0000 7f1b27c00640 1 -- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1afc066f60 msgr2=0x7f1afc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.258+0000 7f1b27c00640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1afc066f60 0x7f1afc069420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1b2013e8b0 tx=0x7f1b08009040 comp rx=0 tx=0).stop 2024-04-25T09:04:43.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.258+0000 7f1b27c00640 1 -- 172.21.15.59:0/3324269353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b200b3090 msgr2=0x7f1b20159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.258+0000 7f1b27c00640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b200b3090 0x7f1b20159610 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f1b100ae040 tx=0x7f1b1001ac50 comp rx=0 tx=0).stop 2024-04-25T09:04:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.258+0000 7f1b27c00640 1 -- 172.21.15.59:0/3324269353 shutdown_connections 2024-04-25T09:04:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.258+0000 7f1b27c00640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1afc066f60 0x7f1afc069420 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.258+0000 7f1b27c00640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1b20144120 0x7f1b2013dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.258+0000 7f1b27c00640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1b200ccbf0 0x7f1b2013d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.258+0000 7f1b27c00640 1 --2- 172.21.15.59:0/3324269353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b200b3090 0x7f1b20159610 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.258+0000 7f1b27c00640 1 -- 172.21.15.59:0/3324269353 >> 172.21.15.59:0/3324269353 conn(0x7f1b20067080 msgr2=0x7f1b201410e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.258+0000 7f1b27c00640 1 -- 172.21.15.59:0/3324269353 shutdown_connections 2024-04-25T09:04:43.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.258+0000 7f1b27c00640 1 -- 172.21.15.59:0/3324269353 wait complete. 2024-04-25T09:04:43.268 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:04:43.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8ffe00640 1 Processor -- start 2024-04-25T09:04:43.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8ffe00640 1 -- start start 2024-04-25T09:04:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8ffe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80b5830 0x7ff8f80ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8ffe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f815e4c0 con 0x7ff8f80b4a10 2024-04-25T09:04:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8ffe00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f815e7a0 con 0x7ff8f815a6c0 2024-04-25T09:04:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8ffe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f815e270 con 0x7ff8f80b5830 2024-04-25T09:04:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8fde00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff8f80b4a10 0x7ff8f80b38b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33902/0 (socket says 172.21.15.59:33902) 2024-04-25T09:04:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8fde00640 1 -- 172.21.15.59:0/404069507 learned_addr learned my addr 172.21.15.59:0/404069507 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:43.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8fca00640 1 --2- 172.21.15.59:0/404069507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80b5830 0x7ff8f80ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595702985 0 0) 0x7ff8f815e4c0 con 0x7ff8f80b4a10 2024-04-25T09:04:43.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8e0003530 con 0x7ff8f80b4a10 2024-04-25T09:04:43.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505665537 0 0) 0x7ff8f815e7a0 con 0x7ff8f815a6c0 2024-04-25T09:04:43.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8f815e4c0 con 0x7ff8f815a6c0 2024-04-25T09:04:43.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3474219972 0 0) 0x7ff8e0003530 con 0x7ff8f80b4a10 2024-04-25T09:04:43.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80b5830 msgr2=0x7ff8f80ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 --2- 172.21.15.59:0/404069507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80b5830 0x7ff8f80ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 >> v1:172.21.15.178:6789/0 conn(0x7ff8f815a6c0 legacy=0x7ff8f80b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f815ea80 con 0x7ff8f80b4a10 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7ff8f0001a00 con 0x7ff8f80b4a10 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 >> v1:172.21.15.59:6789/0 conn(0x7ff8f80b4a10 legacy=0x7ff8f80b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 --2- 172.21.15.59:0/404069507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8e0003b80 0x7ff8e0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 --2- 172.21.15.59:0/404069507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8e0004810 0x7ff8e0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 --2- 172.21.15.59:0/404069507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80b5830 0x7ff8e00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f815e270 con 0x7ff8e0003b80 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e000ba80 con 0x7ff8e0004810 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.418+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e000bc50 con 0x7ff8f80b5830 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.422+0000 7ff8fd400640 1 --2- 172.21.15.59:0/404069507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8e0003b80 0x7ff8e0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.422+0000 7ff8fca00640 1 --2- 172.21.15.59:0/404069507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8e0004810 0x7ff8e0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.422+0000 7ff8fde00640 1 --2- 172.21.15.59:0/404069507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80b5830 0x7ff8e00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.422+0000 7ff8fd400640 1 -- 172.21.15.59:0/404069507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80b5830 msgr2=0x7ff8e00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.422+0000 7ff8fd400640 1 --2- 172.21.15.59:0/404069507 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80b5830 0x7ff8e00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.422+0000 7ff8fd400640 1 -- 172.21.15.59:0/404069507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8e0004810 msgr2=0x7ff8e0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:43.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.422+0000 7ff8fd400640 1 --2- 172.21.15.59:0/404069507 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8e0004810 0x7ff8e0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.422+0000 7ff8fd400640 1 -- 172.21.15.59:0/404069507 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e0003530 con 0x7ff8e0003b80 2024-04-25T09:04:43.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.422+0000 7ff8fd400640 1 --2- 172.21.15.59:0/404069507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8e0003b80 0x7ff8e0003f80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0018d0 tx=0x7ff8ec01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd56ac629548539e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.422+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec001520 con 0x7ff8e0003b80 2024-04-25T09:04:43.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.422+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec0052f0 con 0x7ff8e0003b80 2024-04-25T09:04:43.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.422+0000 7ff8f7e00640 1 -- 172.21.15.59:0/404069507 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec003840 con 0x7ff8e0003b80 2024-04-25T09:04:43.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 -- 172.21.15.59:0/404069507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8e0003b80 msgr2=0x7ff8e0003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 --2- 172.21.15.59:0/404069507 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8e0003b80 0x7ff8e0003f80 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0018d0 tx=0x7ff8ec01c520 comp rx=0 tx=0).stop 2024-04-25T09:04:43.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8fde00640 1 -- 172.21.15.59:0/404069507 reap_dead start 2024-04-25T09:04:43.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 -- 172.21.15.59:0/404069507 shutdown_connections 2024-04-25T09:04:43.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 -- 172.21.15.59:0/404069507 >> 172.21.15.59:0/404069507 conn(0x7ff8f80b2400 msgr2=0x7ff8f80b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 -- 172.21.15.59:0/404069507 shutdown_connections 2024-04-25T09:04:43.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 -- 172.21.15.59:0/404069507 wait complete. 2024-04-25T09:04:43.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 Processor -- start 2024-04-25T09:04:43.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 -- start start 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8e0003b80 0x7ff8f8155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f81ec7a0 0x7ff8f81ecc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80add00 0x7ff8f80ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f8166610 con 0x7ff8e0003b80 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f80b47d0 con 0x7ff8f81ec7a0 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8ffe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f8166790 con 0x7ff8f80add00 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8fd400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8e0003b80 0x7ff8f8155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8fd400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8e0003b80 0x7ff8f8155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60710/0 (socket says 172.21.15.59:60710) 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8fd400640 1 -- 172.21.15.59:0/960888818 learned_addr learned my addr 172.21.15.59:0/960888818 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8fde00640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80add00 0x7ff8f80ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8fca00640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f81ec7a0 0x7ff8f81ecc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8fd400640 1 -- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80add00 msgr2=0x7ff8f80ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8fd400640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80add00 0x7ff8f80ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8fd400640 1 -- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f81ec7a0 msgr2=0x7ff8f81ecc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8fd400640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f81ec7a0 0x7ff8f81ecc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.426+0000 7ff8fd400640 1 -- 172.21.15.59:0/960888818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f80acb20 con 0x7ff8e0003b80 2024-04-25T09:04:43.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.430+0000 7ff8fd400640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8e0003b80 0x7ff8f8155be0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0018d0 tx=0x7ff8e0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.430+0000 7ff8f5600640 1 -- 172.21.15.59:0/960888818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0054a0 con 0x7ff8e0003b80 2024-04-25T09:04:43.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.430+0000 7ff8f5600640 1 -- 172.21.15.59:0/960888818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8ec001500 con 0x7ff8e0003b80 2024-04-25T09:04:43.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.430+0000 7ff8f5600640 1 -- 172.21.15.59:0/960888818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0067e0 con 0x7ff8e0003b80 2024-04-25T09:04:43.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.430+0000 7ff8ffe00640 1 -- 172.21.15.59:0/960888818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f80ace00 con 0x7ff8e0003b80 2024-04-25T09:04:43.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.430+0000 7ff8ffe00640 1 -- 172.21.15.59:0/960888818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f80ad3c0 con 0x7ff8e0003b80 2024-04-25T09:04:43.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.430+0000 7ff8ffe00640 1 -- 172.21.15.59:0/960888818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f80745d0 con 0x7ff8e0003b80 2024-04-25T09:04:43.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.430+0000 7ff8f5600640 1 -- 172.21.15.59:0/960888818 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff8ec006980 con 0x7ff8e0003b80 2024-04-25T09:04:43.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.430+0000 7ff8f5600640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff8d8066f60 0x7ff8d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:43.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.430+0000 7ff8f5600640 1 -- 172.21.15.59:0/960888818 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff8ec11f3b0 con 0x7ff8e0003b80 2024-04-25T09:04:43.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.430+0000 7ff8fca00640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff8d8066f60 0x7ff8d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:43.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.434+0000 7ff8fca00640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff8d8066f60 0x7ff8d8069420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8156910 tx=0x7ff8e4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:43.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.434+0000 7ff8f5600640 1 -- 172.21.15.59:0/960888818 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff8ec0bb020 con 0x7ff8e0003b80 2024-04-25T09:04:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.630+0000 7ff8ffe00640 1 -- 172.21.15.59:0/960888818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff8f8070080 con 0x7ff8e0003b80 2024-04-25T09:04:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8f5600640 1 -- 172.21.15.59:0/960888818 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff8ec016230 con 0x7ff8e0003b80 2024-04-25T09:04:43.624 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:04:43.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8ffe00640 1 -- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff8d8066f60 msgr2=0x7ff8d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8ffe00640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff8d8066f60 0x7ff8d8069420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8156910 tx=0x7ff8e4009190 comp rx=0 tx=0).stop 2024-04-25T09:04:43.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8ffe00640 1 -- 172.21.15.59:0/960888818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8e0003b80 msgr2=0x7ff8f8155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:43.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8ffe00640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8e0003b80 0x7ff8f8155be0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec0018d0 tx=0x7ff8e0005840 comp rx=0 tx=0).stop 2024-04-25T09:04:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8ffe00640 1 -- 172.21.15.59:0/960888818 shutdown_connections 2024-04-25T09:04:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8ffe00640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff8d8066f60 0x7ff8d8069420 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8ffe00640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f80add00 0x7ff8f80ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8ffe00640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f81ec7a0 0x7ff8f81ecc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8ffe00640 1 --2- 172.21.15.59:0/960888818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8e0003b80 0x7ff8f8155be0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8ffe00640 1 -- 172.21.15.59:0/960888818 >> 172.21.15.59:0/960888818 conn(0x7ff8f80b2400 msgr2=0x7ff8f80b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8ffe00640 1 -- 172.21.15.59:0/960888818 shutdown_connections 2024-04-25T09:04:43.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:43.634+0000 7ff8ffe00640 1 -- 172.21.15.59:0/960888818 wait complete. 2024-04-25T09:04:43.645 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:04:43.645 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:04:43.645 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:04:43.645 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:04:43.645 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:43.645 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:04:43.646 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:04:43.646 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:04:43.646 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:43.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:43.646 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:04:43.655 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:04:43.655 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:04:43.655 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:04:43.655 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:43.655 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42284sec preferred_lft 42284sec 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:04:43.656 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:04:43.657 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:04:43.658 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:04:43.658 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:43.658 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:04:43.658 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:04:43.658 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:04:43.658 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:04:43.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:43.659 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:04:43.717 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:04:43.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:43.720 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:04:43.773 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:04:43.773 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:04:43.773 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:04:43.773 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:04:43.773 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:04:43.773 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:04:43.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:43.774 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:04:43.774 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:04:43.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:04:43.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:04:43.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:04:43.774 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:04:43.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:43.865 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:04:43.874 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:04:43.874 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:04:43.875 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:43.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:43.875 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:04:43.936 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:43.936 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:43.987 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:04:43.988 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:04:43.988 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:44.040 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:04:44.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:44.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:44.134 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:44.134 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:04:44.134 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:04:44.149 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:44.149 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:04:44.149 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:04:44.149 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:04:44.149 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:44.158 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:04:44.159 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:04:44.159 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:04:44.159 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:04:44.159 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:04:44.159 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:04:44.159 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:04:44.159 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:04:44.164 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:04:44.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:44.164 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:04:44.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:44.185 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:04:44.249 INFO:teuthology.orchestra.run.smithi059.stdout:client6375 2024-04-25T09:04:44.249 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:04:44.249 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:04:44.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:44.300 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-04-25T09:04:44.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:44.363 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-04-25T09:04:44.414 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:04:44.415 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:04:44.415 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:04:44.415 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:04:44.415 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-04-25T09:04:44.415 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:04:44.525 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627777 2024-04-25T09:04:44.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:04:44.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:04:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc62a00640 1 Processor -- start 2024-04-25T09:04:44.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc62a00640 1 -- start start 2024-04-25T09:04:44.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc62a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc5c06ac10 0x7fcc5c06b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc62a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c0ce130 con 0x7fcc5c145400 2024-04-25T09:04:44.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc62a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc5c0cd5b0 con 0x7fcc5c145020 2024-04-25T09:04:44.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc62a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5c0cd360 con 0x7fcc5c06ac10 2024-04-25T09:04:44.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc53400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcc5c145400 0x7fcc5c06fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:33908/0 (socket says 172.21.15.59:33908) 2024-04-25T09:04:44.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc53400640 1 -- 172.21.15.59:0/4099272706 learned_addr learned my addr 172.21.15.59:0/4099272706 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:44.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc60a00640 1 --2- 172.21.15.59:0/4099272706 >> v2:172.21.15.59:3300/0 conn(0x7fcc5c06ac10 0x7fcc5c06b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc60a00640 1 -- 172.21.15.59:0/4099272706 >> v1:172.21.15.178:6789/0 conn(0x7fcc5c145020 legacy=0x7fcc5c072cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:44.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc60a00640 1 -- 172.21.15.59:0/4099272706 >> v1:172.21.15.59:6789/0 conn(0x7fcc5c145400 legacy=0x7fcc5c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc60a00640 1 -- 172.21.15.59:0/4099272706 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c0cd890 con 0x7fcc5c06ac10 2024-04-25T09:04:44.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.726+0000 7fcc5b400640 1 -- 172.21.15.59:0/4099272706 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1710164871 0 0) 0x7fcc5c0ce130 con 0x7fcc5c145400 2024-04-25T09:04:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.730+0000 7fcc60a00640 1 --2- 172.21.15.59:0/4099272706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5c06ac10 0x7fcc5c06b0c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0cd4e0 tx=0x7fcc5401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd43bef3007b09d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.730+0000 7fcc5b400640 1 -- 172.21.15.59:0/4099272706 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc540b2070 con 0x7fcc5c06ac10 2024-04-25T09:04:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.730+0000 7fcc5b400640 1 -- 172.21.15.59:0/4099272706 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc540a5900 con 0x7fcc5c06ac10 2024-04-25T09:04:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.730+0000 7fcc5b400640 1 -- 172.21.15.59:0/4099272706 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc540a5cd0 con 0x7fcc5c06ac10 2024-04-25T09:04:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.730+0000 7fcc62a00640 1 -- 172.21.15.59:0/4099272706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5c06ac10 msgr2=0x7fcc5c06b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.730+0000 7fcc62a00640 1 --2- 172.21.15.59:0/4099272706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5c06ac10 0x7fcc5c06b0c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c0cd4e0 tx=0x7fcc5401c950 comp rx=0 tx=0).stop 2024-04-25T09:04:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.730+0000 7fcc62a00640 1 -- 172.21.15.59:0/4099272706 shutdown_connections 2024-04-25T09:04:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.730+0000 7fcc62a00640 1 --2- 172.21.15.59:0/4099272706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5c06ac10 0x7fcc5c06b0c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.730+0000 7fcc62a00640 1 -- 172.21.15.59:0/4099272706 >> 172.21.15.59:0/4099272706 conn(0x7fcc5c0b2400 msgr2=0x7fcc5c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.730+0000 7fcc62a00640 1 -- 172.21.15.59:0/4099272706 shutdown_connections 2024-04-25T09:04:44.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.730+0000 7fcc62a00640 1 -- 172.21.15.59:0/4099272706 wait complete. 2024-04-25T09:04:44.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc62a00640 1 Processor -- start 2024-04-25T09:04:44.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc62a00640 1 -- start start 2024-04-25T09:04:44.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc62a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc5c06ac10 0x7fcc5c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc62a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5c145020 0x7fcc5c0b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc62a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc5c145400 0x7fcc5c166d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc62a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c160190 con 0x7fcc5c145020 2024-04-25T09:04:44.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc62a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c160010 con 0x7fcc5c145400 2024-04-25T09:04:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc62a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c160310 con 0x7fcc5c06ac10 2024-04-25T09:04:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc53400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5c145020 0x7fcc5c0b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc53400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5c145020 0x7fcc5c0b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60740/0 (socket says 172.21.15.59:60740) 2024-04-25T09:04:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc53400640 1 -- 172.21.15.59:0/3683303517 learned_addr learned my addr 172.21.15.59:0/3683303517 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc5be00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc5c06ac10 0x7fcc5c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc60a00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc5c145400 0x7fcc5c166d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc53400640 1 -- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc5c06ac10 msgr2=0x7fcc5c159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc53400640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc5c06ac10 0x7fcc5c159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc53400640 1 -- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc5c145400 msgr2=0x7fcc5c166d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc53400640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc5c145400 0x7fcc5c166d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc53400640 1 -- 172.21.15.59:0/3683303517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c15a510 con 0x7fcc5c145020 2024-04-25T09:04:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc5be00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc5c06ac10 0x7fcc5c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc60a00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc5c145400 0x7fcc5c166d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc53400640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5c145020 0x7fcc5c0b3800 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400c410 tx=0x7fcc4400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc58c00640 1 -- 172.21.15.59:0/3683303517 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440074e0 con 0x7fcc5c145020 2024-04-25T09:04:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc58c00640 1 -- 172.21.15.59:0/3683303517 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc440047f0 con 0x7fcc5c145020 2024-04-25T09:04:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc58c00640 1 -- 172.21.15.59:0/3683303517 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc44007680 con 0x7fcc5c145020 2024-04-25T09:04:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc62a00640 1 -- 172.21.15.59:0/3683303517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c0b4880 con 0x7fcc5c145020 2024-04-25T09:04:44.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc62a00640 1 -- 172.21.15.59:0/3683303517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c0b45a0 con 0x7fcc5c145020 2024-04-25T09:04:44.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.734+0000 7fcc62a00640 1 -- 172.21.15.59:0/3683303517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c0745d0 con 0x7fcc5c145020 2024-04-25T09:04:44.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.738+0000 7fcc58c00640 1 -- 172.21.15.59:0/3683303517 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcc44011070 con 0x7fcc5c145020 2024-04-25T09:04:44.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.738+0000 7fcc58c00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc38066f60 0x7fcc38069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:44.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.738+0000 7fcc58c00640 1 -- 172.21.15.59:0/3683303517 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcc44084dc0 con 0x7fcc5c145020 2024-04-25T09:04:44.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.738+0000 7fcc5be00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc38066f60 0x7fcc38069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:44.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.738+0000 7fcc5be00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc38066f60 0x7fcc38069420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c000f70 tx=0x7fcc4c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:44.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.742+0000 7fcc58c00640 1 -- 172.21.15.59:0/3683303517 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcc5c15a510 con 0x7fcc5c145020 2024-04-25T09:04:44.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.938+0000 7fcc62a00640 1 -- 172.21.15.59:0/3683303517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcc5c072550 con 0x7fcc5c145020 2024-04-25T09:04:44.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc58c00640 1 -- 172.21.15.59:0/3683303517 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4936 (secure 0 0 0) 0x7fcc44055c30 con 0x7fcc5c145020 2024-04-25T09:04:44.932 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:44.932 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":38,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2580922028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2580922028},{"type":"v1","addr":"172.21.15.178:6837","nonce":2580922028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/126805970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":126805970},{"type":"v1","addr":"172.21.15.178:6836","nonce":126805970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/402319604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":402319604},{"type":"v1","addr":"172.21.15.59:6833","nonce":402319604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:36.727681+0000","modified":"2024-04-25T09:04:39.739856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/686404516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":686404516},{"type":"v1","addr":"172.21.15.59:6835","nonce":686404516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:04:44.933 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 38 2024-04-25T09:04:44.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc62a00640 1 -- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc38066f60 msgr2=0x7fcc38069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc62a00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc38066f60 0x7fcc38069420 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c000f70 tx=0x7fcc4c009040 comp rx=0 tx=0).stop 2024-04-25T09:04:44.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc62a00640 1 -- 172.21.15.59:0/3683303517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5c145020 msgr2=0x7fcc5c0b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:44.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc62a00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5c145020 0x7fcc5c0b3800 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400c410 tx=0x7fcc4400c8d0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc62a00640 1 -- 172.21.15.59:0/3683303517 shutdown_connections 2024-04-25T09:04:44.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc62a00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc38066f60 0x7fcc38069420 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc62a00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc5c145400 0x7fcc5c166d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc62a00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc5c145020 0x7fcc5c0b3800 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc62a00640 1 --2- 172.21.15.59:0/3683303517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc5c06ac10 0x7fcc5c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:44.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc62a00640 1 -- 172.21.15.59:0/3683303517 >> 172.21.15.59:0/3683303517 conn(0x7fcc5c0b2400 msgr2=0x7fcc5c0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:44.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc62a00640 1 -- 172.21.15.59:0/3683303517 shutdown_connections 2024-04-25T09:04:44.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:44.942+0000 7fcc62a00640 1 -- 172.21.15.59:0/3683303517 wait complete. 2024-04-25T09:04:44.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:04:45.127 INFO:teuthology.orchestra.run.smithi059.stdout:{"message":"","return_code":0} 2024-04-25T09:04:45.127 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:04:45.128 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-25T09:04:45.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.182+0000 7f87ba8e2080 1 Processor -- start 2024-04-25T09:04:45.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.182+0000 7f87ba8e2080 1 -- start start 2024-04-25T09:04:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.182+0000 7f87ba8e2080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b316827770 0x55b31684f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.182+0000 7f87ba8e2080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b3168df930 0x55b3168e2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.182+0000 7f87ba8e2080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b3168e2d00 0x55b3168e2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.182+0000 7f87ba8e2080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3168e3ee0 con 0x55b316827770 2024-04-25T09:04:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.182+0000 7f87ba8e2080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3167cb9f0 con 0x55b3168e2d00 2024-04-25T09:04:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.182+0000 7f87ba8e2080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b3168e0890 con 0x55b3168df930 2024-04-25T09:04:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.182+0000 7f87b7c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b316827770 0x55b31684f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.182+0000 7f87b7c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b316827770 0x55b31684f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60762/0 (socket says 172.21.15.59:60762) 2024-04-25T09:04:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.182+0000 7f87b7c00640 1 -- 172.21.15.59:0/1027714240 learned_addr learned my addr 172.21.15.59:0/1027714240 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b8600640 1 --2- 172.21.15.59:0/1027714240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b3168e2d00 0x55b3168e2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b7200640 1 --2- 172.21.15.59:0/1027714240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b3168df930 0x55b3168e2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b7c00640 1 -- 172.21.15.59:0/1027714240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b3168df930 msgr2=0x55b3168e2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b7c00640 1 --2- 172.21.15.59:0/1027714240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b3168df930 0x55b3168e2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b7c00640 1 -- 172.21.15.59:0/1027714240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b3168e2d00 msgr2=0x55b3168e2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b7c00640 1 --2- 172.21.15.59:0/1027714240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b3168e2d00 0x55b3168e2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b7c00640 1 -- 172.21.15.59:0/1027714240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3168e5700 con 0x55b316827770 2024-04-25T09:04:45.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b7200640 1 --2- 172.21.15.59:0/1027714240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b3168df930 0x55b3168e2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:45.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b7c00640 1 --2- 172.21.15.59:0/1027714240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b316827770 0x55b31684f350 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f87a800a750 tx=0x7f87a800ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2c280e1b436152 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b5e00640 1 -- 172.21.15.59:0/1027714240 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a800ae60 con 0x55b316827770 2024-04-25T09:04:45.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b5e00640 1 -- 172.21.15.59:0/1027714240 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a8008c00 con 0x55b316827770 2024-04-25T09:04:45.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b5e00640 1 -- 172.21.15.59:0/1027714240 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a80133f0 con 0x55b316827770 2024-04-25T09:04:45.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 -- 172.21.15.59:0/1027714240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b316827770 msgr2=0x55b31684f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 --2- 172.21.15.59:0/1027714240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b316827770 0x55b31684f350 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f87a800a750 tx=0x7f87a800ac10 comp rx=0 tx=0).stop 2024-04-25T09:04:45.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 -- 172.21.15.59:0/1027714240 shutdown_connections 2024-04-25T09:04:45.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 --2- 172.21.15.59:0/1027714240 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b3168e2d00 0x55b3168e2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 --2- 172.21.15.59:0/1027714240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b3168df930 0x55b3168e2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 --2- 172.21.15.59:0/1027714240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b316827770 0x55b31684f350 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 -- 172.21.15.59:0/1027714240 >> 172.21.15.59:0/1027714240 conn(0x55b316825400 msgr2=0x55b316850b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 -- 172.21.15.59:0/1027714240 shutdown_connections 2024-04-25T09:04:45.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 -- 172.21.15.59:0/1027714240 wait complete. 2024-04-25T09:04:45.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 Processor -- start 2024-04-25T09:04:45.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 -- start start 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b316827770 0x55b3168cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3168df930 0x55b3168cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b3168e2d00 0x55b3168ce470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3168e59a0 con 0x55b3168df930 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3168fd980 con 0x55b3168e2d00 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87ba8e2080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b3168e5c40 con 0x55b316827770 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3168df930 0x55b3168cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3168df930 0x55b3168cdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60768/0 (socket says 172.21.15.59:60768) 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b7200640 1 -- 172.21.15.59:0/4141235524 learned_addr learned my addr 172.21.15.59:0/4141235524 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b7c00640 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b316827770 0x55b3168cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.186+0000 7f87b8600640 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b3168e2d00 0x55b3168ce470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b7200640 1 -- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b316827770 msgr2=0x55b3168cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b7200640 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b316827770 0x55b3168cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b7200640 1 -- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b3168e2d00 msgr2=0x55b3168ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b7200640 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b3168e2d00 0x55b3168ce470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b7200640 1 -- 172.21.15.59:0/4141235524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3168c86c0 con 0x55b3168df930 2024-04-25T09:04:45.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b7200640 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3168df930 0x55b3168cdf30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f87a4003ef0 tx=0x7f87a400b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b4a00640 1 -- 172.21.15.59:0/4141235524 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a4014070 con 0x55b3168df930 2024-04-25T09:04:45.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b4a00640 1 -- 172.21.15.59:0/4141235524 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a40105f0 con 0x55b3168df930 2024-04-25T09:04:45.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b4a00640 1 -- 172.21.15.59:0/4141235524 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a400a040 con 0x55b3168df930 2024-04-25T09:04:45.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87ba8e2080 1 -- 172.21.15.59:0/4141235524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b3168c8960 con 0x55b3168df930 2024-04-25T09:04:45.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87ba8e2080 1 -- 172.21.15.59:0/4141235524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b3168c8ea0 con 0x55b3168df930 2024-04-25T09:04:45.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b4a00640 1 -- 172.21.15.59:0/4141235524 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f87a4017070 con 0x55b3168df930 2024-04-25T09:04:45.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b4a00640 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f87980659a0 0x7f8798067e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b4a00640 1 -- 172.21.15.59:0/4141235524 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f87a4083dc0 con 0x55b3168df930 2024-04-25T09:04:45.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87ba8e2080 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55b3169063d0 0x55b3169067b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87ba8e2080 1 -- 172.21.15.59:0/4141235524 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e66) v9 -- 0x55b3168c78e0 con 0x55b3169063d0 2024-04-25T09:04:45.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.190+0000 7f87b7c00640 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f87980659a0 0x7f8798067e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87b8600640 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55b3169063d0 0x55b3169067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87b7c00640 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f87980659a0 0x7f8798067e60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f87a8000c10 tx=0x7f87a800c000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87b8600640 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55b3169063d0 0x55b3169067b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87b8600640 1 -- 172.21.15.59:0/4141235524 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7f87b00ab490 con 0x55b3169063d0 2024-04-25T09:04:45.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87ba8e2080 1 -- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55b3169063d0 msgr2=0x55b3169067b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87ba8e2080 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55b3169063d0 0x55b3169067b0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87ba8e2080 1 -- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f87980659a0 msgr2=0x7f8798067e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87ba8e2080 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f87980659a0 0x7f8798067e60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f87a8000c10 tx=0x7f87a800c000 comp rx=0 tx=0).stop 2024-04-25T09:04:45.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87ba8e2080 1 -- 172.21.15.59:0/4141235524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3168df930 msgr2=0x55b3168cdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87ba8e2080 1 --2- 172.21.15.59:0/4141235524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b3168df930 0x55b3168cdf30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f87a4003ef0 tx=0x7f87a400b5c0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87b8600640 1 -- 172.21.15.59:0/4141235524 reap_dead start 2024-04-25T09:04:45.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87ba8e2080 1 -- 172.21.15.59:0/4141235524 shutdown_connections 2024-04-25T09:04:45.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87ba8e2080 1 -- 172.21.15.59:0/4141235524 >> 172.21.15.59:0/4141235524 conn(0x55b316825400 msgr2=0x55b3168fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87ba8e2080 1 -- 172.21.15.59:0/4141235524 shutdown_connections 2024-04-25T09:04:45.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.194+0000 7f87ba8e2080 1 -- 172.21.15.59:0/4141235524 wait complete. 2024-04-25T09:04:45.187 INFO:teuthology.orchestra.run.smithi059.stdout:Xfiledir_test 2024-04-25T09:04:45.190 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:45.190 DEBUG:teuthology.orchestra.run.smithi059:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-25T09:04:45.236 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:04:45.236 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 1099511627777, 2024-04-25T09:04:45.236 INFO:teuthology.orchestra.run.smithi059.stdout: "ancestors": [ 2024-04-25T09:04:45.236 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout: "dirino": 1099511627776, 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout: "dname": "file", 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout: "version": 2 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout: "dirino": 1, 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout: "dname": "dir_test", 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout: "version": 4 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout: "pool": 10, 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout: "old_pools": [] 2024-04-25T09:04:45.237 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:04:45.238 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:04:45.241 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-04-25T09:04:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.342+0000 7fb776414080 1 Processor -- start 2024-04-25T09:04:45.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.342+0000 7fb776414080 1 -- start start 2024-04-25T09:04:45.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 0x560e67624150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e67607f50 0x560e675910a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560e6760d610 0x560e6760da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e67608c10 con 0x560e67607720 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e674f39f0 con 0x560e67607f50 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e67608eb0 con 0x560e6760d610 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb773600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 0x560e67624150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb773600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 0x560e67624150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60782/0 (socket says 172.21.15.59:60782) 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb773600640 1 -- 172.21.15.59:0/1002075540 learned_addr learned my addr 172.21.15.59:0/1002075540 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb772c00640 1 --2- 172.21.15.59:0/1002075540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e67607f50 0x560e675910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb774000640 1 --2- 172.21.15.59:0/1002075540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560e6760d610 0x560e6760da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb773600640 1 -- 172.21.15.59:0/1002075540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560e6760d610 msgr2=0x560e6760da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb773600640 1 --2- 172.21.15.59:0/1002075540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560e6760d610 0x560e6760da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb773600640 1 -- 172.21.15.59:0/1002075540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e67607f50 msgr2=0x560e675910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb773600640 1 --2- 172.21.15.59:0/1002075540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e67607f50 0x560e675910a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb773600640 1 -- 172.21.15.59:0/1002075540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e6760df60 con 0x560e67607720 2024-04-25T09:04:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb773600640 1 --2- 172.21.15.59:0/1002075540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 0x560e67624150 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb76400a750 tx=0x7fb76400ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88cbd2bfd7f90ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb771800640 1 -- 172.21.15.59:0/1002075540 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76400ae60 con 0x560e67607720 2024-04-25T09:04:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb771800640 1 -- 172.21.15.59:0/1002075540 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb764008c00 con 0x560e67607720 2024-04-25T09:04:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb771800640 1 -- 172.21.15.59:0/1002075540 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7640133f0 con 0x560e67607720 2024-04-25T09:04:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 -- 172.21.15.59:0/1002075540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 msgr2=0x560e67624150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 --2- 172.21.15.59:0/1002075540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 0x560e67624150 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb76400a750 tx=0x7fb76400ac10 comp rx=0 tx=0).stop 2024-04-25T09:04:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 -- 172.21.15.59:0/1002075540 shutdown_connections 2024-04-25T09:04:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 --2- 172.21.15.59:0/1002075540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560e6760d610 0x560e6760da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 --2- 172.21.15.59:0/1002075540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e67607f50 0x560e675910a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 --2- 172.21.15.59:0/1002075540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 0x560e67624150 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 -- 172.21.15.59:0/1002075540 >> 172.21.15.59:0/1002075540 conn(0x560e6754d3b0 msgr2=0x560e67609f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 -- 172.21.15.59:0/1002075540 shutdown_connections 2024-04-25T09:04:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 -- 172.21.15.59:0/1002075540 wait complete. 2024-04-25T09:04:45.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 Processor -- start 2024-04-25T09:04:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.346+0000 7fb776414080 1 -- start start 2024-04-25T09:04:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb776414080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 0x560e67578820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb776414080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560e67607f50 0x560e6757a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb776414080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e6760d610 0x560e676c1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb776414080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e6760c270 con 0x560e67607720 2024-04-25T09:04:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb776414080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e6760c510 con 0x560e6760d610 2024-04-25T09:04:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb776414080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560e6760c7b0 con 0x560e67607f50 2024-04-25T09:04:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb773600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 0x560e67578820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb773600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 0x560e67578820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60796/0 (socket says 172.21.15.59:60796) 2024-04-25T09:04:45.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb773600640 1 -- 172.21.15.59:0/1571592903 learned_addr learned my addr 172.21.15.59:0/1571592903 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb774000640 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e6760d610 0x560e676c1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb772c00640 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560e67607f50 0x560e6757a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb773600640 1 -- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560e67607f50 msgr2=0x560e6757a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb773600640 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560e67607f50 0x560e6757a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb773600640 1 -- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e6760d610 msgr2=0x560e676c1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb773600640 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560e6760d610 0x560e676c1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb773600640 1 -- 172.21.15.59:0/1571592903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e676b6980 con 0x560e67607720 2024-04-25T09:04:45.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb772c00640 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560e67607f50 0x560e6757a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:45.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb773600640 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 0x560e67578820 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb764013e70 tx=0x7fb764003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb76be00640 1 -- 172.21.15.59:0/1571592903 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76400ae60 con 0x560e67607720 2024-04-25T09:04:45.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb76be00640 1 -- 172.21.15.59:0/1571592903 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76400a030 con 0x560e67607720 2024-04-25T09:04:45.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb76be00640 1 -- 172.21.15.59:0/1571592903 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764020070 con 0x560e67607720 2024-04-25T09:04:45.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb776414080 1 -- 172.21.15.59:0/1571592903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560e676b6c20 con 0x560e67607720 2024-04-25T09:04:45.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.350+0000 7fb776414080 1 -- 172.21.15.59:0/1571592903 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e6757abf0 con 0x560e67607720 2024-04-25T09:04:45.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.354+0000 7fb76be00640 1 -- 172.21.15.59:0/1571592903 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb76401c430 con 0x560e67607720 2024-04-25T09:04:45.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.354+0000 7fb76be00640 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb754065970 0x7fb754067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.354+0000 7fb76be00640 1 -- 172.21.15.59:0/1571592903 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb764010020 con 0x560e67607720 2024-04-25T09:04:45.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.354+0000 7fb776414080 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x560e676b8610 0x560e676c1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.354+0000 7fb776414080 1 -- 172.21.15.59:0/1571592903 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:1 10.7 10:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e66) v9 -- 0x560e676ca4d0 con 0x560e676b8610 2024-04-25T09:04:45.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.354+0000 7fb772c00640 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb754065970 0x7fb754067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.354+0000 7fb774000640 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x560e676b8610 0x560e676c1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.354+0000 7fb772c00640 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb754065970 0x7fb754067e30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb7600ac000 tx=0x7fb7600a5000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.354+0000 7fb774000640 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x560e676b8610 0x560e676c1c50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.358+0000 7fb774000640 1 -- 172.21.15.59:0/1571592903 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v66'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fb76c0106a0 con 0x560e676b8610 2024-04-25T09:04:45.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.358+0000 7fb776414080 1 -- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x560e676b8610 msgr2=0x560e676c1c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.358+0000 7fb776414080 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x560e676b8610 0x560e676c1c50 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.358+0000 7fb776414080 1 -- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb754065970 msgr2=0x7fb754067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.358+0000 7fb776414080 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb754065970 0x7fb754067e30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb7600ac000 tx=0x7fb7600a5000 comp rx=0 tx=0).stop 2024-04-25T09:04:45.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.358+0000 7fb776414080 1 -- 172.21.15.59:0/1571592903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 msgr2=0x560e67578820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.358+0000 7fb776414080 1 --2- 172.21.15.59:0/1571592903 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560e67607720 0x560e67578820 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fb764013e70 tx=0x7fb764003030 comp rx=0 tx=0).stop 2024-04-25T09:04:45.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.358+0000 7fb774000640 1 -- 172.21.15.59:0/1571592903 reap_dead start 2024-04-25T09:04:45.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.358+0000 7fb776414080 1 -- 172.21.15.59:0/1571592903 shutdown_connections 2024-04-25T09:04:45.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.358+0000 7fb776414080 1 -- 172.21.15.59:0/1571592903 >> 172.21.15.59:0/1571592903 conn(0x560e6754d3b0 msgr2=0x560e67594620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.358+0000 7fb776414080 1 -- 172.21.15.59:0/1571592903 shutdown_connections 2024-04-25T09:04:45.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.358+0000 7fb776414080 1 -- 172.21.15.59:0/1571592903 wait complete. 2024-04-25T09:04:45.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:45.353 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-04-25T09:04:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f243d400640 1 Processor -- start 2024-04-25T09:04:45.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f243d400640 1 -- start start 2024-04-25T09:04:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f243d400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f243815dd00 0x7f24380af860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f243d400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380c60a0 0x7f24381676d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f243d400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24380c6dc0 con 0x7f24380ce1c0 2024-04-25T09:04:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f243d400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24380d0430 con 0x7f243815dd00 2024-04-25T09:04:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f243d400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24380c70a0 con 0x7f24380c60a0 2024-04-25T09:04:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f2437200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380c60a0 0x7f24381676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f2436800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f243815dd00 0x7f24380af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f2437200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380c60a0 0x7f24381676d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:59384/0 (socket says 172.21.15.59:59384) 2024-04-25T09:04:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f2437200640 1 -- 172.21.15.59:0/365466566 learned_addr learned my addr 172.21.15.59:0/365466566 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f242de00640 1 --1- 172.21.15.59:0/365466566 >> v1:172.21.15.178:6789/0 conn(0x7f24380ce1c0 0x7f24380c5990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:33650/0 (socket says 172.21.15.59:33650) 2024-04-25T09:04:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f2436800640 1 -- 172.21.15.59:0/365466566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380c60a0 msgr2=0x7f24381676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f2436800640 1 --2- 172.21.15.59:0/365466566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380c60a0 0x7f24381676d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f2436800640 1 -- 172.21.15.59:0/365466566 >> v1:172.21.15.178:6789/0 conn(0x7f24380ce1c0 legacy=0x7f24380c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f2436800640 1 -- 172.21.15.59:0/365466566 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380c7380 con 0x7f243815dd00 2024-04-25T09:04:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f2437200640 1 --2- 172.21.15.59:0/365466566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380c60a0 0x7f24381676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:04:45.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.554+0000 7f2435e00640 1 -- 172.21.15.59:0/365466566 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969841647 0 0) 0x7f24380c6dc0 con 0x7f24380ce1c0 2024-04-25T09:04:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.558+0000 7f2436800640 1 --2- 172.21.15.59:0/365466566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f243815dd00 0x7f24380af860 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f24280097c0 tx=0x7f242801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f023e627492a8661 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.558+0000 7f2435e00640 1 -- 172.21.15.59:0/365466566 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280b1070 con 0x7f243815dd00 2024-04-25T09:04:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.558+0000 7f2435e00640 1 -- 172.21.15.59:0/365466566 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24280ac410 con 0x7f243815dd00 2024-04-25T09:04:45.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.558+0000 7f2435e00640 1 -- 172.21.15.59:0/365466566 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280ac7e0 con 0x7f243815dd00 2024-04-25T09:04:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.558+0000 7f243d400640 1 -- 172.21.15.59:0/365466566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f243815dd00 msgr2=0x7f24380af860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.558+0000 7f243d400640 1 --2- 172.21.15.59:0/365466566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f243815dd00 0x7f24380af860 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f24280097c0 tx=0x7f242801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.558+0000 7f243d400640 1 -- 172.21.15.59:0/365466566 shutdown_connections 2024-04-25T09:04:45.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.558+0000 7f243d400640 1 --2- 172.21.15.59:0/365466566 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380c60a0 0x7f24381676d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.558+0000 7f243d400640 1 --2- 172.21.15.59:0/365466566 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f243815dd00 0x7f24380af860 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.558+0000 7f243d400640 1 -- 172.21.15.59:0/365466566 >> 172.21.15.59:0/365466566 conn(0x7f24380b2240 msgr2=0x7f24380b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.558+0000 7f243d400640 1 -- 172.21.15.59:0/365466566 shutdown_connections 2024-04-25T09:04:45.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.558+0000 7f243d400640 1 -- 172.21.15.59:0/365466566 wait complete. 2024-04-25T09:04:45.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f243d400640 1 Processor -- start 2024-04-25T09:04:45.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f243d400640 1 -- start start 2024-04-25T09:04:45.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f243d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24380c60a0 0x7f2438146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f243d400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380ce1c0 0x7f24380b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f243d400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24380b4700 0x7f2438151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f243d400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243816a7c0 con 0x7f24380c60a0 2024-04-25T09:04:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f243d400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243816a640 con 0x7f24380b4700 2024-04-25T09:04:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f243d400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243816a940 con 0x7f24380ce1c0 2024-04-25T09:04:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f2436800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24380c60a0 0x7f2438146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f2436800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24380c60a0 0x7f2438146db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60812/0 (socket says 172.21.15.59:60812) 2024-04-25T09:04:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f2436800640 1 -- 172.21.15.59:0/3812788214 learned_addr learned my addr 172.21.15.59:0/3812788214 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f2437200640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24380b4700 0x7f2438151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f242de00640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380ce1c0 0x7f24380b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f2436800640 1 -- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380ce1c0 msgr2=0x7f24380b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f2436800640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380ce1c0 0x7f24380b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f2436800640 1 -- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24380b4700 msgr2=0x7f2438151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f2436800640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24380b4700 0x7f2438151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f2436800640 1 -- 172.21.15.59:0/3812788214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24381472f0 con 0x7f24380c60a0 2024-04-25T09:04:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f242de00640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380ce1c0 0x7f24380b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:04:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f2436800640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24380c60a0 0x7f2438146db0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f24280af040 tx=0x7f2428019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f242f400640 1 -- 172.21.15.59:0/3812788214 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280b1040 con 0x7f24380c60a0 2024-04-25T09:04:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f242f400640 1 -- 172.21.15.59:0/3812788214 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24280bc070 con 0x7f24380c60a0 2024-04-25T09:04:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f242f400640 1 -- 172.21.15.59:0/3812788214 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280b5410 con 0x7f24380c60a0 2024-04-25T09:04:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f243d400640 1 -- 172.21.15.59:0/3812788214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24380b4bc0 con 0x7f24380c60a0 2024-04-25T09:04:45.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.562+0000 7f243d400640 1 -- 172.21.15.59:0/3812788214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24380b5180 con 0x7f24380c60a0 2024-04-25T09:04:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f242f400640 1 -- 172.21.15.59:0/3812788214 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f24280b55d0 con 0x7f24380c60a0 2024-04-25T09:04:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f242f400640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2414066f90 0x7f2414069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f242f400640 1 -- 172.21.15.59:0/3812788214 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f242811eb40 con 0x7f24380c60a0 2024-04-25T09:04:45.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f242de00640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2414066f90 0x7f2414069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f24407bc000 1 Processor -- start 2024-04-25T09:04:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f24407bc000 1 -- start start 2024-04-25T09:04:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f242de00640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2414066f90 0x7f2414069450 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2438156ac0 tx=0x7f2420009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f24407bc000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 0x55eb06988590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f24407bc000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06988ad0 0x55eb0696c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f24407bc000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb0696d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f24407bc000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb0678bfd0 con 0x55eb0696cf10 2024-04-25T09:04:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f24407bc000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb06714170 con 0x55eb069881b0 2024-04-25T09:04:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.566+0000 7f24407bc000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb06788070 con 0x55eb06988ad0 2024-04-25T09:04:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2437200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb0696d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2437200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb0696d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60822/0 (socket says 172.21.15.59:60822) 2024-04-25T09:04:45.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2437200640 1 -- 172.21.15.59:0/1001818115 learned_addr learned my addr 172.21.15.59:0/1001818115 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f242de00640 1 --2- 172.21.15.59:0/1001818115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06988ad0 0x55eb0696c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2436800640 1 --2- 172.21.15.59:0/1001818115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 0x55eb06988590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2437200640 1 -- 172.21.15.59:0/1001818115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06988ad0 msgr2=0x55eb0696c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2437200640 1 --2- 172.21.15.59:0/1001818115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06988ad0 0x55eb0696c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2437200640 1 -- 172.21.15.59:0/1001818115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 msgr2=0x55eb06988590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2437200640 1 --2- 172.21.15.59:0/1001818115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 0x55eb06988590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2437200640 1 -- 172.21.15.59:0/1001818115 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb067d2d20 con 0x55eb0696cf10 2024-04-25T09:04:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2437200640 1 --2- 172.21.15.59:0/1001818115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb0696d2f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2430009370 tx=0x7f2430009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df708853ac4dd9f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2427400640 1 -- 172.21.15.59:0/1001818115 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24300147f0 con 0x55eb0696cf10 2024-04-25T09:04:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2427400640 1 -- 172.21.15.59:0/1001818115 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243001a070 con 0x55eb0696cf10 2024-04-25T09:04:45.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f2427400640 1 -- 172.21.15.59:0/1001818115 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430014b90 con 0x55eb0696cf10 2024-04-25T09:04:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 -- 172.21.15.59:0/1001818115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 msgr2=0x55eb0696d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 --2- 172.21.15.59:0/1001818115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb0696d2f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f2430009370 tx=0x7f2430009810 comp rx=0 tx=0).stop 2024-04-25T09:04:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 -- 172.21.15.59:0/1001818115 shutdown_connections 2024-04-25T09:04:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 --2- 172.21.15.59:0/1001818115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb0696d2f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 --2- 172.21.15.59:0/1001818115 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06988ad0 0x55eb0696c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 --2- 172.21.15.59:0/1001818115 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 0x55eb06988590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 -- 172.21.15.59:0/1001818115 >> 172.21.15.59:0/1001818115 conn(0x55eb06944710 msgr2=0x55eb06944af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 -- 172.21.15.59:0/1001818115 shutdown_connections 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 -- 172.21.15.59:0/1001818115 wait complete. 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 -- start start 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 Processor -- start 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb0698f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.570+0000 7f24407bc000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 0x55eb0698fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06988ad0 0x55eb0696d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb06849c10 con 0x55eb0696cf10 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb06746680 con 0x55eb069881b0 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb06790600 con 0x55eb06988ad0 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 10 client.0 _ll_register_callbacks cb 0x55eb06841080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f2436800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb0698f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f2436800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb0698f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60836/0 (socket says 172.21.15.59:60836) 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f2436800640 1 -- 172.21.15.59:0/2215696149 learned_addr learned my addr 172.21.15.59:0/2215696149 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f242de00640 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 0x55eb0698fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f2437200640 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06988ad0 0x55eb0696d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f2436800640 1 -- 172.21.15.59:0/2215696149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06988ad0 msgr2=0x55eb0696d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f2436800640 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06988ad0 0x55eb0696d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f2436800640 1 -- 172.21.15.59:0/2215696149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 msgr2=0x55eb0698fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f2436800640 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 0x55eb0698fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f2436800640 1 -- 172.21.15.59:0/2215696149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb06763d30 con 0x55eb0696cf10 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f2437200640 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06988ad0 0x55eb0696d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f2436800640 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb0698f720 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f24280eefc0 tx=0x7f24280eec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa658f90d9d685e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f241be00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f241be00640 1 -- 172.21.15.59:0/2215696149 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242811b060 con 0x55eb0696cf10 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f241be00640 1 -- 172.21.15.59:0/2215696149 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f242811ca40 con 0x55eb0696cf10 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 -- 172.21.15.59:0/2215696149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f243001a070 con 0x55eb0696cf10 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f241be00640 1 -- 172.21.15.59:0/2215696149 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24280f3410 con 0x55eb0696cf10 2024-04-25T09:04:45.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 10 client.6414 fetch_fsmap learned FSMap version 38 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 -- 172.21.15.59:0/2215696149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55eb067143c0 con 0x55eb0696cf10 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f241be00640 1 -- 172.21.15.59:0/2215696149 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243001a070 con 0x55eb0696cf10 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f241be00640 1 -- 172.21.15.59:0/2215696149 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f24280b4050 con 0x55eb0696cf10 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 10 client.6414 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 10 client.6414 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 20 client.6414 populate_metadata read hostname 'smithi059' 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55eb0696dfd0 0x55eb0696e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 4 client.6414 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 -- 172.21.15.59:0/2215696149 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb06727e00 con 0x55eb0696dfd0 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f242de00640 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55eb0696dfd0 0x55eb0696e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f242de00640 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55eb0696dfd0 0x55eb0696e3e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=932d016712bc7f48 server_cookie=5d9f0f9574f56858 in_seq=0 out_seq=0 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f241be00640 10 client.6414 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f241be00640 1 -- 172.21.15.59:0/2215696149 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55eb06727e00 con 0x55eb0696dfd0 2024-04-25T09:04:45.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f241be00640 10 client.6414 handle_command_reply: tid=0 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 client.6414 shutdown 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 -- 172.21.15.59:0/2215696149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 msgr2=0x55eb0698f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb0698f720 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f24280eefc0 tx=0x7f24280eec20 comp rx=0 tx=0).stop 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 -- 172.21.15.59:0/2215696149 shutdown_connections 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55eb0696dfd0 0x55eb0696e3e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06988ad0 0x55eb0696d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 0x55eb0698fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 --2- 172.21.15.59:0/2215696149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb0698f720 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f241be00640 0 client.6414 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 -- 172.21.15.59:0/2215696149 >> 172.21.15.59:0/2215696149 conn(0x55eb06944710 msgr2=0x55eb0693c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 -- 172.21.15.59:0/2215696149 shutdown_connections 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 1 -- 172.21.15.59:0/2215696149 wait complete. 2024-04-25T09:04:45.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.574+0000 7f24407bc000 20 client.6414 trim_cache size 0 max 16384 2024-04-25T09:04:45.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.590+0000 7f24407bc000 1 Processor -- start 2024-04-25T09:04:45.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.590+0000 7f24407bc000 1 -- start start 2024-04-25T09:04:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.590+0000 7f24407bc000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06944710 0x55eb069e51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.590+0000 7f24407bc000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb069e5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.590+0000 7f24407bc000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 0x55eb069e5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.590+0000 7f24407bc000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438202f00 con 0x55eb0696cf10 2024-04-25T09:04:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.590+0000 7f24407bc000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24382020a0 con 0x55eb069881b0 2024-04-25T09:04:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.590+0000 7f24407bc000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24382014d0 con 0x55eb06944710 2024-04-25T09:04:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f242de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb069e5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f242de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb069e5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60842/0 (socket says 172.21.15.59:60842) 2024-04-25T09:04:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f242de00640 1 -- 172.21.15.59:0/2137575431 learned_addr learned my addr 172.21.15.59:0/2137575431 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f2437200640 1 --2- 172.21.15.59:0/2137575431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 0x55eb069e5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f2436800640 1 --2- 172.21.15.59:0/2137575431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06944710 0x55eb069e51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f242de00640 1 -- 172.21.15.59:0/2137575431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06944710 msgr2=0x55eb069e51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f242de00640 1 --2- 172.21.15.59:0/2137575431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06944710 0x55eb069e51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f242de00640 1 -- 172.21.15.59:0/2137575431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 msgr2=0x55eb069e5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f242de00640 1 --2- 172.21.15.59:0/2137575431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 0x55eb069e5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f242de00640 1 -- 172.21.15.59:0/2137575431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb0680e0f0 con 0x55eb0696cf10 2024-04-25T09:04:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f2436800640 1 --2- 172.21.15.59:0/2137575431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06944710 0x55eb069e51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f242de00640 1 --2- 172.21.15.59:0/2137575431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb069e5710 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2420000f70 tx=0x7f2420011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d16862d6f2c7124 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f2426a00640 1 -- 172.21.15.59:0/2137575431 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242002a020 con 0x55eb0696cf10 2024-04-25T09:04:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f2426a00640 1 -- 172.21.15.59:0/2137575431 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24200260b0 con 0x55eb0696cf10 2024-04-25T09:04:45.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f2426a00640 1 -- 172.21.15.59:0/2137575431 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2420026e60 con 0x55eb0696cf10 2024-04-25T09:04:45.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 -- 172.21.15.59:0/2137575431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 msgr2=0x55eb069e5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 --2- 172.21.15.59:0/2137575431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb069e5710 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2420000f70 tx=0x7f2420011000 comp rx=0 tx=0).stop 2024-04-25T09:04:45.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 -- 172.21.15.59:0/2137575431 shutdown_connections 2024-04-25T09:04:45.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 --2- 172.21.15.59:0/2137575431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb069881b0 0x55eb069e5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 --2- 172.21.15.59:0/2137575431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb0696cf10 0x55eb069e5710 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 --2- 172.21.15.59:0/2137575431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb06944710 0x55eb069e51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 -- 172.21.15.59:0/2137575431 >> 172.21.15.59:0/2137575431 conn(0x55eb06995b10 msgr2=0x55eb0696c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 -- 172.21.15.59:0/2137575431 shutdown_connections 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 -- 172.21.15.59:0/2137575431 wait complete. 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 -- start start 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 Processor -- start 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb06944710 0x55eb069e9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb0696cf10 0x55eb069e9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb069881b0 0x55eb0693dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb06732d40 con 0x55eb069881b0 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2438201ad0 con 0x55eb06944710 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb06846eb0 con 0x55eb0696cf10 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f24407bc000 10 client.0 _ll_register_callbacks cb 0x55eb06729b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:45.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f2437200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb069881b0 0x55eb0693dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f2436800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb06944710 0x55eb069e9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f2437200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb069881b0 0x55eb0693dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60852/0 (socket says 172.21.15.59:60852) 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f2437200640 1 -- 172.21.15.59:0/1601445928 learned_addr learned my addr 172.21.15.59:0/1601445928 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.594+0000 7f242de00640 1 --2- 172.21.15.59:0/1601445928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb0696cf10 0x55eb069e9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f2437200640 1 -- 172.21.15.59:0/1601445928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb0696cf10 msgr2=0x55eb069e9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f2437200640 1 --2- 172.21.15.59:0/1601445928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb0696cf10 0x55eb069e9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f2437200640 1 -- 172.21.15.59:0/1601445928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb06944710 msgr2=0x55eb069e9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f2437200640 1 --2- 172.21.15.59:0/1601445928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb06944710 0x55eb069e9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f2437200640 1 -- 172.21.15.59:0/1601445928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb06720d20 con 0x55eb069881b0 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f2437200640 1 --2- 172.21.15.59:0/1601445928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb069881b0 0x55eb0693dbc0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2430009340 tx=0x7f2430013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37217bb911fe2a53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f241be00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f241be00640 1 -- 172.21.15.59:0/1601445928 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430003ba0 con 0x55eb069881b0 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f241be00640 1 -- 172.21.15.59:0/1601445928 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2430003d40 con 0x55eb069881b0 2024-04-25T09:04:45.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 -- 172.21.15.59:0/1601445928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f24200260b0 con 0x55eb069881b0 2024-04-25T09:04:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f241be00640 1 -- 172.21.15.59:0/1601445928 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24300094d0 con 0x55eb069881b0 2024-04-25T09:04:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 10 client.6420 fetch_fsmap learned FSMap version 38 2024-04-25T09:04:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 -- 172.21.15.59:0/1601445928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55eb067330c0 con 0x55eb069881b0 2024-04-25T09:04:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f241be00640 1 -- 172.21.15.59:0/1601445928 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24200260b0 con 0x55eb069881b0 2024-04-25T09:04:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f241be00640 1 -- 172.21.15.59:0/1601445928 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2430028070 con 0x55eb069881b0 2024-04-25T09:04:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 10 client.6420 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T09:04:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 10 client.6420 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:04:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 20 client.6420 populate_metadata read hostname 'smithi059' 2024-04-25T09:04:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 --2- 172.21.15.59:0/1601445928 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55eb06988ad0 0x55eb0693e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 4 client.6420 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-04-25T09:04:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 -- 172.21.15.59:0/1601445928 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x55eb06799510 con 0x55eb06988ad0 2024-04-25T09:04:45.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f2436800640 1 --2- 172.21.15.59:0/1601445928 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55eb06988ad0 0x55eb0693e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f2436800640 1 --2- 172.21.15.59:0/1601445928 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55eb06988ad0 0x55eb0693e910 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2bfd047f30a236b server_cookie=6acb94d10c01ad34 in_seq=0 out_seq=0 2024-04-25T09:04:45.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f241be00640 10 client.6420 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:04:45.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f241be00640 1 -- 172.21.15.59:0/1601445928 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55eb06799510 con 0x55eb06988ad0 2024-04-25T09:04:45.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f241be00640 10 client.6420 handle_command_reply: tid=0 2024-04-25T09:04:45.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 client.6420 shutdown 2024-04-25T09:04:45.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 -- 172.21.15.59:0/1601445928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb069881b0 msgr2=0x55eb0693dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 --2- 172.21.15.59:0/1601445928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb069881b0 0x55eb0693dbc0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f2430009340 tx=0x7f2430013000 comp rx=0 tx=0).stop 2024-04-25T09:04:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 -- 172.21.15.59:0/1601445928 shutdown_connections 2024-04-25T09:04:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 --2- 172.21.15.59:0/1601445928 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55eb06988ad0 0x55eb0693e910 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.594 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f74af600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6375=0-4194304@1} caps={6375=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6375 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55b6de0f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:04:45.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 --2- 172.21.15.59:0/1601445928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55eb069881b0 0x55eb0693dbc0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 --2- 172.21.15.59:0/1601445928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55eb0696cf10 0x55eb069e9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 --2- 172.21.15.59:0/1601445928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55eb06944710 0x55eb069e9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 -- 172.21.15.59:0/1601445928 >> 172.21.15.59:0/1601445928 conn(0x55eb06995b10 msgr2=0x55eb069429e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f241be00640 0 client.6420 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:04:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 -- 172.21.15.59:0/1601445928 shutdown_connections 2024-04-25T09:04:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 1 -- 172.21.15.59:0/1601445928 wait complete. 2024-04-25T09:04:45.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.598+0000 7f24407bc000 20 client.6420 trim_cache size 0 max 16384 2024-04-25T09:04:45.595 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:04:45.595 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-04-25T09:04:45.596 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "dd2b6a95-0547-4612-b2a1-63ea1a1b6f73", 2024-04-25T09:04:45.596 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-04-25T09:04:45.596 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:04:45.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.602+0000 7f243d400640 1 -- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2414066f90 msgr2=0x7f2414069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.602+0000 7f243d400640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2414066f90 0x7f2414069450 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2438156ac0 tx=0x7f2420009040 comp rx=0 tx=0).stop 2024-04-25T09:04:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.602+0000 7f243d400640 1 -- 172.21.15.59:0/3812788214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24380c60a0 msgr2=0x7f2438146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.602+0000 7f243d400640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24380c60a0 0x7f2438146db0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f24280af040 tx=0x7f2428019240 comp rx=0 tx=0).stop 2024-04-25T09:04:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.602+0000 7f243d400640 1 -- 172.21.15.59:0/3812788214 shutdown_connections 2024-04-25T09:04:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.602+0000 7f243d400640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2414066f90 0x7f2414069450 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.602+0000 7f243d400640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f24380b4700 0x7f2438151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.602+0000 7f243d400640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f24380ce1c0 0x7f24380b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.602+0000 7f243d400640 1 --2- 172.21.15.59:0/3812788214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f24380c60a0 0x7f2438146db0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.602+0000 7f243d400640 1 -- 172.21.15.59:0/3812788214 >> 172.21.15.59:0/3812788214 conn(0x7f24380b2240 msgr2=0x7f24380ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.602+0000 7f243d400640 1 -- 172.21.15.59:0/3812788214 shutdown_connections 2024-04-25T09:04:45.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.602+0000 7f243d400640 1 -- 172.21.15.59:0/3812788214 wait complete. 2024-04-25T09:04:45.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:04:45.612 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T09:04:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.762+0000 7f2cca000640 1 Processor -- start 2024-04-25T09:04:45.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.762+0000 7f2cca000640 1 -- start start 2024-04-25T09:04:45.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cca000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2cc4144120 0x7f2cc415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cca000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cc40b3090 0x7f2cc40b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cca000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cc415bc40 con 0x7f2cc40ccbf0 2024-04-25T09:04:45.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cca000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cc415e490 con 0x7f2cc4144120 2024-04-25T09:04:45.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cca000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc415b3a0 con 0x7f2cc40b3090 2024-04-25T09:04:45.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cc3400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2cc4144120 0x7f2cc415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cc3e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cc40b3090 0x7f2cc40b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cbbe00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f2cc40ccbf0 0x7f2cc415e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:33666/0 (socket says 172.21.15.59:33666) 2024-04-25T09:04:45.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cbbe00640 1 -- 172.21.15.59:0/1941555676 learned_addr learned my addr 172.21.15.59:0/1941555676 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:04:45.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cc3400640 1 -- 172.21.15.59:0/1941555676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cc40b3090 msgr2=0x7f2cc40b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cc3400640 1 --2- 172.21.15.59:0/1941555676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cc40b3090 0x7f2cc40b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cc3400640 1 -- 172.21.15.59:0/1941555676 >> v1:172.21.15.178:6789/0 conn(0x7f2cc40ccbf0 legacy=0x7f2cc415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cc3400640 1 -- 172.21.15.59:0/1941555676 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc415b680 con 0x7f2cc4144120 2024-04-25T09:04:45.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.766+0000 7f2cc2a00640 1 -- 172.21.15.59:0/1941555676 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2452752882 0 0) 0x7f2cc415bc40 con 0x7f2cc40ccbf0 2024-04-25T09:04:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cc3400640 1 --2- 172.21.15.59:0/1941555676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cc4144120 0x7f2cc415acd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40097c0 tx=0x7f2cb401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a16bc52bcf0ef3d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cc2a00640 1 -- 172.21.15.59:0/1941555676 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40b0070 con 0x7f2cc4144120 2024-04-25T09:04:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cc2a00640 1 -- 172.21.15.59:0/1941555676 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb40ab600 con 0x7f2cc4144120 2024-04-25T09:04:45.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cc2a00640 1 -- 172.21.15.59:0/1941555676 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40ab9d0 con 0x7f2cc4144120 2024-04-25T09:04:45.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 -- 172.21.15.59:0/1941555676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cc4144120 msgr2=0x7f2cc415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 --2- 172.21.15.59:0/1941555676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cc4144120 0x7f2cc415acd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40097c0 tx=0x7f2cb401c410 comp rx=0 tx=0).stop 2024-04-25T09:04:45.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 -- 172.21.15.59:0/1941555676 shutdown_connections 2024-04-25T09:04:45.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 --2- 172.21.15.59:0/1941555676 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cc40b3090 0x7f2cc40b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 --2- 172.21.15.59:0/1941555676 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cc4144120 0x7f2cc415acd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 -- 172.21.15.59:0/1941555676 >> 172.21.15.59:0/1941555676 conn(0x7f2cc4067080 msgr2=0x7f2cc406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 -- 172.21.15.59:0/1941555676 shutdown_connections 2024-04-25T09:04:45.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 -- 172.21.15.59:0/1941555676 wait complete. 2024-04-25T09:04:45.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 Processor -- start 2024-04-25T09:04:45.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 -- start start 2024-04-25T09:04:45.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cc40b3090 0x7f2cc4140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cc40ccbf0 0x7f2cc413c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cc4144120 0x7f2cc4159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.770+0000 7f2cca000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc41675c0 con 0x7f2cc4144120 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cca000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4167440 con 0x7f2cc40b3090 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cca000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4167740 con 0x7f2cc40ccbf0 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cc3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cc4144120 0x7f2cc4159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cc3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cc4144120 0x7f2cc4159320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60858/0 (socket says 172.21.15.59:60858) 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cc3e00640 1 -- 172.21.15.59:0/3939211475 learned_addr learned my addr 172.21.15.59:0/3939211475 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cc3400640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cc40b3090 0x7f2cc4140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cbbe00640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cc40ccbf0 0x7f2cc413c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cc3e00640 1 -- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cc40ccbf0 msgr2=0x7f2cc413c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cc3e00640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cc40ccbf0 0x7f2cc413c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cc3e00640 1 -- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cc40b3090 msgr2=0x7f2cc4140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cc3e00640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cc40b3090 0x7f2cc4140450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cc3e00640 1 -- 172.21.15.59:0/3939211475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc40ad190 con 0x7f2cc4144120 2024-04-25T09:04:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cc3e00640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cc4144120 0x7f2cc4159320 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00efc0 tx=0x7f2cbc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cbb400640 1 -- 172.21.15.59:0/3939211475 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc018020 con 0x7f2cc4144120 2024-04-25T09:04:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cbb400640 1 -- 172.21.15.59:0/3939211475 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cbc014480 con 0x7f2cc4144120 2024-04-25T09:04:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cbb400640 1 -- 172.21.15.59:0/3939211475 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc014870 con 0x7f2cc4144120 2024-04-25T09:04:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cca000640 1 -- 172.21.15.59:0/3939211475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cc40ad430 con 0x7f2cc4144120 2024-04-25T09:04:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cca000640 1 -- 172.21.15.59:0/3939211475 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cc40adcd0 con 0x7f2cc4144120 2024-04-25T09:04:45.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.774+0000 7f2cbb400640 1 -- 172.21.15.59:0/3939211475 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2cbc01b020 con 0x7f2cc4144120 2024-04-25T09:04:45.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cbb400640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ca0066f90 0x7f2ca0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cbb400640 1 -- 172.21.15.59:0/3939211475 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2cbc085c60 con 0x7f2cc4144120 2024-04-25T09:04:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cc3400640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ca0066f90 0x7f2ca0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2ccd467000 1 Processor -- start 2024-04-25T09:04:45.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2ccd467000 1 -- start start 2024-04-25T09:04:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cc3400640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ca0066f90 0x7f2ca0069450 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40ad000 tx=0x7f2cb40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2ccd467000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 0x55e877a84db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2ccd467000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a852f0 0x55e877a3ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2ccd467000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a3b0a0 0x55e877a3b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2ccd467000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e877887ff0 con 0x55e877a849d0 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2ccd467000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e877810150 con 0x55e877a852f0 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2ccd467000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e877884090 con 0x55e877a3b0a0 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cc3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 0x55e877a84db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cc3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 0x55e877a84db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60870/0 (socket says 172.21.15.59:60870) 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cc3400640 1 -- 172.21.15.59:0/2625084399 learned_addr learned my addr 172.21.15.59:0/2625084399 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cbbe00640 1 --2- 172.21.15.59:0/2625084399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a852f0 0x55e877a3ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cc3e00640 1 --2- 172.21.15.59:0/2625084399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a3b0a0 0x55e877a3b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cc3400640 1 -- 172.21.15.59:0/2625084399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a3b0a0 msgr2=0x55e877a3b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cc3400640 1 --2- 172.21.15.59:0/2625084399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a3b0a0 0x55e877a3b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cc3400640 1 -- 172.21.15.59:0/2625084399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a852f0 msgr2=0x55e877a3ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cc3400640 1 --2- 172.21.15.59:0/2625084399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a852f0 0x55e877a3ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cc3400640 1 -- 172.21.15.59:0/2625084399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e877a1e0d0 con 0x55e877a849d0 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cbbe00640 1 --2- 172.21.15.59:0/2625084399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a852f0 0x55e877a3ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cc3400640 1 --2- 172.21.15.59:0/2625084399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 0x55e877a84db0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40ae040 tx=0x7f2cb4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee314bf0141f89d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cb3e00640 1 -- 172.21.15.59:0/2625084399 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40b0040 con 0x55e877a849d0 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cb3e00640 1 -- 172.21.15.59:0/2625084399 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb40c8070 con 0x55e877a849d0 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.778+0000 7f2cb3e00640 1 -- 172.21.15.59:0/2625084399 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40c3810 con 0x55e877a849d0 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 -- 172.21.15.59:0/2625084399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 msgr2=0x55e877a84db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 --2- 172.21.15.59:0/2625084399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 0x55e877a84db0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40ae040 tx=0x7f2cb4004740 comp rx=0 tx=0).stop 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 -- 172.21.15.59:0/2625084399 shutdown_connections 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 --2- 172.21.15.59:0/2625084399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a3b0a0 0x55e877a3b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 --2- 172.21.15.59:0/2625084399 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a852f0 0x55e877a3ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 --2- 172.21.15.59:0/2625084399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 0x55e877a84db0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 -- 172.21.15.59:0/2625084399 >> 172.21.15.59:0/2625084399 conn(0x55e877a37020 msgr2=0x55e877a39440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 -- 172.21.15.59:0/2625084399 shutdown_connections 2024-04-25T09:04:45.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 -- 172.21.15.59:0/2625084399 wait complete. 2024-04-25T09:04:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 -- start start 2024-04-25T09:04:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 Processor -- start 2024-04-25T09:04:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a3b0a0 0x55e877a697f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 0x55e877a69d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a852f0 0x55e877a6a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e87784c250 con 0x55e877a849d0 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e877842690 con 0x55e877a3b0a0 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e877810a40 con 0x55e877a852f0 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 10 client.0 _ll_register_callbacks cb 0x55e877a25e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cbbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 0x55e877a69d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cbbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 0x55e877a69d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60884/0 (socket says 172.21.15.59:60884) 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cbbe00640 1 -- 172.21.15.59:0/3879027431 learned_addr learned my addr 172.21.15.59:0/3879027431 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cc3400640 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a3b0a0 0x55e877a697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cc3e00640 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a852f0 0x55e877a6a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cbbe00640 1 -- 172.21.15.59:0/3879027431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a852f0 msgr2=0x55e877a6a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cbbe00640 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a852f0 0x55e877a6a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cbbe00640 1 -- 172.21.15.59:0/3879027431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a3b0a0 msgr2=0x55e877a697f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cbbe00640 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a3b0a0 0x55e877a697f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cbbe00640 1 -- 172.21.15.59:0/3879027431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e8779351c0 con 0x55e877a849d0 2024-04-25T09:04:45.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cbbe00640 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 0x55e877a69d30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2cac004e60 tx=0x7f2cac0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ea961a4ca1566e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cb0c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cb0c00640 1 -- 172.21.15.59:0/3879027431 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0145e0 con 0x55e877a849d0 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cb0c00640 1 -- 172.21.15.59:0/3879027431 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2cac00c910 con 0x55e877a849d0 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 -- 172.21.15.59:0/3879027431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2cb40c8070 con 0x55e877a849d0 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2cb0c00640 1 -- 172.21.15.59:0/3879027431 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cac00cb10 con 0x55e877a849d0 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 10 client.6429 fetch_fsmap learned FSMap version 38 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.782+0000 7f2ccd467000 1 -- 172.21.15.59:0/3879027431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55e877931170 con 0x55e877a849d0 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2cb0c00640 1 -- 172.21.15.59:0/3879027431 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb40c8070 con 0x55e877a849d0 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2cb0c00640 1 -- 172.21.15.59:0/3879027431 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2cac00ccb0 con 0x55e877a849d0 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 10 client.6429 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 10 client.6429 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 20 client.6429 populate_metadata read hostname 'smithi059' 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55e877a94c80 0x55e877a97070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 4 client.6429 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:04:45.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 -- 172.21.15.59:0/3879027431 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e877823c60 con 0x55e877a94c80 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2cc3400640 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55e877a94c80 0x55e877a97070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2cb0c00640 10 client.6429 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2cc3400640 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55e877a94c80 0x55e877a97070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e71af0d29709138a server_cookie=5271b029820383a9 in_seq=0 out_seq=0 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2cb0c00640 1 -- 172.21.15.59:0/3879027431 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e877823c60 con 0x55e877a94c80 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2cb0c00640 10 client.6429 handle_command_reply: tid=0 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 client.6429 shutdown 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 -- 172.21.15.59:0/3879027431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 msgr2=0x55e877a69d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 0x55e877a69d30 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2cac004e60 tx=0x7f2cac0016d0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 -- 172.21.15.59:0/3879027431 shutdown_connections 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55e877a94c80 0x55e877a97070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a852f0 0x55e877a6a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a849d0 0x55e877a69d30 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 --2- 172.21.15.59:0/3879027431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a3b0a0 0x55e877a697f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2cb0c00640 0 client.6429 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 -- 172.21.15.59:0/3879027431 >> 172.21.15.59:0/3879027431 conn(0x55e877a37020 msgr2=0x55e877a39ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 -- 172.21.15.59:0/3879027431 shutdown_connections 2024-04-25T09:04:45.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 1 -- 172.21.15.59:0/3879027431 wait complete. 2024-04-25T09:04:45.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.786+0000 7f2ccd467000 20 client.6429 trim_cache size 0 max 16384 2024-04-25T09:04:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 Processor -- start 2024-04-25T09:04:45.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 -- start start 2024-04-25T09:04:45.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a3b0a0 0x55e877ae10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a849d0 0x55e877ae1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a852f0 0x55e877ae1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc42031b0 con 0x55e877a3b0a0 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc4202310 con 0x55e877a849d0 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc415c9c0 con 0x55e877a852f0 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2cc3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a3b0a0 0x55e877ae10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2cc3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a3b0a0 0x55e877ae10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60894/0 (socket says 172.21.15.59:60894) 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2cc3400640 1 -- 172.21.15.59:0/3253201003 learned_addr learned my addr 172.21.15.59:0/3253201003 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2cc3400640 1 -- 172.21.15.59:0/3253201003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a852f0 msgr2=0x55e877ae1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2cc3400640 1 --2- 172.21.15.59:0/3253201003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a852f0 0x55e877ae1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2cc3400640 1 -- 172.21.15.59:0/3253201003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a849d0 msgr2=0x55e877ae1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2cc3400640 1 --2- 172.21.15.59:0/3253201003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a849d0 0x55e877ae1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2cc3400640 1 -- 172.21.15.59:0/3253201003 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8778cede0 con 0x55e877a3b0a0 2024-04-25T09:04:45.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2cc3400640 1 --2- 172.21.15.59:0/3253201003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a3b0a0 0x55e877ae10f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40ae040 tx=0x7f2cb40b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ce5db2a79b2e2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2cb3400640 1 -- 172.21.15.59:0/3253201003 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40b0040 con 0x55e877a3b0a0 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2cb3400640 1 -- 172.21.15.59:0/3253201003 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb40da070 con 0x55e877a3b0a0 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2cb3400640 1 -- 172.21.15.59:0/3253201003 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb40d5740 con 0x55e877a3b0a0 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 -- 172.21.15.59:0/3253201003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a3b0a0 msgr2=0x55e877ae10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 --2- 172.21.15.59:0/3253201003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a3b0a0 0x55e877ae10f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40ae040 tx=0x7f2cb40b6000 comp rx=0 tx=0).stop 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 -- 172.21.15.59:0/3253201003 shutdown_connections 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 --2- 172.21.15.59:0/3253201003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a852f0 0x55e877ae1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 --2- 172.21.15.59:0/3253201003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a849d0 0x55e877ae1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 --2- 172.21.15.59:0/3253201003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a3b0a0 0x55e877ae10f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 -- 172.21.15.59:0/3253201003 >> 172.21.15.59:0/3253201003 conn(0x55e877a37020 msgr2=0x55e877a91fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 -- 172.21.15.59:0/3253201003 shutdown_connections 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.802+0000 7f2ccd467000 1 -- 172.21.15.59:0/3253201003 wait complete. 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 1 -- start start 2024-04-25T09:04:45.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 1 Processor -- start 2024-04-25T09:04:45.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a3b0a0 0x55e877a97380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a849d0 0x55e877a978c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a852f0 0x55e877a97e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e877822e00 con 0x55e877a852f0 2024-04-25T09:04:45.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cc415cfc0 con 0x55e877a849d0 2024-04-25T09:04:45.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e877887300 con 0x55e877a3b0a0 2024-04-25T09:04:45.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 10 client.0 _ll_register_callbacks cb 0x55e877a06040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:04:45.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cc3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a852f0 0x55e877a97e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cc3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a852f0 0x55e877a97e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60900/0 (socket says 172.21.15.59:60900) 2024-04-25T09:04:45.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cc3e00640 1 -- 172.21.15.59:0/1081018207 learned_addr learned my addr 172.21.15.59:0/1081018207 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cbbe00640 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a849d0 0x55e877a978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cc3400640 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a3b0a0 0x55e877a97380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cc3e00640 1 -- 172.21.15.59:0/1081018207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a3b0a0 msgr2=0x55e877a97380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cc3e00640 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a3b0a0 0x55e877a97380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cc3e00640 1 -- 172.21.15.59:0/1081018207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a849d0 msgr2=0x55e877a978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cc3e00640 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a849d0 0x55e877a978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cc3e00640 1 -- 172.21.15.59:0/1081018207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e8778298e0 con 0x55e877a852f0 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cc3400640 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a3b0a0 0x55e877a97380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cc3e00640 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a852f0 0x55e877a97e00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00ef90 tx=0x7f2cbc0564a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95306682e475d47 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cb0c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cb0c00640 1 -- 172.21.15.59:0/1081018207 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cbc0557c0 con 0x55e877a852f0 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cb0c00640 1 -- 172.21.15.59:0/1081018207 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(66..66 src has 1..66) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2cbc055960 con 0x55e877a852f0 2024-04-25T09:04:45.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 1 -- 172.21.15.59:0/1081018207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2cb40da070 con 0x55e877a852f0 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cb0c00640 1 -- 172.21.15.59:0/1081018207 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cbc05c3a0 con 0x55e877a852f0 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 10 client.6435 fetch_fsmap learned FSMap version 38 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 1 -- 172.21.15.59:0/1081018207 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x55e8778e18f0 con 0x55e877a852f0 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cb0c00640 1 -- 172.21.15.59:0/1081018207 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb40da070 con 0x55e877a852f0 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cb0c00640 1 -- 172.21.15.59:0/1081018207 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 38) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f2cbc05c540 con 0x55e877a852f0 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 10 client.6435 fetch_fsmap finished waiting for FSMap version 38 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 10 client.6435 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 20 client.6435 populate_metadata read hostname 'smithi059' 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55e877aeaf50 0x55e877aed340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 4 client.6435 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2ccd467000 1 -- 172.21.15.59:0/1081018207 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e877895530 con 0x55e877aeaf50 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.806+0000 7f2cc3400640 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55e877aeaf50 0x55e877aed340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cc3400640 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55e877aeaf50 0x55e877aed340 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b849dccf115a8b0f server_cookie=821fa0dacc769fad in_seq=0 out_seq=0 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cb0c00640 10 client.6435 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:04:45.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cb0c00640 1 -- 172.21.15.59:0/1081018207 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+253 (crc 0 0 0) 0x55e877895530 con 0x55e877aeaf50 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cb0c00640 10 client.6435 handle_command_reply: tid=0 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2ccd467000 1 client.6435 shutdown 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2ccd467000 1 -- 172.21.15.59:0/1081018207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a852f0 msgr2=0x55e877a97e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2ccd467000 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a852f0 0x55e877a97e00 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00ef90 tx=0x7f2cbc0564a0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2ccd467000 1 -- 172.21.15.59:0/1081018207 shutdown_connections 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2ccd467000 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55e877aeaf50 0x55e877aed340 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2ccd467000 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e877a852f0 0x55e877a97e00 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2ccd467000 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e877a849d0 0x55e877a978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2ccd467000 1 --2- 172.21.15.59:0/1081018207 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e877a3b0a0 0x55e877a97380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cb0c00640 0 client.6435 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2ccd467000 1 -- 172.21.15.59:0/1081018207 >> 172.21.15.59:0/1081018207 conn(0x55e877a37020 msgr2=0x55e877a830d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2ccd467000 1 -- 172.21.15.59:0/1081018207 shutdown_connections 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2ccd467000 1 -- 172.21.15.59:0/1081018207 wait complete. 2024-04-25T09:04:45.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2ccd467000 20 client.6435 trim_cache size 0 max 16384 2024-04-25T09:04:45.805 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:04:45.805 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:04:45.805 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-04-25T09:04:45.805 INFO:teuthology.orchestra.run.smithi059.stdout: "dd2b6a95-0547-4612-b2a1-63ea1a1b6f73": { 2024-04-25T09:04:45.805 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-04-25T09:04:45.805 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "dd2b6a95-0547-4612-b2a1-63ea1a1b6f73", 2024-04-25T09:04:45.805 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive" 2024-04-25T09:04:45.805 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:45.805 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:04:45.805 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:04:45.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cca000640 1 -- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ca0066f90 msgr2=0x7f2ca0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cca000640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ca0066f90 0x7f2ca0069450 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2cb40ad000 tx=0x7f2cb40a6000 comp rx=0 tx=0).stop 2024-04-25T09:04:45.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cca000640 1 -- 172.21.15.59:0/3939211475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cc4144120 msgr2=0x7f2cc4159320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:04:45.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cca000640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cc4144120 0x7f2cc4159320 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc00efc0 tx=0x7f2cbc00c490 comp rx=0 tx=0).stop 2024-04-25T09:04:45.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cca000640 1 -- 172.21.15.59:0/3939211475 shutdown_connections 2024-04-25T09:04:45.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cca000640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ca0066f90 0x7f2ca0069450 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cca000640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2cc4144120 0x7f2cc4159320 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cca000640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2cc40ccbf0 0x7f2cc413c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cca000640 1 --2- 172.21.15.59:0/3939211475 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2cc40b3090 0x7f2cc4140450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:04:45.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cca000640 1 -- 172.21.15.59:0/3939211475 >> 172.21.15.59:0/3939211475 conn(0x7f2cc4067080 msgr2=0x7f2cc40cecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:04:45.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cca000640 1 -- 172.21.15.59:0/3939211475 shutdown_connections 2024-04-25T09:04:45.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:04:45.810+0000 7f2cca000640 1 -- 172.21.15.59:0/3939211475 wait complete. 2024-04-25T09:04:45.820 INFO:tasks.cephfs.filesystem:scrub status for tag:dd2b6a95-0547-4612-b2a1-63ea1a1b6f73 - {'path': '/', 'tag': 'dd2b6a95-0547-4612-b2a1-63ea1a1b6f73', 'options': 'recursive'} 2024-04-25T09:04:49.373 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:04:49.382+0000 7f1096a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T09:04:52.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:04:52.989 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:15.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:15.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T09:05:15.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff222400640 1 Processor -- start 2024-04-25T09:05:15.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff222400640 1 -- start start 2024-04-25T09:05:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff222400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff21c15c9b0 0x7ff21c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff222400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff21c06e010 0x7ff21c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff222400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21c15fc00 con 0x7ff21c159320 2024-04-25T09:05:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff222400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21c06d640 con 0x7ff21c15c9b0 2024-04-25T09:05:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff222400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21c15fee0 con 0x7ff21c06e010 2024-04-25T09:05:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff21b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff21c159320 0x7ff21c15f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58798/0 (socket says 172.21.15.59:58798) 2024-04-25T09:05:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff21b400640 1 -- 172.21.15.59:0/988175453 learned_addr learned my addr 172.21.15.59:0/988175453 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:15.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff213e00640 1 --2- 172.21.15.59:0/988175453 >> v2:172.21.15.59:3300/0 conn(0x7ff21c15c9b0 0x7ff21c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff21be00640 1 --2- 172.21.15.59:0/988175453 >> v2:172.21.15.178:3300/0 conn(0x7ff21c06e010 0x7ff21c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff21aa00640 1 -- 172.21.15.59:0/988175453 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974364726 0 0) 0x7ff21c15fc00 con 0x7ff21c159320 2024-04-25T09:05:15.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff21aa00640 1 -- 172.21.15.59:0/988175453 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff200003530 con 0x7ff21c159320 2024-04-25T09:05:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff213e00640 1 -- 172.21.15.59:0/988175453 >> v2:172.21.15.178:3300/0 conn(0x7ff21c06e010 msgr2=0x7ff21c06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff213e00640 1 --2- 172.21.15.59:0/988175453 >> v2:172.21.15.178:3300/0 conn(0x7ff21c06e010 0x7ff21c06e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff213e00640 1 -- 172.21.15.59:0/988175453 >> v1:172.21.15.59:6789/0 conn(0x7ff21c159320 legacy=0x7ff21c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff213e00640 1 -- 172.21.15.59:0/988175453 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c1601c0 con 0x7ff21c15c9b0 2024-04-25T09:05:15.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.986+0000 7ff21be00640 1 --2- 172.21.15.59:0/988175453 >> v2:172.21.15.178:3300/0 conn(0x7ff21c06e010 0x7ff21c06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:15.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.990+0000 7ff213e00640 1 --2- 172.21.15.59:0/988175453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff21c15c9b0 0x7ff21c06dad0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff21c072630 tx=0x7ff20401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aedb9ce46cc7081a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.990+0000 7ff21aa00640 1 -- 172.21.15.59:0/988175453 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040b0070 con 0x7ff21c15c9b0 2024-04-25T09:05:15.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.990+0000 7ff21aa00640 1 -- 172.21.15.59:0/988175453 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2040ab600 con 0x7ff21c15c9b0 2024-04-25T09:05:15.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.990+0000 7ff21aa00640 1 -- 172.21.15.59:0/988175453 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040ab9b0 con 0x7ff21c15c9b0 2024-04-25T09:05:15.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.990+0000 7ff222400640 1 -- 172.21.15.59:0/988175453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff21c15c9b0 msgr2=0x7ff21c06dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.990+0000 7ff222400640 1 --2- 172.21.15.59:0/988175453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff21c15c9b0 0x7ff21c06dad0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff21c072630 tx=0x7ff20401c480 comp rx=0 tx=0).stop 2024-04-25T09:05:15.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.990+0000 7ff222400640 1 -- 172.21.15.59:0/988175453 shutdown_connections 2024-04-25T09:05:15.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.990+0000 7ff222400640 1 --2- 172.21.15.59:0/988175453 >> v2:172.21.15.178:3300/0 conn(0x7ff21c06e010 0x7ff21c06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.990+0000 7ff222400640 1 --2- 172.21.15.59:0/988175453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff21c15c9b0 0x7ff21c06dad0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.990+0000 7ff222400640 1 -- 172.21.15.59:0/988175453 >> 172.21.15.59:0/988175453 conn(0x7ff21c067080 msgr2=0x7ff21c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:15.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.990+0000 7ff222400640 1 -- 172.21.15.59:0/988175453 shutdown_connections 2024-04-25T09:05:15.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.990+0000 7ff222400640 1 -- 172.21.15.59:0/988175453 wait complete. 2024-04-25T09:05:15.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff222400640 1 Processor -- start 2024-04-25T09:05:15.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff222400640 1 -- start start 2024-04-25T09:05:15.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff222400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff21c06e010 0x7ff21c13b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff222400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21c159320 0x7ff21c144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff222400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff21c15c9b0 0x7ff21c1f64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff222400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c168920 con 0x7ff21c06e010 2024-04-25T09:05:15.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff222400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c1687a0 con 0x7ff21c15c9b0 2024-04-25T09:05:15.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff222400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c168aa0 con 0x7ff21c159320 2024-04-25T09:05:15.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff21b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff21c06e010 0x7ff21c13b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff21b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff21c06e010 0x7ff21c13b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59846/0 (socket says 172.21.15.59:59846) 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff21b400640 1 -- 172.21.15.59:0/2754087544 learned_addr learned my addr 172.21.15.59:0/2754087544 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff213e00640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21c159320 0x7ff21c144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff21be00640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff21c15c9b0 0x7ff21c1f64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff21b400640 1 -- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21c159320 msgr2=0x7ff21c144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff21b400640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21c159320 0x7ff21c144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff21b400640 1 -- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff21c15c9b0 msgr2=0x7ff21c1f64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff21b400640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff21c15c9b0 0x7ff21c1f64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff21b400640 1 -- 172.21.15.59:0/2754087544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c143880 con 0x7ff21c06e010 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff21b400640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff21c06e010 0x7ff21c13b090 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00c450 tx=0x7ff20c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff213400640 1 -- 172.21.15.59:0/2754087544 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c017070 con 0x7ff21c06e010 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff213400640 1 -- 172.21.15.59:0/2754087544 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c005cf0 con 0x7ff21c06e010 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff213400640 1 -- 172.21.15.59:0/2754087544 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0072f0 con 0x7ff21c06e010 2024-04-25T09:05:15.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff222400640 1 -- 172.21.15.59:0/2754087544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21c13f860 con 0x7ff21c06e010 2024-04-25T09:05:15.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.994+0000 7ff222400640 1 -- 172.21.15.59:0/2754087544 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21c13fe20 con 0x7ff21c06e010 2024-04-25T09:05:15.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213400640 1 -- 172.21.15.59:0/2754087544 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff20c01a070 con 0x7ff21c06e010 2024-04-25T09:05:15.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213400640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1f8066f90 0x7ff1f8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213400640 1 -- 172.21.15.59:0/2754087544 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7ff20c084710 con 0x7ff21c06e010 2024-04-25T09:05:15.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213e00640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1f8066f90 0x7ff1f8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff22582e000 1 Processor -- start 2024-04-25T09:05:15.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff22582e000 1 -- start start 2024-04-25T09:05:15.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213e00640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1f8066f90 0x7ff1f8069450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff2040ad000 tx=0x7ff204008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff22582e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbda9d0 0x55a72bbdadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff22582e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bb90b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff22582e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bb910a0 0x55a72bb91480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff22582e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a72b9ddff0 con 0x55a72bbdb2f0 2024-04-25T09:05:15.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff22582e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a72b966150 con 0x55a72bb910a0 2024-04-25T09:05:15.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff22582e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a72b9da090 con 0x55a72bbda9d0 2024-04-25T09:05:15.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bb90b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff21b400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbda9d0 0x55a72bbdadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bb90b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59852/0 (socket says 172.21.15.59:59852) 2024-04-25T09:05:15.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213e00640 1 -- 172.21.15.59:0/1812590690 learned_addr learned my addr 172.21.15.59:0/1812590690 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:15.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff21be00640 1 --2- 172.21.15.59:0/1812590690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bb910a0 0x55a72bb91480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213e00640 1 -- 172.21.15.59:0/1812590690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbda9d0 msgr2=0x55a72bbdadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:15.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213e00640 1 --2- 172.21.15.59:0/1812590690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbda9d0 0x55a72bbdadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213e00640 1 -- 172.21.15.59:0/1812590690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bb910a0 msgr2=0x55a72bb91480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:15.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213e00640 1 --2- 172.21.15.59:0/1812590690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bb910a0 0x55a72bb91480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:15.998+0000 7ff213e00640 1 -- 172.21.15.59:0/1812590690 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a72bb740d0 con 0x55a72bbdb2f0 2024-04-25T09:05:15.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff213e00640 1 --2- 172.21.15.59:0/1812590690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bb90b60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff2040ae040 tx=0x7ff2040a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97c2033da5c01122 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:15.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff20be00640 1 -- 172.21.15.59:0/1812590690 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040c7070 con 0x55a72bbdb2f0 2024-04-25T09:05:15.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff20be00640 1 -- 172.21.15.59:0/1812590690 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2040b6670 con 0x55a72bbdb2f0 2024-04-25T09:05:15.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff20be00640 1 -- 172.21.15.59:0/1812590690 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2040b0040 con 0x55a72bbdb2f0 2024-04-25T09:05:15.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 -- 172.21.15.59:0/1812590690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 msgr2=0x55a72bb90b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:15.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 --2- 172.21.15.59:0/1812590690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bb90b60 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7ff2040ae040 tx=0x7ff2040a6000 comp rx=0 tx=0).stop 2024-04-25T09:05:15.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 -- 172.21.15.59:0/1812590690 shutdown_connections 2024-04-25T09:05:15.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 --2- 172.21.15.59:0/1812590690 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bb910a0 0x55a72bb91480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 --2- 172.21.15.59:0/1812590690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bb90b60 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 --2- 172.21.15.59:0/1812590690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbda9d0 0x55a72bbdadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:15.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 -- 172.21.15.59:0/1812590690 >> 172.21.15.59:0/1812590690 conn(0x55a72bb8d020 msgr2=0x55a72bb8f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:15.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 -- 172.21.15.59:0/1812590690 shutdown_connections 2024-04-25T09:05:15.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 -- 172.21.15.59:0/1812590690 wait complete. 2024-04-25T09:05:15.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 -- start start 2024-04-25T09:05:15.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 Processor -- start 2024-04-25T09:05:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bb910a0 0x55a72bbbf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bbda9d0 0x55a72bbbfd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbdb2f0 0x55a72bbc0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a72b9a2250 con 0x55a72bb910a0 2024-04-25T09:05:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a72b998690 con 0x55a72bbda9d0 2024-04-25T09:05:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a72b966a40 con 0x55a72bbdb2f0 2024-04-25T09:05:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff22582e000 10 client.0 _ll_register_callbacks cb 0x55a72bb7be90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff21b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bb910a0 0x55a72bbbf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff21b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bb910a0 0x55a72bbbf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59858/0 (socket says 172.21.15.59:59858) 2024-04-25T09:05:15.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff21b400640 1 -- 172.21.15.59:0/2224643472 learned_addr learned my addr 172.21.15.59:0/2224643472 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff21be00640 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbdb2f0 0x55a72bbc0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff213e00640 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bbda9d0 0x55a72bbbfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff21b400640 1 -- 172.21.15.59:0/2224643472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbdb2f0 msgr2=0x55a72bbc0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff21b400640 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbdb2f0 0x55a72bbc0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff21b400640 1 -- 172.21.15.59:0/2224643472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bbda9d0 msgr2=0x55a72bbbfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff21b400640 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bbda9d0 0x55a72bbbfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff21b400640 1 -- 172.21.15.59:0/2224643472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a72ba8b1c0 con 0x55a72bb910a0 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.002+0000 7ff213e00640 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bbda9d0 0x55a72bbbfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff21b400640 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bb910a0 0x55a72bbbf7f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0070a0 tx=0x7ff20c058f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55092e5c4762df1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff208c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff208c00640 1 -- 172.21.15.59:0/2224643472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c007490 con 0x55a72bb910a0 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff208c00640 1 -- 172.21.15.59:0/2224643472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7ff20c007630 con 0x55a72bb910a0 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 -- 172.21.15.59:0/2224643472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2040b6670 con 0x55a72bb910a0 2024-04-25T09:05:16.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff208c00640 1 -- 172.21.15.59:0/2224643472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff20c0541f0 con 0x55a72bb910a0 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 10 client.6450 fetch_fsmap learned FSMap version 39 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 -- 172.21.15.59:0/2224643472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55a72ba87170 con 0x55a72bb910a0 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff208c00640 1 -- 172.21.15.59:0/2224643472 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2040b6670 con 0x55a72bb910a0 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff208c00640 1 -- 172.21.15.59:0/2224643472 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff20c054390 con 0x55a72bb910a0 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 10 client.6450 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 10 client.6450 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 20 client.6450 populate_metadata read hostname 'smithi059' 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a72bbeac80 0x55a72bbed070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 4 client.6450 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 -- 172.21.15.59:0/2224643472 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a72b979c60 con 0x55a72bbeac80 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff213e00640 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a72bbeac80 0x55a72bbed070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff213e00640 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a72bbeac80 0x55a72bbed070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d73cfd4e6d43d176 server_cookie=6de8f5c0fb1a85c6 in_seq=0 out_seq=0 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff208c00640 10 client.6450 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff208c00640 1 -- 172.21.15.59:0/2224643472 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55a72b979c60 con 0x55a72bbeac80 2024-04-25T09:05:16.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff208c00640 10 client.6450 handle_command_reply: tid=0 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 client.6450 shutdown 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 -- 172.21.15.59:0/2224643472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bb910a0 msgr2=0x55a72bbbf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bb910a0 0x55a72bbbf7f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7ff20c0070a0 tx=0x7ff20c058f00 comp rx=0 tx=0).stop 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 -- 172.21.15.59:0/2224643472 shutdown_connections 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a72bbeac80 0x55a72bbed070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbdb2f0 0x55a72bbc0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bbda9d0 0x55a72bbbfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 --2- 172.21.15.59:0/2224643472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bb910a0 0x55a72bbbf7f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff208c00640 0 client.6450 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 -- 172.21.15.59:0/2224643472 >> 172.21.15.59:0/2224643472 conn(0x55a72bb8d020 msgr2=0x55a72bb8fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 -- 172.21.15.59:0/2224643472 shutdown_connections 2024-04-25T09:05:16.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 1 -- 172.21.15.59:0/2224643472 wait complete. 2024-04-25T09:05:16.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.006+0000 7ff22582e000 20 client.6450 trim_cache size 0 max 16384 2024-04-25T09:05:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff22582e000 1 Processor -- start 2024-04-25T09:05:16.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff22582e000 1 -- start start 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff22582e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bb910a0 0x55a72bc370f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff22582e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bbda9d0 0x55a72bc37630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff22582e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bc37b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff22582e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c2036d0 con 0x55a72bbdb2f0 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff22582e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c2027f0 con 0x55a72bbda9d0 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff22582e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c201e30 con 0x55a72bb910a0 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff21be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bc37b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff21be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bc37b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59874/0 (socket says 172.21.15.59:59874) 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff21be00640 1 -- 172.21.15.59:0/205208274 learned_addr learned my addr 172.21.15.59:0/205208274 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff21be00640 1 -- 172.21.15.59:0/205208274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bb910a0 msgr2=0x55a72bc370f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff21be00640 1 --2- 172.21.15.59:0/205208274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bb910a0 0x55a72bc370f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff21be00640 1 -- 172.21.15.59:0/205208274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bbda9d0 msgr2=0x55a72bc37630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff21be00640 1 --2- 172.21.15.59:0/205208274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bbda9d0 0x55a72bc37630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.022+0000 7ff21be00640 1 -- 172.21.15.59:0/205208274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a72ba24de0 con 0x55a72bbdb2f0 2024-04-25T09:05:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff21be00640 1 --2- 172.21.15.59:0/205208274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bc37b70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff21400d780 tx=0x7ff214010040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebd340db4559dd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff20b400640 1 -- 172.21.15.59:0/205208274 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21401d070 con 0x55a72bbdb2f0 2024-04-25T09:05:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff20b400640 1 -- 172.21.15.59:0/205208274 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214003ba0 con 0x55a72bbdb2f0 2024-04-25T09:05:16.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff20b400640 1 -- 172.21.15.59:0/205208274 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400a960 con 0x55a72bbdb2f0 2024-04-25T09:05:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 -- 172.21.15.59:0/205208274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 msgr2=0x55a72bc37b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 --2- 172.21.15.59:0/205208274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bc37b70 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7ff21400d780 tx=0x7ff214010040 comp rx=0 tx=0).stop 2024-04-25T09:05:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 -- 172.21.15.59:0/205208274 shutdown_connections 2024-04-25T09:05:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 --2- 172.21.15.59:0/205208274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bc37b70 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 --2- 172.21.15.59:0/205208274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bbda9d0 0x55a72bc37630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 --2- 172.21.15.59:0/205208274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bb910a0 0x55a72bc370f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 -- 172.21.15.59:0/205208274 >> 172.21.15.59:0/205208274 conn(0x55a72bb8d020 msgr2=0x55a72bbd90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 -- 172.21.15.59:0/205208274 shutdown_connections 2024-04-25T09:05:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 -- 172.21.15.59:0/205208274 wait complete. 2024-04-25T09:05:16.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 -- start start 2024-04-25T09:05:16.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 Processor -- start 2024-04-25T09:05:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bb910a0 0x55a72bbed770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbda9d0 0x55a72bbedcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bbee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a72b978e00 con 0x55a72bbdb2f0 2024-04-25T09:05:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c202280 con 0x55a72bb910a0 2024-04-25T09:05:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a72b9dd300 con 0x55a72bbda9d0 2024-04-25T09:05:16.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 10 client.0 _ll_register_callbacks cb 0x55a72bb5c040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff21be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bbee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff21be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bbee1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59884/0 (socket says 172.21.15.59:59884) 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff21be00640 1 -- 172.21.15.59:0/1222483606 learned_addr learned my addr 172.21.15.59:0/1222483606 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff213e00640 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbda9d0 0x55a72bbedcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff21b400640 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bb910a0 0x55a72bbed770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff21be00640 1 -- 172.21.15.59:0/1222483606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbda9d0 msgr2=0x55a72bbedcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff21be00640 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbda9d0 0x55a72bbedcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff21be00640 1 -- 172.21.15.59:0/1222483606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bb910a0 msgr2=0x55a72bbed770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff21be00640 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bb910a0 0x55a72bbed770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff21be00640 1 -- 172.21.15.59:0/1222483606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a72b97f8e0 con 0x55a72bbdb2f0 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff21b400640 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bb910a0 0x55a72bbed770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff21be00640 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bbee1f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff214000f90 tx=0x7ff214004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f44c2aed980875f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff208c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:05:16.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff208c00640 1 -- 172.21.15.59:0/1222483606 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214027020 con 0x55a72bbdb2f0 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff208c00640 1 -- 172.21.15.59:0/1222483606 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7ff214003d50 con 0x55a72bbdb2f0 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.026+0000 7ff22582e000 1 -- 172.21.15.59:0/1222483606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff214003ba0 con 0x55a72bbdb2f0 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff208c00640 1 -- 172.21.15.59:0/1222483606 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff214031050 con 0x55a72bbdb2f0 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 10 client.6456 fetch_fsmap learned FSMap version 39 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 -- 172.21.15.59:0/1222483606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55a72ba378f0 con 0x55a72bbdb2f0 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff208c00640 1 -- 172.21.15.59:0/1222483606 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214003ba0 con 0x55a72bbdb2f0 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff208c00640 1 -- 172.21.15.59:0/1222483606 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff214034020 con 0x55a72bbdb2f0 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 10 client.6456 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 10 client.6456 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 20 client.6456 populate_metadata read hostname 'smithi059' 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a72bc40f50 0x55a72bc43340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 4 client.6456 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 -- 172.21.15.59:0/1222483606 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a72b9eb530 con 0x55a72bc40f50 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff21b400640 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a72bc40f50 0x55a72bc43340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff21b400640 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a72bc40f50 0x55a72bc43340 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea6d1b7a989d6382 server_cookie=49530c9fb178966a in_seq=0 out_seq=0 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff208c00640 10 client.6456 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff208c00640 1 -- 172.21.15.59:0/1222483606 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a72b9eb530 con 0x55a72bc40f50 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff208c00640 10 client.6456 handle_command_reply: tid=0 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 client.6456 shutdown 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 -- 172.21.15.59:0/1222483606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 msgr2=0x55a72bbee1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bbee1f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7ff214000f90 tx=0x7ff214004a50 comp rx=0 tx=0).stop 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 -- 172.21.15.59:0/1222483606 shutdown_connections 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55a72bc40f50 0x55a72bc43340 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55a72bbdb2f0 0x55a72bbee1f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55a72bbda9d0 0x55a72bbedcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff208c00640 0 client.6456 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 --2- 172.21.15.59:0/1222483606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55a72bb910a0 0x55a72bbed770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 -- 172.21.15.59:0/1222483606 >> 172.21.15.59:0/1222483606 conn(0x55a72bb8d020 msgr2=0x55a72bbd9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 -- 172.21.15.59:0/1222483606 shutdown_connections 2024-04-25T09:05:16.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 1 -- 172.21.15.59:0/1222483606 wait complete. 2024-04-25T09:05:16.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff22582e000 20 client.6456 trim_cache size 0 max 16384 2024-04-25T09:05:16.026 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:05:16.026 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-04-25T09:05:16.026 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2024-04-25T09:05:16.026 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:05:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff222400640 1 -- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1f8066f90 msgr2=0x7ff1f8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff222400640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1f8066f90 0x7ff1f8069450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7ff2040ad000 tx=0x7ff204008040 comp rx=0 tx=0).stop 2024-04-25T09:05:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff222400640 1 -- 172.21.15.59:0/2754087544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff21c06e010 msgr2=0x7ff21c13b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff222400640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff21c06e010 0x7ff21c13b090 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00c450 tx=0x7ff20c00c910 comp rx=0 tx=0).stop 2024-04-25T09:05:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff222400640 1 -- 172.21.15.59:0/2754087544 shutdown_connections 2024-04-25T09:05:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff222400640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff1f8066f90 0x7ff1f8069450 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff222400640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff21c15c9b0 0x7ff21c1f64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff222400640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff21c159320 0x7ff21c144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff222400640 1 --2- 172.21.15.59:0/2754087544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff21c06e010 0x7ff21c13b090 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff222400640 1 -- 172.21.15.59:0/2754087544 >> 172.21.15.59:0/2754087544 conn(0x7ff21c067080 msgr2=0x7ff21c073850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff222400640 1 -- 172.21.15.59:0/2754087544 shutdown_connections 2024-04-25T09:05:16.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.030+0000 7ff222400640 1 -- 172.21.15.59:0/2754087544 wait complete. 2024-04-25T09:05:16.041 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:05:16.042 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:16.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.189+0000 7f170b600640 1 Processor -- start 2024-04-25T09:05:16.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.189+0000 7f170b600640 1 -- start start 2024-04-25T09:05:16.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.189+0000 7f170b600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1704145270 0x7f170415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.189+0000 7f170b600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17040b1e60 0x7f17040cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.189+0000 7f170b600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17040cc4e0 con 0x7f17040cd4d0 2024-04-25T09:05:16.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.189+0000 7f170b600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1704145650 con 0x7f17040b1e60 2024-04-25T09:05:16.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.189+0000 7f170b600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17040ce040 con 0x7f1704145270 2024-04-25T09:05:16.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.189+0000 7f1709600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17040b1e60 0x7f17040cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.189+0000 7f1709600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17040b1e60 0x7f17040cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59890/0 (socket says 172.21.15.59:59890) 2024-04-25T09:05:16.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.189+0000 7f1709600640 1 -- 172.21.15.59:0/1251636985 learned_addr learned my addr 172.21.15.59:0/1251636985 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:16.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.189+0000 7f1709600640 1 -- 172.21.15.59:0/1251636985 >> v2:172.21.15.178:3300/0 conn(0x7f1704145270 msgr2=0x7f170415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.189+0000 7f1708c00640 1 --2- 172.21.15.59:0/1251636985 >> v2:172.21.15.178:3300/0 conn(0x7f1704145270 0x7f170415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f1709600640 1 --2- 172.21.15.59:0/1251636985 >> v2:172.21.15.178:3300/0 conn(0x7f1704145270 0x7f170415fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f1709600640 1 -- 172.21.15.59:0/1251636985 >> v1:172.21.15.178:6789/0 conn(0x7f17040cd4d0 legacy=0x7f17040b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f1709600640 1 -- 172.21.15.59:0/1251636985 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17040ce320 con 0x7f17040b1e60 2024-04-25T09:05:16.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f1708c00640 1 --2- 172.21.15.59:0/1251636985 >> v2:172.21.15.178:3300/0 conn(0x7f1704145270 0x7f170415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:16.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f1709600640 1 --2- 172.21.15.59:0/1251636985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17040b1e60 0x7f17040cd930 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f170406f3a0 tx=0x7f16fc01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4aed3dcb0f72201 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f1703400640 1 -- 172.21.15.59:0/1251636985 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0a5760 con 0x7f17040b1e60 2024-04-25T09:05:16.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f1703400640 1 -- 172.21.15.59:0/1251636985 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16fc0a5900 con 0x7f17040b1e60 2024-04-25T09:05:16.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f1703400640 1 -- 172.21.15.59:0/1251636985 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16fc0a5cd0 con 0x7f17040b1e60 2024-04-25T09:05:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f170b600640 1 -- 172.21.15.59:0/1251636985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17040b1e60 msgr2=0x7f17040cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f170b600640 1 --2- 172.21.15.59:0/1251636985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17040b1e60 0x7f17040cd930 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f170406f3a0 tx=0x7f16fc01c9b0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f170b600640 1 -- 172.21.15.59:0/1251636985 shutdown_connections 2024-04-25T09:05:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f170b600640 1 --2- 172.21.15.59:0/1251636985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17040b1e60 0x7f17040cd930 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f170b600640 1 --2- 172.21.15.59:0/1251636985 >> v2:172.21.15.178:3300/0 conn(0x7f1704145270 0x7f170415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f170b600640 1 -- 172.21.15.59:0/1251636985 >> 172.21.15.59:0/1251636985 conn(0x7f1704066fa0 msgr2=0x7f170406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f170b600640 1 -- 172.21.15.59:0/1251636985 shutdown_connections 2024-04-25T09:05:16.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.193+0000 7f170b600640 1 -- 172.21.15.59:0/1251636985 wait complete. 2024-04-25T09:05:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f170b600640 1 Processor -- start 2024-04-25T09:05:16.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f170b600640 1 -- start start 2024-04-25T09:05:16.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f170b600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17040b1e60 0x7f1704143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f170b600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17040cd4d0 0x7f17040afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f170b600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1704145270 0x7f17040b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f170b600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170415c710 con 0x7f17040cd4d0 2024-04-25T09:05:16.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f170b600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170415c590 con 0x7f1704145270 2024-04-25T09:05:16.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f170b600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f170415c890 con 0x7f17040b1e60 2024-04-25T09:05:16.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1703e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17040cd4d0 0x7f17040afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1703e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17040cd4d0 0x7f17040afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59902/0 (socket says 172.21.15.59:59902) 2024-04-25T09:05:16.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1703e00640 1 -- 172.21.15.59:0/3973732105 learned_addr learned my addr 172.21.15.59:0/3973732105 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:16.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1709600640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1704145270 0x7f17040b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1708c00640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17040b1e60 0x7f1704143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1703e00640 1 -- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17040b1e60 msgr2=0x7f1704143ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1703e00640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17040b1e60 0x7f1704143ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1703e00640 1 -- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1704145270 msgr2=0x7f17040b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1703e00640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1704145270 0x7f17040b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1703e00640 1 -- 172.21.15.59:0/3973732105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17040af8d0 con 0x7f17040cd4d0 2024-04-25T09:05:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1708c00640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17040b1e60 0x7f1704143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1703e00640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17040cd4d0 0x7f17040afc20 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c450 tx=0x7f16f000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1700c00640 1 -- 172.21.15.59:0/3973732105 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0012830 con 0x7f17040cd4d0 2024-04-25T09:05:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1700c00640 1 -- 172.21.15.59:0/3973732105 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f0017070 con 0x7f17040cd4d0 2024-04-25T09:05:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f170b600640 1 -- 172.21.15.59:0/3973732105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17040b0a30 con 0x7f17040cd4d0 2024-04-25T09:05:16.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f1700c00640 1 -- 172.21.15.59:0/3973732105 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0012c30 con 0x7f17040cd4d0 2024-04-25T09:05:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.197+0000 7f170b600640 1 -- 172.21.15.59:0/3973732105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17040b0ff0 con 0x7f17040cd4d0 2024-04-25T09:05:16.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.201+0000 7f170b600640 1 -- 172.21.15.59:0/3973732105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17040745d0 con 0x7f17040cd4d0 2024-04-25T09:05:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.201+0000 7f1700c00640 1 -- 172.21.15.59:0/3973732105 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f16f001c460 con 0x7f17040cd4d0 2024-04-25T09:05:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.201+0000 7f1700c00640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f16e4066f60 0x7f16e4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.201+0000 7f1700c00640 1 -- 172.21.15.59:0/3973732105 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f16f0084fa0 con 0x7f17040cd4d0 2024-04-25T09:05:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.201+0000 7f1708c00640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f16e4066f60 0x7f16e4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.201+0000 7f1708c00640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f16e4066f60 0x7f16e4069420 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f16f800a9b0 tx=0x7f16f8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.205+0000 7f1700c00640 1 -- 172.21.15.59:0/3973732105 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f16f0055d10 con 0x7f17040cd4d0 2024-04-25T09:05:16.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 -- 172.21.15.59:0/3973732105 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f170406b8e0 con 0x7f17040cd4d0 2024-04-25T09:05:16.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f1700c00640 1 -- 172.21.15.59:0/3973732105 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4936 (secure 0 0 0) 0x7f16f0055610 con 0x7f17040cd4d0 2024-04-25T09:05:16.397 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:16.397 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":39,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2580922028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2580922028},{"type":"v1","addr":"172.21.15.178:6837","nonce":2580922028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/126805970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":126805970},{"type":"v1","addr":"172.21.15.178:6836","nonce":126805970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/402319604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":402319604},{"type":"v1","addr":"172.21.15.59:6833","nonce":402319604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:36.727681+0000","modified":"2024-04-25T09:04:49.372533+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":6,"addr":"172.21.15.59:6835/686404516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":686404516},{"type":"v1","addr":"172.21.15.59:6835","nonce":686404516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:05:16.397 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 39 2024-04-25T09:05:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 -- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f16e4066f60 msgr2=0x7f16e4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f16e4066f60 0x7f16e4069420 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f16f800a9b0 tx=0x7f16f8008040 comp rx=0 tx=0).stop 2024-04-25T09:05:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 -- 172.21.15.59:0/3973732105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17040cd4d0 msgr2=0x7f17040afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17040cd4d0 0x7f17040afc20 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f16f000c450 tx=0x7f16f000c910 comp rx=0 tx=0).stop 2024-04-25T09:05:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 -- 172.21.15.59:0/3973732105 shutdown_connections 2024-04-25T09:05:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f16e4066f60 0x7f16e4069420 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1704145270 0x7f17040b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17040cd4d0 0x7f17040afc20 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 --2- 172.21.15.59:0/3973732105 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f17040b1e60 0x7f1704143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 -- 172.21.15.59:0/3973732105 >> 172.21.15.59:0/3973732105 conn(0x7f1704066fa0 msgr2=0x7f170406dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 -- 172.21.15.59:0/3973732105 shutdown_connections 2024-04-25T09:05:16.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.405+0000 7f170b600640 1 -- 172.21.15.59:0/3973732105 wait complete. 2024-04-25T09:05:16.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T09:05:16.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.569+0000 7f3377000640 1 Processor -- start 2024-04-25T09:05:16.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.569+0000 7f3377000640 1 -- start start 2024-04-25T09:05:16.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f3377000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f33700d0150 0x7f33700af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f3377000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f33700c72a0 0x7f33700c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f3377000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33700b30d0 con 0x7f337015dc00 2024-04-25T09:05:16.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f3377000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33700cd860 con 0x7f33700d0150 2024-04-25T09:05:16.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f3377000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33700ccf30 con 0x7f33700c72a0 2024-04-25T09:05:16.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f336fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f337015dc00 0x7f33700c6b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58810/0 (socket says 172.21.15.59:58810) 2024-04-25T09:05:16.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f336fe00640 1 -- 172.21.15.59:0/2594379113 learned_addr learned my addr 172.21.15.59:0/2594379113 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:16.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f3367400640 1 --2- 172.21.15.59:0/2594379113 >> v2:172.21.15.59:3300/0 conn(0x7f33700d0150 0x7f33700af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f3375000640 1 --2- 172.21.15.59:0/2594379113 >> v2:172.21.15.178:3300/0 conn(0x7f33700c72a0 0x7f33700c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f3367400640 1 -- 172.21.15.59:0/2594379113 >> v2:172.21.15.178:3300/0 conn(0x7f33700c72a0 msgr2=0x7f33700c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f3367400640 1 --2- 172.21.15.59:0/2594379113 >> v2:172.21.15.178:3300/0 conn(0x7f33700c72a0 0x7f33700c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f3367400640 1 -- 172.21.15.59:0/2594379113 >> v1:172.21.15.59:6789/0 conn(0x7f337015dc00 legacy=0x7f33700c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f3367400640 1 -- 172.21.15.59:0/2594379113 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33700cd210 con 0x7f33700d0150 2024-04-25T09:05:16.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.573+0000 7f3367400640 1 --2- 172.21.15.59:0/2594379113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33700d0150 0x7f33700af770 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f33700c6980 tx=0x7f335801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2de1548b918f4b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f336f400640 1 -- 172.21.15.59:0/2594379113 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580b0070 con 0x7f33700d0150 2024-04-25T09:05:16.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f336f400640 1 -- 172.21.15.59:0/2594379113 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33580ab600 con 0x7f33700d0150 2024-04-25T09:05:16.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f336f400640 1 -- 172.21.15.59:0/2594379113 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580ab9d0 con 0x7f33700d0150 2024-04-25T09:05:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 -- 172.21.15.59:0/2594379113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33700d0150 msgr2=0x7f33700af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 --2- 172.21.15.59:0/2594379113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33700d0150 0x7f33700af770 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f33700c6980 tx=0x7f335801c480 comp rx=0 tx=0).stop 2024-04-25T09:05:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 -- 172.21.15.59:0/2594379113 shutdown_connections 2024-04-25T09:05:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 --2- 172.21.15.59:0/2594379113 >> v2:172.21.15.178:3300/0 conn(0x7f33700c72a0 0x7f33700c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 --2- 172.21.15.59:0/2594379113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33700d0150 0x7f33700af770 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 -- 172.21.15.59:0/2594379113 >> 172.21.15.59:0/2594379113 conn(0x7f33700b2240 msgr2=0x7f33700b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 -- 172.21.15.59:0/2594379113 shutdown_connections 2024-04-25T09:05:16.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 -- 172.21.15.59:0/2594379113 wait complete. 2024-04-25T09:05:16.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 Processor -- start 2024-04-25T09:05:16.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 -- start start 2024-04-25T09:05:16.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33700c72a0 0x7f3370146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33700d0150 0x7f337014d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f337015dc00 0x7f33701570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337016a7c0 con 0x7f33700d0150 2024-04-25T09:05:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337016a640 con 0x7f337015dc00 2024-04-25T09:05:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3377000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337016a940 con 0x7f33700c72a0 2024-04-25T09:05:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3367400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33700d0150 0x7f337014d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3367400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33700d0150 0x7f337014d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59908/0 (socket says 172.21.15.59:59908) 2024-04-25T09:05:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3367400640 1 -- 172.21.15.59:0/3236613604 learned_addr learned my addr 172.21.15.59:0/3236613604 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f3375000640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f337015dc00 0x7f33701570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.577+0000 7f336fe00640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33700c72a0 0x7f3370146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f3367400640 1 -- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33700c72a0 msgr2=0x7f3370146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f3367400640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33700c72a0 0x7f3370146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f3367400640 1 -- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f337015dc00 msgr2=0x7f33701570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f3367400640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f337015dc00 0x7f33701570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f3367400640 1 -- 172.21.15.59:0/3236613604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3370156040 con 0x7f33700d0150 2024-04-25T09:05:16.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f3367400640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33700d0150 0x7f337014d820 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f335801a0b0 tx=0x7f3358019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f336cc00640 1 -- 172.21.15.59:0/3236613604 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580ba070 con 0x7f33700d0150 2024-04-25T09:05:16.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f336cc00640 1 -- 172.21.15.59:0/3236613604 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33580abc40 con 0x7f33700d0150 2024-04-25T09:05:16.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f336cc00640 1 -- 172.21.15.59:0/3236613604 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580b0040 con 0x7f33700d0150 2024-04-25T09:05:16.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f3377000640 1 -- 172.21.15.59:0/3236613604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3370156320 con 0x7f33700d0150 2024-04-25T09:05:16.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f3377000640 1 -- 172.21.15.59:0/3236613604 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33701568e0 con 0x7f33700d0150 2024-04-25T09:05:16.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f336cc00640 1 -- 172.21.15.59:0/3236613604 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f33580b43f0 con 0x7f33700d0150 2024-04-25T09:05:16.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.581+0000 7f336cc00640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f334c066f60 0x7f334c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f336cc00640 1 -- 172.21.15.59:0/3236613604 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f335811df70 con 0x7f33700d0150 2024-04-25T09:05:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 Processor -- start 2024-04-25T09:05:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 -- start start 2024-04-25T09:05:16.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f336fe00640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f334c066f60 0x7f334c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f336fe00640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f334c066f60 0x7f334c069420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3370153af0 tx=0x7f3360007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a6922e0 0x564a2a6926c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a692c00 0x564a2a6483a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 0x564a2a648cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2a52fba0 con 0x564a2a6488e0 2024-04-25T09:05:16.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2a495090 con 0x564a2a692c00 2024-04-25T09:05:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a2a41d160 con 0x564a2a6922e0 2024-04-25T09:05:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3375000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 0x564a2a648cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3375000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 0x564a2a648cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59922/0 (socket says 172.21.15.59:59922) 2024-04-25T09:05:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3375000640 1 -- 172.21.15.59:0/2654137439 learned_addr learned my addr 172.21.15.59:0/2654137439 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f336fe00640 1 --2- 172.21.15.59:0/2654137439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a6922e0 0x564a2a6926c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3367400640 1 --2- 172.21.15.59:0/2654137439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a692c00 0x564a2a6483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3375000640 1 -- 172.21.15.59:0/2654137439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a6922e0 msgr2=0x564a2a6926c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3375000640 1 --2- 172.21.15.59:0/2654137439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a6922e0 0x564a2a6926c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3375000640 1 -- 172.21.15.59:0/2654137439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a692c00 msgr2=0x564a2a6483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3375000640 1 --2- 172.21.15.59:0/2654137439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a692c00 0x564a2a6483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3375000640 1 -- 172.21.15.59:0/2654137439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a2a53ec20 con 0x564a2a6488e0 2024-04-25T09:05:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3375000640 1 --2- 172.21.15.59:0/2654137439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 0x564a2a648cc0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3368009fb0 tx=0x7f3368003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a7abd8dd6b80b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3364c00640 1 -- 172.21.15.59:0/2654137439 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368015420 con 0x564a2a6488e0 2024-04-25T09:05:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3364c00640 1 -- 172.21.15.59:0/2654137439 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336801a070 con 0x564a2a6488e0 2024-04-25T09:05:16.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f3364c00640 1 -- 172.21.15.59:0/2654137439 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680157c0 con 0x564a2a6488e0 2024-04-25T09:05:16.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 -- 172.21.15.59:0/2654137439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 msgr2=0x564a2a648cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 --2- 172.21.15.59:0/2654137439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 0x564a2a648cc0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f3368009fb0 tx=0x7f3368003e30 comp rx=0 tx=0).stop 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 -- 172.21.15.59:0/2654137439 shutdown_connections 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 --2- 172.21.15.59:0/2654137439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 0x564a2a648cc0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 --2- 172.21.15.59:0/2654137439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a692c00 0x564a2a6483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 --2- 172.21.15.59:0/2654137439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a6922e0 0x564a2a6926c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 -- 172.21.15.59:0/2654137439 >> 172.21.15.59:0/2654137439 conn(0x564a2a644890 msgr2=0x564a2a646c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 -- 172.21.15.59:0/2654137439 shutdown_connections 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 -- 172.21.15.59:0/2654137439 wait complete. 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.585+0000 7f337a4df000 1 -- start start 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 1 Processor -- start 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6488e0 0x564a2a699640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6922e0 0x564a2a699b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a692c00 0x564a2a680090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2a491130 con 0x564a2a6922e0 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2a459130 con 0x564a2a6488e0 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a2a553300 con 0x564a2a692c00 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 10 client.0 _ll_register_callbacks cb 0x564a2a633bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f3367400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6922e0 0x564a2a699b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f3367400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6922e0 0x564a2a699b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59930/0 (socket says 172.21.15.59:59930) 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f3367400640 1 -- 172.21.15.59:0/48759333 learned_addr learned my addr 172.21.15.59:0/48759333 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f3375000640 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a692c00 0x564a2a680090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f336fe00640 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6488e0 0x564a2a699640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f3367400640 1 -- 172.21.15.59:0/48759333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a692c00 msgr2=0x564a2a680090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f3367400640 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a692c00 0x564a2a680090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f3367400640 1 -- 172.21.15.59:0/48759333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6488e0 msgr2=0x564a2a699640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f3367400640 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6488e0 0x564a2a699640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f3367400640 1 -- 172.21.15.59:0/48759333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a2a472060 con 0x564a2a6922e0 2024-04-25T09:05:16.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f3367400640 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6922e0 0x564a2a699b80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f335801c9f0 tx=0x7f33580ab660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f48c291069a7d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f335d600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f335d600640 1 -- 172.21.15.59:0/48759333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580f6d80 con 0x564a2a6922e0 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f335d600640 1 -- 172.21.15.59:0/48759333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f33580f68f0 con 0x564a2a6922e0 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 1 -- 172.21.15.59:0/48759333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f336801a070 con 0x564a2a6922e0 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f335d600640 1 -- 172.21.15.59:0/48759333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33580f6af0 con 0x564a2a6922e0 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 10 client.6477 fetch_fsmap learned FSMap version 39 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 1 -- 172.21.15.59:0/48759333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x564a2a4367c0 con 0x564a2a6922e0 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f335d600640 1 -- 172.21.15.59:0/48759333 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336801a070 con 0x564a2a6922e0 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f335d600640 1 -- 172.21.15.59:0/48759333 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f33580b3070 con 0x564a2a6922e0 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 10 client.6477 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 10 client.6477 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 20 client.6477 populate_metadata read hostname 'smithi059' 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x564a2a680e30 0x564a2a681210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 4 client.6477 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f337a4df000 1 -- 172.21.15.59:0/48759333 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a2a430cd0 con 0x564a2a680e30 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f336fe00640 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x564a2a680e30 0x564a2a681210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f336fe00640 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x564a2a680e30 0x564a2a681210 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e14e579fb77fabd9 server_cookie=2bc381e9b2018c6 in_seq=0 out_seq=0 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.589+0000 7f335d600640 10 client.6477 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f335d600640 1 -- 172.21.15.59:0/48759333 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564a2a430cd0 con 0x564a2a680e30 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f335d600640 10 client.6477 handle_command_reply: tid=0 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f337a4df000 1 client.6477 shutdown 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f337a4df000 1 -- 172.21.15.59:0/48759333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6922e0 msgr2=0x564a2a699b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f337a4df000 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6922e0 0x564a2a699b80 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f335801c9f0 tx=0x7f33580ab660 comp rx=0 tx=0).stop 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f337a4df000 1 -- 172.21.15.59:0/48759333 shutdown_connections 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f337a4df000 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x564a2a680e30 0x564a2a681210 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f337a4df000 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a692c00 0x564a2a680090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f337a4df000 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6922e0 0x564a2a699b80 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f337a4df000 1 --2- 172.21.15.59:0/48759333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6488e0 0x564a2a699640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f335d600640 0 client.6477 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f337a4df000 1 -- 172.21.15.59:0/48759333 >> 172.21.15.59:0/48759333 conn(0x564a2a644890 msgr2=0x564a2a647510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f337a4df000 1 -- 172.21.15.59:0/48759333 shutdown_connections 2024-04-25T09:05:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f337a4df000 1 -- 172.21.15.59:0/48759333 wait complete. 2024-04-25T09:05:16.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.593+0000 7f337a4df000 20 client.6477 trim_cache size 0 max 16384 2024-04-25T09:05:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 Processor -- start 2024-04-25T09:05:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 -- start start 2024-04-25T09:05:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6488e0 0x564a2a6ee500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a6922e0 0x564a2a6eea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a692c00 0x564a2a6eef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3370202a00 con 0x564a2a692c00 2024-04-25T09:05:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337014cf00 con 0x564a2a6488e0 2024-04-25T09:05:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3370202400 con 0x564a2a6922e0 2024-04-25T09:05:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f3375000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a692c00 0x564a2a6eef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f3375000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a692c00 0x564a2a6eef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59934/0 (socket says 172.21.15.59:59934) 2024-04-25T09:05:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f3375000640 1 -- 172.21.15.59:0/3647738763 learned_addr learned my addr 172.21.15.59:0/3647738763 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f3375000640 1 -- 172.21.15.59:0/3647738763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a6922e0 msgr2=0x564a2a6eea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f3375000640 1 --2- 172.21.15.59:0/3647738763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a6922e0 0x564a2a6eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f336fe00640 1 --2- 172.21.15.59:0/3647738763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6488e0 0x564a2a6ee500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f3375000640 1 -- 172.21.15.59:0/3647738763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6488e0 msgr2=0x564a2a6ee500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f3375000640 1 --2- 172.21.15.59:0/3647738763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6488e0 0x564a2a6ee500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f3375000640 1 -- 172.21.15.59:0/3647738763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a2a450fc0 con 0x564a2a692c00 2024-04-25T09:05:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f336fe00640 1 --2- 172.21.15.59:0/3647738763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6488e0 0x564a2a6ee500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f3375000640 1 --2- 172.21.15.59:0/3647738763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a692c00 0x564a2a6eef80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3368016000 tx=0x7f336800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e95f9b1d6220d8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f335fe00640 1 -- 172.21.15.59:0/3647738763 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680156e0 con 0x564a2a692c00 2024-04-25T09:05:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f335fe00640 1 -- 172.21.15.59:0/3647738763 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3368024070 con 0x564a2a692c00 2024-04-25T09:05:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f335fe00640 1 -- 172.21.15.59:0/3647738763 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368015ac0 con 0x564a2a692c00 2024-04-25T09:05:16.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 -- 172.21.15.59:0/3647738763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a692c00 msgr2=0x564a2a6eef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 --2- 172.21.15.59:0/3647738763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a692c00 0x564a2a6eef80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3368016000 tx=0x7f336800e000 comp rx=0 tx=0).stop 2024-04-25T09:05:16.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 -- 172.21.15.59:0/3647738763 shutdown_connections 2024-04-25T09:05:16.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 --2- 172.21.15.59:0/3647738763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a692c00 0x564a2a6eef80 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 --2- 172.21.15.59:0/3647738763 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a6922e0 0x564a2a6eea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 --2- 172.21.15.59:0/3647738763 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6488e0 0x564a2a6ee500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.605+0000 7f337a4df000 1 -- 172.21.15.59:0/3647738763 >> 172.21.15.59:0/3647738763 conn(0x564a2a644890 msgr2=0x564a2a691290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 -- 172.21.15.59:0/3647738763 shutdown_connections 2024-04-25T09:05:16.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 -- 172.21.15.59:0/3647738763 wait complete. 2024-04-25T09:05:16.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 -- start start 2024-04-25T09:05:16.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 Processor -- start 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 0x564a2a6f2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6922e0 0x564a2a6f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a692c00 0x564a2a6969b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2a42fe70 con 0x564a2a6488e0 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a2a41da50 con 0x564a2a6922e0 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564a2a4943a0 con 0x564a2a692c00 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 10 client.0 _ll_register_callbacks cb 0x564a2a441240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f336fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 0x564a2a6f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f336fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 0x564a2a6f2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59942/0 (socket says 172.21.15.59:59942) 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f336fe00640 1 -- 172.21.15.59:0/2218588955 learned_addr learned my addr 172.21.15.59:0/2218588955 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:16.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f3367400640 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6922e0 0x564a2a6f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f3375000640 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a692c00 0x564a2a6969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f336fe00640 1 -- 172.21.15.59:0/2218588955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a692c00 msgr2=0x564a2a6969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f336fe00640 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a692c00 0x564a2a6969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f336fe00640 1 -- 172.21.15.59:0/2218588955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6922e0 msgr2=0x564a2a6f2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f336fe00640 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6922e0 0x564a2a6f2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f336fe00640 1 -- 172.21.15.59:0/2218588955 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a2a4ee9e0 con 0x564a2a6488e0 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f336fe00640 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 0x564a2a6f2930 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3360001aa0 tx=0x7f3360012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5c8d51bb15a2a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f335d600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f335d600640 1 -- 172.21.15.59:0/2218588955 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3360024890 con 0x564a2a6488e0 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f335d600640 1 -- 172.21.15.59:0/2218588955 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f3360024a30 con 0x564a2a6488e0 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 -- 172.21.15.59:0/2218588955 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3368024070 con 0x564a2a6488e0 2024-04-25T09:05:16.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f335d600640 1 -- 172.21.15.59:0/2218588955 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3360033050 con 0x564a2a6488e0 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 10 client.6483 fetch_fsmap learned FSMap version 39 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 -- 172.21.15.59:0/2218588955 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x564a2a434630 con 0x564a2a6488e0 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f335d600640 1 -- 172.21.15.59:0/2218588955 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3368024070 con 0x564a2a6488e0 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f335d600640 1 -- 172.21.15.59:0/2218588955 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3360036020 con 0x564a2a6488e0 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 10 client.6483 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 10 client.6483 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 20 client.6483 populate_metadata read hostname 'smithi059' 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x564a2a6f9790 0x564a2a6fbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 4 client.6483 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f337a4df000 1 -- 172.21.15.59:0/2218588955 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x564a2a4a25d0 con 0x564a2a6f9790 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.609+0000 7f3367400640 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x564a2a6f9790 0x564a2a6fbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3367400640 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x564a2a6f9790 0x564a2a6fbb80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35d4e7ae8219fe75 server_cookie=477a7d25d773ad41 in_seq=0 out_seq=0 2024-04-25T09:05:16.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f335d600640 10 client.6483 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f335d600640 1 -- 172.21.15.59:0/2218588955 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+141 (crc 0 0 0) 0x564a2a4a25d0 con 0x564a2a6f9790 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f335d600640 10 client.6483 handle_command_reply: tid=0 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f337a4df000 1 client.6483 shutdown 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f337a4df000 1 -- 172.21.15.59:0/2218588955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 msgr2=0x564a2a6f2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f337a4df000 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 0x564a2a6f2930 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f3360001aa0 tx=0x7f3360012000 comp rx=0 tx=0).stop 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f337a4df000 1 -- 172.21.15.59:0/2218588955 shutdown_connections 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f337a4df000 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x564a2a6f9790 0x564a2a6fbb80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f337a4df000 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564a2a692c00 0x564a2a6969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f337a4df000 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564a2a6922e0 0x564a2a6f2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f335d600640 0 client.6483 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f337a4df000 1 --2- 172.21.15.59:0/2218588955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564a2a6488e0 0x564a2a6f2930 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f337a4df000 1 -- 172.21.15.59:0/2218588955 >> 172.21.15.59:0/2218588955 conn(0x564a2a644890 msgr2=0x564a2a691b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f337a4df000 1 -- 172.21.15.59:0/2218588955 shutdown_connections 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f337a4df000 1 -- 172.21.15.59:0/2218588955 wait complete. 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f337a4df000 20 client.6483 trim_cache size 0 max 16384 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi059.stdout: "damage_type": "backtrace", 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4243754826, 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 1099511627777, 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/dir_test/file" 2024-04-25T09:05:16.610 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:05:16.611 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T09:05:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3377000640 1 -- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f334c066f60 msgr2=0x7f334c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3377000640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f334c066f60 0x7f334c069420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3370153af0 tx=0x7f3360007e90 comp rx=0 tx=0).stop 2024-04-25T09:05:16.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3377000640 1 -- 172.21.15.59:0/3236613604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33700d0150 msgr2=0x7f337014d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3377000640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33700d0150 0x7f337014d820 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f335801a0b0 tx=0x7f3358019220 comp rx=0 tx=0).stop 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3377000640 1 -- 172.21.15.59:0/3236613604 shutdown_connections 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3377000640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f334c066f60 0x7f334c069420 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3377000640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f337015dc00 0x7f33701570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3377000640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33700d0150 0x7f337014d820 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3377000640 1 --2- 172.21.15.59:0/3236613604 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33700c72a0 0x7f3370146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3377000640 1 -- 172.21.15.59:0/3236613604 >> 172.21.15.59:0/3236613604 conn(0x7f33700b2240 msgr2=0x7f33700c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3377000640 1 -- 172.21.15.59:0/3236613604 shutdown_connections 2024-04-25T09:05:16.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.613+0000 7f3377000640 1 -- 172.21.15.59:0/3236613604 wait complete. 2024-04-25T09:05:16.625 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:05:16.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f5494400640 1 Processor -- start 2024-04-25T09:05:16.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f5494400640 1 -- start start 2024-04-25T09:05:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f5494400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f548c161510 0x7f548c143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f5494400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c06d090 con 0x7f548c070fe0 2024-04-25T09:05:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f5494400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f548c071ad0 con 0x7f548c1435c0 2024-04-25T09:05:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f5494400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548c162390 con 0x7f548c161510 2024-04-25T09:05:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f5491a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f548c070fe0 0x7f548c0713c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58816/0 (socket says 172.21.15.59:58816) 2024-04-25T09:05:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f5491a00640 1 -- 172.21.15.59:0/189579165 learned_addr learned my addr 172.21.15.59:0/189579165 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:16.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f5491000640 1 --2- 172.21.15.59:0/189579165 >> v2:172.21.15.178:3300/0 conn(0x7f548c161510 0x7f548c143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f548be00640 1 -- 172.21.15.59:0/189579165 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619018166 0 0) 0x7f5480001120 con 0x7f548c070fe0 2024-04-25T09:05:16.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f548be00640 1 -- 172.21.15.59:0/189579165 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5474003530 con 0x7f548c070fe0 2024-04-25T09:05:16.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f5491000640 1 -- 172.21.15.59:0/189579165 >> v1:172.21.15.178:6789/0 conn(0x7f548c1435c0 legacy=0x7f548c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f5491000640 1 -- 172.21.15.59:0/189579165 >> v1:172.21.15.59:6789/0 conn(0x7f548c070fe0 legacy=0x7f548c0713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.773+0000 7f5491000640 1 -- 172.21.15.59:0/189579165 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c161af0 con 0x7f548c161510 2024-04-25T09:05:16.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.777+0000 7f5491000640 1 --2- 172.21.15.59:0/189579165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c161510 0x7f548c143080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f54780097c0 tx=0x7f547801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=158abc6ab8858fae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.777+0000 7f548be00640 1 -- 172.21.15.59:0/189579165 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54780a7070 con 0x7f548c161510 2024-04-25T09:05:16.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.777+0000 7f548be00640 1 -- 172.21.15.59:0/189579165 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54780b0070 con 0x7f548c161510 2024-04-25T09:05:16.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.777+0000 7f548be00640 1 -- 172.21.15.59:0/189579165 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54780ab890 con 0x7f548c161510 2024-04-25T09:05:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.777+0000 7f5494400640 1 -- 172.21.15.59:0/189579165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c161510 msgr2=0x7f548c143080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.777+0000 7f5494400640 1 --2- 172.21.15.59:0/189579165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c161510 0x7f548c143080 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f54780097c0 tx=0x7f547801c470 comp rx=0 tx=0).stop 2024-04-25T09:05:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.777+0000 7f5494400640 1 -- 172.21.15.59:0/189579165 shutdown_connections 2024-04-25T09:05:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.777+0000 7f5494400640 1 --2- 172.21.15.59:0/189579165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c161510 0x7f548c143080 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.777+0000 7f5494400640 1 -- 172.21.15.59:0/189579165 >> 172.21.15.59:0/189579165 conn(0x7f548c0b3390 msgr2=0x7f548c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.777+0000 7f5494400640 1 -- 172.21.15.59:0/189579165 shutdown_connections 2024-04-25T09:05:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.777+0000 7f5494400640 1 -- 172.21.15.59:0/189579165 wait complete. 2024-04-25T09:05:16.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5494400640 1 Processor -- start 2024-04-25T09:05:16.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5494400640 1 -- start start 2024-04-25T09:05:16.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5494400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c070fe0 0x7f548c153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5494400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f548c1435c0 0x7f548c0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5494400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548c161510 0x7f548c1573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5494400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c15ede0 con 0x7f548c1435c0 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5494400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548c15ec60 con 0x7f548c070fe0 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5494400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f548c0b0540 con 0x7f548c161510 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5491000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f548c1435c0 0x7f548c0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5491000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f548c1435c0 0x7f548c0b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59958/0 (socket says 172.21.15.59:59958) 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5491000640 1 -- 172.21.15.59:0/2638014406 learned_addr learned my addr 172.21.15.59:0/2638014406 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5491a00640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c070fe0 0x7f548c153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5492400640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548c161510 0x7f548c1573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5491000640 1 -- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548c161510 msgr2=0x7f548c1573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5491000640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548c161510 0x7f548c1573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5491000640 1 -- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c070fe0 msgr2=0x7f548c153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5491000640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c070fe0 0x7f548c153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5491000640 1 -- 172.21.15.59:0/2638014406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c154000 con 0x7f548c1435c0 2024-04-25T09:05:16.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5492400640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548c161510 0x7f548c1573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:16.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5491000640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f548c1435c0 0x7f548c0b08d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f54780ad040 tx=0x7f547801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5489600640 1 -- 172.21.15.59:0/2638014406 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54780bf610 con 0x7f548c1435c0 2024-04-25T09:05:16.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5489600640 1 -- 172.21.15.59:0/2638014406 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54780bf7d0 con 0x7f548c1435c0 2024-04-25T09:05:16.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5489600640 1 -- 172.21.15.59:0/2638014406 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54780bfbc0 con 0x7f548c1435c0 2024-04-25T09:05:16.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5494400640 1 -- 172.21.15.59:0/2638014406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c1545a0 con 0x7f548c1435c0 2024-04-25T09:05:16.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5494400640 1 -- 172.21.15.59:0/2638014406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548c13ddd0 con 0x7f548c1435c0 2024-04-25T09:05:16.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.781+0000 7f5494400640 1 -- 172.21.15.59:0/2638014406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548c0745d0 con 0x7f548c1435c0 2024-04-25T09:05:16.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.785+0000 7f5489600640 1 -- 172.21.15.59:0/2638014406 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f54780bd020 con 0x7f548c1435c0 2024-04-25T09:05:16.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.785+0000 7f5489600640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f546c066f60 0x7f546c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:16.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.785+0000 7f5489600640 1 -- 172.21.15.59:0/2638014406 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f547811f590 con 0x7f548c1435c0 2024-04-25T09:05:16.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.785+0000 7f5491a00640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f546c066f60 0x7f546c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:16.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.785+0000 7f5491a00640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f546c066f60 0x7f546c069420 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f54800012c0 tx=0x7f5480009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:16.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.789+0000 7f5489600640 1 -- 172.21.15.59:0/2638014406 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54780c6030 con 0x7f548c1435c0 2024-04-25T09:05:16.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 -- 172.21.15.59:0/2638014406 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f548c13dfa0 con 0x7f548c1435c0 2024-04-25T09:05:16.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5489600640 1 -- 172.21.15.59:0/2638014406 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f5478016090 con 0x7f548c1435c0 2024-04-25T09:05:16.982 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:16.982 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T09:05:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 -- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f546c066f60 msgr2=0x7f546c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f546c066f60 0x7f546c069420 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f54800012c0 tx=0x7f5480009040 comp rx=0 tx=0).stop 2024-04-25T09:05:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 -- 172.21.15.59:0/2638014406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f548c1435c0 msgr2=0x7f548c0b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f548c1435c0 0x7f548c0b08d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f54780ad040 tx=0x7f547801acb0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 -- 172.21.15.59:0/2638014406 shutdown_connections 2024-04-25T09:05:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f546c066f60 0x7f546c069420 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f548c161510 0x7f548c1573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f548c1435c0 0x7f548c0b08d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 --2- 172.21.15.59:0/2638014406 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f548c070fe0 0x7f548c153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 -- 172.21.15.59:0/2638014406 >> 172.21.15.59:0/2638014406 conn(0x7f548c0b3390 msgr2=0x7f548c0d0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 -- 172.21.15.59:0/2638014406 shutdown_connections 2024-04-25T09:05:16.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:16.989+0000 7f5494400640 1 -- 172.21.15.59:0/2638014406 wait complete. 2024-04-25T09:05:17.003 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:05:17.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:17.004 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-04-25T09:05:17.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c9a00640 1 Processor -- start 2024-04-25T09:05:17.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c9a00640 1 -- start start 2024-04-25T09:05:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c9a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f57c415e500 0x7f57c40af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c9a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57c40b2cb0 0x7f57c415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c9a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c406fdb0 con 0x7f57c40b2870 2024-04-25T09:05:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c9a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c415bc20 con 0x7f57c40b2cb0 2024-04-25T09:05:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c9a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c40cedf0 con 0x7f57c415e500 2024-04-25T09:05:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c9000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57c40b2cb0 0x7f57c415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c3400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f57c40b2870 0x7f57c415e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58830/0 (socket says 172.21.15.59:58830) 2024-04-25T09:05:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c3400640 1 -- 172.21.15.59:0/2707802680 learned_addr learned my addr 172.21.15.59:0/2707802680 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:17.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c3e00640 1 --2- 172.21.15.59:0/2707802680 >> v2:172.21.15.178:3300/0 conn(0x7f57c415e500 0x7f57c40af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c9000640 1 -- 172.21.15.59:0/2707802680 >> v2:172.21.15.178:3300/0 conn(0x7f57c415e500 msgr2=0x7f57c40af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c9000640 1 --2- 172.21.15.59:0/2707802680 >> v2:172.21.15.178:3300/0 conn(0x7f57c415e500 0x7f57c40af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c9000640 1 -- 172.21.15.59:0/2707802680 >> v1:172.21.15.59:6789/0 conn(0x7f57c40b2870 legacy=0x7f57c415e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.157+0000 7f57c9000640 1 -- 172.21.15.59:0/2707802680 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4070020 con 0x7f57c40b2cb0 2024-04-25T09:05:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c9000640 1 --2- 172.21.15.59:0/2707802680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c40b2cb0 0x7f57c415b6e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f57c40d1570 tx=0x7f57bc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6203815022a587 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c2a00640 1 -- 172.21.15.59:0/2707802680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0b2070 con 0x7f57c40b2cb0 2024-04-25T09:05:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c2a00640 1 -- 172.21.15.59:0/2707802680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc0a5900 con 0x7f57c40b2cb0 2024-04-25T09:05:17.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c2a00640 1 -- 172.21.15.59:0/2707802680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0a5cd0 con 0x7f57c40b2cb0 2024-04-25T09:05:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c9a00640 1 -- 172.21.15.59:0/2707802680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c40b2cb0 msgr2=0x7f57c415b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c9a00640 1 --2- 172.21.15.59:0/2707802680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c40b2cb0 0x7f57c415b6e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f57c40d1570 tx=0x7f57bc01c930 comp rx=0 tx=0).stop 2024-04-25T09:05:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c9a00640 1 -- 172.21.15.59:0/2707802680 shutdown_connections 2024-04-25T09:05:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c9a00640 1 --2- 172.21.15.59:0/2707802680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c40b2cb0 0x7f57c415b6e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c9a00640 1 --2- 172.21.15.59:0/2707802680 >> v2:172.21.15.178:3300/0 conn(0x7f57c415e500 0x7f57c40af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c9a00640 1 -- 172.21.15.59:0/2707802680 >> 172.21.15.59:0/2707802680 conn(0x7f57c4099a60 msgr2=0x7f57c40b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c9a00640 1 -- 172.21.15.59:0/2707802680 shutdown_connections 2024-04-25T09:05:17.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c9a00640 1 -- 172.21.15.59:0/2707802680 wait complete. 2024-04-25T09:05:17.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c9a00640 1 Processor -- start 2024-04-25T09:05:17.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.161+0000 7f57c9a00640 1 -- start start 2024-04-25T09:05:17.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c40b2870 0x7f57c414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c40b2cb0 0x7f57c40aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c415e500 0x7f57c40cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c41675e0 con 0x7f57c415e500 2024-04-25T09:05:17.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c4167760 con 0x7f57c40b2870 2024-04-25T09:05:17.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c41678e0 con 0x7f57c40b2cb0 2024-04-25T09:05:17.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c415e500 0x7f57c40cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c415e500 0x7f57c40cbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59966/0 (socket says 172.21.15.59:59966) 2024-04-25T09:05:17.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9000640 1 -- 172.21.15.59:0/895783892 learned_addr learned my addr 172.21.15.59:0/895783892 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:17.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c3e00640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c40b2870 0x7f57c414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c3400640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c40b2cb0 0x7f57c40aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9000640 1 -- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c40b2cb0 msgr2=0x7f57c40aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9000640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c40b2cb0 0x7f57c40aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9000640 1 -- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c40b2870 msgr2=0x7f57c414c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9000640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c40b2870 0x7f57c414c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9000640 1 -- 172.21.15.59:0/895783892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c414ce20 con 0x7f57c415e500 2024-04-25T09:05:17.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9000640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c415e500 0x7f57c40cbe10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f57bc019540 tx=0x7f57bc0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57bbe00640 1 -- 172.21.15.59:0/895783892 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0b2050 con 0x7f57c415e500 2024-04-25T09:05:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57bbe00640 1 -- 172.21.15.59:0/895783892 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc0be070 con 0x7f57c415e500 2024-04-25T09:05:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57bbe00640 1 -- 172.21.15.59:0/895783892 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0ada90 con 0x7f57c415e500 2024-04-25T09:05:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9a00640 1 -- 172.21.15.59:0/895783892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c40b3090 con 0x7f57c415e500 2024-04-25T09:05:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.165+0000 7f57c9a00640 1 -- 172.21.15.59:0/895783892 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c40b3650 con 0x7f57c415e500 2024-04-25T09:05:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57bbe00640 1 -- 172.21.15.59:0/895783892 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f57bc0adc30 con 0x7f57c415e500 2024-04-25T09:05:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57bbe00640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f57a4066f60 0x7f57a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57bbe00640 1 -- 172.21.15.59:0/895783892 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f57bc1202e0 con 0x7f57c415e500 2024-04-25T09:05:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c3e00640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f57a4066f60 0x7f57a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57ce500000 1 Processor -- start 2024-04-25T09:05:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57ce500000 1 -- start start 2024-04-25T09:05:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c3e00640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f57a4066f60 0x7f57a4069420 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f57b40079c0 tx=0x7f57b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57ce500000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0de520 0x55cb2c0de900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57ce500000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c0dee40 0x55cb2c095430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57ce500000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 0x55cb2c095d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57ce500000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2bee2d00 con 0x55cb2c095970 2024-04-25T09:05:17.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57ce500000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2be6adf0 con 0x55cb2c0de520 2024-04-25T09:05:17.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57ce500000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb2bededa0 con 0x55cb2c0dee40 2024-04-25T09:05:17.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 0x55cb2c095d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 0x55cb2c095d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59968/0 (socket says 172.21.15.59:59968) 2024-04-25T09:05:17.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c9000640 1 -- 172.21.15.59:0/3734046024 learned_addr learned my addr 172.21.15.59:0/3734046024 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c3e00640 1 --2- 172.21.15.59:0/3734046024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0de520 0x55cb2c0de900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c3400640 1 --2- 172.21.15.59:0/3734046024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c0dee40 0x55cb2c095430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c9000640 1 -- 172.21.15.59:0/3734046024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c0dee40 msgr2=0x55cb2c095430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c9000640 1 --2- 172.21.15.59:0/3734046024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c0dee40 0x55cb2c095430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c9000640 1 -- 172.21.15.59:0/3734046024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0de520 msgr2=0x55cb2c0de900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c9000640 1 --2- 172.21.15.59:0/3734046024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0de520 0x55cb2c0de900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c9000640 1 -- 172.21.15.59:0/3734046024 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb2be9d580 con 0x55cb2c095970 2024-04-25T09:05:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.169+0000 7f57c3e00640 1 --2- 172.21.15.59:0/3734046024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0de520 0x55cb2c0de900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c9000640 1 --2- 172.21.15.59:0/3734046024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 0x55cb2c095d50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f57bc01cea0 tx=0x7f57bc0f0a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e843b3cb48969a0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57b8c00640 1 -- 172.21.15.59:0/3734046024 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc1200b0 con 0x55cb2c095970 2024-04-25T09:05:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57b8c00640 1 -- 172.21.15.59:0/3734046024 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc0b3040 con 0x55cb2c095970 2024-04-25T09:05:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57b8c00640 1 -- 172.21.15.59:0/3734046024 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc0f9060 con 0x55cb2c095970 2024-04-25T09:05:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 -- 172.21.15.59:0/3734046024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 msgr2=0x55cb2c095d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 --2- 172.21.15.59:0/3734046024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 0x55cb2c095d50 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f57bc01cea0 tx=0x7f57bc0f0a00 comp rx=0 tx=0).stop 2024-04-25T09:05:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 -- 172.21.15.59:0/3734046024 shutdown_connections 2024-04-25T09:05:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 --2- 172.21.15.59:0/3734046024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 0x55cb2c095d50 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 --2- 172.21.15.59:0/3734046024 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c0dee40 0x55cb2c095430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 --2- 172.21.15.59:0/3734046024 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0de520 0x55cb2c0de900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 -- 172.21.15.59:0/3734046024 >> 172.21.15.59:0/3734046024 conn(0x55cb2bf7cc10 msgr2=0x55cb2c093d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 -- 172.21.15.59:0/3734046024 shutdown_connections 2024-04-25T09:05:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 -- 172.21.15.59:0/3734046024 wait complete. 2024-04-25T09:05:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 -- start start 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 Processor -- start 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c095970 0x55cb2c099e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 0x55cb2c09a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0dee40 0x55cb2c09a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2be7b6d0 con 0x55cb2c0de520 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2be9d950 con 0x55cb2c0dee40 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb2bee2010 con 0x55cb2c095970 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ce500000 10 client.0 _ll_register_callbacks cb 0x55cb2c081030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 0x55cb2c09a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 0x55cb2c09a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59970/0 (socket says 172.21.15.59:59970) 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c3400640 1 -- 172.21.15.59:0/2170590997 learned_addr learned my addr 172.21.15.59:0/2170590997 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c9000640 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0dee40 0x55cb2c09a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c3e00640 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c095970 0x55cb2c099e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c3400640 1 -- 172.21.15.59:0/2170590997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c095970 msgr2=0x55cb2c099e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c3400640 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c095970 0x55cb2c099e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c3400640 1 -- 172.21.15.59:0/2170590997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0dee40 msgr2=0x55cb2c09a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c3400640 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0dee40 0x55cb2c09a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c3400640 1 -- 172.21.15.59:0/2170590997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb2be7fd40 con 0x55cb2c0de520 2024-04-25T09:05:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c3e00640 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c095970 0x55cb2c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57c3400640 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 0x55cb2c09a3b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f57b0007780 tx=0x7f57b0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7bed8ecc62fcbc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.173+0000 7f57ad600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:05:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ad600640 1 -- 172.21.15.59:0/2170590997 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b00145b0 con 0x55cb2c0de520 2024-04-25T09:05:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ad600640 1 -- 172.21.15.59:0/2170590997 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f57b000c980 con 0x55cb2c0de520 2024-04-25T09:05:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 -- 172.21.15.59:0/2170590997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f57bc0b3040 con 0x55cb2c0de520 2024-04-25T09:05:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ad600640 1 -- 172.21.15.59:0/2170590997 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57b000cbc0 con 0x55cb2c0de520 2024-04-25T09:05:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 10 client.6504 fetch_fsmap learned FSMap version 39 2024-04-25T09:05:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 -- 172.21.15.59:0/2170590997 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55cb2beddcf0 con 0x55cb2c0de520 2024-04-25T09:05:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ad600640 1 -- 172.21.15.59:0/2170590997 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc0b3040 con 0x55cb2c0de520 2024-04-25T09:05:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ad600640 1 -- 172.21.15.59:0/2170590997 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f57b0014750 con 0x55cb2c0de520 2024-04-25T09:05:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 10 client.6504 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:05:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 10 client.6504 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:05:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 20 client.6504 populate_metadata read hostname 'smithi059' 2024-04-25T09:05:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55cb2c09b300 0x55cb2c0ef8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 4 client.6504 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 -- 172.21.15.59:0/2170590997 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb2be7e9d0 con 0x55cb2c09b300 2024-04-25T09:05:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57c3e00640 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55cb2c09b300 0x55cb2c0ef8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ad600640 10 client.6504 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:17.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57c3e00640 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55cb2c09b300 0x55cb2c0ef8b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaa2d73ba7396c83 server_cookie=e0298ff710b2ba78 in_seq=0 out_seq=0 2024-04-25T09:05:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ad600640 1 -- 172.21.15.59:0/2170590997 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cb2be7e9d0 con 0x55cb2c09b300 2024-04-25T09:05:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ad600640 10 client.6504 handle_command_reply: tid=0 2024-04-25T09:05:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 client.6504 shutdown 2024-04-25T09:05:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 -- 172.21.15.59:0/2170590997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 msgr2=0x55cb2c09a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 0x55cb2c09a3b0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f57b0007780 tx=0x7f57b0001640 comp rx=0 tx=0).stop 2024-04-25T09:05:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 -- 172.21.15.59:0/2170590997 shutdown_connections 2024-04-25T09:05:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55cb2c09b300 0x55cb2c0ef8b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0dee40 0x55cb2c09a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 0x55cb2c09a3b0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 --2- 172.21.15.59:0/2170590997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c095970 0x55cb2c099e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ad600640 0 client.6504 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 -- 172.21.15.59:0/2170590997 >> 172.21.15.59:0/2170590997 conn(0x55cb2bf7cc10 msgr2=0x55cb2c094420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 -- 172.21.15.59:0/2170590997 shutdown_connections 2024-04-25T09:05:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 1 -- 172.21.15.59:0/2170590997 wait complete. 2024-04-25T09:05:17.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.177+0000 7f57ce500000 20 client.6504 trim_cache size 0 max 16384 2024-04-25T09:05:17.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57ce500000 1 Processor -- start 2024-04-25T09:05:17.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57ce500000 1 -- start start 2024-04-25T09:05:17.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57ce500000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 0x55cb2c0f1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57ce500000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0de520 0x55cb2c0f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57ce500000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c0dee40 0x55cb2c0ee8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57ce500000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c4203520 con 0x55cb2c095970 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57ce500000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c42026b0 con 0x55cb2c0de520 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57ce500000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c414e4c0 con 0x55cb2c0dee40 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57c3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 0x55cb2c0f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57c3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 0x55cb2c0f1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59982/0 (socket says 172.21.15.59:59982) 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57c3e00640 1 -- 172.21.15.59:0/582719606 learned_addr learned my addr 172.21.15.59:0/582719606 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57c3400640 1 --2- 172.21.15.59:0/582719606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0de520 0x55cb2c0f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57c9000640 1 --2- 172.21.15.59:0/582719606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c0dee40 0x55cb2c0ee8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57c3e00640 1 -- 172.21.15.59:0/582719606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c0dee40 msgr2=0x55cb2c0ee8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57c3e00640 1 --2- 172.21.15.59:0/582719606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c0dee40 0x55cb2c0ee8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57c3e00640 1 -- 172.21.15.59:0/582719606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0de520 msgr2=0x55cb2c0f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57c3e00640 1 --2- 172.21.15.59:0/582719606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0de520 0x55cb2c0f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57c3e00640 1 -- 172.21.15.59:0/582719606 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb2c0dec70 con 0x55cb2c095970 2024-04-25T09:05:17.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.193+0000 7f57c3e00640 1 --2- 172.21.15.59:0/582719606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 0x55cb2c0f1820 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x55cb2be676b0 tx=0x7f57b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156bb48bce862c18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57afe00640 1 -- 172.21.15.59:0/582719606 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b401c040 con 0x55cb2c095970 2024-04-25T09:05:17.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57afe00640 1 -- 172.21.15.59:0/582719606 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b402f070 con 0x55cb2c095970 2024-04-25T09:05:17.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57afe00640 1 -- 172.21.15.59:0/582719606 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b4024440 con 0x55cb2c095970 2024-04-25T09:05:17.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 -- 172.21.15.59:0/582719606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 msgr2=0x55cb2c0f1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 --2- 172.21.15.59:0/582719606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 0x55cb2c0f1820 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x55cb2be676b0 tx=0x7f57b4016000 comp rx=0 tx=0).stop 2024-04-25T09:05:17.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 -- 172.21.15.59:0/582719606 shutdown_connections 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 --2- 172.21.15.59:0/582719606 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c0dee40 0x55cb2c0ee8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 --2- 172.21.15.59:0/582719606 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0de520 0x55cb2c0f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 --2- 172.21.15.59:0/582719606 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c095970 0x55cb2c0f1820 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 -- 172.21.15.59:0/582719606 >> 172.21.15.59:0/582719606 conn(0x55cb2bf7cc10 msgr2=0x55cb2c0db3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 -- 172.21.15.59:0/582719606 shutdown_connections 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 -- 172.21.15.59:0/582719606 wait complete. 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 -- start start 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 Processor -- start 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c095970 0x55cb2c13b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 0x55cb2c13ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0dee40 0x55cb2c13bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c414eac0 con 0x55cb2c0de520 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2be6b7e0 con 0x55cb2c0dee40 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb2bee2010 con 0x55cb2c095970 2024-04-25T09:05:17.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 10 client.0 _ll_register_callbacks cb 0x7f57bc009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57c3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 0x55cb2c13ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57c3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 0x55cb2c13ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:59998/0 (socket says 172.21.15.59:59998) 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57c3400640 1 -- 172.21.15.59:0/182406393 learned_addr learned my addr 172.21.15.59:0/182406393 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57c3e00640 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c095970 0x55cb2c13b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57c9000640 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0dee40 0x55cb2c13bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57c3400640 1 -- 172.21.15.59:0/182406393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c095970 msgr2=0x55cb2c13b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57c3400640 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c095970 0x55cb2c13b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57c3400640 1 -- 172.21.15.59:0/182406393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0dee40 msgr2=0x55cb2c13bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57c3400640 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0dee40 0x55cb2c13bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57c3400640 1 -- 172.21.15.59:0/182406393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb2bf65d30 con 0x55cb2c0de520 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57c3400640 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 0x55cb2c13ba40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f57b0007d00 tx=0x7f57b0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3c60248aa6b7e3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ad600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ad600640 1 -- 172.21.15.59:0/182406393 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b002e020 con 0x55cb2c0de520 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ad600640 1 -- 172.21.15.59:0/182406393 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f57b00147b0 con 0x55cb2c0de520 2024-04-25T09:05:17.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.197+0000 7f57ce500000 1 -- 172.21.15.59:0/182406393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f57b402f070 con 0x55cb2c0de520 2024-04-25T09:05:17.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ad600640 1 -- 172.21.15.59:0/182406393 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57b0038050 con 0x55cb2c0de520 2024-04-25T09:05:17.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 10 client.6510 fetch_fsmap learned FSMap version 39 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 -- 172.21.15.59:0/182406393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x55cb2beaf5a0 con 0x55cb2c0de520 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ad600640 1 -- 172.21.15.59:0/182406393 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b402f070 con 0x55cb2c0de520 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ad600640 1 -- 172.21.15.59:0/182406393 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f57b003b020 con 0x55cb2c0de520 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 10 client.6510 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 10 client.6510 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 20 client.6510 populate_metadata read hostname 'smithi059' 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55cb2c13c4c0 0x55cb2c13c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 4 client.6510 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 -- 172.21.15.59:0/182406393 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) v1 -- 0x55cb2bebf610 con 0x55cb2c13c4c0 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c3e00640 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55cb2c13c4c0 0x55cb2c13c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c3e00640 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55cb2c13c4c0 0x55cb2c13c8d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11e067eb800be090 server_cookie=a3ca437b590227c0 in_seq=0 out_seq=0 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ad600640 10 client.6510 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ad600640 1 -- 172.21.15.59:0/182406393 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55cb2bebf610 con 0x55cb2c13c4c0 2024-04-25T09:05:17.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ad600640 10 client.6510 handle_command_reply: tid=0 2024-04-25T09:05:17.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 client.6510 shutdown 2024-04-25T09:05:17.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 -- 172.21.15.59:0/182406393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 msgr2=0x55cb2c13ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 0x55cb2c13ba40 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f57b0007d00 tx=0x7f57b0000ee0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 -- 172.21.15.59:0/182406393 shutdown_connections 2024-04-25T09:05:17.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55cb2c13c4c0 0x55cb2c13c8d0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cb2c0dee40 0x55cb2c13bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cb2c0de520 0x55cb2c13ba40 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 --2- 172.21.15.59:0/182406393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cb2c095970 0x55cb2c13b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 -- 172.21.15.59:0/182406393 >> 172.21.15.59:0/182406393 conn(0x55cb2bf7cc10 msgr2=0x55cb2c0dbac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ad600640 0 client.6510 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:17.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 -- 172.21.15.59:0/182406393 shutdown_connections 2024-04-25T09:05:17.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 1 -- 172.21.15.59:0/182406393 wait complete. 2024-04-25T09:05:17.198 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f74af600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6375=0-4194304@1} caps={6375=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6375 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55b6de0f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:05:17.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57ce500000 20 client.6510 trim_cache size 0 max 16384 2024-04-25T09:05:17.198 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:05:17.198 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-04-25T09:05:17.198 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "b50f7926-89ad-4b91-953b-e2f462b1fe94", 2024-04-25T09:05:17.199 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-04-25T09:05:17.199 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:05:17.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c9a00640 1 -- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f57a4066f60 msgr2=0x7f57a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c9a00640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f57a4066f60 0x7f57a4069420 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f57b40079c0 tx=0x7f57b4008040 comp rx=0 tx=0).stop 2024-04-25T09:05:17.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c9a00640 1 -- 172.21.15.59:0/895783892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c415e500 msgr2=0x7f57c40cbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c9a00640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c415e500 0x7f57c40cbe10 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f57bc019540 tx=0x7f57bc0196d0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c9a00640 1 -- 172.21.15.59:0/895783892 shutdown_connections 2024-04-25T09:05:17.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c9a00640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f57a4066f60 0x7f57a4069420 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c9a00640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c415e500 0x7f57c40cbe10 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c9a00640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f57c40b2cb0 0x7f57c40aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c9a00640 1 --2- 172.21.15.59:0/895783892 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f57c40b2870 0x7f57c414c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c9a00640 1 -- 172.21.15.59:0/895783892 >> 172.21.15.59:0/895783892 conn(0x7f57c4099a60 msgr2=0x7f57c40b0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c9a00640 1 -- 172.21.15.59:0/895783892 shutdown_connections 2024-04-25T09:05:17.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.201+0000 7f57c9a00640 1 -- 172.21.15.59:0/895783892 wait complete. 2024-04-25T09:05:17.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:17.214 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T09:05:17.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f502a400640 1 Processor -- start 2024-04-25T09:05:17.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f502a400640 1 -- start start 2024-04-25T09:05:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f502a400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240d0c00 0x7f50240af870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f502a400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f50240b5f20 0x7f5024143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f502a400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50240aeb10 con 0x7f50240b5b40 2024-04-25T09:05:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f502a400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50240d1130 con 0x7f50240b5f20 2024-04-25T09:05:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f502a400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50240aedb0 con 0x7f50240d0c00 2024-04-25T09:05:17.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5029000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f50240b5b40 0x7f502415fc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58842/0 (socket says 172.21.15.59:58842) 2024-04-25T09:05:17.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5029000640 1 -- 172.21.15.59:0/1122265623 learned_addr learned my addr 172.21.15.59:0/1122265623 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023e00640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240d0c00 0x7f50240af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5029a00640 1 --2- 172.21.15.59:0/1122265623 >> v2:172.21.15.178:3300/0 conn(0x7f50240b5f20 0x7f5024143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718916886 0 0) 0x7f50240aeb10 con 0x7f50240b5b40 2024-04-25T09:05:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f500c003530 con 0x7f50240b5b40 2024-04-25T09:05:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4096739843 0 0) 0x7f500c003530 con 0x7f50240b5b40 2024-04-25T09:05:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240d0c00 msgr2=0x7f50240af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240d0c00 0x7f50240af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 >> v2:172.21.15.178:3300/0 conn(0x7f50240b5f20 msgr2=0x7f5024143dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 --2- 172.21.15.59:0/1122265623 >> v2:172.21.15.178:3300/0 conn(0x7f50240b5f20 0x7f5024143dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240af090 con 0x7f50240b5b40 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f5018001680 con 0x7f50240b5b40 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 >> v1:172.21.15.59:6789/0 conn(0x7f50240b5b40 legacy=0x7f502415fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500c0039c0 0x7f500c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240d0c00 0x7f500c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500c004d50 0x7f500c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240d1130 con 0x7f500c0039c0 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240aedb0 con 0x7f500c004d50 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500c00b9d0 con 0x7f50240d0c00 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5029000640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500c0039c0 0x7f500c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5023e00640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240d0c00 0x7f500c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5029a00640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500c004d50 0x7f500c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5029000640 1 -- 172.21.15.59:0/1122265623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240d0c00 msgr2=0x7f500c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5029000640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240d0c00 0x7f500c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5029000640 1 -- 172.21.15.59:0/1122265623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500c004d50 msgr2=0x7f500c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5029000640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500c004d50 0x7f500c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5029000640 1 -- 172.21.15.59:0/1122265623 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500c003530 con 0x7f500c0039c0 2024-04-25T09:05:17.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.369+0000 7f5029a00640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500c004d50 0x7f500c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:17.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.373+0000 7f5029000640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500c0039c0 0x7f500c003de0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f501800c270 tx=0x7f501801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b792a1cf1956e67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.373+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018007d40 con 0x7f500c0039c0 2024-04-25T09:05:17.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.373+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180a9020 con 0x7f500c0039c0 2024-04-25T09:05:17.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.373+0000 7f5023400640 1 -- 172.21.15.59:0/1122265623 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5018005ae0 con 0x7f500c0039c0 2024-04-25T09:05:17.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.373+0000 7f502a400640 1 -- 172.21.15.59:0/1122265623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500c0039c0 msgr2=0x7f500c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.373+0000 7f502a400640 1 --2- 172.21.15.59:0/1122265623 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500c0039c0 0x7f500c003de0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f501800c270 tx=0x7f501801cca0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.373+0000 7f5029a00640 1 -- 172.21.15.59:0/1122265623 reap_dead start 2024-04-25T09:05:17.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.373+0000 7f502a400640 1 -- 172.21.15.59:0/1122265623 shutdown_connections 2024-04-25T09:05:17.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.373+0000 7f502a400640 1 -- 172.21.15.59:0/1122265623 >> 172.21.15.59:0/1122265623 conn(0x7f50240726e0 msgr2=0x7f5024099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.373+0000 7f502a400640 1 -- 172.21.15.59:0/1122265623 shutdown_connections 2024-04-25T09:05:17.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.373+0000 7f502a400640 1 -- 172.21.15.59:0/1122265623 wait complete. 2024-04-25T09:05:17.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f502a400640 1 Processor -- start 2024-04-25T09:05:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f502a400640 1 -- start start 2024-04-25T09:05:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f502a400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500c0039c0 0x7f502415e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f502a400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240b05d0 0x7f50240b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f502a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50240b0f70 0x7f502415cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f502a400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240b3bd0 con 0x7f50240b0f70 2024-04-25T09:05:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f502a400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50240afe90 con 0x7f500c0039c0 2024-04-25T09:05:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f502a400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50240b3d50 con 0x7f50240b05d0 2024-04-25T09:05:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5029a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50240b0f70 0x7f502415cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5029000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500c0039c0 0x7f502415e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5029a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50240b0f70 0x7f502415cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60018/0 (socket says 172.21.15.59:60018) 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5029a00640 1 -- 172.21.15.59:0/2456966216 learned_addr learned my addr 172.21.15.59:0/2456966216 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5023e00640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240b05d0 0x7f50240b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5029a00640 1 -- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240b05d0 msgr2=0x7f50240b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5029a00640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240b05d0 0x7f50240b0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5029a00640 1 -- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500c0039c0 msgr2=0x7f502415e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5029a00640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500c0039c0 0x7f502415e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5029a00640 1 -- 172.21.15.59:0/2456966216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240b13f0 con 0x7f50240b0f70 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5029a00640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50240b0f70 0x7f502415cba0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f50240ad7f0 tx=0x7f501c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5020c00640 1 -- 172.21.15.59:0/2456966216 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c007ea0 con 0x7f50240b0f70 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5020c00640 1 -- 172.21.15.59:0/2456966216 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c010d20 con 0x7f50240b0f70 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f5020c00640 1 -- 172.21.15.59:0/2456966216 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c003be0 con 0x7f50240b0f70 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f502a400640 1 -- 172.21.15.59:0/2456966216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502415b300 con 0x7f50240b0f70 2024-04-25T09:05:17.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.377+0000 7f502a400640 1 -- 172.21.15.59:0/2456966216 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5024141eb0 con 0x7f50240b0f70 2024-04-25T09:05:17.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f5020c00640 1 -- 172.21.15.59:0/2456966216 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f501c01e030 con 0x7f50240b0f70 2024-04-25T09:05:17.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f5020c00640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5004066f90 0x7f5004069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f5020c00640 1 -- 172.21.15.59:0/2456966216 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f501c0857f0 con 0x7f50240b0f70 2024-04-25T09:05:17.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f5029000640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5004066f90 0x7f5004069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f502ef57000 1 Processor -- start 2024-04-25T09:05:17.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f502ef57000 1 -- start start 2024-04-25T09:05:17.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f5029000640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5004066f90 0x7f5004069450 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f50180aa000 tx=0x7f50240ad820 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f502ef57000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da253db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f502ef57000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da209b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f502ef57000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da20a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f502ef57000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584da056ff0 con 0x5584da2542f0 2024-04-25T09:05:17.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f502ef57000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584d9fdf150 con 0x5584da2539d0 2024-04-25T09:05:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.381+0000 7f502ef57000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5584da053090 con 0x5584da20a0a0 2024-04-25T09:05:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5023e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da209b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5023e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da209b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60026/0 (socket says 172.21.15.59:60026) 2024-04-25T09:05:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5023e00640 1 -- 172.21.15.59:0/451751971 learned_addr learned my addr 172.21.15.59:0/451751971 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5029000640 1 --2- 172.21.15.59:0/451751971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da253db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5029a00640 1 --2- 172.21.15.59:0/451751971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da20a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5023e00640 1 -- 172.21.15.59:0/451751971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 msgr2=0x5584da20a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5023e00640 1 --2- 172.21.15.59:0/451751971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da20a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5023e00640 1 -- 172.21.15.59:0/451751971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 msgr2=0x5584da253db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5023e00640 1 --2- 172.21.15.59:0/451751971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da253db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5023e00640 1 -- 172.21.15.59:0/451751971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584da1ed0d0 con 0x5584da2542f0 2024-04-25T09:05:17.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5023e00640 1 --2- 172.21.15.59:0/451751971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da209b60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5010009cb0 tx=0x7f5010014780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11c8a7fcd235275 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5015600640 1 -- 172.21.15.59:0/451751971 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010022070 con 0x5584da2542f0 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5015600640 1 -- 172.21.15.59:0/451751971 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501001d440 con 0x5584da2542f0 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5015600640 1 -- 172.21.15.59:0/451751971 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501001d7f0 con 0x5584da2542f0 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 -- 172.21.15.59:0/451751971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 msgr2=0x5584da209b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 --2- 172.21.15.59:0/451751971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da209b60 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5010009cb0 tx=0x7f5010014780 comp rx=0 tx=0).stop 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 -- 172.21.15.59:0/451751971 shutdown_connections 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 --2- 172.21.15.59:0/451751971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da20a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 --2- 172.21.15.59:0/451751971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da209b60 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 --2- 172.21.15.59:0/451751971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da253db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 -- 172.21.15.59:0/451751971 >> 172.21.15.59:0/451751971 conn(0x5584da206020 msgr2=0x5584da208440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 -- 172.21.15.59:0/451751971 shutdown_connections 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 -- 172.21.15.59:0/451751971 wait complete. 2024-04-25T09:05:17.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 -- start start 2024-04-25T09:05:17.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 Processor -- start 2024-04-25T09:05:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da2387f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da238d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da239270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584da01b250 con 0x5584da2542f0 2024-04-25T09:05:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584da011690 con 0x5584da2539d0 2024-04-25T09:05:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5584d9fdfa40 con 0x5584da20a0a0 2024-04-25T09:05:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f502ef57000 10 client.0 _ll_register_callbacks cb 0x5584da1f4e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5029a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da239270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5029a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da239270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60028/0 (socket says 172.21.15.59:60028) 2024-04-25T09:05:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.385+0000 7f5029a00640 1 -- 172.21.15.59:0/3912005890 learned_addr learned my addr 172.21.15.59:0/3912005890 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:17.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f5029a00640 1 -- 172.21.15.59:0/3912005890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 msgr2=0x5584da2387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f5029a00640 1 --2- 172.21.15.59:0/3912005890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da2387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f5029a00640 1 -- 172.21.15.59:0/3912005890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 msgr2=0x5584da238d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f5029a00640 1 --2- 172.21.15.59:0/3912005890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da238d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f5029a00640 1 -- 172.21.15.59:0/3912005890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584da1041c0 con 0x5584da2542f0 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f5029a00640 1 --2- 172.21.15.59:0/3912005890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da239270 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f501c05e0d0 tx=0x7f501c056730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364786354a5ae6f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f500a000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f500a000640 1 -- 172.21.15.59:0/3912005890 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c05c2c0 con 0x5584da2542f0 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f500a000640 1 -- 172.21.15.59:0/3912005890 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f501c07ed20 con 0x5584da2542f0 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 -- 172.21.15.59:0/3912005890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f501001d440 con 0x5584da2542f0 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f500a000640 1 -- 172.21.15.59:0/3912005890 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f501c056150 con 0x5584da2542f0 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 10 client.6522 fetch_fsmap learned FSMap version 39 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 -- 172.21.15.59:0/3912005890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x5584da100170 con 0x5584da2542f0 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f500a000640 1 -- 172.21.15.59:0/3912005890 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501001d440 con 0x5584da2542f0 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f500a000640 1 -- 172.21.15.59:0/3912005890 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f501c05e170 con 0x5584da2542f0 2024-04-25T09:05:17.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 10 client.6522 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 10 client.6522 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 20 client.6522 populate_metadata read hostname 'smithi059' 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 --2- 172.21.15.59:0/3912005890 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5584da263c80 0x5584da266070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 4 client.6522 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 -- 172.21.15.59:0/3912005890 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584d9ff2c60 con 0x5584da263c80 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f5029000640 1 --2- 172.21.15.59:0/3912005890 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5584da263c80 0x5584da266070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f5029000640 1 --2- 172.21.15.59:0/3912005890 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5584da263c80 0x5584da266070 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51566b03bbbf5530 server_cookie=818821951a8b447b in_seq=0 out_seq=0 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f500a000640 10 client.6522 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f500a000640 1 -- 172.21.15.59:0/3912005890 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5584d9ff2c60 con 0x5584da263c80 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f500a000640 10 client.6522 handle_command_reply: tid=0 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 client.6522 shutdown 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 -- 172.21.15.59:0/3912005890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 msgr2=0x5584da239270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 --2- 172.21.15.59:0/3912005890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da239270 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f501c05e0d0 tx=0x7f501c056730 comp rx=0 tx=0).stop 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 -- 172.21.15.59:0/3912005890 shutdown_connections 2024-04-25T09:05:17.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 --2- 172.21.15.59:0/3912005890 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5584da263c80 0x5584da266070 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 --2- 172.21.15.59:0/3912005890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da239270 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 --2- 172.21.15.59:0/3912005890 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da238d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 --2- 172.21.15.59:0/3912005890 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da2387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f500a000640 0 client.6522 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 -- 172.21.15.59:0/3912005890 >> 172.21.15.59:0/3912005890 conn(0x5584da206020 msgr2=0x5584da208ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 -- 172.21.15.59:0/3912005890 shutdown_connections 2024-04-25T09:05:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 1 -- 172.21.15.59:0/3912005890 wait complete. 2024-04-25T09:05:17.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.389+0000 7f502ef57000 20 client.6522 trim_cache size 0 max 16384 2024-04-25T09:05:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f502ef57000 1 Processor -- start 2024-04-25T09:05:17.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f502ef57000 1 -- start start 2024-04-25T09:05:17.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f502ef57000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da209a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f502ef57000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da260e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f502ef57000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da261380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f502ef57000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5024203fa0 con 0x5584da2542f0 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f502ef57000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5024203100 con 0x5584da2539d0 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f502ef57000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5024202530 con 0x5584da20a0a0 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f5029a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da261380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f5029a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da261380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60032/0 (socket says 172.21.15.59:60032) 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f5029a00640 1 -- 172.21.15.59:0/4074796828 learned_addr learned my addr 172.21.15.59:0/4074796828 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f5029000640 1 --2- 172.21.15.59:0/4074796828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da209a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f5023e00640 1 --2- 172.21.15.59:0/4074796828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da260e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f5029a00640 1 -- 172.21.15.59:0/4074796828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 msgr2=0x5584da209a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f5029a00640 1 --2- 172.21.15.59:0/4074796828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da209a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f5029a00640 1 -- 172.21.15.59:0/4074796828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 msgr2=0x5584da260e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f5029a00640 1 --2- 172.21.15.59:0/4074796828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da260e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f5029a00640 1 -- 172.21.15.59:0/4074796828 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584da09dde0 con 0x5584da2542f0 2024-04-25T09:05:17.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.405+0000 7f5023e00640 1 --2- 172.21.15.59:0/4074796828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da260e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5029a00640 1 --2- 172.21.15.59:0/4074796828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da261380 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f501c0070b0 tx=0x7f501c05c050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a148c2eddaca93c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5014c00640 1 -- 172.21.15.59:0/4074796828 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c05e170 con 0x5584da2542f0 2024-04-25T09:05:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5014c00640 1 -- 172.21.15.59:0/4074796828 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c05c0c0 con 0x5584da2542f0 2024-04-25T09:05:17.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5014c00640 1 -- 172.21.15.59:0/4074796828 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c055540 con 0x5584da2542f0 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 -- 172.21.15.59:0/4074796828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 msgr2=0x5584da261380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 --2- 172.21.15.59:0/4074796828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da261380 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f501c0070b0 tx=0x7f501c05c050 comp rx=0 tx=0).stop 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 -- 172.21.15.59:0/4074796828 shutdown_connections 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 --2- 172.21.15.59:0/4074796828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da261380 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 --2- 172.21.15.59:0/4074796828 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da260e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 --2- 172.21.15.59:0/4074796828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da209a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 -- 172.21.15.59:0/4074796828 >> 172.21.15.59:0/4074796828 conn(0x5584da206020 msgr2=0x5584da260730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 -- 172.21.15.59:0/4074796828 shutdown_connections 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 -- 172.21.15.59:0/4074796828 wait complete. 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 -- start start 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 Processor -- start 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da2b3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da2b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da265a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584d9ff1e00 con 0x5584da2542f0 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5024202b30 con 0x5584da2539d0 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5584da056300 con 0x5584da20a0a0 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 10 client.0 _ll_register_callbacks cb 0x5584da1d5040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5029a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da265a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5029a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da265a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60046/0 (socket says 172.21.15.59:60046) 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5029a00640 1 -- 172.21.15.59:0/3159224091 learned_addr learned my addr 172.21.15.59:0/3159224091 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5029000640 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da2b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5023e00640 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da2b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5029a00640 1 -- 172.21.15.59:0/3159224091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 msgr2=0x5584da2b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5029a00640 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da2b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5029a00640 1 -- 172.21.15.59:0/3159224091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 msgr2=0x5584da2b3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5029a00640 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da2b3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5029a00640 1 -- 172.21.15.59:0/3159224091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584d9ff88e0 con 0x5584da2542f0 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5029000640 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da2b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f5029a00640 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da265a20 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f501c052350 tx=0x7f501c0839e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e4b87f568a0b8e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f500a000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f500a000640 1 -- 172.21.15.59:0/3159224091 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501c05c270 con 0x5584da2542f0 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f500a000640 1 -- 172.21.15.59:0/3159224091 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f501c079d30 con 0x5584da2542f0 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.409+0000 7f502ef57000 1 -- 172.21.15.59:0/3159224091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f501c05c0c0 con 0x5584da2542f0 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f500a000640 1 -- 172.21.15.59:0/3159224091 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f501c07d0a0 con 0x5584da2542f0 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 10 client.6528 fetch_fsmap learned FSMap version 39 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 -- 172.21.15.59:0/3159224091 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x5584da0b08f0 con 0x5584da2542f0 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f500a000640 1 -- 172.21.15.59:0/3159224091 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501c05c0c0 con 0x5584da2542f0 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f500a000640 1 -- 172.21.15.59:0/3159224091 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 39) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f501c051c40 con 0x5584da2542f0 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 10 client.6528 fetch_fsmap finished waiting for FSMap version 39 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 10 client.6528 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:05:17.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 20 client.6528 populate_metadata read hostname 'smithi059' 2024-04-25T09:05:17.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5584da2663e0 0x5584da2667f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:17.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 4 client.6528 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:05:17.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 -- 172.21.15.59:0/3159224091 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5584da064530 con 0x5584da2663e0 2024-04-25T09:05:17.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f5029000640 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5584da2663e0 0x5584da2667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:17.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f500a000640 10 client.6528 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:17.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f5029000640 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5584da2663e0 0x5584da2667f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e99fb29a40a7fc7 server_cookie=cc583495346ad42a in_seq=0 out_seq=0 2024-04-25T09:05:17.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f500a000640 1 -- 172.21.15.59:0/3159224091 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x5584da064530 con 0x5584da2663e0 2024-04-25T09:05:17.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f500a000640 10 client.6528 handle_command_reply: tid=0 2024-04-25T09:05:17.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 client.6528 shutdown 2024-04-25T09:05:17.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 -- 172.21.15.59:0/3159224091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 msgr2=0x5584da265a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da265a20 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f501c052350 tx=0x7f501c0839e0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 -- 172.21.15.59:0/3159224091 shutdown_connections 2024-04-25T09:05:17.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5584da2663e0 0x5584da2667f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5584da2542f0 0x5584da265a20 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5584da2539d0 0x5584da2b3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 --2- 172.21.15.59:0/3159224091 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5584da20a0a0 0x5584da2b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 -- 172.21.15.59:0/3159224091 >> 172.21.15.59:0/3159224091 conn(0x5584da206020 msgr2=0x5584da260fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f500a000640 0 client.6528 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 -- 172.21.15.59:0/3159224091 shutdown_connections 2024-04-25T09:05:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 1 -- 172.21.15.59:0/3159224091 wait complete. 2024-04-25T09:05:17.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502ef57000 20 client.6528 trim_cache size 0 max 16384 2024-04-25T09:05:17.411 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:05:17.411 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:05:17.411 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-04-25T09:05:17.411 INFO:teuthology.orchestra.run.smithi059.stdout: "b50f7926-89ad-4b91-953b-e2f462b1fe94": { 2024-04-25T09:05:17.411 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-04-25T09:05:17.411 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "b50f7926-89ad-4b91-953b-e2f462b1fe94", 2024-04-25T09:05:17.411 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,repair,force" 2024-04-25T09:05:17.411 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:05:17.411 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:05:17.411 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:05:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502a400640 1 -- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5004066f90 msgr2=0x7f5004069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502a400640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5004066f90 0x7f5004069450 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f50180aa000 tx=0x7f50240ad820 comp rx=0 tx=0).stop 2024-04-25T09:05:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502a400640 1 -- 172.21.15.59:0/2456966216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50240b0f70 msgr2=0x7f502415cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502a400640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50240b0f70 0x7f502415cba0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f50240ad7f0 tx=0x7f501c010590 comp rx=0 tx=0).stop 2024-04-25T09:05:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502a400640 1 -- 172.21.15.59:0/2456966216 shutdown_connections 2024-04-25T09:05:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502a400640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5004066f90 0x7f5004069450 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502a400640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50240b0f70 0x7f502415cba0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502a400640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50240b05d0 0x7f50240b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502a400640 1 --2- 172.21.15.59:0/2456966216 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500c0039c0 0x7f502415e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502a400640 1 -- 172.21.15.59:0/2456966216 >> 172.21.15.59:0/2456966216 conn(0x7f50240726e0 msgr2=0x7f5024142330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502a400640 1 -- 172.21.15.59:0/2456966216 shutdown_connections 2024-04-25T09:05:17.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:17.413+0000 7f502a400640 1 -- 172.21.15.59:0/2456966216 wait complete. 2024-04-25T09:05:17.425 INFO:tasks.cephfs.filesystem:scrub status for tag:b50f7926-89ad-4b91-953b-e2f462b1fe94 - {'path': '/', 'tag': 'b50f7926-89ad-4b91-953b-e2f462b1fe94', 'options': 'recursive,repair,force'} 2024-04-25T09:05:23.059 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:23.063 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:47.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:47.427 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-25T09:05:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.589+0000 7f1384600640 1 Processor -- start 2024-04-25T09:05:47.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1384600640 1 -- start start 2024-04-25T09:05:47.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1384600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f137c072210 0x7f137c0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1384600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f137c0ce1d0 0x7f137c0ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1384600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c06ac10 con 0x7f137c15dd90 2024-04-25T09:05:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1384600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137c0b2dc0 con 0x7f137c0ce1d0 2024-04-25T09:05:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1384600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c06aeb0 con 0x7f137c072210 2024-04-25T09:05:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1382600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f137c0ce1d0 0x7f137c0ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1381c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f137c15dd90 0x7f137c071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39862/0 (socket says 172.21.15.59:39862) 2024-04-25T09:05:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1381c00640 1 -- 172.21.15.59:0/2709922766 learned_addr learned my addr 172.21.15.59:0/2709922766 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1381200640 1 --2- 172.21.15.59:0/2709922766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f137c072210 0x7f137c0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1382600640 1 -- 172.21.15.59:0/2709922766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f137c072210 msgr2=0x7f137c0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1382600640 1 --2- 172.21.15.59:0/2709922766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f137c072210 0x7f137c0cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1382600640 1 -- 172.21.15.59:0/2709922766 >> v1:172.21.15.59:6789/0 conn(0x7f137c15dd90 legacy=0x7f137c071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f1382600640 1 -- 172.21.15.59:0/2709922766 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c06b190 con 0x7f137c0ce1d0 2024-04-25T09:05:47.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.593+0000 7f137be00640 1 -- 172.21.15.59:0/2709922766 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44842975 0 0) 0x7f137c06ac10 con 0x7f137c15dd90 2024-04-25T09:05:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f1382600640 1 --2- 172.21.15.59:0/2709922766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c0ce1d0 0x7f137c0ce640 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1374009d90 tx=0x7f137401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d5709606510123 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f137be00640 1 -- 172.21.15.59:0/2709922766 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740b2070 con 0x7f137c0ce1d0 2024-04-25T09:05:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f137be00640 1 -- 172.21.15.59:0/2709922766 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13740a5850 con 0x7f137c0ce1d0 2024-04-25T09:05:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f137be00640 1 -- 172.21.15.59:0/2709922766 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740a5c20 con 0x7f137c0ce1d0 2024-04-25T09:05:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f1384600640 1 -- 172.21.15.59:0/2709922766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c0ce1d0 msgr2=0x7f137c0ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f1384600640 1 --2- 172.21.15.59:0/2709922766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c0ce1d0 0x7f137c0ce640 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1374009d90 tx=0x7f137401c8e0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f1384600640 1 -- 172.21.15.59:0/2709922766 shutdown_connections 2024-04-25T09:05:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f1384600640 1 --2- 172.21.15.59:0/2709922766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c0ce1d0 0x7f137c0ce640 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f1384600640 1 --2- 172.21.15.59:0/2709922766 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f137c072210 0x7f137c0cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f1384600640 1 -- 172.21.15.59:0/2709922766 >> 172.21.15.59:0/2709922766 conn(0x7f137c0cfd90 msgr2=0x7f137c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:47.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f1384600640 1 -- 172.21.15.59:0/2709922766 shutdown_connections 2024-04-25T09:05:47.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f1384600640 1 -- 172.21.15.59:0/2709922766 wait complete. 2024-04-25T09:05:47.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f1384600640 1 Processor -- start 2024-04-25T09:05:47.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.597+0000 7f1384600640 1 -- start start 2024-04-25T09:05:47.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1384600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c072210 0x7f137c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1384600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f137c0ce1d0 0x7f137c153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1384600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f137c15dd90 0x7f137c153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1384600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0cf720 con 0x7f137c072210 2024-04-25T09:05:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1384600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0cf5a0 con 0x7f137c15dd90 2024-04-25T09:05:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1384600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0cf8a0 con 0x7f137c0ce1d0 2024-04-25T09:05:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1381c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c072210 0x7f137c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1381c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c072210 0x7f137c15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44904/0 (socket says 172.21.15.59:44904) 2024-04-25T09:05:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1381c00640 1 -- 172.21.15.59:0/463588013 learned_addr learned my addr 172.21.15.59:0/463588013 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1381200640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f137c0ce1d0 0x7f137c153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1382600640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f137c15dd90 0x7f137c153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1381c00640 1 -- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f137c0ce1d0 msgr2=0x7f137c153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1381c00640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f137c0ce1d0 0x7f137c153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1381c00640 1 -- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f137c15dd90 msgr2=0x7f137c153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1381c00640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f137c15dd90 0x7f137c153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1381c00640 1 -- 172.21.15.59:0/463588013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c0ad850 con 0x7f137c072210 2024-04-25T09:05:47.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1381c00640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c072210 0x7f137c15a4c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f137000c520 tx=0x7f137000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1379600640 1 -- 172.21.15.59:0/463588013 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1370018070 con 0x7f137c072210 2024-04-25T09:05:47.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1379600640 1 -- 172.21.15.59:0/463588013 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13700074e0 con 0x7f137c072210 2024-04-25T09:05:47.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1379600640 1 -- 172.21.15.59:0/463588013 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13700049f0 con 0x7f137c072210 2024-04-25T09:05:47.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1384600640 1 -- 172.21.15.59:0/463588013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c0adb30 con 0x7f137c072210 2024-04-25T09:05:47.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.601+0000 7f1384600640 1 -- 172.21.15.59:0/463588013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c0ae610 con 0x7f137c072210 2024-04-25T09:05:47.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1379600640 1 -- 172.21.15.59:0/463588013 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f137001b070 con 0x7f137c072210 2024-04-25T09:05:47.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1379600640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f135c066f90 0x7f135c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1379600640 1 -- 172.21.15.59:0/463588013 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f13700846f0 con 0x7f137c072210 2024-04-25T09:05:47.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1381200640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f135c066f90 0x7f135c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1387b1b000 1 Processor -- start 2024-04-25T09:05:47.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1387b1b000 1 -- start start 2024-04-25T09:05:47.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1381200640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f135c066f90 0x7f135c069450 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f137c160c90 tx=0x7f1368008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1387b1b000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57bd9d0 0x5590c57bddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1387b1b000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 0x5590c5773b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1387b1b000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 0x5590c5774480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1387b1b000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c55c0ff0 con 0x5590c57be2f0 2024-04-25T09:05:47.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1387b1b000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c5549150 con 0x5590c57bd9d0 2024-04-25T09:05:47.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1387b1b000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590c55bd090 con 0x5590c57740a0 2024-04-25T09:05:47.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1381200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 0x5590c5773b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1381200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 0x5590c5773b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44918/0 (socket says 172.21.15.59:44918) 2024-04-25T09:05:47.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1381200640 1 -- 172.21.15.59:0/1409284081 learned_addr learned my addr 172.21.15.59:0/1409284081 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:47.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1382600640 1 --2- 172.21.15.59:0/1409284081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 0x5590c5774480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1381c00640 1 --2- 172.21.15.59:0/1409284081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57bd9d0 0x5590c57bddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1381200640 1 -- 172.21.15.59:0/1409284081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 msgr2=0x5590c5774480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:47.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1381200640 1 --2- 172.21.15.59:0/1409284081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 0x5590c5774480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1381200640 1 -- 172.21.15.59:0/1409284081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57bd9d0 msgr2=0x5590c57bddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:47.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1381200640 1 --2- 172.21.15.59:0/1409284081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57bd9d0 0x5590c57bddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1381200640 1 -- 172.21.15.59:0/1409284081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590c57570d0 con 0x5590c57be2f0 2024-04-25T09:05:47.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f1381200640 1 --2- 172.21.15.59:0/1409284081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 0x5590c5773b60 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1368010ab0 tx=0x7f1368013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef4648882174a5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f136e000640 1 -- 172.21.15.59:0/1409284081 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136801c050 con 0x5590c57be2f0 2024-04-25T09:05:47.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f136e000640 1 -- 172.21.15.59:0/1409284081 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1368026070 con 0x5590c57be2f0 2024-04-25T09:05:47.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.605+0000 7f136e000640 1 -- 172.21.15.59:0/1409284081 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368021440 con 0x5590c57be2f0 2024-04-25T09:05:47.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 -- 172.21.15.59:0/1409284081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 msgr2=0x5590c5773b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 --2- 172.21.15.59:0/1409284081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 0x5590c5773b60 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f1368010ab0 tx=0x7f1368013000 comp rx=0 tx=0).stop 2024-04-25T09:05:47.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 -- 172.21.15.59:0/1409284081 shutdown_connections 2024-04-25T09:05:47.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 --2- 172.21.15.59:0/1409284081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 0x5590c5774480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 --2- 172.21.15.59:0/1409284081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 0x5590c5773b60 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 --2- 172.21.15.59:0/1409284081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57bd9d0 0x5590c57bddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 -- 172.21.15.59:0/1409284081 >> 172.21.15.59:0/1409284081 conn(0x5590c5770020 msgr2=0x5590c5772440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:47.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 -- 172.21.15.59:0/1409284081 shutdown_connections 2024-04-25T09:05:47.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 -- 172.21.15.59:0/1409284081 wait complete. 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 -- start start 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 Processor -- start 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 0x5590c57a27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57bd9d0 0x5590c57a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 0x5590c57a3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c5585250 con 0x5590c57be2f0 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c557b690 con 0x5590c57bd9d0 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590c5549a40 con 0x5590c57740a0 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 10 client.0 _ll_register_callbacks cb 0x5590c575ee90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1382600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 0x5590c57a3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1382600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 0x5590c57a3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44922/0 (socket says 172.21.15.59:44922) 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1382600640 1 -- 172.21.15.59:0/3386851576 learned_addr learned my addr 172.21.15.59:0/3386851576 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1381c00640 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 0x5590c57a27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1381200640 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57bd9d0 0x5590c57a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1382600640 1 -- 172.21.15.59:0/3386851576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 msgr2=0x5590c57a27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1382600640 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 0x5590c57a27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1382600640 1 -- 172.21.15.59:0/3386851576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57bd9d0 msgr2=0x5590c57a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1382600640 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57bd9d0 0x5590c57a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1382600640 1 -- 172.21.15.59:0/3386851576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590c566e1c0 con 0x5590c57be2f0 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1382600640 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 0x5590c57a3270 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1374009bd0 tx=0x7f137401b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beafcc1a9445a198 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1362a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1362a00640 1 -- 172.21.15.59:0/3386851576 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13740b2040 con 0x5590c57be2f0 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1362a00640 1 -- 172.21.15.59:0/3386851576 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f13740a5bd0 con 0x5590c57be2f0 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.609+0000 7f1387b1b000 1 -- 172.21.15.59:0/3386851576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1368026070 con 0x5590c57be2f0 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1362a00640 1 -- 172.21.15.59:0/3386851576 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13740cc050 con 0x5590c57be2f0 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 10 client.6543 fetch_fsmap learned FSMap version 40 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 -- 172.21.15.59:0/3386851576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x5590c566a170 con 0x5590c57be2f0 2024-04-25T09:05:47.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1362a00640 1 -- 172.21.15.59:0/3386851576 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1368026070 con 0x5590c57be2f0 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1362a00640 1 -- 172.21.15.59:0/3386851576 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 40) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f13740cf020 con 0x5590c57be2f0 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 10 client.6543 fetch_fsmap finished waiting for FSMap version 40 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 10 client.6543 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 20 client.6543 populate_metadata read hostname 'smithi059' 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5590c57cdc80 0x5590c57d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 4 client.6543 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 -- 172.21.15.59:0/3386851576 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590c555cc60 con 0x5590c57cdc80 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1381c00640 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5590c57cdc80 0x5590c57d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1381c00640 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5590c57cdc80 0x5590c57d0070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ce43a1ae3b66528 server_cookie=6e9970077caff25c in_seq=0 out_seq=0 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1362a00640 10 client.6543 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1362a00640 1 -- 172.21.15.59:0/3386851576 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5590c555cc60 con 0x5590c57cdc80 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1362a00640 10 client.6543 handle_command_reply: tid=0 2024-04-25T09:05:47.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 client.6543 shutdown 2024-04-25T09:05:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 -- 172.21.15.59:0/3386851576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 msgr2=0x5590c57a3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 0x5590c57a3270 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f1374009bd0 tx=0x7f137401b120 comp rx=0 tx=0).stop 2024-04-25T09:05:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 -- 172.21.15.59:0/3386851576 shutdown_connections 2024-04-25T09:05:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5590c57cdc80 0x5590c57d0070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57be2f0 0x5590c57a3270 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57bd9d0 0x5590c57a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 --2- 172.21.15.59:0/3386851576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 0x5590c57a27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1362a00640 0 client.6543 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 -- 172.21.15.59:0/3386851576 >> 172.21.15.59:0/3386851576 conn(0x5590c5770020 msgr2=0x5590c5772ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 -- 172.21.15.59:0/3386851576 shutdown_connections 2024-04-25T09:05:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 1 -- 172.21.15.59:0/3386851576 wait complete. 2024-04-25T09:05:47.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.613+0000 7f1387b1b000 20 client.6543 trim_cache size 0 max 16384 2024-04-25T09:05:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1387b1b000 1 Processor -- start 2024-04-25T09:05:47.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1387b1b000 1 -- start start 2024-04-25T09:05:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1387b1b000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 0x5590c5773630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1387b1b000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 0x5590c57bc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1387b1b000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57be2f0 0x5590c57bccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1387b1b000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c2031f0 con 0x5590c57bd9d0 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1387b1b000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c202310 con 0x5590c57be2f0 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1387b1b000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c142310 con 0x5590c57740a0 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1381200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 0x5590c57bc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1381200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 0x5590c57bc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44932/0 (socket says 172.21.15.59:44932) 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1381200640 1 -- 172.21.15.59:0/521778836 learned_addr learned my addr 172.21.15.59:0/521778836 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1382600640 1 --2- 172.21.15.59:0/521778836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57be2f0 0x5590c57bccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1381c00640 1 --2- 172.21.15.59:0/521778836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 0x5590c5773630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1381200640 1 -- 172.21.15.59:0/521778836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 msgr2=0x5590c5773630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1381200640 1 --2- 172.21.15.59:0/521778836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 0x5590c5773630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1381200640 1 -- 172.21.15.59:0/521778836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57be2f0 msgr2=0x5590c57bccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1381200640 1 --2- 172.21.15.59:0/521778836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57be2f0 0x5590c57bccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1381200640 1 -- 172.21.15.59:0/521778836 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590c5607de0 con 0x5590c57bd9d0 2024-04-25T09:05:47.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1381200640 1 --2- 172.21.15.59:0/521778836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 0x5590c57bc780 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1368010620 tx=0x7f1368015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa88535e0e13ef49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f136d600640 1 -- 172.21.15.59:0/521778836 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13680059a0 con 0x5590c57bd9d0 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f136d600640 1 -- 172.21.15.59:0/521778836 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1368026050 con 0x5590c57bd9d0 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f136d600640 1 -- 172.21.15.59:0/521778836 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368005d60 con 0x5590c57bd9d0 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1387b1b000 1 -- 172.21.15.59:0/521778836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 msgr2=0x5590c57bc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.629+0000 7f1387b1b000 1 --2- 172.21.15.59:0/521778836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 0x5590c57bc780 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f1368010620 tx=0x7f1368015000 comp rx=0 tx=0).stop 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 -- 172.21.15.59:0/521778836 shutdown_connections 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 --2- 172.21.15.59:0/521778836 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57be2f0 0x5590c57bccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 --2- 172.21.15.59:0/521778836 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 0x5590c57bc780 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 --2- 172.21.15.59:0/521778836 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57740a0 0x5590c5773630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 -- 172.21.15.59:0/521778836 >> 172.21.15.59:0/521778836 conn(0x5590c5770020 msgr2=0x5590c57bc070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 -- 172.21.15.59:0/521778836 shutdown_connections 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 -- 172.21.15.59:0/521778836 wait complete. 2024-04-25T09:05:47.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 -- start start 2024-04-25T09:05:47.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 Processor -- start 2024-04-25T09:05:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57740a0 0x5590c581e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 0x5590c581e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57be2f0 0x5590c57d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590c555be00 con 0x5590c57bd9d0 2024-04-25T09:05:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c159b30 con 0x5590c57740a0 2024-04-25T09:05:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590c55c0300 con 0x5590c57be2f0 2024-04-25T09:05:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 10 client.0 _ll_register_callbacks cb 0x5590c573f040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1381200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 0x5590c581e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1381200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 0x5590c581e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44948/0 (socket says 172.21.15.59:44948) 2024-04-25T09:05:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1381200640 1 -- 172.21.15.59:0/1433359901 learned_addr learned my addr 172.21.15.59:0/1433359901 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1381c00640 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57740a0 0x5590c581e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1382600640 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57be2f0 0x5590c57d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1381200640 1 -- 172.21.15.59:0/1433359901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57be2f0 msgr2=0x5590c57d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1381200640 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57be2f0 0x5590c57d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1381200640 1 -- 172.21.15.59:0/1433359901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57740a0 msgr2=0x5590c581e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1381200640 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57740a0 0x5590c581e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1381200640 1 -- 172.21.15.59:0/1433359901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590c55628e0 con 0x5590c57bd9d0 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1382600640 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57be2f0 0x5590c57d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1381200640 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 0x5590c581e850 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1368022000 tx=0x7f1368004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3258ca75fd6d1cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1362a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1362a00640 1 -- 172.21.15.59:0/1433359901 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136801c070 con 0x5590c57bd9d0 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1362a00640 1 -- 172.21.15.59:0/1433359901 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f1368021710 con 0x5590c57bd9d0 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 -- 172.21.15.59:0/1433359901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1368026050 con 0x5590c57bd9d0 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1362a00640 1 -- 172.21.15.59:0/1433359901 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1368044050 con 0x5590c57bd9d0 2024-04-25T09:05:47.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 10 client.6549 fetch_fsmap learned FSMap version 40 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 -- 172.21.15.59:0/1433359901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x5590c561a8f0 con 0x5590c57bd9d0 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1362a00640 1 -- 172.21.15.59:0/1433359901 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1368026050 con 0x5590c57bd9d0 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1362a00640 1 -- 172.21.15.59:0/1433359901 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 40) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1368047020 con 0x5590c57bd9d0 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 10 client.6549 fetch_fsmap finished waiting for FSMap version 40 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 10 client.6549 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 20 client.6549 populate_metadata read hostname 'smithi059' 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5590c57d0ce0 0x5590c57d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 4 client.6549 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.633+0000 7f1387b1b000 1 -- 172.21.15.59:0/1433359901 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5590c55ce530 con 0x5590c57d0ce0 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1381c00640 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5590c57d0ce0 0x5590c57d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1381c00640 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5590c57d0ce0 0x5590c57d10c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dd422ec2d317e1d server_cookie=2dd883e50c150185 in_seq=0 out_seq=0 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1362a00640 10 client.6549 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1362a00640 1 -- 172.21.15.59:0/1433359901 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5590c55ce530 con 0x5590c57d0ce0 2024-04-25T09:05:47.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1362a00640 10 client.6549 handle_command_reply: tid=0 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1387b1b000 1 client.6549 shutdown 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1387b1b000 1 -- 172.21.15.59:0/1433359901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 msgr2=0x5590c581e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1387b1b000 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 0x5590c581e850 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f1368022000 tx=0x7f1368004740 comp rx=0 tx=0).stop 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1387b1b000 1 -- 172.21.15.59:0/1433359901 shutdown_connections 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1387b1b000 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x5590c57d0ce0 0x5590c57d10c0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1387b1b000 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5590c57be2f0 0x5590c57d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1387b1b000 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5590c57bd9d0 0x5590c581e850 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1387b1b000 1 --2- 172.21.15.59:0/1433359901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5590c57740a0 0x5590c581e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1362a00640 0 client.6549 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1387b1b000 1 -- 172.21.15.59:0/1433359901 >> 172.21.15.59:0/1433359901 conn(0x5590c5770020 msgr2=0x5590c57bc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1387b1b000 1 -- 172.21.15.59:0/1433359901 shutdown_connections 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1387b1b000 1 -- 172.21.15.59:0/1433359901 wait complete. 2024-04-25T09:05:47.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1387b1b000 20 client.6549 trim_cache size 0 max 16384 2024-04-25T09:05:47.633 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:05:47.633 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-04-25T09:05:47.633 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2024-04-25T09:05:47.633 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:05:47.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1384600640 1 -- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f135c066f90 msgr2=0x7f135c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1384600640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f135c066f90 0x7f135c069450 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f137c160c90 tx=0x7f1368008040 comp rx=0 tx=0).stop 2024-04-25T09:05:47.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1384600640 1 -- 172.21.15.59:0/463588013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c072210 msgr2=0x7f137c15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1384600640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c072210 0x7f137c15a4c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f137000c520 tx=0x7f137000c9e0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1384600640 1 -- 172.21.15.59:0/463588013 shutdown_connections 2024-04-25T09:05:47.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1384600640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f135c066f90 0x7f135c069450 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1384600640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f137c15dd90 0x7f137c153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1384600640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f137c0ce1d0 0x7f137c153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1384600640 1 --2- 172.21.15.59:0/463588013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f137c072210 0x7f137c15a4c0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1384600640 1 -- 172.21.15.59:0/463588013 >> 172.21.15.59:0/463588013 conn(0x7f137c0cfd90 msgr2=0x7f137c156c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:47.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1384600640 1 -- 172.21.15.59:0/463588013 shutdown_connections 2024-04-25T09:05:47.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.637+0000 7f1384600640 1 -- 172.21.15.59:0/463588013 wait complete. 2024-04-25T09:05:47.648 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:05:47.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3348400640 1 Processor -- start 2024-04-25T09:05:47.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3348400640 1 -- start start 2024-04-25T09:05:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3348400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f334015b5a0 0x7f33400cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3348400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f334015b980 0x7f33400cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3348400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3340071970 0x7f33400cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3348400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33400cfcd0 con 0x7f3340071970 2024-04-25T09:05:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3348400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33400ce7f0 con 0x7f334015b5a0 2024-04-25T09:05:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3348400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33400cead0 con 0x7f334015b980 2024-04-25T09:05:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3346400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3340071970 0x7f33400cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3346400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3340071970 0x7f33400cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44952/0 (socket says 172.21.15.59:44952) 2024-04-25T09:05:47.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3346400640 1 -- 172.21.15.59:0/859114950 learned_addr learned my addr 172.21.15.59:0/859114950 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3345000640 1 --2- 172.21.15.59:0/859114950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f334015b980 0x7f33400cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3345a00640 1 --2- 172.21.15.59:0/859114950 >> v2:172.21.15.178:3300/0 conn(0x7f334015b5a0 0x7f33400cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3346400640 1 -- 172.21.15.59:0/859114950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f334015b980 msgr2=0x7f33400cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3346400640 1 --2- 172.21.15.59:0/859114950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f334015b980 0x7f33400cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3346400640 1 -- 172.21.15.59:0/859114950 >> v2:172.21.15.178:3300/0 conn(0x7f334015b5a0 msgr2=0x7f33400cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3346400640 1 --2- 172.21.15.59:0/859114950 >> v2:172.21.15.178:3300/0 conn(0x7f334015b5a0 0x7f33400cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3346400640 1 -- 172.21.15.59:0/859114950 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33400cf960 con 0x7f3340071970 2024-04-25T09:05:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3345000640 1 --2- 172.21.15.59:0/859114950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f334015b980 0x7f33400cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:47.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.797+0000 7f3345a00640 1 --2- 172.21.15.59:0/859114950 >> v2:172.21.15.178:3300/0 conn(0x7f334015b5a0 0x7f33400cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:47.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f3346400640 1 --2- 172.21.15.59:0/859114950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3340071970 0x7f33400cc270 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3340072e00 tx=0x7f333801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b1e1e69a05fbf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f333fe00640 1 -- 172.21.15.59:0/859114950 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380a5890 con 0x7f3340071970 2024-04-25T09:05:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f333fe00640 1 -- 172.21.15.59:0/859114950 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33380a5a30 con 0x7f3340071970 2024-04-25T09:05:47.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f333fe00640 1 -- 172.21.15.59:0/859114950 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33380a5e00 con 0x7f3340071970 2024-04-25T09:05:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f3348400640 1 -- 172.21.15.59:0/859114950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3340071970 msgr2=0x7f33400cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f3348400640 1 --2- 172.21.15.59:0/859114950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3340071970 0x7f33400cc270 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3340072e00 tx=0x7f333801c9f0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f3348400640 1 -- 172.21.15.59:0/859114950 shutdown_connections 2024-04-25T09:05:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f3348400640 1 --2- 172.21.15.59:0/859114950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3340071970 0x7f33400cc270 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f3348400640 1 --2- 172.21.15.59:0/859114950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f334015b980 0x7f33400cbd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f3348400640 1 --2- 172.21.15.59:0/859114950 >> v2:172.21.15.178:3300/0 conn(0x7f334015b5a0 0x7f33400cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f3348400640 1 -- 172.21.15.59:0/859114950 >> 172.21.15.59:0/859114950 conn(0x7f33400b3390 msgr2=0x7f33400b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:47.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f3348400640 1 -- 172.21.15.59:0/859114950 shutdown_connections 2024-04-25T09:05:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.801+0000 7f3348400640 1 -- 172.21.15.59:0/859114950 wait complete. 2024-04-25T09:05:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3348400640 1 Processor -- start 2024-04-25T09:05:47.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3348400640 1 -- start start 2024-04-25T09:05:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3348400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3340071970 0x7f33401f9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3348400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f334015b5a0 0x7f33401584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3348400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f334015b980 0x7f33401589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3348400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334015ff40 con 0x7f334015b5a0 2024-04-25T09:05:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3348400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334015fdc0 con 0x7f3340071970 2024-04-25T09:05:47.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3348400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33401600c0 con 0x7f334015b980 2024-04-25T09:05:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3345000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f334015b5a0 0x7f33401584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3345000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f334015b5a0 0x7f33401584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44960/0 (socket says 172.21.15.59:44960) 2024-04-25T09:05:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3345000640 1 -- 172.21.15.59:0/136768791 learned_addr learned my addr 172.21.15.59:0/136768791 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3345a00640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3340071970 0x7f33401f9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3346400640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f334015b980 0x7f33401589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3345000640 1 -- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f334015b980 msgr2=0x7f33401589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3345000640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f334015b980 0x7f33401589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3345000640 1 -- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3340071970 msgr2=0x7f33401f9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3345000640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3340071970 0x7f33401f9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3345000640 1 -- 172.21.15.59:0/136768791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3340159020 con 0x7f334015b5a0 2024-04-25T09:05:47.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3345000640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f334015b5a0 0x7f33401584b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f332c00e810 tx=0x7f332c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f333d600640 1 -- 172.21.15.59:0/136768791 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c017070 con 0x7f334015b5a0 2024-04-25T09:05:47.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f333d600640 1 -- 172.21.15.59:0/136768791 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332c00c8d0 con 0x7f334015b5a0 2024-04-25T09:05:47.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f333d600640 1 -- 172.21.15.59:0/136768791 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332c00f040 con 0x7f334015b5a0 2024-04-25T09:05:47.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3348400640 1 -- 172.21.15.59:0/136768791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3340159300 con 0x7f334015b5a0 2024-04-25T09:05:47.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.805+0000 7f3348400640 1 -- 172.21.15.59:0/136768791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33401598c0 con 0x7f334015b5a0 2024-04-25T09:05:47.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.809+0000 7f3348400640 1 -- 172.21.15.59:0/136768791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33400745d0 con 0x7f334015b5a0 2024-04-25T09:05:47.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.809+0000 7f333d600640 1 -- 172.21.15.59:0/136768791 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f332c01a070 con 0x7f334015b5a0 2024-04-25T09:05:47.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.809+0000 7f333d600640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3320066f60 0x7f3320069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:47.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.809+0000 7f333d600640 1 -- 172.21.15.59:0/136768791 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f332c084d00 con 0x7f334015b5a0 2024-04-25T09:05:47.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.809+0000 7f3345a00640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3320066f60 0x7f3320069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:47.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.809+0000 7f3345a00640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3320066f60 0x7f3320069420 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f33340045f0 tx=0x7f3334008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:47.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:47.813+0000 7f333d600640 1 -- 172.21.15.59:0/136768791 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f332c0554b0 con 0x7f334015b5a0 2024-04-25T09:05:48.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.009+0000 7f3348400640 1 -- 172.21.15.59:0/136768791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33400ceeb0 con 0x7f334015b5a0 2024-04-25T09:05:48.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.009+0000 7f333d600640 1 -- 172.21.15.59:0/136768791 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4937 (secure 0 0 0) 0x7f332c059550 con 0x7f334015b5a0 2024-04-25T09:05:48.003 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:48.003 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":40,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2580922028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2580922028},{"type":"v1","addr":"172.21.15.178:6837","nonce":2580922028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/126805970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":126805970},{"type":"v1","addr":"172.21.15.178:6836","nonce":126805970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/402319604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":402319604},{"type":"v1","addr":"172.21.15.59:6833","nonce":402319604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:36.727681+0000","modified":"2024-04-25T09:05:25.370357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6835/686404516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":686404516},{"type":"v1","addr":"172.21.15.59:6835","nonce":686404516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:05:48.004 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 40 2024-04-25T09:05:48.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.013+0000 7f3348400640 1 -- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3320066f60 msgr2=0x7f3320069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.013+0000 7f3348400640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3320066f60 0x7f3320069420 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f33340045f0 tx=0x7f3334008040 comp rx=0 tx=0).stop 2024-04-25T09:05:48.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.013+0000 7f3348400640 1 -- 172.21.15.59:0/136768791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f334015b5a0 msgr2=0x7f33401584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.013+0000 7f3348400640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f334015b5a0 0x7f33401584b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f332c00e810 tx=0x7f332c00ecd0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.013+0000 7f3348400640 1 -- 172.21.15.59:0/136768791 shutdown_connections 2024-04-25T09:05:48.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.013+0000 7f3348400640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3320066f60 0x7f3320069420 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.013+0000 7f3348400640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f334015b980 0x7f33401589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.013+0000 7f3348400640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f334015b5a0 0x7f33401584b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.013+0000 7f3348400640 1 --2- 172.21.15.59:0/136768791 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3340071970 0x7f33401f9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.013+0000 7f3348400640 1 -- 172.21.15.59:0/136768791 >> 172.21.15.59:0/136768791 conn(0x7f33400b3390 msgr2=0x7f33400cbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.013+0000 7f3348400640 1 -- 172.21.15.59:0/136768791 shutdown_connections 2024-04-25T09:05:48.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.013+0000 7f3348400640 1 -- 172.21.15.59:0/136768791 wait complete. 2024-04-25T09:05:48.024 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T09:05:48.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.173+0000 7efe24e00640 1 Processor -- start 2024-04-25T09:05:48.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.173+0000 7efe24e00640 1 -- start start 2024-04-25T09:05:48.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe24e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe20144120 0x7efe2015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe24e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe200ccbf0 0x7efe2015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe24e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efe2015ee60 0x7efe200b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe24e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2015e490 con 0x7efe200ccbf0 2024-04-25T09:05:48.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe24e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2015bc40 con 0x7efe2015ee60 2024-04-25T09:05:48.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe24e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2015b3a0 con 0x7efe20144120 2024-04-25T09:05:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe17e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe200ccbf0 0x7efe2015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe17e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe200ccbf0 0x7efe2015e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44966/0 (socket says 172.21.15.59:44966) 2024-04-25T09:05:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe17e00640 1 -- 172.21.15.59:0/3014704471 learned_addr learned my addr 172.21.15.59:0/3014704471 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe1e800640 1 --2- 172.21.15.59:0/3014704471 >> v2:172.21.15.178:3300/0 conn(0x7efe2015ee60 0x7efe200b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe1de00640 1 --2- 172.21.15.59:0/3014704471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe20144120 0x7efe2015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe17e00640 1 -- 172.21.15.59:0/3014704471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe20144120 msgr2=0x7efe2015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe17e00640 1 --2- 172.21.15.59:0/3014704471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe20144120 0x7efe2015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe17e00640 1 -- 172.21.15.59:0/3014704471 >> v2:172.21.15.178:3300/0 conn(0x7efe2015ee60 msgr2=0x7efe200b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe17e00640 1 --2- 172.21.15.59:0/3014704471 >> v2:172.21.15.178:3300/0 conn(0x7efe2015ee60 0x7efe200b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe17e00640 1 -- 172.21.15.59:0/3014704471 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2015b680 con 0x7efe200ccbf0 2024-04-25T09:05:48.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe1e800640 1 --2- 172.21.15.59:0/3014704471 >> v2:172.21.15.178:3300/0 conn(0x7efe2015ee60 0x7efe200b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:48.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe17e00640 1 --2- 172.21.15.59:0/3014704471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe200ccbf0 0x7efe2015e920 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7efe200b2fe0 tx=0x7efe0801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b054b5c8551ece server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe1d400640 1 -- 172.21.15.59:0/3014704471 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080b0070 con 0x7efe200ccbf0 2024-04-25T09:05:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe1d400640 1 -- 172.21.15.59:0/3014704471 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe080ab600 con 0x7efe200ccbf0 2024-04-25T09:05:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.177+0000 7efe1d400640 1 -- 172.21.15.59:0/3014704471 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080ab9d0 con 0x7efe200ccbf0 2024-04-25T09:05:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 -- 172.21.15.59:0/3014704471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe200ccbf0 msgr2=0x7efe2015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 --2- 172.21.15.59:0/3014704471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe200ccbf0 0x7efe2015e920 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7efe200b2fe0 tx=0x7efe0801c490 comp rx=0 tx=0).stop 2024-04-25T09:05:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 -- 172.21.15.59:0/3014704471 shutdown_connections 2024-04-25T09:05:48.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 --2- 172.21.15.59:0/3014704471 >> v2:172.21.15.178:3300/0 conn(0x7efe2015ee60 0x7efe200b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 --2- 172.21.15.59:0/3014704471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe200ccbf0 0x7efe2015e920 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 --2- 172.21.15.59:0/3014704471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe20144120 0x7efe2015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 -- 172.21.15.59:0/3014704471 >> 172.21.15.59:0/3014704471 conn(0x7efe20067080 msgr2=0x7efe2006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 -- 172.21.15.59:0/3014704471 shutdown_connections 2024-04-25T09:05:48.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 -- 172.21.15.59:0/3014704471 wait complete. 2024-04-25T09:05:48.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 Processor -- start 2024-04-25T09:05:48.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 -- start start 2024-04-25T09:05:48.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe200ccbf0 0x7efe200ae160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe20144120 0x7efe200af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe2015ee60 0x7efe200b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe20071640 con 0x7efe20144120 2024-04-25T09:05:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe200714c0 con 0x7efe200ccbf0 2024-04-25T09:05:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe24e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe200717c0 con 0x7efe2015ee60 2024-04-25T09:05:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe17e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe20144120 0x7efe200af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe17e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe20144120 0x7efe200af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44972/0 (socket says 172.21.15.59:44972) 2024-04-25T09:05:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe17e00640 1 -- 172.21.15.59:0/1811456044 learned_addr learned my addr 172.21.15.59:0/1811456044 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe1de00640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe200ccbf0 0x7efe200ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe1e800640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe2015ee60 0x7efe200b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe17e00640 1 -- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe2015ee60 msgr2=0x7efe200b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe17e00640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe2015ee60 0x7efe200b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe17e00640 1 -- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe200ccbf0 msgr2=0x7efe200ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe17e00640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe200ccbf0 0x7efe200ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe17e00640 1 -- 172.21.15.59:0/1811456044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2015a7b0 con 0x7efe20144120 2024-04-25T09:05:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.181+0000 7efe1e800640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe2015ee60 0x7efe200b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.185+0000 7efe17e00640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe20144120 0x7efe200af110 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7efe080ae040 tx=0x7efe08019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.185+0000 7efe16000640 1 -- 172.21.15.59:0/1811456044 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080b9070 con 0x7efe20144120 2024-04-25T09:05:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.185+0000 7efe16000640 1 -- 172.21.15.59:0/1811456044 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe080b4400 con 0x7efe20144120 2024-04-25T09:05:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.185+0000 7efe16000640 1 -- 172.21.15.59:0/1811456044 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080b0040 con 0x7efe20144120 2024-04-25T09:05:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.185+0000 7efe24e00640 1 -- 172.21.15.59:0/1811456044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe200af810 con 0x7efe20144120 2024-04-25T09:05:48.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.185+0000 7efe24e00640 1 -- 172.21.15.59:0/1811456044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe200afdd0 con 0x7efe20144120 2024-04-25T09:05:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.185+0000 7efe16000640 1 -- 172.21.15.59:0/1811456044 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efe080b33a0 con 0x7efe20144120 2024-04-25T09:05:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.185+0000 7efe16000640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efdfc066f60 0x7efdfc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.185+0000 7efe16000640 1 -- 172.21.15.59:0/1811456044 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7efe0811e450 con 0x7efe20144120 2024-04-25T09:05:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.185+0000 7efe1de00640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efdfc066f60 0x7efdfc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.185+0000 7efe282e5000 1 Processor -- start 2024-04-25T09:05:48.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 -- start start 2024-04-25T09:05:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe1de00640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efdfc066f60 0x7efdfc069420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efe1000ba30 tx=0x7efe10008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe5223d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe5223dc00 0x55fe521f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 0x55fe521f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe520daba0 con 0x55fe521f38e0 2024-04-25T09:05:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe52040090 con 0x55fe5223dc00 2024-04-25T09:05:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe51fc8160 con 0x55fe5223d2e0 2024-04-25T09:05:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe1e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 0x55fe521f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe1de00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe5223d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe1de00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe5223d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:47832/0 (socket says 172.21.15.59:47832) 2024-04-25T09:05:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe1de00640 1 -- 172.21.15.59:0/1063022357 learned_addr learned my addr 172.21.15.59:0/1063022357 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe1e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 0x55fe521f3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44988/0 (socket says 172.21.15.59:44988) 2024-04-25T09:05:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe17e00640 1 --2- 172.21.15.59:0/1063022357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe5223dc00 0x55fe521f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe1e800640 1 -- 172.21.15.59:0/1063022357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 msgr2=0x55fe5223d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe1e800640 1 --2- 172.21.15.59:0/1063022357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe5223d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe1e800640 1 -- 172.21.15.59:0/1063022357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe5223dc00 msgr2=0x55fe521f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe1e800640 1 --2- 172.21.15.59:0/1063022357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe5223dc00 0x55fe521f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe1e800640 1 -- 172.21.15.59:0/1063022357 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe520e9c20 con 0x55fe521f38e0 2024-04-25T09:05:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe1e800640 1 --2- 172.21.15.59:0/1063022357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 0x55fe521f3cc0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7efe18009f40 tx=0x7efe180077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc23d03ef5ede182 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe0ea00640 1 -- 172.21.15.59:0/1063022357 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe180137d0 con 0x55fe521f38e0 2024-04-25T09:05:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe0ea00640 1 -- 172.21.15.59:0/1063022357 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe18019070 con 0x55fe521f38e0 2024-04-25T09:05:48.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe0ea00640 1 -- 172.21.15.59:0/1063022357 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18013bb0 con 0x55fe521f38e0 2024-04-25T09:05:48.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 -- 172.21.15.59:0/1063022357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 msgr2=0x55fe521f3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 --2- 172.21.15.59:0/1063022357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 0x55fe521f3cc0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7efe18009f40 tx=0x7efe180077c0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 -- 172.21.15.59:0/1063022357 shutdown_connections 2024-04-25T09:05:48.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 --2- 172.21.15.59:0/1063022357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 0x55fe521f3cc0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 --2- 172.21.15.59:0/1063022357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe5223dc00 0x55fe521f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 --2- 172.21.15.59:0/1063022357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe5223d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 -- 172.21.15.59:0/1063022357 >> 172.21.15.59:0/1063022357 conn(0x55fe521ef890 msgr2=0x55fe521f1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 -- 172.21.15.59:0/1063022357 shutdown_connections 2024-04-25T09:05:48.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 -- 172.21.15.59:0/1063022357 wait complete. 2024-04-25T09:05:48.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 -- start start 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.189+0000 7efe282e5000 1 Processor -- start 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe521f38e0 0x55fe52244640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe5223d2e0 0x55fe52244b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe5223dc00 0x55fe5222b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe5203c130 con 0x55fe5223d2e0 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe52004130 con 0x55fe5223dc00 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe520fe300 con 0x55fe521f38e0 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 10 client.0 _ll_register_callbacks cb 0x55fe521debc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe17e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe5223d2e0 0x55fe52244b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe17e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe5223d2e0 0x55fe52244b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:44992/0 (socket says 172.21.15.59:44992) 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe17e00640 1 -- 172.21.15.59:0/488399646 learned_addr learned my addr 172.21.15.59:0/488399646 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe1de00640 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe521f38e0 0x55fe52244640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe1e800640 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe5223dc00 0x55fe5222b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe17e00640 1 -- 172.21.15.59:0/488399646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe521f38e0 msgr2=0x55fe52244640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe17e00640 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe521f38e0 0x55fe52244640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe17e00640 1 -- 172.21.15.59:0/488399646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe5223dc00 msgr2=0x55fe5222b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe17e00640 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe5223dc00 0x55fe5222b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe17e00640 1 -- 172.21.15.59:0/488399646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe5201d060 con 0x55fe5223d2e0 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe17e00640 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe5223d2e0 0x55fe52244b80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7efe0801c4d0 tx=0x7efe080ee720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55db2bb3f8e11de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe03400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe03400640 1 -- 172.21.15.59:0/488399646 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080eebe0 con 0x55fe5223d2e0 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe03400640 1 -- 172.21.15.59:0/488399646 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7efe080eee40 con 0x55fe5223d2e0 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 -- 172.21.15.59:0/488399646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe18019070 con 0x55fe5223d2e0 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe03400640 1 -- 172.21.15.59:0/488399646 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe080f2d30 con 0x55fe5223d2e0 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 10 client.6567 fetch_fsmap learned FSMap version 40 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 -- 172.21.15.59:0/488399646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55fe51fe17c0 con 0x55fe5223d2e0 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe03400640 1 -- 172.21.15.59:0/488399646 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe18019070 con 0x55fe5223d2e0 2024-04-25T09:05:48.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe03400640 1 -- 172.21.15.59:0/488399646 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 40) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efe2006ebf0 con 0x55fe5223d2e0 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 10 client.6567 fetch_fsmap finished waiting for FSMap version 40 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 10 client.6567 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 20 client.6567 populate_metadata read hostname 'smithi059' 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55fe5222be30 0x55fe5222c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 4 client.6567 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 -- 172.21.15.59:0/488399646 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe51fdbcd0 con 0x55fe5222be30 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe1de00640 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55fe5222be30 0x55fe5222c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe1de00640 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55fe5222be30 0x55fe5222c210 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23a627d7d46b72a8 server_cookie=81348253b7e0b6b6 in_seq=0 out_seq=0 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe03400640 10 client.6567 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe03400640 1 -- 172.21.15.59:0/488399646 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fe51fdbcd0 con 0x55fe5222be30 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe03400640 10 client.6567 handle_command_reply: tid=0 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 client.6567 shutdown 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 -- 172.21.15.59:0/488399646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe5223d2e0 msgr2=0x55fe52244b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.193+0000 7efe282e5000 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe5223d2e0 0x55fe52244b80 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7efe0801c4d0 tx=0x7efe080ee720 comp rx=0 tx=0).stop 2024-04-25T09:05:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.197+0000 7efe282e5000 1 -- 172.21.15.59:0/488399646 shutdown_connections 2024-04-25T09:05:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.197+0000 7efe282e5000 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55fe5222be30 0x55fe5222c210 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.197+0000 7efe282e5000 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe5223dc00 0x55fe5222b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.197+0000 7efe282e5000 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe5223d2e0 0x55fe52244b80 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.197+0000 7efe03400640 0 client.6567 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.197+0000 7efe282e5000 1 --2- 172.21.15.59:0/488399646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe521f38e0 0x55fe52244640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.197+0000 7efe282e5000 1 -- 172.21.15.59:0/488399646 >> 172.21.15.59:0/488399646 conn(0x55fe521ef890 msgr2=0x55fe521f2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.197+0000 7efe282e5000 1 -- 172.21.15.59:0/488399646 shutdown_connections 2024-04-25T09:05:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.197+0000 7efe282e5000 1 -- 172.21.15.59:0/488399646 wait complete. 2024-04-25T09:05:48.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.197+0000 7efe282e5000 20 client.6567 trim_cache size 0 max 16384 2024-04-25T09:05:48.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 Processor -- start 2024-04-25T09:05:48.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 -- start start 2024-04-25T09:05:48.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe521ef890 0x55fe52299500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 0x55fe52299a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe52299f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe202009c0 con 0x55fe521f38e0 2024-04-25T09:05:48.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe20162650 con 0x55fe521ef890 2024-04-25T09:05:48.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe202003c0 con 0x55fe5223d2e0 2024-04-25T09:05:48.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe17e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 0x55fe52299a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe17e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 0x55fe52299a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45006/0 (socket says 172.21.15.59:45006) 2024-04-25T09:05:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe17e00640 1 -- 172.21.15.59:0/113604004 learned_addr learned my addr 172.21.15.59:0/113604004 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe1de00640 1 --2- 172.21.15.59:0/113604004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe521ef890 0x55fe52299500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe1e800640 1 --2- 172.21.15.59:0/113604004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe52299f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe17e00640 1 -- 172.21.15.59:0/113604004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 msgr2=0x55fe52299f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe17e00640 1 --2- 172.21.15.59:0/113604004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe52299f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe17e00640 1 -- 172.21.15.59:0/113604004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe521ef890 msgr2=0x55fe52299500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe17e00640 1 --2- 172.21.15.59:0/113604004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe521ef890 0x55fe52299500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe17e00640 1 -- 172.21.15.59:0/113604004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe51ffbfc0 con 0x55fe521f38e0 2024-04-25T09:05:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe17e00640 1 --2- 172.21.15.59:0/113604004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 0x55fe52299a40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7efe080eb040 tx=0x7efe080bf000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e6c13c91962d35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe0e000640 1 -- 172.21.15.59:0/113604004 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080ee540 con 0x55fe521f38e0 2024-04-25T09:05:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe0e000640 1 -- 172.21.15.59:0/113604004 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0811c1c0 con 0x55fe521f38e0 2024-04-25T09:05:48.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe0e000640 1 -- 172.21.15.59:0/113604004 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe080eee40 con 0x55fe521f38e0 2024-04-25T09:05:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 -- 172.21.15.59:0/113604004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 msgr2=0x55fe52299a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 --2- 172.21.15.59:0/113604004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 0x55fe52299a40 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7efe080eb040 tx=0x7efe080bf000 comp rx=0 tx=0).stop 2024-04-25T09:05:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 -- 172.21.15.59:0/113604004 shutdown_connections 2024-04-25T09:05:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 --2- 172.21.15.59:0/113604004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe52299f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 --2- 172.21.15.59:0/113604004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521f38e0 0x55fe52299a40 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 --2- 172.21.15.59:0/113604004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe521ef890 0x55fe52299500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 -- 172.21.15.59:0/113604004 >> 172.21.15.59:0/113604004 conn(0x55fe521f8ba0 msgr2=0x55fe5223c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 -- 172.21.15.59:0/113604004 shutdown_connections 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 -- 172.21.15.59:0/113604004 wait complete. 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 -- start start 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.209+0000 7efe282e5000 1 Processor -- start 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521ef890 0x55fe5229d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe521f38e0 0x55fe5229de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe522419b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe51fdae70 con 0x55fe521ef890 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe51fc8a50 con 0x55fe521f38e0 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fe5203f3a0 con 0x55fe5223d2e0 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 10 client.0 _ll_register_callbacks cb 0x55fe51fec240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe1de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521ef890 0x55fe5229d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe1de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521ef890 0x55fe5229d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45016/0 (socket says 172.21.15.59:45016) 2024-04-25T09:05:48.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe1de00640 1 -- 172.21.15.59:0/2672796691 learned_addr learned my addr 172.21.15.59:0/2672796691 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe17e00640 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe521f38e0 0x55fe5229de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe1de00640 1 -- 172.21.15.59:0/2672796691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 msgr2=0x55fe522419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe1e800640 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe522419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe1de00640 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe522419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe1de00640 1 -- 172.21.15.59:0/2672796691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe521f38e0 msgr2=0x55fe5229de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe1de00640 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe521f38e0 0x55fe5229de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe1de00640 1 -- 172.21.15.59:0/2672796691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fe520999e0 con 0x55fe521ef890 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe17e00640 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe521f38e0 0x55fe5229de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe1e800640 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe522419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe1de00640 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521ef890 0x55fe5229d930 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7efe10006cf0 tx=0x7efe10012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb860a80cc22e06d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe03400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe03400640 1 -- 172.21.15.59:0/2672796691 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1001b040 con 0x55fe521ef890 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe03400640 1 -- 172.21.15.59:0/2672796691 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7efe10014e00 con 0x55fe521ef890 2024-04-25T09:05:48.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 -- 172.21.15.59:0/2672796691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe0811c1c0 con 0x55fe521ef890 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe03400640 1 -- 172.21.15.59:0/2672796691 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe100291a0 con 0x55fe521ef890 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 10 client.6573 fetch_fsmap learned FSMap version 40 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 -- 172.21.15.59:0/2672796691 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55fe51fdf630 con 0x55fe521ef890 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe03400640 1 -- 172.21.15.59:0/2672796691 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0811c1c0 con 0x55fe521ef890 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe03400640 1 -- 172.21.15.59:0/2672796691 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 40) v1 ==== 3294+0+0 (secure 0 0 0) 0x7efe10029340 con 0x55fe521ef890 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 10 client.6573 fetch_fsmap finished waiting for FSMap version 40 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 10 client.6573 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 20 client.6573 populate_metadata read hostname 'smithi059' 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55fe5223dc00 0x55fe522a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 4 client.6573 mds_command: new command op to 6225 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 -- 172.21.15.59:0/2672796691 --> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55fe5204d5d0 con 0x55fe5223dc00 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe17e00640 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55fe5223dc00 0x55fe522a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe17e00640 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55fe5223dc00 0x55fe522a67a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=149c04844b697298 server_cookie=395375c14762cc89 in_seq=0 out_seq=0 2024-04-25T09:05:48.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe03400640 10 client.6573 ms_handle_connect on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:48.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe03400640 1 -- 172.21.15.59:0/2672796691 <== mds.0 v2:172.21.15.59:6834/686404516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fe5204d5d0 con 0x55fe5223dc00 2024-04-25T09:05:48.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe03400640 10 client.6573 handle_command_reply: tid=0 2024-04-25T09:05:48.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 client.6573 shutdown 2024-04-25T09:05:48.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 -- 172.21.15.59:0/2672796691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521ef890 msgr2=0x55fe5229d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521ef890 0x55fe5229d930 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7efe10006cf0 tx=0x7efe10012000 comp rx=0 tx=0).stop 2024-04-25T09:05:48.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 -- 172.21.15.59:0/2672796691 shutdown_connections 2024-04-25T09:05:48.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.59:6834/686404516,v1:172.21.15.59:6835/686404516] conn(0x55fe5223dc00 0x55fe522a67a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fe5223d2e0 0x55fe522419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fe521f38e0 0x55fe5229de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe03400640 0 client.6573 ms_handle_reset on v2:172.21.15.59:6834/686404516 2024-04-25T09:05:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 --2- 172.21.15.59:0/2672796691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fe521ef890 0x55fe5229d930 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.213+0000 7efe282e5000 1 -- 172.21.15.59:0/2672796691 >> 172.21.15.59:0/2672796691 conn(0x55fe521f8ba0 msgr2=0x55fe5223cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe282e5000 1 -- 172.21.15.59:0/2672796691 shutdown_connections 2024-04-25T09:05:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe282e5000 1 -- 172.21.15.59:0/2672796691 wait complete. 2024-04-25T09:05:48.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe282e5000 20 client.6573 trim_cache size 0 max 16384 2024-04-25T09:05:48.214 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:48.214 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-04-25T09:05:48.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe24e00640 1 -- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efdfc066f60 msgr2=0x7efdfc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe24e00640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efdfc066f60 0x7efdfc069420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efe1000ba30 tx=0x7efe10008040 comp rx=0 tx=0).stop 2024-04-25T09:05:48.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe24e00640 1 -- 172.21.15.59:0/1811456044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe20144120 msgr2=0x7efe200af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe24e00640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe20144120 0x7efe200af110 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7efe080ae040 tx=0x7efe08019230 comp rx=0 tx=0).stop 2024-04-25T09:05:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe24e00640 1 -- 172.21.15.59:0/1811456044 shutdown_connections 2024-04-25T09:05:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe24e00640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efdfc066f60 0x7efdfc069420 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe24e00640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe2015ee60 0x7efe200b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe24e00640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe20144120 0x7efe200af110 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe24e00640 1 --2- 172.21.15.59:0/1811456044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe200ccbf0 0x7efe200ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe24e00640 1 -- 172.21.15.59:0/1811456044 >> 172.21.15.59:0/1811456044 conn(0x7efe20067080 msgr2=0x7efe2015bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe24e00640 1 -- 172.21.15.59:0/1811456044 shutdown_connections 2024-04-25T09:05:48.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.217+0000 7efe24e00640 1 -- 172.21.15.59:0/1811456044 wait complete. 2024-04-25T09:05:48.228 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:05:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b52600640 1 Processor -- start 2024-04-25T09:05:48.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b52600640 1 -- start start 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b52600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b4c15a6c0 0x7f6b4c0ce550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b52600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6b4c0b4a10 0x7f6b4c0d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b52600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b4c0b5120 0x7f6b4c0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b52600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4c15e270 con 0x7f6b4c0b5120 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b52600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4c15f0d0 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b52600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c15e4c0 con 0x7f6b4c15a6c0 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b4be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b4c0b5120 0x7f6b4c0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b4be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b4c0b5120 0x7f6b4c0b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45020/0 (socket says 172.21.15.59:45020) 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b4be00640 1 -- 172.21.15.59:0/3612684372 learned_addr learned my addr 172.21.15.59:0/3612684372 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b42a00640 1 --2- 172.21.15.59:0/3612684372 >> v2:172.21.15.178:3300/0 conn(0x7f6b4c0b4a10 0x7f6b4c0d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b4b400640 1 --2- 172.21.15.59:0/3612684372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b4c15a6c0 0x7f6b4c0ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b4be00640 1 -- 172.21.15.59:0/3612684372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b4c15a6c0 msgr2=0x7f6b4c0ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b4be00640 1 --2- 172.21.15.59:0/3612684372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b4c15a6c0 0x7f6b4c0ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b4be00640 1 -- 172.21.15.59:0/3612684372 >> v2:172.21.15.178:3300/0 conn(0x7f6b4c0b4a10 msgr2=0x7f6b4c0d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b4be00640 1 --2- 172.21.15.59:0/3612684372 >> v2:172.21.15.178:3300/0 conn(0x7f6b4c0b4a10 0x7f6b4c0d0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.377+0000 7f6b4be00640 1 -- 172.21.15.59:0/3612684372 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c15e7a0 con 0x7f6b4c0b5120 2024-04-25T09:05:48.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b4be00640 1 --2- 172.21.15.59:0/3612684372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b4c0b5120 0x7f6b4c0b55b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c06f390 tx=0x7f6b4401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c93333ed60353b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b4aa00640 1 -- 172.21.15.59:0/3612684372 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4400b2d0 con 0x7f6b4c0b5120 2024-04-25T09:05:48.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b4aa00640 1 -- 172.21.15.59:0/3612684372 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4400b470 con 0x7f6b4c0b5120 2024-04-25T09:05:48.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b4aa00640 1 -- 172.21.15.59:0/3612684372 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b440a7aa0 con 0x7f6b4c0b5120 2024-04-25T09:05:48.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b52600640 1 -- 172.21.15.59:0/3612684372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b4c0b5120 msgr2=0x7f6b4c0b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b52600640 1 --2- 172.21.15.59:0/3612684372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b4c0b5120 0x7f6b4c0b55b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c06f390 tx=0x7f6b4401ebf0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b52600640 1 -- 172.21.15.59:0/3612684372 shutdown_connections 2024-04-25T09:05:48.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b52600640 1 --2- 172.21.15.59:0/3612684372 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b4c0b5120 0x7f6b4c0b55b0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b52600640 1 --2- 172.21.15.59:0/3612684372 >> v2:172.21.15.178:3300/0 conn(0x7f6b4c0b4a10 0x7f6b4c0d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b52600640 1 --2- 172.21.15.59:0/3612684372 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b4c15a6c0 0x7f6b4c0ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b52600640 1 -- 172.21.15.59:0/3612684372 >> 172.21.15.59:0/3612684372 conn(0x7f6b4c0b2400 msgr2=0x7f6b4c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b52600640 1 -- 172.21.15.59:0/3612684372 shutdown_connections 2024-04-25T09:05:48.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.381+0000 7f6b52600640 1 -- 172.21.15.59:0/3612684372 wait complete. 2024-04-25T09:05:48.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b52600640 1 Processor -- start 2024-04-25T09:05:48.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b52600640 1 -- start start 2024-04-25T09:05:48.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b52600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b4c0b4a10 0x7f6b4c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b52600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b4c0b5120 0x7f6b4c151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b52600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b4c15a6c0 0x7f6b4c0b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b52600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c072cc0 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b52600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c072b40 con 0x7f6b4c0b5120 2024-04-25T09:05:48.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b52600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c072e40 con 0x7f6b4c15a6c0 2024-04-25T09:05:48.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b4b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b4c0b4a10 0x7f6b4c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b4b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b4c0b4a10 0x7f6b4c150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45022/0 (socket says 172.21.15.59:45022) 2024-04-25T09:05:48.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b4b400640 1 -- 172.21.15.59:0/3547896086 learned_addr learned my addr 172.21.15.59:0/3547896086 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:48.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b42a00640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b4c0b5120 0x7f6b4c151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b4b400640 1 -- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b4c15a6c0 msgr2=0x7f6b4c0b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b4be00640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b4c15a6c0 0x7f6b4c0b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b4b400640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b4c15a6c0 0x7f6b4c0b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b4b400640 1 -- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b4c0b5120 msgr2=0x7f6b4c151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b4b400640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b4c0b5120 0x7f6b4c151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b4b400640 1 -- 172.21.15.59:0/3547896086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c1507a0 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b4be00640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b4c15a6c0 0x7f6b4c0b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b4b400640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b4c0b4a10 0x7f6b4c150260 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00d620 tx=0x7f6b3c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b43e00640 1 -- 172.21.15.59:0/3547896086 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00b620 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b43e00640 1 -- 172.21.15.59:0/3547896086 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c019070 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b43e00640 1 -- 172.21.15.59:0/3547896086 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00b9e0 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b52600640 1 -- 172.21.15.59:0/3547896086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c158030 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b52600640 1 -- 172.21.15.59:0/3547896086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c1585f0 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.385+0000 7f6b52600640 1 -- 172.21.15.59:0/3547896086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4c0745d0 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.389+0000 7f6b43e00640 1 -- 172.21.15.59:0/3547896086 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6b3c00bb80 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.389+0000 7f6b43e00640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6b28066f90 0x7f6b28069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.389+0000 7f6b43e00640 1 -- 172.21.15.59:0/3547896086 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f6b3c085600 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.389+0000 7f6b42a00640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6b28066f90 0x7f6b28069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:48.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.389+0000 7f6b42a00640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6b28066f90 0x7f6b28069450 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c157640 tx=0x7f6b34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:48.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.393+0000 7f6b43e00640 1 -- 172.21.15.59:0/3547896086 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6b3c056370 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 -- 172.21.15.59:0/3547896086 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6b4c06b7e0 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b43e00640 1 -- 172.21.15.59:0/3547896086 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f6b3c055c70 con 0x7f6b4c0b4a10 2024-04-25T09:05:48.584 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:48.584 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:05:48.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 -- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6b28066f90 msgr2=0x7f6b28069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6b28066f90 0x7f6b28069450 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c157640 tx=0x7f6b34008040 comp rx=0 tx=0).stop 2024-04-25T09:05:48.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 -- 172.21.15.59:0/3547896086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b4c0b4a10 msgr2=0x7f6b4c150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:48.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b4c0b4a10 0x7f6b4c150260 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00d620 tx=0x7f6b3c00dae0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 -- 172.21.15.59:0/3547896086 shutdown_connections 2024-04-25T09:05:48.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6b28066f90 0x7f6b28069450 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6b4c15a6c0 0x7f6b4c0b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6b4c0b5120 0x7f6b4c151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 --2- 172.21.15.59:0/3547896086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b4c0b4a10 0x7f6b4c150260 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:48.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 -- 172.21.15.59:0/3547896086 >> 172.21.15.59:0/3547896086 conn(0x7f6b4c0b2400 msgr2=0x7f6b4c1637a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:48.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 -- 172.21.15.59:0/3547896086 shutdown_connections 2024-04-25T09:05:48.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:48.593+0000 7f6b52600640 1 -- 172.21.15.59:0/3547896086 wait complete. 2024-04-25T09:05:48.607 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:05:48.607 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:05:48.607 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:48.690 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:05:48.785 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:05:48.786 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:05:48.786 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:48.794 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:05:48.794 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:48.843 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:49.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe780a00640 1 Processor -- start 2024-04-25T09:05:49.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe780a00640 1 -- start start 2024-04-25T09:05:49.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe780a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe77c161510 0x7fe77c143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe780a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c06d090 con 0x7fe77c070fe0 2024-04-25T09:05:49.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe780a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe77c071ad0 con 0x7fe77c1435c0 2024-04-25T09:05:49.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe780a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe77c162390 con 0x7fe77c161510 2024-04-25T09:05:49.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe771400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe77c161510 0x7fe77c143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe771400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe77c161510 0x7fe77c143080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45026/0 (socket says 172.21.15.59:45026) 2024-04-25T09:05:49.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe779e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe77c070fe0 0x7fe77c0713c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39870/0 (socket says 172.21.15.59:39870) 2024-04-25T09:05:49.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe771400640 1 -- 172.21.15.59:0/48645369 learned_addr learned my addr 172.21.15.59:0/48645369 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:49.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe771400640 1 -- 172.21.15.59:0/48645369 >> v1:172.21.15.178:6789/0 conn(0x7fe77c1435c0 legacy=0x7fe77c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:49.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe771400640 1 -- 172.21.15.59:0/48645369 >> v1:172.21.15.59:6789/0 conn(0x7fe77c070fe0 legacy=0x7fe77c0713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.041+0000 7fe771400640 1 -- 172.21.15.59:0/48645369 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c161af0 con 0x7fe77c161510 2024-04-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.045+0000 7fe771400640 1 --2- 172.21.15.59:0/48645369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77c161510 0x7fe77c143080 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe764009e50 tx=0x7fe76401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9afbe3b83259a75a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.045+0000 7fe779400640 1 -- 172.21.15.59:0/48645369 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7640a5880 con 0x7fe77c161510 2024-04-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.045+0000 7fe779400640 1 -- 172.21.15.59:0/48645369 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7640a5a20 con 0x7fe77c161510 2024-04-25T09:05:49.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.045+0000 7fe779400640 1 -- 172.21.15.59:0/48645369 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7640a5df0 con 0x7fe77c161510 2024-04-25T09:05:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.045+0000 7fe780a00640 1 -- 172.21.15.59:0/48645369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77c161510 msgr2=0x7fe77c143080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.045+0000 7fe780a00640 1 --2- 172.21.15.59:0/48645369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77c161510 0x7fe77c143080 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fe764009e50 tx=0x7fe76401c9c0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.045+0000 7fe780a00640 1 -- 172.21.15.59:0/48645369 shutdown_connections 2024-04-25T09:05:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.045+0000 7fe780a00640 1 --2- 172.21.15.59:0/48645369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77c161510 0x7fe77c143080 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.045+0000 7fe780a00640 1 -- 172.21.15.59:0/48645369 >> 172.21.15.59:0/48645369 conn(0x7fe77c0b3390 msgr2=0x7fe77c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.045+0000 7fe780a00640 1 -- 172.21.15.59:0/48645369 shutdown_connections 2024-04-25T09:05:49.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.045+0000 7fe780a00640 1 -- 172.21.15.59:0/48645369 wait complete. 2024-04-25T09:05:49.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe780a00640 1 Processor -- start 2024-04-25T09:05:49.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe780a00640 1 -- start start 2024-04-25T09:05:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe780a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77c070fe0 0x7fe77c138640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe780a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c1435c0 0x7fe77c160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe780a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c161510 0x7fe77c0cc480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe780a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c15ede0 con 0x7fe77c070fe0 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe780a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c15ec60 con 0x7fe77c161510 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe780a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0b0540 con 0x7fe77c1435c0 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe779e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77c070fe0 0x7fe77c138640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe779e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77c070fe0 0x7fe77c138640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45034/0 (socket says 172.21.15.59:45034) 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe779e00640 1 -- 172.21.15.59:0/4066629863 learned_addr learned my addr 172.21.15.59:0/4066629863 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe77a800640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c161510 0x7fe77c0cc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe779e00640 1 -- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c1435c0 msgr2=0x7fe77c160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe771400640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c1435c0 0x7fe77c160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe779e00640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c1435c0 0x7fe77c160810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe779e00640 1 -- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c161510 msgr2=0x7fe77c0cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe779e00640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c161510 0x7fe77c0cc480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe779e00640 1 -- 172.21.15.59:0/4066629863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c156960 con 0x7fe77c070fe0 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe77a800640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c161510 0x7fe77c0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:49.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe771400640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c1435c0 0x7fe77c160810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe779e00640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77c070fe0 0x7fe77c138640 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00c450 tx=0x7fe76c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe772a00640 1 -- 172.21.15.59:0/4066629863 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c018070 con 0x7fe77c070fe0 2024-04-25T09:05:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe772a00640 1 -- 172.21.15.59:0/4066629863 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76c007480 con 0x7fe77c070fe0 2024-04-25T09:05:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe772a00640 1 -- 172.21.15.59:0/4066629863 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76c0047f0 con 0x7fe77c070fe0 2024-04-25T09:05:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe780a00640 1 -- 172.21.15.59:0/4066629863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c156c40 con 0x7fe77c070fe0 2024-04-25T09:05:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe780a00640 1 -- 172.21.15.59:0/4066629863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c157200 con 0x7fe77c070fe0 2024-04-25T09:05:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.049+0000 7fe780a00640 1 -- 172.21.15.59:0/4066629863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c0745d0 con 0x7fe77c070fe0 2024-04-25T09:05:49.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.053+0000 7fe772a00640 1 -- 172.21.15.59:0/4066629863 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe76c01b070 con 0x7fe77c070fe0 2024-04-25T09:05:49.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.053+0000 7fe772a00640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe758066f60 0x7fe758069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.053+0000 7fe772a00640 1 -- 172.21.15.59:0/4066629863 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fe76c084500 con 0x7fe77c070fe0 2024-04-25T09:05:49.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.053+0000 7fe771400640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe758066f60 0x7fe758069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.053+0000 7fe771400640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe758066f60 0x7fe758069420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe7640ae000 tx=0x7fe7640a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.057+0000 7fe772a00640 1 -- 172.21.15.59:0/4066629863 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe77c06d090 con 0x7fe77c070fe0 2024-04-25T09:05:49.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.217+0000 7fe780a00640 1 -- 172.21.15.59:0/4066629863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe77c071780 con 0x7fe77c070fe0 2024-04-25T09:05:49.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.217+0000 7fe772a00640 1 -- 172.21.15.59:0/4066629863 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+17075 (secure 0 0 0) 0x7fe76c055270 con 0x7fe77c070fe0 2024-04-25T09:05:49.212 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:49.212 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":68,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:05:10.441583+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:35.130789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:35.714100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.221+0000 7fe780a00640 1 -- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe758066f60 msgr2=0x7fe758069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.221+0000 7fe780a00640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe758066f60 0x7fe758069420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fe7640ae000 tx=0x7fe7640a7070 comp rx=0 tx=0).stop 2024-04-25T09:05:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.221+0000 7fe780a00640 1 -- 172.21.15.59:0/4066629863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77c070fe0 msgr2=0x7fe77c138640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.221+0000 7fe780a00640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77c070fe0 0x7fe77c138640 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe76c00c450 tx=0x7fe76c00c910 comp rx=0 tx=0).stop 2024-04-25T09:05:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.221+0000 7fe780a00640 1 -- 172.21.15.59:0/4066629863 shutdown_connections 2024-04-25T09:05:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.221+0000 7fe780a00640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe758066f60 0x7fe758069420 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.221+0000 7fe780a00640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe77c161510 0x7fe77c0cc480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.221+0000 7fe780a00640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe77c1435c0 0x7fe77c160810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.221+0000 7fe780a00640 1 --2- 172.21.15.59:0/4066629863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe77c070fe0 0x7fe77c138640 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.221+0000 7fe780a00640 1 -- 172.21.15.59:0/4066629863 >> 172.21.15.59:0/4066629863 conn(0x7fe77c0b3390 msgr2=0x7fe77c141120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.221+0000 7fe780a00640 1 -- 172.21.15.59:0/4066629863 shutdown_connections 2024-04-25T09:05:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.221+0000 7fe780a00640 1 -- 172.21.15.59:0/4066629863 wait complete. 2024-04-25T09:05:49.233 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:35.130789+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:35.714100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:49.233 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:49.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f3ac00640 1 Processor -- start 2024-04-25T09:05:49.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f3ac00640 1 -- start start 2024-04-25T09:05:49.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f3ac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f34144120 0x7f0f3415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f3ac00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f340ccbf0 0x7f0f3415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f3ac00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3415bc40 con 0x7f0f3415ee60 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f3ac00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3415e490 con 0x7f0f340ccbf0 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f3ac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3415b3a0 con 0x7f0f34144120 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f2be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f340ccbf0 0x7f0f3415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f2be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f340ccbf0 0x7f0f3415e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45044/0 (socket says 172.21.15.59:45044) 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f2be00640 1 -- 172.21.15.59:0/1864667429 learned_addr learned my addr 172.21.15.59:0/1864667429 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f33e00640 1 --2- 172.21.15.59:0/1864667429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f34144120 0x7f0f3415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f2be00640 1 -- 172.21.15.59:0/1864667429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f34144120 msgr2=0x7f0f3415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f2be00640 1 --2- 172.21.15.59:0/1864667429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f34144120 0x7f0f3415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f2be00640 1 -- 172.21.15.59:0/1864667429 >> v1:172.21.15.178:6789/0 conn(0x7f0f3415ee60 legacy=0x7f0f340b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.389+0000 7f0f2be00640 1 -- 172.21.15.59:0/1864667429 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3415b680 con 0x7f0f340ccbf0 2024-04-25T09:05:49.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.393+0000 7f0f2be00640 1 --2- 172.21.15.59:0/1864667429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f340ccbf0 0x7f0f3415e920 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009870 tx=0x7f0f1c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b28d2d53db08fba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.393+0000 7f0f33400640 1 -- 172.21.15.59:0/1864667429 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c0b0070 con 0x7f0f340ccbf0 2024-04-25T09:05:49.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.393+0000 7f0f33400640 1 -- 172.21.15.59:0/1864667429 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c0ab600 con 0x7f0f340ccbf0 2024-04-25T09:05:49.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.393+0000 7f0f33400640 1 -- 172.21.15.59:0/1864667429 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c0ab9d0 con 0x7f0f340ccbf0 2024-04-25T09:05:49.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.393+0000 7f0f3ac00640 1 -- 172.21.15.59:0/1864667429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f340ccbf0 msgr2=0x7f0f3415e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.393+0000 7f0f3ac00640 1 --2- 172.21.15.59:0/1864667429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f340ccbf0 0x7f0f3415e920 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009870 tx=0x7f0f1c01c4d0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.393+0000 7f0f3ac00640 1 -- 172.21.15.59:0/1864667429 shutdown_connections 2024-04-25T09:05:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.393+0000 7f0f3ac00640 1 --2- 172.21.15.59:0/1864667429 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f340ccbf0 0x7f0f3415e920 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.393+0000 7f0f3ac00640 1 --2- 172.21.15.59:0/1864667429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f34144120 0x7f0f3415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.393+0000 7f0f3ac00640 1 -- 172.21.15.59:0/1864667429 >> 172.21.15.59:0/1864667429 conn(0x7f0f34067080 msgr2=0x7f0f3406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.393+0000 7f0f3ac00640 1 -- 172.21.15.59:0/1864667429 shutdown_connections 2024-04-25T09:05:49.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.393+0000 7f0f3ac00640 1 -- 172.21.15.59:0/1864667429 wait complete. 2024-04-25T09:05:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f3ac00640 1 Processor -- start 2024-04-25T09:05:49.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f3ac00640 1 -- start start 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f3ac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f340ccbf0 0x7f0f341fa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f3ac00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f34144120 0x7f0f340ae490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f3ac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3415ee60 0x7f0f340aac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f3ac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3406d450 con 0x7f0f3415ee60 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f3ac00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3406d2d0 con 0x7f0f34144120 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f3ac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3406d5d0 con 0x7f0f340ccbf0 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f38c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3415ee60 0x7f0f340aac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f33e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f340ccbf0 0x7f0f341fa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f38c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3415ee60 0x7f0f340aac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45056/0 (socket says 172.21.15.59:45056) 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f38c00640 1 -- 172.21.15.59:0/4219630573 learned_addr learned my addr 172.21.15.59:0/4219630573 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f2be00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f34144120 0x7f0f340ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f38c00640 1 -- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f340ccbf0 msgr2=0x7f0f341fa6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f38c00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f340ccbf0 0x7f0f341fa6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f38c00640 1 -- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f34144120 msgr2=0x7f0f340ae490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f38c00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f34144120 0x7f0f340ae490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f38c00640 1 -- 172.21.15.59:0/4219630573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f341fada0 con 0x7f0f3415ee60 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f38c00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3415ee60 0x7f0f340aac40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00c730 tx=0x7f0f2c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f30c00640 1 -- 172.21.15.59:0/4219630573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c003b80 con 0x7f0f3415ee60 2024-04-25T09:05:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f30c00640 1 -- 172.21.15.59:0/4219630573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f2c003d20 con 0x7f0f3415ee60 2024-04-25T09:05:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f30c00640 1 -- 172.21.15.59:0/4219630573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00aa30 con 0x7f0f3415ee60 2024-04-25T09:05:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f3ac00640 1 -- 172.21.15.59:0/4219630573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f341fb080 con 0x7f0f3415ee60 2024-04-25T09:05:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f3ac00640 1 -- 172.21.15.59:0/4219630573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f340ab180 con 0x7f0f3415ee60 2024-04-25T09:05:49.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.397+0000 7f0f3ac00640 1 -- 172.21.15.59:0/4219630573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f341fb530 con 0x7f0f3415ee60 2024-04-25T09:05:49.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.401+0000 7f0f30c00640 1 -- 172.21.15.59:0/4219630573 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0f2c00abd0 con 0x7f0f3415ee60 2024-04-25T09:05:49.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.401+0000 7f0f30c00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f10066f60 0x7f0f10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.401+0000 7f0f30c00640 1 -- 172.21.15.59:0/4219630573 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f0f2c084f60 con 0x7f0f3415ee60 2024-04-25T09:05:49.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.401+0000 7f0f33e00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f10066f60 0x7f0f10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.401+0000 7f0f33e00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f10066f60 0x7f0f10069420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009b60 tx=0x7f0f24009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.405+0000 7f0f30c00640 1 -- 172.21.15.59:0/4219630573 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0f2c055710 con 0x7f0f3415ee60 2024-04-25T09:05:49.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 -- 172.21.15.59:0/4219630573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f340745d0 con 0x7f0f3415ee60 2024-04-25T09:05:49.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f30c00640 1 -- 172.21.15.59:0/4219630573 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f2c0597b0 con 0x7f0f3415ee60 2024-04-25T09:05:49.565 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:05:49.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 -- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f10066f60 msgr2=0x7f0f10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f10066f60 0x7f0f10069420 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009b60 tx=0x7f0f24009190 comp rx=0 tx=0).stop 2024-04-25T09:05:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 -- 172.21.15.59:0/4219630573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3415ee60 msgr2=0x7f0f340aac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3415ee60 0x7f0f340aac40 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00c730 tx=0x7f0f2c00cbf0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 -- 172.21.15.59:0/4219630573 shutdown_connections 2024-04-25T09:05:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f10066f60 0x7f0f10069420 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3415ee60 0x7f0f340aac40 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f34144120 0x7f0f340ae490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 --2- 172.21.15.59:0/4219630573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f340ccbf0 0x7f0f341fa6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 -- 172.21.15.59:0/4219630573 >> 172.21.15.59:0/4219630573 conn(0x7f0f34067080 msgr2=0x7f0f340b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 -- 172.21.15.59:0/4219630573 shutdown_connections 2024-04-25T09:05:49.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.573+0000 7f0f3ac00640 1 -- 172.21.15.59:0/4219630573 wait complete. 2024-04-25T09:05:49.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:05:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.737+0000 7f0ddb800640 1 Processor -- start 2024-04-25T09:05:49.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.737+0000 7f0ddb800640 1 -- start start 2024-04-25T09:05:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.741+0000 7f0ddb800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dd4159320 0x7f0dd415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.741+0000 7f0ddb800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd415fc00 con 0x7f0dd406e4a0 2024-04-25T09:05:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.741+0000 7f0ddb800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd415fee0 con 0x7f0dd415f440 2024-04-25T09:05:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.741+0000 7f0ddb800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd406d640 con 0x7f0dd4159320 2024-04-25T09:05:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.741+0000 7f0dd8e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dd4159320 0x7f0dd415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.741+0000 7f0dd8e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0dd4159320 0x7f0dd415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45070/0 (socket says 172.21.15.59:45070) 2024-04-25T09:05:49.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.741+0000 7f0dd8e00640 1 -- 172.21.15.59:0/3226140717 learned_addr learned my addr 172.21.15.59:0/3226140717 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:49.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.741+0000 7f0dd8e00640 1 -- 172.21.15.59:0/3226140717 >> v1:172.21.15.178:6789/0 conn(0x7f0dd415f440 legacy=0x7f0dd406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.741+0000 7f0dd8e00640 1 -- 172.21.15.59:0/3226140717 >> v1:172.21.15.59:6789/0 conn(0x7f0dd406e4a0 legacy=0x7f0dd4071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.741+0000 7f0dd8e00640 1 -- 172.21.15.59:0/3226140717 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd41601c0 con 0x7f0dd4159320 2024-04-25T09:05:49.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.741+0000 7f0dd3e00640 1 -- 172.21.15.59:0/3226140717 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167285103 0 0) 0x7f0dd415fc00 con 0x7f0dd406e4a0 2024-04-25T09:05:49.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.741+0000 7f0dd8e00640 1 --2- 172.21.15.59:0/3226140717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd4159320 0x7f0dd415c9b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f0dd406d7c0 tx=0x7f0dc401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7681a0be96bf4b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0dd3e00640 1 -- 172.21.15.59:0/3226140717 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40ab620 con 0x7f0dd4159320 2024-04-25T09:05:49.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0dd3e00640 1 -- 172.21.15.59:0/3226140717 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc40b0070 con 0x7f0dd4159320 2024-04-25T09:05:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0dd3e00640 1 -- 172.21.15.59:0/3226140717 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40ab9e0 con 0x7f0dd4159320 2024-04-25T09:05:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 -- 172.21.15.59:0/3226140717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd4159320 msgr2=0x7f0dd415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 --2- 172.21.15.59:0/3226140717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd4159320 0x7f0dd415c9b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f0dd406d7c0 tx=0x7f0dc401c480 comp rx=0 tx=0).stop 2024-04-25T09:05:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 -- 172.21.15.59:0/3226140717 shutdown_connections 2024-04-25T09:05:49.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 --2- 172.21.15.59:0/3226140717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd4159320 0x7f0dd415c9b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 -- 172.21.15.59:0/3226140717 >> 172.21.15.59:0/3226140717 conn(0x7f0dd4067080 msgr2=0x7f0dd406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 -- 172.21.15.59:0/3226140717 shutdown_connections 2024-04-25T09:05:49.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 -- 172.21.15.59:0/3226140717 wait complete. 2024-04-25T09:05:49.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 Processor -- start 2024-04-25T09:05:49.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 -- start start 2024-04-25T09:05:49.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd406e4a0 0x7f0dd4158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dd4159320 0x7f0dd41429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dd415f440 0x7f0dd4142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd415f9a0 con 0x7f0dd406e4a0 2024-04-25T09:05:49.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd415f820 con 0x7f0dd415f440 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0ddb800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd4071980 con 0x7f0dd4159320 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0dd8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd406e4a0 0x7f0dd4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0dd8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd406e4a0 0x7f0dd4158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45084/0 (socket says 172.21.15.59:45084) 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0dd8e00640 1 -- 172.21.15.59:0/2648857436 learned_addr learned my addr 172.21.15.59:0/2648857436 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0dcbe00640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dd4159320 0x7f0dd41429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.745+0000 7f0dd9800640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dd415f440 0x7f0dd4142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd8e00640 1 -- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dd4159320 msgr2=0x7f0dd41429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd8e00640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dd4159320 0x7f0dd41429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd8e00640 1 -- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dd415f440 msgr2=0x7f0dd4142ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd8e00640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dd415f440 0x7f0dd4142ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd8e00640 1 -- 172.21.15.59:0/2648857436 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd40b3710 con 0x7f0dd406e4a0 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd9800640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dd415f440 0x7f0dd4142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd8e00640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd406e4a0 0x7f0dd4158040 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0dc401ab30 tx=0x7f0dc401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd1600640 1 -- 172.21.15.59:0/2648857436 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc40ba070 con 0x7f0dd406e4a0 2024-04-25T09:05:49.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd1600640 1 -- 172.21.15.59:0/2648857436 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc40abc50 con 0x7f0dd406e4a0 2024-04-25T09:05:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd1600640 1 -- 172.21.15.59:0/2648857436 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4004020 con 0x7f0dd406e4a0 2024-04-25T09:05:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0ddb800640 1 -- 172.21.15.59:0/2648857436 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd40b39f0 con 0x7f0dd406e4a0 2024-04-25T09:05:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0ddb800640 1 -- 172.21.15.59:0/2648857436 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd40b3fb0 con 0x7f0dd406e4a0 2024-04-25T09:05:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0ddb800640 1 -- 172.21.15.59:0/2648857436 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd40745d0 con 0x7f0dd406e4a0 2024-04-25T09:05:49.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd1600640 1 -- 172.21.15.59:0/2648857436 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0dc40041c0 con 0x7f0dd406e4a0 2024-04-25T09:05:49.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd1600640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0db0066f60 0x7f0db0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:49.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dd1600640 1 -- 172.21.15.59:0/2648857436 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f0dc411f3b0 con 0x7f0dd406e4a0 2024-04-25T09:05:49.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.749+0000 7f0dcbe00640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0db0066f60 0x7f0db0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:49.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.753+0000 7f0dcbe00640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0db0066f60 0x7f0db0069420 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4166680 tx=0x7f0dbc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:49.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.753+0000 7f0dd1600640 1 -- 172.21.15.59:0/2648857436 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0dc4016130 con 0x7f0dd406e4a0 2024-04-25T09:05:49.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.913+0000 7f0ddb800640 1 -- 172.21.15.59:0/2648857436 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0dd40cb810 con 0x7f0dd406e4a0 2024-04-25T09:05:49.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.913+0000 7f0dd1600640 1 -- 172.21.15.59:0/2648857436 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0dc40044b0 con 0x7f0dd406e4a0 2024-04-25T09:05:49.907 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:05:49.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.917+0000 7f0ddb800640 1 -- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0db0066f60 msgr2=0x7f0db0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.917+0000 7f0ddb800640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0db0066f60 0x7f0db0069420 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4166680 tx=0x7f0dbc009040 comp rx=0 tx=0).stop 2024-04-25T09:05:49.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.917+0000 7f0ddb800640 1 -- 172.21.15.59:0/2648857436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd406e4a0 msgr2=0x7f0dd4158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:49.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.917+0000 7f0ddb800640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd406e4a0 0x7f0dd4158040 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f0dc401ab30 tx=0x7f0dc401acc0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.917+0000 7f0ddb800640 1 -- 172.21.15.59:0/2648857436 shutdown_connections 2024-04-25T09:05:49.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.917+0000 7f0ddb800640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0db0066f60 0x7f0db0069420 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.917+0000 7f0ddb800640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0dd415f440 0x7f0dd4142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.917+0000 7f0ddb800640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0dd4159320 0x7f0dd41429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.917+0000 7f0ddb800640 1 --2- 172.21.15.59:0/2648857436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0dd406e4a0 0x7f0dd4158040 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:49.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.917+0000 7f0ddb800640 1 -- 172.21.15.59:0/2648857436 >> 172.21.15.59:0/2648857436 conn(0x7f0dd4067080 msgr2=0x7f0dd406dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:49.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.917+0000 7f0ddb800640 1 -- 172.21.15.59:0/2648857436 shutdown_connections 2024-04-25T09:05:49.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:49.917+0000 7f0ddb800640 1 -- 172.21.15.59:0/2648857436 wait complete. 2024-04-25T09:05:49.928 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:05:50.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d7a600640 1 Processor -- start 2024-04-25T09:05:50.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d7a600640 1 -- start start 2024-04-25T09:05:50.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d7a600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0d74071270 0x7f0d740716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d7a600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7415efe0 con 0x7f0d7415eb50 2024-04-25T09:05:50.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d7a600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d7406db20 con 0x7f0d7415e770 2024-04-25T09:05:50.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d7a600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d74071be0 con 0x7f0d74071270 2024-04-25T09:05:50.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d6aa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0d7415eb50 0x7f0d7415f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39882/0 (socket says 172.21.15.59:39882) 2024-04-25T09:05:50.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d6aa00640 1 -- 172.21.15.59:0/1984043204 learned_addr learned my addr 172.21.15.59:0/1984043204 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:50.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d73e00640 1 --2- 172.21.15.59:0/1984043204 >> v2:172.21.15.178:3300/0 conn(0x7f0d74071270 0x7f0d740716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d72a00640 1 -- 172.21.15.59:0/1984043204 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1496878341 0 0) 0x7f0d7415efe0 con 0x7f0d7415eb50 2024-04-25T09:05:50.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d72a00640 1 -- 172.21.15.59:0/1984043204 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d58003530 con 0x7f0d7415eb50 2024-04-25T09:05:50.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d72a00640 1 -- 172.21.15.59:0/1984043204 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817110590 0 0) 0x7f0d7406db20 con 0x7f0d7415e770 2024-04-25T09:05:50.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d72a00640 1 -- 172.21.15.59:0/1984043204 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d7415efe0 con 0x7f0d7415e770 2024-04-25T09:05:50.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d73e00640 1 -- 172.21.15.59:0/1984043204 >> v1:172.21.15.178:6789/0 conn(0x7f0d7415e770 legacy=0x7f0d7406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d73e00640 1 -- 172.21.15.59:0/1984043204 >> v1:172.21.15.59:6789/0 conn(0x7f0d7415eb50 legacy=0x7f0d7415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.081+0000 7f0d73e00640 1 -- 172.21.15.59:0/1984043204 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7406de00 con 0x7f0d74071270 2024-04-25T09:05:50.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.085+0000 7f0d73e00640 1 --2- 172.21.15.59:0/1984043204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d74071270 0x7f0d740716a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009d90 tx=0x7f0d6c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efba9158c45256c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.085+0000 7f0d72a00640 1 -- 172.21.15.59:0/1984043204 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0b2070 con 0x7f0d74071270 2024-04-25T09:05:50.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.085+0000 7f0d72a00640 1 -- 172.21.15.59:0/1984043204 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0a59a0 con 0x7f0d74071270 2024-04-25T09:05:50.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.085+0000 7f0d72a00640 1 -- 172.21.15.59:0/1984043204 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0a5d50 con 0x7f0d74071270 2024-04-25T09:05:50.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.085+0000 7f0d7a600640 1 -- 172.21.15.59:0/1984043204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d74071270 msgr2=0x7f0d740716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.085+0000 7f0d7a600640 1 --2- 172.21.15.59:0/1984043204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d74071270 0x7f0d740716a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c009d90 tx=0x7f0d6c01c8e0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.085+0000 7f0d7a600640 1 -- 172.21.15.59:0/1984043204 shutdown_connections 2024-04-25T09:05:50.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.085+0000 7f0d7a600640 1 --2- 172.21.15.59:0/1984043204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d74071270 0x7f0d740716a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.085+0000 7f0d7a600640 1 -- 172.21.15.59:0/1984043204 >> 172.21.15.59:0/1984043204 conn(0x7f0d74067080 msgr2=0x7f0d7406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.085+0000 7f0d7a600640 1 -- 172.21.15.59:0/1984043204 shutdown_connections 2024-04-25T09:05:50.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.085+0000 7f0d7a600640 1 -- 172.21.15.59:0/1984043204 wait complete. 2024-04-25T09:05:50.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d7a600640 1 Processor -- start 2024-04-25T09:05:50.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d7a600640 1 -- start start 2024-04-25T09:05:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d7a600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d74071270 0x7f0d74151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d7a600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d7415e770 0x7f0d7414b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d7a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7415eb50 0x7f0d7414e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d7a600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740aeef0 con 0x7f0d7415eb50 2024-04-25T09:05:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d7a600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740aed70 con 0x7f0d74071270 2024-04-25T09:05:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d7a600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d740af070 con 0x7f0d7415e770 2024-04-25T09:05:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d73e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7415eb50 0x7f0d7414e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d73400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d74071270 0x7f0d74151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d73e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7415eb50 0x7f0d7414e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45098/0 (socket says 172.21.15.59:45098) 2024-04-25T09:05:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d73e00640 1 -- 172.21.15.59:0/301657180 learned_addr learned my addr 172.21.15.59:0/301657180 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d73400640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d74071270 0x7f0d74151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:48124/0 (socket says 172.21.15.59:48124) 2024-04-25T09:05:50.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d6aa00640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d7415e770 0x7f0d7414b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d73e00640 1 -- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d7415e770 msgr2=0x7f0d7414b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d73e00640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d7415e770 0x7f0d7414b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d73e00640 1 -- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d74071270 msgr2=0x7f0d74151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d73e00640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d74071270 0x7f0d74151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d73e00640 1 -- 172.21.15.59:0/301657180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7414dcf0 con 0x7f0d7415eb50 2024-04-25T09:05:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d73400640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d74071270 0x7f0d74151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d73e00640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7415eb50 0x7f0d7414e160 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c01a510 tx=0x7f0d6c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d6be00640 1 -- 172.21.15.59:0/301657180 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0b2050 con 0x7f0d7415eb50 2024-04-25T09:05:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d6be00640 1 -- 172.21.15.59:0/301657180 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6c0be070 con 0x7f0d7415eb50 2024-04-25T09:05:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d6be00640 1 -- 172.21.15.59:0/301657180 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c0ada50 con 0x7f0d7415eb50 2024-04-25T09:05:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d7a600640 1 -- 172.21.15.59:0/301657180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d74150e20 con 0x7f0d7415eb50 2024-04-25T09:05:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d7a600640 1 -- 172.21.15.59:0/301657180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d7414bd50 con 0x7f0d7415eb50 2024-04-25T09:05:50.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.089+0000 7f0d7a600640 1 -- 172.21.15.59:0/301657180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d740745d0 con 0x7f0d7415eb50 2024-04-25T09:05:50.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.093+0000 7f0d6be00640 1 -- 172.21.15.59:0/301657180 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0d6c0a5820 con 0x7f0d7415eb50 2024-04-25T09:05:50.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.093+0000 7f0d6be00640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0d50066f60 0x7f0d50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.093+0000 7f0d6be00640 1 -- 172.21.15.59:0/301657180 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f0d6c1201e0 con 0x7f0d7415eb50 2024-04-25T09:05:50.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.093+0000 7f0d73400640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0d50066f60 0x7f0d50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.093+0000 7f0d73400640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0d50066f60 0x7f0d50069420 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0d640011f0 tx=0x7f0d64009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.097+0000 7f0d6be00640 1 -- 172.21.15.59:0/301657180 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0d6c016560 con 0x7f0d7415eb50 2024-04-25T09:05:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.257+0000 7f0d7a600640 1 -- 172.21.15.59:0/301657180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d74158040 con 0x7f0d7415eb50 2024-04-25T09:05:50.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.257+0000 7f0d6be00640 1 -- 172.21.15.59:0/301657180 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d6c0f0900 con 0x7f0d7415eb50 2024-04-25T09:05:50.251 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:05:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.261+0000 7f0d7a600640 1 -- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0d50066f60 msgr2=0x7f0d50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.261+0000 7f0d7a600640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0d50066f60 0x7f0d50069420 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0d640011f0 tx=0x7f0d64009040 comp rx=0 tx=0).stop 2024-04-25T09:05:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.261+0000 7f0d7a600640 1 -- 172.21.15.59:0/301657180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7415eb50 msgr2=0x7f0d7414e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.261+0000 7f0d7a600640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7415eb50 0x7f0d7414e160 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c01a510 tx=0x7f0d6c019680 comp rx=0 tx=0).stop 2024-04-25T09:05:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.261+0000 7f0d7a600640 1 -- 172.21.15.59:0/301657180 shutdown_connections 2024-04-25T09:05:50.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.261+0000 7f0d7a600640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0d50066f60 0x7f0d50069420 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.261+0000 7f0d7a600640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7415eb50 0x7f0d7414e160 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.261+0000 7f0d7a600640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0d7415e770 0x7f0d7414b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.261+0000 7f0d7a600640 1 --2- 172.21.15.59:0/301657180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0d74071270 0x7f0d74151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.261+0000 7f0d7a600640 1 -- 172.21.15.59:0/301657180 >> 172.21.15.59:0/301657180 conn(0x7f0d74067080 msgr2=0x7f0d74158730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.261+0000 7f0d7a600640 1 -- 172.21.15.59:0/301657180 shutdown_connections 2024-04-25T09:05:50.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.261+0000 7f0d7a600640 1 -- 172.21.15.59:0/301657180 wait complete. 2024-04-25T09:05:50.273 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:05:50.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.421+0000 7fe6eba00640 1 Processor -- start 2024-04-25T09:05:50.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6eba00640 1 -- start start 2024-04-25T09:05:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6eba00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe6e4159320 0x7fe6e415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6eba00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6e406e4a0 0x7fe6e406e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6eba00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6e415fc00 con 0x7fe6e415f440 2024-04-25T09:05:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6eba00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6e406ee50 con 0x7fe6e4159320 2024-04-25T09:05:50.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6eba00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e406d640 con 0x7fe6e406e4a0 2024-04-25T09:05:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6e9000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe6e4159320 0x7fe6e415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6e9a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6e406e4a0 0x7fe6e406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6e9000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe6e4159320 0x7fe6e415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:48128/0 (socket says 172.21.15.59:48128) 2024-04-25T09:05:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6e9000640 1 -- 172.21.15.59:0/4171736953 learned_addr learned my addr 172.21.15.59:0/4171736953 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6e9000640 1 -- 172.21.15.59:0/4171736953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6e406e4a0 msgr2=0x7fe6e406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6e9000640 1 --2- 172.21.15.59:0/4171736953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6e406e4a0 0x7fe6e406e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6e9000640 1 -- 172.21.15.59:0/4171736953 >> v1:172.21.15.178:6789/0 conn(0x7fe6e415f440 legacy=0x7fe6e406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.425+0000 7fe6e9000640 1 -- 172.21.15.59:0/4171736953 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e415fee0 con 0x7fe6e4159320 2024-04-25T09:05:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.429+0000 7fe6e9000640 1 --2- 172.21.15.59:0/4171736953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6e4159320 0x7fe6e415c9b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009870 tx=0x7fe6d401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9928a3e611d613b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.429+0000 7fe6e3e00640 1 -- 172.21.15.59:0/4171736953 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40aa600 con 0x7fe6e4159320 2024-04-25T09:05:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.429+0000 7fe6e3e00640 1 -- 172.21.15.59:0/4171736953 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d40af070 con 0x7fe6e4159320 2024-04-25T09:05:50.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.429+0000 7fe6e3e00640 1 -- 172.21.15.59:0/4171736953 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d40aa9c0 con 0x7fe6e4159320 2024-04-25T09:05:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.429+0000 7fe6eba00640 1 -- 172.21.15.59:0/4171736953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6e4159320 msgr2=0x7fe6e415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.429+0000 7fe6eba00640 1 --2- 172.21.15.59:0/4171736953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6e4159320 0x7fe6e415c9b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe6d4009870 tx=0x7fe6d401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.429+0000 7fe6eba00640 1 -- 172.21.15.59:0/4171736953 shutdown_connections 2024-04-25T09:05:50.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.429+0000 7fe6eba00640 1 --2- 172.21.15.59:0/4171736953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6e406e4a0 0x7fe6e406e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.429+0000 7fe6eba00640 1 --2- 172.21.15.59:0/4171736953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6e4159320 0x7fe6e415c9b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.429+0000 7fe6eba00640 1 -- 172.21.15.59:0/4171736953 >> 172.21.15.59:0/4171736953 conn(0x7fe6e4067080 msgr2=0x7fe6e406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.429+0000 7fe6eba00640 1 -- 172.21.15.59:0/4171736953 shutdown_connections 2024-04-25T09:05:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.429+0000 7fe6eba00640 1 -- 172.21.15.59:0/4171736953 wait complete. 2024-04-25T09:05:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6eba00640 1 Processor -- start 2024-04-25T09:05:50.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6eba00640 1 -- start start 2024-04-25T09:05:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6eba00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6e406e4a0 0x7fe6e4157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6eba00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6e4159320 0x7fe6e41f67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6eba00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e415f440 0x7fe6e40af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6eba00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e415f820 con 0x7fe6e415f440 2024-04-25T09:05:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6eba00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e4159700 con 0x7fe6e406e4a0 2024-04-25T09:05:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6eba00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6e415f9a0 con 0x7fe6e4159320 2024-04-25T09:05:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e415f440 0x7fe6e40af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e415f440 0x7fe6e40af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45110/0 (socket says 172.21.15.59:45110) 2024-04-25T09:05:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e9a00640 1 -- 172.21.15.59:0/3139771199 learned_addr learned my addr 172.21.15.59:0/3139771199 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e9000640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6e406e4a0 0x7fe6e4157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6dbe00640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6e4159320 0x7fe6e41f67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e9a00640 1 -- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6e4159320 msgr2=0x7fe6e41f67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e9a00640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6e4159320 0x7fe6e41f67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e9a00640 1 -- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6e406e4a0 msgr2=0x7fe6e4157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e9a00640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6e406e4a0 0x7fe6e4157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e9a00640 1 -- 172.21.15.59:0/3139771199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6e40afbe0 con 0x7fe6e415f440 2024-04-25T09:05:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e9a00640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e415f440 0x7fe6e40af270 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00efc0 tx=0x7fe6dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e1600640 1 -- 172.21.15.59:0/3139771199 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc018020 con 0x7fe6e415f440 2024-04-25T09:05:50.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e1600640 1 -- 172.21.15.59:0/3139771199 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6dc014480 con 0x7fe6e415f440 2024-04-25T09:05:50.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6eba00640 1 -- 172.21.15.59:0/3139771199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6e40afec0 con 0x7fe6e415f440 2024-04-25T09:05:50.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6e1600640 1 -- 172.21.15.59:0/3139771199 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc014870 con 0x7fe6e415f440 2024-04-25T09:05:50.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6eba00640 1 -- 172.21.15.59:0/3139771199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6e40b2bf0 con 0x7fe6e415f440 2024-04-25T09:05:50.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.433+0000 7fe6eba00640 1 -- 172.21.15.59:0/3139771199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6e40745d0 con 0x7fe6e415f440 2024-04-25T09:05:50.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.437+0000 7fe6e1600640 1 -- 172.21.15.59:0/3139771199 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe6dc01b020 con 0x7fe6e415f440 2024-04-25T09:05:50.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.437+0000 7fe6e1600640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe6c0066f60 0x7fe6c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.437+0000 7fe6e1600640 1 -- 172.21.15.59:0/3139771199 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fe6dc085b70 con 0x7fe6e415f440 2024-04-25T09:05:50.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.437+0000 7fe6e9000640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe6c0066f60 0x7fe6c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.437+0000 7fe6e9000640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe6c0066f60 0x7fe6c0069420 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40ae000 tx=0x7fe6d40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.441+0000 7fe6e1600640 1 -- 172.21.15.59:0/3139771199 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe6dc022070 con 0x7fe6e415f440 2024-04-25T09:05:50.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 -- 172.21.15.59:0/3139771199 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe6e40cc510 con 0x7fe6e415f440 2024-04-25T09:05:50.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6e1600640 1 -- 172.21.15.59:0/3139771199 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v68) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe6dc010040 con 0x7fe6e415f440 2024-04-25T09:05:50.609 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:05:50.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 -- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe6c0066f60 msgr2=0x7fe6c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe6c0066f60 0x7fe6c0069420 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe6d40ae000 tx=0x7fe6d40a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:50.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 -- 172.21.15.59:0/3139771199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e415f440 msgr2=0x7fe6e40af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e415f440 0x7fe6e40af270 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc00efc0 tx=0x7fe6dc00c490 comp rx=0 tx=0).stop 2024-04-25T09:05:50.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 -- 172.21.15.59:0/3139771199 shutdown_connections 2024-04-25T09:05:50.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe6c0066f60 0x7fe6c0069420 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6e415f440 0x7fe6e40af270 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe6e4159320 0x7fe6e41f67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 --2- 172.21.15.59:0/3139771199 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6e406e4a0 0x7fe6e4157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 -- 172.21.15.59:0/3139771199 >> 172.21.15.59:0/3139771199 conn(0x7fe6e4067080 msgr2=0x7fe6e41427f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 -- 172.21.15.59:0/3139771199 shutdown_connections 2024-04-25T09:05:50.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.617+0000 7fe6eba00640 1 -- 172.21.15.59:0/3139771199 wait complete. 2024-04-25T09:05:50.631 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:05:50.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:50.631 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:05:50.682 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:05:50.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:05:50.683 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:05:50.702 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:05:50.702 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:50.712 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:05:50.713 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:05:50.713 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:50.757 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:05:50.757 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:05:50.757 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:05:50.766 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:05:50.766 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:50.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.945+0000 7fd6a2200640 1 Processor -- start 2024-04-25T09:05:50.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.945+0000 7fd6a2200640 1 -- start start 2024-04-25T09:05:50.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd6a2200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd69c09a600 0x7fd69c0cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd6a2200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69c0cf800 con 0x7fd69c0cf370 2024-04-25T09:05:50.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd6a2200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd69c0cfae0 con 0x7fd69c099a60 2024-04-25T09:05:50.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd6a2200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd69c0d0410 con 0x7fd69c09a600 2024-04-25T09:05:50.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd692a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd69c0cf370 0x7fd69c099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60450/0 (socket says 172.21.15.59:60450) 2024-04-25T09:05:50.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd692a00640 1 -- 172.21.15.59:0/3580989777 learned_addr learned my addr 172.21.15.59:0/3580989777 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69be00640 1 --2- 172.21.15.59:0/3580989777 >> v2:172.21.15.178:3300/0 conn(0x7fd69c09a600 0x7fd69c0cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986989197 0 0) 0x7fd69c0cf800 con 0x7fd69c0cf370 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd680003530 con 0x7fd69c0cf370 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1386052598 0 0) 0x7fd680003530 con 0x7fd69c0cf370 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 >> v2:172.21.15.178:3300/0 conn(0x7fd69c09a600 msgr2=0x7fd69c0cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 --2- 172.21.15.59:0/3580989777 >> v2:172.21.15.178:3300/0 conn(0x7fd69c09a600 0x7fd69c0cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 >> v1:172.21.15.178:6789/0 conn(0x7fd69c099a60 legacy=0x7fd69c15bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c0cfdc0 con 0x7fd69c0cf370 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fd684001680 con 0x7fd69c0cf370 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 >> v1:172.21.15.59:6789/0 conn(0x7fd69c0cf370 legacy=0x7fd69c099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6800039c0 0x7fd680003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd680004810 0x7fd680004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6800051d0 0x7fd68000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c0d0410 con 0x7fd6800039c0 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68000c170 con 0x7fd6800051d0 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68000c370 con 0x7fd680004810 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69be00640 1 --2- 172.21.15.59:0/3580989777 >> v2:172.21.15.178:3300/0 conn(0x7fd69c09a600 0x7fd69c0cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69b400640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6800039c0 0x7fd680003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd692a00640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd680004810 0x7fd680004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69be00640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6800051d0 0x7fd68000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69b400640 1 -- 172.21.15.59:0/3580989777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd680004810 msgr2=0x7fd680004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69b400640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd680004810 0x7fd680004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69b400640 1 -- 172.21.15.59:0/3580989777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6800051d0 msgr2=0x7fd68000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69b400640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6800051d0 0x7fd68000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69b400640 1 -- 172.21.15.59:0/3580989777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd680003530 con 0x7fd6800039c0 2024-04-25T09:05:50.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd692a00640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd680004810 0x7fd680004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69be00640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6800051d0 0x7fd68000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:50.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.949+0000 7fd69be00640 1 -- 172.21.15.59:0/3580989777 reap_dead start 2024-04-25T09:05:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.953+0000 7fd69b400640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6800039c0 0x7fd680003de0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd68c001e70 tx=0x7fd68c01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbb1569080baccc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.953+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c001a90 con 0x7fd6800039c0 2024-04-25T09:05:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.953+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68c003b80 con 0x7fd6800039c0 2024-04-25T09:05:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.953+0000 7fd69aa00640 1 -- 172.21.15.59:0/3580989777 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c0050d0 con 0x7fd6800039c0 2024-04-25T09:05:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.953+0000 7fd6a2200640 1 -- 172.21.15.59:0/3580989777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6800039c0 msgr2=0x7fd680003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.953+0000 7fd6a2200640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6800039c0 0x7fd680003de0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd68c001e70 tx=0x7fd68c01c730 comp rx=0 tx=0).stop 2024-04-25T09:05:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.953+0000 7fd6a2200640 1 -- 172.21.15.59:0/3580989777 shutdown_connections 2024-04-25T09:05:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.953+0000 7fd6a2200640 1 --2- 172.21.15.59:0/3580989777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd6800039c0 0x7fd680003de0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.953+0000 7fd6a2200640 1 -- 172.21.15.59:0/3580989777 >> 172.21.15.59:0/3580989777 conn(0x7fd69c0d17a0 msgr2=0x7fd69c0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.953+0000 7fd6a2200640 1 -- 172.21.15.59:0/3580989777 shutdown_connections 2024-04-25T09:05:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.953+0000 7fd6a2200640 1 -- 172.21.15.59:0/3580989777 wait complete. 2024-04-25T09:05:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.953+0000 7fd6a2200640 1 Processor -- start 2024-04-25T09:05:50.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd6a2200640 1 -- start start 2024-04-25T09:05:50.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd6a2200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6800039c0 0x7fd69c0c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd6a2200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd69c0c8870 0x7fd69c154ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd6a2200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69c06cd70 0x7fd69c06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd6a2200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c15bf50 con 0x7fd69c06cd70 2024-04-25T09:05:50.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd6a2200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c15bdd0 con 0x7fd6800039c0 2024-04-25T09:05:50.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd6a2200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69c15c0d0 con 0x7fd69c0c8870 2024-04-25T09:05:50.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd69be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69c06cd70 0x7fd69c06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd69be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69c06cd70 0x7fd69c06d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43174/0 (socket says 172.21.15.59:43174) 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd69be00640 1 -- 172.21.15.59:0/2062420160 learned_addr learned my addr 172.21.15.59:0/2062420160 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd692a00640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd69c0c8870 0x7fd69c154ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd69b400640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6800039c0 0x7fd69c0c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd69be00640 1 -- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd69c0c8870 msgr2=0x7fd69c154ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd69be00640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd69c0c8870 0x7fd69c154ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd69be00640 1 -- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6800039c0 msgr2=0x7fd69c0c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd69be00640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6800039c0 0x7fd69c0c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd69be00640 1 -- 172.21.15.59:0/2062420160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c15cf90 con 0x7fd69c06cd70 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd692a00640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd69c0c8870 0x7fd69c154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd69b400640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6800039c0 0x7fd69c0c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd69be00640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69c06cd70 0x7fd69c06d1f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0d2350 tx=0x7fd694011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd693e00640 1 -- 172.21.15.59:0/2062420160 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694004440 con 0x7fd69c06cd70 2024-04-25T09:05:50.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd693e00640 1 -- 172.21.15.59:0/2062420160 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69401c070 con 0x7fd69c06cd70 2024-04-25T09:05:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd693e00640 1 -- 172.21.15.59:0/2062420160 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694003820 con 0x7fd69c06cd70 2024-04-25T09:05:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd6a2200640 1 -- 172.21.15.59:0/2062420160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69c0c90c0 con 0x7fd69c06cd70 2024-04-25T09:05:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd6a2200640 1 -- 172.21.15.59:0/2062420160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69c0c9680 con 0x7fd69c06cd70 2024-04-25T09:05:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.957+0000 7fd6a2200640 1 -- 172.21.15.59:0/2062420160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69c06d730 con 0x7fd69c06cd70 2024-04-25T09:05:50.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.961+0000 7fd693e00640 1 -- 172.21.15.59:0/2062420160 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd6940039c0 con 0x7fd69c06cd70 2024-04-25T09:05:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.961+0000 7fd693e00640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd678066f60 0x7fd678069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.961+0000 7fd693e00640 1 -- 172.21.15.59:0/2062420160 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fd694085560 con 0x7fd69c06cd70 2024-04-25T09:05:50.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.961+0000 7fd69b400640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd678066f60 0x7fd678069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:50.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.961+0000 7fd69b400640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd678066f60 0x7fd678069420 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0ad000 tx=0x7fd68c001520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:50.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:50.965+0000 7fd693e00640 1 -- 172.21.15.59:0/2062420160 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd6940562d0 con 0x7fd69c06cd70 2024-04-25T09:05:51.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.157+0000 7fd6a2200640 1 -- 172.21.15.59:0/2062420160 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd69c0745d0 con 0x7fd69c06cd70 2024-04-25T09:05:51.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.157+0000 7fd693e00640 1 -- 172.21.15.59:0/2062420160 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4937 (secure 0 0 0) 0x7fd694055bd0 con 0x7fd69c06cd70 2024-04-25T09:05:51.152 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:51.152 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":40,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2580922028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2580922028},{"type":"v1","addr":"172.21.15.178:6837","nonce":2580922028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/126805970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":126805970},{"type":"v1","addr":"172.21.15.178:6836","nonce":126805970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/402319604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":402319604},{"type":"v1","addr":"172.21.15.59:6833","nonce":402319604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:36.727681+0000","modified":"2024-04-25T09:05:25.370357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6835/686404516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":686404516},{"type":"v1","addr":"172.21.15.59:6835","nonce":686404516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:05:51.152 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 40 2024-04-25T09:05:51.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.161+0000 7fd6a2200640 1 -- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd678066f60 msgr2=0x7fd678069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.161+0000 7fd6a2200640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd678066f60 0x7fd678069420 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0ad000 tx=0x7fd68c001520 comp rx=0 tx=0).stop 2024-04-25T09:05:51.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.161+0000 7fd6a2200640 1 -- 172.21.15.59:0/2062420160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69c06cd70 msgr2=0x7fd69c06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.161+0000 7fd6a2200640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69c06cd70 0x7fd69c06d1f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0d2350 tx=0x7fd694011a60 comp rx=0 tx=0).stop 2024-04-25T09:05:51.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.161+0000 7fd6a2200640 1 -- 172.21.15.59:0/2062420160 shutdown_connections 2024-04-25T09:05:51.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.161+0000 7fd6a2200640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd678066f60 0x7fd678069420 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.161+0000 7fd6a2200640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69c06cd70 0x7fd69c06d1f0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.161+0000 7fd6a2200640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd69c0c8870 0x7fd69c154ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.161+0000 7fd6a2200640 1 --2- 172.21.15.59:0/2062420160 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd6800039c0 0x7fd69c0c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.161+0000 7fd6a2200640 1 -- 172.21.15.59:0/2062420160 >> 172.21.15.59:0/2062420160 conn(0x7fd69c0d17a0 msgr2=0x7fd69c159dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.161+0000 7fd6a2200640 1 -- 172.21.15.59:0/2062420160 shutdown_connections 2024-04-25T09:05:51.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.161+0000 7fd6a2200640 1 -- 172.21.15.59:0/2062420160 wait complete. 2024-04-25T09:05:51.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:51.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.321+0000 7f7599200640 1 Processor -- start 2024-04-25T09:05:51.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.321+0000 7f7599200640 1 -- start start 2024-04-25T09:05:51.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.321+0000 7f7599200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f75940cef30 0x7f759406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.321+0000 7f7599200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f759406e900 0x7f75940b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.321+0000 7f7599200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f759415ac60 con 0x7f7594144140 2024-04-25T09:05:51.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.321+0000 7f7599200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f759406ed50 con 0x7f759406e900 2024-04-25T09:05:51.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.321+0000 7f7599200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75940cf3e0 con 0x7f75940cef30 2024-04-25T09:05:51.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.321+0000 7f7591e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7594144140 0x7f75940ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60460/0 (socket says 172.21.15.59:60460) 2024-04-25T09:05:51.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.321+0000 7f7591e00640 1 -- 172.21.15.59:0/2605983730 learned_addr learned my addr 172.21.15.59:0/2605983730 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:51.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.321+0000 7f7592800640 1 --2- 172.21.15.59:0/2605983730 >> v2:172.21.15.59:3300/0 conn(0x7f759406e900 0x7f75940b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.321+0000 7f7589400640 1 --2- 172.21.15.59:0/2605983730 >> v2:172.21.15.178:3300/0 conn(0x7f75940cef30 0x7f759406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7591400640 1 -- 172.21.15.59:0/2605983730 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 800182559 0 0) 0x7f759415ac60 con 0x7f7594144140 2024-04-25T09:05:51.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7591400640 1 -- 172.21.15.59:0/2605983730 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7578003530 con 0x7f7594144140 2024-04-25T09:05:51.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7592800640 1 -- 172.21.15.59:0/2605983730 >> v2:172.21.15.178:3300/0 conn(0x7f75940cef30 msgr2=0x7f759406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7592800640 1 --2- 172.21.15.59:0/2605983730 >> v2:172.21.15.178:3300/0 conn(0x7f75940cef30 0x7f759406e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7592800640 1 -- 172.21.15.59:0/2605983730 >> v1:172.21.15.59:6789/0 conn(0x7f7594144140 legacy=0x7f75940ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7592800640 1 -- 172.21.15.59:0/2605983730 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759415af20 con 0x7f759406e900 2024-04-25T09:05:51.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7592800640 1 --2- 172.21.15.59:0/2605983730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759406e900 0x7f75940b0760 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f759406efb0 tx=0x7f758c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283af52acc804a59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7591400640 1 -- 172.21.15.59:0/2605983730 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0b0070 con 0x7f759406e900 2024-04-25T09:05:51.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7591400640 1 -- 172.21.15.59:0/2605983730 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f758c0ab600 con 0x7f759406e900 2024-04-25T09:05:51.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7591400640 1 -- 172.21.15.59:0/2605983730 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f758c0ab9d0 con 0x7f759406e900 2024-04-25T09:05:51.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7599200640 1 -- 172.21.15.59:0/2605983730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759406e900 msgr2=0x7f75940b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7599200640 1 --2- 172.21.15.59:0/2605983730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759406e900 0x7f75940b0760 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f759406efb0 tx=0x7f758c01c480 comp rx=0 tx=0).stop 2024-04-25T09:05:51.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7599200640 1 -- 172.21.15.59:0/2605983730 shutdown_connections 2024-04-25T09:05:51.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7599200640 1 --2- 172.21.15.59:0/2605983730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f759406e900 0x7f75940b0760 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7599200640 1 --2- 172.21.15.59:0/2605983730 >> v2:172.21.15.178:3300/0 conn(0x7f75940cef30 0x7f759406e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7599200640 1 -- 172.21.15.59:0/2605983730 >> 172.21.15.59:0/2605983730 conn(0x7f7594066fa0 msgr2=0x7f759406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7599200640 1 -- 172.21.15.59:0/2605983730 shutdown_connections 2024-04-25T09:05:51.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.325+0000 7f7599200640 1 -- 172.21.15.59:0/2605983730 wait complete. 2024-04-25T09:05:51.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7599200640 1 Processor -- start 2024-04-25T09:05:51.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7599200640 1 -- start start 2024-04-25T09:05:51.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7599200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759406e900 0x7f759412ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7599200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75940cef30 0x7f7594139620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7599200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7594144140 0x7f7594139b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7599200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759415ba00 con 0x7f75940cef30 2024-04-25T09:05:51.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7599200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7594144520 con 0x7f759406e900 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7599200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759415bb80 con 0x7f7594144140 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7589400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75940cef30 0x7f7594139620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7589400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75940cef30 0x7f7594139620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43186/0 (socket says 172.21.15.59:43186) 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7589400640 1 -- 172.21.15.59:0/3452261741 learned_addr learned my addr 172.21.15.59:0/3452261741 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7589400640 1 -- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7594144140 msgr2=0x7f7594139b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7591e00640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759406e900 0x7f759412ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7589400640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7594144140 0x7f7594139b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7589400640 1 -- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759406e900 msgr2=0x7f759412ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7589400640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759406e900 0x7f759412ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7589400640 1 -- 172.21.15.59:0/3452261741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759413e080 con 0x7f75940cef30 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7591e00640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759406e900 0x7f759412ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7589400640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75940cef30 0x7f7594139620 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f757c00e930 tx=0x7f757c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f758aa00640 1 -- 172.21.15.59:0/3452261741 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c017070 con 0x7f75940cef30 2024-04-25T09:05:51.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f758aa00640 1 -- 172.21.15.59:0/3452261741 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c00ca00 con 0x7f75940cef30 2024-04-25T09:05:51.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f758aa00640 1 -- 172.21.15.59:0/3452261741 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c00cdb0 con 0x7f75940cef30 2024-04-25T09:05:51.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7599200640 1 -- 172.21.15.59:0/3452261741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75940b35b0 con 0x7f75940cef30 2024-04-25T09:05:51.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.329+0000 7f7599200640 1 -- 172.21.15.59:0/3452261741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75940b3b70 con 0x7f75940cef30 2024-04-25T09:05:51.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.333+0000 7f7599200640 1 -- 172.21.15.59:0/3452261741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75940745d0 con 0x7f75940cef30 2024-04-25T09:05:51.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.333+0000 7f758aa00640 1 -- 172.21.15.59:0/3452261741 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f757c01a070 con 0x7f75940cef30 2024-04-25T09:05:51.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.333+0000 7f758aa00640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7570066f60 0x7f7570069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.333+0000 7f758aa00640 1 -- 172.21.15.59:0/3452261741 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f757c085270 con 0x7f75940cef30 2024-04-25T09:05:51.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.333+0000 7f7591e00640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7570066f60 0x7f7570069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.333+0000 7f7591e00640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7570066f60 0x7f7570069420 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7584005c10 tx=0x7f7584009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.337+0000 7f758aa00640 1 -- 172.21.15.59:0/3452261741 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f757c056130 con 0x7f75940cef30 2024-04-25T09:05:51.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.501+0000 7f7599200640 1 -- 172.21.15.59:0/3452261741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f759415dd40 con 0x7f75940cef30 2024-04-25T09:05:51.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.501+0000 7f758aa00640 1 -- 172.21.15.59:0/3452261741 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+17075 (secure 0 0 0) 0x7f757c055a30 con 0x7f75940cef30 2024-04-25T09:05:51.495 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:51.496 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":68,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:05:10.441583+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:35.130789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:35.714100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.505+0000 7f7599200640 1 -- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7570066f60 msgr2=0x7f7570069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.505+0000 7f7599200640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7570066f60 0x7f7570069420 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7584005c10 tx=0x7f7584009040 comp rx=0 tx=0).stop 2024-04-25T09:05:51.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.505+0000 7f7599200640 1 -- 172.21.15.59:0/3452261741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75940cef30 msgr2=0x7f7594139620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.505+0000 7f7599200640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75940cef30 0x7f7594139620 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f757c00e930 tx=0x7f757c00edf0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.505+0000 7f7599200640 1 -- 172.21.15.59:0/3452261741 shutdown_connections 2024-04-25T09:05:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.505+0000 7f7599200640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7570066f60 0x7f7570069420 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.505+0000 7f7599200640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7594144140 0x7f7594139b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.505+0000 7f7599200640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75940cef30 0x7f7594139620 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.505+0000 7f7599200640 1 --2- 172.21.15.59:0/3452261741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f759406e900 0x7f759412ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.505+0000 7f7599200640 1 -- 172.21.15.59:0/3452261741 >> 172.21.15.59:0/3452261741 conn(0x7f7594066fa0 msgr2=0x7f759415be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.505+0000 7f7599200640 1 -- 172.21.15.59:0/3452261741 shutdown_connections 2024-04-25T09:05:51.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.505+0000 7f7599200640 1 -- 172.21.15.59:0/3452261741 wait complete. 2024-04-25T09:05:51.516 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:04:35.130789+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:04:35.714100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:51.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:51.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.669+0000 7f6a54600640 1 Processor -- start 2024-04-25T09:05:51.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.669+0000 7f6a54600640 1 -- start start 2024-04-25T09:05:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.669+0000 7f6a54600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6a4c159320 0x7f6a4c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.669+0000 7f6a54600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a4c06e4a0 0x7f6a4c06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.669+0000 7f6a54600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4c15fc00 con 0x7f6a4c15f440 2024-04-25T09:05:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.669+0000 7f6a54600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c06d640 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.669+0000 7f6a54600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c06ee10 con 0x7f6a4c159320 2024-04-25T09:05:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a51200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6a4c15f440 0x7f6a4c06dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60462/0 (socket says 172.21.15.59:60462) 2024-04-25T09:05:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a52600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6a4c06e4a0 0x7f6a4c06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a51200640 1 -- 172.21.15.59:0/3611366747 learned_addr learned my addr 172.21.15.59:0/3611366747 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:51.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a51c00640 1 --2- 172.21.15.59:0/3611366747 >> v2:172.21.15.178:3300/0 conn(0x7f6a4c159320 0x7f6a4c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a52600640 1 -- 172.21.15.59:0/3611366747 >> v2:172.21.15.178:3300/0 conn(0x7f6a4c159320 msgr2=0x7f6a4c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a52600640 1 --2- 172.21.15.59:0/3611366747 >> v2:172.21.15.178:3300/0 conn(0x7f6a4c159320 0x7f6a4c15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a52600640 1 -- 172.21.15.59:0/3611366747 >> v1:172.21.15.59:6789/0 conn(0x7f6a4c15f440 legacy=0x7f6a4c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a52600640 1 -- 172.21.15.59:0/3611366747 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c15fee0 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a4be00640 1 -- 172.21.15.59:0/3611366747 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 736691127 0 0) 0x7f6a4c15fc00 con 0x7f6a4c15f440 2024-04-25T09:05:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a52600640 1 --2- 172.21.15.59:0/3611366747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e4a0 0x7f6a4c06e8d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c06e470 tx=0x7f6a4401c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600dbdfdcc334e8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a4be00640 1 -- 172.21.15.59:0/3611366747 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440b2070 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a4be00640 1 -- 172.21.15.59:0/3611366747 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a440a5930 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.673+0000 7f6a4be00640 1 -- 172.21.15.59:0/3611366747 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440a5d00 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 -- 172.21.15.59:0/3611366747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e4a0 msgr2=0x7f6a4c06e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 --2- 172.21.15.59:0/3611366747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e4a0 0x7f6a4c06e8d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c06e470 tx=0x7f6a4401c870 comp rx=0 tx=0).stop 2024-04-25T09:05:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 -- 172.21.15.59:0/3611366747 shutdown_connections 2024-04-25T09:05:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 --2- 172.21.15.59:0/3611366747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e4a0 0x7f6a4c06e8d0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 --2- 172.21.15.59:0/3611366747 >> v2:172.21.15.178:3300/0 conn(0x7f6a4c159320 0x7f6a4c15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 -- 172.21.15.59:0/3611366747 >> 172.21.15.59:0/3611366747 conn(0x7f6a4c067080 msgr2=0x7f6a4c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 -- 172.21.15.59:0/3611366747 shutdown_connections 2024-04-25T09:05:51.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 -- 172.21.15.59:0/3611366747 wait complete. 2024-04-25T09:05:51.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 Processor -- start 2024-04-25T09:05:51.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 -- start start 2024-04-25T09:05:51.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e4a0 0x7f6a4c0cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a4c159320 0x7f6a4c159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a4c15f440 0x7f6a4c13f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c15f860 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c159700 con 0x7f6a4c159320 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a54600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c15f9e0 con 0x7f6a4c15f440 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a51c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e4a0 0x7f6a4c0cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a51c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e4a0 0x7f6a4c0cccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43194/0 (socket says 172.21.15.59:43194) 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a51c00640 1 -- 172.21.15.59:0/781899190 learned_addr learned my addr 172.21.15.59:0/781899190 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a52600640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a4c15f440 0x7f6a4c13f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a51200640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a4c159320 0x7f6a4c159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a51c00640 1 -- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a4c15f440 msgr2=0x7f6a4c13f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a51c00640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a4c15f440 0x7f6a4c13f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a51c00640 1 -- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a4c159320 msgr2=0x7f6a4c159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a51c00640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a4c159320 0x7f6a4c159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.677+0000 7f6a51c00640 1 -- 172.21.15.59:0/781899190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0b0070 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.681+0000 7f6a51c00640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e4a0 0x7f6a4c0cccf0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000e930 tx=0x7f6a4000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.681+0000 7f6a49600640 1 -- 172.21.15.59:0/781899190 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a40017070 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.681+0000 7f6a49600640 1 -- 172.21.15.59:0/781899190 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4000ca00 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.681+0000 7f6a49600640 1 -- 172.21.15.59:0/781899190 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000cdb0 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.681+0000 7f6a54600640 1 -- 172.21.15.59:0/781899190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c0b0350 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.681+0000 7f6a54600640 1 -- 172.21.15.59:0/781899190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c0b0910 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.681+0000 7f6a54600640 1 -- 172.21.15.59:0/781899190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c0745d0 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.681+0000 7f6a49600640 1 -- 172.21.15.59:0/781899190 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6a4001a070 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.681+0000 7f6a49600640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a2c066f60 0x7f6a2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:51.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.681+0000 7f6a49600640 1 -- 172.21.15.59:0/781899190 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f6a40085590 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.681+0000 7f6a51200640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a2c066f60 0x7f6a2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:51.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.685+0000 7f6a51200640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a2c066f60 0x7f6a2c069420 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c143a90 tx=0x7f6a38007d60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:51.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.685+0000 7f6a49600640 1 -- 172.21.15.59:0/781899190 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6a40055e00 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 -- 172.21.15.59:0/781899190 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a4c15b5e0 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a49600640 1 -- 172.21.15.59:0/781899190 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a40059ea0 con 0x7f6a4c06e4a0 2024-04-25T09:05:51.844 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:05:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 -- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a2c066f60 msgr2=0x7f6a2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a2c066f60 0x7f6a2c069420 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c143a90 tx=0x7f6a38007d60 comp rx=0 tx=0).stop 2024-04-25T09:05:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 -- 172.21.15.59:0/781899190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e4a0 msgr2=0x7f6a4c0cccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e4a0 0x7f6a4c0cccf0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000e930 tx=0x7f6a4000edf0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 -- 172.21.15.59:0/781899190 shutdown_connections 2024-04-25T09:05:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a2c066f60 0x7f6a2c069420 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6a4c15f440 0x7f6a4c13f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6a4c159320 0x7f6a4c159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 --2- 172.21.15.59:0/781899190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e4a0 0x7f6a4c0cccf0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 -- 172.21.15.59:0/781899190 >> 172.21.15.59:0/781899190 conn(0x7f6a4c067080 msgr2=0x7f6a4c140660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 -- 172.21.15.59:0/781899190 shutdown_connections 2024-04-25T09:05:51.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:51.853+0000 7f6a54600640 1 -- 172.21.15.59:0/781899190 wait complete. 2024-04-25T09:05:51.866 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:05:52.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.017+0000 7f117b000640 1 Processor -- start 2024-04-25T09:05:52.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.017+0000 7f117b000640 1 -- start start 2024-04-25T09:05:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.017+0000 7f117b000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f117415c9b0 0x7f117406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.017+0000 7f117b000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117415fc00 con 0x7f1174159320 2024-04-25T09:05:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.017+0000 7f117b000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f117415fee0 con 0x7f117406e010 2024-04-25T09:05:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.017+0000 7f117b000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117406d640 con 0x7f117415c9b0 2024-04-25T09:05:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.017+0000 7f1173e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1174159320 0x7f117415f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60470/0 (socket says 172.21.15.59:60470) 2024-04-25T09:05:52.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.017+0000 7f1173e00640 1 -- 172.21.15.59:0/1594623648 learned_addr learned my addr 172.21.15.59:0/1594623648 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.017+0000 7f116b400640 1 --2- 172.21.15.59:0/1594623648 >> v2:172.21.15.178:3300/0 conn(0x7f117415c9b0 0x7f117406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.017+0000 7f1173400640 1 -- 172.21.15.59:0/1594623648 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865324522 0 0) 0x7f117415fc00 con 0x7f1174159320 2024-04-25T09:05:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.017+0000 7f1173400640 1 -- 172.21.15.59:0/1594623648 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1158003530 con 0x7f1174159320 2024-04-25T09:05:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.021+0000 7f1173400640 1 -- 172.21.15.59:0/1594623648 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399218495 0 0) 0x7f117415fee0 con 0x7f117406e010 2024-04-25T09:05:52.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.021+0000 7f1173400640 1 -- 172.21.15.59:0/1594623648 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f117415fc00 con 0x7f117406e010 2024-04-25T09:05:52.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.021+0000 7f1173400640 1 -- 172.21.15.59:0/1594623648 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2616824036 0 0) 0x7f1158003530 con 0x7f1174159320 2024-04-25T09:05:52.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.021+0000 7f116b400640 1 -- 172.21.15.59:0/1594623648 >> v1:172.21.15.178:6789/0 conn(0x7f117406e010 legacy=0x7f117406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.021+0000 7f116b400640 1 -- 172.21.15.59:0/1594623648 >> v1:172.21.15.59:6789/0 conn(0x7f1174159320 legacy=0x7f117415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.021+0000 7f116b400640 1 -- 172.21.15.59:0/1594623648 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11741601c0 con 0x7f117415c9b0 2024-04-25T09:05:52.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.021+0000 7f116b400640 1 --2- 172.21.15.59:0/1594623648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f117415c9b0 0x7f117406dad0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f115c0097c0 tx=0x7f115c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adb2249fde3f359c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.021+0000 7f1173400640 1 -- 172.21.15.59:0/1594623648 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0b0070 con 0x7f117415c9b0 2024-04-25T09:05:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.021+0000 7f1173400640 1 -- 172.21.15.59:0/1594623648 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c0ab400 con 0x7f117415c9b0 2024-04-25T09:05:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.021+0000 7f1173400640 1 -- 172.21.15.59:0/1594623648 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164001a00 con 0x7f117415c9b0 2024-04-25T09:05:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 -- 172.21.15.59:0/1594623648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f117415c9b0 msgr2=0x7f117406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 --2- 172.21.15.59:0/1594623648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f117415c9b0 0x7f117406dad0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f115c0097c0 tx=0x7f115c01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 -- 172.21.15.59:0/1594623648 shutdown_connections 2024-04-25T09:05:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 --2- 172.21.15.59:0/1594623648 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f117415c9b0 0x7f117406dad0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 -- 172.21.15.59:0/1594623648 >> 172.21.15.59:0/1594623648 conn(0x7f1174067080 msgr2=0x7f117406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 -- 172.21.15.59:0/1594623648 shutdown_connections 2024-04-25T09:05:52.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 -- 172.21.15.59:0/1594623648 wait complete. 2024-04-25T09:05:52.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 Processor -- start 2024-04-25T09:05:52.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 -- start start 2024-04-25T09:05:52.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f117406e010 0x7f117413ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1174159320 0x7f11741574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f117415c9b0 0x7f11740b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117406ed30 con 0x7f117406e010 2024-04-25T09:05:52.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117406ebb0 con 0x7f117415c9b0 2024-04-25T09:05:52.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f117b000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11741695a0 con 0x7f1174159320 2024-04-25T09:05:52.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f1173e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f117406e010 0x7f117413ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f1173e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f117406e010 0x7f117413ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43202/0 (socket says 172.21.15.59:43202) 2024-04-25T09:05:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f1173e00640 1 -- 172.21.15.59:0/2131977583 learned_addr learned my addr 172.21.15.59:0/2131977583 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f116b400640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1174159320 0x7f11741574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f1179000640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f117415c9b0 0x7f11740b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f1173e00640 1 -- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1174159320 msgr2=0x7f11741574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f1173e00640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1174159320 0x7f11741574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f1173e00640 1 -- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f117415c9b0 msgr2=0x7f11740b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f1173e00640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f117415c9b0 0x7f11740b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.025+0000 7f1173e00640 1 -- 172.21.15.59:0/2131977583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740b2700 con 0x7f117406e010 2024-04-25T09:05:52.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.029+0000 7f1173e00640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f117406e010 0x7f117413ab60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1164001f40 tx=0x7f116400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.029+0000 7f1170c00640 1 -- 172.21.15.59:0/2131977583 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164017070 con 0x7f117406e010 2024-04-25T09:05:52.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.029+0000 7f1170c00640 1 -- 172.21.15.59:0/2131977583 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1164012400 con 0x7f117406e010 2024-04-25T09:05:52.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.029+0000 7f1170c00640 1 -- 172.21.15.59:0/2131977583 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1164012870 con 0x7f117406e010 2024-04-25T09:05:52.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.029+0000 7f117b000640 1 -- 172.21.15.59:0/2131977583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11740b29e0 con 0x7f117406e010 2024-04-25T09:05:52.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.029+0000 7f117b000640 1 -- 172.21.15.59:0/2131977583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117413fbb0 con 0x7f117406e010 2024-04-25T09:05:52.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.029+0000 7f117b000640 1 -- 172.21.15.59:0/2131977583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11740745d0 con 0x7f117406e010 2024-04-25T09:05:52.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.029+0000 7f1170c00640 1 -- 172.21.15.59:0/2131977583 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f116401a070 con 0x7f117406e010 2024-04-25T09:05:52.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.029+0000 7f1170c00640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1150066f60 0x7f1150069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.029+0000 7f1170c00640 1 -- 172.21.15.59:0/2131977583 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f1164085250 con 0x7f117406e010 2024-04-25T09:05:52.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.029+0000 7f116b400640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1150066f60 0x7f1150069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.033+0000 7f116b400640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1150066f60 0x7f1150069420 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f115c0ad000 tx=0x7f115c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.033+0000 7f1170c00640 1 -- 172.21.15.59:0/2131977583 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1164055970 con 0x7f117406e010 2024-04-25T09:05:52.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.193+0000 7f117b000640 1 -- 172.21.15.59:0/2131977583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f117415b730 con 0x7f117406e010 2024-04-25T09:05:52.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f1170c00640 1 -- 172.21.15.59:0/2131977583 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v68) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1164059a10 con 0x7f117406e010 2024-04-25T09:05:52.188 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:05:52.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f117b000640 1 -- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1150066f60 msgr2=0x7f1150069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f117b000640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1150066f60 0x7f1150069420 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f115c0ad000 tx=0x7f115c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:05:52.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f117b000640 1 -- 172.21.15.59:0/2131977583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f117406e010 msgr2=0x7f117413ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f117b000640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f117406e010 0x7f117413ab60 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1164001f40 tx=0x7f116400a430 comp rx=0 tx=0).stop 2024-04-25T09:05:52.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f117b000640 1 -- 172.21.15.59:0/2131977583 shutdown_connections 2024-04-25T09:05:52.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f117b000640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1150066f60 0x7f1150069420 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f117b000640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f117415c9b0 0x7f11740b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f117b000640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1174159320 0x7f11741574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f117b000640 1 --2- 172.21.15.59:0/2131977583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f117406e010 0x7f117413ab60 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f117b000640 1 -- 172.21.15.59:0/2131977583 >> 172.21.15.59:0/2131977583 conn(0x7f1174067080 msgr2=0x7f11740cb810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:52.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f117b000640 1 -- 172.21.15.59:0/2131977583 shutdown_connections 2024-04-25T09:05:52.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.197+0000 7f117b000640 1 -- 172.21.15.59:0/2131977583 wait complete. 2024-04-25T09:05:52.210 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:05:52.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc2a00640 1 Processor -- start 2024-04-25T09:05:52.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc2a00640 1 -- start start 2024-04-25T09:05:52.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc2a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fadbc15dc60 0x7fadbc0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fadbc09a170 0x7fadbc0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc2a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadbc15e040 con 0x7fadbc06bf30 2024-04-25T09:05:52.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc2a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc0cff80 con 0x7fadbc09a170 2024-04-25T09:05:52.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc2a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc0d0260 con 0x7fadbc15dc60 2024-04-25T09:05:52.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc0a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fadbc09a170 0x7fadbc0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc0a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fadbc09a170 0x7fadbc0cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43218/0 (socket says 172.21.15.59:43218) 2024-04-25T09:05:52.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc0a00640 1 -- 172.21.15.59:0/3706754455 learned_addr learned my addr 172.21.15.59:0/3706754455 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:52.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadbbe00640 1 --2- 172.21.15.59:0/3706754455 >> v2:172.21.15.178:3300/0 conn(0x7fadbc15dc60 0x7fadbc0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc0a00640 1 -- 172.21.15.59:0/3706754455 >> v2:172.21.15.178:3300/0 conn(0x7fadbc15dc60 msgr2=0x7fadbc0d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:52.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc0a00640 1 --2- 172.21.15.59:0/3706754455 >> v2:172.21.15.178:3300/0 conn(0x7fadbc15dc60 0x7fadbc0d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc0a00640 1 -- 172.21.15.59:0/3706754455 >> v1:172.21.15.178:6789/0 conn(0x7fadbc06bf30 legacy=0x7fadbc099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:52.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.361+0000 7fadc0a00640 1 -- 172.21.15.59:0/3706754455 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc0d0540 con 0x7fadbc09a170 2024-04-25T09:05:52.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.365+0000 7fadc0a00640 1 --2- 172.21.15.59:0/3706754455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc09a170 0x7fadbc0cf8a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fadbc09a6b0 tx=0x7fadb401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3480c19b104b00f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.365+0000 7fadbb400640 1 -- 172.21.15.59:0/3706754455 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40a57b0 con 0x7fadbc09a170 2024-04-25T09:05:52.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.365+0000 7fadbb400640 1 -- 172.21.15.59:0/3706754455 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb40a5950 con 0x7fadbc09a170 2024-04-25T09:05:52.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.365+0000 7fadbb400640 1 -- 172.21.15.59:0/3706754455 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40a5d20 con 0x7fadbc09a170 2024-04-25T09:05:52.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.365+0000 7fadc2a00640 1 -- 172.21.15.59:0/3706754455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc09a170 msgr2=0x7fadbc0cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.365+0000 7fadc2a00640 1 --2- 172.21.15.59:0/3706754455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc09a170 0x7fadbc0cf8a0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fadbc09a6b0 tx=0x7fadb401c8f0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.365+0000 7fadc2a00640 1 -- 172.21.15.59:0/3706754455 shutdown_connections 2024-04-25T09:05:52.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.365+0000 7fadc2a00640 1 --2- 172.21.15.59:0/3706754455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc09a170 0x7fadbc0cf8a0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.365+0000 7fadc2a00640 1 --2- 172.21.15.59:0/3706754455 >> v2:172.21.15.178:3300/0 conn(0x7fadbc15dc60 0x7fadbc0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.365+0000 7fadc2a00640 1 -- 172.21.15.59:0/3706754455 >> 172.21.15.59:0/3706754455 conn(0x7fadbc0b3200 msgr2=0x7fadbc0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:52.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.365+0000 7fadc2a00640 1 -- 172.21.15.59:0/3706754455 shutdown_connections 2024-04-25T09:05:52.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.365+0000 7fadc2a00640 1 -- 172.21.15.59:0/3706754455 wait complete. 2024-04-25T09:05:52.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc2a00640 1 Processor -- start 2024-04-25T09:05:52.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc2a00640 1 -- start start 2024-04-25T09:05:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc2a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadbc06bf30 0x7fadbc1565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc2a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc09a170 0x7fadbc0caa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc15dc60 0x7fadbc155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc2a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0cc6f0 con 0x7fadbc15dc60 2024-04-25T09:05:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc2a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0cc570 con 0x7fadbc06bf30 2024-04-25T09:05:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc2a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0cc870 con 0x7fadbc09a170 2024-04-25T09:05:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc15dc60 0x7fadbc155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc15dc60 0x7fadbc155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43222/0 (socket says 172.21.15.59:43222) 2024-04-25T09:05:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc0a00640 1 -- 172.21.15.59:0/3788359520 learned_addr learned my addr 172.21.15.59:0/3788359520 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadb3400640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc09a170 0x7fadbc0caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadbbe00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadbc06bf30 0x7fadbc1565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc0a00640 1 -- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc09a170 msgr2=0x7fadbc0caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc0a00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc09a170 0x7fadbc0caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc0a00640 1 -- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadbc06bf30 msgr2=0x7fadbc1565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc0a00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadbc06bf30 0x7fadbc1565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc0a00640 1 -- 172.21.15.59:0/3788359520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc156cb0 con 0x7fadbc15dc60 2024-04-25T09:05:52.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc0a00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc15dc60 0x7fadbc155540 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fadb40af040 tx=0x7fadb4019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadb8c00640 1 -- 172.21.15.59:0/3788359520 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40bc020 con 0x7fadbc15dc60 2024-04-25T09:05:52.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadb8c00640 1 -- 172.21.15.59:0/3788359520 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb40b8670 con 0x7fadbc15dc60 2024-04-25T09:05:52.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadb8c00640 1 -- 172.21.15.59:0/3788359520 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadb40b8a60 con 0x7fadbc15dc60 2024-04-25T09:05:52.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc2a00640 1 -- 172.21.15.59:0/3788359520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadbc156f90 con 0x7fadbc15dc60 2024-04-25T09:05:52.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.369+0000 7fadc2a00640 1 -- 172.21.15.59:0/3788359520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadbc157550 con 0x7fadbc15dc60 2024-04-25T09:05:52.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.373+0000 7fadc2a00640 1 -- 172.21.15.59:0/3788359520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadbc155a80 con 0x7fadbc15dc60 2024-04-25T09:05:52.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.373+0000 7fadb8c00640 1 -- 172.21.15.59:0/3788359520 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fadb40bf020 con 0x7fadbc15dc60 2024-04-25T09:05:52.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.373+0000 7fadb8c00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad98066f60 0x7fad98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.373+0000 7fadb8c00640 1 -- 172.21.15.59:0/3788359520 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fadb41206a0 con 0x7fadbc15dc60 2024-04-25T09:05:52.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.373+0000 7fadbbe00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad98066f60 0x7fad98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.373+0000 7fadbbe00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad98066f60 0x7fad98069420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fadbc09f560 tx=0x7fadac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.377+0000 7fadb8c00640 1 -- 172.21.15.59:0/3788359520 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fadb40c6030 con 0x7fadbc15dc60 2024-04-25T09:05:52.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.537+0000 7fadc2a00640 1 -- 172.21.15.59:0/3788359520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fadbc0745d0 con 0x7fadbc15dc60 2024-04-25T09:05:52.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.537+0000 7fadb8c00640 1 -- 172.21.15.59:0/3788359520 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v68) v1 ==== 100+0+11 (secure 0 0 0) 0x7fadb40165a0 con 0x7fadbc15dc60 2024-04-25T09:05:52.530 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:05:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.541+0000 7fadc2a00640 1 -- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad98066f60 msgr2=0x7fad98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.541+0000 7fadc2a00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad98066f60 0x7fad98069420 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fadbc09f560 tx=0x7fadac008040 comp rx=0 tx=0).stop 2024-04-25T09:05:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.541+0000 7fadc2a00640 1 -- 172.21.15.59:0/3788359520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc15dc60 msgr2=0x7fadbc155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.541+0000 7fadc2a00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc15dc60 0x7fadbc155540 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fadb40af040 tx=0x7fadb4019690 comp rx=0 tx=0).stop 2024-04-25T09:05:52.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.541+0000 7fadc2a00640 1 -- 172.21.15.59:0/3788359520 shutdown_connections 2024-04-25T09:05:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.541+0000 7fadc2a00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad98066f60 0x7fad98069420 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.541+0000 7fadc2a00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc15dc60 0x7fadbc155540 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.541+0000 7fadc2a00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc09a170 0x7fadbc0caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.541+0000 7fadc2a00640 1 --2- 172.21.15.59:0/3788359520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadbc06bf30 0x7fadbc1565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.541+0000 7fadc2a00640 1 -- 172.21.15.59:0/3788359520 >> 172.21.15.59:0/3788359520 conn(0x7fadbc0b3200 msgr2=0x7fadbc0ccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.541+0000 7fadc2a00640 1 -- 172.21.15.59:0/3788359520 shutdown_connections 2024-04-25T09:05:52.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.541+0000 7fadc2a00640 1 -- 172.21.15.59:0/3788359520 wait complete. 2024-04-25T09:05:52.552 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:52.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c3e00640 1 Processor -- start 2024-04-25T09:05:52.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c3e00640 1 -- start start 2024-04-25T09:05:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe4bc099a60 0x7fe4bc099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c3e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe4bc15ee00 0x7fe4bc06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c3e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4bc09a380 con 0x7fe4bc1616a0 2024-04-25T09:05:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c3e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4bc06c650 con 0x7fe4bc099a60 2024-04-25T09:05:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c3e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4bc06c930 con 0x7fe4bc15ee00 2024-04-25T09:05:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c1e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe4bc1616a0 0x7fe4bc161b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60486/0 (socket says 172.21.15.59:60486) 2024-04-25T09:05:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c1e00640 1 -- 172.21.15.59:0/1843215396 learned_addr learned my addr 172.21.15.59:0/1843215396 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c1400640 1 --2- 172.21.15.59:0/1843215396 >> v2:172.21.15.59:3300/0 conn(0x7fe4bc099a60 0x7fe4bc099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c0a00640 1 --2- 172.21.15.59:0/1843215396 >> v2:172.21.15.178:3300/0 conn(0x7fe4bc15ee00 0x7fe4bc06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c1400640 1 -- 172.21.15.59:0/1843215396 >> v2:172.21.15.178:3300/0 conn(0x7fe4bc15ee00 msgr2=0x7fe4bc06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c1400640 1 --2- 172.21.15.59:0/1843215396 >> v2:172.21.15.178:3300/0 conn(0x7fe4bc15ee00 0x7fe4bc06bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c1400640 1 -- 172.21.15.59:0/1843215396 >> v1:172.21.15.59:6789/0 conn(0x7fe4bc1616a0 legacy=0x7fe4bc161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c1400640 1 -- 172.21.15.59:0/1843215396 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc06cc10 con 0x7fe4bc099a60 2024-04-25T09:05:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.701+0000 7fe4c0a00640 1 --2- 172.21.15.59:0/1843215396 >> v2:172.21.15.178:3300/0 conn(0x7fe4bc15ee00 0x7fe4bc06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.705+0000 7fe4c1400640 1 --2- 172.21.15.59:0/1843215396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4bc099a60 0x7fe4bc099e40 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0ce1f0 tx=0x7fe4b001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78eaae870b6205d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.705+0000 7fe4bbe00640 1 -- 172.21.15.59:0/1843215396 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00b0070 con 0x7fe4bc099a60 2024-04-25T09:05:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.705+0000 7fe4bbe00640 1 -- 172.21.15.59:0/1843215396 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b00ab600 con 0x7fe4bc099a60 2024-04-25T09:05:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.705+0000 7fe4bbe00640 1 -- 172.21.15.59:0/1843215396 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00ab9d0 con 0x7fe4bc099a60 2024-04-25T09:05:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.705+0000 7fe4c3e00640 1 -- 172.21.15.59:0/1843215396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4bc099a60 msgr2=0x7fe4bc099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.705+0000 7fe4c3e00640 1 --2- 172.21.15.59:0/1843215396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4bc099a60 0x7fe4bc099e40 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0ce1f0 tx=0x7fe4b001c480 comp rx=0 tx=0).stop 2024-04-25T09:05:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.705+0000 7fe4c3e00640 1 -- 172.21.15.59:0/1843215396 shutdown_connections 2024-04-25T09:05:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.705+0000 7fe4c3e00640 1 --2- 172.21.15.59:0/1843215396 >> v2:172.21.15.178:3300/0 conn(0x7fe4bc15ee00 0x7fe4bc06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.705+0000 7fe4c3e00640 1 --2- 172.21.15.59:0/1843215396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4bc099a60 0x7fe4bc099e40 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.705+0000 7fe4c3e00640 1 -- 172.21.15.59:0/1843215396 >> 172.21.15.59:0/1843215396 conn(0x7fe4bc0d17a0 msgr2=0x7fe4bc0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.705+0000 7fe4c3e00640 1 -- 172.21.15.59:0/1843215396 shutdown_connections 2024-04-25T09:05:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.705+0000 7fe4c3e00640 1 -- 172.21.15.59:0/1843215396 wait complete. 2024-04-25T09:05:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c3e00640 1 Processor -- start 2024-04-25T09:05:52.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c3e00640 1 -- start start 2024-04-25T09:05:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4bc099a60 0x7fe4bc0c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4bc15ee00 0x7fe4bc160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c3e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4bc1616a0 0x7fe4bc0cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c3e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc06c3e0 con 0x7fe4bc099a60 2024-04-25T09:05:52.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c3e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc06c260 con 0x7fe4bc15ee00 2024-04-25T09:05:52.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c3e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4bc16b210 con 0x7fe4bc1616a0 2024-04-25T09:05:52.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4bc099a60 0x7fe4bc0c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4bc099a60 0x7fe4bc0c7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43248/0 (socket says 172.21.15.59:43248) 2024-04-25T09:05:52.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c1400640 1 -- 172.21.15.59:0/3560989857 learned_addr learned my addr 172.21.15.59:0/3560989857 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:52.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c1400640 1 -- 172.21.15.59:0/3560989857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4bc1616a0 msgr2=0x7fe4bc0cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c1400640 1 --2- 172.21.15.59:0/3560989857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4bc1616a0 0x7fe4bc0cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c1400640 1 -- 172.21.15.59:0/3560989857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4bc15ee00 msgr2=0x7fe4bc160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c1400640 1 --2- 172.21.15.59:0/3560989857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4bc15ee00 0x7fe4bc160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c1400640 1 -- 172.21.15.59:0/3560989857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc0c6f40 con 0x7fe4bc099a60 2024-04-25T09:05:52.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c1400640 1 --2- 172.21.15.59:0/3560989857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4bc099a60 0x7fe4bc0c7cc0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe4b001a0b0 tx=0x7fe4b001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4b9600640 1 -- 172.21.15.59:0/3560989857 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00b0050 con 0x7fe4bc099a60 2024-04-25T09:05:52.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4b9600640 1 -- 172.21.15.59:0/3560989857 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b00bc070 con 0x7fe4bc099a60 2024-04-25T09:05:52.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4b9600640 1 -- 172.21.15.59:0/3560989857 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00b5a70 con 0x7fe4bc099a60 2024-04-25T09:05:52.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c3e00640 1 -- 172.21.15.59:0/3560989857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4bc0c5840 con 0x7fe4bc099a60 2024-04-25T09:05:52.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c3e00640 1 -- 172.21.15.59:0/3560989857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4bc0c74c0 con 0x7fe4bc099a60 2024-04-25T09:05:52.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.709+0000 7fe4c3e00640 1 -- 172.21.15.59:0/3560989857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4bc0745d0 con 0x7fe4bc099a60 2024-04-25T09:05:52.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.713+0000 7fe4b9600640 1 -- 172.21.15.59:0/3560989857 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe4b00ab4c0 con 0x7fe4bc099a60 2024-04-25T09:05:52.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.713+0000 7fe4b9600640 1 --2- 172.21.15.59:0/3560989857 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe49c066f90 0x7fe49c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:52.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.713+0000 7fe4b9600640 1 -- 172.21.15.59:0/3560989857 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fe4b011fb80 con 0x7fe4bc099a60 2024-04-25T09:05:52.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.713+0000 7fe4c0a00640 1 --2- 172.21.15.59:0/3560989857 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe49c066f90 0x7fe49c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:52.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.713+0000 7fe4c0a00640 1 --2- 172.21.15.59:0/3560989857 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe49c066f90 0x7fe49c069450 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc06c000 tx=0x7fe4a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:52.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.717+0000 7fe4b9600640 1 -- 172.21.15.59:0/3560989857 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe4b0016070 con 0x7fe4bc099a60 2024-04-25T09:05:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.913+0000 7fe4c3e00640 1 -- 172.21.15.59:0/3560989857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4bc09ae10 con 0x7fe4bc099a60 2024-04-25T09:05:52.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.913+0000 7fe4b9600640 1 -- 172.21.15.59:0/3560989857 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4937 (secure 0 0 0) 0x7fe4b00f0980 con 0x7fe4bc099a60 2024-04-25T09:05:52.906 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:52.906 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":40,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2580922028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2580922028},{"type":"v1","addr":"172.21.15.178:6837","nonce":2580922028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/126805970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":126805970},{"type":"v1","addr":"172.21.15.178:6836","nonce":126805970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/402319604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":402319604},{"type":"v1","addr":"172.21.15.59:6833","nonce":402319604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:36.727681+0000","modified":"2024-04-25T09:05:25.370357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6835/686404516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":686404516},{"type":"v1","addr":"172.21.15.59:6835","nonce":686404516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:05:52.906 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 40 2024-04-25T09:05:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.913+0000 7fe4c3e00640 1 -- 172.21.15.59:0/3560989857 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe49c066f90 msgr2=0x7fe49c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.913+0000 7fe4c3e00640 1 --2- 172.21.15.59:0/3560989857 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe49c066f90 0x7fe49c069450 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc06c000 tx=0x7fe4a8008040 comp rx=0 tx=0).stop 2024-04-25T09:05:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.913+0000 7fe4c3e00640 1 -- 172.21.15.59:0/3560989857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4bc099a60 msgr2=0x7fe4bc0c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.913+0000 7fe4c3e00640 1 --2- 172.21.15.59:0/3560989857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4bc099a60 0x7fe4bc0c7cc0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe4b001a0b0 tx=0x7fe4b001acc0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.913+0000 7fe4c3e00640 1 -- 172.21.15.59:0/3560989857 shutdown_connections 2024-04-25T09:05:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.913+0000 7fe4c3e00640 1 --2- 172.21.15.59:0/3560989857 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe49c066f90 0x7fe49c069450 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.913+0000 7fe4c3e00640 1 --2- 172.21.15.59:0/3560989857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe4bc1616a0 0x7fe4bc0cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.913+0000 7fe4c3e00640 1 --2- 172.21.15.59:0/3560989857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4bc15ee00 0x7fe4bc160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.913+0000 7fe4c3e00640 1 --2- 172.21.15.59:0/3560989857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4bc099a60 0x7fe4bc0c7cc0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.913+0000 7fe4c3e00640 1 -- 172.21.15.59:0/3560989857 >> 172.21.15.59:0/3560989857 conn(0x7fe4bc0d17a0 msgr2=0x7fe4bc0ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.917+0000 7fe4c3e00640 1 -- 172.21.15.59:0/3560989857 shutdown_connections 2024-04-25T09:05:52.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:52.917+0000 7fe4c3e00640 1 -- 172.21.15.59:0/3560989857 wait complete. 2024-04-25T09:05:52.927 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bfc600640 1 Processor -- start 2024-04-25T09:05:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bfc600640 1 -- start start 2024-04-25T09:05:53.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bfc600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bf4070fe0 0x7f5bf4161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bfc600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf406d090 con 0x7f5bf4071830 2024-04-25T09:05:53.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bfc600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf4162390 con 0x7f5bf40713c0 2024-04-25T09:05:53.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bfc600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf4161af0 con 0x7f5bf4070fe0 2024-04-25T09:05:53.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bf9c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bf4070fe0 0x7f5bf4161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bfa600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5bf4071830 0x7f5bf415e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60502/0 (socket says 172.21.15.59:60502) 2024-04-25T09:05:53.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bfa600640 1 -- 172.21.15.59:0/4003072461 learned_addr learned my addr 172.21.15.59:0/4003072461 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:53.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bf9c00640 1 -- 172.21.15.59:0/4003072461 >> v1:172.21.15.178:6789/0 conn(0x7f5bf40713c0 legacy=0x7f5bf4143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:53.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bf9c00640 1 -- 172.21.15.59:0/4003072461 >> v1:172.21.15.59:6789/0 conn(0x7f5bf4071830 legacy=0x7f5bf415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bf3e00640 1 -- 172.21.15.59:0/4003072461 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476403918 0 0) 0x7f5bec0014a0 con 0x7f5bf4071830 2024-04-25T09:05:53.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.077+0000 7f5bf9c00640 1 -- 172.21.15.59:0/4003072461 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf4161dd0 con 0x7f5bf4070fe0 2024-04-25T09:05:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bf9c00640 1 --2- 172.21.15.59:0/4003072461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4070fe0 0x7f5bf4161510 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5be80097c0 tx=0x7f5be801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db9ba5e420fb1f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bf3e00640 1 -- 172.21.15.59:0/4003072461 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be80a7070 con 0x7f5bf4070fe0 2024-04-25T09:05:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bf3e00640 1 -- 172.21.15.59:0/4003072461 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be80b0070 con 0x7f5bf4070fe0 2024-04-25T09:05:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bf3e00640 1 -- 172.21.15.59:0/4003072461 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be80ab890 con 0x7f5bf4070fe0 2024-04-25T09:05:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bfc600640 1 -- 172.21.15.59:0/4003072461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4070fe0 msgr2=0x7f5bf4161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bfc600640 1 --2- 172.21.15.59:0/4003072461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4070fe0 0x7f5bf4161510 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f5be80097c0 tx=0x7f5be801c470 comp rx=0 tx=0).stop 2024-04-25T09:05:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bfc600640 1 -- 172.21.15.59:0/4003072461 shutdown_connections 2024-04-25T09:05:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bfc600640 1 --2- 172.21.15.59:0/4003072461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf4070fe0 0x7f5bf4161510 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bfc600640 1 -- 172.21.15.59:0/4003072461 >> 172.21.15.59:0/4003072461 conn(0x7f5bf40b3390 msgr2=0x7f5bf40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bfc600640 1 -- 172.21.15.59:0/4003072461 shutdown_connections 2024-04-25T09:05:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bfc600640 1 -- 172.21.15.59:0/4003072461 wait complete. 2024-04-25T09:05:53.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bfc600640 1 Processor -- start 2024-04-25T09:05:53.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.081+0000 7f5bfc600640 1 -- start start 2024-04-25T09:05:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bfc600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bf4070fe0 0x7f5bf4140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bfc600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf40713c0 0x7f5bf40cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bfc600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf4071830 0x7f5bf40cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bfc600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf415ede0 con 0x7f5bf40713c0 2024-04-25T09:05:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bfc600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf415ec60 con 0x7f5bf4070fe0 2024-04-25T09:05:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bfc600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf40b0540 con 0x7f5bf4071830 2024-04-25T09:05:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf9200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf40713c0 0x7f5bf40cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf9200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf40713c0 0x7f5bf40cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43278/0 (socket says 172.21.15.59:43278) 2024-04-25T09:05:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf9200640 1 -- 172.21.15.59:0/1329565126 learned_addr learned my addr 172.21.15.59:0/1329565126 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf9c00640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bf4070fe0 0x7f5bf4140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bfa600640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf4071830 0x7f5bf40cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf9200640 1 -- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf4071830 msgr2=0x7f5bf40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf9200640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf4071830 0x7f5bf40cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf9200640 1 -- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bf4070fe0 msgr2=0x7f5bf4140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf9200640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bf4070fe0 0x7f5bf4140050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf9200640 1 -- 172.21.15.59:0/1329565126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf4146350 con 0x7f5bf40713c0 2024-04-25T09:05:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bfa600640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf4071830 0x7f5bf40cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf9200640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf40713c0 0x7f5bf40cc360 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5be000c500 tx=0x7f5be000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf1600640 1 -- 172.21.15.59:0/1329565126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0016020 con 0x7f5bf40713c0 2024-04-25T09:05:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf1600640 1 -- 172.21.15.59:0/1329565126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be0005220 con 0x7f5bf40713c0 2024-04-25T09:05:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bf1600640 1 -- 172.21.15.59:0/1329565126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be0007030 con 0x7f5bf40713c0 2024-04-25T09:05:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bfc600640 1 -- 172.21.15.59:0/1329565126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf4146630 con 0x7f5bf40713c0 2024-04-25T09:05:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bfc600640 1 -- 172.21.15.59:0/1329565126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf4146bf0 con 0x7f5bf40713c0 2024-04-25T09:05:53.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.085+0000 7f5bfc600640 1 -- 172.21.15.59:0/1329565126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf40745d0 con 0x7f5bf40713c0 2024-04-25T09:05:53.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.089+0000 7f5bf1600640 1 -- 172.21.15.59:0/1329565126 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5be00071f0 con 0x7f5bf40713c0 2024-04-25T09:05:53.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.089+0000 7f5bf1600640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5bd4066f60 0x7f5bd4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.089+0000 7f5bf1600640 1 -- 172.21.15.59:0/1329565126 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f5be0084ba0 con 0x7f5bf40713c0 2024-04-25T09:05:53.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.089+0000 7f5bf9c00640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5bd4066f60 0x7f5bd4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.089+0000 7f5bf9c00640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5bd4066f60 0x7f5bd4069420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5be80af000 tx=0x7f5be80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.093+0000 7f5bf1600640 1 -- 172.21.15.59:0/1329565126 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5be0020020 con 0x7f5bf40713c0 2024-04-25T09:05:53.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:53.119 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:05:53.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 -- 172.21.15.59:0/1329565126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bf4158310 con 0x7f5bf40713c0 2024-04-25T09:05:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bf1600640 1 -- 172.21.15.59:0/1329565126 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+17075 (secure 0 0 0) 0x7f5be00559c0 con 0x7f5bf40713c0 2024-04-25T09:05:53.249 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:53.250 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":68,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:05:10.441583+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:35.130789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:35.714100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 -- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5bd4066f60 msgr2=0x7f5bd4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5bd4066f60 0x7f5bd4069420 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5be80af000 tx=0x7f5be80a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 -- 172.21.15.59:0/1329565126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf40713c0 msgr2=0x7f5bf40cc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf40713c0 0x7f5bf40cc360 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f5be000c500 tx=0x7f5be000c9c0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 -- 172.21.15.59:0/1329565126 shutdown_connections 2024-04-25T09:05:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5bd4066f60 0x7f5bd4069420 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bf4071830 0x7f5bf40cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf40713c0 0x7f5bf40cc360 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 --2- 172.21.15.59:0/1329565126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bf4070fe0 0x7f5bf4140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 -- 172.21.15.59:0/1329565126 >> 172.21.15.59:0/1329565126 conn(0x7f5bf40b3390 msgr2=0x7f5bf40cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 -- 172.21.15.59:0/1329565126 shutdown_connections 2024-04-25T09:05:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.257+0000 7f5bfc600640 1 -- 172.21.15.59:0/1329565126 wait complete. 2024-04-25T09:05:53.271 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:05:53.271 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.417+0000 7f94a8c00640 1 Processor -- start 2024-04-25T09:05:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.417+0000 7f94a8c00640 1 -- start start 2024-04-25T09:05:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f94a8c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f94a415da10 0x7f94a40afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f94a8c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94a40b4210 0x7f94a40b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f94a8c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94a40b4b60 con 0x7f94a40d11b0 2024-04-25T09:05:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f94a8c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a415ddf0 con 0x7f94a40b4210 2024-04-25T09:05:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f94a8c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94a406b480 con 0x7f94a415da10 2024-04-25T09:05:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f94a2800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94a40b4210 0x7f94a40b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f949be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f94a40d11b0 0x7f94a406ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60510/0 (socket says 172.21.15.59:60510) 2024-04-25T09:05:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f949be00640 1 -- 172.21.15.59:0/4058139718 learned_addr learned my addr 172.21.15.59:0/4058139718 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f94a1e00640 1 --2- 172.21.15.59:0/4058139718 >> v2:172.21.15.178:3300/0 conn(0x7f94a415da10 0x7f94a40afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f94a2800640 1 -- 172.21.15.59:0/4058139718 >> v2:172.21.15.178:3300/0 conn(0x7f94a415da10 msgr2=0x7f94a40afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f94a2800640 1 --2- 172.21.15.59:0/4058139718 >> v2:172.21.15.178:3300/0 conn(0x7f94a415da10 0x7f94a40afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f94a2800640 1 -- 172.21.15.59:0/4058139718 >> v1:172.21.15.59:6789/0 conn(0x7f94a40d11b0 legacy=0x7f94a406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.421+0000 7f94a2800640 1 -- 172.21.15.59:0/4058139718 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a40d06d0 con 0x7f94a40b4210 2024-04-25T09:05:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a2800640 1 --2- 172.21.15.59:0/4058139718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a40b4210 0x7f94a40b4620 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f94a40684f0 tx=0x7f949c01c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2442a78e1702c18a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a1400640 1 -- 172.21.15.59:0/4058139718 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0b2070 con 0x7f94a40b4210 2024-04-25T09:05:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a1400640 1 -- 172.21.15.59:0/4058139718 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c0a5850 con 0x7f94a40b4210 2024-04-25T09:05:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a1400640 1 -- 172.21.15.59:0/4058139718 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0a5c20 con 0x7f94a40b4210 2024-04-25T09:05:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a8c00640 1 -- 172.21.15.59:0/4058139718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a40b4210 msgr2=0x7f94a40b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a8c00640 1 --2- 172.21.15.59:0/4058139718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a40b4210 0x7f94a40b4620 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f94a40684f0 tx=0x7f949c01c8a0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a8c00640 1 -- 172.21.15.59:0/4058139718 shutdown_connections 2024-04-25T09:05:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a8c00640 1 --2- 172.21.15.59:0/4058139718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a40b4210 0x7f94a40b4620 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a8c00640 1 --2- 172.21.15.59:0/4058139718 >> v2:172.21.15.178:3300/0 conn(0x7f94a415da10 0x7f94a40afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a8c00640 1 -- 172.21.15.59:0/4058139718 >> 172.21.15.59:0/4058139718 conn(0x7f94a40b2400 msgr2=0x7f94a40b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a8c00640 1 -- 172.21.15.59:0/4058139718 shutdown_connections 2024-04-25T09:05:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a8c00640 1 -- 172.21.15.59:0/4058139718 wait complete. 2024-04-25T09:05:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a8c00640 1 Processor -- start 2024-04-25T09:05:53.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.425+0000 7f94a8c00640 1 -- start start 2024-04-25T09:05:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a8c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94a40b4210 0x7f94a41563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a8c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94a40d11b0 0x7f94a415f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a415da10 0x7f94a4146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a8c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a41621d0 con 0x7f94a415da10 2024-04-25T09:05:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a8c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94a4162050 con 0x7f94a40d11b0 2024-04-25T09:05:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a8c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94a4162350 con 0x7f94a40b4210 2024-04-25T09:05:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a415da10 0x7f94a4146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a415da10 0x7f94a4146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43290/0 (socket says 172.21.15.59:43290) 2024-04-25T09:05:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a2800640 1 -- 172.21.15.59:0/1713201146 learned_addr learned my addr 172.21.15.59:0/1713201146 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f949be00640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94a40d11b0 0x7f94a415f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a1e00640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94a40b4210 0x7f94a41563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a2800640 1 -- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94a40b4210 msgr2=0x7f94a41563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a2800640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94a40b4210 0x7f94a41563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a2800640 1 -- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94a40d11b0 msgr2=0x7f94a415f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a2800640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94a40d11b0 0x7f94a415f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a2800640 1 -- 172.21.15.59:0/1713201146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a41f6e20 con 0x7f94a415da10 2024-04-25T09:05:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a1e00640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94a40b4210 0x7f94a41563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a2800640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a415da10 0x7f94a4146bd0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f949c0b0040 tx=0x7f949c019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f949a000640 1 -- 172.21.15.59:0/1713201146 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0b2050 con 0x7f94a415da10 2024-04-25T09:05:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f949a000640 1 -- 172.21.15.59:0/1713201146 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f949c0be070 con 0x7f94a415da10 2024-04-25T09:05:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f949a000640 1 -- 172.21.15.59:0/1713201146 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f949c0adad0 con 0x7f94a415da10 2024-04-25T09:05:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a8c00640 1 -- 172.21.15.59:0/1713201146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94a41f7160 con 0x7f94a415da10 2024-04-25T09:05:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a8c00640 1 -- 172.21.15.59:0/1713201146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94a41f79a0 con 0x7f94a415da10 2024-04-25T09:05:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f94a8c00640 1 -- 172.21.15.59:0/1713201146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94a40745d0 con 0x7f94a415da10 2024-04-25T09:05:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.429+0000 7f949a000640 1 -- 172.21.15.59:0/1713201146 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f949c0a56d0 con 0x7f94a415da10 2024-04-25T09:05:53.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.433+0000 7f949a000640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9480066f60 0x7f9480069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.433+0000 7f949a000640 1 -- 172.21.15.59:0/1713201146 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f949c1203d0 con 0x7f94a415da10 2024-04-25T09:05:53.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.433+0000 7f94a1e00640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9480066f60 0x7f9480069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.433+0000 7f94a1e00640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9480066f60 0x7f9480069420 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f949400b9f0 tx=0x7f9494008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.437+0000 7f949a000640 1 -- 172.21.15.59:0/1713201146 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f94a41f7160 con 0x7f94a415da10 2024-04-25T09:05:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.633+0000 7f94a8c00640 1 -- 172.21.15.59:0/1713201146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94a4072860 con 0x7f94a415da10 2024-04-25T09:05:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f949a000640 1 -- 172.21.15.59:0/1713201146 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4937 (secure 0 0 0) 0x7f949c016520 con 0x7f94a415da10 2024-04-25T09:05:53.628 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:53.628 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":40,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2580922028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2580922028},{"type":"v1","addr":"172.21.15.178:6837","nonce":2580922028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/126805970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":126805970},{"type":"v1","addr":"172.21.15.178:6836","nonce":126805970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/402319604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":402319604},{"type":"v1","addr":"172.21.15.59:6833","nonce":402319604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:36.727681+0000","modified":"2024-04-25T09:05:25.370357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6835/686404516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":686404516},{"type":"v1","addr":"172.21.15.59:6835","nonce":686404516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:05:53.628 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 40 2024-04-25T09:05:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f94a8c00640 1 -- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9480066f60 msgr2=0x7f9480069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f94a8c00640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9480066f60 0x7f9480069420 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f949400b9f0 tx=0x7f9494008040 comp rx=0 tx=0).stop 2024-04-25T09:05:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f94a8c00640 1 -- 172.21.15.59:0/1713201146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a415da10 msgr2=0x7f94a4146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f94a8c00640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a415da10 0x7f94a4146bd0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f949c0b0040 tx=0x7f949c019640 comp rx=0 tx=0).stop 2024-04-25T09:05:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f94a8c00640 1 -- 172.21.15.59:0/1713201146 shutdown_connections 2024-04-25T09:05:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f94a8c00640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9480066f60 0x7f9480069420 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f94a8c00640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94a415da10 0x7f94a4146bd0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f94a8c00640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f94a40d11b0 0x7f94a415f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f94a8c00640 1 --2- 172.21.15.59:0/1713201146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f94a40b4210 0x7f94a41563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f94a8c00640 1 -- 172.21.15.59:0/1713201146 >> 172.21.15.59:0/1713201146 conn(0x7f94a40b2400 msgr2=0x7f94a415c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f94a8c00640 1 -- 172.21.15.59:0/1713201146 shutdown_connections 2024-04-25T09:05:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.637+0000 7f94a8c00640 1 -- 172.21.15.59:0/1713201146 wait complete. 2024-04-25T09:05:53.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:05:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.797+0000 7f2351200640 1 Processor -- start 2024-04-25T09:05:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.797+0000 7f2351200640 1 -- start start 2024-04-25T09:05:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.797+0000 7f2351200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234c144140 0x7f234c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.797+0000 7f2351200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f234c0ced60 0x7f234c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.797+0000 7f2351200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234c15ac60 con 0x7f234c06e900 2024-04-25T09:05:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.797+0000 7f2351200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c06ed70 con 0x7f234c0ced60 2024-04-25T09:05:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.797+0000 7f2351200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c0cf3e0 con 0x7f234c144140 2024-04-25T09:05:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.801+0000 7f2343e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f234c0ced60 0x7f234c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.801+0000 7f2343e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f234c0ced60 0x7f234c06e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43306/0 (socket says 172.21.15.59:43306) 2024-04-25T09:05:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.801+0000 7f2343e00640 1 -- 172.21.15.59:0/2491867690 learned_addr learned my addr 172.21.15.59:0/2491867690 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.801+0000 7f2349e00640 1 --2- 172.21.15.59:0/2491867690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234c144140 0x7f234c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.801+0000 7f2343e00640 1 -- 172.21.15.59:0/2491867690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234c144140 msgr2=0x7f234c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.801+0000 7f2343e00640 1 --2- 172.21.15.59:0/2491867690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234c144140 0x7f234c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.801+0000 7f2343e00640 1 -- 172.21.15.59:0/2491867690 >> v1:172.21.15.178:6789/0 conn(0x7f234c06e900 legacy=0x7f234c15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.801+0000 7f2343e00640 1 -- 172.21.15.59:0/2491867690 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c15af20 con 0x7f234c0ced60 2024-04-25T09:05:53.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.801+0000 7f2343e00640 1 --2- 172.21.15.59:0/2491867690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0ced60 0x7f234c06e3c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2334009870 tx=0x7f233401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa87f821ff77502 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.801+0000 7f2349400640 1 -- 172.21.15.59:0/2491867690 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340b0070 con 0x7f234c0ced60 2024-04-25T09:05:53.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.801+0000 7f2349400640 1 -- 172.21.15.59:0/2491867690 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23340ab600 con 0x7f234c0ced60 2024-04-25T09:05:53.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.801+0000 7f2349400640 1 -- 172.21.15.59:0/2491867690 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23340ab9d0 con 0x7f234c0ced60 2024-04-25T09:05:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 -- 172.21.15.59:0/2491867690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0ced60 msgr2=0x7f234c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 --2- 172.21.15.59:0/2491867690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0ced60 0x7f234c06e3c0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2334009870 tx=0x7f233401c560 comp rx=0 tx=0).stop 2024-04-25T09:05:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 -- 172.21.15.59:0/2491867690 shutdown_connections 2024-04-25T09:05:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 --2- 172.21.15.59:0/2491867690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c0ced60 0x7f234c06e3c0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 --2- 172.21.15.59:0/2491867690 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234c144140 0x7f234c0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 -- 172.21.15.59:0/2491867690 >> 172.21.15.59:0/2491867690 conn(0x7f234c066fa0 msgr2=0x7f234c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 -- 172.21.15.59:0/2491867690 shutdown_connections 2024-04-25T09:05:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 -- 172.21.15.59:0/2491867690 wait complete. 2024-04-25T09:05:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 Processor -- start 2024-04-25T09:05:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 -- start start 2024-04-25T09:05:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c06e900 0x7f234c138bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f234c0ced60 0x7f234c139970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234c144140 0x7f234c13edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c15ba00 con 0x7f234c06e900 2024-04-25T09:05:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234c144520 con 0x7f234c0ced60 2024-04-25T09:05:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2351200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f234c15bb80 con 0x7f234c144140 2024-04-25T09:05:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2349e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c06e900 0x7f234c138bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2349e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c06e900 0x7f234c138bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43322/0 (socket says 172.21.15.59:43322) 2024-04-25T09:05:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2349e00640 1 -- 172.21.15.59:0/3131427666 learned_addr learned my addr 172.21.15.59:0/3131427666 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2343e00640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f234c0ced60 0x7f234c139970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f234a800640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234c144140 0x7f234c13edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2349e00640 1 -- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234c144140 msgr2=0x7f234c13edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2349e00640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234c144140 0x7f234c13edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2349e00640 1 -- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f234c0ced60 msgr2=0x7f234c139970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2349e00640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f234c0ced60 0x7f234c139970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2349e00640 1 -- 172.21.15.59:0/3131427666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c1390f0 con 0x7f234c06e900 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f234a800640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234c144140 0x7f234c13edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.805+0000 7f2349e00640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c06e900 0x7f234c138bb0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f233c00d5f0 tx=0x7f233c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.809+0000 7f2342000640 1 -- 172.21.15.59:0/3131427666 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0125f0 con 0x7f234c06e900 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.809+0000 7f2342000640 1 -- 172.21.15.59:0/3131427666 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c019070 con 0x7f234c06e900 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.809+0000 7f2342000640 1 -- 172.21.15.59:0/3131427666 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c0129b0 con 0x7f234c06e900 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.809+0000 7f2351200640 1 -- 172.21.15.59:0/3131427666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234c13a350 con 0x7f234c06e900 2024-04-25T09:05:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.809+0000 7f2351200640 1 -- 172.21.15.59:0/3131427666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234c13a910 con 0x7f234c06e900 2024-04-25T09:05:53.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.809+0000 7f2351200640 1 -- 172.21.15.59:0/3131427666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234c0745d0 con 0x7f234c06e900 2024-04-25T09:05:53.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.809+0000 7f2342000640 1 -- 172.21.15.59:0/3131427666 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f233c012b50 con 0x7f234c06e900 2024-04-25T09:05:53.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.809+0000 7f2342000640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2328066f60 0x7f2328069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:53.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.809+0000 7f2342000640 1 -- 172.21.15.59:0/3131427666 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f233c0855b0 con 0x7f234c06e900 2024-04-25T09:05:53.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.809+0000 7f2343e00640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2328066f60 0x7f2328069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:53.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.813+0000 7f2343e00640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2328066f60 0x7f2328069420 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f23340ad000 tx=0x7f2334008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:53.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:53.813+0000 7f2342000640 1 -- 172.21.15.59:0/3131427666 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f234c1390f0 con 0x7f234c06e900 2024-04-25T09:05:54.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2351200640 1 -- 172.21.15.59:0/3131427666 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f234c0cb8d0 con 0x7f234c06e900 2024-04-25T09:05:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2342000640 1 -- 172.21.15.59:0/3131427666 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4937 (secure 0 0 0) 0x7f233c0563b0 con 0x7f234c06e900 2024-04-25T09:05:54.002 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:54.002 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":40,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2580922028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2580922028},{"type":"v1","addr":"172.21.15.178:6837","nonce":2580922028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/126805970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":126805970},{"type":"v1","addr":"172.21.15.178:6836","nonce":126805970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/402319604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":402319604},{"type":"v1","addr":"172.21.15.59:6833","nonce":402319604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:04:36.727681+0000","modified":"2024-04-25T09:05:25.370357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6225},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6225":{"gid":6225,"name":"a","rank":0,"incarnation":34,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6835/686404516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":686404516},{"type":"v1","addr":"172.21.15.59:6835","nonce":686404516}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-25T09:05:54.002 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 40 2024-04-25T09:05:54.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2351200640 1 -- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2328066f60 msgr2=0x7f2328069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2351200640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2328066f60 0x7f2328069420 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f23340ad000 tx=0x7f2334008040 comp rx=0 tx=0).stop 2024-04-25T09:05:54.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2351200640 1 -- 172.21.15.59:0/3131427666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c06e900 msgr2=0x7f234c138bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2351200640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c06e900 0x7f234c138bb0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f233c00d5f0 tx=0x7f233c00dab0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2351200640 1 -- 172.21.15.59:0/3131427666 shutdown_connections 2024-04-25T09:05:54.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2351200640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2328066f60 0x7f2328069420 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2351200640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f234c144140 0x7f234c13edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2351200640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f234c0ced60 0x7f234c139970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2351200640 1 --2- 172.21.15.59:0/3131427666 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f234c06e900 0x7f234c138bb0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2351200640 1 -- 172.21.15.59:0/3131427666 >> 172.21.15.59:0/3131427666 conn(0x7f234c066fa0 msgr2=0x7f234c0b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.009+0000 7f2351200640 1 -- 172.21.15.59:0/3131427666 shutdown_connections 2024-04-25T09:05:54.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.013+0000 7f2351200640 1 -- 172.21.15.59:0/3131427666 wait complete. 2024-04-25T09:05:54.022 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.169+0000 7f90e4800640 1 Processor -- start 2024-04-25T09:05:54.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.169+0000 7f90e4800640 1 -- start start 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e4800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f90dc0d11b0 0x7f90dc0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e4800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90dc0b4210 0x7f90dc0b4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e4800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90dc0b4b60 con 0x7f90dc15da10 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e4800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90dc15ddf0 con 0x7f90dc0b4210 2024-04-25T09:05:54.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e4800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90dc06b480 con 0x7f90dc0d11b0 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e2800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90dc0b4210 0x7f90dc0b4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e1e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f90dc15da10 0x7f90dc06ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60516/0 (socket says 172.21.15.59:60516) 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e1e00640 1 -- 172.21.15.59:0/2045622871 learned_addr learned my addr 172.21.15.59:0/2045622871 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e1400640 1 --2- 172.21.15.59:0/2045622871 >> v2:172.21.15.178:3300/0 conn(0x7f90dc0d11b0 0x7f90dc0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e2800640 1 -- 172.21.15.59:0/2045622871 >> v2:172.21.15.178:3300/0 conn(0x7f90dc0d11b0 msgr2=0x7f90dc0afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e2800640 1 --2- 172.21.15.59:0/2045622871 >> v2:172.21.15.178:3300/0 conn(0x7f90dc0d11b0 0x7f90dc0afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e2800640 1 -- 172.21.15.59:0/2045622871 >> v1:172.21.15.59:6789/0 conn(0x7f90dc15da10 legacy=0x7f90dc06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.173+0000 7f90e2800640 1 -- 172.21.15.59:0/2045622871 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc0d06d0 con 0x7f90dc0b4210 2024-04-25T09:05:54.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e2800640 1 --2- 172.21.15.59:0/2045622871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc0b4210 0x7f90dc0b4620 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f90dc071d40 tx=0x7f90d801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5266a170d648d8c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e0a00640 1 -- 172.21.15.59:0/2045622871 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80b2070 con 0x7f90dc0b4210 2024-04-25T09:05:54.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e0a00640 1 -- 172.21.15.59:0/2045622871 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d80a5850 con 0x7f90dc0b4210 2024-04-25T09:05:54.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e0a00640 1 -- 172.21.15.59:0/2045622871 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80a5c20 con 0x7f90dc0b4210 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 -- 172.21.15.59:0/2045622871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc0b4210 msgr2=0x7f90dc0b4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 --2- 172.21.15.59:0/2045622871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc0b4210 0x7f90dc0b4620 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f90dc071d40 tx=0x7f90d801c8a0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 -- 172.21.15.59:0/2045622871 shutdown_connections 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 --2- 172.21.15.59:0/2045622871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc0b4210 0x7f90dc0b4620 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 --2- 172.21.15.59:0/2045622871 >> v2:172.21.15.178:3300/0 conn(0x7f90dc0d11b0 0x7f90dc0afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 -- 172.21.15.59:0/2045622871 >> 172.21.15.59:0/2045622871 conn(0x7f90dc0b2400 msgr2=0x7f90dc0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 -- 172.21.15.59:0/2045622871 shutdown_connections 2024-04-25T09:05:54.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 -- 172.21.15.59:0/2045622871 wait complete. 2024-04-25T09:05:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 Processor -- start 2024-04-25T09:05:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 -- start start 2024-04-25T09:05:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90dc0b4210 0x7f90dc0cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90dc0d11b0 0x7f90dc15f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc15da10 0x7f90dc15e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc1621d0 con 0x7f90dc15da10 2024-04-25T09:05:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc162050 con 0x7f90dc0d11b0 2024-04-25T09:05:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.177+0000 7f90e4800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc162350 con 0x7f90dc0b4210 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc15da10 0x7f90dc15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc15da10 0x7f90dc15e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43328/0 (socket says 172.21.15.59:43328) 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e2800640 1 -- 172.21.15.59:0/2094721419 learned_addr learned my addr 172.21.15.59:0/2094721419 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e1e00640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90dc0b4210 0x7f90dc0cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e1400640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90dc0d11b0 0x7f90dc15f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e2800640 1 -- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90dc0b4210 msgr2=0x7f90dc0cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e2800640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90dc0b4210 0x7f90dc0cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e2800640 1 -- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90dc0d11b0 msgr2=0x7f90dc15f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e2800640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90dc0d11b0 0x7f90dc15f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e2800640 1 -- 172.21.15.59:0/2094721419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc15e770 con 0x7f90dc15da10 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e1400640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90dc0d11b0 0x7f90dc15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e1e00640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90dc0b4210 0x7f90dc0cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:54.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e2800640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc15da10 0x7f90dc15e000 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f90d801a4d0 tx=0x7f90d8019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90d6000640 1 -- 172.21.15.59:0/2094721419 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80b2050 con 0x7f90dc15da10 2024-04-25T09:05:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90d6000640 1 -- 172.21.15.59:0/2094721419 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d80be070 con 0x7f90dc15da10 2024-04-25T09:05:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90d6000640 1 -- 172.21.15.59:0/2094721419 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80ad870 con 0x7f90dc15da10 2024-04-25T09:05:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e4800640 1 -- 172.21.15.59:0/2094721419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90dc15ea50 con 0x7f90dc15da10 2024-04-25T09:05:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e4800640 1 -- 172.21.15.59:0/2094721419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90dc15f010 con 0x7f90dc15da10 2024-04-25T09:05:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90e4800640 1 -- 172.21.15.59:0/2094721419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90dc0745d0 con 0x7f90dc15da10 2024-04-25T09:05:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90d6000640 1 -- 172.21.15.59:0/2094721419 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f90d80ada10 con 0x7f90dc15da10 2024-04-25T09:05:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90d6000640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f90c0066f60 0x7f90c0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.181+0000 7f90d6000640 1 -- 172.21.15.59:0/2094721419 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7f90d8120460 con 0x7f90dc15da10 2024-04-25T09:05:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.185+0000 7f90e1e00640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f90c0066f60 0x7f90c0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.185+0000 7f90e1e00640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f90c0066f60 0x7f90c0069420 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f90d0007fd0 tx=0x7f90d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.185+0000 7f90d6000640 1 -- 172.21.15.59:0/2094721419 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f90d8016520 con 0x7f90dc15da10 2024-04-25T09:05:54.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.349+0000 7f90e4800640 1 -- 172.21.15.59:0/2094721419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90dc072860 con 0x7f90dc15da10 2024-04-25T09:05:54.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90d6000640 1 -- 172.21.15.59:0/2094721419 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+17075 (secure 0 0 0) 0x7f90d80add00 con 0x7f90dc15da10 2024-04-25T09:05:54.344 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:54.344 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":68,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:05:10.441583+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:04:35.130789+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data","create_time":"2024-04-25T09:04:35.714100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.e","mappings":[{"from":7,"to":2}]},{"pgid":"10.4","mappings":[{"from":4,"to":3}]},{"pgid":"10.37","mappings":[{"from":7,"to":3}]},{"pgid":"10.3c","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90e4800640 1 -- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f90c0066f60 msgr2=0x7f90c0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90e4800640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f90c0066f60 0x7f90c0069420 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f90d0007fd0 tx=0x7f90d0009040 comp rx=0 tx=0).stop 2024-04-25T09:05:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90e4800640 1 -- 172.21.15.59:0/2094721419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc15da10 msgr2=0x7f90dc15e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90e4800640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc15da10 0x7f90dc15e000 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f90d801a4d0 tx=0x7f90d8019640 comp rx=0 tx=0).stop 2024-04-25T09:05:54.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90e4800640 1 -- 172.21.15.59:0/2094721419 shutdown_connections 2024-04-25T09:05:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90e4800640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f90c0066f60 0x7f90c0069420 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90e4800640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90dc15da10 0x7f90dc15e000 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90e4800640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90dc0d11b0 0x7f90dc15f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90e4800640 1 --2- 172.21.15.59:0/2094721419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90dc0b4210 0x7f90dc0cf600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90e4800640 1 -- 172.21.15.59:0/2094721419 >> 172.21.15.59:0/2094721419 conn(0x7f90dc0b2400 msgr2=0x7f90dc0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90e4800640 1 -- 172.21.15.59:0/2094721419 shutdown_connections 2024-04-25T09:05:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.353+0000 7f90e4800640 1 -- 172.21.15.59:0/2094721419 wait complete. 2024-04-25T09:05:54.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:05:54.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc731200640 1 Processor -- start 2024-04-25T09:05:54.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc731200640 1 -- start start 2024-04-25T09:05:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc731200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c15dd90 0x7fc72c071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc731200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c072460 con 0x7fc72c161e90 2024-04-25T09:05:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc731200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc72c06ac10 con 0x7fc72c072040 2024-04-25T09:05:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc731200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c0b2dc0 con 0x7fc72c15dd90 2024-04-25T09:05:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc72a800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc72c161e90 0x7fc72c0ceca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60520/0 (socket says 172.21.15.59:60520) 2024-04-25T09:05:54.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc72a800640 1 -- 172.21.15.59:0/1622338178 learned_addr learned my addr 172.21.15.59:0/1622338178 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729e00640 1 --2- 172.21.15.59:0/1622338178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c15dd90 0x7fc72c071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218535370 0 0) 0x7fc72c072460 con 0x7fc72c161e90 2024-04-25T09:05:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc710003530 con 0x7fc72c161e90 2024-04-25T09:05:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2473991653 0 0) 0x7fc710003530 con 0x7fc72c161e90 2024-04-25T09:05:54.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c15dd90 msgr2=0x7fc72c071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 --2- 172.21.15.59:0/1622338178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c15dd90 0x7fc72c071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 >> v1:172.21.15.178:6789/0 conn(0x7fc72c072040 legacy=0x7fc72c161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c06aeb0 con 0x7fc72c161e90 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fc724001a00 con 0x7fc72c161e90 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 >> v1:172.21.15.59:6789/0 conn(0x7fc72c161e90 legacy=0x7fc72c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 --2- 172.21.15.59:0/1622338178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c15dd90 0x7fc7100039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 --2- 172.21.15.59:0/1622338178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc710003f30 0x7fc710004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 --2- 172.21.15.59:0/1622338178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc710004d50 0x7fc7100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71000bae0 con 0x7fc710003f30 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc71000bc90 con 0x7fc710004d50 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71000be90 con 0x7fc72c15dd90 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc723e00640 1 --2- 172.21.15.59:0/1622338178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc710003f30 0x7fc710004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc729e00640 1 --2- 172.21.15.59:0/1622338178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c15dd90 0x7fc7100039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.517+0000 7fc72a800640 1 --2- 172.21.15.59:0/1622338178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc710004d50 0x7fc7100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc723e00640 1 -- 172.21.15.59:0/1622338178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c15dd90 msgr2=0x7fc7100039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc723e00640 1 --2- 172.21.15.59:0/1622338178 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c15dd90 0x7fc7100039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc723e00640 1 -- 172.21.15.59:0/1622338178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc710004d50 msgr2=0x7fc7100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc723e00640 1 --2- 172.21.15.59:0/1622338178 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc710004d50 0x7fc7100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc723e00640 1 -- 172.21.15.59:0/1622338178 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc710003530 con 0x7fc710003f30 2024-04-25T09:05:54.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc723e00640 1 --2- 172.21.15.59:0/1622338178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc710003f30 0x7fc710004810 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc714001860 tx=0x7fc71401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f77b63c5ae439b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7140b5070 con 0x7fc710003f30 2024-04-25T09:05:54.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7140a8890 con 0x7fc710003f30 2024-04-25T09:05:54.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc729400640 1 -- 172.21.15.59:0/1622338178 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc714001460 con 0x7fc710003f30 2024-04-25T09:05:54.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc731200640 1 -- 172.21.15.59:0/1622338178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc710003f30 msgr2=0x7fc710004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc731200640 1 --2- 172.21.15.59:0/1622338178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc710003f30 0x7fc710004810 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc714001860 tx=0x7fc71401ec70 comp rx=0 tx=0).stop 2024-04-25T09:05:54.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc72a800640 1 -- 172.21.15.59:0/1622338178 reap_dead start 2024-04-25T09:05:54.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc731200640 1 -- 172.21.15.59:0/1622338178 shutdown_connections 2024-04-25T09:05:54.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc731200640 1 -- 172.21.15.59:0/1622338178 >> 172.21.15.59:0/1622338178 conn(0x7fc72c0cfd90 msgr2=0x7fc72c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc731200640 1 -- 172.21.15.59:0/1622338178 shutdown_connections 2024-04-25T09:05:54.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.521+0000 7fc731200640 1 -- 172.21.15.59:0/1622338178 wait complete. 2024-04-25T09:05:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc731200640 1 Processor -- start 2024-04-25T09:05:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc731200640 1 -- start start 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc731200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72c1f3360 0x7fc72c15c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc731200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc72c15a5f0 0x7fc72c1f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc731200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c1f3c80 0x7fc72c1570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc731200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c06b750 con 0x7fc72c1f3360 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc731200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c06b470 con 0x7fc72c15a5f0 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc731200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c162300 con 0x7fc72c1f3c80 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc729e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72c1f3360 0x7fc72c15c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc729e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72c1f3360 0x7fc72c15c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43348/0 (socket says 172.21.15.59:43348) 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc729e00640 1 -- 172.21.15.59:0/302666228 learned_addr learned my addr 172.21.15.59:0/302666228 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc72a800640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c1f3c80 0x7fc72c1570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc723e00640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc72c15a5f0 0x7fc72c1f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc729e00640 1 -- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c1f3c80 msgr2=0x7fc72c1570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc729e00640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c1f3c80 0x7fc72c1570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc729e00640 1 -- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc72c15a5f0 msgr2=0x7fc72c1f3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc729e00640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc72c15a5f0 0x7fc72c1f3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc729e00640 1 -- 172.21.15.59:0/302666228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c15d1a0 con 0x7fc72c1f3360 2024-04-25T09:05:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc72a800640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c1f3c80 0x7fc72c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc729e00640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72c1f3360 0x7fc72c15c950 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc71c011a00 tx=0x7fc71c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc722000640 1 -- 172.21.15.59:0/302666228 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c00faf0 con 0x7fc72c1f3360 2024-04-25T09:05:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc722000640 1 -- 172.21.15.59:0/302666228 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71c00fc90 con 0x7fc72c1f3360 2024-04-25T09:05:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc731200640 1 -- 172.21.15.59:0/302666228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72c15d480 con 0x7fc72c1f3360 2024-04-25T09:05:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc722000640 1 -- 172.21.15.59:0/302666228 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c014440 con 0x7fc72c1f3360 2024-04-25T09:05:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.525+0000 7fc731200640 1 -- 172.21.15.59:0/302666228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72c156ba0 con 0x7fc72c1f3360 2024-04-25T09:05:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.529+0000 7fc731200640 1 -- 172.21.15.59:0/302666228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72c0745d0 con 0x7fc72c1f3360 2024-04-25T09:05:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.529+0000 7fc722000640 1 -- 172.21.15.59:0/302666228 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc71c012040 con 0x7fc72c1f3360 2024-04-25T09:05:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.529+0000 7fc722000640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc708066f90 0x7fc708069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.529+0000 7fc722000640 1 -- 172.21.15.59:0/302666228 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6217+0+0 (secure 0 0 0) 0x7fc71c085900 con 0x7fc72c1f3360 2024-04-25T09:05:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.529+0000 7fc723e00640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc708066f90 0x7fc708069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.529+0000 7fc723e00640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc708066f90 0x7fc708069450 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc7140b2000 tx=0x7fc714005040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.533+0000 7fc722000640 1 -- 172.21.15.59:0/302666228 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc71c019030 con 0x7fc72c1f3360 2024-04-25T09:05:54.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.733+0000 7fc731200640 1 -- 172.21.15.59:0/302666228 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc72c0671b0 con 0x7fc72c1f3360 2024-04-25T09:05:54.727 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:05:54.733+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:05:54.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.737+0000 7fc722000640 1 -- 172.21.15.59:0/302666228 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc71c056730 con 0x7fc72c1f3360 2024-04-25T09:05:54.730 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:05:54.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.737+0000 7fc731200640 1 -- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc708066f90 msgr2=0x7fc708069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.737+0000 7fc731200640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc708066f90 0x7fc708069450 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc7140b2000 tx=0x7fc714005040 comp rx=0 tx=0).stop 2024-04-25T09:05:54.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.737+0000 7fc731200640 1 -- 172.21.15.59:0/302666228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72c1f3360 msgr2=0x7fc72c15c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.737+0000 7fc731200640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72c1f3360 0x7fc72c15c950 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc71c011a00 tx=0x7fc71c011ec0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.741+0000 7fc731200640 1 -- 172.21.15.59:0/302666228 shutdown_connections 2024-04-25T09:05:54.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.741+0000 7fc731200640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc708066f90 0x7fc708069450 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.741+0000 7fc731200640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc72c1f3c80 0x7fc72c1570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.741+0000 7fc731200640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc72c15a5f0 0x7fc72c1f3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.741+0000 7fc731200640 1 --2- 172.21.15.59:0/302666228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc72c1f3360 0x7fc72c15c950 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.741+0000 7fc731200640 1 -- 172.21.15.59:0/302666228 >> 172.21.15.59:0/302666228 conn(0x7fc72c0cfd90 msgr2=0x7fc72c0af780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.741+0000 7fc731200640 1 -- 172.21.15.59:0/302666228 shutdown_connections 2024-04-25T09:05:54.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.741+0000 7fc731200640 1 -- 172.21.15.59:0/302666228 wait complete. 2024-04-25T09:05:54.744 INFO:tasks.ceph.mds.a.smithi059.stderr: -7475> 2024-04-25T09:04:42.302+0000 7f74b4600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:05:54.747 INFO:tasks.ceph.mds.a.smithi059.stderr: -4870> 2024-04-25T09:04:45.598+0000 7f74af600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6375=0-4194304@1} caps={6375=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6375 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x55b6de0f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:05:54.749 INFO:tasks.ceph.mds.a.smithi059.stderr: -3104> 2024-04-25T09:05:17.201+0000 7f74af600640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6375=0-4194304@1} caps={6375=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6375 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x55b6de0f5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(10)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:05:54.754 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:05:54.795 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:05:54.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.905+0000 7f9d04e00640 1 Processor -- start 2024-04-25T09:05:54.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.905+0000 7f9d04e00640 1 -- start start 2024-04-25T09:05:54.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.905+0000 7f9d04e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9d0015acd0 0x7f9d0015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.905+0000 7f9d04e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d0015ee60 0x7f9d000b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.905+0000 7f9d04e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0015bc40 con 0x7f9d00144120 2024-04-25T09:05:54.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.905+0000 7f9d04e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0015e490 con 0x7f9d0015ee60 2024-04-25T09:05:54.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.905+0000 7f9d04e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0015b150 con 0x7f9d0015acd0 2024-04-25T09:05:54.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.905+0000 7f9cfde00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9d00144120 0x7f9d000ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60534/0 (socket says 172.21.15.59:60534) 2024-04-25T09:05:54.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cfde00640 1 -- 172.21.15.59:0/67715554 learned_addr learned my addr 172.21.15.59:0/67715554 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:54.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cf7e00640 1 --2- 172.21.15.59:0/67715554 >> v2:172.21.15.178:3300/0 conn(0x7f9d0015acd0 0x7f9d0015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cfe800640 1 --2- 172.21.15.59:0/67715554 >> v2:172.21.15.59:3300/0 conn(0x7f9d0015ee60 0x7f9d000b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cfd400640 1 -- 172.21.15.59:0/67715554 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 626396928 0 0) 0x7f9d0015bc40 con 0x7f9d00144120 2024-04-25T09:05:54.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cfd400640 1 -- 172.21.15.59:0/67715554 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ce4003530 con 0x7f9d00144120 2024-04-25T09:05:54.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cf7e00640 1 -- 172.21.15.59:0/67715554 >> v2:172.21.15.59:3300/0 conn(0x7f9d0015ee60 msgr2=0x7f9d000b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:54.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cf7e00640 1 --2- 172.21.15.59:0/67715554 >> v2:172.21.15.59:3300/0 conn(0x7f9d0015ee60 0x7f9d000b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cf7e00640 1 -- 172.21.15.59:0/67715554 >> v1:172.21.15.59:6789/0 conn(0x7f9d00144120 legacy=0x7f9d000ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cf7e00640 1 -- 172.21.15.59:0/67715554 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0015b3a0 con 0x7f9d0015acd0 2024-04-25T09:05:54.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cf7e00640 1 --2- 172.21.15.59:0/67715554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d0015acd0 0x7f9d0015e920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9d0006b870 tx=0x7f9ce801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c553074686d984 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cfd400640 1 -- 172.21.15.59:0/67715554 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80b0070 con 0x7f9d0015acd0 2024-04-25T09:05:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cfd400640 1 -- 172.21.15.59:0/67715554 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce80ab600 con 0x7f9d0015acd0 2024-04-25T09:05:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.909+0000 7f9cfd400640 1 -- 172.21.15.59:0/67715554 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ce80ab9d0 con 0x7f9d0015acd0 2024-04-25T09:05:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 -- 172.21.15.59:0/67715554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d0015acd0 msgr2=0x7f9d0015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 --2- 172.21.15.59:0/67715554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d0015acd0 0x7f9d0015e920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9d0006b870 tx=0x7f9ce801c3f0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 -- 172.21.15.59:0/67715554 shutdown_connections 2024-04-25T09:05:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 --2- 172.21.15.59:0/67715554 >> v2:172.21.15.59:3300/0 conn(0x7f9d0015ee60 0x7f9d000b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 --2- 172.21.15.59:0/67715554 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d0015acd0 0x7f9d0015e920 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 -- 172.21.15.59:0/67715554 >> 172.21.15.59:0/67715554 conn(0x7f9d00067080 msgr2=0x7f9d0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 -- 172.21.15.59:0/67715554 shutdown_connections 2024-04-25T09:05:54.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 -- 172.21.15.59:0/67715554 wait complete. 2024-04-25T09:05:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 Processor -- start 2024-04-25T09:05:54.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 -- start start 2024-04-25T09:05:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d00144120 0x7f9d000b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d0015acd0 0x7f9d00142d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d0015ee60 0x7f9d001424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d001677d0 con 0x7f9d0015ee60 2024-04-25T09:05:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00167650 con 0x7f9d0015acd0 2024-04-25T09:05:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9d04e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d00167950 con 0x7f9d00144120 2024-04-25T09:05:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9cfde00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d00144120 0x7f9d000b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9cfe800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d0015ee60 0x7f9d001424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9cf7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d0015acd0 0x7f9d00142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9cfde00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d00144120 0x7f9d000b0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:47948/0 (socket says 172.21.15.59:47948) 2024-04-25T09:05:54.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9cfde00640 1 -- 172.21.15.59:0/2619411576 learned_addr learned my addr 172.21.15.59:0/2619411576 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9cfe800640 1 -- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d00144120 msgr2=0x7f9d000b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9cfe800640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d00144120 0x7f9d000b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9cfe800640 1 -- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d0015acd0 msgr2=0x7f9d00142d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9cfe800640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d0015acd0 0x7f9d00142d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9cfe800640 1 -- 172.21.15.59:0/2619411576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d001429e0 con 0x7f9d0015ee60 2024-04-25T09:05:54.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9cfde00640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d00144120 0x7f9d000b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.913+0000 7f9cf7e00640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d0015acd0 0x7f9d00142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.917+0000 7f9cfe800640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d0015ee60 0x7f9d001424a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800eba0 tx=0x7f9cf800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.917+0000 7f9cf6000640 1 -- 172.21.15.59:0/2619411576 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf8018020 con 0x7f9d0015ee60 2024-04-25T09:05:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.917+0000 7f9cf6000640 1 -- 172.21.15.59:0/2619411576 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf800cd20 con 0x7f9d0015ee60 2024-04-25T09:05:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.917+0000 7f9cf6000640 1 -- 172.21.15.59:0/2619411576 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf80146c0 con 0x7f9d0015ee60 2024-04-25T09:05:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.917+0000 7f9d04e00640 1 -- 172.21.15.59:0/2619411576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d00143530 con 0x7f9d0015ee60 2024-04-25T09:05:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.917+0000 7f9d04e00640 1 -- 172.21.15.59:0/2619411576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d00141ca0 con 0x7f9d0015ee60 2024-04-25T09:05:54.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.917+0000 7f9d04e00640 1 -- 172.21.15.59:0/2619411576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d000745d0 con 0x7f9d0015ee60 2024-04-25T09:05:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.917+0000 7f9cf6000640 1 -- 172.21.15.59:0/2619411576 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9cf801b020 con 0x7f9d0015ee60 2024-04-25T09:05:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.917+0000 7f9cf6000640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9cdc066f60 0x7f9cdc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.917+0000 7f9cf6000640 1 -- 172.21.15.59:0/2619411576 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f9cf8085e50 con 0x7f9d0015ee60 2024-04-25T09:05:54.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.917+0000 7f9cfde00640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9cdc066f60 0x7f9cdc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:54.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.921+0000 7f9cfde00640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9cdc066f60 0x7f9cdc069420 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0007fd0 tx=0x7f9cf0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:54.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:54.921+0000 7f9cf6000640 1 -- 172.21.15.59:0/2619411576 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9cf8022030 con 0x7f9d0015ee60 2024-04-25T09:05:55.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.121+0000 7f9d04e00640 1 -- 172.21.15.59:0/2619411576 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9d000b2bd0 con 0x7f9d0015ee60 2024-04-25T09:05:55.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9cf6000640 1 -- 172.21.15.59:0/2619411576 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9cf8010040 con 0x7f9d0015ee60 2024-04-25T09:05:55.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9d04e00640 1 -- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9cdc066f60 msgr2=0x7f9cdc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9d04e00640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9cdc066f60 0x7f9cdc069420 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0007fd0 tx=0x7f9cf0009040 comp rx=0 tx=0).stop 2024-04-25T09:05:55.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9d04e00640 1 -- 172.21.15.59:0/2619411576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d0015ee60 msgr2=0x7f9d001424a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9d04e00640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d0015ee60 0x7f9d001424a0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800eba0 tx=0x7f9cf800c490 comp rx=0 tx=0).stop 2024-04-25T09:05:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9d04e00640 1 -- 172.21.15.59:0/2619411576 shutdown_connections 2024-04-25T09:05:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9d04e00640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9cdc066f60 0x7f9cdc069420 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9d04e00640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d0015ee60 0x7f9d001424a0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9d04e00640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9d0015acd0 0x7f9d00142d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9d04e00640 1 --2- 172.21.15.59:0/2619411576 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9d00144120 0x7f9d000b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9d04e00640 1 -- 172.21.15.59:0/2619411576 >> 172.21.15.59:0/2619411576 conn(0x7f9d00067080 msgr2=0x7f9d00140660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9d04e00640 1 -- 172.21.15.59:0/2619411576 shutdown_connections 2024-04-25T09:05:55.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.741+0000 7f9d04e00640 1 -- 172.21.15.59:0/2619411576 wait complete. 2024-04-25T09:05:55.758 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:05:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc53e00640 1 Processor -- start 2024-04-25T09:05:55.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc53e00640 1 -- start start 2024-04-25T09:05:55.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc53e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcc4c06ee10 0x7fcc4c0b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc53e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc4c0cac40 0x7fcc4c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc53e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc4c0ce9b0 con 0x7fcc4c0cd880 2024-04-25T09:05:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc53e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4c0ce780 con 0x7fcc4c0cac40 2024-04-25T09:05:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc53e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc4c0cdff0 con 0x7fcc4c06ee10 2024-04-25T09:05:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc50a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcc4c0cd880 0x7fcc4c06f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60536/0 (socket says 172.21.15.59:60536) 2024-04-25T09:05:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc51e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc4c0cac40 0x7fcc4c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc50a00640 1 -- 172.21.15.59:0/505760678 learned_addr learned my addr 172.21.15.59:0/505760678 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:55.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc51400640 1 --2- 172.21.15.59:0/505760678 >> v2:172.21.15.178:3300/0 conn(0x7fcc4c06ee10 0x7fcc4c0b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc51e00640 1 -- 172.21.15.59:0/505760678 >> v2:172.21.15.178:3300/0 conn(0x7fcc4c06ee10 msgr2=0x7fcc4c0b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc51e00640 1 --2- 172.21.15.59:0/505760678 >> v2:172.21.15.178:3300/0 conn(0x7fcc4c06ee10 0x7fcc4c0b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc51e00640 1 -- 172.21.15.59:0/505760678 >> v1:172.21.15.59:6789/0 conn(0x7fcc4c0cd880 legacy=0x7fcc4c06f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc51e00640 1 -- 172.21.15.59:0/505760678 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c0cec90 con 0x7fcc4c0cac40 2024-04-25T09:05:55.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.961+0000 7fcc4be00640 1 -- 172.21.15.59:0/505760678 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174910601 0 0) 0x7fcc4c0ce9b0 con 0x7fcc4c0cd880 2024-04-25T09:05:55.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc51e00640 1 --2- 172.21.15.59:0/505760678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4c0cac40 0x7fcc4c0cb0b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0d1690 tx=0x7fcc4401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f96c339677b8f3c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:55.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc4be00640 1 -- 172.21.15.59:0/505760678 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440b2070 con 0x7fcc4c0cac40 2024-04-25T09:05:55.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc4be00640 1 -- 172.21.15.59:0/505760678 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc440a59c0 con 0x7fcc4c0cac40 2024-04-25T09:05:55.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc4be00640 1 -- 172.21.15.59:0/505760678 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440a5d90 con 0x7fcc4c0cac40 2024-04-25T09:05:55.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc53e00640 1 -- 172.21.15.59:0/505760678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4c0cac40 msgr2=0x7fcc4c0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc53e00640 1 --2- 172.21.15.59:0/505760678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4c0cac40 0x7fcc4c0cb0b0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c0d1690 tx=0x7fcc4401c900 comp rx=0 tx=0).stop 2024-04-25T09:05:55.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc53e00640 1 -- 172.21.15.59:0/505760678 shutdown_connections 2024-04-25T09:05:55.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc53e00640 1 --2- 172.21.15.59:0/505760678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4c0cac40 0x7fcc4c0cb0b0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc53e00640 1 --2- 172.21.15.59:0/505760678 >> v2:172.21.15.178:3300/0 conn(0x7fcc4c06ee10 0x7fcc4c0b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc53e00640 1 -- 172.21.15.59:0/505760678 >> 172.21.15.59:0/505760678 conn(0x7fcc4c0b2240 msgr2=0x7fcc4c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:55.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc53e00640 1 -- 172.21.15.59:0/505760678 shutdown_connections 2024-04-25T09:05:55.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc53e00640 1 -- 172.21.15.59:0/505760678 wait complete. 2024-04-25T09:05:55.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.965+0000 7fcc53e00640 1 Processor -- start 2024-04-25T09:05:55.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc53e00640 1 -- start start 2024-04-25T09:05:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc53e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc4c06ee10 0x7fcc4c0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc53e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c0cac40 0x7fcc4c1538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc53e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4c0cd880 0x7fcc4c153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc53e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c15ab80 con 0x7fcc4c0cd880 2024-04-25T09:05:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc53e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c15aa00 con 0x7fcc4c06ee10 2024-04-25T09:05:55.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc53e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4c167320 con 0x7fcc4c0cac40 2024-04-25T09:05:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc51e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4c0cd880 0x7fcc4c153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc51e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4c0cd880 0x7fcc4c153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43436/0 (socket says 172.21.15.59:43436) 2024-04-25T09:05:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc51e00640 1 -- 172.21.15.59:0/1068835333 learned_addr learned my addr 172.21.15.59:0/1068835333 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc51400640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc4c06ee10 0x7fcc4c0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc50a00640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c0cac40 0x7fcc4c1538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc51e00640 1 -- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c0cac40 msgr2=0x7fcc4c1538f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc51e00640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c0cac40 0x7fcc4c1538f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc51e00640 1 -- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc4c06ee10 msgr2=0x7fcc4c0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc51e00640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc4c06ee10 0x7fcc4c0b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc51e00640 1 -- 172.21.15.59:0/1068835333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc4c0b1890 con 0x7fcc4c0cd880 2024-04-25T09:05:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc50a00640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c0cac40 0x7fcc4c1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:55.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc51e00640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4c0cd880 0x7fcc4c153e30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fcc4401a530 tx=0x7fcc440196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc49600640 1 -- 172.21.15.59:0/1068835333 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440b2050 con 0x7fcc4c0cd880 2024-04-25T09:05:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc49600640 1 -- 172.21.15.59:0/1068835333 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc440be070 con 0x7fcc4c0cd880 2024-04-25T09:05:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc49600640 1 -- 172.21.15.59:0/1068835333 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc440ada90 con 0x7fcc4c0cd880 2024-04-25T09:05:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc53e00640 1 -- 172.21.15.59:0/1068835333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc4c0b07f0 con 0x7fcc4c0cd880 2024-04-25T09:05:55.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc53e00640 1 -- 172.21.15.59:0/1068835333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc4c0b0db0 con 0x7fcc4c0cd880 2024-04-25T09:05:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.969+0000 7fcc53e00640 1 -- 172.21.15.59:0/1068835333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc4c0745d0 con 0x7fcc4c0cd880 2024-04-25T09:05:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.973+0000 7fcc49600640 1 -- 172.21.15.59:0/1068835333 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcc440adc30 con 0x7fcc4c0cd880 2024-04-25T09:05:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.973+0000 7fcc49600640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc2c066f60 0x7fcc2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:55.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.973+0000 7fcc49600640 1 -- 172.21.15.59:0/1068835333 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fcc44120500 con 0x7fcc4c0cd880 2024-04-25T09:05:55.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.973+0000 7fcc51400640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc2c066f60 0x7fcc2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:55.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.973+0000 7fcc51400640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc2c066f60 0x7fcc2c069420 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009b60 tx=0x7fcc40009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:55.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:55.977+0000 7fcc49600640 1 -- 172.21.15.59:0/1068835333 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcc44016520 con 0x7fcc4c0cd880 2024-04-25T09:05:56.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.141+0000 7fcc53e00640 1 -- 172.21.15.59:0/1068835333 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcc4c06fd00 con 0x7fcc4c0cd880 2024-04-25T09:05:56.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.741+0000 7fcc49600640 1 -- 172.21.15.59:0/1068835333 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v70) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcc440f1220 con 0x7fcc4c0cd880 2024-04-25T09:05:56.734 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:05:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.745+0000 7fcc53e00640 1 -- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc2c066f60 msgr2=0x7fcc2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.745+0000 7fcc53e00640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc2c066f60 0x7fcc2c069420 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009b60 tx=0x7fcc40009190 comp rx=0 tx=0).stop 2024-04-25T09:05:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.745+0000 7fcc53e00640 1 -- 172.21.15.59:0/1068835333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4c0cd880 msgr2=0x7fcc4c153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.745+0000 7fcc53e00640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4c0cd880 0x7fcc4c153e30 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fcc4401a530 tx=0x7fcc440196a0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.745+0000 7fcc53e00640 1 -- 172.21.15.59:0/1068835333 shutdown_connections 2024-04-25T09:05:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.745+0000 7fcc53e00640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcc2c066f60 0x7fcc2c069420 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.745+0000 7fcc53e00640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc4c0cd880 0x7fcc4c153e30 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.745+0000 7fcc53e00640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcc4c0cac40 0x7fcc4c1538f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.745+0000 7fcc53e00640 1 --2- 172.21.15.59:0/1068835333 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcc4c06ee10 0x7fcc4c0b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.745+0000 7fcc53e00640 1 -- 172.21.15.59:0/1068835333 >> 172.21.15.59:0/1068835333 conn(0x7fcc4c0b2240 msgr2=0x7fcc4c06b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:56.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.745+0000 7fcc53e00640 1 -- 172.21.15.59:0/1068835333 shutdown_connections 2024-04-25T09:05:56.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.745+0000 7fcc53e00640 1 -- 172.21.15.59:0/1068835333 wait complete. 2024-04-25T09:05:56.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:05:56.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.913+0000 7f8c22a00640 1 Processor -- start 2024-04-25T09:05:56.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.913+0000 7f8c22a00640 1 -- start start 2024-04-25T09:05:56.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c22a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c1c0713c0 0x7f8c1c0cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:56.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c22a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8c1c0d1220 0x7f8c1c0b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:56.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c22a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1c15f7d0 con 0x7f8c1c15b6d0 2024-04-25T09:05:56.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c22a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c1c0ce4d0 con 0x7f8c1c0d1220 2024-04-25T09:05:56.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c22a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c15fab0 con 0x7f8c1c0713c0 2024-04-25T09:05:56.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c20a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8c1c0d1220 0x7f8c1c0b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:56.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c13400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c1c0713c0 0x7f8c1c0cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:56.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c20a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8c1c0d1220 0x7f8c1c0b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:60952/0 (socket says 172.21.15.59:60952) 2024-04-25T09:05:56.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c20a00640 1 -- 172.21.15.59:0/269385537 learned_addr learned my addr 172.21.15.59:0/269385537 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:56.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c1be00640 1 --1- 172.21.15.59:0/269385537 >> v1:172.21.15.178:6789/0 conn(0x7f8c1c15b6d0 0x7f8c1c070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:35238/0 (socket says 172.21.15.59:35238) 2024-04-25T09:05:56.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c13400640 1 -- 172.21.15.59:0/269385537 >> v2:172.21.15.178:3300/0 conn(0x7f8c1c0d1220 msgr2=0x7f8c1c0b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:56.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c13400640 1 --2- 172.21.15.59:0/269385537 >> v2:172.21.15.178:3300/0 conn(0x7f8c1c0d1220 0x7f8c1c0b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c13400640 1 -- 172.21.15.59:0/269385537 >> v1:172.21.15.178:6789/0 conn(0x7f8c1c15b6d0 legacy=0x7f8c1c070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:56.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c13400640 1 -- 172.21.15.59:0/269385537 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c15fd90 con 0x7f8c1c0713c0 2024-04-25T09:05:56.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.917+0000 7f8c20a00640 1 --2- 172.21.15.59:0/269385537 >> v2:172.21.15.178:3300/0 conn(0x7f8c1c0d1220 0x7f8c1c0b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:56.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c13400640 1 --2- 172.21.15.59:0/269385537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c1c0713c0 0x7f8c1c0cdf90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c040097c0 tx=0x7f8c0401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec6a0d511b7c110d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:56.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c1b400640 1 -- 172.21.15.59:0/269385537 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c040b1070 con 0x7f8c1c0713c0 2024-04-25T09:05:56.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c1b400640 1 -- 172.21.15.59:0/269385537 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c040ac410 con 0x7f8c1c0713c0 2024-04-25T09:05:56.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c1b400640 1 -- 172.21.15.59:0/269385537 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c15bcc0 con 0x7f8c1c0713c0 2024-04-25T09:05:56.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c22a00640 1 -- 172.21.15.59:0/269385537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c1c0713c0 msgr2=0x7f8c1c0cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:56.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c22a00640 1 --2- 172.21.15.59:0/269385537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c1c0713c0 0x7f8c1c0cdf90 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8c040097c0 tx=0x7f8c0401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c22a00640 1 -- 172.21.15.59:0/269385537 shutdown_connections 2024-04-25T09:05:56.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c22a00640 1 --2- 172.21.15.59:0/269385537 >> v2:172.21.15.178:3300/0 conn(0x7f8c1c0d1220 0x7f8c1c0b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c22a00640 1 --2- 172.21.15.59:0/269385537 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c1c0713c0 0x7f8c1c0cdf90 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c22a00640 1 -- 172.21.15.59:0/269385537 >> 172.21.15.59:0/269385537 conn(0x7f8c1c06f510 msgr2=0x7f8c1c06f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:56.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c22a00640 1 -- 172.21.15.59:0/269385537 shutdown_connections 2024-04-25T09:05:56.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c22a00640 1 -- 172.21.15.59:0/269385537 wait complete. 2024-04-25T09:05:56.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c22a00640 1 Processor -- start 2024-04-25T09:05:56.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.921+0000 7f8c22a00640 1 -- start start 2024-04-25T09:05:56.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c22a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1c0713c0 0x7f8c1c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c22a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c1c0d1220 0x7f8c1c159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c22a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c1c15b6d0 0x7f8c1c1fa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c22a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c168880 con 0x7f8c1c0d1220 2024-04-25T09:05:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c22a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c168700 con 0x7f8c1c0713c0 2024-04-25T09:05:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c22a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1c168a00 con 0x7f8c1c15b6d0 2024-04-25T09:05:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c13400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c1c0d1220 0x7f8c1c159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c13400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c1c0d1220 0x7f8c1c159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43442/0 (socket says 172.21.15.59:43442) 2024-04-25T09:05:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c13400640 1 -- 172.21.15.59:0/1458397269 learned_addr learned my addr 172.21.15.59:0/1458397269 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c20a00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c1c15b6d0 0x7f8c1c1fa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:56.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c1be00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1c0713c0 0x7f8c1c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:56.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c20a00640 1 -- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1c0713c0 msgr2=0x7f8c1c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:56.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c20a00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1c0713c0 0x7f8c1c06bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c20a00640 1 -- 172.21.15.59:0/1458397269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c1c0d1220 msgr2=0x7f8c1c159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:56.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c20a00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c1c0d1220 0x7f8c1c159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:56.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c20a00640 1 -- 172.21.15.59:0/1458397269 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c15a890 con 0x7f8c1c15b6d0 2024-04-25T09:05:56.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c13400640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c1c0d1220 0x7f8c1c159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:56.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c20a00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c1c15b6d0 0x7f8c1c1fa3e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400ef90 tx=0x7f8c1400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:56.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c18c00640 1 -- 172.21.15.59:0/1458397269 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400cd20 con 0x7f8c1c15b6d0 2024-04-25T09:05:56.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c18c00640 1 -- 172.21.15.59:0/1458397269 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c14019070 con 0x7f8c1c15b6d0 2024-04-25T09:05:56.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c18c00640 1 -- 172.21.15.59:0/1458397269 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c140146c0 con 0x7f8c1c15b6d0 2024-04-25T09:05:56.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c22a00640 1 -- 172.21.15.59:0/1458397269 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1c159ff0 con 0x7f8c1c15b6d0 2024-04-25T09:05:56.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c22a00640 1 -- 172.21.15.59:0/1458397269 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1c15a5b0 con 0x7f8c1c15b6d0 2024-04-25T09:05:56.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.925+0000 7f8c22a00640 1 -- 172.21.15.59:0/1458397269 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c1c0745d0 con 0x7f8c1c15b6d0 2024-04-25T09:05:56.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.929+0000 7f8c18c00640 1 -- 172.21.15.59:0/1458397269 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8c14012050 con 0x7f8c1c15b6d0 2024-04-25T09:05:56.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.929+0000 7f8c18c00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8bf8066f90 0x7f8bf8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:56.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.929+0000 7f8c18c00640 1 -- 172.21.15.59:0/1458397269 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5836+0+0 (secure 0 0 0) 0x7f8c14085eb0 con 0x7f8c1c15b6d0 2024-04-25T09:05:56.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.929+0000 7f8c1be00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8bf8066f90 0x7f8bf8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:56.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.929+0000 7f8c1be00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8bf8066f90 0x7f8bf8069450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c000f70 tx=0x7f8c0c007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:56.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:56.933+0000 7f8c18c00640 1 -- 172.21.15.59:0/1458397269 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8c14010040 con 0x7f8c1c15b6d0 2024-04-25T09:05:57.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.101+0000 7f8c22a00640 1 -- 172.21.15.59:0/1458397269 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8c1c070100 con 0x7f8c1c15b6d0 2024-04-25T09:05:57.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.749+0000 7f8c18c00640 1 -- 172.21.15.59:0/1458397269 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v71) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8c140567d0 con 0x7f8c1c15b6d0 2024-04-25T09:05:57.740 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-04-25T09:05:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.749+0000 7f8c22a00640 1 -- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8bf8066f90 msgr2=0x7f8bf8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.749+0000 7f8c22a00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8bf8066f90 0x7f8bf8069450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c000f70 tx=0x7f8c0c007e90 comp rx=0 tx=0).stop 2024-04-25T09:05:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.749+0000 7f8c22a00640 1 -- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c1c15b6d0 msgr2=0x7f8c1c1fa3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.749+0000 7f8c22a00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c1c15b6d0 0x7f8c1c1fa3e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c1400ef90 tx=0x7f8c1400c490 comp rx=0 tx=0).stop 2024-04-25T09:05:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.749+0000 7f8c22a00640 1 -- 172.21.15.59:0/1458397269 shutdown_connections 2024-04-25T09:05:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.749+0000 7f8c22a00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8bf8066f90 0x7f8bf8069450 secure :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c000f70 tx=0x7f8c0c007e90 comp rx=0 tx=0).stop 2024-04-25T09:05:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.753+0000 7f8c22a00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8c1c15b6d0 0x7f8c1c1fa3e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.753+0000 7f8c22a00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8c1c0d1220 0x7f8c1c159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.753+0000 7f8c22a00640 1 --2- 172.21.15.59:0/1458397269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8c1c0713c0 0x7f8c1c06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.753+0000 7f8c22a00640 1 -- 172.21.15.59:0/1458397269 >> 172.21.15.59:0/1458397269 conn(0x7f8c1c06f510 msgr2=0x7f8c1c070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.753+0000 7f8c22a00640 1 -- 172.21.15.59:0/1458397269 shutdown_connections 2024-04-25T09:05:57.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.753+0000 7f8c22a00640 1 -- 172.21.15.59:0/1458397269 wait complete. 2024-04-25T09:05:57.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:05:57.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f055dc00640 1 Processor -- start 2024-04-25T09:05:57.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f055dc00640 1 -- start start 2024-04-25T09:05:57.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f055dc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f055815e770 0x7f055815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f055dc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f055806d2d0 0x7f055815f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f055dc00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055806db20 con 0x7f0558071270 2024-04-25T09:05:57.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f055dc00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055815f090 con 0x7f055815e770 2024-04-25T09:05:57.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f055dc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055806de00 con 0x7f055806d2d0 2024-04-25T09:05:57.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f0556a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f055815e770 0x7f055815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f054fe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f055806d2d0 0x7f055815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f0557400640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f0558071270 0x7f05580ae560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:35240/0 (socket says 172.21.15.59:35240) 2024-04-25T09:05:57.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f0557400640 1 -- 172.21.15.59:0/160864808 learned_addr learned my addr 172.21.15.59:0/160864808 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:57.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f054fe00640 1 -- 172.21.15.59:0/160864808 >> v2:172.21.15.178:3300/0 conn(0x7f055815e770 msgr2=0x7f055815eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:57.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f054fe00640 1 --2- 172.21.15.59:0/160864808 >> v2:172.21.15.178:3300/0 conn(0x7f055815e770 0x7f055815eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f054fe00640 1 -- 172.21.15.59:0/160864808 >> v1:172.21.15.178:6789/0 conn(0x7f0558071270 legacy=0x7f05580ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f054fe00640 1 -- 172.21.15.59:0/160864808 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055806e0e0 con 0x7f055806d2d0 2024-04-25T09:05:57.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f0556a00640 1 --2- 172.21.15.59:0/160864808 >> v2:172.21.15.178:3300/0 conn(0x7f055815e770 0x7f055815eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:05:57.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.921+0000 7f0556000640 1 -- 172.21.15.59:0/160864808 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363742371 0 0) 0x7f055806db20 con 0x7f0558071270 2024-04-25T09:05:57.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.925+0000 7f054fe00640 1 --2- 172.21.15.59:0/160864808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f055806d2d0 0x7f055815f230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f05400097c0 tx=0x7f054001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c7468c08b418a74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:57.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.925+0000 7f0556000640 1 -- 172.21.15.59:0/160864808 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400b0070 con 0x7f055806d2d0 2024-04-25T09:05:57.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.925+0000 7f0556000640 1 -- 172.21.15.59:0/160864808 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05400ab600 con 0x7f055806d2d0 2024-04-25T09:05:57.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.925+0000 7f0556000640 1 -- 172.21.15.59:0/160864808 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400ab9d0 con 0x7f055806d2d0 2024-04-25T09:05:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.925+0000 7f055dc00640 1 -- 172.21.15.59:0/160864808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f055806d2d0 msgr2=0x7f055815f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.925+0000 7f055dc00640 1 --2- 172.21.15.59:0/160864808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f055806d2d0 0x7f055815f230 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f05400097c0 tx=0x7f054001c410 comp rx=0 tx=0).stop 2024-04-25T09:05:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.925+0000 7f055dc00640 1 -- 172.21.15.59:0/160864808 shutdown_connections 2024-04-25T09:05:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.925+0000 7f055dc00640 1 --2- 172.21.15.59:0/160864808 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f055806d2d0 0x7f055815f230 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.925+0000 7f055dc00640 1 --2- 172.21.15.59:0/160864808 >> v2:172.21.15.178:3300/0 conn(0x7f055815e770 0x7f055815eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.925+0000 7f055dc00640 1 -- 172.21.15.59:0/160864808 >> 172.21.15.59:0/160864808 conn(0x7f0558067080 msgr2=0x7f055806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.925+0000 7f055dc00640 1 -- 172.21.15.59:0/160864808 shutdown_connections 2024-04-25T09:05:57.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.925+0000 7f055dc00640 1 -- 172.21.15.59:0/160864808 wait complete. 2024-04-25T09:05:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f055dc00640 1 Processor -- start 2024-04-25T09:05:57.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f055dc00640 1 -- start start 2024-04-25T09:05:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f055dc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f055806d2d0 0x7f05581f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f055dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0558071270 0x7f0558155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f055dc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f055815e770 0x7f055814c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f055dc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055806d730 con 0x7f0558071270 2024-04-25T09:05:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f055dc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0558071ad0 con 0x7f055806d2d0 2024-04-25T09:05:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f055dc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055806d8b0 con 0x7f055815e770 2024-04-25T09:05:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f054fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0558071270 0x7f0558155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f054fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0558071270 0x7f0558155740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43454/0 (socket says 172.21.15.59:43454) 2024-04-25T09:05:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f054fe00640 1 -- 172.21.15.59:0/2841285885 learned_addr learned my addr 172.21.15.59:0/2841285885 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f0556a00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f055806d2d0 0x7f05581f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f0557400640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f055815e770 0x7f055814c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f054fe00640 1 -- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f055815e770 msgr2=0x7f055814c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f054fe00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f055815e770 0x7f055814c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f054fe00640 1 -- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f055806d2d0 msgr2=0x7f05581f6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f054fe00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f055806d2d0 0x7f05581f6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f054fe00640 1 -- 172.21.15.59:0/2841285885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055814dc50 con 0x7f0558071270 2024-04-25T09:05:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f0556a00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f055806d2d0 0x7f05581f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:57.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f054fe00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0558071270 0x7f0558155740 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f05400ae040 tx=0x7f05400191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:57.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f054ea00640 1 -- 172.21.15.59:0/2841285885 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400b0040 con 0x7f0558071270 2024-04-25T09:05:57.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f054ea00640 1 -- 172.21.15.59:0/2841285885 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05400ab400 con 0x7f0558071270 2024-04-25T09:05:57.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f055dc00640 1 -- 172.21.15.59:0/2841285885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055814df30 con 0x7f0558071270 2024-04-25T09:05:57.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f054ea00640 1 -- 172.21.15.59:0/2841285885 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400b4670 con 0x7f0558071270 2024-04-25T09:05:57.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.929+0000 7f055dc00640 1 -- 172.21.15.59:0/2841285885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055814e4f0 con 0x7f0558071270 2024-04-25T09:05:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.933+0000 7f055dc00640 1 -- 172.21.15.59:0/2841285885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05580745d0 con 0x7f0558071270 2024-04-25T09:05:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.933+0000 7f054ea00640 1 -- 172.21.15.59:0/2841285885 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f05400bc020 con 0x7f0558071270 2024-04-25T09:05:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.933+0000 7f054ea00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0534066f60 0x7f0534069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:57.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.933+0000 7f054ea00640 1 -- 172.21.15.59:0/2841285885 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f054011e230 con 0x7f0558071270 2024-04-25T09:05:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.933+0000 7f0556a00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0534066f60 0x7f0534069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:57.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.933+0000 7f0556a00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0534066f60 0x7f0534069420 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0548009bc0 tx=0x7f0548008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:57.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:57.937+0000 7f054ea00640 1 -- 172.21.15.59:0/2841285885 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f05400c3020 con 0x7f0558071270 2024-04-25T09:05:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.097+0000 7f055dc00640 1 -- 172.21.15.59:0/2841285885 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f055815ebf0 con 0x7f0558071270 2024-04-25T09:05:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.101+0000 7f054ea00640 1 -- 172.21.15.59:0/2841285885 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0540016090 con 0x7f0558071270 2024-04-25T09:05:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.105+0000 7f055dc00640 1 -- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0534066f60 msgr2=0x7f0534069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.105+0000 7f055dc00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0534066f60 0x7f0534069420 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0548009bc0 tx=0x7f0548008040 comp rx=0 tx=0).stop 2024-04-25T09:05:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.105+0000 7f055dc00640 1 -- 172.21.15.59:0/2841285885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0558071270 msgr2=0x7f0558155740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.105+0000 7f055dc00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0558071270 0x7f0558155740 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f05400ae040 tx=0x7f05400191b0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.105+0000 7f055dc00640 1 -- 172.21.15.59:0/2841285885 shutdown_connections 2024-04-25T09:05:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.105+0000 7f055dc00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0534066f60 0x7f0534069420 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.105+0000 7f055dc00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f055815e770 0x7f055814c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.105+0000 7f055dc00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0558071270 0x7f0558155740 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.105+0000 7f055dc00640 1 --2- 172.21.15.59:0/2841285885 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f055806d2d0 0x7f05581f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.105+0000 7f055dc00640 1 -- 172.21.15.59:0/2841285885 >> 172.21.15.59:0/2841285885 conn(0x7f0558067080 msgr2=0x7f0558161fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.105+0000 7f055dc00640 1 -- 172.21.15.59:0/2841285885 shutdown_connections 2024-04-25T09:05:58.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.105+0000 7f055dc00640 1 -- 172.21.15.59:0/2841285885 wait complete. 2024-04-25T09:05:58.116 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-25T09:05:58.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52df000640 1 Processor -- start 2024-04-25T09:05:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52df000640 1 -- start start 2024-04-25T09:05:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52df000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f52d8145270 0x7f52d815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52df000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f52d80cd4d0 0x7f52d80cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52df000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d80b1750 0x7f52d80b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52df000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d8145650 con 0x7f52d80cd4d0 2024-04-25T09:05:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52df000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d80b20c0 con 0x7f52d8145270 2024-04-25T09:05:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52df000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d80cc4e0 con 0x7f52d80b1750 2024-04-25T09:05:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52cfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f52d80cd4d0 0x7f52d80cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52cfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f52d80cd4d0 0x7f52d80cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43464/0 (socket says 172.21.15.59:43464) 2024-04-25T09:05:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52cfe00640 1 -- 172.21.15.59:0/845110715 learned_addr learned my addr 172.21.15.59:0/845110715 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52dd000640 1 --2- 172.21.15.59:0/845110715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d80b1750 0x7f52d80b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52d7e00640 1 --2- 172.21.15.59:0/845110715 >> v2:172.21.15.178:3300/0 conn(0x7f52d8145270 0x7f52d815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52cfe00640 1 -- 172.21.15.59:0/845110715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d80b1750 msgr2=0x7f52d80b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52cfe00640 1 --2- 172.21.15.59:0/845110715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d80b1750 0x7f52d80b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52cfe00640 1 -- 172.21.15.59:0/845110715 >> v2:172.21.15.178:3300/0 conn(0x7f52d8145270 msgr2=0x7f52d815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52cfe00640 1 --2- 172.21.15.59:0/845110715 >> v2:172.21.15.178:3300/0 conn(0x7f52d8145270 0x7f52d815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.265+0000 7f52cfe00640 1 -- 172.21.15.59:0/845110715 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80ce040 con 0x7f52d80cd4d0 2024-04-25T09:05:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52cfe00640 1 --2- 172.21.15.59:0/845110715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d80cd4d0 0x7f52d80cd930 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f52d806f3a0 tx=0x7f52c001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66eb350c1c5c545 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52d7400640 1 -- 172.21.15.59:0/845110715 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c00b1070 con 0x7f52d80cd4d0 2024-04-25T09:05:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52d7400640 1 -- 172.21.15.59:0/845110715 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c00ac630 con 0x7f52d80cd4d0 2024-04-25T09:05:58.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52d7400640 1 -- 172.21.15.59:0/845110715 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c00a8050 con 0x7f52d80cd4d0 2024-04-25T09:05:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52df000640 1 -- 172.21.15.59:0/845110715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d80cd4d0 msgr2=0x7f52d80cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52df000640 1 --2- 172.21.15.59:0/845110715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d80cd4d0 0x7f52d80cd930 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f52d806f3a0 tx=0x7f52c001c520 comp rx=0 tx=0).stop 2024-04-25T09:05:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52df000640 1 -- 172.21.15.59:0/845110715 shutdown_connections 2024-04-25T09:05:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52df000640 1 --2- 172.21.15.59:0/845110715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d80b1750 0x7f52d80b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52df000640 1 --2- 172.21.15.59:0/845110715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d80cd4d0 0x7f52d80cd930 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52df000640 1 --2- 172.21.15.59:0/845110715 >> v2:172.21.15.178:3300/0 conn(0x7f52d8145270 0x7f52d815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52df000640 1 -- 172.21.15.59:0/845110715 >> 172.21.15.59:0/845110715 conn(0x7f52d8066fa0 msgr2=0x7f52d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52df000640 1 -- 172.21.15.59:0/845110715 shutdown_connections 2024-04-25T09:05:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.269+0000 7f52df000640 1 -- 172.21.15.59:0/845110715 wait complete. 2024-04-25T09:05:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52df000640 1 Processor -- start 2024-04-25T09:05:58.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52df000640 1 -- start start 2024-04-25T09:05:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52df000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d80b1750 0x7f52d81417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52df000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52d80cd4d0 0x7f52d815e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52df000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d8145270 0x7f52d815cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52df000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d815c590 con 0x7f52d80b1750 2024-04-25T09:05:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52df000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d815f930 con 0x7f52d80cd4d0 2024-04-25T09:05:58.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52df000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d815c710 con 0x7f52d8145270 2024-04-25T09:05:58.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d80b1750 0x7f52d81417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d80b1750 0x7f52d81417f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43468/0 (socket says 172.21.15.59:43468) 2024-04-25T09:05:58.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52d7e00640 1 -- 172.21.15.59:0/3458094440 learned_addr learned my addr 172.21.15.59:0/3458094440 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:58.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52cfe00640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52d80cd4d0 0x7f52d815e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52dd000640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d8145270 0x7f52d815cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52d7e00640 1 -- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d8145270 msgr2=0x7f52d815cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52d7e00640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d8145270 0x7f52d815cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52d7e00640 1 -- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52d80cd4d0 msgr2=0x7f52d815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52d7e00640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52d80cd4d0 0x7f52d815e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52d7e00640 1 -- 172.21.15.59:0/3458094440 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d80a8660 con 0x7f52d80b1750 2024-04-25T09:05:58.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52cfe00640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52d80cd4d0 0x7f52d815e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:58.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52dd000640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d8145270 0x7f52d815cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:05:58.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52d7e00640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d80b1750 0x7f52d81417f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f52c800d620 tx=0x7f52c800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52d4c00640 1 -- 172.21.15.59:0/3458094440 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800b620 con 0x7f52d80b1750 2024-04-25T09:05:58.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52d4c00640 1 -- 172.21.15.59:0/3458094440 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8019070 con 0x7f52d80b1750 2024-04-25T09:05:58.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52d4c00640 1 -- 172.21.15.59:0/3458094440 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c800b9e0 con 0x7f52d80b1750 2024-04-25T09:05:58.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52df000640 1 -- 172.21.15.59:0/3458094440 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d80a8940 con 0x7f52d80b1750 2024-04-25T09:05:58.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52df000640 1 -- 172.21.15.59:0/3458094440 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d80a8f00 con 0x7f52d80b1750 2024-04-25T09:05:58.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.273+0000 7f52df000640 1 -- 172.21.15.59:0/3458094440 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d80745d0 con 0x7f52d80b1750 2024-04-25T09:05:58.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.277+0000 7f52d4c00640 1 -- 172.21.15.59:0/3458094440 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f52c800bb80 con 0x7f52d80b1750 2024-04-25T09:05:58.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.277+0000 7f52d4c00640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f52b4066f60 0x7f52b4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.277+0000 7f52d4c00640 1 -- 172.21.15.59:0/3458094440 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f52c8085350 con 0x7f52d80b1750 2024-04-25T09:05:58.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.277+0000 7f52cfe00640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f52b4066f60 0x7f52b4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.277+0000 7f52cfe00640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f52b4066f60 0x7f52b4069420 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f52c00ae000 tx=0x7f52c00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.281+0000 7f52d4c00640 1 -- 172.21.15.59:0/3458094440 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f52c8056430 con 0x7f52d80b1750 2024-04-25T09:05:58.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.501+0000 7f52df000640 1 -- 172.21.15.59:0/3458094440 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f52d806b8b0 con 0x7f52d80b1750 2024-04-25T09:05:58.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.745+0000 7f52d4c00640 1 -- 172.21.15.59:0/3458094440 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v243) v1 ==== 169+0+0 (secure 0 0 0) 0x7f52c8055d30 con 0x7f52d80b1750 2024-04-25T09:05:58.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.749+0000 7f52df000640 1 -- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f52b4066f60 msgr2=0x7f52b4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.749+0000 7f52df000640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f52b4066f60 0x7f52b4069420 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f52c00ae000 tx=0x7f52c00a7000 comp rx=0 tx=0).stop 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.749+0000 7f52df000640 1 -- 172.21.15.59:0/3458094440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d80b1750 msgr2=0x7f52d81417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.749+0000 7f52df000640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d80b1750 0x7f52d81417f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f52c800d620 tx=0x7f52c800dae0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.749+0000 7f52df000640 1 -- 172.21.15.59:0/3458094440 shutdown_connections 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.749+0000 7f52df000640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f52b4066f60 0x7f52b4069420 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.749+0000 7f52df000640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52d8145270 0x7f52d815cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.749+0000 7f52df000640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52d80cd4d0 0x7f52d815e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.749+0000 7f52df000640 1 --2- 172.21.15.59:0/3458094440 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52d80b1750 0x7f52d81417f0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.749+0000 7f52df000640 1 -- 172.21.15.59:0/3458094440 >> 172.21.15.59:0/3458094440 conn(0x7f52d8066fa0 msgr2=0x7f52d8165b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.749+0000 7f52df000640 1 -- 172.21.15.59:0/3458094440 shutdown_connections 2024-04-25T09:05:58.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.749+0000 7f52df000640 1 -- 172.21.15.59:0/3458094440 wait complete. 2024-04-25T09:05:58.762 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T09:05:58.762 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T09:05:58.762 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:05:58.762 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:05:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.909+0000 7f0cc2e00640 1 Processor -- start 2024-04-25T09:05:58.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.909+0000 7f0cc2e00640 1 -- start start 2024-04-25T09:05:58.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.913+0000 7f0cc2e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cbc0cef30 0x7f0cbc06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.913+0000 7f0cc2e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cbc15ac60 con 0x7f0cbc144140 2024-04-25T09:05:58.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.913+0000 7f0cc2e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cbc0cf3e0 con 0x7f0cbc06e900 2024-04-25T09:05:58.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.913+0000 7f0cc2e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cbc06ed50 con 0x7f0cbc0cef30 2024-04-25T09:05:58.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.913+0000 7f0cb3400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cbc0cef30 0x7f0cbc06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.913+0000 7f0cbbe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0cbc144140 0x7f0cbc0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60546/0 (socket says 172.21.15.59:60546) 2024-04-25T09:05:58.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.913+0000 7f0cbbe00640 1 -- 172.21.15.59:0/4259773423 learned_addr learned my addr 172.21.15.59:0/4259773423 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:58.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.913+0000 7f0cb3400640 1 -- 172.21.15.59:0/4259773423 >> v1:172.21.15.178:6789/0 conn(0x7f0cbc06e900 legacy=0x7f0cbc0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:58.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.913+0000 7f0cbb400640 1 -- 172.21.15.59:0/4259773423 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106531370 0 0) 0x7f0cbc15ac60 con 0x7f0cbc144140 2024-04-25T09:05:58.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.913+0000 7f0cb3400640 1 -- 172.21.15.59:0/4259773423 >> v1:172.21.15.59:6789/0 conn(0x7f0cbc144140 legacy=0x7f0cbc0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.913+0000 7f0cb3400640 1 -- 172.21.15.59:0/4259773423 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc15af20 con 0x7f0cbc0cef30 2024-04-25T09:05:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cb3400640 1 --2- 172.21.15.59:0/4259773423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cbc0cef30 0x7f0cbc06e3c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40097c0 tx=0x7f0ca401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21faca2827f18db7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cbb400640 1 -- 172.21.15.59:0/4259773423 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40b0070 con 0x7f0cbc0cef30 2024-04-25T09:05:58.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cbb400640 1 -- 172.21.15.59:0/4259773423 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca4004030 con 0x7f0cbc0cef30 2024-04-25T09:05:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cbb400640 1 -- 172.21.15.59:0/4259773423 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4004400 con 0x7f0cbc0cef30 2024-04-25T09:05:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cc2e00640 1 -- 172.21.15.59:0/4259773423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cbc0cef30 msgr2=0x7f0cbc06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cc2e00640 1 --2- 172.21.15.59:0/4259773423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cbc0cef30 0x7f0cbc06e3c0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40097c0 tx=0x7f0ca401c460 comp rx=0 tx=0).stop 2024-04-25T09:05:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cc2e00640 1 -- 172.21.15.59:0/4259773423 shutdown_connections 2024-04-25T09:05:58.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cc2e00640 1 --2- 172.21.15.59:0/4259773423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cbc0cef30 0x7f0cbc06e3c0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cc2e00640 1 -- 172.21.15.59:0/4259773423 >> 172.21.15.59:0/4259773423 conn(0x7f0cbc066fa0 msgr2=0x7f0cbc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:58.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cc2e00640 1 -- 172.21.15.59:0/4259773423 shutdown_connections 2024-04-25T09:05:58.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cc2e00640 1 -- 172.21.15.59:0/4259773423 wait complete. 2024-04-25T09:05:58.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cc2e00640 1 Processor -- start 2024-04-25T09:05:58.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.917+0000 7f0cc2e00640 1 -- start start 2024-04-25T09:05:58.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cc2e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cbc06e900 0x7f0cbc13a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cc2e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cbc0cef30 0x7f0cbc13bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cc2e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cbc144140 0x7f0cbc1407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cc2e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc15ba00 con 0x7f0cbc0cef30 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cc2e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc144520 con 0x7f0cbc144140 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cc2e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cbc15bb80 con 0x7f0cbc06e900 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cbc0cef30 0x7f0cbc13bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cbc0cef30 0x7f0cbc13bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43488/0 (socket says 172.21.15.59:43488) 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb3400640 1 -- 172.21.15.59:0/3118352467 learned_addr learned my addr 172.21.15.59:0/3118352467 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cbbe00640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cbc06e900 0x7f0cbc13a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cc0e00640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cbc144140 0x7f0cbc1407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb3400640 1 -- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cbc06e900 msgr2=0x7f0cbc13a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb3400640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cbc06e900 0x7f0cbc13a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb3400640 1 -- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cbc144140 msgr2=0x7f0cbc1407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb3400640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cbc144140 0x7f0cbc1407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb3400640 1 -- 172.21.15.59:0/3118352467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cbc13a700 con 0x7f0cbc0cef30 2024-04-25T09:05:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb3400640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cbc0cef30 0x7f0cbc13bed0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40ae040 tx=0x7f0ca4019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb8c00640 1 -- 172.21.15.59:0/3118352467 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40b9020 con 0x7f0cbc0cef30 2024-04-25T09:05:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb8c00640 1 -- 172.21.15.59:0/3118352467 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca4003b80 con 0x7f0cbc0cef30 2024-04-25T09:05:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb8c00640 1 -- 172.21.15.59:0/3118352467 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40b0040 con 0x7f0cbc0cef30 2024-04-25T09:05:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cc2e00640 1 -- 172.21.15.59:0/3118352467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cbc13f1e0 con 0x7f0cbc0cef30 2024-04-25T09:05:58.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cc2e00640 1 -- 172.21.15.59:0/3118352467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cbc13ef00 con 0x7f0cbc0cef30 2024-04-25T09:05:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cc2e00640 1 -- 172.21.15.59:0/3118352467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cbc0745d0 con 0x7f0cbc0cef30 2024-04-25T09:05:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.921+0000 7f0cb8c00640 1 -- 172.21.15.59:0/3118352467 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0ca40bc020 con 0x7f0cbc0cef30 2024-04-25T09:05:58.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.925+0000 7f0cb8c00640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0c98066f60 0x7f0c98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.925+0000 7f0cb8c00640 1 -- 172.21.15.59:0/3118352467 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f0ca411efe0 con 0x7f0cbc0cef30 2024-04-25T09:05:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.925+0000 7f0cbbe00640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0c98066f60 0x7f0c98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:58.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.925+0000 7f0cbbe00640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0c98066f60 0x7f0c98069420 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0cac000f70 tx=0x7f0cac007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:58.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:58.929+0000 7f0cb8c00640 1 -- 172.21.15.59:0/3118352467 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0ca40c3030 con 0x7f0cbc0cef30 2024-04-25T09:05:59.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.093+0000 7f0cc2e00640 1 -- 172.21.15.59:0/3118352467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cbc15a6e0 con 0x7f0cbc0cef30 2024-04-25T09:05:59.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.093+0000 7f0cb8c00640 1 -- 172.21.15.59:0/3118352467 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+13292 (secure 0 0 0) 0x7f0ca4016050 con 0x7f0cbc0cef30 2024-04-25T09:05:59.087 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:05:59.087 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":71,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:05:57.747183+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/686404516":"2024-04-26T09:05:54.740495+0000","172.21.15.59:6834/686404516":"2024-04-26T09:05:54.740495+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:05:59.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.097+0000 7f0cc2e00640 1 -- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0c98066f60 msgr2=0x7f0c98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.097+0000 7f0cc2e00640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0c98066f60 0x7f0c98069420 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0cac000f70 tx=0x7f0cac007c10 comp rx=0 tx=0).stop 2024-04-25T09:05:59.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.097+0000 7f0cc2e00640 1 -- 172.21.15.59:0/3118352467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cbc0cef30 msgr2=0x7f0cbc13bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.097+0000 7f0cc2e00640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cbc0cef30 0x7f0cbc13bed0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40ae040 tx=0x7f0ca4019200 comp rx=0 tx=0).stop 2024-04-25T09:05:59.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.097+0000 7f0cc2e00640 1 -- 172.21.15.59:0/3118352467 shutdown_connections 2024-04-25T09:05:59.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.097+0000 7f0cc2e00640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0c98066f60 0x7f0c98069420 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.097+0000 7f0cc2e00640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cbc144140 0x7f0cbc1407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.097+0000 7f0cc2e00640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cbc0cef30 0x7f0cbc13bed0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.097+0000 7f0cc2e00640 1 --2- 172.21.15.59:0/3118352467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cbc06e900 0x7f0cbc13a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.097+0000 7f0cc2e00640 1 -- 172.21.15.59:0/3118352467 >> 172.21.15.59:0/3118352467 conn(0x7f0cbc066fa0 msgr2=0x7f0cbc165c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.097+0000 7f0cc2e00640 1 -- 172.21.15.59:0/3118352467 shutdown_connections 2024-04-25T09:05:59.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.097+0000 7f0cc2e00640 1 -- 172.21.15.59:0/3118352467 wait complete. 2024-04-25T09:05:59.108 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:05:59.108 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:05:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.261+0000 7fe8f0200640 1 Processor -- start 2024-04-25T09:05:59.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.261+0000 7fe8f0200640 1 -- start start 2024-04-25T09:05:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.261+0000 7fe8f0200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe8e815aa90 0x7fe8e80cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.261+0000 7fe8f0200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e80b2d60 0x7fe8e806ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.261+0000 7fe8f0200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8e806f230 0x7fe8e80cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.261+0000 7fe8f0200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e80cf7a0 con 0x7fe8e806f230 2024-04-25T09:05:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.261+0000 7fe8f0200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8e80cfa20 con 0x7fe8e815aa90 2024-04-25T09:05:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.261+0000 7fe8f0200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e80cfd00 con 0x7fe8e80b2d60 2024-04-25T09:05:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.261+0000 7fe8ee200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8e806f230 0x7fe8e80cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.261+0000 7fe8ee200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8e806f230 0x7fe8e80cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43502/0 (socket says 172.21.15.59:43502) 2024-04-25T09:05:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.261+0000 7fe8ee200640 1 -- 172.21.15.59:0/4292100536 learned_addr learned my addr 172.21.15.59:0/4292100536 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.261+0000 7fe8ece00640 1 --2- 172.21.15.59:0/4292100536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e80b2d60 0x7fe8e806ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8ed800640 1 --2- 172.21.15.59:0/4292100536 >> v2:172.21.15.178:3300/0 conn(0x7fe8e815aa90 0x7fe8e80cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8ee200640 1 -- 172.21.15.59:0/4292100536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e80b2d60 msgr2=0x7fe8e806ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:59.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8ee200640 1 --2- 172.21.15.59:0/4292100536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e80b2d60 0x7fe8e806ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8ee200640 1 -- 172.21.15.59:0/4292100536 >> v2:172.21.15.178:3300/0 conn(0x7fe8e815aa90 msgr2=0x7fe8e80cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:05:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8ee200640 1 --2- 172.21.15.59:0/4292100536 >> v2:172.21.15.178:3300/0 conn(0x7fe8e815aa90 0x7fe8e80cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8ee200640 1 -- 172.21.15.59:0/4292100536 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e80cffe0 con 0x7fe8e806f230 2024-04-25T09:05:59.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8ed800640 1 --2- 172.21.15.59:0/4292100536 >> v2:172.21.15.178:3300/0 conn(0x7fe8e815aa90 0x7fe8e80cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:59.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8ee200640 1 --2- 172.21.15.59:0/4292100536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e806f230 0x7fe8e80cce90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80d16c0 tx=0x7fe8e001c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1f0fef5c23dfdb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8e7e00640 1 -- 172.21.15.59:0/4292100536 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00ac020 con 0x7fe8e806f230 2024-04-25T09:05:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8e7e00640 1 -- 172.21.15.59:0/4292100536 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e00a6440 con 0x7fe8e806f230 2024-04-25T09:05:59.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8e7e00640 1 -- 172.21.15.59:0/4292100536 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00a6810 con 0x7fe8e806f230 2024-04-25T09:05:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8f0200640 1 -- 172.21.15.59:0/4292100536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e806f230 msgr2=0x7fe8e80cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.265+0000 7fe8f0200640 1 --2- 172.21.15.59:0/4292100536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e806f230 0x7fe8e80cce90 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fe8e80d16c0 tx=0x7fe8e001c6a0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 -- 172.21.15.59:0/4292100536 shutdown_connections 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 --2- 172.21.15.59:0/4292100536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e806f230 0x7fe8e80cce90 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 --2- 172.21.15.59:0/4292100536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e80b2d60 0x7fe8e806ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 --2- 172.21.15.59:0/4292100536 >> v2:172.21.15.178:3300/0 conn(0x7fe8e815aa90 0x7fe8e80cf260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 -- 172.21.15.59:0/4292100536 >> 172.21.15.59:0/4292100536 conn(0x7fe8e80b2240 msgr2=0x7fe8e80b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 -- 172.21.15.59:0/4292100536 shutdown_connections 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 -- 172.21.15.59:0/4292100536 wait complete. 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 Processor -- start 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 -- start start 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e806f230 0x7fe8e80af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8e80b2d60 0x7fe8e814aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e815aa90 0x7fe8e8149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e806b7b0 con 0x7fe8e815aa90 2024-04-25T09:05:59.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e806b630 con 0x7fe8e80b2d60 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e806b930 con 0x7fe8e806f230 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8ee200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e815aa90 0x7fe8e8149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8ee200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e815aa90 0x7fe8e8149230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43518/0 (socket says 172.21.15.59:43518) 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8ee200640 1 -- 172.21.15.59:0/661574559 learned_addr learned my addr 172.21.15.59:0/661574559 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8ece00640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8e80b2d60 0x7fe8e814aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8ed800640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e806f230 0x7fe8e80af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8ee200640 1 -- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e806f230 msgr2=0x7fe8e80af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8ee200640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e806f230 0x7fe8e80af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8ee200640 1 -- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8e80b2d60 msgr2=0x7fe8e814aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8ee200640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8e80b2d60 0x7fe8e814aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8ee200640 1 -- 172.21.15.59:0/661574559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e8149770 con 0x7fe8e815aa90 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8ece00640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8e80b2d60 0x7fe8e814aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8ee200640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e815aa90 0x7fe8e8149230 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe8e001cf40 tx=0x7fe8e0019440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8e5600640 1 -- 172.21.15.59:0/661574559 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00ac040 con 0x7fe8e815aa90 2024-04-25T09:05:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8e5600640 1 -- 172.21.15.59:0/661574559 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e00a6970 con 0x7fe8e815aa90 2024-04-25T09:05:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8e5600640 1 -- 172.21.15.59:0/661574559 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00a6d40 con 0x7fe8e815aa90 2024-04-25T09:05:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.269+0000 7fe8f0200640 1 -- 172.21.15.59:0/661574559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8e814aca0 con 0x7fe8e815aa90 2024-04-25T09:05:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.273+0000 7fe8f0200640 1 -- 172.21.15.59:0/661574559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8e80ae3b0 con 0x7fe8e815aa90 2024-04-25T09:05:59.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.273+0000 7fe8f0200640 1 -- 172.21.15.59:0/661574559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8e80745d0 con 0x7fe8e815aa90 2024-04-25T09:05:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.273+0000 7fe8e5600640 1 -- 172.21.15.59:0/661574559 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe8e00af020 con 0x7fe8e815aa90 2024-04-25T09:05:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.273+0000 7fe8e5600640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8c8066f60 0x7fe8c8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.273+0000 7fe8e5600640 1 -- 172.21.15.59:0/661574559 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe8e011ea90 con 0x7fe8e815aa90 2024-04-25T09:05:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.273+0000 7fe8ed800640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8c8066f60 0x7fe8c8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.273+0000 7fe8ed800640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8c8066f60 0x7fe8c8069420 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe8e815a800 tx=0x7fe8dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.277+0000 7fe8e5600640 1 -- 172.21.15.59:0/661574559 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe8e814aca0 con 0x7fe8e815aa90 2024-04-25T09:05:59.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.441+0000 7fe8f0200640 1 -- 172.21.15.59:0/661574559 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe8e806e8c0 con 0x7fe8e815aa90 2024-04-25T09:05:59.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.441+0000 7fe8e5600640 1 -- 172.21.15.59:0/661574559 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8e00165e0 con 0x7fe8e815aa90 2024-04-25T09:05:59.435 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:05:59.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.445+0000 7fe8f0200640 1 -- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8c8066f60 msgr2=0x7fe8c8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.445+0000 7fe8f0200640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8c8066f60 0x7fe8c8069420 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fe8e815a800 tx=0x7fe8dc008040 comp rx=0 tx=0).stop 2024-04-25T09:05:59.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.445+0000 7fe8f0200640 1 -- 172.21.15.59:0/661574559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e815aa90 msgr2=0x7fe8e8149230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.445+0000 7fe8f0200640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e815aa90 0x7fe8e8149230 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fe8e001cf40 tx=0x7fe8e0019440 comp rx=0 tx=0).stop 2024-04-25T09:05:59.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.445+0000 7fe8f0200640 1 -- 172.21.15.59:0/661574559 shutdown_connections 2024-04-25T09:05:59.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.445+0000 7fe8f0200640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8c8066f60 0x7fe8c8069420 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.445+0000 7fe8f0200640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8e815aa90 0x7fe8e8149230 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.445+0000 7fe8f0200640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8e80b2d60 0x7fe8e814aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.445+0000 7fe8f0200640 1 --2- 172.21.15.59:0/661574559 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8e806f230 0x7fe8e80af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.445+0000 7fe8f0200640 1 -- 172.21.15.59:0/661574559 >> 172.21.15.59:0/661574559 conn(0x7fe8e80b2240 msgr2=0x7fe8e80c5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.445+0000 7fe8f0200640 1 -- 172.21.15.59:0/661574559 shutdown_connections 2024-04-25T09:05:59.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.445+0000 7fe8f0200640 1 -- 172.21.15.59:0/661574559 wait complete. 2024-04-25T09:05:59.457 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-25T09:05:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.609+0000 7ffb61a00640 1 Processor -- start 2024-04-25T09:05:59.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.609+0000 7ffb61a00640 1 -- start start 2024-04-25T09:05:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.613+0000 7ffb61a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb5c145020 0x7ffb5c072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.613+0000 7ffb61a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5c0ce130 con 0x7ffb5c145400 2024-04-25T09:05:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.613+0000 7ffb61a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5c073200 con 0x7ffb5c06ac10 2024-04-25T09:05:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.613+0000 7ffb61a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb5c0cd360 con 0x7ffb5c145020 2024-04-25T09:05:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.613+0000 7ffb5aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb5c145020 0x7ffb5c072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.613+0000 7ffb5a000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffb5c145400 0x7ffb5c06fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60556/0 (socket says 172.21.15.59:60556) 2024-04-25T09:05:59.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.613+0000 7ffb5a000640 1 -- 172.21.15.59:0/2561607346 learned_addr learned my addr 172.21.15.59:0/2561607346 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:05:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.613+0000 7ffb5aa00640 1 -- 172.21.15.59:0/2561607346 >> v1:172.21.15.178:6789/0 conn(0x7ffb5c06ac10 legacy=0x7ffb5c15f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.613+0000 7ffb5aa00640 1 -- 172.21.15.59:0/2561607346 >> v1:172.21.15.59:6789/0 conn(0x7ffb5c145400 legacy=0x7ffb5c06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.613+0000 7ffb5aa00640 1 -- 172.21.15.59:0/2561607346 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c0cd5b0 con 0x7ffb5c145020 2024-04-25T09:05:59.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb5aa00640 1 --2- 172.21.15.59:0/2561607346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb5c145020 0x7ffb5c072cc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0cd4e0 tx=0x7ffb4c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11197044f5ce1623 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb59600640 1 -- 172.21.15.59:0/2561607346 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c0b2070 con 0x7ffb5c145020 2024-04-25T09:05:59.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb59600640 1 -- 172.21.15.59:0/2561607346 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4c0ad680 con 0x7ffb5c145020 2024-04-25T09:05:59.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb59600640 1 -- 172.21.15.59:0/2561607346 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c0ada50 con 0x7ffb5c145020 2024-04-25T09:05:59.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb61a00640 1 -- 172.21.15.59:0/2561607346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb5c145020 msgr2=0x7ffb5c072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb61a00640 1 --2- 172.21.15.59:0/2561607346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb5c145020 0x7ffb5c072cc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0cd4e0 tx=0x7ffb4c01c470 comp rx=0 tx=0).stop 2024-04-25T09:05:59.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb61a00640 1 -- 172.21.15.59:0/2561607346 shutdown_connections 2024-04-25T09:05:59.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb61a00640 1 --2- 172.21.15.59:0/2561607346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb5c145020 0x7ffb5c072cc0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb61a00640 1 -- 172.21.15.59:0/2561607346 >> 172.21.15.59:0/2561607346 conn(0x7ffb5c0b2400 msgr2=0x7ffb5c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:05:59.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb61a00640 1 -- 172.21.15.59:0/2561607346 shutdown_connections 2024-04-25T09:05:59.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb61a00640 1 -- 172.21.15.59:0/2561607346 wait complete. 2024-04-25T09:05:59.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb61a00640 1 Processor -- start 2024-04-25T09:05:59.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.617+0000 7ffb61a00640 1 -- start start 2024-04-25T09:05:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb61a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb5c06ac10 0x7ffb5c13c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb61a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb5c145020 0x7ffb5c0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb61a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb5c145400 0x7ffb5c13e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb61a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0d01e0 con 0x7ffb5c145020 2024-04-25T09:05:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb61a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c06b450 con 0x7ffb5c06ac10 2024-04-25T09:05:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb61a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5c0d0360 con 0x7ffb5c145400 2024-04-25T09:05:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb5a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb5c145020 0x7ffb5c0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb5a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb5c145020 0x7ffb5c0b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43534/0 (socket says 172.21.15.59:43534) 2024-04-25T09:05:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb5a000640 1 -- 172.21.15.59:0/3921635314 learned_addr learned my addr 172.21.15.59:0/3921635314 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:05:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb5aa00640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb5c06ac10 0x7ffb5c13c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb5b400640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb5c145400 0x7ffb5c13e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb5a000640 1 -- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb5c145400 msgr2=0x7ffb5c13e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb5a000640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb5c145400 0x7ffb5c13e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb5a000640 1 -- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb5c06ac10 msgr2=0x7ffb5c13c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:05:59.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb5a000640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb5c06ac10 0x7ffb5c13c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:05:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb5a000640 1 -- 172.21.15.59:0/3921635314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5c164b20 con 0x7ffb5c145020 2024-04-25T09:05:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb5a000640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb5c145020 0x7ffb5c0b50e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c500 tx=0x7ffb4800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb52a00640 1 -- 172.21.15.59:0/3921635314 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb48017070 con 0x7ffb5c145020 2024-04-25T09:05:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb52a00640 1 -- 172.21.15.59:0/3921635314 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb48005cf0 con 0x7ffb5c145020 2024-04-25T09:05:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb52a00640 1 -- 172.21.15.59:0/3921635314 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb480072f0 con 0x7ffb5c145020 2024-04-25T09:05:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb61a00640 1 -- 172.21.15.59:0/3921635314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5c142e30 con 0x7ffb5c145020 2024-04-25T09:05:59.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb61a00640 1 -- 172.21.15.59:0/3921635314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c1433f0 con 0x7ffb5c145020 2024-04-25T09:05:59.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb61a00640 1 -- 172.21.15.59:0/3921635314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5c0745d0 con 0x7ffb5c145020 2024-04-25T09:05:59.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.621+0000 7ffb52a00640 1 -- 172.21.15.59:0/3921635314 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffb4801a070 con 0x7ffb5c145020 2024-04-25T09:05:59.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.625+0000 7ffb52a00640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffb3c066f60 0x7ffb3c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:05:59.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.625+0000 7ffb52a00640 1 -- 172.21.15.59:0/3921635314 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5335+0+0 (secure 0 0 0) 0x7ffb48084150 con 0x7ffb5c145020 2024-04-25T09:05:59.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.625+0000 7ffb5aa00640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffb3c066f60 0x7ffb3c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:05:59.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.625+0000 7ffb5aa00640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffb3c066f60 0x7ffb3c069420 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0af000 tx=0x7ffb4c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:05:59.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.629+0000 7ffb52a00640 1 -- 172.21.15.59:0/3921635314 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffb48054c70 con 0x7ffb5c145020 2024-04-25T09:05:59.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:05:59.849+0000 7ffb61a00640 1 -- 172.21.15.59:0/3921635314 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7ffb5c143630 con 0x7ffb5c145020 2024-04-25T09:06:00.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.753+0000 7ffb52a00640 1 -- 172.21.15.59:0/3921635314 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v245) v1 ==== 169+0+0 (secure 0 0 0) 0x7ffb48058d10 con 0x7ffb5c145020 2024-04-25T09:06:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.753+0000 7ffb61a00640 1 -- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffb3c066f60 msgr2=0x7ffb3c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.753+0000 7ffb61a00640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffb3c066f60 0x7ffb3c069420 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c0af000 tx=0x7ffb4c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.753+0000 7ffb61a00640 1 -- 172.21.15.59:0/3921635314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb5c145020 msgr2=0x7ffb5c0b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.753+0000 7ffb61a00640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb5c145020 0x7ffb5c0b50e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c500 tx=0x7ffb4800c9c0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.753+0000 7ffb61a00640 1 -- 172.21.15.59:0/3921635314 shutdown_connections 2024-04-25T09:06:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.753+0000 7ffb61a00640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffb3c066f60 0x7ffb3c069420 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.753+0000 7ffb61a00640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffb5c145400 0x7ffb5c13e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.753+0000 7ffb61a00640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb5c145020 0x7ffb5c0b50e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.753+0000 7ffb61a00640 1 --2- 172.21.15.59:0/3921635314 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffb5c06ac10 0x7ffb5c13c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.753+0000 7ffb61a00640 1 -- 172.21.15.59:0/3921635314 >> 172.21.15.59:0/3921635314 conn(0x7ffb5c0b2400 msgr2=0x7ffb5c073770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.757+0000 7ffb61a00640 1 -- 172.21.15.59:0/3921635314 shutdown_connections 2024-04-25T09:06:00.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.757+0000 7ffb61a00640 1 -- 172.21.15.59:0/3921635314 wait complete. 2024-04-25T09:06:00.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:06:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f647c800640 1 Processor -- start 2024-04-25T09:06:00.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f647c800640 1 -- start start 2024-04-25T09:06:00.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f647c800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6474159320 0x7f647415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f647c800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f647415f440 0x7f647406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f647c800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647415fc00 con 0x7f647406e010 2024-04-25T09:06:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f647c800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647406d640 con 0x7f647415f440 2024-04-25T09:06:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f647c800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647415fee0 con 0x7f6474159320 2024-04-25T09:06:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f6479400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f647415f440 0x7f647406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f647a800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f647406e010 0x7f647406e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52010/0 (socket says 172.21.15.59:52010) 2024-04-25T09:06:00.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f647a800640 1 -- 172.21.15.59:0/2300339081 learned_addr learned my addr 172.21.15.59:0/2300339081 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:00.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f6479e00640 1 --2- 172.21.15.59:0/2300339081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6474159320 0x7f647415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f6479400640 1 -- 172.21.15.59:0/2300339081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6474159320 msgr2=0x7f647415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:00.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f6479400640 1 --2- 172.21.15.59:0/2300339081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6474159320 0x7f647415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f6478a00640 1 -- 172.21.15.59:0/2300339081 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031122965 0 0) 0x7f647415fc00 con 0x7f647406e010 2024-04-25T09:06:00.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f6479400640 1 -- 172.21.15.59:0/2300339081 >> v1:172.21.15.59:6789/0 conn(0x7f647406e010 legacy=0x7f647406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.921+0000 7f6479400640 1 -- 172.21.15.59:0/2300339081 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64741601c0 con 0x7f647415f440 2024-04-25T09:06:00.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.925+0000 7f6479400640 1 --2- 172.21.15.59:0/2300339081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647415f440 0x7f647406dad0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f64640097c0 tx=0x7f646401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973eb057cc5e681f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.925+0000 7f6478a00640 1 -- 172.21.15.59:0/2300339081 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640ab600 con 0x7f647415f440 2024-04-25T09:06:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.925+0000 7f6478a00640 1 -- 172.21.15.59:0/2300339081 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64640b0070 con 0x7f647415f440 2024-04-25T09:06:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.925+0000 7f6478a00640 1 -- 172.21.15.59:0/2300339081 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64640ab9c0 con 0x7f647415f440 2024-04-25T09:06:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.925+0000 7f647c800640 1 -- 172.21.15.59:0/2300339081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647415f440 msgr2=0x7f647406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.925+0000 7f647c800640 1 --2- 172.21.15.59:0/2300339081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647415f440 0x7f647406dad0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f64640097c0 tx=0x7f646401c3e0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.925+0000 7f647c800640 1 -- 172.21.15.59:0/2300339081 shutdown_connections 2024-04-25T09:06:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.925+0000 7f647c800640 1 --2- 172.21.15.59:0/2300339081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647415f440 0x7f647406dad0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.925+0000 7f647c800640 1 --2- 172.21.15.59:0/2300339081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6474159320 0x7f647415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.925+0000 7f647c800640 1 -- 172.21.15.59:0/2300339081 >> 172.21.15.59:0/2300339081 conn(0x7f6474067080 msgr2=0x7f647406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.925+0000 7f647c800640 1 -- 172.21.15.59:0/2300339081 shutdown_connections 2024-04-25T09:06:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.925+0000 7f647c800640 1 -- 172.21.15.59:0/2300339081 wait complete. 2024-04-25T09:06:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f647c800640 1 Processor -- start 2024-04-25T09:06:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f647c800640 1 -- start start 2024-04-25T09:06:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f647c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647406e010 0x7f6474141fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f647c800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6474159320 0x7f64740b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f647c800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f647415f440 0x7f647415d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f647c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6474071c00 con 0x7f647406e010 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f647c800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6474071a80 con 0x7f6474159320 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f647c800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647406ebb0 con 0x7f647415f440 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f6479e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647406e010 0x7f6474141fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f6479e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647406e010 0x7f6474141fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36882/0 (socket says 172.21.15.59:36882) 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f6479e00640 1 -- 172.21.15.59:0/212632545 learned_addr learned my addr 172.21.15.59:0/212632545 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f647a800640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f647415f440 0x7f647415d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f6479400640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6474159320 0x7f64740b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f6479e00640 1 -- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f647415f440 msgr2=0x7f647415d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f6479e00640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f647415f440 0x7f647415d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f6479e00640 1 -- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6474159320 msgr2=0x7f64740b1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f6479e00640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6474159320 0x7f64740b1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f6479e00640 1 -- 172.21.15.59:0/212632545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647415c6e0 con 0x7f647406e010 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f6479400640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6474159320 0x7f64740b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f647a800640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f647415f440 0x7f647415d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f6479e00640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647406e010 0x7f6474141fb0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f646800d5f0 tx=0x7f646800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f646e000640 1 -- 172.21.15.59:0/212632545 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64680125f0 con 0x7f647406e010 2024-04-25T09:06:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f646e000640 1 -- 172.21.15.59:0/212632545 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6468019070 con 0x7f647406e010 2024-04-25T09:06:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f646e000640 1 -- 172.21.15.59:0/212632545 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64680129b0 con 0x7f647406e010 2024-04-25T09:06:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.929+0000 7f647c800640 1 -- 172.21.15.59:0/212632545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6474165900 con 0x7f647406e010 2024-04-25T09:06:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.933+0000 7f647c800640 1 -- 172.21.15.59:0/212632545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64740b0f20 con 0x7f647406e010 2024-04-25T09:06:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.933+0000 7f647c800640 1 -- 172.21.15.59:0/212632545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64740745d0 con 0x7f647406e010 2024-04-25T09:06:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.933+0000 7f646e000640 1 -- 172.21.15.59:0/212632545 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6468012b50 con 0x7f647406e010 2024-04-25T09:06:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.933+0000 7f646e000640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6458066f60 0x7f6458069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.933+0000 7f646e000640 1 -- 172.21.15.59:0/212632545 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f64680853a0 con 0x7f647406e010 2024-04-25T09:06:00.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.933+0000 7f6479400640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6458066f60 0x7f6458069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:00.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.933+0000 7f6479400640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6458066f60 0x7f6458069420 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f64640af000 tx=0x7f6464008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:00.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:00.937+0000 7f646e000640 1 -- 172.21.15.59:0/212632545 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6468056480 con 0x7f647406e010 2024-04-25T09:06:01.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.101+0000 7f647c800640 1 -- 172.21.15.59:0/212632545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f64740b0cd0 con 0x7f647406e010 2024-04-25T09:06:01.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f646e000640 1 -- 172.21.15.59:0/212632545 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6468055d80 con 0x7f647406e010 2024-04-25T09:06:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f647c800640 1 -- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6458066f60 msgr2=0x7f6458069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f647c800640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6458066f60 0x7f6458069420 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f64640af000 tx=0x7f6464008040 comp rx=0 tx=0).stop 2024-04-25T09:06:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f647c800640 1 -- 172.21.15.59:0/212632545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647406e010 msgr2=0x7f6474141fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f647c800640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647406e010 0x7f6474141fb0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f646800d5f0 tx=0x7f646800dab0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f647c800640 1 -- 172.21.15.59:0/212632545 shutdown_connections 2024-04-25T09:06:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f647c800640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6458066f60 0x7f6458069420 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f647c800640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f647415f440 0x7f647415d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f647c800640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6474159320 0x7f64740b1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f647c800640 1 --2- 172.21.15.59:0/212632545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f647406e010 0x7f6474141fb0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f647c800640 1 -- 172.21.15.59:0/212632545 >> 172.21.15.59:0/212632545 conn(0x7f6474067080 msgr2=0x7f64740cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f647c800640 1 -- 172.21.15.59:0/212632545 shutdown_connections 2024-04-25T09:06:01.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.105+0000 7f647c800640 1 -- 172.21.15.59:0/212632545 wait complete. 2024-04-25T09:06:01.117 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:06:01.117 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:01.238 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:06:01.329 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:06:01.330 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:06:01.330 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:01.339 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:01.339 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:06:01.339 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:01.349 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:01.349 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:06:01.349 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:01.392 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:06:01.392 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:06:01.392 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:01.401 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:06:01.401 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:06:01.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.589+0000 7f54e0c00640 1 Processor -- start 2024-04-25T09:06:01.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.589+0000 7f54e0c00640 1 -- start start 2024-04-25T09:06:01.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54e0c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54dc06b320 0x7f54dc06fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54e0c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54dc15ca20 0x7f54dc0cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54e0c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc0cfa70 con 0x7f54dc156090 2024-04-25T09:06:01.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54e0c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54dc0703a0 con 0x7f54dc15ca20 2024-04-25T09:06:01.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54e0c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc070680 con 0x7f54dc06b320 2024-04-25T09:06:01.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54da800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54dc15ca20 0x7f54dc0cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54da800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54dc15ca20 0x7f54dc0cff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36892/0 (socket says 172.21.15.59:36892) 2024-04-25T09:06:01.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54da800640 1 -- 172.21.15.59:0/3888555245 learned_addr learned my addr 172.21.15.59:0/3888555245 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:01.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54d3e00640 1 --2- 172.21.15.59:0/3888555245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54dc06b320 0x7f54dc06fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54da800640 1 -- 172.21.15.59:0/3888555245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54dc06b320 msgr2=0x7f54dc06fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:01.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54da800640 1 --2- 172.21.15.59:0/3888555245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54dc06b320 0x7f54dc06fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54da800640 1 -- 172.21.15.59:0/3888555245 >> v1:172.21.15.178:6789/0 conn(0x7f54dc156090 legacy=0x7f54dc06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:01.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54da800640 1 -- 172.21.15.59:0/3888555245 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc15ceb0 con 0x7f54dc15ca20 2024-04-25T09:06:01.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.593+0000 7f54d3e00640 1 --2- 172.21.15.59:0/3888555245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54dc06b320 0x7f54dc06fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:01.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54da800640 1 --2- 172.21.15.59:0/3888555245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54dc15ca20 0x7f54dc0cff20 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009e50 tx=0x7f54d401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965b054d0a085507 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:01.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54d9400640 1 -- 172.21.15.59:0/3888555245 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d40a5780 con 0x7f54dc15ca20 2024-04-25T09:06:01.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54d9400640 1 -- 172.21.15.59:0/3888555245 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d40a5920 con 0x7f54dc15ca20 2024-04-25T09:06:01.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54d9400640 1 -- 172.21.15.59:0/3888555245 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d40a5cf0 con 0x7f54dc15ca20 2024-04-25T09:06:01.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 -- 172.21.15.59:0/3888555245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54dc15ca20 msgr2=0x7f54dc0cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 --2- 172.21.15.59:0/3888555245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54dc15ca20 0x7f54dc0cff20 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f54d4009e50 tx=0x7f54d401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 -- 172.21.15.59:0/3888555245 shutdown_connections 2024-04-25T09:06:01.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 --2- 172.21.15.59:0/3888555245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54dc15ca20 0x7f54dc0cff20 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 --2- 172.21.15.59:0/3888555245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54dc06b320 0x7f54dc06fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 -- 172.21.15.59:0/3888555245 >> 172.21.15.59:0/3888555245 conn(0x7f54dc06e3a0 msgr2=0x7f54dc06e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:01.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 -- 172.21.15.59:0/3888555245 shutdown_connections 2024-04-25T09:06:01.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 -- 172.21.15.59:0/3888555245 wait complete. 2024-04-25T09:06:01.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 Processor -- start 2024-04-25T09:06:01.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 -- start start 2024-04-25T09:06:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54dc06b320 0x7f54dc14bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54dc156090 0x7f54dc150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54dc15ca20 0x7f54dc1519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc0d1000 con 0x7f54dc156090 2024-04-25T09:06:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc0d0e80 con 0x7f54dc06b320 2024-04-25T09:06:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.597+0000 7f54e0c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc0d1180 con 0x7f54dc15ca20 2024-04-25T09:06:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54dc156090 0x7f54dc150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54dc156090 0x7f54dc150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36908/0 (socket says 172.21.15.59:36908) 2024-04-25T09:06:01.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d3e00640 1 -- 172.21.15.59:0/939162330 learned_addr learned my addr 172.21.15.59:0/939162330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54da800640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54dc15ca20 0x7f54dc1519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d9e00640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54dc06b320 0x7f54dc14bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d3e00640 1 -- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54dc15ca20 msgr2=0x7f54dc1519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d3e00640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54dc15ca20 0x7f54dc1519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d3e00640 1 -- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54dc06b320 msgr2=0x7f54dc14bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d3e00640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54dc06b320 0x7f54dc14bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d3e00640 1 -- 172.21.15.59:0/939162330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc150b00 con 0x7f54dc156090 2024-04-25T09:06:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d3e00640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54dc156090 0x7f54dc150190 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f54c400c7f0 tx=0x7f54c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d2000640 1 -- 172.21.15.59:0/939162330 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4015070 con 0x7f54dc156090 2024-04-25T09:06:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d2000640 1 -- 172.21.15.59:0/939162330 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c4007820 con 0x7f54dc156090 2024-04-25T09:06:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54e0c00640 1 -- 172.21.15.59:0/939162330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54dc150de0 con 0x7f54dc156090 2024-04-25T09:06:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d2000640 1 -- 172.21.15.59:0/939162330 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c4007c10 con 0x7f54dc156090 2024-04-25T09:06:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54e0c00640 1 -- 172.21.15.59:0/939162330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc1513a0 con 0x7f54dc156090 2024-04-25T09:06:01.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54e0c00640 1 -- 172.21.15.59:0/939162330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54dc0745d0 con 0x7f54dc156090 2024-04-25T09:06:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d2000640 1 -- 172.21.15.59:0/939162330 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f54c4018070 con 0x7f54dc156090 2024-04-25T09:06:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.601+0000 7f54d2000640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f54b8066f90 0x7f54b8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:01.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.605+0000 7f54d2000640 1 -- 172.21.15.59:0/939162330 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5335+0+0 (secure 0 0 0) 0x7f54c4084fc0 con 0x7f54dc156090 2024-04-25T09:06:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.605+0000 7f54d9e00640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f54b8066f90 0x7f54b8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:01.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.605+0000 7f54d9e00640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f54b8066f90 0x7f54b8069450 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00b810 tx=0x7f54cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:01.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.605+0000 7f54d2000640 1 -- 172.21.15.59:0/939162330 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f54c4056140 con 0x7f54dc156090 2024-04-25T09:06:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.801+0000 7f54e0c00640 1 -- 172.21.15.59:0/939162330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54dc0b23e0 con 0x7f54dc156090 2024-04-25T09:06:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.801+0000 7f54d2000640 1 -- 172.21.15.59:0/939162330 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3696 (secure 0 0 0) 0x7f54c4055a40 con 0x7f54dc156090 2024-04-25T09:06:01.795 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:01.795 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5540,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2580922028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2580922028},{"type":"v1","addr":"172.21.15.178:6837","nonce":2580922028}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6016,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/126805970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":126805970},{"type":"v1","addr":"172.21.15.178:6836","nonce":126805970}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":32},{"gid":6216,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/402319604","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":402319604},{"type":"v1","addr":"172.21.15.59:6833","nonce":402319604}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":31},{"gid":6705,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/181719637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":181719637},{"type":"v1","addr":"172.21.15.59:6835","nonce":181719637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[]} 2024-04-25T09:06:01.795 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 42 2024-04-25T09:06:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.805+0000 7f54e0c00640 1 -- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f54b8066f90 msgr2=0x7f54b8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.805+0000 7f54e0c00640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f54b8066f90 0x7f54b8069450 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f54cc00b810 tx=0x7f54cc008040 comp rx=0 tx=0).stop 2024-04-25T09:06:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.805+0000 7f54e0c00640 1 -- 172.21.15.59:0/939162330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54dc156090 msgr2=0x7f54dc150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.805+0000 7f54e0c00640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54dc156090 0x7f54dc150190 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f54c400c7f0 tx=0x7f54c400ccb0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.805+0000 7f54e0c00640 1 -- 172.21.15.59:0/939162330 shutdown_connections 2024-04-25T09:06:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.805+0000 7f54e0c00640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f54b8066f90 0x7f54b8069450 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.805+0000 7f54e0c00640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f54dc15ca20 0x7f54dc1519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.805+0000 7f54e0c00640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54dc156090 0x7f54dc150190 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.805+0000 7f54e0c00640 1 --2- 172.21.15.59:0/939162330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54dc06b320 0x7f54dc14bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.805+0000 7f54e0c00640 1 -- 172.21.15.59:0/939162330 >> 172.21.15.59:0/939162330 conn(0x7f54dc06e3a0 msgr2=0x7f54dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.805+0000 7f54e0c00640 1 -- 172.21.15.59:0/939162330 shutdown_connections 2024-04-25T09:06:01.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:01.805+0000 7f54e0c00640 1 -- 172.21.15.59:0/939162330 wait complete. 2024-04-25T09:06:01.816 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:06:01.816 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:06:01.817 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:06:01.817 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:01.817 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:06:01.817 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:06:01.817 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:06:01.817 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:01.817 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:06:01.817 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:06:01.818 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:06:01.818 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:01.818 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:06:01.818 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:06:01.818 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:06:01.818 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:06:01.829 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:06:01.829 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:06:01.830 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:06:01.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:06:01.832 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:06:01.832 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:06:01.832 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:06:01.833 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:06:01.874 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:06:01.874 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:01.875 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:06:01.875 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:01.881 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:06:01.881 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:01.883 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:06:01.883 DEBUG:teuthology.parallel:result is None 2024-04-25T09:06:01.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:06:01.959 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:06:01.960 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T09:06:01.973 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-04-25T09:06:01.974 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-04-25T09:06:02.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.037+0000 7fe3ae400640 1 Processor -- start 2024-04-25T09:06:02.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.037+0000 7fe3ae400640 1 -- start start 2024-04-25T09:06:02.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.037+0000 7fe3ae400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe3a815dd90 0x7fe3a8071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.037+0000 7fe3ae400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a8072040 0x7fe3a8161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3ae400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3a8072460 con 0x7fe3a8161cc0 2024-04-25T09:06:02.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3ae400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3a80b2dc0 con 0x7fe3a815dd90 2024-04-25T09:06:02.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3ae400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a806ac10 con 0x7fe3a8072040 2024-04-25T09:06:02.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3a7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe3a815dd90 0x7fe3a8071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3a7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe3a815dd90 0x7fe3a8071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36976/0 (socket says 172.21.15.59:36976) 2024-04-25T09:06:02.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3a7400640 1 -- 172.21.15.59:0/384891028 learned_addr learned my addr 172.21.15.59:0/384891028 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:02.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3a7e00640 1 --1- 172.21.15.59:0/384891028 >> v1:172.21.15.59:6789/0 conn(0x7fe3a8161cc0 0x7fe3a80cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52044/0 (socket says 172.21.15.59:52044) 2024-04-25T09:06:02.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe39fe00640 1 --2- 172.21.15.59:0/384891028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a8072040 0x7fe3a8161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3a7400640 1 -- 172.21.15.59:0/384891028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a8072040 msgr2=0x7fe3a8161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:02.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3a7400640 1 --2- 172.21.15.59:0/384891028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a8072040 0x7fe3a8161780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3a7400640 1 -- 172.21.15.59:0/384891028 >> v1:172.21.15.59:6789/0 conn(0x7fe3a8161cc0 legacy=0x7fe3a80cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3a7400640 1 -- 172.21.15.59:0/384891028 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a806aeb0 con 0x7fe3a815dd90 2024-04-25T09:06:02.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe39fe00640 1 --2- 172.21.15.59:0/384891028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a8072040 0x7fe3a8161780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:02.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3a7400640 1 --2- 172.21.15.59:0/384891028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3a815dd90 0x7fe3a8071b00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe398009870 tx=0x7fe39801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15767e61d6efd83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:02.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3a6a00640 1 -- 172.21.15.59:0/384891028 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3980b1070 con 0x7fe3a815dd90 2024-04-25T09:06:02.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3a6a00640 1 -- 172.21.15.59:0/384891028 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3980ac600 con 0x7fe3a815dd90 2024-04-25T09:06:02.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.041+0000 7fe3a6a00640 1 -- 172.21.15.59:0/384891028 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3980ac9d0 con 0x7fe3a815dd90 2024-04-25T09:06:02.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 -- 172.21.15.59:0/384891028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3a815dd90 msgr2=0x7fe3a8071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 --2- 172.21.15.59:0/384891028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3a815dd90 0x7fe3a8071b00 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fe398009870 tx=0x7fe39801c4d0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 -- 172.21.15.59:0/384891028 shutdown_connections 2024-04-25T09:06:02.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 --2- 172.21.15.59:0/384891028 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a8072040 0x7fe3a8161780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 --2- 172.21.15.59:0/384891028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3a815dd90 0x7fe3a8071b00 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 -- 172.21.15.59:0/384891028 >> 172.21.15.59:0/384891028 conn(0x7fe3a80cfd90 msgr2=0x7fe3a80d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:02.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 -- 172.21.15.59:0/384891028 shutdown_connections 2024-04-25T09:06:02.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 -- 172.21.15.59:0/384891028 wait complete. 2024-04-25T09:06:02.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 Processor -- start 2024-04-25T09:06:02.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 -- start start 2024-04-25T09:06:02.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3a8072040 0x7fe3a80acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3a815dd90 0x7fe3a8160b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a8161cc0 0x7fe3a8151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a816aac0 con 0x7fe3a815dd90 2024-04-25T09:06:02.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a81624e0 con 0x7fe3a8072040 2024-04-25T09:06:02.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3ae400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3a816ac40 con 0x7fe3a8161cc0 2024-04-25T09:06:02.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe39fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3a815dd90 0x7fe3a8160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe39fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3a815dd90 0x7fe3a8160b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36984/0 (socket says 172.21.15.59:36984) 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe39fe00640 1 -- 172.21.15.59:0/2930493774 learned_addr learned my addr 172.21.15.59:0/2930493774 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3a7400640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3a8072040 0x7fe3a80acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3a7e00640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a8161cc0 0x7fe3a8151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe39fe00640 1 -- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a8161cc0 msgr2=0x7fe3a8151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe39fe00640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a8161cc0 0x7fe3a8151480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe39fe00640 1 -- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3a8072040 msgr2=0x7fe3a80acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe39fe00640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3a8072040 0x7fe3a80acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe39fe00640 1 -- 172.21.15.59:0/2930493774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3a8161080 con 0x7fe3a815dd90 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.045+0000 7fe3a7400640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3a8072040 0x7fe3a80acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.049+0000 7fe39fe00640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3a815dd90 0x7fe3a8160b40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe39000d830 tx=0x7fe39000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.049+0000 7fe39f400640 1 -- 172.21.15.59:0/2930493774 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39000b6c0 con 0x7fe3a815dd90 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.049+0000 7fe39f400640 1 -- 172.21.15.59:0/2930493774 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe390019070 con 0x7fe3a815dd90 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.049+0000 7fe39f400640 1 -- 172.21.15.59:0/2930493774 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39000baa0 con 0x7fe3a815dd90 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.049+0000 7fe3ae400640 1 -- 172.21.15.59:0/2930493774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3a80ad430 con 0x7fe3a815dd90 2024-04-25T09:06:02.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.049+0000 7fe3ae400640 1 -- 172.21.15.59:0/2930493774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3a80ad9f0 con 0x7fe3a815dd90 2024-04-25T09:06:02.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.049+0000 7fe3ae400640 1 -- 172.21.15.59:0/2930493774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3a80745d0 con 0x7fe3a815dd90 2024-04-25T09:06:02.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.049+0000 7fe39f400640 1 -- 172.21.15.59:0/2930493774 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe39001e460 con 0x7fe3a815dd90 2024-04-25T09:06:02.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.049+0000 7fe39f400640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe384066f60 0x7fe384069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:02.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.049+0000 7fe39f400640 1 -- 172.21.15.59:0/2930493774 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5335+0+0 (secure 0 0 0) 0x7fe390085450 con 0x7fe3a815dd90 2024-04-25T09:06:02.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.053+0000 7fe3a7400640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe384066f60 0x7fe384069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:02.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.053+0000 7fe3a7400640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe384066f60 0x7fe384069420 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe3980ae000 tx=0x7fe3980a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:02.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.057+0000 7fe39f400640 1 -- 172.21.15.59:0/2930493774 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe390055ee0 con 0x7fe3a815dd90 2024-04-25T09:06:02.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:02.237+0000 7fe3ae400640 1 -- 172.21.15.59:0/2930493774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe3a8153e40 con 0x7fe3a815dd90 2024-04-25T09:06:03.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe39f400640 1 -- 172.21.15.59:0/2930493774 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v76) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe390059f80 con 0x7fe3a815dd90 2024-04-25T09:06:03.112 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-04-25T09:06:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe3ae400640 1 -- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe384066f60 msgr2=0x7fe384069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe3ae400640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe384066f60 0x7fe384069420 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe3980ae000 tx=0x7fe3980a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe3ae400640 1 -- 172.21.15.59:0/2930493774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3a815dd90 msgr2=0x7fe3a8160b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe3ae400640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3a815dd90 0x7fe3a8160b40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fe39000d830 tx=0x7fe39000dcf0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe3ae400640 1 -- 172.21.15.59:0/2930493774 shutdown_connections 2024-04-25T09:06:03.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe3ae400640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe384066f60 0x7fe384069420 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe3ae400640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe3a8161cc0 0x7fe3a8151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe3ae400640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe3a815dd90 0x7fe3a8160b40 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe3ae400640 1 --2- 172.21.15.59:0/2930493774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe3a8072040 0x7fe3a80acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe3ae400640 1 -- 172.21.15.59:0/2930493774 >> 172.21.15.59:0/2930493774 conn(0x7fe3a80cfd90 msgr2=0x7fe3a8153390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe3ae400640 1 -- 172.21.15.59:0/2930493774 shutdown_connections 2024-04-25T09:06:03.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.121+0000 7fe3ae400640 1 -- 172.21.15.59:0/2930493774 wait complete. 2024-04-25T09:06:03.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:06:03.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88ce400640 1 Processor -- start 2024-04-25T09:06:03.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88ce400640 1 -- start start 2024-04-25T09:06:03.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88ce400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f88c815fde0 0x7f88c80710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88ce400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88c815c7d0 0x7f88c80715f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88ce400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c80cdb30 con 0x7f88c8144ea0 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88ce400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c815c340 con 0x7f88c815c7d0 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88ce400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c8145280 con 0x7f88c815fde0 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88cda00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88c815c7d0 0x7f88c80715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88cda00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88c815c7d0 0x7f88c80715f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36992/0 (socket says 172.21.15.59:36992) 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88cda00640 1 -- 172.21.15.59:0/2393807982 learned_addr learned my addr 172.21.15.59:0/2393807982 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88bfe00640 1 --2- 172.21.15.59:0/2393807982 >> v2:172.21.15.178:3300/0 conn(0x7f88c815fde0 0x7f88c80710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88cda00640 1 -- 172.21.15.59:0/2393807982 >> v2:172.21.15.178:3300/0 conn(0x7f88c815fde0 msgr2=0x7f88c80710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88cda00640 1 --2- 172.21.15.59:0/2393807982 >> v2:172.21.15.178:3300/0 conn(0x7f88c815fde0 0x7f88c80710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88cda00640 1 -- 172.21.15.59:0/2393807982 >> v1:172.21.15.178:6789/0 conn(0x7f88c8144ea0 legacy=0x7f88c80cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88cda00640 1 -- 172.21.15.59:0/2393807982 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c815bcf0 con 0x7f88c815c7d0 2024-04-25T09:06:03.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.297+0000 7f88bfe00640 1 --2- 172.21.15.59:0/2393807982 >> v2:172.21.15.178:3300/0 conn(0x7f88c815fde0 0x7f88c80710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:03.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88cda00640 1 --2- 172.21.15.59:0/2393807982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c815c7d0 0x7f88c80715f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f88c8071e20 tx=0x7f88c001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6be40e80e38334a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88c7e00640 1 -- 172.21.15.59:0/2393807982 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00a5740 con 0x7f88c815c7d0 2024-04-25T09:06:03.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88c7e00640 1 -- 172.21.15.59:0/2393807982 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c00a58e0 con 0x7f88c815c7d0 2024-04-25T09:06:03.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88c7e00640 1 -- 172.21.15.59:0/2393807982 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00a5cb0 con 0x7f88c815c7d0 2024-04-25T09:06:03.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88ce400640 1 -- 172.21.15.59:0/2393807982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c815c7d0 msgr2=0x7f88c80715f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88ce400640 1 --2- 172.21.15.59:0/2393807982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c815c7d0 0x7f88c80715f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f88c8071e20 tx=0x7f88c001c9f0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88ce400640 1 -- 172.21.15.59:0/2393807982 shutdown_connections 2024-04-25T09:06:03.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88ce400640 1 --2- 172.21.15.59:0/2393807982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c815c7d0 0x7f88c80715f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88ce400640 1 --2- 172.21.15.59:0/2393807982 >> v2:172.21.15.178:3300/0 conn(0x7f88c815fde0 0x7f88c80710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88ce400640 1 -- 172.21.15.59:0/2393807982 >> 172.21.15.59:0/2393807982 conn(0x7f88c8066fa0 msgr2=0x7f88c806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:03.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88ce400640 1 -- 172.21.15.59:0/2393807982 shutdown_connections 2024-04-25T09:06:03.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88ce400640 1 -- 172.21.15.59:0/2393807982 wait complete. 2024-04-25T09:06:03.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88ce400640 1 Processor -- start 2024-04-25T09:06:03.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.301+0000 7f88ce400640 1 -- start start 2024-04-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88ce400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88c8144ea0 0x7f88c813bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88ce400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c815c7d0 0x7f88c80ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88ce400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c815fde0 0x7f88c815a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88ce400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80cc9f0 con 0x7f88c815fde0 2024-04-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88ce400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80cc870 con 0x7f88c8144ea0 2024-04-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88ce400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80ccb70 con 0x7f88c815c7d0 2024-04-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88cda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c815fde0 0x7f88c815a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88cda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c815fde0 0x7f88c815a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37006/0 (socket says 172.21.15.59:37006) 2024-04-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88cda00640 1 -- 172.21.15.59:0/382407717 learned_addr learned my addr 172.21.15.59:0/382407717 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88cd000640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88c8144ea0 0x7f88c813bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88bfe00640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c815c7d0 0x7f88c80ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88cda00640 1 -- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c815c7d0 msgr2=0x7f88c80ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88cda00640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c815c7d0 0x7f88c80ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88cda00640 1 -- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88c8144ea0 msgr2=0x7f88c813bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88cda00640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88c8144ea0 0x7f88c813bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88cda00640 1 -- 172.21.15.59:0/382407717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c8139700 con 0x7f88c815fde0 2024-04-25T09:06:03.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88cda00640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c815fde0 0x7f88c815a7d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f88c00af040 tx=0x7f88c0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88c5600640 1 -- 172.21.15.59:0/382407717 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00b8670 con 0x7f88c815fde0 2024-04-25T09:06:03.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88c5600640 1 -- 172.21.15.59:0/382407717 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c00be070 con 0x7f88c815fde0 2024-04-25T09:06:03.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88c5600640 1 -- 172.21.15.59:0/382407717 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00b8a90 con 0x7f88c815fde0 2024-04-25T09:06:03.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88ce400640 1 -- 172.21.15.59:0/382407717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c80aed90 con 0x7f88c815fde0 2024-04-25T09:06:03.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88ce400640 1 -- 172.21.15.59:0/382407717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c813c2e0 con 0x7f88c815fde0 2024-04-25T09:06:03.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.305+0000 7f88ce400640 1 -- 172.21.15.59:0/382407717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c804efa0 con 0x7f88c815fde0 2024-04-25T09:06:03.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.309+0000 7f88c5600640 1 -- 172.21.15.59:0/382407717 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f88c00b8c30 con 0x7f88c815fde0 2024-04-25T09:06:03.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.309+0000 7f88c5600640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f88a4066f60 0x7f88a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.309+0000 7f88c5600640 1 -- 172.21.15.59:0/382407717 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f88c011ff20 con 0x7f88c815fde0 2024-04-25T09:06:03.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.309+0000 7f88cd000640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f88a4066f60 0x7f88a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.309+0000 7f88cd000640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f88a4066f60 0x7f88a4069420 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f88c81f79b0 tx=0x7f88b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.313+0000 7f88c5600640 1 -- 172.21.15.59:0/382407717 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f88c00165e0 con 0x7f88c815fde0 2024-04-25T09:06:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.533+0000 7f88ce400640 1 -- 172.21.15.59:0/382407717 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f88c8072150 con 0x7f88c815fde0 2024-04-25T09:06:03.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.533+0000 7f88c5600640 1 -- 172.21.15.59:0/382407717 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f88c00a58b0 con 0x7f88c815fde0 2024-04-25T09:06:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:03.528 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:06:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-04-25T09:06:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-04-25T09:06:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmefAMLRAAyOhrYPGN2IYchV7wMDkkTQ==", 2024-04-25T09:06:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:06:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:06:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:06:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-04-25T09:06:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmcZtGORAA9RU5OkQHTCXe5nkpEp77Fw==", 2024-04-25T09:06:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:06:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:06:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:06:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmF3skNBAAcKEUsLnvjEY8fz59SnjWtg==", 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm95/1BBAAsIbA6GBVS4dl7sZ8CoZoLA==", 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCsGypmmikBDRAAcxA0eWyo/w0bALsf4Fb3KQ==", 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCvGypm66dNFxAAzl06IBbHoxHorB3FuCFNOQ==", 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCyGypmQrwdIhAAyF53f8p7/vnJ6L4ZjXcKhQ==", 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC1GypmtETmLBAAM4p1FOPAiB0aOcdfIcl6vg==", 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC6GypmyXGCAhAAKJ2Yh0lezpRfFMPXjN4Asg==", 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC9GypmmfZZDBAAzw9IygUbRErERr2lXEfutA==", 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDAGypmS4KRFRAAXrvA1QNbuWF6+ln+cz6orQ==", 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:03.535 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDDGypmruPJHRAAWFONkZiSsYgvsr04uO9J9A==", 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg==", 2024-04-25T09:06:03.536 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm8NCkEhAAEELIQ7EAUFHsANHAa5EnTA==", 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:06:03.537 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmdosADxAAxmQqp2O5lT5XenyqxyyMKw==", 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-04-25T09:06:03.538 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmsqWgGBAAIXaSazGZkKiY2hqcC+WApA==", 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypm5ldPEBAAepEqWPcDy8atp78XxKERYg==", 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:06:03.539 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmwOe7KBAAIvO6OJiUeb5hRdu9VX11cA==", 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:03.540 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-04-25T09:06:03.541 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmX2GpJBAA8RvpxNpdPFExISwQzT56fA==", 2024-04-25T09:06:03.541 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:06:03.541 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:06:03.541 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:06:03.541 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:06:03.541 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.541 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:03.541 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-25T09:06:03.541 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:06:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.537+0000 7f88ce400640 1 -- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f88a4066f60 msgr2=0x7f88a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.537+0000 7f88ce400640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f88a4066f60 0x7f88a4069420 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f88c81f79b0 tx=0x7f88b8009040 comp rx=0 tx=0).stop 2024-04-25T09:06:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.537+0000 7f88ce400640 1 -- 172.21.15.59:0/382407717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c815fde0 msgr2=0x7f88c815a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.537+0000 7f88ce400640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c815fde0 0x7f88c815a7d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f88c00af040 tx=0x7f88c0019790 comp rx=0 tx=0).stop 2024-04-25T09:06:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.537+0000 7f88ce400640 1 -- 172.21.15.59:0/382407717 shutdown_connections 2024-04-25T09:06:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.537+0000 7f88ce400640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f88a4066f60 0x7f88a4069420 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.537+0000 7f88ce400640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88c815fde0 0x7f88c815a7d0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.537+0000 7f88ce400640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88c815c7d0 0x7f88c80ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.537+0000 7f88ce400640 1 --2- 172.21.15.59:0/382407717 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f88c8144ea0 0x7f88c813bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.537+0000 7f88ce400640 1 -- 172.21.15.59:0/382407717 >> 172.21.15.59:0/382407717 conn(0x7f88c8066fa0 msgr2=0x7f88c815cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:03.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.537+0000 7f88ce400640 1 -- 172.21.15.59:0/382407717 shutdown_connections 2024-04-25T09:06:03.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.537+0000 7f88ce400640 1 -- 172.21.15.59:0/382407717 wait complete. 2024-04-25T09:06:03.549 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:03.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd703e00640 1 Processor -- start 2024-04-25T09:06:03.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd703e00640 1 -- start start 2024-04-25T09:06:03.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd703e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd70415dcd0 0x7fd704099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd703e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd70409a7a0 0x7fd704099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd703e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd70406d740 con 0x7fd7040b06c0 2024-04-25T09:06:03.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd703e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7040cbfc0 con 0x7fd70415dcd0 2024-04-25T09:06:03.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd703e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd70406cea0 con 0x7fd70409a7a0 2024-04-25T09:06:03.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd702a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd70415dcd0 0x7fd704099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd702a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd70415dcd0 0x7fd704099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37018/0 (socket says 172.21.15.59:37018) 2024-04-25T09:06:03.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd702a00640 1 -- 172.21.15.59:0/2577718724 learned_addr learned my addr 172.21.15.59:0/2577718724 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:03.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd6fa000640 1 --2- 172.21.15.59:0/2577718724 >> v2:172.21.15.178:3300/0 conn(0x7fd70409a7a0 0x7fd704099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd702a00640 1 -- 172.21.15.59:0/2577718724 >> v2:172.21.15.178:3300/0 conn(0x7fd70409a7a0 msgr2=0x7fd704099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:03.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd702a00640 1 --2- 172.21.15.59:0/2577718724 >> v2:172.21.15.178:3300/0 conn(0x7fd70409a7a0 0x7fd704099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd702a00640 1 -- 172.21.15.59:0/2577718724 >> v1:172.21.15.178:6789/0 conn(0x7fd7040b06c0 legacy=0x7fd7040cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:03.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.697+0000 7fd702a00640 1 -- 172.21.15.59:0/2577718724 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70406d180 con 0x7fd70415dcd0 2024-04-25T09:06:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.701+0000 7fd702a00640 1 --2- 172.21.15.59:0/2577718724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70415dcd0 0x7fd704099a60 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd70409b120 tx=0x7fd6f401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2aec83f97012554 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.701+0000 7fd702000640 1 -- 172.21.15.59:0/2577718724 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40aa650 con 0x7fd70415dcd0 2024-04-25T09:06:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.701+0000 7fd702000640 1 -- 172.21.15.59:0/2577718724 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f40af070 con 0x7fd70415dcd0 2024-04-25T09:06:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.701+0000 7fd702000640 1 -- 172.21.15.59:0/2577718724 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f40aaa10 con 0x7fd70415dcd0 2024-04-25T09:06:03.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.701+0000 7fd703e00640 1 -- 172.21.15.59:0/2577718724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70415dcd0 msgr2=0x7fd704099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.701+0000 7fd703e00640 1 --2- 172.21.15.59:0/2577718724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70415dcd0 0x7fd704099a60 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fd70409b120 tx=0x7fd6f401c4f0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.701+0000 7fd703e00640 1 -- 172.21.15.59:0/2577718724 shutdown_connections 2024-04-25T09:06:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.701+0000 7fd703e00640 1 --2- 172.21.15.59:0/2577718724 >> v2:172.21.15.178:3300/0 conn(0x7fd70409a7a0 0x7fd704099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.701+0000 7fd703e00640 1 --2- 172.21.15.59:0/2577718724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd70415dcd0 0x7fd704099a60 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.701+0000 7fd703e00640 1 -- 172.21.15.59:0/2577718724 >> 172.21.15.59:0/2577718724 conn(0x7fd7040b3050 msgr2=0x7fd7040b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.701+0000 7fd703e00640 1 -- 172.21.15.59:0/2577718724 shutdown_connections 2024-04-25T09:06:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.701+0000 7fd703e00640 1 -- 172.21.15.59:0/2577718724 wait complete. 2024-04-25T09:06:03.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd703e00640 1 Processor -- start 2024-04-25T09:06:03.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd703e00640 1 -- start start 2024-04-25T09:06:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd703e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd70409a7a0 0x7fd704154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd703e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7040b06c0 0x7fd7040af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd703e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd70415dcd0 0x7fd7040af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd703e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70416aa20 con 0x7fd7040b06c0 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd703e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70416a8a0 con 0x7fd70415dcd0 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd703e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70416aba0 con 0x7fd70409a7a0 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd6fa000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7040b06c0 0x7fd7040af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd6fa000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7040b06c0 0x7fd7040af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37026/0 (socket says 172.21.15.59:37026) 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd6fa000640 1 -- 172.21.15.59:0/742100419 learned_addr learned my addr 172.21.15.59:0/742100419 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd702a00640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd70409a7a0 0x7fd704154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd703400640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd70415dcd0 0x7fd7040af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd6fa000640 1 -- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd70409a7a0 msgr2=0x7fd704154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd6fa000640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd70409a7a0 0x7fd704154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd6fa000640 1 -- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd70415dcd0 msgr2=0x7fd7040af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd6fa000640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd70415dcd0 0x7fd7040af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd6fa000640 1 -- 172.21.15.59:0/742100419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704160540 con 0x7fd7040b06c0 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd6fa000640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7040b06c0 0x7fd7040af360 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00d5f0 tx=0x7fd6ec00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd6fb400640 1 -- 172.21.15.59:0/742100419 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec0125f0 con 0x7fd7040b06c0 2024-04-25T09:06:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd6fb400640 1 -- 172.21.15.59:0/742100419 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec019070 con 0x7fd7040b06c0 2024-04-25T09:06:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd703e00640 1 -- 172.21.15.59:0/742100419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70415f4a0 con 0x7fd7040b06c0 2024-04-25T09:06:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd6fb400640 1 -- 172.21.15.59:0/742100419 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec0129b0 con 0x7fd7040b06c0 2024-04-25T09:06:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.705+0000 7fd703e00640 1 -- 172.21.15.59:0/742100419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70415fa60 con 0x7fd7040b06c0 2024-04-25T09:06:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.709+0000 7fd703e00640 1 -- 172.21.15.59:0/742100419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70404efa0 con 0x7fd7040b06c0 2024-04-25T09:06:03.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.709+0000 7fd6fb400640 1 -- 172.21.15.59:0/742100419 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd6ec012b50 con 0x7fd7040b06c0 2024-04-25T09:06:03.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.709+0000 7fd6fb400640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd6e0066f60 0x7fd6e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:03.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.709+0000 7fd6fb400640 1 -- 172.21.15.59:0/742100419 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fd6ec085190 con 0x7fd7040b06c0 2024-04-25T09:06:03.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.709+0000 7fd702a00640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd6e0066f60 0x7fd6e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:03.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.709+0000 7fd702a00640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd6e0066f60 0x7fd6e0069420 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40ae000 tx=0x7fd6f40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:03.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.713+0000 7fd6fb400640 1 -- 172.21.15.59:0/742100419 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd6ec056350 con 0x7fd7040b06c0 2024-04-25T09:06:03.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 -- 172.21.15.59:0/742100419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd70406f7b0 con 0x7fd7040b06c0 2024-04-25T09:06:03.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd6fb400640 1 -- 172.21.15.59:0/742100419 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+13165 (secure 0 0 0) 0x7fd6ec055c50 con 0x7fd7040b06c0 2024-04-25T09:06:03.873 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:03.873 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":76,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:06:03.121835+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:03.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 -- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd6e0066f60 msgr2=0x7fd6e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd6e0066f60 0x7fd6e0069420 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd6f40ae000 tx=0x7fd6f40a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:03.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 -- 172.21.15.59:0/742100419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7040b06c0 msgr2=0x7fd7040af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:03.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7040b06c0 0x7fd7040af360 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00d5f0 tx=0x7fd6ec00dab0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 -- 172.21.15.59:0/742100419 shutdown_connections 2024-04-25T09:06:03.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd6e0066f60 0x7fd6e0069420 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd70415dcd0 0x7fd7040af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7040b06c0 0x7fd7040af360 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 --2- 172.21.15.59:0/742100419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd70409a7a0 0x7fd704154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:03.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 -- 172.21.15.59:0/742100419 >> 172.21.15.59:0/742100419 conn(0x7fd7040b3050 msgr2=0x7fd70406c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:03.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 -- 172.21.15.59:0/742100419 shutdown_connections 2024-04-25T09:06:03.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:03.881+0000 7fd703e00640 1 -- 172.21.15.59:0/742100419 wait complete. 2024-04-25T09:06:03.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:03.895 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:04.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.045+0000 7f312dc00640 1 Processor -- start 2024-04-25T09:06:04.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.045+0000 7f312dc00640 1 -- start start 2024-04-25T09:06:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f312dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3128099a60 0x7f312806c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f312dc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31280cf350 0x7f31280cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f312dc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f312806ca00 con 0x7f312815ddb0 2024-04-25T09:06:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f312dc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f312806cce0 con 0x7f3128099a60 2024-04-25T09:06:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f312dc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312806cfc0 con 0x7f31280cf350 2024-04-25T09:06:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f3127e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3128099a60 0x7f312806c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f311f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f312815ddb0 0x7f3128099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52056/0 (socket says 172.21.15.59:52056) 2024-04-25T09:06:04.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f311f400640 1 -- 172.21.15.59:0/2501477083 learned_addr learned my addr 172.21.15.59:0/2501477083 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f312d200640 1 --2- 172.21.15.59:0/2501477083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31280cf350 0x7f31280cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f3127e00640 1 -- 172.21.15.59:0/2501477083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31280cf350 msgr2=0x7f31280cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f3127e00640 1 --2- 172.21.15.59:0/2501477083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31280cf350 0x7f31280cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f3127e00640 1 -- 172.21.15.59:0/2501477083 >> v1:172.21.15.59:6789/0 conn(0x7f312815ddb0 legacy=0x7f3128099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.049+0000 7f3127e00640 1 -- 172.21.15.59:0/2501477083 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f312806d2a0 con 0x7f3128099a60 2024-04-25T09:06:04.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f3127e00640 1 --2- 172.21.15.59:0/2501477083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3128099a60 0x7f312806c320 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f31180097f0 tx=0x7f311801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882ce3675559c7ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f3127400640 1 -- 172.21.15.59:0/2501477083 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31180aa5f0 con 0x7f3128099a60 2024-04-25T09:06:04.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f3127400640 1 -- 172.21.15.59:0/2501477083 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31180af070 con 0x7f3128099a60 2024-04-25T09:06:04.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f3127400640 1 -- 172.21.15.59:0/2501477083 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31180aa9b0 con 0x7f3128099a60 2024-04-25T09:06:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 -- 172.21.15.59:0/2501477083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3128099a60 msgr2=0x7f312806c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 --2- 172.21.15.59:0/2501477083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3128099a60 0x7f312806c320 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f31180097f0 tx=0x7f311801c470 comp rx=0 tx=0).stop 2024-04-25T09:06:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 -- 172.21.15.59:0/2501477083 shutdown_connections 2024-04-25T09:06:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 --2- 172.21.15.59:0/2501477083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f31280cf350 0x7f31280cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 --2- 172.21.15.59:0/2501477083 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3128099a60 0x7f312806c320 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 -- 172.21.15.59:0/2501477083 >> 172.21.15.59:0/2501477083 conn(0x7f31280d15d0 msgr2=0x7f31280d19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 -- 172.21.15.59:0/2501477083 shutdown_connections 2024-04-25T09:06:04.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 -- 172.21.15.59:0/2501477083 wait complete. 2024-04-25T09:06:04.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 Processor -- start 2024-04-25T09:06:04.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 -- start start 2024-04-25T09:06:04.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3128099a60 0x7f3128151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31280cf350 0x7f3128070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312815ddb0 0x7f31280b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312816a990 con 0x7f31280cf350 2024-04-25T09:06:04.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.053+0000 7f312dc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f312816a810 con 0x7f3128099a60 2024-04-25T09:06:04.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f312dc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f312816ab10 con 0x7f312815ddb0 2024-04-25T09:06:04.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f311f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31280cf350 0x7f3128070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f311f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31280cf350 0x7f3128070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37038/0 (socket says 172.21.15.59:37038) 2024-04-25T09:06:04.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f311f400640 1 -- 172.21.15.59:0/1920337986 learned_addr learned my addr 172.21.15.59:0/1920337986 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:04.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f312d200640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312815ddb0 0x7f31280b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f3127e00640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3128099a60 0x7f3128151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f311f400640 1 -- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312815ddb0 msgr2=0x7f31280b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f311f400640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312815ddb0 0x7f31280b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f311f400640 1 -- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3128099a60 msgr2=0x7f3128151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f311f400640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3128099a60 0x7f3128151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f311f400640 1 -- 172.21.15.59:0/1920337986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3128151d60 con 0x7f31280cf350 2024-04-25T09:06:04.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f312d200640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312815ddb0 0x7f31280b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:04.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f3127e00640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3128099a60 0x7f3128151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:04.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f311f400640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31280cf350 0x7f3128070480 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f311000c3a0 tx=0x7f311000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f3124c00640 1 -- 172.21.15.59:0/1920337986 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3110017070 con 0x7f31280cf350 2024-04-25T09:06:04.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f3124c00640 1 -- 172.21.15.59:0/1920337986 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3110005cf0 con 0x7f31280cf350 2024-04-25T09:06:04.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f3124c00640 1 -- 172.21.15.59:0/1920337986 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31100072f0 con 0x7f31280cf350 2024-04-25T09:06:04.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f312dc00640 1 -- 172.21.15.59:0/1920337986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f312806f3e0 con 0x7f31280cf350 2024-04-25T09:06:04.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f312dc00640 1 -- 172.21.15.59:0/1920337986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f312806f9a0 con 0x7f31280cf350 2024-04-25T09:06:04.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f312dc00640 1 -- 172.21.15.59:0/1920337986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3128068670 con 0x7f31280cf350 2024-04-25T09:06:04.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f3124c00640 1 -- 172.21.15.59:0/1920337986 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f311001a070 con 0x7f31280cf350 2024-04-25T09:06:04.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.057+0000 7f3124c00640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3104066f60 0x7f3104069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.061+0000 7f3124c00640 1 -- 172.21.15.59:0/1920337986 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f31100842b0 con 0x7f31280cf350 2024-04-25T09:06:04.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.061+0000 7f3127e00640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3104066f60 0x7f3104069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.061+0000 7f3127e00640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3104066f60 0x7f3104069420 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f31180ae000 tx=0x7f31180a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.061+0000 7f3124c00640 1 -- 172.21.15.59:0/1920337986 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3128151d60 con 0x7f31280cf350 2024-04-25T09:06:04.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.225+0000 7f312dc00640 1 -- 172.21.15.59:0/1920337986 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31280745d0 con 0x7f31280cf350 2024-04-25T09:06:04.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.225+0000 7f3124c00640 1 -- 172.21.15.59:0/1920337986 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31100553e0 con 0x7f31280cf350 2024-04-25T09:06:04.218 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:06:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.225+0000 7f312dc00640 1 -- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3104066f60 msgr2=0x7f3104069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.225+0000 7f312dc00640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3104066f60 0x7f3104069420 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f31180ae000 tx=0x7f31180a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.229+0000 7f312dc00640 1 -- 172.21.15.59:0/1920337986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31280cf350 msgr2=0x7f3128070480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.229+0000 7f312dc00640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31280cf350 0x7f3128070480 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f311000c3a0 tx=0x7f311000c860 comp rx=0 tx=0).stop 2024-04-25T09:06:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.229+0000 7f312dc00640 1 -- 172.21.15.59:0/1920337986 shutdown_connections 2024-04-25T09:06:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.229+0000 7f312dc00640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3104066f60 0x7f3104069420 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.229+0000 7f312dc00640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f312815ddb0 0x7f31280b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.229+0000 7f312dc00640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31280cf350 0x7f3128070480 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.229+0000 7f312dc00640 1 --2- 172.21.15.59:0/1920337986 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3128099a60 0x7f3128151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.229+0000 7f312dc00640 1 -- 172.21.15.59:0/1920337986 >> 172.21.15.59:0/1920337986 conn(0x7f31280d15d0 msgr2=0x7f3128099e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.229+0000 7f312dc00640 1 -- 172.21.15.59:0/1920337986 shutdown_connections 2024-04-25T09:06:04.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.229+0000 7f312dc00640 1 -- 172.21.15.59:0/1920337986 wait complete. 2024-04-25T09:06:04.239 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:06:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63aa400640 1 Processor -- start 2024-04-25T09:06:04.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63aa400640 1 -- start start 2024-04-25T09:06:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63aa400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63a4161510 0x7f63a4143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63aa400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f63a41435c0 0x7f63a415e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63aa400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a406d090 con 0x7f63a4070fe0 2024-04-25T09:06:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63aa400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a4071ad0 con 0x7f63a41435c0 2024-04-25T09:06:04.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63aa400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4162390 con 0x7f63a4161510 2024-04-25T09:06:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63a3e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f63a41435c0 0x7f63a415e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63a2a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63a4161510 0x7f63a4143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63a3e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f63a41435c0 0x7f63a415e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:32912/0 (socket says 172.21.15.59:32912) 2024-04-25T09:06:04.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63a3e00640 1 -- 172.21.15.59:0/2831750118 learned_addr learned my addr 172.21.15.59:0/2831750118 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63a3400640 1 --1- 172.21.15.59:0/2831750118 >> v1:172.21.15.178:6789/0 conn(0x7f63a4070fe0 0x7f63a40713c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:43262/0 (socket says 172.21.15.59:43262) 2024-04-25T09:06:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63a2a00640 1 -- 172.21.15.59:0/2831750118 >> v2:172.21.15.178:3300/0 conn(0x7f63a41435c0 msgr2=0x7f63a415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63a2a00640 1 --2- 172.21.15.59:0/2831750118 >> v2:172.21.15.178:3300/0 conn(0x7f63a41435c0 0x7f63a415e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63a2a00640 1 -- 172.21.15.59:0/2831750118 >> v1:172.21.15.178:6789/0 conn(0x7f63a4070fe0 legacy=0x7f63a40713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63a2a00640 1 -- 172.21.15.59:0/2831750118 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a4161af0 con 0x7f63a4161510 2024-04-25T09:06:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63a2000640 1 -- 172.21.15.59:0/2831750118 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571085865 0 0) 0x7f6394001120 con 0x7f63a4070fe0 2024-04-25T09:06:04.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.389+0000 7f63a3e00640 1 --2- 172.21.15.59:0/2831750118 >> v2:172.21.15.178:3300/0 conn(0x7f63a41435c0 0x7f63a415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:04.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.393+0000 7f63a2a00640 1 --2- 172.21.15.59:0/2831750118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63a4161510 0x7f63a4143080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63900097c0 tx=0x7f639001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8902dd0f11f4eb6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.393+0000 7f63a2000640 1 -- 172.21.15.59:0/2831750118 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900b2070 con 0x7f63a4161510 2024-04-25T09:06:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.393+0000 7f63a2000640 1 -- 172.21.15.59:0/2831750118 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63900ad680 con 0x7f63a4161510 2024-04-25T09:06:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.393+0000 7f63a2000640 1 -- 172.21.15.59:0/2831750118 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900ada50 con 0x7f63a4161510 2024-04-25T09:06:04.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.393+0000 7f63aa400640 1 -- 172.21.15.59:0/2831750118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63a4161510 msgr2=0x7f63a4143080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.393+0000 7f63aa400640 1 --2- 172.21.15.59:0/2831750118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63a4161510 0x7f63a4143080 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f63900097c0 tx=0x7f639001c470 comp rx=0 tx=0).stop 2024-04-25T09:06:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.393+0000 7f63aa400640 1 -- 172.21.15.59:0/2831750118 shutdown_connections 2024-04-25T09:06:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.393+0000 7f63aa400640 1 --2- 172.21.15.59:0/2831750118 >> v2:172.21.15.178:3300/0 conn(0x7f63a41435c0 0x7f63a415e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.393+0000 7f63aa400640 1 --2- 172.21.15.59:0/2831750118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63a4161510 0x7f63a4143080 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.393+0000 7f63aa400640 1 -- 172.21.15.59:0/2831750118 >> 172.21.15.59:0/2831750118 conn(0x7f63a40b3390 msgr2=0x7f63a40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.393+0000 7f63aa400640 1 -- 172.21.15.59:0/2831750118 shutdown_connections 2024-04-25T09:06:04.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.393+0000 7f63aa400640 1 -- 172.21.15.59:0/2831750118 wait complete. 2024-04-25T09:06:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63aa400640 1 Processor -- start 2024-04-25T09:06:04.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63aa400640 1 -- start start 2024-04-25T09:06:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63aa400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63a4070fe0 0x7f63a4143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63aa400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a41435c0 0x7f63a4157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63aa400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63a4161510 0x7f63a41553e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63aa400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40b06c0 con 0x7f63a41435c0 2024-04-25T09:06:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63aa400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40b0540 con 0x7f63a4161510 2024-04-25T09:06:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63aa400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40b0840 con 0x7f63a4070fe0 2024-04-25T09:06:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63a2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a41435c0 0x7f63a4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63a2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a41435c0 0x7f63a4157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37042/0 (socket says 172.21.15.59:37042) 2024-04-25T09:06:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63a2a00640 1 -- 172.21.15.59:0/4194322321 learned_addr learned my addr 172.21.15.59:0/4194322321 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63a3400640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63a4070fe0 0x7f63a4143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63a3e00640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63a4161510 0x7f63a41553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63a2a00640 1 -- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63a4070fe0 msgr2=0x7f63a4143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63a2a00640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63a4070fe0 0x7f63a4143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63a2a00640 1 -- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63a4161510 msgr2=0x7f63a41553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63a2a00640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63a4161510 0x7f63a41553e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63a2a00640 1 -- 172.21.15.59:0/4194322321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40b11b0 con 0x7f63a41435c0 2024-04-25T09:06:04.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63a2a00640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a41435c0 0x7f63a4157620 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f639001a0a0 tx=0x7f6390019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f639b400640 1 -- 172.21.15.59:0/4194322321 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900bd070 con 0x7f63a41435c0 2024-04-25T09:06:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f639b400640 1 -- 172.21.15.59:0/4194322321 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63900adaf0 con 0x7f63a41435c0 2024-04-25T09:06:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f639b400640 1 -- 172.21.15.59:0/4194322321 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900b2040 con 0x7f63a41435c0 2024-04-25T09:06:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63aa400640 1 -- 172.21.15.59:0/4194322321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a40b1490 con 0x7f63a41435c0 2024-04-25T09:06:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.397+0000 7f63aa400640 1 -- 172.21.15.59:0/4194322321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a40b1a50 con 0x7f63a41435c0 2024-04-25T09:06:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.401+0000 7f63aa400640 1 -- 172.21.15.59:0/4194322321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a40745d0 con 0x7f63a41435c0 2024-04-25T09:06:04.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.401+0000 7f639b400640 1 -- 172.21.15.59:0/4194322321 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f63900c0070 con 0x7f63a41435c0 2024-04-25T09:06:04.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.401+0000 7f639b400640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6384066f60 0x7f6384069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.401+0000 7f639b400640 1 -- 172.21.15.59:0/4194322321 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f639011f780 con 0x7f63a41435c0 2024-04-25T09:06:04.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.401+0000 7f63a3400640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6384066f60 0x7f6384069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.401+0000 7f63a3400640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6384066f60 0x7f6384069420 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6394007fd0 tx=0x7f6394007980 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.405+0000 7f639b400640 1 -- 172.21.15.59:0/4194322321 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6390016090 con 0x7f63a41435c0 2024-04-25T09:06:04.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.565+0000 7f63aa400640 1 -- 172.21.15.59:0/4194322321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f63a40d23f0 con 0x7f63a41435c0 2024-04-25T09:06:04.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f639b400640 1 -- 172.21.15.59:0/4194322321 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) v1 ==== 84+0+65 (secure 0 0 0) 0x7f63900f0b00 con 0x7f63a41435c0 2024-04-25T09:06:04.560 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:04.560 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T09:06:04.560 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:04.560 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-04-25T09:06:04.560 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-04-25T09:06:04.560 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:04.561 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T09:06:04.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f63aa400640 1 -- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6384066f60 msgr2=0x7f6384069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f63aa400640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6384066f60 0x7f6384069420 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6394007fd0 tx=0x7f6394007980 comp rx=0 tx=0).stop 2024-04-25T09:06:04.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f63aa400640 1 -- 172.21.15.59:0/4194322321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a41435c0 msgr2=0x7f63a4157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f63aa400640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a41435c0 0x7f63a4157620 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f639001a0a0 tx=0x7f6390019210 comp rx=0 tx=0).stop 2024-04-25T09:06:04.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f63aa400640 1 -- 172.21.15.59:0/4194322321 shutdown_connections 2024-04-25T09:06:04.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f63aa400640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6384066f60 0x7f6384069420 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f63aa400640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63a4161510 0x7f63a41553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f63aa400640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63a41435c0 0x7f63a4157620 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f63aa400640 1 --2- 172.21.15.59:0/4194322321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63a4070fe0 0x7f63a4143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f63aa400640 1 -- 172.21.15.59:0/4194322321 >> 172.21.15.59:0/4194322321 conn(0x7f63a40b3390 msgr2=0x7f63a40cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f63aa400640 1 -- 172.21.15.59:0/4194322321 shutdown_connections 2024-04-25T09:06:04.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.569+0000 7f63aa400640 1 -- 172.21.15.59:0/4194322321 wait complete. 2024-04-25T09:06:04.582 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:06:04.582 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:06:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.733+0000 7fc8d8000640 1 Processor -- start 2024-04-25T09:06:04.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.733+0000 7fc8d8000640 1 -- start start 2024-04-25T09:06:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d8000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8d0071250 0x7fc8d00cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d8000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d015ccc0 con 0x7fc8d0071630 2024-04-25T09:06:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d8000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8d0160200 con 0x7fc8d015c4a0 2024-04-25T09:06:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d8000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d015c9e0 con 0x7fc8d0071250 2024-04-25T09:06:04.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d4c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc8d0071630 0x7fc8d015bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52066/0 (socket says 172.21.15.59:52066) 2024-04-25T09:06:04.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d4c00640 1 -- 172.21.15.59:0/465848954 learned_addr learned my addr 172.21.15.59:0/465848954 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:04.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d5600640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8d0071250 0x7fc8d00cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963357060 0 0) 0x7fc8d015ccc0 con 0x7fc8d0071630 2024-04-25T09:06:04.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8b8003530 con 0x7fc8d0071630 2024-04-25T09:06:04.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2506135197 0 0) 0x7fc8d0160200 con 0x7fc8d015c4a0 2024-04-25T09:06:04.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8d015ccc0 con 0x7fc8d015c4a0 2024-04-25T09:06:04.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4129250464 0 0) 0x7fc8b8003530 con 0x7fc8d0071630 2024-04-25T09:06:04.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8d0071250 msgr2=0x7fc8d00cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:04.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8d0071250 0x7fc8d00cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 >> v1:172.21.15.178:6789/0 conn(0x7fc8d015c4a0 legacy=0x7fc8d015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d00cd4b0 con 0x7fc8d0071630 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fc8bc001680 con 0x7fc8d0071630 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 >> v1:172.21.15.59:6789/0 conn(0x7fc8d0071630 legacy=0x7fc8d015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b8003b80 0x7fc8b8003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b8004810 0x7fc8b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8b80051d0 0x7fc8b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d015c9e0 con 0x7fc8b8004810 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b800c100 con 0x7fc8b80051d0 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b800c300 con 0x7fc8b8003b80 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d5600640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8d0071250 0x7fc8d00cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d4c00640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b8004810 0x7fc8b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d6000640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8b80051d0 0x7fc8b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d5600640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b8003b80 0x7fc8b8003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d4c00640 1 -- 172.21.15.59:0/465848954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b8003b80 msgr2=0x7fc8b8003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d4c00640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8b8003b80 0x7fc8b8003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d4c00640 1 -- 172.21.15.59:0/465848954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8b80051d0 msgr2=0x7fc8b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:04.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d4c00640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8b80051d0 0x7fc8b800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.737+0000 7fc8d4c00640 1 -- 172.21.15.59:0/465848954 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b8003530 con 0x7fc8b8004810 2024-04-25T09:06:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8d4c00640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b8004810 0x7fc8b8004c90 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c1c0 tx=0x7fc8d015de00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8b955f4dcc8f3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc007cf0 con 0x7fc8b8004810 2024-04-25T09:06:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8bc0a9020 con 0x7fc8b8004810 2024-04-25T09:06:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8cfe00640 1 -- 172.21.15.59:0/465848954 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc005ae0 con 0x7fc8b8004810 2024-04-25T09:06:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8d8000640 1 -- 172.21.15.59:0/465848954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b8004810 msgr2=0x7fc8b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8d8000640 1 --2- 172.21.15.59:0/465848954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8b8004810 0x7fc8b8004c90 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c1c0 tx=0x7fc8d015de00 comp rx=0 tx=0).stop 2024-04-25T09:06:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8d6000640 1 -- 172.21.15.59:0/465848954 reap_dead start 2024-04-25T09:06:04.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8d8000640 1 -- 172.21.15.59:0/465848954 shutdown_connections 2024-04-25T09:06:04.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8d8000640 1 -- 172.21.15.59:0/465848954 >> 172.21.15.59:0/465848954 conn(0x7fc8d006ac10 msgr2=0x7fc8d006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:04.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8d8000640 1 -- 172.21.15.59:0/465848954 shutdown_connections 2024-04-25T09:06:04.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8d8000640 1 -- 172.21.15.59:0/465848954 wait complete. 2024-04-25T09:06:04.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8d8000640 1 Processor -- start 2024-04-25T09:06:04.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.741+0000 7fc8d8000640 1 -- start start 2024-04-25T09:06:04.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d8000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8d0156dc0 0x7fc8d0159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d8000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8d00ad480 0x7fc8d0145ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d8000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d01571a0 0x7fc8d01460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d8000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d0167620 con 0x7fc8d01571a0 2024-04-25T09:06:04.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d8000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d01674a0 con 0x7fc8d0156dc0 2024-04-25T09:06:04.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d8000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d01677a0 con 0x7fc8d00ad480 2024-04-25T09:06:04.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d01571a0 0x7fc8d01460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d01571a0 0x7fc8d01460e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37064/0 (socket says 172.21.15.59:37064) 2024-04-25T09:06:04.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d6000640 1 -- 172.21.15.59:0/3060885738 learned_addr learned my addr 172.21.15.59:0/3060885738 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d4c00640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8d00ad480 0x7fc8d0145ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d5600640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8d0156dc0 0x7fc8d0159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d6000640 1 -- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8d00ad480 msgr2=0x7fc8d0145ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d6000640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8d00ad480 0x7fc8d0145ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d6000640 1 -- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8d0156dc0 msgr2=0x7fc8d0159060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d6000640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8d0156dc0 0x7fc8d0159060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d6000640 1 -- 172.21.15.59:0/3060885738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d00ad920 con 0x7fc8d01571a0 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d5600640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8d0156dc0 0x7fc8d0159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d6000640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d01571a0 0x7fc8d01460e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8007fd0 tx=0x7fc8c800ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8cd600640 1 -- 172.21.15.59:0/3060885738 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8019070 con 0x7fc8d01571a0 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8cd600640 1 -- 172.21.15.59:0/3060885738 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c8006d70 con 0x7fc8d01571a0 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8cd600640 1 -- 172.21.15.59:0/3060885738 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8003bc0 con 0x7fc8d01571a0 2024-04-25T09:06:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d8000640 1 -- 172.21.15.59:0/3060885738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8d00adc00 con 0x7fc8d01571a0 2024-04-25T09:06:04.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d8000640 1 -- 172.21.15.59:0/3060885738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d00ae1c0 con 0x7fc8d01571a0 2024-04-25T09:06:04.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.745+0000 7fc8d8000640 1 -- 172.21.15.59:0/3060885738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8d00745d0 con 0x7fc8d01571a0 2024-04-25T09:06:04.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.749+0000 7fc8cd600640 1 -- 172.21.15.59:0/3060885738 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc8c800d740 con 0x7fc8d01571a0 2024-04-25T09:06:04.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.749+0000 7fc8cd600640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc8b0066f60 0x7fc8b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:04.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.749+0000 7fc8cd600640 1 -- 172.21.15.59:0/3060885738 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fc8c8084000 con 0x7fc8d01571a0 2024-04-25T09:06:04.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.749+0000 7fc8d5600640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc8b0066f60 0x7fc8b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:04.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.749+0000 7fc8d5600640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc8b0066f60 0x7fc8b0069420 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc8d006b990 tx=0x7fc8c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:04.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.753+0000 7fc8cd600640 1 -- 172.21.15.59:0/3060885738 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc8c8054b80 con 0x7fc8d01571a0 2024-04-25T09:06:04.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:04.917+0000 7fc8d8000640 1 -- 172.21.15.59:0/3060885738 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc8d00ae400 con 0x7fc8d01571a0 2024-04-25T09:06:05.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.769+0000 7fc8cd600640 1 -- 172.21.15.59:0/3060885738 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc8c8058c20 con 0x7fc8d01571a0 2024-04-25T09:06:05.764 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-04-25T09:06:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.773+0000 7fc8d8000640 1 -- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc8b0066f60 msgr2=0x7fc8b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.773+0000 7fc8d8000640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc8b0066f60 0x7fc8b0069420 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc8d006b990 tx=0x7fc8c4008040 comp rx=0 tx=0).stop 2024-04-25T09:06:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.773+0000 7fc8d8000640 1 -- 172.21.15.59:0/3060885738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d01571a0 msgr2=0x7fc8d01460e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.773+0000 7fc8d8000640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d01571a0 0x7fc8d01460e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fc8c8007fd0 tx=0x7fc8c800ff70 comp rx=0 tx=0).stop 2024-04-25T09:06:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.777+0000 7fc8d8000640 1 -- 172.21.15.59:0/3060885738 shutdown_connections 2024-04-25T09:06:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.777+0000 7fc8d8000640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc8b0066f60 0x7fc8b0069420 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.777+0000 7fc8d8000640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8d01571a0 0x7fc8d01460e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.777+0000 7fc8d8000640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc8d00ad480 0x7fc8d0145ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.777+0000 7fc8d8000640 1 --2- 172.21.15.59:0/3060885738 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8d0156dc0 0x7fc8d0159060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.777+0000 7fc8d8000640 1 -- 172.21.15.59:0/3060885738 >> 172.21.15.59:0/3060885738 conn(0x7fc8d006ac10 msgr2=0x7fc8d00b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:05.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.777+0000 7fc8d8000640 1 -- 172.21.15.59:0/3060885738 shutdown_connections 2024-04-25T09:06:05.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.777+0000 7fc8d8000640 1 -- 172.21.15.59:0/3060885738 wait complete. 2024-04-25T09:06:05.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:06:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe87e00640 1 Processor -- start 2024-04-25T09:06:05.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe87e00640 1 -- start start 2024-04-25T09:06:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe87e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efe8009a170 0x7efe800d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe87e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8015e040 con 0x7efe8015dc60 2024-04-25T09:06:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe87e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe800cff80 con 0x7efe8006bf30 2024-04-25T09:06:05.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe87e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe800d0260 con 0x7efe8009a170 2024-04-25T09:06:05.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe85400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efe8015dc60 0x7efe80099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52078/0 (socket says 172.21.15.59:52078) 2024-04-25T09:06:05.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe85400640 1 -- 172.21.15.59:0/2749138528 learned_addr learned my addr 172.21.15.59:0/2749138528 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe84a00640 1 --2- 172.21.15.59:0/2749138528 >> v2:172.21.15.178:3300/0 conn(0x7efe8009a170 0x7efe800d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe7fe00640 1 -- 172.21.15.59:0/2749138528 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146253656 0 0) 0x7efe8015e040 con 0x7efe8015dc60 2024-04-25T09:06:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe7fe00640 1 -- 172.21.15.59:0/2749138528 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe68003530 con 0x7efe8015dc60 2024-04-25T09:06:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe7fe00640 1 -- 172.21.15.59:0/2749138528 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362660357 0 0) 0x7efe800cff80 con 0x7efe8006bf30 2024-04-25T09:06:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe7fe00640 1 -- 172.21.15.59:0/2749138528 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe8015e040 con 0x7efe8006bf30 2024-04-25T09:06:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe84a00640 1 -- 172.21.15.59:0/2749138528 >> v1:172.21.15.178:6789/0 conn(0x7efe8006bf30 legacy=0x7efe800cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe84a00640 1 -- 172.21.15.59:0/2749138528 >> v1:172.21.15.59:6789/0 conn(0x7efe8015dc60 legacy=0x7efe80099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe7fe00640 1 -- 172.21.15.59:0/2749138528 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1940623690 0 0) 0x7efe68003530 con 0x7efe8015dc60 2024-04-25T09:06:05.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.961+0000 7efe84a00640 1 -- 172.21.15.59:0/2749138528 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800d0540 con 0x7efe8009a170 2024-04-25T09:06:05.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.965+0000 7efe84a00640 1 --2- 172.21.15.59:0/2749138528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe8009a170 0x7efe800d1020 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0097c0 tx=0x7efe6c01c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a152bcbb7880f1b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.965+0000 7efe7fe00640 1 -- 172.21.15.59:0/2749138528 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6c0b0070 con 0x7efe8009a170 2024-04-25T09:06:05.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.965+0000 7efe7fe00640 1 -- 172.21.15.59:0/2749138528 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6c0ab400 con 0x7efe8009a170 2024-04-25T09:06:05.959 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.965+0000 7efe7fe00640 1 -- 172.21.15.59:0/2749138528 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe74001680 con 0x7efe8009a170 2024-04-25T09:06:05.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.965+0000 7efe87e00640 1 -- 172.21.15.59:0/2749138528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe8009a170 msgr2=0x7efe800d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.965+0000 7efe87e00640 1 --2- 172.21.15.59:0/2749138528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe8009a170 0x7efe800d1020 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7efe6c0097c0 tx=0x7efe6c01c270 comp rx=0 tx=0).stop 2024-04-25T09:06:05.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 -- 172.21.15.59:0/2749138528 shutdown_connections 2024-04-25T09:06:05.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 --2- 172.21.15.59:0/2749138528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe8009a170 0x7efe800d1020 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 -- 172.21.15.59:0/2749138528 >> 172.21.15.59:0/2749138528 conn(0x7efe800b3200 msgr2=0x7efe800b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:05.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 -- 172.21.15.59:0/2749138528 shutdown_connections 2024-04-25T09:06:05.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 -- 172.21.15.59:0/2749138528 wait complete. 2024-04-25T09:06:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 Processor -- start 2024-04-25T09:06:05.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 -- start start 2024-04-25T09:06:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe8006bf30 0x7efe80154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe8009a170 0x7efe8015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8015dc60 0x7efe800b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8006cfa0 con 0x7efe8015dc60 2024-04-25T09:06:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe800cc880 con 0x7efe8009a170 2024-04-25T09:06:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe87e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe80154f70 con 0x7efe8006bf30 2024-04-25T09:06:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe85e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8015dc60 0x7efe800b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe85e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8015dc60 0x7efe800b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37080/0 (socket says 172.21.15.59:37080) 2024-04-25T09:06:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe85e00640 1 -- 172.21.15.59:0/2402033953 learned_addr learned my addr 172.21.15.59:0/2402033953 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe84a00640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe8009a170 0x7efe8015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe85400640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe8006bf30 0x7efe80154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe85e00640 1 -- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe8006bf30 msgr2=0x7efe80154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe85e00640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe8006bf30 0x7efe80154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe85e00640 1 -- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe8009a170 msgr2=0x7efe8015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe85e00640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe8009a170 0x7efe8015c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe85e00640 1 -- 172.21.15.59:0/2402033953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800c87e0 con 0x7efe8015dc60 2024-04-25T09:06:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe85400640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe8006bf30 0x7efe80154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.969+0000 7efe85e00640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8015dc60 0x7efe800b5c90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7efe7800c7c0 tx=0x7efe7800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.973+0000 7efe7d600640 1 -- 172.21.15.59:0/2402033953 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe78003b80 con 0x7efe8015dc60 2024-04-25T09:06:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.973+0000 7efe7d600640 1 -- 172.21.15.59:0/2402033953 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe78003d20 con 0x7efe8015dc60 2024-04-25T09:06:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.973+0000 7efe87e00640 1 -- 172.21.15.59:0/2402033953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe800c8ac0 con 0x7efe8015dc60 2024-04-25T09:06:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.973+0000 7efe7d600640 1 -- 172.21.15.59:0/2402033953 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7800aa50 con 0x7efe8015dc60 2024-04-25T09:06:05.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.973+0000 7efe87e00640 1 -- 172.21.15.59:0/2402033953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe800c9080 con 0x7efe8015dc60 2024-04-25T09:06:05.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.973+0000 7efe87e00640 1 -- 172.21.15.59:0/2402033953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe800745d0 con 0x7efe8015dc60 2024-04-25T09:06:05.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.973+0000 7efe7d600640 1 -- 172.21.15.59:0/2402033953 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efe7800abf0 con 0x7efe8015dc60 2024-04-25T09:06:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.977+0000 7efe7d600640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efe60066f60 0x7efe60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.977+0000 7efe7d600640 1 -- 172.21.15.59:0/2402033953 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5619+0+0 (secure 0 0 0) 0x7efe780859b0 con 0x7efe8015dc60 2024-04-25T09:06:05.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.977+0000 7efe85400640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efe60066f60 0x7efe60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:05.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.977+0000 7efe85400640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efe60066f60 0x7efe60069420 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efe740017f0 tx=0x7efe74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:05.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:05.977+0000 7efe7d600640 1 -- 172.21.15.59:0/2402033953 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efe78056a80 con 0x7efe8015dc60 2024-04-25T09:06:06.139 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.145+0000 7efe87e00640 1 -- 172.21.15.59:0/2402033953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efe80155170 con 0x7efe8015dc60 2024-04-25T09:06:06.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.773+0000 7efe7d600640 1 -- 172.21.15.59:0/2402033953 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) v1 ==== 170+0+0 (secure 0 0 0) 0x7efe78056380 con 0x7efe8015dc60 2024-04-25T09:06:06.767 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-04-25T09:06:06.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.777+0000 7efe87e00640 1 -- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efe60066f60 msgr2=0x7efe60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:06.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.777+0000 7efe87e00640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efe60066f60 0x7efe60069420 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7efe740017f0 tx=0x7efe74009040 comp rx=0 tx=0).stop 2024-04-25T09:06:06.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.777+0000 7efe87e00640 1 -- 172.21.15.59:0/2402033953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8015dc60 msgr2=0x7efe800b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:06.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.777+0000 7efe87e00640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8015dc60 0x7efe800b5c90 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7efe7800c7c0 tx=0x7efe7800cc80 comp rx=0 tx=0).stop 2024-04-25T09:06:06.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.777+0000 7efe87e00640 1 -- 172.21.15.59:0/2402033953 shutdown_connections 2024-04-25T09:06:06.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.777+0000 7efe87e00640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efe60066f60 0x7efe60069420 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.777+0000 7efe87e00640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8015dc60 0x7efe800b5c90 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.777+0000 7efe87e00640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efe8009a170 0x7efe8015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.777+0000 7efe87e00640 1 --2- 172.21.15.59:0/2402033953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efe8006bf30 0x7efe80154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.777+0000 7efe87e00640 1 -- 172.21.15.59:0/2402033953 >> 172.21.15.59:0/2402033953 conn(0x7efe800b3200 msgr2=0x7efe80073900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:06.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.777+0000 7efe87e00640 1 -- 172.21.15.59:0/2402033953 shutdown_connections 2024-04-25T09:06:06.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.777+0000 7efe87e00640 1 -- 172.21.15.59:0/2402033953 wait complete. 2024-04-25T09:06:06.810 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:06:06.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.961+0000 7f71f7c00640 1 Processor -- start 2024-04-25T09:06:06.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.961+0000 7f71f7c00640 1 -- start start 2024-04-25T09:06:06.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71f7c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f71f009a170 0x7f71f00d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:06.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71f7c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71f006bf30 0x7f71f00cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:06.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71f7c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f015e040 con 0x7f71f015dc60 2024-04-25T09:06:06.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71f7c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f00cff80 con 0x7f71f009a170 2024-04-25T09:06:06.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71f7c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00d0260 con 0x7f71f006bf30 2024-04-25T09:06:06.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71f5200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f71f015dc60 0x7f71f0099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52090/0 (socket says 172.21.15.59:52090) 2024-04-25T09:06:06.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71f5200640 1 -- 172.21.15.59:0/2128529482 learned_addr learned my addr 172.21.15.59:0/2128529482 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:06.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71f5c00640 1 --2- 172.21.15.59:0/2128529482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71f006bf30 0x7f71f00cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:06.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71efe00640 1 --2- 172.21.15.59:0/2128529482 >> v2:172.21.15.178:3300/0 conn(0x7f71f009a170 0x7f71f00d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:06.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71ef400640 1 -- 172.21.15.59:0/2128529482 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142723052 0 0) 0x7f71f015e040 con 0x7f71f015dc60 2024-04-25T09:06:06.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71ef400640 1 -- 172.21.15.59:0/2128529482 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d8003530 con 0x7f71f015dc60 2024-04-25T09:06:06.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71f5c00640 1 -- 172.21.15.59:0/2128529482 >> v2:172.21.15.178:3300/0 conn(0x7f71f009a170 msgr2=0x7f71f00d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:06.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71f5c00640 1 --2- 172.21.15.59:0/2128529482 >> v2:172.21.15.178:3300/0 conn(0x7f71f009a170 0x7f71f00d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71f5c00640 1 -- 172.21.15.59:0/2128529482 >> v1:172.21.15.59:6789/0 conn(0x7f71f015dc60 legacy=0x7f71f0099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:06.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.965+0000 7f71f5c00640 1 -- 172.21.15.59:0/2128529482 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f00d0540 con 0x7f71f006bf30 2024-04-25T09:06:06.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71f5c00640 1 --2- 172.21.15.59:0/2128529482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71f006bf30 0x7f71f00cf8a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009d90 tx=0x7f71e801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1932d3bccb0b4722 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:06.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71ef400640 1 -- 172.21.15.59:0/2128529482 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e80b2070 con 0x7f71f006bf30 2024-04-25T09:06:06.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71ef400640 1 -- 172.21.15.59:0/2128529482 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e80a5970 con 0x7f71f006bf30 2024-04-25T09:06:06.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71ef400640 1 -- 172.21.15.59:0/2128529482 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e80a5d20 con 0x7f71f006bf30 2024-04-25T09:06:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71f7c00640 1 -- 172.21.15.59:0/2128529482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71f006bf30 msgr2=0x7f71f00cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71f7c00640 1 --2- 172.21.15.59:0/2128529482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71f006bf30 0x7f71f00cf8a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009d90 tx=0x7f71e801c8b0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71f7c00640 1 -- 172.21.15.59:0/2128529482 shutdown_connections 2024-04-25T09:06:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71f7c00640 1 --2- 172.21.15.59:0/2128529482 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71f006bf30 0x7f71f00cf8a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71f7c00640 1 --2- 172.21.15.59:0/2128529482 >> v2:172.21.15.178:3300/0 conn(0x7f71f009a170 0x7f71f00d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71f7c00640 1 -- 172.21.15.59:0/2128529482 >> 172.21.15.59:0/2128529482 conn(0x7f71f00b3200 msgr2=0x7f71f00b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71f7c00640 1 -- 172.21.15.59:0/2128529482 shutdown_connections 2024-04-25T09:06:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71f7c00640 1 -- 172.21.15.59:0/2128529482 wait complete. 2024-04-25T09:06:06.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71f7c00640 1 Processor -- start 2024-04-25T09:06:06.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.969+0000 7f71f7c00640 1 -- start start 2024-04-25T09:06:06.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f7c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71f006bf30 0x7f71f0153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f7c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f009a170 0x7f71f00ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f7c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71f015dc60 0x7f71f00c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f7c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00cc6f0 con 0x7f71f009a170 2024-04-25T09:06:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f7c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00cc570 con 0x7f71f006bf30 2024-04-25T09:06:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f7c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00cc870 con 0x7f71f015dc60 2024-04-25T09:06:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f009a170 0x7f71f00ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f009a170 0x7f71f00ca410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37094/0 (socket says 172.21.15.59:37094) 2024-04-25T09:06:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71efe00640 1 -- 172.21.15.59:0/1581790574 learned_addr learned my addr 172.21.15.59:0/1581790574 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f5200640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71f006bf30 0x7f71f0153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f5c00640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71f015dc60 0x7f71f00c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71efe00640 1 -- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71f015dc60 msgr2=0x7f71f00c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:06.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71efe00640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71f015dc60 0x7f71f00c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71efe00640 1 -- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71f006bf30 msgr2=0x7f71f0153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:06.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71efe00640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71f006bf30 0x7f71f0153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:06.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71efe00640 1 -- 172.21.15.59:0/1581790574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f0154490 con 0x7f71f009a170 2024-04-25T09:06:06.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f5200640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71f006bf30 0x7f71f0153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:06.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f5c00640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71f015dc60 0x7f71f00c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:06.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71efe00640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f009a170 0x7f71f00ca410 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00e960 tx=0x7f71dc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:06.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71ecc00640 1 -- 172.21.15.59:0/1581790574 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc017070 con 0x7f71f009a170 2024-04-25T09:06:06.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71ecc00640 1 -- 172.21.15.59:0/1581790574 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71dc00ca00 con 0x7f71f009a170 2024-04-25T09:06:06.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71ecc00640 1 -- 172.21.15.59:0/1581790574 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71dc00cdb0 con 0x7f71f009a170 2024-04-25T09:06:06.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f7c00640 1 -- 172.21.15.59:0/1581790574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f0154770 con 0x7f71f009a170 2024-04-25T09:06:06.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f7c00640 1 -- 172.21.15.59:0/1581790574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f0154d30 con 0x7f71f009a170 2024-04-25T09:06:06.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.973+0000 7f71f7c00640 1 -- 172.21.15.59:0/1581790574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f00745d0 con 0x7f71f009a170 2024-04-25T09:06:06.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.977+0000 7f71ecc00640 1 -- 172.21.15.59:0/1581790574 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f71dc01a070 con 0x7f71f009a170 2024-04-25T09:06:06.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.977+0000 7f71ecc00640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f71d0066f60 0x7f71d0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:06.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.977+0000 7f71ecc00640 1 -- 172.21.15.59:0/1581790574 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f71dc085920 con 0x7f71f009a170 2024-04-25T09:06:06.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.977+0000 7f71f5200640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f71d0066f60 0x7f71d0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:06.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.977+0000 7f71f5200640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f71d0066f60 0x7f71d0069420 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f71e4005890 tx=0x7f71e4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:06.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:06.981+0000 7f71ecc00640 1 -- 172.21.15.59:0/1581790574 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f71dc056870 con 0x7f71f009a170 2024-04-25T09:06:07.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.173+0000 7f71f7c00640 1 -- 172.21.15.59:0/1581790574 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f71f00b7590 con 0x7f71f009a170 2024-04-25T09:06:07.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.801+0000 7f71ecc00640 1 -- 172.21.15.59:0/1581790574 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f71dc056170 con 0x7f71f009a170 2024-04-25T09:06:07.804 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 11 and data pool 12 2024-04-25T09:06:07.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.817+0000 7f71f7c00640 1 -- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f71d0066f60 msgr2=0x7f71d0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.817+0000 7f71f7c00640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f71d0066f60 0x7f71d0069420 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f71e4005890 tx=0x7f71e4009040 comp rx=0 tx=0).stop 2024-04-25T09:06:07.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.817+0000 7f71f7c00640 1 -- 172.21.15.59:0/1581790574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f009a170 msgr2=0x7f71f00ca410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.817+0000 7f71f7c00640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f009a170 0x7f71f00ca410 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00e960 tx=0x7f71dc00ee20 comp rx=0 tx=0).stop 2024-04-25T09:06:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.817+0000 7f71f7c00640 1 -- 172.21.15.59:0/1581790574 shutdown_connections 2024-04-25T09:06:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.817+0000 7f71f7c00640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f71d0066f60 0x7f71d0069420 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.817+0000 7f71f7c00640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f71f015dc60 0x7f71f00c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.817+0000 7f71f7c00640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71f009a170 0x7f71f00ca410 secure :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f71dc00e960 tx=0x7f71dc00ee20 comp rx=0 tx=0).stop 2024-04-25T09:06:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.817+0000 7f71f7c00640 1 --2- 172.21.15.59:0/1581790574 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71f006bf30 0x7f71f0153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.817+0000 7f71f7c00640 1 -- 172.21.15.59:0/1581790574 >> 172.21.15.59:0/1581790574 conn(0x7f71f00b3200 msgr2=0x7f71f0156410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.821+0000 7f71f7c00640 1 -- 172.21.15.59:0/1581790574 shutdown_connections 2024-04-25T09:06:07.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.821+0000 7f71f7c00640 1 -- 172.21.15.59:0/1581790574 wait complete. 2024-04-25T09:06:07.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:07.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.997+0000 7fa33f800640 1 Processor -- start 2024-04-25T09:06:07.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:07.997+0000 7fa33f800640 1 -- start start 2024-04-25T09:06:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa33f800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3380cef30 0x7fa33806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa33f800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa33806e900 0x7fa3380b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa33f800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa33815ac60 con 0x7fa338144140 2024-04-25T09:06:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa33f800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33806ed50 con 0x7fa3380cef30 2024-04-25T09:06:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa33f800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3380cf3e0 con 0x7fa33806e900 2024-04-25T09:06:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa32fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3380cef30 0x7fa33806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa32fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3380cef30 0x7fa33806e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37096/0 (socket says 172.21.15.59:37096) 2024-04-25T09:06:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa32fe00640 1 -- 172.21.15.59:0/1000049892 learned_addr learned my addr 172.21.15.59:0/1000049892 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa33d800640 1 --2- 172.21.15.59:0/1000049892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa33806e900 0x7fa3380b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa32fe00640 1 -- 172.21.15.59:0/1000049892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa33806e900 msgr2=0x7fa3380b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:07.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa32fe00640 1 --2- 172.21.15.59:0/1000049892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa33806e900 0x7fa3380b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa32fe00640 1 -- 172.21.15.59:0/1000049892 >> v1:172.21.15.178:6789/0 conn(0x7fa338144140 legacy=0x7fa3380ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa32fe00640 1 -- 172.21.15.59:0/1000049892 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33815af20 con 0x7fa3380cef30 2024-04-25T09:06:07.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.001+0000 7fa33d800640 1 --2- 172.21.15.59:0/1000049892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa33806e900 0x7fa3380b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:07.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa32fe00640 1 --2- 172.21.15.59:0/1000049892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3380cef30 0x7fa33806e3c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa320009870 tx=0x7fa32001e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5624c12bb5a7dbd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa337e00640 1 -- 172.21.15.59:0/1000049892 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200b2070 con 0x7fa3380cef30 2024-04-25T09:06:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa337e00640 1 -- 172.21.15.59:0/1000049892 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3200ad600 con 0x7fa3380cef30 2024-04-25T09:06:07.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa337e00640 1 -- 172.21.15.59:0/1000049892 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200ad9d0 con 0x7fa3380cef30 2024-04-25T09:06:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 -- 172.21.15.59:0/1000049892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3380cef30 msgr2=0x7fa33806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 --2- 172.21.15.59:0/1000049892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3380cef30 0x7fa33806e3c0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fa320009870 tx=0x7fa32001e770 comp rx=0 tx=0).stop 2024-04-25T09:06:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 -- 172.21.15.59:0/1000049892 shutdown_connections 2024-04-25T09:06:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 --2- 172.21.15.59:0/1000049892 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa33806e900 0x7fa3380b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 --2- 172.21.15.59:0/1000049892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3380cef30 0x7fa33806e3c0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 -- 172.21.15.59:0/1000049892 >> 172.21.15.59:0/1000049892 conn(0x7fa338066fa0 msgr2=0x7fa33806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 -- 172.21.15.59:0/1000049892 shutdown_connections 2024-04-25T09:06:07.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 -- 172.21.15.59:0/1000049892 wait complete. 2024-04-25T09:06:07.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 Processor -- start 2024-04-25T09:06:07.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 -- start start 2024-04-25T09:06:08.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa33806e900 0x7fa33812fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3380cef30 0x7fa3381522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa338144140 0x7fa3381540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815ba00 con 0x7fa338144140 2024-04-25T09:06:08.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa338144520 con 0x7fa3380cef30 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33f800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa33815bb80 con 0x7fa33806e900 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa338144140 0x7fa3381540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa338144140 0x7fa3381540b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37098/0 (socket says 172.21.15.59:37098) 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa33d800640 1 -- 172.21.15.59:0/3814869121 learned_addr learned my addr 172.21.15.59:0/3814869121 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.005+0000 7fa32fe00640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3380cef30 0x7fa3381522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa33ce00640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa33806e900 0x7fa33812fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa33d800640 1 -- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa33806e900 msgr2=0x7fa33812fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa33d800640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa33806e900 0x7fa33812fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa33d800640 1 -- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3380cef30 msgr2=0x7fa3381522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa33d800640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3380cef30 0x7fa3381522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa33d800640 1 -- 172.21.15.59:0/3814869121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338152bd0 con 0x7fa338144140 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa33ce00640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa33806e900 0x7fa33812fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:08.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa33d800640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa338144140 0x7fa3381540b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa330009fa0 tx=0x7fa33000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa335600640 1 -- 172.21.15.59:0/3814869121 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa33001a070 con 0x7fa338144140 2024-04-25T09:06:08.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa335600640 1 -- 172.21.15.59:0/3814869121 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa330003bc0 con 0x7fa338144140 2024-04-25T09:06:08.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa335600640 1 -- 172.21.15.59:0/3814869121 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa330004030 con 0x7fa338144140 2024-04-25T09:06:08.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa33f800640 1 -- 172.21.15.59:0/3814869121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa338152eb0 con 0x7fa338144140 2024-04-25T09:06:08.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa33f800640 1 -- 172.21.15.59:0/3814869121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa33813e4f0 con 0x7fa338144140 2024-04-25T09:06:08.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa33f800640 1 -- 172.21.15.59:0/3814869121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3380745d0 con 0x7fa338144140 2024-04-25T09:06:08.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.009+0000 7fa335600640 1 -- 172.21.15.59:0/3814869121 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa33001d070 con 0x7fa338144140 2024-04-25T09:06:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.013+0000 7fa335600640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa314066f60 0x7fa314069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.013+0000 7fa335600640 1 -- 172.21.15.59:0/3814869121 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa330085420 con 0x7fa338144140 2024-04-25T09:06:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.013+0000 7fa33ce00640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa314066f60 0x7fa314069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.013+0000 7fa33ce00640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa314066f60 0x7fa314069420 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa328001670 tx=0x7fa328009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.017+0000 7fa335600640 1 -- 172.21.15.59:0/3814869121 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa330010070 con 0x7fa338144140 2024-04-25T09:06:08.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.177+0000 7fa33f800640 1 -- 172.21.15.59:0/3814869121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa33806e640 con 0x7fa338144140 2024-04-25T09:06:08.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.177+0000 7fa335600640 1 -- 172.21.15.59:0/3814869121 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16958 (secure 0 0 0) 0x7fa330055c50 con 0x7fa338144140 2024-04-25T09:06:08.171 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:08.171 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":79,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:06:07.180875+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:04.967523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:06.198067+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:08.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.181+0000 7fa33f800640 1 -- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa314066f60 msgr2=0x7fa314069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.181+0000 7fa33f800640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa314066f60 0x7fa314069420 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa328001670 tx=0x7fa328009040 comp rx=0 tx=0).stop 2024-04-25T09:06:08.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.181+0000 7fa33f800640 1 -- 172.21.15.59:0/3814869121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa338144140 msgr2=0x7fa3381540b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.181+0000 7fa33f800640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa338144140 0x7fa3381540b0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fa330009fa0 tx=0x7fa33000d560 comp rx=0 tx=0).stop 2024-04-25T09:06:08.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.181+0000 7fa33f800640 1 -- 172.21.15.59:0/3814869121 shutdown_connections 2024-04-25T09:06:08.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.181+0000 7fa33f800640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa314066f60 0x7fa314069420 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.181+0000 7fa33f800640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa338144140 0x7fa3381540b0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.181+0000 7fa33f800640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3380cef30 0x7fa3381522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.181+0000 7fa33f800640 1 --2- 172.21.15.59:0/3814869121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa33806e900 0x7fa33812fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.181+0000 7fa33f800640 1 -- 172.21.15.59:0/3814869121 >> 172.21.15.59:0/3814869121 conn(0x7fa338066fa0 msgr2=0x7fa33815e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:08.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.181+0000 7fa33f800640 1 -- 172.21.15.59:0/3814869121 shutdown_connections 2024-04-25T09:06:08.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.181+0000 7fa33f800640 1 -- 172.21.15.59:0/3814869121 wait complete. 2024-04-25T09:06:08.192 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:08.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe78c00640 1 Processor -- start 2024-04-25T09:06:08.332 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe78c00640 1 -- start start 2024-04-25T09:06:08.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe78c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbe74147300 0x7fbe740b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe78c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe740b5670 0x7fbe7406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe78c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7415ea70 con 0x7fbe7406b150 2024-04-25T09:06:08.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe78c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe741476e0 con 0x7fbe74147300 2024-04-25T09:06:08.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe78c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740b35f0 con 0x7fbe740b5670 2024-04-25T09:06:08.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe73e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbe7406b150 0x7fbe740d01c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52096/0 (socket says 172.21.15.59:52096) 2024-04-25T09:06:08.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe73e00640 1 -- 172.21.15.59:0/2105675877 learned_addr learned my addr 172.21.15.59:0/2105675877 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72a00640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe740b5670 0x7fbe7406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437532360 0 0) 0x7fbe7415ea70 con 0x7fbe7406b150 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe73400640 1 --2- 172.21.15.59:0/2105675877 >> v2:172.21.15.178:3300/0 conn(0x7fbe74147300 0x7fbe740b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe58003530 con 0x7fbe7406b150 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 305320481 0 0) 0x7fbe58003530 con 0x7fbe7406b150 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe740b5670 msgr2=0x7fbe7406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe740b5670 0x7fbe7406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 >> v2:172.21.15.178:3300/0 conn(0x7fbe74147300 msgr2=0x7fbe740b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 --2- 172.21.15.59:0/2105675877 >> v2:172.21.15.178:3300/0 conn(0x7fbe74147300 0x7fbe740b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe740b38d0 con 0x7fbe7406b150 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fbe6c001a00 con 0x7fbe7406b150 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 >> v1:172.21.15.59:6789/0 conn(0x7fbe7406b150 legacy=0x7fbe740d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe580039c0 0x7fbe58003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe58004810 0x7fbe58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe740b5670 0x7fbe580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe741476e0 con 0x7fbe580039c0 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe740b35f0 con 0x7fbe58004810 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5800b9d0 con 0x7fbe740b5670 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe73400640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe580039c0 0x7fbe58003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72a00640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe58004810 0x7fbe58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe73e00640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe740b5670 0x7fbe580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe73400640 1 -- 172.21.15.59:0/2105675877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe740b5670 msgr2=0x7fbe580051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe73400640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe740b5670 0x7fbe580051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe73400640 1 -- 172.21.15.59:0/2105675877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe58004810 msgr2=0x7fbe58004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe73400640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe58004810 0x7fbe58004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe73400640 1 -- 172.21.15.59:0/2105675877 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe58003530 con 0x7fbe580039c0 2024-04-25T09:06:08.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.341+0000 7fbe72a00640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe58004810 0x7fbe58004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:08.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.345+0000 7fbe73400640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe580039c0 0x7fbe58003de0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fbe64009ae0 tx=0x7fbe6401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe6bd09e36ef406d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.345+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640096b0 con 0x7fbe580039c0 2024-04-25T09:06:08.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.345+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe640a8430 con 0x7fbe580039c0 2024-04-25T09:06:08.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.345+0000 7fbe72000640 1 -- 172.21.15.59:0/2105675877 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe640a8820 con 0x7fbe580039c0 2024-04-25T09:06:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.345+0000 7fbe78c00640 1 -- 172.21.15.59:0/2105675877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe580039c0 msgr2=0x7fbe58003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.345+0000 7fbe78c00640 1 --2- 172.21.15.59:0/2105675877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe580039c0 0x7fbe58003de0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fbe64009ae0 tx=0x7fbe6401cab0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.345+0000 7fbe73e00640 1 -- 172.21.15.59:0/2105675877 reap_dead start 2024-04-25T09:06:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.345+0000 7fbe78c00640 1 -- 172.21.15.59:0/2105675877 shutdown_connections 2024-04-25T09:06:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.345+0000 7fbe78c00640 1 -- 172.21.15.59:0/2105675877 >> 172.21.15.59:0/2105675877 conn(0x7fbe740b5b90 msgr2=0x7fbe74099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:08.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.345+0000 7fbe78c00640 1 -- 172.21.15.59:0/2105675877 shutdown_connections 2024-04-25T09:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.345+0000 7fbe78c00640 1 -- 172.21.15.59:0/2105675877 wait complete. 2024-04-25T09:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe78c00640 1 Processor -- start 2024-04-25T09:06:08.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe78c00640 1 -- start start 2024-04-25T09:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe78c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe580039c0 0x7fbe74162520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe78c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe741614e0 0x7fbe7415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe78c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe74142750 0x7fbe74142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe78c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe74168680 con 0x7fbe74142750 2024-04-25T09:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe78c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe74168500 con 0x7fbe741614e0 2024-04-25T09:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe78c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe74168800 con 0x7fbe580039c0 2024-04-25T09:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe73e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe74142750 0x7fbe74142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe73e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe74142750 0x7fbe74142be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37128/0 (socket says 172.21.15.59:37128) 2024-04-25T09:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe73e00640 1 -- 172.21.15.59:0/310986404 learned_addr learned my addr 172.21.15.59:0/310986404 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe73400640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe580039c0 0x7fbe74162520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe72a00640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe741614e0 0x7fbe7415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe73e00640 1 -- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe580039c0 msgr2=0x7fbe74162520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe73e00640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe580039c0 0x7fbe74162520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe73e00640 1 -- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe741614e0 msgr2=0x7fbe7415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe73e00640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe741614e0 0x7fbe7415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe73e00640 1 -- 172.21.15.59:0/310986404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe74163540 con 0x7fbe74142750 2024-04-25T09:06:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe72a00640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe741614e0 0x7fbe7415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe73e00640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe74142750 0x7fbe74142be0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fbe7406e120 tx=0x7fbe6c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe6b400640 1 -- 172.21.15.59:0/310986404 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c007ae0 con 0x7fbe74142750 2024-04-25T09:06:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe6b400640 1 -- 172.21.15.59:0/310986404 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c018070 con 0x7fbe74142750 2024-04-25T09:06:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe78c00640 1 -- 172.21.15.59:0/310986404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe74163820 con 0x7fbe74142750 2024-04-25T09:06:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe6b400640 1 -- 172.21.15.59:0/310986404 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c013420 con 0x7fbe74142750 2024-04-25T09:06:08.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.349+0000 7fbe78c00640 1 -- 172.21.15.59:0/310986404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe74163de0 con 0x7fbe74142750 2024-04-25T09:06:08.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.353+0000 7fbe78c00640 1 -- 172.21.15.59:0/310986404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7413d310 con 0x7fbe74142750 2024-04-25T09:06:08.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.353+0000 7fbe6b400640 1 -- 172.21.15.59:0/310986404 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbe6c0135c0 con 0x7fbe74142750 2024-04-25T09:06:08.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.353+0000 7fbe6b400640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe54066f90 0x7fbe54069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.353+0000 7fbe6b400640 1 -- 172.21.15.59:0/310986404 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbe6c0853f0 con 0x7fbe74142750 2024-04-25T09:06:08.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.353+0000 7fbe73400640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe54066f90 0x7fbe54069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.353+0000 7fbe73400640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe54066f90 0x7fbe54069450 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbe640af000 tx=0x7fbe640b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.357+0000 7fbe6b400640 1 -- 172.21.15.59:0/310986404 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbe7413d310 con 0x7fbe74142750 2024-04-25T09:06:08.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.521+0000 7fbe78c00640 1 -- 172.21.15.59:0/310986404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe7404efa0 con 0x7fbe74142750 2024-04-25T09:06:08.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.521+0000 7fbe6b400640 1 -- 172.21.15.59:0/310986404 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+16958 (secure 0 0 0) 0x7fbe6c0562e0 con 0x7fbe74142750 2024-04-25T09:06:08.514 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:08.514 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":79,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:06:07.180875+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:04.967523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:06.198067+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:08.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.525+0000 7fbe78c00640 1 -- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe54066f90 msgr2=0x7fbe54069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.525+0000 7fbe78c00640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe54066f90 0x7fbe54069450 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbe640af000 tx=0x7fbe640b3040 comp rx=0 tx=0).stop 2024-04-25T09:06:08.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.525+0000 7fbe78c00640 1 -- 172.21.15.59:0/310986404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe74142750 msgr2=0x7fbe74142be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.525+0000 7fbe78c00640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe74142750 0x7fbe74142be0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fbe7406e120 tx=0x7fbe6c00e530 comp rx=0 tx=0).stop 2024-04-25T09:06:08.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.525+0000 7fbe78c00640 1 -- 172.21.15.59:0/310986404 shutdown_connections 2024-04-25T09:06:08.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.525+0000 7fbe78c00640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe54066f90 0x7fbe54069450 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.525+0000 7fbe78c00640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe74142750 0x7fbe74142be0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.525+0000 7fbe78c00640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe741614e0 0x7fbe7415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.525+0000 7fbe78c00640 1 --2- 172.21.15.59:0/310986404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe580039c0 0x7fbe74162520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.525+0000 7fbe78c00640 1 -- 172.21.15.59:0/310986404 >> 172.21.15.59:0/310986404 conn(0x7fbe740b5b90 msgr2=0x7fbe74099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:08.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.525+0000 7fbe78c00640 1 -- 172.21.15.59:0/310986404 shutdown_connections 2024-04-25T09:06:08.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.525+0000 7fbe78c00640 1 -- 172.21.15.59:0/310986404 wait complete. 2024-04-25T09:06:08.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:06:08.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc24ee00640 1 Processor -- start 2024-04-25T09:06:08.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc24ee00640 1 -- start start 2024-04-25T09:06:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc24ee00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc248072210 0x7fc2480cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc24ee00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc2480ce1d0 0x7fc2480ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc24ee00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24806ac10 con 0x7fc24815dd90 2024-04-25T09:06:08.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc24ee00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2480b2dc0 con 0x7fc2480ce1d0 2024-04-25T09:06:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc24ee00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24806aeb0 con 0x7fc248072210 2024-04-25T09:06:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc24815dd90 0x7fc248071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52112/0 (socket says 172.21.15.59:52112) 2024-04-25T09:06:08.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247e00640 1 -- 172.21.15.59:0/611468528 learned_addr learned my addr 172.21.15.59:0/611468528 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc23fe00640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc248072210 0x7fc2480cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc24ce00640 1 --2- 172.21.15.59:0/611468528 >> v2:172.21.15.178:3300/0 conn(0x7fc2480ce1d0 0x7fc2480ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467931325 0 0) 0x7fc24806ac10 con 0x7fc24815dd90 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc22c003530 con 0x7fc24815dd90 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3600491671 0 0) 0x7fc22c003530 con 0x7fc24815dd90 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc248072210 msgr2=0x7fc2480cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc248072210 0x7fc2480cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 >> v2:172.21.15.178:3300/0 conn(0x7fc2480ce1d0 msgr2=0x7fc2480ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 --2- 172.21.15.59:0/611468528 >> v2:172.21.15.178:3300/0 conn(0x7fc2480ce1d0 0x7fc2480ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24806b190 con 0x7fc24815dd90 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fc238001680 con 0x7fc24815dd90 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 >> v1:172.21.15.59:6789/0 conn(0x7fc24815dd90 legacy=0x7fc248071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc22c0039c0 0x7fc22c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc22c0043b0 0x7fc22c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc22c004fa0 0x7fc22c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24806aeb0 con 0x7fc22c0043b0 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c00bf10 con 0x7fc22c004fa0 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc22c00c0c0 con 0x7fc22c0039c0 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc23fe00640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc248072210 0x7fc2480cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc23fe00640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc22c0043b0 0x7fc22c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc247e00640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc22c0039c0 0x7fc22c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc24ce00640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc22c004fa0 0x7fc22c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc23fe00640 1 -- 172.21.15.59:0/611468528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc22c0039c0 msgr2=0x7fc22c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc23fe00640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc22c0039c0 0x7fc22c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc23fe00640 1 -- 172.21.15.59:0/611468528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc22c004fa0 msgr2=0x7fc22c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc23fe00640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc22c004fa0 0x7fc22c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.689+0000 7fc23fe00640 1 -- 172.21.15.59:0/611468528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c003530 con 0x7fc22c0043b0 2024-04-25T09:06:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.693+0000 7fc23fe00640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc22c0043b0 0x7fc22c004890 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc2481616e0 tx=0x7fc23001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2141ae32394a20f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.693+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2300ac020 con 0x7fc22c0043b0 2024-04-25T09:06:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.693+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc230004030 con 0x7fc22c0043b0 2024-04-25T09:06:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.693+0000 7fc247400640 1 -- 172.21.15.59:0/611468528 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2300097f0 con 0x7fc22c0043b0 2024-04-25T09:06:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.693+0000 7fc24ee00640 1 -- 172.21.15.59:0/611468528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc22c0043b0 msgr2=0x7fc22c004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.693+0000 7fc24ee00640 1 --2- 172.21.15.59:0/611468528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc22c0043b0 0x7fc22c004890 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fc2481616e0 tx=0x7fc23001ca50 comp rx=0 tx=0).stop 2024-04-25T09:06:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.693+0000 7fc24ce00640 1 -- 172.21.15.59:0/611468528 reap_dead start 2024-04-25T09:06:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.693+0000 7fc24ee00640 1 -- 172.21.15.59:0/611468528 shutdown_connections 2024-04-25T09:06:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.693+0000 7fc24ee00640 1 -- 172.21.15.59:0/611468528 >> 172.21.15.59:0/611468528 conn(0x7fc2480cfd90 msgr2=0x7fc2480d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.693+0000 7fc24ee00640 1 -- 172.21.15.59:0/611468528 shutdown_connections 2024-04-25T09:06:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.693+0000 7fc24ee00640 1 -- 172.21.15.59:0/611468528 wait complete. 2024-04-25T09:06:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ee00640 1 Processor -- start 2024-04-25T09:06:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ee00640 1 -- start start 2024-04-25T09:06:08.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ee00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc22c0043b0 0x7fc248160970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ee00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2481599f0 0x7fc2481fa3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc24815fef0 0x7fc2481fa920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2480cf720 con 0x7fc24815fef0 2024-04-25T09:06:08.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ee00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2480cf5a0 con 0x7fc22c0043b0 2024-04-25T09:06:08.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ee00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2480cf8a0 con 0x7fc2481599f0 2024-04-25T09:06:08.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc24815fef0 0x7fc2481fa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc24815fef0 0x7fc2481fa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37138/0 (socket says 172.21.15.59:37138) 2024-04-25T09:06:08.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ce00640 1 -- 172.21.15.59:0/2767448245 learned_addr learned my addr 172.21.15.59:0/2767448245 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:08.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc247e00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc22c0043b0 0x7fc248160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc23fe00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2481599f0 0x7fc2481fa3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ce00640 1 -- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2481599f0 msgr2=0x7fc2481fa3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ce00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2481599f0 0x7fc2481fa3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ce00640 1 -- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc22c0043b0 msgr2=0x7fc248160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ce00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc22c0043b0 0x7fc248160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ce00640 1 -- 172.21.15.59:0/2767448245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2480ad990 con 0x7fc24815fef0 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc247e00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc22c0043b0 0x7fc248160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc23fe00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2481599f0 0x7fc2481fa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ce00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc24815fef0 0x7fc2481fa920 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc24809dfd0 tx=0x7fc24000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc244c00640 1 -- 172.21.15.59:0/2767448245 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24000fd80 con 0x7fc24815fef0 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc244c00640 1 -- 172.21.15.59:0/2767448245 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240015430 con 0x7fc24815fef0 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ee00640 1 -- 172.21.15.59:0/2767448245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2480adc70 con 0x7fc24815fef0 2024-04-25T09:06:08.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc244c00640 1 -- 172.21.15.59:0/2767448245 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240015820 con 0x7fc24815fef0 2024-04-25T09:06:08.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.697+0000 7fc24ee00640 1 -- 172.21.15.59:0/2767448245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc248160eb0 con 0x7fc24815fef0 2024-04-25T09:06:08.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.701+0000 7fc24ee00640 1 -- 172.21.15.59:0/2767448245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2480745d0 con 0x7fc24815fef0 2024-04-25T09:06:08.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.701+0000 7fc244c00640 1 -- 172.21.15.59:0/2767448245 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc2400159c0 con 0x7fc24815fef0 2024-04-25T09:06:08.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.701+0000 7fc244c00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc224066f60 0x7fc224069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:08.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.701+0000 7fc244c00640 1 -- 172.21.15.59:0/2767448245 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc240086170 con 0x7fc24815fef0 2024-04-25T09:06:08.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.701+0000 7fc247e00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc224066f60 0x7fc224069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:08.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.701+0000 7fc247e00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc224066f60 0x7fc224069420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc238000c10 tx=0x7fc238009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:08.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.705+0000 7fc244c00640 1 -- 172.21.15.59:0/2767448245 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc240019030 con 0x7fc24815fef0 2024-04-25T09:06:08.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:08.905+0000 7fc24ee00640 1 -- 172.21.15.59:0/2767448245 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc2480671b0 con 0x7fc24815fef0 2024-04-25T09:06:09.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.825+0000 7fc244c00640 1 -- 172.21.15.59:0/2767448245 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc240010040 con 0x7fc24815fef0 2024-04-25T09:06:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.829+0000 7fc24ee00640 1 -- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc224066f60 msgr2=0x7fc224069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.829+0000 7fc24ee00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc224066f60 0x7fc224069420 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc238000c10 tx=0x7fc238009040 comp rx=0 tx=0).stop 2024-04-25T09:06:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.829+0000 7fc24ee00640 1 -- 172.21.15.59:0/2767448245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc24815fef0 msgr2=0x7fc2481fa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.829+0000 7fc24ee00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc24815fef0 0x7fc2481fa920 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc24809dfd0 tx=0x7fc24000f580 comp rx=0 tx=0).stop 2024-04-25T09:06:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.829+0000 7fc24ee00640 1 -- 172.21.15.59:0/2767448245 shutdown_connections 2024-04-25T09:06:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.829+0000 7fc24ee00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc224066f60 0x7fc224069420 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.829+0000 7fc24ee00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc24815fef0 0x7fc2481fa920 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.829+0000 7fc24ee00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc2481599f0 0x7fc2481fa3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.829+0000 7fc24ee00640 1 --2- 172.21.15.59:0/2767448245 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc22c0043b0 0x7fc248160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.829+0000 7fc24ee00640 1 -- 172.21.15.59:0/2767448245 >> 172.21.15.59:0/2767448245 conn(0x7fc2480cfd90 msgr2=0x7fc248073980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:09.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.829+0000 7fc24ee00640 1 -- 172.21.15.59:0/2767448245 shutdown_connections 2024-04-25T09:06:09.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.829+0000 7fc24ee00640 1 -- 172.21.15.59:0/2767448245 wait complete. 2024-04-25T09:06:09.842 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:06:09.843 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:06:09.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.997+0000 7f089c600640 1 Processor -- start 2024-04-25T09:06:09.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:09.997+0000 7f089c600640 1 -- start start 2024-04-25T09:06:09.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f089c600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f089409a170 0x7f08940d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f089c600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089406bf30 0x7f08940cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:09.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f089c600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089415e040 con 0x7f089415dc60 2024-04-25T09:06:09.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f089c600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08940cff80 con 0x7f089409a170 2024-04-25T09:06:09.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f089c600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08940d0260 con 0x7f089406bf30 2024-04-25T09:06:09.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f0899200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f089409a170 0x7f08940d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f0899c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f089415dc60 0x7f0894099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52128/0 (socket says 172.21.15.59:52128) 2024-04-25T09:06:09.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f0899c00640 1 -- 172.21.15.59:0/3254394869 learned_addr learned my addr 172.21.15.59:0/3254394869 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:09.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f0899200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f089409a170 0x7f08940d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37148/0 (socket says 172.21.15.59:37148) 2024-04-25T09:06:09.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f089a600640 1 --2- 172.21.15.59:0/3254394869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089406bf30 0x7f08940cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:09.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f0899200640 1 -- 172.21.15.59:0/3254394869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089406bf30 msgr2=0x7f08940cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:09.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f0899200640 1 --2- 172.21.15.59:0/3254394869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089406bf30 0x7f08940cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f0899200640 1 -- 172.21.15.59:0/3254394869 >> v1:172.21.15.59:6789/0 conn(0x7f089415dc60 legacy=0x7f0894099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f0899200640 1 -- 172.21.15.59:0/3254394869 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08940d0540 con 0x7f089409a170 2024-04-25T09:06:09.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.001+0000 7f0893e00640 1 -- 172.21.15.59:0/3254394869 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2457629728 0 0) 0x7f089415e040 con 0x7f089415dc60 2024-04-25T09:06:09.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f0899200640 1 --2- 172.21.15.59:0/3254394869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089409a170 0x7f08940d1020 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f08800097c0 tx=0x7f088001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3807a52e9bbd47b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:09.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f0893e00640 1 -- 172.21.15.59:0/3254394869 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08800b1070 con 0x7f089409a170 2024-04-25T09:06:09.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f0893e00640 1 -- 172.21.15.59:0/3254394869 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08800a8050 con 0x7f089409a170 2024-04-25T09:06:09.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f0893e00640 1 -- 172.21.15.59:0/3254394869 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08800ac860 con 0x7f089409a170 2024-04-25T09:06:09.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f089c600640 1 -- 172.21.15.59:0/3254394869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089409a170 msgr2=0x7f08940d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:09.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f089c600640 1 --2- 172.21.15.59:0/3254394869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089409a170 0x7f08940d1020 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f08800097c0 tx=0x7f088001c3e0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f089c600640 1 -- 172.21.15.59:0/3254394869 shutdown_connections 2024-04-25T09:06:09.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f089c600640 1 --2- 172.21.15.59:0/3254394869 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089406bf30 0x7f08940cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f089c600640 1 --2- 172.21.15.59:0/3254394869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089409a170 0x7f08940d1020 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:09.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f089c600640 1 -- 172.21.15.59:0/3254394869 >> 172.21.15.59:0/3254394869 conn(0x7f08940b3200 msgr2=0x7f08940b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:09.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f089c600640 1 -- 172.21.15.59:0/3254394869 shutdown_connections 2024-04-25T09:06:09.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f089c600640 1 -- 172.21.15.59:0/3254394869 wait complete. 2024-04-25T09:06:09.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f089c600640 1 Processor -- start 2024-04-25T09:06:09.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.005+0000 7f089c600640 1 -- start start 2024-04-25T09:06:10.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f089c600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089406bf30 0x7f08940c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f089c600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089409a170 0x7f0894153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f089c600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f089415dc60 0x7f0894154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f089c600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08940cc6f0 con 0x7f089406bf30 2024-04-25T09:06:10.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f089c600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08940cc570 con 0x7f089415dc60 2024-04-25T09:06:10.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f089c600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08940cc870 con 0x7f089409a170 2024-04-25T09:06:10.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0899c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089406bf30 0x7f08940c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0899c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089406bf30 0x7f08940c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37154/0 (socket says 172.21.15.59:37154) 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0899c00640 1 -- 172.21.15.59:0/2162464540 learned_addr learned my addr 172.21.15.59:0/2162464540 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f089a600640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f089415dc60 0x7f0894154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0899200640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089409a170 0x7f0894153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0899c00640 1 -- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089409a170 msgr2=0x7f0894153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0899c00640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089409a170 0x7f0894153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0899c00640 1 -- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f089415dc60 msgr2=0x7f0894154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0899c00640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f089415dc60 0x7f0894154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0899c00640 1 -- 172.21.15.59:0/2162464540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0894155470 con 0x7f089406bf30 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0899c00640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089406bf30 0x7f08940c8a40 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f088800c480 tx=0x7f088800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0891600640 1 -- 172.21.15.59:0/2162464540 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888018070 con 0x7f089406bf30 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0891600640 1 -- 172.21.15.59:0/2162464540 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0888007500 con 0x7f089406bf30 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0891600640 1 -- 172.21.15.59:0/2162464540 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0888004a30 con 0x7f089406bf30 2024-04-25T09:06:10.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f089c600640 1 -- 172.21.15.59:0/2162464540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0894155750 con 0x7f089406bf30 2024-04-25T09:06:10.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f089c600640 1 -- 172.21.15.59:0/2162464540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0894155090 con 0x7f089406bf30 2024-04-25T09:06:10.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f089c600640 1 -- 172.21.15.59:0/2162464540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08940745d0 con 0x7f089406bf30 2024-04-25T09:06:10.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.009+0000 7f0891600640 1 -- 172.21.15.59:0/2162464540 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f088801b070 con 0x7f089406bf30 2024-04-25T09:06:10.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.013+0000 7f0891600640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0874066f90 0x7f0874069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.013+0000 7f0891600640 1 -- 172.21.15.59:0/2162464540 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0888084410 con 0x7f089406bf30 2024-04-25T09:06:10.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.013+0000 7f0899200640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0874066f90 0x7f0874069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.013+0000 7f0899200640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0874066f90 0x7f0874069450 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f08800ae000 tx=0x7f08800a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.017+0000 7f0891600640 1 -- 172.21.15.59:0/2162464540 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0888054cd0 con 0x7f089406bf30 2024-04-25T09:06:10.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.213+0000 7f089c600640 1 -- 172.21.15.59:0/2162464540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f08940b7590 con 0x7f089406bf30 2024-04-25T09:06:10.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f0891600640 1 -- 172.21.15.59:0/2162464540 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0888058d70 con 0x7f089406bf30 2024-04-25T09:06:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f089c600640 1 -- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0874066f90 msgr2=0x7f0874069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f089c600640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0874066f90 0x7f0874069450 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f08800ae000 tx=0x7f08800a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f089c600640 1 -- 172.21.15.59:0/2162464540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089406bf30 msgr2=0x7f08940c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f089c600640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089406bf30 0x7f08940c8a40 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f088800c480 tx=0x7f088800c940 comp rx=0 tx=0).stop 2024-04-25T09:06:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f089c600640 1 -- 172.21.15.59:0/2162464540 shutdown_connections 2024-04-25T09:06:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f089c600640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0874066f90 0x7f0874069450 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f089c600640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f089415dc60 0x7f0894154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f089c600640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f089409a170 0x7f0894153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f089c600640 1 --2- 172.21.15.59:0/2162464540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089406bf30 0x7f08940c8a40 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f089c600640 1 -- 172.21.15.59:0/2162464540 >> 172.21.15.59:0/2162464540 conn(0x7f08940b3200 msgr2=0x7f08940cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f089c600640 1 -- 172.21.15.59:0/2162464540 shutdown_connections 2024-04-25T09:06:10.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.829+0000 7f089c600640 1 -- 172.21.15.59:0/2162464540 wait complete. 2024-04-25T09:06:10.846 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:06:10.846 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:10.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.997+0000 7fe43fa00640 1 Processor -- start 2024-04-25T09:06:10.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:10.997+0000 7fe43fa00640 1 -- start start 2024-04-25T09:06:10.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43fa00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe43815b2f0 0x7fe4380b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43fa00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43806edc0 con 0x7fe4380b2dc0 2024-04-25T09:06:10.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43fa00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43815def0 con 0x7fe43806dad0 2024-04-25T09:06:10.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43fa00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43815e1b0 con 0x7fe43815b2f0 2024-04-25T09:06:10.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe42fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe4380b2dc0 0x7fe43806dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55046/0 (socket says 172.21.15.59:55046) 2024-04-25T09:06:10.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe42fe00640 1 -- 172.21.15.59:0/4212928352 learned_addr learned my addr 172.21.15.59:0/4212928352 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:10.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411832018 0 0) 0x7fe43806edc0 con 0x7fe4380b2dc0 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe41c003530 con 0x7fe4380b2dc0 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43d000640 1 --2- 172.21.15.59:0/4212928352 >> v2:172.21.15.178:3300/0 conn(0x7fe43815b2f0 0x7fe4380b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1027948892 0 0) 0x7fe41c003530 con 0x7fe4380b2dc0 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 >> v2:172.21.15.178:3300/0 conn(0x7fe43815b2f0 msgr2=0x7fe4380b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 --2- 172.21.15.59:0/4212928352 >> v2:172.21.15.178:3300/0 conn(0x7fe43815b2f0 0x7fe4380b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 >> v1:172.21.15.178:6789/0 conn(0x7fe43806dad0 legacy=0x7fe43806e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43815e490 con 0x7fe4380b2dc0 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fe420001680 con 0x7fe4380b2dc0 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 >> v1:172.21.15.59:6789/0 conn(0x7fe4380b2dc0 legacy=0x7fe43806dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 --2- 172.21.15.59:0/4212928352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe41c003a10 0x7fe41c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 --2- 172.21.15.59:0/4212928352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe41c004810 0x7fe41c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 --2- 172.21.15.59:0/4212928352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c005220 0x7fe41c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:10.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43815e1b0 con 0x7fe41c003a10 2024-04-25T09:06:10.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c00c170 con 0x7fe41c004810 2024-04-25T09:06:10.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c00c370 con 0x7fe41c005220 2024-04-25T09:06:10.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43d000640 1 --2- 172.21.15.59:0/4212928352 >> v2:172.21.15.178:3300/0 conn(0x7fe43815b2f0 0x7fe4380b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:10.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe42fe00640 1 --2- 172.21.15.59:0/4212928352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe41c004810 0x7fe41c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43d000640 1 --2- 172.21.15.59:0/4212928352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe41c003a10 0x7fe41c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43da00640 1 --2- 172.21.15.59:0/4212928352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c005220 0x7fe41c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:10.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43d000640 1 -- 172.21.15.59:0/4212928352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c005220 msgr2=0x7fe41c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43d000640 1 --2- 172.21.15.59:0/4212928352 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c005220 0x7fe41c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43d000640 1 -- 172.21.15.59:0/4212928352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe41c004810 msgr2=0x7fe41c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:10.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43d000640 1 --2- 172.21.15.59:0/4212928352 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe41c004810 0x7fe41c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43d000640 1 -- 172.21.15.59:0/4212928352 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c003530 con 0x7fe41c003a10 2024-04-25T09:06:10.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.001+0000 7fe43da00640 1 -- 172.21.15.59:0/4212928352 reap_dead start 2024-04-25T09:06:10.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.005+0000 7fe43d000640 1 --2- 172.21.15.59:0/4212928352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe41c003a10 0x7fe41c003e30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fe4280098b0 tx=0x7fe42801c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f33c5f8e346fcd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:10.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.005+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42800f040 con 0x7fe41c003a10 2024-04-25T09:06:10.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.005+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe428004220 con 0x7fe41c003a10 2024-04-25T09:06:10.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.005+0000 7fe437e00640 1 -- 172.21.15.59:0/4212928352 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428003620 con 0x7fe41c003a10 2024-04-25T09:06:10.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.005+0000 7fe43fa00640 1 -- 172.21.15.59:0/4212928352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe41c003a10 msgr2=0x7fe41c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:10.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.005+0000 7fe43fa00640 1 --2- 172.21.15.59:0/4212928352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe41c003a10 0x7fe41c003e30 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fe4280098b0 tx=0x7fe42801c5a0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.005+0000 7fe43fa00640 1 -- 172.21.15.59:0/4212928352 shutdown_connections 2024-04-25T09:06:10.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.005+0000 7fe43fa00640 1 --2- 172.21.15.59:0/4212928352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe41c003a10 0x7fe41c003e30 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:10.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.005+0000 7fe43fa00640 1 -- 172.21.15.59:0/4212928352 >> 172.21.15.59:0/4212928352 conn(0x7fe4380b23b0 msgr2=0x7fe4380cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:10.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.005+0000 7fe43fa00640 1 -- 172.21.15.59:0/4212928352 shutdown_connections 2024-04-25T09:06:10.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.005+0000 7fe43fa00640 1 -- 172.21.15.59:0/4212928352 wait complete. 2024-04-25T09:06:11.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43fa00640 1 Processor -- start 2024-04-25T09:06:11.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43fa00640 1 -- start start 2024-04-25T09:06:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43fa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c003a10 0x7fe438159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43fa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe438158c70 0x7fe4381f8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43fa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4380c8550 0x7fe4380c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43fa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4381614e0 con 0x7fe438158c70 2024-04-25T09:06:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43fa00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43815b8e0 con 0x7fe4380c8550 2024-04-25T09:06:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43fa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe438161660 con 0x7fe41c003a10 2024-04-25T09:06:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe42fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe438158c70 0x7fe4381f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe42fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe438158c70 0x7fe4381f8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45596/0 (socket says 172.21.15.59:45596) 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe42fe00640 1 -- 172.21.15.59:0/3763911295 learned_addr learned my addr 172.21.15.59:0/3763911295 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43d000640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c003a10 0x7fe438159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43da00640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4380c8550 0x7fe4380c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe42fe00640 1 -- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c003a10 msgr2=0x7fe438159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe42fe00640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c003a10 0x7fe438159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe42fe00640 1 -- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4380c8550 msgr2=0x7fe4380c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe42fe00640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4380c8550 0x7fe4380c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe42fe00640 1 -- 172.21.15.59:0/3763911295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4381590f0 con 0x7fe438158c70 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43da00640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4380c8550 0x7fe4380c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe42fe00640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe438158c70 0x7fe4381f8230 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fe4200072c0 tx=0x7fe420007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe435600640 1 -- 172.21.15.59:0/3763911295 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe420001620 con 0x7fe438158c70 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe435600640 1 -- 172.21.15.59:0/3763911295 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe420018070 con 0x7fe438158c70 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43fa00640 1 -- 172.21.15.59:0/3763911295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4381f89a0 con 0x7fe438158c70 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe435600640 1 -- 172.21.15.59:0/3763911295 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42000fc00 con 0x7fe438158c70 2024-04-25T09:06:11.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43fa00640 1 -- 172.21.15.59:0/3763911295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4381f8f60 con 0x7fe438158c70 2024-04-25T09:06:11.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.009+0000 7fe43fa00640 1 -- 172.21.15.59:0/3763911295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4380745d0 con 0x7fe438158c70 2024-04-25T09:06:11.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.013+0000 7fe435600640 1 -- 172.21.15.59:0/3763911295 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe42001d460 con 0x7fe438158c70 2024-04-25T09:06:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.013+0000 7fe435600640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe414066f90 0x7fe414069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.013+0000 7fe435600640 1 -- 172.21.15.59:0/3763911295 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe4200850b0 con 0x7fe438158c70 2024-04-25T09:06:11.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.013+0000 7fe43d000640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe414066f90 0x7fe414069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.013+0000 7fe43d000640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe414066f90 0x7fe414069450 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe4280ad000 tx=0x7fe4280b4040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.017+0000 7fe435600640 1 -- 172.21.15.59:0/3763911295 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe420055fc0 con 0x7fe438158c70 2024-04-25T09:06:11.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.213+0000 7fe43fa00640 1 -- 172.21.15.59:0/3763911295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe4380d0ab0 con 0x7fe438158c70 2024-04-25T09:06:11.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.213+0000 7fe435600640 1 -- 172.21.15.59:0/3763911295 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fe4200558c0 con 0x7fe438158c70 2024-04-25T09:06:11.207 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:11.207 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":48,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:07.181212+0000","modified":"2024-04-25T09:06:10.221503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/1468235926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1468235926},{"type":"v1","addr":"172.21.15.59:6834","nonce":1468235926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:06:11.207 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 48 2024-04-25T09:06:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.217+0000 7fe43fa00640 1 -- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe414066f90 msgr2=0x7fe414069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.217+0000 7fe43fa00640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe414066f90 0x7fe414069450 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe4280ad000 tx=0x7fe4280b4040 comp rx=0 tx=0).stop 2024-04-25T09:06:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.217+0000 7fe43fa00640 1 -- 172.21.15.59:0/3763911295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe438158c70 msgr2=0x7fe4381f8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.217+0000 7fe43fa00640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe438158c70 0x7fe4381f8230 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fe4200072c0 tx=0x7fe420007780 comp rx=0 tx=0).stop 2024-04-25T09:06:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.217+0000 7fe43fa00640 1 -- 172.21.15.59:0/3763911295 shutdown_connections 2024-04-25T09:06:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.217+0000 7fe43fa00640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe414066f90 0x7fe414069450 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.217+0000 7fe43fa00640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4380c8550 0x7fe4380c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.217+0000 7fe43fa00640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe438158c70 0x7fe4381f8230 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.217+0000 7fe43fa00640 1 --2- 172.21.15.59:0/3763911295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe41c003a10 0x7fe438159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.217+0000 7fe43fa00640 1 -- 172.21.15.59:0/3763911295 >> 172.21.15.59:0/3763911295 conn(0x7fe4380b23b0 msgr2=0x7fe43806e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.217+0000 7fe43fa00640 1 -- 172.21.15.59:0/3763911295 shutdown_connections 2024-04-25T09:06:11.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.217+0000 7fe43fa00640 1 -- 172.21.15.59:0/3763911295 wait complete. 2024-04-25T09:06:11.228 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:11.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91ada00640 1 Processor -- start 2024-04-25T09:06:11.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91ada00640 1 -- start start 2024-04-25T09:06:11.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91ada00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91a80ae6d0 0x7f91a806e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91ada00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a815c1f0 con 0x7f91a815b890 2024-04-25T09:06:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91ada00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a815c4d0 con 0x7f91a80cc260 2024-04-25T09:06:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91ada00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a815c7b0 con 0x7f91a80ae6d0 2024-04-25T09:06:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91ad000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91a80ae6d0 0x7f91a806e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91a7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f91a815b890 0x7f91a80adfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55054/0 (socket says 172.21.15.59:55054) 2024-04-25T09:06:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91a7e00640 1 -- 172.21.15.59:0/3578132493 learned_addr learned my addr 172.21.15.59:0/3578132493 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91ad000640 1 -- 172.21.15.59:0/3578132493 >> v1:172.21.15.178:6789/0 conn(0x7f91a80cc260 legacy=0x7f91a806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91ad000640 1 -- 172.21.15.59:0/3578132493 >> v1:172.21.15.59:6789/0 conn(0x7f91a815b890 legacy=0x7f91a80adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91ad000640 1 -- 172.21.15.59:0/3578132493 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a815ca90 con 0x7f91a80ae6d0 2024-04-25T09:06:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.377+0000 7f91a7400640 1 -- 172.21.15.59:0/3578132493 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079272031 0 0) 0x7f91a815c1f0 con 0x7f91a815b890 2024-04-25T09:06:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91ad000640 1 --2- 172.21.15.59:0/3578132493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91a80ae6d0 0x7f91a806e220 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009d90 tx=0x7f91a806ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd07d32ec55739bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91a7400640 1 -- 172.21.15.59:0/3578132493 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a00b2070 con 0x7f91a80ae6d0 2024-04-25T09:06:11.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91a7400640 1 -- 172.21.15.59:0/3578132493 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91a00a5a20 con 0x7f91a80ae6d0 2024-04-25T09:06:11.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91a7400640 1 -- 172.21.15.59:0/3578132493 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91a00a5df0 con 0x7f91a80ae6d0 2024-04-25T09:06:11.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91ada00640 1 -- 172.21.15.59:0/3578132493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91a80ae6d0 msgr2=0x7f91a806e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91ada00640 1 --2- 172.21.15.59:0/3578132493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91a80ae6d0 0x7f91a806e220 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f91a0009d90 tx=0x7f91a806ef70 comp rx=0 tx=0).stop 2024-04-25T09:06:11.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91ada00640 1 -- 172.21.15.59:0/3578132493 shutdown_connections 2024-04-25T09:06:11.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91ada00640 1 --2- 172.21.15.59:0/3578132493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91a80ae6d0 0x7f91a806e220 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91ada00640 1 -- 172.21.15.59:0/3578132493 >> 172.21.15.59:0/3578132493 conn(0x7f91a80726f0 msgr2=0x7f91a806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91ada00640 1 -- 172.21.15.59:0/3578132493 shutdown_connections 2024-04-25T09:06:11.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91ada00640 1 -- 172.21.15.59:0/3578132493 wait complete. 2024-04-25T09:06:11.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91ada00640 1 Processor -- start 2024-04-25T09:06:11.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.381+0000 7f91ada00640 1 -- start start 2024-04-25T09:06:11.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91ada00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91a80ae6d0 0x7f91a81506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91ada00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91a80cc260 0x7f91a8166b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91ada00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91a815b890 0x7f91a8152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91ada00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a81699d0 con 0x7f91a80ae6d0 2024-04-25T09:06:11.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91ada00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a8169850 con 0x7f91a80cc260 2024-04-25T09:06:11.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91ada00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a8169b50 con 0x7f91a815b890 2024-04-25T09:06:11.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91a7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91a80ae6d0 0x7f91a81506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91a7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91a80ae6d0 0x7f91a81506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45618/0 (socket says 172.21.15.59:45618) 2024-04-25T09:06:11.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91a7e00640 1 -- 172.21.15.59:0/1971656139 learned_addr learned my addr 172.21.15.59:0/1971656139 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:11.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91ad000640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91a815b890 0x7f91a8152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91a7e00640 1 -- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91a815b890 msgr2=0x7f91a8152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f919fe00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91a80cc260 0x7f91a8166b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91a7e00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91a815b890 0x7f91a8152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91a7e00640 1 -- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91a80cc260 msgr2=0x7f91a8166b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91a7e00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91a80cc260 0x7f91a8166b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91a7e00640 1 -- 172.21.15.59:0/1971656139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a8164c00 con 0x7f91a80ae6d0 2024-04-25T09:06:11.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91ad000640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91a815b890 0x7f91a8152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f919fe00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91a80cc260 0x7f91a8166b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91a7e00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91a80ae6d0 0x7f91a81506e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f919800c410 tx=0x7f919800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91a4c00640 1 -- 172.21.15.59:0/1971656139 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91980074e0 con 0x7f91a80ae6d0 2024-04-25T09:06:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91a4c00640 1 -- 172.21.15.59:0/1971656139 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91980047f0 con 0x7f91a80ae6d0 2024-04-25T09:06:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91a4c00640 1 -- 172.21.15.59:0/1971656139 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9198007680 con 0x7f91a80ae6d0 2024-04-25T09:06:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91ada00640 1 -- 172.21.15.59:0/1971656139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a8164ee0 con 0x7f91a80ae6d0 2024-04-25T09:06:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91ada00640 1 -- 172.21.15.59:0/1971656139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a81654a0 con 0x7f91a80ae6d0 2024-04-25T09:06:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.385+0000 7f91ada00640 1 -- 172.21.15.59:0/1971656139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a804efa0 con 0x7f91a80ae6d0 2024-04-25T09:06:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.389+0000 7f91a4c00640 1 -- 172.21.15.59:0/1971656139 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9198011070 con 0x7f91a80ae6d0 2024-04-25T09:06:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.389+0000 7f91a4c00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9184066f60 0x7f9184069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.389+0000 7f91a4c00640 1 -- 172.21.15.59:0/1971656139 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9198084e50 con 0x7f91a80ae6d0 2024-04-25T09:06:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.389+0000 7f919fe00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9184066f60 0x7f9184069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.389+0000 7f919fe00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9184066f60 0x7f9184069420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f91a806c190 tx=0x7f9190009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.393+0000 7f91a4c00640 1 -- 172.21.15.59:0/1971656139 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9198055cc0 con 0x7f91a80ae6d0 2024-04-25T09:06:11.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.553+0000 7f91ada00640 1 -- 172.21.15.59:0/1971656139 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91a8150c20 con 0x7f91a80ae6d0 2024-04-25T09:06:11.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.553+0000 7f91a4c00640 1 -- 172.21.15.59:0/1971656139 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16945 (secure 0 0 0) 0x7f91980555c0 con 0x7f91a80ae6d0 2024-04-25T09:06:11.547 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:11.547 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":80,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:06:08.804276+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:04.967523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:06.198067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:11.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.557+0000 7f91ada00640 1 -- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9184066f60 msgr2=0x7f9184069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.557+0000 7f91ada00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9184066f60 0x7f9184069420 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f91a806c190 tx=0x7f9190009040 comp rx=0 tx=0).stop 2024-04-25T09:06:11.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.557+0000 7f91ada00640 1 -- 172.21.15.59:0/1971656139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91a80ae6d0 msgr2=0x7f91a81506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.557+0000 7f91ada00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91a80ae6d0 0x7f91a81506e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f919800c410 tx=0x7f919800c8d0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.557+0000 7f91ada00640 1 -- 172.21.15.59:0/1971656139 shutdown_connections 2024-04-25T09:06:11.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.557+0000 7f91ada00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9184066f60 0x7f9184069420 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.557+0000 7f91ada00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91a815b890 0x7f91a8152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.557+0000 7f91ada00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91a80cc260 0x7f91a8166b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.557+0000 7f91ada00640 1 --2- 172.21.15.59:0/1971656139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91a80ae6d0 0x7f91a81506e0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.557+0000 7f91ada00640 1 -- 172.21.15.59:0/1971656139 >> 172.21.15.59:0/1971656139 conn(0x7f91a80726f0 msgr2=0x7f91a815f770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.557+0000 7f91ada00640 1 -- 172.21.15.59:0/1971656139 shutdown_connections 2024-04-25T09:06:11.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.557+0000 7f91ada00640 1 -- 172.21.15.59:0/1971656139 wait complete. 2024-04-25T09:06:11.569 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:06:11.569 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.717+0000 7f995ae00640 1 Processor -- start 2024-04-25T09:06:11.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.717+0000 7f995ae00640 1 -- start start 2024-04-25T09:06:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f995ae00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f995415da10 0x7f99540afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f995ae00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995415ddf0 con 0x7f99540b4210 2024-04-25T09:06:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f995ae00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f995406b480 con 0x7f99540d11b0 2024-04-25T09:06:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f995ae00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99540d06d0 con 0x7f995415da10 2024-04-25T09:06:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f9953e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f995415da10 0x7f99540afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f9958e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f99540b4210 0x7f99540b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55066/0 (socket says 172.21.15.59:55066) 2024-04-25T09:06:11.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f9958e00640 1 -- 172.21.15.59:0/3076193850 learned_addr learned my addr 172.21.15.59:0/3076193850 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f9953e00640 1 -- 172.21.15.59:0/3076193850 >> v1:172.21.15.178:6789/0 conn(0x7f99540d11b0 legacy=0x7f995406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f9953e00640 1 -- 172.21.15.59:0/3076193850 >> v1:172.21.15.59:6789/0 conn(0x7f99540b4210 legacy=0x7f99540b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f9953e00640 1 -- 172.21.15.59:0/3076193850 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540d09b0 con 0x7f995415da10 2024-04-25T09:06:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f9953e00640 1 --2- 172.21.15.59:0/3076193850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f995415da10 0x7f99540afe20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f99440097c0 tx=0x7f994401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce42d72fd37327f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f9953400640 1 -- 172.21.15.59:0/3076193850 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99440b0070 con 0x7f995415da10 2024-04-25T09:06:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f9953400640 1 -- 172.21.15.59:0/3076193850 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99440ab600 con 0x7f995415da10 2024-04-25T09:06:11.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.721+0000 7f9953400640 1 -- 172.21.15.59:0/3076193850 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99440ab9d0 con 0x7f995415da10 2024-04-25T09:06:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 -- 172.21.15.59:0/3076193850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f995415da10 msgr2=0x7f99540afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 --2- 172.21.15.59:0/3076193850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f995415da10 0x7f99540afe20 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f99440097c0 tx=0x7f994401c3d0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 -- 172.21.15.59:0/3076193850 shutdown_connections 2024-04-25T09:06:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 --2- 172.21.15.59:0/3076193850 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f995415da10 0x7f99540afe20 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 -- 172.21.15.59:0/3076193850 >> 172.21.15.59:0/3076193850 conn(0x7f99540b2400 msgr2=0x7f99540b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 -- 172.21.15.59:0/3076193850 shutdown_connections 2024-04-25T09:06:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 -- 172.21.15.59:0/3076193850 wait complete. 2024-04-25T09:06:11.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 Processor -- start 2024-04-25T09:06:11.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 -- start start 2024-04-25T09:06:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99540b4210 0x7f9954138e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99540d11b0 0x7f99540c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f995415da10 0x7f99540c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995416b900 con 0x7f99540d11b0 2024-04-25T09:06:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f995416b780 con 0x7f995415da10 2024-04-25T09:06:11.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f995ae00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f995416ba80 con 0x7f99540b4210 2024-04-25T09:06:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f994be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99540d11b0 0x7f99540c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f994be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99540d11b0 0x7f99540c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45630/0 (socket says 172.21.15.59:45630) 2024-04-25T09:06:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f994be00640 1 -- 172.21.15.59:0/303242786 learned_addr learned my addr 172.21.15.59:0/303242786 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f9953e00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99540b4210 0x7f9954138e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f9958e00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f995415da10 0x7f99540c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f994be00640 1 -- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99540b4210 msgr2=0x7f9954138e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f994be00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99540b4210 0x7f9954138e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f994be00640 1 -- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f995415da10 msgr2=0x7f99540c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f994be00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f995415da10 0x7f99540c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f994be00640 1 -- 172.21.15.59:0/303242786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540cdf30 con 0x7f99540d11b0 2024-04-25T09:06:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.725+0000 7f9953e00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99540b4210 0x7f9954138e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.729+0000 7f9958e00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f995415da10 0x7f99540c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.729+0000 7f994be00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99540d11b0 0x7f99540c9a80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f993c00c480 tx=0x7f993c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.729+0000 7f9950c00640 1 -- 172.21.15.59:0/303242786 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c012830 con 0x7f99540d11b0 2024-04-25T09:06:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.729+0000 7f9950c00640 1 -- 172.21.15.59:0/303242786 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993c017070 con 0x7f99540d11b0 2024-04-25T09:06:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.729+0000 7f9950c00640 1 -- 172.21.15.59:0/303242786 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993c012c30 con 0x7f99540d11b0 2024-04-25T09:06:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.729+0000 7f995ae00640 1 -- 172.21.15.59:0/303242786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99540ccfd0 con 0x7f99540d11b0 2024-04-25T09:06:11.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.729+0000 7f995ae00640 1 -- 172.21.15.59:0/303242786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f995414fc90 con 0x7f99540d11b0 2024-04-25T09:06:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.729+0000 7f995ae00640 1 -- 172.21.15.59:0/303242786 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99540745d0 con 0x7f99540d11b0 2024-04-25T09:06:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.729+0000 7f9950c00640 1 -- 172.21.15.59:0/303242786 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f993c01c460 con 0x7f99540d11b0 2024-04-25T09:06:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.729+0000 7f9950c00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9930066f60 0x7f9930069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:11.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.729+0000 7f9950c00640 1 -- 172.21.15.59:0/303242786 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f993c084fe0 con 0x7f99540d11b0 2024-04-25T09:06:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.729+0000 7f9953e00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9930066f60 0x7f9930069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:11.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.733+0000 7f9953e00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9930066f60 0x7f9930069420 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f99440ad000 tx=0x7f9944008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:11.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.733+0000 7f9950c00640 1 -- 172.21.15.59:0/303242786 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f993c055e50 con 0x7f99540d11b0 2024-04-25T09:06:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.893+0000 7f995ae00640 1 -- 172.21.15.59:0/303242786 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9954072860 con 0x7f9930066f60 2024-04-25T09:06:11.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.901+0000 7f9950c00640 1 -- 172.21.15.59:0/303242786 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252073 (secure 0 0 0) 0x7f9954072860 con 0x7f9930066f60 2024-04-25T09:06:11.896 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:11.897 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:06:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.905+0000 7f995ae00640 1 -- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9930066f60 msgr2=0x7f9930069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.905+0000 7f995ae00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9930066f60 0x7f9930069420 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f99440ad000 tx=0x7f9944008040 comp rx=0 tx=0).stop 2024-04-25T09:06:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.905+0000 7f995ae00640 1 -- 172.21.15.59:0/303242786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99540d11b0 msgr2=0x7f99540c9a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.905+0000 7f995ae00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99540d11b0 0x7f99540c9a80 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f993c00c480 tx=0x7f993c00c940 comp rx=0 tx=0).stop 2024-04-25T09:06:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.905+0000 7f995ae00640 1 -- 172.21.15.59:0/303242786 shutdown_connections 2024-04-25T09:06:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.905+0000 7f995ae00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9930066f60 0x7f9930069420 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.905+0000 7f995ae00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f995415da10 0x7f99540c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.905+0000 7f995ae00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99540d11b0 0x7f99540c9a80 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.905+0000 7f995ae00640 1 --2- 172.21.15.59:0/303242786 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f99540b4210 0x7f9954138e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:11.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.905+0000 7f995ae00640 1 -- 172.21.15.59:0/303242786 >> 172.21.15.59:0/303242786 conn(0x7f99540b2400 msgr2=0x7f9954151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:11.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.905+0000 7f995ae00640 1 -- 172.21.15.59:0/303242786 shutdown_connections 2024-04-25T09:06:11.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:11.905+0000 7f995ae00640 1 -- 172.21.15.59:0/303242786 wait complete. 2024-04-25T09:06:11.916 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-04-25T09:06:11.718660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258304,"kb_used_data":8848,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716416,"statfs":{"total":773094113280,"available":772829609984,"internally_reserved":0,"allocated":9060352,"data_stored":4763980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.939693"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.309236+0000","last_change":"2024-04-25T09:06:07.814667+0000","last_active":"2024-04-25T09:06:09.309236+0000","last_peered":"2024-04-25T09:06:09.309236+0000","last_clean":"2024-04-25T09:06:09.309236+0000","last_became_active":"2024-04-25T09:06:07.814358+0000","last_became_peered":"2024-04-25T09:06:07.814358+0000","last_unstale":"2024-04-25T09:06:09.309236+0000","last_undegraded":"2024-04-25T09:06:09.309236+0000","last_fullsized":"2024-04-25T09:06:09.309236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:53.757405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832187+0000","last_change":"2024-04-25T09:06:07.826443+0000","last_active":"2024-04-25T09:06:08.832187+0000","last_peered":"2024-04-25T09:06:08.832187+0000","last_clean":"2024-04-25T09:06:08.832187+0000","last_became_active":"2024-04-25T09:06:07.825931+0000","last_became_peered":"2024-04-25T09:06:07.825931+0000","last_unstale":"2024-04-25T09:06:08.832187+0000","last_undegraded":"2024-04-25T09:06:08.832187+0000","last_fullsized":"2024-04-25T09:06:08.832187+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:00.119958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818701+0000","last_change":"2024-04-25T09:06:07.814845+0000","last_active":"2024-04-25T09:06:08.818701+0000","last_peered":"2024-04-25T09:06:08.818701+0000","last_clean":"2024-04-25T09:06:08.818701+0000","last_became_active":"2024-04-25T09:06:07.812696+0000","last_became_peered":"2024-04-25T09:06:07.812696+0000","last_unstale":"2024-04-25T09:06:08.818701+0000","last_undegraded":"2024-04-25T09:06:08.818701+0000","last_fullsized":"2024-04-25T09:06:08.818701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:59.759841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818507+0000","last_change":"2024-04-25T09:06:07.816331+0000","last_active":"2024-04-25T09:06:08.818507+0000","last_peered":"2024-04-25T09:06:08.818507+0000","last_clean":"2024-04-25T09:06:08.818507+0000","last_became_active":"2024-04-25T09:06:07.813580+0000","last_became_peered":"2024-04-25T09:06:07.813580+0000","last_unstale":"2024-04-25T09:06:08.818507+0000","last_undegraded":"2024-04-25T09:06:08.818507+0000","last_fullsized":"2024-04-25T09:06:08.818507+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:39.519249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836332+0000","last_change":"2024-04-25T09:06:07.823993+0000","last_active":"2024-04-25T09:06:08.836332+0000","last_peered":"2024-04-25T09:06:08.836332+0000","last_clean":"2024-04-25T09:06:08.836332+0000","last_became_active":"2024-04-25T09:06:07.823705+0000","last_became_peered":"2024-04-25T09:06:07.823705+0000","last_unstale":"2024-04-25T09:06:08.836332+0000","last_undegraded":"2024-04-25T09:06:08.836332+0000","last_fullsized":"2024-04-25T09:06:08.836332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:02.088813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210711+0000","last_change":"2024-04-25T09:06:07.813296+0000","last_active":"2024-04-25T09:06:09.210711+0000","last_peered":"2024-04-25T09:06:09.210711+0000","last_clean":"2024-04-25T09:06:09.210711+0000","last_became_active":"2024-04-25T09:06:07.812961+0000","last_became_peered":"2024-04-25T09:06:07.812961+0000","last_unstale":"2024-04-25T09:06:09.210711+0000","last_undegraded":"2024-04-25T09:06:09.210711+0000","last_fullsized":"2024-04-25T09:06:09.210711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:59.755379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308389+0000","last_change":"2024-04-25T09:06:07.820902+0000","last_active":"2024-04-25T09:06:09.308389+0000","last_peered":"2024-04-25T09:06:09.308389+0000","last_clean":"2024-04-25T09:06:09.308389+0000","last_became_active":"2024-04-25T09:06:07.820606+0000","last_became_peered":"2024-04-25T09:06:07.820606+0000","last_unstale":"2024-04-25T09:06:09.308389+0000","last_undegraded":"2024-04-25T09:06:09.308389+0000","last_fullsized":"2024-04-25T09:06:09.308389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:06.874625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836217+0000","last_change":"2024-04-25T09:06:07.823901+0000","last_active":"2024-04-25T09:06:08.836217+0000","last_peered":"2024-04-25T09:06:08.836217+0000","last_clean":"2024-04-25T09:06:08.836217+0000","last_became_active":"2024-04-25T09:06:07.823593+0000","last_became_peered":"2024-04-25T09:06:07.823593+0000","last_unstale":"2024-04-25T09:06:08.836217+0000","last_undegraded":"2024-04-25T09:06:08.836217+0000","last_fullsized":"2024-04-25T09:06:08.836217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:22.753687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818168+0000","last_change":"2024-04-25T09:06:07.813505+0000","last_active":"2024-04-25T09:06:08.818168+0000","last_peered":"2024-04-25T09:06:08.818168+0000","last_clean":"2024-04-25T09:06:08.818168+0000","last_became_active":"2024-04-25T09:06:07.813183+0000","last_became_peered":"2024-04-25T09:06:07.813183+0000","last_unstale":"2024-04-25T09:06:08.818168+0000","last_undegraded":"2024-04-25T09:06:08.818168+0000","last_fullsized":"2024-04-25T09:06:08.818168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:26.604042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818746+0000","last_change":"2024-04-25T09:06:07.817892+0000","last_active":"2024-04-25T09:06:08.818746+0000","last_peered":"2024-04-25T09:06:08.818746+0000","last_clean":"2024-04-25T09:06:08.818746+0000","last_became_active":"2024-04-25T09:06:07.817470+0000","last_became_peered":"2024-04-25T09:06:07.817470+0000","last_unstale":"2024-04-25T09:06:08.818746+0000","last_undegraded":"2024-04-25T09:06:08.818746+0000","last_fullsized":"2024-04-25T09:06:08.818746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:09.442091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832111+0000","last_change":"2024-04-25T09:06:07.824928+0000","last_active":"2024-04-25T09:06:08.832111+0000","last_peered":"2024-04-25T09:06:08.832111+0000","last_clean":"2024-04-25T09:06:08.832111+0000","last_became_active":"2024-04-25T09:06:07.824636+0000","last_became_peered":"2024-04-25T09:06:07.824636+0000","last_unstale":"2024-04-25T09:06:08.832111+0000","last_undegraded":"2024-04-25T09:06:08.832111+0000","last_fullsized":"2024-04-25T09:06:08.832111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:43.370580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818526+0000","last_change":"2024-04-25T09:06:07.818634+0000","last_active":"2024-04-25T09:06:08.818526+0000","last_peered":"2024-04-25T09:06:08.818526+0000","last_clean":"2024-04-25T09:06:08.818526+0000","last_became_active":"2024-04-25T09:06:07.818365+0000","last_became_peered":"2024-04-25T09:06:07.818365+0000","last_unstale":"2024-04-25T09:06:08.818526+0000","last_undegraded":"2024-04-25T09:06:08.818526+0000","last_fullsized":"2024-04-25T09:06:08.818526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:40.236951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836498+0000","last_change":"2024-04-25T09:06:07.839315+0000","last_active":"2024-04-25T09:06:08.836498+0000","last_peered":"2024-04-25T09:06:08.836498+0000","last_clean":"2024-04-25T09:06:08.836498+0000","last_became_active":"2024-04-25T09:06:07.839012+0000","last_became_peered":"2024-04-25T09:06:07.839012+0000","last_unstale":"2024-04-25T09:06:08.836498+0000","last_undegraded":"2024-04-25T09:06:08.836498+0000","last_fullsized":"2024-04-25T09:06:08.836498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:32.400599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210734+0000","last_change":"2024-04-25T09:06:07.811999+0000","last_active":"2024-04-25T09:06:09.210734+0000","last_peered":"2024-04-25T09:06:09.210734+0000","last_clean":"2024-04-25T09:06:09.210734+0000","last_became_active":"2024-04-25T09:06:07.811718+0000","last_became_peered":"2024-04-25T09:06:07.811718+0000","last_unstale":"2024-04-25T09:06:09.210734+0000","last_undegraded":"2024-04-25T09:06:09.210734+0000","last_fullsized":"2024-04-25T09:06:09.210734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:55.538406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831637+0000","last_change":"2024-04-25T09:06:07.813698+0000","last_active":"2024-04-25T09:06:08.831637+0000","last_peered":"2024-04-25T09:06:08.831637+0000","last_clean":"2024-04-25T09:06:08.831637+0000","last_became_active":"2024-04-25T09:06:07.813398+0000","last_became_peered":"2024-04-25T09:06:07.813398+0000","last_unstale":"2024-04-25T09:06:08.831637+0000","last_undegraded":"2024-04-25T09:06:08.831637+0000","last_fullsized":"2024-04-25T09:06:08.831637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:05.723410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308518+0000","last_change":"2024-04-25T09:06:07.818770+0000","last_active":"2024-04-25T09:06:09.308518+0000","last_peered":"2024-04-25T09:06:09.308518+0000","last_clean":"2024-04-25T09:06:09.308518+0000","last_became_active":"2024-04-25T09:06:07.818475+0000","last_became_peered":"2024-04-25T09:06:07.818475+0000","last_unstale":"2024-04-25T09:06:09.308518+0000","last_undegraded":"2024-04-25T09:06:09.308518+0000","last_fullsized":"2024-04-25T09:06:09.308518+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:59.755379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836805+0000","last_change":"2024-04-25T09:06:07.812973+0000","last_active":"2024-04-25T09:06:08.836805+0000","last_peered":"2024-04-25T09:06:08.836805+0000","last_clean":"2024-04-25T09:06:08.836805+0000","last_became_active":"2024-04-25T09:06:07.812694+0000","last_became_peered":"2024-04-25T09:06:07.812694+0000","last_unstale":"2024-04-25T09:06:08.836805+0000","last_undegraded":"2024-04-25T09:06:08.836805+0000","last_fullsized":"2024-04-25T09:06:08.836805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:18.945579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818597+0000","last_change":"2024-04-25T09:06:07.811579+0000","last_active":"2024-04-25T09:06:08.818597+0000","last_peered":"2024-04-25T09:06:08.818597+0000","last_clean":"2024-04-25T09:06:08.818597+0000","last_became_active":"2024-04-25T09:06:07.811299+0000","last_became_peered":"2024-04-25T09:06:07.811299+0000","last_unstale":"2024-04-25T09:06:08.818597+0000","last_undegraded":"2024-04-25T09:06:08.818597+0000","last_fullsized":"2024-04-25T09:06:08.818597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:26.464358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.211028+0000","last_change":"2024-04-25T09:06:07.827195+0000","last_active":"2024-04-25T09:06:09.211028+0000","last_peered":"2024-04-25T09:06:09.211028+0000","last_clean":"2024-04-25T09:06:09.211028+0000","last_became_active":"2024-04-25T09:06:07.826932+0000","last_became_peered":"2024-04-25T09:06:07.826932+0000","last_unstale":"2024-04-25T09:06:09.211028+0000","last_undegraded":"2024-04-25T09:06:09.211028+0000","last_fullsized":"2024-04-25T09:06:09.211028+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:53.757405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836656+0000","last_change":"2024-04-25T09:06:07.832803+0000","last_active":"2024-04-25T09:06:08.836656+0000","last_peered":"2024-04-25T09:06:08.836656+0000","last_clean":"2024-04-25T09:06:08.836656+0000","last_became_active":"2024-04-25T09:06:07.832522+0000","last_became_peered":"2024-04-25T09:06:07.832522+0000","last_unstale":"2024-04-25T09:06:08.836656+0000","last_undegraded":"2024-04-25T09:06:08.836656+0000","last_fullsized":"2024-04-25T09:06:08.836656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:35.545592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818386+0000","last_change":"2024-04-25T09:06:07.824236+0000","last_active":"2024-04-25T09:06:08.818386+0000","last_peered":"2024-04-25T09:06:08.818386+0000","last_clean":"2024-04-25T09:06:08.818386+0000","last_became_active":"2024-04-25T09:06:07.823966+0000","last_became_peered":"2024-04-25T09:06:07.823966+0000","last_unstale":"2024-04-25T09:06:08.818386+0000","last_undegraded":"2024-04-25T09:06:08.818386+0000","last_fullsized":"2024-04-25T09:06:08.818386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:59.265850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836251+0000","last_change":"2024-04-25T09:06:07.817816+0000","last_active":"2024-04-25T09:06:08.836251+0000","last_peered":"2024-04-25T09:06:08.836251+0000","last_clean":"2024-04-25T09:06:08.836251+0000","last_became_active":"2024-04-25T09:06:07.817523+0000","last_became_peered":"2024-04-25T09:06:07.817523+0000","last_unstale":"2024-04-25T09:06:08.836251+0000","last_undegraded":"2024-04-25T09:06:08.836251+0000","last_fullsized":"2024-04-25T09:06:08.836251+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:13.351079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.817751+0000","last_change":"2024-04-25T09:06:07.806925+0000","last_active":"2024-04-25T09:06:08.817751+0000","last_peered":"2024-04-25T09:06:08.817751+0000","last_clean":"2024-04-25T09:06:08.817751+0000","last_became_active":"2024-04-25T09:06:07.806526+0000","last_became_peered":"2024-04-25T09:06:07.806526+0000","last_unstale":"2024-04-25T09:06:08.817751+0000","last_undegraded":"2024-04-25T09:06:08.817751+0000","last_fullsized":"2024-04-25T09:06:08.817751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:26.244153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831629+0000","last_change":"2024-04-25T09:06:07.820560+0000","last_active":"2024-04-25T09:06:08.831629+0000","last_peered":"2024-04-25T09:06:08.831629+0000","last_clean":"2024-04-25T09:06:08.831629+0000","last_became_active":"2024-04-25T09:06:07.819208+0000","last_became_peered":"2024-04-25T09:06:07.819208+0000","last_unstale":"2024-04-25T09:06:08.831629+0000","last_undegraded":"2024-04-25T09:06:08.831629+0000","last_fullsized":"2024-04-25T09:06:08.831629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:55.538406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832111+0000","last_change":"2024-04-25T09:06:07.831771+0000","last_active":"2024-04-25T09:06:08.832111+0000","last_peered":"2024-04-25T09:06:08.832111+0000","last_clean":"2024-04-25T09:06:08.832111+0000","last_became_active":"2024-04-25T09:06:07.831449+0000","last_became_peered":"2024-04-25T09:06:07.831449+0000","last_unstale":"2024-04-25T09:06:08.832111+0000","last_undegraded":"2024-04-25T09:06:08.832111+0000","last_fullsized":"2024-04-25T09:06:08.832111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:40.432168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818720+0000","last_change":"2024-04-25T09:06:07.820708+0000","last_active":"2024-04-25T09:06:08.818720+0000","last_peered":"2024-04-25T09:06:08.818720+0000","last_clean":"2024-04-25T09:06:08.818720+0000","last_became_active":"2024-04-25T09:06:07.818356+0000","last_became_peered":"2024-04-25T09:06:07.818356+0000","last_unstale":"2024-04-25T09:06:08.818720+0000","last_undegraded":"2024-04-25T09:06:08.818720+0000","last_fullsized":"2024-04-25T09:06:08.818720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:49.872705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308669+0000","last_change":"2024-04-25T09:06:07.818943+0000","last_active":"2024-04-25T09:06:09.308669+0000","last_peered":"2024-04-25T09:06:09.308669+0000","last_clean":"2024-04-25T09:06:09.308669+0000","last_became_active":"2024-04-25T09:06:07.817531+0000","last_became_peered":"2024-04-25T09:06:07.817531+0000","last_unstale":"2024-04-25T09:06:09.308669+0000","last_undegraded":"2024-04-25T09:06:09.308669+0000","last_fullsized":"2024-04-25T09:06:09.308669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:55.538406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836631+0000","last_change":"2024-04-25T09:06:07.822269+0000","last_active":"2024-04-25T09:06:08.836631+0000","last_peered":"2024-04-25T09:06:08.836631+0000","last_clean":"2024-04-25T09:06:08.836631+0000","last_became_active":"2024-04-25T09:06:07.821791+0000","last_became_peered":"2024-04-25T09:06:07.821791+0000","last_unstale":"2024-04-25T09:06:08.836631+0000","last_undegraded":"2024-04-25T09:06:08.836631+0000","last_fullsized":"2024-04-25T09:06:08.836631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:59.329846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832061+0000","last_change":"2024-04-25T09:06:07.817929+0000","last_active":"2024-04-25T09:06:08.832061+0000","last_peered":"2024-04-25T09:06:08.832061+0000","last_clean":"2024-04-25T09:06:08.832061+0000","last_became_active":"2024-04-25T09:06:07.817252+0000","last_became_peered":"2024-04-25T09:06:07.817252+0000","last_unstale":"2024-04-25T09:06:08.832061+0000","last_undegraded":"2024-04-25T09:06:08.832061+0000","last_fullsized":"2024-04-25T09:06:08.832061+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:30.773752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308453+0000","last_change":"2024-04-25T09:06:07.812990+0000","last_active":"2024-04-25T09:06:09.308453+0000","last_peered":"2024-04-25T09:06:09.308453+0000","last_clean":"2024-04-25T09:06:09.308453+0000","last_became_active":"2024-04-25T09:06:07.812712+0000","last_became_peered":"2024-04-25T09:06:07.812712+0000","last_unstale":"2024-04-25T09:06:09.308453+0000","last_undegraded":"2024-04-25T09:06:09.308453+0000","last_fullsized":"2024-04-25T09:06:09.308453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:09.442091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818316+0000","last_change":"2024-04-25T09:06:07.813121+0000","last_active":"2024-04-25T09:06:08.818316+0000","last_peered":"2024-04-25T09:06:08.818316+0000","last_clean":"2024-04-25T09:06:08.818316+0000","last_became_active":"2024-04-25T09:06:07.812832+0000","last_became_peered":"2024-04-25T09:06:07.812832+0000","last_unstale":"2024-04-25T09:06:08.818316+0000","last_undegraded":"2024-04-25T09:06:08.818316+0000","last_fullsized":"2024-04-25T09:06:08.818316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:19.373376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308838+0000","last_change":"2024-04-25T09:06:07.817377+0000","last_active":"2024-04-25T09:06:09.308838+0000","last_peered":"2024-04-25T09:06:09.308838+0000","last_clean":"2024-04-25T09:06:09.308838+0000","last_became_active":"2024-04-25T09:06:07.817019+0000","last_became_peered":"2024-04-25T09:06:07.817019+0000","last_unstale":"2024-04-25T09:06:09.308838+0000","last_undegraded":"2024-04-25T09:06:09.308838+0000","last_fullsized":"2024-04-25T09:06:09.308838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:05.723410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818080+0000","last_change":"2024-04-25T09:06:07.806136+0000","last_active":"2024-04-25T09:06:08.818080+0000","last_peered":"2024-04-25T09:06:08.818080+0000","last_clean":"2024-04-25T09:06:08.818080+0000","last_became_active":"2024-04-25T09:06:07.805793+0000","last_became_peered":"2024-04-25T09:06:07.805793+0000","last_unstale":"2024-04-25T09:06:08.818080+0000","last_undegraded":"2024-04-25T09:06:08.818080+0000","last_fullsized":"2024-04-25T09:06:08.818080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:53.451332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836751+0000","last_change":"2024-04-25T09:06:06.799806+0000","last_active":"2024-04-25T09:06:08.836751+0000","last_peered":"2024-04-25T09:06:08.836751+0000","last_clean":"2024-04-25T09:06:08.836751+0000","last_became_active":"2024-04-25T09:06:06.799517+0000","last_became_peered":"2024-04-25T09:06:06.799517+0000","last_unstale":"2024-04-25T09:06:08.836751+0000","last_undegraded":"2024-04-25T09:06:08.836751+0000","last_fullsized":"2024-04-25T09:06:08.836751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:57.126954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831650+0000","last_change":"2024-04-25T09:06:07.819471+0000","last_active":"2024-04-25T09:06:08.831650+0000","last_peered":"2024-04-25T09:06:08.831650+0000","last_clean":"2024-04-25T09:06:08.831650+0000","last_became_active":"2024-04-25T09:06:07.819167+0000","last_became_peered":"2024-04-25T09:06:07.819167+0000","last_unstale":"2024-04-25T09:06:08.831650+0000","last_undegraded":"2024-04-25T09:06:08.831650+0000","last_fullsized":"2024-04-25T09:06:08.831650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:17.868732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.309111+0000","last_change":"2024-04-25T09:06:06.808373+0000","last_active":"2024-04-25T09:06:09.309111+0000","last_peered":"2024-04-25T09:06:09.309111+0000","last_clean":"2024-04-25T09:06:09.309111+0000","last_became_active":"2024-04-25T09:06:06.807999+0000","last_became_peered":"2024-04-25T09:06:06.807999+0000","last_unstale":"2024-04-25T09:06:09.309111+0000","last_undegraded":"2024-04-25T09:06:09.309111+0000","last_fullsized":"2024-04-25T09:06:09.309111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:16.074826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818170+0000","last_change":"2024-04-25T09:06:07.814292+0000","last_active":"2024-04-25T09:06:08.818170+0000","last_peered":"2024-04-25T09:06:08.818170+0000","last_clean":"2024-04-25T09:06:08.818170+0000","last_became_active":"2024-04-25T09:06:07.813768+0000","last_became_peered":"2024-04-25T09:06:07.813768+0000","last_unstale":"2024-04-25T09:06:08.818170+0000","last_undegraded":"2024-04-25T09:06:08.818170+0000","last_fullsized":"2024-04-25T09:06:08.818170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:52.691319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308778+0000","last_change":"2024-04-25T09:06:06.811431+0000","last_active":"2024-04-25T09:06:09.308778+0000","last_peered":"2024-04-25T09:06:09.308778+0000","last_clean":"2024-04-25T09:06:09.308778+0000","last_became_active":"2024-04-25T09:06:06.811143+0000","last_became_peered":"2024-04-25T09:06:06.811143+0000","last_unstale":"2024-04-25T09:06:09.308778+0000","last_undegraded":"2024-04-25T09:06:09.308778+0000","last_fullsized":"2024-04-25T09:06:09.308778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:10.106722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818433+0000","last_change":"2024-04-25T09:06:07.823752+0000","last_active":"2024-04-25T09:06:08.818433+0000","last_peered":"2024-04-25T09:06:08.818433+0000","last_clean":"2024-04-25T09:06:08.818433+0000","last_became_active":"2024-04-25T09:06:07.823400+0000","last_became_peered":"2024-04-25T09:06:07.823400+0000","last_unstale":"2024-04-25T09:06:08.818433+0000","last_undegraded":"2024-04-25T09:06:08.818433+0000","last_fullsized":"2024-04-25T09:06:08.818433+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:12.442269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308546+0000","last_change":"2024-04-25T09:06:06.805395+0000","last_active":"2024-04-25T09:06:09.308546+0000","last_peered":"2024-04-25T09:06:09.308546+0000","last_clean":"2024-04-25T09:06:09.308546+0000","last_became_active":"2024-04-25T09:06:06.803652+0000","last_became_peered":"2024-04-25T09:06:06.803652+0000","last_unstale":"2024-04-25T09:06:09.308546+0000","last_undegraded":"2024-04-25T09:06:09.308546+0000","last_fullsized":"2024-04-25T09:06:09.308546+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:34.974640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831977+0000","last_change":"2024-04-25T09:06:07.825333+0000","last_active":"2024-04-25T09:06:08.831977+0000","last_peered":"2024-04-25T09:06:08.831977+0000","last_clean":"2024-04-25T09:06:08.831977+0000","last_became_active":"2024-04-25T09:06:07.825017+0000","last_became_peered":"2024-04-25T09:06:07.825017+0000","last_unstale":"2024-04-25T09:06:08.831977+0000","last_undegraded":"2024-04-25T09:06:08.831977+0000","last_fullsized":"2024-04-25T09:06:08.831977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:53.757405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818499+0000","last_change":"2024-04-25T09:06:06.795698+0000","last_active":"2024-04-25T09:06:08.818499+0000","last_peered":"2024-04-25T09:06:08.818499+0000","last_clean":"2024-04-25T09:06:08.818499+0000","last_became_active":"2024-04-25T09:06:06.795409+0000","last_became_peered":"2024-04-25T09:06:06.795409+0000","last_unstale":"2024-04-25T09:06:08.818499+0000","last_undegraded":"2024-04-25T09:06:08.818499+0000","last_fullsized":"2024-04-25T09:06:08.818499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:13.643147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832208+0000","last_change":"2024-04-25T09:06:07.816118+0000","last_active":"2024-04-25T09:06:08.832208+0000","last_peered":"2024-04-25T09:06:08.832208+0000","last_clean":"2024-04-25T09:06:08.832208+0000","last_became_active":"2024-04-25T09:06:07.815845+0000","last_became_peered":"2024-04-25T09:06:07.815845+0000","last_unstale":"2024-04-25T09:06:08.832208+0000","last_undegraded":"2024-04-25T09:06:08.832208+0000","last_fullsized":"2024-04-25T09:06:08.832208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:35.594988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.817984+0000","last_change":"2024-04-25T09:06:06.807630+0000","last_active":"2024-04-25T09:06:08.817984+0000","last_peered":"2024-04-25T09:06:08.817984+0000","last_clean":"2024-04-25T09:06:08.817984+0000","last_became_active":"2024-04-25T09:06:06.807308+0000","last_became_peered":"2024-04-25T09:06:06.807308+0000","last_unstale":"2024-04-25T09:06:08.817984+0000","last_undegraded":"2024-04-25T09:06:08.817984+0000","last_fullsized":"2024-04-25T09:06:08.817984+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:34.524363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818208+0000","last_change":"2024-04-25T09:06:07.816283+0000","last_active":"2024-04-25T09:06:08.818208+0000","last_peered":"2024-04-25T09:06:08.818208+0000","last_clean":"2024-04-25T09:06:08.818208+0000","last_became_active":"2024-04-25T09:06:07.814559+0000","last_became_peered":"2024-04-25T09:06:07.814559+0000","last_unstale":"2024-04-25T09:06:08.818208+0000","last_undegraded":"2024-04-25T09:06:08.818208+0000","last_fullsized":"2024-04-25T09:06:08.818208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:17.129985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831736+0000","last_change":"2024-04-25T09:06:06.805117+0000","last_active":"2024-04-25T09:06:08.831736+0000","last_peered":"2024-04-25T09:06:08.831736+0000","last_clean":"2024-04-25T09:06:08.831736+0000","last_became_active":"2024-04-25T09:06:06.801186+0000","last_became_peered":"2024-04-25T09:06:06.801186+0000","last_unstale":"2024-04-25T09:06:08.831736+0000","last_undegraded":"2024-04-25T09:06:08.831736+0000","last_fullsized":"2024-04-25T09:06:08.831736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:42.041797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308942+0000","last_change":"2024-04-25T09:06:07.823691+0000","last_active":"2024-04-25T09:06:09.308942+0000","last_peered":"2024-04-25T09:06:09.308942+0000","last_clean":"2024-04-25T09:06:09.308942+0000","last_became_active":"2024-04-25T09:06:07.821474+0000","last_became_peered":"2024-04-25T09:06:07.821474+0000","last_unstale":"2024-04-25T09:06:09.308942+0000","last_undegraded":"2024-04-25T09:06:09.308942+0000","last_fullsized":"2024-04-25T09:06:09.308942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:43.048846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836342+0000","last_change":"2024-04-25T09:06:06.794266+0000","last_active":"2024-04-25T09:06:08.836342+0000","last_peered":"2024-04-25T09:06:08.836342+0000","last_clean":"2024-04-25T09:06:08.836342+0000","last_became_active":"2024-04-25T09:06:06.793467+0000","last_became_peered":"2024-04-25T09:06:06.793467+0000","last_unstale":"2024-04-25T09:06:08.836342+0000","last_undegraded":"2024-04-25T09:06:08.836342+0000","last_fullsized":"2024-04-25T09:06:08.836342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:34.015527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831614+0000","last_change":"2024-04-25T09:06:07.819547+0000","last_active":"2024-04-25T09:06:08.831614+0000","last_peered":"2024-04-25T09:06:08.831614+0000","last_clean":"2024-04-25T09:06:08.831614+0000","last_became_active":"2024-04-25T09:06:07.818746+0000","last_became_peered":"2024-04-25T09:06:07.818746+0000","last_unstale":"2024-04-25T09:06:08.831614+0000","last_undegraded":"2024-04-25T09:06:08.831614+0000","last_fullsized":"2024-04-25T09:06:08.831614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:59.755379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.309306+0000","last_change":"2024-04-25T09:06:06.805986+0000","last_active":"2024-04-25T09:06:09.309306+0000","last_peered":"2024-04-25T09:06:09.309306+0000","last_clean":"2024-04-25T09:06:09.309306+0000","last_became_active":"2024-04-25T09:06:06.805703+0000","last_became_peered":"2024-04-25T09:06:06.805703+0000","last_unstale":"2024-04-25T09:06:09.309306+0000","last_undegraded":"2024-04-25T09:06:09.309306+0000","last_fullsized":"2024-04-25T09:06:09.309306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:00.876693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.817783+0000","last_change":"2024-04-25T09:06:07.811960+0000","last_active":"2024-04-25T09:06:08.817783+0000","last_peered":"2024-04-25T09:06:08.817783+0000","last_clean":"2024-04-25T09:06:08.817783+0000","last_became_active":"2024-04-25T09:06:07.811631+0000","last_became_peered":"2024-04-25T09:06:07.811631+0000","last_unstale":"2024-04-25T09:06:08.817783+0000","last_undegraded":"2024-04-25T09:06:08.817783+0000","last_fullsized":"2024-04-25T09:06:08.817783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:21.351326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818819+0000","last_change":"2024-04-25T09:06:06.797157+0000","last_active":"2024-04-25T09:06:08.818819+0000","last_peered":"2024-04-25T09:06:08.818819+0000","last_clean":"2024-04-25T09:06:08.818819+0000","last_became_active":"2024-04-25T09:06:06.796861+0000","last_became_peered":"2024-04-25T09:06:06.796861+0000","last_unstale":"2024-04-25T09:06:08.818819+0000","last_undegraded":"2024-04-25T09:06:08.818819+0000","last_fullsized":"2024-04-25T09:06:08.818819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:01.653369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210882+0000","last_change":"2024-04-25T09:06:07.824912+0000","last_active":"2024-04-25T09:06:09.210882+0000","last_peered":"2024-04-25T09:06:09.210882+0000","last_clean":"2024-04-25T09:06:09.210882+0000","last_became_active":"2024-04-25T09:06:07.824652+0000","last_became_peered":"2024-04-25T09:06:07.824652+0000","last_unstale":"2024-04-25T09:06:09.210882+0000","last_undegraded":"2024-04-25T09:06:09.210882+0000","last_fullsized":"2024-04-25T09:06:09.210882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:17.868732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836789+0000","last_change":"2024-04-25T09:06:06.800505+0000","last_active":"2024-04-25T09:06:08.836789+0000","last_peered":"2024-04-25T09:06:08.836789+0000","last_clean":"2024-04-25T09:06:08.836789+0000","last_became_active":"2024-04-25T09:06:06.800254+0000","last_became_peered":"2024-04-25T09:06:06.800254+0000","last_unstale":"2024-04-25T09:06:08.836789+0000","last_undegraded":"2024-04-25T09:06:08.836789+0000","last_fullsized":"2024-04-25T09:06:08.836789+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:44.777626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818339+0000","last_change":"2024-04-25T09:06:07.816195+0000","last_active":"2024-04-25T09:06:08.818339+0000","last_peered":"2024-04-25T09:06:08.818339+0000","last_clean":"2024-04-25T09:06:08.818339+0000","last_became_active":"2024-04-25T09:06:07.815062+0000","last_became_peered":"2024-04-25T09:06:07.815062+0000","last_unstale":"2024-04-25T09:06:08.818339+0000","last_undegraded":"2024-04-25T09:06:08.818339+0000","last_fullsized":"2024-04-25T09:06:08.818339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:02.996376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"79'6","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308662+0000","last_change":"2024-04-25T09:06:06.802758+0000","last_active":"2024-04-25T09:06:09.308662+0000","last_peered":"2024-04-25T09:06:09.308662+0000","last_clean":"2024-04-25T09:06:09.308662+0000","last_became_active":"2024-04-25T09:06:06.802483+0000","last_became_peered":"2024-04-25T09:06:06.802483+0000","last_unstale":"2024-04-25T09:06:09.308662+0000","last_undegraded":"2024-04-25T09:06:09.308662+0000","last_fullsized":"2024-04-25T09:06:09.308662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:58.258801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818679+0000","last_change":"2024-04-25T09:06:07.806167+0000","last_active":"2024-04-25T09:06:08.818679+0000","last_peered":"2024-04-25T09:06:08.818679+0000","last_clean":"2024-04-25T09:06:08.818679+0000","last_became_active":"2024-04-25T09:06:07.805890+0000","last_became_peered":"2024-04-25T09:06:07.805890+0000","last_unstale":"2024-04-25T09:06:08.818679+0000","last_undegraded":"2024-04-25T09:06:08.818679+0000","last_fullsized":"2024-04-25T09:06:08.818679+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:07.266097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.817662+0000","last_change":"2024-04-25T09:06:06.797408+0000","last_active":"2024-04-25T09:06:08.817662+0000","last_peered":"2024-04-25T09:06:08.817662+0000","last_clean":"2024-04-25T09:06:08.817662+0000","last_became_active":"2024-04-25T09:06:06.796993+0000","last_became_peered":"2024-04-25T09:06:06.796993+0000","last_unstale":"2024-04-25T09:06:08.817662+0000","last_undegraded":"2024-04-25T09:06:08.817662+0000","last_fullsized":"2024-04-25T09:06:08.817662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:43.837307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308382+0000","last_change":"2024-04-25T09:06:07.825171+0000","last_active":"2024-04-25T09:06:09.308382+0000","last_peered":"2024-04-25T09:06:09.308382+0000","last_clean":"2024-04-25T09:06:09.308382+0000","last_became_active":"2024-04-25T09:06:07.824862+0000","last_became_peered":"2024-04-25T09:06:07.824862+0000","last_unstale":"2024-04-25T09:06:09.308382+0000","last_undegraded":"2024-04-25T09:06:09.308382+0000","last_fullsized":"2024-04-25T09:06:09.308382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:11.015197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308445+0000","last_change":"2024-04-25T09:06:06.800180+0000","last_active":"2024-04-25T09:06:09.308445+0000","last_peered":"2024-04-25T09:06:09.308445+0000","last_clean":"2024-04-25T09:06:09.308445+0000","last_became_active":"2024-04-25T09:06:06.799584+0000","last_became_peered":"2024-04-25T09:06:06.799584+0000","last_unstale":"2024-04-25T09:06:09.308445+0000","last_undegraded":"2024-04-25T09:06:09.308445+0000","last_fullsized":"2024-04-25T09:06:09.308445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:01.653369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308804+0000","last_change":"2024-04-25T09:06:07.823830+0000","last_active":"2024-04-25T09:06:09.308804+0000","last_peered":"2024-04-25T09:06:09.308804+0000","last_clean":"2024-04-25T09:06:09.308804+0000","last_became_active":"2024-04-25T09:06:07.823307+0000","last_became_peered":"2024-04-25T09:06:07.823307+0000","last_unstale":"2024-04-25T09:06:09.308804+0000","last_undegraded":"2024-04-25T09:06:09.308804+0000","last_fullsized":"2024-04-25T09:06:09.308804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:02.660418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836261+0000","last_change":"2024-04-25T09:06:06.806324+0000","last_active":"2024-04-25T09:06:08.836261+0000","last_peered":"2024-04-25T09:06:08.836261+0000","last_clean":"2024-04-25T09:06:08.836261+0000","last_became_active":"2024-04-25T09:06:06.806051+0000","last_became_peered":"2024-04-25T09:06:06.806051+0000","last_unstale":"2024-04-25T09:06:08.836261+0000","last_undegraded":"2024-04-25T09:06:08.836261+0000","last_fullsized":"2024-04-25T09:06:08.836261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:35.865602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308930+0000","last_change":"2024-04-25T09:06:07.814393+0000","last_active":"2024-04-25T09:06:09.308930+0000","last_peered":"2024-04-25T09:06:09.308930+0000","last_clean":"2024-04-25T09:06:09.308930+0000","last_became_active":"2024-04-25T09:06:07.813204+0000","last_became_peered":"2024-04-25T09:06:07.813204+0000","last_unstale":"2024-04-25T09:06:09.308930+0000","last_undegraded":"2024-04-25T09:06:09.308930+0000","last_fullsized":"2024-04-25T09:06:09.308930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:11.113771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"79'8","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831719+0000","last_change":"2024-04-25T09:06:06.807960+0000","last_active":"2024-04-25T09:06:08.831719+0000","last_peered":"2024-04-25T09:06:08.831719+0000","last_clean":"2024-04-25T09:06:08.831719+0000","last_became_active":"2024-04-25T09:06:06.807661+0000","last_became_peered":"2024-04-25T09:06:06.807661+0000","last_unstale":"2024-04-25T09:06:08.831719+0000","last_undegraded":"2024-04-25T09:06:08.831719+0000","last_fullsized":"2024-04-25T09:06:08.831719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:43.837307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210625+0000","last_change":"2024-04-25T09:06:07.839888+0000","last_active":"2024-04-25T09:06:09.210625+0000","last_peered":"2024-04-25T09:06:09.210625+0000","last_clean":"2024-04-25T09:06:09.210625+0000","last_became_active":"2024-04-25T09:06:07.839610+0000","last_became_peered":"2024-04-25T09:06:07.839610+0000","last_unstale":"2024-04-25T09:06:09.210625+0000","last_undegraded":"2024-04-25T09:06:09.210625+0000","last_fullsized":"2024-04-25T09:06:09.210625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:09.442091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.309311+0000","last_change":"2024-04-25T09:06:06.809225+0000","last_active":"2024-04-25T09:06:09.309311+0000","last_peered":"2024-04-25T09:06:09.309311+0000","last_clean":"2024-04-25T09:06:09.309311+0000","last_became_active":"2024-04-25T09:06:06.808899+0000","last_became_peered":"2024-04-25T09:06:06.808899+0000","last_unstale":"2024-04-25T09:06:09.309311+0000","last_undegraded":"2024-04-25T09:06:09.309311+0000","last_fullsized":"2024-04-25T09:06:09.309311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:44.135882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836235+0000","last_change":"2024-04-25T09:06:07.817410+0000","last_active":"2024-04-25T09:06:08.836235+0000","last_peered":"2024-04-25T09:06:08.836235+0000","last_clean":"2024-04-25T09:06:08.836235+0000","last_became_active":"2024-04-25T09:06:07.817098+0000","last_became_peered":"2024-04-25T09:06:07.817098+0000","last_unstale":"2024-04-25T09:06:08.836235+0000","last_undegraded":"2024-04-25T09:06:08.836235+0000","last_fullsized":"2024-04-25T09:06:08.836235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:16.154195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818005+0000","last_change":"2024-04-25T09:06:06.806648+0000","last_active":"2024-04-25T09:06:08.818005+0000","last_peered":"2024-04-25T09:06:08.818005+0000","last_clean":"2024-04-25T09:06:08.818005+0000","last_became_active":"2024-04-25T09:06:06.806391+0000","last_became_peered":"2024-04-25T09:06:06.806391+0000","last_unstale":"2024-04-25T09:06:08.818005+0000","last_undegraded":"2024-04-25T09:06:08.818005+0000","last_fullsized":"2024-04-25T09:06:08.818005+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:41.541091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836332+0000","last_change":"2024-04-25T09:06:07.813854+0000","last_active":"2024-04-25T09:06:08.836332+0000","last_peered":"2024-04-25T09:06:08.836332+0000","last_clean":"2024-04-25T09:06:08.836332+0000","last_became_active":"2024-04-25T09:06:07.813475+0000","last_became_peered":"2024-04-25T09:06:07.813475+0000","last_unstale":"2024-04-25T09:06:08.836332+0000","last_undegraded":"2024-04-25T09:06:08.836332+0000","last_fullsized":"2024-04-25T09:06:08.836332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:33.852726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836789+0000","last_change":"2024-04-25T09:06:06.796724+0000","last_active":"2024-04-25T09:06:08.836789+0000","last_peered":"2024-04-25T09:06:08.836789+0000","last_clean":"2024-04-25T09:06:08.836789+0000","last_became_active":"2024-04-25T09:06:06.796319+0000","last_became_peered":"2024-04-25T09:06:06.796319+0000","last_unstale":"2024-04-25T09:06:08.836789+0000","last_undegraded":"2024-04-25T09:06:08.836789+0000","last_fullsized":"2024-04-25T09:06:08.836789+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:53.252269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210804+0000","last_change":"2024-04-25T09:06:07.818928+0000","last_active":"2024-04-25T09:06:09.210804+0000","last_peered":"2024-04-25T09:06:09.210804+0000","last_clean":"2024-04-25T09:06:09.210804+0000","last_became_active":"2024-04-25T09:06:07.818663+0000","last_became_peered":"2024-04-25T09:06:07.818663+0000","last_unstale":"2024-04-25T09:06:09.210804+0000","last_undegraded":"2024-04-25T09:06:09.210804+0000","last_fullsized":"2024-04-25T09:06:09.210804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:05.723410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818541+0000","last_change":"2024-04-25T09:06:06.808871+0000","last_active":"2024-04-25T09:06:08.818541+0000","last_peered":"2024-04-25T09:06:08.818541+0000","last_clean":"2024-04-25T09:06:08.818541+0000","last_became_active":"2024-04-25T09:06:06.808548+0000","last_became_peered":"2024-04-25T09:06:06.808548+0000","last_unstale":"2024-04-25T09:06:08.818541+0000","last_undegraded":"2024-04-25T09:06:08.818541+0000","last_fullsized":"2024-04-25T09:06:08.818541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:16.122936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832069+0000","last_change":"2024-04-25T09:06:07.819486+0000","last_active":"2024-04-25T09:06:08.832069+0000","last_peered":"2024-04-25T09:06:08.832069+0000","last_clean":"2024-04-25T09:06:08.832069+0000","last_became_active":"2024-04-25T09:06:07.819141+0000","last_became_peered":"2024-04-25T09:06:07.819141+0000","last_unstale":"2024-04-25T09:06:08.832069+0000","last_undegraded":"2024-04-25T09:06:08.832069+0000","last_fullsized":"2024-04-25T09:06:08.832069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:48.151096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210950+0000","last_change":"2024-04-25T09:06:06.809981+0000","last_active":"2024-04-25T09:06:09.210950+0000","last_peered":"2024-04-25T09:06:09.210950+0000","last_clean":"2024-04-25T09:06:09.210950+0000","last_became_active":"2024-04-25T09:06:06.809714+0000","last_became_peered":"2024-04-25T09:06:06.809714+0000","last_unstale":"2024-04-25T09:06:09.210950+0000","last_undegraded":"2024-04-25T09:06:09.210950+0000","last_fullsized":"2024-04-25T09:06:09.210950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:16.074826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832275+0000","last_change":"2024-04-25T09:06:07.820270+0000","last_active":"2024-04-25T09:06:08.832275+0000","last_peered":"2024-04-25T09:06:08.832275+0000","last_clean":"2024-04-25T09:06:08.832275+0000","last_became_active":"2024-04-25T09:06:07.819988+0000","last_became_peered":"2024-04-25T09:06:07.819988+0000","last_unstale":"2024-04-25T09:06:08.832275+0000","last_undegraded":"2024-04-25T09:06:08.832275+0000","last_fullsized":"2024-04-25T09:06:08.832275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:37.354176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210652+0000","last_change":"2024-04-25T09:06:06.802161+0000","last_active":"2024-04-25T09:06:09.210652+0000","last_peered":"2024-04-25T09:06:09.210652+0000","last_clean":"2024-04-25T09:06:09.210652+0000","last_became_active":"2024-04-25T09:06:06.801899+0000","last_became_peered":"2024-04-25T09:06:06.801899+0000","last_unstale":"2024-04-25T09:06:09.210652+0000","last_undegraded":"2024-04-25T09:06:09.210652+0000","last_fullsized":"2024-04-25T09:06:09.210652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:10.106722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.309127+0000","last_change":"2024-04-25T09:06:07.822766+0000","last_active":"2024-04-25T09:06:09.309127+0000","last_peered":"2024-04-25T09:06:09.309127+0000","last_clean":"2024-04-25T09:06:09.309127+0000","last_became_active":"2024-04-25T09:06:07.821775+0000","last_became_peered":"2024-04-25T09:06:07.821775+0000","last_unstale":"2024-04-25T09:06:09.309127+0000","last_undegraded":"2024-04-25T09:06:09.309127+0000","last_fullsized":"2024-04-25T09:06:09.309127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:17.081875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210583+0000","last_change":"2024-04-25T09:06:06.804020+0000","last_active":"2024-04-25T09:06:09.210583+0000","last_peered":"2024-04-25T09:06:09.210583+0000","last_clean":"2024-04-25T09:06:09.210583+0000","last_became_active":"2024-04-25T09:06:06.803763+0000","last_became_peered":"2024-04-25T09:06:06.803763+0000","last_unstale":"2024-04-25T09:06:09.210583+0000","last_undegraded":"2024-04-25T09:06:09.210583+0000","last_fullsized":"2024-04-25T09:06:09.210583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:00.876693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818070+0000","last_change":"2024-04-25T09:06:07.814633+0000","last_active":"2024-04-25T09:06:08.818070+0000","last_peered":"2024-04-25T09:06:08.818070+0000","last_clean":"2024-04-25T09:06:08.818070+0000","last_became_active":"2024-04-25T09:06:07.814358+0000","last_became_peered":"2024-04-25T09:06:07.814358+0000","last_unstale":"2024-04-25T09:06:08.818070+0000","last_undegraded":"2024-04-25T09:06:08.818070+0000","last_fullsized":"2024-04-25T09:06:08.818070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:01.152866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818690+0000","last_change":"2024-04-25T09:06:06.803193+0000","last_active":"2024-04-25T09:06:08.818690+0000","last_peered":"2024-04-25T09:06:08.818690+0000","last_clean":"2024-04-25T09:06:08.818690+0000","last_became_active":"2024-04-25T09:06:06.802915+0000","last_became_peered":"2024-04-25T09:06:06.802915+0000","last_unstale":"2024-04-25T09:06:08.818690+0000","last_undegraded":"2024-04-25T09:06:08.818690+0000","last_fullsized":"2024-04-25T09:06:08.818690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:42.041797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308253+0000","last_change":"2024-04-25T09:06:07.834067+0000","last_active":"2024-04-25T09:06:09.308253+0000","last_peered":"2024-04-25T09:06:09.308253+0000","last_clean":"2024-04-25T09:06:09.308253+0000","last_became_active":"2024-04-25T09:06:07.833702+0000","last_became_peered":"2024-04-25T09:06:07.833702+0000","last_unstale":"2024-04-25T09:06:09.308253+0000","last_undegraded":"2024-04-25T09:06:09.308253+0000","last_fullsized":"2024-04-25T09:06:09.308253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:59.759841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"80'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.833749+0000","last_change":"2024-04-25T09:06:06.802921+0000","last_active":"2024-04-25T09:06:08.833749+0000","last_peered":"2024-04-25T09:06:08.833749+0000","last_clean":"2024-04-25T09:06:08.833749+0000","last_became_active":"2024-04-25T09:06:06.801064+0000","last_became_peered":"2024-04-25T09:06:06.801064+0000","last_unstale":"2024-04-25T09:06:08.833749+0000","last_undegraded":"2024-04-25T09:06:08.833749+0000","last_fullsized":"2024-04-25T09:06:08.833749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:34.524363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818326+0000","last_change":"2024-04-25T09:06:07.812609+0000","last_active":"2024-04-25T09:06:08.818326+0000","last_peered":"2024-04-25T09:06:08.818326+0000","last_clean":"2024-04-25T09:06:08.818326+0000","last_became_active":"2024-04-25T09:06:07.812329+0000","last_became_peered":"2024-04-25T09:06:07.812329+0000","last_unstale":"2024-04-25T09:06:08.818326+0000","last_undegraded":"2024-04-25T09:06:08.818326+0000","last_fullsized":"2024-04-25T09:06:08.818326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:35.981689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308996+0000","last_change":"2024-04-25T09:06:06.803197+0000","last_active":"2024-04-25T09:06:09.308996+0000","last_peered":"2024-04-25T09:06:09.308996+0000","last_clean":"2024-04-25T09:06:09.308996+0000","last_became_active":"2024-04-25T09:06:06.802937+0000","last_became_peered":"2024-04-25T09:06:06.802937+0000","last_unstale":"2024-04-25T09:06:09.308996+0000","last_undegraded":"2024-04-25T09:06:09.308996+0000","last_fullsized":"2024-04-25T09:06:09.308996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:39.811621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832186+0000","last_change":"2024-04-25T09:06:07.818188+0000","last_active":"2024-04-25T09:06:08.832186+0000","last_peered":"2024-04-25T09:06:08.832186+0000","last_clean":"2024-04-25T09:06:08.832186+0000","last_became_active":"2024-04-25T09:06:07.817671+0000","last_became_peered":"2024-04-25T09:06:07.817671+0000","last_unstale":"2024-04-25T09:06:08.832186+0000","last_undegraded":"2024-04-25T09:06:08.832186+0000","last_fullsized":"2024-04-25T09:06:08.832186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:44.370904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308630+0000","last_change":"2024-04-25T09:06:06.806391+0000","last_active":"2024-04-25T09:06:09.308630+0000","last_peered":"2024-04-25T09:06:09.308630+0000","last_clean":"2024-04-25T09:06:09.308630+0000","last_became_active":"2024-04-25T09:06:06.805276+0000","last_became_peered":"2024-04-25T09:06:06.805276+0000","last_unstale":"2024-04-25T09:06:09.308630+0000","last_undegraded":"2024-04-25T09:06:09.308630+0000","last_fullsized":"2024-04-25T09:06:09.308630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:43.837307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308429+0000","last_change":"2024-04-25T09:06:07.814294+0000","last_active":"2024-04-25T09:06:09.308429+0000","last_peered":"2024-04-25T09:06:09.308429+0000","last_clean":"2024-04-25T09:06:09.308429+0000","last_became_active":"2024-04-25T09:06:07.813922+0000","last_became_peered":"2024-04-25T09:06:07.813922+0000","last_unstale":"2024-04-25T09:06:09.308429+0000","last_undegraded":"2024-04-25T09:06:09.308429+0000","last_fullsized":"2024-04-25T09:06:09.308429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:35.531412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308192+0000","last_change":"2024-04-25T09:06:06.806505+0000","last_active":"2024-04-25T09:06:09.308192+0000","last_peered":"2024-04-25T09:06:09.308192+0000","last_clean":"2024-04-25T09:06:09.308192+0000","last_became_active":"2024-04-25T09:06:06.806247+0000","last_became_peered":"2024-04-25T09:06:06.806247+0000","last_unstale":"2024-04-25T09:06:09.308192+0000","last_undegraded":"2024-04-25T09:06:09.308192+0000","last_fullsized":"2024-04-25T09:06:09.308192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:11.435220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308554+0000","last_change":"2024-04-25T09:06:07.822064+0000","last_active":"2024-04-25T09:06:09.308554+0000","last_peered":"2024-04-25T09:06:09.308554+0000","last_clean":"2024-04-25T09:06:09.308554+0000","last_became_active":"2024-04-25T09:06:07.821759+0000","last_became_peered":"2024-04-25T09:06:07.821759+0000","last_unstale":"2024-04-25T09:06:09.308554+0000","last_undegraded":"2024-04-25T09:06:09.308554+0000","last_fullsized":"2024-04-25T09:06:09.308554+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:44.844356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836375+0000","last_change":"2024-04-25T09:06:06.811017+0000","last_active":"2024-04-25T09:06:08.836375+0000","last_peered":"2024-04-25T09:06:08.836375+0000","last_clean":"2024-04-25T09:06:08.836375+0000","last_became_active":"2024-04-25T09:06:06.810754+0000","last_became_peered":"2024-04-25T09:06:06.810754+0000","last_unstale":"2024-04-25T09:06:08.836375+0000","last_undegraded":"2024-04-25T09:06:08.836375+0000","last_fullsized":"2024-04-25T09:06:08.836375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:01.800816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818683+0000","last_change":"2024-04-25T09:06:07.816329+0000","last_active":"2024-04-25T09:06:08.818683+0000","last_peered":"2024-04-25T09:06:08.818683+0000","last_clean":"2024-04-25T09:06:08.818683+0000","last_became_active":"2024-04-25T09:06:07.816119+0000","last_became_peered":"2024-04-25T09:06:07.816119+0000","last_unstale":"2024-04-25T09:06:08.818683+0000","last_undegraded":"2024-04-25T09:06:08.818683+0000","last_fullsized":"2024-04-25T09:06:08.818683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:59.000976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308596+0000","last_change":"2024-04-25T09:06:06.803206+0000","last_active":"2024-04-25T09:06:09.308596+0000","last_peered":"2024-04-25T09:06:09.308596+0000","last_clean":"2024-04-25T09:06:09.308596+0000","last_became_active":"2024-04-25T09:06:06.802833+0000","last_became_peered":"2024-04-25T09:06:06.802833+0000","last_unstale":"2024-04-25T09:06:09.308596+0000","last_undegraded":"2024-04-25T09:06:09.308596+0000","last_fullsized":"2024-04-25T09:06:09.308596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:02.050818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818865+0000","last_change":"2024-04-25T09:06:07.825756+0000","last_active":"2024-04-25T09:06:08.818865+0000","last_peered":"2024-04-25T09:06:08.818865+0000","last_clean":"2024-04-25T09:06:08.818865+0000","last_became_active":"2024-04-25T09:06:07.825435+0000","last_became_peered":"2024-04-25T09:06:07.825435+0000","last_unstale":"2024-04-25T09:06:08.818865+0000","last_undegraded":"2024-04-25T09:06:08.818865+0000","last_fullsized":"2024-04-25T09:06:08.818865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:11.015197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818242+0000","last_change":"2024-04-25T09:06:06.808770+0000","last_active":"2024-04-25T09:06:08.818242+0000","last_peered":"2024-04-25T09:06:08.818242+0000","last_clean":"2024-04-25T09:06:08.818242+0000","last_became_active":"2024-04-25T09:06:06.808438+0000","last_became_peered":"2024-04-25T09:06:06.808438+0000","last_unstale":"2024-04-25T09:06:08.818242+0000","last_undegraded":"2024-04-25T09:06:08.818242+0000","last_fullsized":"2024-04-25T09:06:08.818242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:51.684270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.309035+0000","last_change":"2024-04-25T09:06:07.830796+0000","last_active":"2024-04-25T09:06:09.309035+0000","last_peered":"2024-04-25T09:06:09.309035+0000","last_clean":"2024-04-25T09:06:09.309035+0000","last_became_active":"2024-04-25T09:06:07.830464+0000","last_became_peered":"2024-04-25T09:06:07.830464+0000","last_unstale":"2024-04-25T09:06:09.309035+0000","last_undegraded":"2024-04-25T09:06:09.309035+0000","last_fullsized":"2024-04-25T09:06:09.309035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:17.868732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210947+0000","last_change":"2024-04-25T09:06:06.805173+0000","last_active":"2024-04-25T09:06:09.210947+0000","last_peered":"2024-04-25T09:06:09.210947+0000","last_clean":"2024-04-25T09:06:09.210947+0000","last_became_active":"2024-04-25T09:06:06.804827+0000","last_became_peered":"2024-04-25T09:06:06.804827+0000","last_unstale":"2024-04-25T09:06:09.210947+0000","last_undegraded":"2024-04-25T09:06:09.210947+0000","last_fullsized":"2024-04-25T09:06:09.210947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:39.811621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":281,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308613+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:06:09.308613+0000","last_peered":"2024-04-25T09:06:09.308613+0000","last_clean":"2024-04-25T09:06:09.308613+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:06:09.308613+0000","last_undegraded":"2024-04-25T09:06:09.308613+0000","last_fullsized":"2024-04-25T09:06:09.308613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":1039366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":443896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":449010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":450692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":449558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":991232,"data_stored":449718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":442396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1572864,"data_stored":1039344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:11.921 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:06:12.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.105+0000 7fb83fc00640 1 Processor -- start 2024-04-25T09:06:12.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.105+0000 7fb83fc00640 1 -- start start 2024-04-25T09:06:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83fc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb838144140 0x7fb8380ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83fc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb83806ead0 0x7fb8380b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83fc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb83815ac60 con 0x7fb8380ced60 2024-04-25T09:06:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83fc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8380cf3e0 con 0x7fb838144140 2024-04-25T09:06:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83fc00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb83815af20 con 0x7fb83806ead0 2024-04-25T09:06:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83d200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb838144140 0x7fb8380ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83d200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb838144140 0x7fb8380ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45634/0 (socket says 172.21.15.59:45634) 2024-04-25T09:06:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83d200640 1 -- 172.21.15.59:0/3381722944 learned_addr learned my addr 172.21.15.59:0/3381722944 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb82fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb8380ced60 0x7fb83806e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55082/0 (socket says 172.21.15.59:55082) 2024-04-25T09:06:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83dc00640 1 --2- 172.21.15.59:0/3381722944 >> v2:172.21.15.178:3300/0 conn(0x7fb83806ead0 0x7fb8380b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83d200640 1 -- 172.21.15.59:0/3381722944 >> v2:172.21.15.178:3300/0 conn(0x7fb83806ead0 msgr2=0x7fb8380b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83d200640 1 --2- 172.21.15.59:0/3381722944 >> v2:172.21.15.178:3300/0 conn(0x7fb83806ead0 0x7fb8380b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83d200640 1 -- 172.21.15.59:0/3381722944 >> v1:172.21.15.59:6789/0 conn(0x7fb8380ced60 legacy=0x7fb83806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb837e00640 1 -- 172.21.15.59:0/3381722944 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818319251 0 0) 0x7fb83815ac60 con 0x7fb8380ced60 2024-04-25T09:06:12.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83d200640 1 -- 172.21.15.59:0/3381722944 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83815b200 con 0x7fb838144140 2024-04-25T09:06:12.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.109+0000 7fb83dc00640 1 --2- 172.21.15.59:0/3381722944 >> v2:172.21.15.178:3300/0 conn(0x7fb83806ead0 0x7fb8380b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:12.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb83d200640 1 --2- 172.21.15.59:0/3381722944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb838144140 0x7fb8380ce820 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb8380cc520 tx=0x7fb82801ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfda44f866668f70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb837e00640 1 -- 172.21.15.59:0/3381722944 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8280a8700 con 0x7fb838144140 2024-04-25T09:06:12.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb837e00640 1 -- 172.21.15.59:0/3381722944 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8280a88a0 con 0x7fb838144140 2024-04-25T09:06:12.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb837e00640 1 -- 172.21.15.59:0/3381722944 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8280a8c70 con 0x7fb838144140 2024-04-25T09:06:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb83fc00640 1 -- 172.21.15.59:0/3381722944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb838144140 msgr2=0x7fb8380ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb83fc00640 1 --2- 172.21.15.59:0/3381722944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb838144140 0x7fb8380ce820 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fb8380cc520 tx=0x7fb82801ebf0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb83fc00640 1 -- 172.21.15.59:0/3381722944 shutdown_connections 2024-04-25T09:06:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb83fc00640 1 --2- 172.21.15.59:0/3381722944 >> v2:172.21.15.178:3300/0 conn(0x7fb83806ead0 0x7fb8380b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb83fc00640 1 --2- 172.21.15.59:0/3381722944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb838144140 0x7fb8380ce820 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb83fc00640 1 -- 172.21.15.59:0/3381722944 >> 172.21.15.59:0/3381722944 conn(0x7fb838066fa0 msgr2=0x7fb83806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb83fc00640 1 -- 172.21.15.59:0/3381722944 shutdown_connections 2024-04-25T09:06:12.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb83fc00640 1 -- 172.21.15.59:0/3381722944 wait complete. 2024-04-25T09:06:12.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb83fc00640 1 Processor -- start 2024-04-25T09:06:12.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.113+0000 7fb83fc00640 1 -- start start 2024-04-25T09:06:12.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb83fc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83806ead0 0x7fb8381f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb83fc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8380ced60 0x7fb8381f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb83fc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb838144140 0x7fb838156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb83fc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83815bb80 con 0x7fb8380ced60 2024-04-25T09:06:12.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb83fc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83815ba00 con 0x7fb838144140 2024-04-25T09:06:12.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb83fc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83806d2b0 con 0x7fb83806ead0 2024-04-25T09:06:12.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb82fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8380ced60 0x7fb8381f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb82fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8380ced60 0x7fb8381f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45642/0 (socket says 172.21.15.59:45642) 2024-04-25T09:06:12.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb82fe00640 1 -- 172.21.15.59:0/829399100 learned_addr learned my addr 172.21.15.59:0/829399100 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:12.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb82fe00640 1 -- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83806ead0 msgr2=0x7fb8381f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb82fe00640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83806ead0 0x7fb8381f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb82fe00640 1 -- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb838144140 msgr2=0x7fb838156e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb83dc00640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb838144140 0x7fb838156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb82fe00640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb838144140 0x7fb838156e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb82fe00640 1 -- 172.21.15.59:0/829399100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83815f380 con 0x7fb8380ced60 2024-04-25T09:06:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb83dc00640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb838144140 0x7fb838156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb82fe00640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8380ced60 0x7fb8381f2460 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb8200011f0 tx=0x7fb82000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb835600640 1 -- 172.21.15.59:0/829399100 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820018070 con 0x7fb8380ced60 2024-04-25T09:06:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb835600640 1 -- 172.21.15.59:0/829399100 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8200074e0 con 0x7fb8380ced60 2024-04-25T09:06:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb835600640 1 -- 172.21.15.59:0/829399100 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb820004a10 con 0x7fb8380ced60 2024-04-25T09:06:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb83fc00640 1 -- 172.21.15.59:0/829399100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83815f620 con 0x7fb8380ced60 2024-04-25T09:06:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb83fc00640 1 -- 172.21.15.59:0/829399100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8381581f0 con 0x7fb8380ced60 2024-04-25T09:06:12.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.117+0000 7fb83fc00640 1 -- 172.21.15.59:0/829399100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8380745d0 con 0x7fb8380ced60 2024-04-25T09:06:12.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.121+0000 7fb835600640 1 -- 172.21.15.59:0/829399100 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb820004bb0 con 0x7fb8380ced60 2024-04-25T09:06:12.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.121+0000 7fb835600640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb814066f60 0x7fb814069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.121+0000 7fb835600640 1 -- 172.21.15.59:0/829399100 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fb820084650 con 0x7fb8380ced60 2024-04-25T09:06:12.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.121+0000 7fb83d200640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb814066f60 0x7fb814069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.121+0000 7fb83d200640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb814066f60 0x7fb814069420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb8280b1000 tx=0x7fb828004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.125+0000 7fb835600640 1 -- 172.21.15.59:0/829399100 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb820055430 con 0x7fb8380ced60 2024-04-25T09:06:12.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.285+0000 7fb83fc00640 1 -- 172.21.15.59:0/829399100 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb83815ea30 con 0x7fb814066f60 2024-04-25T09:06:12.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.293+0000 7fb835600640 1 -- 172.21.15.59:0/829399100 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252073 (secure 0 0 0) 0x7fb83815ea30 con 0x7fb814066f60 2024-04-25T09:06:12.286 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:12.288 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:06:12.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.293+0000 7fb83fc00640 1 -- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb814066f60 msgr2=0x7fb814069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.293+0000 7fb83fc00640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb814066f60 0x7fb814069420 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb8280b1000 tx=0x7fb828004740 comp rx=0 tx=0).stop 2024-04-25T09:06:12.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.293+0000 7fb83fc00640 1 -- 172.21.15.59:0/829399100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8380ced60 msgr2=0x7fb8381f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.293+0000 7fb83fc00640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8380ced60 0x7fb8381f2460 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fb8200011f0 tx=0x7fb82000c9b0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.297+0000 7fb83fc00640 1 -- 172.21.15.59:0/829399100 shutdown_connections 2024-04-25T09:06:12.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.297+0000 7fb83fc00640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb814066f60 0x7fb814069420 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.297+0000 7fb83fc00640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb838144140 0x7fb838156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.297+0000 7fb83fc00640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8380ced60 0x7fb8381f2460 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.297+0000 7fb83fc00640 1 --2- 172.21.15.59:0/829399100 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb83806ead0 0x7fb8381f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.297+0000 7fb83fc00640 1 -- 172.21.15.59:0/829399100 >> 172.21.15.59:0/829399100 conn(0x7fb838066fa0 msgr2=0x7fb838140c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.297+0000 7fb83fc00640 1 -- 172.21.15.59:0/829399100 shutdown_connections 2024-04-25T09:06:12.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.297+0000 7fb83fc00640 1 -- 172.21.15.59:0/829399100 wait complete. 2024-04-25T09:06:12.307 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2024-04-25T09:06:11.718660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258304,"kb_used_data":8848,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716416,"statfs":{"total":773094113280,"available":772829609984,"internally_reserved":0,"allocated":9060352,"data_stored":4763980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.939693"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.309236+0000","last_change":"2024-04-25T09:06:07.814667+0000","last_active":"2024-04-25T09:06:09.309236+0000","last_peered":"2024-04-25T09:06:09.309236+0000","last_clean":"2024-04-25T09:06:09.309236+0000","last_became_active":"2024-04-25T09:06:07.814358+0000","last_became_peered":"2024-04-25T09:06:07.814358+0000","last_unstale":"2024-04-25T09:06:09.309236+0000","last_undegraded":"2024-04-25T09:06:09.309236+0000","last_fullsized":"2024-04-25T09:06:09.309236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:53.757405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832187+0000","last_change":"2024-04-25T09:06:07.826443+0000","last_active":"2024-04-25T09:06:08.832187+0000","last_peered":"2024-04-25T09:06:08.832187+0000","last_clean":"2024-04-25T09:06:08.832187+0000","last_became_active":"2024-04-25T09:06:07.825931+0000","last_became_peered":"2024-04-25T09:06:07.825931+0000","last_unstale":"2024-04-25T09:06:08.832187+0000","last_undegraded":"2024-04-25T09:06:08.832187+0000","last_fullsized":"2024-04-25T09:06:08.832187+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:02:00.119958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818701+0000","last_change":"2024-04-25T09:06:07.814845+0000","last_active":"2024-04-25T09:06:08.818701+0000","last_peered":"2024-04-25T09:06:08.818701+0000","last_clean":"2024-04-25T09:06:08.818701+0000","last_became_active":"2024-04-25T09:06:07.812696+0000","last_became_peered":"2024-04-25T09:06:07.812696+0000","last_unstale":"2024-04-25T09:06:08.818701+0000","last_undegraded":"2024-04-25T09:06:08.818701+0000","last_fullsized":"2024-04-25T09:06:08.818701+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:59.759841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818507+0000","last_change":"2024-04-25T09:06:07.816331+0000","last_active":"2024-04-25T09:06:08.818507+0000","last_peered":"2024-04-25T09:06:08.818507+0000","last_clean":"2024-04-25T09:06:08.818507+0000","last_became_active":"2024-04-25T09:06:07.813580+0000","last_became_peered":"2024-04-25T09:06:07.813580+0000","last_unstale":"2024-04-25T09:06:08.818507+0000","last_undegraded":"2024-04-25T09:06:08.818507+0000","last_fullsized":"2024-04-25T09:06:08.818507+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:35:39.519249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836332+0000","last_change":"2024-04-25T09:06:07.823993+0000","last_active":"2024-04-25T09:06:08.836332+0000","last_peered":"2024-04-25T09:06:08.836332+0000","last_clean":"2024-04-25T09:06:08.836332+0000","last_became_active":"2024-04-25T09:06:07.823705+0000","last_became_peered":"2024-04-25T09:06:07.823705+0000","last_unstale":"2024-04-25T09:06:08.836332+0000","last_undegraded":"2024-04-25T09:06:08.836332+0000","last_fullsized":"2024-04-25T09:06:08.836332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:02.088813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210711+0000","last_change":"2024-04-25T09:06:07.813296+0000","last_active":"2024-04-25T09:06:09.210711+0000","last_peered":"2024-04-25T09:06:09.210711+0000","last_clean":"2024-04-25T09:06:09.210711+0000","last_became_active":"2024-04-25T09:06:07.812961+0000","last_became_peered":"2024-04-25T09:06:07.812961+0000","last_unstale":"2024-04-25T09:06:09.210711+0000","last_undegraded":"2024-04-25T09:06:09.210711+0000","last_fullsized":"2024-04-25T09:06:09.210711+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:59.755379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308389+0000","last_change":"2024-04-25T09:06:07.820902+0000","last_active":"2024-04-25T09:06:09.308389+0000","last_peered":"2024-04-25T09:06:09.308389+0000","last_clean":"2024-04-25T09:06:09.308389+0000","last_became_active":"2024-04-25T09:06:07.820606+0000","last_became_peered":"2024-04-25T09:06:07.820606+0000","last_unstale":"2024-04-25T09:06:09.308389+0000","last_undegraded":"2024-04-25T09:06:09.308389+0000","last_fullsized":"2024-04-25T09:06:09.308389+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:06.874625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836217+0000","last_change":"2024-04-25T09:06:07.823901+0000","last_active":"2024-04-25T09:06:08.836217+0000","last_peered":"2024-04-25T09:06:08.836217+0000","last_clean":"2024-04-25T09:06:08.836217+0000","last_became_active":"2024-04-25T09:06:07.823593+0000","last_became_peered":"2024-04-25T09:06:07.823593+0000","last_unstale":"2024-04-25T09:06:08.836217+0000","last_undegraded":"2024-04-25T09:06:08.836217+0000","last_fullsized":"2024-04-25T09:06:08.836217+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:36:22.753687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818168+0000","last_change":"2024-04-25T09:06:07.813505+0000","last_active":"2024-04-25T09:06:08.818168+0000","last_peered":"2024-04-25T09:06:08.818168+0000","last_clean":"2024-04-25T09:06:08.818168+0000","last_became_active":"2024-04-25T09:06:07.813183+0000","last_became_peered":"2024-04-25T09:06:07.813183+0000","last_unstale":"2024-04-25T09:06:08.818168+0000","last_undegraded":"2024-04-25T09:06:08.818168+0000","last_fullsized":"2024-04-25T09:06:08.818168+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:58:26.604042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818746+0000","last_change":"2024-04-25T09:06:07.817892+0000","last_active":"2024-04-25T09:06:08.818746+0000","last_peered":"2024-04-25T09:06:08.818746+0000","last_clean":"2024-04-25T09:06:08.818746+0000","last_became_active":"2024-04-25T09:06:07.817470+0000","last_became_peered":"2024-04-25T09:06:07.817470+0000","last_unstale":"2024-04-25T09:06:08.818746+0000","last_undegraded":"2024-04-25T09:06:08.818746+0000","last_fullsized":"2024-04-25T09:06:08.818746+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:09.442091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832111+0000","last_change":"2024-04-25T09:06:07.824928+0000","last_active":"2024-04-25T09:06:08.832111+0000","last_peered":"2024-04-25T09:06:08.832111+0000","last_clean":"2024-04-25T09:06:08.832111+0000","last_became_active":"2024-04-25T09:06:07.824636+0000","last_became_peered":"2024-04-25T09:06:07.824636+0000","last_unstale":"2024-04-25T09:06:08.832111+0000","last_undegraded":"2024-04-25T09:06:08.832111+0000","last_fullsized":"2024-04-25T09:06:08.832111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:23:43.370580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818526+0000","last_change":"2024-04-25T09:06:07.818634+0000","last_active":"2024-04-25T09:06:08.818526+0000","last_peered":"2024-04-25T09:06:08.818526+0000","last_clean":"2024-04-25T09:06:08.818526+0000","last_became_active":"2024-04-25T09:06:07.818365+0000","last_became_peered":"2024-04-25T09:06:07.818365+0000","last_unstale":"2024-04-25T09:06:08.818526+0000","last_undegraded":"2024-04-25T09:06:08.818526+0000","last_fullsized":"2024-04-25T09:06:08.818526+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:40.236951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836498+0000","last_change":"2024-04-25T09:06:07.839315+0000","last_active":"2024-04-25T09:06:08.836498+0000","last_peered":"2024-04-25T09:06:08.836498+0000","last_clean":"2024-04-25T09:06:08.836498+0000","last_became_active":"2024-04-25T09:06:07.839012+0000","last_became_peered":"2024-04-25T09:06:07.839012+0000","last_unstale":"2024-04-25T09:06:08.836498+0000","last_undegraded":"2024-04-25T09:06:08.836498+0000","last_fullsized":"2024-04-25T09:06:08.836498+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:32.400599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210734+0000","last_change":"2024-04-25T09:06:07.811999+0000","last_active":"2024-04-25T09:06:09.210734+0000","last_peered":"2024-04-25T09:06:09.210734+0000","last_clean":"2024-04-25T09:06:09.210734+0000","last_became_active":"2024-04-25T09:06:07.811718+0000","last_became_peered":"2024-04-25T09:06:07.811718+0000","last_unstale":"2024-04-25T09:06:09.210734+0000","last_undegraded":"2024-04-25T09:06:09.210734+0000","last_fullsized":"2024-04-25T09:06:09.210734+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:55.538406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831637+0000","last_change":"2024-04-25T09:06:07.813698+0000","last_active":"2024-04-25T09:06:08.831637+0000","last_peered":"2024-04-25T09:06:08.831637+0000","last_clean":"2024-04-25T09:06:08.831637+0000","last_became_active":"2024-04-25T09:06:07.813398+0000","last_became_peered":"2024-04-25T09:06:07.813398+0000","last_unstale":"2024-04-25T09:06:08.831637+0000","last_undegraded":"2024-04-25T09:06:08.831637+0000","last_fullsized":"2024-04-25T09:06:08.831637+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:05.723410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308518+0000","last_change":"2024-04-25T09:06:07.818770+0000","last_active":"2024-04-25T09:06:09.308518+0000","last_peered":"2024-04-25T09:06:09.308518+0000","last_clean":"2024-04-25T09:06:09.308518+0000","last_became_active":"2024-04-25T09:06:07.818475+0000","last_became_peered":"2024-04-25T09:06:07.818475+0000","last_unstale":"2024-04-25T09:06:09.308518+0000","last_undegraded":"2024-04-25T09:06:09.308518+0000","last_fullsized":"2024-04-25T09:06:09.308518+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:59.755379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836805+0000","last_change":"2024-04-25T09:06:07.812973+0000","last_active":"2024-04-25T09:06:08.836805+0000","last_peered":"2024-04-25T09:06:08.836805+0000","last_clean":"2024-04-25T09:06:08.836805+0000","last_became_active":"2024-04-25T09:06:07.812694+0000","last_became_peered":"2024-04-25T09:06:07.812694+0000","last_unstale":"2024-04-25T09:06:08.836805+0000","last_undegraded":"2024-04-25T09:06:08.836805+0000","last_fullsized":"2024-04-25T09:06:08.836805+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:53:18.945579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818597+0000","last_change":"2024-04-25T09:06:07.811579+0000","last_active":"2024-04-25T09:06:08.818597+0000","last_peered":"2024-04-25T09:06:08.818597+0000","last_clean":"2024-04-25T09:06:08.818597+0000","last_became_active":"2024-04-25T09:06:07.811299+0000","last_became_peered":"2024-04-25T09:06:07.811299+0000","last_unstale":"2024-04-25T09:06:08.818597+0000","last_undegraded":"2024-04-25T09:06:08.818597+0000","last_fullsized":"2024-04-25T09:06:08.818597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:47:26.464358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.211028+0000","last_change":"2024-04-25T09:06:07.827195+0000","last_active":"2024-04-25T09:06:09.211028+0000","last_peered":"2024-04-25T09:06:09.211028+0000","last_clean":"2024-04-25T09:06:09.211028+0000","last_became_active":"2024-04-25T09:06:07.826932+0000","last_became_peered":"2024-04-25T09:06:07.826932+0000","last_unstale":"2024-04-25T09:06:09.211028+0000","last_undegraded":"2024-04-25T09:06:09.211028+0000","last_fullsized":"2024-04-25T09:06:09.211028+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:53.757405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836656+0000","last_change":"2024-04-25T09:06:07.832803+0000","last_active":"2024-04-25T09:06:08.836656+0000","last_peered":"2024-04-25T09:06:08.836656+0000","last_clean":"2024-04-25T09:06:08.836656+0000","last_became_active":"2024-04-25T09:06:07.832522+0000","last_became_peered":"2024-04-25T09:06:07.832522+0000","last_unstale":"2024-04-25T09:06:08.836656+0000","last_undegraded":"2024-04-25T09:06:08.836656+0000","last_fullsized":"2024-04-25T09:06:08.836656+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:35.545592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818386+0000","last_change":"2024-04-25T09:06:07.824236+0000","last_active":"2024-04-25T09:06:08.818386+0000","last_peered":"2024-04-25T09:06:08.818386+0000","last_clean":"2024-04-25T09:06:08.818386+0000","last_became_active":"2024-04-25T09:06:07.823966+0000","last_became_peered":"2024-04-25T09:06:07.823966+0000","last_unstale":"2024-04-25T09:06:08.818386+0000","last_undegraded":"2024-04-25T09:06:08.818386+0000","last_fullsized":"2024-04-25T09:06:08.818386+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:59.265850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836251+0000","last_change":"2024-04-25T09:06:07.817816+0000","last_active":"2024-04-25T09:06:08.836251+0000","last_peered":"2024-04-25T09:06:08.836251+0000","last_clean":"2024-04-25T09:06:08.836251+0000","last_became_active":"2024-04-25T09:06:07.817523+0000","last_became_peered":"2024-04-25T09:06:07.817523+0000","last_unstale":"2024-04-25T09:06:08.836251+0000","last_undegraded":"2024-04-25T09:06:08.836251+0000","last_fullsized":"2024-04-25T09:06:08.836251+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:13.351079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.817751+0000","last_change":"2024-04-25T09:06:07.806925+0000","last_active":"2024-04-25T09:06:08.817751+0000","last_peered":"2024-04-25T09:06:08.817751+0000","last_clean":"2024-04-25T09:06:08.817751+0000","last_became_active":"2024-04-25T09:06:07.806526+0000","last_became_peered":"2024-04-25T09:06:07.806526+0000","last_unstale":"2024-04-25T09:06:08.817751+0000","last_undegraded":"2024-04-25T09:06:08.817751+0000","last_fullsized":"2024-04-25T09:06:08.817751+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:19:26.244153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831629+0000","last_change":"2024-04-25T09:06:07.820560+0000","last_active":"2024-04-25T09:06:08.831629+0000","last_peered":"2024-04-25T09:06:08.831629+0000","last_clean":"2024-04-25T09:06:08.831629+0000","last_became_active":"2024-04-25T09:06:07.819208+0000","last_became_peered":"2024-04-25T09:06:07.819208+0000","last_unstale":"2024-04-25T09:06:08.831629+0000","last_undegraded":"2024-04-25T09:06:08.831629+0000","last_fullsized":"2024-04-25T09:06:08.831629+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:55.538406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832111+0000","last_change":"2024-04-25T09:06:07.831771+0000","last_active":"2024-04-25T09:06:08.832111+0000","last_peered":"2024-04-25T09:06:08.832111+0000","last_clean":"2024-04-25T09:06:08.832111+0000","last_became_active":"2024-04-25T09:06:07.831449+0000","last_became_peered":"2024-04-25T09:06:07.831449+0000","last_unstale":"2024-04-25T09:06:08.832111+0000","last_undegraded":"2024-04-25T09:06:08.832111+0000","last_fullsized":"2024-04-25T09:06:08.832111+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:20:40.432168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818720+0000","last_change":"2024-04-25T09:06:07.820708+0000","last_active":"2024-04-25T09:06:08.818720+0000","last_peered":"2024-04-25T09:06:08.818720+0000","last_clean":"2024-04-25T09:06:08.818720+0000","last_became_active":"2024-04-25T09:06:07.818356+0000","last_became_peered":"2024-04-25T09:06:07.818356+0000","last_unstale":"2024-04-25T09:06:08.818720+0000","last_undegraded":"2024-04-25T09:06:08.818720+0000","last_fullsized":"2024-04-25T09:06:08.818720+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:49.872705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308669+0000","last_change":"2024-04-25T09:06:07.818943+0000","last_active":"2024-04-25T09:06:09.308669+0000","last_peered":"2024-04-25T09:06:09.308669+0000","last_clean":"2024-04-25T09:06:09.308669+0000","last_became_active":"2024-04-25T09:06:07.817531+0000","last_became_peered":"2024-04-25T09:06:07.817531+0000","last_unstale":"2024-04-25T09:06:09.308669+0000","last_undegraded":"2024-04-25T09:06:09.308669+0000","last_fullsized":"2024-04-25T09:06:09.308669+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:47:55.538406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836631+0000","last_change":"2024-04-25T09:06:07.822269+0000","last_active":"2024-04-25T09:06:08.836631+0000","last_peered":"2024-04-25T09:06:08.836631+0000","last_clean":"2024-04-25T09:06:08.836631+0000","last_became_active":"2024-04-25T09:06:07.821791+0000","last_became_peered":"2024-04-25T09:06:07.821791+0000","last_unstale":"2024-04-25T09:06:08.836631+0000","last_undegraded":"2024-04-25T09:06:08.836631+0000","last_fullsized":"2024-04-25T09:06:08.836631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:54:59.329846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832061+0000","last_change":"2024-04-25T09:06:07.817929+0000","last_active":"2024-04-25T09:06:08.832061+0000","last_peered":"2024-04-25T09:06:08.832061+0000","last_clean":"2024-04-25T09:06:08.832061+0000","last_became_active":"2024-04-25T09:06:07.817252+0000","last_became_peered":"2024-04-25T09:06:07.817252+0000","last_unstale":"2024-04-25T09:06:08.832061+0000","last_undegraded":"2024-04-25T09:06:08.832061+0000","last_fullsized":"2024-04-25T09:06:08.832061+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:17:30.773752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308453+0000","last_change":"2024-04-25T09:06:07.812990+0000","last_active":"2024-04-25T09:06:09.308453+0000","last_peered":"2024-04-25T09:06:09.308453+0000","last_clean":"2024-04-25T09:06:09.308453+0000","last_became_active":"2024-04-25T09:06:07.812712+0000","last_became_peered":"2024-04-25T09:06:07.812712+0000","last_unstale":"2024-04-25T09:06:09.308453+0000","last_undegraded":"2024-04-25T09:06:09.308453+0000","last_fullsized":"2024-04-25T09:06:09.308453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:09.442091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818316+0000","last_change":"2024-04-25T09:06:07.813121+0000","last_active":"2024-04-25T09:06:08.818316+0000","last_peered":"2024-04-25T09:06:08.818316+0000","last_clean":"2024-04-25T09:06:08.818316+0000","last_became_active":"2024-04-25T09:06:07.812832+0000","last_became_peered":"2024-04-25T09:06:07.812832+0000","last_unstale":"2024-04-25T09:06:08.818316+0000","last_undegraded":"2024-04-25T09:06:08.818316+0000","last_fullsized":"2024-04-25T09:06:08.818316+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:12:19.373376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308838+0000","last_change":"2024-04-25T09:06:07.817377+0000","last_active":"2024-04-25T09:06:09.308838+0000","last_peered":"2024-04-25T09:06:09.308838+0000","last_clean":"2024-04-25T09:06:09.308838+0000","last_became_active":"2024-04-25T09:06:07.817019+0000","last_became_peered":"2024-04-25T09:06:07.817019+0000","last_unstale":"2024-04-25T09:06:09.308838+0000","last_undegraded":"2024-04-25T09:06:09.308838+0000","last_fullsized":"2024-04-25T09:06:09.308838+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:05.723410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818080+0000","last_change":"2024-04-25T09:06:07.806136+0000","last_active":"2024-04-25T09:06:08.818080+0000","last_peered":"2024-04-25T09:06:08.818080+0000","last_clean":"2024-04-25T09:06:08.818080+0000","last_became_active":"2024-04-25T09:06:07.805793+0000","last_became_peered":"2024-04-25T09:06:07.805793+0000","last_unstale":"2024-04-25T09:06:08.818080+0000","last_undegraded":"2024-04-25T09:06:08.818080+0000","last_fullsized":"2024-04-25T09:06:08.818080+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:53.451332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"79'4","reported_seq":18,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836751+0000","last_change":"2024-04-25T09:06:06.799806+0000","last_active":"2024-04-25T09:06:08.836751+0000","last_peered":"2024-04-25T09:06:08.836751+0000","last_clean":"2024-04-25T09:06:08.836751+0000","last_became_active":"2024-04-25T09:06:06.799517+0000","last_became_peered":"2024-04-25T09:06:06.799517+0000","last_unstale":"2024-04-25T09:06:08.836751+0000","last_undegraded":"2024-04-25T09:06:08.836751+0000","last_fullsized":"2024-04-25T09:06:08.836751+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:57.126954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831650+0000","last_change":"2024-04-25T09:06:07.819471+0000","last_active":"2024-04-25T09:06:08.831650+0000","last_peered":"2024-04-25T09:06:08.831650+0000","last_clean":"2024-04-25T09:06:08.831650+0000","last_became_active":"2024-04-25T09:06:07.819167+0000","last_became_peered":"2024-04-25T09:06:07.819167+0000","last_unstale":"2024-04-25T09:06:08.831650+0000","last_undegraded":"2024-04-25T09:06:08.831650+0000","last_fullsized":"2024-04-25T09:06:08.831650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:17.868732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.309111+0000","last_change":"2024-04-25T09:06:06.808373+0000","last_active":"2024-04-25T09:06:09.309111+0000","last_peered":"2024-04-25T09:06:09.309111+0000","last_clean":"2024-04-25T09:06:09.309111+0000","last_became_active":"2024-04-25T09:06:06.807999+0000","last_became_peered":"2024-04-25T09:06:06.807999+0000","last_unstale":"2024-04-25T09:06:09.309111+0000","last_undegraded":"2024-04-25T09:06:09.309111+0000","last_fullsized":"2024-04-25T09:06:09.309111+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:16.074826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818170+0000","last_change":"2024-04-25T09:06:07.814292+0000","last_active":"2024-04-25T09:06:08.818170+0000","last_peered":"2024-04-25T09:06:08.818170+0000","last_clean":"2024-04-25T09:06:08.818170+0000","last_became_active":"2024-04-25T09:06:07.813768+0000","last_became_peered":"2024-04-25T09:06:07.813768+0000","last_unstale":"2024-04-25T09:06:08.818170+0000","last_undegraded":"2024-04-25T09:06:08.818170+0000","last_fullsized":"2024-04-25T09:06:08.818170+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:52.691319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308778+0000","last_change":"2024-04-25T09:06:06.811431+0000","last_active":"2024-04-25T09:06:09.308778+0000","last_peered":"2024-04-25T09:06:09.308778+0000","last_clean":"2024-04-25T09:06:09.308778+0000","last_became_active":"2024-04-25T09:06:06.811143+0000","last_became_peered":"2024-04-25T09:06:06.811143+0000","last_unstale":"2024-04-25T09:06:09.308778+0000","last_undegraded":"2024-04-25T09:06:09.308778+0000","last_fullsized":"2024-04-25T09:06:09.308778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:10.106722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818433+0000","last_change":"2024-04-25T09:06:07.823752+0000","last_active":"2024-04-25T09:06:08.818433+0000","last_peered":"2024-04-25T09:06:08.818433+0000","last_clean":"2024-04-25T09:06:08.818433+0000","last_became_active":"2024-04-25T09:06:07.823400+0000","last_became_peered":"2024-04-25T09:06:07.823400+0000","last_unstale":"2024-04-25T09:06:08.818433+0000","last_undegraded":"2024-04-25T09:06:08.818433+0000","last_fullsized":"2024-04-25T09:06:08.818433+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:12.442269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308546+0000","last_change":"2024-04-25T09:06:06.805395+0000","last_active":"2024-04-25T09:06:09.308546+0000","last_peered":"2024-04-25T09:06:09.308546+0000","last_clean":"2024-04-25T09:06:09.308546+0000","last_became_active":"2024-04-25T09:06:06.803652+0000","last_became_peered":"2024-04-25T09:06:06.803652+0000","last_unstale":"2024-04-25T09:06:09.308546+0000","last_undegraded":"2024-04-25T09:06:09.308546+0000","last_fullsized":"2024-04-25T09:06:09.308546+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:34.974640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831977+0000","last_change":"2024-04-25T09:06:07.825333+0000","last_active":"2024-04-25T09:06:08.831977+0000","last_peered":"2024-04-25T09:06:08.831977+0000","last_clean":"2024-04-25T09:06:08.831977+0000","last_became_active":"2024-04-25T09:06:07.825017+0000","last_became_peered":"2024-04-25T09:06:07.825017+0000","last_unstale":"2024-04-25T09:06:08.831977+0000","last_undegraded":"2024-04-25T09:06:08.831977+0000","last_fullsized":"2024-04-25T09:06:08.831977+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:53.757405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818499+0000","last_change":"2024-04-25T09:06:06.795698+0000","last_active":"2024-04-25T09:06:08.818499+0000","last_peered":"2024-04-25T09:06:08.818499+0000","last_clean":"2024-04-25T09:06:08.818499+0000","last_became_active":"2024-04-25T09:06:06.795409+0000","last_became_peered":"2024-04-25T09:06:06.795409+0000","last_unstale":"2024-04-25T09:06:08.818499+0000","last_undegraded":"2024-04-25T09:06:08.818499+0000","last_fullsized":"2024-04-25T09:06:08.818499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:30:13.643147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832208+0000","last_change":"2024-04-25T09:06:07.816118+0000","last_active":"2024-04-25T09:06:08.832208+0000","last_peered":"2024-04-25T09:06:08.832208+0000","last_clean":"2024-04-25T09:06:08.832208+0000","last_became_active":"2024-04-25T09:06:07.815845+0000","last_became_peered":"2024-04-25T09:06:07.815845+0000","last_unstale":"2024-04-25T09:06:08.832208+0000","last_undegraded":"2024-04-25T09:06:08.832208+0000","last_fullsized":"2024-04-25T09:06:08.832208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:26:35.594988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.817984+0000","last_change":"2024-04-25T09:06:06.807630+0000","last_active":"2024-04-25T09:06:08.817984+0000","last_peered":"2024-04-25T09:06:08.817984+0000","last_clean":"2024-04-25T09:06:08.817984+0000","last_became_active":"2024-04-25T09:06:06.807308+0000","last_became_peered":"2024-04-25T09:06:06.807308+0000","last_unstale":"2024-04-25T09:06:08.817984+0000","last_undegraded":"2024-04-25T09:06:08.817984+0000","last_fullsized":"2024-04-25T09:06:08.817984+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:34.524363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818208+0000","last_change":"2024-04-25T09:06:07.816283+0000","last_active":"2024-04-25T09:06:08.818208+0000","last_peered":"2024-04-25T09:06:08.818208+0000","last_clean":"2024-04-25T09:06:08.818208+0000","last_became_active":"2024-04-25T09:06:07.814559+0000","last_became_peered":"2024-04-25T09:06:07.814559+0000","last_unstale":"2024-04-25T09:06:08.818208+0000","last_undegraded":"2024-04-25T09:06:08.818208+0000","last_fullsized":"2024-04-25T09:06:08.818208+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:17.129985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831736+0000","last_change":"2024-04-25T09:06:06.805117+0000","last_active":"2024-04-25T09:06:08.831736+0000","last_peered":"2024-04-25T09:06:08.831736+0000","last_clean":"2024-04-25T09:06:08.831736+0000","last_became_active":"2024-04-25T09:06:06.801186+0000","last_became_peered":"2024-04-25T09:06:06.801186+0000","last_unstale":"2024-04-25T09:06:08.831736+0000","last_undegraded":"2024-04-25T09:06:08.831736+0000","last_fullsized":"2024-04-25T09:06:08.831736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:42.041797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308942+0000","last_change":"2024-04-25T09:06:07.823691+0000","last_active":"2024-04-25T09:06:09.308942+0000","last_peered":"2024-04-25T09:06:09.308942+0000","last_clean":"2024-04-25T09:06:09.308942+0000","last_became_active":"2024-04-25T09:06:07.821474+0000","last_became_peered":"2024-04-25T09:06:07.821474+0000","last_unstale":"2024-04-25T09:06:09.308942+0000","last_undegraded":"2024-04-25T09:06:09.308942+0000","last_fullsized":"2024-04-25T09:06:09.308942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:43.048846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836342+0000","last_change":"2024-04-25T09:06:06.794266+0000","last_active":"2024-04-25T09:06:08.836342+0000","last_peered":"2024-04-25T09:06:08.836342+0000","last_clean":"2024-04-25T09:06:08.836342+0000","last_became_active":"2024-04-25T09:06:06.793467+0000","last_became_peered":"2024-04-25T09:06:06.793467+0000","last_unstale":"2024-04-25T09:06:08.836342+0000","last_undegraded":"2024-04-25T09:06:08.836342+0000","last_fullsized":"2024-04-25T09:06:08.836342+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:33:34.015527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831614+0000","last_change":"2024-04-25T09:06:07.819547+0000","last_active":"2024-04-25T09:06:08.831614+0000","last_peered":"2024-04-25T09:06:08.831614+0000","last_clean":"2024-04-25T09:06:08.831614+0000","last_became_active":"2024-04-25T09:06:07.818746+0000","last_became_peered":"2024-04-25T09:06:07.818746+0000","last_unstale":"2024-04-25T09:06:08.831614+0000","last_undegraded":"2024-04-25T09:06:08.831614+0000","last_fullsized":"2024-04-25T09:06:08.831614+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:44:59.755379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.309306+0000","last_change":"2024-04-25T09:06:06.805986+0000","last_active":"2024-04-25T09:06:09.309306+0000","last_peered":"2024-04-25T09:06:09.309306+0000","last_clean":"2024-04-25T09:06:09.309306+0000","last_became_active":"2024-04-25T09:06:06.805703+0000","last_became_peered":"2024-04-25T09:06:06.805703+0000","last_unstale":"2024-04-25T09:06:09.309306+0000","last_undegraded":"2024-04-25T09:06:09.309306+0000","last_fullsized":"2024-04-25T09:06:09.309306+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:00.876693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.817783+0000","last_change":"2024-04-25T09:06:07.811960+0000","last_active":"2024-04-25T09:06:08.817783+0000","last_peered":"2024-04-25T09:06:08.817783+0000","last_clean":"2024-04-25T09:06:08.817783+0000","last_became_active":"2024-04-25T09:06:07.811631+0000","last_became_peered":"2024-04-25T09:06:07.811631+0000","last_unstale":"2024-04-25T09:06:08.817783+0000","last_undegraded":"2024-04-25T09:06:08.817783+0000","last_fullsized":"2024-04-25T09:06:08.817783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:17:21.351326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818819+0000","last_change":"2024-04-25T09:06:06.797157+0000","last_active":"2024-04-25T09:06:08.818819+0000","last_peered":"2024-04-25T09:06:08.818819+0000","last_clean":"2024-04-25T09:06:08.818819+0000","last_became_active":"2024-04-25T09:06:06.796861+0000","last_became_peered":"2024-04-25T09:06:06.796861+0000","last_unstale":"2024-04-25T09:06:08.818819+0000","last_undegraded":"2024-04-25T09:06:08.818819+0000","last_fullsized":"2024-04-25T09:06:08.818819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:01.653369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210882+0000","last_change":"2024-04-25T09:06:07.824912+0000","last_active":"2024-04-25T09:06:09.210882+0000","last_peered":"2024-04-25T09:06:09.210882+0000","last_clean":"2024-04-25T09:06:09.210882+0000","last_became_active":"2024-04-25T09:06:07.824652+0000","last_became_peered":"2024-04-25T09:06:07.824652+0000","last_unstale":"2024-04-25T09:06:09.210882+0000","last_undegraded":"2024-04-25T09:06:09.210882+0000","last_fullsized":"2024-04-25T09:06:09.210882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:17.868732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"79'3","reported_seq":17,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836789+0000","last_change":"2024-04-25T09:06:06.800505+0000","last_active":"2024-04-25T09:06:08.836789+0000","last_peered":"2024-04-25T09:06:08.836789+0000","last_clean":"2024-04-25T09:06:08.836789+0000","last_became_active":"2024-04-25T09:06:06.800254+0000","last_became_peered":"2024-04-25T09:06:06.800254+0000","last_unstale":"2024-04-25T09:06:08.836789+0000","last_undegraded":"2024-04-25T09:06:08.836789+0000","last_fullsized":"2024-04-25T09:06:08.836789+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:04:44.777626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818339+0000","last_change":"2024-04-25T09:06:07.816195+0000","last_active":"2024-04-25T09:06:08.818339+0000","last_peered":"2024-04-25T09:06:08.818339+0000","last_clean":"2024-04-25T09:06:08.818339+0000","last_became_active":"2024-04-25T09:06:07.815062+0000","last_became_peered":"2024-04-25T09:06:07.815062+0000","last_unstale":"2024-04-25T09:06:08.818339+0000","last_undegraded":"2024-04-25T09:06:08.818339+0000","last_fullsized":"2024-04-25T09:06:08.818339+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:00:02.996376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"79'6","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308662+0000","last_change":"2024-04-25T09:06:06.802758+0000","last_active":"2024-04-25T09:06:09.308662+0000","last_peered":"2024-04-25T09:06:09.308662+0000","last_clean":"2024-04-25T09:06:09.308662+0000","last_became_active":"2024-04-25T09:06:06.802483+0000","last_became_peered":"2024-04-25T09:06:06.802483+0000","last_unstale":"2024-04-25T09:06:09.308662+0000","last_undegraded":"2024-04-25T09:06:09.308662+0000","last_fullsized":"2024-04-25T09:06:09.308662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:58.258801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818679+0000","last_change":"2024-04-25T09:06:07.806167+0000","last_active":"2024-04-25T09:06:08.818679+0000","last_peered":"2024-04-25T09:06:08.818679+0000","last_clean":"2024-04-25T09:06:08.818679+0000","last_became_active":"2024-04-25T09:06:07.805890+0000","last_became_peered":"2024-04-25T09:06:07.805890+0000","last_unstale":"2024-04-25T09:06:08.818679+0000","last_undegraded":"2024-04-25T09:06:08.818679+0000","last_fullsized":"2024-04-25T09:06:08.818679+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:07.266097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.817662+0000","last_change":"2024-04-25T09:06:06.797408+0000","last_active":"2024-04-25T09:06:08.817662+0000","last_peered":"2024-04-25T09:06:08.817662+0000","last_clean":"2024-04-25T09:06:08.817662+0000","last_became_active":"2024-04-25T09:06:06.796993+0000","last_became_peered":"2024-04-25T09:06:06.796993+0000","last_unstale":"2024-04-25T09:06:08.817662+0000","last_undegraded":"2024-04-25T09:06:08.817662+0000","last_fullsized":"2024-04-25T09:06:08.817662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:43.837307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308382+0000","last_change":"2024-04-25T09:06:07.825171+0000","last_active":"2024-04-25T09:06:09.308382+0000","last_peered":"2024-04-25T09:06:09.308382+0000","last_clean":"2024-04-25T09:06:09.308382+0000","last_became_active":"2024-04-25T09:06:07.824862+0000","last_became_peered":"2024-04-25T09:06:07.824862+0000","last_unstale":"2024-04-25T09:06:09.308382+0000","last_undegraded":"2024-04-25T09:06:09.308382+0000","last_fullsized":"2024-04-25T09:06:09.308382+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:11.015197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308445+0000","last_change":"2024-04-25T09:06:06.800180+0000","last_active":"2024-04-25T09:06:09.308445+0000","last_peered":"2024-04-25T09:06:09.308445+0000","last_clean":"2024-04-25T09:06:09.308445+0000","last_became_active":"2024-04-25T09:06:06.799584+0000","last_became_peered":"2024-04-25T09:06:06.799584+0000","last_unstale":"2024-04-25T09:06:09.308445+0000","last_undegraded":"2024-04-25T09:06:09.308445+0000","last_fullsized":"2024-04-25T09:06:09.308445+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:01.653369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308804+0000","last_change":"2024-04-25T09:06:07.823830+0000","last_active":"2024-04-25T09:06:09.308804+0000","last_peered":"2024-04-25T09:06:09.308804+0000","last_clean":"2024-04-25T09:06:09.308804+0000","last_became_active":"2024-04-25T09:06:07.823307+0000","last_became_peered":"2024-04-25T09:06:07.823307+0000","last_unstale":"2024-04-25T09:06:09.308804+0000","last_undegraded":"2024-04-25T09:06:09.308804+0000","last_fullsized":"2024-04-25T09:06:09.308804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:02.660418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836261+0000","last_change":"2024-04-25T09:06:06.806324+0000","last_active":"2024-04-25T09:06:08.836261+0000","last_peered":"2024-04-25T09:06:08.836261+0000","last_clean":"2024-04-25T09:06:08.836261+0000","last_became_active":"2024-04-25T09:06:06.806051+0000","last_became_peered":"2024-04-25T09:06:06.806051+0000","last_unstale":"2024-04-25T09:06:08.836261+0000","last_undegraded":"2024-04-25T09:06:08.836261+0000","last_fullsized":"2024-04-25T09:06:08.836261+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:41:35.865602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308930+0000","last_change":"2024-04-25T09:06:07.814393+0000","last_active":"2024-04-25T09:06:09.308930+0000","last_peered":"2024-04-25T09:06:09.308930+0000","last_clean":"2024-04-25T09:06:09.308930+0000","last_became_active":"2024-04-25T09:06:07.813204+0000","last_became_peered":"2024-04-25T09:06:07.813204+0000","last_unstale":"2024-04-25T09:06:09.308930+0000","last_undegraded":"2024-04-25T09:06:09.308930+0000","last_fullsized":"2024-04-25T09:06:09.308930+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:11.113771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"79'8","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.831719+0000","last_change":"2024-04-25T09:06:06.807960+0000","last_active":"2024-04-25T09:06:08.831719+0000","last_peered":"2024-04-25T09:06:08.831719+0000","last_clean":"2024-04-25T09:06:08.831719+0000","last_became_active":"2024-04-25T09:06:06.807661+0000","last_became_peered":"2024-04-25T09:06:06.807661+0000","last_unstale":"2024-04-25T09:06:08.831719+0000","last_undegraded":"2024-04-25T09:06:08.831719+0000","last_fullsized":"2024-04-25T09:06:08.831719+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:43.837307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210625+0000","last_change":"2024-04-25T09:06:07.839888+0000","last_active":"2024-04-25T09:06:09.210625+0000","last_peered":"2024-04-25T09:06:09.210625+0000","last_clean":"2024-04-25T09:06:09.210625+0000","last_became_active":"2024-04-25T09:06:07.839610+0000","last_became_peered":"2024-04-25T09:06:07.839610+0000","last_unstale":"2024-04-25T09:06:09.210625+0000","last_undegraded":"2024-04-25T09:06:09.210625+0000","last_fullsized":"2024-04-25T09:06:09.210625+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:20:09.442091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.309311+0000","last_change":"2024-04-25T09:06:06.809225+0000","last_active":"2024-04-25T09:06:09.309311+0000","last_peered":"2024-04-25T09:06:09.309311+0000","last_clean":"2024-04-25T09:06:09.309311+0000","last_became_active":"2024-04-25T09:06:06.808899+0000","last_became_peered":"2024-04-25T09:06:06.808899+0000","last_unstale":"2024-04-25T09:06:09.309311+0000","last_undegraded":"2024-04-25T09:06:09.309311+0000","last_fullsized":"2024-04-25T09:06:09.309311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:00:44.135882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836235+0000","last_change":"2024-04-25T09:06:07.817410+0000","last_active":"2024-04-25T09:06:08.836235+0000","last_peered":"2024-04-25T09:06:08.836235+0000","last_clean":"2024-04-25T09:06:08.836235+0000","last_became_active":"2024-04-25T09:06:07.817098+0000","last_became_peered":"2024-04-25T09:06:07.817098+0000","last_unstale":"2024-04-25T09:06:08.836235+0000","last_undegraded":"2024-04-25T09:06:08.836235+0000","last_fullsized":"2024-04-25T09:06:08.836235+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:16.154195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818005+0000","last_change":"2024-04-25T09:06:06.806648+0000","last_active":"2024-04-25T09:06:08.818005+0000","last_peered":"2024-04-25T09:06:08.818005+0000","last_clean":"2024-04-25T09:06:08.818005+0000","last_became_active":"2024-04-25T09:06:06.806391+0000","last_became_peered":"2024-04-25T09:06:06.806391+0000","last_unstale":"2024-04-25T09:06:08.818005+0000","last_undegraded":"2024-04-25T09:06:08.818005+0000","last_fullsized":"2024-04-25T09:06:08.818005+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:41.541091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836332+0000","last_change":"2024-04-25T09:06:07.813854+0000","last_active":"2024-04-25T09:06:08.836332+0000","last_peered":"2024-04-25T09:06:08.836332+0000","last_clean":"2024-04-25T09:06:08.836332+0000","last_became_active":"2024-04-25T09:06:07.813475+0000","last_became_peered":"2024-04-25T09:06:07.813475+0000","last_unstale":"2024-04-25T09:06:08.836332+0000","last_undegraded":"2024-04-25T09:06:08.836332+0000","last_fullsized":"2024-04-25T09:06:08.836332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:33.852726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"79'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836789+0000","last_change":"2024-04-25T09:06:06.796724+0000","last_active":"2024-04-25T09:06:08.836789+0000","last_peered":"2024-04-25T09:06:08.836789+0000","last_clean":"2024-04-25T09:06:08.836789+0000","last_became_active":"2024-04-25T09:06:06.796319+0000","last_became_peered":"2024-04-25T09:06:06.796319+0000","last_unstale":"2024-04-25T09:06:08.836789+0000","last_undegraded":"2024-04-25T09:06:08.836789+0000","last_fullsized":"2024-04-25T09:06:08.836789+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:52:53.252269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210804+0000","last_change":"2024-04-25T09:06:07.818928+0000","last_active":"2024-04-25T09:06:09.210804+0000","last_peered":"2024-04-25T09:06:09.210804+0000","last_clean":"2024-04-25T09:06:09.210804+0000","last_became_active":"2024-04-25T09:06:07.818663+0000","last_became_peered":"2024-04-25T09:06:07.818663+0000","last_unstale":"2024-04-25T09:06:09.210804+0000","last_undegraded":"2024-04-25T09:06:09.210804+0000","last_fullsized":"2024-04-25T09:06:09.210804+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:05.723410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818541+0000","last_change":"2024-04-25T09:06:06.808871+0000","last_active":"2024-04-25T09:06:08.818541+0000","last_peered":"2024-04-25T09:06:08.818541+0000","last_clean":"2024-04-25T09:06:08.818541+0000","last_became_active":"2024-04-25T09:06:06.808548+0000","last_became_peered":"2024-04-25T09:06:06.808548+0000","last_unstale":"2024-04-25T09:06:08.818541+0000","last_undegraded":"2024-04-25T09:06:08.818541+0000","last_fullsized":"2024-04-25T09:06:08.818541+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:11:16.122936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832069+0000","last_change":"2024-04-25T09:06:07.819486+0000","last_active":"2024-04-25T09:06:08.832069+0000","last_peered":"2024-04-25T09:06:08.832069+0000","last_clean":"2024-04-25T09:06:08.832069+0000","last_became_active":"2024-04-25T09:06:07.819141+0000","last_became_peered":"2024-04-25T09:06:07.819141+0000","last_unstale":"2024-04-25T09:06:08.832069+0000","last_undegraded":"2024-04-25T09:06:08.832069+0000","last_fullsized":"2024-04-25T09:06:08.832069+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:58:48.151096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210950+0000","last_change":"2024-04-25T09:06:06.809981+0000","last_active":"2024-04-25T09:06:09.210950+0000","last_peered":"2024-04-25T09:06:09.210950+0000","last_clean":"2024-04-25T09:06:09.210950+0000","last_became_active":"2024-04-25T09:06:06.809714+0000","last_became_peered":"2024-04-25T09:06:06.809714+0000","last_unstale":"2024-04-25T09:06:09.210950+0000","last_undegraded":"2024-04-25T09:06:09.210950+0000","last_fullsized":"2024-04-25T09:06:09.210950+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:16.074826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832275+0000","last_change":"2024-04-25T09:06:07.820270+0000","last_active":"2024-04-25T09:06:08.832275+0000","last_peered":"2024-04-25T09:06:08.832275+0000","last_clean":"2024-04-25T09:06:08.832275+0000","last_became_active":"2024-04-25T09:06:07.819988+0000","last_became_peered":"2024-04-25T09:06:07.819988+0000","last_unstale":"2024-04-25T09:06:08.832275+0000","last_undegraded":"2024-04-25T09:06:08.832275+0000","last_fullsized":"2024-04-25T09:06:08.832275+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:37.354176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210652+0000","last_change":"2024-04-25T09:06:06.802161+0000","last_active":"2024-04-25T09:06:09.210652+0000","last_peered":"2024-04-25T09:06:09.210652+0000","last_clean":"2024-04-25T09:06:09.210652+0000","last_became_active":"2024-04-25T09:06:06.801899+0000","last_became_peered":"2024-04-25T09:06:06.801899+0000","last_unstale":"2024-04-25T09:06:09.210652+0000","last_undegraded":"2024-04-25T09:06:09.210652+0000","last_fullsized":"2024-04-25T09:06:09.210652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:39:10.106722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.309127+0000","last_change":"2024-04-25T09:06:07.822766+0000","last_active":"2024-04-25T09:06:09.309127+0000","last_peered":"2024-04-25T09:06:09.309127+0000","last_clean":"2024-04-25T09:06:09.309127+0000","last_became_active":"2024-04-25T09:06:07.821775+0000","last_became_peered":"2024-04-25T09:06:07.821775+0000","last_unstale":"2024-04-25T09:06:09.309127+0000","last_undegraded":"2024-04-25T09:06:09.309127+0000","last_fullsized":"2024-04-25T09:06:09.309127+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:59:17.081875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210583+0000","last_change":"2024-04-25T09:06:06.804020+0000","last_active":"2024-04-25T09:06:09.210583+0000","last_peered":"2024-04-25T09:06:09.210583+0000","last_clean":"2024-04-25T09:06:09.210583+0000","last_became_active":"2024-04-25T09:06:06.803763+0000","last_became_peered":"2024-04-25T09:06:06.803763+0000","last_unstale":"2024-04-25T09:06:09.210583+0000","last_undegraded":"2024-04-25T09:06:09.210583+0000","last_fullsized":"2024-04-25T09:06:09.210583+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:04:00.876693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818070+0000","last_change":"2024-04-25T09:06:07.814633+0000","last_active":"2024-04-25T09:06:08.818070+0000","last_peered":"2024-04-25T09:06:08.818070+0000","last_clean":"2024-04-25T09:06:08.818070+0000","last_became_active":"2024-04-25T09:06:07.814358+0000","last_became_peered":"2024-04-25T09:06:07.814358+0000","last_unstale":"2024-04-25T09:06:08.818070+0000","last_undegraded":"2024-04-25T09:06:08.818070+0000","last_fullsized":"2024-04-25T09:06:08.818070+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:01.152866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"79'2","reported_seq":16,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818690+0000","last_change":"2024-04-25T09:06:06.803193+0000","last_active":"2024-04-25T09:06:08.818690+0000","last_peered":"2024-04-25T09:06:08.818690+0000","last_clean":"2024-04-25T09:06:08.818690+0000","last_became_active":"2024-04-25T09:06:06.802915+0000","last_became_peered":"2024-04-25T09:06:06.802915+0000","last_unstale":"2024-04-25T09:06:08.818690+0000","last_undegraded":"2024-04-25T09:06:08.818690+0000","last_fullsized":"2024-04-25T09:06:08.818690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:42.041797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308253+0000","last_change":"2024-04-25T09:06:07.834067+0000","last_active":"2024-04-25T09:06:09.308253+0000","last_peered":"2024-04-25T09:06:09.308253+0000","last_clean":"2024-04-25T09:06:09.308253+0000","last_became_active":"2024-04-25T09:06:07.833702+0000","last_became_peered":"2024-04-25T09:06:07.833702+0000","last_unstale":"2024-04-25T09:06:09.308253+0000","last_undegraded":"2024-04-25T09:06:09.308253+0000","last_fullsized":"2024-04-25T09:06:09.308253+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:59.759841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"80'1","reported_seq":15,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.833749+0000","last_change":"2024-04-25T09:06:06.802921+0000","last_active":"2024-04-25T09:06:08.833749+0000","last_peered":"2024-04-25T09:06:08.833749+0000","last_clean":"2024-04-25T09:06:08.833749+0000","last_became_active":"2024-04-25T09:06:06.801064+0000","last_became_peered":"2024-04-25T09:06:06.801064+0000","last_unstale":"2024-04-25T09:06:08.833749+0000","last_undegraded":"2024-04-25T09:06:08.833749+0000","last_fullsized":"2024-04-25T09:06:08.833749+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:34.524363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818326+0000","last_change":"2024-04-25T09:06:07.812609+0000","last_active":"2024-04-25T09:06:08.818326+0000","last_peered":"2024-04-25T09:06:08.818326+0000","last_clean":"2024-04-25T09:06:08.818326+0000","last_became_active":"2024-04-25T09:06:07.812329+0000","last_became_peered":"2024-04-25T09:06:07.812329+0000","last_unstale":"2024-04-25T09:06:08.818326+0000","last_undegraded":"2024-04-25T09:06:08.818326+0000","last_fullsized":"2024-04-25T09:06:08.818326+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:35.981689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308996+0000","last_change":"2024-04-25T09:06:06.803197+0000","last_active":"2024-04-25T09:06:09.308996+0000","last_peered":"2024-04-25T09:06:09.308996+0000","last_clean":"2024-04-25T09:06:09.308996+0000","last_became_active":"2024-04-25T09:06:06.802937+0000","last_became_peered":"2024-04-25T09:06:06.802937+0000","last_unstale":"2024-04-25T09:06:09.308996+0000","last_undegraded":"2024-04-25T09:06:09.308996+0000","last_fullsized":"2024-04-25T09:06:09.308996+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:39.811621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.832186+0000","last_change":"2024-04-25T09:06:07.818188+0000","last_active":"2024-04-25T09:06:08.832186+0000","last_peered":"2024-04-25T09:06:08.832186+0000","last_clean":"2024-04-25T09:06:08.832186+0000","last_became_active":"2024-04-25T09:06:07.817671+0000","last_became_peered":"2024-04-25T09:06:07.817671+0000","last_unstale":"2024-04-25T09:06:08.832186+0000","last_undegraded":"2024-04-25T09:06:08.832186+0000","last_fullsized":"2024-04-25T09:06:08.832186+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:52:44.370904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308630+0000","last_change":"2024-04-25T09:06:06.806391+0000","last_active":"2024-04-25T09:06:09.308630+0000","last_peered":"2024-04-25T09:06:09.308630+0000","last_clean":"2024-04-25T09:06:09.308630+0000","last_became_active":"2024-04-25T09:06:06.805276+0000","last_became_peered":"2024-04-25T09:06:06.805276+0000","last_unstale":"2024-04-25T09:06:09.308630+0000","last_undegraded":"2024-04-25T09:06:09.308630+0000","last_fullsized":"2024-04-25T09:06:09.308630+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:43.837307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308429+0000","last_change":"2024-04-25T09:06:07.814294+0000","last_active":"2024-04-25T09:06:09.308429+0000","last_peered":"2024-04-25T09:06:09.308429+0000","last_clean":"2024-04-25T09:06:09.308429+0000","last_became_active":"2024-04-25T09:06:07.813922+0000","last_became_peered":"2024-04-25T09:06:07.813922+0000","last_unstale":"2024-04-25T09:06:09.308429+0000","last_undegraded":"2024-04-25T09:06:09.308429+0000","last_fullsized":"2024-04-25T09:06:09.308429+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:35.531412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308192+0000","last_change":"2024-04-25T09:06:06.806505+0000","last_active":"2024-04-25T09:06:09.308192+0000","last_peered":"2024-04-25T09:06:09.308192+0000","last_clean":"2024-04-25T09:06:09.308192+0000","last_became_active":"2024-04-25T09:06:06.806247+0000","last_became_peered":"2024-04-25T09:06:06.806247+0000","last_unstale":"2024-04-25T09:06:09.308192+0000","last_undegraded":"2024-04-25T09:06:09.308192+0000","last_fullsized":"2024-04-25T09:06:09.308192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:13:11.435220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308554+0000","last_change":"2024-04-25T09:06:07.822064+0000","last_active":"2024-04-25T09:06:09.308554+0000","last_peered":"2024-04-25T09:06:09.308554+0000","last_clean":"2024-04-25T09:06:09.308554+0000","last_became_active":"2024-04-25T09:06:07.821759+0000","last_became_peered":"2024-04-25T09:06:07.821759+0000","last_unstale":"2024-04-25T09:06:09.308554+0000","last_undegraded":"2024-04-25T09:06:09.308554+0000","last_fullsized":"2024-04-25T09:06:09.308554+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:44.844356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.836375+0000","last_change":"2024-04-25T09:06:06.811017+0000","last_active":"2024-04-25T09:06:08.836375+0000","last_peered":"2024-04-25T09:06:08.836375+0000","last_clean":"2024-04-25T09:06:08.836375+0000","last_became_active":"2024-04-25T09:06:06.810754+0000","last_became_peered":"2024-04-25T09:06:06.810754+0000","last_unstale":"2024-04-25T09:06:08.836375+0000","last_undegraded":"2024-04-25T09:06:08.836375+0000","last_fullsized":"2024-04-25T09:06:08.836375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:01.800816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818683+0000","last_change":"2024-04-25T09:06:07.816329+0000","last_active":"2024-04-25T09:06:08.818683+0000","last_peered":"2024-04-25T09:06:08.818683+0000","last_clean":"2024-04-25T09:06:08.818683+0000","last_became_active":"2024-04-25T09:06:07.816119+0000","last_became_peered":"2024-04-25T09:06:07.816119+0000","last_unstale":"2024-04-25T09:06:08.818683+0000","last_undegraded":"2024-04-25T09:06:08.818683+0000","last_fullsized":"2024-04-25T09:06:08.818683+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:08:59.000976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308596+0000","last_change":"2024-04-25T09:06:06.803206+0000","last_active":"2024-04-25T09:06:09.308596+0000","last_peered":"2024-04-25T09:06:09.308596+0000","last_clean":"2024-04-25T09:06:09.308596+0000","last_became_active":"2024-04-25T09:06:06.802833+0000","last_became_peered":"2024-04-25T09:06:06.802833+0000","last_unstale":"2024-04-25T09:06:09.308596+0000","last_undegraded":"2024-04-25T09:06:09.308596+0000","last_fullsized":"2024-04-25T09:06:09.308596+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:02.050818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818865+0000","last_change":"2024-04-25T09:06:07.825756+0000","last_active":"2024-04-25T09:06:08.818865+0000","last_peered":"2024-04-25T09:06:08.818865+0000","last_clean":"2024-04-25T09:06:08.818865+0000","last_became_active":"2024-04-25T09:06:07.825435+0000","last_became_peered":"2024-04-25T09:06:07.825435+0000","last_unstale":"2024-04-25T09:06:08.818865+0000","last_undegraded":"2024-04-25T09:06:08.818865+0000","last_fullsized":"2024-04-25T09:06:08.818865+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:28:11.015197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:08.818242+0000","last_change":"2024-04-25T09:06:06.808770+0000","last_active":"2024-04-25T09:06:08.818242+0000","last_peered":"2024-04-25T09:06:08.818242+0000","last_clean":"2024-04-25T09:06:08.818242+0000","last_became_active":"2024-04-25T09:06:06.808438+0000","last_became_peered":"2024-04-25T09:06:06.808438+0000","last_unstale":"2024-04-25T09:06:08.818242+0000","last_undegraded":"2024-04-25T09:06:08.818242+0000","last_fullsized":"2024-04-25T09:06:08.818242+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:51.684270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":12,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.309035+0000","last_change":"2024-04-25T09:06:07.830796+0000","last_active":"2024-04-25T09:06:09.309035+0000","last_peered":"2024-04-25T09:06:09.309035+0000","last_clean":"2024-04-25T09:06:09.309035+0000","last_became_active":"2024-04-25T09:06:07.830464+0000","last_became_peered":"2024-04-25T09:06:07.830464+0000","last_unstale":"2024-04-25T09:06:09.309035+0000","last_undegraded":"2024-04-25T09:06:09.309035+0000","last_fullsized":"2024-04-25T09:06:09.309035+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:06.776548+0000","last_clean_scrub_stamp":"2024-04-25T09:06:06.776548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:28:17.868732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.210947+0000","last_change":"2024-04-25T09:06:06.805173+0000","last_active":"2024-04-25T09:06:09.210947+0000","last_peered":"2024-04-25T09:06:09.210947+0000","last_clean":"2024-04-25T09:06:09.210947+0000","last_became_active":"2024-04-25T09:06:06.804827+0000","last_became_peered":"2024-04-25T09:06:06.804827+0000","last_unstale":"2024-04-25T09:06:09.210947+0000","last_undegraded":"2024-04-25T09:06:09.210947+0000","last_fullsized":"2024-04-25T09:06:09.210947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:06:05.769499+0000","last_clean_scrub_stamp":"2024-04-25T09:06:05.769499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:42:39.811621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":281,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-25T09:06:09.308613+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:06:09.308613+0000","last_peered":"2024-04-25T09:06:09.308613+0000","last_clean":"2024-04-25T09:06:09.308613+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:06:09.308613+0000","last_undegraded":"2024-04-25T09:06:09.308613+0000","last_fullsized":"2024-04-25T09:06:09.308613+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574910,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":1039366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":978944,"data_stored":443896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":449010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":999424,"data_stored":450692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":983040,"data_stored":449558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":991232,"data_stored":449718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":442396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1572864,"data_stored":1039344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:06:12.311 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:06:12.311 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:06:12.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.505+0000 7f7829400640 1 Processor -- start 2024-04-25T09:06:12.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.505+0000 7f7829400640 1 -- start start 2024-04-25T09:06:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.505+0000 7f7829400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7824144120 0x7f782415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.505+0000 7f7829400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78240ccbf0 0x7f782415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.505+0000 7f7829400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782415bc40 con 0x7f782415ee60 2024-04-25T09:06:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.505+0000 7f7829400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782415e490 con 0x7f7824144120 2024-04-25T09:06:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.505+0000 7f7829400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782415b3a0 con 0x7f78240ccbf0 2024-04-25T09:06:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.505+0000 7f7822800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7824144120 0x7f782415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.505+0000 7f7822800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7824144120 0x7f782415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45654/0 (socket says 172.21.15.59:45654) 2024-04-25T09:06:12.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.505+0000 7f7822800640 1 -- 172.21.15.59:0/349919840 learned_addr learned my addr 172.21.15.59:0/349919840 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.505+0000 7f7819e00640 1 --2- 172.21.15.59:0/349919840 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78240ccbf0 0x7f782415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7822800640 1 -- 172.21.15.59:0/349919840 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78240ccbf0 msgr2=0x7f782415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7822800640 1 --2- 172.21.15.59:0/349919840 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78240ccbf0 0x7f782415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7822800640 1 -- 172.21.15.59:0/349919840 >> v1:172.21.15.59:6789/0 conn(0x7f782415ee60 legacy=0x7f78240b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7822800640 1 -- 172.21.15.59:0/349919840 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782415b680 con 0x7f7824144120 2024-04-25T09:06:12.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7822800640 1 --2- 172.21.15.59:0/349919840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824144120 0x7f782415acd0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7814009870 tx=0x7f781401e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e383a370a0b38b87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7821e00640 1 -- 172.21.15.59:0/349919840 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140ac650 con 0x7f7824144120 2024-04-25T09:06:12.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7821e00640 1 -- 172.21.15.59:0/349919840 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78140b1070 con 0x7f7824144120 2024-04-25T09:06:12.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7821e00640 1 -- 172.21.15.59:0/349919840 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140aca10 con 0x7f7824144120 2024-04-25T09:06:12.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7829400640 1 -- 172.21.15.59:0/349919840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824144120 msgr2=0x7f782415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7829400640 1 --2- 172.21.15.59:0/349919840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824144120 0x7f782415acd0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f7814009870 tx=0x7f781401e6e0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7829400640 1 -- 172.21.15.59:0/349919840 shutdown_connections 2024-04-25T09:06:12.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7829400640 1 --2- 172.21.15.59:0/349919840 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78240ccbf0 0x7f782415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7829400640 1 --2- 172.21.15.59:0/349919840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824144120 0x7f782415acd0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7829400640 1 -- 172.21.15.59:0/349919840 >> 172.21.15.59:0/349919840 conn(0x7f7824067080 msgr2=0x7f782406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7829400640 1 -- 172.21.15.59:0/349919840 shutdown_connections 2024-04-25T09:06:12.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.509+0000 7f7829400640 1 -- 172.21.15.59:0/349919840 wait complete. 2024-04-25T09:06:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7829400640 1 Processor -- start 2024-04-25T09:06:12.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7829400640 1 -- start start 2024-04-25T09:06:12.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7829400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78240ccbf0 0x7f782413d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7829400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824144120 0x7f782413f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7829400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f782415ee60 0x7f7824142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7829400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782406dc60 con 0x7f7824144120 2024-04-25T09:06:12.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7829400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782406dae0 con 0x7f782415ee60 2024-04-25T09:06:12.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7829400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782406dde0 con 0x7f78240ccbf0 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7819e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824144120 0x7f782413f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7819e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824144120 0x7f782413f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45670/0 (socket says 172.21.15.59:45670) 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7819e00640 1 -- 172.21.15.59:0/4009695499 learned_addr learned my addr 172.21.15.59:0/4009695499 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7822800640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78240ccbf0 0x7f782413d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7823200640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f782415ee60 0x7f7824142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7819e00640 1 -- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78240ccbf0 msgr2=0x7f782413d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7819e00640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78240ccbf0 0x7f782413d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7819e00640 1 -- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f782415ee60 msgr2=0x7f7824142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7819e00640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f782415ee60 0x7f7824142e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7819e00640 1 -- 172.21.15.59:0/4009695499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782413fa60 con 0x7f7824144120 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7823200640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f782415ee60 0x7f7824142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7819e00640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824144120 0x7f782413f520 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f780c00d800 tx=0x7f780c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f781b400640 1 -- 172.21.15.59:0/4009695499 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c00b660 con 0x7f7824144120 2024-04-25T09:06:12.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f781b400640 1 -- 172.21.15.59:0/4009695499 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780c019070 con 0x7f7824144120 2024-04-25T09:06:12.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7829400640 1 -- 172.21.15.59:0/4009695499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782413e480 con 0x7f7824144120 2024-04-25T09:06:12.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f781b400640 1 -- 172.21.15.59:0/4009695499 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780c00ba00 con 0x7f7824144120 2024-04-25T09:06:12.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.513+0000 7f7829400640 1 -- 172.21.15.59:0/4009695499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782413ea40 con 0x7f7824144120 2024-04-25T09:06:12.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.517+0000 7f7829400640 1 -- 172.21.15.59:0/4009695499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78240745d0 con 0x7f7824144120 2024-04-25T09:06:12.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.517+0000 7f781b400640 1 -- 172.21.15.59:0/4009695499 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f780c00bba0 con 0x7f7824144120 2024-04-25T09:06:12.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.517+0000 7f781b400640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7800066f60 0x7f7800069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.517+0000 7f781b400640 1 -- 172.21.15.59:0/4009695499 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f780c085630 con 0x7f7824144120 2024-04-25T09:06:12.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.517+0000 7f7822800640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7800066f60 0x7f7800069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.521+0000 7f7822800640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7800066f60 0x7f7800069420 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f78140b0000 tx=0x7f7814008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.521+0000 7f781b400640 1 -- 172.21.15.59:0/4009695499 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f780c0564a0 con 0x7f7824144120 2024-04-25T09:06:12.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.745+0000 7f7829400640 1 -- 172.21.15.59:0/4009695499 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f78241413c0 con 0x7f7824144120 2024-04-25T09:06:12.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f781b400640 1 -- 172.21.15.59:0/4009695499 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f780c055da0 con 0x7f7824144120 2024-04-25T09:06:12.741 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-04-25T09:06:12.741 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg== 2024-04-25T09:06:12.741 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-04-25T09:06:12.741 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-04-25T09:06:12.741 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:06:12.741 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-04-25T09:06:12.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f7829400640 1 -- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7800066f60 msgr2=0x7f7800069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f7829400640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7800066f60 0x7f7800069420 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f78140b0000 tx=0x7f7814008040 comp rx=0 tx=0).stop 2024-04-25T09:06:12.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f7829400640 1 -- 172.21.15.59:0/4009695499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824144120 msgr2=0x7f782413f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f7829400640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824144120 0x7f782413f520 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f780c00d800 tx=0x7f780c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f7829400640 1 -- 172.21.15.59:0/4009695499 shutdown_connections 2024-04-25T09:06:12.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f7829400640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7800066f60 0x7f7800069420 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f7829400640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f782415ee60 0x7f7824142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f7829400640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7824144120 0x7f782413f520 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f7829400640 1 --2- 172.21.15.59:0/4009695499 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f78240ccbf0 0x7f782413d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f7829400640 1 -- 172.21.15.59:0/4009695499 >> 172.21.15.59:0/4009695499 conn(0x7f7824067080 msgr2=0x7f782406e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f7829400640 1 -- 172.21.15.59:0/4009695499 shutdown_connections 2024-04-25T09:06:12.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.749+0000 7f7829400640 1 -- 172.21.15.59:0/4009695499 wait complete. 2024-04-25T09:06:12.758 INFO:tasks.ceph.mds.c.smithi059.stderr:2024-04-25T09:06:12.765+0000 7faf9fa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:06:12.764 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:12.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.913+0000 7f746b600640 1 Processor -- start 2024-04-25T09:06:12.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.913+0000 7f746b600640 1 -- start start 2024-04-25T09:06:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.913+0000 7f746b600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7464141d20 0x7f746415c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.913+0000 7f746b600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f74640acda0 0x7f74640ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.913+0000 7f746b600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746406e1e0 con 0x7f74640af140 2024-04-25T09:06:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.913+0000 7f746b600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746406ac10 con 0x7f7464141d20 2024-04-25T09:06:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.913+0000 7f746b600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746406ae60 con 0x7f74640acda0 2024-04-25T09:06:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.913+0000 7f7468c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7464141d20 0x7f746415c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.913+0000 7f745be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f74640af140 0x7f746406dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55096/0 (socket says 172.21.15.59:55096) 2024-04-25T09:06:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.913+0000 7f745be00640 1 -- 172.21.15.59:0/436690092 learned_addr learned my addr 172.21.15.59:0/436690092 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.913+0000 7f7469600640 1 --2- 172.21.15.59:0/436690092 >> v2:172.21.15.178:3300/0 conn(0x7f74640acda0 0x7f74640ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f7468c00640 1 -- 172.21.15.59:0/436690092 >> v2:172.21.15.178:3300/0 conn(0x7f74640acda0 msgr2=0x7f74640ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f7468c00640 1 --2- 172.21.15.59:0/436690092 >> v2:172.21.15.178:3300/0 conn(0x7f74640acda0 0x7f74640ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f7468c00640 1 -- 172.21.15.59:0/436690092 >> v1:172.21.15.59:6789/0 conn(0x7f74640af140 legacy=0x7f746406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f7468c00640 1 -- 172.21.15.59:0/436690092 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746406b140 con 0x7f7464141d20 2024-04-25T09:06:12.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f7463e00640 1 -- 172.21.15.59:0/436690092 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2644952735 0 0) 0x7f746406e1e0 con 0x7f74640af140 2024-04-25T09:06:12.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f7468c00640 1 --2- 172.21.15.59:0/436690092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7464141d20 0x7f746415c8a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f746409e0d0 tx=0x7f745401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168dc8af12ade85f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f7463e00640 1 -- 172.21.15.59:0/436690092 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74540b0070 con 0x7f7464141d20 2024-04-25T09:06:12.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f7463e00640 1 -- 172.21.15.59:0/436690092 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74540ab600 con 0x7f7464141d20 2024-04-25T09:06:12.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f7463e00640 1 -- 172.21.15.59:0/436690092 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74540ab9d0 con 0x7f7464141d20 2024-04-25T09:06:12.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f746b600640 1 -- 172.21.15.59:0/436690092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7464141d20 msgr2=0x7f746415c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f746b600640 1 --2- 172.21.15.59:0/436690092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7464141d20 0x7f746415c8a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f746409e0d0 tx=0x7f745401c3f0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f746b600640 1 -- 172.21.15.59:0/436690092 shutdown_connections 2024-04-25T09:06:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f746b600640 1 --2- 172.21.15.59:0/436690092 >> v2:172.21.15.178:3300/0 conn(0x7f74640acda0 0x7f74640ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f746b600640 1 --2- 172.21.15.59:0/436690092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7464141d20 0x7f746415c8a0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f746b600640 1 -- 172.21.15.59:0/436690092 >> 172.21.15.59:0/436690092 conn(0x7f74640b23b0 msgr2=0x7f74640cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f746b600640 1 -- 172.21.15.59:0/436690092 shutdown_connections 2024-04-25T09:06:12.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.917+0000 7f746b600640 1 -- 172.21.15.59:0/436690092 wait complete. 2024-04-25T09:06:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f746b600640 1 Processor -- start 2024-04-25T09:06:12.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f746b600640 1 -- start start 2024-04-25T09:06:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f746b600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74640acda0 0x7f7464140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f746b600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74640af140 0x7f7464144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f746b600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7464141d20 0x7f74640b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f746b600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74641688a0 con 0x7f74640acda0 2024-04-25T09:06:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f746b600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7464168720 con 0x7f7464141d20 2024-04-25T09:06:12.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f746b600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7464168a20 con 0x7f74640af140 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7468c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74640acda0 0x7f7464140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7468c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74640acda0 0x7f7464140280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45684/0 (socket says 172.21.15.59:45684) 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7468c00640 1 -- 172.21.15.59:0/234044550 learned_addr learned my addr 172.21.15.59:0/234044550 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f745be00640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74640af140 0x7f7464144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7469600640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7464141d20 0x7f74640b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7468c00640 1 -- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74640af140 msgr2=0x7f7464144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7468c00640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74640af140 0x7f7464144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7468c00640 1 -- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7464141d20 msgr2=0x7f74640b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7468c00640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7464141d20 0x7f74640b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7468c00640 1 -- 172.21.15.59:0/234044550 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7464164330 con 0x7f74640acda0 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7468c00640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74640acda0 0x7f7464140280 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f74540ae040 tx=0x7f745401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7461600640 1 -- 172.21.15.59:0/234044550 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74540b0050 con 0x7f74640acda0 2024-04-25T09:06:12.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7461600640 1 -- 172.21.15.59:0/234044550 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74540bc070 con 0x7f74640acda0 2024-04-25T09:06:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f7461600640 1 -- 172.21.15.59:0/234044550 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74540b5a70 con 0x7f74640acda0 2024-04-25T09:06:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f746b600640 1 -- 172.21.15.59:0/234044550 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7464143670 con 0x7f74640acda0 2024-04-25T09:06:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.921+0000 7f746b600640 1 -- 172.21.15.59:0/234044550 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7464143c30 con 0x7f74640acda0 2024-04-25T09:06:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.925+0000 7f746b600640 1 -- 172.21.15.59:0/234044550 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74640745d0 con 0x7f74640acda0 2024-04-25T09:06:12.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.925+0000 7f7461600640 1 -- 172.21.15.59:0/234044550 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f74540ab4c0 con 0x7f74640acda0 2024-04-25T09:06:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.925+0000 7f7461600640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7440066f60 0x7f7440069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.925+0000 7f7461600640 1 -- 172.21.15.59:0/234044550 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f745411fa30 con 0x7f74640acda0 2024-04-25T09:06:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.925+0000 7f745be00640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7440066f60 0x7f7440069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:12.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.925+0000 7f745be00640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7440066f60 0x7f7440069420 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f746406f2f0 tx=0x7f744c007b60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:12.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:12.929+0000 7f7461600640 1 -- 172.21.15.59:0/234044550 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7454016070 con 0x7f74640acda0 2024-04-25T09:06:13.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.125+0000 7f746b600640 1 -- 172.21.15.59:0/234044550 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7464145320 con 0x7f74640acda0 2024-04-25T09:06:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f7461600640 1 -- 172.21.15.59:0/234044550 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f74540f0940 con 0x7f74640acda0 2024-04-25T09:06:13.120 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:13.120 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":48,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:07.181212+0000","modified":"2024-04-25T09:06:10.221503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/1468235926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1468235926},{"type":"v1","addr":"172.21.15.59:6834","nonce":1468235926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:06:13.120 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 48 2024-04-25T09:06:13.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f746b600640 1 -- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7440066f60 msgr2=0x7f7440069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f746b600640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7440066f60 0x7f7440069420 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f746406f2f0 tx=0x7f744c007b60 comp rx=0 tx=0).stop 2024-04-25T09:06:13.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f746b600640 1 -- 172.21.15.59:0/234044550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74640acda0 msgr2=0x7f7464140280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f746b600640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74640acda0 0x7f7464140280 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f74540ae040 tx=0x7f745401ac30 comp rx=0 tx=0).stop 2024-04-25T09:06:13.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f746b600640 1 -- 172.21.15.59:0/234044550 shutdown_connections 2024-04-25T09:06:13.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f746b600640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7440066f60 0x7f7440069420 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f746b600640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7464141d20 0x7f74640b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f746b600640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f74640af140 0x7f7464144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f746b600640 1 --2- 172.21.15.59:0/234044550 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74640acda0 0x7f7464140280 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f746b600640 1 -- 172.21.15.59:0/234044550 >> 172.21.15.59:0/234044550 conn(0x7f74640b23b0 msgr2=0x7f746415d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f746b600640 1 -- 172.21.15.59:0/234044550 shutdown_connections 2024-04-25T09:06:13.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.129+0000 7f746b600640 1 -- 172.21.15.59:0/234044550 wait complete. 2024-04-25T09:06:13.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:06:07.181212+0000', 'modified': '2024-04-25T09:06:10.221503+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6786}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6786': {'gid': 6786, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6834/1468235926', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1468235926}, {'type': 'v1', 'addr': '172.21.15.59:6834', 'nonce': 1468235926}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:06:13.544 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:06:13.544 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:06:13.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f5852c00640 1 Processor -- start 2024-04-25T09:06:13.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f5852c00640 1 -- start start 2024-04-25T09:06:13.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f5852c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f584c15e770 0x7f584c15eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f5852c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c06db20 con 0x7f584c071270 2024-04-25T09:06:13.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f5852c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584c06de00 con 0x7f584c06d2d0 2024-04-25T09:06:13.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f5852c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c15f090 con 0x7f584c15e770 2024-04-25T09:06:13.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f5850c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f584c071270 0x7f584c0ae560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55098/0 (socket says 172.21.15.59:55098) 2024-04-25T09:06:13.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f5850c00640 1 -- 172.21.15.59:0/3219314478 learned_addr learned my addr 172.21.15.59:0/3219314478 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:13.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f584be00640 1 --2- 172.21.15.59:0/3219314478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f584c15e770 0x7f584c15eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f584b400640 1 -- 172.21.15.59:0/3219314478 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155007874 0 0) 0x7f584c06db20 con 0x7f584c071270 2024-04-25T09:06:13.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f584b400640 1 -- 172.21.15.59:0/3219314478 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5830003530 con 0x7f584c071270 2024-04-25T09:06:13.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f584b400640 1 -- 172.21.15.59:0/3219314478 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220108751 0 0) 0x7f584c06de00 con 0x7f584c06d2d0 2024-04-25T09:06:13.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f584b400640 1 -- 172.21.15.59:0/3219314478 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f584c06db20 con 0x7f584c06d2d0 2024-04-25T09:06:13.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f584be00640 1 -- 172.21.15.59:0/3219314478 >> v1:172.21.15.178:6789/0 conn(0x7f584c06d2d0 legacy=0x7f584c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f584be00640 1 -- 172.21.15.59:0/3219314478 >> v1:172.21.15.59:6789/0 conn(0x7f584c071270 legacy=0x7f584c0ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.697+0000 7f584be00640 1 -- 172.21.15.59:0/3219314478 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c06e0e0 con 0x7f584c15e770 2024-04-25T09:06:13.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.701+0000 7f584be00640 1 --2- 172.21.15.59:0/3219314478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f584c15e770 0x7f584c15eb50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f583c0097f0 tx=0x7f583c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b52519ec590b51c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.701+0000 7f584b400640 1 -- 172.21.15.59:0/3219314478 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c0b2070 con 0x7f584c15e770 2024-04-25T09:06:13.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.701+0000 7f584b400640 1 -- 172.21.15.59:0/3219314478 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c0a9070 con 0x7f584c15e770 2024-04-25T09:06:13.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.701+0000 7f584b400640 1 -- 172.21.15.59:0/3219314478 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c0ad880 con 0x7f584c15e770 2024-04-25T09:06:13.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.701+0000 7f5852c00640 1 -- 172.21.15.59:0/3219314478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f584c15e770 msgr2=0x7f584c15eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.701+0000 7f5852c00640 1 --2- 172.21.15.59:0/3219314478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f584c15e770 0x7f584c15eb50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f583c0097f0 tx=0x7f583c01c450 comp rx=0 tx=0).stop 2024-04-25T09:06:13.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.701+0000 7f5852c00640 1 -- 172.21.15.59:0/3219314478 shutdown_connections 2024-04-25T09:06:13.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.701+0000 7f5852c00640 1 --2- 172.21.15.59:0/3219314478 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f584c15e770 0x7f584c15eb50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.701+0000 7f5852c00640 1 -- 172.21.15.59:0/3219314478 >> 172.21.15.59:0/3219314478 conn(0x7f584c067080 msgr2=0x7f584c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.701+0000 7f5852c00640 1 -- 172.21.15.59:0/3219314478 shutdown_connections 2024-04-25T09:06:13.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.701+0000 7f5852c00640 1 -- 172.21.15.59:0/3219314478 wait complete. 2024-04-25T09:06:13.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5852c00640 1 Processor -- start 2024-04-25T09:06:13.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5852c00640 1 -- start start 2024-04-25T09:06:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5852c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f584c06d2d0 0x7f584c162e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5852c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f584c071270 0x7f584c0b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5852c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f584c15e770 0x7f584c13cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5852c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c06d830 con 0x7f584c15e770 2024-04-25T09:06:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5852c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c06d6b0 con 0x7f584c06d2d0 2024-04-25T09:06:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5852c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c16c220 con 0x7f584c071270 2024-04-25T09:06:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5850c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f584c15e770 0x7f584c13cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5850c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f584c15e770 0x7f584c13cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45694/0 (socket says 172.21.15.59:45694) 2024-04-25T09:06:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f584be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f584c06d2d0 0x7f584c162e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5850c00640 1 -- 172.21.15.59:0/444009242 learned_addr learned my addr 172.21.15.59:0/444009242 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:13.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5843e00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f584c071270 0x7f584c0b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5850c00640 1 -- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f584c071270 msgr2=0x7f584c0b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5850c00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f584c071270 0x7f584c0b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5850c00640 1 -- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f584c06d2d0 msgr2=0x7f584c162e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5850c00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f584c06d2d0 0x7f584c162e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5850c00640 1 -- 172.21.15.59:0/444009242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584c0b1130 con 0x7f584c15e770 2024-04-25T09:06:13.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5850c00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f584c15e770 0x7f584c13cf00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f584400cb40 tx=0x7f584400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5848c00640 1 -- 172.21.15.59:0/444009242 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844017070 con 0x7f584c15e770 2024-04-25T09:06:13.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5848c00640 1 -- 172.21.15.59:0/444009242 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584400aca0 con 0x7f584c15e770 2024-04-25T09:06:13.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5852c00640 1 -- 172.21.15.59:0/444009242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f584c13d990 con 0x7f584c15e770 2024-04-25T09:06:13.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5848c00640 1 -- 172.21.15.59:0/444009242 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844012600 con 0x7f584c15e770 2024-04-25T09:06:13.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.705+0000 7f5852c00640 1 -- 172.21.15.59:0/444009242 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f584c13df50 con 0x7f584c15e770 2024-04-25T09:06:13.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f5848c00640 1 -- 172.21.15.59:0/444009242 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f584401a070 con 0x7f584c15e770 2024-04-25T09:06:13.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f5848c00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5828066f90 0x7f5828069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f5848c00640 1 -- 172.21.15.59:0/444009242 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5844084eb0 con 0x7f584c15e770 2024-04-25T09:06:13.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f5856098000 1 Processor -- start 2024-04-25T09:06:13.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f584be00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5828066f90 0x7f5828069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f5856098000 1 -- start start 2024-04-25T09:06:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f584be00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5828066f90 0x7f5828069450 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f583c0af000 tx=0x7f583c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f5856098000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ebabd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f5856098000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99ebac240 0x55f99eb619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f5856098000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb61f30 0x55f99eb62310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f5856098000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f99ea495f0 con 0x55f99ebab920 2024-04-25T09:06:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f5856098000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f99e9b0da0 con 0x55f99eb61f30 2024-04-25T09:06:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f5856098000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f99e939150 con 0x55f99ebac240 2024-04-25T09:06:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f584be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ebabd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f584be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ebabd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45704/0 (socket says 172.21.15.59:45704) 2024-04-25T09:06:13.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.709+0000 7f584be00640 1 -- 172.21.15.59:0/2409789545 learned_addr learned my addr 172.21.15.59:0/2409789545 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5850c00640 1 --2- 172.21.15.59:0/2409789545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb61f30 0x55f99eb62310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5843e00640 1 --2- 172.21.15.59:0/2409789545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99ebac240 0x55f99eb619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f584be00640 1 -- 172.21.15.59:0/2409789545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99ebac240 msgr2=0x55f99eb619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f584be00640 1 --2- 172.21.15.59:0/2409789545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99ebac240 0x55f99eb619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f584be00640 1 -- 172.21.15.59:0/2409789545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb61f30 msgr2=0x55f99eb62310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f584be00640 1 --2- 172.21.15.59:0/2409789545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb61f30 0x55f99eb62310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f584be00640 1 -- 172.21.15.59:0/2409789545 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f99e952ca0 con 0x55f99ebab920 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5850c00640 1 --2- 172.21.15.59:0/2409789545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb61f30 0x55f99eb62310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5843e00640 1 --2- 172.21.15.59:0/2409789545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99ebac240 0x55f99eb619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f584be00640 1 --2- 172.21.15.59:0/2409789545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ebabd00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f583c097e30 tx=0x7f583c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d7731cfc2f7363 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5840c00640 1 -- 172.21.15.59:0/2409789545 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c0bd070 con 0x55f99ebab920 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5840c00640 1 -- 172.21.15.59:0/2409789545 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c0adaf0 con 0x55f99ebab920 2024-04-25T09:06:13.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5840c00640 1 -- 172.21.15.59:0/2409789545 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c0b2040 con 0x55f99ebab920 2024-04-25T09:06:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 -- 172.21.15.59:0/2409789545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 msgr2=0x55f99ebabd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 --2- 172.21.15.59:0/2409789545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ebabd00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f583c097e30 tx=0x7f583c004740 comp rx=0 tx=0).stop 2024-04-25T09:06:13.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 -- 172.21.15.59:0/2409789545 shutdown_connections 2024-04-25T09:06:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 --2- 172.21.15.59:0/2409789545 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb61f30 0x55f99eb62310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 --2- 172.21.15.59:0/2409789545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99ebac240 0x55f99eb619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 --2- 172.21.15.59:0/2409789545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ebabd00 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 -- 172.21.15.59:0/2409789545 >> 172.21.15.59:0/2409789545 conn(0x55f99eb682a0 msgr2=0x55f99eb602d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 -- 172.21.15.59:0/2409789545 shutdown_connections 2024-04-25T09:06:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 -- 172.21.15.59:0/2409789545 wait complete. 2024-04-25T09:06:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 -- start start 2024-04-25T09:06:13.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 Processor -- start 2024-04-25T09:06:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99eb61f30 0x55f99ebb2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99ebab920 0x55f99ebb32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99ebac240 0x55f99eb65aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f99e96b990 con 0x55f99eb61f30 2024-04-25T09:06:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f99e9ace40 con 0x55f99ebab920 2024-04-25T09:06:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f99e93c900 con 0x55f99ebac240 2024-04-25T09:06:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5856098000 10 client.0 _ll_register_callbacks cb 0x55f99ea641c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f584be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99eb61f30 0x55f99ebb2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f584be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99eb61f30 0x55f99ebb2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45706/0 (socket says 172.21.15.59:45706) 2024-04-25T09:06:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f584be00640 1 -- 172.21.15.59:0/2229765758 learned_addr learned my addr 172.21.15.59:0/2229765758 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:13.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5843e00640 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99ebab920 0x55f99ebb32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f5850c00640 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99ebac240 0x55f99eb65aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.713+0000 7f584be00640 1 -- 172.21.15.59:0/2229765758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99ebac240 msgr2=0x55f99eb65aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f584be00640 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99ebac240 0x55f99eb65aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f584be00640 1 -- 172.21.15.59:0/2229765758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99ebab920 msgr2=0x55f99ebb32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f584be00640 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99ebab920 0x55f99ebb32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f584be00640 1 -- 172.21.15.59:0/2229765758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f99e969630 con 0x55f99eb61f30 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5850c00640 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99ebac240 0x55f99eb65aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5843e00640 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99ebab920 0x55f99ebb32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f584be00640 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99eb61f30 0x55f99ebb2d60 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f583c01c930 tx=0x7f583c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ac03162b50f16a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5839600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5839600640 1 -- 172.21.15.59:0/2229765758 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583c0bd030 con 0x55f99eb61f30 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5839600640 1 -- 172.21.15.59:0/2229765758 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f583c0d7c80 con 0x55f99eb61f30 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 -- 172.21.15.59:0/2229765758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f583c0adaf0 con 0x55f99eb61f30 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5839600640 1 -- 172.21.15.59:0/2229765758 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f583c0de050 con 0x55f99eb61f30 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 10 client.6942 fetch_fsmap learned FSMap version 48 2024-04-25T09:06:13.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 -- 172.21.15.59:0/2229765758 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x55f99e9393a0 con 0x55f99eb61f30 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5839600640 1 -- 172.21.15.59:0/2229765758 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583c0adaf0 con 0x55f99eb61f30 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5839600640 1 -- 172.21.15.59:0/2229765758 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 48) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f583c0e1020 con 0x55f99eb61f30 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 10 client.6942 fetch_fsmap finished waiting for FSMap version 48 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 10 client.6942 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 20 client.6942 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.59:6832/1468235926,v1:172.21.15.59:6834/1468235926] conn(0x55f99eb664b0 0x55f99eb66890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 4 client.6942 mds_command: new command op to 6786 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 -- 172.21.15.59:0/2229765758 --> [v2:172.21.15.59:6832/1468235926,v1:172.21.15.59:6834/1468235926] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f99e94ca50 con 0x55f99eb664b0 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5843e00640 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.59:6832/1468235926,v1:172.21.15.59:6834/1468235926] conn(0x55f99eb664b0 0x55f99eb66890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5843e00640 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.59:6832/1468235926,v1:172.21.15.59:6834/1468235926] conn(0x55f99eb664b0 0x55f99eb66890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af3b362473d514fc server_cookie=818291033ff4c441 in_seq=0 out_seq=0 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5839600640 10 client.6942 ms_handle_connect on v2:172.21.15.59:6832/1468235926 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5839600640 1 -- 172.21.15.59:0/2229765758 <== mds.0 v2:172.21.15.59:6832/1468235926 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55f99e94ca50 con 0x55f99eb664b0 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5839600640 10 client.6942 handle_command_reply: tid=0 2024-04-25T09:06:13.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 client.6942 shutdown 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 -- 172.21.15.59:0/2229765758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99eb61f30 msgr2=0x55f99ebb2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99eb61f30 0x55f99ebb2d60 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f583c01c930 tx=0x7f583c01ac90 comp rx=0 tx=0).stop 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 -- 172.21.15.59:0/2229765758 shutdown_connections 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.59:6832/1468235926,v1:172.21.15.59:6834/1468235926] conn(0x55f99eb664b0 0x55f99eb66890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99ebac240 0x55f99eb65aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99ebab920 0x55f99ebb32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 --2- 172.21.15.59:0/2229765758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99eb61f30 0x55f99ebb2d60 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5839600640 0 client.6942 ms_handle_reset on v2:172.21.15.59:6832/1468235926 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 -- 172.21.15.59:0/2229765758 >> 172.21.15.59:0/2229765758 conn(0x55f99eb682a0 msgr2=0x55f99eb609e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 -- 172.21.15.59:0/2229765758 shutdown_connections 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 1 -- 172.21.15.59:0/2229765758 wait complete. 2024-04-25T09:06:13.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.717+0000 7f5856098000 20 client.6942 trim_cache size 0 max 16384 2024-04-25T09:06:13.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.733+0000 7f5856098000 1 Processor -- start 2024-04-25T09:06:13.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.733+0000 7f5856098000 1 -- start start 2024-04-25T09:06:13.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb682a0 0x55f99ec070b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99eb61f30 0x55f99ec075f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ec07b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c2029e0 con 0x55f99ebab920 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584c1405a0 con 0x55f99eb682a0 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584c13f340 con 0x55f99eb61f30 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5850c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ec07b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5850c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ec07b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45722/0 (socket says 172.21.15.59:45722) 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5850c00640 1 -- 172.21.15.59:0/1463260886 learned_addr learned my addr 172.21.15.59:0/1463260886 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5843e00640 1 --2- 172.21.15.59:0/1463260886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99eb61f30 0x55f99ec075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f584be00640 1 --2- 172.21.15.59:0/1463260886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb682a0 0x55f99ec070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5850c00640 1 -- 172.21.15.59:0/1463260886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99eb61f30 msgr2=0x55f99ec075f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5850c00640 1 --2- 172.21.15.59:0/1463260886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99eb61f30 0x55f99ec075f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5850c00640 1 -- 172.21.15.59:0/1463260886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb682a0 msgr2=0x55f99ec070b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5850c00640 1 --2- 172.21.15.59:0/1463260886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb682a0 0x55f99ec070b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5850c00640 1 -- 172.21.15.59:0/1463260886 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f99ea32600 con 0x55f99ebab920 2024-04-25T09:06:13.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5843e00640 1 --2- 172.21.15.59:0/1463260886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99eb61f30 0x55f99ec075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:13.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5850c00640 1 --2- 172.21.15.59:0/1463260886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ec07b30 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f584400a560 tx=0x7f5844055790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4c1e5eeb8dd15a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f583be00640 1 -- 172.21.15.59:0/1463260886 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584406d020 con 0x55f99ebab920 2024-04-25T09:06:13.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f583be00640 1 -- 172.21.15.59:0/1463260886 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58440539d0 con 0x55f99ebab920 2024-04-25T09:06:13.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f583be00640 1 -- 172.21.15.59:0/1463260886 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584405d8a0 con 0x55f99ebab920 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 -- 172.21.15.59:0/1463260886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 msgr2=0x55f99ec07b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 --2- 172.21.15.59:0/1463260886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ec07b30 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f584400a560 tx=0x7f5844055790 comp rx=0 tx=0).stop 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 -- 172.21.15.59:0/1463260886 shutdown_connections 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 --2- 172.21.15.59:0/1463260886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ec07b30 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 --2- 172.21.15.59:0/1463260886 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99eb61f30 0x55f99ec075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 --2- 172.21.15.59:0/1463260886 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb682a0 0x55f99ec070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 -- 172.21.15.59:0/1463260886 >> 172.21.15.59:0/1463260886 conn(0x55f99ebab050 msgr2=0x55f99eb65470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 -- 172.21.15.59:0/1463260886 shutdown_connections 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 -- 172.21.15.59:0/1463260886 wait complete. 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 -- start start 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 Processor -- start 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb61f30 0x55f99ebb8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99eb682a0 0x55f99ec0c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ec0c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f99e9b53d0 con 0x55f99ebab920 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f99ea6cd50 con 0x55f99eb61f30 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.737+0000 7f5856098000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f99e94b980 con 0x55f99eb682a0 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 10 client.0 _ll_register_callbacks cb 0x7f5830003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5850c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ec0c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5850c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ec0c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45728/0 (socket says 172.21.15.59:45728) 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5850c00640 1 -- 172.21.15.59:0/1428863823 learned_addr learned my addr 172.21.15.59:0/1428863823 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f584be00640 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb61f30 0x55f99ebb8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5843e00640 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99eb682a0 0x55f99ec0c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5850c00640 1 -- 172.21.15.59:0/1428863823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99eb682a0 msgr2=0x55f99ec0c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5850c00640 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99eb682a0 0x55f99ec0c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5850c00640 1 -- 172.21.15.59:0/1428863823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb61f30 msgr2=0x55f99ebb8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5850c00640 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb61f30 0x55f99ebb8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5850c00640 1 -- 172.21.15.59:0/1428863823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f99e9459b0 con 0x55f99ebab920 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5850c00640 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ec0c6f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f5844083210 tx=0x7f5844001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcf183feb468740 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5839600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5839600640 1 -- 172.21.15.59:0/1428863823 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5844073060 con 0x55f99ebab920 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5839600640 1 -- 172.21.15.59:0/1428863823 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f584405daa0 con 0x55f99ebab920 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 -- 172.21.15.59:0/1428863823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58440539d0 con 0x55f99ebab920 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5839600640 1 -- 172.21.15.59:0/1428863823 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f584407cba0 con 0x55f99ebab920 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 10 client.6948 fetch_fsmap learned FSMap version 48 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 -- 172.21.15.59:0/1428863823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x55f99e9580b0 con 0x55f99ebab920 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5839600640 1 -- 172.21.15.59:0/1428863823 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58440539d0 con 0x55f99ebab920 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5839600640 1 -- 172.21.15.59:0/1428863823 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 48) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5844004b70 con 0x55f99ebab920 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 10 client.6948 fetch_fsmap finished waiting for FSMap version 48 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 10 client.6948 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 20 client.6948 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.59:6832/1468235926,v1:172.21.15.59:6834/1468235926] conn(0x55f99ebac240 0x55f99ec0cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 4 client.6948 mds_command: new command op to 6786 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:06:13.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 -- 172.21.15.59:0/1428863823 --> [v2:172.21.15.59:6832/1468235926,v1:172.21.15.59:6834/1468235926] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f99e9be2e0 con 0x55f99ebac240 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f584be00640 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.59:6832/1468235926,v1:172.21.15.59:6834/1468235926] conn(0x55f99ebac240 0x55f99ec0cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f584be00640 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.59:6832/1468235926,v1:172.21.15.59:6834/1468235926] conn(0x55f99ebac240 0x55f99ec0cc30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5acf77ffea6213bf server_cookie=9b37757bbf28d49a in_seq=0 out_seq=0 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5839600640 10 client.6948 ms_handle_connect on v2:172.21.15.59:6832/1468235926 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5839600640 1 -- 172.21.15.59:0/1428863823 <== mds.0 v2:172.21.15.59:6832/1468235926 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f99e9be2e0 con 0x55f99ebac240 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5839600640 10 client.6948 handle_command_reply: tid=0 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 client.6948 shutdown 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 -- 172.21.15.59:0/1428863823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 msgr2=0x55f99ec0c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ec0c6f0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f5844083210 tx=0x7f5844001260 comp rx=0 tx=0).stop 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 -- 172.21.15.59:0/1428863823 shutdown_connections 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55f99ebab920 0x55f99ec0c6f0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.59:6832/1468235926,v1:172.21.15.59:6834/1468235926] conn(0x55f99ebac240 0x55f99ec0cc30 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55f99eb682a0 0x55f99ec0c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 --2- 172.21.15.59:0/1428863823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55f99eb61f30 0x55f99ebb8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5839600640 0 client.6948 ms_handle_reset on v2:172.21.15.59:6832/1468235926 2024-04-25T09:06:13.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 -- 172.21.15.59:0/1428863823 >> 172.21.15.59:0/1428863823 conn(0x55f99ebab050 msgr2=0x55f99ebb3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 -- 172.21.15.59:0/1428863823 shutdown_connections 2024-04-25T09:06:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 1 -- 172.21.15.59:0/1428863823 wait complete. 2024-04-25T09:06:13.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5856098000 20 client.6948 trim_cache size 0 max 16384 2024-04-25T09:06:13.738 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:06:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:06:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:06:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6786, 2024-04-25T09:06:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:06:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:06:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:06:13.738 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 5.9401744159999996, 2024-04-25T09:06:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 48, 2024-04-25T09:06:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 80, 2024-04-25T09:06:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 80, 2024-04-25T09:06:13.739 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 11.771135105000001 2024-04-25T09:06:13.739 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:06:13.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5852c00640 1 -- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5828066f90 msgr2=0x7f5828069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5852c00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5828066f90 0x7f5828069450 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f583c0af000 tx=0x7f583c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5852c00640 1 -- 172.21.15.59:0/444009242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f584c15e770 msgr2=0x7f584c13cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5852c00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f584c15e770 0x7f584c13cf00 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f584400cb40 tx=0x7f584400a060 comp rx=0 tx=0).stop 2024-04-25T09:06:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5852c00640 1 -- 172.21.15.59:0/444009242 shutdown_connections 2024-04-25T09:06:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5852c00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5828066f90 0x7f5828069450 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5852c00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f584c15e770 0x7f584c13cf00 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5852c00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f584c071270 0x7f584c0b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5852c00640 1 --2- 172.21.15.59:0/444009242 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f584c06d2d0 0x7f584c162e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.741+0000 7f5852c00640 1 -- 172.21.15.59:0/444009242 >> 172.21.15.59:0/444009242 conn(0x7f584c067080 msgr2=0x7f584c15d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.745+0000 7f5852c00640 1 -- 172.21.15.59:0/444009242 shutdown_connections 2024-04-25T09:06:13.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.745+0000 7f5852c00640 1 -- 172.21.15.59:0/444009242 wait complete. 2024-04-25T09:06:13.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:06:13.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9f05a00640 1 Processor -- start 2024-04-25T09:06:13.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9f05a00640 1 -- start start 2024-04-25T09:06:13.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9f05a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f00144140 0x7f9f000ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9f05a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f000ced60 0x7f9f0006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9f05a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f0015ac60 con 0x7f9f0006e900 2024-04-25T09:06:13.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9f05a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f0006ed70 con 0x7f9f00144140 2024-04-25T09:06:13.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9f05a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f000cf3e0 con 0x7f9f000ced60 2024-04-25T09:06:13.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9efea00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f00144140 0x7f9f000ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9efea00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f00144140 0x7f9f000ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:42386/0 (socket says 172.21.15.59:42386) 2024-04-25T09:06:13.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9efea00640 1 -- 172.21.15.59:0/2271838083 learned_addr learned my addr 172.21.15.59:0/2271838083 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:13.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9eff400640 1 --1- 172.21.15.59:0/2271838083 >> v1:172.21.15.178:6789/0 conn(0x7f9f0006e900 0x7f9f0015e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:53684/0 (socket says 172.21.15.59:53684) 2024-04-25T09:06:13.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9ef7e00640 1 --2- 172.21.15.59:0/2271838083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f000ced60 0x7f9f0006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9efea00640 1 -- 172.21.15.59:0/2271838083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f000ced60 msgr2=0x7f9f0006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:13.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9efea00640 1 --2- 172.21.15.59:0/2271838083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f000ced60 0x7f9f0006e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9efea00640 1 -- 172.21.15.59:0/2271838083 >> v1:172.21.15.178:6789/0 conn(0x7f9f0006e900 legacy=0x7f9f0015e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9efea00640 1 -- 172.21.15.59:0/2271838083 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0015af20 con 0x7f9f00144140 2024-04-25T09:06:13.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9ef7e00640 1 --2- 172.21.15.59:0/2271838083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f000ced60 0x7f9f0006e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:13.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.905+0000 7f9efe000640 1 -- 172.21.15.59:0/2271838083 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267869835 0 0) 0x7f9f0015ac60 con 0x7f9f0006e900 2024-04-25T09:06:13.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.909+0000 7f9efea00640 1 --2- 172.21.15.59:0/2271838083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f00144140 0x7f9f000ce820 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9ef000bb10 tx=0x7f9ef001ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=829c8b4a5c8972e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.909+0000 7f9efe000640 1 -- 172.21.15.59:0/2271838083 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef00b4070 con 0x7f9f00144140 2024-04-25T09:06:13.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.909+0000 7f9efe000640 1 -- 172.21.15.59:0/2271838083 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef00a7a20 con 0x7f9f00144140 2024-04-25T09:06:13.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.909+0000 7f9efe000640 1 -- 172.21.15.59:0/2271838083 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef00a7df0 con 0x7f9f00144140 2024-04-25T09:06:13.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.909+0000 7f9f05a00640 1 -- 172.21.15.59:0/2271838083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f00144140 msgr2=0x7f9f000ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.909+0000 7f9f05a00640 1 --2- 172.21.15.59:0/2271838083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f00144140 0x7f9f000ce820 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9ef000bb10 tx=0x7f9ef001ec30 comp rx=0 tx=0).stop 2024-04-25T09:06:13.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.909+0000 7f9f05a00640 1 -- 172.21.15.59:0/2271838083 shutdown_connections 2024-04-25T09:06:13.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.909+0000 7f9f05a00640 1 --2- 172.21.15.59:0/2271838083 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f000ced60 0x7f9f0006e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.909+0000 7f9f05a00640 1 --2- 172.21.15.59:0/2271838083 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f00144140 0x7f9f000ce820 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.909+0000 7f9f05a00640 1 -- 172.21.15.59:0/2271838083 >> 172.21.15.59:0/2271838083 conn(0x7f9f00066fa0 msgr2=0x7f9f0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:13.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.909+0000 7f9f05a00640 1 -- 172.21.15.59:0/2271838083 shutdown_connections 2024-04-25T09:06:13.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.909+0000 7f9f05a00640 1 -- 172.21.15.59:0/2271838083 wait complete. 2024-04-25T09:06:13.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9f05a00640 1 Processor -- start 2024-04-25T09:06:13.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9f05a00640 1 -- start start 2024-04-25T09:06:13.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9f05a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f0006e900 0x7f9f00129040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9f05a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f000ced60 0x7f9f0013c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9f05a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00144140 0x7f9f00127630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9f05a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f00144520 con 0x7f9f00144140 2024-04-25T09:06:13.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9f05a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f000cf140 con 0x7f9f0006e900 2024-04-25T09:06:13.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9f05a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0015ba00 con 0x7f9f000ced60 2024-04-25T09:06:13.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9eff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00144140 0x7f9f00127630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9eff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00144140 0x7f9f00127630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45732/0 (socket says 172.21.15.59:45732) 2024-04-25T09:06:13.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9eff400640 1 -- 172.21.15.59:0/839503731 learned_addr learned my addr 172.21.15.59:0/839503731 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:13.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9efea00640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f0006e900 0x7f9f00129040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9ef7e00640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f000ced60 0x7f9f0013c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9eff400640 1 -- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f000ced60 msgr2=0x7f9f0013c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9eff400640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f000ced60 0x7f9f0013c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9eff400640 1 -- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f0006e900 msgr2=0x7f9f00129040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:13.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9eff400640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f0006e900 0x7f9f00129040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:13.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9eff400640 1 -- 172.21.15.59:0/839503731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f00127fa0 con 0x7f9f00144140 2024-04-25T09:06:13.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9ef7e00640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f000ced60 0x7f9f0013c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:13.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9eff400640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00144140 0x7f9f00127630 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800c7a0 tx=0x7f9ef800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9ef6a00640 1 -- 172.21.15.59:0/839503731 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8018070 con 0x7f9f00144140 2024-04-25T09:06:13.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9ef6a00640 1 -- 172.21.15.59:0/839503731 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef800a640 con 0x7f9f00144140 2024-04-25T09:06:13.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9ef6a00640 1 -- 172.21.15.59:0/839503731 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef800aab0 con 0x7f9f00144140 2024-04-25T09:06:13.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9f05a00640 1 -- 172.21.15.59:0/839503731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f00128280 con 0x7f9f00144140 2024-04-25T09:06:13.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.913+0000 7f9f05a00640 1 -- 172.21.15.59:0/839503731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f00128b20 con 0x7f9f00144140 2024-04-25T09:06:13.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.917+0000 7f9f05a00640 1 -- 172.21.15.59:0/839503731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f000745d0 con 0x7f9f00144140 2024-04-25T09:06:13.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.917+0000 7f9ef6a00640 1 -- 172.21.15.59:0/839503731 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ef801b070 con 0x7f9f00144140 2024-04-25T09:06:13.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.917+0000 7f9ef6a00640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9edc066f60 0x7f9edc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:13.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.917+0000 7f9ef6a00640 1 -- 172.21.15.59:0/839503731 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9ef8084800 con 0x7f9f00144140 2024-04-25T09:06:13.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.917+0000 7f9efea00640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9edc066f60 0x7f9edc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:13.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.917+0000 7f9efea00640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9edc066f60 0x7f9edc069420 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00b1000 tx=0x7f9ef00a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:13.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:13.921+0000 7f9ef6a00640 1 -- 172.21.15.59:0/839503731 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ef8054f90 con 0x7f9f00144140 2024-04-25T09:06:14.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.117+0000 7f9f05a00640 1 -- 172.21.15.59:0/839503731 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9f00128cf0 con 0x7f9f00144140 2024-04-25T09:06:14.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.117+0000 7f9ef6a00640 1 -- 172.21.15.59:0/839503731 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9ef8059030 con 0x7f9f00144140 2024-04-25T09:06:14.111 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:06:14.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.121+0000 7f9f05a00640 1 -- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9edc066f60 msgr2=0x7f9edc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.121+0000 7f9f05a00640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9edc066f60 0x7f9edc069420 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00b1000 tx=0x7f9ef00a9070 comp rx=0 tx=0).stop 2024-04-25T09:06:14.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.121+0000 7f9f05a00640 1 -- 172.21.15.59:0/839503731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00144140 msgr2=0x7f9f00127630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:14.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.121+0000 7f9f05a00640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00144140 0x7f9f00127630 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f9ef800c7a0 tx=0x7f9ef800cc60 comp rx=0 tx=0).stop 2024-04-25T09:06:14.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.121+0000 7f9f05a00640 1 -- 172.21.15.59:0/839503731 shutdown_connections 2024-04-25T09:06:14.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.121+0000 7f9f05a00640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9edc066f60 0x7f9edc069420 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.121+0000 7f9f05a00640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f00144140 0x7f9f00127630 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.121+0000 7f9f05a00640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f000ced60 0x7f9f0013c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.121+0000 7f9f05a00640 1 --2- 172.21.15.59:0/839503731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f0006e900 0x7f9f00129040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:14.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.121+0000 7f9f05a00640 1 -- 172.21.15.59:0/839503731 >> 172.21.15.59:0/839503731 conn(0x7f9f00066fa0 msgr2=0x7f9f000b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:14.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.121+0000 7f9f05a00640 1 -- 172.21.15.59:0/839503731 shutdown_connections 2024-04-25T09:06:14.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:14.121+0000 7f9f05a00640 1 -- 172.21.15.59:0/839503731 wait complete. 2024-04-25T09:06:14.131 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:06:14.131 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:06:14.131 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:06:14.131 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:06:14.131 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:14.132 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:06:14.132 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:06:14.132 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:06:14.132 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:14.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:14.132 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:06:14.141 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:06:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:06:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:06:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:06:14.141 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:14.141 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42193sec preferred_lft 42193sec 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:14.142 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:06:14.143 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:06:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:06:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:14.144 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:06:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:06:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:06:14.144 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:14.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:14.145 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:06:14.209 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:06:14.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:14.211 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:06:14.268 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:06:14.268 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:06:14.268 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:06:14.268 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:06:14.268 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:06:14.269 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:06:14.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:14.269 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:06:14.269 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:06:14.269 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:06:14.269 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:06:14.269 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:06:14.269 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:06:14.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:14.361 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:06:14.370 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:06:14.370 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:06:14.371 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:14.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:14.372 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:06:14.439 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:06:14.439 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:14.491 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:14.491 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:06:14.491 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:14.547 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:06:14.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:14.547 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:14.637 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:14.638 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:14.638 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:06:14.652 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:14.652 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:14.652 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:06:14.652 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:06:14.652 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:06:14.661 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:06:14.664 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:06:14.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:14.665 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:14.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:14.685 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:06:14.744 INFO:teuthology.orchestra.run.smithi059.stdout:client6954 2024-04-25T09:06:14.745 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:06:14.745 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:14.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:14.800 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-04-25T09:06:14.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:14.862 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-04-25T09:06:14.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:14.913 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-04-25T09:06:14.964 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:06:14.964 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:06:14.964 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:06:14.964 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:06:14.964 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-04-25T09:06:14.964 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:06:15.073 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627776 2024-04-25T09:06:15.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:06:15.082 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:06:15.082 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:15.132 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:06:15.132 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:15.183 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.373+0000 7f6185400640 1 Processor -- start 2024-04-25T09:06:15.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.373+0000 7f6185400640 1 -- start start 2024-04-25T09:06:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6185400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f618015da10 0x7f61800afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6185400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61800d11b0 0x7f618006ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6185400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800b4210 0x7f61800b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6185400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61800b4ba0 con 0x7f61800d11b0 2024-04-25T09:06:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6185400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618015ddf0 con 0x7f618015da10 2024-04-25T09:06:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6185400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618006b480 con 0x7f61800b4210 2024-04-25T09:06:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6175e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61800d11b0 0x7f618006ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6175e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61800d11b0 0x7f618006ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45738/0 (socket says 172.21.15.59:45738) 2024-04-25T09:06:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6175e00640 1 -- 172.21.15.59:0/3796415567 learned_addr learned my addr 172.21.15.59:0/3796415567 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f617e800640 1 --2- 172.21.15.59:0/3796415567 >> v2:172.21.15.178:3300/0 conn(0x7f618015da10 0x7f61800afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f617f200640 1 --2- 172.21.15.59:0/3796415567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800b4210 0x7f61800b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6175e00640 1 -- 172.21.15.59:0/3796415567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800b4210 msgr2=0x7f61800b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6175e00640 1 --2- 172.21.15.59:0/3796415567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800b4210 0x7f61800b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6175e00640 1 -- 172.21.15.59:0/3796415567 >> v2:172.21.15.178:3300/0 conn(0x7f618015da10 msgr2=0x7f61800afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6175e00640 1 --2- 172.21.15.59:0/3796415567 >> v2:172.21.15.178:3300/0 conn(0x7f618015da10 0x7f61800afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.377+0000 7f6175e00640 1 -- 172.21.15.59:0/3796415567 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61800d06d0 con 0x7f61800d11b0 2024-04-25T09:06:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f6175e00640 1 --2- 172.21.15.59:0/3796415567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800d11b0 0x7f618006ac10 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f61800684f0 tx=0x7f616801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c667b6a66c755ba2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f617de00640 1 -- 172.21.15.59:0/3796415567 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61680a56d0 con 0x7f61800d11b0 2024-04-25T09:06:15.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f617de00640 1 -- 172.21.15.59:0/3796415567 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61680a5870 con 0x7f61800d11b0 2024-04-25T09:06:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f617de00640 1 -- 172.21.15.59:0/3796415567 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61680a5c40 con 0x7f61800d11b0 2024-04-25T09:06:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f6185400640 1 -- 172.21.15.59:0/3796415567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800d11b0 msgr2=0x7f618006ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f6185400640 1 --2- 172.21.15.59:0/3796415567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800d11b0 0x7f618006ac10 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f61800684f0 tx=0x7f616801c960 comp rx=0 tx=0).stop 2024-04-25T09:06:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f6185400640 1 -- 172.21.15.59:0/3796415567 shutdown_connections 2024-04-25T09:06:15.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f6185400640 1 --2- 172.21.15.59:0/3796415567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800b4210 0x7f61800b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f6185400640 1 --2- 172.21.15.59:0/3796415567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800d11b0 0x7f618006ac10 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f6185400640 1 --2- 172.21.15.59:0/3796415567 >> v2:172.21.15.178:3300/0 conn(0x7f618015da10 0x7f61800afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f6185400640 1 -- 172.21.15.59:0/3796415567 >> 172.21.15.59:0/3796415567 conn(0x7f61800b2400 msgr2=0x7f61800b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f6185400640 1 -- 172.21.15.59:0/3796415567 shutdown_connections 2024-04-25T09:06:15.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f6185400640 1 -- 172.21.15.59:0/3796415567 wait complete. 2024-04-25T09:06:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f6185400640 1 Processor -- start 2024-04-25T09:06:15.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.381+0000 7f6185400640 1 -- start start 2024-04-25T09:06:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6185400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b4210 0x7f6180149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6185400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800d11b0 0x7f618015e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6185400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f618015da10 0x7f6180137aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6185400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61800704b0 con 0x7f61800b4210 2024-04-25T09:06:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6185400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6180070330 con 0x7f618015da10 2024-04-25T09:06:15.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6185400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6180070630 con 0x7f61800d11b0 2024-04-25T09:06:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f617e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b4210 0x7f6180149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f617e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b4210 0x7f6180149450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45754/0 (socket says 172.21.15.59:45754) 2024-04-25T09:06:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f617e800640 1 -- 172.21.15.59:0/2910258942 learned_addr learned my addr 172.21.15.59:0/2910258942 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f617f200640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f618015da10 0x7f6180137aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6175e00640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800d11b0 0x7f618015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f617e800640 1 -- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800d11b0 msgr2=0x7f618015e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f617e800640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800d11b0 0x7f618015e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f617e800640 1 -- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f618015da10 msgr2=0x7f6180137aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f617e800640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f618015da10 0x7f6180137aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f617e800640 1 -- 172.21.15.59:0/2910258942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618014a550 con 0x7f61800b4210 2024-04-25T09:06:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f617e800640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b4210 0x7f6180149450 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f617000e870 tx=0x7f617000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6177400640 1 -- 172.21.15.59:0/2910258942 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6170017070 con 0x7f61800b4210 2024-04-25T09:06:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6177400640 1 -- 172.21.15.59:0/2910258942 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617000c940 con 0x7f61800b4210 2024-04-25T09:06:15.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6177400640 1 -- 172.21.15.59:0/2910258942 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f617000ccf0 con 0x7f61800b4210 2024-04-25T09:06:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6185400640 1 -- 172.21.15.59:0/2910258942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618014a830 con 0x7f61800b4210 2024-04-25T09:06:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6185400640 1 -- 172.21.15.59:0/2910258942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618014adf0 con 0x7f61800b4210 2024-04-25T09:06:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6185400640 1 -- 172.21.15.59:0/2910258942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61800745d0 con 0x7f61800b4210 2024-04-25T09:06:15.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.385+0000 7f6177400640 1 -- 172.21.15.59:0/2910258942 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f617001a070 con 0x7f61800b4210 2024-04-25T09:06:15.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.389+0000 7f6177400640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f615c066f60 0x7f615c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.389+0000 7f6177400640 1 -- 172.21.15.59:0/2910258942 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6170085440 con 0x7f61800b4210 2024-04-25T09:06:15.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.389+0000 7f6175e00640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f615c066f60 0x7f615c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.389+0000 7f6175e00640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f615c066f60 0x7f615c069420 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f61680ae000 tx=0x7f61680a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.393+0000 7f6177400640 1 -- 172.21.15.59:0/2910258942 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6170055bd0 con 0x7f61800b4210 2024-04-25T09:06:15.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.565+0000 7f6185400640 1 -- 172.21.15.59:0/2910258942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6180072860 con 0x7f61800b4210 2024-04-25T09:06:15.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.565+0000 7f6177400640 1 -- 172.21.15.59:0/2910258942 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+16945 (secure 0 0 0) 0x7f6170059c70 con 0x7f61800b4210 2024-04-25T09:06:15.558 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:15.558 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":80,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:06:08.804276+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:04.967523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:06.198067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:15.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.569+0000 7f6185400640 1 -- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f615c066f60 msgr2=0x7f615c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.569+0000 7f6185400640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f615c066f60 0x7f615c069420 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f61680ae000 tx=0x7f61680a7070 comp rx=0 tx=0).stop 2024-04-25T09:06:15.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.569+0000 7f6185400640 1 -- 172.21.15.59:0/2910258942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b4210 msgr2=0x7f6180149450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.569+0000 7f6185400640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b4210 0x7f6180149450 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f617000e870 tx=0x7f617000ec70 comp rx=0 tx=0).stop 2024-04-25T09:06:15.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.569+0000 7f6185400640 1 -- 172.21.15.59:0/2910258942 shutdown_connections 2024-04-25T09:06:15.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.569+0000 7f6185400640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f615c066f60 0x7f615c069420 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.569+0000 7f6185400640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f618015da10 0x7f6180137aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.569+0000 7f6185400640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61800d11b0 0x7f618015e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.569+0000 7f6185400640 1 --2- 172.21.15.59:0/2910258942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61800b4210 0x7f6180149450 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.569+0000 7f6185400640 1 -- 172.21.15.59:0/2910258942 >> 172.21.15.59:0/2910258942 conn(0x7f61800b2400 msgr2=0x7f6180157a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.569+0000 7f6185400640 1 -- 172.21.15.59:0/2910258942 shutdown_connections 2024-04-25T09:06:15.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.569+0000 7f6185400640 1 -- 172.21.15.59:0/2910258942 wait complete. 2024-04-25T09:06:15.580 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:06:04.967523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:06:06.198067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:15.581 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f111b000640 1 Processor -- start 2024-04-25T09:06:15.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f111b000640 1 -- start start 2024-04-25T09:06:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f111b000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f111415dc00 0x7f11140af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f111b000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11140c72a0 0x7f11140c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f111b000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11140b30d0 con 0x7f11140d0150 2024-04-25T09:06:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f111b000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11140cd860 con 0x7f11140c72a0 2024-04-25T09:06:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f111b000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11140ccf30 con 0x7f111415dc00 2024-04-25T09:06:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f1119000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11140c72a0 0x7f11140c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f1119000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11140c72a0 0x7f11140c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:42430/0 (socket says 172.21.15.59:42430) 2024-04-25T09:06:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f1119000640 1 -- 172.21.15.59:0/213425315 learned_addr learned my addr 172.21.15.59:0/213425315 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:15.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f1113e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f111415dc00 0x7f11140af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f1113400640 1 -- 172.21.15.59:0/213425315 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008498257 0 0) 0x7f11140b30d0 con 0x7f11140d0150 2024-04-25T09:06:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f1113400640 1 -- 172.21.15.59:0/213425315 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f8003530 con 0x7f11140d0150 2024-04-25T09:06:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f1113e00640 1 -- 172.21.15.59:0/213425315 >> v2:172.21.15.178:3300/0 conn(0x7f11140c72a0 msgr2=0x7f11140c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f1113e00640 1 --2- 172.21.15.59:0/213425315 >> v2:172.21.15.178:3300/0 conn(0x7f11140c72a0 0x7f11140c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f1113e00640 1 -- 172.21.15.59:0/213425315 >> v1:172.21.15.178:6789/0 conn(0x7f11140d0150 legacy=0x7f11140c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f1113e00640 1 -- 172.21.15.59:0/213425315 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11140cd210 con 0x7f111415dc00 2024-04-25T09:06:15.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.733+0000 7f1119000640 1 --2- 172.21.15.59:0/213425315 >> v2:172.21.15.178:3300/0 conn(0x7f11140c72a0 0x7f11140c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.737+0000 7f1113e00640 1 --2- 172.21.15.59:0/213425315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f111415dc00 0x7f11140af770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11040097f0 tx=0x7f110401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea3a853e271d0051 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.737+0000 7f1113400640 1 -- 172.21.15.59:0/213425315 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040b0070 con 0x7f111415dc00 2024-04-25T09:06:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.737+0000 7f1113400640 1 -- 172.21.15.59:0/213425315 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11040ab600 con 0x7f111415dc00 2024-04-25T09:06:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.737+0000 7f1113400640 1 -- 172.21.15.59:0/213425315 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11040ab9d0 con 0x7f111415dc00 2024-04-25T09:06:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.737+0000 7f111b000640 1 -- 172.21.15.59:0/213425315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f111415dc00 msgr2=0x7f11140af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.737+0000 7f111b000640 1 --2- 172.21.15.59:0/213425315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f111415dc00 0x7f11140af770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f11040097f0 tx=0x7f110401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.737+0000 7f111b000640 1 -- 172.21.15.59:0/213425315 shutdown_connections 2024-04-25T09:06:15.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.737+0000 7f111b000640 1 --2- 172.21.15.59:0/213425315 >> v2:172.21.15.178:3300/0 conn(0x7f11140c72a0 0x7f11140c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.737+0000 7f111b000640 1 --2- 172.21.15.59:0/213425315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f111415dc00 0x7f11140af770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.737+0000 7f111b000640 1 -- 172.21.15.59:0/213425315 >> 172.21.15.59:0/213425315 conn(0x7f11140b2240 msgr2=0x7f11140b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.737+0000 7f111b000640 1 -- 172.21.15.59:0/213425315 shutdown_connections 2024-04-25T09:06:15.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.737+0000 7f111b000640 1 -- 172.21.15.59:0/213425315 wait complete. 2024-04-25T09:06:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f111b000640 1 Processor -- start 2024-04-25T09:06:15.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f111b000640 1 -- start start 2024-04-25T09:06:15.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f111b000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11140c72a0 0x7f11141454a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f111b000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11140d0150 0x7f111409a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f111b000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f111415dc00 0x7f11140b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f111b000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111416a640 con 0x7f111415dc00 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f111b000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11140cdf00 con 0x7f11140d0150 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f111b000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111416a7c0 con 0x7f11140c72a0 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f1119000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f111415dc00 0x7f11140b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f1119000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f111415dc00 0x7f11140b5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45762/0 (socket says 172.21.15.59:45762) 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f1119000640 1 -- 172.21.15.59:0/3421999985 learned_addr learned my addr 172.21.15.59:0/3421999985 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f110be00640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11140d0150 0x7f111409a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f1113e00640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11140c72a0 0x7f11141454a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f1119000640 1 -- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11140c72a0 msgr2=0x7f11141454a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f1119000640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11140c72a0 0x7f11141454a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f1119000640 1 -- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11140d0150 msgr2=0x7f111409a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f1119000640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11140d0150 0x7f111409a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f1119000640 1 -- 172.21.15.59:0/3421999985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11141459e0 con 0x7f111415dc00 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f1119000640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f111415dc00 0x7f11140b5a20 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f110c00ef90 tx=0x7f110c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.741+0000 7f1110c00640 1 -- 172.21.15.59:0/3421999985 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c00cbe0 con 0x7f111415dc00 2024-04-25T09:06:15.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.745+0000 7f1110c00640 1 -- 172.21.15.59:0/3421999985 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c00cd80 con 0x7f111415dc00 2024-04-25T09:06:15.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.745+0000 7f111b000640 1 -- 172.21.15.59:0/3421999985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111409b080 con 0x7f111415dc00 2024-04-25T09:06:15.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.745+0000 7f1110c00640 1 -- 172.21.15.59:0/3421999985 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c003bc0 con 0x7f111415dc00 2024-04-25T09:06:15.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.745+0000 7f111b000640 1 -- 172.21.15.59:0/3421999985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111409b640 con 0x7f111415dc00 2024-04-25T09:06:15.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.745+0000 7f111b000640 1 -- 172.21.15.59:0/3421999985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11140745d0 con 0x7f111415dc00 2024-04-25T09:06:15.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.745+0000 7f1110c00640 1 -- 172.21.15.59:0/3421999985 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f110c01b030 con 0x7f111415dc00 2024-04-25T09:06:15.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.745+0000 7f1110c00640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f10f0066f90 0x7f10f0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:15.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.745+0000 7f1110c00640 1 -- 172.21.15.59:0/3421999985 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f110c0853e0 con 0x7f111415dc00 2024-04-25T09:06:15.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.745+0000 7f1113e00640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f10f0066f90 0x7f10f0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:15.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.745+0000 7f1113e00640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f10f0066f90 0x7f10f0069450 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f11040ad000 tx=0x7f1104008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:15.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.749+0000 7f1110c00640 1 -- 172.21.15.59:0/3421999985 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f110c022020 con 0x7f111415dc00 2024-04-25T09:06:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.917+0000 7f111b000640 1 -- 172.21.15.59:0/3421999985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11140af0e0 con 0x7f111415dc00 2024-04-25T09:06:15.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f1110c00640 1 -- 172.21.15.59:0/3421999985 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f110c010040 con 0x7f111415dc00 2024-04-25T09:06:15.912 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f111b000640 1 -- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f10f0066f90 msgr2=0x7f10f0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f111b000640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f10f0066f90 0x7f10f0069450 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f11040ad000 tx=0x7f1104008040 comp rx=0 tx=0).stop 2024-04-25T09:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f111b000640 1 -- 172.21.15.59:0/3421999985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f111415dc00 msgr2=0x7f11140b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f111b000640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f111415dc00 0x7f11140b5a20 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f110c00ef90 tx=0x7f110c00c490 comp rx=0 tx=0).stop 2024-04-25T09:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f111b000640 1 -- 172.21.15.59:0/3421999985 shutdown_connections 2024-04-25T09:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f111b000640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f10f0066f90 0x7f10f0069450 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f111b000640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f111415dc00 0x7f11140b5a20 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f111b000640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11140d0150 0x7f111409a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f111b000640 1 --2- 172.21.15.59:0/3421999985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11140c72a0 0x7f11141454a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f111b000640 1 -- 172.21.15.59:0/3421999985 >> 172.21.15.59:0/3421999985 conn(0x7f11140b2240 msgr2=0x7f111406fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f111b000640 1 -- 172.21.15.59:0/3421999985 shutdown_connections 2024-04-25T09:06:15.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:15.921+0000 7f111b000640 1 -- 172.21.15.59:0/3421999985 wait complete. 2024-04-25T09:06:15.933 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:06:16.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2d05a00640 1 Processor -- start 2024-04-25T09:06:16.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2d05a00640 1 -- start start 2024-04-25T09:06:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2d05a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d0015c9b0 0x7f2d0006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2d05a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d0006e010 0x7f2d0006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2d05a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d0015fc00 con 0x7f2d00159320 2024-04-25T09:06:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2d05a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0006d640 con 0x7f2d0006e010 2024-04-25T09:06:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2d05a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d0015fee0 con 0x7f2d0015c9b0 2024-04-25T09:06:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2cfea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2d00159320 0x7f2d0015f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55108/0 (socket says 172.21.15.59:55108) 2024-04-25T09:06:16.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2cff400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d0006e010 0x7f2d0006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2cfea00640 1 -- 172.21.15.59:0/1882162962 learned_addr learned my addr 172.21.15.59:0/1882162962 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:16.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2cf6000640 1 --2- 172.21.15.59:0/1882162962 >> v2:172.21.15.178:3300/0 conn(0x7f2d0015c9b0 0x7f2d0006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2cfe000640 1 -- 172.21.15.59:0/1882162962 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3776830973 0 0) 0x7f2d0015fc00 con 0x7f2d00159320 2024-04-25T09:06:16.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2cfe000640 1 -- 172.21.15.59:0/1882162962 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ce4003530 con 0x7f2d00159320 2024-04-25T09:06:16.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2cff400640 1 -- 172.21.15.59:0/1882162962 >> v2:172.21.15.178:3300/0 conn(0x7f2d0015c9b0 msgr2=0x7f2d0006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:16.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2cff400640 1 --2- 172.21.15.59:0/1882162962 >> v2:172.21.15.178:3300/0 conn(0x7f2d0015c9b0 0x7f2d0006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2cff400640 1 -- 172.21.15.59:0/1882162962 >> v1:172.21.15.59:6789/0 conn(0x7f2d00159320 legacy=0x7f2d0015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.085+0000 7f2cff400640 1 -- 172.21.15.59:0/1882162962 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d001601c0 con 0x7f2d0006e010 2024-04-25T09:06:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.089+0000 7f2cff400640 1 --2- 172.21.15.59:0/1882162962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0006e010 0x7f2d0006e4a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f2d000b4b50 tx=0x7f2cf801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92b5400f2863a8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.089+0000 7f2cfe000640 1 -- 172.21.15.59:0/1882162962 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80b0070 con 0x7f2d0006e010 2024-04-25T09:06:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.089+0000 7f2cfe000640 1 -- 172.21.15.59:0/1882162962 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf80ab600 con 0x7f2d0006e010 2024-04-25T09:06:16.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.089+0000 7f2cfe000640 1 -- 172.21.15.59:0/1882162962 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf80ab9d0 con 0x7f2d0006e010 2024-04-25T09:06:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.089+0000 7f2d05a00640 1 -- 172.21.15.59:0/1882162962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0006e010 msgr2=0x7f2d0006e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.089+0000 7f2d05a00640 1 --2- 172.21.15.59:0/1882162962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0006e010 0x7f2d0006e4a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f2d000b4b50 tx=0x7f2cf801c480 comp rx=0 tx=0).stop 2024-04-25T09:06:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.089+0000 7f2d05a00640 1 -- 172.21.15.59:0/1882162962 shutdown_connections 2024-04-25T09:06:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.089+0000 7f2d05a00640 1 --2- 172.21.15.59:0/1882162962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d0006e010 0x7f2d0006e4a0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.089+0000 7f2d05a00640 1 --2- 172.21.15.59:0/1882162962 >> v2:172.21.15.178:3300/0 conn(0x7f2d0015c9b0 0x7f2d0006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.089+0000 7f2d05a00640 1 -- 172.21.15.59:0/1882162962 >> 172.21.15.59:0/1882162962 conn(0x7f2d00067080 msgr2=0x7f2d0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.089+0000 7f2d05a00640 1 -- 172.21.15.59:0/1882162962 shutdown_connections 2024-04-25T09:06:16.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.089+0000 7f2d05a00640 1 -- 172.21.15.59:0/1882162962 wait complete. 2024-04-25T09:06:16.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2d05a00640 1 Processor -- start 2024-04-25T09:06:16.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2d05a00640 1 -- start start 2024-04-25T09:06:16.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2d05a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d0006e010 0x7f2d00139c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2d05a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00159320 0x7f2d0015b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2d05a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d0015c9b0 0x7f2d00157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2d05a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d00168920 con 0x7f2d00159320 2024-04-25T09:06:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2d05a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d001687a0 con 0x7f2d0006e010 2024-04-25T09:06:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2d05a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d00168aa0 con 0x7f2d0015c9b0 2024-04-25T09:06:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cf6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00159320 0x7f2d0015b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cf6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00159320 0x7f2d0015b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45778/0 (socket says 172.21.15.59:45778) 2024-04-25T09:06:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cf6000640 1 -- 172.21.15.59:0/1223985709 learned_addr learned my addr 172.21.15.59:0/1223985709 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cfea00640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d0006e010 0x7f2d00139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cff400640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d0015c9b0 0x7f2d00157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cf6000640 1 -- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d0015c9b0 msgr2=0x7f2d00157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cf6000640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d0015c9b0 0x7f2d00157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cf6000640 1 -- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d0006e010 msgr2=0x7f2d00139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cf6000640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d0006e010 0x7f2d00139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cf6000640 1 -- 172.21.15.59:0/1223985709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d0015bb10 con 0x7f2d00159320 2024-04-25T09:06:16.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cf6000640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00159320 0x7f2d0015b5d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800e960 tx=0x7f2ce800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cf7400640 1 -- 172.21.15.59:0/1223985709 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8017070 con 0x7f2d00159320 2024-04-25T09:06:16.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cf7400640 1 -- 172.21.15.59:0/1223985709 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce800ca00 con 0x7f2d00159320 2024-04-25T09:06:16.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2cf7400640 1 -- 172.21.15.59:0/1223985709 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800cdb0 con 0x7f2d00159320 2024-04-25T09:06:16.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2d05a00640 1 -- 172.21.15.59:0/1223985709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0013a1e0 con 0x7f2d00159320 2024-04-25T09:06:16.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2d05a00640 1 -- 172.21.15.59:0/1223985709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0013a7a0 con 0x7f2d00159320 2024-04-25T09:06:16.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.093+0000 7f2d05a00640 1 -- 172.21.15.59:0/1223985709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d000b25f0 con 0x7f2d00159320 2024-04-25T09:06:16.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.097+0000 7f2cf7400640 1 -- 172.21.15.59:0/1223985709 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2ce801a070 con 0x7f2d00159320 2024-04-25T09:06:16.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.097+0000 7f2cf7400640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2cdc066f60 0x7f2cdc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.097+0000 7f2cf7400640 1 -- 172.21.15.59:0/1223985709 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2ce80851d0 con 0x7f2d00159320 2024-04-25T09:06:16.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.097+0000 7f2cfea00640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2cdc066f60 0x7f2cdc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.097+0000 7f2cfea00640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2cdc066f60 0x7f2cdc069420 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0005c10 tx=0x7f2cf0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.101+0000 7f2cf7400640 1 -- 172.21.15.59:0/1223985709 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2ce8055960 con 0x7f2d00159320 2024-04-25T09:06:16.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 -- 172.21.15.59:0/1223985709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d001427b0 con 0x7f2d00159320 2024-04-25T09:06:16.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2cf7400640 1 -- 172.21.15.59:0/1223985709 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v80) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ce8059a00 con 0x7f2d00159320 2024-04-25T09:06:16.254 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:06:16.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 -- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2cdc066f60 msgr2=0x7f2cdc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2cdc066f60 0x7f2cdc069420 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0005c10 tx=0x7f2cf0009040 comp rx=0 tx=0).stop 2024-04-25T09:06:16.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 -- 172.21.15.59:0/1223985709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00159320 msgr2=0x7f2d0015b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00159320 0x7f2d0015b5d0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800e960 tx=0x7f2ce800ee20 comp rx=0 tx=0).stop 2024-04-25T09:06:16.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 -- 172.21.15.59:0/1223985709 shutdown_connections 2024-04-25T09:06:16.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2cdc066f60 0x7f2cdc069420 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d0015c9b0 0x7f2d00157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d00159320 0x7f2d0015b5d0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 --2- 172.21.15.59:0/1223985709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d0006e010 0x7f2d00139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 -- 172.21.15.59:0/1223985709 >> 172.21.15.59:0/1223985709 conn(0x7f2d00067080 msgr2=0x7f2d000cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:16.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 -- 172.21.15.59:0/1223985709 shutdown_connections 2024-04-25T09:06:16.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.261+0000 7f2d05a00640 1 -- 172.21.15.59:0/1223985709 wait complete. 2024-04-25T09:06:16.274 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:06:16.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.425+0000 7fbba4200640 1 Processor -- start 2024-04-25T09:06:16.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.425+0000 7fbba4200640 1 -- start start 2024-04-25T09:06:16.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.425+0000 7fbba4200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbb9c15acd0 0x7fbb9c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.425+0000 7fbba4200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c15bc40 con 0x7fbb9c15ee60 2024-04-25T09:06:16.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.425+0000 7fbba4200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9c15b3a0 con 0x7fbb9c144120 2024-04-25T09:06:16.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.425+0000 7fbba4200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9c15e490 con 0x7fbb9c15acd0 2024-04-25T09:06:16.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.425+0000 7fbba2200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbb9c15ee60 0x7fbb9c0b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55112/0 (socket says 172.21.15.59:55112) 2024-04-25T09:06:16.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.425+0000 7fbba2200640 1 -- 172.21.15.59:0/743772618 learned_addr learned my addr 172.21.15.59:0/743772618 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:16.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.425+0000 7fbba0e00640 1 --2- 172.21.15.59:0/743772618 >> v2:172.21.15.178:3300/0 conn(0x7fbb9c15acd0 0x7fbb9c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.425+0000 7fbb9be00640 1 -- 172.21.15.59:0/743772618 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1315317034 0 0) 0x7fbb9c15bc40 con 0x7fbb9c15ee60 2024-04-25T09:06:16.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.425+0000 7fbb9be00640 1 -- 172.21.15.59:0/743772618 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb84005740 con 0x7fbb9c15ee60 2024-04-25T09:06:16.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.429+0000 7fbba0e00640 1 -- 172.21.15.59:0/743772618 >> v1:172.21.15.178:6789/0 conn(0x7fbb9c144120 legacy=0x7fbb9c0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.429+0000 7fbb9be00640 1 -- 172.21.15.59:0/743772618 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3791395920 0 0) 0x7fbb84005740 con 0x7fbb9c15ee60 2024-04-25T09:06:16.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.429+0000 7fbba0e00640 1 -- 172.21.15.59:0/743772618 >> v1:172.21.15.59:6789/0 conn(0x7fbb9c15ee60 legacy=0x7fbb9c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.429+0000 7fbba0e00640 1 -- 172.21.15.59:0/743772618 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c15b680 con 0x7fbb9c15acd0 2024-04-25T09:06:16.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.429+0000 7fbba0e00640 1 --2- 172.21.15.59:0/743772618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb9c15acd0 0x7fbb9c15e920 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbb880097c0 tx=0x7fbb8801c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0d8a7cb7c8065ea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.429+0000 7fbb9be00640 1 -- 172.21.15.59:0/743772618 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880b0070 con 0x7fbb9c15acd0 2024-04-25T09:06:16.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.429+0000 7fbb9be00640 1 -- 172.21.15.59:0/743772618 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb880ab400 con 0x7fbb9c15acd0 2024-04-25T09:06:16.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.429+0000 7fbb9be00640 1 -- 172.21.15.59:0/743772618 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb94001a00 con 0x7fbb9c15acd0 2024-04-25T09:06:16.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.429+0000 7fbba4200640 1 -- 172.21.15.59:0/743772618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb9c15acd0 msgr2=0x7fbb9c15e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.429+0000 7fbba4200640 1 --2- 172.21.15.59:0/743772618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb9c15acd0 0x7fbb9c15e920 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbb880097c0 tx=0x7fbb8801c330 comp rx=0 tx=0).stop 2024-04-25T09:06:16.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 -- 172.21.15.59:0/743772618 shutdown_connections 2024-04-25T09:06:16.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 --2- 172.21.15.59:0/743772618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb9c15acd0 0x7fbb9c15e920 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 -- 172.21.15.59:0/743772618 >> 172.21.15.59:0/743772618 conn(0x7fbb9c067080 msgr2=0x7fbb9c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:16.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 -- 172.21.15.59:0/743772618 shutdown_connections 2024-04-25T09:06:16.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 -- 172.21.15.59:0/743772618 wait complete. 2024-04-25T09:06:16.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 Processor -- start 2024-04-25T09:06:16.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 -- start start 2024-04-25T09:06:16.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb9c144120 0x7fbb9c163660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9c15acd0 0x7fbb9c161960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb9c15ee60 0x7fbb9c1fa870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c06de70 con 0x7fbb9c15acd0 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c06dcf0 con 0x7fbb9c144120 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba4200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9c06dff0 con 0x7fbb9c15ee60 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9c15acd0 0x7fbb9c161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9c15acd0 0x7fbb9c161960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45792/0 (socket says 172.21.15.59:45792) 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba0e00640 1 -- 172.21.15.59:0/2378725010 learned_addr learned my addr 172.21.15.59:0/2378725010 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba1800640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb9c144120 0x7fbb9c163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba2200640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb9c15ee60 0x7fbb9c1fa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba0e00640 1 -- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb9c15ee60 msgr2=0x7fbb9c1fa870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba0e00640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb9c15ee60 0x7fbb9c1fa870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba0e00640 1 -- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb9c144120 msgr2=0x7fbb9c163660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba0e00640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb9c144120 0x7fbb9c163660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba0e00640 1 -- 172.21.15.59:0/2378725010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9c1fadb0 con 0x7fbb9c15acd0 2024-04-25T09:06:16.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.433+0000 7fbba0e00640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9c15acd0 0x7fbb9c161960 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fbb88097c00 tx=0x7fbb880190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.437+0000 7fbb99600640 1 -- 172.21.15.59:0/2378725010 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880b9020 con 0x7fbb9c15acd0 2024-04-25T09:06:16.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.437+0000 7fbb99600640 1 -- 172.21.15.59:0/2378725010 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb880038e0 con 0x7fbb9c15acd0 2024-04-25T09:06:16.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.437+0000 7fbba4200640 1 -- 172.21.15.59:0/2378725010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9c160ea0 con 0x7fbb9c15acd0 2024-04-25T09:06:16.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.437+0000 7fbb99600640 1 -- 172.21.15.59:0/2378725010 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880b0040 con 0x7fbb9c15acd0 2024-04-25T09:06:16.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.437+0000 7fbba4200640 1 -- 172.21.15.59:0/2378725010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9c165670 con 0x7fbb9c15acd0 2024-04-25T09:06:16.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.437+0000 7fbba4200640 1 -- 172.21.15.59:0/2378725010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9c0745d0 con 0x7fbb9c15acd0 2024-04-25T09:06:16.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.437+0000 7fbb99600640 1 -- 172.21.15.59:0/2378725010 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbb880bc020 con 0x7fbb9c15acd0 2024-04-25T09:06:16.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.437+0000 7fbb99600640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb7c066f60 0x7fbb7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.437+0000 7fbb99600640 1 -- 172.21.15.59:0/2378725010 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbb8811f1b0 con 0x7fbb9c15acd0 2024-04-25T09:06:16.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.437+0000 7fbba1800640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb7c066f60 0x7fbb7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.437+0000 7fbba1800640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb7c066f60 0x7fbb7c069420 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbb90001650 tx=0x7fbb90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.441+0000 7fbb99600640 1 -- 172.21.15.59:0/2378725010 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbb880c3030 con 0x7fbb9c15acd0 2024-04-25T09:06:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 -- 172.21.15.59:0/2378725010 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbb9c160c80 con 0x7fbb9c15acd0 2024-04-25T09:06:16.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbb99600640 1 -- 172.21.15.59:0/2378725010 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v80) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbb88015fb0 con 0x7fbb9c15acd0 2024-04-25T09:06:16.597 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:06:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 -- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb7c066f60 msgr2=0x7fbb7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb7c066f60 0x7fbb7c069420 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbb90001650 tx=0x7fbb90009040 comp rx=0 tx=0).stop 2024-04-25T09:06:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 -- 172.21.15.59:0/2378725010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9c15acd0 msgr2=0x7fbb9c161960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9c15acd0 0x7fbb9c161960 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fbb88097c00 tx=0x7fbb880190d0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 -- 172.21.15.59:0/2378725010 shutdown_connections 2024-04-25T09:06:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb7c066f60 0x7fbb7c069420 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb9c15ee60 0x7fbb9c1fa870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9c15acd0 0x7fbb9c161960 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 --2- 172.21.15.59:0/2378725010 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb9c144120 0x7fbb9c163660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 -- 172.21.15.59:0/2378725010 >> 172.21.15.59:0/2378725010 conn(0x7fbb9c067080 msgr2=0x7fbb9c071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 -- 172.21.15.59:0/2378725010 shutdown_connections 2024-04-25T09:06:16.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.605+0000 7fbba4200640 1 -- 172.21.15.59:0/2378725010 wait complete. 2024-04-25T09:06:16.618 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:06:16.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed3f000640 1 Processor -- start 2024-04-25T09:06:16.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed3f000640 1 -- start start 2024-04-25T09:06:16.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed3f000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed38072210 0x7fed3806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed3f000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed3815af40 0x7fed380cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed3f000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed3815e9a0 con 0x7fed38150f40 2024-04-25T09:06:16.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed3f000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed3806f530 con 0x7fed3815af40 2024-04-25T09:06:16.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed3f000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed3815dbe0 con 0x7fed38072210 2024-04-25T09:06:16.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed37400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed38072210 0x7fed3806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed3d000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed3815af40 0x7fed380cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed37400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed38072210 0x7fed3806ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:41046/0 (socket says 172.21.15.59:41046) 2024-04-25T09:06:16.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed3d000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed3815af40 0x7fed380cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:42470/0 (socket says 172.21.15.59:42470) 2024-04-25T09:06:16.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed37400640 1 -- 172.21.15.59:0/3486677839 learned_addr learned my addr 172.21.15.59:0/3486677839 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:16.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed37e00640 1 --1- 172.21.15.59:0/3486677839 >> v1:172.21.15.178:6789/0 conn(0x7fed38150f40 0x7fed38071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:53712/0 (socket says 172.21.15.59:53712) 2024-04-25T09:06:16.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed37400640 1 -- 172.21.15.59:0/3486677839 >> v2:172.21.15.178:3300/0 conn(0x7fed3815af40 msgr2=0x7fed380cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:16.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed37400640 1 --2- 172.21.15.59:0/3486677839 >> v2:172.21.15.178:3300/0 conn(0x7fed3815af40 0x7fed380cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed37400640 1 -- 172.21.15.59:0/3486677839 >> v1:172.21.15.178:6789/0 conn(0x7fed38150f40 legacy=0x7fed38071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.769+0000 7fed37400640 1 -- 172.21.15.59:0/3486677839 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3815dec0 con 0x7fed38072210 2024-04-25T09:06:16.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.773+0000 7fed37400640 1 --2- 172.21.15.59:0/3486677839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed38072210 0x7fed3806ef50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed2400bb10 tx=0x7fed2401eb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f0588d92ca4c39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.773+0000 7fed36a00640 1 -- 172.21.15.59:0/3486677839 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240b4070 con 0x7fed38072210 2024-04-25T09:06:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.773+0000 7fed36a00640 1 -- 172.21.15.59:0/3486677839 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed240a7960 con 0x7fed38072210 2024-04-25T09:06:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.773+0000 7fed36a00640 1 -- 172.21.15.59:0/3486677839 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240a7d30 con 0x7fed38072210 2024-04-25T09:06:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.773+0000 7fed3f000640 1 -- 172.21.15.59:0/3486677839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed38072210 msgr2=0x7fed3806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.773+0000 7fed3f000640 1 --2- 172.21.15.59:0/3486677839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed38072210 0x7fed3806ef50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed2400bb10 tx=0x7fed2401eb10 comp rx=0 tx=0).stop 2024-04-25T09:06:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.773+0000 7fed3f000640 1 -- 172.21.15.59:0/3486677839 shutdown_connections 2024-04-25T09:06:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.773+0000 7fed3f000640 1 --2- 172.21.15.59:0/3486677839 >> v2:172.21.15.178:3300/0 conn(0x7fed3815af40 0x7fed380cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.773+0000 7fed3f000640 1 --2- 172.21.15.59:0/3486677839 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed38072210 0x7fed3806ef50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.773+0000 7fed3f000640 1 -- 172.21.15.59:0/3486677839 >> 172.21.15.59:0/3486677839 conn(0x7fed38067080 msgr2=0x7fed3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.773+0000 7fed3f000640 1 -- 172.21.15.59:0/3486677839 shutdown_connections 2024-04-25T09:06:16.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.773+0000 7fed3f000640 1 -- 172.21.15.59:0/3486677839 wait complete. 2024-04-25T09:06:16.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3f000640 1 Processor -- start 2024-04-25T09:06:16.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3f000640 1 -- start start 2024-04-25T09:06:16.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3f000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed38072210 0x7fed38163740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3f000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed38150f40 0x7fed3814e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3f000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed3815af40 0x7fed38153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3f000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed380ce380 con 0x7fed38150f40 2024-04-25T09:06:16.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3f000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed380ce200 con 0x7fed3815af40 2024-04-25T09:06:16.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3f000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed380ce500 con 0x7fed38072210 2024-04-25T09:06:16.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed37400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed38150f40 0x7fed3814e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed37400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed38150f40 0x7fed3814e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45800/0 (socket says 172.21.15.59:45800) 2024-04-25T09:06:16.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed37400640 1 -- 172.21.15.59:0/1419618167 learned_addr learned my addr 172.21.15.59:0/1419618167 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed37400640 1 -- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed38072210 msgr2=0x7fed38163740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed37400640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed38072210 0x7fed38163740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed37400640 1 -- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed3815af40 msgr2=0x7fed38153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3d000640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed3815af40 0x7fed38153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed37400640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed3815af40 0x7fed38153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed37400640 1 -- 172.21.15.59:0/1419618167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed3814ec30 con 0x7fed38150f40 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3d000640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed3815af40 0x7fed38153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed37400640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed38150f40 0x7fed3814e6f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fed2400b2c0 tx=0x7fed2401b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed2fe00640 1 -- 172.21.15.59:0/1419618167 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240b4070 con 0x7fed38150f40 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed2fe00640 1 -- 172.21.15.59:0/1419618167 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed240b6070 con 0x7fed38150f40 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed2fe00640 1 -- 172.21.15.59:0/1419618167 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240afbf0 con 0x7fed38150f40 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3f000640 1 -- 172.21.15.59:0/1419618167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed38157270 con 0x7fed38150f40 2024-04-25T09:06:16.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3f000640 1 -- 172.21.15.59:0/1419618167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed38157830 con 0x7fed38150f40 2024-04-25T09:06:16.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.777+0000 7fed3f000640 1 -- 172.21.15.59:0/1419618167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed380745d0 con 0x7fed38150f40 2024-04-25T09:06:16.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.781+0000 7fed2fe00640 1 -- 172.21.15.59:0/1419618167 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fed240c53f0 con 0x7fed38150f40 2024-04-25T09:06:16.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.781+0000 7fed2fe00640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed18066f60 0x7fed18069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:16.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.781+0000 7fed2fe00640 1 -- 172.21.15.59:0/1419618167 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fed2411f390 con 0x7fed38150f40 2024-04-25T09:06:16.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.781+0000 7fed37e00640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed18066f60 0x7fed18069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:16.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.781+0000 7fed37e00640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed18066f60 0x7fed18069420 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fed280015f0 tx=0x7fed280079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:16.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.785+0000 7fed2fe00640 1 -- 172.21.15.59:0/1419618167 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed24018820 con 0x7fed38150f40 2024-04-25T09:06:16.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.961+0000 7fed3f000640 1 -- 172.21.15.59:0/1419618167 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fed380b3aa0 con 0x7fed38150f40 2024-04-25T09:06:16.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.961+0000 7fed2fe00640 1 -- 172.21.15.59:0/1419618167 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v80) v1 ==== 80+0+0 (secure 0 0 0) 0x7fed240f0200 con 0x7fed38150f40 2024-04-25T09:06:16.955 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:06:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.965+0000 7fed3f000640 1 -- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed18066f60 msgr2=0x7fed18069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.965+0000 7fed3f000640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed18066f60 0x7fed18069420 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fed280015f0 tx=0x7fed280079d0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.965+0000 7fed3f000640 1 -- 172.21.15.59:0/1419618167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed38150f40 msgr2=0x7fed3814e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.965+0000 7fed3f000640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed38150f40 0x7fed3814e6f0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fed2400b2c0 tx=0x7fed2401b8b0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.965+0000 7fed3f000640 1 -- 172.21.15.59:0/1419618167 shutdown_connections 2024-04-25T09:06:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.965+0000 7fed3f000640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed18066f60 0x7fed18069420 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.965+0000 7fed3f000640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed3815af40 0x7fed38153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.965+0000 7fed3f000640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed38150f40 0x7fed3814e6f0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.965+0000 7fed3f000640 1 --2- 172.21.15.59:0/1419618167 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed38072210 0x7fed38163740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.965+0000 7fed3f000640 1 -- 172.21.15.59:0/1419618167 >> 172.21.15.59:0/1419618167 conn(0x7fed38067080 msgr2=0x7fed380736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.965+0000 7fed3f000640 1 -- 172.21.15.59:0/1419618167 shutdown_connections 2024-04-25T09:06:16.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:16.965+0000 7fed3f000640 1 -- 172.21.15.59:0/1419618167 wait complete. 2024-04-25T09:06:16.976 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:06:16.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:16.976 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:17.043 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:06:17.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:17.043 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:06:17.058 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:17.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf87200640 1 Processor -- start 2024-04-25T09:06:17.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf87200640 1 -- start start 2024-04-25T09:06:17.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf87200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8815daf0 0x7fbf880ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf87200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbf8806ac10 0x7fbf8806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf87200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf880b2870 con 0x7fbf880cf9f0 2024-04-25T09:06:17.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf87200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8815ded0 con 0x7fbf8806ac10 2024-04-25T09:06:17.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf87200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880ca860 con 0x7fbf8815daf0 2024-04-25T09:06:17.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf86800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbf8806ac10 0x7fbf8806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf85e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8815daf0 0x7fbf880ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf86800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbf8806ac10 0x7fbf8806b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:42484/0 (socket says 172.21.15.59:42484) 2024-04-25T09:06:17.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf86800640 1 -- 172.21.15.59:0/1436047514 learned_addr learned my addr 172.21.15.59:0/1436047514 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:17.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf86800640 1 -- 172.21.15.59:0/1436047514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8815daf0 msgr2=0x7fbf880ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:17.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf86800640 1 --2- 172.21.15.59:0/1436047514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8815daf0 0x7fbf880ad3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf86800640 1 -- 172.21.15.59:0/1436047514 >> v1:172.21.15.178:6789/0 conn(0x7fbf880cf9f0 legacy=0x7fbf880ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf86800640 1 -- 172.21.15.59:0/1436047514 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf880b2ae0 con 0x7fbf8806ac10 2024-04-25T09:06:17.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.249+0000 7fbf85e00640 1 --2- 172.21.15.59:0/1436047514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8815daf0 0x7fbf880ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:17.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.253+0000 7fbf86800640 1 --2- 172.21.15.59:0/1436047514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8806ac10 0x7fbf8806b0a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009e50 tx=0x7fbf8001ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d0934651a7a7bdf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:17.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.253+0000 7fbf85400640 1 -- 172.21.15.59:0/1436047514 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf800a57f0 con 0x7fbf8806ac10 2024-04-25T09:06:17.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.253+0000 7fbf85400640 1 -- 172.21.15.59:0/1436047514 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf800a5990 con 0x7fbf8806ac10 2024-04-25T09:06:17.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.253+0000 7fbf85400640 1 -- 172.21.15.59:0/1436047514 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf800a5d60 con 0x7fbf8806ac10 2024-04-25T09:06:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.253+0000 7fbf87200640 1 -- 172.21.15.59:0/1436047514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8806ac10 msgr2=0x7fbf8806b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.253+0000 7fbf87200640 1 --2- 172.21.15.59:0/1436047514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8806ac10 0x7fbf8806b0a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fbf80009e50 tx=0x7fbf8001ca30 comp rx=0 tx=0).stop 2024-04-25T09:06:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.253+0000 7fbf87200640 1 -- 172.21.15.59:0/1436047514 shutdown_connections 2024-04-25T09:06:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.253+0000 7fbf87200640 1 --2- 172.21.15.59:0/1436047514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf8806ac10 0x7fbf8806b0a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.253+0000 7fbf87200640 1 --2- 172.21.15.59:0/1436047514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8815daf0 0x7fbf880ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.253+0000 7fbf87200640 1 -- 172.21.15.59:0/1436047514 >> 172.21.15.59:0/1436047514 conn(0x7fbf88099a60 msgr2=0x7fbf880b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.253+0000 7fbf87200640 1 -- 172.21.15.59:0/1436047514 shutdown_connections 2024-04-25T09:06:17.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.253+0000 7fbf87200640 1 -- 172.21.15.59:0/1436047514 wait complete. 2024-04-25T09:06:17.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf87200640 1 Processor -- start 2024-04-25T09:06:17.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf87200640 1 -- start start 2024-04-25T09:06:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf87200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8806ac10 0x7fbf880cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf87200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf880cf9f0 0x7fbf880cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf87200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf8815daf0 0x7fbf8813cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf87200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880cf220 con 0x7fbf8815daf0 2024-04-25T09:06:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf87200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880ce1a0 con 0x7fbf880cf9f0 2024-04-25T09:06:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf87200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf880cf3a0 con 0x7fbf8806ac10 2024-04-25T09:06:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf85e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8806ac10 0x7fbf880cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf86800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf8815daf0 0x7fbf8813cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf85e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8806ac10 0x7fbf880cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:41054/0 (socket says 172.21.15.59:41054) 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf85e00640 1 -- 172.21.15.59:0/2034296815 learned_addr learned my addr 172.21.15.59:0/2034296815 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf7fe00640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf880cf9f0 0x7fbf880cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf85e00640 1 -- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf880cf9f0 msgr2=0x7fbf880cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf85e00640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf880cf9f0 0x7fbf880cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf85e00640 1 -- 172.21.15.59:0/2034296815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf8815daf0 msgr2=0x7fbf8813cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf85e00640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf8815daf0 0x7fbf8813cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf85e00640 1 -- 172.21.15.59:0/2034296815 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf880cf7c0 con 0x7fbf8806ac10 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf85e00640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8806ac10 0x7fbf880cce30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800e9b0 tx=0x7fbf7800ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf7e000640 1 -- 172.21.15.59:0/2034296815 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf78017070 con 0x7fbf8806ac10 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf7e000640 1 -- 172.21.15.59:0/2034296815 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7800ca00 con 0x7fbf8806ac10 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf7e000640 1 -- 172.21.15.59:0/2034296815 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7800cdd0 con 0x7fbf8806ac10 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf87200640 1 -- 172.21.15.59:0/2034296815 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf880cd8b0 con 0x7fbf8806ac10 2024-04-25T09:06:17.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf87200640 1 -- 172.21.15.59:0/2034296815 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf880b55a0 con 0x7fbf8806ac10 2024-04-25T09:06:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.257+0000 7fbf87200640 1 -- 172.21.15.59:0/2034296815 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8804efa0 con 0x7fbf8806ac10 2024-04-25T09:06:17.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.261+0000 7fbf7e000640 1 -- 172.21.15.59:0/2034296815 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbf7801a070 con 0x7fbf8806ac10 2024-04-25T09:06:17.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.261+0000 7fbf7e000640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbf64066f60 0x7fbf64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.261+0000 7fbf7e000640 1 -- 172.21.15.59:0/2034296815 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbf78084ff0 con 0x7fbf8806ac10 2024-04-25T09:06:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.261+0000 7fbf7fe00640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbf64066f60 0x7fbf64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.261+0000 7fbf7fe00640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbf64066f60 0x7fbf64069420 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbf88168570 tx=0x7fbf70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:17.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.265+0000 7fbf7e000640 1 -- 172.21.15.59:0/2034296815 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbf78055890 con 0x7fbf8806ac10 2024-04-25T09:06:17.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.461+0000 7fbf87200640 1 -- 172.21.15.59:0/2034296815 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf8806d1a0 con 0x7fbf8806ac10 2024-04-25T09:06:17.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.461+0000 7fbf7e000640 1 -- 172.21.15.59:0/2034296815 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fbf78059930 con 0x7fbf8806ac10 2024-04-25T09:06:17.455 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:17.455 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":48,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:07.181212+0000","modified":"2024-04-25T09:06:10.221503+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/1468235926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1468235926},{"type":"v1","addr":"172.21.15.59:6834","nonce":1468235926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:06:17.455 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 48 2024-04-25T09:06:17.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.465+0000 7fbf87200640 1 -- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbf64066f60 msgr2=0x7fbf64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.465+0000 7fbf87200640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbf64066f60 0x7fbf64069420 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbf88168570 tx=0x7fbf70009040 comp rx=0 tx=0).stop 2024-04-25T09:06:17.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.465+0000 7fbf87200640 1 -- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8806ac10 msgr2=0x7fbf880cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.465+0000 7fbf87200640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8806ac10 0x7fbf880cce30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbf7800e9b0 tx=0x7fbf7800ee70 comp rx=0 tx=0).stop 2024-04-25T09:06:17.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.465+0000 7fbf87200640 1 -- 172.21.15.59:0/2034296815 shutdown_connections 2024-04-25T09:06:17.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.465+0000 7fbf87200640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbf64066f60 0x7fbf64069420 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.465+0000 7fbf87200640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf8815daf0 0x7fbf8813cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.465+0000 7fbf87200640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbf880cf9f0 0x7fbf880cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.465+0000 7fbf87200640 1 --2- 172.21.15.59:0/2034296815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbf8806ac10 0x7fbf880cce30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.465+0000 7fbf87200640 1 -- 172.21.15.59:0/2034296815 >> 172.21.15.59:0/2034296815 conn(0x7fbf88099a60 msgr2=0x7fbf88157e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:17.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.465+0000 7fbf87200640 1 -- 172.21.15.59:0/2034296815 shutdown_connections 2024-04-25T09:06:17.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.465+0000 7fbf87200640 1 -- 172.21.15.59:0/2034296815 wait complete. 2024-04-25T09:06:17.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2024-04-25T09:06:17.643 INFO:teuthology.orchestra.run.smithi059.stdout:{"message":"","return_code":0} 2024-04-25T09:06:17.643 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:06:17.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:06:17.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a4800640 1 Processor -- start 2024-04-25T09:06:17.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a4800640 1 -- start start 2024-04-25T09:06:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a4800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe29c15dc00 0x7fe29c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a4800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe29c0c72a0 0x7fe29c0c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a4800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c0b30d0 con 0x7fe29c0d0150 2024-04-25T09:06:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a4800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29c0cd860 con 0x7fe29c15dc00 2024-04-25T09:06:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a4800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29c0ccf30 con 0x7fe29c0c72a0 2024-04-25T09:06:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a1e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe29c15dc00 0x7fe29c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a1e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe29c15dc00 0x7fe29c0af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45808/0 (socket says 172.21.15.59:45808) 2024-04-25T09:06:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a1e00640 1 -- 172.21.15.59:0/1382544051 learned_addr learned my addr 172.21.15.59:0/1382544051 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a2800640 1 --2- 172.21.15.59:0/1382544051 >> v2:172.21.15.178:3300/0 conn(0x7fe29c0c72a0 0x7fe29c0c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a1e00640 1 -- 172.21.15.59:0/1382544051 >> v2:172.21.15.178:3300/0 conn(0x7fe29c0c72a0 msgr2=0x7fe29c0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a1e00640 1 --2- 172.21.15.59:0/1382544051 >> v2:172.21.15.178:3300/0 conn(0x7fe29c0c72a0 0x7fe29c0c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a1e00640 1 -- 172.21.15.59:0/1382544051 >> v1:172.21.15.178:6789/0 conn(0x7fe29c0d0150 legacy=0x7fe29c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.793+0000 7fe2a1e00640 1 -- 172.21.15.59:0/1382544051 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0cd210 con 0x7fe29c15dc00 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.797+0000 7fe2a1e00640 1 --2- 172.21.15.59:0/1382544051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29c15dc00 0x7fe29c0af770 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0c6980 tx=0x7fe29001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcfd4712bc991a22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.797+0000 7fe2a0a00640 1 -- 172.21.15.59:0/1382544051 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900b0070 con 0x7fe29c15dc00 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.797+0000 7fe2a0a00640 1 -- 172.21.15.59:0/1382544051 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2900ab600 con 0x7fe29c15dc00 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.797+0000 7fe2a0a00640 1 -- 172.21.15.59:0/1382544051 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900ab9d0 con 0x7fe29c15dc00 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.797+0000 7fe2a4800640 1 -- 172.21.15.59:0/1382544051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29c15dc00 msgr2=0x7fe29c0af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.797+0000 7fe2a4800640 1 --2- 172.21.15.59:0/1382544051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29c15dc00 0x7fe29c0af770 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0c6980 tx=0x7fe29001c520 comp rx=0 tx=0).stop 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.797+0000 7fe2a4800640 1 -- 172.21.15.59:0/1382544051 shutdown_connections 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.797+0000 7fe2a4800640 1 --2- 172.21.15.59:0/1382544051 >> v2:172.21.15.178:3300/0 conn(0x7fe29c0c72a0 0x7fe29c0c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.797+0000 7fe2a4800640 1 --2- 172.21.15.59:0/1382544051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29c15dc00 0x7fe29c0af770 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.797+0000 7fe2a4800640 1 -- 172.21.15.59:0/1382544051 >> 172.21.15.59:0/1382544051 conn(0x7fe29c0b2240 msgr2=0x7fe29c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:17.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.797+0000 7fe2a4800640 1 -- 172.21.15.59:0/1382544051 shutdown_connections 2024-04-25T09:06:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.797+0000 7fe2a4800640 1 -- 172.21.15.59:0/1382544051 wait complete. 2024-04-25T09:06:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a4800640 1 Processor -- start 2024-04-25T09:06:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a4800640 1 -- start start 2024-04-25T09:06:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a4800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe29c0c72a0 0x7fe29c160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a4800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29c0d0150 0x7fe29c148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a4800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29c15dc00 0x7fe29c149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a4800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c16a7c0 con 0x7fe29c0d0150 2024-04-25T09:06:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a4800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c16a640 con 0x7fe29c0c72a0 2024-04-25T09:06:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a4800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c16a940 con 0x7fe29c15dc00 2024-04-25T09:06:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29c0d0150 0x7fe29c148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29c0d0150 0x7fe29c148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45810/0 (socket says 172.21.15.59:45810) 2024-04-25T09:06:17.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a1400640 1 -- 172.21.15.59:0/1274468864 learned_addr learned my addr 172.21.15.59:0/1274468864 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:17.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a1e00640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe29c0c72a0 0x7fe29c160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a2800640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29c15dc00 0x7fe29c149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a1400640 1 -- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29c15dc00 msgr2=0x7fe29c149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a1400640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29c15dc00 0x7fe29c149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a1400640 1 -- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe29c0c72a0 msgr2=0x7fe29c160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:17.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a1400640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe29c0c72a0 0x7fe29c160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:17.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a1400640 1 -- 172.21.15.59:0/1274468864 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c148cc0 con 0x7fe29c0d0150 2024-04-25T09:06:17.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a1400640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29c0d0150 0x7fe29c148780 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00c420 tx=0x7fe28c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:17.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe296000640 1 -- 172.21.15.59:0/1274468864 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0052d0 con 0x7fe29c0d0150 2024-04-25T09:06:17.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe296000640 1 -- 172.21.15.59:0/1274468864 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c005470 con 0x7fe29c0d0150 2024-04-25T09:06:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a4800640 1 -- 172.21.15.59:0/1274468864 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29c0b44a0 con 0x7fe29c0d0150 2024-04-25T09:06:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe296000640 1 -- 172.21.15.59:0/1274468864 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c007260 con 0x7fe29c0d0150 2024-04-25T09:06:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.801+0000 7fe2a4800640 1 -- 172.21.15.59:0/1274468864 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29c149190 con 0x7fe29c0d0150 2024-04-25T09:06:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.805+0000 7fe2a4800640 1 -- 172.21.15.59:0/1274468864 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29c0745d0 con 0x7fe29c0d0150 2024-04-25T09:06:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.805+0000 7fe296000640 1 -- 172.21.15.59:0/1274468864 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe28c007400 con 0x7fe29c0d0150 2024-04-25T09:06:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.805+0000 7fe296000640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe280066f90 0x7fe280069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.805+0000 7fe296000640 1 -- 172.21.15.59:0/1274468864 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe28c084530 con 0x7fe29c0d0150 2024-04-25T09:06:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.805+0000 7fe2a1e00640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe280066f90 0x7fe280069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.805+0000 7fe2a1e00640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe280066f90 0x7fe280069450 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ad000 tx=0x7fe290008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:17.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:17.809+0000 7fe296000640 1 -- 172.21.15.59:0/1274468864 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe29c0b44a0 con 0x7fe29c0d0150 2024-04-25T09:06:17.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.005+0000 7fe2a4800640 1 -- 172.21.15.59:0/1274468864 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe29c1583c0 con 0x7fe29c0d0150 2024-04-25T09:06:17.999 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:06:18.005+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:06:18.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.009+0000 7fe296000640 1 -- 172.21.15.59:0/1274468864 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe28c054df0 con 0x7fe29c0d0150 2024-04-25T09:06:18.001 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:06:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.009+0000 7fe2a4800640 1 -- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe280066f90 msgr2=0x7fe280069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.009+0000 7fe2a4800640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe280066f90 0x7fe280069450 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ad000 tx=0x7fe290008040 comp rx=0 tx=0).stop 2024-04-25T09:06:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.009+0000 7fe2a4800640 1 -- 172.21.15.59:0/1274468864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29c0d0150 msgr2=0x7fe29c148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.009+0000 7fe2a4800640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29c0d0150 0x7fe29c148780 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fe28c00c420 tx=0x7fe28c00c8e0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.013+0000 7fe2a4800640 1 -- 172.21.15.59:0/1274468864 shutdown_connections 2024-04-25T09:06:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.013+0000 7fe2a4800640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe280066f90 0x7fe280069450 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.013+0000 7fe2a4800640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe29c15dc00 0x7fe29c149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.013+0000 7fe2a4800640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29c0d0150 0x7fe29c148780 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.013+0000 7fe2a4800640 1 --2- 172.21.15.59:0/1274468864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe29c0c72a0 0x7fe29c160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.013+0000 7fe2a4800640 1 -- 172.21.15.59:0/1274468864 >> 172.21.15.59:0/1274468864 conn(0x7fe29c0b2240 msgr2=0x7fe29c1576f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.013+0000 7fe2a4800640 1 -- 172.21.15.59:0/1274468864 shutdown_connections 2024-04-25T09:06:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.013+0000 7fe2a4800640 1 -- 172.21.15.59:0/1274468864 wait complete. 2024-04-25T09:06:18.012 INFO:tasks.ceph.mds.c.smithi059.stderr: -4356> 2024-04-25T09:06:12.765+0000 7faf9fa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:06:18.025 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-25T09:06:18.062 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T09:06:18.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f6511e4e080 1 Processor -- start 2024-04-25T09:06:18.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f6511e4e080 1 -- start start 2024-04-25T09:06:18.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f6511e4e080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 0x5587a27880f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f6511e4e080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587a276f490 0x5587a2821060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f6511e4e080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5587a276f870 0x5587a28215a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f6511e4e080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587a2771af0 con 0x5587a26b9770 2024-04-25T09:06:18.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f6511e4e080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587a265d9f0 con 0x5587a276f490 2024-04-25T09:06:18.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f6511e4e080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587a2771c70 con 0x5587a276f870 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f650f000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 0x5587a27880f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f650f000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 0x5587a27880f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45856/0 (socket says 172.21.15.59:45856) 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f650f000640 1 -- 172.21.15.59:0/617803508 learned_addr learned my addr 172.21.15.59:0/617803508 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f650f000640 1 -- 172.21.15.59:0/617803508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5587a276f870 msgr2=0x5587a28215a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f650fa00640 1 --2- 172.21.15.59:0/617803508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5587a276f870 0x5587a28215a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f650e600640 1 --2- 172.21.15.59:0/617803508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587a276f490 0x5587a2821060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f650f000640 1 --2- 172.21.15.59:0/617803508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5587a276f870 0x5587a28215a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f650f000640 1 -- 172.21.15.59:0/617803508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587a276f490 msgr2=0x5587a2821060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f650f000640 1 --2- 172.21.15.59:0/617803508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587a276f490 0x5587a2821060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f650f000640 1 -- 172.21.15.59:0/617803508 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587a278a9c0 con 0x5587a26b9770 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f650fa00640 1 --2- 172.21.15.59:0/617803508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5587a276f870 0x5587a28215a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.081+0000 7f650e600640 1 --2- 172.21.15.59:0/617803508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587a276f490 0x5587a2821060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650f000640 1 --2- 172.21.15.59:0/617803508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 0x5587a27880f0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f6500009950 tx=0x7f6500005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b8d3c1c3cd901 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650d200640 1 -- 172.21.15.59:0/617803508 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500008d40 con 0x5587a26b9770 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650d200640 1 -- 172.21.15.59:0/617803508 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6500018070 con 0x5587a26b9770 2024-04-25T09:06:18.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650d200640 1 -- 172.21.15.59:0/617803508 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500013640 con 0x5587a26b9770 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 -- 172.21.15.59:0/617803508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 msgr2=0x5587a27880f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 --2- 172.21.15.59:0/617803508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 0x5587a27880f0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f6500009950 tx=0x7f6500005a10 comp rx=0 tx=0).stop 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 -- 172.21.15.59:0/617803508 shutdown_connections 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 --2- 172.21.15.59:0/617803508 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5587a276f870 0x5587a28215a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 --2- 172.21.15.59:0/617803508 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587a276f490 0x5587a2821060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 --2- 172.21.15.59:0/617803508 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 0x5587a27880f0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 -- 172.21.15.59:0/617803508 >> 172.21.15.59:0/617803508 conn(0x5587a26b73b0 msgr2=0x5587a278cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 -- 172.21.15.59:0/617803508 shutdown_connections 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 -- 172.21.15.59:0/617803508 wait complete. 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 Processor -- start 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 -- start start 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 0x5587a276ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5587a276f490 0x5587a26e2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587a276f870 0x5587a26e2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587a278ac60 con 0x5587a26b9770 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587a278a760 con 0x5587a276f870 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6511e4e080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587a278af00 con 0x5587a276f490 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650f000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 0x5587a276ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650f000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 0x5587a276ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45866/0 (socket says 172.21.15.59:45866) 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650f000640 1 -- 172.21.15.59:0/819226266 learned_addr learned my addr 172.21.15.59:0/819226266 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650fa00640 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587a276f870 0x5587a26e2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650e600640 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5587a276f490 0x5587a26e2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650f000640 1 -- 172.21.15.59:0/819226266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5587a276f490 msgr2=0x5587a26e2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650f000640 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5587a276f490 0x5587a26e2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650f000640 1 -- 172.21.15.59:0/819226266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587a276f870 msgr2=0x5587a26e2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650f000640 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5587a276f870 0x5587a26e2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650f000640 1 -- 172.21.15.59:0/819226266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587a28262c0 con 0x5587a26b9770 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f650f000640 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 0x5587a276ec30 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6500013700 tx=0x7f6500003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6507400640 1 -- 172.21.15.59:0/819226266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500013af0 con 0x5587a26b9770 2024-04-25T09:06:18.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6507400640 1 -- 172.21.15.59:0/819226266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6500021070 con 0x5587a26b9770 2024-04-25T09:06:18.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.085+0000 7f6507400640 1 -- 172.21.15.59:0/819226266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500026470 con 0x5587a26b9770 2024-04-25T09:06:18.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.089+0000 7f6511e4e080 1 -- 172.21.15.59:0/819226266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5587a2826560 con 0x5587a26b9770 2024-04-25T09:06:18.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.089+0000 7f6511e4e080 1 -- 172.21.15.59:0/819226266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5587a2826aa0 con 0x5587a26b9770 2024-04-25T09:06:18.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.089+0000 7f6507400640 1 -- 172.21.15.59:0/819226266 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f650001c400 con 0x5587a26b9770 2024-04-25T09:06:18.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.089+0000 7f6507400640 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f64f0065970 0x7f64f0067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.089+0000 7f6507400640 1 -- 172.21.15.59:0/819226266 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f65000869d0 con 0x5587a26b9770 2024-04-25T09:06:18.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.089+0000 7f6511e4e080 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x5587a2826f40 0x5587a2827320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.089+0000 7f650e600640 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f64f0065970 0x7f64f0067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.089+0000 7f6511e4e080 1 -- 172.21.15.59:0/819226266 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81) v9 -- 0x5587a2827860 con 0x5587a2826f40 2024-04-25T09:06:18.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.089+0000 7f650fa00640 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x5587a2826f40 0x5587a2827320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.089+0000 7f650e600640 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f64f0065970 0x7f64f0067e30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00e4d0 tx=0x7f64fc003690 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.089+0000 7f650fa00640 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x5587a2826f40 0x5587a2827320 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.093+0000 7f650fa00640 1 -- 172.21.15.59:0/819226266 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v81'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f65080ab530 con 0x5587a2826f40 2024-04-25T09:06:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.093+0000 7f6511e4e080 1 -- 172.21.15.59:0/819226266 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x5587a2826f40 msgr2=0x5587a2827320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.093+0000 7f6511e4e080 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x5587a2826f40 0x5587a2827320 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.093+0000 7f6511e4e080 1 -- 172.21.15.59:0/819226266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f64f0065970 msgr2=0x7f64f0067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.093+0000 7f6511e4e080 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f64f0065970 0x7f64f0067e30 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f64fc00e4d0 tx=0x7f64fc003690 comp rx=0 tx=0).stop 2024-04-25T09:06:18.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.093+0000 7f6511e4e080 1 -- 172.21.15.59:0/819226266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 msgr2=0x5587a276ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.093+0000 7f6511e4e080 1 --2- 172.21.15.59:0/819226266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5587a26b9770 0x5587a276ec30 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6500013700 tx=0x7f6500003030 comp rx=0 tx=0).stop 2024-04-25T09:06:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.093+0000 7f650fa00640 1 -- 172.21.15.59:0/819226266 reap_dead start 2024-04-25T09:06:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.093+0000 7f6511e4e080 1 -- 172.21.15.59:0/819226266 shutdown_connections 2024-04-25T09:06:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.093+0000 7f6511e4e080 1 -- 172.21.15.59:0/819226266 >> 172.21.15.59:0/819226266 conn(0x5587a26b73b0 msgr2=0x5587a2789bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.093+0000 7f6511e4e080 1 -- 172.21.15.59:0/819226266 shutdown_connections 2024-04-25T09:06:18.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.093+0000 7f6511e4e080 1 -- 172.21.15.59:0/819226266 wait complete. 2024-04-25T09:06:18.092 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:06:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.289+0000 7fd15e400640 1 Processor -- start 2024-04-25T09:06:18.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.289+0000 7fd15e400640 1 -- start start 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd15e400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd15815e770 0x7fd15815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd15e400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd15806d2d0 0x7fd15815f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd15e400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd158071270 0x7fd158071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd15e400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15815f090 con 0x7fd158071270 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd15e400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15806db20 con 0x7fd15806d2d0 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd15e400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15806de00 con 0x7fd15815e770 2024-04-25T09:06:18.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd157e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd158071270 0x7fd158071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd157e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd158071270 0x7fd158071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45874/0 (socket says 172.21.15.59:45874) 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd157e00640 1 -- 172.21.15.59:0/2422403399 learned_addr learned my addr 172.21.15.59:0/2422403399 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd14fe00640 1 --2- 172.21.15.59:0/2422403399 >> v2:172.21.15.178:3300/0 conn(0x7fd15806d2d0 0x7fd15815f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd157400640 1 --2- 172.21.15.59:0/2422403399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd15815e770 0x7fd15815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd157e00640 1 -- 172.21.15.59:0/2422403399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd15815e770 msgr2=0x7fd15815eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:18.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd157e00640 1 --2- 172.21.15.59:0/2422403399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd15815e770 0x7fd15815eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd157e00640 1 -- 172.21.15.59:0/2422403399 >> v2:172.21.15.178:3300/0 conn(0x7fd15806d2d0 msgr2=0x7fd15815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:18.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd157e00640 1 --2- 172.21.15.59:0/2422403399 >> v2:172.21.15.178:3300/0 conn(0x7fd15806d2d0 0x7fd15815f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.293+0000 7fd157e00640 1 -- 172.21.15.59:0/2422403399 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15806e0e0 con 0x7fd158071270 2024-04-25T09:06:18.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd157e00640 1 --2- 172.21.15.59:0/2422403399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd158071270 0x7fd158071700 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd15806b9b0 tx=0x7fd15001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c141e7be96caf7c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd156a00640 1 -- 172.21.15.59:0/2422403399 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500a56f0 con 0x7fd158071270 2024-04-25T09:06:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd156a00640 1 -- 172.21.15.59:0/2422403399 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1500a5890 con 0x7fd158071270 2024-04-25T09:06:18.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd156a00640 1 -- 172.21.15.59:0/2422403399 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500a5c60 con 0x7fd158071270 2024-04-25T09:06:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 -- 172.21.15.59:0/2422403399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd158071270 msgr2=0x7fd158071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 --2- 172.21.15.59:0/2422403399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd158071270 0x7fd158071700 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7fd15806b9b0 tx=0x7fd15001c960 comp rx=0 tx=0).stop 2024-04-25T09:06:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 -- 172.21.15.59:0/2422403399 shutdown_connections 2024-04-25T09:06:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 --2- 172.21.15.59:0/2422403399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd158071270 0x7fd158071700 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 --2- 172.21.15.59:0/2422403399 >> v2:172.21.15.178:3300/0 conn(0x7fd15806d2d0 0x7fd15815f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 --2- 172.21.15.59:0/2422403399 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd15815e770 0x7fd15815eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 -- 172.21.15.59:0/2422403399 >> 172.21.15.59:0/2422403399 conn(0x7fd158067080 msgr2=0x7fd15806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 -- 172.21.15.59:0/2422403399 shutdown_connections 2024-04-25T09:06:18.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 -- 172.21.15.59:0/2422403399 wait complete. 2024-04-25T09:06:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 Processor -- start 2024-04-25T09:06:18.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 -- start start 2024-04-25T09:06:18.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd15806d2d0 0x7fd15814a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.297+0000 7fd15e400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd158071270 0x7fd15814bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd15e400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd15815e770 0x7fd158157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd15e400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15806d830 con 0x7fd15806d2d0 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd15e400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15806d6b0 con 0x7fd15815e770 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd15e400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580aed70 con 0x7fd158071270 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd157400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd15806d2d0 0x7fd15814a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd157400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd15806d2d0 0x7fd15814a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45888/0 (socket says 172.21.15.59:45888) 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd157400640 1 -- 172.21.15.59:0/2741322977 learned_addr learned my addr 172.21.15.59:0/2741322977 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd14fe00640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd158071270 0x7fd15814bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd157e00640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd15815e770 0x7fd158157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd157400640 1 -- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd158071270 msgr2=0x7fd15814bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd157400640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd158071270 0x7fd15814bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd157400640 1 -- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd15815e770 msgr2=0x7fd158157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd157400640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd15815e770 0x7fd158157d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd157400640 1 -- 172.21.15.59:0/2741322977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15814aaf0 con 0x7fd15806d2d0 2024-04-25T09:06:18.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd157400640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd15806d2d0 0x7fd15814a5b0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd14800d620 tx=0x7fd14800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd14f400640 1 -- 172.21.15.59:0/2741322977 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800b620 con 0x7fd15806d2d0 2024-04-25T09:06:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd14f400640 1 -- 172.21.15.59:0/2741322977 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd148019070 con 0x7fd15806d2d0 2024-04-25T09:06:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd15e400640 1 -- 172.21.15.59:0/2741322977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1580b1b20 con 0x7fd15806d2d0 2024-04-25T09:06:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd14f400640 1 -- 172.21.15.59:0/2741322977 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800b9e0 con 0x7fd15806d2d0 2024-04-25T09:06:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd15e400640 1 -- 172.21.15.59:0/2741322977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1580b20e0 con 0x7fd15806d2d0 2024-04-25T09:06:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd15e400640 1 -- 172.21.15.59:0/2741322977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1580745d0 con 0x7fd15806d2d0 2024-04-25T09:06:18.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.301+0000 7fd14f400640 1 -- 172.21.15.59:0/2741322977 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd14800bb80 con 0x7fd15806d2d0 2024-04-25T09:06:18.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.305+0000 7fd14f400640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd134066f60 0x7fd134069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:18.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.305+0000 7fd14f400640 1 -- 172.21.15.59:0/2741322977 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd148085660 con 0x7fd15806d2d0 2024-04-25T09:06:18.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.305+0000 7fd14fe00640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd134066f60 0x7fd134069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:18.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.305+0000 7fd14fe00640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd134066f60 0x7fd134069420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd15815dfa0 tx=0x7fd140008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:18.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.309+0000 7fd14f400640 1 -- 172.21.15.59:0/2741322977 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd1480563f0 con 0x7fd15806d2d0 2024-04-25T09:06:18.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:18.505+0000 7fd15e400640 1 -- 172.21.15.59:0/2741322977 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fd15806e8d0 con 0x7fd15806d2d0 2024-04-25T09:06:19.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.009+0000 7fd14f400640 1 -- 172.21.15.59:0/2741322977 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v50) v1 ==== 162+0+0 (secure 0 0 0) 0x7fd148055cf0 con 0x7fd15806d2d0 2024-04-25T09:06:19.003 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:06:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.013+0000 7fd15e400640 1 -- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd134066f60 msgr2=0x7fd134069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.013+0000 7fd15e400640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd134066f60 0x7fd134069420 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd15815dfa0 tx=0x7fd140008040 comp rx=0 tx=0).stop 2024-04-25T09:06:19.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.013+0000 7fd15e400640 1 -- 172.21.15.59:0/2741322977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd15806d2d0 msgr2=0x7fd15814a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.013+0000 7fd15e400640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd15806d2d0 0x7fd15814a5b0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd14800d620 tx=0x7fd14800dae0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.013+0000 7fd15e400640 1 -- 172.21.15.59:0/2741322977 shutdown_connections 2024-04-25T09:06:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.013+0000 7fd15e400640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd134066f60 0x7fd134069420 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.013+0000 7fd15e400640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd15815e770 0x7fd158157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.013+0000 7fd15e400640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd158071270 0x7fd15814bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.013+0000 7fd15e400640 1 --2- 172.21.15.59:0/2741322977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd15806d2d0 0x7fd15814a5b0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.013+0000 7fd15e400640 1 -- 172.21.15.59:0/2741322977 >> 172.21.15.59:0/2741322977 conn(0x7fd158067080 msgr2=0x7fd1580b0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.013+0000 7fd15e400640 1 -- 172.21.15.59:0/2741322977 shutdown_connections 2024-04-25T09:06:19.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.013+0000 7fd15e400640 1 -- 172.21.15.59:0/2741322977 wait complete. 2024-04-25T09:06:19.031 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:19.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.181+0000 7f4682600640 1 Processor -- start 2024-04-25T09:06:19.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.181+0000 7f4682600640 1 -- start start 2024-04-25T09:06:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.181+0000 7f4682600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c145270 0x7f467c15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.181+0000 7f4682600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f467c0cd4d0 0x7f467c0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.181+0000 7f4682600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f467c0b1750 0x7f467c0b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.181+0000 7f4682600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c0b20e0 con 0x7f467c0b1750 2024-04-25T09:06:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.181+0000 7f4682600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f467c145650 con 0x7f467c0cd4d0 2024-04-25T09:06:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.181+0000 7f4682600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c0cc4e0 con 0x7f467c145270 2024-04-25T09:06:19.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f467c0b1750 0x7f467c0b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:19.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f467c0b1750 0x7f467c0b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45898/0 (socket says 172.21.15.59:45898) 2024-04-25T09:06:19.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467be00640 1 -- 172.21.15.59:0/1565076828 learned_addr learned my addr 172.21.15.59:0/1565076828 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f4672a00640 1 --2- 172.21.15.59:0/1565076828 >> v2:172.21.15.178:3300/0 conn(0x7f467c0cd4d0 0x7f467c0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467b400640 1 --2- 172.21.15.59:0/1565076828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c145270 0x7f467c15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467be00640 1 -- 172.21.15.59:0/1565076828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c145270 msgr2=0x7f467c15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467be00640 1 --2- 172.21.15.59:0/1565076828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c145270 0x7f467c15fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467be00640 1 -- 172.21.15.59:0/1565076828 >> v2:172.21.15.178:3300/0 conn(0x7f467c0cd4d0 msgr2=0x7f467c0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467be00640 1 --2- 172.21.15.59:0/1565076828 >> v2:172.21.15.178:3300/0 conn(0x7f467c0cd4d0 0x7f467c0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467be00640 1 -- 172.21.15.59:0/1565076828 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c0ce040 con 0x7f467c0b1750 2024-04-25T09:06:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467be00640 1 --2- 172.21.15.59:0/1565076828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c0b1750 0x7f467c0b1ba0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f467c0b23c0 tx=0x7f467401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d9942075b2284d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467aa00640 1 -- 172.21.15.59:0/1565076828 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740a5760 con 0x7f467c0b1750 2024-04-25T09:06:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467aa00640 1 -- 172.21.15.59:0/1565076828 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46740a5900 con 0x7f467c0b1750 2024-04-25T09:06:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.185+0000 7f467aa00640 1 -- 172.21.15.59:0/1565076828 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740a5cd0 con 0x7f467c0b1750 2024-04-25T09:06:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 -- 172.21.15.59:0/1565076828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c0b1750 msgr2=0x7f467c0b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 --2- 172.21.15.59:0/1565076828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c0b1750 0x7f467c0b1ba0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f467c0b23c0 tx=0x7f467401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 -- 172.21.15.59:0/1565076828 shutdown_connections 2024-04-25T09:06:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 --2- 172.21.15.59:0/1565076828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c0b1750 0x7f467c0b1ba0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 --2- 172.21.15.59:0/1565076828 >> v2:172.21.15.178:3300/0 conn(0x7f467c0cd4d0 0x7f467c0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 --2- 172.21.15.59:0/1565076828 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c145270 0x7f467c15fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 -- 172.21.15.59:0/1565076828 >> 172.21.15.59:0/1565076828 conn(0x7f467c066fa0 msgr2=0x7f467c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:19.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 -- 172.21.15.59:0/1565076828 shutdown_connections 2024-04-25T09:06:19.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 -- 172.21.15.59:0/1565076828 wait complete. 2024-04-25T09:06:19.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 Processor -- start 2024-04-25T09:06:19.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 -- start start 2024-04-25T09:06:19.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c0b1750 0x7f467c161d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:19.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c0cd4d0 0x7f467c13c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:19.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c145270 0x7f467c141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:19.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c15c590 con 0x7f467c145270 2024-04-25T09:06:19.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467c15f930 con 0x7f467c0b1750 2024-04-25T09:06:19.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4682600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c15c710 con 0x7f467c0cd4d0 2024-04-25T09:06:19.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f467be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c145270 0x7f467c141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f467be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c145270 0x7f467c141260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:45902/0 (socket says 172.21.15.59:45902) 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f467be00640 1 -- 172.21.15.59:0/2845131041 learned_addr learned my addr 172.21.15.59:0/2845131041 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f467b400640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c0b1750 0x7f467c161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.189+0000 7f4672a00640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c0cd4d0 0x7f467c13c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f467be00640 1 -- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c0cd4d0 msgr2=0x7f467c13c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f467be00640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c0cd4d0 0x7f467c13c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f467be00640 1 -- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c0b1750 msgr2=0x7f467c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f467be00640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c0b1750 0x7f467c161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f467be00640 1 -- 172.21.15.59:0/2845131041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c141cb0 con 0x7f467c145270 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f467be00640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c145270 0x7f467c141260 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f467401b0a0 tx=0x7f4674019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f4673e00640 1 -- 172.21.15.59:0/2845131041 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674009510 con 0x7f467c145270 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f4673e00640 1 -- 172.21.15.59:0/2845131041 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46740be070 con 0x7f467c145270 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f4682600640 1 -- 172.21.15.59:0/2845131041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f467c141f90 con 0x7f467c145270 2024-04-25T09:06:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f4673e00640 1 -- 172.21.15.59:0/2845131041 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46740b88b0 con 0x7f467c145270 2024-04-25T09:06:19.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f4682600640 1 -- 172.21.15.59:0/2845131041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f467c161570 con 0x7f467c145270 2024-04-25T09:06:19.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f4682600640 1 -- 172.21.15.59:0/2845131041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f467c0745d0 con 0x7f467c145270 2024-04-25T09:06:19.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f4673e00640 1 -- 172.21.15.59:0/2845131041 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f46740b8a50 con 0x7f467c145270 2024-04-25T09:06:19.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f4673e00640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4658066f60 0x7f4658069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:19.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f4673e00640 1 -- 172.21.15.59:0/2845131041 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4674120480 con 0x7f467c145270 2024-04-25T09:06:19.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.193+0000 7f467b400640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4658066f60 0x7f4658069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:19.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.197+0000 7f467b400640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4658066f60 0x7f4658069420 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f467c1f7960 tx=0x7f466c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.197+0000 7f4673e00640 1 -- 172.21.15.59:0/2845131041 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f46740165e0 con 0x7f467c145270 2024-04-25T09:06:19.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.393+0000 7f4682600640 1 -- 172.21.15.59:0/2845131041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f467c15d750 con 0x7f467c145270 2024-04-25T09:06:19.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.393+0000 7f4673e00640 1 -- 172.21.15.59:0/2845131041 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f46740f13f0 con 0x7f467c145270 2024-04-25T09:06:19.386 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:19.387 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":51,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:07.181212+0000","modified":"2024-04-25T09:06:19.018309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":51,"state":"up:replay","state_seq":1,"addr":"172.21.15.59:6834/1033010830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1033010830},{"type":"v1","addr":"172.21.15.59:6834","nonce":1033010830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:06:19.387 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 51 2024-04-25T09:06:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.397+0000 7f4682600640 1 -- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4658066f60 msgr2=0x7f4658069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.397+0000 7f4682600640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4658066f60 0x7f4658069420 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f467c1f7960 tx=0x7f466c009190 comp rx=0 tx=0).stop 2024-04-25T09:06:19.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.397+0000 7f4682600640 1 -- 172.21.15.59:0/2845131041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c145270 msgr2=0x7f467c141260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.397+0000 7f4682600640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c145270 0x7f467c141260 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f467401b0a0 tx=0x7f4674019790 comp rx=0 tx=0).stop 2024-04-25T09:06:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.397+0000 7f4682600640 1 -- 172.21.15.59:0/2845131041 shutdown_connections 2024-04-25T09:06:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.397+0000 7f4682600640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4658066f60 0x7f4658069420 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.397+0000 7f4682600640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c145270 0x7f467c141260 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.397+0000 7f4682600640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f467c0cd4d0 0x7f467c13c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.397+0000 7f4682600640 1 --2- 172.21.15.59:0/2845131041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c0b1750 0x7f467c161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.397+0000 7f4682600640 1 -- 172.21.15.59:0/2845131041 >> 172.21.15.59:0/2845131041 conn(0x7f467c066fa0 msgr2=0x7f467c15e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.397+0000 7f4682600640 1 -- 172.21.15.59:0/2845131041 shutdown_connections 2024-04-25T09:06:19.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:19.397+0000 7f4682600640 1 -- 172.21.15.59:0/2845131041 wait complete. 2024-04-25T09:06:19.810 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:06:07.181212+0000', 'modified': '2024-04-25T09:06:19.018309+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 81, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6999}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6999': {'gid': 6999, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.59:6834/1033010830', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1033010830}, {'type': 'v1', 'addr': '172.21.15.59:6834', 'nonce': 1033010830}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:06:19.810 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6999:up:replay 2024-04-25T09:06:20.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:20.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc8fe00640 1 Processor -- start 2024-04-25T09:06:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc8fe00640 1 -- start start 2024-04-25T09:06:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc8fe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc8815b5a0 0x7fbc880cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc8fe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc880ce7f0 con 0x7fbc880cc440 2024-04-25T09:06:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc8fe00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc880cead0 con 0x7fbc8815b980 2024-04-25T09:06:20.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc8fe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880cfcd0 con 0x7fbc8815b5a0 2024-04-25T09:06:20.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc8de00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbc880cc440 0x7fbc880d0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34212/0 (socket says 172.21.15.59:34212) 2024-04-25T09:06:20.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc8de00640 1 -- 172.21.15.59:0/2486668717 learned_addr learned my addr 172.21.15.59:0/2486668717 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:20.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc8d400640 1 --2- 172.21.15.59:0/2486668717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc8815b5a0 0x7fbc880cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc87e00640 1 -- 172.21.15.59:0/2486668717 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661450398 0 0) 0x7fbc880ce7f0 con 0x7fbc880cc440 2024-04-25T09:06:20.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc87e00640 1 -- 172.21.15.59:0/2486668717 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc70003530 con 0x7fbc880cc440 2024-04-25T09:06:20.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc87e00640 1 -- 172.21.15.59:0/2486668717 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 150128578 0 0) 0x7fbc70003530 con 0x7fbc880cc440 2024-04-25T09:06:20.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc8d400640 1 -- 172.21.15.59:0/2486668717 >> v1:172.21.15.178:6789/0 conn(0x7fbc8815b980 legacy=0x7fbc880cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc8d400640 1 -- 172.21.15.59:0/2486668717 >> v1:172.21.15.59:6789/0 conn(0x7fbc880cc440 legacy=0x7fbc880d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.973+0000 7fbc8d400640 1 -- 172.21.15.59:0/2486668717 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc880cf960 con 0x7fbc8815b5a0 2024-04-25T09:06:20.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.977+0000 7fbc8d400640 1 --2- 172.21.15.59:0/2486668717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc8815b5a0 0x7fbc880cdea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0097f0 tx=0x7fbc7c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eba8bda377d4bc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.977+0000 7fbc87e00640 1 -- 172.21.15.59:0/2486668717 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0b1070 con 0x7fbc8815b5a0 2024-04-25T09:06:20.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.977+0000 7fbc87e00640 1 -- 172.21.15.59:0/2486668717 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c0ac400 con 0x7fbc8815b5a0 2024-04-25T09:06:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.977+0000 7fbc87e00640 1 -- 172.21.15.59:0/2486668717 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80001a00 con 0x7fbc8815b5a0 2024-04-25T09:06:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.977+0000 7fbc8fe00640 1 -- 172.21.15.59:0/2486668717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc8815b5a0 msgr2=0x7fbc880cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.977+0000 7fbc8fe00640 1 --2- 172.21.15.59:0/2486668717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc8815b5a0 0x7fbc880cdea0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0097f0 tx=0x7fbc7c01c400 comp rx=0 tx=0).stop 2024-04-25T09:06:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.977+0000 7fbc8fe00640 1 -- 172.21.15.59:0/2486668717 shutdown_connections 2024-04-25T09:06:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.977+0000 7fbc8fe00640 1 --2- 172.21.15.59:0/2486668717 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc8815b5a0 0x7fbc880cdea0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.977+0000 7fbc8fe00640 1 -- 172.21.15.59:0/2486668717 >> 172.21.15.59:0/2486668717 conn(0x7fbc880b3390 msgr2=0x7fbc880b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.977+0000 7fbc8fe00640 1 -- 172.21.15.59:0/2486668717 shutdown_connections 2024-04-25T09:06:20.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.977+0000 7fbc8fe00640 1 -- 172.21.15.59:0/2486668717 wait complete. 2024-04-25T09:06:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8fe00640 1 Processor -- start 2024-04-25T09:06:20.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8fe00640 1 -- start start 2024-04-25T09:06:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8fe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc880cc440 0x7fbc8814cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc8815b5a0 0x7fbc8815e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc8815b980 0x7fbc88150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880d1490 con 0x7fbc8815b5a0 2024-04-25T09:06:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8fe00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc880d1310 con 0x7fbc8815b980 2024-04-25T09:06:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8fe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc88169750 con 0x7fbc880cc440 2024-04-25T09:06:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc8815b5a0 0x7fbc8815e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc8815b5a0 0x7fbc8815e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56358/0 (socket says 172.21.15.59:56358) 2024-04-25T09:06:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8ca00640 1 -- 172.21.15.59:0/168950305 learned_addr learned my addr 172.21.15.59:0/168950305 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:20.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8d400640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc880cc440 0x7fbc8814cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8de00640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc8815b980 0x7fbc88150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8ca00640 1 -- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc880cc440 msgr2=0x7fbc8814cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8ca00640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc880cc440 0x7fbc8814cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8ca00640 1 -- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc8815b980 msgr2=0x7fbc88150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8ca00640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc8815b980 0x7fbc88150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8ca00640 1 -- 172.21.15.59:0/168950305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8815c0a0 con 0x7fbc8815b5a0 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8d400640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc880cc440 0x7fbc8814cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8ca00640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc8815b5a0 0x7fbc8815e620 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400c3c0 tx=0x7fbc7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc85600640 1 -- 172.21.15.59:0/168950305 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74017070 con 0x7fbc8815b5a0 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc85600640 1 -- 172.21.15.59:0/168950305 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc740052d0 con 0x7fbc8815b5a0 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc85600640 1 -- 172.21.15.59:0/168950305 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74003840 con 0x7fbc8815b5a0 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8fe00640 1 -- 172.21.15.59:0/168950305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc881517a0 con 0x7fbc8815b5a0 2024-04-25T09:06:20.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.981+0000 7fbc8fe00640 1 -- 172.21.15.59:0/168950305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8815de20 con 0x7fbc8815b5a0 2024-04-25T09:06:20.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.985+0000 7fbc8fe00640 1 -- 172.21.15.59:0/168950305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc880745d0 con 0x7fbc8815b5a0 2024-04-25T09:06:20.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.985+0000 7fbc85600640 1 -- 172.21.15.59:0/168950305 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbc7401a070 con 0x7fbc8815b5a0 2024-04-25T09:06:20.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.985+0000 7fbc85600640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbc68066f60 0x7fbc68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:20.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.985+0000 7fbc85600640 1 -- 172.21.15.59:0/168950305 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fbc740844a0 con 0x7fbc8815b5a0 2024-04-25T09:06:20.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.985+0000 7fbc8d400640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbc68066f60 0x7fbc68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:20.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.985+0000 7fbc8d400640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbc68066f60 0x7fbc68069420 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0ae000 tx=0x7fbc7c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:20.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:20.989+0000 7fbc85600640 1 -- 172.21.15.59:0/168950305 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbc74005480 con 0x7fbc8815b5a0 2024-04-25T09:06:21.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.185+0000 7fbc8fe00640 1 -- 172.21.15.59:0/168950305 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc880cc960 con 0x7fbc8815b5a0 2024-04-25T09:06:21.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.185+0000 7fbc85600640 1 -- 172.21.15.59:0/168950305 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fbc74054c70 con 0x7fbc8815b5a0 2024-04-25T09:06:21.178 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:21.179 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":53,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:07.181212+0000","modified":"2024-04-25T09:06:20.027550+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":51,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.59:6834/1033010830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1033010830},{"type":"v1","addr":"172.21.15.59:6834","nonce":1033010830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:06:21.179 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 53 2024-04-25T09:06:21.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.189+0000 7fbc8fe00640 1 -- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbc68066f60 msgr2=0x7fbc68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.189+0000 7fbc8fe00640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbc68066f60 0x7fbc68069420 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c0ae000 tx=0x7fbc7c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:06:21.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.189+0000 7fbc8fe00640 1 -- 172.21.15.59:0/168950305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc8815b5a0 msgr2=0x7fbc8815e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.189+0000 7fbc8fe00640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc8815b5a0 0x7fbc8815e620 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400c3c0 tx=0x7fbc7400c880 comp rx=0 tx=0).stop 2024-04-25T09:06:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.189+0000 7fbc8fe00640 1 -- 172.21.15.59:0/168950305 shutdown_connections 2024-04-25T09:06:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.189+0000 7fbc8fe00640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbc68066f60 0x7fbc68069420 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.189+0000 7fbc8fe00640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbc8815b980 0x7fbc88150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.189+0000 7fbc8fe00640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc8815b5a0 0x7fbc8815e620 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.189+0000 7fbc8fe00640 1 --2- 172.21.15.59:0/168950305 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbc880cc440 0x7fbc8814cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.189+0000 7fbc8fe00640 1 -- 172.21.15.59:0/168950305 >> 172.21.15.59:0/168950305 conn(0x7fbc880b3390 msgr2=0x7fbc880b4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.189+0000 7fbc8fe00640 1 -- 172.21.15.59:0/168950305 shutdown_connections 2024-04-25T09:06:21.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:21.189+0000 7fbc8fe00640 1 -- 172.21.15.59:0/168950305 wait complete. 2024-04-25T09:06:21.602 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:06:07.181212+0000', 'modified': '2024-04-25T09:06:20.027550+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 81, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6999}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6999': {'gid': 6999, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.59:6834/1033010830', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1033010830}, {'type': 'v1', 'addr': '172.21.15.59:6834', 'nonce': 1033010830}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:06:21.602 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6999:up:rejoin 2024-04-25T09:06:22.603 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:22.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb83000640 1 Processor -- start 2024-04-25T09:06:22.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb83000640 1 -- start start 2024-04-25T09:06:22.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb83000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c0b46f0 0x7feb7c15e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb83000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feb7c0669a0 0x7feb7c0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb83000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7c072ce0 con 0x7feb7c15d7b0 2024-04-25T09:06:22.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb83000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb7c0b3990 con 0x7feb7c0669a0 2024-04-25T09:06:22.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb83000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0b2dc0 con 0x7feb7c0b46f0 2024-04-25T09:06:22.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb82600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feb7c0669a0 0x7feb7c0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb81200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c0b46f0 0x7feb7c15e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb82600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7feb7c0669a0 0x7feb7c0adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:58746/0 (socket says 172.21.15.59:58746) 2024-04-25T09:06:22.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb82600640 1 -- 172.21.15.59:0/866892187 learned_addr learned my addr 172.21.15.59:0/866892187 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:22.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb81200640 1 -- 172.21.15.59:0/866892187 >> v2:172.21.15.178:3300/0 conn(0x7feb7c0669a0 msgr2=0x7feb7c0adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:22.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb81200640 1 --2- 172.21.15.59:0/866892187 >> v2:172.21.15.178:3300/0 conn(0x7feb7c0669a0 0x7feb7c0adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb81200640 1 -- 172.21.15.59:0/866892187 >> v1:172.21.15.178:6789/0 conn(0x7feb7c15d7b0 legacy=0x7feb7c0b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.761+0000 7feb81200640 1 -- 172.21.15.59:0/866892187 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c0b3060 con 0x7feb7c0b46f0 2024-04-25T09:06:22.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.765+0000 7feb81200640 1 --2- 172.21.15.59:0/866892187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c0b46f0 0x7feb7c15e890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feb680097c0 tx=0x7feb6801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce9751aea68d4c57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.765+0000 7feb7be00640 1 -- 172.21.15.59:0/866892187 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb680b2070 con 0x7feb7c0b46f0 2024-04-25T09:06:22.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.765+0000 7feb7be00640 1 -- 172.21.15.59:0/866892187 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb680ad640 con 0x7feb7c0b46f0 2024-04-25T09:06:22.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.765+0000 7feb7be00640 1 -- 172.21.15.59:0/866892187 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb680ada10 con 0x7feb7c0b46f0 2024-04-25T09:06:22.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.765+0000 7feb83000640 1 -- 172.21.15.59:0/866892187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c0b46f0 msgr2=0x7feb7c15e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.765+0000 7feb83000640 1 --2- 172.21.15.59:0/866892187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c0b46f0 0x7feb7c15e890 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feb680097c0 tx=0x7feb6801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.765+0000 7feb83000640 1 -- 172.21.15.59:0/866892187 shutdown_connections 2024-04-25T09:06:22.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.765+0000 7feb83000640 1 --2- 172.21.15.59:0/866892187 >> v2:172.21.15.178:3300/0 conn(0x7feb7c0669a0 0x7feb7c0adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.765+0000 7feb83000640 1 --2- 172.21.15.59:0/866892187 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c0b46f0 0x7feb7c15e890 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.765+0000 7feb83000640 1 -- 172.21.15.59:0/866892187 >> 172.21.15.59:0/866892187 conn(0x7feb7c0726f0 msgr2=0x7feb7c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.765+0000 7feb83000640 1 -- 172.21.15.59:0/866892187 shutdown_connections 2024-04-25T09:06:22.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.765+0000 7feb83000640 1 -- 172.21.15.59:0/866892187 wait complete. 2024-04-25T09:06:22.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb83000640 1 Processor -- start 2024-04-25T09:06:22.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb83000640 1 -- start start 2024-04-25T09:06:22.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb83000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb7c0669a0 0x7feb7c158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb83000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb7c0b46f0 0x7feb7c13b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb83000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c15d7b0 0x7feb7c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb83000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0ae9d0 con 0x7feb7c0b46f0 2024-04-25T09:06:22.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb83000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0ae850 con 0x7feb7c0669a0 2024-04-25T09:06:22.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb83000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c0aeb50 con 0x7feb7c15d7b0 2024-04-25T09:06:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb81200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb7c0b46f0 0x7feb7c13b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb81200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb7c0b46f0 0x7feb7c13b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56362/0 (socket says 172.21.15.59:56362) 2024-04-25T09:06:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb81200640 1 -- 172.21.15.59:0/1097120780 learned_addr learned my addr 172.21.15.59:0/1097120780 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb81c00640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb7c0669a0 0x7feb7c158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb82600640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c15d7b0 0x7feb7c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb81200640 1 -- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c15d7b0 msgr2=0x7feb7c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb81200640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c15d7b0 0x7feb7c06df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb81200640 1 -- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb7c0669a0 msgr2=0x7feb7c158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb81200640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb7c0669a0 0x7feb7c158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb81200640 1 -- 172.21.15.59:0/1097120780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7c157910 con 0x7feb7c0b46f0 2024-04-25T09:06:22.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb81c00640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb7c0669a0 0x7feb7c158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:22.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb82600640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c15d7b0 0x7feb7c06df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:22.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb81200640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb7c0b46f0 0x7feb7c13b460 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7feb6801a0d0 tx=0x7feb68019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb79600640 1 -- 172.21.15.59:0/1097120780 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb680ba020 con 0x7feb7c0b46f0 2024-04-25T09:06:22.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb79600640 1 -- 172.21.15.59:0/1097120780 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb680b6410 con 0x7feb7c0b46f0 2024-04-25T09:06:22.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb79600640 1 -- 172.21.15.59:0/1097120780 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb680b2040 con 0x7feb7c0b46f0 2024-04-25T09:06:22.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb83000640 1 -- 172.21.15.59:0/1097120780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c157bf0 con 0x7feb7c0b46f0 2024-04-25T09:06:22.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb83000640 1 -- 172.21.15.59:0/1097120780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7c1581b0 con 0x7feb7c0b46f0 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.769+0000 7feb83000640 1 -- 172.21.15.59:0/1097120780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7c158590 con 0x7feb7c0b46f0 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.773+0000 7feb79600640 1 -- 172.21.15.59:0/1097120780 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feb680bd020 con 0x7feb7c0b46f0 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.773+0000 7feb79600640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feb5c066f60 0x7feb5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.773+0000 7feb79600640 1 -- 172.21.15.59:0/1097120780 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7feb6811f2d0 con 0x7feb7c0b46f0 2024-04-25T09:06:22.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.773+0000 7feb81c00640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feb5c066f60 0x7feb5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:22.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.773+0000 7feb81c00640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feb5c066f60 0x7feb5c069420 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feb7c158e90 tx=0x7feb70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:22.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.777+0000 7feb79600640 1 -- 172.21.15.59:0/1097120780 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7feb7c158590 con 0x7feb7c0b46f0 2024-04-25T09:06:22.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.973+0000 7feb83000640 1 -- 172.21.15.59:0/1097120780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb7c04efa0 con 0x7feb7c0b46f0 2024-04-25T09:06:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb79600640 1 -- 172.21.15.59:0/1097120780 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+4947 (secure 0 0 0) 0x7feb680c4030 con 0x7feb7c0b46f0 2024-04-25T09:06:22.968 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:22.968 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":54,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":54,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:07.181212+0000","modified":"2024-04-25T09:06:21.033604+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6834/1033010830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1033010830},{"type":"v1","addr":"172.21.15.59:6834","nonce":1033010830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:06:22.968 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 54 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb83000640 1 -- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feb5c066f60 msgr2=0x7feb5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb83000640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feb5c066f60 0x7feb5c069420 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feb7c158e90 tx=0x7feb70009040 comp rx=0 tx=0).stop 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb83000640 1 -- 172.21.15.59:0/1097120780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb7c0b46f0 msgr2=0x7feb7c13b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb83000640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb7c0b46f0 0x7feb7c13b460 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7feb6801a0d0 tx=0x7feb68019240 comp rx=0 tx=0).stop 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb83000640 1 -- 172.21.15.59:0/1097120780 shutdown_connections 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb83000640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7feb5c066f60 0x7feb5c069420 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb83000640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7feb7c15d7b0 0x7feb7c06df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb83000640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb7c0b46f0 0x7feb7c13b460 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb83000640 1 --2- 172.21.15.59:0/1097120780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7feb7c0669a0 0x7feb7c158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb83000640 1 -- 172.21.15.59:0/1097120780 >> 172.21.15.59:0/1097120780 conn(0x7feb7c0726f0 msgr2=0x7feb7c159ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb83000640 1 -- 172.21.15.59:0/1097120780 shutdown_connections 2024-04-25T09:06:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:22.977+0000 7feb83000640 1 -- 172.21.15.59:0/1097120780 wait complete. 2024-04-25T09:06:23.171 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:23.174 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:23.393 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 54, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:06:07.181212+0000', 'modified': '2024-04-25T09:06:21.033604+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 81, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6999}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6999': {'gid': 6999, 'name': 'c', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.59:6834/1033010830', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1033010830}, {'type': 'v1', 'addr': '172.21.15.59:6834', 'nonce': 1033010830}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:06:23.393 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:06:23.393 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:06:23.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.545+0000 7f742e200640 1 Processor -- start 2024-04-25T09:06:23.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.545+0000 7f742e200640 1 -- start start 2024-04-25T09:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.545+0000 7f742e200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f742815a7a0 0x7f742806df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.545+0000 7f742e200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f74280ce690 0x7f742815ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.545+0000 7f742e200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74280cecb0 con 0x7f742806e4b0 2024-04-25T09:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.545+0000 7f742e200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742806e910 con 0x7f74280ce690 2024-04-25T09:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.545+0000 7f742e200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742806c5c0 con 0x7f742815a7a0 2024-04-25T09:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.545+0000 7f741fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f742806e4b0 0x7f74280cdf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34226/0 (socket says 172.21.15.59:34226) 2024-04-25T09:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.545+0000 7f741fe00640 1 -- 172.21.15.59:0/2267481065 learned_addr learned my addr 172.21.15.59:0/2267481065 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.545+0000 7f7427e00640 1 --2- 172.21.15.59:0/2267481065 >> v2:172.21.15.59:3300/0 conn(0x7f74280ce690 0x7f742815ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.545+0000 7f7427400640 1 --2- 172.21.15.59:0/2267481065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f742815a7a0 0x7f742806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.545+0000 7f7426a00640 1 -- 172.21.15.59:0/2267481065 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784993854 0 0) 0x7f74280cecb0 con 0x7f742806e4b0 2024-04-25T09:06:23.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f7426a00640 1 -- 172.21.15.59:0/2267481065 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f740c003530 con 0x7f742806e4b0 2024-04-25T09:06:23.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f7427e00640 1 -- 172.21.15.59:0/2267481065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f742815a7a0 msgr2=0x7f742806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f7427e00640 1 --2- 172.21.15.59:0/2267481065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f742815a7a0 0x7f742806df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f7427e00640 1 -- 172.21.15.59:0/2267481065 >> v1:172.21.15.59:6789/0 conn(0x7f742806e4b0 legacy=0x7f74280cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f7427e00640 1 -- 172.21.15.59:0/2267481065 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74280cef90 con 0x7f74280ce690 2024-04-25T09:06:23.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f7427e00640 1 --2- 172.21.15.59:0/2267481065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74280ce690 0x7f742815ab80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f7420009d90 tx=0x7f742001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4954715f693c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f7426a00640 1 -- 172.21.15.59:0/2267481065 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74200b2070 con 0x7f74280ce690 2024-04-25T09:06:23.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f7426a00640 1 -- 172.21.15.59:0/2267481065 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74200a5970 con 0x7f74280ce690 2024-04-25T09:06:23.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f7426a00640 1 -- 172.21.15.59:0/2267481065 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74200a5d40 con 0x7f74280ce690 2024-04-25T09:06:23.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f742e200640 1 -- 172.21.15.59:0/2267481065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74280ce690 msgr2=0x7f742815ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f742e200640 1 --2- 172.21.15.59:0/2267481065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74280ce690 0x7f742815ab80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f7420009d90 tx=0x7f742001c8b0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f742e200640 1 -- 172.21.15.59:0/2267481065 shutdown_connections 2024-04-25T09:06:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f742e200640 1 --2- 172.21.15.59:0/2267481065 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74280ce690 0x7f742815ab80 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f742e200640 1 --2- 172.21.15.59:0/2267481065 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f742815a7a0 0x7f742806df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f742e200640 1 -- 172.21.15.59:0/2267481065 >> 172.21.15.59:0/2267481065 conn(0x7f74280cfd90 msgr2=0x7f74280d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f742e200640 1 -- 172.21.15.59:0/2267481065 shutdown_connections 2024-04-25T09:06:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.549+0000 7f742e200640 1 -- 172.21.15.59:0/2267481065 wait complete. 2024-04-25T09:06:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f742e200640 1 Processor -- start 2024-04-25T09:06:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f742e200640 1 -- start start 2024-04-25T09:06:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f742e200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f742806e4b0 0x7f7428150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f742e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74280ce690 0x7f74280b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f742e200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f742815a7a0 0x7f74280b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f742e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742815ba50 con 0x7f74280ce690 2024-04-25T09:06:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f742e200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742815b8d0 con 0x7f742806e4b0 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f742e200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f742815bbd0 con 0x7f742815a7a0 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f741fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74280ce690 0x7f74280b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f741fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74280ce690 0x7f74280b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56384/0 (socket says 172.21.15.59:56384) 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f741fe00640 1 -- 172.21.15.59:0/2532423184 learned_addr learned my addr 172.21.15.59:0/2532423184 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f7427400640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f742806e4b0 0x7f7428150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f7427e00640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f742815a7a0 0x7f74280b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f741fe00640 1 -- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f742815a7a0 msgr2=0x7f74280b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f741fe00640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f742815a7a0 0x7f74280b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f741fe00640 1 -- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f742806e4b0 msgr2=0x7f7428150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f741fe00640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f742806e4b0 0x7f7428150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f741fe00640 1 -- 172.21.15.59:0/2532423184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428152140 con 0x7f74280ce690 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f741fe00640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74280ce690 0x7f74280b3ad0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f741000c3c0 tx=0x7f741000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f741f400640 1 -- 172.21.15.59:0/2532423184 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410017070 con 0x7f74280ce690 2024-04-25T09:06:23.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f741f400640 1 -- 172.21.15.59:0/2532423184 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7410005cf0 con 0x7f74280ce690 2024-04-25T09:06:23.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f741f400640 1 -- 172.21.15.59:0/2532423184 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100072f0 con 0x7f74280ce690 2024-04-25T09:06:23.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f742e200640 1 -- 172.21.15.59:0/2532423184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7428152420 con 0x7f74280ce690 2024-04-25T09:06:23.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.553+0000 7f742e200640 1 -- 172.21.15.59:0/2532423184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7428157940 con 0x7f74280ce690 2024-04-25T09:06:23.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.557+0000 7f741f400640 1 -- 172.21.15.59:0/2532423184 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f741001a070 con 0x7f74280ce690 2024-04-25T09:06:23.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.557+0000 7f741f400640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7404066f60 0x7f7404069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.557+0000 7f741f400640 1 -- 172.21.15.59:0/2532423184 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f7410084620 con 0x7f74280ce690 2024-04-25T09:06:23.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.557+0000 7f7427400640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7404066f60 0x7f7404069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.557+0000 7f7431779000 1 Processor -- start 2024-04-25T09:06:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.557+0000 7f7431779000 1 -- start start 2024-04-25T09:06:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.557+0000 7f7427400640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7404066f60 0x7f7404069420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7418009a50 tx=0x7f7418008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5fc6920 0x5579a5fc6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc7240 0x5579a5f7c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5f7cf30 0x5579a5f7d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579a5e645f0 con 0x5579a5f7cf30 2024-04-25T09:06:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579a5dcbda0 con 0x5579a5fc7240 2024-04-25T09:06:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579a5d54150 con 0x5579a5fc6920 2024-04-25T09:06:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7427e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5f7cf30 0x5579a5f7d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7427e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5f7cf30 0x5579a5f7d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56400/0 (socket says 172.21.15.59:56400) 2024-04-25T09:06:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7427e00640 1 -- 172.21.15.59:0/1279666865 learned_addr learned my addr 172.21.15.59:0/1279666865 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7427400640 1 --2- 172.21.15.59:0/1279666865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5fc6920 0x5579a5fc6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f741fe00640 1 --2- 172.21.15.59:0/1279666865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc7240 0x5579a5f7c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7427e00640 1 -- 172.21.15.59:0/1279666865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5fc6920 msgr2=0x5579a5fc6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7427e00640 1 --2- 172.21.15.59:0/1279666865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5fc6920 0x5579a5fc6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7427e00640 1 -- 172.21.15.59:0/1279666865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc7240 msgr2=0x5579a5f7c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7427e00640 1 --2- 172.21.15.59:0/1279666865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc7240 0x5579a5f7c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7427e00640 1 -- 172.21.15.59:0/1279666865 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579a5d6dca0 con 0x5579a5f7cf30 2024-04-25T09:06:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7427e00640 1 --2- 172.21.15.59:0/1279666865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5f7cf30 0x5579a5f7d310 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f742001af60 tx=0x7f7420004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b7e08fb713bf96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7417e00640 1 -- 172.21.15.59:0/1279666865 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74200b2040 con 0x5579a5f7cf30 2024-04-25T09:06:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7417e00640 1 -- 172.21.15.59:0/1279666865 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74200a5970 con 0x5579a5f7cf30 2024-04-25T09:06:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7417e00640 1 -- 172.21.15.59:0/1279666865 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74200a5d20 con 0x5579a5f7cf30 2024-04-25T09:06:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 -- 172.21.15.59:0/1279666865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5f7cf30 msgr2=0x5579a5f7d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 --2- 172.21.15.59:0/1279666865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5f7cf30 0x5579a5f7d310 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f742001af60 tx=0x7f7420004ac0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 -- 172.21.15.59:0/1279666865 shutdown_connections 2024-04-25T09:06:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 --2- 172.21.15.59:0/1279666865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5f7cf30 0x5579a5f7d310 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 --2- 172.21.15.59:0/1279666865 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc7240 0x5579a5f7c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 --2- 172.21.15.59:0/1279666865 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5fc6920 0x5579a5fc6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 -- 172.21.15.59:0/1279666865 >> 172.21.15.59:0/1279666865 conn(0x5579a5f832a0 msgr2=0x5579a5f7b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 -- 172.21.15.59:0/1279666865 shutdown_connections 2024-04-25T09:06:23.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 -- 172.21.15.59:0/1279666865 wait complete. 2024-04-25T09:06:23.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 -- start start 2024-04-25T09:06:23.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.561+0000 7f7431779000 1 Processor -- start 2024-04-25T09:06:23.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5f7cf30 0x5579a5fcdc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc6920 0x5579a5fce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 0x5579a5f80aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579a5d86990 con 0x5579a5fc7240 2024-04-25T09:06:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579a5dc7e40 con 0x5579a5fc6920 2024-04-25T09:06:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579a5d57900 con 0x5579a5f7cf30 2024-04-25T09:06:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 10 client.0 _ll_register_callbacks cb 0x5579a5e7f1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7427e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 0x5579a5f80aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7427e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 0x5579a5f80aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56410/0 (socket says 172.21.15.59:56410) 2024-04-25T09:06:23.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7427e00640 1 -- 172.21.15.59:0/567047213 learned_addr learned my addr 172.21.15.59:0/567047213 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7427400640 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5f7cf30 0x5579a5fcdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f741fe00640 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc6920 0x5579a5fce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7427e00640 1 -- 172.21.15.59:0/567047213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5f7cf30 msgr2=0x5579a5fcdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7427e00640 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5f7cf30 0x5579a5fcdc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7427e00640 1 -- 172.21.15.59:0/567047213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc6920 msgr2=0x5579a5fce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7427e00640 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc6920 0x5579a5fce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7427e00640 1 -- 172.21.15.59:0/567047213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5579a5d84630 con 0x5579a5fc7240 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7427e00640 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 0x5579a5f80aa0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f742001d150 tx=0x7f742001b0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=618b5a0f815fa348 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7414c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7414c00640 1 -- 172.21.15.59:0/567047213 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74200c5070 con 0x5579a5fc7240 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 1 -- 172.21.15.59:0/567047213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74200a5970 con 0x5579a5fc7240 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7414c00640 1 -- 172.21.15.59:0/567047213 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f74200039a0 con 0x5579a5fc7240 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7414c00640 1 -- 172.21.15.59:0/567047213 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74200d2050 con 0x5579a5fc7240 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 10 client.7044 fetch_fsmap learned FSMap version 54 2024-04-25T09:06:23.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 1 -- 172.21.15.59:0/567047213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x5579a5d543a0 con 0x5579a5fc7240 2024-04-25T09:06:23.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7414c00640 1 -- 172.21.15.59:0/567047213 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74200a5970 con 0x5579a5fc7240 2024-04-25T09:06:23.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7414c00640 1 -- 172.21.15.59:0/567047213 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f74200d5020 con 0x5579a5fc7240 2024-04-25T09:06:23.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 10 client.7044 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T09:06:23.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 10 client.7044 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:06:23.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 20 client.7044 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:23.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x5579a5f814b0 0x5579a5f81890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 4 client.7044 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:23.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7431779000 1 -- 172.21.15.59:0/567047213 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5579a5d67a50 con 0x5579a5f814b0 2024-04-25T09:06:23.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7427400640 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x5579a5f814b0 0x5579a5f81890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7427400640 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x5579a5f814b0 0x5579a5f81890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22eb800d9a9a9385 server_cookie=daf091fb64415644 in_seq=0 out_seq=0 2024-04-25T09:06:23.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7414c00640 10 client.7044 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:23.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.565+0000 7f7414c00640 1 -- 172.21.15.59:0/567047213 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5579a5d67a50 con 0x5579a5f814b0 2024-04-25T09:06:23.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7414c00640 10 client.7044 handle_command_reply: tid=0 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7431779000 1 client.7044 shutdown 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7431779000 1 -- 172.21.15.59:0/567047213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 msgr2=0x5579a5f80aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7431779000 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 0x5579a5f80aa0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f742001d150 tx=0x7f742001b0f0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7431779000 1 -- 172.21.15.59:0/567047213 shutdown_connections 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7431779000 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x5579a5f814b0 0x5579a5f81890 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7431779000 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 0x5579a5f80aa0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7431779000 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc6920 0x5579a5fce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7431779000 1 --2- 172.21.15.59:0/567047213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5f7cf30 0x5579a5fcdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7414c00640 0 client.7044 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7431779000 1 -- 172.21.15.59:0/567047213 >> 172.21.15.59:0/567047213 conn(0x5579a5f832a0 msgr2=0x5579a5f7b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7431779000 1 -- 172.21.15.59:0/567047213 shutdown_connections 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7431779000 1 -- 172.21.15.59:0/567047213 wait complete. 2024-04-25T09:06:23.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.569+0000 7f7431779000 20 client.7044 trim_cache size 0 max 16384 2024-04-25T09:06:23.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 Processor -- start 2024-04-25T09:06:23.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 -- start start 2024-04-25T09:06:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5f7cf30 0x5579a5f80330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc6920 0x5579a5f80870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 0x5579a5fd08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7428202170 con 0x5579a5fc7240 2024-04-25T09:06:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7428158c40 con 0x5579a5fc6920 2024-04-25T09:06:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7428201ce0 con 0x5579a5f7cf30 2024-04-25T09:06:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7427e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 0x5579a5fd08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7427e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 0x5579a5fd08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56416/0 (socket says 172.21.15.59:56416) 2024-04-25T09:06:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7427e00640 1 -- 172.21.15.59:0/597457311 learned_addr learned my addr 172.21.15.59:0/597457311 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:23.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f741fe00640 1 --2- 172.21.15.59:0/597457311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc6920 0x5579a5f80870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7427400640 1 --2- 172.21.15.59:0/597457311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5f7cf30 0x5579a5f80330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7427e00640 1 -- 172.21.15.59:0/597457311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5f7cf30 msgr2=0x5579a5f80330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7427e00640 1 --2- 172.21.15.59:0/597457311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5f7cf30 0x5579a5f80330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7427e00640 1 -- 172.21.15.59:0/597457311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc6920 msgr2=0x5579a5f80870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7427e00640 1 --2- 172.21.15.59:0/597457311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc6920 0x5579a5f80870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7427e00640 1 -- 172.21.15.59:0/597457311 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579a5e4d600 con 0x5579a5fc7240 2024-04-25T09:06:23.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7427e00640 1 --2- 172.21.15.59:0/597457311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 0x5579a5fd08b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f7420000f90 tx=0x7f74200af070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89596701738fe35d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7417400640 1 -- 172.21.15.59:0/597457311 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74200c5040 con 0x5579a5fc7240 2024-04-25T09:06:23.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7417400640 1 -- 172.21.15.59:0/597457311 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74200a5770 con 0x5579a5fc7240 2024-04-25T09:06:23.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7417400640 1 -- 172.21.15.59:0/597457311 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74200b2050 con 0x5579a5fc7240 2024-04-25T09:06:23.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 -- 172.21.15.59:0/597457311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 msgr2=0x5579a5fd08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 --2- 172.21.15.59:0/597457311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 0x5579a5fd08b0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f7420000f90 tx=0x7f74200af070 comp rx=0 tx=0).stop 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 -- 172.21.15.59:0/597457311 shutdown_connections 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 --2- 172.21.15.59:0/597457311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc7240 0x5579a5fd08b0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 --2- 172.21.15.59:0/597457311 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5fc6920 0x5579a5f80870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 --2- 172.21.15.59:0/597457311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5f7cf30 0x5579a5f80330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 -- 172.21.15.59:0/597457311 >> 172.21.15.59:0/597457311 conn(0x5579a5f832a0 msgr2=0x5579a5fb2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 -- 172.21.15.59:0/597457311 shutdown_connections 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 -- 172.21.15.59:0/597457311 wait complete. 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.585+0000 7f7431779000 1 -- start start 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 1 Processor -- start 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5f7cf30 0x5579a5fd3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc6920 0x5579a5fe2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5fc7240 0x5579a5fe2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579a5dd03d0 con 0x5579a5fc6920 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579a5e87d50 con 0x5579a5f7cf30 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5579a5d66980 con 0x5579a5fc7240 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 10 client.0 _ll_register_callbacks cb 0x7f74200b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f741fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc6920 0x5579a5fe2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f741fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc6920 0x5579a5fe2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56418/0 (socket says 172.21.15.59:56418) 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f741fe00640 1 -- 172.21.15.59:0/3001019625 learned_addr learned my addr 172.21.15.59:0/3001019625 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7427e00640 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5fc7240 0x5579a5fe2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7427400640 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5f7cf30 0x5579a5fd3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f741fe00640 1 -- 172.21.15.59:0/3001019625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5fc7240 msgr2=0x5579a5fe2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f741fe00640 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5fc7240 0x5579a5fe2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f741fe00640 1 -- 172.21.15.59:0/3001019625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5f7cf30 msgr2=0x5579a5fd3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f741fe00640 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5f7cf30 0x5579a5fd3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f741fe00640 1 -- 172.21.15.59:0/3001019625 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5579a5d609b0 con 0x5579a5fc6920 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f741fe00640 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc6920 0x5579a5fe2330 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f7410054a40 tx=0x7f741005b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecaa7440a2c6610a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7414c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7414c00640 1 -- 172.21.15.59:0/3001019625 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7410007490 con 0x5579a5fc6920 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7414c00640 1 -- 172.21.15.59:0/3001019625 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f7410007630 con 0x5579a5fc6920 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 1 -- 172.21.15.59:0/3001019625 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74200a5770 con 0x5579a5fc6920 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7414c00640 1 -- 172.21.15.59:0/3001019625 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7410054190 con 0x5579a5fc6920 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 10 client.7050 fetch_fsmap learned FSMap version 54 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 1 -- 172.21.15.59:0/3001019625 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x5579a5d730b0 con 0x5579a5fc6920 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7414c00640 1 -- 172.21.15.59:0/3001019625 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74200a5770 con 0x5579a5fc6920 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7414c00640 1 -- 172.21.15.59:0/3001019625 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7410054330 con 0x5579a5fc6920 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 10 client.7050 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 10 client.7050 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:06:23.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 20 client.7050 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:23.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x5579a5fe2db0 0x5579a6027190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 4 client.7050 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:06:23.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7431779000 1 -- 172.21.15.59:0/3001019625 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5579a5dd92e0 con 0x5579a5fe2db0 2024-04-25T09:06:23.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7427400640 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x5579a5fe2db0 0x5579a6027190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7414c00640 10 client.7050 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:23.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.589+0000 7f7427400640 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x5579a5fe2db0 0x5579a6027190 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64fff5b9acbca3f7 server_cookie=6bce31822cf18c67 in_seq=0 out_seq=0 2024-04-25T09:06:23.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7414c00640 1 -- 172.21.15.59:0/3001019625 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5579a5dd92e0 con 0x5579a5fe2db0 2024-04-25T09:06:23.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7414c00640 10 client.7050 handle_command_reply: tid=0 2024-04-25T09:06:23.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7431779000 1 client.7050 shutdown 2024-04-25T09:06:23.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7431779000 1 -- 172.21.15.59:0/3001019625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc6920 msgr2=0x5579a5fe2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7431779000 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc6920 0x5579a5fe2330 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f7410054a40 tx=0x7f741005b040 comp rx=0 tx=0).stop 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7431779000 1 -- 172.21.15.59:0/3001019625 shutdown_connections 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7431779000 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x5579a5fe2db0 0x5579a6027190 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7431779000 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5579a5fc7240 0x5579a5fe2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7431779000 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5579a5fc6920 0x5579a5fe2330 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7431779000 1 --2- 172.21.15.59:0/3001019625 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5579a5f7cf30 0x5579a5fd3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7414c00640 0 client.7050 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7431779000 1 -- 172.21.15.59:0/3001019625 >> 172.21.15.59:0/3001019625 conn(0x5579a5f832a0 msgr2=0x5579a5f7f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7431779000 1 -- 172.21.15.59:0/3001019625 shutdown_connections 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7431779000 1 -- 172.21.15.59:0/3001019625 wait complete. 2024-04-25T09:06:23.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f7431779000 20 client.7050 trim_cache size 0 max 16384 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 6999, 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 4.5724311269999998, 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 54, 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 81, 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 81, 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 5.5179773340000002 2024-04-25T09:06:23.589 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:06:23.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f742e200640 1 -- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7404066f60 msgr2=0x7f7404069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f742e200640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7404066f60 0x7f7404069420 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7418009a50 tx=0x7f7418008040 comp rx=0 tx=0).stop 2024-04-25T09:06:23.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f742e200640 1 -- 172.21.15.59:0/2532423184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74280ce690 msgr2=0x7f74280b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f742e200640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74280ce690 0x7f74280b3ad0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f741000c3c0 tx=0x7f741000c880 comp rx=0 tx=0).stop 2024-04-25T09:06:23.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f742e200640 1 -- 172.21.15.59:0/2532423184 shutdown_connections 2024-04-25T09:06:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f742e200640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7404066f60 0x7f7404069420 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f742e200640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f742815a7a0 0x7f74280b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f742e200640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74280ce690 0x7f74280b3ad0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f742e200640 1 --2- 172.21.15.59:0/2532423184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f742806e4b0 0x7f7428150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f742e200640 1 -- 172.21.15.59:0/2532423184 >> 172.21.15.59:0/2532423184 conn(0x7f74280cfd90 msgr2=0x7f74280af970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f742e200640 1 -- 172.21.15.59:0/2532423184 shutdown_connections 2024-04-25T09:06:23.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.593+0000 7f742e200640 1 -- 172.21.15.59:0/2532423184 wait complete. 2024-04-25T09:06:23.604 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:06:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.753+0000 7fe298800640 1 Processor -- start 2024-04-25T09:06:23.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.753+0000 7fe298800640 1 -- start start 2024-04-25T09:06:23.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.753+0000 7fe298800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe2900b2dc0 0x7fe29006ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.753+0000 7fe298800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2900b3950 0x7fe29006b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.753+0000 7fe298800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29015def0 con 0x7fe29015b2f0 2024-04-25T09:06:23.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.753+0000 7fe298800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29015e1b0 con 0x7fe2900b3950 2024-04-25T09:06:23.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.753+0000 7fe298800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29015e490 con 0x7fe2900b2dc0 2024-04-25T09:06:23.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.753+0000 7fe296800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2900b3950 0x7fe29006b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.753+0000 7fe296800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2900b3950 0x7fe29006b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56434/0 (socket says 172.21.15.59:56434) 2024-04-25T09:06:23.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.753+0000 7fe296800640 1 -- 172.21.15.59:0/3297125411 learned_addr learned my addr 172.21.15.59:0/3297125411 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:23.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.757+0000 7fe295400640 1 --2- 172.21.15.59:0/3297125411 >> v2:172.21.15.178:3300/0 conn(0x7fe2900b2dc0 0x7fe29006ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.757+0000 7fe296800640 1 -- 172.21.15.59:0/3297125411 >> v2:172.21.15.178:3300/0 conn(0x7fe2900b2dc0 msgr2=0x7fe29006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:23.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.757+0000 7fe296800640 1 --2- 172.21.15.59:0/3297125411 >> v2:172.21.15.178:3300/0 conn(0x7fe2900b2dc0 0x7fe29006ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.757+0000 7fe296800640 1 -- 172.21.15.59:0/3297125411 >> v1:172.21.15.178:6789/0 conn(0x7fe29015b2f0 legacy=0x7fe2900b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.757+0000 7fe296800640 1 -- 172.21.15.59:0/3297125411 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29015e770 con 0x7fe2900b3950 2024-04-25T09:06:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.757+0000 7fe296800640 1 --2- 172.21.15.59:0/3297125411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2900b3950 0x7fe29006b150 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fe290067200 tx=0x7fe28c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94991fa74f7840e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.757+0000 7fe294a00640 1 -- 172.21.15.59:0/3297125411 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29015b8e0 con 0x7fe2900b3950 2024-04-25T09:06:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.757+0000 7fe294a00640 1 -- 172.21.15.59:0/3297125411 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c0a58a0 con 0x7fe2900b3950 2024-04-25T09:06:23.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.757+0000 7fe294a00640 1 -- 172.21.15.59:0/3297125411 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0a5c70 con 0x7fe2900b3950 2024-04-25T09:06:23.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 -- 172.21.15.59:0/3297125411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2900b3950 msgr2=0x7fe29006b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 --2- 172.21.15.59:0/3297125411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2900b3950 0x7fe29006b150 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fe290067200 tx=0x7fe28c01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 -- 172.21.15.59:0/3297125411 shutdown_connections 2024-04-25T09:06:23.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 --2- 172.21.15.59:0/3297125411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2900b3950 0x7fe29006b150 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 --2- 172.21.15.59:0/3297125411 >> v2:172.21.15.178:3300/0 conn(0x7fe2900b2dc0 0x7fe29006ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 -- 172.21.15.59:0/3297125411 >> 172.21.15.59:0/3297125411 conn(0x7fe2900b23b0 msgr2=0x7fe2900cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 -- 172.21.15.59:0/3297125411 shutdown_connections 2024-04-25T09:06:23.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 -- 172.21.15.59:0/3297125411 wait complete. 2024-04-25T09:06:23.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 Processor -- start 2024-04-25T09:06:23.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 -- start start 2024-04-25T09:06:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2900b2dc0 0x7fe290151870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2900b3950 0x7fe29013ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29015b2f0 0x7fe290154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29016a880 con 0x7fe29015b2f0 2024-04-25T09:06:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe290161730 con 0x7fe2900b2dc0 2024-04-25T09:06:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe298800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29016aa00 con 0x7fe2900b3950 2024-04-25T09:06:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe296800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29015b2f0 0x7fe290154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe296800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29015b2f0 0x7fe290154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56442/0 (socket says 172.21.15.59:56442) 2024-04-25T09:06:23.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe296800640 1 -- 172.21.15.59:0/2115004490 learned_addr learned my addr 172.21.15.59:0/2115004490 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:23.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe295e00640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2900b2dc0 0x7fe290151870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe295400640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2900b3950 0x7fe29013ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe296800640 1 -- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2900b3950 msgr2=0x7fe29013ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe296800640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2900b3950 0x7fe29013ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe296800640 1 -- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2900b2dc0 msgr2=0x7fe290151870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe296800640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2900b2dc0 0x7fe290151870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.761+0000 7fe296800640 1 -- 172.21.15.59:0/2115004490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2901fa600 con 0x7fe29015b2f0 2024-04-25T09:06:23.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.765+0000 7fe296800640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29015b2f0 0x7fe290154250 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0af040 tx=0x7fe28c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.765+0000 7fe28a000640 1 -- 172.21.15.59:0/2115004490 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0b8670 con 0x7fe29015b2f0 2024-04-25T09:06:23.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.765+0000 7fe28a000640 1 -- 172.21.15.59:0/2115004490 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe28c0be070 con 0x7fe29015b2f0 2024-04-25T09:06:23.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.765+0000 7fe28a000640 1 -- 172.21.15.59:0/2115004490 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe28c0b8a50 con 0x7fe29015b2f0 2024-04-25T09:06:23.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.765+0000 7fe298800640 1 -- 172.21.15.59:0/2115004490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2901fa8e0 con 0x7fe29015b2f0 2024-04-25T09:06:23.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.765+0000 7fe298800640 1 -- 172.21.15.59:0/2115004490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2901faea0 con 0x7fe29015b2f0 2024-04-25T09:06:23.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.765+0000 7fe298800640 1 -- 172.21.15.59:0/2115004490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2900745d0 con 0x7fe29015b2f0 2024-04-25T09:06:23.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.765+0000 7fe28a000640 1 -- 172.21.15.59:0/2115004490 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe28c0b8bf0 con 0x7fe29015b2f0 2024-04-25T09:06:23.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.765+0000 7fe28a000640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe274066f60 0x7fe274069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:23.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.765+0000 7fe28a000640 1 -- 172.21.15.59:0/2115004490 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe28c120390 con 0x7fe29015b2f0 2024-04-25T09:06:23.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.769+0000 7fe295e00640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe274066f60 0x7fe274069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:23.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.769+0000 7fe295e00640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe274066f60 0x7fe274069420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe29015ab90 tx=0x7fe284009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:23.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.769+0000 7fe28a000640 1 -- 172.21.15.59:0/2115004490 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe28c0165e0 con 0x7fe29015b2f0 2024-04-25T09:06:23.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.973+0000 7fe298800640 1 -- 172.21.15.59:0/2115004490 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe2900d0ab0 con 0x7fe29015b2f0 2024-04-25T09:06:23.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.973+0000 7fe28a000640 1 -- 172.21.15.59:0/2115004490 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v54) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe28c0f0b90 con 0x7fe29015b2f0 2024-04-25T09:06:23.967 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:06:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.977+0000 7fe298800640 1 -- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe274066f60 msgr2=0x7fe274069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.977+0000 7fe298800640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe274066f60 0x7fe274069420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe29015ab90 tx=0x7fe284009040 comp rx=0 tx=0).stop 2024-04-25T09:06:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.977+0000 7fe298800640 1 -- 172.21.15.59:0/2115004490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29015b2f0 msgr2=0x7fe290154250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.977+0000 7fe298800640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29015b2f0 0x7fe290154250 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fe28c0af040 tx=0x7fe28c019760 comp rx=0 tx=0).stop 2024-04-25T09:06:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.977+0000 7fe298800640 1 -- 172.21.15.59:0/2115004490 shutdown_connections 2024-04-25T09:06:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.977+0000 7fe298800640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe274066f60 0x7fe274069420 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.977+0000 7fe298800640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe29015b2f0 0x7fe290154250 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.977+0000 7fe298800640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe2900b3950 0x7fe29013ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.977+0000 7fe298800640 1 --2- 172.21.15.59:0/2115004490 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe2900b2dc0 0x7fe290151870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.977+0000 7fe298800640 1 -- 172.21.15.59:0/2115004490 >> 172.21.15.59:0/2115004490 conn(0x7fe2900b23b0 msgr2=0x7fe2900b0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.977+0000 7fe298800640 1 -- 172.21.15.59:0/2115004490 shutdown_connections 2024-04-25T09:06:23.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:23.977+0000 7fe298800640 1 -- 172.21.15.59:0/2115004490 wait complete. 2024-04-25T09:06:23.988 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:06:23.988 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:06:23.988 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:06:23.988 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:06:23.988 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:23.988 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:06:23.988 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:06:23.988 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:06:23.988 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:23.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:23.988 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:06:23.998 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:06:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:06:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:06:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:06:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:23.998 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:06:23.998 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42184sec preferred_lft 42184sec 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:06:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:06:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:06:24.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.001 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:06:24.065 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:06:24.067 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.067 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:06:24.125 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:06:24.125 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:06:24.125 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:06:24.125 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:06:24.125 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:06:24.125 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:06:24.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.125 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:06:24.125 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:06:24.125 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:06:24.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:06:24.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:06:24.126 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:06:24.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.217 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:06:24.226 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:06:24.227 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:06:24.227 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:24.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.227 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:06:24.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:06:24.291 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:24.340 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:06:24.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:06:24.340 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:24.390 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:06:24.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.391 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:24.480 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:24.480 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:24.481 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:06:24.496 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:24.496 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:24.496 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:06:24.496 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:06:24.496 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:06:24.505 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:06:24.505 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:06:24.505 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:06:24.505 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:06:24.505 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:06:24.505 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:06:24.505 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:06:24.505 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:06:24.508 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:06:24.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.509 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:24.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.529 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:06:24.586 INFO:teuthology.orchestra.run.smithi059.stdout:client7059 2024-04-25T09:06:24.586 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:06:24.586 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:24.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.636 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-04-25T09:06:24.689 INFO:teuthology.orchestra.run.smithi059.stdout:file_undamaged 2024-04-25T09:06:24.691 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:06:24.691 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:06:24.691 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:06:24.691 DEBUG:teuthology.orchestra.run.smithi059:> import json 2024-04-25T09:06:24.691 DEBUG:teuthology.orchestra.run.smithi059:> import sys 2024-04-25T09:06:24.691 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:06:24.692 DEBUG:teuthology.orchestra.run.smithi059:> try: 2024-04-25T09:06:24.692 DEBUG:teuthology.orchestra.run.smithi059:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-04-25T09:06:24.692 DEBUG:teuthology.orchestra.run.smithi059:> except OSError as e: 2024-04-25T09:06:24.692 DEBUG:teuthology.orchestra.run.smithi059:> sys.exit(e.errno) 2024-04-25T09:06:24.692 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:06:24.692 DEBUG:teuthology.orchestra.run.smithi059:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-25T09:06:24.692 DEBUG:teuthology.orchestra.run.smithi059:> print(json.dumps( 2024-04-25T09:06:24.692 DEBUG:teuthology.orchestra.run.smithi059:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-25T09:06:24.692 DEBUG:teuthology.orchestra.run.smithi059:> indent=2)) 2024-04-25T09:06:24.692 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:06:24.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:24 stdin-killer INFO: command exited with status 2: exiting normally with same code! 2024-04-25T09:06:24.810 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-25T09:06:24.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:24.811 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-25T09:06:24.860 INFO:teuthology.orchestra.run.smithi059.stdout:2 2024-04-25T09:06:24.860 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:06:24.861 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:24.911 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:06:24.911 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:06:24.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:06:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f7e00640 1 Processor -- start 2024-04-25T09:06:25.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f7e00640 1 -- start start 2024-04-25T09:06:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f7e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f89f809a170 0x7f89f80cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f7e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f806d740 con 0x7f89f809a7a0 2024-04-25T09:06:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f7e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f806cea0 con 0x7f89f815dcd0 2024-04-25T09:06:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f7e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f80cbfc0 con 0x7f89f809a170 2024-04-25T09:06:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f89f809a7a0 0x7f89f80cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34236/0 (socket says 172.21.15.59:34236) 2024-04-25T09:06:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f7400640 1 -- 172.21.15.59:0/3494278064 learned_addr learned my addr 172.21.15.59:0/3494278064 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:25.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f6000640 1 --2- 172.21.15.59:0/3494278064 >> v2:172.21.15.178:3300/0 conn(0x7f89f809a170 0x7f89f80cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f5600640 1 -- 172.21.15.59:0/3494278064 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331538638 0 0) 0x7f89f806d740 con 0x7f89f809a7a0 2024-04-25T09:06:25.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f5600640 1 -- 172.21.15.59:0/3494278064 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc003530 con 0x7f89f809a7a0 2024-04-25T09:06:25.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f6000640 1 -- 172.21.15.59:0/3494278064 >> v1:172.21.15.178:6789/0 conn(0x7f89f815dcd0 legacy=0x7f89f8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f5600640 1 -- 172.21.15.59:0/3494278064 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1679654183 0 0) 0x7f89dc003530 con 0x7f89f809a7a0 2024-04-25T09:06:25.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f6000640 1 -- 172.21.15.59:0/3494278064 >> v1:172.21.15.59:6789/0 conn(0x7f89f809a7a0 legacy=0x7f89f80cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.157+0000 7f89f6000640 1 -- 172.21.15.59:0/3494278064 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f806d180 con 0x7f89f809a170 2024-04-25T09:06:25.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.161+0000 7f89f6000640 1 --2- 172.21.15.59:0/3494278064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89f809a170 0x7f89f80cc450 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f89e40097c0 tx=0x7f89f80cd8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=368bc8ec4c39d51d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.161+0000 7f89f5600640 1 -- 172.21.15.59:0/3494278064 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40b0070 con 0x7f89f809a170 2024-04-25T09:06:25.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.161+0000 7f89f5600640 1 -- 172.21.15.59:0/3494278064 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e40ab400 con 0x7f89f809a170 2024-04-25T09:06:25.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.161+0000 7f89f5600640 1 -- 172.21.15.59:0/3494278064 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0001a00 con 0x7f89f809a170 2024-04-25T09:06:25.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.161+0000 7f89f7e00640 1 -- 172.21.15.59:0/3494278064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89f809a170 msgr2=0x7f89f80cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.161+0000 7f89f7e00640 1 --2- 172.21.15.59:0/3494278064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89f809a170 0x7f89f80cc450 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f89e40097c0 tx=0x7f89f80cd8b0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.161+0000 7f89f7e00640 1 -- 172.21.15.59:0/3494278064 shutdown_connections 2024-04-25T09:06:25.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.161+0000 7f89f7e00640 1 --2- 172.21.15.59:0/3494278064 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89f809a170 0x7f89f80cc450 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.161+0000 7f89f7e00640 1 -- 172.21.15.59:0/3494278064 >> 172.21.15.59:0/3494278064 conn(0x7f89f80b3050 msgr2=0x7f89f80b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.161+0000 7f89f7e00640 1 -- 172.21.15.59:0/3494278064 shutdown_connections 2024-04-25T09:06:25.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.161+0000 7f89f7e00640 1 -- 172.21.15.59:0/3494278064 wait complete. 2024-04-25T09:06:25.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f7e00640 1 Processor -- start 2024-04-25T09:06:25.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f7e00640 1 -- start start 2024-04-25T09:06:25.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f7e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89f809a170 0x7f89f80aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f809a7a0 0x7f89f80b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89f815dcd0 0x7f89f80ae700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f7e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f816ba30 con 0x7f89f809a7a0 2024-04-25T09:06:25.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f7e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f816b8b0 con 0x7f89f815dcd0 2024-04-25T09:06:25.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f7e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f816bbb0 con 0x7f89f809a170 2024-04-25T09:06:25.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f809a7a0 0x7f89f80b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f6000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f809a7a0 0x7f89f80b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56458/0 (socket says 172.21.15.59:56458) 2024-04-25T09:06:25.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f6000640 1 -- 172.21.15.59:0/3933553779 learned_addr learned my addr 172.21.15.59:0/3933553779 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:25.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f6000640 1 -- 172.21.15.59:0/3933553779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89f809a170 msgr2=0x7f89f80aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f6000640 1 --2- 172.21.15.59:0/3933553779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89f809a170 0x7f89f80aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f6000640 1 -- 172.21.15.59:0/3933553779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89f815dcd0 msgr2=0x7f89f80ae700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f6000640 1 --2- 172.21.15.59:0/3933553779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89f815dcd0 0x7f89f80ae700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f6000640 1 -- 172.21.15.59:0/3933553779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f80aec40 con 0x7f89f809a7a0 2024-04-25T09:06:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f6000640 1 --2- 172.21.15.59:0/3933553779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f809a7a0 0x7f89f80b4f50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f89e40097c0 tx=0x7f89e401aa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89ef400640 1 -- 172.21.15.59:0/3933553779 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40b0050 con 0x7f89f809a7a0 2024-04-25T09:06:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89ef400640 1 -- 172.21.15.59:0/3933553779 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e40b1040 con 0x7f89f809a7a0 2024-04-25T09:06:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f7e00640 1 -- 172.21.15.59:0/3933553779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f80aeed0 con 0x7f89f809a7a0 2024-04-25T09:06:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89ef400640 1 -- 172.21.15.59:0/3933553779 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e4004220 con 0x7f89f809a7a0 2024-04-25T09:06:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f7e00640 1 -- 172.21.15.59:0/3933553779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f80af490 con 0x7f89f809a7a0 2024-04-25T09:06:25.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.165+0000 7f89f7e00640 1 -- 172.21.15.59:0/3933553779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f804efa0 con 0x7f89f809a7a0 2024-04-25T09:06:25.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.169+0000 7f89ef400640 1 -- 172.21.15.59:0/3933553779 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f89e40be020 con 0x7f89f809a7a0 2024-04-25T09:06:25.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.169+0000 7f89ef400640 1 --2- 172.21.15.59:0/3933553779 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89d8066fe0 0x7f89d80694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.169+0000 7f89ef400640 1 -- 172.21.15.59:0/3933553779 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f89e411f0d0 con 0x7f89f809a7a0 2024-04-25T09:06:25.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.169+0000 7f89f6a00640 1 --2- 172.21.15.59:0/3933553779 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89d8066fe0 0x7f89d80694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.169+0000 7f89f6a00640 1 --2- 172.21.15.59:0/3933553779 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89d8066fe0 0x7f89d80694a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f89e8007fd0 tx=0x7f89e80079a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.173+0000 7f89ef400640 1 -- 172.21.15.59:0/3933553779 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f89e4015fb0 con 0x7f89f809a7a0 2024-04-25T09:06:25.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.333+0000 7f89f7e00640 1 -- 172.21.15.59:0/3933553779 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89f806d740 con 0x7f89f809a7a0 2024-04-25T09:06:25.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89ef400640 1 -- 172.21.15.59:0/3933553779 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f89e40bf370 con 0x7f89f809a7a0 2024-04-25T09:06:25.328 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:25.329 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":81,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:06:18.012348+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:04.967523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:06.198067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6834/1468235926":"2024-04-26T09:06:18.012326+0000","172.21.15.59:6832/1468235926":"2024-04-26T09:06:18.012326+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:06:25.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89f7e00640 1 -- 172.21.15.59:0/3933553779 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89d8066fe0 msgr2=0x7f89d80694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89f7e00640 1 --2- 172.21.15.59:0/3933553779 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89d8066fe0 0x7f89d80694a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f89e8007fd0 tx=0x7f89e80079a0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89f7e00640 1 -- 172.21.15.59:0/3933553779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f809a7a0 msgr2=0x7f89f80b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89f7e00640 1 --2- 172.21.15.59:0/3933553779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f809a7a0 0x7f89f80b4f50 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f89e40097c0 tx=0x7f89e401aa80 comp rx=0 tx=0).stop 2024-04-25T09:06:25.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89f7e00640 1 -- 172.21.15.59:0/3933553779 shutdown_connections 2024-04-25T09:06:25.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89f7e00640 1 --2- 172.21.15.59:0/3933553779 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89d8066fe0 0x7f89d80694a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89f7e00640 1 --2- 172.21.15.59:0/3933553779 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89f815dcd0 0x7f89f80ae700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89f7e00640 1 --2- 172.21.15.59:0/3933553779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89f809a7a0 0x7f89f80b4f50 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89f7e00640 1 --2- 172.21.15.59:0/3933553779 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89f809a170 0x7f89f80aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89f7e00640 1 -- 172.21.15.59:0/3933553779 >> 172.21.15.59:0/3933553779 conn(0x7f89f80b3050 msgr2=0x7f89f80b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89f7e00640 1 -- 172.21.15.59:0/3933553779 shutdown_connections 2024-04-25T09:06:25.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.337+0000 7f89f7e00640 1 -- 172.21.15.59:0/3933553779 wait complete. 2024-04-25T09:06:25.350 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:06:04.967523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:06:06.198067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:06:25.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:06:25.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.501+0000 7f2851600640 1 Processor -- start 2024-04-25T09:06:25.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.501+0000 7f2851600640 1 -- start start 2024-04-25T09:06:25.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.501+0000 7f2851600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f284c15dd90 0x7f284c071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.501+0000 7f2851600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f284c161e90 0x7f284c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.501+0000 7f2851600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c072460 con 0x7f284c072040 2024-04-25T09:06:25.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.501+0000 7f2851600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c0b2dc0 con 0x7f284c15dd90 2024-04-25T09:06:25.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.501+0000 7f2851600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c06ac10 con 0x7f284c161e90 2024-04-25T09:06:25.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f284aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f284c15dd90 0x7f284c071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f2842000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f284c072040 0x7f284c161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34252/0 (socket says 172.21.15.59:34252) 2024-04-25T09:06:25.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f2842000640 1 -- 172.21.15.59:0/312955292 learned_addr learned my addr 172.21.15.59:0/312955292 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:25.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f284b400640 1 --2- 172.21.15.59:0/312955292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f284c161e90 0x7f284c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f284aa00640 1 -- 172.21.15.59:0/312955292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f284c161e90 msgr2=0x7f284c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f284aa00640 1 --2- 172.21.15.59:0/312955292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f284c161e90 0x7f284c0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f284aa00640 1 -- 172.21.15.59:0/312955292 >> v1:172.21.15.59:6789/0 conn(0x7f284c072040 legacy=0x7f284c161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f284a000640 1 -- 172.21.15.59:0/312955292 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135416017 0 0) 0x7f284c072460 con 0x7f284c072040 2024-04-25T09:06:25.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f284aa00640 1 -- 172.21.15.59:0/312955292 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c06aeb0 con 0x7f284c15dd90 2024-04-25T09:06:25.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f284aa00640 1 --2- 172.21.15.59:0/312955292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c15dd90 0x7f284c071b00 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f283c0097c0 tx=0x7f283c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d7673dbe1a0309 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f284a000640 1 -- 172.21.15.59:0/312955292 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0b0070 con 0x7f284c15dd90 2024-04-25T09:06:25.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f284a000640 1 -- 172.21.15.59:0/312955292 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c0ab600 con 0x7f284c15dd90 2024-04-25T09:06:25.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.505+0000 7f284a000640 1 -- 172.21.15.59:0/312955292 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0ab9d0 con 0x7f284c15dd90 2024-04-25T09:06:25.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 -- 172.21.15.59:0/312955292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c15dd90 msgr2=0x7f284c071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 --2- 172.21.15.59:0/312955292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c15dd90 0x7f284c071b00 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f283c0097c0 tx=0x7f283c01c410 comp rx=0 tx=0).stop 2024-04-25T09:06:25.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 -- 172.21.15.59:0/312955292 shutdown_connections 2024-04-25T09:06:25.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 --2- 172.21.15.59:0/312955292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f284c161e90 0x7f284c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 --2- 172.21.15.59:0/312955292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c15dd90 0x7f284c071b00 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 -- 172.21.15.59:0/312955292 >> 172.21.15.59:0/312955292 conn(0x7f284c0cfd90 msgr2=0x7f284c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 -- 172.21.15.59:0/312955292 shutdown_connections 2024-04-25T09:06:25.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 -- 172.21.15.59:0/312955292 wait complete. 2024-04-25T09:06:25.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 Processor -- start 2024-04-25T09:06:25.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 -- start start 2024-04-25T09:06:25.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f284c072040 0x7f284c153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f284c15dd90 0x7f284c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c161e90 0x7f284c0b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c16ac40 con 0x7f284c161e90 2024-04-25T09:06:25.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c16aac0 con 0x7f284c15dd90 2024-04-25T09:06:25.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2851600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c16adc0 con 0x7f284c072040 2024-04-25T09:06:25.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f284b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c161e90 0x7f284c0b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f284b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c161e90 0x7f284c0b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56486/0 (socket says 172.21.15.59:56486) 2024-04-25T09:06:25.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f284b400640 1 -- 172.21.15.59:0/3673633220 learned_addr learned my addr 172.21.15.59:0/3673633220 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:25.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2842000640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f284c15dd90 0x7f284c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f284aa00640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f284c072040 0x7f284c153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f284b400640 1 -- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f284c072040 msgr2=0x7f284c153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f284b400640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f284c072040 0x7f284c153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f284b400640 1 -- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f284c15dd90 msgr2=0x7f284c0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f284b400640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f284c15dd90 0x7f284c0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f284b400640 1 -- 172.21.15.59:0/3673633220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c152a30 con 0x7f284c161e90 2024-04-25T09:06:25.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.509+0000 7f2842000640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f284c15dd90 0x7f284c0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:25.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.513+0000 7f284b400640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c161e90 0x7f284c0b44e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2844007e40 tx=0x7f284400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.513+0000 7f2843400640 1 -- 172.21.15.59:0/3673633220 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844014620 con 0x7f284c161e90 2024-04-25T09:06:25.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.513+0000 7f2843400640 1 -- 172.21.15.59:0/3673633220 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844019070 con 0x7f284c161e90 2024-04-25T09:06:25.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.513+0000 7f2843400640 1 -- 172.21.15.59:0/3673633220 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844014a20 con 0x7f284c161e90 2024-04-25T09:06:25.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.513+0000 7f2851600640 1 -- 172.21.15.59:0/3673633220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c152d10 con 0x7f284c161e90 2024-04-25T09:06:25.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.513+0000 7f2851600640 1 -- 172.21.15.59:0/3673633220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c1532d0 con 0x7f284c161e90 2024-04-25T09:06:25.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.513+0000 7f2851600640 1 -- 172.21.15.59:0/3673633220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c158df0 con 0x7f284c161e90 2024-04-25T09:06:25.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.513+0000 7f2843400640 1 -- 172.21.15.59:0/3673633220 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2844014bc0 con 0x7f284c161e90 2024-04-25T09:06:25.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.513+0000 7f2843400640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2828066f90 0x7f2828069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.513+0000 7f2843400640 1 -- 172.21.15.59:0/3673633220 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f2844085a10 con 0x7f284c161e90 2024-04-25T09:06:25.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.513+0000 7f284aa00640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2828066f90 0x7f2828069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.517+0000 7f284aa00640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2828066f90 0x7f2828069450 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f283c0ad000 tx=0x7f283c0a4f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.517+0000 7f2843400640 1 -- 172.21.15.59:0/3673633220 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2844056830 con 0x7f284c161e90 2024-04-25T09:06:25.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.681+0000 7f2851600640 1 -- 172.21.15.59:0/3673633220 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f284c06edd0 con 0x7f284c161e90 2024-04-25T09:06:25.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.681+0000 7f2843400640 1 -- 172.21.15.59:0/3673633220 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2844056130 con 0x7f284c161e90 2024-04-25T09:06:25.675 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:06:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.685+0000 7f2851600640 1 -- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2828066f90 msgr2=0x7f2828069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.685+0000 7f2851600640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2828066f90 0x7f2828069450 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f283c0ad000 tx=0x7f283c0a4f90 comp rx=0 tx=0).stop 2024-04-25T09:06:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.685+0000 7f2851600640 1 -- 172.21.15.59:0/3673633220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c161e90 msgr2=0x7f284c0b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.685+0000 7f2851600640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c161e90 0x7f284c0b44e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f2844007e40 tx=0x7f284400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.685+0000 7f2851600640 1 -- 172.21.15.59:0/3673633220 shutdown_connections 2024-04-25T09:06:25.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.685+0000 7f2851600640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2828066f90 0x7f2828069450 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.685+0000 7f2851600640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c161e90 0x7f284c0b44e0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.685+0000 7f2851600640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f284c15dd90 0x7f284c0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.685+0000 7f2851600640 1 --2- 172.21.15.59:0/3673633220 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f284c072040 0x7f284c153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.685+0000 7f2851600640 1 -- 172.21.15.59:0/3673633220 >> 172.21.15.59:0/3673633220 conn(0x7f284c0cfd90 msgr2=0x7f284c0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.685+0000 7f2851600640 1 -- 172.21.15.59:0/3673633220 shutdown_connections 2024-04-25T09:06:25.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.685+0000 7f2851600640 1 -- 172.21.15.59:0/3673633220 wait complete. 2024-04-25T09:06:25.697 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:06:25.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.849+0000 7f1a86600640 1 Processor -- start 2024-04-25T09:06:25.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.849+0000 7f1a86600640 1 -- start start 2024-04-25T09:06:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.849+0000 7f1a86600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a80072210 0x7f1a8006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.849+0000 7f1a86600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a8015af40 0x7f1a800cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.849+0000 7f1a86600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a8015e9a0 con 0x7f1a80150f40 2024-04-25T09:06:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.849+0000 7f1a86600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8006f530 con 0x7f1a8015af40 2024-04-25T09:06:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.849+0000 7f1a86600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a8015dbe0 con 0x7f1a80072210 2024-04-25T09:06:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.849+0000 7f1a7fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a8015af40 0x7f1a800cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.849+0000 7f1a7fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a8015af40 0x7f1a800cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56500/0 (socket says 172.21.15.59:56500) 2024-04-25T09:06:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.849+0000 7f1a7fe00640 1 -- 172.21.15.59:0/1199017919 learned_addr learned my addr 172.21.15.59:0/1199017919 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.849+0000 7f1a76a00640 1 --2- 172.21.15.59:0/1199017919 >> v2:172.21.15.178:3300/0 conn(0x7f1a80072210 0x7f1a8006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a7fe00640 1 -- 172.21.15.59:0/1199017919 >> v2:172.21.15.178:3300/0 conn(0x7f1a80072210 msgr2=0x7f1a8006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a7fe00640 1 --2- 172.21.15.59:0/1199017919 >> v2:172.21.15.178:3300/0 conn(0x7f1a80072210 0x7f1a8006ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a7fe00640 1 -- 172.21.15.59:0/1199017919 >> v1:172.21.15.178:6789/0 conn(0x7f1a80150f40 legacy=0x7f1a80071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a7fe00640 1 -- 172.21.15.59:0/1199017919 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8015dec0 con 0x7f1a8015af40 2024-04-25T09:06:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a7fe00640 1 --2- 172.21.15.59:0/1199017919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a8015af40 0x7f1a800cdcc0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1a80072710 tx=0x7f1a7801ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737f16426b223570 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a7ea00640 1 -- 172.21.15.59:0/1199017919 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a780ad070 con 0x7f1a8015af40 2024-04-25T09:06:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a7ea00640 1 -- 172.21.15.59:0/1199017919 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a780a7920 con 0x7f1a8015af40 2024-04-25T09:06:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a7ea00640 1 -- 172.21.15.59:0/1199017919 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a780a7cf0 con 0x7f1a8015af40 2024-04-25T09:06:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a86600640 1 -- 172.21.15.59:0/1199017919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a8015af40 msgr2=0x7f1a800cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a86600640 1 --2- 172.21.15.59:0/1199017919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a8015af40 0x7f1a800cdcc0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1a80072710 tx=0x7f1a7801ead0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a86600640 1 -- 172.21.15.59:0/1199017919 shutdown_connections 2024-04-25T09:06:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a86600640 1 --2- 172.21.15.59:0/1199017919 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a8015af40 0x7f1a800cdcc0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a86600640 1 --2- 172.21.15.59:0/1199017919 >> v2:172.21.15.178:3300/0 conn(0x7f1a80072210 0x7f1a8006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a86600640 1 -- 172.21.15.59:0/1199017919 >> 172.21.15.59:0/1199017919 conn(0x7f1a80067080 msgr2=0x7f1a8006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a86600640 1 -- 172.21.15.59:0/1199017919 shutdown_connections 2024-04-25T09:06:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.853+0000 7f1a86600640 1 -- 172.21.15.59:0/1199017919 wait complete. 2024-04-25T09:06:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a86600640 1 Processor -- start 2024-04-25T09:06:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a86600640 1 -- start start 2024-04-25T09:06:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a86600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a80072210 0x7f1a8014b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a86600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a80150f40 0x7f1a8014d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a86600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a8015af40 0x7f1a80159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a86600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800ce380 con 0x7f1a80072210 2024-04-25T09:06:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a86600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800ce200 con 0x7f1a80150f40 2024-04-25T09:06:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a86600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a800ce500 con 0x7f1a8015af40 2024-04-25T09:06:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a7f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a80072210 0x7f1a8014b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a7f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a80072210 0x7f1a8014b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56512/0 (socket says 172.21.15.59:56512) 2024-04-25T09:06:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a7f400640 1 -- 172.21.15.59:0/3060462157 learned_addr learned my addr 172.21.15.59:0/3060462157 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a7fe00640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a8015af40 0x7f1a80159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a76a00640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a80150f40 0x7f1a8014d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a7f400640 1 -- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a8015af40 msgr2=0x7f1a80159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a7f400640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a8015af40 0x7f1a80159170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a7f400640 1 -- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a80150f40 msgr2=0x7f1a8014d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a7f400640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a80150f40 0x7f1a8014d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a7f400640 1 -- 172.21.15.59:0/3060462157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8014fad0 con 0x7f1a80072210 2024-04-25T09:06:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a76a00640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a80150f40 0x7f1a8014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a7f400640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a80072210 0x7f1a8014b2e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000c420 tx=0x7f1a7000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a77e00640 1 -- 172.21.15.59:0/3060462157 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a700052d0 con 0x7f1a80072210 2024-04-25T09:06:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a77e00640 1 -- 172.21.15.59:0/3060462157 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a70005470 con 0x7f1a80072210 2024-04-25T09:06:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a86600640 1 -- 172.21.15.59:0/3060462157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a8014b820 con 0x7f1a80072210 2024-04-25T09:06:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a77e00640 1 -- 172.21.15.59:0/3060462157 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a70007260 con 0x7f1a80072210 2024-04-25T09:06:25.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.857+0000 7f1a86600640 1 -- 172.21.15.59:0/3060462157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a80157280 con 0x7f1a80072210 2024-04-25T09:06:25.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.861+0000 7f1a86600640 1 -- 172.21.15.59:0/3060462157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a800745d0 con 0x7f1a80072210 2024-04-25T09:06:25.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.861+0000 7f1a77e00640 1 -- 172.21.15.59:0/3060462157 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1a70007400 con 0x7f1a80072210 2024-04-25T09:06:25.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.861+0000 7f1a77e00640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a5c066f60 0x7f1a5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:25.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.861+0000 7f1a77e00640 1 -- 172.21.15.59:0/3060462157 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f1a70084700 con 0x7f1a80072210 2024-04-25T09:06:25.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.861+0000 7f1a76a00640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a5c066f60 0x7f1a5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:25.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.861+0000 7f1a76a00640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a5c066f60 0x7f1a5c069420 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1a8006ef60 tx=0x7f1a68008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:25.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:25.865+0000 7f1a77e00640 1 -- 172.21.15.59:0/3060462157 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1a70054e40 con 0x7f1a80072210 2024-04-25T09:06:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.025+0000 7f1a86600640 1 -- 172.21.15.59:0/3060462157 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1a80071b00 con 0x7f1a80072210 2024-04-25T09:06:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.025+0000 7f1a77e00640 1 -- 172.21.15.59:0/3060462157 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1a70058ee0 con 0x7f1a80072210 2024-04-25T09:06:26.019 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:06:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.029+0000 7f1a86600640 1 -- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a5c066f60 msgr2=0x7f1a5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.029+0000 7f1a86600640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a5c066f60 0x7f1a5c069420 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1a8006ef60 tx=0x7f1a68008040 comp rx=0 tx=0).stop 2024-04-25T09:06:26.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.029+0000 7f1a86600640 1 -- 172.21.15.59:0/3060462157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a80072210 msgr2=0x7f1a8014b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.029+0000 7f1a86600640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a80072210 0x7f1a8014b2e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f1a7000c420 tx=0x7f1a7000c8e0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.029+0000 7f1a86600640 1 -- 172.21.15.59:0/3060462157 shutdown_connections 2024-04-25T09:06:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.029+0000 7f1a86600640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a5c066f60 0x7f1a5c069420 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.029+0000 7f1a86600640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a8015af40 0x7f1a80159170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.029+0000 7f1a86600640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a80150f40 0x7f1a8014d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.029+0000 7f1a86600640 1 --2- 172.21.15.59:0/3060462157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a80072210 0x7f1a8014b2e0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.029+0000 7f1a86600640 1 -- 172.21.15.59:0/3060462157 >> 172.21.15.59:0/3060462157 conn(0x7f1a80067080 msgr2=0x7f1a80150280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.029+0000 7f1a86600640 1 -- 172.21.15.59:0/3060462157 shutdown_connections 2024-04-25T09:06:26.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.029+0000 7f1a86600640 1 -- 172.21.15.59:0/3060462157 wait complete. 2024-04-25T09:06:26.042 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:06:26.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc04ee00640 1 Processor -- start 2024-04-25T09:06:26.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc04ee00640 1 -- start start 2024-04-25T09:06:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc04ee00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc04815e770 0x7fc04815eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc04ee00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc048071270 0x7fc0480716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc04ee00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04806db20 con 0x7fc04806d2d0 2024-04-25T09:06:26.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc04ee00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04815f090 con 0x7fc04815e770 2024-04-25T09:06:26.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc04ee00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc048071c20 con 0x7fc048071270 2024-04-25T09:06:26.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc047e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc04815e770 0x7fc04815eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc03f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc04806d2d0 0x7fc04815f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34262/0 (socket says 172.21.15.59:34262) 2024-04-25T09:06:26.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc03f400640 1 -- 172.21.15.59:0/2595149757 learned_addr learned my addr 172.21.15.59:0/2595149757 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:26.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc04ce00640 1 --2- 172.21.15.59:0/2595149757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc048071270 0x7fc0480716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc047e00640 1 -- 172.21.15.59:0/2595149757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc048071270 msgr2=0x7fc0480716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:26.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc047e00640 1 --2- 172.21.15.59:0/2595149757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc048071270 0x7fc0480716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc047e00640 1 -- 172.21.15.59:0/2595149757 >> v1:172.21.15.59:6789/0 conn(0x7fc04806d2d0 legacy=0x7fc04815f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc047e00640 1 -- 172.21.15.59:0/2595149757 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04806de00 con 0x7fc04815e770 2024-04-25T09:06:26.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc047400640 1 -- 172.21.15.59:0/2595149757 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3615298791 0 0) 0x7fc04806db20 con 0x7fc04806d2d0 2024-04-25T09:06:26.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.193+0000 7fc04ce00640 1 --2- 172.21.15.59:0/2595149757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc048071270 0x7fc0480716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.197+0000 7fc047e00640 1 --2- 172.21.15.59:0/2595149757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc04815e770 0x7fc04815eb50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fc038009d90 tx=0x7fc03801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf0e91b2ef04b11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.197+0000 7fc047400640 1 -- 172.21.15.59:0/2595149757 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380b2070 con 0x7fc04815e770 2024-04-25T09:06:26.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.197+0000 7fc047400640 1 -- 172.21.15.59:0/2595149757 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0380a59a0 con 0x7fc04815e770 2024-04-25T09:06:26.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.197+0000 7fc047400640 1 -- 172.21.15.59:0/2595149757 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380a5d70 con 0x7fc04815e770 2024-04-25T09:06:26.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.197+0000 7fc04ee00640 1 -- 172.21.15.59:0/2595149757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc04815e770 msgr2=0x7fc04815eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.197+0000 7fc04ee00640 1 --2- 172.21.15.59:0/2595149757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc04815e770 0x7fc04815eb50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fc038009d90 tx=0x7fc03801c8e0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.197+0000 7fc04ee00640 1 -- 172.21.15.59:0/2595149757 shutdown_connections 2024-04-25T09:06:26.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.197+0000 7fc04ee00640 1 --2- 172.21.15.59:0/2595149757 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc048071270 0x7fc0480716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.197+0000 7fc04ee00640 1 --2- 172.21.15.59:0/2595149757 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc04815e770 0x7fc04815eb50 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.197+0000 7fc04ee00640 1 -- 172.21.15.59:0/2595149757 >> 172.21.15.59:0/2595149757 conn(0x7fc048067080 msgr2=0x7fc04806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:26.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.197+0000 7fc04ee00640 1 -- 172.21.15.59:0/2595149757 shutdown_connections 2024-04-25T09:06:26.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.197+0000 7fc04ee00640 1 -- 172.21.15.59:0/2595149757 wait complete. 2024-04-25T09:06:26.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc04ee00640 1 Processor -- start 2024-04-25T09:06:26.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc04ee00640 1 -- start start 2024-04-25T09:06:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc04ee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc04806d2d0 0x7fc0480b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc04ee00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc048071270 0x7fc04815a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc04ee00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc04815e770 0x7fc04815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc04ee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04806d8a0 con 0x7fc04806d2d0 2024-04-25T09:06:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc04ee00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc04806d720 con 0x7fc048071270 2024-04-25T09:06:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc04ee00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0480aed70 con 0x7fc04815e770 2024-04-25T09:06:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc047e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc04806d2d0 0x7fc0480b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc047e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc04806d2d0 0x7fc0480b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56520/0 (socket says 172.21.15.59:56520) 2024-04-25T09:06:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc047e00640 1 -- 172.21.15.59:0/3385901640 learned_addr learned my addr 172.21.15.59:0/3385901640 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc04ce00640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc04815e770 0x7fc04815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc03f400640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc048071270 0x7fc04815a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc047e00640 1 -- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc04815e770 msgr2=0x7fc04815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc047e00640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc04815e770 0x7fc04815ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc047e00640 1 -- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc048071270 msgr2=0x7fc04815a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc047e00640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc048071270 0x7fc04815a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc047e00640 1 -- 172.21.15.59:0/3385901640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0480b42f0 con 0x7fc04806d2d0 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc03f400640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc048071270 0x7fc04815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc047e00640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc04806d2d0 0x7fc0480b3db0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fc0380b0040 tx=0x7fc038019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc044c00640 1 -- 172.21.15.59:0/3385901640 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380bd020 con 0x7fc04806d2d0 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc044c00640 1 -- 172.21.15.59:0/3385901640 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0380b8670 con 0x7fc04806d2d0 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc04ee00640 1 -- 172.21.15.59:0/3385901640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04814d700 con 0x7fc04806d2d0 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc044c00640 1 -- 172.21.15.59:0/3385901640 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380b2040 con 0x7fc04806d2d0 2024-04-25T09:06:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.201+0000 7fc04ee00640 1 -- 172.21.15.59:0/3385901640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc048155aa0 con 0x7fc04806d2d0 2024-04-25T09:06:26.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.205+0000 7fc04ee00640 1 -- 172.21.15.59:0/3385901640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0480745d0 con 0x7fc04806d2d0 2024-04-25T09:06:26.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.205+0000 7fc044c00640 1 -- 172.21.15.59:0/3385901640 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc0380c0020 con 0x7fc04806d2d0 2024-04-25T09:06:26.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.205+0000 7fc044c00640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc024066f60 0x7fc024069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.205+0000 7fc044c00640 1 -- 172.21.15.59:0/3385901640 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fc038120140 con 0x7fc04806d2d0 2024-04-25T09:06:26.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.205+0000 7fc03f400640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc024066f60 0x7fc024069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.205+0000 7fc03f400640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc024066f60 0x7fc024069420 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc04815ba70 tx=0x7fc030009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.209+0000 7fc044c00640 1 -- 172.21.15.59:0/3385901640 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc0380c7030 con 0x7fc04806d2d0 2024-04-25T09:06:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.373+0000 7fc04ee00640 1 -- 172.21.15.59:0/3385901640 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc04815ee70 con 0x7fc04806d2d0 2024-04-25T09:06:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.373+0000 7fc044c00640 1 -- 172.21.15.59:0/3385901640 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc038016560 con 0x7fc04806d2d0 2024-04-25T09:06:26.366 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:06:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.377+0000 7fc04ee00640 1 -- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc024066f60 msgr2=0x7fc024069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.377+0000 7fc04ee00640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc024066f60 0x7fc024069420 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc04815ba70 tx=0x7fc030009040 comp rx=0 tx=0).stop 2024-04-25T09:06:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.377+0000 7fc04ee00640 1 -- 172.21.15.59:0/3385901640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc04806d2d0 msgr2=0x7fc0480b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.377+0000 7fc04ee00640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc04806d2d0 0x7fc0480b3db0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fc0380b0040 tx=0x7fc038019680 comp rx=0 tx=0).stop 2024-04-25T09:06:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.377+0000 7fc04ee00640 1 -- 172.21.15.59:0/3385901640 shutdown_connections 2024-04-25T09:06:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.377+0000 7fc04ee00640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc024066f60 0x7fc024069420 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.377+0000 7fc04ee00640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc04815e770 0x7fc04815ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.377+0000 7fc04ee00640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc048071270 0x7fc04815a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.377+0000 7fc04ee00640 1 --2- 172.21.15.59:0/3385901640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc04806d2d0 0x7fc0480b3db0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.377+0000 7fc04ee00640 1 -- 172.21.15.59:0/3385901640 >> 172.21.15.59:0/3385901640 conn(0x7fc048067080 msgr2=0x7fc04815bc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.377+0000 7fc04ee00640 1 -- 172.21.15.59:0/3385901640 shutdown_connections 2024-04-25T09:06:26.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.377+0000 7fc04ee00640 1 -- 172.21.15.59:0/3385901640 wait complete. 2024-04-25T09:06:26.387 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:06:26.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f353e200640 1 Processor -- start 2024-04-25T09:06:26.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f353e200640 1 -- start start 2024-04-25T09:06:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f353e200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f353815b470 0x7f3538161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f353e200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3538161d80 con 0x7f35380b9320 2024-04-25T09:06:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f353e200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3538162060 con 0x7f35380ce660 2024-04-25T09:06:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f353e200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3538162340 con 0x7f353815b470 2024-04-25T09:06:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f35380b9320 0x7f353815e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34270/0 (socket says 172.21.15.59:34270) 2024-04-25T09:06:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537e00640 1 -- 172.21.15.59:0/2015486549 learned_addr learned my addr 172.21.15.59:0/2015486549 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:26.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f353ce00640 1 --2- 172.21.15.59:0/2015486549 >> v2:172.21.15.178:3300/0 conn(0x7f353815b470 0x7f3538161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488507912 0 0) 0x7f3538161d80 con 0x7f35380b9320 2024-04-25T09:06:26.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3520003530 con 0x7f35380b9320 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128126022 0 0) 0x7f3538162060 con 0x7f35380ce660 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3538161d80 con 0x7f35380ce660 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1642627741 0 0) 0x7f3520003530 con 0x7f35380b9320 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 >> v2:172.21.15.178:3300/0 conn(0x7f353815b470 msgr2=0x7f3538161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 --2- 172.21.15.59:0/2015486549 >> v2:172.21.15.178:3300/0 conn(0x7f353815b470 0x7f3538161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 >> v1:172.21.15.178:6789/0 conn(0x7f35380ce660 legacy=0x7f35380d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353815e050 con 0x7f35380b9320 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f3524001680 con 0x7f35380b9320 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f353ce00640 1 --2- 172.21.15.59:0/2015486549 >> v2:172.21.15.178:3300/0 conn(0x7f353815b470 0x7f3538161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 >> v1:172.21.15.59:6789/0 conn(0x7f35380b9320 legacy=0x7f353815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 --2- 172.21.15.59:0/2015486549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3520003ba0 0x7f3520003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 --2- 172.21.15.59:0/2015486549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3520004810 0x7f3520004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 --2- 172.21.15.59:0/2015486549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3520005290 0x7f352000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538162340 con 0x7f3520004810 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f352000c1d0 con 0x7f3520003ba0 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.537+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f352000c3d0 con 0x7f3520005290 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f3537e00640 1 --2- 172.21.15.59:0/2015486549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3520004810 0x7f3520004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f353ce00640 1 --2- 172.21.15.59:0/2015486549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3520003ba0 0x7f3520003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f353d800640 1 --2- 172.21.15.59:0/2015486549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3520005290 0x7f352000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f3537e00640 1 -- 172.21.15.59:0/2015486549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3520005290 msgr2=0x7f352000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f3537e00640 1 --2- 172.21.15.59:0/2015486549 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3520005290 0x7f352000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f3537e00640 1 -- 172.21.15.59:0/2015486549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3520003ba0 msgr2=0x7f3520003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f3537e00640 1 --2- 172.21.15.59:0/2015486549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3520003ba0 0x7f3520003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f3537e00640 1 -- 172.21.15.59:0/2015486549 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3520003530 con 0x7f3520004810 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f353ce00640 1 --2- 172.21.15.59:0/2015486549 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3520003ba0 0x7f3520003fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f353d800640 1 -- 172.21.15.59:0/2015486549 reap_dead start 2024-04-25T09:06:26.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f3537e00640 1 --2- 172.21.15.59:0/2015486549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3520004810 0x7f3520004c90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f3524007fa0 tx=0x7f352401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d552437d42542615 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524007bf0 con 0x7f3520004810 2024-04-25T09:06:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35240a9020 con 0x7f3520004810 2024-04-25T09:06:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.541+0000 7f3537400640 1 -- 172.21.15.59:0/2015486549 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524005b00 con 0x7f3520004810 2024-04-25T09:06:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 -- 172.21.15.59:0/2015486549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3520004810 msgr2=0x7f3520004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 --2- 172.21.15.59:0/2015486549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3520004810 0x7f3520004c90 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f3524007fa0 tx=0x7f352401cab0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 -- 172.21.15.59:0/2015486549 shutdown_connections 2024-04-25T09:06:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 --2- 172.21.15.59:0/2015486549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3520004810 0x7f3520004c90 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 -- 172.21.15.59:0/2015486549 >> 172.21.15.59:0/2015486549 conn(0x7f3538072340 msgr2=0x7f3538072750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 -- 172.21.15.59:0/2015486549 shutdown_connections 2024-04-25T09:06:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 -- 172.21.15.59:0/2015486549 wait complete. 2024-04-25T09:06:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 Processor -- start 2024-04-25T09:06:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 -- start start 2024-04-25T09:06:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3520004810 0x7f35380c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35381f7640 0x7f3538159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3538159db0 0x7f3538148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538161ac0 con 0x7f3538159db0 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538161940 con 0x7f35381f7640 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353e200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35380d1ab0 con 0x7f3520004810 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3538159db0 0x7f3538148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353d800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3538159db0 0x7f3538148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56538/0 (socket says 172.21.15.59:56538) 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353d800640 1 -- 172.21.15.59:0/2055596038 learned_addr learned my addr 172.21.15.59:0/2055596038 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353ce00640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3520004810 0x7f35380c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f3537e00640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35381f7640 0x7f3538159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353d800640 1 -- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3520004810 msgr2=0x7f35380c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353d800640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3520004810 0x7f35380c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353d800640 1 -- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35381f7640 msgr2=0x7f3538159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353d800640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35381f7640 0x7f3538159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353d800640 1 -- 172.21.15.59:0/2055596038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380c9090 con 0x7f3538159db0 2024-04-25T09:06:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.545+0000 7f353d800640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3538159db0 0x7f3538148590 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f353000e700 tx=0x7f353000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.549+0000 7f3534c00640 1 -- 172.21.15.59:0/2055596038 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530006b60 con 0x7f3538159db0 2024-04-25T09:06:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.549+0000 7f3534c00640 1 -- 172.21.15.59:0/2055596038 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3530006d00 con 0x7f3538159db0 2024-04-25T09:06:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.549+0000 7f3534c00640 1 -- 172.21.15.59:0/2055596038 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530003980 con 0x7f3538159db0 2024-04-25T09:06:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.549+0000 7f353e200640 1 -- 172.21.15.59:0/2055596038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35380cad00 con 0x7f3538159db0 2024-04-25T09:06:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.549+0000 7f353e200640 1 -- 172.21.15.59:0/2055596038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35380cb2c0 con 0x7f3538159db0 2024-04-25T09:06:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.549+0000 7f353e200640 1 -- 172.21.15.59:0/2055596038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353815a230 con 0x7f3538159db0 2024-04-25T09:06:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.549+0000 7f3534c00640 1 -- 172.21.15.59:0/2055596038 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f353001a020 con 0x7f3538159db0 2024-04-25T09:06:26.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.549+0000 7f3534c00640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3518066f90 0x7f3518069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:26.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.549+0000 7f3534c00640 1 -- 172.21.15.59:0/2055596038 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f35300847c0 con 0x7f3538159db0 2024-04-25T09:06:26.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.549+0000 7f353ce00640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3518066f90 0x7f3518069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:26.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.553+0000 7f353ce00640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3518066f90 0x7f3518069450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3538075b60 tx=0x7f352c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:26.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.553+0000 7f3534c00640 1 -- 172.21.15.59:0/2055596038 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3530055680 con 0x7f3538159db0 2024-04-25T09:06:26.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.725+0000 7f353e200640 1 -- 172.21.15.59:0/2055596038 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f35380745d0 con 0x7f3538159db0 2024-04-25T09:06:26.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.725+0000 7f3534c00640 1 -- 172.21.15.59:0/2055596038 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v81) v1 ==== 80+0+122 (secure 0 0 0) 0x7f3530054f80 con 0x7f3538159db0 2024-04-25T09:06:26.720 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6834/1468235926 2024-04-26T09:06:18.012326+0000 2024-04-25T09:06:26.720 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6832/1468235926 2024-04-26T09:06:18.012326+0000 2024-04-25T09:06:26.720 INFO:teuthology.orchestra.run.smithi059.stderr:listed 2 entries 2024-04-25T09:06:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.729+0000 7f353e200640 1 -- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3518066f90 msgr2=0x7f3518069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.729+0000 7f353e200640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3518066f90 0x7f3518069450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3538075b60 tx=0x7f352c008040 comp rx=0 tx=0).stop 2024-04-25T09:06:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.729+0000 7f353e200640 1 -- 172.21.15.59:0/2055596038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3538159db0 msgr2=0x7f3538148590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.729+0000 7f353e200640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3538159db0 0x7f3538148590 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f353000e700 tx=0x7f353000ebc0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.729+0000 7f353e200640 1 -- 172.21.15.59:0/2055596038 shutdown_connections 2024-04-25T09:06:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.729+0000 7f353e200640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3518066f90 0x7f3518069450 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.729+0000 7f353e200640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3538159db0 0x7f3538148590 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.729+0000 7f353e200640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f35381f7640 0x7f3538159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.729+0000 7f353e200640 1 --2- 172.21.15.59:0/2055596038 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3520004810 0x7f35380c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.729+0000 7f353e200640 1 -- 172.21.15.59:0/2055596038 >> 172.21.15.59:0/2055596038 conn(0x7f3538072340 msgr2=0x7f35380b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.729+0000 7f353e200640 1 -- 172.21.15.59:0/2055596038 shutdown_connections 2024-04-25T09:06:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:26.729+0000 7f353e200640 1 -- 172.21.15.59:0/2055596038 wait complete. 2024-04-25T09:06:26.740 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:06:26.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:26.741 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:06:26.767 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:06:26.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:26.767 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:06:26.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:26.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-04-25T09:06:27.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.025+0000 7ff48bc00640 1 Processor -- start 2024-04-25T09:06:27.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff48bc00640 1 -- start start 2024-04-25T09:06:27.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff48bc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff48415bb30 0x7ff4840ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff48bc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff48406ac10 0x7ff4840cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff48bc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4840cd480 con 0x7ff4840cfdc0 2024-04-25T09:06:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff48bc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4840ce460 con 0x7ff48406ac10 2024-04-25T09:06:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff48bc00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4840cd720 con 0x7ff48415bb30 2024-04-25T09:06:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff47be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff48406ac10 0x7ff4840cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff47be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff48406ac10 0x7ff4840cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56540/0 (socket says 172.21.15.59:56540) 2024-04-25T09:06:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff47be00640 1 -- 172.21.15.59:0/2294237745 learned_addr learned my addr 172.21.15.59:0/2294237745 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff489200640 1 --2- 172.21.15.59:0/2294237745 >> v2:172.21.15.178:3300/0 conn(0x7ff48415bb30 0x7ff4840ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff47be00640 1 -- 172.21.15.59:0/2294237745 >> v2:172.21.15.178:3300/0 conn(0x7ff48415bb30 msgr2=0x7ff4840ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff47be00640 1 --2- 172.21.15.59:0/2294237745 >> v2:172.21.15.178:3300/0 conn(0x7ff48415bb30 0x7ff4840ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff47be00640 1 -- 172.21.15.59:0/2294237745 >> v1:172.21.15.59:6789/0 conn(0x7ff4840cfdc0 legacy=0x7ff4840cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.029+0000 7ff47be00640 1 -- 172.21.15.59:0/2294237745 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4840cda00 con 0x7ff48406ac10 2024-04-25T09:06:27.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff47be00640 1 --2- 172.21.15.59:0/2294237745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48406ac10 0x7ff4840cf880 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff484067a10 tx=0x7ff46c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a4be5cbb095628 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff483e00640 1 -- 172.21.15.59:0/2294237745 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c0ab610 con 0x7ff48406ac10 2024-04-25T09:06:27.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff483e00640 1 -- 172.21.15.59:0/2294237745 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c0b0070 con 0x7ff48406ac10 2024-04-25T09:06:27.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff483e00640 1 -- 172.21.15.59:0/2294237745 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c0ab9d0 con 0x7ff48406ac10 2024-04-25T09:06:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff48bc00640 1 -- 172.21.15.59:0/2294237745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48406ac10 msgr2=0x7ff4840cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff48bc00640 1 --2- 172.21.15.59:0/2294237745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48406ac10 0x7ff4840cf880 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7ff484067a10 tx=0x7ff46c01c520 comp rx=0 tx=0).stop 2024-04-25T09:06:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff48bc00640 1 -- 172.21.15.59:0/2294237745 shutdown_connections 2024-04-25T09:06:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff48bc00640 1 --2- 172.21.15.59:0/2294237745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48406ac10 0x7ff4840cf880 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff48bc00640 1 --2- 172.21.15.59:0/2294237745 >> v2:172.21.15.178:3300/0 conn(0x7ff48415bb30 0x7ff4840ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff48bc00640 1 -- 172.21.15.59:0/2294237745 >> 172.21.15.59:0/2294237745 conn(0x7ff4840b2240 msgr2=0x7ff4840b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff48bc00640 1 -- 172.21.15.59:0/2294237745 shutdown_connections 2024-04-25T09:06:27.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff48bc00640 1 -- 172.21.15.59:0/2294237745 wait complete. 2024-04-25T09:06:27.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff48bc00640 1 Processor -- start 2024-04-25T09:06:27.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.033+0000 7ff48bc00640 1 -- start start 2024-04-25T09:06:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff48bc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff48406ac10 0x7ff484152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff48bc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4840cfdc0 0x7ff4840b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff48bc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48415bb30 0x7ff48406f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff48bc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff484168540 con 0x7ff48415bb30 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff48bc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4840d01d0 con 0x7ff48406ac10 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff48bc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4841686c0 con 0x7ff4840cfdc0 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff489c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48415bb30 0x7ff48406f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff489c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48415bb30 0x7ff48406f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56556/0 (socket says 172.21.15.59:56556) 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff489c00640 1 -- 172.21.15.59:0/373171089 learned_addr learned my addr 172.21.15.59:0/373171089 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff489200640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff48406ac10 0x7ff484152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff47be00640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4840cfdc0 0x7ff4840b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff489c00640 1 -- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4840cfdc0 msgr2=0x7ff4840b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff489c00640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4840cfdc0 0x7ff4840b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff489c00640 1 -- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff48406ac10 msgr2=0x7ff484152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff489c00640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff48406ac10 0x7ff484152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff489c00640 1 -- 172.21.15.59:0/373171089 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4840b4cb0 con 0x7ff48415bb30 2024-04-25T09:06:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff489c00640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48415bb30 0x7ff48406f9f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00c7a0 tx=0x7ff47c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff481600640 1 -- 172.21.15.59:0/373171089 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c003b80 con 0x7ff48415bb30 2024-04-25T09:06:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff481600640 1 -- 172.21.15.59:0/373171089 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c003d20 con 0x7ff48415bb30 2024-04-25T09:06:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff48bc00640 1 -- 172.21.15.59:0/373171089 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4840b4f90 con 0x7ff48415bb30 2024-04-25T09:06:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff481600640 1 -- 172.21.15.59:0/373171089 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c00aa90 con 0x7ff48415bb30 2024-04-25T09:06:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.037+0000 7ff48bc00640 1 -- 172.21.15.59:0/373171089 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4840b5550 con 0x7ff48415bb30 2024-04-25T09:06:27.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff481600640 1 -- 172.21.15.59:0/373171089 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff47c00ac30 con 0x7ff48415bb30 2024-04-25T09:06:27.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff481600640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff460066f60 0x7ff460069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff481600640 1 -- 172.21.15.59:0/373171089 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff47c084fe0 con 0x7ff48415bb30 2024-04-25T09:06:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff489200640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff460066f60 0x7ff460069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff48efd4000 1 Processor -- start 2024-04-25T09:06:27.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff48efd4000 1 -- start start 2024-04-25T09:06:27.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff489200640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff460066f60 0x7ff460069420 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff4840cabd0 tx=0x7ff474008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff48efd4000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7c028c0 0x55c3e7c02ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff48efd4000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c031e0 0x55c3e7bb8110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff48efd4000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7bb8650 0x55c3e7bb8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff48efd4000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e7a06dd0 con 0x55c3e7bb8650 2024-04-25T09:06:27.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff48efd4000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e798f010 con 0x55c3e7c028c0 2024-04-25T09:06:27.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff48efd4000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3e7a02e70 con 0x55c3e7c031e0 2024-04-25T09:06:27.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff489c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7bb8650 0x55c3e7bb8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff489c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7bb8650 0x55c3e7bb8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56572/0 (socket says 172.21.15.59:56572) 2024-04-25T09:06:27.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff489c00640 1 -- 172.21.15.59:0/1686380320 learned_addr learned my addr 172.21.15.59:0/1686380320 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff489200640 1 --2- 172.21.15.59:0/1686380320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7c028c0 0x55c3e7c02ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff47be00640 1 --2- 172.21.15.59:0/1686380320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c031e0 0x55c3e7bb8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff489c00640 1 -- 172.21.15.59:0/1686380320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c031e0 msgr2=0x55c3e7bb8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff489c00640 1 --2- 172.21.15.59:0/1686380320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c031e0 0x55c3e7bb8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff489c00640 1 -- 172.21.15.59:0/1686380320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7c028c0 msgr2=0x55c3e7c02ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff489c00640 1 --2- 172.21.15.59:0/1686380320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7c028c0 0x55c3e7c02ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff489c00640 1 -- 172.21.15.59:0/1686380320 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3e79bf9c0 con 0x55c3e7bb8650 2024-04-25T09:06:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff489c00640 1 --2- 172.21.15.59:0/1686380320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7bb8650 0x55c3e7bb8a30 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff47c05d900 tx=0x7ff47c055410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5f6aabe52d48bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.041+0000 7ff479600640 1 -- 172.21.15.59:0/1686380320 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c05de30 con 0x55c3e7bb8650 2024-04-25T09:06:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff479600640 1 -- 172.21.15.59:0/1686380320 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c053ad0 con 0x55c3e7bb8650 2024-04-25T09:06:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff479600640 1 -- 172.21.15.59:0/1686380320 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c051e40 con 0x55c3e7bb8650 2024-04-25T09:06:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 -- 172.21.15.59:0/1686380320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7bb8650 msgr2=0x55c3e7bb8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 --2- 172.21.15.59:0/1686380320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7bb8650 0x55c3e7bb8a30 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff47c05d900 tx=0x7ff47c055410 comp rx=0 tx=0).stop 2024-04-25T09:06:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 -- 172.21.15.59:0/1686380320 shutdown_connections 2024-04-25T09:06:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 --2- 172.21.15.59:0/1686380320 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7bb8650 0x55c3e7bb8a30 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 --2- 172.21.15.59:0/1686380320 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c031e0 0x55c3e7bb8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 --2- 172.21.15.59:0/1686380320 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7c028c0 0x55c3e7c02ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 -- 172.21.15.59:0/1686380320 >> 172.21.15.59:0/1686380320 conn(0x55c3e7aa0870 msgr2=0x55c3e7bb69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 -- 172.21.15.59:0/1686380320 shutdown_connections 2024-04-25T09:06:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 -- 172.21.15.59:0/1686380320 wait complete. 2024-04-25T09:06:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 -- start start 2024-04-25T09:06:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 Processor -- start 2024-04-25T09:06:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7bb8650 0x55c3e7bbcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c028c0 0x55c3e7bbd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7c031e0 0x55c3e7bbda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e79c1420 con 0x55c3e7c031e0 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e7a89470 con 0x55c3e7bb8650 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3e7bc1c20 con 0x55c3e7c028c0 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff48efd4000 10 client.0 _ll_register_callbacks cb 0x55c3e7ba3f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff489c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7c031e0 0x55c3e7bbda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff489200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7bb8650 0x55c3e7bbcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff489200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7bb8650 0x55c3e7bbcfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:58930/0 (socket says 172.21.15.59:58930) 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff47be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c028c0 0x55c3e7bbd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff489200640 1 -- 172.21.15.59:0/3228379404 learned_addr learned my addr 172.21.15.59:0/3228379404 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff489c00640 1 -- 172.21.15.59:0/3228379404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c028c0 msgr2=0x55c3e7bbd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff489c00640 1 --2- 172.21.15.59:0/3228379404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c028c0 0x55c3e7bbd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff489c00640 1 -- 172.21.15.59:0/3228379404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7bb8650 msgr2=0x55c3e7bbcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff489c00640 1 --2- 172.21.15.59:0/3228379404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7bb8650 0x55c3e7bbcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff489c00640 1 -- 172.21.15.59:0/3228379404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3e798f260 con 0x55c3e7c031e0 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff489200640 1 --2- 172.21.15.59:0/3228379404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7bb8650 0x55c3e7bbcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff489c00640 1 --2- 172.21.15.59:0/3228379404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7c031e0 0x55c3e7bbda20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00a430 tx=0x7ff47c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186734525d9bb208 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff472000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.045+0000 7ff472000640 1 -- 172.21.15.59:0/3228379404 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c083030 con 0x55c3e7c031e0 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff472000640 1 -- 172.21.15.59:0/3228379404 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff47c06ed40 con 0x55c3e7c031e0 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 -- 172.21.15.59:0/3228379404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff47c053ad0 con 0x55c3e7c031e0 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff472000640 1 -- 172.21.15.59:0/3228379404 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff47c05de30 con 0x55c3e7c031e0 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 10 client.7110 fetch_fsmap learned FSMap version 54 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 -- 172.21.15.59:0/3228379404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55c3e79c1b30 con 0x55c3e7c031e0 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff472000640 1 -- 172.21.15.59:0/3228379404 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c053ad0 con 0x55c3e7c031e0 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff472000640 1 -- 172.21.15.59:0/3228379404 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff47c073b60 con 0x55c3e7c031e0 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 10 client.7110 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 10 client.7110 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:06:27.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 20 client.7110 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 --2- 172.21.15.59:0/3228379404 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55c3e7bbe430 0x55c3e7c13960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 4 client.7110 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 -- 172.21.15.59:0/3228379404 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c3e79a2c80 con 0x55c3e7bbe430 2024-04-25T09:06:27.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff489200640 1 --2- 172.21.15.59:0/3228379404 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55c3e7bbe430 0x55c3e7c13960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff489200640 1 --2- 172.21.15.59:0/3228379404 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55c3e7bbe430 0x55c3e7c13960 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7f947fb7de7ef39 server_cookie=d239d6cc5da624be in_seq=0 out_seq=0 2024-04-25T09:06:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff472000640 10 client.7110 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff472000640 1 -- 172.21.15.59:0/3228379404 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c3e79a2c80 con 0x55c3e7bbe430 2024-04-25T09:06:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff472000640 10 client.7110 handle_command_reply: tid=0 2024-04-25T09:06:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 client.7110 shutdown 2024-04-25T09:06:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 -- 172.21.15.59:0/3228379404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7c031e0 msgr2=0x55c3e7bbda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 --2- 172.21.15.59:0/3228379404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7c031e0 0x55c3e7bbda20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00a430 tx=0x7ff47c001260 comp rx=0 tx=0).stop 2024-04-25T09:06:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 -- 172.21.15.59:0/3228379404 shutdown_connections 2024-04-25T09:06:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 --2- 172.21.15.59:0/3228379404 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55c3e7bbe430 0x55c3e7c13960 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 --2- 172.21.15.59:0/3228379404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7c031e0 0x55c3e7bbda20 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 --2- 172.21.15.59:0/3228379404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c028c0 0x55c3e7bbd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 --2- 172.21.15.59:0/3228379404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7bb8650 0x55c3e7bbcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff472000640 0 client.7110 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 -- 172.21.15.59:0/3228379404 >> 172.21.15.59:0/3228379404 conn(0x55c3e7aa0870 msgr2=0x55c3e7bb69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 -- 172.21.15.59:0/3228379404 shutdown_connections 2024-04-25T09:06:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 1 -- 172.21.15.59:0/3228379404 wait complete. 2024-04-25T09:06:27.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.049+0000 7ff48efd4000 20 client.7110 trim_cache size 0 max 16384 2024-04-25T09:06:27.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff48efd4000 1 Processor -- start 2024-04-25T09:06:27.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff48efd4000 1 -- start start 2024-04-25T09:06:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff48efd4000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 0x55c3e7c5e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff48efd4000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7bb8650 0x55c3e7c5ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff48efd4000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c028c0 0x55c3e7c5f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff48efd4000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff484202840 con 0x55c3e7aa0870 2024-04-25T09:06:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff48efd4000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4840ae8b0 con 0x55c3e7bb8650 2024-04-25T09:06:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff48efd4000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff484202240 con 0x55c3e7c028c0 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff489200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 0x55c3e7c5e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff489200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 0x55c3e7c5e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56580/0 (socket says 172.21.15.59:56580) 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff489200640 1 -- 172.21.15.59:0/844282152 learned_addr learned my addr 172.21.15.59:0/844282152 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff47be00640 1 --2- 172.21.15.59:0/844282152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7bb8650 0x55c3e7c5ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff489c00640 1 --2- 172.21.15.59:0/844282152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c028c0 0x55c3e7c5f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff489200640 1 -- 172.21.15.59:0/844282152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c028c0 msgr2=0x55c3e7c5f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff489200640 1 --2- 172.21.15.59:0/844282152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c028c0 0x55c3e7c5f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff489200640 1 -- 172.21.15.59:0/844282152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7bb8650 msgr2=0x55c3e7c5ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff489200640 1 --2- 172.21.15.59:0/844282152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7bb8650 0x55c3e7c5ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff489200640 1 -- 172.21.15.59:0/844282152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3e7a8c6d0 con 0x55c3e7aa0870 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff489200640 1 --2- 172.21.15.59:0/844282152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 0x55c3e7c5e7f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff4740077a0 tx=0x7ff474015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80cb29ba31168d6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff478c00640 1 -- 172.21.15.59:0/844282152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47401c040 con 0x55c3e7aa0870 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff478c00640 1 -- 172.21.15.59:0/844282152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47401d040 con 0x55c3e7aa0870 2024-04-25T09:06:27.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.065+0000 7ff478c00640 1 -- 172.21.15.59:0/844282152 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474016d50 con 0x55c3e7aa0870 2024-04-25T09:06:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 -- 172.21.15.59:0/844282152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 msgr2=0x55c3e7c5e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 --2- 172.21.15.59:0/844282152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 0x55c3e7c5e7f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff4740077a0 tx=0x7ff474015000 comp rx=0 tx=0).stop 2024-04-25T09:06:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 -- 172.21.15.59:0/844282152 shutdown_connections 2024-04-25T09:06:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 --2- 172.21.15.59:0/844282152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7c028c0 0x55c3e7c5f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 --2- 172.21.15.59:0/844282152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7bb8650 0x55c3e7c5ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 --2- 172.21.15.59:0/844282152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 0x55c3e7c5e7f0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 -- 172.21.15.59:0/844282152 >> 172.21.15.59:0/844282152 conn(0x55c3e7be4620 msgr2=0x55c3e7c01aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 -- 172.21.15.59:0/844282152 shutdown_connections 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 -- 172.21.15.59:0/844282152 wait complete. 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 -- start start 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 Processor -- start 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 0x55c3e7c63cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7bb8650 0x55c3e7c66240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7c028c0 0x55c3e7c68790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e79adae0 con 0x55c3e7aa0870 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3e7a060e0 con 0x55c3e7c028c0 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3e7a0b400 con 0x55c3e7bb8650 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 10 client.0 _ll_register_callbacks cb 0x55c3e79a3200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff489200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 0x55c3e7c63cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff489200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 0x55c3e7c63cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56584/0 (socket says 172.21.15.59:56584) 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff489200640 1 -- 172.21.15.59:0/373270186 learned_addr learned my addr 172.21.15.59:0/373270186 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff489c00640 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7c028c0 0x55c3e7c68790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff47be00640 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7bb8650 0x55c3e7c66240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff489200640 1 -- 172.21.15.59:0/373270186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7bb8650 msgr2=0x55c3e7c66240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff489200640 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7bb8650 0x55c3e7c66240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff489200640 1 -- 172.21.15.59:0/373270186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7c028c0 msgr2=0x55c3e7c68790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff489200640 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7c028c0 0x55c3e7c68790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff489200640 1 -- 172.21.15.59:0/373270186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c3e7a89900 con 0x55c3e7aa0870 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff489200640 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 0x55c3e7c63cf0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff474016500 tx=0x7ff474013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fd89132e70ac73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff472000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff472000640 1 -- 172.21.15.59:0/373270186 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474038060 con 0x55c3e7aa0870 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff472000640 1 -- 172.21.15.59:0/373270186 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff47402a250 con 0x55c3e7aa0870 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 -- 172.21.15.59:0/373270186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff47401d040 con 0x55c3e7aa0870 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff472000640 1 -- 172.21.15.59:0/373270186 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff47403e050 con 0x55c3e7aa0870 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 10 client.7116 fetch_fsmap learned FSMap version 54 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.069+0000 7ff48efd4000 1 -- 172.21.15.59:0/373270186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55c3e79adf20 con 0x55c3e7aa0870 2024-04-25T09:06:27.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff472000640 1 -- 172.21.15.59:0/373270186 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47401d040 con 0x55c3e7aa0870 2024-04-25T09:06:27.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff472000640 1 -- 172.21.15.59:0/373270186 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff474041020 con 0x55c3e7aa0870 2024-04-25T09:06:27.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 10 client.7116 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T09:06:27.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 10 client.7116 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:06:27.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 20 client.7116 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55c3e7c031e0 0x55c3e7c6ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 4 client.7116 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-04-25T09:06:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 -- 172.21.15.59:0/373270186 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) v1 -- 0x55c3e7a14310 con 0x55c3e7c031e0 2024-04-25T09:06:27.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff47be00640 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55c3e7c031e0 0x55c3e7c6ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff472000640 10 client.7116 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:27.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff47be00640 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55c3e7c031e0 0x55c3e7c6ace0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8bb068a7a6c8465 server_cookie=df76546a256a9db in_seq=0 out_seq=0 2024-04-25T09:06:27.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff472000640 1 -- 172.21.15.59:0/373270186 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c3e7a14310 con 0x55c3e7c031e0 2024-04-25T09:06:27.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff472000640 10 client.7116 handle_command_reply: tid=0 2024-04-25T09:06:27.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 client.7116 shutdown 2024-04-25T09:06:27.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 -- 172.21.15.59:0/373270186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 msgr2=0x55c3e7c63cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 0x55c3e7c63cf0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff474016500 tx=0x7ff474013000 comp rx=0 tx=0).stop 2024-04-25T09:06:27.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 -- 172.21.15.59:0/373270186 shutdown_connections 2024-04-25T09:06:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55c3e7c031e0 0x55c3e7c6ace0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3e7c028c0 0x55c3e7c68790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3e7bb8650 0x55c3e7c66240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 --2- 172.21.15.59:0/373270186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3e7aa0870 0x55c3e7c63cf0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 -- 172.21.15.59:0/373270186 >> 172.21.15.59:0/373270186 conn(0x55c3e7be4620 msgr2=0x55c3e7c11950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff472000640 0 client.7116 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 -- 172.21.15.59:0/373270186 shutdown_connections 2024-04-25T09:06:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 1 -- 172.21.15.59:0/373270186 wait complete. 2024-04-25T09:06:27.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48efd4000 20 client.7116 trim_cache size 0 max 16384 2024-04-25T09:06:27.071 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:06:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-04-25T09:06:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "612b6d40-dcd4-4164-9cc9-9d9b7e9d0348", 2024-04-25T09:06:27.071 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-04-25T09:06:27.071 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:06:27.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48bc00640 1 -- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff460066f60 msgr2=0x7ff460069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48bc00640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff460066f60 0x7ff460069420 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff4840cabd0 tx=0x7ff474008040 comp rx=0 tx=0).stop 2024-04-25T09:06:27.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48bc00640 1 -- 172.21.15.59:0/373171089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48415bb30 msgr2=0x7ff48406f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48bc00640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48415bb30 0x7ff48406f9f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff47c00c7a0 tx=0x7ff47c00cc60 comp rx=0 tx=0).stop 2024-04-25T09:06:27.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48bc00640 1 -- 172.21.15.59:0/373171089 shutdown_connections 2024-04-25T09:06:27.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48bc00640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff460066f60 0x7ff460069420 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48bc00640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff48415bb30 0x7ff48406f9f0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48bc00640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff4840cfdc0 0x7ff4840b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48bc00640 1 --2- 172.21.15.59:0/373171089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff48406ac10 0x7ff484152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48bc00640 1 -- 172.21.15.59:0/373171089 >> 172.21.15.59:0/373171089 conn(0x7ff4840b2240 msgr2=0x7ff484073830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48bc00640 1 -- 172.21.15.59:0/373171089 shutdown_connections 2024-04-25T09:06:27.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.073+0000 7ff48bc00640 1 -- 172.21.15.59:0/373171089 wait complete. 2024-04-25T09:06:27.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:27.087 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:06:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.237+0000 7f65e7000640 1 Processor -- start 2024-04-25T09:06:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.237+0000 7f65e7000640 1 -- start start 2024-04-25T09:06:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.237+0000 7f65e7000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f65e006cb10 0x7f65e00cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.237+0000 7f65e7000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e0099dd0 con 0x7f65e006c730 2024-04-25T09:06:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.237+0000 7f65e7000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e009a0b0 con 0x7f65e00cfcc0 2024-04-25T09:06:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.237+0000 7f65e7000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e009a9e0 con 0x7f65e006cb10 2024-04-25T09:06:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.237+0000 7f65e5c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f65e006c730 0x7f65e015ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34298/0 (socket says 172.21.15.59:34298) 2024-04-25T09:06:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.237+0000 7f65e5c00640 1 -- 172.21.15.59:0/4125524163 learned_addr learned my addr 172.21.15.59:0/4125524163 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.241+0000 7f65e5200640 1 --2- 172.21.15.59:0/4125524163 >> v2:172.21.15.178:3300/0 conn(0x7f65e006cb10 0x7f65e00cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.241+0000 7f65dfe00640 1 -- 172.21.15.59:0/4125524163 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094028386 0 0) 0x7f65e0099dd0 con 0x7f65e006c730 2024-04-25T09:06:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.241+0000 7f65dfe00640 1 -- 172.21.15.59:0/4125524163 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65c8003530 con 0x7f65e006c730 2024-04-25T09:06:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.241+0000 7f65dfe00640 1 -- 172.21.15.59:0/4125524163 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339283044 0 0) 0x7f65e009a0b0 con 0x7f65e00cfcc0 2024-04-25T09:06:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.241+0000 7f65dfe00640 1 -- 172.21.15.59:0/4125524163 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65e0099dd0 con 0x7f65e00cfcc0 2024-04-25T09:06:27.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.241+0000 7f65e5200640 1 -- 172.21.15.59:0/4125524163 >> v1:172.21.15.178:6789/0 conn(0x7f65e00cfcc0 legacy=0x7f65e00d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.241+0000 7f65e5200640 1 -- 172.21.15.59:0/4125524163 >> v1:172.21.15.59:6789/0 conn(0x7f65e006c730 legacy=0x7f65e015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.241+0000 7f65e5200640 1 -- 172.21.15.59:0/4125524163 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e009a390 con 0x7f65e006cb10 2024-04-25T09:06:27.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.241+0000 7f65e5200640 1 --2- 172.21.15.59:0/4125524163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65e006cb10 0x7f65e00cf780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0097c0 tx=0x7f65cc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=431fa103168a5f51 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.241+0000 7f65dfe00640 1 -- 172.21.15.59:0/4125524163 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc0b0070 con 0x7f65e006cb10 2024-04-25T09:06:27.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.241+0000 7f65dfe00640 1 -- 172.21.15.59:0/4125524163 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc004230 con 0x7f65e006cb10 2024-04-25T09:06:27.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.241+0000 7f65dfe00640 1 -- 172.21.15.59:0/4125524163 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc003620 con 0x7f65e006cb10 2024-04-25T09:06:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 -- 172.21.15.59:0/4125524163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65e006cb10 msgr2=0x7f65e00cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 --2- 172.21.15.59:0/4125524163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65e006cb10 0x7f65e00cf780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0097c0 tx=0x7f65cc01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 -- 172.21.15.59:0/4125524163 shutdown_connections 2024-04-25T09:06:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 --2- 172.21.15.59:0/4125524163 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65e006cb10 0x7f65e00cf780 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 -- 172.21.15.59:0/4125524163 >> 172.21.15.59:0/4125524163 conn(0x7f65e00b3030 msgr2=0x7f65e00b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 -- 172.21.15.59:0/4125524163 shutdown_connections 2024-04-25T09:06:27.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 -- 172.21.15.59:0/4125524163 wait complete. 2024-04-25T09:06:27.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 Processor -- start 2024-04-25T09:06:27.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 -- start start 2024-04-25T09:06:27.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65e006c730 0x7f65e0150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65e006cb10 0x7f65e014fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e00cfcc0 0x7f65e0160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00b08a0 con 0x7f65e00cfcc0 2024-04-25T09:06:27.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e00b0720 con 0x7f65e006cb10 2024-04-25T09:06:27.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e7000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e006cf50 con 0x7f65e006c730 2024-04-25T09:06:27.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e00cfcc0 0x7f65e0160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e5c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65e006c730 0x7f65e0150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e5200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65e006cb10 0x7f65e014fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e00cfcc0 0x7f65e0160430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56590/0 (socket says 172.21.15.59:56590) 2024-04-25T09:06:27.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e6600640 1 -- 172.21.15.59:0/681449446 learned_addr learned my addr 172.21.15.59:0/681449446 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:27.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e6600640 1 -- 172.21.15.59:0/681449446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65e006c730 msgr2=0x7f65e0150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e6600640 1 --2- 172.21.15.59:0/681449446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65e006c730 0x7f65e0150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e6600640 1 -- 172.21.15.59:0/681449446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65e006cb10 msgr2=0x7f65e014fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e6600640 1 --2- 172.21.15.59:0/681449446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65e006cb10 0x7f65e014fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.245+0000 7f65e6600640 1 -- 172.21.15.59:0/681449446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e01512e0 con 0x7f65e00cfcc0 2024-04-25T09:06:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.249+0000 7f65e6600640 1 --2- 172.21.15.59:0/681449446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e00cfcc0 0x7f65e0160430 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f65d800c7a0 tx=0x7f65d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.249+0000 7f65dd600640 1 -- 172.21.15.59:0/681449446 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8003b80 con 0x7f65e00cfcc0 2024-04-25T09:06:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.249+0000 7f65dd600640 1 -- 172.21.15.59:0/681449446 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d8003d20 con 0x7f65e00cfcc0 2024-04-25T09:06:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.249+0000 7f65dd600640 1 -- 172.21.15.59:0/681449446 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d800aa90 con 0x7f65e00cfcc0 2024-04-25T09:06:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.249+0000 7f65e7000640 1 -- 172.21.15.59:0/681449446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e01515c0 con 0x7f65e00cfcc0 2024-04-25T09:06:27.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.249+0000 7f65e7000640 1 -- 172.21.15.59:0/681449446 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e0150fd0 con 0x7f65e00cfcc0 2024-04-25T09:06:27.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.249+0000 7f65dd600640 1 -- 172.21.15.59:0/681449446 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f65d800ac30 con 0x7f65e00cfcc0 2024-04-25T09:06:27.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65dd600640 1 --2- 172.21.15.59:0/681449446 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f65c0066fe0 0x7f65c00694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65dd600640 1 -- 172.21.15.59:0/681449446 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f65d8084f00 con 0x7f65e00cfcc0 2024-04-25T09:06:27.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 Processor -- start 2024-04-25T09:06:27.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e5c00640 1 --2- 172.21.15.59:0/681449446 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f65c0066fe0 0x7f65c00694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 -- start start 2024-04-25T09:06:27.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e5c00640 1 --2- 172.21.15.59:0/681449446 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f65c0066fe0 0x7f65c00694a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f65d4007fd0 tx=0x7f65d4007d80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 0x55e4adec6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec72f0 0x55e4ade7cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4ade7d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4adcc9ff0 con 0x55e4adec69d0 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4adc52150 con 0x55e4ade7d0a0 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4adcc6090 con 0x55e4adec72f0 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e5c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 0x55e4adec6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e5c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 0x55e4adec6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56606/0 (socket says 172.21.15.59:56606) 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e5c00640 1 -- 172.21.15.59:0/236323156 learned_addr learned my addr 172.21.15.59:0/236323156 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e5200640 1 --2- 172.21.15.59:0/236323156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec72f0 0x55e4ade7cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e6600640 1 --2- 172.21.15.59:0/236323156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4ade7d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e5c00640 1 -- 172.21.15.59:0/236323156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec72f0 msgr2=0x55e4ade7cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e5c00640 1 --2- 172.21.15.59:0/236323156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec72f0 0x55e4ade7cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e5c00640 1 -- 172.21.15.59:0/236323156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 msgr2=0x55e4ade7d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e5c00640 1 --2- 172.21.15.59:0/236323156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4ade7d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e5c00640 1 -- 172.21.15.59:0/236323156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4ade600d0 con 0x55e4adec69d0 2024-04-25T09:06:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e6600640 1 --2- 172.21.15.59:0/236323156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4ade7d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65e5c00640 1 --2- 172.21.15.59:0/236323156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 0x55e4adec6db0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f65d40017c0 tx=0x7f65d4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba5d02e1776b96d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65d2000640 1 -- 172.21.15.59:0/236323156 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4025070 con 0x55e4adec69d0 2024-04-25T09:06:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65d2000640 1 -- 172.21.15.59:0/236323156 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d401b050 con 0x55e4adec69d0 2024-04-25T09:06:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65d2000640 1 -- 172.21.15.59:0/236323156 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d4014d60 con 0x55e4adec69d0 2024-04-25T09:06:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 -- 172.21.15.59:0/236323156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 msgr2=0x55e4adec6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 --2- 172.21.15.59:0/236323156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 0x55e4adec6db0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f65d40017c0 tx=0x7f65d4012000 comp rx=0 tx=0).stop 2024-04-25T09:06:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 -- 172.21.15.59:0/236323156 shutdown_connections 2024-04-25T09:06:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 --2- 172.21.15.59:0/236323156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4ade7d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 --2- 172.21.15.59:0/236323156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec72f0 0x55e4ade7cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 --2- 172.21.15.59:0/236323156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 0x55e4adec6db0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 -- 172.21.15.59:0/236323156 >> 172.21.15.59:0/236323156 conn(0x55e4ade79020 msgr2=0x55e4ade7b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 -- 172.21.15.59:0/236323156 shutdown_connections 2024-04-25T09:06:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.253+0000 7f65ebb87000 1 -- 172.21.15.59:0/236323156 wait complete. 2024-04-25T09:06:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 1 -- start start 2024-04-25T09:06:27.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 1 Processor -- start 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4adeab7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec69d0 0x55e4adeabd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 0x55e4adeac270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4adc8e250 con 0x55e4adec72f0 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4adc84690 con 0x55e4ade7d0a0 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4adc52a40 con 0x55e4adec69d0 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 10 client.0 _ll_register_callbacks cb 0x55e4ade67e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65e6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 0x55e4adeac270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65e6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 0x55e4adeac270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56610/0 (socket says 172.21.15.59:56610) 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65e6600640 1 -- 172.21.15.59:0/1307082913 learned_addr learned my addr 172.21.15.59:0/1307082913 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65e5c00640 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4adeab7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65e5200640 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec69d0 0x55e4adeabd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65e6600640 1 -- 172.21.15.59:0/1307082913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec69d0 msgr2=0x55e4adeabd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65e6600640 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec69d0 0x55e4adeabd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65e6600640 1 -- 172.21.15.59:0/1307082913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 msgr2=0x55e4adeab7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65e6600640 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4adeab7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65e6600640 1 -- 172.21.15.59:0/1307082913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4add771c0 con 0x55e4adec72f0 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65e6600640 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 0x55e4adeac270 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f65d805d8f0 tx=0x7f65d8055880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74836fc0f0635bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65c6a00640 1 -- 172.21.15.59:0/1307082913 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d806d020 con 0x55e4adec72f0 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65c6a00640 1 -- 172.21.15.59:0/1307082913 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f65d8054c10 con 0x55e4adec72f0 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 1 -- 172.21.15.59:0/1307082913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65d401b050 con 0x55e4adec72f0 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65c6a00640 1 -- 172.21.15.59:0/1307082913 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65d8054e10 con 0x55e4adec72f0 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 10 client.7128 fetch_fsmap learned FSMap version 54 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 1 -- 172.21.15.59:0/1307082913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55e4add73170 con 0x55e4adec72f0 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65c6a00640 1 -- 172.21.15.59:0/1307082913 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d401b050 con 0x55e4adec72f0 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65c6a00640 1 -- 172.21.15.59:0/1307082913 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f65d8051510 con 0x55e4adec72f0 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 10 client.7128 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T09:06:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 10 client.7128 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:06:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 20 client.7128 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4aded6c80 0x55e4aded9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 4 client.7128 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65ebb87000 1 -- 172.21.15.59:0/1307082913 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4adc65c60 con 0x55e4aded6c80 2024-04-25T09:06:27.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.257+0000 7f65e5c00640 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4aded6c80 0x55e4aded9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65c6a00640 10 client.7128 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65e5c00640 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4aded6c80 0x55e4aded9070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32cef24895cdd9df server_cookie=5f0f23b039a50aa0 in_seq=0 out_seq=0 2024-04-25T09:06:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65c6a00640 1 -- 172.21.15.59:0/1307082913 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e4adc65c60 con 0x55e4aded6c80 2024-04-25T09:06:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65c6a00640 10 client.7128 handle_command_reply: tid=0 2024-04-25T09:06:27.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65ebb87000 1 client.7128 shutdown 2024-04-25T09:06:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65ebb87000 1 -- 172.21.15.59:0/1307082913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 msgr2=0x55e4adeac270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65ebb87000 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 0x55e4adeac270 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f65d805d8f0 tx=0x7f65d8055880 comp rx=0 tx=0).stop 2024-04-25T09:06:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65ebb87000 1 -- 172.21.15.59:0/1307082913 shutdown_connections 2024-04-25T09:06:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65ebb87000 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4aded6c80 0x55e4aded9070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65ebb87000 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 0x55e4adeac270 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65ebb87000 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec69d0 0x55e4adeabd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65ebb87000 1 --2- 172.21.15.59:0/1307082913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4adeab7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65c6a00640 0 client.7128 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65ebb87000 1 -- 172.21.15.59:0/1307082913 >> 172.21.15.59:0/1307082913 conn(0x55e4ade79020 msgr2=0x55e4ade7bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65ebb87000 1 -- 172.21.15.59:0/1307082913 shutdown_connections 2024-04-25T09:06:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65ebb87000 1 -- 172.21.15.59:0/1307082913 wait complete. 2024-04-25T09:06:27.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.261+0000 7f65ebb87000 20 client.7128 trim_cache size 0 max 16384 2024-04-25T09:06:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 Processor -- start 2024-04-25T09:06:27.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 -- start start 2024-04-25T09:06:27.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4adf23300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 0x55e4adf23840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec72f0 0x55e4adf23d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e02035b0 con 0x55e4adec69d0 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e0202770 con 0x55e4ade7d0a0 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e0201ba0 con 0x55e4adec72f0 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65e5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 0x55e4adf23840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65e5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 0x55e4adf23840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56620/0 (socket says 172.21.15.59:56620) 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65e5200640 1 -- 172.21.15.59:0/2366047964 learned_addr learned my addr 172.21.15.59:0/2366047964 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65e5c00640 1 --2- 172.21.15.59:0/2366047964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4adf23300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65e6600640 1 --2- 172.21.15.59:0/2366047964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec72f0 0x55e4adf23d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65e5200640 1 -- 172.21.15.59:0/2366047964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec72f0 msgr2=0x55e4adf23d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65e5200640 1 --2- 172.21.15.59:0/2366047964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec72f0 0x55e4adf23d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65e5200640 1 -- 172.21.15.59:0/2366047964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 msgr2=0x55e4adf23300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65e5200640 1 --2- 172.21.15.59:0/2366047964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4adf23300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65e5200640 1 -- 172.21.15.59:0/2366047964 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4add10de0 con 0x55e4adec69d0 2024-04-25T09:06:27.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65e6600640 1 --2- 172.21.15.59:0/2366047964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec72f0 0x55e4adf23d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:27.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65e5200640 1 --2- 172.21.15.59:0/2366047964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 0x55e4adf23840 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0ae040 tx=0x7f65cc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6c3eb56f62cae3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65d1600640 1 -- 172.21.15.59:0/2366047964 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc0b0040 con 0x55e4adec69d0 2024-04-25T09:06:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65d1600640 1 -- 172.21.15.59:0/2366047964 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc0043f0 con 0x55e4adec69d0 2024-04-25T09:06:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65d1600640 1 -- 172.21.15.59:0/2366047964 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65cc003820 con 0x55e4adec69d0 2024-04-25T09:06:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 -- 172.21.15.59:0/2366047964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 msgr2=0x55e4adf23840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 --2- 172.21.15.59:0/2366047964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 0x55e4adf23840 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f65cc0ae040 tx=0x7f65cc004740 comp rx=0 tx=0).stop 2024-04-25T09:06:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 -- 172.21.15.59:0/2366047964 shutdown_connections 2024-04-25T09:06:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 --2- 172.21.15.59:0/2366047964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4adec72f0 0x55e4adf23d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 --2- 172.21.15.59:0/2366047964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec69d0 0x55e4adf23840 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 --2- 172.21.15.59:0/2366047964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4ade7d0a0 0x55e4adf23300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 -- 172.21.15.59:0/2366047964 >> 172.21.15.59:0/2366047964 conn(0x55e4ade79020 msgr2=0x55e4aded3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 -- 172.21.15.59:0/2366047964 shutdown_connections 2024-04-25T09:06:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.277+0000 7f65ebb87000 1 -- 172.21.15.59:0/2366047964 wait complete. 2024-04-25T09:06:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 1 -- start start 2024-04-25T09:06:27.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 1 Processor -- start 2024-04-25T09:06:27.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4ade7d0a0 0x55e4aded9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4adec69d0 0x55e4aded98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 0x55e4aded9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4adc64e00 con 0x55e4adec72f0 2024-04-25T09:06:27.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e0202170 con 0x55e4adec69d0 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4adcc9300 con 0x55e4ade7d0a0 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 10 client.0 _ll_register_callbacks cb 0x55e4ade48040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 0x55e4aded9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 0x55e4aded9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56632/0 (socket says 172.21.15.59:56632) 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e6600640 1 -- 172.21.15.59:0/1408559728 learned_addr learned my addr 172.21.15.59:0/1408559728 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e5200640 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4adec69d0 0x55e4aded98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e5c00640 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4ade7d0a0 0x55e4aded9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e6600640 1 -- 172.21.15.59:0/1408559728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4ade7d0a0 msgr2=0x55e4aded9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e6600640 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4ade7d0a0 0x55e4aded9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e6600640 1 -- 172.21.15.59:0/1408559728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4adec69d0 msgr2=0x55e4aded98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e6600640 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4adec69d0 0x55e4aded98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e6600640 1 -- 172.21.15.59:0/1408559728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4adc6b8e0 con 0x55e4adec72f0 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e6600640 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 0x55e4aded9e00 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f65d80554c0 tx=0x7f65d8083200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4ad12802d601 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:27.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65c6a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65c6a00640 1 -- 172.21.15.59:0/1408559728 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d806d040 con 0x55e4adec72f0 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65c6a00640 1 -- 172.21.15.59:0/1408559728 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f65d8054890 con 0x55e4adec72f0 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 1 -- 172.21.15.59:0/1408559728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65cc0043f0 con 0x55e4adec72f0 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65c6a00640 1 -- 172.21.15.59:0/1408559728 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65d8051a60 con 0x55e4adec72f0 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 10 client.7134 fetch_fsmap learned FSMap version 54 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 1 -- 172.21.15.59:0/1408559728 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=2+}) v3 -- 0x55e4add238f0 con 0x55e4adec72f0 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65c6a00640 1 -- 172.21.15.59:0/1408559728 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65cc0043f0 con 0x55e4adec72f0 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65c6a00640 1 -- 172.21.15.59:0/1408559728 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 54) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f65d8073b50 con 0x55e4adec72f0 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 10 client.7134 fetch_fsmap finished waiting for FSMap version 54 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 10 client.7134 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 20 client.7134 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4adeda730 0x55e4adf2ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 4 client.7134 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65ebb87000 1 -- 172.21.15.59:0/1408559728 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e4adcd7530 con 0x55e4adeda730 2024-04-25T09:06:27.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e5c00640 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4adeda730 0x55e4adf2ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65e5c00640 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4adeda730 0x55e4adf2ef60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf166f65b78036af server_cookie=ca0431298a61d234 in_seq=0 out_seq=0 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.281+0000 7f65c6a00640 10 client.7134 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65c6a00640 1 -- 172.21.15.59:0/1408559728 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e4adcd7530 con 0x55e4adeda730 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65c6a00640 10 client.7134 handle_command_reply: tid=0 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65ebb87000 1 client.7134 shutdown 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65ebb87000 1 -- 172.21.15.59:0/1408559728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 msgr2=0x55e4aded9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65ebb87000 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 0x55e4aded9e00 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f65d80554c0 tx=0x7f65d8083200 comp rx=0 tx=0).stop 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65ebb87000 1 -- 172.21.15.59:0/1408559728 shutdown_connections 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65ebb87000 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4adeda730 0x55e4adf2ef60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65ebb87000 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4adec72f0 0x55e4aded9e00 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65ebb87000 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4adec69d0 0x55e4aded98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65ebb87000 1 --2- 172.21.15.59:0/1408559728 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4ade7d0a0 0x55e4aded9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65c6a00640 0 client.7134 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:27.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65ebb87000 1 -- 172.21.15.59:0/1408559728 >> 172.21.15.59:0/1408559728 conn(0x55e4ade79020 msgr2=0x55e4adec50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65ebb87000 1 -- 172.21.15.59:0/1408559728 shutdown_connections 2024-04-25T09:06:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65ebb87000 1 -- 172.21.15.59:0/1408559728 wait complete. 2024-04-25T09:06:27.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65ebb87000 20 client.7134 trim_cache size 0 max 16384 2024-04-25T09:06:27.280 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:06:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:06:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-04-25T09:06:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "612b6d40-dcd4-4164-9cc9-9d9b7e9d0348": { 2024-04-25T09:06:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/subdir", 2024-04-25T09:06:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "612b6d40-dcd4-4164-9cc9-9d9b7e9d0348", 2024-04-25T09:06:27.280 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive" 2024-04-25T09:06:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:27.281 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:27.281 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:06:27.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65e7000640 1 -- 172.21.15.59:0/681449446 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f65c0066fe0 msgr2=0x7f65c00694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65e7000640 1 --2- 172.21.15.59:0/681449446 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f65c0066fe0 0x7f65c00694a0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f65d4007fd0 tx=0x7f65d4007d80 comp rx=0 tx=0).stop 2024-04-25T09:06:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65e7000640 1 -- 172.21.15.59:0/681449446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e00cfcc0 msgr2=0x7f65e0160430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65e7000640 1 --2- 172.21.15.59:0/681449446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e00cfcc0 0x7f65e0160430 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f65d800c7a0 tx=0x7f65d800cc60 comp rx=0 tx=0).stop 2024-04-25T09:06:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65e7000640 1 -- 172.21.15.59:0/681449446 shutdown_connections 2024-04-25T09:06:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65e7000640 1 --2- 172.21.15.59:0/681449446 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f65c0066fe0 0x7f65c00694a0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65e7000640 1 --2- 172.21.15.59:0/681449446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f65e00cfcc0 0x7f65e0160430 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65e7000640 1 --2- 172.21.15.59:0/681449446 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f65e006cb10 0x7f65e014fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65e7000640 1 --2- 172.21.15.59:0/681449446 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f65e006c730 0x7f65e0150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65e7000640 1 -- 172.21.15.59:0/681449446 >> 172.21.15.59:0/681449446 conn(0x7f65e00b3030 msgr2=0x7f65e00cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65e7000640 1 -- 172.21.15.59:0/681449446 shutdown_connections 2024-04-25T09:06:27.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:27.285+0000 7f65e7000640 1 -- 172.21.15.59:0/681449446 wait complete. 2024-04-25T09:06:27.296 INFO:tasks.cephfs.filesystem:scrub status for tag:612b6d40-dcd4-4164-9cc9-9d9b7e9d0348 - {'path': '/subdir', 'tag': '612b6d40-dcd4-4164-9cc9-9d9b7e9d0348', 'options': 'recursive'} 2024-04-25T09:06:29.042 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:06:29.049+0000 7f1096a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T09:06:53.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:53.230 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:06:57.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:57.297 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:06:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.465+0000 7fe14e400640 1 Processor -- start 2024-04-25T09:06:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.465+0000 7fe14e400640 1 -- start start 2024-04-25T09:06:57.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.465+0000 7fe14e400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe14815dd90 0x7fe148071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.465+0000 7fe14e400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe148072460 con 0x7fe148072040 2024-04-25T09:06:57.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.465+0000 7fe14e400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe14806ac10 con 0x7fe148161e90 2024-04-25T09:06:57.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.465+0000 7fe14e400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1480b2dc0 con 0x7fe14815dd90 2024-04-25T09:06:57.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.465+0000 7fe13fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe148072040 0x7fe148161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60324/0 (socket says 172.21.15.59:60324) 2024-04-25T09:06:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.465+0000 7fe13fe00640 1 -- 172.21.15.59:0/1745536170 learned_addr learned my addr 172.21.15.59:0/1745536170 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.465+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4293296004 0 0) 0x7fe148072460 con 0x7fe148072040 2024-04-25T09:06:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.465+0000 7fe147400640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe14815dd90 0x7fe148071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.465+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe12c003530 con 0x7fe148072040 2024-04-25T09:06:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4234793731 0 0) 0x7fe12c003530 con 0x7fe148072040 2024-04-25T09:06:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe14815dd90 msgr2=0x7fe148071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe14815dd90 0x7fe148071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 >> v1:172.21.15.178:6789/0 conn(0x7fe148161e90 legacy=0x7fe1480ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14806aeb0 con 0x7fe148072040 2024-04-25T09:06:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fe130001680 con 0x7fe148072040 2024-04-25T09:06:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 >> v1:172.21.15.59:6789/0 conn(0x7fe148072040 legacy=0x7fe148161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c0039f0 0x7fe12c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe14815dd90 0x7fe12c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe12c004d50 0x7fe12c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c00bb60 con 0x7fe12c0039f0 2024-04-25T09:06:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c00bce0 con 0x7fe12c004d50 2024-04-25T09:06:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12c00bee0 con 0x7fe14815dd90 2024-04-25T09:06:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe147400640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c0039f0 0x7fe12c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe147e00640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe12c004d50 0x7fe12c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe13fe00640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe14815dd90 0x7fe12c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe147400640 1 -- 172.21.15.59:0/1745536170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe14815dd90 msgr2=0x7fe12c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe147400640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe14815dd90 0x7fe12c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe147400640 1 -- 172.21.15.59:0/1745536170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe12c004d50 msgr2=0x7fe12c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe147400640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe12c004d50 0x7fe12c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe147400640 1 -- 172.21.15.59:0/1745536170 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12c003530 con 0x7fe12c0039f0 2024-04-25T09:06:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe147e00640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe12c004d50 0x7fe12c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.469+0000 7fe147400640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c0039f0 0x7fe12c003e10 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fe138009ae0 tx=0x7fe13801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9972800d72a25558 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1380b2070 con 0x7fe12c0039f0 2024-04-25T09:06:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1380a5530 con 0x7fe12c0039f0 2024-04-25T09:06:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe146a00640 1 -- 172.21.15.59:0/1745536170 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1380096b0 con 0x7fe12c0039f0 2024-04-25T09:06:57.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 -- 172.21.15.59:0/1745536170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c0039f0 msgr2=0x7fe12c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 --2- 172.21.15.59:0/1745536170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c0039f0 0x7fe12c003e10 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fe138009ae0 tx=0x7fe13801ca70 comp rx=0 tx=0).stop 2024-04-25T09:06:57.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe147e00640 1 -- 172.21.15.59:0/1745536170 reap_dead start 2024-04-25T09:06:57.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 -- 172.21.15.59:0/1745536170 shutdown_connections 2024-04-25T09:06:57.465 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 -- 172.21.15.59:0/1745536170 >> 172.21.15.59:0/1745536170 conn(0x7fe1480cfd90 msgr2=0x7fe1480d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 -- 172.21.15.59:0/1745536170 shutdown_connections 2024-04-25T09:06:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 -- 172.21.15.59:0/1745536170 wait complete. 2024-04-25T09:06:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 Processor -- start 2024-04-25T09:06:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 -- start start 2024-04-25T09:06:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c0039f0 0x7fe148153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe14815f1a0 0x7fe1480b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1480b0e50 0x7fe1480af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148169c40 con 0x7fe12c0039f0 2024-04-25T09:06:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148169ac0 con 0x7fe14815f1a0 2024-04-25T09:06:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe14e400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe148169dc0 con 0x7fe1480b0e50 2024-04-25T09:06:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe147400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c0039f0 0x7fe148153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe147400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c0039f0 0x7fe148153480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55718/0 (socket says 172.21.15.59:55718) 2024-04-25T09:06:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe147400640 1 -- 172.21.15.59:0/1197135772 learned_addr learned my addr 172.21.15.59:0/1197135772 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe13fe00640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe14815f1a0 0x7fe1480b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.473+0000 7fe147e00640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1480b0e50 0x7fe1480af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.477+0000 7fe147400640 1 -- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1480b0e50 msgr2=0x7fe1480af780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.477+0000 7fe147400640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1480b0e50 0x7fe1480af780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.477+0000 7fe147400640 1 -- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe14815f1a0 msgr2=0x7fe1480b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.477+0000 7fe147400640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe14815f1a0 0x7fe1480b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.477+0000 7fe147400640 1 -- 172.21.15.59:0/1197135772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14815f600 con 0x7fe12c0039f0 2024-04-25T09:06:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.477+0000 7fe147400640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c0039f0 0x7fe148153480 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fe13801c8a0 tx=0x7fe12c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.477+0000 7fe13f400640 1 -- 172.21.15.59:0/1197135772 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1380bc020 con 0x7fe12c0039f0 2024-04-25T09:06:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.477+0000 7fe13f400640 1 -- 172.21.15.59:0/1197135772 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1380a5d60 con 0x7fe12c0039f0 2024-04-25T09:06:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.477+0000 7fe13f400640 1 -- 172.21.15.59:0/1197135772 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1380b2040 con 0x7fe12c0039f0 2024-04-25T09:06:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.477+0000 7fe14e400640 1 -- 172.21.15.59:0/1197135772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe148161080 con 0x7fe12c0039f0 2024-04-25T09:06:57.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.477+0000 7fe14e400640 1 -- 172.21.15.59:0/1197135772 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1481607e0 con 0x7fe12c0039f0 2024-04-25T09:06:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.477+0000 7fe13f400640 1 -- 172.21.15.59:0/1197135772 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe138004220 con 0x7fe12c0039f0 2024-04-25T09:06:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13f400640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe124066f60 0x7fe124069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13f400640 1 -- 172.21.15.59:0/1197135772 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe13811f1b0 con 0x7fe12c0039f0 2024-04-25T09:06:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 Processor -- start 2024-04-25T09:06:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13fe00640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe124066f60 0x7fe124069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 -- start start 2024-04-25T09:06:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13fe00640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe124066f60 0x7fe124069420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe148157650 tx=0x7fe130007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fd99d0 0x560403fd9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403f8fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560403f90480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560403ddcff0 con 0x560403fda2f0 2024-04-25T09:06:57.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560403d65150 con 0x560403fd99d0 2024-04-25T09:06:57.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560403dd9090 con 0x560403f900a0 2024-04-25T09:06:57.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403f8fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403f8fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55732/0 (socket says 172.21.15.59:55732) 2024-04-25T09:06:57.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13fe00640 1 -- 172.21.15.59:0/855000548 learned_addr learned my addr 172.21.15.59:0/855000548 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:57.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe147400640 1 --2- 172.21.15.59:0/855000548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fd99d0 0x560403fd9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe147e00640 1 --2- 172.21.15.59:0/855000548 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560403f90480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13fe00640 1 -- 172.21.15.59:0/855000548 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 msgr2=0x560403f90480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13fe00640 1 --2- 172.21.15.59:0/855000548 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560403f90480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13fe00640 1 -- 172.21.15.59:0/855000548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fd99d0 msgr2=0x560403fd9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13fe00640 1 --2- 172.21.15.59:0/855000548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fd99d0 0x560403fd9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13fe00640 1 -- 172.21.15.59:0/855000548 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560403f730d0 con 0x560403fda2f0 2024-04-25T09:06:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe147400640 1 --2- 172.21.15.59:0/855000548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fd99d0 0x560403fd9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:57.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe13fe00640 1 --2- 172.21.15.59:0/855000548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403f8fb60 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fe130011c00 tx=0x7fe130000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c708d25d0c39dcf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe137e00640 1 -- 172.21.15.59:0/855000548 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130017ad0 con 0x560403fda2f0 2024-04-25T09:06:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe137e00640 1 -- 172.21.15.59:0/855000548 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe130017c70 con 0x560403fda2f0 2024-04-25T09:06:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe137e00640 1 -- 172.21.15.59:0/855000548 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130015690 con 0x560403fda2f0 2024-04-25T09:06:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 -- 172.21.15.59:0/855000548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 msgr2=0x560403f8fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 --2- 172.21.15.59:0/855000548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403f8fb60 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fe130011c00 tx=0x7fe130000bd0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 -- 172.21.15.59:0/855000548 shutdown_connections 2024-04-25T09:06:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 --2- 172.21.15.59:0/855000548 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560403f90480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 --2- 172.21.15.59:0/855000548 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403f8fb60 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 --2- 172.21.15.59:0/855000548 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fd99d0 0x560403fd9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 -- 172.21.15.59:0/855000548 >> 172.21.15.59:0/855000548 conn(0x560403f8c020 msgr2=0x560403f8e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 -- 172.21.15.59:0/855000548 shutdown_connections 2024-04-25T09:06:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.481+0000 7fe151801000 1 -- 172.21.15.59:0/855000548 wait complete. 2024-04-25T09:06:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 1 -- start start 2024-04-25T09:06:57.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 1 Processor -- start 2024-04-25T09:06:57.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560403fbe7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fd99d0 0x560403fbed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403fbf270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560403da1250 con 0x560403fda2f0 2024-04-25T09:06:57.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560403d97690 con 0x560403fd99d0 2024-04-25T09:06:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560403d65a40 con 0x560403f900a0 2024-04-25T09:06:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 10 client.0 _ll_register_callbacks cb 0x560403f7ae90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe147e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403fbf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe147e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403fbf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55736/0 (socket says 172.21.15.59:55736) 2024-04-25T09:06:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe147e00640 1 -- 172.21.15.59:0/4278682401 learned_addr learned my addr 172.21.15.59:0/4278682401 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe147400640 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560403fbe7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe13fe00640 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fd99d0 0x560403fbed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe147e00640 1 -- 172.21.15.59:0/4278682401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 msgr2=0x560403fbe7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe147e00640 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560403fbe7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe147e00640 1 -- 172.21.15.59:0/4278682401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fd99d0 msgr2=0x560403fbed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe147e00640 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fd99d0 0x560403fbed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe147e00640 1 -- 172.21.15.59:0/4278682401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560403e8a1c0 con 0x560403fda2f0 2024-04-25T09:06:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe13fe00640 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fd99d0 0x560403fbed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe147e00640 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403fbf270 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe148162820 tx=0x7fe140001c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ffdd199c1a1190b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe134c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe134c00640 1 -- 172.21.15.59:0/4278682401 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14001a020 con 0x560403fda2f0 2024-04-25T09:06:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe134c00640 1 -- 172.21.15.59:0/4278682401 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe140016450 con 0x560403fda2f0 2024-04-25T09:06:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 1 -- 172.21.15.59:0/4278682401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe130017c70 con 0x560403fda2f0 2024-04-25T09:06:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe134c00640 1 -- 172.21.15.59:0/4278682401 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe140024050 con 0x560403fda2f0 2024-04-25T09:06:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 10 client.7146 fetch_fsmap learned FSMap version 55 2024-04-25T09:06:57.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 1 -- 172.21.15.59:0/4278682401 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x560403e86170 con 0x560403fda2f0 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe134c00640 1 -- 172.21.15.59:0/4278682401 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe130017c70 con 0x560403fda2f0 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe134c00640 1 -- 172.21.15.59:0/4278682401 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe140027020 con 0x560403fda2f0 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 10 client.7146 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 10 client.7146 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 20 client.7146 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x560403fe9c80 0x560403fec070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 4 client.7146 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe151801000 1 -- 172.21.15.59:0/4278682401 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560403d78c60 con 0x560403fe9c80 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.485+0000 7fe147400640 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x560403fe9c80 0x560403fec070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe147400640 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x560403fe9c80 0x560403fec070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a081caebd05ddc67 server_cookie=3f7b7617071eedb6 in_seq=0 out_seq=0 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe134c00640 10 client.7146 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe134c00640 1 -- 172.21.15.59:0/4278682401 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560403d78c60 con 0x560403fe9c80 2024-04-25T09:06:57.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe134c00640 10 client.7146 handle_command_reply: tid=0 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe151801000 1 client.7146 shutdown 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe151801000 1 -- 172.21.15.59:0/4278682401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 msgr2=0x560403fbf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe151801000 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403fbf270 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe148162820 tx=0x7fe140001c10 comp rx=0 tx=0).stop 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe151801000 1 -- 172.21.15.59:0/4278682401 shutdown_connections 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe151801000 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x560403fe9c80 0x560403fec070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe151801000 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403fbf270 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe151801000 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fd99d0 0x560403fbed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe151801000 1 --2- 172.21.15.59:0/4278682401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560403fbe7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe134c00640 0 client.7146 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe151801000 1 -- 172.21.15.59:0/4278682401 >> 172.21.15.59:0/4278682401 conn(0x560403f8c020 msgr2=0x560403f8eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe151801000 1 -- 172.21.15.59:0/4278682401 shutdown_connections 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe151801000 1 -- 172.21.15.59:0/4278682401 wait complete. 2024-04-25T09:06:57.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.489+0000 7fe151801000 20 client.7146 trim_cache size 0 max 16384 2024-04-25T09:06:57.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 Processor -- start 2024-04-25T09:06:57.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 -- start start 2024-04-25T09:06:57.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403f900a0 0x560403f8fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403fd99d0 0x560403fe6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403fe7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1482041f0 con 0x560403fda2f0 2024-04-25T09:06:57.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1482033f0 con 0x560403f900a0 2024-04-25T09:06:57.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14815b190 con 0x560403fd99d0 2024-04-25T09:06:57.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe147e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403fe7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe147e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403fe7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55740/0 (socket says 172.21.15.59:55740) 2024-04-25T09:06:57.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe147e00640 1 -- 172.21.15.59:0/325623771 learned_addr learned my addr 172.21.15.59:0/325623771 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:57.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe13fe00640 1 --2- 172.21.15.59:0/325623771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403fd99d0 0x560403fe6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe147400640 1 --2- 172.21.15.59:0/325623771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403f900a0 0x560403f8fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe147e00640 1 -- 172.21.15.59:0/325623771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403fd99d0 msgr2=0x560403fe6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe147e00640 1 --2- 172.21.15.59:0/325623771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403fd99d0 0x560403fe6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe147e00640 1 -- 172.21.15.59:0/325623771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403f900a0 msgr2=0x560403f8fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe147e00640 1 --2- 172.21.15.59:0/325623771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403f900a0 0x560403f8fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe147e00640 1 -- 172.21.15.59:0/325623771 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560403e23de0 con 0x560403fda2f0 2024-04-25T09:06:57.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe147e00640 1 --2- 172.21.15.59:0/325623771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403fe7380 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe140007dd0 tx=0x7fe140011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c6fd374b188c01d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe137400640 1 -- 172.21.15.59:0/325623771 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14001a040 con 0x560403fda2f0 2024-04-25T09:06:57.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe137400640 1 -- 172.21.15.59:0/325623771 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14001f720 con 0x560403fda2f0 2024-04-25T09:06:57.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe137400640 1 -- 172.21.15.59:0/325623771 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140016450 con 0x560403fda2f0 2024-04-25T09:06:57.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 -- 172.21.15.59:0/325623771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 msgr2=0x560403fe7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 --2- 172.21.15.59:0/325623771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403fe7380 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe140007dd0 tx=0x7fe140011000 comp rx=0 tx=0).stop 2024-04-25T09:06:57.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 -- 172.21.15.59:0/325623771 shutdown_connections 2024-04-25T09:06:57.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 --2- 172.21.15.59:0/325623771 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fda2f0 0x560403fe7380 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 --2- 172.21.15.59:0/325623771 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403fd99d0 0x560403fe6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 --2- 172.21.15.59:0/325623771 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403f900a0 0x560403f8fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 -- 172.21.15.59:0/325623771 >> 172.21.15.59:0/325623771 conn(0x560403f8c020 msgr2=0x560403fe6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 -- 172.21.15.59:0/325623771 shutdown_connections 2024-04-25T09:06:57.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 -- 172.21.15.59:0/325623771 wait complete. 2024-04-25T09:06:57.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.505+0000 7fe151801000 1 -- start start 2024-04-25T09:06:57.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 1 Processor -- start 2024-04-25T09:06:57.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560404039720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fd99d0 0x560404039c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fda2f0 0x560403febab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560403d77e00 con 0x560403fd99d0 2024-04-25T09:06:57.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148202df0 con 0x560403fda2f0 2024-04-25T09:06:57.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560403ddc300 con 0x560403f900a0 2024-04-25T09:06:57.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 10 client.0 _ll_register_callbacks cb 0x560403f5b040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:57.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe13fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fd99d0 0x560404039c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe13fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fd99d0 0x560404039c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55746/0 (socket says 172.21.15.59:55746) 2024-04-25T09:06:57.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe13fe00640 1 -- 172.21.15.59:0/3388616520 learned_addr learned my addr 172.21.15.59:0/3388616520 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:57.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe147400640 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560404039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe147e00640 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fda2f0 0x560403febab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe13fe00640 1 -- 172.21.15.59:0/3388616520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 msgr2=0x560404039720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe13fe00640 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560404039720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe13fe00640 1 -- 172.21.15.59:0/3388616520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fda2f0 msgr2=0x560403febab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe13fe00640 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fda2f0 0x560403febab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe13fe00640 1 -- 172.21.15.59:0/3388616520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560403d7e8e0 con 0x560403fd99d0 2024-04-25T09:06:57.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe147e00640 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fda2f0 0x560403febab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe147400640 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560404039720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe13fe00640 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fd99d0 0x560404039c60 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe130016000 tx=0x7fe130001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7261691a68f2aebb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe134c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe134c00640 1 -- 172.21.15.59:0/3388616520 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130015a30 con 0x560403fd99d0 2024-04-25T09:06:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 1 -- 172.21.15.59:0/3388616520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe14001f720 con 0x560403fd99d0 2024-04-25T09:06:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe134c00640 1 -- 172.21.15.59:0/3388616520 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe130015bd0 con 0x560403fd99d0 2024-04-25T09:06:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe134c00640 1 -- 172.21.15.59:0/3388616520 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe13003b050 con 0x560403fd99d0 2024-04-25T09:06:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 10 client.7152 fetch_fsmap learned FSMap version 55 2024-04-25T09:06:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 1 -- 172.21.15.59:0/3388616520 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x560403e368f0 con 0x560403fd99d0 2024-04-25T09:06:57.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe134c00640 1 -- 172.21.15.59:0/3388616520 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14001f720 con 0x560403fd99d0 2024-04-25T09:06:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe134c00640 1 -- 172.21.15.59:0/3388616520 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe13003e020 con 0x560403fd99d0 2024-04-25T09:06:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 10 client.7152 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:06:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 10 client.7152 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:06:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 20 client.7152 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x560403fec4a0 0x560403fec880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 4 client.7152 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:06:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 1 -- 172.21.15.59:0/3388616520 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560403dea530 con 0x560403fec4a0 2024-04-25T09:06:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe147400640 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x560403fec4a0 0x560403fec880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe134c00640 10 client.7152 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe147400640 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x560403fec4a0 0x560403fec880 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5550db4309cbefe server_cookie=e7ac193008a7dff in_seq=0 out_seq=0 2024-04-25T09:06:57.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe134c00640 1 -- 172.21.15.59:0/3388616520 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560403dea530 con 0x560403fec4a0 2024-04-25T09:06:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe134c00640 10 client.7152 handle_command_reply: tid=0 2024-04-25T09:06:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.509+0000 7fe151801000 1 client.7152 shutdown 2024-04-25T09:06:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe151801000 1 -- 172.21.15.59:0/3388616520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fd99d0 msgr2=0x560404039c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe151801000 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fd99d0 0x560404039c60 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe130016000 tx=0x7fe130001980 comp rx=0 tx=0).stop 2024-04-25T09:06:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe151801000 1 -- 172.21.15.59:0/3388616520 shutdown_connections 2024-04-25T09:06:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe151801000 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x560403fec4a0 0x560403fec880 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe151801000 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560403fda2f0 0x560403febab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe151801000 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560403fd99d0 0x560404039c60 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe151801000 1 --2- 172.21.15.59:0/3388616520 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560403f900a0 0x560404039720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe134c00640 0 client.7152 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:57.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe151801000 1 -- 172.21.15.59:0/3388616520 >> 172.21.15.59:0/3388616520 conn(0x560403f8c020 msgr2=0x560403fe6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe151801000 1 -- 172.21.15.59:0/3388616520 shutdown_connections 2024-04-25T09:06:57.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe151801000 1 -- 172.21.15.59:0/3388616520 wait complete. 2024-04-25T09:06:57.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe151801000 20 client.7152 trim_cache size 0 max 16384 2024-04-25T09:06:57.507 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:06:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-04-25T09:06:57.507 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2024-04-25T09:06:57.507 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:06:57.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe14e400640 1 -- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe124066f60 msgr2=0x7fe124069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe14e400640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe124066f60 0x7fe124069420 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe148157650 tx=0x7fe130007040 comp rx=0 tx=0).stop 2024-04-25T09:06:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe14e400640 1 -- 172.21.15.59:0/1197135772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c0039f0 msgr2=0x7fe148153480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe14e400640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c0039f0 0x7fe148153480 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fe13801c8a0 tx=0x7fe12c005840 comp rx=0 tx=0).stop 2024-04-25T09:06:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe14e400640 1 -- 172.21.15.59:0/1197135772 shutdown_connections 2024-04-25T09:06:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe14e400640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe124066f60 0x7fe124069420 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe14e400640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe1480b0e50 0x7fe1480af780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe14e400640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe14815f1a0 0x7fe1480b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe14e400640 1 --2- 172.21.15.59:0/1197135772 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe12c0039f0 0x7fe148153480 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe14e400640 1 -- 172.21.15.59:0/1197135772 >> 172.21.15.59:0/1197135772 conn(0x7fe1480cfd90 msgr2=0x7fe1480aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe14e400640 1 -- 172.21.15.59:0/1197135772 shutdown_connections 2024-04-25T09:06:57.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.513+0000 7fe14e400640 1 -- 172.21.15.59:0/1197135772 wait complete. 2024-04-25T09:06:57.520 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:06:57.520 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:06:57.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c75800640 1 Processor -- start 2024-04-25T09:06:57.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c75800640 1 -- start start 2024-04-25T09:06:57.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c75800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3c7015b980 0x7f3c700cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c75800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c700ce7f0 con 0x7f3c70071970 2024-04-25T09:06:57.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c75800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c700cead0 con 0x7f3c7015b5a0 2024-04-25T09:06:57.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c75800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c700ce5b0 con 0x7f3c7015b980 2024-04-25T09:06:57.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3c70071970 0x7f3c700d0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60332/0 (socket says 172.21.15.59:60332) 2024-04-25T09:06:57.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6f400640 1 -- 172.21.15.59:0/2218186907 learned_addr learned my addr 172.21.15.59:0/2218186907 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:57.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c66000640 1 --2- 172.21.15.59:0/2218186907 >> v2:172.21.15.178:3300/0 conn(0x7f3c7015b980 0x7f3c700cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312236022 0 0) 0x7f3c700ce7f0 con 0x7f3c70071970 2024-04-25T09:06:57.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c54003530 con 0x7f3c70071970 2024-04-25T09:06:57.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2131189047 0 0) 0x7f3c54003530 con 0x7f3c70071970 2024-04-25T09:06:57.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 >> v2:172.21.15.178:3300/0 conn(0x7f3c7015b980 msgr2=0x7f3c700cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 --2- 172.21.15.59:0/2218186907 >> v2:172.21.15.178:3300/0 conn(0x7f3c7015b980 0x7f3c700cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 >> v1:172.21.15.178:6789/0 conn(0x7f3c7015b5a0 legacy=0x7f3c700cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c700cf960 con 0x7f3c70071970 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f3c68001680 con 0x7f3c70071970 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 >> v1:172.21.15.59:6789/0 conn(0x7f3c70071970 legacy=0x7f3c700d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 --2- 172.21.15.59:0/2218186907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c540039c0 0x7f3c54003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 --2- 172.21.15.59:0/2218186907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c54004810 0x7f3c54004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 --2- 172.21.15.59:0/2218186907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c540051d0 0x7f3c5400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c700ce5b0 con 0x7f3c540039c0 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5400c070 con 0x7f3c54004810 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.673+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5400c270 con 0x7f3c540051d0 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c6ea00640 1 --2- 172.21.15.59:0/2218186907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c540039c0 0x7f3c54003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c66000640 1 --2- 172.21.15.59:0/2218186907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c54004810 0x7f3c54004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c6f400640 1 --2- 172.21.15.59:0/2218186907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c540051d0 0x7f3c5400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c6ea00640 1 -- 172.21.15.59:0/2218186907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c540051d0 msgr2=0x7f3c5400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c6ea00640 1 --2- 172.21.15.59:0/2218186907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c540051d0 0x7f3c5400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c6ea00640 1 -- 172.21.15.59:0/2218186907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c54004810 msgr2=0x7f3c54004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:57.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c6ea00640 1 --2- 172.21.15.59:0/2218186907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c54004810 0x7f3c54004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c6ea00640 1 -- 172.21.15.59:0/2218186907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c54003530 con 0x7f3c540039c0 2024-04-25T09:06:57.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c6f400640 1 -- 172.21.15.59:0/2218186907 reap_dead start 2024-04-25T09:06:57.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c6ea00640 1 --2- 172.21.15.59:0/2218186907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c540039c0 0x7f3c54003de0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3c60001e70 tx=0x7f3c6001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d4a027956c2e83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60001a90 con 0x7f3c540039c0 2024-04-25T09:06:57.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c60003b80 con 0x7f3c540039c0 2024-04-25T09:06:57.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.677+0000 7f3c6e000640 1 -- 172.21.15.59:0/2218186907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60005080 con 0x7f3c540039c0 2024-04-25T09:06:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 -- 172.21.15.59:0/2218186907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c540039c0 msgr2=0x7f3c54003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 --2- 172.21.15.59:0/2218186907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c540039c0 0x7f3c54003de0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3c60001e70 tx=0x7f3c6001c760 comp rx=0 tx=0).stop 2024-04-25T09:06:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 -- 172.21.15.59:0/2218186907 shutdown_connections 2024-04-25T09:06:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 --2- 172.21.15.59:0/2218186907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c540039c0 0x7f3c54003de0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 -- 172.21.15.59:0/2218186907 >> 172.21.15.59:0/2218186907 conn(0x7f3c700b3390 msgr2=0x7f3c700b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 -- 172.21.15.59:0/2218186907 shutdown_connections 2024-04-25T09:06:57.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 -- 172.21.15.59:0/2218186907 wait complete. 2024-04-25T09:06:57.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 Processor -- start 2024-04-25T09:06:57.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 -- start start 2024-04-25T09:06:57.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c540039c0 0x7f3c7014d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c70151f60 0x7f3c701523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c700d0060 0x7f3c700d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7015f730 con 0x7f3c700d0060 2024-04-25T09:06:57.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7015f5b0 con 0x7f3c70151f60 2024-04-25T09:06:57.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c75800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7015f8b0 con 0x7f3c540039c0 2024-04-25T09:06:57.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c6f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c700d0060 0x7f3c700d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c6f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c700d0060 0x7f3c700d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55770/0 (socket says 172.21.15.59:55770) 2024-04-25T09:06:57.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c6f400640 1 -- 172.21.15.59:0/40603070 learned_addr learned my addr 172.21.15.59:0/40603070 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:57.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c66000640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c70151f60 0x7f3c701523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c6ea00640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c540039c0 0x7f3c7014d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c6f400640 1 -- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c540039c0 msgr2=0x7f3c7014d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c6f400640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c540039c0 0x7f3c7014d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c6f400640 1 -- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c70151f60 msgr2=0x7f3c701523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c6f400640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c70151f60 0x7f3c701523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c6f400640 1 -- 172.21.15.59:0/40603070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c701f6300 con 0x7f3c700d0060 2024-04-25T09:06:57.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.681+0000 7f3c66000640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c70151f60 0x7f3c701523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:57.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.685+0000 7f3c6f400640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c700d0060 0x7f3c700d0510 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f3c7015bd60 tx=0x7f3c68007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.685+0000 7f3c67400640 1 -- 172.21.15.59:0/40603070 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6800f700 con 0x7f3c700d0060 2024-04-25T09:06:57.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.685+0000 7f3c67400640 1 -- 172.21.15.59:0/40603070 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c68018070 con 0x7f3c700d0060 2024-04-25T09:06:57.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.685+0000 7f3c67400640 1 -- 172.21.15.59:0/40603070 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6800fb20 con 0x7f3c700d0060 2024-04-25T09:06:57.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.685+0000 7f3c75800640 1 -- 172.21.15.59:0/40603070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c701f5540 con 0x7f3c700d0060 2024-04-25T09:06:57.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.685+0000 7f3c75800640 1 -- 172.21.15.59:0/40603070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c701f5b00 con 0x7f3c700d0060 2024-04-25T09:06:57.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.685+0000 7f3c75800640 1 -- 172.21.15.59:0/40603070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c700745d0 con 0x7f3c700d0060 2024-04-25T09:06:57.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.685+0000 7f3c67400640 1 -- 172.21.15.59:0/40603070 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3c6800fcc0 con 0x7f3c700d0060 2024-04-25T09:06:57.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.685+0000 7f3c67400640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3c4c066f60 0x7f3c4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:57.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.685+0000 7f3c67400640 1 -- 172.21.15.59:0/40603070 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3c68084f50 con 0x7f3c700d0060 2024-04-25T09:06:57.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.685+0000 7f3c6ea00640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3c4c066f60 0x7f3c4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:57.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.689+0000 7f3c6ea00640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3c4c066f60 0x7f3c4c069420 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3c60005000 tx=0x7f3c60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:57.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.689+0000 7f3c67400640 1 -- 172.21.15.59:0/40603070 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3c68055ce0 con 0x7f3c700d0060 2024-04-25T09:06:57.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.893+0000 7f3c75800640 1 -- 172.21.15.59:0/40603070 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c700d1860 con 0x7f3c700d0060 2024-04-25T09:06:57.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.893+0000 7f3c67400640 1 -- 172.21.15.59:0/40603070 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f3c680555e0 con 0x7f3c700d0060 2024-04-25T09:06:57.882 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:57.882 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":55,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:07.181212+0000","modified":"2024-04-25T09:06:29.033257+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":6,"addr":"172.21.15.59:6834/1033010830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1033010830},{"type":"v1","addr":"172.21.15.59:6834","nonce":1033010830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:06:57.882 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 55 2024-04-25T09:06:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.897+0000 7f3c75800640 1 -- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3c4c066f60 msgr2=0x7f3c4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.897+0000 7f3c75800640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3c4c066f60 0x7f3c4c069420 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3c60005000 tx=0x7f3c60009040 comp rx=0 tx=0).stop 2024-04-25T09:06:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.897+0000 7f3c75800640 1 -- 172.21.15.59:0/40603070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c700d0060 msgr2=0x7f3c700d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.897+0000 7f3c75800640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c700d0060 0x7f3c700d0510 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f3c7015bd60 tx=0x7f3c68007430 comp rx=0 tx=0).stop 2024-04-25T09:06:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.897+0000 7f3c75800640 1 -- 172.21.15.59:0/40603070 shutdown_connections 2024-04-25T09:06:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.897+0000 7f3c75800640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3c4c066f60 0x7f3c4c069420 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.897+0000 7f3c75800640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c700d0060 0x7f3c700d0510 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.897+0000 7f3c75800640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c70151f60 0x7f3c701523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.897+0000 7f3c75800640 1 --2- 172.21.15.59:0/40603070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c540039c0 0x7f3c7014d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.897+0000 7f3c75800640 1 -- 172.21.15.59:0/40603070 >> 172.21.15.59:0/40603070 conn(0x7f3c700b3390 msgr2=0x7f3c700b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.897+0000 7f3c75800640 1 -- 172.21.15.59:0/40603070 shutdown_connections 2024-04-25T09:06:57.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:57.897+0000 7f3c75800640 1 -- 172.21.15.59:0/40603070 wait complete. 2024-04-25T09:06:57.903 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T09:06:58.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.057+0000 7fb288a00640 1 Processor -- start 2024-04-25T09:06:58.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.057+0000 7fb288a00640 1 -- start start 2024-04-25T09:06:58.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.057+0000 7fb288a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415bcf0 0x7fb284099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.057+0000 7fb288a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2840d02a0 con 0x7fb28415b910 2024-04-25T09:06:58.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.057+0000 7fb288a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2840cc350 con 0x7fb2840cf3c0 2024-04-25T09:06:58.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.057+0000 7fb288a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840cc630 con 0x7fb28415bcf0 2024-04-25T09:06:58.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb28415b910 0x7fb2840cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60342/0 (socket says 172.21.15.59:60342) 2024-04-25T09:06:58.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281e00640 1 -- 172.21.15.59:0/4226841149 learned_addr learned my addr 172.21.15.59:0/4226841149 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:58.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb282800640 1 --2- 172.21.15.59:0/4226841149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415bcf0 0x7fb284099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326186506 0 0) 0x7fb2840d02a0 con 0x7fb28415b910 2024-04-25T09:06:58.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb268003530 con 0x7fb28415b910 2024-04-25T09:06:58.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718761907 0 0) 0x7fb268003530 con 0x7fb28415b910 2024-04-25T09:06:58.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415bcf0 msgr2=0x7fb284099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 --2- 172.21.15.59:0/4226841149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415bcf0 0x7fb284099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 >> v1:172.21.15.178:6789/0 conn(0x7fb2840cf3c0 legacy=0x7fb2840cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2840cc910 con 0x7fb28415b910 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fb274001680 con 0x7fb28415b910 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 >> v1:172.21.15.59:6789/0 conn(0x7fb28415b910 legacy=0x7fb2840cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 --2- 172.21.15.59:0/4226841149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2680039f0 0x7fb268003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 --2- 172.21.15.59:0/4226841149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb268004810 0x7fb268004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 --2- 172.21.15.59:0/4226841149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415bcf0 0x7fb2680051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840cc630 con 0x7fb2680039f0 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26800ba80 con 0x7fb268004810 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb26800bc80 con 0x7fb28415bcf0 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281e00640 1 --2- 172.21.15.59:0/4226841149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2680039f0 0x7fb268003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb27be00640 1 --2- 172.21.15.59:0/4226841149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb268004810 0x7fb268004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb282800640 1 --2- 172.21.15.59:0/4226841149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415bcf0 0x7fb2680051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281e00640 1 -- 172.21.15.59:0/4226841149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415bcf0 msgr2=0x7fb2680051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281e00640 1 --2- 172.21.15.59:0/4226841149 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415bcf0 0x7fb2680051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281e00640 1 -- 172.21.15.59:0/4226841149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb268004810 msgr2=0x7fb268004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281e00640 1 --2- 172.21.15.59:0/4226841149 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb268004810 0x7fb268004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.061+0000 7fb281e00640 1 -- 172.21.15.59:0/4226841149 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb268003530 con 0x7fb2680039f0 2024-04-25T09:06:58.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb281e00640 1 --2- 172.21.15.59:0/4226841149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2680039f0 0x7fb268003e10 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb274001ec0 tx=0x7fb27401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c517d5e82b5ce7b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274007d40 con 0x7fb2680039f0 2024-04-25T09:06:58.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2740a9070 con 0x7fb2680039f0 2024-04-25T09:06:58.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb281400640 1 -- 172.21.15.59:0/4226841149 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274005d40 con 0x7fb2680039f0 2024-04-25T09:06:58.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb288a00640 1 -- 172.21.15.59:0/4226841149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2680039f0 msgr2=0x7fb268003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb288a00640 1 --2- 172.21.15.59:0/4226841149 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2680039f0 0x7fb268003e10 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fb274001ec0 tx=0x7fb27401cc40 comp rx=0 tx=0).stop 2024-04-25T09:06:58.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb282800640 1 -- 172.21.15.59:0/4226841149 reap_dead start 2024-04-25T09:06:58.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb288a00640 1 -- 172.21.15.59:0/4226841149 shutdown_connections 2024-04-25T09:06:58.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb288a00640 1 -- 172.21.15.59:0/4226841149 >> 172.21.15.59:0/4226841149 conn(0x7fb2840b3200 msgr2=0x7fb2840b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb288a00640 1 -- 172.21.15.59:0/4226841149 shutdown_connections 2024-04-25T09:06:58.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb288a00640 1 -- 172.21.15.59:0/4226841149 wait complete. 2024-04-25T09:06:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb288a00640 1 Processor -- start 2024-04-25T09:06:58.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb288a00640 1 -- start start 2024-04-25T09:06:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb288a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2680039f0 0x7fb284159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb288a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb284153e40 0x7fb2841542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.065+0000 7fb288a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415de90 0x7fb28415e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb288a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840c5670 con 0x7fb2680039f0 2024-04-25T09:06:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb288a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840c54f0 con 0x7fb284153e40 2024-04-25T09:06:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb288a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2840c57f0 con 0x7fb28415de90 2024-04-25T09:06:58.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb281e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2680039f0 0x7fb284159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb281e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2680039f0 0x7fb284159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55792/0 (socket says 172.21.15.59:55792) 2024-04-25T09:06:58.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb281e00640 1 -- 172.21.15.59:0/2030898703 learned_addr learned my addr 172.21.15.59:0/2030898703 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb282800640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415de90 0x7fb28415e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb27be00640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb284153e40 0x7fb2841542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb281e00640 1 -- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415de90 msgr2=0x7fb28415e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb281e00640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415de90 0x7fb28415e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb281e00640 1 -- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb284153e40 msgr2=0x7fb2841542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb281e00640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb284153e40 0x7fb2841542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb281e00640 1 -- 172.21.15.59:0/2030898703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb284154800 con 0x7fb2680039f0 2024-04-25T09:06:58.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb281e00640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2680039f0 0x7fb284159d80 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fb27401cc80 tx=0x7fb268005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb27a000640 1 -- 172.21.15.59:0/2030898703 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274007d20 con 0x7fb2680039f0 2024-04-25T09:06:58.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb27a000640 1 -- 172.21.15.59:0/2030898703 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb274005d20 con 0x7fb2680039f0 2024-04-25T09:06:58.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb27a000640 1 -- 172.21.15.59:0/2030898703 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740a5a30 con 0x7fb2680039f0 2024-04-25T09:06:58.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb288a00640 1 -- 172.21.15.59:0/2030898703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb28415c160 con 0x7fb2680039f0 2024-04-25T09:06:58.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb288a00640 1 -- 172.21.15.59:0/2030898703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb28415c6e0 con 0x7fb2680039f0 2024-04-25T09:06:58.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.069+0000 7fb27a000640 1 -- 172.21.15.59:0/2030898703 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb2740a5bd0 con 0x7fb2680039f0 2024-04-25T09:06:58.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb27a000640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb260066f60 0x7fb260069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb27a000640 1 -- 172.21.15.59:0/2030898703 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fb27411e790 con 0x7fb2680039f0 2024-04-25T09:06:58.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 Processor -- start 2024-04-25T09:06:58.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb27be00640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb260066f60 0x7fb260069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 -- start start 2024-04-25T09:06:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb27be00640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb260066f60 0x7fb260069420 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb28415b2d0 tx=0x7fb26c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dcbf2e0 0x55be2dcbf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbfc00 0x55be2dc753a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc758e0 0x55be2dc75cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2db5cba0 con 0x55be2dcbf2e0 2024-04-25T09:06:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2dac2090 con 0x55be2dc758e0 2024-04-25T09:06:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be2da4a160 con 0x55be2dcbfc00 2024-04-25T09:06:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb281e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dcbf2e0 0x55be2dcbf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb281e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dcbf2e0 0x55be2dcbf6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55806/0 (socket says 172.21.15.59:55806) 2024-04-25T09:06:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb281e00640 1 -- 172.21.15.59:0/1412506894 learned_addr learned my addr 172.21.15.59:0/1412506894 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb282800640 1 --2- 172.21.15.59:0/1412506894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc758e0 0x55be2dc75cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb27be00640 1 --2- 172.21.15.59:0/1412506894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbfc00 0x55be2dc753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb281e00640 1 -- 172.21.15.59:0/1412506894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbfc00 msgr2=0x55be2dc753a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb281e00640 1 --2- 172.21.15.59:0/1412506894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbfc00 0x55be2dc753a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb281e00640 1 -- 172.21.15.59:0/1412506894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc758e0 msgr2=0x55be2dc75cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb281e00640 1 --2- 172.21.15.59:0/1412506894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc758e0 0x55be2dc75cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb281e00640 1 -- 172.21.15.59:0/1412506894 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be2db6bc20 con 0x55be2dcbf2e0 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb27be00640 1 --2- 172.21.15.59:0/1412506894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbfc00 0x55be2dc753a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb281e00640 1 --2- 172.21.15.59:0/1412506894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dcbf2e0 0x55be2dcbf6c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fb27401cf00 tx=0x7fb2740eef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95cf7c407aba592 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb272a00640 1 -- 172.21.15.59:0/1412506894 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740be030 con 0x55be2dcbf2e0 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb272a00640 1 -- 172.21.15.59:0/1412506894 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2740a9070 con 0x55be2dcbf2e0 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb272a00640 1 -- 172.21.15.59:0/1412506894 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2740f7530 con 0x55be2dcbf2e0 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 -- 172.21.15.59:0/1412506894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dcbf2e0 msgr2=0x55be2dcbf6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 --2- 172.21.15.59:0/1412506894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dcbf2e0 0x55be2dcbf6c0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fb27401cf00 tx=0x7fb2740eef90 comp rx=0 tx=0).stop 2024-04-25T09:06:58.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 -- 172.21.15.59:0/1412506894 shutdown_connections 2024-04-25T09:06:58.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 --2- 172.21.15.59:0/1412506894 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc758e0 0x55be2dc75cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 --2- 172.21.15.59:0/1412506894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbfc00 0x55be2dc753a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 --2- 172.21.15.59:0/1412506894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dcbf2e0 0x55be2dcbf6c0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 -- 172.21.15.59:0/1412506894 >> 172.21.15.59:0/1412506894 conn(0x55be2dc71890 msgr2=0x55be2dc73c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 -- 172.21.15.59:0/1412506894 shutdown_connections 2024-04-25T09:06:58.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.073+0000 7fb28bea4000 1 -- 172.21.15.59:0/1412506894 wait complete. 2024-04-25T09:06:58.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 1 -- start start 2024-04-25T09:06:58.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 1 Processor -- start 2024-04-25T09:06:58.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 0x55be2dc80480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 0x55be2dc809c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dcbfc00 0x55be2dc80f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2dabe130 con 0x55be2dc758e0 2024-04-25T09:06:58.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2da86130 con 0x55be2dcbfc00 2024-04-25T09:06:58.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be2db80300 con 0x55be2dcbf2e0 2024-04-25T09:06:58.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 10 client.0 _ll_register_callbacks cb 0x55be2dc60bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb281e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 0x55be2dc80480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb281e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 0x55be2dc80480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55814/0 (socket says 172.21.15.59:55814) 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb281e00640 1 -- 172.21.15.59:0/450850693 learned_addr learned my addr 172.21.15.59:0/450850693 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb27be00640 1 --2- 172.21.15.59:0/450850693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 0x55be2dc809c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb281e00640 1 -- 172.21.15.59:0/450850693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 msgr2=0x55be2dc809c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb281e00640 1 --2- 172.21.15.59:0/450850693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 0x55be2dc809c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb281e00640 1 -- 172.21.15.59:0/450850693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dcbfc00 msgr2=0x55be2dc80f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb281e00640 1 --2- 172.21.15.59:0/450850693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dcbfc00 0x55be2dc80f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb281e00640 1 -- 172.21.15.59:0/450850693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be2da9f060 con 0x55be2dc758e0 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb281e00640 1 --2- 172.21.15.59:0/450850693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 0x55be2dc80480 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fb27401c6b0 tx=0x7fb274007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d56476961807da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb267400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb267400640 1 -- 172.21.15.59:0/450850693 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274106030 con 0x55be2dc758e0 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb267400640 1 -- 172.21.15.59:0/450850693 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fb274118cd0 con 0x55be2dc758e0 2024-04-25T09:06:58.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 1 -- 172.21.15.59:0/450850693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb2740a9070 con 0x55be2dc758e0 2024-04-25T09:06:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb267400640 1 -- 172.21.15.59:0/450850693 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2740be040 con 0x55be2dc758e0 2024-04-25T09:06:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 10 client.7170 fetch_fsmap learned FSMap version 55 2024-04-25T09:06:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 1 -- 172.21.15.59:0/450850693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55be2da637c0 con 0x55be2dc758e0 2024-04-25T09:06:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb267400640 1 -- 172.21.15.59:0/450850693 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2740a9070 con 0x55be2dc758e0 2024-04-25T09:06:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb267400640 1 -- 172.21.15.59:0/450850693 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb28409a270 con 0x55be2dc758e0 2024-04-25T09:06:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 10 client.7170 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:06:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 10 client.7170 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:06:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 20 client.7170 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 1 --2- 172.21.15.59:0/450850693 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55be2dc817d0 0x55be2dcd0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 4 client.7170 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb28bea4000 1 -- 172.21.15.59:0/450850693 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be2da5dcd0 con 0x55be2dc817d0 2024-04-25T09:06:58.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb27be00640 1 --2- 172.21.15.59:0/450850693 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55be2dc817d0 0x55be2dcd0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb267400640 10 client.7170 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.077+0000 7fb27be00640 1 --2- 172.21.15.59:0/450850693 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55be2dc817d0 0x55be2dcd0850 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9802c94fddd48898 server_cookie=dda913f6981a9e42 in_seq=0 out_seq=0 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb267400640 1 -- 172.21.15.59:0/450850693 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55be2da5dcd0 con 0x55be2dc817d0 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb267400640 10 client.7170 handle_command_reply: tid=0 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb28bea4000 1 client.7170 shutdown 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb28bea4000 1 -- 172.21.15.59:0/450850693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 msgr2=0x55be2dc80480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb28bea4000 1 --2- 172.21.15.59:0/450850693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 0x55be2dc80480 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fb27401c6b0 tx=0x7fb274007ee0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb28bea4000 1 -- 172.21.15.59:0/450850693 shutdown_connections 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb28bea4000 1 --2- 172.21.15.59:0/450850693 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55be2dc817d0 0x55be2dcd0850 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb28bea4000 1 --2- 172.21.15.59:0/450850693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dcbfc00 0x55be2dc80f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb28bea4000 1 --2- 172.21.15.59:0/450850693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 0x55be2dc809c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb28bea4000 1 --2- 172.21.15.59:0/450850693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 0x55be2dc80480 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb267400640 0 client.7170 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb28bea4000 1 -- 172.21.15.59:0/450850693 >> 172.21.15.59:0/450850693 conn(0x55be2dc71890 msgr2=0x55be2dc74510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb28bea4000 1 -- 172.21.15.59:0/450850693 shutdown_connections 2024-04-25T09:06:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb28bea4000 1 -- 172.21.15.59:0/450850693 wait complete. 2024-04-25T09:06:58.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.081+0000 7fb28bea4000 20 client.7170 trim_cache size 0 max 16384 2024-04-25T09:06:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 Processor -- start 2024-04-25T09:06:58.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 -- start start 2024-04-25T09:06:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc71890 0x55be2dcbead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 0x55be2dc74c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 0x55be2dc751d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb284203030 con 0x55be2dc758e0 2024-04-25T09:06:58.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb284202490 con 0x55be2dc71890 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb284202a30 con 0x55be2dcbf2e0 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb27be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 0x55be2dc74c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb27be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 0x55be2dc74c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55816/0 (socket says 172.21.15.59:55816) 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb27be00640 1 -- 172.21.15.59:0/1888288925 learned_addr learned my addr 172.21.15.59:0/1888288925 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb281e00640 1 --2- 172.21.15.59:0/1888288925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc71890 0x55be2dcbead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb282800640 1 --2- 172.21.15.59:0/1888288925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 0x55be2dc751d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb27be00640 1 -- 172.21.15.59:0/1888288925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 msgr2=0x55be2dc751d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb27be00640 1 --2- 172.21.15.59:0/1888288925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 0x55be2dc751d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb27be00640 1 -- 172.21.15.59:0/1888288925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc71890 msgr2=0x55be2dcbead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb27be00640 1 --2- 172.21.15.59:0/1888288925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc71890 0x55be2dcbead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb27be00640 1 -- 172.21.15.59:0/1888288925 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be2da7dfc0 con 0x55be2dc758e0 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb281e00640 1 --2- 172.21.15.59:0/1888288925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc71890 0x55be2dcbead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:58.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb27be00640 1 --2- 172.21.15.59:0/1888288925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 0x55be2dc74c90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fb26c001550 tx=0x7fb26c00c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0f3bf2e81718dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb272000640 1 -- 172.21.15.59:0/1888288925 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c02e070 con 0x55be2dc758e0 2024-04-25T09:06:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb272000640 1 -- 172.21.15.59:0/1888288925 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c0281d0 con 0x55be2dc758e0 2024-04-25T09:06:58.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb272000640 1 -- 172.21.15.59:0/1888288925 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c026030 con 0x55be2dc758e0 2024-04-25T09:06:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 -- 172.21.15.59:0/1888288925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 msgr2=0x55be2dc74c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 --2- 172.21.15.59:0/1888288925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 0x55be2dc74c90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fb26c001550 tx=0x7fb26c00c000 comp rx=0 tx=0).stop 2024-04-25T09:06:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 -- 172.21.15.59:0/1888288925 shutdown_connections 2024-04-25T09:06:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 --2- 172.21.15.59:0/1888288925 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 0x55be2dc751d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 --2- 172.21.15.59:0/1888288925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc758e0 0x55be2dc74c90 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 --2- 172.21.15.59:0/1888288925 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc71890 0x55be2dcbead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 -- 172.21.15.59:0/1888288925 >> 172.21.15.59:0/1888288925 conn(0x55be2dc80ec0 msgr2=0x55be2dcbdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 -- 172.21.15.59:0/1888288925 shutdown_connections 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.093+0000 7fb28bea4000 1 -- 172.21.15.59:0/1888288925 wait complete. 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 1 -- start start 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 1 Processor -- start 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc71890 0x55be2dd1f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc758e0 0x55be2dd1f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 0x55be2dcda2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2da5ce70 con 0x55be2dc71890 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be2da4aa50 con 0x55be2dc758e0 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be2dac13a0 con 0x55be2dcbf2e0 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 10 client.0 _ll_register_callbacks cb 0x55be2da6e240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb281e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc71890 0x55be2dd1f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb281e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc71890 0x55be2dd1f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55820/0 (socket says 172.21.15.59:55820) 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb281e00640 1 -- 172.21.15.59:0/510796395 learned_addr learned my addr 172.21.15.59:0/510796395 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb27be00640 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc758e0 0x55be2dd1f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb282800640 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 0x55be2dcda2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb281e00640 1 -- 172.21.15.59:0/510796395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 msgr2=0x55be2dcda2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb281e00640 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 0x55be2dcda2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb281e00640 1 -- 172.21.15.59:0/510796395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc758e0 msgr2=0x55be2dd1f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb281e00640 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc758e0 0x55be2dd1f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb281e00640 1 -- 172.21.15.59:0/510796395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be2db1b9e0 con 0x55be2dc71890 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb281e00640 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc71890 0x55be2dd1f280 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fb27401ca70 tx=0x7fb274005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44440165086062d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb267400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb267400640 1 -- 172.21.15.59:0/510796395 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274106040 con 0x55be2dc71890 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb267400640 1 -- 172.21.15.59:0/510796395 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fb2740afcf0 con 0x55be2dc71890 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 1 -- 172.21.15.59:0/510796395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb26c0281d0 con 0x55be2dc71890 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb267400640 1 -- 172.21.15.59:0/510796395 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2740ee830 con 0x55be2dc71890 2024-04-25T09:06:58.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 10 client.7176 fetch_fsmap learned FSMap version 55 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 1 -- 172.21.15.59:0/510796395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55be2da61630 con 0x55be2dc71890 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb267400640 1 -- 172.21.15.59:0/510796395 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c0281d0 con 0x55be2dc71890 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb267400640 1 -- 172.21.15.59:0/510796395 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb2740eac20 con 0x55be2dc71890 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 10 client.7176 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 10 client.7176 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 20 client.7176 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55be2dcbfc00 0x55be2dcdac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 4 client.7176 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb28bea4000 1 -- 172.21.15.59:0/510796395 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55be2dacf5d0 con 0x55be2dcbfc00 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.097+0000 7fb27be00640 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55be2dcbfc00 0x55be2dcdac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb27be00640 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55be2dcbfc00 0x55be2dcdac90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aecde169e1f6bed server_cookie=2e6022a69985ea7f in_seq=0 out_seq=0 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb267400640 10 client.7176 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:58.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb267400640 1 -- 172.21.15.59:0/510796395 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+237 (crc 0 0 0) 0x55be2dacf5d0 con 0x55be2dcbfc00 2024-04-25T09:06:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb267400640 10 client.7176 handle_command_reply: tid=0 2024-04-25T09:06:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb28bea4000 1 client.7176 shutdown 2024-04-25T09:06:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb28bea4000 1 -- 172.21.15.59:0/510796395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc71890 msgr2=0x55be2dd1f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb28bea4000 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc71890 0x55be2dd1f280 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fb27401ca70 tx=0x7fb274005f90 comp rx=0 tx=0).stop 2024-04-25T09:06:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb28bea4000 1 -- 172.21.15.59:0/510796395 shutdown_connections 2024-04-25T09:06:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb28bea4000 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55be2dcbfc00 0x55be2dcdac90 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb28bea4000 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55be2dcbf2e0 0x55be2dcda2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb28bea4000 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55be2dc758e0 0x55be2dd1f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb28bea4000 1 --2- 172.21.15.59:0/510796395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55be2dc71890 0x55be2dd1f280 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb267400640 0 client.7176 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb28bea4000 1 -- 172.21.15.59:0/510796395 >> 172.21.15.59:0/510796395 conn(0x55be2dc80ec0 msgr2=0x55be2dc7aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb28bea4000 1 -- 172.21.15.59:0/510796395 shutdown_connections 2024-04-25T09:06:58.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb28bea4000 1 -- 172.21.15.59:0/510796395 wait complete. 2024-04-25T09:06:58.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb28bea4000 20 client.7176 trim_cache size 0 max 16384 2024-04-25T09:06:58.093 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:58.093 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T09:06:58.093 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:06:58.093 INFO:teuthology.orchestra.run.smithi059.stdout: "damage_type": "dentry", 2024-04-25T09:06:58.093 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 4202414407, 2024-04-25T09:06:58.093 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 1099511627776, 2024-04-25T09:06:58.093 INFO:teuthology.orchestra.run.smithi059.stdout: "frag": "*", 2024-04-25T09:06:58.094 INFO:teuthology.orchestra.run.smithi059.stdout: "dname": "file_to_be_damaged", 2024-04-25T09:06:58.094 INFO:teuthology.orchestra.run.smithi059.stdout: "snap_id": "head", 2024-04-25T09:06:58.094 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/subdir/file_to_be_damaged" 2024-04-25T09:06:58.094 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:58.094 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T09:06:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb288a00640 1 -- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb260066f60 msgr2=0x7fb260069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb288a00640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb260066f60 0x7fb260069420 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb28415b2d0 tx=0x7fb26c009040 comp rx=0 tx=0).stop 2024-04-25T09:06:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb288a00640 1 -- 172.21.15.59:0/2030898703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2680039f0 msgr2=0x7fb284159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb288a00640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2680039f0 0x7fb284159d80 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fb27401cc80 tx=0x7fb268005840 comp rx=0 tx=0).stop 2024-04-25T09:06:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb288a00640 1 -- 172.21.15.59:0/2030898703 shutdown_connections 2024-04-25T09:06:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb288a00640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb260066f60 0x7fb260069420 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb288a00640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb28415de90 0x7fb28415e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb288a00640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb284153e40 0x7fb2841542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb288a00640 1 --2- 172.21.15.59:0/2030898703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2680039f0 0x7fb284159d80 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb288a00640 1 -- 172.21.15.59:0/2030898703 >> 172.21.15.59:0/2030898703 conn(0x7fb2840b3200 msgr2=0x7fb28406c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb288a00640 1 -- 172.21.15.59:0/2030898703 shutdown_connections 2024-04-25T09:06:58.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.101+0000 7fb288a00640 1 -- 172.21.15.59:0/2030898703 wait complete. 2024-04-25T09:06:58.107 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:06:58.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.257+0000 7fbef1600640 1 Processor -- start 2024-04-25T09:06:58.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbef1600640 1 -- start start 2024-04-25T09:06:58.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbef1600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbeec15b980 0x7fbeec0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbef1600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeec0ce7f0 con 0x7fbeec071970 2024-04-25T09:06:58.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbef1600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeec0cead0 con 0x7fbeec15b5a0 2024-04-25T09:06:58.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbef1600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeec0ce5b0 con 0x7fbeec15b980 2024-04-25T09:06:58.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbeeb400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbeec071970 0x7fbeec0d0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60346/0 (socket says 172.21.15.59:60346) 2024-04-25T09:06:58.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbeeb400640 1 -- 172.21.15.59:0/642761248 learned_addr learned my addr 172.21.15.59:0/642761248 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:58.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbee2000640 1 --2- 172.21.15.59:0/642761248 >> v2:172.21.15.178:3300/0 conn(0x7fbeec15b980 0x7fbeec0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbeea000640 1 -- 172.21.15.59:0/642761248 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3833097765 0 0) 0x7fbeec0ce7f0 con 0x7fbeec071970 2024-04-25T09:06:58.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbeea000640 1 -- 172.21.15.59:0/642761248 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed0003530 con 0x7fbeec071970 2024-04-25T09:06:58.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbee2000640 1 -- 172.21.15.59:0/642761248 >> v1:172.21.15.178:6789/0 conn(0x7fbeec15b5a0 legacy=0x7fbeec0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbee2000640 1 -- 172.21.15.59:0/642761248 >> v1:172.21.15.59:6789/0 conn(0x7fbeec071970 legacy=0x7fbeec0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.261+0000 7fbee2000640 1 -- 172.21.15.59:0/642761248 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec0cf960 con 0x7fbeec15b980 2024-04-25T09:06:58.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbee2000640 1 --2- 172.21.15.59:0/642761248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbeec15b980 0x7fbeec0cbd30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbed40097c0 tx=0x7fbed401c2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a903ab663bc7780a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbeea000640 1 -- 172.21.15.59:0/642761248 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed40b0070 con 0x7fbeec15b980 2024-04-25T09:06:58.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbeea000640 1 -- 172.21.15.59:0/642761248 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed40ab600 con 0x7fbeec15b980 2024-04-25T09:06:58.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbeea000640 1 -- 172.21.15.59:0/642761248 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed40a4e60 con 0x7fbeec15b980 2024-04-25T09:06:58.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbef1600640 1 -- 172.21.15.59:0/642761248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbeec15b980 msgr2=0x7fbeec0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbef1600640 1 --2- 172.21.15.59:0/642761248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbeec15b980 0x7fbeec0cbd30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbed40097c0 tx=0x7fbed401c2c0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbef1600640 1 -- 172.21.15.59:0/642761248 shutdown_connections 2024-04-25T09:06:58.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbef1600640 1 --2- 172.21.15.59:0/642761248 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbeec15b980 0x7fbeec0cbd30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbef1600640 1 -- 172.21.15.59:0/642761248 >> 172.21.15.59:0/642761248 conn(0x7fbeec0b3390 msgr2=0x7fbeec0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbef1600640 1 -- 172.21.15.59:0/642761248 shutdown_connections 2024-04-25T09:06:58.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbef1600640 1 -- 172.21.15.59:0/642761248 wait complete. 2024-04-25T09:06:58.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbef1600640 1 Processor -- start 2024-04-25T09:06:58.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.265+0000 7fbef1600640 1 -- start start 2024-04-25T09:06:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbef1600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbeec071970 0x7fbeec154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbef1600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec15b5a0 0x7fbeec0b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbef1600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbeec15b980 0x7fbeec141ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbef1600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0d1490 con 0x7fbeec15b5a0 2024-04-25T09:06:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbef1600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec0d1310 con 0x7fbeec15b980 2024-04-25T09:06:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbef1600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeec169750 con 0x7fbeec071970 2024-04-25T09:06:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec15b5a0 0x7fbeec0b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec15b5a0 0x7fbeec0b5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55834/0 (socket says 172.21.15.59:55834) 2024-04-25T09:06:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee2000640 1 -- 172.21.15.59:0/2959900370 learned_addr learned my addr 172.21.15.59:0/2959900370 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbeeb400640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbeec15b980 0x7fbeec141ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbeeaa00640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbeec071970 0x7fbeec154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee2000640 1 -- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbeec071970 msgr2=0x7fbeec154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee2000640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbeec071970 0x7fbeec154b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee2000640 1 -- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbeec15b980 msgr2=0x7fbeec141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee2000640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbeec15b980 0x7fbeec141ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee2000640 1 -- 172.21.15.59:0/2959900370 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec0b69a0 con 0x7fbeec15b5a0 2024-04-25T09:06:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee2000640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec15b5a0 0x7fbeec0b5730 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbed40097c0 tx=0x7fbed401ab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee3400640 1 -- 172.21.15.59:0/2959900370 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed40bc070 con 0x7fbeec15b5a0 2024-04-25T09:06:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee3400640 1 -- 172.21.15.59:0/2959900370 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed40b1040 con 0x7fbeec15b5a0 2024-04-25T09:06:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbef1600640 1 -- 172.21.15.59:0/2959900370 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeec15bf90 con 0x7fbeec15b5a0 2024-04-25T09:06:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee3400640 1 -- 172.21.15.59:0/2959900370 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed40b0050 con 0x7fbeec15b5a0 2024-04-25T09:06:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbef1600640 1 -- 172.21.15.59:0/2959900370 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeec15c830 con 0x7fbeec15b5a0 2024-04-25T09:06:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbef1600640 1 -- 172.21.15.59:0/2959900370 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeec0745d0 con 0x7fbeec15b5a0 2024-04-25T09:06:58.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.269+0000 7fbee3400640 1 -- 172.21.15.59:0/2959900370 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbed40bf070 con 0x7fbeec15b5a0 2024-04-25T09:06:58.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.273+0000 7fbee3400640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbec8066f60 0x7fbec8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.273+0000 7fbee3400640 1 -- 172.21.15.59:0/2959900370 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fbed411eed0 con 0x7fbeec15b5a0 2024-04-25T09:06:58.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.273+0000 7fbeeaa00640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbec8066f60 0x7fbec8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.273+0000 7fbeeaa00640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbec8066f60 0x7fbec8069420 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbedc001650 tx=0x7fbedc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.277+0000 7fbee3400640 1 -- 172.21.15.59:0/2959900370 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbeec0cc680 con 0x7fbeec15b5a0 2024-04-25T09:06:58.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 -- 172.21.15.59:0/2959900370 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbeec0cc960 con 0x7fbeec15b5a0 2024-04-25T09:06:58.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbee3400640 1 -- 172.21.15.59:0/2959900370 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fbed40efcf0 con 0x7fbeec15b5a0 2024-04-25T09:06:58.461 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:06:58.461 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T09:06:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 -- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbec8066f60 msgr2=0x7fbec8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbec8066f60 0x7fbec8069420 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbedc001650 tx=0x7fbedc009040 comp rx=0 tx=0).stop 2024-04-25T09:06:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 -- 172.21.15.59:0/2959900370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec15b5a0 msgr2=0x7fbeec0b5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec15b5a0 0x7fbeec0b5730 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbed40097c0 tx=0x7fbed401ab00 comp rx=0 tx=0).stop 2024-04-25T09:06:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 -- 172.21.15.59:0/2959900370 shutdown_connections 2024-04-25T09:06:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbec8066f60 0x7fbec8069420 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbeec15b980 0x7fbeec141ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbeec15b5a0 0x7fbeec0b5730 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 --2- 172.21.15.59:0/2959900370 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbeec071970 0x7fbeec154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 -- 172.21.15.59:0/2959900370 >> 172.21.15.59:0/2959900370 conn(0x7fbeec0b3390 msgr2=0x7fbeec06be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 -- 172.21.15.59:0/2959900370 shutdown_connections 2024-04-25T09:06:58.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.473+0000 7fbef1600640 1 -- 172.21.15.59:0/2959900370 wait complete. 2024-04-25T09:06:58.482 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:06:58.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:58.482 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-04-25T09:06:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.637+0000 7ff8f6800640 1 Processor -- start 2024-04-25T09:06:58.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.637+0000 7ff8f6800640 1 -- start start 2024-04-25T09:06:58.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8f6800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f00af860 0x7ff8f00c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8f6800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f00afcc0 con 0x7ff8f00c5ed0 2024-04-25T09:06:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8f6800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f00c6dc0 con 0x7ff8f015dd00 2024-04-25T09:06:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8f6800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00d0430 con 0x7ff8f00af860 2024-04-25T09:06:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8efe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff8f00c5ed0 0x7ff8f01676d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60356/0 (socket says 172.21.15.59:60356) 2024-04-25T09:06:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8efe00640 1 -- 172.21.15.59:0/1393741144 learned_addr learned my addr 172.21.15.59:0/1393741144 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:06:58.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8e7e00640 1 --2- 172.21.15.59:0/1393741144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f00af860 0x7ff8f00c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8eea00640 1 -- 172.21.15.59:0/1393741144 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507112232 0 0) 0x7ff8f00afcc0 con 0x7ff8f00c5ed0 2024-04-25T09:06:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8eea00640 1 -- 172.21.15.59:0/1393741144 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d4003530 con 0x7ff8f00c5ed0 2024-04-25T09:06:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8eea00640 1 -- 172.21.15.59:0/1393741144 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651900006 0 0) 0x7ff8f00c6dc0 con 0x7ff8f015dd00 2024-04-25T09:06:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8e7e00640 1 -- 172.21.15.59:0/1393741144 >> v1:172.21.15.178:6789/0 conn(0x7ff8f015dd00 legacy=0x7ff8f00ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8e7e00640 1 -- 172.21.15.59:0/1393741144 >> v1:172.21.15.59:6789/0 conn(0x7ff8f00c5ed0 legacy=0x7ff8f01676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.641+0000 7ff8e7e00640 1 -- 172.21.15.59:0/1393741144 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f00c70a0 con 0x7ff8f00af860 2024-04-25T09:06:58.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8e7e00640 1 --2- 172.21.15.59:0/1393741144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f00af860 0x7ff8f00c5990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80097f0 tx=0x7ff8d801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90febbe5c3cb62c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8eea00640 1 -- 172.21.15.59:0/1393741144 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80b0070 con 0x7ff8f00af860 2024-04-25T09:06:58.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8eea00640 1 -- 172.21.15.59:0/1393741144 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d80ab600 con 0x7ff8f00af860 2024-04-25T09:06:58.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8eea00640 1 -- 172.21.15.59:0/1393741144 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80ab9d0 con 0x7ff8f00af860 2024-04-25T09:06:58.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8f6800640 1 -- 172.21.15.59:0/1393741144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f00af860 msgr2=0x7ff8f00c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8f6800640 1 --2- 172.21.15.59:0/1393741144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f00af860 0x7ff8f00c5990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80097f0 tx=0x7ff8d801c4e0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8f6800640 1 -- 172.21.15.59:0/1393741144 shutdown_connections 2024-04-25T09:06:58.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8f6800640 1 --2- 172.21.15.59:0/1393741144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f00af860 0x7ff8f00c5990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8f6800640 1 -- 172.21.15.59:0/1393741144 >> 172.21.15.59:0/1393741144 conn(0x7ff8f00b2240 msgr2=0x7ff8f00b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8f6800640 1 -- 172.21.15.59:0/1393741144 shutdown_connections 2024-04-25T09:06:58.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8f6800640 1 -- 172.21.15.59:0/1393741144 wait complete. 2024-04-25T09:06:58.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8f6800640 1 Processor -- start 2024-04-25T09:06:58.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.645+0000 7ff8f6800640 1 -- start start 2024-04-25T09:06:58.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8f6800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f00af860 0x7ff8f015c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8f6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f00c5ed0 0x7ff8f015aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8f6800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f015cdb0 0x7ff8f015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8f6800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f016bcc0 con 0x7ff8f00c5ed0 2024-04-25T09:06:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8f6800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f016bb40 con 0x7ff8f00af860 2024-04-25T09:06:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8f6800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f016be40 con 0x7ff8f015cdb0 2024-04-25T09:06:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f00c5ed0 0x7ff8f015aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f00c5ed0 0x7ff8f015aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55842/0 (socket says 172.21.15.59:55842) 2024-04-25T09:06:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8e7e00640 1 -- 172.21.15.59:0/3559204095 learned_addr learned my addr 172.21.15.59:0/3559204095 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8efe00640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f015cdb0 0x7ff8f015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8ef400640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f00af860 0x7ff8f015c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8e7e00640 1 -- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f015cdb0 msgr2=0x7ff8f015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8e7e00640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f015cdb0 0x7ff8f015b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8e7e00640 1 -- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f00af860 msgr2=0x7ff8f015c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8e7e00640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f00af860 0x7ff8f015c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8e7e00640 1 -- 172.21.15.59:0/3559204095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f01531e0 con 0x7ff8f00c5ed0 2024-04-25T09:06:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8ef400640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f00af860 0x7ff8f015c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8efe00640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f015cdb0 0x7ff8f015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8e7e00640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f00c5ed0 0x7ff8f015aca0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80190f0 tx=0x7ff8d8019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8e7400640 1 -- 172.21.15.59:0/3559204095 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80b9070 con 0x7ff8f00c5ed0 2024-04-25T09:06:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8e7400640 1 -- 172.21.15.59:0/3559204095 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d80b5480 con 0x7ff8f00c5ed0 2024-04-25T09:06:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8e7400640 1 -- 172.21.15.59:0/3559204095 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d80b0040 con 0x7ff8f00c5ed0 2024-04-25T09:06:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8f6800640 1 -- 172.21.15.59:0/3559204095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f015d320 con 0x7ff8f00c5ed0 2024-04-25T09:06:58.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.649+0000 7ff8f6800640 1 -- 172.21.15.59:0/3559204095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f013f600 con 0x7ff8f00c5ed0 2024-04-25T09:06:58.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8e7400640 1 -- 172.21.15.59:0/3559204095 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff8d80bc070 con 0x7ff8f00c5ed0 2024-04-25T09:06:58.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8e7400640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff8cc066f60 0x7ff8cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8e7400640 1 -- 172.21.15.59:0/3559204095 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff8d811f3e0 con 0x7ff8f00c5ed0 2024-04-25T09:06:58.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8ef400640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff8cc066f60 0x7ff8cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8f9d03000 1 Processor -- start 2024-04-25T09:06:58.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8f9d03000 1 -- start start 2024-04-25T09:06:58.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8ef400640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff8cc066f60 0x7ff8cc069420 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0168d10 tx=0x7ff8e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8f9d03000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d3d40 0x55943e3d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8f9d03000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e3d4660 0x55943e38a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8f9d03000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e38a5f0 0x55943e38a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8f9d03000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943e1d8c40 con 0x55943e38a5f0 2024-04-25T09:06:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8f9d03000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943e1611d0 con 0x55943e3d3d40 2024-04-25T09:06:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8f9d03000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55943e1d4ce0 con 0x55943e3d4660 2024-04-25T09:06:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e38a5f0 0x55943e38a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e38a5f0 0x55943e38a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55846/0 (socket says 172.21.15.59:55846) 2024-04-25T09:06:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8efe00640 1 -- 172.21.15.59:0/2389152941 learned_addr learned my addr 172.21.15.59:0/2389152941 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8e7e00640 1 --2- 172.21.15.59:0/2389152941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e3d4660 0x55943e38a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8ef400640 1 --2- 172.21.15.59:0/2389152941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d3d40 0x55943e3d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8efe00640 1 -- 172.21.15.59:0/2389152941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e3d4660 msgr2=0x55943e38a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8efe00640 1 --2- 172.21.15.59:0/2389152941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e3d4660 0x55943e38a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8efe00640 1 -- 172.21.15.59:0/2389152941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d3d40 msgr2=0x55943e3d4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8efe00640 1 --2- 172.21.15.59:0/2389152941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d3d40 0x55943e3d4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8efe00640 1 -- 172.21.15.59:0/2389152941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55943e21e2a0 con 0x55943e38a5f0 2024-04-25T09:06:58.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8efe00640 1 --2- 172.21.15.59:0/2389152941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e38a5f0 0x55943e38a9d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80021d0 tx=0x7ff8e8002200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd2086b8507dcf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8dfe00640 1 -- 172.21.15.59:0/2389152941 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8018070 con 0x55943e38a5f0 2024-04-25T09:06:58.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8dfe00640 1 -- 172.21.15.59:0/2389152941 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e8013670 con 0x55943e38a5f0 2024-04-25T09:06:58.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.653+0000 7ff8dfe00640 1 -- 172.21.15.59:0/2389152941 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8013a20 con 0x55943e38a5f0 2024-04-25T09:06:58.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 -- 172.21.15.59:0/2389152941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e38a5f0 msgr2=0x55943e38a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/2389152941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e38a5f0 0x55943e38a9d0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80021d0 tx=0x7ff8e8002200 comp rx=0 tx=0).stop 2024-04-25T09:06:58.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 -- 172.21.15.59:0/2389152941 shutdown_connections 2024-04-25T09:06:58.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/2389152941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e38a5f0 0x55943e38a9d0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/2389152941 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e3d4660 0x55943e38a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/2389152941 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d3d40 0x55943e3d4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 -- 172.21.15.59:0/2389152941 >> 172.21.15.59:0/2389152941 conn(0x55943e3865a0 msgr2=0x55943e388990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 -- 172.21.15.59:0/2389152941 shutdown_connections 2024-04-25T09:06:58.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 -- 172.21.15.59:0/2389152941 wait complete. 2024-04-25T09:06:58.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 -- start start 2024-04-25T09:06:58.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 Processor -- start 2024-04-25T09:06:58.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e38f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 0x55943e38fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d4660 0x55943e3b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943e193a90 con 0x55943e3d3d40 2024-04-25T09:06:58.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943e1d7f50 con 0x55943e3d4660 2024-04-25T09:06:58.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55943e18fd60 con 0x55943e38a5f0 2024-04-25T09:06:58.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 10 client.0 _ll_register_callbacks cb 0x55943e375410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:58.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 0x55943e38fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 0x55943e38fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55862/0 (socket says 172.21.15.59:55862) 2024-04-25T09:06:58.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8e7e00640 1 -- 172.21.15.59:0/1005621400 learned_addr learned my addr 172.21.15.59:0/1005621400 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8ef400640 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e38f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8efe00640 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d4660 0x55943e3b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8e7e00640 1 -- 172.21.15.59:0/1005621400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 msgr2=0x55943e38f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8e7e00640 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e38f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8e7e00640 1 -- 172.21.15.59:0/1005621400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d4660 msgr2=0x55943e3b8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8e7e00640 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d4660 0x55943e3b8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8e7e00640 1 -- 172.21.15.59:0/1005621400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55943e191730 con 0x55943e3d3d40 2024-04-25T09:06:58.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8efe00640 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d4660 0x55943e3b8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:58.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8e7e00640 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 0x55943e38fef0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009580 tx=0x7ff8d80ef520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d27ea7fda8bb5bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8dcc00640 1 -- 172.21.15.59:0/1005621400 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d811a060 con 0x55943e3d3d40 2024-04-25T09:06:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8dcc00640 1 -- 172.21.15.59:0/1005621400 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff8d80efd60 con 0x55943e3d3d40 2024-04-25T09:06:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 -- 172.21.15.59:0/1005621400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8e8013670 con 0x55943e3d3d40 2024-04-25T09:06:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8dcc00640 1 -- 172.21.15.59:0/1005621400 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8d80f3c50 con 0x55943e3d3d40 2024-04-25T09:06:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 10 client.7194 fetch_fsmap learned FSMap version 55 2024-04-25T09:06:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 -- 172.21.15.59:0/1005621400 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55943e161420 con 0x55943e3d3d40 2024-04-25T09:06:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8dcc00640 1 -- 172.21.15.59:0/1005621400 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e8013670 con 0x55943e3d3d40 2024-04-25T09:06:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8dcc00640 1 -- 172.21.15.59:0/1005621400 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff8d80f7d80 con 0x55943e3d3d40 2024-04-25T09:06:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 10 client.7194 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:06:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 10 client.7194 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:06:58.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 20 client.7194 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55943e3b9780 0x55943e3e6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 4 client.7194 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.657+0000 7ff8f9d03000 1 -- 172.21.15.59:0/1005621400 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55943e174b50 con 0x55943e3b9780 2024-04-25T09:06:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8ef400640 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55943e3b9780 0x55943e3e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8ef400640 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55943e3b9780 0x55943e3e6000 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8ac64cb796bff88 server_cookie=df8d1003cdfc22f4 in_seq=0 out_seq=0 2024-04-25T09:06:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8dcc00640 10 client.7194 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8dcc00640 1 -- 172.21.15.59:0/1005621400 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55943e174b50 con 0x55943e3b9780 2024-04-25T09:06:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8dcc00640 10 client.7194 handle_command_reply: tid=0 2024-04-25T09:06:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8f9d03000 1 client.7194 shutdown 2024-04-25T09:06:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8f9d03000 1 -- 172.21.15.59:0/1005621400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 msgr2=0x55943e38fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 0x55943e38fef0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8009580 tx=0x7ff8d80ef520 comp rx=0 tx=0).stop 2024-04-25T09:06:58.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8f9d03000 1 -- 172.21.15.59:0/1005621400 shutdown_connections 2024-04-25T09:06:58.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55943e3b9780 0x55943e3e6000 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d4660 0x55943e3b8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 0x55943e38fef0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8dcc00640 0 client.7194 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:58.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/1005621400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e38f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8f9d03000 1 -- 172.21.15.59:0/1005621400 >> 172.21.15.59:0/1005621400 conn(0x55943e3865a0 msgr2=0x55943e389220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8f9d03000 1 -- 172.21.15.59:0/1005621400 shutdown_connections 2024-04-25T09:06:58.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8f9d03000 1 -- 172.21.15.59:0/1005621400 wait complete. 2024-04-25T09:06:58.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.661+0000 7ff8f9d03000 20 client.7194 trim_cache size 0 max 16384 2024-04-25T09:06:58.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 Processor -- start 2024-04-25T09:06:58.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 -- start start 2024-04-25T09:06:58.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3865a0 0x55943e3899a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e389ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d3d40 0x55943e3e6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f0203340 con 0x55943e3865a0 2024-04-25T09:06:58.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f0202540 con 0x55943e3d3d40 2024-04-25T09:06:58.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f01409a0 con 0x55943e38a5f0 2024-04-25T09:06:58.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8ef400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3865a0 0x55943e3899a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8ef400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3865a0 0x55943e3899a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55876/0 (socket says 172.21.15.59:55876) 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8ef400640 1 -- 172.21.15.59:0/949208696 learned_addr learned my addr 172.21.15.59:0/949208696 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8efe00640 1 --2- 172.21.15.59:0/949208696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d3d40 0x55943e3e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8e7e00640 1 --2- 172.21.15.59:0/949208696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e389ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8ef400640 1 -- 172.21.15.59:0/949208696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 msgr2=0x55943e389ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8ef400640 1 --2- 172.21.15.59:0/949208696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e389ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8ef400640 1 -- 172.21.15.59:0/949208696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d3d40 msgr2=0x55943e3e6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8ef400640 1 --2- 172.21.15.59:0/949208696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d3d40 0x55943e3e6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8ef400640 1 -- 172.21.15.59:0/949208696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55943e38d7c0 con 0x55943e3865a0 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8efe00640 1 --2- 172.21.15.59:0/949208696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d3d40 0x55943e3e6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8e7e00640 1 --2- 172.21.15.59:0/949208696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e389ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8ef400640 1 --2- 172.21.15.59:0/949208696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3865a0 0x55943e3899a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0000f70 tx=0x7ff8e0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8533384fb6d516b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8df400640 1 -- 172.21.15.59:0/949208696 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e002a020 con 0x55943e3865a0 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8df400640 1 -- 172.21.15.59:0/949208696 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e000dd60 con 0x55943e3865a0 2024-04-25T09:06:58.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8df400640 1 -- 172.21.15.59:0/949208696 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0026e60 con 0x55943e3865a0 2024-04-25T09:06:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 -- 172.21.15.59:0/949208696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3865a0 msgr2=0x55943e3899a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/949208696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3865a0 0x55943e3899a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0000f70 tx=0x7ff8e0011000 comp rx=0 tx=0).stop 2024-04-25T09:06:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 -- 172.21.15.59:0/949208696 shutdown_connections 2024-04-25T09:06:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/949208696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3d3d40 0x55943e3e6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/949208696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e389ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/949208696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3865a0 0x55943e3899a0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 -- 172.21.15.59:0/949208696 >> 172.21.15.59:0/949208696 conn(0x55943e3b6d60 msgr2=0x55943e3e1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 -- 172.21.15.59:0/949208696 shutdown_connections 2024-04-25T09:06:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.677+0000 7ff8f9d03000 1 -- 172.21.15.59:0/949208696 wait complete. 2024-04-25T09:06:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 1 -- start start 2024-04-25T09:06:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 1 Processor -- start 2024-04-25T09:06:58.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3865a0 0x55943e4363e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e438930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 0x55943e43ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55943e1d7f50 con 0x55943e3d3d40 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f0202090 con 0x55943e3865a0 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55943e193a90 con 0x55943e38a5f0 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 10 client.0 _ll_register_callbacks cb 0x7ff8e8001a20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 0x55943e43ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8efe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 0x55943e43ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55884/0 (socket says 172.21.15.59:55884) 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8efe00640 1 -- 172.21.15.59:0/129271444 learned_addr learned my addr 172.21.15.59:0/129271444 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8ef400640 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3865a0 0x55943e4363e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8e7e00640 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e438930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8efe00640 1 -- 172.21.15.59:0/129271444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 msgr2=0x55943e438930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8efe00640 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e438930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8efe00640 1 -- 172.21.15.59:0/129271444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3865a0 msgr2=0x55943e4363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8efe00640 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3865a0 0x55943e4363e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8efe00640 1 -- 172.21.15.59:0/129271444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55943e25d550 con 0x55943e3d3d40 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8efe00640 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 0x55943e43ae80 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009010 tx=0x7ff8e8001410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffd66b74ad2fd61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8dcc00640 1 -- 172.21.15.59:0/129271444 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8024030 con 0x55943e3d3d40 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8dcc00640 1 -- 172.21.15.59:0/129271444 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff8e8020680 con 0x55943e3d3d40 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 1 -- 172.21.15.59:0/129271444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8e000dd60 con 0x55943e3d3d40 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8dcc00640 1 -- 172.21.15.59:0/129271444 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8e8030050 con 0x55943e3d3d40 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 10 client.7200 fetch_fsmap learned FSMap version 55 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 1 -- 172.21.15.59:0/129271444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55943e18b490 con 0x55943e3d3d40 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8dcc00640 1 -- 172.21.15.59:0/129271444 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e000dd60 con 0x55943e3d3d40 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8dcc00640 1 -- 172.21.15.59:0/129271444 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff8e8033020 con 0x55943e3d3d40 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 10 client.7200 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 10 client.7200 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:06:58.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 20 client.7200 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:58.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55943e3d4660 0x55943e43d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 4 client.7200 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-04-25T09:06:58.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8f9d03000 1 -- 172.21.15.59:0/129271444 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) v1 -- 0x55943e1e6180 con 0x55943e3d4660 2024-04-25T09:06:58.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.681+0000 7ff8ef400640 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55943e3d4660 0x55943e43d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8ef400640 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55943e3d4660 0x55943e43d3d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=337ab3c1ab74b289 server_cookie=48eb5894025ca82d in_seq=0 out_seq=0 2024-04-25T09:06:58.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8dcc00640 10 client.7200 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:58.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8dcc00640 1 -- 172.21.15.59:0/129271444 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55943e1e6180 con 0x55943e3d4660 2024-04-25T09:06:58.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8dcc00640 10 client.7200 handle_command_reply: tid=0 2024-04-25T09:06:58.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f9d03000 1 client.7200 shutdown 2024-04-25T09:06:58.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f9d03000 1 -- 172.21.15.59:0/129271444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 msgr2=0x55943e43ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 0x55943e43ae80 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009010 tx=0x7ff8e8001410 comp rx=0 tx=0).stop 2024-04-25T09:06:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f9d03000 1 -- 172.21.15.59:0/129271444 shutdown_connections 2024-04-25T09:06:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55943e3d4660 0x55943e43d3d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55943e3d3d40 0x55943e43ae80 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55943e38a5f0 0x55943e438930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f9d03000 1 --2- 172.21.15.59:0/129271444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55943e3865a0 0x55943e4363e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8dcc00640 0 client.7200 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f9d03000 1 -- 172.21.15.59:0/129271444 >> 172.21.15.59:0/129271444 conn(0x55943e3b6d60 msgr2=0x55943e388990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f9d03000 1 -- 172.21.15.59:0/129271444 shutdown_connections 2024-04-25T09:06:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f9d03000 1 -- 172.21.15.59:0/129271444 wait complete. 2024-04-25T09:06:58.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f9d03000 20 client.7200 trim_cache size 0 max 16384 2024-04-25T09:06:58.676 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:06:58.676 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-04-25T09:06:58.677 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "cd7232c6-a910-43e9-96d7-1414846c4fd0", 2024-04-25T09:06:58.677 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-04-25T09:06:58.677 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:06:58.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f6800640 1 -- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff8cc066f60 msgr2=0x7ff8cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f6800640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff8cc066f60 0x7ff8cc069420 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0168d10 tx=0x7ff8e0009040 comp rx=0 tx=0).stop 2024-04-25T09:06:58.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f6800640 1 -- 172.21.15.59:0/3559204095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f00c5ed0 msgr2=0x7ff8f015aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f6800640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f00c5ed0 0x7ff8f015aca0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff8d80190f0 tx=0x7ff8d8019280 comp rx=0 tx=0).stop 2024-04-25T09:06:58.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f6800640 1 -- 172.21.15.59:0/3559204095 shutdown_connections 2024-04-25T09:06:58.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f6800640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff8cc066f60 0x7ff8cc069420 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f6800640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff8f015cdb0 0x7ff8f015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f6800640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8f00c5ed0 0x7ff8f015aca0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f6800640 1 --2- 172.21.15.59:0/3559204095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff8f00af860 0x7ff8f015c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f6800640 1 -- 172.21.15.59:0/3559204095 >> 172.21.15.59:0/3559204095 conn(0x7ff8f00b2240 msgr2=0x7ff8f006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f6800640 1 -- 172.21.15.59:0/3559204095 shutdown_connections 2024-04-25T09:06:58.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.685+0000 7ff8f6800640 1 -- 172.21.15.59:0/3559204095 wait complete. 2024-04-25T09:06:58.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:06:58.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:06:58.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c0a800640 1 Processor -- start 2024-04-25T09:06:58.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c0a800640 1 -- start start 2024-04-25T09:06:58.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c0a800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7c0415acd0 0x7f7c0415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c0a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c0415ee60 0x7f7c040b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c0a800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0415bc40 con 0x7f7c04144120 2024-04-25T09:06:58.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c0a800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0415e490 con 0x7f7c0415ee60 2024-04-25T09:06:58.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c0a800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c0415b150 con 0x7f7c0415acd0 2024-04-25T09:06:58.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c03e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c0415ee60 0x7f7c040b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c03e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c0415ee60 0x7f7c040b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55894/0 (socket says 172.21.15.59:55894) 2024-04-25T09:06:58.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c03e00640 1 -- 172.21.15.59:0/2033765168 learned_addr learned my addr 172.21.15.59:0/2033765168 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c03e00640 1 -- 172.21.15.59:0/2033765168 >> v2:172.21.15.178:3300/0 conn(0x7f7c0415acd0 msgr2=0x7f7c0415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c03e00640 1 --2- 172.21.15.59:0/2033765168 >> v2:172.21.15.178:3300/0 conn(0x7f7c0415acd0 0x7f7c0415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c03e00640 1 -- 172.21.15.59:0/2033765168 >> v1:172.21.15.178:6789/0 conn(0x7f7c04144120 legacy=0x7f7c040ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.849+0000 7f7c03e00640 1 -- 172.21.15.59:0/2033765168 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0415b3a0 con 0x7f7c0415ee60 2024-04-25T09:06:58.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c03e00640 1 --2- 172.21.15.59:0/2033765168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c0415ee60 0x7f7c040b3090 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f7c0406b870 tx=0x7f7bfc01eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928b6aceb3f6ed0d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c02000640 1 -- 172.21.15.59:0/2033765168 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc00b2d0 con 0x7f7c0415ee60 2024-04-25T09:06:58.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c02000640 1 -- 172.21.15.59:0/2033765168 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc00b470 con 0x7f7c0415ee60 2024-04-25T09:06:58.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c02000640 1 -- 172.21.15.59:0/2033765168 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0a7a10 con 0x7f7c0415ee60 2024-04-25T09:06:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c0a800640 1 -- 172.21.15.59:0/2033765168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c0415ee60 msgr2=0x7f7c040b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c0a800640 1 --2- 172.21.15.59:0/2033765168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c0415ee60 0x7f7c040b3090 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f7c0406b870 tx=0x7f7bfc01eb20 comp rx=0 tx=0).stop 2024-04-25T09:06:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c0a800640 1 -- 172.21.15.59:0/2033765168 shutdown_connections 2024-04-25T09:06:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c0a800640 1 --2- 172.21.15.59:0/2033765168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c0415ee60 0x7f7c040b3090 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c0a800640 1 --2- 172.21.15.59:0/2033765168 >> v2:172.21.15.178:3300/0 conn(0x7f7c0415acd0 0x7f7c0415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c0a800640 1 -- 172.21.15.59:0/2033765168 >> 172.21.15.59:0/2033765168 conn(0x7f7c04067080 msgr2=0x7f7c0406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c0a800640 1 -- 172.21.15.59:0/2033765168 shutdown_connections 2024-04-25T09:06:58.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c0a800640 1 -- 172.21.15.59:0/2033765168 wait complete. 2024-04-25T09:06:58.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c0a800640 1 Processor -- start 2024-04-25T09:06:58.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.853+0000 7f7c0a800640 1 -- start start 2024-04-25T09:06:58.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c0a800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c04144120 0x7f7c0413ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c0a800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c0415acd0 0x7f7c04162920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c0a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c0415ee60 0x7f7c04160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c0a800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0406de70 con 0x7f7c0415ee60 2024-04-25T09:06:58.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c0a800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0406dcf0 con 0x7f7c0415acd0 2024-04-25T09:06:58.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c0a800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0406dff0 con 0x7f7c04144120 2024-04-25T09:06:58.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c03e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c0415ee60 0x7f7c04160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c03e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c0415ee60 0x7f7c04160910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55904/0 (socket says 172.21.15.59:55904) 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c03e00640 1 -- 172.21.15.59:0/1126280527 learned_addr learned my addr 172.21.15.59:0/1126280527 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c03400640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c04144120 0x7f7c0413ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c02a00640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c0415acd0 0x7f7c04162920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c03e00640 1 -- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c04144120 msgr2=0x7f7c0413ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c03e00640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c04144120 0x7f7c0413ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c03e00640 1 -- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c0415acd0 msgr2=0x7f7c04162920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c03e00640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c0415acd0 0x7f7c04162920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c03e00640 1 -- 172.21.15.59:0/1126280527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c04163320 con 0x7f7c0415ee60 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c02a00640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c0415acd0 0x7f7c04162920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c03e00640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c0415ee60 0x7f7c04160910 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc01c750 tx=0x7f7bfc01b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7bfb400640 1 -- 172.21.15.59:0/1126280527 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0be020 con 0x7f7c0415ee60 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7bfb400640 1 -- 172.21.15.59:0/1126280527 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc009800 con 0x7f7c0415ee60 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7bfb400640 1 -- 172.21.15.59:0/1126280527 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc009bf0 con 0x7f7c0415ee60 2024-04-25T09:06:58.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c0a800640 1 -- 172.21.15.59:0/1126280527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c04163600 con 0x7f7c0415ee60 2024-04-25T09:06:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.857+0000 7f7c0a800640 1 -- 172.21.15.59:0/1126280527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c04163bc0 con 0x7f7c0415ee60 2024-04-25T09:06:58.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7bfb400640 1 -- 172.21.15.59:0/1126280527 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7bfc0c1020 con 0x7f7c0415ee60 2024-04-25T09:06:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7bfb400640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7be4066f60 0x7f7be4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7bfb400640 1 -- 172.21.15.59:0/1126280527 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f7bfc122660 con 0x7f7c0415ee60 2024-04-25T09:06:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c03400640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7be4066f60 0x7f7be4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c0dbd3000 1 Processor -- start 2024-04-25T09:06:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c0dbd3000 1 -- start start 2024-04-25T09:06:58.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c03400640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7be4066f60 0x7f7be4069420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7c04140960 tx=0x7f7bf4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c0dbd3000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3ae30 0x55e4acd3b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c0dbd3000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3b750 0x55e4accf0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c0dbd3000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4accf1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c0dbd3000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4acb39ff0 con 0x55e4accf14b0 2024-04-25T09:06:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c0dbd3000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4acac2150 con 0x55e4acd3ae30 2024-04-25T09:06:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c0dbd3000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4acb36090 con 0x55e4acd3b750 2024-04-25T09:06:58.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c03e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4accf1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c03e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4accf1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55916/0 (socket says 172.21.15.59:55916) 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c03e00640 1 -- 172.21.15.59:0/2772278369 learned_addr learned my addr 172.21.15.59:0/2772278369 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c02a00640 1 --2- 172.21.15.59:0/2772278369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3b750 0x55e4accf0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c03400640 1 --2- 172.21.15.59:0/2772278369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3ae30 0x55e4acd3b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c03e00640 1 -- 172.21.15.59:0/2772278369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3b750 msgr2=0x55e4accf0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c03e00640 1 --2- 172.21.15.59:0/2772278369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3b750 0x55e4accf0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c03e00640 1 -- 172.21.15.59:0/2772278369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3ae30 msgr2=0x55e4acd3b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c03e00640 1 --2- 172.21.15.59:0/2772278369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3ae30 0x55e4acd3b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c03e00640 1 -- 172.21.15.59:0/2772278369 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4accd00d0 con 0x55e4accf14b0 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c02a00640 1 --2- 172.21.15.59:0/2772278369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3b750 0x55e4accf0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7c03e00640 1 --2- 172.21.15.59:0/2772278369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4accf1890 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0faff0 tx=0x7f7bfc0f2770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb99840e4935ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7befe00640 1 -- 172.21.15.59:0/2772278369 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc009450 con 0x55e4accf14b0 2024-04-25T09:06:58.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7befe00640 1 -- 172.21.15.59:0/2772278369 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0f6f60 con 0x55e4accf14b0 2024-04-25T09:06:58.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.861+0000 7f7befe00640 1 -- 172.21.15.59:0/2772278369 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bfc0fb520 con 0x55e4accf14b0 2024-04-25T09:06:58.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/2772278369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 msgr2=0x55e4accf1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/2772278369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4accf1890 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0faff0 tx=0x7f7bfc0f2770 comp rx=0 tx=0).stop 2024-04-25T09:06:58.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/2772278369 shutdown_connections 2024-04-25T09:06:58.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/2772278369 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4accf1890 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/2772278369 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3b750 0x55e4accf0f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/2772278369 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3ae30 0x55e4acd3b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/2772278369 >> 172.21.15.59:0/2772278369 conn(0x55e4acce9020 msgr2=0x55e4acceb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/2772278369 shutdown_connections 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/2772278369 wait complete. 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 -- start start 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 Processor -- start 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4acd3a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3ae30 0x55e4accf7360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4accf78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4acb3e620 con 0x55e4accf14b0 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4acaf4690 con 0x55e4acd3b750 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4acac2a40 con 0x55e4acd3ae30 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 10 client.0 _ll_register_callbacks cb 0x55e4accd7e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c03400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4acd3a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c03400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4acd3a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55918/0 (socket says 172.21.15.59:55918) 2024-04-25T09:06:58.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c03400640 1 -- 172.21.15.59:0/1956159337 learned_addr learned my addr 172.21.15.59:0/1956159337 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c03e00640 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4accf78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c02a00640 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3ae30 0x55e4accf7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c03400640 1 -- 172.21.15.59:0/1956159337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3ae30 msgr2=0x55e4accf7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c03400640 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3ae30 0x55e4accf7360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c03400640 1 -- 172.21.15.59:0/1956159337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 msgr2=0x55e4accf78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c03400640 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4accf78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c03400640 1 -- 172.21.15.59:0/1956159337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4acbe71c0 con 0x55e4accf14b0 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c03400640 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4acd3a790 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4014700 tx=0x7f7bf4001030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd69e30a0fcd2215 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7becc00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7becc00640 1 -- 172.21.15.59:0/1956159337 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4013680 con 0x55e4accf14b0 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7becc00640 1 -- 172.21.15.59:0/1956159337 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f7bf4013820 con 0x55e4accf14b0 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.865+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/1956159337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7bfc0f6f60 con 0x55e4accf14b0 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7becc00640 1 -- 172.21.15.59:0/1956159337 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bf402e050 con 0x55e4accf14b0 2024-04-25T09:06:58.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 10 client.7212 fetch_fsmap learned FSMap version 55 2024-04-25T09:06:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/1956159337 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55e4acbe3170 con 0x55e4accf14b0 2024-04-25T09:06:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7becc00640 1 -- 172.21.15.59:0/1956159337 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bfc0f6f60 con 0x55e4accf14b0 2024-04-25T09:06:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7becc00640 1 -- 172.21.15.59:0/1956159337 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7bf4031020 con 0x55e4accf14b0 2024-04-25T09:06:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 10 client.7212 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:06:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 10 client.7212 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:06:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 20 client.7212 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4accf8640 0x55e4acd4d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 4 client.7212 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:06:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/1956159337 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4acad5c60 con 0x55e4accf8640 2024-04-25T09:06:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c02a00640 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4accf8640 0x55e4acd4d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c02a00640 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4accf8640 0x55e4acd4d0f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6956140d7f57a54 server_cookie=f9560480172e9ee4 in_seq=0 out_seq=0 2024-04-25T09:06:58.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7becc00640 10 client.7212 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:58.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7becc00640 1 -- 172.21.15.59:0/1956159337 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e4acad5c60 con 0x55e4accf8640 2024-04-25T09:06:58.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7becc00640 10 client.7212 handle_command_reply: tid=0 2024-04-25T09:06:58.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 client.7212 shutdown 2024-04-25T09:06:58.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/1956159337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 msgr2=0x55e4acd3a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4acd3a790 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4014700 tx=0x7f7bf4001030 comp rx=0 tx=0).stop 2024-04-25T09:06:58.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/1956159337 shutdown_connections 2024-04-25T09:06:58.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4accf8640 0x55e4acd4d0f0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4accf78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3ae30 0x55e4accf7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/1956159337 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4acd3a790 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7becc00640 0 client.7212 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:58.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/1956159337 >> 172.21.15.59:0/1956159337 conn(0x55e4acce9020 msgr2=0x55e4accf2120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/1956159337 shutdown_connections 2024-04-25T09:06:58.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/1956159337 wait complete. 2024-04-25T09:06:58.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.869+0000 7f7c0dbd3000 20 client.7212 trim_cache size 0 max 16384 2024-04-25T09:06:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 Processor -- start 2024-04-25T09:06:58.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 -- start start 2024-04-25T09:06:58.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4accf14b0 0x55e4acd4f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4acd3ae30 0x55e4acd4f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4acd482a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4acd3a220 con 0x55e4acd3ae30 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c041ff240 con 0x55e4acd3b750 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c041fe430 con 0x55e4accf14b0 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c02a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4acd3ae30 0x55e4acd4f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c02a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4acd3ae30 0x55e4acd4f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55920/0 (socket says 172.21.15.59:55920) 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c02a00640 1 -- 172.21.15.59:0/3401266573 learned_addr learned my addr 172.21.15.59:0/3401266573 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c03400640 1 --2- 172.21.15.59:0/3401266573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4accf14b0 0x55e4acd4f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c03e00640 1 --2- 172.21.15.59:0/3401266573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4acd482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c02a00640 1 -- 172.21.15.59:0/3401266573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4accf14b0 msgr2=0x55e4acd4f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c02a00640 1 --2- 172.21.15.59:0/3401266573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4accf14b0 0x55e4acd4f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c02a00640 1 -- 172.21.15.59:0/3401266573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 msgr2=0x55e4acd482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c02a00640 1 --2- 172.21.15.59:0/3401266573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4acd482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c02a00640 1 -- 172.21.15.59:0/3401266573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4acb80de0 con 0x55e4acd3ae30 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c03e00640 1 --2- 172.21.15.59:0/3401266573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4acd482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c02a00640 1 --2- 172.21.15.59:0/3401266573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4acd3ae30 0x55e4acd4f650 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0007890 tx=0x7f7bf0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a57cfbdacd8b53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7bef400640 1 -- 172.21.15.59:0/3401266573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0007d80 con 0x55e4acd3ae30 2024-04-25T09:06:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7bef400640 1 -- 172.21.15.59:0/3401266573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf001f030 con 0x55e4acd3ae30 2024-04-25T09:06:58.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7bef400640 1 -- 172.21.15.59:0/3401266573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0016b10 con 0x55e4acd3ae30 2024-04-25T09:06:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3401266573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4acd3ae30 msgr2=0x55e4acd4f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/3401266573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4acd3ae30 0x55e4acd4f650 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0007890 tx=0x7f7bf0008040 comp rx=0 tx=0).stop 2024-04-25T09:06:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3401266573 shutdown_connections 2024-04-25T09:06:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/3401266573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4acd482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/3401266573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4acd3ae30 0x55e4acd4f650 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/3401266573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4accf14b0 0x55e4acd4f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.885+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3401266573 >> 172.21.15.59:0/3401266573 conn(0x55e4acce9020 msgr2=0x55e4acd47b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3401266573 shutdown_connections 2024-04-25T09:06:58.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3401266573 wait complete. 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 -- start start 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 Processor -- start 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4acd1b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3ae30 0x55e4acd1b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4acd4e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0413fcc0 con 0x55e4accf14b0 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0413f6c0 con 0x55e4acd3b750 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4acad4e00 con 0x55e4acd3ae30 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 10 client.0 _ll_register_callbacks cb 0x55e4accb8040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c03400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4acd1b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c03400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4acd1b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55924/0 (socket says 172.21.15.59:55924) 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c03400640 1 -- 172.21.15.59:0/3593118848 learned_addr learned my addr 172.21.15.59:0/3593118848 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c02a00640 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3ae30 0x55e4acd1b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c03e00640 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4acd4e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c03400640 1 -- 172.21.15.59:0/3593118848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3ae30 msgr2=0x55e4acd1b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c03400640 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3ae30 0x55e4acd1b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c03400640 1 -- 172.21.15.59:0/3593118848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 msgr2=0x55e4acd4e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c03400640 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4acd4e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c03400640 1 -- 172.21.15.59:0/3593118848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4acadb8e0 con 0x55e4accf14b0 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c03400640 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4acd1b1a0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4014700 tx=0x7f7bf4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f012f2b117c4d20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7becc00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7becc00640 1 -- 172.21.15.59:0/3593118848 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf4021630 con 0x55e4accf14b0 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3593118848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7bf001f030 con 0x55e4accf14b0 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7becc00640 1 -- 172.21.15.59:0/3593118848 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f7bf40217d0 con 0x55e4accf14b0 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7becc00640 1 -- 172.21.15.59:0/3593118848 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bf40219d0 con 0x55e4accf14b0 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 10 client.7218 fetch_fsmap learned FSMap version 55 2024-04-25T09:06:58.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3593118848 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x55e4acb938f0 con 0x55e4accf14b0 2024-04-25T09:06:58.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7becc00640 1 -- 172.21.15.59:0/3593118848 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf001f030 con 0x55e4accf14b0 2024-04-25T09:06:58.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7becc00640 1 -- 172.21.15.59:0/3593118848 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 55) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7bf4045020 con 0x55e4accf14b0 2024-04-25T09:06:58.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 10 client.7218 fetch_fsmap finished waiting for FSMap version 55 2024-04-25T09:06:58.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 10 client.7218 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:06:58.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 20 client.7218 populate_metadata read hostname 'smithi059' 2024-04-25T09:06:58.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4acda0fd0 0x55e4acda33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 4 client.7218 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3593118848 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e4acb47530 con 0x55e4acda0fd0 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.889+0000 7f7c02a00640 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4acda0fd0 0x55e4acda33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c02a00640 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4acda0fd0 0x55e4acda33c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dad25deee6e3e508 server_cookie=734dc513a055b0a7 in_seq=0 out_seq=0 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7becc00640 10 client.7218 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7becc00640 1 -- 172.21.15.59:0/3593118848 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x55e4acb47530 con 0x55e4acda0fd0 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7becc00640 10 client.7218 handle_command_reply: tid=0 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0dbd3000 1 client.7218 shutdown 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3593118848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 msgr2=0x55e4acd1b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4acd1b1a0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f7bf4014700 tx=0x7f7bf4014000 comp rx=0 tx=0).stop 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3593118848 shutdown_connections 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55e4acda0fd0 0x55e4acda33c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e4acd3b750 0x55e4acd4e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e4acd3ae30 0x55e4acd1b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0dbd3000 1 --2- 172.21.15.59:0/3593118848 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e4accf14b0 0x55e4acd1b1a0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7becc00640 0 client.7218 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:06:58.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3593118848 >> 172.21.15.59:0/3593118848 conn(0x55e4acce9020 msgr2=0x55e4acd48420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3593118848 shutdown_connections 2024-04-25T09:06:58.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0dbd3000 1 -- 172.21.15.59:0/3593118848 wait complete. 2024-04-25T09:06:58.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0dbd3000 20 client.7218 trim_cache size 0 max 16384 2024-04-25T09:06:58.884 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:06:58.884 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:06:58.884 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-04-25T09:06:58.884 INFO:teuthology.orchestra.run.smithi059.stdout: "cd7232c6-a910-43e9-96d7-1414846c4fd0": { 2024-04-25T09:06:58.884 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/subdir", 2024-04-25T09:06:58.884 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "cd7232c6-a910-43e9-96d7-1414846c4fd0", 2024-04-25T09:06:58.885 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,repair" 2024-04-25T09:06:58.885 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:58.885 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:06:58.885 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:06:58.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0a800640 1 -- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7be4066f60 msgr2=0x7f7be4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0a800640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7be4066f60 0x7f7be4069420 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7c04140960 tx=0x7f7bf4009040 comp rx=0 tx=0).stop 2024-04-25T09:06:58.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0a800640 1 -- 172.21.15.59:0/1126280527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c0415ee60 msgr2=0x7f7c04160910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:06:58.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0a800640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c0415ee60 0x7f7c04160910 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc01c750 tx=0x7f7bfc01b8c0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0a800640 1 -- 172.21.15.59:0/1126280527 shutdown_connections 2024-04-25T09:06:58.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0a800640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7be4066f60 0x7f7be4069420 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0a800640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c0415ee60 0x7f7c04160910 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0a800640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c0415acd0 0x7f7c04162920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0a800640 1 --2- 172.21.15.59:0/1126280527 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c04144120 0x7f7c0413ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:06:58.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0a800640 1 -- 172.21.15.59:0/1126280527 >> 172.21.15.59:0/1126280527 conn(0x7f7c04067080 msgr2=0x7f7c040b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:06:58.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0a800640 1 -- 172.21.15.59:0/1126280527 shutdown_connections 2024-04-25T09:06:58.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:06:58.893+0000 7f7c0a800640 1 -- 172.21.15.59:0/1126280527 wait complete. 2024-04-25T09:06:58.900 INFO:tasks.cephfs.filesystem:scrub status for tag:cd7232c6-a910-43e9-96d7-1414846c4fd0 - {'path': '/subdir', 'tag': 'cd7232c6-a910-43e9-96d7-1414846c4fd0', 'options': 'recursive,repair'} 2024-04-25T09:07:23.280 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:23.284 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:28.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:28.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-25T09:07:29.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f768b400640 1 Processor -- start 2024-04-25T09:07:29.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f768b400640 1 -- start start 2024-04-25T09:07:29.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f768b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7684072210 0x7f768406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f768b400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768415e9a0 con 0x7f7684150f40 2024-04-25T09:07:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f768b400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768415dbe0 con 0x7f768415af40 2024-04-25T09:07:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f768b400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768406f530 con 0x7f7684072210 2024-04-25T09:07:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f767be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7684072210 0x7f768406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f7688a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7684150f40 0x7f7684071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36798/0 (socket says 172.21.15.59:36798) 2024-04-25T09:07:29.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f7688a00640 1 -- 172.21.15.59:0/3229087046 learned_addr learned my addr 172.21.15.59:0/3229087046 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:29.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f767be00640 1 -- 172.21.15.59:0/3229087046 >> v1:172.21.15.178:6789/0 conn(0x7f768415af40 legacy=0x7f76840cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f767be00640 1 -- 172.21.15.59:0/3229087046 >> v1:172.21.15.59:6789/0 conn(0x7f7684150f40 legacy=0x7f7684071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f7683e00640 1 -- 172.21.15.59:0/3229087046 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181280473 0 0) 0x7f768415e9a0 con 0x7f7684150f40 2024-04-25T09:07:29.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.068+0000 7f767be00640 1 -- 172.21.15.59:0/3229087046 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768415dec0 con 0x7f7684072210 2024-04-25T09:07:29.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.072+0000 7f767be00640 1 --2- 172.21.15.59:0/3229087046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7684072210 0x7f768406ef50 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f768406f6b0 tx=0x7f766c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80401529dd5ca997 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.072+0000 7f7683e00640 1 -- 172.21.15.59:0/3229087046 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0b0070 con 0x7f7684072210 2024-04-25T09:07:29.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.072+0000 7f7683e00640 1 -- 172.21.15.59:0/3229087046 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c0ab600 con 0x7f7684072210 2024-04-25T09:07:29.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.072+0000 7f7683e00640 1 -- 172.21.15.59:0/3229087046 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0ab9d0 con 0x7f7684072210 2024-04-25T09:07:29.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.072+0000 7f768b400640 1 -- 172.21.15.59:0/3229087046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7684072210 msgr2=0x7f768406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.072+0000 7f768b400640 1 --2- 172.21.15.59:0/3229087046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7684072210 0x7f768406ef50 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f768406f6b0 tx=0x7f766c01c340 comp rx=0 tx=0).stop 2024-04-25T09:07:29.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.072+0000 7f768b400640 1 -- 172.21.15.59:0/3229087046 shutdown_connections 2024-04-25T09:07:29.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.072+0000 7f768b400640 1 --2- 172.21.15.59:0/3229087046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7684072210 0x7f768406ef50 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.072+0000 7f768b400640 1 -- 172.21.15.59:0/3229087046 >> 172.21.15.59:0/3229087046 conn(0x7f7684067080 msgr2=0x7f768406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.072+0000 7f768b400640 1 -- 172.21.15.59:0/3229087046 shutdown_connections 2024-04-25T09:07:29.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.072+0000 7f768b400640 1 -- 172.21.15.59:0/3229087046 wait complete. 2024-04-25T09:07:29.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f768b400640 1 Processor -- start 2024-04-25T09:07:29.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f768b400640 1 -- start start 2024-04-25T09:07:29.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f768b400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7684072210 0x7f7684150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f768b400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7684150f40 0x7f76841681f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f768b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f768415af40 0x7f76840acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f768b400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76840ce550 con 0x7f768415af40 2024-04-25T09:07:29.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f768b400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76840ce3d0 con 0x7f7684150f40 2024-04-25T09:07:29.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f768b400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76840ce6d0 con 0x7f7684072210 2024-04-25T09:07:29.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7689400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f768415af40 0x7f76840acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7689400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f768415af40 0x7f76840acc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56304/0 (socket says 172.21.15.59:56304) 2024-04-25T09:07:29.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7689400640 1 -- 172.21.15.59:0/1500989985 learned_addr learned my addr 172.21.15.59:0/1500989985 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7688a00640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7684072210 0x7f7684150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f767be00640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7684150f40 0x7f76841681f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7689400640 1 -- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7684072210 msgr2=0x7f7684150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7689400640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7684072210 0x7f7684150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7689400640 1 -- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7684150f40 msgr2=0x7f76841681f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7689400640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7684150f40 0x7f76841681f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7689400640 1 -- 172.21.15.59:0/1500989985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768414eeb0 con 0x7f768415af40 2024-04-25T09:07:29.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7689400640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f768415af40 0x7f76840acc20 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f767c00b970 tx=0x7f767c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7681600640 1 -- 172.21.15.59:0/1500989985 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c019070 con 0x7f768415af40 2024-04-25T09:07:29.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7681600640 1 -- 172.21.15.59:0/1500989985 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f767c00cb40 con 0x7f768415af40 2024-04-25T09:07:29.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f7681600640 1 -- 172.21.15.59:0/1500989985 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c014440 con 0x7f768415af40 2024-04-25T09:07:29.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f768b400640 1 -- 172.21.15.59:0/1500989985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768414f190 con 0x7f768415af40 2024-04-25T09:07:29.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.076+0000 7f768b400640 1 -- 172.21.15.59:0/1500989985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768414f750 con 0x7f768415af40 2024-04-25T09:07:29.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f7681600640 1 -- 172.21.15.59:0/1500989985 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f767c01c070 con 0x7f768415af40 2024-04-25T09:07:29.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f768e8f1000 1 Processor -- start 2024-04-25T09:07:29.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f7681600640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7660066f60 0x7f7660069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f768e8f1000 1 -- start start 2024-04-25T09:07:29.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f7681600640 1 -- 172.21.15.59:0/1500989985 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f767c084da0 con 0x7f768415af40 2024-04-25T09:07:29.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f7688a00640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7660066f60 0x7f7660069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f768e8f1000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1c6bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f768e8f1000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c6c2f0 0x561dc1c21b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f768e8f1000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c220a0 0x561dc1c22480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f768e8f1000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dc1a6eff0 con 0x561dc1c6b9d0 2024-04-25T09:07:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f768e8f1000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dc19f7150 con 0x561dc1c220a0 2024-04-25T09:07:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f768e8f1000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x561dc1a6b090 con 0x561dc1c6c2f0 2024-04-25T09:07:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.080+0000 7f7688a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1c6bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7688a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1c6bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56310/0 (socket says 172.21.15.59:56310) 2024-04-25T09:07:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7688a00640 1 -- 172.21.15.59:0/3751407706 learned_addr learned my addr 172.21.15.59:0/3751407706 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7689400640 1 --2- 172.21.15.59:0/3751407706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c220a0 0x561dc1c22480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f767be00640 1 --2- 172.21.15.59:0/3751407706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c6c2f0 0x561dc1c21b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7688a00640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7660066f60 0x7f7660069420 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7674007fd0 tx=0x7f7674007d60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7688a00640 1 -- 172.21.15.59:0/3751407706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c6c2f0 msgr2=0x561dc1c21b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7688a00640 1 --2- 172.21.15.59:0/3751407706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c6c2f0 0x561dc1c21b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7688a00640 1 -- 172.21.15.59:0/3751407706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c220a0 msgr2=0x561dc1c22480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7688a00640 1 --2- 172.21.15.59:0/3751407706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c220a0 0x561dc1c22480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7688a00640 1 -- 172.21.15.59:0/3751407706 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dc1c050d0 con 0x561dc1c6b9d0 2024-04-25T09:07:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7688a00640 1 --2- 172.21.15.59:0/3751407706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1c6bdb0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f7674001950 tx=0x7f7674012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74d8cb1cb69c8f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7679600640 1 -- 172.21.15.59:0/3751407706 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674017040 con 0x561dc1c6b9d0 2024-04-25T09:07:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7679600640 1 -- 172.21.15.59:0/3751407706 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7674023070 con 0x561dc1c6b9d0 2024-04-25T09:07:29.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f7679600640 1 -- 172.21.15.59:0/3751407706 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7674013b70 con 0x561dc1c6b9d0 2024-04-25T09:07:29.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 -- 172.21.15.59:0/3751407706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 msgr2=0x561dc1c6bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 --2- 172.21.15.59:0/3751407706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1c6bdb0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f7674001950 tx=0x7f7674012000 comp rx=0 tx=0).stop 2024-04-25T09:07:29.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 -- 172.21.15.59:0/3751407706 shutdown_connections 2024-04-25T09:07:29.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 --2- 172.21.15.59:0/3751407706 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c220a0 0x561dc1c22480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 --2- 172.21.15.59:0/3751407706 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c6c2f0 0x561dc1c21b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 --2- 172.21.15.59:0/3751407706 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1c6bdb0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 -- 172.21.15.59:0/3751407706 >> 172.21.15.59:0/3751407706 conn(0x561dc1c1e020 msgr2=0x561dc1c20440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 -- 172.21.15.59:0/3751407706 shutdown_connections 2024-04-25T09:07:29.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 -- 172.21.15.59:0/3751407706 wait complete. 2024-04-25T09:07:29.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 -- start start 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 Processor -- start 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c220a0 0x561dc1c507f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1c50d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c6c2f0 0x561dc1c51270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dc1a33250 con 0x561dc1c6b9d0 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dc1a29690 con 0x561dc1c6c2f0 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x561dc19f7a40 con 0x561dc1c220a0 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f768e8f1000 10 client.0 _ll_register_callbacks cb 0x561dc1c0ce90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.084+0000 7f767be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1c50d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f767be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1c50d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56318/0 (socket says 172.21.15.59:56318) 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f767be00640 1 -- 172.21.15.59:0/2764617467 learned_addr learned my addr 172.21.15.59:0/2764617467 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7689400640 1 --2- 172.21.15.59:0/2764617467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c6c2f0 0x561dc1c51270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f767be00640 1 -- 172.21.15.59:0/2764617467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c220a0 msgr2=0x561dc1c507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f767be00640 1 --2- 172.21.15.59:0/2764617467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c220a0 0x561dc1c507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f767be00640 1 -- 172.21.15.59:0/2764617467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c6c2f0 msgr2=0x561dc1c51270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f767be00640 1 --2- 172.21.15.59:0/2764617467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c6c2f0 0x561dc1c51270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f767be00640 1 -- 172.21.15.59:0/2764617467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561dc1b1c1c0 con 0x561dc1c6b9d0 2024-04-25T09:07:29.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f767be00640 1 --2- 172.21.15.59:0/2764617467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1c50d30 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f766c0ae040 tx=0x7f766c01ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ea945721b80d43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7672000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:07:29.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7672000640 1 -- 172.21.15.59:0/2764617467 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0b0040 con 0x561dc1c6b9d0 2024-04-25T09:07:29.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7672000640 1 -- 172.21.15.59:0/2764617467 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f766c0c2c80 con 0x561dc1c6b9d0 2024-04-25T09:07:29.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 -- 172.21.15.59:0/2764617467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7674023070 con 0x561dc1c6b9d0 2024-04-25T09:07:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7672000640 1 -- 172.21.15.59:0/2764617467 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f766c0c2e80 con 0x561dc1c6b9d0 2024-04-25T09:07:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 10 client.7233 fetch_fsmap learned FSMap version 56 2024-04-25T09:07:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 -- 172.21.15.59:0/2764617467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x561dc1b18170 con 0x561dc1c6b9d0 2024-04-25T09:07:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7672000640 1 -- 172.21.15.59:0/2764617467 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7674023070 con 0x561dc1c6b9d0 2024-04-25T09:07:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7672000640 1 -- 172.21.15.59:0/2764617467 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f766c0c9050 con 0x561dc1c6b9d0 2024-04-25T09:07:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 10 client.7233 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:07:29.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 10 client.7233 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 20 client.7233 populate_metadata read hostname 'smithi059' 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 --2- 172.21.15.59:0/2764617467 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x561dc1c7bc80 0x561dc1c7e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 4 client.7233 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 -- 172.21.15.59:0/2764617467 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561dc1a0ac60 con 0x561dc1c7bc80 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7688a00640 1 --2- 172.21.15.59:0/2764617467 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x561dc1c7bc80 0x561dc1c7e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7688a00640 1 --2- 172.21.15.59:0/2764617467 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x561dc1c7bc80 0x561dc1c7e070 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4067f1c3cefce20 server_cookie=b730a055561ce250 in_seq=0 out_seq=0 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7672000640 10 client.7233 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7672000640 1 -- 172.21.15.59:0/2764617467 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561dc1a0ac60 con 0x561dc1c7bc80 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7672000640 10 client.7233 handle_command_reply: tid=0 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 client.7233 shutdown 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 -- 172.21.15.59:0/2764617467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 msgr2=0x561dc1c50d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 --2- 172.21.15.59:0/2764617467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1c50d30 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f766c0ae040 tx=0x7f766c01ab80 comp rx=0 tx=0).stop 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 -- 172.21.15.59:0/2764617467 shutdown_connections 2024-04-25T09:07:29.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 --2- 172.21.15.59:0/2764617467 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x561dc1c7bc80 0x561dc1c7e070 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 --2- 172.21.15.59:0/2764617467 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c6c2f0 0x561dc1c51270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 --2- 172.21.15.59:0/2764617467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1c50d30 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f7672000640 0 client.7233 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:07:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 --2- 172.21.15.59:0/2764617467 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c220a0 0x561dc1c507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 -- 172.21.15.59:0/2764617467 >> 172.21.15.59:0/2764617467 conn(0x561dc1c1e020 msgr2=0x561dc1c20ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 -- 172.21.15.59:0/2764617467 shutdown_connections 2024-04-25T09:07:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 1 -- 172.21.15.59:0/2764617467 wait complete. 2024-04-25T09:07:29.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.088+0000 7f768e8f1000 20 client.7233 trim_cache size 0 max 16384 2024-04-25T09:07:29.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.104+0000 7f768e8f1000 1 Processor -- start 2024-04-25T09:07:29.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.104+0000 7f768e8f1000 1 -- start start 2024-04-25T09:07:29.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.104+0000 7f768e8f1000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c220a0 0x561dc1cc80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.104+0000 7f768e8f1000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1cc8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.104+0000 7f768e8f1000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c6c2f0 0x561dc1cc8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.104+0000 7f768e8f1000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76842031b0 con 0x561dc1c6b9d0 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.104+0000 7f768e8f1000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7684202310 con 0x561dc1c220a0 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.104+0000 7f768e8f1000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76840b0060 con 0x561dc1c6c2f0 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f767be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1cc8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f767be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1cc8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56326/0 (socket says 172.21.15.59:56326) 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f767be00640 1 -- 172.21.15.59:0/707562441 learned_addr learned my addr 172.21.15.59:0/707562441 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f7688a00640 1 --2- 172.21.15.59:0/707562441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c220a0 0x561dc1cc80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f7689400640 1 --2- 172.21.15.59:0/707562441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c6c2f0 0x561dc1cc8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f767be00640 1 -- 172.21.15.59:0/707562441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c6c2f0 msgr2=0x561dc1cc8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f767be00640 1 --2- 172.21.15.59:0/707562441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c6c2f0 0x561dc1cc8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f767be00640 1 -- 172.21.15.59:0/707562441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c220a0 msgr2=0x561dc1cc80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f767be00640 1 --2- 172.21.15.59:0/707562441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c220a0 0x561dc1cc80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f767be00640 1 -- 172.21.15.59:0/707562441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561dc1ab5de0 con 0x561dc1c6b9d0 2024-04-25T09:07:29.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f7688a00640 1 --2- 172.21.15.59:0/707562441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c220a0 0x561dc1cc80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:29.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f767be00640 1 --2- 172.21.15.59:0/707562441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1cc8630 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f766c000c10 tx=0x7f766c0b8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4c03dee9f4eb2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f7678c00640 1 -- 172.21.15.59:0/707562441 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0d0070 con 0x561dc1c6b9d0 2024-04-25T09:07:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f7678c00640 1 -- 172.21.15.59:0/707562441 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c000e50 con 0x561dc1c6b9d0 2024-04-25T09:07:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f7678c00640 1 -- 172.21.15.59:0/707562441 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c0b0040 con 0x561dc1c6b9d0 2024-04-25T09:07:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 -- 172.21.15.59:0/707562441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 msgr2=0x561dc1cc8630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 --2- 172.21.15.59:0/707562441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1cc8630 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f766c000c10 tx=0x7f766c0b8000 comp rx=0 tx=0).stop 2024-04-25T09:07:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 -- 172.21.15.59:0/707562441 shutdown_connections 2024-04-25T09:07:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 --2- 172.21.15.59:0/707562441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c6c2f0 0x561dc1cc8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 --2- 172.21.15.59:0/707562441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6b9d0 0x561dc1cc8630 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 --2- 172.21.15.59:0/707562441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c220a0 0x561dc1cc80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 -- 172.21.15.59:0/707562441 >> 172.21.15.59:0/707562441 conn(0x561dc1c1e020 msgr2=0x561dc1c78fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 -- 172.21.15.59:0/707562441 shutdown_connections 2024-04-25T09:07:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 -- 172.21.15.59:0/707562441 wait complete. 2024-04-25T09:07:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 -- start start 2024-04-25T09:07:29.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 Processor -- start 2024-04-25T09:07:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c220a0 0x561dc1c7e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c6b9d0 0x561dc1c7e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6c2f0 0x561dc1c7ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561dc1a09e00 con 0x561dc1c6c2f0 2024-04-25T09:07:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7684201d40 con 0x561dc1c6b9d0 2024-04-25T09:07:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x561dc1a6e300 con 0x561dc1c220a0 2024-04-25T09:07:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f768e8f1000 10 client.0 _ll_register_callbacks cb 0x561dc1bed040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f7689400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6c2f0 0x561dc1c7ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f7689400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6c2f0 0x561dc1c7ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56342/0 (socket says 172.21.15.59:56342) 2024-04-25T09:07:29.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f7689400640 1 -- 172.21.15.59:0/1345258229 learned_addr learned my addr 172.21.15.59:0/1345258229 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f7688a00640 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c220a0 0x561dc1c7e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.108+0000 7f767be00640 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c6b9d0 0x561dc1c7e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7689400640 1 -- 172.21.15.59:0/1345258229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c220a0 msgr2=0x561dc1c7e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7689400640 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c220a0 0x561dc1c7e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7689400640 1 -- 172.21.15.59:0/1345258229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c6b9d0 msgr2=0x561dc1c7e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7689400640 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c6b9d0 0x561dc1c7e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7689400640 1 -- 172.21.15.59:0/1345258229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561dc1a108e0 con 0x561dc1c6c2f0 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7689400640 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6c2f0 0x561dc1c7ee00 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f767c05d6a0 tx=0x7f767c051910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21461e7c8017d74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7672000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7672000640 1 -- 172.21.15.59:0/1345258229 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c059170 con 0x561dc1c6c2f0 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7672000640 1 -- 172.21.15.59:0/1345258229 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f767c059310 con 0x561dc1c6c2f0 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 -- 172.21.15.59:0/1345258229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f766c000e50 con 0x561dc1c6c2f0 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7672000640 1 -- 172.21.15.59:0/1345258229 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f767c0549c0 con 0x561dc1c6c2f0 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 10 client.7239 fetch_fsmap learned FSMap version 56 2024-04-25T09:07:29.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 -- 172.21.15.59:0/1345258229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x561dc1ac88f0 con 0x561dc1c6c2f0 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7672000640 1 -- 172.21.15.59:0/1345258229 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c000e50 con 0x561dc1c6c2f0 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7672000640 1 -- 172.21.15.59:0/1345258229 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f767c054b60 con 0x561dc1c6c2f0 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 10 client.7239 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 10 client.7239 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.c 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 20 client.7239 populate_metadata read hostname 'smithi059' 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x561dc1cd1f50 0x561dc1cd4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 4 client.7239 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 -- 172.21.15.59:0/1345258229 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561dc1a7c530 con 0x561dc1cd1f50 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7688a00640 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x561dc1cd1f50 0x561dc1cd4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7688a00640 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x561dc1cd1f50 0x561dc1cd4340 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=840c7b048e912fcb server_cookie=620be45f6d4e4d46 in_seq=0 out_seq=0 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7672000640 10 client.7239 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7672000640 1 -- 172.21.15.59:0/1345258229 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x7f7674023050 con 0x561dc1cd1f50 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7672000640 10 client.7239 handle_command_reply: tid=0 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 client.7239 shutdown 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 -- 172.21.15.59:0/1345258229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6c2f0 msgr2=0x561dc1c7ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6c2f0 0x561dc1c7ee00 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f767c05d6a0 tx=0x7f767c051910 comp rx=0 tx=0).stop 2024-04-25T09:07:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 -- 172.21.15.59:0/1345258229 shutdown_connections 2024-04-25T09:07:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x561dc1cd1f50 0x561dc1cd4340 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561dc1c6c2f0 0x561dc1c7ee00 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561dc1c6b9d0 0x561dc1c7e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 --2- 172.21.15.59:0/1345258229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561dc1c220a0 0x561dc1c7e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f7672000640 0 client.7239 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:07:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 -- 172.21.15.59:0/1345258229 >> 172.21.15.59:0/1345258229 conn(0x561dc1c1e020 msgr2=0x561dc1c6a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 -- 172.21.15.59:0/1345258229 shutdown_connections 2024-04-25T09:07:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 1 -- 172.21.15.59:0/1345258229 wait complete. 2024-04-25T09:07:29.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768e8f1000 20 client.7239 trim_cache size 0 max 16384 2024-04-25T09:07:29.105 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:07:29.105 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-04-25T09:07:29.106 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2024-04-25T09:07:29.106 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:07:29.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768b400640 1 -- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7660066f60 msgr2=0x7f7660069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768b400640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7660066f60 0x7f7660069420 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7674007fd0 tx=0x7f7674007d60 comp rx=0 tx=0).stop 2024-04-25T09:07:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768b400640 1 -- 172.21.15.59:0/1500989985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f768415af40 msgr2=0x7f76840acc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768b400640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f768415af40 0x7f76840acc20 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f767c00b970 tx=0x7f767c00be30 comp rx=0 tx=0).stop 2024-04-25T09:07:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768b400640 1 -- 172.21.15.59:0/1500989985 shutdown_connections 2024-04-25T09:07:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768b400640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7660066f60 0x7f7660069420 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768b400640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f768415af40 0x7f76840acc20 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768b400640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7684150f40 0x7f76841681f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768b400640 1 --2- 172.21.15.59:0/1500989985 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7684072210 0x7f7684150160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768b400640 1 -- 172.21.15.59:0/1500989985 >> 172.21.15.59:0/1500989985 conn(0x7f7684067080 msgr2=0x7f76840cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768b400640 1 -- 172.21.15.59:0/1500989985 shutdown_connections 2024-04-25T09:07:29.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.112+0000 7f768b400640 1 -- 172.21.15.59:0/1500989985 wait complete. 2024-04-25T09:07:29.121 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:07:29.122 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:29.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.272+0000 7fa18c400640 1 Processor -- start 2024-04-25T09:07:29.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.272+0000 7fa18c400640 1 -- start start 2024-04-25T09:07:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa18c400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1840cef30 0x7fa18406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa18c400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa18406e900 0x7fa1840b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa18c400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa18415ac60 con 0x7fa184144140 2024-04-25T09:07:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa18c400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa18406ed50 con 0x7fa1840cef30 2024-04-25T09:07:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa18c400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1840cf3e0 con 0x7fa18406e900 2024-04-25T09:07:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa189000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa1840cef30 0x7fa18406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa189a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa184144140 0x7fa1840ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36808/0 (socket says 172.21.15.59:36808) 2024-04-25T09:07:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa189a00640 1 -- 172.21.15.59:0/1051010088 learned_addr learned my addr 172.21.15.59:0/1051010088 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:29.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa18a400640 1 --2- 172.21.15.59:0/1051010088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa18406e900 0x7fa1840b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa189000640 1 -- 172.21.15.59:0/1051010088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa18406e900 msgr2=0x7fa1840b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa189000640 1 --2- 172.21.15.59:0/1051010088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa18406e900 0x7fa1840b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa189000640 1 -- 172.21.15.59:0/1051010088 >> v1:172.21.15.59:6789/0 conn(0x7fa184144140 legacy=0x7fa1840ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.276+0000 7fa189000640 1 -- 172.21.15.59:0/1051010088 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18415af20 con 0x7fa1840cef30 2024-04-25T09:07:29.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa189000640 1 --2- 172.21.15.59:0/1051010088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1840cef30 0x7fa18406e3c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa1700097c0 tx=0x7fa17001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9765286086e9743b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa183e00640 1 -- 172.21.15.59:0/1051010088 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1700b0070 con 0x7fa1840cef30 2024-04-25T09:07:29.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa183e00640 1 -- 172.21.15.59:0/1051010088 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1700ab600 con 0x7fa1840cef30 2024-04-25T09:07:29.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa183e00640 1 -- 172.21.15.59:0/1051010088 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1700ab9d0 con 0x7fa1840cef30 2024-04-25T09:07:29.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 -- 172.21.15.59:0/1051010088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1840cef30 msgr2=0x7fa18406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 --2- 172.21.15.59:0/1051010088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1840cef30 0x7fa18406e3c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fa1700097c0 tx=0x7fa17001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 -- 172.21.15.59:0/1051010088 shutdown_connections 2024-04-25T09:07:29.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 --2- 172.21.15.59:0/1051010088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa18406e900 0x7fa1840b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 --2- 172.21.15.59:0/1051010088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1840cef30 0x7fa18406e3c0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 -- 172.21.15.59:0/1051010088 >> 172.21.15.59:0/1051010088 conn(0x7fa184066fa0 msgr2=0x7fa18406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 -- 172.21.15.59:0/1051010088 shutdown_connections 2024-04-25T09:07:29.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 -- 172.21.15.59:0/1051010088 wait complete. 2024-04-25T09:07:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 Processor -- start 2024-04-25T09:07:29.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 -- start start 2024-04-25T09:07:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa18406e900 0x7fa18413a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1840cef30 0x7fa184138bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa184144140 0x7fa18415d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18415ba00 con 0x7fa1840cef30 2024-04-25T09:07:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa184144520 con 0x7fa18406e900 2024-04-25T09:07:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa18c400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa18415bb80 con 0x7fa184144140 2024-04-25T09:07:29.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa189000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1840cef30 0x7fa184138bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa189000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1840cef30 0x7fa184138bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56364/0 (socket says 172.21.15.59:56364) 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.280+0000 7fa189000640 1 -- 172.21.15.59:0/744554493 learned_addr learned my addr 172.21.15.59:0/744554493 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa189a00640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa18406e900 0x7fa18413a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa18a400640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa184144140 0x7fa18415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa189000640 1 -- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa184144140 msgr2=0x7fa18415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa189000640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa184144140 0x7fa18415d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa189000640 1 -- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa18406e900 msgr2=0x7fa18413a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa189000640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa18406e900 0x7fa18413a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa189000640 1 -- 172.21.15.59:0/744554493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18413cce0 con 0x7fa1840cef30 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa189000640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1840cef30 0x7fa184138bb0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fa1700ae040 tx=0x7fa170019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa181600640 1 -- 172.21.15.59:0/744554493 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1700ba070 con 0x7fa1840cef30 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa181600640 1 -- 172.21.15.59:0/744554493 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1700abbf0 con 0x7fa1840cef30 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa181600640 1 -- 172.21.15.59:0/744554493 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1700b0040 con 0x7fa1840cef30 2024-04-25T09:07:29.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa18c400640 1 -- 172.21.15.59:0/744554493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18413ee60 con 0x7fa1840cef30 2024-04-25T09:07:29.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa18c400640 1 -- 172.21.15.59:0/744554493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18413aa60 con 0x7fa1840cef30 2024-04-25T09:07:29.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa18c400640 1 -- 172.21.15.59:0/744554493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1840745d0 con 0x7fa1840cef30 2024-04-25T09:07:29.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.284+0000 7fa181600640 1 -- 172.21.15.59:0/744554493 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa1700b43f0 con 0x7fa1840cef30 2024-04-25T09:07:29.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.288+0000 7fa181600640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa164066f60 0x7fa164069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.288+0000 7fa181600640 1 -- 172.21.15.59:0/744554493 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa17011e0d0 con 0x7fa1840cef30 2024-04-25T09:07:29.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.288+0000 7fa189a00640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa164066f60 0x7fa164069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.288+0000 7fa189a00640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa164066f60 0x7fa164069420 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa178000f70 tx=0x7fa178009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.292+0000 7fa181600640 1 -- 172.21.15.59:0/744554493 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa170016090 con 0x7fa1840cef30 2024-04-25T09:07:29.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.488+0000 7fa18c400640 1 -- 172.21.15.59:0/744554493 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1840b2a80 con 0x7fa1840cef30 2024-04-25T09:07:29.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.488+0000 7fa181600640 1 -- 172.21.15.59:0/744554493 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4948 (secure 0 0 0) 0x7fa1700eee60 con 0x7fa1840cef30 2024-04-25T09:07:29.478 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:29.478 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":56,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:07.181212+0000","modified":"2024-04-25T09:07:05.036822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6834/1033010830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1033010830},{"type":"v1","addr":"172.21.15.59:6834","nonce":1033010830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:07:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 56 2024-04-25T09:07:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.492+0000 7fa18c400640 1 -- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa164066f60 msgr2=0x7fa164069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.492+0000 7fa18c400640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa164066f60 0x7fa164069420 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa178000f70 tx=0x7fa178009040 comp rx=0 tx=0).stop 2024-04-25T09:07:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.492+0000 7fa18c400640 1 -- 172.21.15.59:0/744554493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1840cef30 msgr2=0x7fa184138bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.492+0000 7fa18c400640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1840cef30 0x7fa184138bb0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fa1700ae040 tx=0x7fa170019240 comp rx=0 tx=0).stop 2024-04-25T09:07:29.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.492+0000 7fa18c400640 1 -- 172.21.15.59:0/744554493 shutdown_connections 2024-04-25T09:07:29.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.492+0000 7fa18c400640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa164066f60 0x7fa164069420 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.492+0000 7fa18c400640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa184144140 0x7fa18415d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.492+0000 7fa18c400640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1840cef30 0x7fa184138bb0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.492+0000 7fa18c400640 1 --2- 172.21.15.59:0/744554493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa18406e900 0x7fa18413a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.492+0000 7fa18c400640 1 -- 172.21.15.59:0/744554493 >> 172.21.15.59:0/744554493 conn(0x7fa184066fa0 msgr2=0x7fa184142af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.492+0000 7fa18c400640 1 -- 172.21.15.59:0/744554493 shutdown_connections 2024-04-25T09:07:29.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.492+0000 7fa18c400640 1 -- 172.21.15.59:0/744554493 wait complete. 2024-04-25T09:07:29.500 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage ls --format=json-pretty 2024-04-25T09:07:29.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.652+0000 7f3af5800640 1 Processor -- start 2024-04-25T09:07:29.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.652+0000 7f3af5800640 1 -- start start 2024-04-25T09:07:29.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3af5800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3af015eb50 0x7f3af015f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3af5800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af0071270 0x7f3af00716e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3af5800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af015efe0 con 0x7f3af015e770 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3af5800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af0071c20 con 0x7f3af015eb50 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3af5800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af006db20 con 0x7f3af0071270 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3ae7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3af015eb50 0x7f3af015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3ae7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3af015eb50 0x7f3af015f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56376/0 (socket says 172.21.15.59:56376) 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3aeea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3af015e770 0x7f3af006d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36822/0 (socket says 172.21.15.59:36822) 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3ae7e00640 1 -- 172.21.15.59:0/812275421 learned_addr learned my addr 172.21.15.59:0/812275421 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3aef400640 1 --2- 172.21.15.59:0/812275421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af0071270 0x7f3af00716e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3ae7e00640 1 -- 172.21.15.59:0/812275421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af0071270 msgr2=0x7f3af00716e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/812275421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af0071270 0x7f3af00716e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3ae7e00640 1 -- 172.21.15.59:0/812275421 >> v1:172.21.15.59:6789/0 conn(0x7f3af015e770 legacy=0x7f3af006d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3ae7e00640 1 -- 172.21.15.59:0/812275421 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af006de00 con 0x7f3af015eb50 2024-04-25T09:07:29.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.656+0000 7f3aee000640 1 -- 172.21.15.59:0/812275421 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363575390 0 0) 0x7f3af015efe0 con 0x7f3af015e770 2024-04-25T09:07:29.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/812275421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3af015eb50 0x7f3af015f230 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009870 tx=0x7f3ad801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b978d4c471dbe0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3aee000640 1 -- 172.21.15.59:0/812275421 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80aa430 con 0x7f3af015eb50 2024-04-25T09:07:29.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3aee000640 1 -- 172.21.15.59:0/812275421 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad80af070 con 0x7f3af015eb50 2024-04-25T09:07:29.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3aee000640 1 -- 172.21.15.59:0/812275421 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80aa7f0 con 0x7f3af015eb50 2024-04-25T09:07:29.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3af5800640 1 -- 172.21.15.59:0/812275421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3af015eb50 msgr2=0x7f3af015f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3af5800640 1 --2- 172.21.15.59:0/812275421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3af015eb50 0x7f3af015f230 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009870 tx=0x7f3ad801c4d0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3af5800640 1 -- 172.21.15.59:0/812275421 shutdown_connections 2024-04-25T09:07:29.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3af5800640 1 --2- 172.21.15.59:0/812275421 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af0071270 0x7f3af00716e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3af5800640 1 --2- 172.21.15.59:0/812275421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3af015eb50 0x7f3af015f230 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3af5800640 1 -- 172.21.15.59:0/812275421 >> 172.21.15.59:0/812275421 conn(0x7f3af0067080 msgr2=0x7f3af006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3af5800640 1 -- 172.21.15.59:0/812275421 shutdown_connections 2024-04-25T09:07:29.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3af5800640 1 -- 172.21.15.59:0/812275421 wait complete. 2024-04-25T09:07:29.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3af5800640 1 Processor -- start 2024-04-25T09:07:29.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.660+0000 7f3af5800640 1 -- start start 2024-04-25T09:07:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3af5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3af0071270 0x7f3af00b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3af5800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3af015e770 0x7f3af0154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3af5800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af015eb50 0x7f3af014c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3af5800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00aed70 con 0x7f3af0071270 2024-04-25T09:07:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3af5800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af015f770 con 0x7f3af015e770 2024-04-25T09:07:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3af5800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af00aeef0 con 0x7f3af015eb50 2024-04-25T09:07:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3aeea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3af0071270 0x7f3af00b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3aeea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3af0071270 0x7f3af00b45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56380/0 (socket says 172.21.15.59:56380) 2024-04-25T09:07:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3aeea00640 1 -- 172.21.15.59:0/3521353584 learned_addr learned my addr 172.21.15.59:0/3521353584 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3af015e770 0x7f3af0154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3aef400640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af015eb50 0x7f3af014c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3aeea00640 1 -- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af015eb50 msgr2=0x7f3af014c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3aeea00640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af015eb50 0x7f3af014c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3aeea00640 1 -- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3af015e770 msgr2=0x7f3af0154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3aeea00640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3af015e770 0x7f3af0154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3aeea00640 1 -- 172.21.15.59:0/3521353584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af0151030 con 0x7f3af0071270 2024-04-25T09:07:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3aeea00640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3af0071270 0x7f3af00b45e0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000c4b0 tx=0x7f3ae000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3ae6a00640 1 -- 172.21.15.59:0/3521353584 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0018070 con 0x7f3af0071270 2024-04-25T09:07:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3ae6a00640 1 -- 172.21.15.59:0/3521353584 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae0007500 con 0x7f3af0071270 2024-04-25T09:07:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3ae6a00640 1 -- 172.21.15.59:0/3521353584 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0004a30 con 0x7f3af0071270 2024-04-25T09:07:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3af5800640 1 -- 172.21.15.59:0/3521353584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af014dbd0 con 0x7f3af0071270 2024-04-25T09:07:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3af5800640 1 -- 172.21.15.59:0/3521353584 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af01515b0 con 0x7f3af0071270 2024-04-25T09:07:29.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.664+0000 7f3ae6a00640 1 -- 172.21.15.59:0/3521353584 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3ae001b070 con 0x7f3af0071270 2024-04-25T09:07:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3ae6a00640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3acc066f60 0x7f3acc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3ae6a00640 1 -- 172.21.15.59:0/3521353584 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3ae0084530 con 0x7f3af0071270 2024-04-25T09:07:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 Processor -- start 2024-04-25T09:07:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3acc066f60 0x7f3acc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 -- start start 2024-04-25T09:07:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3acc066f60 0x7f3acc069420 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80ae000 tx=0x7f3ad80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996512e0 0x55cc996516c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc996073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 0x55cc99607cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc994eeba0 con 0x55cc996078e0 2024-04-25T09:07:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc99454090 con 0x55cc996512e0 2024-04-25T09:07:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc993dc160 con 0x55cc99651c00 2024-04-25T09:07:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3aef400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 0x55cc99607cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3aef400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 0x55cc99607cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56386/0 (socket says 172.21.15.59:56386) 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3aef400640 1 -- 172.21.15.59:0/3657179480 learned_addr learned my addr 172.21.15.59:0/3657179480 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3aeea00640 1 --2- 172.21.15.59:0/3657179480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996512e0 0x55cc996516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/3657179480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc996073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3aef400640 1 -- 172.21.15.59:0/3657179480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 msgr2=0x55cc996073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3aef400640 1 --2- 172.21.15.59:0/3657179480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc996073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3aef400640 1 -- 172.21.15.59:0/3657179480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996512e0 msgr2=0x55cc996516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3aef400640 1 --2- 172.21.15.59:0/3657179480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996512e0 0x55cc996516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3aef400640 1 -- 172.21.15.59:0/3657179480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc994fdc20 con 0x55cc996078e0 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3aeea00640 1 --2- 172.21.15.59:0/3657179480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996512e0 0x55cc996516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3aef400640 1 --2- 172.21.15.59:0/3657179480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 0x55cc99607cc0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80074f0 tx=0x7f3ae8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcade5e0c7120a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3adf400640 1 -- 172.21.15.59:0/3657179480 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8019020 con 0x55cc996078e0 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3adf400640 1 -- 172.21.15.59:0/3657179480 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae8015600 con 0x55cc996078e0 2024-04-25T09:07:29.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3adf400640 1 -- 172.21.15.59:0/3657179480 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80159d0 con 0x55cc996078e0 2024-04-25T09:07:29.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 -- 172.21.15.59:0/3657179480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 msgr2=0x55cc99607cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/3657179480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 0x55cc99607cc0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80074f0 tx=0x7f3ae8009750 comp rx=0 tx=0).stop 2024-04-25T09:07:29.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 -- 172.21.15.59:0/3657179480 shutdown_connections 2024-04-25T09:07:29.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/3657179480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 0x55cc99607cc0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/3657179480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc996073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/3657179480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996512e0 0x55cc996516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 -- 172.21.15.59:0/3657179480 >> 172.21.15.59:0/3657179480 conn(0x55cc99603890 msgr2=0x55cc99605c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 -- 172.21.15.59:0/3657179480 shutdown_connections 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.668+0000 7f3af8c7e000 1 -- 172.21.15.59:0/3657179480 wait complete. 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 1 -- start start 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 1 Processor -- start 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996078e0 0x55cc99658640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996512e0 0x55cc99658b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc9963f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc99450130 con 0x55cc996512e0 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc99418130 con 0x55cc996078e0 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc99512300 con 0x55cc99651c00 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 10 client.0 _ll_register_callbacks cb 0x55cc995f2bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ae7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996512e0 0x55cc99658b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ae7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996512e0 0x55cc99658b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56394/0 (socket says 172.21.15.59:56394) 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ae7e00640 1 -- 172.21.15.59:0/2717901486 learned_addr learned my addr 172.21.15.59:0/2717901486 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3aeea00640 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996078e0 0x55cc99658640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3aef400640 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc9963f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ae7e00640 1 -- 172.21.15.59:0/2717901486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 msgr2=0x55cc9963f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc9963f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ae7e00640 1 -- 172.21.15.59:0/2717901486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996078e0 msgr2=0x55cc99658640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996078e0 0x55cc99658640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ae7e00640 1 -- 172.21.15.59:0/2717901486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc99431060 con 0x55cc996512e0 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3aeea00640 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996078e0 0x55cc99658640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3aef400640 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc9963f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996512e0 0x55cc99658b80 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009630 tx=0x7f3ad801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b397bb658ec3e13f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ad3e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ad3e00640 1 -- 172.21.15.59:0/2717901486 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80cc060 con 0x55cc996512e0 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ad3e00640 1 -- 172.21.15.59:0/2717901486 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3ad80be8d0 con 0x55cc996512e0 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 1 -- 172.21.15.59:0/2717901486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ae8015600 con 0x55cc996512e0 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ad3e00640 1 -- 172.21.15.59:0/2717901486 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ad80d2050 con 0x55cc996512e0 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 10 client.7263 fetch_fsmap learned FSMap version 56 2024-04-25T09:07:29.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 1 -- 172.21.15.59:0/2717901486 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55cc993f57c0 con 0x55cc996512e0 2024-04-25T09:07:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ad3e00640 1 -- 172.21.15.59:0/2717901486 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae8015600 con 0x55cc996512e0 2024-04-25T09:07:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3ad3e00640 1 -- 172.21.15.59:0/2717901486 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3ad80d5020 con 0x55cc996512e0 2024-04-25T09:07:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 10 client.7263 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:07:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 10 client.7263 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:07:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 20 client.7263 populate_metadata read hostname 'smithi059' 2024-04-25T09:07:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55cc9963fe30 0x55cc99640210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 4 client.7263 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:07:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3af8c7e000 1 -- 172.21.15.59:0/2717901486 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc993efcd0 con 0x55cc9963fe30 2024-04-25T09:07:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.672+0000 7f3aeea00640 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55cc9963fe30 0x55cc99640210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3aeea00640 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55cc9963fe30 0x55cc99640210 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3c789eb5344ca4c server_cookie=754e35526de661eb in_seq=0 out_seq=0 2024-04-25T09:07:29.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3ad3e00640 10 client.7263 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:07:29.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3ad3e00640 1 -- 172.21.15.59:0/2717901486 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55cc993efcd0 con 0x55cc9963fe30 2024-04-25T09:07:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3ad3e00640 10 client.7263 handle_command_reply: tid=0 2024-04-25T09:07:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3af8c7e000 1 client.7263 shutdown 2024-04-25T09:07:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3af8c7e000 1 -- 172.21.15.59:0/2717901486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996512e0 msgr2=0x55cc99658b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996512e0 0x55cc99658b80 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8009630 tx=0x7f3ad801ad10 comp rx=0 tx=0).stop 2024-04-25T09:07:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3af8c7e000 1 -- 172.21.15.59:0/2717901486 shutdown_connections 2024-04-25T09:07:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55cc9963fe30 0x55cc99640210 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc9963f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996512e0 0x55cc99658b80 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3ad3e00640 0 client.7263 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:07:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/2717901486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996078e0 0x55cc99658640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3af8c7e000 1 -- 172.21.15.59:0/2717901486 >> 172.21.15.59:0/2717901486 conn(0x55cc99603890 msgr2=0x55cc99606510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3af8c7e000 1 -- 172.21.15.59:0/2717901486 shutdown_connections 2024-04-25T09:07:29.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3af8c7e000 1 -- 172.21.15.59:0/2717901486 wait complete. 2024-04-25T09:07:29.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.676+0000 7f3af8c7e000 20 client.7263 trim_cache size 0 max 16384 2024-04-25T09:07:29.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 Processor -- start 2024-04-25T09:07:29.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 -- start start 2024-04-25T09:07:29.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996078e0 0x55cc9963e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc996512e0 0x55cc9963e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99651c00 0x55cc99605c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af02022f0 con 0x55cc99651c00 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af0152980 con 0x55cc996078e0 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af0201df0 con 0x55cc996512e0 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3aef400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99651c00 0x55cc99605c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3aef400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99651c00 0x55cc99605c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56404/0 (socket says 172.21.15.59:56404) 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3aef400640 1 -- 172.21.15.59:0/955447863 learned_addr learned my addr 172.21.15.59:0/955447863 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3aef400640 1 -- 172.21.15.59:0/955447863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc996512e0 msgr2=0x55cc9963e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3aef400640 1 --2- 172.21.15.59:0/955447863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc996512e0 0x55cc9963e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3aef400640 1 -- 172.21.15.59:0/955447863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996078e0 msgr2=0x55cc9963e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3aef400640 1 --2- 172.21.15.59:0/955447863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996078e0 0x55cc9963e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3aef400640 1 -- 172.21.15.59:0/955447863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc9940ffc0 con 0x55cc99651c00 2024-04-25T09:07:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3aef400640 1 --2- 172.21.15.59:0/955447863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99651c00 0x55cc99605c80 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8000f90 tx=0x7f3ae8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bf5f26e503e01c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3adea00640 1 -- 172.21.15.59:0/955447863 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8024070 con 0x55cc99651c00 2024-04-25T09:07:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3adea00640 1 -- 172.21.15.59:0/955447863 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae8015800 con 0x55cc99651c00 2024-04-25T09:07:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3adea00640 1 -- 172.21.15.59:0/955447863 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8019040 con 0x55cc99651c00 2024-04-25T09:07:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 -- 172.21.15.59:0/955447863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99651c00 msgr2=0x55cc99605c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/955447863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99651c00 0x55cc99605c80 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8000f90 tx=0x7f3ae8009f90 comp rx=0 tx=0).stop 2024-04-25T09:07:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 -- 172.21.15.59:0/955447863 shutdown_connections 2024-04-25T09:07:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/955447863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc99651c00 0x55cc99605c80 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/955447863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc996512e0 0x55cc9963e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/955447863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996078e0 0x55cc9963e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.688+0000 7f3af8c7e000 1 -- 172.21.15.59:0/955447863 >> 172.21.15.59:0/955447863 conn(0x55cc99603890 msgr2=0x55cc9965ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 -- 172.21.15.59:0/955447863 shutdown_connections 2024-04-25T09:07:29.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 -- 172.21.15.59:0/955447863 wait complete. 2024-04-25T09:07:29.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 -- start start 2024-04-25T09:07:29.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 Processor -- start 2024-04-25T09:07:29.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 0x55cc996b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996512e0 0x55cc996b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc99655040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc993eee70 con 0x55cc996078e0 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc993dca50 con 0x55cc996512e0 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc994533a0 con 0x55cc99651c00 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 10 client.0 _ll_register_callbacks cb 0x55cc99400240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3aeea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 0x55cc996b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3aeea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 0x55cc996b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56410/0 (socket says 172.21.15.59:56410) 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3aeea00640 1 -- 172.21.15.59:0/1780347780 learned_addr learned my addr 172.21.15.59:0/1780347780 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996512e0 0x55cc996b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3aef400640 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc99655040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3aeea00640 1 -- 172.21.15.59:0/1780347780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 msgr2=0x55cc99655040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3aeea00640 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc99655040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3aeea00640 1 -- 172.21.15.59:0/1780347780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996512e0 msgr2=0x55cc996b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3aeea00640 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996512e0 0x55cc996b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3aeea00640 1 -- 172.21.15.59:0/1780347780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cc994ad9e0 con 0x55cc996078e0 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996512e0 0x55cc996b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3aef400640 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc99655040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3aeea00640 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 0x55cc996b0d40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0054b00 tx=0x7f3ae0084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75c8e5f9d9f7380 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3ad3e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3ad3e00640 1 -- 172.21.15.59:0/1780347780 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0051230 con 0x55cc996078e0 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3ad3e00640 1 -- 172.21.15.59:0/1780347780 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3ae0004bd0 con 0x55cc996078e0 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 -- 172.21.15.59:0/1780347780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ae8015800 con 0x55cc996078e0 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3ad3e00640 1 -- 172.21.15.59:0/1780347780 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ae00513d0 con 0x55cc996078e0 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 10 client.7269 fetch_fsmap learned FSMap version 56 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 -- 172.21.15.59:0/1780347780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55cc993f3630 con 0x55cc996078e0 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3ad3e00640 1 -- 172.21.15.59:0/1780347780 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae8015800 con 0x55cc996078e0 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3ad3e00640 1 -- 172.21.15.59:0/1780347780 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 56) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f3ae0054e20 con 0x55cc996078e0 2024-04-25T09:07:29.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 10 client.7269 fetch_fsmap finished waiting for FSMap version 56 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 10 client.7269 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 20 client.7269 populate_metadata read hostname 'smithi059' 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55cc996b7ba0 0x55cc996b9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 4 client.7269 mds_command: new command op to 6999 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3af8c7e000 1 -- 172.21.15.59:0/1780347780 --> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55cc994615d0 con 0x55cc996b7ba0 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.692+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55cc996b7ba0 0x55cc996b9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3ae7e00640 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55cc996b7ba0 0x55cc996b9f90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3da6c06e26acedfb server_cookie=93864d40de5cfaa8 in_seq=0 out_seq=0 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3ad3e00640 10 client.7269 ms_handle_connect on v2:172.21.15.59:6832/1033010830 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3ad3e00640 1 -- 172.21.15.59:0/1780347780 <== mds.0 v2:172.21.15.59:6832/1033010830 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cc994615d0 con 0x55cc996b7ba0 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3ad3e00640 10 client.7269 handle_command_reply: tid=0 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af8c7e000 1 client.7269 shutdown 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af8c7e000 1 -- 172.21.15.59:0/1780347780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 msgr2=0x55cc996b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 0x55cc996b0d40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0054b00 tx=0x7f3ae0084040 comp rx=0 tx=0).stop 2024-04-25T09:07:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af8c7e000 1 -- 172.21.15.59:0/1780347780 shutdown_connections 2024-04-25T09:07:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.59:6832/1033010830,v1:172.21.15.59:6834/1033010830] conn(0x55cc996b7ba0 0x55cc996b9f90 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55cc99651c00 0x55cc99655040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55cc996512e0 0x55cc996b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af8c7e000 1 --2- 172.21.15.59:0/1780347780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55cc996078e0 0x55cc996b0d40 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af8c7e000 1 -- 172.21.15.59:0/1780347780 >> 172.21.15.59:0/1780347780 conn(0x55cc99603890 msgr2=0x55cc9965e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3ad3e00640 0 client.7269 ms_handle_reset on v2:172.21.15.59:6832/1033010830 2024-04-25T09:07:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af8c7e000 1 -- 172.21.15.59:0/1780347780 shutdown_connections 2024-04-25T09:07:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af8c7e000 1 -- 172.21.15.59:0/1780347780 wait complete. 2024-04-25T09:07:29.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af8c7e000 20 client.7269 trim_cache size 0 max 16384 2024-04-25T09:07:29.688 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:29.689 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-04-25T09:07:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af5800640 1 -- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3acc066f60 msgr2=0x7f3acc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af5800640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3acc066f60 0x7f3acc069420 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80ae000 tx=0x7f3ad80a7000 comp rx=0 tx=0).stop 2024-04-25T09:07:29.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af5800640 1 -- 172.21.15.59:0/3521353584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3af0071270 msgr2=0x7f3af00b45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af5800640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3af0071270 0x7f3af00b45e0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f3ae000c4b0 tx=0x7f3ae000c970 comp rx=0 tx=0).stop 2024-04-25T09:07:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af5800640 1 -- 172.21.15.59:0/3521353584 shutdown_connections 2024-04-25T09:07:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af5800640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3acc066f60 0x7f3acc069420 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af5800640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3af015eb50 0x7f3af014c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af5800640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3af015e770 0x7f3af0154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af5800640 1 --2- 172.21.15.59:0/3521353584 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3af0071270 0x7f3af00b45e0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af5800640 1 -- 172.21.15.59:0/3521353584 >> 172.21.15.59:0/3521353584 conn(0x7f3af0067080 msgr2=0x7f3af0159300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af5800640 1 -- 172.21.15.59:0/3521353584 shutdown_connections 2024-04-25T09:07:29.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.696+0000 7f3af5800640 1 -- 172.21.15.59:0/3521353584 wait complete. 2024-04-25T09:07:29.703 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:07:29.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbdaa000640 1 Processor -- start 2024-04-25T09:07:29.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbdaa000640 1 -- start start 2024-04-25T09:07:29.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbdaa000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda415fe50 0x7fbda40b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbdaa000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda40cc4e0 con 0x7fbda40b1c90 2024-04-25T09:07:29.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbdaa000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda40ce040 con 0x7fbda4145270 2024-04-25T09:07:29.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbdaa000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40b20e0 con 0x7fbda415fe50 2024-04-25T09:07:29.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbda3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbda40b1c90 0x7fbda415bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36824/0 (socket says 172.21.15.59:36824) 2024-04-25T09:07:29.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbda3e00640 1 -- 172.21.15.59:0/4032488025 learned_addr learned my addr 172.21.15.59:0/4032488025 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:29.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbda2a00640 1 --2- 172.21.15.59:0/4032488025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda415fe50 0x7fbda40b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbda2000640 1 -- 172.21.15.59:0/4032488025 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403715701 0 0) 0x7fbda40cc4e0 con 0x7fbda40b1c90 2024-04-25T09:07:29.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbda2000640 1 -- 172.21.15.59:0/4032488025 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd88003530 con 0x7fbda40b1c90 2024-04-25T09:07:29.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbda2a00640 1 -- 172.21.15.59:0/4032488025 >> v1:172.21.15.178:6789/0 conn(0x7fbda4145270 legacy=0x7fbda40cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbda2000640 1 -- 172.21.15.59:0/4032488025 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688907704 0 0) 0x7fbda40ce040 con 0x7fbda4145270 2024-04-25T09:07:29.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbda2a00640 1 -- 172.21.15.59:0/4032488025 >> v1:172.21.15.59:6789/0 conn(0x7fbda40b1c90 legacy=0x7fbda415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.856+0000 7fbda2a00640 1 -- 172.21.15.59:0/4032488025 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda40ce320 con 0x7fbda415fe50 2024-04-25T09:07:29.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.860+0000 7fbda2a00640 1 --2- 172.21.15.59:0/4032488025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda415fe50 0x7fbda40b1750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd900097f0 tx=0x7fbd9001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e364f31e65d6fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.860+0000 7fbda2000640 1 -- 172.21.15.59:0/4032488025 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd900b0070 con 0x7fbda415fe50 2024-04-25T09:07:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.860+0000 7fbda2000640 1 -- 172.21.15.59:0/4032488025 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd900ab600 con 0x7fbda415fe50 2024-04-25T09:07:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.860+0000 7fbda2000640 1 -- 172.21.15.59:0/4032488025 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd900ab9d0 con 0x7fbda415fe50 2024-04-25T09:07:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.860+0000 7fbdaa000640 1 -- 172.21.15.59:0/4032488025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda415fe50 msgr2=0x7fbda40b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.860+0000 7fbdaa000640 1 --2- 172.21.15.59:0/4032488025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda415fe50 0x7fbda40b1750 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbd900097f0 tx=0x7fbd9001c4e0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.860+0000 7fbdaa000640 1 -- 172.21.15.59:0/4032488025 shutdown_connections 2024-04-25T09:07:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.860+0000 7fbdaa000640 1 --2- 172.21.15.59:0/4032488025 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda415fe50 0x7fbda40b1750 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.860+0000 7fbdaa000640 1 -- 172.21.15.59:0/4032488025 >> 172.21.15.59:0/4032488025 conn(0x7fbda4066fa0 msgr2=0x7fbda406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:29.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.860+0000 7fbdaa000640 1 -- 172.21.15.59:0/4032488025 shutdown_connections 2024-04-25T09:07:29.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.860+0000 7fbdaa000640 1 -- 172.21.15.59:0/4032488025 wait complete. 2024-04-25T09:07:29.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbdaa000640 1 Processor -- start 2024-04-25T09:07:29.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbdaa000640 1 -- start start 2024-04-25T09:07:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbdaa000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda40b1c90 0x7fbda413cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbdaa000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda4145270 0x7fbda413ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbdaa000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbda415fe50 0x7fbda415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbdaa000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40cdd60 con 0x7fbda40b1c90 2024-04-25T09:07:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbdaa000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40cdbe0 con 0x7fbda415fe50 2024-04-25T09:07:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbdaa000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda4169720 con 0x7fbda4145270 2024-04-25T09:07:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbda3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda40b1c90 0x7fbda413cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbda3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda40b1c90 0x7fbda413cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56414/0 (socket says 172.21.15.59:56414) 2024-04-25T09:07:29.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbda3400640 1 -- 172.21.15.59:0/93755646 learned_addr learned my addr 172.21.15.59:0/93755646 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbda3e00640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbda415fe50 0x7fbda415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbda2a00640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda4145270 0x7fbda413ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbda3400640 1 -- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda4145270 msgr2=0x7fbda413ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbda3400640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda4145270 0x7fbda413ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbda3400640 1 -- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbda415fe50 msgr2=0x7fbda415ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbda3400640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbda415fe50 0x7fbda415ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbda3400640 1 -- 172.21.15.59:0/93755646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda415bfc0 con 0x7fbda40b1c90 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbda3e00640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbda415fe50 0x7fbda415ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbda3400640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda40b1c90 0x7fbda413cb40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c500 tx=0x7fbd9400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbd9b400640 1 -- 172.21.15.59:0/93755646 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94017070 con 0x7fbda40b1c90 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbd9b400640 1 -- 172.21.15.59:0/93755646 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd94003600 con 0x7fbda40b1c90 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbdaa000640 1 -- 172.21.15.59:0/93755646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda413f4d0 con 0x7fbda40b1c90 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbd9b400640 1 -- 172.21.15.59:0/93755646 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd940039f0 con 0x7fbda40b1c90 2024-04-25T09:07:29.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbdaa000640 1 -- 172.21.15.59:0/93755646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda413fa90 con 0x7fbda40b1c90 2024-04-25T09:07:29.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.864+0000 7fbdaa000640 1 -- 172.21.15.59:0/93755646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda40745d0 con 0x7fbda40b1c90 2024-04-25T09:07:29.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.868+0000 7fbd9b400640 1 -- 172.21.15.59:0/93755646 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbd9401a070 con 0x7fbda40b1c90 2024-04-25T09:07:29.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.868+0000 7fbd9b400640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbd84066f60 0x7fbd84069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.868+0000 7fbd9b400640 1 -- 172.21.15.59:0/93755646 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fbd94084640 con 0x7fbda40b1c90 2024-04-25T09:07:29.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.868+0000 7fbda2a00640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbd84066f60 0x7fbd84069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:29.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.868+0000 7fbda2a00640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbd84066f60 0x7fbd84069420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbd900ad000 tx=0x7fbd90008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:29.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:29.872+0000 7fbd9b400640 1 -- 172.21.15.59:0/93755646 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbd94054e40 con 0x7fbda40b1c90 2024-04-25T09:07:30.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.072+0000 7fbdaa000640 1 -- 172.21.15.59:0/93755646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbda40b1a70 con 0x7fbda40b1c90 2024-04-25T09:07:30.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbd9b400640 1 -- 172.21.15.59:0/93755646 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbd94058ee0 con 0x7fbda40b1c90 2024-04-25T09:07:30.063 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:30.063 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:07:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbdaa000640 1 -- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbd84066f60 msgr2=0x7fbd84069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbdaa000640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbd84066f60 0x7fbd84069420 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbd900ad000 tx=0x7fbd90008040 comp rx=0 tx=0).stop 2024-04-25T09:07:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbdaa000640 1 -- 172.21.15.59:0/93755646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda40b1c90 msgr2=0x7fbda413cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbdaa000640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda40b1c90 0x7fbda413cb40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c500 tx=0x7fbd9400c9c0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbdaa000640 1 -- 172.21.15.59:0/93755646 shutdown_connections 2024-04-25T09:07:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbdaa000640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbd84066f60 0x7fbd84069420 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbdaa000640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbda415fe50 0x7fbda415ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbdaa000640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbda4145270 0x7fbda413ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbdaa000640 1 --2- 172.21.15.59:0/93755646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbda40b1c90 0x7fbda413cb40 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbdaa000640 1 -- 172.21.15.59:0/93755646 >> 172.21.15.59:0/93755646 conn(0x7fbda4066fa0 msgr2=0x7fbda4142d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbdaa000640 1 -- 172.21.15.59:0/93755646 shutdown_connections 2024-04-25T09:07:30.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.076+0000 7fbdaa000640 1 -- 172.21.15.59:0/93755646 wait complete. 2024-04-25T09:07:30.084 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:07:30.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:07:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.236+0000 7f6405200640 1 Processor -- start 2024-04-25T09:07:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.236+0000 7f6405200640 1 -- start start 2024-04-25T09:07:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.236+0000 7f6405200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6400144140 0x7f64000ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.236+0000 7f6405200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f640006ead0 0x7f64000b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.236+0000 7f6405200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640015ac60 con 0x7f64000ced60 2024-04-25T09:07:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.236+0000 7f6405200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64000cf3e0 con 0x7f6400144140 2024-04-25T09:07:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.236+0000 7f6405200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640015af20 con 0x7f640006ead0 2024-04-25T09:07:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.240+0000 7f63fde00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6400144140 0x7f64000ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.240+0000 7f63fe800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f640006ead0 0x7f64000b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.240+0000 7f63f5400640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f64000ced60 0x7f640006e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:48564/0 (socket says 172.21.15.59:48564) 2024-04-25T09:07:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.240+0000 7f63fde00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6400144140 0x7f64000ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:53864/0 (socket says 172.21.15.59:53864) 2024-04-25T09:07:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.240+0000 7f63f5400640 1 -- 172.21.15.59:0/4203061512 learned_addr learned my addr 172.21.15.59:0/4203061512 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.240+0000 7f63fd400640 1 -- 172.21.15.59:0/4203061512 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2851731705 0 0) 0x7f640015ac60 con 0x7f64000ced60 2024-04-25T09:07:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.240+0000 7f63fe800640 1 -- 172.21.15.59:0/4203061512 >> v2:172.21.15.178:3300/0 conn(0x7f6400144140 msgr2=0x7f64000ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.240+0000 7f63fe800640 1 --2- 172.21.15.59:0/4203061512 >> v2:172.21.15.178:3300/0 conn(0x7f6400144140 0x7f64000ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.240+0000 7f63fe800640 1 -- 172.21.15.59:0/4203061512 >> v1:172.21.15.178:6789/0 conn(0x7f64000ced60 legacy=0x7f640006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.240+0000 7f63fe800640 1 -- 172.21.15.59:0/4203061512 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640015b200 con 0x7f640006ead0 2024-04-25T09:07:30.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.240+0000 7f63fe800640 1 --2- 172.21.15.59:0/4203061512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f640006ead0 0x7f64000b0760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009d90 tx=0x7f63f801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e6bf7c60b02a0ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:30.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.240+0000 7f63fd400640 1 -- 172.21.15.59:0/4203061512 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f80aa610 con 0x7f640006ead0 2024-04-25T09:07:30.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f63fd400640 1 -- 172.21.15.59:0/4203061512 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f80af070 con 0x7f640006ead0 2024-04-25T09:07:30.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f63fd400640 1 -- 172.21.15.59:0/4203061512 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f80aa9d0 con 0x7f640006ead0 2024-04-25T09:07:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 -- 172.21.15.59:0/4203061512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f640006ead0 msgr2=0x7f64000b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 --2- 172.21.15.59:0/4203061512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f640006ead0 0x7f64000b0760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f63f8009d90 tx=0x7f63f801c970 comp rx=0 tx=0).stop 2024-04-25T09:07:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 -- 172.21.15.59:0/4203061512 shutdown_connections 2024-04-25T09:07:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 --2- 172.21.15.59:0/4203061512 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f640006ead0 0x7f64000b0760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 --2- 172.21.15.59:0/4203061512 >> v2:172.21.15.178:3300/0 conn(0x7f6400144140 0x7f64000ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 -- 172.21.15.59:0/4203061512 >> 172.21.15.59:0/4203061512 conn(0x7f6400066fa0 msgr2=0x7f640006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 -- 172.21.15.59:0/4203061512 shutdown_connections 2024-04-25T09:07:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 -- 172.21.15.59:0/4203061512 wait complete. 2024-04-25T09:07:30.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 Processor -- start 2024-04-25T09:07:30.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 -- start start 2024-04-25T09:07:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f640006ead0 0x7f6400143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64000ced60 0x7f6400152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6400144140 0x7f6400152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640015bb80 con 0x7f64000ced60 2024-04-25T09:07:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640015ba00 con 0x7f6400144140 2024-04-25T09:07:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f6405200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640006d2b0 con 0x7f640006ead0 2024-04-25T09:07:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f63f5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64000ced60 0x7f6400152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f63f5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64000ced60 0x7f6400152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:56416/0 (socket says 172.21.15.59:56416) 2024-04-25T09:07:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f63f5400640 1 -- 172.21.15.59:0/1486669154 learned_addr learned my addr 172.21.15.59:0/1486669154 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:30.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f63fe800640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6400144140 0x7f6400152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f63fde00640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f640006ead0 0x7f6400143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f63f5400640 1 -- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f640006ead0 msgr2=0x7f6400143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f63f5400640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f640006ead0 0x7f6400143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f63f5400640 1 -- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6400144140 msgr2=0x7f6400152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f63f5400640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6400144140 0x7f6400152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.244+0000 7f63f5400640 1 -- 172.21.15.59:0/1486669154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640013eaa0 con 0x7f64000ced60 2024-04-25T09:07:30.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.248+0000 7f63f5400640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64000ced60 0x7f6400152440 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f63e800c520 tx=0x7f63e800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.248+0000 7f63f6a00640 1 -- 172.21.15.59:0/1486669154 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e8018070 con 0x7f64000ced60 2024-04-25T09:07:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.248+0000 7f63f6a00640 1 -- 172.21.15.59:0/1486669154 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e80074e0 con 0x7f64000ced60 2024-04-25T09:07:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.248+0000 7f63f6a00640 1 -- 172.21.15.59:0/1486669154 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e80049f0 con 0x7f64000ced60 2024-04-25T09:07:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.248+0000 7f6405200640 1 -- 172.21.15.59:0/1486669154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6400151aa0 con 0x7f64000ced60 2024-04-25T09:07:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.248+0000 7f6405200640 1 -- 172.21.15.59:0/1486669154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6400152060 con 0x7f64000ced60 2024-04-25T09:07:30.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.248+0000 7f6405200640 1 -- 172.21.15.59:0/1486669154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64000745d0 con 0x7f64000ced60 2024-04-25T09:07:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.248+0000 7f63f6a00640 1 -- 172.21.15.59:0/1486669154 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f63e8004b90 con 0x7f64000ced60 2024-04-25T09:07:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.248+0000 7f63f6a00640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f63dc066f60 0x7f63dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.248+0000 7f63f6a00640 1 -- 172.21.15.59:0/1486669154 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f63e8084520 con 0x7f64000ced60 2024-04-25T09:07:30.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.248+0000 7f63fde00640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f63dc066f60 0x7f63dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:30.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.252+0000 7f63fde00640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f63dc066f60 0x7f63dc069420 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009ac0 tx=0x7f63f0009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:30.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.252+0000 7f63f6a00640 1 -- 172.21.15.59:0/1486669154 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f63e8054c60 con 0x7f64000ced60 2024-04-25T09:07:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.448+0000 7f6405200640 1 -- 172.21.15.59:0/1486669154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f64001650d0 con 0x7f64000ced60 2024-04-25T09:07:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.448+0000 7f63f6a00640 1 -- 172.21.15.59:0/1486669154 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7f63e8058d00 con 0x7f64000ced60 2024-04-25T09:07:30.437 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:07:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.448+0000 7f6405200640 1 -- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f63dc066f60 msgr2=0x7f63dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.448+0000 7f6405200640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f63dc066f60 0x7f63dc069420 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f63f0009ac0 tx=0x7f63f0009190 comp rx=0 tx=0).stop 2024-04-25T09:07:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.448+0000 7f6405200640 1 -- 172.21.15.59:0/1486669154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64000ced60 msgr2=0x7f6400152440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.448+0000 7f6405200640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64000ced60 0x7f6400152440 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f63e800c520 tx=0x7f63e800c9e0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.452+0000 7f6405200640 1 -- 172.21.15.59:0/1486669154 shutdown_connections 2024-04-25T09:07:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.452+0000 7f6405200640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f63dc066f60 0x7f63dc069420 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.452+0000 7f6405200640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6400144140 0x7f6400152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.452+0000 7f6405200640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f64000ced60 0x7f6400152440 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.452+0000 7f6405200640 1 --2- 172.21.15.59:0/1486669154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f640006ead0 0x7f6400143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.452+0000 7f6405200640 1 -- 172.21.15.59:0/1486669154 >> 172.21.15.59:0/1486669154 conn(0x7f6400066fa0 msgr2=0x7f64000b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.452+0000 7f6405200640 1 -- 172.21.15.59:0/1486669154 shutdown_connections 2024-04-25T09:07:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:30.452+0000 7f6405200640 1 -- 172.21.15.59:0/1486669154 wait complete. 2024-04-25T09:07:30.458 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:07:30.459 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:07:30.459 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:07:30.459 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:07:30.459 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:30.459 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:07:30.459 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:07:30.459 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:07:30.459 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:07:30.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:30.459 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:07:30.468 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:07:30.468 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:07:30.468 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:07:30.468 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:30.468 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42117sec preferred_lft 42117sec 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:30.469 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:07:30.470 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:30.471 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:07:30.471 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:07:30.471 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:07:30.471 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:30.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:30.472 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:07:30.532 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:07:30.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:30.535 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:07:30.588 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:07:30.588 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:07:30.588 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:07:30.588 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:07:30.588 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:07:30.588 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:07:30.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:30.589 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:07:30.589 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:07:30.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:07:30.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:07:30.589 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:07:30.589 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:07:30.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:30.681 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:07:30.690 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:07:30.690 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:07:30.690 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:07:30.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:30.690 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:07:30.750 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:07:30.750 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:30.799 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:07:30.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:07:30.799 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:30.850 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:07:30.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:30.850 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:30.939 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:07:30.940 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:07:30.955 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:30.955 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:07:30.956 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:07:30.956 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:07:30.956 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:07:30.964 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:30.964 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:07:30.965 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:07:30.965 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:07:30.965 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:07:30.965 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:07:30.965 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:07:30.965 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:07:30.968 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:07:30.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:30.969 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:30.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:30.988 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:07:31.045 INFO:teuthology.orchestra.run.smithi059.stdout:client6230 2024-04-25T09:07:31.045 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:07:31.046 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:31.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:31.095 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-25T09:07:31.148 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:07:31.148 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-25T09:07:31.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.248+0000 7f304b38c080 1 Processor -- start 2024-04-25T09:07:31.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.248+0000 7f304b38c080 1 -- start start 2024-04-25T09:07:31.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922a32b770 0x55922a3e9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a3e3720 0x55922a3e2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55922a3e3f50 0x55922a36e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55922a3e4970 con 0x55922a3e3720 2024-04-25T09:07:31.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55922a2cf9f0 con 0x55922a32b770 2024-04-25T09:07:31.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55922a3e4c10 con 0x55922a3e3f50 2024-04-25T09:07:31.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f3047c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a3e3720 0x55922a3e2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f3047c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a3e3720 0x55922a3e2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46414/0 (socket says 172.21.15.59:46414) 2024-04-25T09:07:31.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f3047c00640 1 -- 172.21.15.59:0/354559266 learned_addr learned my addr 172.21.15.59:0/354559266 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:31.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f3047c00640 1 -- 172.21.15.59:0/354559266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55922a3e3f50 msgr2=0x55922a36e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f3047c00640 1 --2- 172.21.15.59:0/354559266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55922a3e3f50 0x55922a36e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f3047c00640 1 -- 172.21.15.59:0/354559266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922a32b770 msgr2=0x55922a3e9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f3047c00640 1 --2- 172.21.15.59:0/354559266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922a32b770 0x55922a3e9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f3047c00640 1 -- 172.21.15.59:0/354559266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55922a3e8990 con 0x55922a3e3720 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f3047c00640 1 --2- 172.21.15.59:0/354559266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a3e3720 0x55922a3e2be0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f303400b400 tx=0x7f303400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb4c53ee3319577 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f3046800640 1 -- 172.21.15.59:0/354559266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3034012020 con 0x55922a3e3720 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f3046800640 1 -- 172.21.15.59:0/354559266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303400d6b0 con 0x55922a3e3720 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f3046800640 1 -- 172.21.15.59:0/354559266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303400dac0 con 0x55922a3e3720 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 -- 172.21.15.59:0/354559266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a3e3720 msgr2=0x55922a3e2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 --2- 172.21.15.59:0/354559266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a3e3720 0x55922a3e2be0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f303400b400 tx=0x7f303400b8c0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 -- 172.21.15.59:0/354559266 shutdown_connections 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 --2- 172.21.15.59:0/354559266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55922a3e3f50 0x55922a36e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 --2- 172.21.15.59:0/354559266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a3e3720 0x55922a3e2be0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 --2- 172.21.15.59:0/354559266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922a32b770 0x55922a3e9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 -- 172.21.15.59:0/354559266 >> 172.21.15.59:0/354559266 conn(0x55922a3293b0 msgr2=0x55922a36f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:31.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 -- 172.21.15.59:0/354559266 shutdown_connections 2024-04-25T09:07:31.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 -- 172.21.15.59:0/354559266 wait complete. 2024-04-25T09:07:31.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 Processor -- start 2024-04-25T09:07:31.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 -- start start 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a32b770 0x55922a3e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922a3e3720 0x55922a3564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55922a3e3f50 0x55922a358d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55922a3e8450 con 0x55922a32b770 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55922a36ee30 con 0x55922a3e3720 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.252+0000 7f304b38c080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55922a3e86f0 con 0x55922a3e3f50 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3048600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a32b770 0x55922a3e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3048600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a32b770 0x55922a3e14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46430/0 (socket says 172.21.15.59:46430) 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3048600640 1 -- 172.21.15.59:0/1433572411 learned_addr learned my addr 172.21.15.59:0/1433572411 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3049000640 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55922a3e3f50 0x55922a358d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3047c00640 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922a3e3720 0x55922a3564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3048600640 1 -- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55922a3e3f50 msgr2=0x55922a358d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3048600640 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55922a3e3f50 0x55922a358d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3048600640 1 -- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922a3e3720 msgr2=0x55922a3564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3048600640 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922a3e3720 0x55922a3564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3048600640 1 -- 172.21.15.59:0/1433572411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55922a356be0 con 0x55922a32b770 2024-04-25T09:07:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3049000640 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55922a3e3f50 0x55922a358d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3047c00640 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55922a3e3720 0x55922a3564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3048600640 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a32b770 0x55922a3e14c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f303801ba50 tx=0x7f30380ab7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3045400640 1 -- 172.21.15.59:0/1433572411 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30380ba020 con 0x55922a32b770 2024-04-25T09:07:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3045400640 1 -- 172.21.15.59:0/1433572411 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30380abbe0 con 0x55922a32b770 2024-04-25T09:07:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f304b38c080 1 -- 172.21.15.59:0/1433572411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55922a356e80 con 0x55922a32b770 2024-04-25T09:07:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3045400640 1 -- 172.21.15.59:0/1433572411 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30380af040 con 0x55922a32b770 2024-04-25T09:07:31.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f304b38c080 1 -- 172.21.15.59:0/1433572411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55922a3573c0 con 0x55922a32b770 2024-04-25T09:07:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3045400640 1 -- 172.21.15.59:0/1433572411 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f30380bd020 con 0x55922a32b770 2024-04-25T09:07:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3045400640 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3028065970 0x7f3028067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.256+0000 7f3045400640 1 -- 172.21.15.59:0/1433572411 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f303811ef90 con 0x55922a32b770 2024-04-25T09:07:31.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f304b38c080 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55922a359240 0x55922a499800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f304b38c080 1 -- 172.21.15.59:0/1433572411 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:1 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e81) v9 -- 0x55922a499d40 con 0x55922a359240 2024-04-25T09:07:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f3047c00640 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3028065970 0x7f3028067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f3049000640 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55922a359240 0x55922a499800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f3049000640 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55922a359240 0x55922a499800 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:31.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f3047c00640 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3028065970 0x7f3028067e30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3034001ee0 tx=0x7f303400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f3049000640 1 -- 172.21.15.59:0/1433572411 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v81'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f304000aaf0 con 0x55922a359240 2024-04-25T09:07:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f304b38c080 1 -- 172.21.15.59:0/1433572411 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55922a359240 msgr2=0x55922a499800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f304b38c080 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55922a359240 0x55922a499800 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f304b38c080 1 -- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3028065970 msgr2=0x7f3028067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f304b38c080 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3028065970 0x7f3028067e30 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3034001ee0 tx=0x7f303400f000 comp rx=0 tx=0).stop 2024-04-25T09:07:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f304b38c080 1 -- 172.21.15.59:0/1433572411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a32b770 msgr2=0x55922a3e14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f304b38c080 1 --2- 172.21.15.59:0/1433572411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55922a32b770 0x55922a3e14c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f303801ba50 tx=0x7f30380ab7f0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f3049000640 1 -- 172.21.15.59:0/1433572411 reap_dead start 2024-04-25T09:07:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f304b38c080 1 -- 172.21.15.59:0/1433572411 shutdown_connections 2024-04-25T09:07:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f304b38c080 1 -- 172.21.15.59:0/1433572411 >> 172.21.15.59:0/1433572411 conn(0x55922a3293b0 msgr2=0x55922a3e1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f304b38c080 1 -- 172.21.15.59:0/1433572411 shutdown_connections 2024-04-25T09:07:31.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.260+0000 7f304b38c080 1 -- 172.21.15.59:0/1433572411 wait complete. 2024-04-25T09:07:31.255 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:07:31.255 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:07:31.385 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:07:31.445 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:07:31.445 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:07:31.445 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:31.454 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:07:31.454 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:31.507 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.704+0000 7f15d8c00640 1 Processor -- start 2024-04-25T09:07:31.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.704+0000 7f15d8c00640 1 -- start start 2024-04-25T09:07:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d8c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15d415da00 0x7f15d406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d8c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f15d4070030 0x7f15d406e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d8c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d406b660 con 0x7f15d406b150 2024-04-25T09:07:31.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d8c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d415e350 con 0x7f15d4070030 2024-04-25T09:07:31.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d8c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d415e630 con 0x7f15d415da00 2024-04-25T09:07:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d3400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15d415da00 0x7f15d406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d3e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f15d4070030 0x7f15d406e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15cbe00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f15d406b150 0x7f15d406f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:37506/0 (socket says 172.21.15.59:37506) 2024-04-25T09:07:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d3400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15d415da00 0x7f15d406ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:44102/0 (socket says 172.21.15.59:44102) 2024-04-25T09:07:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15cbe00640 1 -- 172.21.15.59:0/2928589117 learned_addr learned my addr 172.21.15.59:0/2928589117 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d3e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f15d4070030 0x7f15d406e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:38782/0 (socket says 172.21.15.59:38782) 2024-04-25T09:07:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d2a00640 1 -- 172.21.15.59:0/2928589117 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305634236 0 0) 0x7f15d406b660 con 0x7f15d406b150 2024-04-25T09:07:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d2a00640 1 -- 172.21.15.59:0/2928589117 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15b8003530 con 0x7f15d406b150 2024-04-25T09:07:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d3e00640 1 -- 172.21.15.59:0/2928589117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15d415da00 msgr2=0x7f15d406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d3e00640 1 --2- 172.21.15.59:0/2928589117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15d415da00 0x7f15d406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d3e00640 1 -- 172.21.15.59:0/2928589117 >> v1:172.21.15.178:6789/0 conn(0x7f15d406b150 legacy=0x7f15d406f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d3e00640 1 -- 172.21.15.59:0/2928589117 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d415e910 con 0x7f15d4070030 2024-04-25T09:07:31.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.708+0000 7f15d3400640 1 --2- 172.21.15.59:0/2928589117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15d415da00 0x7f15d406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:31.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d3e00640 1 --2- 172.21.15.59:0/2928589117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15d4070030 0x7f15d406e280 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009d90 tx=0x7f15cc01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c347f6784613630 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d2a00640 1 -- 172.21.15.59:0/2928589117 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0ad070 con 0x7f15d4070030 2024-04-25T09:07:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d2a00640 1 -- 172.21.15.59:0/2928589117 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc0a9680 con 0x7f15d4070030 2024-04-25T09:07:31.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d2a00640 1 -- 172.21.15.59:0/2928589117 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0a9a50 con 0x7f15d4070030 2024-04-25T09:07:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d8c00640 1 -- 172.21.15.59:0/2928589117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15d4070030 msgr2=0x7f15d406e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d8c00640 1 --2- 172.21.15.59:0/2928589117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15d4070030 0x7f15d406e280 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009d90 tx=0x7f15cc01c970 comp rx=0 tx=0).stop 2024-04-25T09:07:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d8c00640 1 -- 172.21.15.59:0/2928589117 shutdown_connections 2024-04-25T09:07:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d8c00640 1 --2- 172.21.15.59:0/2928589117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15d4070030 0x7f15d406e280 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d8c00640 1 --2- 172.21.15.59:0/2928589117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15d415da00 0x7f15d406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d8c00640 1 -- 172.21.15.59:0/2928589117 >> 172.21.15.59:0/2928589117 conn(0x7f15d4099a60 msgr2=0x7f15d40b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d8c00640 1 -- 172.21.15.59:0/2928589117 shutdown_connections 2024-04-25T09:07:31.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d8c00640 1 -- 172.21.15.59:0/2928589117 wait complete. 2024-04-25T09:07:31.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d8c00640 1 Processor -- start 2024-04-25T09:07:31.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.712+0000 7f15d8c00640 1 -- start start 2024-04-25T09:07:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d8c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15d406b150 0x7f15d4155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d8c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15d4070030 0x7f15d415a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15d415da00 0x7f15d40b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d8c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d416aba0 con 0x7f15d415da00 2024-04-25T09:07:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d8c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d416aa20 con 0x7f15d4070030 2024-04-25T09:07:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d8c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d416ad20 con 0x7f15d406b150 2024-04-25T09:07:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15d415da00 0x7f15d40b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d3400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15d406b150 0x7f15d4155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15d415da00 0x7f15d40b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46444/0 (socket says 172.21.15.59:46444) 2024-04-25T09:07:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d3e00640 1 -- 172.21.15.59:0/34347534 learned_addr learned my addr 172.21.15.59:0/34347534 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:31.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15cbe00640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15d4070030 0x7f15d415a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d3e00640 1 -- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15d406b150 msgr2=0x7f15d4155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d3e00640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15d406b150 0x7f15d4155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d3e00640 1 -- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15d4070030 msgr2=0x7f15d415a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d3e00640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15d4070030 0x7f15d415a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d3e00640 1 -- 172.21.15.59:0/34347534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d41571e0 con 0x7f15d415da00 2024-04-25T09:07:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d3e00640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15d415da00 0x7f15d40b4090 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f15cc01b020 tx=0x7f15cc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15cb400640 1 -- 172.21.15.59:0/34347534 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc0ad040 con 0x7f15d415da00 2024-04-25T09:07:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15cb400640 1 -- 172.21.15.59:0/34347534 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15cc0b2660 con 0x7f15d415da00 2024-04-25T09:07:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d8c00640 1 -- 172.21.15.59:0/34347534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d415ade0 con 0x7f15d415da00 2024-04-25T09:07:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15cb400640 1 -- 172.21.15.59:0/34347534 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc009450 con 0x7f15d415da00 2024-04-25T09:07:31.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d8c00640 1 -- 172.21.15.59:0/34347534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d41560d0 con 0x7f15d415da00 2024-04-25T09:07:31.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15d8c00640 1 -- 172.21.15.59:0/34347534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d404efa0 con 0x7f15d415da00 2024-04-25T09:07:31.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.716+0000 7f15cb400640 1 -- 172.21.15.59:0/34347534 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f15cc0b0070 con 0x7f15d415da00 2024-04-25T09:07:31.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.720+0000 7f15cb400640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f15b0066f60 0x7f15b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:31.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.720+0000 7f15cb400640 1 -- 172.21.15.59:0/34347534 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f15cc120030 con 0x7f15d415da00 2024-04-25T09:07:31.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.720+0000 7f15d3400640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f15b0066f60 0x7f15b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:31.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.720+0000 7f15d3400640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f15b0066f60 0x7f15b0069420 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009580 tx=0x7f15c4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:31.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.724+0000 7f15cb400640 1 -- 172.21.15.59:0/34347534 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f15cc016560 con 0x7f15d415da00 2024-04-25T09:07:31.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.888+0000 7f15d8c00640 1 -- 172.21.15.59:0/34347534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15d40af910 con 0x7f15d415da00 2024-04-25T09:07:31.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15cb400640 1 -- 172.21.15.59:0/34347534 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f15cc0f0770 con 0x7f15d415da00 2024-04-25T09:07:31.879 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:31.880 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":81,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:06:18.012348+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:04.967523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:06.198067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6834/1468235926":"2024-04-26T09:06:18.012326+0000","172.21.15.59:6832/1468235926":"2024-04-26T09:06:18.012326+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:31.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15d8c00640 1 -- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f15b0066f60 msgr2=0x7f15b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15d8c00640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f15b0066f60 0x7f15b0069420 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009580 tx=0x7f15c4009190 comp rx=0 tx=0).stop 2024-04-25T09:07:31.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15d8c00640 1 -- 172.21.15.59:0/34347534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15d415da00 msgr2=0x7f15d40b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:31.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15d8c00640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15d415da00 0x7f15d40b4090 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f15cc01b020 tx=0x7f15cc019710 comp rx=0 tx=0).stop 2024-04-25T09:07:31.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15d8c00640 1 -- 172.21.15.59:0/34347534 shutdown_connections 2024-04-25T09:07:31.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15d8c00640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f15b0066f60 0x7f15b0069420 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15d8c00640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15d415da00 0x7f15d40b4090 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15d8c00640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f15d4070030 0x7f15d415a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15d8c00640 1 --2- 172.21.15.59:0/34347534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f15d406b150 0x7f15d4155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:31.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15d8c00640 1 -- 172.21.15.59:0/34347534 >> 172.21.15.59:0/34347534 conn(0x7f15d4099a60 msgr2=0x7f15d40b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:31.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15d8c00640 1 -- 172.21.15.59:0/34347534 shutdown_connections 2024-04-25T09:07:31.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:31.892+0000 7f15d8c00640 1 -- 172.21.15.59:0/34347534 wait complete. 2024-04-25T09:07:31.900 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:06:04.967523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:06:06.198067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:07:31.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:07:32.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.056+0000 7f0cd6a00640 1 Processor -- start 2024-04-25T09:07:32.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.056+0000 7f0cd6a00640 1 -- start start 2024-04-25T09:07:32.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.056+0000 7f0cd6a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0cd0144120 0x7f0cd015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.056+0000 7f0cd6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cd00ccbf0 0x7f0cd015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.056+0000 7f0cd6a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cd015bc40 con 0x7f0cd015ee60 2024-04-25T09:07:32.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.056+0000 7f0cd6a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd015e490 con 0x7f0cd00ccbf0 2024-04-25T09:07:32.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.056+0000 7f0cd6a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cd015b3a0 con 0x7f0cd0144120 2024-04-25T09:07:32.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.056+0000 7f0cc7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cd00ccbf0 0x7f0cd015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.056+0000 7f0cc7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cd00ccbf0 0x7f0cd015e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46448/0 (socket says 172.21.15.59:46448) 2024-04-25T09:07:32.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.056+0000 7f0cc7e00640 1 -- 172.21.15.59:0/1646706326 learned_addr learned my addr 172.21.15.59:0/1646706326 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:32.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0ccfe00640 1 --2- 172.21.15.59:0/1646706326 >> v2:172.21.15.178:3300/0 conn(0x7f0cd0144120 0x7f0cd015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0cc7e00640 1 -- 172.21.15.59:0/1646706326 >> v2:172.21.15.178:3300/0 conn(0x7f0cd0144120 msgr2=0x7f0cd015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:32.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0cc7e00640 1 --2- 172.21.15.59:0/1646706326 >> v2:172.21.15.178:3300/0 conn(0x7f0cd0144120 0x7f0cd015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0cc7e00640 1 -- 172.21.15.59:0/1646706326 >> v1:172.21.15.59:6789/0 conn(0x7f0cd015ee60 legacy=0x7f0cd00b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0cc7e00640 1 -- 172.21.15.59:0/1646706326 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd015b680 con 0x7f0cd00ccbf0 2024-04-25T09:07:32.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0cc7e00640 1 --2- 172.21.15.59:0/1646706326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00ccbf0 0x7f0cd015e920 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f0cd006b9b0 tx=0x7f0cb801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bf62a7c2d14535 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0ccf400640 1 -- 172.21.15.59:0/1646706326 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80b1070 con 0x7f0cd00ccbf0 2024-04-25T09:07:32.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0ccf400640 1 -- 172.21.15.59:0/1646706326 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb80ac600 con 0x7f0cd00ccbf0 2024-04-25T09:07:32.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0ccf400640 1 -- 172.21.15.59:0/1646706326 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80ac9d0 con 0x7f0cd00ccbf0 2024-04-25T09:07:32.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1646706326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00ccbf0 msgr2=0x7f0cd015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0cd6a00640 1 --2- 172.21.15.59:0/1646706326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00ccbf0 0x7f0cd015e920 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f0cd006b9b0 tx=0x7f0cb801c490 comp rx=0 tx=0).stop 2024-04-25T09:07:32.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1646706326 shutdown_connections 2024-04-25T09:07:32.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0cd6a00640 1 --2- 172.21.15.59:0/1646706326 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd00ccbf0 0x7f0cd015e920 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0cd6a00640 1 --2- 172.21.15.59:0/1646706326 >> v2:172.21.15.178:3300/0 conn(0x7f0cd0144120 0x7f0cd015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.060+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1646706326 >> 172.21.15.59:0/1646706326 conn(0x7f0cd0067080 msgr2=0x7f0cd006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:32.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1646706326 shutdown_connections 2024-04-25T09:07:32.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1646706326 wait complete. 2024-04-25T09:07:32.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cd6a00640 1 Processor -- start 2024-04-25T09:07:32.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cd6a00640 1 -- start start 2024-04-25T09:07:32.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cd6a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd00ccbf0 0x7f0cd013b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cd6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0144120 0x7f0cd01f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cd6a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd015ee60 0x7f0cd01f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cd6a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0165dc0 con 0x7f0cd0144120 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cd6a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0165c40 con 0x7f0cd015ee60 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cd6a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd0165f40 con 0x7f0cd00ccbf0 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cc7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0144120 0x7f0cd01f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cc7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0144120 0x7f0cd01f64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46458/0 (socket says 172.21.15.59:46458) 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cc7e00640 1 -- 172.21.15.59:0/1087955551 learned_addr learned my addr 172.21.15.59:0/1087955551 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0ccfe00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd00ccbf0 0x7f0cd013b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cd4a00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd015ee60 0x7f0cd01f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cc7e00640 1 -- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd00ccbf0 msgr2=0x7f0cd013b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cc7e00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd00ccbf0 0x7f0cd013b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cc7e00640 1 -- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd015ee60 msgr2=0x7f0cd01f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cc7e00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd015ee60 0x7f0cd01f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cc7e00640 1 -- 172.21.15.59:0/1087955551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd0143980 con 0x7f0cd0144120 2024-04-25T09:07:32.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.064+0000 7f0cc7e00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0144120 0x7f0cd01f64e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80190a0 tx=0x7f0cb801acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.068+0000 7f0cccc00640 1 -- 172.21.15.59:0/1087955551 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80bb020 con 0x7f0cd0144120 2024-04-25T09:07:32.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.068+0000 7f0cccc00640 1 -- 172.21.15.59:0/1087955551 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb80b7620 con 0x7f0cd0144120 2024-04-25T09:07:32.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.068+0000 7f0cccc00640 1 -- 172.21.15.59:0/1087955551 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80b1040 con 0x7f0cd0144120 2024-04-25T09:07:32.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.068+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1087955551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd00afc50 con 0x7f0cd0144120 2024-04-25T09:07:32.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.068+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1087955551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd01436a0 con 0x7f0cd0144120 2024-04-25T09:07:32.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.068+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1087955551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd00745d0 con 0x7f0cd0144120 2024-04-25T09:07:32.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.068+0000 7f0cccc00640 1 -- 172.21.15.59:0/1087955551 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0cb80be020 con 0x7f0cd0144120 2024-04-25T09:07:32.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.068+0000 7f0cccc00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0cac066f90 0x7f0cac069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.068+0000 7f0cccc00640 1 -- 172.21.15.59:0/1087955551 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0cb811f0e0 con 0x7f0cd0144120 2024-04-25T09:07:32.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.068+0000 7f0ccfe00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0cac066f90 0x7f0cac069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.068+0000 7f0ccfe00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0cac066f90 0x7f0cac069450 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000b9b0 tx=0x7f0cc0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.072+0000 7f0cccc00640 1 -- 172.21.15.59:0/1087955551 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0cb80c5070 con 0x7f0cd0144120 2024-04-25T09:07:32.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1087955551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0cd015ea10 con 0x7f0cd0144120 2024-04-25T09:07:32.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cccc00640 1 -- 172.21.15.59:0/1087955551 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0cb8016110 con 0x7f0cd0144120 2024-04-25T09:07:32.228 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:07:32.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0cac066f90 msgr2=0x7f0cac069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0cac066f90 0x7f0cac069450 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0cc000b9b0 tx=0x7f0cc0008040 comp rx=0 tx=0).stop 2024-04-25T09:07:32.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1087955551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0144120 msgr2=0x7f0cd01f64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0144120 0x7f0cd01f64e0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f0cb80190a0 tx=0x7f0cb801acd0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1087955551 shutdown_connections 2024-04-25T09:07:32.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0cac066f90 0x7f0cac069450 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0cd015ee60 0x7f0cd01f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cd0144120 0x7f0cd01f64e0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 --2- 172.21.15.59:0/1087955551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0cd00ccbf0 0x7f0cd013b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1087955551 >> 172.21.15.59:0/1087955551 conn(0x7f0cd0067080 msgr2=0x7f0cd00b4570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:32.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1087955551 shutdown_connections 2024-04-25T09:07:32.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.240+0000 7f0cd6a00640 1 -- 172.21.15.59:0/1087955551 wait complete. 2024-04-25T09:07:32.248 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:07:32.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c46c00640 1 Processor -- start 2024-04-25T09:07:32.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c46c00640 1 -- start start 2024-04-25T09:07:32.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c46c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c40157610 0x7f4c400b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c46c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c4015aa10 0x7f4c400cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c46c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c400b2c20 con 0x7f4c40071270 2024-04-25T09:07:32.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c46c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c400b3a40 con 0x7f4c4015aa10 2024-04-25T09:07:32.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c46c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c401579f0 con 0x7f4c40157610 2024-04-25T09:07:32.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c37400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c4015aa10 0x7f4c400cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c37400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c4015aa10 0x7f4c400cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46470/0 (socket says 172.21.15.59:46470) 2024-04-25T09:07:32.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c37400640 1 -- 172.21.15.59:0/306720653 learned_addr learned my addr 172.21.15.59:0/306720653 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:32.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c3fe00640 1 --2- 172.21.15.59:0/306720653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c40157610 0x7f4c400b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c37400640 1 -- 172.21.15.59:0/306720653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c40157610 msgr2=0x7f4c400b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:32.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c37400640 1 --2- 172.21.15.59:0/306720653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c40157610 0x7f4c400b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c37400640 1 -- 172.21.15.59:0/306720653 >> v1:172.21.15.178:6789/0 conn(0x7f4c40071270 legacy=0x7f4c400b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.404+0000 7f4c37400640 1 -- 172.21.15.59:0/306720653 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c400b2f00 con 0x7f4c4015aa10 2024-04-25T09:07:32.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c37400640 1 --2- 172.21.15.59:0/306720653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4015aa10 0x7f4c400cd900 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800aa40 tx=0x7f4c2801d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42faca59b20de49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c3f400640 1 -- 172.21.15.59:0/306720653 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c280b3070 con 0x7f4c4015aa10 2024-04-25T09:07:32.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c3f400640 1 -- 172.21.15.59:0/306720653 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c280a6900 con 0x7f4c4015aa10 2024-04-25T09:07:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c3f400640 1 -- 172.21.15.59:0/306720653 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2800b040 con 0x7f4c4015aa10 2024-04-25T09:07:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c46c00640 1 -- 172.21.15.59:0/306720653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4015aa10 msgr2=0x7f4c400cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c46c00640 1 --2- 172.21.15.59:0/306720653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4015aa10 0x7f4c400cd900 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800aa40 tx=0x7f4c2801d850 comp rx=0 tx=0).stop 2024-04-25T09:07:32.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c46c00640 1 -- 172.21.15.59:0/306720653 shutdown_connections 2024-04-25T09:07:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c46c00640 1 --2- 172.21.15.59:0/306720653 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4015aa10 0x7f4c400cd900 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c46c00640 1 --2- 172.21.15.59:0/306720653 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c40157610 0x7f4c400b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c46c00640 1 -- 172.21.15.59:0/306720653 >> 172.21.15.59:0/306720653 conn(0x7f4c40067080 msgr2=0x7f4c4006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c46c00640 1 -- 172.21.15.59:0/306720653 shutdown_connections 2024-04-25T09:07:32.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c46c00640 1 -- 172.21.15.59:0/306720653 wait complete. 2024-04-25T09:07:32.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c46c00640 1 Processor -- start 2024-04-25T09:07:32.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.408+0000 7f4c46c00640 1 -- start start 2024-04-25T09:07:32.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c46c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c40071270 0x7f4c40150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c46c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c40157610 0x7f4c401f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c46c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4015aa10 0x7f4c40139e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c46c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c40071a90 con 0x7f4c40157610 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c46c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4015ae90 con 0x7f4c4015aa10 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c46c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c40151ab0 con 0x7f4c40071270 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c37400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c40157610 0x7f4c401f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c37400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c40157610 0x7f4c401f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46484/0 (socket says 172.21.15.59:46484) 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c37400640 1 -- 172.21.15.59:0/120064480 learned_addr learned my addr 172.21.15.59:0/120064480 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c3fe00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c40071270 0x7f4c40150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c37400640 1 -- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c40071270 msgr2=0x7f4c40150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c37400640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c40071270 0x7f4c40150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c44c00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4015aa10 0x7f4c40139e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c37400640 1 -- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4015aa10 msgr2=0x7f4c40139e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c37400640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4015aa10 0x7f4c40139e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c37400640 1 -- 172.21.15.59:0/120064480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c40150ea0 con 0x7f4c40157610 2024-04-25T09:07:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c3fe00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c40071270 0x7f4c40150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c44c00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4015aa10 0x7f4c40139e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c37400640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c40157610 0x7f4c401f5000 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f4c2801b480 tx=0x7f4c2801c090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c3cc00640 1 -- 172.21.15.59:0/120064480 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c280be070 con 0x7f4c40157610 2024-04-25T09:07:32.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c3cc00640 1 -- 172.21.15.59:0/120064480 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c280b5050 con 0x7f4c40157610 2024-04-25T09:07:32.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c3cc00640 1 -- 172.21.15.59:0/120064480 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c280b3030 con 0x7f4c40157610 2024-04-25T09:07:32.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c46c00640 1 -- 172.21.15.59:0/120064480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c40151180 con 0x7f4c40157610 2024-04-25T09:07:32.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c46c00640 1 -- 172.21.15.59:0/120064480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c40151740 con 0x7f4c40157610 2024-04-25T09:07:32.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.412+0000 7f4c46c00640 1 -- 172.21.15.59:0/120064480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c400745d0 con 0x7f4c40157610 2024-04-25T09:07:32.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.416+0000 7f4c3cc00640 1 -- 172.21.15.59:0/120064480 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4c280ae930 con 0x7f4c40157610 2024-04-25T09:07:32.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.416+0000 7f4c3cc00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4c1c066f60 0x7f4c1c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.416+0000 7f4c3cc00640 1 -- 172.21.15.59:0/120064480 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4c2811ec20 con 0x7f4c40157610 2024-04-25T09:07:32.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.416+0000 7f4c3fe00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4c1c066f60 0x7f4c1c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.416+0000 7f4c3fe00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4c1c066f60 0x7f4c1c069420 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4c30007330 tx=0x7f4c3000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.420+0000 7f4c3cc00640 1 -- 172.21.15.59:0/120064480 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4c28017500 con 0x7f4c40157610 2024-04-25T09:07:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.580+0000 7f4c46c00640 1 -- 172.21.15.59:0/120064480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c40071c10 con 0x7f4c40157610 2024-04-25T09:07:32.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.580+0000 7f4c3cc00640 1 -- 172.21.15.59:0/120064480 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c40071c10 con 0x7f4c40157610 2024-04-25T09:07:32.570 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:07:32.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.584+0000 7f4c46c00640 1 -- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4c1c066f60 msgr2=0x7f4c1c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.584+0000 7f4c46c00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4c1c066f60 0x7f4c1c069420 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f4c30007330 tx=0x7f4c3000b040 comp rx=0 tx=0).stop 2024-04-25T09:07:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.584+0000 7f4c46c00640 1 -- 172.21.15.59:0/120064480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c40157610 msgr2=0x7f4c401f5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.584+0000 7f4c46c00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c40157610 0x7f4c401f5000 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f4c2801b480 tx=0x7f4c2801c090 comp rx=0 tx=0).stop 2024-04-25T09:07:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.584+0000 7f4c46c00640 1 -- 172.21.15.59:0/120064480 shutdown_connections 2024-04-25T09:07:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.584+0000 7f4c46c00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4c1c066f60 0x7f4c1c069420 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.584+0000 7f4c46c00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4015aa10 0x7f4c40139e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.584+0000 7f4c46c00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c40157610 0x7f4c401f5000 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.584+0000 7f4c46c00640 1 --2- 172.21.15.59:0/120064480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c40071270 0x7f4c40150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.584+0000 7f4c46c00640 1 -- 172.21.15.59:0/120064480 >> 172.21.15.59:0/120064480 conn(0x7f4c40067080 msgr2=0x7f4c400b0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.584+0000 7f4c46c00640 1 -- 172.21.15.59:0/120064480 shutdown_connections 2024-04-25T09:07:32.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.584+0000 7f4c46c00640 1 -- 172.21.15.59:0/120064480 wait complete. 2024-04-25T09:07:32.591 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:07:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55c0800640 1 Processor -- start 2024-04-25T09:07:32.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55c0800640 1 -- start start 2024-04-25T09:07:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55c0800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55b8144120 0x7f55b815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55c0800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55b80ccbf0 0x7f55b815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55c0800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b815ee60 0x7f55b80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55c0800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b815e490 con 0x7f55b8144120 2024-04-25T09:07:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55c0800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b815bc40 con 0x7f55b80ccbf0 2024-04-25T09:07:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55c0800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b815b3a0 con 0x7f55b815ee60 2024-04-25T09:07:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55bde00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55b8144120 0x7f55b815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55bde00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55b8144120 0x7f55b815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46490/0 (socket says 172.21.15.59:46490) 2024-04-25T09:07:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55bde00640 1 -- 172.21.15.59:0/3591166438 learned_addr learned my addr 172.21.15.59:0/3591166438 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55bd400640 1 --2- 172.21.15.59:0/3591166438 >> v2:172.21.15.178:3300/0 conn(0x7f55b80ccbf0 0x7f55b815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55be800640 1 --2- 172.21.15.59:0/3591166438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b815ee60 0x7f55b80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55bde00640 1 -- 172.21.15.59:0/3591166438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b815ee60 msgr2=0x7f55b80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55bde00640 1 --2- 172.21.15.59:0/3591166438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b815ee60 0x7f55b80b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55bde00640 1 -- 172.21.15.59:0/3591166438 >> v2:172.21.15.178:3300/0 conn(0x7f55b80ccbf0 msgr2=0x7f55b815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55bde00640 1 --2- 172.21.15.59:0/3591166438 >> v2:172.21.15.178:3300/0 conn(0x7f55b80ccbf0 0x7f55b815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.748+0000 7f55bde00640 1 -- 172.21.15.59:0/3591166438 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b815b680 con 0x7f55b8144120 2024-04-25T09:07:32.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55bde00640 1 --2- 172.21.15.59:0/3591166438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b8144120 0x7f55b815acd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f55b806b870 tx=0x7f55ac01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64df4046666e15f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55bca00640 1 -- 172.21.15.59:0/3591166438 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0b2070 con 0x7f55b8144120 2024-04-25T09:07:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55bca00640 1 -- 172.21.15.59:0/3591166438 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac0a9070 con 0x7f55b8144120 2024-04-25T09:07:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55bca00640 1 -- 172.21.15.59:0/3591166438 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0ad880 con 0x7f55b8144120 2024-04-25T09:07:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55c0800640 1 -- 172.21.15.59:0/3591166438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b8144120 msgr2=0x7f55b815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55c0800640 1 --2- 172.21.15.59:0/3591166438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b8144120 0x7f55b815acd0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f55b806b870 tx=0x7f55ac01c490 comp rx=0 tx=0).stop 2024-04-25T09:07:32.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55c0800640 1 -- 172.21.15.59:0/3591166438 shutdown_connections 2024-04-25T09:07:32.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55c0800640 1 --2- 172.21.15.59:0/3591166438 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b815ee60 0x7f55b80b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55c0800640 1 --2- 172.21.15.59:0/3591166438 >> v2:172.21.15.178:3300/0 conn(0x7f55b80ccbf0 0x7f55b815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55c0800640 1 --2- 172.21.15.59:0/3591166438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b8144120 0x7f55b815acd0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55c0800640 1 -- 172.21.15.59:0/3591166438 >> 172.21.15.59:0/3591166438 conn(0x7f55b8067080 msgr2=0x7f55b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:32.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55c0800640 1 -- 172.21.15.59:0/3591166438 shutdown_connections 2024-04-25T09:07:32.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55c0800640 1 -- 172.21.15.59:0/3591166438 wait complete. 2024-04-25T09:07:32.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.752+0000 7f55c0800640 1 Processor -- start 2024-04-25T09:07:32.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55c0800640 1 -- start start 2024-04-25T09:07:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55c0800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b80ccbf0 0x7f55b81633a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55c0800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b8144120 0x7f55b80b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55c0800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b815ee60 0x7f55b81615f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55c0800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b8071640 con 0x7f55b80ccbf0 2024-04-25T09:07:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55c0800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80714c0 con 0x7f55b8144120 2024-04-25T09:07:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55c0800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80717c0 con 0x7f55b815ee60 2024-04-25T09:07:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55bde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b80ccbf0 0x7f55b81633a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55bde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b80ccbf0 0x7f55b81633a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46504/0 (socket says 172.21.15.59:46504) 2024-04-25T09:07:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55bde00640 1 -- 172.21.15.59:0/2425198969 learned_addr learned my addr 172.21.15.59:0/2425198969 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55be800640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b815ee60 0x7f55b81615f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55bd400640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b8144120 0x7f55b80b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55bde00640 1 -- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b815ee60 msgr2=0x7f55b81615f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55bde00640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b815ee60 0x7f55b81615f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55bde00640 1 -- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b8144120 msgr2=0x7f55b80b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55bde00640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b8144120 0x7f55b80b1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55bde00640 1 -- 172.21.15.59:0/2425198969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b8162300 con 0x7f55b80ccbf0 2024-04-25T09:07:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55be800640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b815ee60 0x7f55b81615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:32.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55bde00640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b80ccbf0 0x7f55b81633a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f55ac01cd30 tx=0x7f55ac01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55b2000640 1 -- 172.21.15.59:0/2425198969 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0bc020 con 0x7f55b80ccbf0 2024-04-25T09:07:32.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55b2000640 1 -- 172.21.15.59:0/2425198969 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac0addb0 con 0x7f55b80ccbf0 2024-04-25T09:07:32.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55b2000640 1 -- 172.21.15.59:0/2425198969 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac0b2040 con 0x7f55b80ccbf0 2024-04-25T09:07:32.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55c0800640 1 -- 172.21.15.59:0/2425198969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b81625e0 con 0x7f55b80ccbf0 2024-04-25T09:07:32.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55c0800640 1 -- 172.21.15.59:0/2425198969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b8162ba0 con 0x7f55b80ccbf0 2024-04-25T09:07:32.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.756+0000 7f55c0800640 1 -- 172.21.15.59:0/2425198969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b80745d0 con 0x7f55b80ccbf0 2024-04-25T09:07:32.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.760+0000 7f55b2000640 1 -- 172.21.15.59:0/2425198969 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f55ac0bf020 con 0x7f55b80ccbf0 2024-04-25T09:07:32.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.760+0000 7f55b2000640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f559c066f60 0x7f559c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:32.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.760+0000 7f55b2000640 1 -- 172.21.15.59:0/2425198969 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f55ac11f330 con 0x7f55b80ccbf0 2024-04-25T09:07:32.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.760+0000 7f55bd400640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f559c066f60 0x7f559c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:32.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.760+0000 7f55bd400640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f559c066f60 0x7f559c069420 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f55b813d830 tx=0x7f55a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:32.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.764+0000 7f55b2000640 1 -- 172.21.15.59:0/2425198969 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f55ac0c6030 con 0x7f55b80ccbf0 2024-04-25T09:07:32.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.924+0000 7f55c0800640 1 -- 172.21.15.59:0/2425198969 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f55b815da00 con 0x7f55b80ccbf0 2024-04-25T09:07:32.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.924+0000 7f55b2000640 1 -- 172.21.15.59:0/2425198969 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f55ac016110 con 0x7f55b80ccbf0 2024-04-25T09:07:32.915 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:07:32.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.928+0000 7f55c0800640 1 -- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f559c066f60 msgr2=0x7f559c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.928+0000 7f55c0800640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f559c066f60 0x7f559c069420 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f55b813d830 tx=0x7f55a8008040 comp rx=0 tx=0).stop 2024-04-25T09:07:32.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.928+0000 7f55c0800640 1 -- 172.21.15.59:0/2425198969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b80ccbf0 msgr2=0x7f55b81633a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:32.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.928+0000 7f55c0800640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b80ccbf0 0x7f55b81633a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f55ac01cd30 tx=0x7f55ac01acd0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.928+0000 7f55c0800640 1 -- 172.21.15.59:0/2425198969 shutdown_connections 2024-04-25T09:07:32.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.928+0000 7f55c0800640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f559c066f60 0x7f559c069420 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.928+0000 7f55c0800640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55b815ee60 0x7f55b81615f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.928+0000 7f55c0800640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55b8144120 0x7f55b80b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.928+0000 7f55c0800640 1 --2- 172.21.15.59:0/2425198969 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55b80ccbf0 0x7f55b81633a0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:32.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.928+0000 7f55c0800640 1 -- 172.21.15.59:0/2425198969 >> 172.21.15.59:0/2425198969 conn(0x7f55b8067080 msgr2=0x7f55b806db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:32.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.928+0000 7f55c0800640 1 -- 172.21.15.59:0/2425198969 shutdown_connections 2024-04-25T09:07:32.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:32.928+0000 7f55c0800640 1 -- 172.21.15.59:0/2425198969 wait complete. 2024-04-25T09:07:32.936 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:07:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.088+0000 7fd52a600640 1 Processor -- start 2024-04-25T09:07:33.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.088+0000 7fd52a600640 1 -- start start 2024-04-25T09:07:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.088+0000 7fd52a600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52415acd0 0x7fd52415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.088+0000 7fd52a600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd52415ee60 0x7fd5240b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.088+0000 7fd52a600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52415bc40 con 0x7fd524144120 2024-04-25T09:07:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.088+0000 7fd52a600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52415e490 con 0x7fd52415ee60 2024-04-25T09:07:33.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.088+0000 7fd52a600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52415b150 con 0x7fd52415acd0 2024-04-25T09:07:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.092+0000 7fd523e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd52415ee60 0x7fd5240b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.092+0000 7fd51be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52415acd0 0x7fd52415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.092+0000 7fd523400640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fd524144120 0x7fd5240ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:37524/0 (socket says 172.21.15.59:37524) 2024-04-25T09:07:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.092+0000 7fd523400640 1 -- 172.21.15.59:0/298363328 learned_addr learned my addr 172.21.15.59:0/298363328 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.092+0000 7fd522a00640 1 -- 172.21.15.59:0/298363328 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973698699 0 0) 0x7fd52415bc40 con 0x7fd524144120 2024-04-25T09:07:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.092+0000 7fd522a00640 1 -- 172.21.15.59:0/298363328 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd508003530 con 0x7fd524144120 2024-04-25T09:07:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.092+0000 7fd523e00640 1 -- 172.21.15.59:0/298363328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52415acd0 msgr2=0x7fd52415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.092+0000 7fd523e00640 1 --2- 172.21.15.59:0/298363328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52415acd0 0x7fd52415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.092+0000 7fd523e00640 1 -- 172.21.15.59:0/298363328 >> v1:172.21.15.178:6789/0 conn(0x7fd524144120 legacy=0x7fd5240ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.092+0000 7fd523e00640 1 -- 172.21.15.59:0/298363328 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52415b3a0 con 0x7fd52415ee60 2024-04-25T09:07:33.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.092+0000 7fd51be00640 1 --2- 172.21.15.59:0/298363328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52415acd0 0x7fd52415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:33.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd523e00640 1 --2- 172.21.15.59:0/298363328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd52415ee60 0x7fd5240b3090 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009d90 tx=0x7fd51c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5eb5dd1e70f1108 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:33.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd522a00640 1 -- 172.21.15.59:0/298363328 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0b2070 con 0x7fd52415ee60 2024-04-25T09:07:33.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd522a00640 1 -- 172.21.15.59:0/298363328 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c0a57a0 con 0x7fd52415ee60 2024-04-25T09:07:33.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd522a00640 1 -- 172.21.15.59:0/298363328 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0a5b50 con 0x7fd52415ee60 2024-04-25T09:07:33.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 -- 172.21.15.59:0/298363328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd52415ee60 msgr2=0x7fd5240b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 --2- 172.21.15.59:0/298363328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd52415ee60 0x7fd5240b3090 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009d90 tx=0x7fd51c01c8e0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 -- 172.21.15.59:0/298363328 shutdown_connections 2024-04-25T09:07:33.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 --2- 172.21.15.59:0/298363328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd52415ee60 0x7fd5240b3090 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 --2- 172.21.15.59:0/298363328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52415acd0 0x7fd52415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 -- 172.21.15.59:0/298363328 >> 172.21.15.59:0/298363328 conn(0x7fd524067080 msgr2=0x7fd52406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:33.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 -- 172.21.15.59:0/298363328 shutdown_connections 2024-04-25T09:07:33.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 -- 172.21.15.59:0/298363328 wait complete. 2024-04-25T09:07:33.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 Processor -- start 2024-04-25T09:07:33.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 -- start start 2024-04-25T09:07:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd524144120 0x7fd5240b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52415acd0 0x7fd524166cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52415ee60 0x7fd524138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd524166010 con 0x7fd52415acd0 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd524165e90 con 0x7fd524144120 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd52a600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd524166190 con 0x7fd52415ee60 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.096+0000 7fd51be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52415acd0 0x7fd524166cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd51be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52415acd0 0x7fd524166cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46506/0 (socket says 172.21.15.59:46506) 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd51be00640 1 -- 172.21.15.59:0/1780300583 learned_addr learned my addr 172.21.15.59:0/1780300583 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd523400640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd524144120 0x7fd5240b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd523e00640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52415ee60 0x7fd524138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd51be00640 1 -- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52415ee60 msgr2=0x7fd524138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd51be00640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52415ee60 0x7fd524138e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd51be00640 1 -- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd524144120 msgr2=0x7fd5240b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd51be00640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd524144120 0x7fd5240b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd51be00640 1 -- 172.21.15.59:0/1780300583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd524167420 con 0x7fd52415acd0 2024-04-25T09:07:33.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd51be00640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52415acd0 0x7fd524166cf0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00ebe0 tx=0x7fd50c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:33.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd51b400640 1 -- 172.21.15.59:0/1780300583 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c017070 con 0x7fd52415acd0 2024-04-25T09:07:33.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd51b400640 1 -- 172.21.15.59:0/1780300583 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00cc30 con 0x7fd52415acd0 2024-04-25T09:07:33.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd51b400640 1 -- 172.21.15.59:0/1780300583 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c013470 con 0x7fd52415acd0 2024-04-25T09:07:33.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd52a600640 1 -- 172.21.15.59:0/1780300583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd524167700 con 0x7fd52415acd0 2024-04-25T09:07:33.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd52a600640 1 -- 172.21.15.59:0/1780300583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd524167cc0 con 0x7fd52415acd0 2024-04-25T09:07:33.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd52a600640 1 -- 172.21.15.59:0/1780300583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5240745d0 con 0x7fd52415acd0 2024-04-25T09:07:33.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.100+0000 7fd51b400640 1 -- 172.21.15.59:0/1780300583 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd50c01a070 con 0x7fd52415acd0 2024-04-25T09:07:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.104+0000 7fd51b400640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd500066f60 0x7fd500069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.104+0000 7fd51b400640 1 -- 172.21.15.59:0/1780300583 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd50c085490 con 0x7fd52415acd0 2024-04-25T09:07:33.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.104+0000 7fd523400640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd500066f60 0x7fd500069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.104+0000 7fd523400640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd500066f60 0x7fd500069420 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd514007fd0 tx=0x7fd514009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:33.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.108+0000 7fd51b400640 1 -- 172.21.15.59:0/1780300583 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd50c055c60 con 0x7fd52415acd0 2024-04-25T09:07:33.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.280+0000 7fd52a600640 1 -- 172.21.15.59:0/1780300583 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd524067f90 con 0x7fd52415acd0 2024-04-25T09:07:33.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd51b400640 1 -- 172.21.15.59:0/1780300583 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v81) v1 ==== 80+0+122 (secure 0 0 0) 0x7fd50c059d00 con 0x7fd52415acd0 2024-04-25T09:07:33.272 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6834/1468235926 2024-04-26T09:06:18.012326+0000 2024-04-25T09:07:33.272 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6832/1468235926 2024-04-26T09:06:18.012326+0000 2024-04-25T09:07:33.272 INFO:teuthology.orchestra.run.smithi059.stderr:listed 2 entries 2024-04-25T09:07:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd52a600640 1 -- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd500066f60 msgr2=0x7fd500069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd52a600640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd500066f60 0x7fd500069420 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd514007fd0 tx=0x7fd514009040 comp rx=0 tx=0).stop 2024-04-25T09:07:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd52a600640 1 -- 172.21.15.59:0/1780300583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52415acd0 msgr2=0x7fd524166cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd52a600640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52415acd0 0x7fd524166cf0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fd50c00ebe0 tx=0x7fd50c00c520 comp rx=0 tx=0).stop 2024-04-25T09:07:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd52a600640 1 -- 172.21.15.59:0/1780300583 shutdown_connections 2024-04-25T09:07:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd52a600640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd500066f60 0x7fd500069420 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd52a600640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd52415ee60 0x7fd524138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd52a600640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd52415acd0 0x7fd524166cf0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd52a600640 1 --2- 172.21.15.59:0/1780300583 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd524144120 0x7fd5240b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd52a600640 1 -- 172.21.15.59:0/1780300583 >> 172.21.15.59:0/1780300583 conn(0x7fd524067080 msgr2=0x7fd524071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:33.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd52a600640 1 -- 172.21.15.59:0/1780300583 shutdown_connections 2024-04-25T09:07:33.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.284+0000 7fd52a600640 1 -- 172.21.15.59:0/1780300583 wait complete. 2024-04-25T09:07:33.292 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:07:33.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:33.292 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:33.318 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:07:33.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:33.318 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:07:33.371 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:07:33.371 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:33.381 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:07:33.381 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:07:33.381 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:33.422 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:07:33.423 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:07:33.423 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:33.437 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:07:33.438 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:33.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.616+0000 7fe459600640 1 Processor -- start 2024-04-25T09:07:33.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.616+0000 7fe459600640 1 -- start start 2024-04-25T09:07:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe459600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe45415fe50 0x7fe4540b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe459600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4540cc4e0 con 0x7fe454145270 2024-04-25T09:07:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe459600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4540ce040 con 0x7fe4540b1c90 2024-04-25T09:07:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe459600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540b20e0 con 0x7fe45415fe50 2024-04-25T09:07:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe454145270 0x7fe4540cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46874/0 (socket says 172.21.15.59:46874) 2024-04-25T09:07:33.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452a00640 1 -- 172.21.15.59:0/2424104453 learned_addr learned my addr 172.21.15.59:0/2424104453 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe44be00640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe45415fe50 0x7fe4540b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610488381 0 0) 0x7fe4540cc4e0 con 0x7fe454145270 2024-04-25T09:07:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe438003530 con 0x7fe454145270 2024-04-25T09:07:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 815652704 0 0) 0x7fe438003530 con 0x7fe454145270 2024-04-25T09:07:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe45415fe50 msgr2=0x7fe4540b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe45415fe50 0x7fe4540b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 >> v1:172.21.15.178:6789/0 conn(0x7fe4540b1c90 legacy=0x7fe45415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4540ce320 con 0x7fe454145270 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fe444001680 con 0x7fe454145270 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 >> v1:172.21.15.59:6789/0 conn(0x7fe454145270 legacy=0x7fe4540cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe45415fe50 0x7fe4380039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe438003f30 0x7fe438004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe438004d50 0x7fe4380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4540b20e0 con 0x7fe438004d50 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43800ba80 con 0x7fe438003f30 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe43800bc80 con 0x7fe45415fe50 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe453400640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe438004d50 0x7fe4380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe452a00640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe45415fe50 0x7fe4380039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe44be00640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe438003f30 0x7fe438004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe453400640 1 -- 172.21.15.59:0/2424104453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe45415fe50 msgr2=0x7fe4380039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe453400640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe45415fe50 0x7fe4380039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe453400640 1 -- 172.21.15.59:0/2424104453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe438003f30 msgr2=0x7fe438004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:33.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe453400640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe438003f30 0x7fe438004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe453400640 1 -- 172.21.15.59:0/2424104453 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe438003530 con 0x7fe438004d50 2024-04-25T09:07:33.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.620+0000 7fe44be00640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe438003f30 0x7fe438004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.624+0000 7fe453400640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe438004d50 0x7fe4380051d0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fe44c001f60 tx=0x7fe44c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92f3f1db4f499e3b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.624+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c0b2070 con 0x7fe438004d50 2024-04-25T09:07:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.624+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe44c0a5770 con 0x7fe438004d50 2024-04-25T09:07:33.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.624+0000 7fe452000640 1 -- 172.21.15.59:0/2424104453 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44c001b60 con 0x7fe438004d50 2024-04-25T09:07:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.624+0000 7fe459600640 1 -- 172.21.15.59:0/2424104453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe438004d50 msgr2=0x7fe4380051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.624+0000 7fe459600640 1 --2- 172.21.15.59:0/2424104453 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe438004d50 0x7fe4380051d0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fe44c001f60 tx=0x7fe44c01c880 comp rx=0 tx=0).stop 2024-04-25T09:07:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.624+0000 7fe453400640 1 -- 172.21.15.59:0/2424104453 reap_dead start 2024-04-25T09:07:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.624+0000 7fe459600640 1 -- 172.21.15.59:0/2424104453 shutdown_connections 2024-04-25T09:07:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.624+0000 7fe459600640 1 -- 172.21.15.59:0/2424104453 >> 172.21.15.59:0/2424104453 conn(0x7fe454066fa0 msgr2=0x7fe45406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.624+0000 7fe459600640 1 -- 172.21.15.59:0/2424104453 shutdown_connections 2024-04-25T09:07:33.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.624+0000 7fe459600640 1 -- 172.21.15.59:0/2424104453 wait complete. 2024-04-25T09:07:33.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe459600640 1 Processor -- start 2024-04-25T09:07:33.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe459600640 1 -- start start 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe459600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe438004d50 0x7fe45413f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe459600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45415c3d0 0x7fe45415bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe459600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4540adcc0 0x7fe4540ae170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe459600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4541602b0 con 0x7fe45415c3d0 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe459600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe454145650 con 0x7fe4540adcc0 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe459600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45415f650 con 0x7fe438004d50 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe44be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45415c3d0 0x7fe45415bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe44be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45415c3d0 0x7fe45415bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46512/0 (socket says 172.21.15.59:46512) 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe44be00640 1 -- 172.21.15.59:0/2097369579 learned_addr learned my addr 172.21.15.59:0/2097369579 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe452a00640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe438004d50 0x7fe45413f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe453400640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4540adcc0 0x7fe4540ae170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe44be00640 1 -- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe438004d50 msgr2=0x7fe45413f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe44be00640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe438004d50 0x7fe45413f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe44be00640 1 -- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4540adcc0 msgr2=0x7fe4540ae170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe44be00640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4540adcc0 0x7fe4540ae170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe44be00640 1 -- 172.21.15.59:0/2097369579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45415c860 con 0x7fe45415c3d0 2024-04-25T09:07:33.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe44be00640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45415c3d0 0x7fe45415bbd0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fe43c011ca0 tx=0x7fe43c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:33.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe44aa00640 1 -- 172.21.15.59:0/2097369579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c011cd0 con 0x7fe45415c3d0 2024-04-25T09:07:33.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe44aa00640 1 -- 172.21.15.59:0/2097369579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c011e70 con 0x7fe45415c3d0 2024-04-25T09:07:33.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe459600640 1 -- 172.21.15.59:0/2097369579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45415cb40 con 0x7fe45415c3d0 2024-04-25T09:07:33.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe44aa00640 1 -- 172.21.15.59:0/2097369579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c004240 con 0x7fe45415c3d0 2024-04-25T09:07:33.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe459600640 1 -- 172.21.15.59:0/2097369579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45415d100 con 0x7fe45415c3d0 2024-04-25T09:07:33.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.628+0000 7fe459600640 1 -- 172.21.15.59:0/2097369579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4540745d0 con 0x7fe45415c3d0 2024-04-25T09:07:33.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.632+0000 7fe44aa00640 1 -- 172.21.15.59:0/2097369579 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe43c012040 con 0x7fe45415c3d0 2024-04-25T09:07:33.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.632+0000 7fe44aa00640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe430066f60 0x7fe430069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.632+0000 7fe44aa00640 1 -- 172.21.15.59:0/2097369579 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe43c0857e0 con 0x7fe45415c3d0 2024-04-25T09:07:33.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.632+0000 7fe452a00640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe430066f60 0x7fe430069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.632+0000 7fe452a00640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe430066f60 0x7fe430069420 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe444005260 tx=0x7fe444000ee0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:33.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.636+0000 7fe44aa00640 1 -- 172.21.15.59:0/2097369579 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe43c019030 con 0x7fe45415c3d0 2024-04-25T09:07:33.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.836+0000 7fe459600640 1 -- 172.21.15.59:0/2097369579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe45406b8e0 con 0x7fe45415c3d0 2024-04-25T09:07:33.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.836+0000 7fe44aa00640 1 -- 172.21.15.59:0/2097369579 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4948 (secure 0 0 0) 0x7fe43c056570 con 0x7fe45415c3d0 2024-04-25T09:07:33.825 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:33.825 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":56,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:07.181212+0000","modified":"2024-04-25T09:07:05.036822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6834/1033010830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1033010830},{"type":"v1","addr":"172.21.15.59:6834","nonce":1033010830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:07:33.826 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 56 2024-04-25T09:07:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.836+0000 7fe459600640 1 -- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe430066f60 msgr2=0x7fe430069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.836+0000 7fe459600640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe430066f60 0x7fe430069420 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe444005260 tx=0x7fe444000ee0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.840+0000 7fe459600640 1 -- 172.21.15.59:0/2097369579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45415c3d0 msgr2=0x7fe45415bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.840+0000 7fe459600640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45415c3d0 0x7fe45415bbd0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fe43c011ca0 tx=0x7fe43c00f610 comp rx=0 tx=0).stop 2024-04-25T09:07:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.840+0000 7fe459600640 1 -- 172.21.15.59:0/2097369579 shutdown_connections 2024-04-25T09:07:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.840+0000 7fe459600640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe430066f60 0x7fe430069420 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.840+0000 7fe459600640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4540adcc0 0x7fe4540ae170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.840+0000 7fe459600640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe45415c3d0 0x7fe45415bbd0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.840+0000 7fe459600640 1 --2- 172.21.15.59:0/2097369579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe438004d50 0x7fe45413f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.840+0000 7fe459600640 1 -- 172.21.15.59:0/2097369579 >> 172.21.15.59:0/2097369579 conn(0x7fe454066fa0 msgr2=0x7fe4541408c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.840+0000 7fe459600640 1 -- 172.21.15.59:0/2097369579 shutdown_connections 2024-04-25T09:07:33.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.840+0000 7fe459600640 1 -- 172.21.15.59:0/2097369579 wait complete. 2024-04-25T09:07:33.846 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:33.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.996+0000 7fe8a3c00640 1 Processor -- start 2024-04-25T09:07:33.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:33.996+0000 7fe8a3c00640 1 -- start start 2024-04-25T09:07:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe8a3c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe89c15b860 0x7fe89c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe8a3c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89c072c70 0x7fe89c0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe8a3c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c15c180 con 0x7fe89c0cd540 2024-04-25T09:07:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe8a3c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c15f4e0 con 0x7fe89c15b860 2024-04-25T09:07:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe8a3c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c15c430 con 0x7fe89c072c70 2024-04-25T09:07:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe8a1200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe89c15b860 0x7fe89c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe8a1200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe89c15b860 0x7fe89c15bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46520/0 (socket says 172.21.15.59:46520) 2024-04-25T09:07:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe8a1200640 1 -- 172.21.15.59:0/1200336435 learned_addr learned my addr 172.21.15.59:0/1200336435 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe89be00640 1 --2- 172.21.15.59:0/1200336435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89c072c70 0x7fe89c0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe8a1200640 1 -- 172.21.15.59:0/1200336435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89c072c70 msgr2=0x7fe89c0cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:33.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe8a1200640 1 --2- 172.21.15.59:0/1200336435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89c072c70 0x7fe89c0cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe8a1200640 1 -- 172.21.15.59:0/1200336435 >> v1:172.21.15.178:6789/0 conn(0x7fe89c0cd540 legacy=0x7fe89c06ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.000+0000 7fe8a1200640 1 -- 172.21.15.59:0/1200336435 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c15c710 con 0x7fe89c15b860 2024-04-25T09:07:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a1200640 1 --2- 172.21.15.59:0/1200336435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe89c15b860 0x7fe89c15bc40 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fe890009870 tx=0x7fe89001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20830d3275a30b19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe89b400640 1 -- 172.21.15.59:0/1200336435 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900aa430 con 0x7fe89c15b860 2024-04-25T09:07:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe89b400640 1 -- 172.21.15.59:0/1200336435 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8900af070 con 0x7fe89c15b860 2024-04-25T09:07:33.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe89b400640 1 -- 172.21.15.59:0/1200336435 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8900aa7f0 con 0x7fe89c15b860 2024-04-25T09:07:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 -- 172.21.15.59:0/1200336435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe89c15b860 msgr2=0x7fe89c15bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 --2- 172.21.15.59:0/1200336435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe89c15b860 0x7fe89c15bc40 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fe890009870 tx=0x7fe89001c530 comp rx=0 tx=0).stop 2024-04-25T09:07:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 -- 172.21.15.59:0/1200336435 shutdown_connections 2024-04-25T09:07:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 --2- 172.21.15.59:0/1200336435 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89c072c70 0x7fe89c0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 --2- 172.21.15.59:0/1200336435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe89c15b860 0x7fe89c15bc40 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 -- 172.21.15.59:0/1200336435 >> 172.21.15.59:0/1200336435 conn(0x7fe89c0b2400 msgr2=0x7fe89c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 -- 172.21.15.59:0/1200336435 shutdown_connections 2024-04-25T09:07:33.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 -- 172.21.15.59:0/1200336435 wait complete. 2024-04-25T09:07:33.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 Processor -- start 2024-04-25T09:07:33.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 -- start start 2024-04-25T09:07:33.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe89c072c70 0x7fe89c14dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89c0cd540 0x7fe89c160390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe89c15b860 0x7fe89c160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c0731d0 con 0x7fe89c15b860 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c073050 con 0x7fe89c072c70 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.004+0000 7fe8a3c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c06b320 con 0x7fe89c0cd540 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a1c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe89c15b860 0x7fe89c160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a1c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe89c15b860 0x7fe89c160e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46526/0 (socket says 172.21.15.59:46526) 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a1c00640 1 -- 172.21.15.59:0/4254982246 learned_addr learned my addr 172.21.15.59:0/4254982246 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe89be00640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89c0cd540 0x7fe89c160390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a1200640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe89c072c70 0x7fe89c14dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a1c00640 1 -- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89c0cd540 msgr2=0x7fe89c160390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a1c00640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89c0cd540 0x7fe89c160390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a1c00640 1 -- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe89c072c70 msgr2=0x7fe89c14dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:33.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a1c00640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe89c072c70 0x7fe89c14dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:33.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a1c00640 1 -- 172.21.15.59:0/4254982246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c14e000 con 0x7fe89c15b860 2024-04-25T09:07:33.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a1c00640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe89c15b860 0x7fe89c160e30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fe89400c770 tx=0x7fe89400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:33.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe898c00640 1 -- 172.21.15.59:0/4254982246 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe894003b80 con 0x7fe89c15b860 2024-04-25T09:07:33.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe898c00640 1 -- 172.21.15.59:0/4254982246 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe894003d20 con 0x7fe89c15b860 2024-04-25T09:07:33.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a3c00640 1 -- 172.21.15.59:0/4254982246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c1608d0 con 0x7fe89c15b860 2024-04-25T09:07:33.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe898c00640 1 -- 172.21.15.59:0/4254982246 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400aa90 con 0x7fe89c15b860 2024-04-25T09:07:33.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a3c00640 1 -- 172.21.15.59:0/4254982246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c151b30 con 0x7fe89c15b860 2024-04-25T09:07:33.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe8a3c00640 1 -- 172.21.15.59:0/4254982246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c0745d0 con 0x7fe89c15b860 2024-04-25T09:07:33.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.008+0000 7fe898c00640 1 -- 172.21.15.59:0/4254982246 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe89400ac30 con 0x7fe89c15b860 2024-04-25T09:07:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.012+0000 7fe898c00640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe87c066f60 0x7fe87c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:33.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.012+0000 7fe898c00640 1 -- 172.21.15.59:0/4254982246 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe894084f40 con 0x7fe89c15b860 2024-04-25T09:07:34.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.012+0000 7fe8a1200640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe87c066f60 0x7fe87c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.012+0000 7fe8a1200640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe87c066f60 0x7fe87c069420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe8900ae000 tx=0x7fe8900a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.016+0000 7fe898c00640 1 -- 172.21.15.59:0/4254982246 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe89c14e000 con 0x7fe89c15b860 2024-04-25T09:07:34.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.176+0000 7fe8a3c00640 1 -- 172.21.15.59:0/4254982246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe89c072550 con 0x7fe89c15b860 2024-04-25T09:07:34.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe898c00640 1 -- 172.21.15.59:0/4254982246 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fe8940557b0 con 0x7fe89c15b860 2024-04-25T09:07:34.168 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:34.168 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":81,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:06:18.012348+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:04.967523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:06.198067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6834/1468235926":"2024-04-26T09:06:18.012326+0000","172.21.15.59:6832/1468235926":"2024-04-26T09:06:18.012326+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe8a3c00640 1 -- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe87c066f60 msgr2=0x7fe87c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe8a3c00640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe87c066f60 0x7fe87c069420 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe8900ae000 tx=0x7fe8900a7000 comp rx=0 tx=0).stop 2024-04-25T09:07:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe8a3c00640 1 -- 172.21.15.59:0/4254982246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe89c15b860 msgr2=0x7fe89c160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe8a3c00640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe89c15b860 0x7fe89c160e30 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7fe89400c770 tx=0x7fe89400cc30 comp rx=0 tx=0).stop 2024-04-25T09:07:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe8a3c00640 1 -- 172.21.15.59:0/4254982246 shutdown_connections 2024-04-25T09:07:34.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe8a3c00640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe87c066f60 0x7fe87c069420 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe8a3c00640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe89c15b860 0x7fe89c160e30 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe8a3c00640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89c0cd540 0x7fe89c160390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe8a3c00640 1 --2- 172.21.15.59:0/4254982246 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe89c072c70 0x7fe89c14dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe8a3c00640 1 -- 172.21.15.59:0/4254982246 >> 172.21.15.59:0/4254982246 conn(0x7fe89c0b2400 msgr2=0x7fe89c070070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:34.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe8a3c00640 1 -- 172.21.15.59:0/4254982246 shutdown_connections 2024-04-25T09:07:34.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.180+0000 7fe8a3c00640 1 -- 172.21.15.59:0/4254982246 wait complete. 2024-04-25T09:07:34.190 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:06:04.967523+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:06:06.198067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:07:34.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:07:34.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.344+0000 7f4f22a00640 1 Processor -- start 2024-04-25T09:07:34.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.344+0000 7f4f22a00640 1 -- start start 2024-04-25T09:07:34.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.344+0000 7f4f22a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f1c072210 0x7f4f1c0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.344+0000 7f4f22a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f1c0ce1d0 0x7f4f1c0ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.344+0000 7f4f22a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1c06ac10 con 0x7f4f1c15dd90 2024-04-25T09:07:34.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.344+0000 7f4f22a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1c0b2dc0 con 0x7f4f1c0ce1d0 2024-04-25T09:07:34.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.344+0000 7f4f22a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c06aeb0 con 0x7f4f1c072210 2024-04-25T09:07:34.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f20a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f1c0ce1d0 0x7f4f1c0ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f20a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f1c0ce1d0 0x7f4f1c0ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46530/0 (socket says 172.21.15.59:46530) 2024-04-25T09:07:34.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f20a00640 1 -- 172.21.15.59:0/4145467047 learned_addr learned my addr 172.21.15.59:0/4145467047 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:34.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f13e00640 1 --2- 172.21.15.59:0/4145467047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f1c072210 0x7f4f1c0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f20a00640 1 -- 172.21.15.59:0/4145467047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f1c072210 msgr2=0x7f4f1c0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:34.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f20a00640 1 --2- 172.21.15.59:0/4145467047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f1c072210 0x7f4f1c0cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f20a00640 1 -- 172.21.15.59:0/4145467047 >> v1:172.21.15.59:6789/0 conn(0x7f4f1c15dd90 legacy=0x7f4f1c071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f20a00640 1 -- 172.21.15.59:0/4145467047 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c06b190 con 0x7f4f1c0ce1d0 2024-04-25T09:07:34.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f1b400640 1 -- 172.21.15.59:0/4145467047 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098551108 0 0) 0x7f4f1c06ac10 con 0x7f4f1c15dd90 2024-04-25T09:07:34.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f20a00640 1 --2- 172.21.15.59:0/4145467047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f1c0ce1d0 0x7f4f1c0ce640 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009e50 tx=0x7f4f1401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5844e216c39c80ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f1b400640 1 -- 172.21.15.59:0/4145467047 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f140a5710 con 0x7f4f1c0ce1d0 2024-04-25T09:07:34.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f1b400640 1 -- 172.21.15.59:0/4145467047 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f140a58b0 con 0x7f4f1c0ce1d0 2024-04-25T09:07:34.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.348+0000 7f4f1b400640 1 -- 172.21.15.59:0/4145467047 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f140a5c80 con 0x7f4f1c0ce1d0 2024-04-25T09:07:34.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 -- 172.21.15.59:0/4145467047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f1c0ce1d0 msgr2=0x7f4f1c0ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 --2- 172.21.15.59:0/4145467047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f1c0ce1d0 0x7f4f1c0ce640 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009e50 tx=0x7f4f1401c9a0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 -- 172.21.15.59:0/4145467047 shutdown_connections 2024-04-25T09:07:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 --2- 172.21.15.59:0/4145467047 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f1c0ce1d0 0x7f4f1c0ce640 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 --2- 172.21.15.59:0/4145467047 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f1c072210 0x7f4f1c0cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 -- 172.21.15.59:0/4145467047 >> 172.21.15.59:0/4145467047 conn(0x7f4f1c0cfd90 msgr2=0x7f4f1c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 -- 172.21.15.59:0/4145467047 shutdown_connections 2024-04-25T09:07:34.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 -- 172.21.15.59:0/4145467047 wait complete. 2024-04-25T09:07:34.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 Processor -- start 2024-04-25T09:07:34.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 -- start start 2024-04-25T09:07:34.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f1c072210 0x7f4f1c1609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f1c0ce1d0 0x7f4f1c141550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f1c15dd90 0x7f4f1c155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0cf720 con 0x7f4f1c15dd90 2024-04-25T09:07:34.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0cf5a0 con 0x7f4f1c0ce1d0 2024-04-25T09:07:34.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f22a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0cf8a0 con 0x7f4f1c072210 2024-04-25T09:07:34.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f20a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f1c15dd90 0x7f4f1c155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f20a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f1c15dd90 0x7f4f1c155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46538/0 (socket says 172.21.15.59:46538) 2024-04-25T09:07:34.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f20a00640 1 -- 172.21.15.59:0/1353052323 learned_addr learned my addr 172.21.15.59:0/1353052323 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:34.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f1be00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f1c072210 0x7f4f1c1609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f13e00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f1c0ce1d0 0x7f4f1c141550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f20a00640 1 -- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f1c072210 msgr2=0x7f4f1c1609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f20a00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f1c072210 0x7f4f1c1609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f20a00640 1 -- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f1c0ce1d0 msgr2=0x7f4f1c141550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f20a00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f1c0ce1d0 0x7f4f1c141550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f20a00640 1 -- 172.21.15.59:0/1353052323 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c15ec30 con 0x7f4f1c15dd90 2024-04-25T09:07:34.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.352+0000 7f4f13e00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f1c0ce1d0 0x7f4f1c141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:34.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.356+0000 7f4f20a00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f1c15dd90 0x7f4f1c155780 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009e50 tx=0x7f4f14019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.356+0000 7f4f18c00640 1 -- 172.21.15.59:0/1353052323 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f140bc020 con 0x7f4f1c15dd90 2024-04-25T09:07:34.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.356+0000 7f4f18c00640 1 -- 172.21.15.59:0/1353052323 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f140b8670 con 0x7f4f1c15dd90 2024-04-25T09:07:34.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.356+0000 7f4f18c00640 1 -- 172.21.15.59:0/1353052323 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f14009510 con 0x7f4f1c15dd90 2024-04-25T09:07:34.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.356+0000 7f4f22a00640 1 -- 172.21.15.59:0/1353052323 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1c15eea0 con 0x7f4f1c15dd90 2024-04-25T09:07:34.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.356+0000 7f4f22a00640 1 -- 172.21.15.59:0/1353052323 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1c15f460 con 0x7f4f1c15dd90 2024-04-25T09:07:34.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.356+0000 7f4f22a00640 1 -- 172.21.15.59:0/1353052323 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c072700 con 0x7f4f1c15dd90 2024-04-25T09:07:34.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.356+0000 7f4f18c00640 1 -- 172.21.15.59:0/1353052323 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4f140bf020 con 0x7f4f1c15dd90 2024-04-25T09:07:34.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.356+0000 7f4f18c00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4ef8066f60 0x7f4ef8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.356+0000 7f4f18c00640 1 -- 172.21.15.59:0/1353052323 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f4f14120370 con 0x7f4f1c15dd90 2024-04-25T09:07:34.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.356+0000 7f4f1be00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4ef8066f60 0x7f4ef8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.360+0000 7f4f1be00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4ef8066f60 0x7f4ef8069420 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c007fd0 tx=0x7f4f0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.360+0000 7f4f18c00640 1 -- 172.21.15.59:0/1353052323 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4f140c6030 con 0x7f4f1c15dd90 2024-04-25T09:07:34.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.520+0000 7f4f22a00640 1 -- 172.21.15.59:0/1353052323 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f1c160ef0 con 0x7f4f1c15dd90 2024-04-25T09:07:34.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f18c00640 1 -- 172.21.15.59:0/1353052323 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f14016620 con 0x7f4f1c15dd90 2024-04-25T09:07:34.511 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:07:34.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f22a00640 1 -- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4ef8066f60 msgr2=0x7f4ef8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f22a00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4ef8066f60 0x7f4ef8069420 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c007fd0 tx=0x7f4f0c009040 comp rx=0 tx=0).stop 2024-04-25T09:07:34.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f22a00640 1 -- 172.21.15.59:0/1353052323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f1c15dd90 msgr2=0x7f4f1c155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f22a00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f1c15dd90 0x7f4f1c155780 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f4f14009e50 tx=0x7f4f14019740 comp rx=0 tx=0).stop 2024-04-25T09:07:34.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f22a00640 1 -- 172.21.15.59:0/1353052323 shutdown_connections 2024-04-25T09:07:34.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f22a00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4ef8066f60 0x7f4ef8069420 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f22a00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f1c15dd90 0x7f4f1c155780 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f22a00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4f1c0ce1d0 0x7f4f1c141550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f22a00640 1 --2- 172.21.15.59:0/1353052323 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4f1c072210 0x7f4f1c1609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f22a00640 1 -- 172.21.15.59:0/1353052323 >> 172.21.15.59:0/1353052323 conn(0x7f4f1c0cfd90 msgr2=0x7f4f1c06df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:34.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f22a00640 1 -- 172.21.15.59:0/1353052323 shutdown_connections 2024-04-25T09:07:34.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.524+0000 7f4f22a00640 1 -- 172.21.15.59:0/1353052323 wait complete. 2024-04-25T09:07:34.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:07:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf7000640 1 Processor -- start 2024-04-25T09:07:34.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf7000640 1 -- start start 2024-04-25T09:07:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf7000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaf0072210 0x7fcaf00cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf7000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcaf00ce1d0 0x7fcaf00ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf7000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaf006ac10 con 0x7fcaf015dd90 2024-04-25T09:07:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf7000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaf00b2dc0 con 0x7fcaf00ce1d0 2024-04-25T09:07:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf7000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf006aeb0 con 0x7fcaf0072210 2024-04-25T09:07:34.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf5000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcaf00ce1d0 0x7fcaf00ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaefe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcaf015dd90 0x7fcaf0071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46882/0 (socket says 172.21.15.59:46882) 2024-04-25T09:07:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf5000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcaf00ce1d0 0x7fcaf00ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46552/0 (socket says 172.21.15.59:46552) 2024-04-25T09:07:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaefe00640 1 -- 172.21.15.59:0/683754792 learned_addr learned my addr 172.21.15.59:0/683754792 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaef400640 1 --2- 172.21.15.59:0/683754792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaf0072210 0x7fcaf00cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf5000640 1 -- 172.21.15.59:0/683754792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaf0072210 msgr2=0x7fcaf00cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf5000640 1 --2- 172.21.15.59:0/683754792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaf0072210 0x7fcaf00cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf5000640 1 -- 172.21.15.59:0/683754792 >> v1:172.21.15.59:6789/0 conn(0x7fcaf015dd90 legacy=0x7fcaf0071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaf5000640 1 -- 172.21.15.59:0/683754792 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf006b190 con 0x7fcaf00ce1d0 2024-04-25T09:07:34.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.688+0000 7fcaef400640 1 --2- 172.21.15.59:0/683754792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaf0072210 0x7fcaf00cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaf5000640 1 --2- 172.21.15.59:0/683754792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf00ce1d0 0x7fcaf00ce640 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009d90 tx=0x7fcae801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ebc9eafe7bf711 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaeea00640 1 -- 172.21.15.59:0/683754792 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80b2070 con 0x7fcaf00ce1d0 2024-04-25T09:07:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaeea00640 1 -- 172.21.15.59:0/683754792 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae80a5850 con 0x7fcaf00ce1d0 2024-04-25T09:07:34.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaeea00640 1 -- 172.21.15.59:0/683754792 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80a5c20 con 0x7fcaf00ce1d0 2024-04-25T09:07:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaf7000640 1 -- 172.21.15.59:0/683754792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf00ce1d0 msgr2=0x7fcaf00ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaf7000640 1 --2- 172.21.15.59:0/683754792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf00ce1d0 0x7fcaf00ce640 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7fcae8009d90 tx=0x7fcae801c8e0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaf7000640 1 -- 172.21.15.59:0/683754792 shutdown_connections 2024-04-25T09:07:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaf7000640 1 --2- 172.21.15.59:0/683754792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf00ce1d0 0x7fcaf00ce640 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaf7000640 1 --2- 172.21.15.59:0/683754792 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaf0072210 0x7fcaf00cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaf7000640 1 -- 172.21.15.59:0/683754792 >> 172.21.15.59:0/683754792 conn(0x7fcaf00cfd90 msgr2=0x7fcaf00d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaf7000640 1 -- 172.21.15.59:0/683754792 shutdown_connections 2024-04-25T09:07:34.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaf7000640 1 -- 172.21.15.59:0/683754792 wait complete. 2024-04-25T09:07:34.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaf7000640 1 Processor -- start 2024-04-25T09:07:34.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.692+0000 7fcaf7000640 1 -- start start 2024-04-25T09:07:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf7000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf0072210 0x7fcaf014b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf7000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaf00ce1d0 0x7fcaf0154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf7000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf015dd90 0x7fcaf0155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf7000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00cf720 con 0x7fcaf015dd90 2024-04-25T09:07:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf7000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00cf5a0 con 0x7fcaf0072210 2024-04-25T09:07:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf7000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaf00cf8a0 con 0x7fcaf00ce1d0 2024-04-25T09:07:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf015dd90 0x7fcaf0155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf015dd90 0x7fcaf0155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46556/0 (socket says 172.21.15.59:46556) 2024-04-25T09:07:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf5000640 1 -- 172.21.15.59:0/2337941266 learned_addr learned my addr 172.21.15.59:0/2337941266 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:34.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaefe00640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf0072210 0x7fcaf014b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaef400640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaf00ce1d0 0x7fcaf0154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf5000640 1 -- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaf00ce1d0 msgr2=0x7fcaf0154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf5000640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaf00ce1d0 0x7fcaf0154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf5000640 1 -- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf0072210 msgr2=0x7fcaf014b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf5000640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf0072210 0x7fcaf014b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf5000640 1 -- 172.21.15.59:0/2337941266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf0155890 con 0x7fcaf015dd90 2024-04-25T09:07:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf5000640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf015dd90 0x7fcaf0155260 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcae80b0040 tx=0x7fcae8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcae7e00640 1 -- 172.21.15.59:0/2337941266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80b2050 con 0x7fcaf015dd90 2024-04-25T09:07:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcae7e00640 1 -- 172.21.15.59:0/2337941266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae80be070 con 0x7fcaf015dd90 2024-04-25T09:07:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcae7e00640 1 -- 172.21.15.59:0/2337941266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcae80ada70 con 0x7fcaf015dd90 2024-04-25T09:07:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf7000640 1 -- 172.21.15.59:0/2337941266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaf0155b70 con 0x7fcaf015dd90 2024-04-25T09:07:34.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf7000640 1 -- 172.21.15.59:0/2337941266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaf0156130 con 0x7fcaf015dd90 2024-04-25T09:07:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.696+0000 7fcaf7000640 1 -- 172.21.15.59:0/2337941266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf00745d0 con 0x7fcaf015dd90 2024-04-25T09:07:34.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.700+0000 7fcae7e00640 1 -- 172.21.15.59:0/2337941266 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcae80adc10 con 0x7fcaf015dd90 2024-04-25T09:07:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.700+0000 7fcae7e00640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcad0066f60 0x7fcad0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.700+0000 7fcae7e00640 1 -- 172.21.15.59:0/2337941266 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fcae8120490 con 0x7fcaf015dd90 2024-04-25T09:07:34.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.700+0000 7fcaefe00640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcad0066f60 0x7fcad0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:34.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.700+0000 7fcaefe00640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcad0066f60 0x7fcad0069420 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcae0000f70 tx=0x7fcae0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:34.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.704+0000 7fcae7e00640 1 -- 172.21.15.59:0/2337941266 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcae8016560 con 0x7fcaf015dd90 2024-04-25T09:07:34.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.868+0000 7fcaf7000640 1 -- 172.21.15.59:0/2337941266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcaf00b3410 con 0x7fcaf015dd90 2024-04-25T09:07:34.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.868+0000 7fcae7e00640 1 -- 172.21.15.59:0/2337941266 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v81) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcae80ab340 con 0x7fcaf015dd90 2024-04-25T09:07:34.857 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:07:34.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.868+0000 7fcaf7000640 1 -- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcad0066f60 msgr2=0x7fcad0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.868+0000 7fcaf7000640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcad0066f60 0x7fcad0069420 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fcae0000f70 tx=0x7fcae0009040 comp rx=0 tx=0).stop 2024-04-25T09:07:34.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.868+0000 7fcaf7000640 1 -- 172.21.15.59:0/2337941266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf015dd90 msgr2=0x7fcaf0155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:34.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.868+0000 7fcaf7000640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf015dd90 0x7fcaf0155260 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fcae80b0040 tx=0x7fcae8019680 comp rx=0 tx=0).stop 2024-04-25T09:07:34.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.872+0000 7fcaf7000640 1 -- 172.21.15.59:0/2337941266 shutdown_connections 2024-04-25T09:07:34.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.872+0000 7fcaf7000640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcad0066f60 0x7fcad0069420 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.872+0000 7fcaf7000640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcaf015dd90 0x7fcaf0155260 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.872+0000 7fcaf7000640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcaf00ce1d0 0x7fcaf0154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.872+0000 7fcaf7000640 1 --2- 172.21.15.59:0/2337941266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcaf0072210 0x7fcaf014b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:34.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.872+0000 7fcaf7000640 1 -- 172.21.15.59:0/2337941266 >> 172.21.15.59:0/2337941266 conn(0x7fcaf00cfd90 msgr2=0x7fcaf01570c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:34.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.872+0000 7fcaf7000640 1 -- 172.21.15.59:0/2337941266 shutdown_connections 2024-04-25T09:07:34.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:34.872+0000 7fcaf7000640 1 -- 172.21.15.59:0/2337941266 wait complete. 2024-04-25T09:07:34.878 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:07:35.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7023e00640 1 Processor -- start 2024-04-25T09:07:35.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7023e00640 1 -- start start 2024-04-25T09:07:35.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7023e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f701c15c9b0 0x7f701c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7023e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701c15fc00 con 0x7f701c06e010 2024-04-25T09:07:35.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7023e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701c15fee0 con 0x7f701c159320 2024-04-25T09:07:35.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7023e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701c06d640 con 0x7f701c15c9b0 2024-04-25T09:07:35.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7020a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f701c15c9b0 0x7f701c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7020a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f701c15c9b0 0x7f701c06dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46564/0 (socket says 172.21.15.59:46564) 2024-04-25T09:07:35.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7020a00640 1 -- 172.21.15.59:0/3833598146 learned_addr learned my addr 172.21.15.59:0/3833598146 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:35.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7021e00640 1 --1- 172.21.15.59:0/3833598146 >> v1:172.21.15.59:6789/0 conn(0x7f701c06e010 0x7f701c06e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46898/0 (socket says 172.21.15.59:46898) 2024-04-25T09:07:35.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7020a00640 1 -- 172.21.15.59:0/3833598146 >> v1:172.21.15.178:6789/0 conn(0x7f701c159320 legacy=0x7f701c15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7020a00640 1 -- 172.21.15.59:0/3833598146 >> v1:172.21.15.59:6789/0 conn(0x7f701c06e010 legacy=0x7f701c06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f7020a00640 1 -- 172.21.15.59:0/3833598146 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c1601c0 con 0x7f701c15c9b0 2024-04-25T09:07:35.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.032+0000 7f701be00640 1 -- 172.21.15.59:0/3833598146 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1947378674 0 0) 0x7f701c15fc00 con 0x7f701c06e010 2024-04-25T09:07:35.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.036+0000 7f7020a00640 1 --2- 172.21.15.59:0/3833598146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c15c9b0 0x7f701c06dad0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f7008009870 tx=0x7f700801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c37c9f5547a772 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.036+0000 7f701be00640 1 -- 172.21.15.59:0/3833598146 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080a7070 con 0x7f701c15c9b0 2024-04-25T09:07:35.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.036+0000 7f701be00640 1 -- 172.21.15.59:0/3833598146 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70080b0070 con 0x7f701c15c9b0 2024-04-25T09:07:35.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.036+0000 7f701be00640 1 -- 172.21.15.59:0/3833598146 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080ab890 con 0x7f701c15c9b0 2024-04-25T09:07:35.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.036+0000 7f7023e00640 1 -- 172.21.15.59:0/3833598146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c15c9b0 msgr2=0x7f701c06dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.036+0000 7f7023e00640 1 --2- 172.21.15.59:0/3833598146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c15c9b0 0x7f701c06dad0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f7008009870 tx=0x7f700801c560 comp rx=0 tx=0).stop 2024-04-25T09:07:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.036+0000 7f7023e00640 1 -- 172.21.15.59:0/3833598146 shutdown_connections 2024-04-25T09:07:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.036+0000 7f7023e00640 1 --2- 172.21.15.59:0/3833598146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c15c9b0 0x7f701c06dad0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.036+0000 7f7023e00640 1 -- 172.21.15.59:0/3833598146 >> 172.21.15.59:0/3833598146 conn(0x7f701c067080 msgr2=0x7f701c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.036+0000 7f7023e00640 1 -- 172.21.15.59:0/3833598146 shutdown_connections 2024-04-25T09:07:35.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.036+0000 7f7023e00640 1 -- 172.21.15.59:0/3833598146 wait complete. 2024-04-25T09:07:35.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7023e00640 1 Processor -- start 2024-04-25T09:07:35.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7023e00640 1 -- start start 2024-04-25T09:07:35.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7023e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701c06e010 0x7f701c157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7023e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c159320 0x7f701c13e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7023e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f701c15c9b0 0x7f701c157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7023e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c06ed30 con 0x7f701c159320 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7023e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701c06ebb0 con 0x7f701c06e010 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7023e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701c1695a0 con 0x7f701c15c9b0 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7020a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c159320 0x7f701c13e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7020a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c159320 0x7f701c13e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46580/0 (socket says 172.21.15.59:46580) 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7020a00640 1 -- 172.21.15.59:0/397127442 learned_addr learned my addr 172.21.15.59:0/397127442 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7021400640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701c06e010 0x7f701c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7021e00640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f701c15c9b0 0x7f701c157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7020a00640 1 -- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f701c15c9b0 msgr2=0x7f701c157bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7020a00640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f701c15c9b0 0x7f701c157bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7020a00640 1 -- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701c06e010 msgr2=0x7f701c157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7020a00640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701c06e010 0x7f701c157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7020a00640 1 -- 172.21.15.59:0/397127442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701c0ae600 con 0x7f701c159320 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7021e00640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f701c15c9b0 0x7f701c157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7021400640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701c06e010 0x7f701c157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:35.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7020a00640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c159320 0x7f701c13e6d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f70080ad040 tx=0x7f700801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7019600640 1 -- 172.21.15.59:0/397127442 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70080ba070 con 0x7f701c159320 2024-04-25T09:07:35.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7019600640 1 -- 172.21.15.59:0/397127442 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70080abd90 con 0x7f701c159320 2024-04-25T09:07:35.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7019600640 1 -- 172.21.15.59:0/397127442 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008004220 con 0x7f701c159320 2024-04-25T09:07:35.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7023e00640 1 -- 172.21.15.59:0/397127442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701c140f30 con 0x7f701c159320 2024-04-25T09:07:35.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.040+0000 7f7023e00640 1 -- 172.21.15.59:0/397127442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f701c1411d0 con 0x7f701c159320 2024-04-25T09:07:35.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.044+0000 7f7023e00640 1 -- 172.21.15.59:0/397127442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f701c0745d0 con 0x7f701c159320 2024-04-25T09:07:35.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.044+0000 7f7019600640 1 -- 172.21.15.59:0/397127442 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7008003620 con 0x7f701c159320 2024-04-25T09:07:35.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.044+0000 7f7019600640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ffc066f60 0x7f6ffc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.044+0000 7f7019600640 1 -- 172.21.15.59:0/397127442 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f700811f230 con 0x7f701c159320 2024-04-25T09:07:35.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.044+0000 7f7021400640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ffc066f60 0x7f6ffc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.044+0000 7f7021400640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ffc066f60 0x7f6ffc069420 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f701c1f9b90 tx=0x7f7010009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.048+0000 7f7019600640 1 -- 172.21.15.59:0/397127442 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f70080c5030 con 0x7f701c159320 2024-04-25T09:07:35.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 -- 172.21.15.59:0/397127442 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f701c141780 con 0x7f701c159320 2024-04-25T09:07:35.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7019600640 1 -- 172.21.15.59:0/397127442 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v81) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7008016150 con 0x7f701c159320 2024-04-25T09:07:35.197 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:07:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 -- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ffc066f60 msgr2=0x7f6ffc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ffc066f60 0x7f6ffc069420 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f701c1f9b90 tx=0x7f7010009040 comp rx=0 tx=0).stop 2024-04-25T09:07:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 -- 172.21.15.59:0/397127442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c159320 msgr2=0x7f701c13e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c159320 0x7f701c13e6d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f70080ad040 tx=0x7f700801ada0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 -- 172.21.15.59:0/397127442 shutdown_connections 2024-04-25T09:07:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6ffc066f60 0x7f6ffc069420 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f701c15c9b0 0x7f701c157bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701c159320 0x7f701c13e6d0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 --2- 172.21.15.59:0/397127442 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701c06e010 0x7f701c157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 -- 172.21.15.59:0/397127442 >> 172.21.15.59:0/397127442 conn(0x7f701c067080 msgr2=0x7f701c0736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:35.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 -- 172.21.15.59:0/397127442 shutdown_connections 2024-04-25T09:07:35.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.208+0000 7f7023e00640 1 -- 172.21.15.59:0/397127442 wait complete. 2024-04-25T09:07:35.218 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:35.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.368+0000 7efff1000640 1 Processor -- start 2024-04-25T09:07:35.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.368+0000 7efff1000640 1 -- start start 2024-04-25T09:07:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.372+0000 7efff1000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7effec0b22d0 0x7effec06e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.372+0000 7efff1000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec06d6f0 con 0x7effec06edc0 2024-04-25T09:07:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.372+0000 7efff1000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effec06d9d0 con 0x7effec071690 2024-04-25T09:07:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.372+0000 7efff1000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effec06dcb0 con 0x7effec0b22d0 2024-04-25T09:07:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.372+0000 7effea800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7effec06edc0 0x7effec0acc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46914/0 (socket says 172.21.15.59:46914) 2024-04-25T09:07:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.372+0000 7effea800640 1 -- 172.21.15.59:0/402260981 learned_addr learned my addr 172.21.15.59:0/402260981 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:35.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.372+0000 7effe1400640 1 --2- 172.21.15.59:0/402260981 >> v2:172.21.15.178:3300/0 conn(0x7effec0b22d0 0x7effec06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.372+0000 7effe9400640 1 -- 172.21.15.59:0/402260981 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208649417 0 0) 0x7effec06d6f0 con 0x7effec06edc0 2024-04-25T09:07:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.372+0000 7effe9400640 1 -- 172.21.15.59:0/402260981 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effd0003530 con 0x7effec06edc0 2024-04-25T09:07:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.372+0000 7effe1400640 1 -- 172.21.15.59:0/402260981 >> v1:172.21.15.178:6789/0 conn(0x7effec071690 legacy=0x7effec071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.372+0000 7effe1400640 1 -- 172.21.15.59:0/402260981 >> v1:172.21.15.59:6789/0 conn(0x7effec06edc0 legacy=0x7effec0acc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.372+0000 7effe1400640 1 -- 172.21.15.59:0/402260981 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec06df90 con 0x7effec0b22d0 2024-04-25T09:07:35.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7effe1400640 1 --2- 172.21.15.59:0/402260981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec0b22d0 0x7effec06e790 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7effd4009d90 tx=0x7effd401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efa38d53f69c9e3a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7effe9400640 1 -- 172.21.15.59:0/402260981 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd40b2070 con 0x7effec0b22d0 2024-04-25T09:07:35.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7effe9400640 1 -- 172.21.15.59:0/402260981 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd40a5920 con 0x7effec0b22d0 2024-04-25T09:07:35.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7effe9400640 1 -- 172.21.15.59:0/402260981 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd40a5cd0 con 0x7effec0b22d0 2024-04-25T09:07:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7efff1000640 1 -- 172.21.15.59:0/402260981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec0b22d0 msgr2=0x7effec06e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7efff1000640 1 --2- 172.21.15.59:0/402260981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec0b22d0 0x7effec06e790 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7effd4009d90 tx=0x7effd401c940 comp rx=0 tx=0).stop 2024-04-25T09:07:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7efff1000640 1 -- 172.21.15.59:0/402260981 shutdown_connections 2024-04-25T09:07:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7efff1000640 1 --2- 172.21.15.59:0/402260981 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec0b22d0 0x7effec06e790 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7efff1000640 1 -- 172.21.15.59:0/402260981 >> 172.21.15.59:0/402260981 conn(0x7effec0b17b0 msgr2=0x7effec0b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7efff1000640 1 -- 172.21.15.59:0/402260981 shutdown_connections 2024-04-25T09:07:35.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7efff1000640 1 -- 172.21.15.59:0/402260981 wait complete. 2024-04-25T09:07:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7efff1000640 1 Processor -- start 2024-04-25T09:07:35.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.376+0000 7efff1000640 1 -- start start 2024-04-25T09:07:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7efff1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effec06edc0 0x7effec073900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7efff1000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec071690 0x7effec15eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7efff1000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec0b22d0 0x7effec1f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7efff1000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec16b980 con 0x7effec06edc0 2024-04-25T09:07:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7efff1000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec16b800 con 0x7effec071690 2024-04-25T09:07:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7efff1000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec16bb00 con 0x7effec0b22d0 2024-04-25T09:07:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effec06edc0 0x7effec073900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effec06edc0 0x7effec073900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46582/0 (socket says 172.21.15.59:46582) 2024-04-25T09:07:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe9e00640 1 -- 172.21.15.59:0/3385552273 learned_addr learned my addr 172.21.15.59:0/3385552273 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe1400640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec071690 0x7effec15eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effea800640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec0b22d0 0x7effec1f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe9e00640 1 -- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec0b22d0 msgr2=0x7effec1f6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe9e00640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec0b22d0 0x7effec1f6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe9e00640 1 -- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec071690 msgr2=0x7effec15eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe9e00640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec071690 0x7effec15eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe9e00640 1 -- 172.21.15.59:0/3385552273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec15f050 con 0x7effec06edc0 2024-04-25T09:07:35.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe9e00640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effec06edc0 0x7effec073900 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7effdc00c530 tx=0x7effdc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe2a00640 1 -- 172.21.15.59:0/3385552273 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc016020 con 0x7effec06edc0 2024-04-25T09:07:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe2a00640 1 -- 172.21.15.59:0/3385552273 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effdc005220 con 0x7effec06edc0 2024-04-25T09:07:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7efff1000640 1 -- 172.21.15.59:0/3385552273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec155300 con 0x7effec06edc0 2024-04-25T09:07:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe2a00640 1 -- 172.21.15.59:0/3385552273 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effdc007030 con 0x7effec06edc0 2024-04-25T09:07:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7efff1000640 1 -- 172.21.15.59:0/3385552273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec1558c0 con 0x7effec06edc0 2024-04-25T09:07:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7efff1000640 1 -- 172.21.15.59:0/3385552273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effec0745d0 con 0x7effec06edc0 2024-04-25T09:07:35.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.380+0000 7effe2a00640 1 -- 172.21.15.59:0/3385552273 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7effdc0071d0 con 0x7effec06edc0 2024-04-25T09:07:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.384+0000 7effe2a00640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effc8066f60 0x7effc8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.384+0000 7effe2a00640 1 -- 172.21.15.59:0/3385552273 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7effdc084bc0 con 0x7effec06edc0 2024-04-25T09:07:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.384+0000 7effe1400640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effc8066f60 0x7effc8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.384+0000 7effe1400640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effc8066f60 0x7effc8069420 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7effd40af000 tx=0x7effd40a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.388+0000 7effe2a00640 1 -- 172.21.15.59:0/3385552273 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7effdc020020 con 0x7effec06edc0 2024-04-25T09:07:35.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.584+0000 7efff1000640 1 -- 172.21.15.59:0/3385552273 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effec0af880 con 0x7effec06edc0 2024-04-25T09:07:35.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.584+0000 7effe2a00640 1 -- 172.21.15.59:0/3385552273 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4948 (secure 0 0 0) 0x7effdc0074c0 con 0x7effec06edc0 2024-04-25T09:07:35.574 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:35.575 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":56,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:07.181212+0000","modified":"2024-04-25T09:07:05.036822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6834/1033010830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1033010830},{"type":"v1","addr":"172.21.15.59:6834","nonce":1033010830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 56 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.584+0000 7efff1000640 1 -- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effc8066f60 msgr2=0x7effc8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.584+0000 7efff1000640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effc8066f60 0x7effc8069420 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7effd40af000 tx=0x7effd40a7070 comp rx=0 tx=0).stop 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.584+0000 7efff1000640 1 -- 172.21.15.59:0/3385552273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effec06edc0 msgr2=0x7effec073900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.584+0000 7efff1000640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effec06edc0 0x7effec073900 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7effdc00c530 tx=0x7effdc00c9f0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.584+0000 7efff1000640 1 -- 172.21.15.59:0/3385552273 shutdown_connections 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.584+0000 7efff1000640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effc8066f60 0x7effc8069420 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.584+0000 7efff1000640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effec0b22d0 0x7effec1f6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.584+0000 7efff1000640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effec071690 0x7effec15eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.584+0000 7efff1000640 1 --2- 172.21.15.59:0/3385552273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effec06edc0 0x7effec073900 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.584+0000 7efff1000640 1 -- 172.21.15.59:0/3385552273 >> 172.21.15.59:0/3385552273 conn(0x7effec0b17b0 msgr2=0x7effec0b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.588+0000 7efff1000640 1 -- 172.21.15.59:0/3385552273 shutdown_connections 2024-04-25T09:07:35.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.588+0000 7efff1000640 1 -- 172.21.15.59:0/3385552273 wait complete. 2024-04-25T09:07:35.594 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:35.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.744+0000 7f91edc00640 1 Processor -- start 2024-04-25T09:07:35.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.744+0000 7f91edc00640 1 -- start start 2024-04-25T09:07:35.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91edc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91e815fe50 0x7f91e80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91edc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e80b1c90 0x7f91e815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91edc00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e80cc4e0 con 0x7f91e8145270 2024-04-25T09:07:35.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91edc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e8145650 con 0x7f91e815fe50 2024-04-25T09:07:35.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91edc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e81602b0 con 0x7f91e80b1c90 2024-04-25T09:07:35.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91dfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91e815fe50 0x7f91e80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91dfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f91e815fe50 0x7f91e80b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46588/0 (socket says 172.21.15.59:46588) 2024-04-25T09:07:35.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91dfe00640 1 -- 172.21.15.59:0/1736871239 learned_addr learned my addr 172.21.15.59:0/1736871239 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:35.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91e7400640 1 --2- 172.21.15.59:0/1736871239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e80b1c90 0x7f91e815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91dfe00640 1 -- 172.21.15.59:0/1736871239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e80b1c90 msgr2=0x7f91e815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:35.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91dfe00640 1 --2- 172.21.15.59:0/1736871239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e80b1c90 0x7f91e815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91dfe00640 1 -- 172.21.15.59:0/1736871239 >> v1:172.21.15.178:6789/0 conn(0x7f91e8145270 legacy=0x7f91e80cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91dfe00640 1 -- 172.21.15.59:0/1736871239 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80ce040 con 0x7f91e815fe50 2024-04-25T09:07:35.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.748+0000 7f91e7400640 1 --2- 172.21.15.59:0/1736871239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e80b1c90 0x7f91e815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:35.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91dfe00640 1 --2- 172.21.15.59:0/1736871239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e815fe50 0x7f91e80b1750 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009870 tx=0x7f91d001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367e0afa400e171b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91e6000640 1 -- 172.21.15.59:0/1736871239 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00ab650 con 0x7f91e815fe50 2024-04-25T09:07:35.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91e6000640 1 -- 172.21.15.59:0/1736871239 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d00b0070 con 0x7f91e815fe50 2024-04-25T09:07:35.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91e6000640 1 -- 172.21.15.59:0/1736871239 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00aba10 con 0x7f91e815fe50 2024-04-25T09:07:35.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 -- 172.21.15.59:0/1736871239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e815fe50 msgr2=0x7f91e80b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 --2- 172.21.15.59:0/1736871239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e815fe50 0x7f91e80b1750 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f91d0009870 tx=0x7f91d001c560 comp rx=0 tx=0).stop 2024-04-25T09:07:35.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 -- 172.21.15.59:0/1736871239 shutdown_connections 2024-04-25T09:07:35.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 --2- 172.21.15.59:0/1736871239 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e80b1c90 0x7f91e815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 --2- 172.21.15.59:0/1736871239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e815fe50 0x7f91e80b1750 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 -- 172.21.15.59:0/1736871239 >> 172.21.15.59:0/1736871239 conn(0x7f91e8066fa0 msgr2=0x7f91e806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:35.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 -- 172.21.15.59:0/1736871239 shutdown_connections 2024-04-25T09:07:35.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 -- 172.21.15.59:0/1736871239 wait complete. 2024-04-25T09:07:35.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 Processor -- start 2024-04-25T09:07:35.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 -- start start 2024-04-25T09:07:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91e80b1c90 0x7f91e813b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e8145270 0x7f91e815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e815fe50 0x7f91e815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80cdbe0 con 0x7f91e815fe50 2024-04-25T09:07:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e815f930 con 0x7f91e80b1c90 2024-04-25T09:07:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.752+0000 7f91edc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e80cdd60 con 0x7f91e8145270 2024-04-25T09:07:35.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e815fe50 0x7f91e815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e815fe50 0x7f91e815b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46604/0 (socket says 172.21.15.59:46604) 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91e7400640 1 -- 172.21.15.59:0/2457536913 learned_addr learned my addr 172.21.15.59:0/2457536913 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91e6a00640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91e80b1c90 0x7f91e813b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91dfe00640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e8145270 0x7f91e815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91e7400640 1 -- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e8145270 msgr2=0x7f91e815ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91e7400640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e8145270 0x7f91e815ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91e7400640 1 -- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91e80b1c90 msgr2=0x7f91e813b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91e7400640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91e80b1c90 0x7f91e813b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91e7400640 1 -- 172.21.15.59:0/2457536913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e80b3a40 con 0x7f91e815fe50 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91e7400640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e815fe50 0x7f91e815b1c0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f91e0007ef0 tx=0x7f91e000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91dea00640 1 -- 172.21.15.59:0/2457536913 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e001a070 con 0x7f91e815fe50 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91dea00640 1 -- 172.21.15.59:0/2457536913 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e0003ba0 con 0x7f91e815fe50 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91edc00640 1 -- 172.21.15.59:0/2457536913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e80b3d20 con 0x7f91e815fe50 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91dea00640 1 -- 172.21.15.59:0/2457536913 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0004030 con 0x7f91e815fe50 2024-04-25T09:07:35.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91edc00640 1 -- 172.21.15.59:0/2457536913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e80b42e0 con 0x7f91e815fe50 2024-04-25T09:07:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91edc00640 1 -- 172.21.15.59:0/2457536913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e80745d0 con 0x7f91e815fe50 2024-04-25T09:07:35.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.756+0000 7f91dea00640 1 -- 172.21.15.59:0/2457536913 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f91e001d070 con 0x7f91e815fe50 2024-04-25T09:07:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.760+0000 7f91dea00640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f91c4066f90 0x7f91c4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.760+0000 7f91dea00640 1 -- 172.21.15.59:0/2457536913 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f91e0085390 con 0x7f91e815fe50 2024-04-25T09:07:35.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.760+0000 7f91e6a00640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f91c4066f90 0x7f91c4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:35.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.760+0000 7f91e6a00640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f91c4066f90 0x7f91c4069450 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f91d8001810 tx=0x7f91d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:35.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.764+0000 7f91dea00640 1 -- 172.21.15.59:0/2457536913 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f91e0010070 con 0x7f91e815fe50 2024-04-25T09:07:35.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.928+0000 7f91edc00640 1 -- 172.21.15.59:0/2457536913 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91e806ec30 con 0x7f91e815fe50 2024-04-25T09:07:35.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.928+0000 7f91dea00640 1 -- 172.21.15.59:0/2457536913 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17074 (secure 0 0 0) 0x7f91e0055c00 con 0x7f91e815fe50 2024-04-25T09:07:35.918 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:35.919 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":81,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:06:18.012348+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:04.967523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:06.198067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6834/1468235926":"2024-04-26T09:06:18.012326+0000","172.21.15.59:6832/1468235926":"2024-04-26T09:06:18.012326+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.932+0000 7f91edc00640 1 -- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f91c4066f90 msgr2=0x7f91c4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.932+0000 7f91edc00640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f91c4066f90 0x7f91c4069450 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f91d8001810 tx=0x7f91d8009040 comp rx=0 tx=0).stop 2024-04-25T09:07:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.932+0000 7f91edc00640 1 -- 172.21.15.59:0/2457536913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e815fe50 msgr2=0x7f91e815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.932+0000 7f91edc00640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e815fe50 0x7f91e815b1c0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f91e0007ef0 tx=0x7f91e000d4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.932+0000 7f91edc00640 1 -- 172.21.15.59:0/2457536913 shutdown_connections 2024-04-25T09:07:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.932+0000 7f91edc00640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f91c4066f90 0x7f91c4069450 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.932+0000 7f91edc00640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e815fe50 0x7f91e815b1c0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.932+0000 7f91edc00640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e8145270 0x7f91e815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.932+0000 7f91edc00640 1 --2- 172.21.15.59:0/2457536913 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91e80b1c90 0x7f91e813b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.932+0000 7f91edc00640 1 -- 172.21.15.59:0/2457536913 >> 172.21.15.59:0/2457536913 conn(0x7f91e8066fa0 msgr2=0x7f91e813bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.932+0000 7f91edc00640 1 -- 172.21.15.59:0/2457536913 shutdown_connections 2024-04-25T09:07:35.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:35.932+0000 7f91edc00640 1 -- 172.21.15.59:0/2457536913 wait complete. 2024-04-25T09:07:35.941 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:07:35.941 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:36.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.092+0000 7f6259800640 1 Processor -- start 2024-04-25T09:07:36.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.092+0000 7f6259800640 1 -- start start 2024-04-25T09:07:36.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6259800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62540cef30 0x7f625406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6259800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f625406e900 0x7f62540b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6259800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625415ac60 con 0x7f6254144140 2024-04-25T09:07:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6259800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625406ed30 con 0x7f625406e900 2024-04-25T09:07:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6259800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62540cf3e0 con 0x7f62540cef30 2024-04-25T09:07:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6252a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6254144140 0x7f62540ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46930/0 (socket says 172.21.15.59:46930) 2024-04-25T09:07:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6252a00640 1 -- 172.21.15.59:0/2374482614 learned_addr learned my addr 172.21.15.59:0/2374482614 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6253400640 1 --2- 172.21.15.59:0/2374482614 >> v2:172.21.15.178:3300/0 conn(0x7f625406e900 0x7f62540b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f624a000640 1 --2- 172.21.15.59:0/2374482614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62540cef30 0x7f625406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6252000640 1 -- 172.21.15.59:0/2374482614 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951268946 0 0) 0x7f625415ac60 con 0x7f6254144140 2024-04-25T09:07:36.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6252000640 1 -- 172.21.15.59:0/2374482614 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6238003530 con 0x7f6254144140 2024-04-25T09:07:36.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6253400640 1 -- 172.21.15.59:0/2374482614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62540cef30 msgr2=0x7f625406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:36.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6253400640 1 --2- 172.21.15.59:0/2374482614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62540cef30 0x7f625406e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6253400640 1 -- 172.21.15.59:0/2374482614 >> v1:172.21.15.59:6789/0 conn(0x7f6254144140 legacy=0x7f62540ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f6253400640 1 -- 172.21.15.59:0/2374482614 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625415af20 con 0x7f625406e900 2024-04-25T09:07:36.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.096+0000 7f624a000640 1 --2- 172.21.15.59:0/2374482614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62540cef30 0x7f625406e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:36.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6253400640 1 --2- 172.21.15.59:0/2374482614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f625406e900 0x7f62540b0760 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f624c009d90 tx=0x7f624c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=707f445424c277eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:36.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6252000640 1 -- 172.21.15.59:0/2374482614 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0ad070 con 0x7f625406e900 2024-04-25T09:07:36.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6252000640 1 -- 172.21.15.59:0/2374482614 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c0a9660 con 0x7f625406e900 2024-04-25T09:07:36.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6252000640 1 -- 172.21.15.59:0/2374482614 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0a9a30 con 0x7f625406e900 2024-04-25T09:07:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 -- 172.21.15.59:0/2374482614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f625406e900 msgr2=0x7f62540b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 --2- 172.21.15.59:0/2374482614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f625406e900 0x7f62540b0760 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f624c009d90 tx=0x7f624c01c970 comp rx=0 tx=0).stop 2024-04-25T09:07:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 -- 172.21.15.59:0/2374482614 shutdown_connections 2024-04-25T09:07:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 --2- 172.21.15.59:0/2374482614 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f625406e900 0x7f62540b0760 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 --2- 172.21.15.59:0/2374482614 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f62540cef30 0x7f625406e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 -- 172.21.15.59:0/2374482614 >> 172.21.15.59:0/2374482614 conn(0x7f6254066fa0 msgr2=0x7f625406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 -- 172.21.15.59:0/2374482614 shutdown_connections 2024-04-25T09:07:36.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 -- 172.21.15.59:0/2374482614 wait complete. 2024-04-25T09:07:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 Processor -- start 2024-04-25T09:07:36.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 -- start start 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f625406e900 0x7f625412eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62540cef30 0x7f62540b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6254144140 0x7f625413de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625415ba00 con 0x7f6254144140 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6254144520 con 0x7f62540cef30 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.100+0000 7f6259800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625415bb80 con 0x7f625406e900 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6253400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6254144140 0x7f625413de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6253400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6254144140 0x7f625413de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46618/0 (socket says 172.21.15.59:46618) 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6253400640 1 -- 172.21.15.59:0/2714193593 learned_addr learned my addr 172.21.15.59:0/2714193593 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f624a000640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62540cef30 0x7f62540b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6252a00640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f625406e900 0x7f625412eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6253400640 1 -- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f625406e900 msgr2=0x7f625412eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6253400640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f625406e900 0x7f625412eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6253400640 1 -- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62540cef30 msgr2=0x7f62540b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6253400640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62540cef30 0x7f62540b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6253400640 1 -- 172.21.15.59:0/2714193593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62540b3ee0 con 0x7f6254144140 2024-04-25T09:07:36.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f624a000640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62540cef30 0x7f62540b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:36.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6252a00640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f625406e900 0x7f625412eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:36.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6253400640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6254144140 0x7f625413de00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f624c01b020 tx=0x7f624c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:36.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f624b400640 1 -- 172.21.15.59:0/2714193593 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c0ad040 con 0x7f6254144140 2024-04-25T09:07:36.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f624b400640 1 -- 172.21.15.59:0/2714193593 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c0b2660 con 0x7f6254144140 2024-04-25T09:07:36.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f624b400640 1 -- 172.21.15.59:0/2714193593 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c009450 con 0x7f6254144140 2024-04-25T09:07:36.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6259800640 1 -- 172.21.15.59:0/2714193593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625413bbc0 con 0x7f6254144140 2024-04-25T09:07:36.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6259800640 1 -- 172.21.15.59:0/2714193593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62540b3ab0 con 0x7f6254144140 2024-04-25T09:07:36.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f6259800640 1 -- 172.21.15.59:0/2714193593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62540745d0 con 0x7f6254144140 2024-04-25T09:07:36.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.104+0000 7f624b400640 1 -- 172.21.15.59:0/2714193593 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f624c0b0070 con 0x7f6254144140 2024-04-25T09:07:36.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.108+0000 7f624b400640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6230066f60 0x7f6230069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.108+0000 7f624b400640 1 -- 172.21.15.59:0/2714193593 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f624c1200c0 con 0x7f6254144140 2024-04-25T09:07:36.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.108+0000 7f6252a00640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6230066f60 0x7f6230069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.108+0000 7f6252a00640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6230066f60 0x7f6230069420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6244005890 tx=0x7f6244009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:36.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.108+0000 7f624b400640 1 -- 172.21.15.59:0/2714193593 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f624c016560 con 0x7f6254144140 2024-04-25T09:07:36.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.304+0000 7f6259800640 1 -- 172.21.15.59:0/2714193593 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6254164f80 con 0x7f6254144140 2024-04-25T09:07:36.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f624b400640 1 -- 172.21.15.59:0/2714193593 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f624c0f0f10 con 0x7f6254144140 2024-04-25T09:07:36.295 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:36.296 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":56,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:07.181212+0000","modified":"2024-04-25T09:07:05.036822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6834/1033010830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1033010830},{"type":"v1","addr":"172.21.15.59:6834","nonce":1033010830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:07:36.296 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 56 2024-04-25T09:07:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f6259800640 1 -- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6230066f60 msgr2=0x7f6230069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f6259800640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6230066f60 0x7f6230069420 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f6244005890 tx=0x7f6244009040 comp rx=0 tx=0).stop 2024-04-25T09:07:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f6259800640 1 -- 172.21.15.59:0/2714193593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6254144140 msgr2=0x7f625413de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f6259800640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6254144140 0x7f625413de00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f624c01b020 tx=0x7f624c019710 comp rx=0 tx=0).stop 2024-04-25T09:07:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f6259800640 1 -- 172.21.15.59:0/2714193593 shutdown_connections 2024-04-25T09:07:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f6259800640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6230066f60 0x7f6230069420 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f6259800640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6254144140 0x7f625413de00 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f6259800640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f62540cef30 0x7f62540b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f6259800640 1 --2- 172.21.15.59:0/2714193593 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f625406e900 0x7f625412eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f6259800640 1 -- 172.21.15.59:0/2714193593 >> 172.21.15.59:0/2714193593 conn(0x7f6254066fa0 msgr2=0x7f625406de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f6259800640 1 -- 172.21.15.59:0/2714193593 shutdown_connections 2024-04-25T09:07:36.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.308+0000 7f6259800640 1 -- 172.21.15.59:0/2714193593 wait complete. 2024-04-25T09:07:36.316 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:36.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3849a00640 1 Processor -- start 2024-04-25T09:07:36.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3849a00640 1 -- start start 2024-04-25T09:07:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3849a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3844099a60 0x7f3844099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3849a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f384415ee00 0x7f384406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3849a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384409a380 con 0x7f38441616a0 2024-04-25T09:07:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3849a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384406c650 con 0x7f384415ee00 2024-04-25T09:07:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3849a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384406c930 con 0x7f3844099a60 2024-04-25T09:07:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3843400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f38441616a0 0x7f3844161b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46942/0 (socket says 172.21.15.59:46942) 2024-04-25T09:07:36.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3843400640 1 -- 172.21.15.59:0/159838201 learned_addr learned my addr 172.21.15.59:0/159838201 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:36.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3842a00640 1 --2- 172.21.15.59:0/159838201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3844099a60 0x7f3844099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f383be00640 1 --2- 172.21.15.59:0/159838201 >> v2:172.21.15.178:3300/0 conn(0x7f384415ee00 0x7f384406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3842000640 1 -- 172.21.15.59:0/159838201 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232887743 0 0) 0x7f384409a380 con 0x7f38441616a0 2024-04-25T09:07:36.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3842000640 1 -- 172.21.15.59:0/159838201 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3828003530 con 0x7f38441616a0 2024-04-25T09:07:36.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f383be00640 1 -- 172.21.15.59:0/159838201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3844099a60 msgr2=0x7f3844099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:36.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f383be00640 1 --2- 172.21.15.59:0/159838201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3844099a60 0x7f3844099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f383be00640 1 -- 172.21.15.59:0/159838201 >> v1:172.21.15.59:6789/0 conn(0x7f38441616a0 legacy=0x7f3844161b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f383be00640 1 -- 172.21.15.59:0/159838201 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384406cc10 con 0x7f384415ee00 2024-04-25T09:07:36.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.468+0000 7f3842a00640 1 --2- 172.21.15.59:0/159838201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3844099a60 0x7f3844099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:36.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.472+0000 7f383be00640 1 --2- 172.21.15.59:0/159838201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f384415ee00 0x7f384406bd20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f382c0097c0 tx=0x7f382c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a15fbf9b24bc6686 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:36.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.472+0000 7f3842000640 1 -- 172.21.15.59:0/159838201 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c0b0070 con 0x7f384415ee00 2024-04-25T09:07:36.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.472+0000 7f3842000640 1 -- 172.21.15.59:0/159838201 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c004230 con 0x7f384415ee00 2024-04-25T09:07:36.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.472+0000 7f3842000640 1 -- 172.21.15.59:0/159838201 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c003620 con 0x7f384415ee00 2024-04-25T09:07:36.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.472+0000 7f3849a00640 1 -- 172.21.15.59:0/159838201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f384415ee00 msgr2=0x7f384406bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.472+0000 7f3849a00640 1 --2- 172.21.15.59:0/159838201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f384415ee00 0x7f384406bd20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f382c0097c0 tx=0x7f382c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.472+0000 7f3849a00640 1 -- 172.21.15.59:0/159838201 shutdown_connections 2024-04-25T09:07:36.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.472+0000 7f3849a00640 1 --2- 172.21.15.59:0/159838201 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f384415ee00 0x7f384406bd20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.472+0000 7f3849a00640 1 --2- 172.21.15.59:0/159838201 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3844099a60 0x7f3844099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.472+0000 7f3849a00640 1 -- 172.21.15.59:0/159838201 >> 172.21.15.59:0/159838201 conn(0x7f38440d17a0 msgr2=0x7f38440d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:36.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.472+0000 7f3849a00640 1 -- 172.21.15.59:0/159838201 shutdown_connections 2024-04-25T09:07:36.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.472+0000 7f3849a00640 1 -- 172.21.15.59:0/159838201 wait complete. 2024-04-25T09:07:36.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3849a00640 1 Processor -- start 2024-04-25T09:07:36.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3849a00640 1 -- start start 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3849a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3844099a60 0x7f38440b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3849a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f384415ee00 0x7f3844160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3849a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38441616a0 0x7f38441607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3849a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384406c3e0 con 0x7f384415ee00 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3849a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384406c260 con 0x7f38441616a0 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3849a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384416b210 con 0x7f3844099a60 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f383be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f384415ee00 0x7f3844160270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f383be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f384415ee00 0x7f3844160270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46634/0 (socket says 172.21.15.59:46634) 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f383be00640 1 -- 172.21.15.59:0/1213825589 learned_addr learned my addr 172.21.15.59:0/1213825589 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3842a00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3844099a60 0x7f38440b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3843400640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38441616a0 0x7f38441607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f383be00640 1 -- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3844099a60 msgr2=0x7f38440b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f383be00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3844099a60 0x7f38440b7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f383be00640 1 -- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38441616a0 msgr2=0x7f38441607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f383be00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38441616a0 0x7f38441607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f383be00640 1 -- 172.21.15.59:0/1213825589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38440ca020 con 0x7f384415ee00 2024-04-25T09:07:36.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3843400640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38441616a0 0x7f38441607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:36.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f383be00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f384415ee00 0x7f3844160270 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f382c01a0d0 tx=0x7f382c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:36.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f383aa00640 1 -- 172.21.15.59:0/1213825589 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c0b0040 con 0x7f384415ee00 2024-04-25T09:07:36.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f383aa00640 1 -- 172.21.15.59:0/1213825589 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c0bb070 con 0x7f384415ee00 2024-04-25T09:07:36.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3849a00640 1 -- 172.21.15.59:0/1213825589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38440ca300 con 0x7f384415ee00 2024-04-25T09:07:36.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f383aa00640 1 -- 172.21.15.59:0/1213825589 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382c0043e0 con 0x7f384415ee00 2024-04-25T09:07:36.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.476+0000 7f3849a00640 1 -- 172.21.15.59:0/1213825589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3844158e00 con 0x7f384415ee00 2024-04-25T09:07:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.480+0000 7f3849a00640 1 -- 172.21.15.59:0/1213825589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38440745d0 con 0x7f384415ee00 2024-04-25T09:07:36.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.480+0000 7f383aa00640 1 -- 172.21.15.59:0/1213825589 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f382c0b3070 con 0x7f384415ee00 2024-04-25T09:07:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.480+0000 7f383aa00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3820066f60 0x7f3820069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.480+0000 7f383aa00640 1 -- 172.21.15.59:0/1213825589 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f382c11ef10 con 0x7f384415ee00 2024-04-25T09:07:36.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.480+0000 7f3842a00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3820066f60 0x7f3820069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.484+0000 7f3842a00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3820066f60 0x7f3820069420 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3834009580 tx=0x7f3834009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:36.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.484+0000 7f383aa00640 1 -- 172.21.15.59:0/1213825589 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f382c016090 con 0x7f384415ee00 2024-04-25T09:07:36.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.684+0000 7f3849a00640 1 -- 172.21.15.59:0/1213825589 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f384409ae10 con 0x7f384415ee00 2024-04-25T09:07:36.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.684+0000 7f383aa00640 1 -- 172.21.15.59:0/1213825589 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f382c0efca0 con 0x7f384415ee00 2024-04-25T09:07:36.675 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:36.675 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":56,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:06:07.181212+0000","modified":"2024-04-25T09:07:05.036822+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6999},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6999":{"gid":6999,"name":"c","rank":0,"incarnation":51,"state":"up:active","state_seq":15,"addr":"172.21.15.59:6834/1033010830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1033010830},{"type":"v1","addr":"172.21.15.59:6834","nonce":1033010830}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-25T09:07:36.675 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 56 2024-04-25T09:07:36.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.688+0000 7f3849a00640 1 -- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3820066f60 msgr2=0x7f3820069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.688+0000 7f3849a00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3820066f60 0x7f3820069420 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3834009580 tx=0x7f3834009190 comp rx=0 tx=0).stop 2024-04-25T09:07:36.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.688+0000 7f3849a00640 1 -- 172.21.15.59:0/1213825589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f384415ee00 msgr2=0x7f3844160270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.688+0000 7f3849a00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f384415ee00 0x7f3844160270 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f382c01a0d0 tx=0x7f382c019240 comp rx=0 tx=0).stop 2024-04-25T09:07:36.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.688+0000 7f3849a00640 1 -- 172.21.15.59:0/1213825589 shutdown_connections 2024-04-25T09:07:36.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.688+0000 7f3849a00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3820066f60 0x7f3820069420 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.688+0000 7f3849a00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f38441616a0 0x7f38441607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.688+0000 7f3849a00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f384415ee00 0x7f3844160270 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.688+0000 7f3849a00640 1 --2- 172.21.15.59:0/1213825589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3844099a60 0x7f38440b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.688+0000 7f3849a00640 1 -- 172.21.15.59:0/1213825589 >> 172.21.15.59:0/1213825589 conn(0x7f38440d17a0 msgr2=0x7f38440cc670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:36.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.688+0000 7f3849a00640 1 -- 172.21.15.59:0/1213825589 shutdown_connections 2024-04-25T09:07:36.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.688+0000 7f3849a00640 1 -- 172.21.15.59:0/1213825589 wait complete. 2024-04-25T09:07:36.696 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:36.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9b0000640 1 Processor -- start 2024-04-25T09:07:36.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9b0000640 1 -- start start 2024-04-25T09:07:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9b0000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd9a8144140 0x7fd9a80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9b0000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a80ced60 0x7fd9a806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9b0000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9a815ac60 con 0x7fd9a806e900 2024-04-25T09:07:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9b0000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9a806ed70 con 0x7fd9a8144140 2024-04-25T09:07:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9b0000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80cf3e0 con 0x7fd9a80ced60 2024-04-25T09:07:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9ae000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd9a806e900 0x7fd9a815e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46952/0 (socket says 172.21.15.59:46952) 2024-04-25T09:07:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9ae000640 1 -- 172.21.15.59:0/3797718128 learned_addr learned my addr 172.21.15.59:0/3797718128 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9ad600640 1 --2- 172.21.15.59:0/3797718128 >> v2:172.21.15.178:3300/0 conn(0x7fd9a8144140 0x7fd9a80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9acc00640 1 --2- 172.21.15.59:0/3797718128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a80ced60 0x7fd9a806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9a7e00640 1 -- 172.21.15.59:0/3797718128 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794313230 0 0) 0x7fd9a815ac60 con 0x7fd9a806e900 2024-04-25T09:07:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9a7e00640 1 -- 172.21.15.59:0/3797718128 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd990005740 con 0x7fd9a806e900 2024-04-25T09:07:36.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9a7e00640 1 -- 172.21.15.59:0/3797718128 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 62448379 0 0) 0x7fd990005740 con 0x7fd9a806e900 2024-04-25T09:07:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9ad600640 1 -- 172.21.15.59:0/3797718128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a80ced60 msgr2=0x7fd9a806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9ad600640 1 --2- 172.21.15.59:0/3797718128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a80ced60 0x7fd9a806e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9ad600640 1 -- 172.21.15.59:0/3797718128 >> v1:172.21.15.59:6789/0 conn(0x7fd9a806e900 legacy=0x7fd9a815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9ad600640 1 -- 172.21.15.59:0/3797718128 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a815af20 con 0x7fd9a8144140 2024-04-25T09:07:36.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.848+0000 7fd9acc00640 1 --2- 172.21.15.59:0/3797718128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a80ced60 0x7fd9a806e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:36.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.852+0000 7fd9ad600640 1 --2- 172.21.15.59:0/3797718128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a8144140 0x7fd9a80ce820 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0097c0 tx=0x7fd99c01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34b9d4c2d59802c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:36.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.852+0000 7fd9a7e00640 1 -- 172.21.15.59:0/3797718128 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd99c0b0070 con 0x7fd9a8144140 2024-04-25T09:07:36.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.852+0000 7fd9a7e00640 1 -- 172.21.15.59:0/3797718128 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd99c0ab400 con 0x7fd9a8144140 2024-04-25T09:07:36.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.852+0000 7fd9a7e00640 1 -- 172.21.15.59:0/3797718128 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0001a00 con 0x7fd9a8144140 2024-04-25T09:07:36.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.852+0000 7fd9b0000640 1 -- 172.21.15.59:0/3797718128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a8144140 msgr2=0x7fd9a80ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.852+0000 7fd9b0000640 1 --2- 172.21.15.59:0/3797718128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a8144140 0x7fd9a80ce820 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0097c0 tx=0x7fd99c01c3c0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 -- 172.21.15.59:0/3797718128 shutdown_connections 2024-04-25T09:07:36.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 --2- 172.21.15.59:0/3797718128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a80ced60 0x7fd9a806e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 --2- 172.21.15.59:0/3797718128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a8144140 0x7fd9a80ce820 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 -- 172.21.15.59:0/3797718128 >> 172.21.15.59:0/3797718128 conn(0x7fd9a8066fa0 msgr2=0x7fd9a806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:36.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 -- 172.21.15.59:0/3797718128 shutdown_connections 2024-04-25T09:07:36.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 -- 172.21.15.59:0/3797718128 wait complete. 2024-04-25T09:07:36.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 Processor -- start 2024-04-25T09:07:36.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 -- start start 2024-04-25T09:07:36.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a806e900 0x7fd9a813bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a80ced60 0x7fd9a8152ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9a8144140 0x7fd9a8139fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a8144520 con 0x7fd9a8144140 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a80cf140 con 0x7fd9a806e900 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9b0000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9a815ba00 con 0x7fd9a80ced60 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9ae000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9a8144140 0x7fd9a8139fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9ae000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9a8144140 0x7fd9a8139fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46646/0 (socket says 172.21.15.59:46646) 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9ae000640 1 -- 172.21.15.59:0/2533443380 learned_addr learned my addr 172.21.15.59:0/2533443380 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9ad600640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a806e900 0x7fd9a813bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9acc00640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a80ced60 0x7fd9a8152ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9ae000640 1 -- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a80ced60 msgr2=0x7fd9a8152ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9ae000640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a80ced60 0x7fd9a8152ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9ae000640 1 -- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a806e900 msgr2=0x7fd9a813bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:36.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9ae000640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a806e900 0x7fd9a813bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:36.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9ae000640 1 -- 172.21.15.59:0/2533443380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a8153e60 con 0x7fd9a8144140 2024-04-25T09:07:36.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9ad600640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a806e900 0x7fd9a813bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:36.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.856+0000 7fd9ae000640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9a8144140 0x7fd9a8139fa0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0001f60 tx=0x7fd9a000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:36.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.860+0000 7fd9a5600640 1 -- 172.21.15.59:0/2533443380 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0012400 con 0x7fd9a8144140 2024-04-25T09:07:36.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.860+0000 7fd9a5600640 1 -- 172.21.15.59:0/2533443380 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a00125a0 con 0x7fd9a8144140 2024-04-25T09:07:36.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.860+0000 7fd9a5600640 1 -- 172.21.15.59:0/2533443380 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a0012990 con 0x7fd9a8144140 2024-04-25T09:07:36.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.860+0000 7fd9b0000640 1 -- 172.21.15.59:0/2533443380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9a8153020 con 0x7fd9a8144140 2024-04-25T09:07:36.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.860+0000 7fd9b0000640 1 -- 172.21.15.59:0/2533443380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9a81535c0 con 0x7fd9a8144140 2024-04-25T09:07:36.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.860+0000 7fd9b0000640 1 -- 172.21.15.59:0/2533443380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9a80745d0 con 0x7fd9a8144140 2024-04-25T09:07:36.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.860+0000 7fd9a5600640 1 -- 172.21.15.59:0/2533443380 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd9a0012b30 con 0x7fd9a8144140 2024-04-25T09:07:36.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.860+0000 7fd9a5600640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd988066f60 0x7fd988069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:36.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.860+0000 7fd9a5600640 1 -- 172.21.15.59:0/2533443380 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fd9a0085a10 con 0x7fd9a8144140 2024-04-25T09:07:36.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.860+0000 7fd9ad600640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd988066f60 0x7fd988069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:36.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.864+0000 7fd9ad600640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd988066f60 0x7fd988069420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0ad000 tx=0x7fd99c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:36.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:36.864+0000 7fd9a5600640 1 -- 172.21.15.59:0/2533443380 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd9a0012e20 con 0x7fd9a8144140 2024-04-25T09:07:37.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.028+0000 7fd9b0000640 1 -- 172.21.15.59:0/2533443380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9a813a4e0 con 0x7fd9a8144140 2024-04-25T09:07:37.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.028+0000 7fd9a5600640 1 -- 172.21.15.59:0/2533443380 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+17074 (secure 0 0 0) 0x7fd9a0056830 con 0x7fd9a8144140 2024-04-25T09:07:37.018 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:37.018 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":81,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:06:18.012348+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:06:04.967523+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2024-04-25T09:06:06.198067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6834/1468235926":"2024-04-26T09:06:18.012326+0000","172.21.15.59:6832/1468235926":"2024-04-26T09:06:18.012326+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.032+0000 7fd9b0000640 1 -- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd988066f60 msgr2=0x7fd988069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.032+0000 7fd9b0000640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd988066f60 0x7fd988069420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0ad000 tx=0x7fd99c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:07:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.032+0000 7fd9b0000640 1 -- 172.21.15.59:0/2533443380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9a8144140 msgr2=0x7fd9a8139fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.032+0000 7fd9b0000640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9a8144140 0x7fd9a8139fa0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fd9a0001f60 tx=0x7fd9a000a430 comp rx=0 tx=0).stop 2024-04-25T09:07:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.032+0000 7fd9b0000640 1 -- 172.21.15.59:0/2533443380 shutdown_connections 2024-04-25T09:07:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.032+0000 7fd9b0000640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd988066f60 0x7fd988069420 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.032+0000 7fd9b0000640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd9a8144140 0x7fd9a8139fa0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.032+0000 7fd9b0000640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd9a80ced60 0x7fd9a8152ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.032+0000 7fd9b0000640 1 --2- 172.21.15.59:0/2533443380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd9a806e900 0x7fd9a813bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.032+0000 7fd9b0000640 1 -- 172.21.15.59:0/2533443380 >> 172.21.15.59:0/2533443380 conn(0x7fd9a8066fa0 msgr2=0x7fd9a806ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.032+0000 7fd9b0000640 1 -- 172.21.15.59:0/2533443380 shutdown_connections 2024-04-25T09:07:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.032+0000 7fd9b0000640 1 -- 172.21.15.59:0/2533443380 wait complete. 2024-04-25T09:07:37.040 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:07:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.192+0000 7f3947800640 1 Processor -- start 2024-04-25T09:07:37.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.192+0000 7f3947800640 1 -- start start 2024-04-25T09:07:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3947800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f39400d0150 0x7f39400af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3947800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39400c72a0 0x7f39400c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3947800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39400b30d0 con 0x7f394015dc00 2024-04-25T09:07:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3947800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39400cd860 con 0x7f39400d0150 2024-04-25T09:07:37.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3947800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39400ccf30 con 0x7f39400c72a0 2024-04-25T09:07:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3945800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39400c72a0 0x7f39400c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3937e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f39400d0150 0x7f39400af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3945800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39400c72a0 0x7f39400c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:44362/0 (socket says 172.21.15.59:44362) 2024-04-25T09:07:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3945800640 1 -- 172.21.15.59:0/2711255540 learned_addr learned my addr 172.21.15.59:0/2711255540 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:37.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3945800640 1 -- 172.21.15.59:0/2711255540 >> v2:172.21.15.178:3300/0 conn(0x7f39400d0150 msgr2=0x7f39400af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3945800640 1 --2- 172.21.15.59:0/2711255540 >> v2:172.21.15.178:3300/0 conn(0x7f39400d0150 0x7f39400af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3945800640 1 -- 172.21.15.59:0/2711255540 >> v1:172.21.15.178:6789/0 conn(0x7f394015dc00 legacy=0x7f39400c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.196+0000 7f3945800640 1 -- 172.21.15.59:0/2711255540 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400cd210 con 0x7f39400c72a0 2024-04-25T09:07:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3945800640 1 --2- 172.21.15.59:0/2711255540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39400c72a0 0x7f39400c54b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3938009e50 tx=0x7f393801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b4f64dee5939fe7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f393fe00640 1 -- 172.21.15.59:0/2711255540 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39380ac020 con 0x7f39400c72a0 2024-04-25T09:07:37.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f393fe00640 1 -- 172.21.15.59:0/2711255540 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39380a6450 con 0x7f39400c72a0 2024-04-25T09:07:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f393fe00640 1 -- 172.21.15.59:0/2711255540 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39380a6820 con 0x7f39400c72a0 2024-04-25T09:07:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 -- 172.21.15.59:0/2711255540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39400c72a0 msgr2=0x7f39400c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 --2- 172.21.15.59:0/2711255540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39400c72a0 0x7f39400c54b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3938009e50 tx=0x7f393801ca30 comp rx=0 tx=0).stop 2024-04-25T09:07:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 -- 172.21.15.59:0/2711255540 shutdown_connections 2024-04-25T09:07:37.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 --2- 172.21.15.59:0/2711255540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39400c72a0 0x7f39400c54b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 --2- 172.21.15.59:0/2711255540 >> v2:172.21.15.178:3300/0 conn(0x7f39400d0150 0x7f39400af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 -- 172.21.15.59:0/2711255540 >> 172.21.15.59:0/2711255540 conn(0x7f39400b2240 msgr2=0x7f39400b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 -- 172.21.15.59:0/2711255540 shutdown_connections 2024-04-25T09:07:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 -- 172.21.15.59:0/2711255540 wait complete. 2024-04-25T09:07:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 Processor -- start 2024-04-25T09:07:37.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 -- start start 2024-04-25T09:07:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39400c72a0 0x7f394014e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39400d0150 0x7f3940156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394015dc00 0x7f39401510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394016a640 con 0x7f394015dc00 2024-04-25T09:07:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39400cdee0 con 0x7f39400d0150 2024-04-25T09:07:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3947800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394016a7c0 con 0x7f39400c72a0 2024-04-25T09:07:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.200+0000 7f3945800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394015dc00 0x7f39401510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3945800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394015dc00 0x7f39401510f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46654/0 (socket says 172.21.15.59:46654) 2024-04-25T09:07:37.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3945800640 1 -- 172.21.15.59:0/3410102740 learned_addr learned my addr 172.21.15.59:0/3410102740 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3944e00640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39400c72a0 0x7f394014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3937e00640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39400d0150 0x7f3940156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3945800640 1 -- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39400c72a0 msgr2=0x7f394014e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3945800640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39400c72a0 0x7f394014e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3945800640 1 -- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39400d0150 msgr2=0x7f3940156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3945800640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39400d0150 0x7f3940156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3945800640 1 -- 172.21.15.59:0/3410102740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400b5400 con 0x7f394015dc00 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3945800640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394015dc00 0x7f39401510f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f393801a660 tx=0x7f39380197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f393d600640 1 -- 172.21.15.59:0/3410102740 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938009510 con 0x7f394015dc00 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f393d600640 1 -- 172.21.15.59:0/3410102740 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39380bb440 con 0x7f394015dc00 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f393d600640 1 -- 172.21.15.59:0/3410102740 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39380bb810 con 0x7f394015dc00 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3947800640 1 -- 172.21.15.59:0/3410102740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39401572f0 con 0x7f394015dc00 2024-04-25T09:07:37.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3947800640 1 -- 172.21.15.59:0/3410102740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39400b5960 con 0x7f394015dc00 2024-04-25T09:07:37.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f3947800640 1 -- 172.21.15.59:0/3410102740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39400745d0 con 0x7f394015dc00 2024-04-25T09:07:37.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f393d600640 1 -- 172.21.15.59:0/3410102740 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f39380af020 con 0x7f394015dc00 2024-04-25T09:07:37.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f393d600640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f391c066f60 0x7f391c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.204+0000 7f393d600640 1 -- 172.21.15.59:0/3410102740 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f393811f4f0 con 0x7f394015dc00 2024-04-25T09:07:37.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.208+0000 7f3944e00640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f391c066f60 0x7f391c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.208+0000 7f3944e00640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f391c066f60 0x7f391c069420 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f39300015b0 tx=0x7f3930009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:37.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.208+0000 7f393d600640 1 -- 172.21.15.59:0/3410102740 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f39400b5400 con 0x7f394015dc00 2024-04-25T09:07:37.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.408+0000 7f3947800640 1 -- 172.21.15.59:0/3410102740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f39400cf370 con 0x7f394015dc00 2024-04-25T09:07:37.396 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:07:37.408+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:07:37.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.408+0000 7f393d600640 1 -- 172.21.15.59:0/3410102740 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3938016620 con 0x7f394015dc00 2024-04-25T09:07:37.398 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:07:37.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.412+0000 7f3947800640 1 -- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f391c066f60 msgr2=0x7f391c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.412+0000 7f3947800640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f391c066f60 0x7f391c069420 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f39300015b0 tx=0x7f3930009040 comp rx=0 tx=0).stop 2024-04-25T09:07:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.412+0000 7f3947800640 1 -- 172.21.15.59:0/3410102740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394015dc00 msgr2=0x7f39401510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.412+0000 7f3947800640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394015dc00 0x7f39401510f0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f393801a660 tx=0x7f39380197d0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.412+0000 7f3947800640 1 -- 172.21.15.59:0/3410102740 shutdown_connections 2024-04-25T09:07:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.412+0000 7f3947800640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f391c066f60 0x7f391c069420 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.412+0000 7f3947800640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f394015dc00 0x7f39401510f0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.412+0000 7f3947800640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f39400d0150 0x7f3940156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.412+0000 7f3947800640 1 --2- 172.21.15.59:0/3410102740 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f39400c72a0 0x7f394014e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.412+0000 7f3947800640 1 -- 172.21.15.59:0/3410102740 >> 172.21.15.59:0/3410102740 conn(0x7f39400b2240 msgr2=0x7f39400c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.412+0000 7f3947800640 1 -- 172.21.15.59:0/3410102740 shutdown_connections 2024-04-25T09:07:37.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.412+0000 7f3947800640 1 -- 172.21.15.59:0/3410102740 wait complete. 2024-04-25T09:07:37.423 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:07:37.458 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T09:07:37.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bcae00640 1 Processor -- start 2024-04-25T09:07:37.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bcae00640 1 -- start start 2024-04-25T09:07:37.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bcae00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5bc4099a60 0x7f5bc406c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bcae00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bc415ddb0 0x7f5bc4099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bcae00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc409a380 con 0x7f5bc41614d0 2024-04-25T09:07:37.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bcae00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc406ca00 con 0x7f5bc415ddb0 2024-04-25T09:07:37.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bcae00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc406cce0 con 0x7f5bc4099a60 2024-04-25T09:07:37.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bc9000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bc415ddb0 0x7f5bc4099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bca400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5bc41614d0 0x7f5bc41618e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46954/0 (socket says 172.21.15.59:46954) 2024-04-25T09:07:37.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bca400640 1 -- 172.21.15.59:0/793488175 learned_addr learned my addr 172.21.15.59:0/793488175 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bc9000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bc415ddb0 0x7f5bc4099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46676/0 (socket says 172.21.15.59:46676) 2024-04-25T09:07:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bc9a00640 1 --2- 172.21.15.59:0/793488175 >> v2:172.21.15.178:3300/0 conn(0x7f5bc4099a60 0x7f5bc406c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bc9000640 1 -- 172.21.15.59:0/793488175 >> v2:172.21.15.178:3300/0 conn(0x7f5bc4099a60 msgr2=0x7f5bc406c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bc9000640 1 --2- 172.21.15.59:0/793488175 >> v2:172.21.15.178:3300/0 conn(0x7f5bc4099a60 0x7f5bc406c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bc9000640 1 -- 172.21.15.59:0/793488175 >> v1:172.21.15.59:6789/0 conn(0x7f5bc41614d0 legacy=0x7f5bc41618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bc3e00640 1 -- 172.21.15.59:0/793488175 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154217700 0 0) 0x7f5bc409a380 con 0x7f5bc41614d0 2024-04-25T09:07:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bc9000640 1 -- 172.21.15.59:0/793488175 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc406cfc0 con 0x7f5bc415ddb0 2024-04-25T09:07:37.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.580+0000 7f5bc9a00640 1 --2- 172.21.15.59:0/793488175 >> v2:172.21.15.178:3300/0 conn(0x7f5bc4099a60 0x7f5bc406c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:37.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.584+0000 7f5bc9000640 1 --2- 172.21.15.59:0/793488175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bc415ddb0 0x7f5bc4099e40 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4072920 tx=0x7f5bb001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6375df7c9170fdc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:37.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.584+0000 7f5bc3e00640 1 -- 172.21.15.59:0/793488175 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb00ab650 con 0x7f5bc415ddb0 2024-04-25T09:07:37.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.584+0000 7f5bc3e00640 1 -- 172.21.15.59:0/793488175 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb00b0070 con 0x7f5bc415ddb0 2024-04-25T09:07:37.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.584+0000 7f5bc3e00640 1 -- 172.21.15.59:0/793488175 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb00aba10 con 0x7f5bc415ddb0 2024-04-25T09:07:37.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.584+0000 7f5bcae00640 1 -- 172.21.15.59:0/793488175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bc415ddb0 msgr2=0x7f5bc4099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.584+0000 7f5bcae00640 1 --2- 172.21.15.59:0/793488175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bc415ddb0 0x7f5bc4099e40 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4072920 tx=0x7f5bb001c450 comp rx=0 tx=0).stop 2024-04-25T09:07:37.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.584+0000 7f5bcae00640 1 -- 172.21.15.59:0/793488175 shutdown_connections 2024-04-25T09:07:37.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.584+0000 7f5bcae00640 1 --2- 172.21.15.59:0/793488175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bc415ddb0 0x7f5bc4099e40 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.584+0000 7f5bcae00640 1 --2- 172.21.15.59:0/793488175 >> v2:172.21.15.178:3300/0 conn(0x7f5bc4099a60 0x7f5bc406c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.584+0000 7f5bcae00640 1 -- 172.21.15.59:0/793488175 >> 172.21.15.59:0/793488175 conn(0x7f5bc40d15d0 msgr2=0x7f5bc40d19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:37.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.584+0000 7f5bcae00640 1 -- 172.21.15.59:0/793488175 shutdown_connections 2024-04-25T09:07:37.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.584+0000 7f5bcae00640 1 -- 172.21.15.59:0/793488175 wait complete. 2024-04-25T09:07:37.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bcae00640 1 Processor -- start 2024-04-25T09:07:37.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bcae00640 1 -- start start 2024-04-25T09:07:37.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bcae00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bc4099a60 0x7f5bc415aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bcae00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bc415ddb0 0x7f5bc40af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bcae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bc41614d0 0x7f5bc40afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bcae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc409abe0 con 0x7f5bc41614d0 2024-04-25T09:07:37.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bcae00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc409aa60 con 0x7f5bc4099a60 2024-04-25T09:07:37.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bcae00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc416b020 con 0x7f5bc415ddb0 2024-04-25T09:07:37.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bca400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bc41614d0 0x7f5bc40afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bca400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bc41614d0 0x7f5bc40afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46684/0 (socket says 172.21.15.59:46684) 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bca400640 1 -- 172.21.15.59:0/3998631624 learned_addr learned my addr 172.21.15.59:0/3998631624 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bc9a00640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bc4099a60 0x7f5bc415aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bc9000640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bc415ddb0 0x7f5bc40af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bca400640 1 -- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bc415ddb0 msgr2=0x7f5bc40af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bca400640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bc415ddb0 0x7f5bc40af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bca400640 1 -- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bc4099a60 msgr2=0x7f5bc415aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bca400640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bc4099a60 0x7f5bc415aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bca400640 1 -- 172.21.15.59:0/3998631624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc40b6190 con 0x7f5bc41614d0 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bca400640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bc41614d0 0x7f5bc40afe60 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00c730 tx=0x7f5bbc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bc1600640 1 -- 172.21.15.59:0/3998631624 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc018070 con 0x7f5bc41614d0 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bc1600640 1 -- 172.21.15.59:0/3998631624 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc00ce40 con 0x7f5bc41614d0 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bc1600640 1 -- 172.21.15.59:0/3998631624 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00a860 con 0x7f5bc41614d0 2024-04-25T09:07:37.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bcae00640 1 -- 172.21.15.59:0/3998631624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc40c5100 con 0x7f5bc41614d0 2024-04-25T09:07:37.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.588+0000 7f5bcae00640 1 -- 172.21.15.59:0/3998631624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc40c56c0 con 0x7f5bc41614d0 2024-04-25T09:07:37.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.592+0000 7f5bcae00640 1 -- 172.21.15.59:0/3998631624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc4068670 con 0x7f5bc41614d0 2024-04-25T09:07:37.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.592+0000 7f5bc1600640 1 -- 172.21.15.59:0/3998631624 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5bbc01b070 con 0x7f5bc41614d0 2024-04-25T09:07:37.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.592+0000 7f5bc1600640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ba4066f60 0x7f5ba4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:37.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.592+0000 7f5bc1600640 1 -- 172.21.15.59:0/3998631624 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f5bbc084940 con 0x7f5bc41614d0 2024-04-25T09:07:37.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.592+0000 7f5bc9a00640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ba4066f60 0x7f5ba4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:37.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.592+0000 7f5bc9a00640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ba4066f60 0x7f5ba4069420 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c900 tx=0x7f5bb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:37.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.596+0000 7f5bc1600640 1 -- 172.21.15.59:0/3998631624 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5bbc0555e0 con 0x7f5bc41614d0 2024-04-25T09:07:37.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:37.792+0000 7f5bcae00640 1 -- 172.21.15.59:0/3998631624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5bc40d0900 con 0x7f5bc41614d0 2024-04-25T09:07:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.412+0000 7f5bc1600640 1 -- 172.21.15.59:0/3998631624 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5bbc054ee0 con 0x7f5bc41614d0 2024-04-25T09:07:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.416+0000 7f5bcae00640 1 -- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ba4066f60 msgr2=0x7f5ba4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.416+0000 7f5bcae00640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ba4066f60 0x7f5ba4069420 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c900 tx=0x7f5bb8008040 comp rx=0 tx=0).stop 2024-04-25T09:07:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.416+0000 7f5bcae00640 1 -- 172.21.15.59:0/3998631624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bc41614d0 msgr2=0x7f5bc40afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.416+0000 7f5bcae00640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bc41614d0 0x7f5bc40afe60 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00c730 tx=0x7f5bbc00cbf0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.416+0000 7f5bcae00640 1 -- 172.21.15.59:0/3998631624 shutdown_connections 2024-04-25T09:07:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.416+0000 7f5bcae00640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ba4066f60 0x7f5ba4069420 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.416+0000 7f5bcae00640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bc41614d0 0x7f5bc40afe60 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.416+0000 7f5bcae00640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5bc415ddb0 0x7f5bc40af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.416+0000 7f5bcae00640 1 --2- 172.21.15.59:0/3998631624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5bc4099a60 0x7f5bc415aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.416+0000 7f5bcae00640 1 -- 172.21.15.59:0/3998631624 >> 172.21.15.59:0/3998631624 conn(0x7f5bc40d15d0 msgr2=0x7f5bc41618e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.416+0000 7f5bcae00640 1 -- 172.21.15.59:0/3998631624 shutdown_connections 2024-04-25T09:07:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.416+0000 7f5bcae00640 1 -- 172.21.15.59:0/3998631624 wait complete. 2024-04-25T09:07:38.428 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:07:38.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.632+0000 7f2072600640 1 Processor -- start 2024-04-25T09:07:38.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.632+0000 7f2072600640 1 -- start start 2024-04-25T09:07:38.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.632+0000 7f2072600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f206c071e40 0x7f206c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.632+0000 7f2072600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c0cf490 con 0x7f206c144080 2024-04-25T09:07:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.632+0000 7f2072600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206c0cf1b0 con 0x7f206c06e900 2024-04-25T09:07:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.632+0000 7f2072600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f206c06ed70 con 0x7f206c071e40 2024-04-25T09:07:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.632+0000 7f206b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f206c144080 0x7f206c0ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46958/0 (socket says 172.21.15.59:46958) 2024-04-25T09:07:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.632+0000 7f206b400640 1 -- 172.21.15.59:0/1736472411 learned_addr learned my addr 172.21.15.59:0/1736472411 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.632+0000 7f2062a00640 1 --2- 172.21.15.59:0/1736472411 >> v2:172.21.15.178:3300/0 conn(0x7f206c071e40 0x7f206c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.632+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477421577 0 0) 0x7f206c0cf490 con 0x7f206c144080 2024-04-25T09:07:38.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.632+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2050003530 con 0x7f206c144080 2024-04-25T09:07:38.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3022439692 0 0) 0x7f2050003530 con 0x7f206c144080 2024-04-25T09:07:38.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 >> v2:172.21.15.178:3300/0 conn(0x7f206c071e40 msgr2=0x7f206c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:38.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 --2- 172.21.15.59:0/1736472411 >> v2:172.21.15.178:3300/0 conn(0x7f206c071e40 0x7f206c06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 >> v1:172.21.15.178:6789/0 conn(0x7f206c06e900 legacy=0x7f206c15e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c071360 con 0x7f206c144080 2024-04-25T09:07:38.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f205c001680 con 0x7f206c144080 2024-04-25T09:07:38.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 >> v1:172.21.15.59:6789/0 conn(0x7f206c144080 legacy=0x7f206c0ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 --2- 172.21.15.59:0/1736472411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2050003a10 0x7f2050003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 --2- 172.21.15.59:0/1736472411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2050004810 0x7f2050004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 --2- 172.21.15.59:0/1736472411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20500051d0 0x7f205000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c06ed70 con 0x7f2050004810 2024-04-25T09:07:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205000c0d0 con 0x7f20500051d0 2024-04-25T09:07:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205000c2d0 con 0x7f2050003a10 2024-04-25T09:07:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f2062a00640 1 --2- 172.21.15.59:0/1736472411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2050004810 0x7f2050004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206b400640 1 --2- 172.21.15.59:0/1736472411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2050003a10 0x7f2050003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206be00640 1 --2- 172.21.15.59:0/1736472411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20500051d0 0x7f205000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f2062a00640 1 -- 172.21.15.59:0/1736472411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2050003a10 msgr2=0x7f2050003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f2062a00640 1 --2- 172.21.15.59:0/1736472411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2050003a10 0x7f2050003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f2062a00640 1 -- 172.21.15.59:0/1736472411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20500051d0 msgr2=0x7f205000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f2062a00640 1 --2- 172.21.15.59:0/1736472411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20500051d0 0x7f205000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f2062a00640 1 -- 172.21.15.59:0/1736472411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2050003530 con 0x7f2050004810 2024-04-25T09:07:38.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f206be00640 1 -- 172.21.15.59:0/1736472411 reap_dead start 2024-04-25T09:07:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.636+0000 7f2062a00640 1 --2- 172.21.15.59:0/1736472411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2050004810 0x7f2050004c90 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2054009670 tx=0x7f205401eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fd0d97cf1ab2d9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540b4070 con 0x7f2050004810 2024-04-25T09:07:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20540a7790 con 0x7f2050004810 2024-04-25T09:07:38.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f206aa00640 1 -- 172.21.15.59:0/1736472411 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540096b0 con 0x7f2050004810 2024-04-25T09:07:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 -- 172.21.15.59:0/1736472411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2050004810 msgr2=0x7f2050004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 --2- 172.21.15.59:0/1736472411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2050004810 0x7f2050004c90 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2054009670 tx=0x7f205401eca0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 -- 172.21.15.59:0/1736472411 shutdown_connections 2024-04-25T09:07:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 --2- 172.21.15.59:0/1736472411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2050004810 0x7f2050004c90 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 -- 172.21.15.59:0/1736472411 >> 172.21.15.59:0/1736472411 conn(0x7f206c06ac10 msgr2=0x7f206c06b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 -- 172.21.15.59:0/1736472411 shutdown_connections 2024-04-25T09:07:38.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 -- 172.21.15.59:0/1736472411 wait complete. 2024-04-25T09:07:38.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 Processor -- start 2024-04-25T09:07:38.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 -- start start 2024-04-25T09:07:38.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2050004810 0x7f206c15c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c138800 0x7f206c141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206c138c80 0x7f206c141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c144460 con 0x7f206c138c80 2024-04-25T09:07:38.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0719b0 con 0x7f206c138800 2024-04-25T09:07:38.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2072600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206c0b4950 con 0x7f2050004810 2024-04-25T09:07:38.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f206be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206c138c80 0x7f206c141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f206be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206c138c80 0x7f206c141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46704/0 (socket says 172.21.15.59:46704) 2024-04-25T09:07:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f206be00640 1 -- 172.21.15.59:0/2855348362 learned_addr learned my addr 172.21.15.59:0/2855348362 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f2062a00640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c138800 0x7f206c141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.640+0000 7f206b400640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2050004810 0x7f206c15c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f206be00640 1 -- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2050004810 msgr2=0x7f206c15c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f206be00640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2050004810 0x7f206c15c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f206be00640 1 -- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c138800 msgr2=0x7f206c141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f206be00640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c138800 0x7f206c141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f206be00640 1 -- 172.21.15.59:0/2855348362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c1394e0 con 0x7f206c138c80 2024-04-25T09:07:38.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f206be00640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206c138c80 0x7f206c141ac0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f206c06b9c0 tx=0x7f206400e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f2063e00640 1 -- 172.21.15.59:0/2855348362 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064019070 con 0x7f206c138c80 2024-04-25T09:07:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f2063e00640 1 -- 172.21.15.59:0/2855348362 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2064006e30 con 0x7f206c138c80 2024-04-25T09:07:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f2063e00640 1 -- 172.21.15.59:0/2855348362 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064003ba0 con 0x7f206c138c80 2024-04-25T09:07:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f2072600640 1 -- 172.21.15.59:0/2855348362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206c1f0770 con 0x7f206c138c80 2024-04-25T09:07:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f2072600640 1 -- 172.21.15.59:0/2855348362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206c1ef9b0 con 0x7f206c138c80 2024-04-25T09:07:38.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f2072600640 1 -- 172.21.15.59:0/2855348362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206c0745d0 con 0x7f206c138c80 2024-04-25T09:07:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f2063e00640 1 -- 172.21.15.59:0/2855348362 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2064005070 con 0x7f206c138c80 2024-04-25T09:07:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f2063e00640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2048066f60 0x7f2048069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:38.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f2063e00640 1 -- 172.21.15.59:0/2855348362 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f2064084730 con 0x7f206c138c80 2024-04-25T09:07:38.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.644+0000 7f206b400640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2048066f60 0x7f2048069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:38.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.648+0000 7f206b400640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2048066f60 0x7f2048069420 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f205c007c20 tx=0x7f205c000ee0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:38.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.648+0000 7f2063e00640 1 -- 172.21.15.59:0/2855348362 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f206c1394e0 con 0x7f206c138c80 2024-04-25T09:07:38.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:38.812+0000 7f2072600640 1 -- 172.21.15.59:0/2855348362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f206c0b4580 con 0x7f206c138c80 2024-04-25T09:07:39.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.420+0000 7f2063e00640 1 -- 172.21.15.59:0/2855348362 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v83) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2064054e10 con 0x7f206c138c80 2024-04-25T09:07:39.411 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:07:39.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.424+0000 7f2072600640 1 -- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2048066f60 msgr2=0x7f2048069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.424+0000 7f2072600640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2048066f60 0x7f2048069420 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f205c007c20 tx=0x7f205c000ee0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.424+0000 7f2072600640 1 -- 172.21.15.59:0/2855348362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206c138c80 msgr2=0x7f206c141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.424+0000 7f2072600640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206c138c80 0x7f206c141ac0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f206c06b9c0 tx=0x7f206400e8a0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.424+0000 7f2072600640 1 -- 172.21.15.59:0/2855348362 shutdown_connections 2024-04-25T09:07:39.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.424+0000 7f2072600640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2048066f60 0x7f2048069420 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.424+0000 7f2072600640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206c138c80 0x7f206c141ac0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.424+0000 7f2072600640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206c138800 0x7f206c141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.424+0000 7f2072600640 1 --2- 172.21.15.59:0/2855348362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2050004810 0x7f206c15c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.424+0000 7f2072600640 1 -- 172.21.15.59:0/2855348362 >> 172.21.15.59:0/2855348362 conn(0x7f206c06ac10 msgr2=0x7f206c06dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:39.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.424+0000 7f2072600640 1 -- 172.21.15.59:0/2855348362 shutdown_connections 2024-04-25T09:07:39.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.424+0000 7f2072600640 1 -- 172.21.15.59:0/2855348362 wait complete. 2024-04-25T09:07:39.437 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:07:39.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f0587c00640 1 Processor -- start 2024-04-25T09:07:39.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f0587c00640 1 -- start start 2024-04-25T09:07:39.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f0587c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0580071250 0x7f05800cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f0587c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058015ccc0 con 0x7f0580071630 2024-04-25T09:07:39.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f0587c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0580160200 con 0x7f058015c4a0 2024-04-25T09:07:39.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f0587c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058015c9e0 con 0x7f0580071250 2024-04-25T09:07:39.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f0577e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0580071630 0x7f058015bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46964/0 (socket says 172.21.15.59:46964) 2024-04-25T09:07:39.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f0577e00640 1 -- 172.21.15.59:0/3227472621 learned_addr learned my addr 172.21.15.59:0/3227472621 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f0585200640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0580071250 0x7f05800cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000533994 0 0) 0x7f058015ccc0 con 0x7f0580071630 2024-04-25T09:07:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0564003530 con 0x7f0580071630 2024-04-25T09:07:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119655884 0 0) 0x7f0580160200 con 0x7f058015c4a0 2024-04-25T09:07:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f058015ccc0 con 0x7f058015c4a0 2024-04-25T09:07:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3062212081 0 0) 0x7f0564003530 con 0x7f0580071630 2024-04-25T09:07:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0580071250 msgr2=0x7f05800cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0580071250 0x7f05800cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 >> v1:172.21.15.178:6789/0 conn(0x7f058015c4a0 legacy=0x7f058015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05800cd4b0 con 0x7f0580071630 2024-04-25T09:07:39.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f0568001680 con 0x7f0580071630 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f0585200640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0580071250 0x7f05800cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 >> v1:172.21.15.59:6789/0 conn(0x7f0580071630 legacy=0x7f058015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0580071250 0x7f0564003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564004110 0x7f0564004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0564004d50 0x7f05640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058015c9e0 con 0x7f0564004d50 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056400bc10 con 0x7f0564004110 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056400be10 con 0x7f0580071250 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f0585c00640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0564004d50 0x7f05640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.596+0000 7f0585200640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0580071250 0x7f0564003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0577e00640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564004110 0x7f0564004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0585c00640 1 -- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0580071250 msgr2=0x7f0564003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0585c00640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0580071250 0x7f0564003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0585c00640 1 -- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564004110 msgr2=0x7f0564004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:39.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0585c00640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564004110 0x7f0564004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0585c00640 1 -- 172.21.15.59:0/3227472621 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0564003530 con 0x7f0564004d50 2024-04-25T09:07:39.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0577e00640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0564004110 0x7f0564004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0585c00640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0564004d50 0x7f05640051d0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f058015c910 tx=0x7f058015de00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2de15bff989a85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578001c20 con 0x7f0564004d50 2024-04-25T09:07:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0578003ba0 con 0x7f0564004d50 2024-04-25T09:07:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f057fe00640 1 -- 172.21.15.59:0/3227472621 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05780050d0 con 0x7f0564004d50 2024-04-25T09:07:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0587c00640 1 -- 172.21.15.59:0/3227472621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0564004d50 msgr2=0x7f05640051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0587c00640 1 --2- 172.21.15.59:0/3227472621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0564004d50 0x7f05640051d0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f058015c910 tx=0x7f058015de00 comp rx=0 tx=0).stop 2024-04-25T09:07:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0585c00640 1 -- 172.21.15.59:0/3227472621 reap_dead start 2024-04-25T09:07:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0587c00640 1 -- 172.21.15.59:0/3227472621 shutdown_connections 2024-04-25T09:07:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0587c00640 1 -- 172.21.15.59:0/3227472621 >> 172.21.15.59:0/3227472621 conn(0x7f058006ac10 msgr2=0x7f058006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.600+0000 7f0587c00640 1 -- 172.21.15.59:0/3227472621 shutdown_connections 2024-04-25T09:07:39.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0587c00640 1 -- 172.21.15.59:0/3227472621 wait complete. 2024-04-25T09:07:39.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0587c00640 1 Processor -- start 2024-04-25T09:07:39.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0587c00640 1 -- start start 2024-04-25T09:07:39.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0587c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0564004d50 0x7f0580156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0587c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0580152e40 0x7f05800b0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0587c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f058014a580 0x7f058014aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0587c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800b2990 con 0x7f0564004d50 2024-04-25T09:07:39.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0587c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05800b2810 con 0x7f0580152e40 2024-04-25T09:07:39.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0587c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05800b2b10 con 0x7f058014a580 2024-04-25T09:07:39.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0585200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0564004d50 0x7f0580156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0585200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0564004d50 0x7f0580156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46716/0 (socket says 172.21.15.59:46716) 2024-04-25T09:07:39.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0585200640 1 -- 172.21.15.59:0/2432500749 learned_addr learned my addr 172.21.15.59:0/2432500749 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:39.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0585c00640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f058014a580 0x7f058014aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0577e00640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0580152e40 0x7f05800b0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0585200640 1 -- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f058014a580 msgr2=0x7f058014aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0585200640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f058014a580 0x7f058014aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0585200640 1 -- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0580152e40 msgr2=0x7f05800b0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:39.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0585200640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0580152e40 0x7f05800b0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:39.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0585200640 1 -- 172.21.15.59:0/2432500749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05801f2330 con 0x7f0564004d50 2024-04-25T09:07:39.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f0585200640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0564004d50 0x7f0580156df0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f05700119d0 tx=0x7f0570011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:39.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.604+0000 7f057d600640 1 -- 172.21.15.59:0/2432500749 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057000fb50 con 0x7f0564004d50 2024-04-25T09:07:39.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.608+0000 7f057d600640 1 -- 172.21.15.59:0/2432500749 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057000fcf0 con 0x7f0564004d50 2024-04-25T09:07:39.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.608+0000 7f057d600640 1 -- 172.21.15.59:0/2432500749 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057000fea0 con 0x7f0564004d50 2024-04-25T09:07:39.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.608+0000 7f0587c00640 1 -- 172.21.15.59:0/2432500749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0580153620 con 0x7f0564004d50 2024-04-25T09:07:39.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.608+0000 7f0587c00640 1 -- 172.21.15.59:0/2432500749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0580153be0 con 0x7f0564004d50 2024-04-25T09:07:39.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.608+0000 7f0587c00640 1 -- 172.21.15.59:0/2432500749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05800745d0 con 0x7f0564004d50 2024-04-25T09:07:39.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.608+0000 7f057d600640 1 -- 172.21.15.59:0/2432500749 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0570012040 con 0x7f0564004d50 2024-04-25T09:07:39.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.608+0000 7f057d600640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f055c066f90 0x7f055c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:39.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.608+0000 7f057d600640 1 -- 172.21.15.59:0/2432500749 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5835+0+0 (secure 0 0 0) 0x7f0570085790 con 0x7f0564004d50 2024-04-25T09:07:39.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.608+0000 7f0577e00640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f055c066f90 0x7f055c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:39.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.608+0000 7f0577e00640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f055c066f90 0x7f055c069450 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f058014b9f0 tx=0x7f0568009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:39.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.612+0000 7f057d600640 1 -- 172.21.15.59:0/2432500749 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0570019030 con 0x7f0564004d50 2024-04-25T09:07:39.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:39.780+0000 7f0587c00640 1 -- 172.21.15.59:0/2432500749 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f058015b690 con 0x7f0564004d50 2024-04-25T09:07:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.424+0000 7f057d600640 1 -- 172.21.15.59:0/2432500749 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v84) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0570056680 con 0x7f0564004d50 2024-04-25T09:07:40.413 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-04-25T09:07:40.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.428+0000 7f0587c00640 1 -- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f055c066f90 msgr2=0x7f055c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.428+0000 7f0587c00640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f055c066f90 0x7f055c069450 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f058014b9f0 tx=0x7f0568009040 comp rx=0 tx=0).stop 2024-04-25T09:07:40.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.428+0000 7f0587c00640 1 -- 172.21.15.59:0/2432500749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0564004d50 msgr2=0x7f0580156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.428+0000 7f0587c00640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0564004d50 0x7f0580156df0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f05700119d0 tx=0x7f0570011e90 comp rx=0 tx=0).stop 2024-04-25T09:07:40.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.428+0000 7f0587c00640 1 -- 172.21.15.59:0/2432500749 shutdown_connections 2024-04-25T09:07:40.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.428+0000 7f0587c00640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f055c066f90 0x7f055c069450 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.428+0000 7f0587c00640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f058014a580 0x7f058014aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.428+0000 7f0587c00640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0580152e40 0x7f05800b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.428+0000 7f0587c00640 1 --2- 172.21.15.59:0/2432500749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0564004d50 0x7f0580156df0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.428+0000 7f0587c00640 1 -- 172.21.15.59:0/2432500749 >> 172.21.15.59:0/2432500749 conn(0x7f058006ac10 msgr2=0x7f05800af330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.428+0000 7f0587c00640 1 -- 172.21.15.59:0/2432500749 shutdown_connections 2024-04-25T09:07:40.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.428+0000 7f0587c00640 1 -- 172.21.15.59:0/2432500749 wait complete. 2024-04-25T09:07:40.442 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:07:40.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f3400640 1 Processor -- start 2024-04-25T09:07:40.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f3400640 1 -- start start 2024-04-25T09:07:40.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f3400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f92ec15c9b0 0x7f92ec06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f3400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92ec06e010 0x7f92ec06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f3400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92ec15fc00 con 0x7f92ec159320 2024-04-25T09:07:40.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f3400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92ec06d640 con 0x7f92ec15c9b0 2024-04-25T09:07:40.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f3400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec15fee0 con 0x7f92ec06e010 2024-04-25T09:07:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f1400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92ec06e010 0x7f92ec06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92ebe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f92ec15c9b0 0x7f92ec06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f1400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92ec06e010 0x7f92ec06e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:60606/0 (socket says 172.21.15.59:60606) 2024-04-25T09:07:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f1400640 1 -- 172.21.15.59:0/88907557 learned_addr learned my addr 172.21.15.59:0/88907557 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f1400640 1 -- 172.21.15.59:0/88907557 >> v2:172.21.15.178:3300/0 conn(0x7f92ec15c9b0 msgr2=0x7f92ec06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:40.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f1400640 1 --2- 172.21.15.59:0/88907557 >> v2:172.21.15.178:3300/0 conn(0x7f92ec15c9b0 0x7f92ec06dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f1400640 1 -- 172.21.15.59:0/88907557 >> v1:172.21.15.178:6789/0 conn(0x7f92ec159320 legacy=0x7f92ec15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.600+0000 7f92f1400640 1 -- 172.21.15.59:0/88907557 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec1601c0 con 0x7f92ec06e010 2024-04-25T09:07:40.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.604+0000 7f92f1400640 1 --2- 172.21.15.59:0/88907557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92ec06e010 0x7f92ec06e4a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009e50 tx=0x7f92e401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a656363032a8f1af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:40.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.604+0000 7f92eb400640 1 -- 172.21.15.59:0/88907557 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e40a5700 con 0x7f92ec06e010 2024-04-25T09:07:40.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.604+0000 7f92eb400640 1 -- 172.21.15.59:0/88907557 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e40a58a0 con 0x7f92ec06e010 2024-04-25T09:07:40.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.604+0000 7f92eb400640 1 -- 172.21.15.59:0/88907557 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e40a5c70 con 0x7f92ec06e010 2024-04-25T09:07:40.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.604+0000 7f92f3400640 1 -- 172.21.15.59:0/88907557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92ec06e010 msgr2=0x7f92ec06e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.604+0000 7f92f3400640 1 --2- 172.21.15.59:0/88907557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92ec06e010 0x7f92ec06e4a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009e50 tx=0x7f92e401ca30 comp rx=0 tx=0).stop 2024-04-25T09:07:40.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.604+0000 7f92f3400640 1 -- 172.21.15.59:0/88907557 shutdown_connections 2024-04-25T09:07:40.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.604+0000 7f92f3400640 1 --2- 172.21.15.59:0/88907557 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92ec06e010 0x7f92ec06e4a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.604+0000 7f92f3400640 1 --2- 172.21.15.59:0/88907557 >> v2:172.21.15.178:3300/0 conn(0x7f92ec15c9b0 0x7f92ec06dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.604+0000 7f92f3400640 1 -- 172.21.15.59:0/88907557 >> 172.21.15.59:0/88907557 conn(0x7f92ec067080 msgr2=0x7f92ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:40.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.604+0000 7f92f3400640 1 -- 172.21.15.59:0/88907557 shutdown_connections 2024-04-25T09:07:40.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.604+0000 7f92f3400640 1 -- 172.21.15.59:0/88907557 wait complete. 2024-04-25T09:07:40.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f3400640 1 Processor -- start 2024-04-25T09:07:40.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f3400640 1 -- start start 2024-04-25T09:07:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92ec06e010 0x7f92ec0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f3400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92ec159320 0x7f92ec1580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92ec15c9b0 0x7f92ec0b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f3400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec168920 con 0x7f92ec06e010 2024-04-25T09:07:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f3400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec1687a0 con 0x7f92ec15c9b0 2024-04-25T09:07:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f3400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92ec168aa0 con 0x7f92ec159320 2024-04-25T09:07:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92ec06e010 0x7f92ec0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92ec06e010 0x7f92ec0afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41230/0 (socket says 172.21.15.59:41230) 2024-04-25T09:07:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f0a00640 1 -- 172.21.15.59:0/1447583880 learned_addr learned my addr 172.21.15.59:0/1447583880 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:40.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92ebe00640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92ec159320 0x7f92ec1580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f1400640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92ec15c9b0 0x7f92ec0b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f0a00640 1 -- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92ec159320 msgr2=0x7f92ec1580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f0a00640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92ec159320 0x7f92ec1580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f0a00640 1 -- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92ec15c9b0 msgr2=0x7f92ec0b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f0a00640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92ec15c9b0 0x7f92ec0b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f0a00640 1 -- 172.21.15.59:0/1447583880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ec0b2c30 con 0x7f92ec06e010 2024-04-25T09:07:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f0a00640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92ec06e010 0x7f92ec0afc80 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c420 tx=0x7f92e000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92e8c00640 1 -- 172.21.15.59:0/1447583880 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e00052d0 con 0x7f92ec06e010 2024-04-25T09:07:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92e8c00640 1 -- 172.21.15.59:0/1447583880 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e0005470 con 0x7f92ec06e010 2024-04-25T09:07:40.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f3400640 1 -- 172.21.15.59:0/1447583880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92ec141430 con 0x7f92ec06e010 2024-04-25T09:07:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92e8c00640 1 -- 172.21.15.59:0/1447583880 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e0007260 con 0x7f92ec06e010 2024-04-25T09:07:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.608+0000 7f92f3400640 1 -- 172.21.15.59:0/1447583880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92ec0b2eb0 con 0x7f92ec06e010 2024-04-25T09:07:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.612+0000 7f92f3400640 1 -- 172.21.15.59:0/1447583880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92ec0745d0 con 0x7f92ec06e010 2024-04-25T09:07:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.612+0000 7f92e8c00640 1 -- 172.21.15.59:0/1447583880 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f92e0007400 con 0x7f92ec06e010 2024-04-25T09:07:40.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.612+0000 7f92e8c00640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92cc066f60 0x7f92cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.612+0000 7f92e8c00640 1 -- 172.21.15.59:0/1447583880 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f92e0084430 con 0x7f92ec06e010 2024-04-25T09:07:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.612+0000 7f92ebe00640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92cc066f60 0x7f92cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.612+0000 7f92ebe00640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92cc066f60 0x7f92cc069420 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f92ec1fa5e0 tx=0x7f92d8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:40.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.616+0000 7f92e8c00640 1 -- 172.21.15.59:0/1447583880 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f92ec0b2c30 con 0x7f92ec06e010 2024-04-25T09:07:40.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.780+0000 7f92f3400640 1 -- 172.21.15.59:0/1447583880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f92ec15e680 con 0x7f92ec06e010 2024-04-25T09:07:40.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92e8c00640 1 -- 172.21.15.59:0/1447583880 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f92e0054e70 con 0x7f92ec06e010 2024-04-25T09:07:40.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92f3400640 1 -- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92cc066f60 msgr2=0x7f92cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92f3400640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92cc066f60 0x7f92cc069420 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f92ec1fa5e0 tx=0x7f92d8009190 comp rx=0 tx=0).stop 2024-04-25T09:07:40.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92f3400640 1 -- 172.21.15.59:0/1447583880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92ec06e010 msgr2=0x7f92ec0afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92f3400640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92ec06e010 0x7f92ec0afc80 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f92e000c420 tx=0x7f92e000c8e0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92f3400640 1 -- 172.21.15.59:0/1447583880 shutdown_connections 2024-04-25T09:07:40.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92f3400640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92cc066f60 0x7f92cc069420 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92f3400640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92ec15c9b0 0x7f92ec0b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92f3400640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92ec159320 0x7f92ec1580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92f3400640 1 --2- 172.21.15.59:0/1447583880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92ec06e010 0x7f92ec0afc80 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92f3400640 1 -- 172.21.15.59:0/1447583880 >> 172.21.15.59:0/1447583880 conn(0x7f92ec067080 msgr2=0x7f92ec15cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:40.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92f3400640 1 -- 172.21.15.59:0/1447583880 shutdown_connections 2024-04-25T09:07:40.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.784+0000 7f92f3400640 1 -- 172.21.15.59:0/1447583880 wait complete. 2024-04-25T09:07:40.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-25T09:07:40.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d8b800640 1 Processor -- start 2024-04-25T09:07:40.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d8b800640 1 -- start start 2024-04-25T09:07:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d8b800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d84145020 0x7f8d84072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d8b800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d84145400 0x7f8d8406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d8b800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d840ce130 con 0x7f8d8406ac10 2024-04-25T09:07:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d8b800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d840cd360 con 0x7f8d84145020 2024-04-25T09:07:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d8b800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84073200 con 0x7f8d84145400 2024-04-25T09:07:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d88e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d84145020 0x7f8d84072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d88e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d84145020 0x7f8d84072cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41246/0 (socket says 172.21.15.59:41246) 2024-04-25T09:07:40.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d88e00640 1 -- 172.21.15.59:0/3821572636 learned_addr learned my addr 172.21.15.59:0/3821572636 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:40.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d83e00640 1 --2- 172.21.15.59:0/3821572636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d84145400 0x7f8d8406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d88e00640 1 -- 172.21.15.59:0/3821572636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d84145400 msgr2=0x7f8d8406fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:40.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d88e00640 1 --2- 172.21.15.59:0/3821572636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d84145400 0x7f8d8406fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d88e00640 1 -- 172.21.15.59:0/3821572636 >> v1:172.21.15.178:6789/0 conn(0x7f8d8406ac10 legacy=0x7f8d8415f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:40.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d88e00640 1 -- 172.21.15.59:0/3821572636 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d840cd5b0 con 0x7f8d84145020 2024-04-25T09:07:40.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.956+0000 7f8d83e00640 1 --2- 172.21.15.59:0/3821572636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d84145400 0x7f8d8406fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.960+0000 7f8d88e00640 1 --2- 172.21.15.59:0/3821572636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d84145020 0x7f8d84072cc0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009870 tx=0x7f8d7801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c8b3f0681be75f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.960+0000 7f8d83400640 1 -- 172.21.15.59:0/3821572636 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780b1070 con 0x7f8d84145020 2024-04-25T09:07:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.960+0000 7f8d83400640 1 -- 172.21.15.59:0/3821572636 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d780ac620 con 0x7f8d84145020 2024-04-25T09:07:40.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.960+0000 7f8d83400640 1 -- 172.21.15.59:0/3821572636 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780ac9f0 con 0x7f8d84145020 2024-04-25T09:07:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.960+0000 7f8d8b800640 1 -- 172.21.15.59:0/3821572636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d84145020 msgr2=0x7f8d84072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.960+0000 7f8d8b800640 1 --2- 172.21.15.59:0/3821572636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d84145020 0x7f8d84072cc0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009870 tx=0x7f8d7801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.960+0000 7f8d8b800640 1 -- 172.21.15.59:0/3821572636 shutdown_connections 2024-04-25T09:07:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.960+0000 7f8d8b800640 1 --2- 172.21.15.59:0/3821572636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d84145400 0x7f8d8406fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.960+0000 7f8d8b800640 1 --2- 172.21.15.59:0/3821572636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d84145020 0x7f8d84072cc0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.960+0000 7f8d8b800640 1 -- 172.21.15.59:0/3821572636 >> 172.21.15.59:0/3821572636 conn(0x7f8d840b2400 msgr2=0x7f8d840b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.960+0000 7f8d8b800640 1 -- 172.21.15.59:0/3821572636 shutdown_connections 2024-04-25T09:07:40.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.960+0000 7f8d8b800640 1 -- 172.21.15.59:0/3821572636 wait complete. 2024-04-25T09:07:40.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d8b800640 1 Processor -- start 2024-04-25T09:07:40.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d8b800640 1 -- start start 2024-04-25T09:07:40.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d8b800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8406ac10 0x7f8d840b5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d8b800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d84145020 0x7f8d8415b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d8b800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84145400 0x7f8d84140ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d8b800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8406b480 con 0x7f8d8406ac10 2024-04-25T09:07:40.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d8b800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d84070060 con 0x7f8d84145400 2024-04-25T09:07:40.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d8b800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840d01e0 con 0x7f8d84145020 2024-04-25T09:07:40.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d88e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8406ac10 0x7f8d840b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d88e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8406ac10 0x7f8d840b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41258/0 (socket says 172.21.15.59:41258) 2024-04-25T09:07:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d88e00640 1 -- 172.21.15.59:0/1775576596 learned_addr learned my addr 172.21.15.59:0/1775576596 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d83e00640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d84145020 0x7f8d8415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d89800640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84145400 0x7f8d84140ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d88e00640 1 -- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d84145020 msgr2=0x7f8d8415b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d88e00640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d84145020 0x7f8d8415b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d88e00640 1 -- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84145400 msgr2=0x7f8d84140ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d88e00640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84145400 0x7f8d84140ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d88e00640 1 -- 172.21.15.59:0/1775576596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d840b4440 con 0x7f8d8406ac10 2024-04-25T09:07:40.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d89800640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84145400 0x7f8d84140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:40.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d88e00640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8406ac10 0x7f8d840b5200 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f8d780af040 tx=0x7f8d7801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:40.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d80c00640 1 -- 172.21.15.59:0/1775576596 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780b1040 con 0x7f8d8406ac10 2024-04-25T09:07:40.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d80c00640 1 -- 172.21.15.59:0/1775576596 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d780bd070 con 0x7f8d8406ac10 2024-04-25T09:07:40.955 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d8b800640 1 -- 172.21.15.59:0/1775576596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d840b4720 con 0x7f8d8406ac10 2024-04-25T09:07:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d80c00640 1 -- 172.21.15.59:0/1775576596 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780b7880 con 0x7f8d8406ac10 2024-04-25T09:07:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.964+0000 7f8d8b800640 1 -- 172.21.15.59:0/1775576596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d840b5740 con 0x7f8d8406ac10 2024-04-25T09:07:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.968+0000 7f8d8b800640 1 -- 172.21.15.59:0/1775576596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d840745d0 con 0x7f8d8406ac10 2024-04-25T09:07:40.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.968+0000 7f8d80c00640 1 -- 172.21.15.59:0/1775576596 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8d780b7a20 con 0x7f8d8406ac10 2024-04-25T09:07:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.968+0000 7f8d80c00640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d64066f60 0x7f8d64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.968+0000 7f8d80c00640 1 -- 172.21.15.59:0/1775576596 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f8d7811f4e0 con 0x7f8d8406ac10 2024-04-25T09:07:40.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.968+0000 7f8d83e00640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d64066f60 0x7f8d64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:40.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.968+0000 7f8d83e00640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d64066f60 0x7f8d64069420 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8d841667c0 tx=0x7f8d70008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:40.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:40.972+0000 7f8d80c00640 1 -- 172.21.15.59:0/1775576596 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8d78016110 con 0x7f8d8406ac10 2024-04-25T09:07:41.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.188+0000 7f8d8b800640 1 -- 172.21.15.59:0/1775576596 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7f8d84072550 con 0x7f8d8406ac10 2024-04-25T09:07:41.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.436+0000 7f8d80c00640 1 -- 172.21.15.59:0/1775576596 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v319) v1 ==== 166+0+0 (secure 0 0 0) 0x7f8d780f0570 con 0x7f8d8406ac10 2024-04-25T09:07:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.436+0000 7f8d8b800640 1 -- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d64066f60 msgr2=0x7f8d64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.436+0000 7f8d8b800640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d64066f60 0x7f8d64069420 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8d841667c0 tx=0x7f8d70008040 comp rx=0 tx=0).stop 2024-04-25T09:07:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.436+0000 7f8d8b800640 1 -- 172.21.15.59:0/1775576596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8406ac10 msgr2=0x7f8d840b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.436+0000 7f8d8b800640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8406ac10 0x7f8d840b5200 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f8d780af040 tx=0x7f8d7801ad30 comp rx=0 tx=0).stop 2024-04-25T09:07:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.436+0000 7f8d8b800640 1 -- 172.21.15.59:0/1775576596 shutdown_connections 2024-04-25T09:07:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.436+0000 7f8d8b800640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d64066f60 0x7f8d64069420 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.436+0000 7f8d8b800640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d84145400 0x7f8d84140ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.436+0000 7f8d8b800640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d84145020 0x7f8d8415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.436+0000 7f8d8b800640 1 --2- 172.21.15.59:0/1775576596 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d8406ac10 0x7f8d840b5200 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.436+0000 7f8d8b800640 1 -- 172.21.15.59:0/1775576596 >> 172.21.15.59:0/1775576596 conn(0x7f8d840b2400 msgr2=0x7f8d840b1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:41.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.436+0000 7f8d8b800640 1 -- 172.21.15.59:0/1775576596 shutdown_connections 2024-04-25T09:07:41.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.440+0000 7f8d8b800640 1 -- 172.21.15.59:0/1775576596 wait complete. 2024-04-25T09:07:41.448 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T09:07:41.448 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-25T09:07:41.449 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:07:41.449 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:41.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.600+0000 7fcfe4c00640 1 Processor -- start 2024-04-25T09:07:41.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.600+0000 7fcfe4c00640 1 -- start start 2024-04-25T09:07:41.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfe4c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcfe015fe50 0x7fcfe00b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfe4c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfe00b1c90 0x7fcfe015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfe4c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe00cc4e0 con 0x7fcfe0145270 2024-04-25T09:07:41.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfe4c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe0145650 con 0x7fcfe015fe50 2024-04-25T09:07:41.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfe4c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe01602b0 con 0x7fcfe00b1c90 2024-04-25T09:07:41.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfdde00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcfe0145270 0x7fcfe00cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50000/0 (socket says 172.21.15.59:50000) 2024-04-25T09:07:41.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfdde00640 1 -- 172.21.15.59:0/3485969731 learned_addr learned my addr 172.21.15.59:0/3485969731 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:41.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfd5400640 1 --2- 172.21.15.59:0/3485969731 >> v2:172.21.15.178:3300/0 conn(0x7fcfe015fe50 0x7fcfe00b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfde800640 1 --2- 172.21.15.59:0/3485969731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfe00b1c90 0x7fcfe015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfdd400640 1 -- 172.21.15.59:0/3485969731 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302415782 0 0) 0x7fcfe00cc4e0 con 0x7fcfe0145270 2024-04-25T09:07:41.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfdd400640 1 -- 172.21.15.59:0/3485969731 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc4003530 con 0x7fcfe0145270 2024-04-25T09:07:41.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfd5400640 1 -- 172.21.15.59:0/3485969731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfe00b1c90 msgr2=0x7fcfe015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:41.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfdd400640 1 -- 172.21.15.59:0/3485969731 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 832401089 0 0) 0x7fcfc4003530 con 0x7fcfe0145270 2024-04-25T09:07:41.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfd5400640 1 --2- 172.21.15.59:0/3485969731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfe00b1c90 0x7fcfe015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfd5400640 1 -- 172.21.15.59:0/3485969731 >> v1:172.21.15.59:6789/0 conn(0x7fcfe0145270 legacy=0x7fcfe00cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfd5400640 1 -- 172.21.15.59:0/3485969731 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00ce040 con 0x7fcfe015fe50 2024-04-25T09:07:41.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.604+0000 7fcfde800640 1 --2- 172.21.15.59:0/3485969731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfe00b1c90 0x7fcfe015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:41.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfd5400640 1 --2- 172.21.15.59:0/3485969731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfe015fe50 0x7fcfe00b1750 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80097c0 tx=0x7fcfc801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61ddf4035e07be7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfdd400640 1 -- 172.21.15.59:0/3485969731 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80b0070 con 0x7fcfe015fe50 2024-04-25T09:07:41.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfdd400640 1 -- 172.21.15.59:0/3485969731 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc80ab400 con 0x7fcfe015fe50 2024-04-25T09:07:41.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfdd400640 1 -- 172.21.15.59:0/3485969731 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0001680 con 0x7fcfe015fe50 2024-04-25T09:07:41.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfe4c00640 1 -- 172.21.15.59:0/3485969731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfe015fe50 msgr2=0x7fcfe00b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfe4c00640 1 --2- 172.21.15.59:0/3485969731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfe015fe50 0x7fcfe00b1750 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fcfc80097c0 tx=0x7fcfc801c3c0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfe4c00640 1 -- 172.21.15.59:0/3485969731 shutdown_connections 2024-04-25T09:07:41.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfe4c00640 1 --2- 172.21.15.59:0/3485969731 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfe00b1c90 0x7fcfe015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfe4c00640 1 --2- 172.21.15.59:0/3485969731 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfe015fe50 0x7fcfe00b1750 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfe4c00640 1 -- 172.21.15.59:0/3485969731 >> 172.21.15.59:0/3485969731 conn(0x7fcfe0066fa0 msgr2=0x7fcfe006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:41.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfe4c00640 1 -- 172.21.15.59:0/3485969731 shutdown_connections 2024-04-25T09:07:41.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfe4c00640 1 -- 172.21.15.59:0/3485969731 wait complete. 2024-04-25T09:07:41.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfe4c00640 1 Processor -- start 2024-04-25T09:07:41.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.608+0000 7fcfe4c00640 1 -- start start 2024-04-25T09:07:41.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfe4c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfe00b1c90 0x7fcfe00a9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfe4c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfe0145270 0x7fcfe00ab850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfe4c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfe015fe50 0x7fcfe00b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfe4c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00cdbe0 con 0x7fcfe0145270 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfe4c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe015f930 con 0x7fcfe00b1c90 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfe4c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe00cdd60 con 0x7fcfe015fe50 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfe0145270 0x7fcfe00ab850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfe0145270 0x7fcfe00ab850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41266/0 (socket says 172.21.15.59:41266) 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd5400640 1 -- 172.21.15.59:0/2525255661 learned_addr learned my addr 172.21.15.59:0/2525255661 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfdde00640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfe00b1c90 0x7fcfe00a9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfde800640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfe015fe50 0x7fcfe00b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd5400640 1 -- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfe015fe50 msgr2=0x7fcfe00b36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd5400640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfe015fe50 0x7fcfe00b36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd5400640 1 -- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfe00b1c90 msgr2=0x7fcfe00a9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd5400640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfe00b1c90 0x7fcfe00a9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd5400640 1 -- 172.21.15.59:0/2525255661 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe00aa110 con 0x7fcfe0145270 2024-04-25T09:07:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd5400640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfe0145270 0x7fcfe00ab850 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fcfc801aa70 tx=0x7fcfc8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd6a00640 1 -- 172.21.15.59:0/2525255661 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80b8020 con 0x7fcfe0145270 2024-04-25T09:07:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd6a00640 1 -- 172.21.15.59:0/2525255661 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc80b4410 con 0x7fcfe0145270 2024-04-25T09:07:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfe4c00640 1 -- 172.21.15.59:0/2525255661 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe00aa7b0 con 0x7fcfe0145270 2024-04-25T09:07:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd6a00640 1 -- 172.21.15.59:0/2525255661 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc80b0040 con 0x7fcfe0145270 2024-04-25T09:07:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfe4c00640 1 -- 172.21.15.59:0/2525255661 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe00aad70 con 0x7fcfe0145270 2024-04-25T09:07:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfe4c00640 1 -- 172.21.15.59:0/2525255661 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe00745d0 con 0x7fcfe0145270 2024-04-25T09:07:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.612+0000 7fcfd6a00640 1 -- 172.21.15.59:0/2525255661 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcfc80bb020 con 0x7fcfe0145270 2024-04-25T09:07:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.616+0000 7fcfd6a00640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcfbc066f60 0x7fcfbc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.616+0000 7fcfd6a00640 1 -- 172.21.15.59:0/2525255661 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fcfc811e9b0 con 0x7fcfe0145270 2024-04-25T09:07:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.616+0000 7fcfdde00640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcfbc066f60 0x7fcfbc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.616+0000 7fcfdde00640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcfbc066f60 0x7fcfbc069420 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00ccf30 tx=0x7fcfd0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.620+0000 7fcfd6a00640 1 -- 172.21.15.59:0/2525255661 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcfc80c2030 con 0x7fcfe0145270 2024-04-25T09:07:41.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.780+0000 7fcfe4c00640 1 -- 172.21.15.59:0/2525255661 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfe00ae8e0 con 0x7fcfe0145270 2024-04-25T09:07:41.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfd6a00640 1 -- 172.21.15.59:0/2525255661 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+13424 (secure 0 0 0) 0x7fcfe00aa110 con 0x7fcfe0145270 2024-04-25T09:07:41.772 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:41.772 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":84,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:07:40.424669+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6834/1033010830":"2024-04-26T09:07:37.410259+0000","172.21.15.59:6832/1033010830":"2024-04-26T09:07:37.410259+0000","172.21.15.59:6834/1468235926":"2024-04-26T09:06:18.012326+0000","172.21.15.59:6832/1468235926":"2024-04-26T09:06:18.012326+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:41.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfe4c00640 1 -- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcfbc066f60 msgr2=0x7fcfbc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfe4c00640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcfbc066f60 0x7fcfbc069420 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00ccf30 tx=0x7fcfd0009040 comp rx=0 tx=0).stop 2024-04-25T09:07:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfe4c00640 1 -- 172.21.15.59:0/2525255661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfe0145270 msgr2=0x7fcfe00ab850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfe4c00640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfe0145270 0x7fcfe00ab850 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fcfc801aa70 tx=0x7fcfc8019160 comp rx=0 tx=0).stop 2024-04-25T09:07:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfe4c00640 1 -- 172.21.15.59:0/2525255661 shutdown_connections 2024-04-25T09:07:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfe4c00640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcfbc066f60 0x7fcfbc069420 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfe4c00640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcfe015fe50 0x7fcfe00b36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfe4c00640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcfe0145270 0x7fcfe00ab850 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfe4c00640 1 --2- 172.21.15.59:0/2525255661 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcfe00b1c90 0x7fcfe00a9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfe4c00640 1 -- 172.21.15.59:0/2525255661 >> 172.21.15.59:0/2525255661 conn(0x7fcfe0066fa0 msgr2=0x7fcfe0142870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfe4c00640 1 -- 172.21.15.59:0/2525255661 shutdown_connections 2024-04-25T09:07:41.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.784+0000 7fcfe4c00640 1 -- 172.21.15.59:0/2525255661 wait complete. 2024-04-25T09:07:41.792 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:07:41.793 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:07:41.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.948+0000 7f387d200640 1 Processor -- start 2024-04-25T09:07:41.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.948+0000 7f387d200640 1 -- start start 2024-04-25T09:07:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.948+0000 7f387d200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f387815c9b0 0x7f387806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.948+0000 7f387d200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387815fc00 con 0x7f387806e010 2024-04-25T09:07:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.948+0000 7f387d200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f387815fee0 con 0x7f3878159320 2024-04-25T09:07:41.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.948+0000 7f387d200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387806d640 con 0x7f387815c9b0 2024-04-25T09:07:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.948+0000 7f386d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f387815c9b0 0x7f387806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.948+0000 7f3876800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f387806e010 0x7f387806e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50016/0 (socket says 172.21.15.59:50016) 2024-04-25T09:07:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.948+0000 7f3876800640 1 -- 172.21.15.59:0/4054360405 learned_addr learned my addr 172.21.15.59:0/4054360405 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.948+0000 7f386d400640 1 -- 172.21.15.59:0/4054360405 >> v1:172.21.15.178:6789/0 conn(0x7f3878159320 legacy=0x7f387815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.948+0000 7f386d400640 1 -- 172.21.15.59:0/4054360405 >> v1:172.21.15.59:6789/0 conn(0x7f387806e010 legacy=0x7f387806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.948+0000 7f386d400640 1 -- 172.21.15.59:0/4054360405 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38781601c0 con 0x7f387815c9b0 2024-04-25T09:07:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.952+0000 7f386d400640 1 --2- 172.21.15.59:0/4054360405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f387815c9b0 0x7f387806dad0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f38600097c0 tx=0x7f386001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b02fb3ad58a6ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.952+0000 7f3875400640 1 -- 172.21.15.59:0/4054360405 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38600b1070 con 0x7f387815c9b0 2024-04-25T09:07:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.952+0000 7f3875400640 1 -- 172.21.15.59:0/4054360405 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38600ac410 con 0x7f387815c9b0 2024-04-25T09:07:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.952+0000 7f3875400640 1 -- 172.21.15.59:0/4054360405 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38600ac7e0 con 0x7f387815c9b0 2024-04-25T09:07:41.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.952+0000 7f387d200640 1 -- 172.21.15.59:0/4054360405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f387815c9b0 msgr2=0x7f387806dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.952+0000 7f387d200640 1 --2- 172.21.15.59:0/4054360405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f387815c9b0 0x7f387806dad0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f38600097c0 tx=0x7f386001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.952+0000 7f387d200640 1 -- 172.21.15.59:0/4054360405 shutdown_connections 2024-04-25T09:07:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.952+0000 7f387d200640 1 --2- 172.21.15.59:0/4054360405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f387815c9b0 0x7f387806dad0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.952+0000 7f387d200640 1 -- 172.21.15.59:0/4054360405 >> 172.21.15.59:0/4054360405 conn(0x7f3878067080 msgr2=0x7f387806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.952+0000 7f387d200640 1 -- 172.21.15.59:0/4054360405 shutdown_connections 2024-04-25T09:07:41.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.952+0000 7f387d200640 1 -- 172.21.15.59:0/4054360405 wait complete. 2024-04-25T09:07:41.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f387d200640 1 Processor -- start 2024-04-25T09:07:41.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f387d200640 1 -- start start 2024-04-25T09:07:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f387d200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387806e010 0x7f3878157cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f387d200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3878159320 0x7f38780acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f387d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f387815c9b0 0x7f387813bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f387d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387806ed30 con 0x7f387815c9b0 2024-04-25T09:07:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f387d200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387806ebb0 con 0x7f387806e010 2024-04-25T09:07:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f387d200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38781695a0 con 0x7f3878159320 2024-04-25T09:07:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f3876800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f387815c9b0 0x7f387813bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f3876800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f387815c9b0 0x7f387813bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41282/0 (socket says 172.21.15.59:41282) 2024-04-25T09:07:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f3876800640 1 -- 172.21.15.59:0/1724755500 learned_addr learned my addr 172.21.15.59:0/1724755500 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f3875e00640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387806e010 0x7f3878157cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f386d400640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3878159320 0x7f38780acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f3876800640 1 -- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3878159320 msgr2=0x7f38780acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f3876800640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3878159320 0x7f38780acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f3876800640 1 -- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387806e010 msgr2=0x7f3878157cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:41.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f3876800640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387806e010 0x7f3878157cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:41.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f3876800640 1 -- 172.21.15.59:0/1724755500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38780ad5b0 con 0x7f387815c9b0 2024-04-25T09:07:41.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f3876800640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f387815c9b0 0x7f387813bd20 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f387000caa0 tx=0x7f387000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f386ea00640 1 -- 172.21.15.59:0/1724755500 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3870017070 con 0x7f387815c9b0 2024-04-25T09:07:41.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f386ea00640 1 -- 172.21.15.59:0/1724755500 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387000ac00 con 0x7f387815c9b0 2024-04-25T09:07:41.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f387d200640 1 -- 172.21.15.59:0/1724755500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38780ad890 con 0x7f387815c9b0 2024-04-25T09:07:41.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f386ea00640 1 -- 172.21.15.59:0/1724755500 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3870012400 con 0x7f387815c9b0 2024-04-25T09:07:41.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f387d200640 1 -- 172.21.15.59:0/1724755500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38780ade50 con 0x7f387815c9b0 2024-04-25T09:07:41.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.956+0000 7f387d200640 1 -- 172.21.15.59:0/1724755500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38780745d0 con 0x7f387815c9b0 2024-04-25T09:07:41.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.960+0000 7f386ea00640 1 -- 172.21.15.59:0/1724755500 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f387001a070 con 0x7f387815c9b0 2024-04-25T09:07:41.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.960+0000 7f386ea00640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3854066f60 0x7f3854069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:41.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.960+0000 7f386ea00640 1 -- 172.21.15.59:0/1724755500 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f3870084bb0 con 0x7f387815c9b0 2024-04-25T09:07:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.960+0000 7f3875e00640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3854066f60 0x7f3854069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:41.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.960+0000 7f3875e00640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3854066f60 0x7f3854069420 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f38780cc210 tx=0x7f3868009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:41.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:41.964+0000 7f386ea00640 1 -- 172.21.15.59:0/1724755500 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f38700555f0 con 0x7f387815c9b0 2024-04-25T09:07:42.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 -- 172.21.15.59:0/1724755500 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f387806dca0 con 0x7f387815c9b0 2024-04-25T09:07:42.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f386ea00640 1 -- 172.21.15.59:0/1724755500 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3870059690 con 0x7f387815c9b0 2024-04-25T09:07:42.116 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:07:42.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 -- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3854066f60 msgr2=0x7f3854069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3854066f60 0x7f3854069420 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f38780cc210 tx=0x7f3868009040 comp rx=0 tx=0).stop 2024-04-25T09:07:42.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 -- 172.21.15.59:0/1724755500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f387815c9b0 msgr2=0x7f387813bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f387815c9b0 0x7f387813bd20 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f387000caa0 tx=0x7f387000cf60 comp rx=0 tx=0).stop 2024-04-25T09:07:42.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 -- 172.21.15.59:0/1724755500 shutdown_connections 2024-04-25T09:07:42.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3854066f60 0x7f3854069420 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f387815c9b0 0x7f387813bd20 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3878159320 0x7f38780acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 --2- 172.21.15.59:0/1724755500 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f387806e010 0x7f3878157cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 -- 172.21.15.59:0/1724755500 >> 172.21.15.59:0/1724755500 conn(0x7f3878067080 msgr2=0x7f387815bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:42.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 -- 172.21.15.59:0/1724755500 shutdown_connections 2024-04-25T09:07:42.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.128+0000 7f387d200640 1 -- 172.21.15.59:0/1724755500 wait complete. 2024-04-25T09:07:42.138 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-25T09:07:42.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.288+0000 7f869e200640 1 Processor -- start 2024-04-25T09:07:42.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.288+0000 7f869e200640 1 -- start start 2024-04-25T09:07:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f869e200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86980cef30 0x7f869806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f869e200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f869806e900 0x7f86980b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f869e200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f869815ac60 con 0x7f8698144140 2024-04-25T09:07:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f869e200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869806ed30 con 0x7f869806e900 2024-04-25T09:07:42.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f869e200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86980cf3e0 con 0x7f86980cef30 2024-04-25T09:07:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f8697e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f869806e900 0x7f86980b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f868ea00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86980cef30 0x7f869806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f8697e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f869806e900 0x7f86980b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:46784/0 (socket says 172.21.15.59:46784) 2024-04-25T09:07:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f8697e00640 1 -- 172.21.15.59:0/4127722464 learned_addr learned my addr 172.21.15.59:0/4127722464 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f868ea00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86980cef30 0x7f869806e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:60694/0 (socket says 172.21.15.59:60694) 2024-04-25T09:07:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f8697400640 1 --1- 172.21.15.59:0/4127722464 >> v1:172.21.15.178:6789/0 conn(0x7f8698144140 0x7f86980ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:52380/0 (socket says 172.21.15.59:52380) 2024-04-25T09:07:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f8697e00640 1 -- 172.21.15.59:0/4127722464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86980cef30 msgr2=0x7f869806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f8697e00640 1 --2- 172.21.15.59:0/4127722464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86980cef30 0x7f869806e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f8697e00640 1 -- 172.21.15.59:0/4127722464 >> v1:172.21.15.178:6789/0 conn(0x7f8698144140 legacy=0x7f86980ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.292+0000 7f8697e00640 1 -- 172.21.15.59:0/4127722464 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869815af20 con 0x7f869806e900 2024-04-25T09:07:42.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f8697e00640 1 --2- 172.21.15.59:0/4127722464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f869806e900 0x7f86980b0760 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f869000d150 tx=0x7f869001ec30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b444a0f6ba37b280 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:42.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f8696a00640 1 -- 172.21.15.59:0/4127722464 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869000b2d0 con 0x7f869806e900 2024-04-25T09:07:42.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f8696a00640 1 -- 172.21.15.59:0/4127722464 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869000b470 con 0x7f869806e900 2024-04-25T09:07:42.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f8696a00640 1 -- 172.21.15.59:0/4127722464 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86900a7840 con 0x7f869806e900 2024-04-25T09:07:42.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f869e200640 1 -- 172.21.15.59:0/4127722464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f869806e900 msgr2=0x7f86980b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f869e200640 1 --2- 172.21.15.59:0/4127722464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f869806e900 0x7f86980b0760 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f869000d150 tx=0x7f869001ec30 comp rx=0 tx=0).stop 2024-04-25T09:07:42.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f869e200640 1 -- 172.21.15.59:0/4127722464 shutdown_connections 2024-04-25T09:07:42.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f869e200640 1 --2- 172.21.15.59:0/4127722464 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f869806e900 0x7f86980b0760 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f869e200640 1 --2- 172.21.15.59:0/4127722464 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86980cef30 0x7f869806e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f869e200640 1 -- 172.21.15.59:0/4127722464 >> 172.21.15.59:0/4127722464 conn(0x7f8698066fa0 msgr2=0x7f869806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:42.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f869e200640 1 -- 172.21.15.59:0/4127722464 shutdown_connections 2024-04-25T09:07:42.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f869e200640 1 -- 172.21.15.59:0/4127722464 wait complete. 2024-04-25T09:07:42.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f869e200640 1 Processor -- start 2024-04-25T09:07:42.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.296+0000 7f869e200640 1 -- start start 2024-04-25T09:07:42.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f869e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f869806e900 0x7f869813f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f869e200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86980cef30 0x7f869814ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f869e200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8698144140 0x7f869813d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f869e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869815ba00 con 0x7f869806e900 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f869e200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8698144520 con 0x7f8698144140 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f869e200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869815bb80 con 0x7f86980cef30 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f8697400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f869806e900 0x7f869813f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f8697400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f869806e900 0x7f869813f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41288/0 (socket says 172.21.15.59:41288) 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f8697400640 1 -- 172.21.15.59:0/2786475715 learned_addr learned my addr 172.21.15.59:0/2786475715 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f8697e00640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8698144140 0x7f869813d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f868ea00640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86980cef30 0x7f869814ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f8697400640 1 -- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86980cef30 msgr2=0x7f869814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f8697400640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86980cef30 0x7f869814ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f8697400640 1 -- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8698144140 msgr2=0x7f869813d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:42.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f8697400640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8698144140 0x7f869813d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:42.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f8697400640 1 -- 172.21.15.59:0/2786475715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8698139af0 con 0x7f869806e900 2024-04-25T09:07:42.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f8697400640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f869806e900 0x7f869813f5a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f868800c370 tx=0x7f868800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:42.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f868fe00640 1 -- 172.21.15.59:0/2786475715 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86880074e0 con 0x7f869806e900 2024-04-25T09:07:42.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f868fe00640 1 -- 172.21.15.59:0/2786475715 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8688007680 con 0x7f869806e900 2024-04-25T09:07:42.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f868fe00640 1 -- 172.21.15.59:0/2786475715 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688004a30 con 0x7f869806e900 2024-04-25T09:07:42.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f869e200640 1 -- 172.21.15.59:0/2786475715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f869813fdf0 con 0x7f869806e900 2024-04-25T09:07:42.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f869e200640 1 -- 172.21.15.59:0/2786475715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86981403b0 con 0x7f869806e900 2024-04-25T09:07:42.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f869e200640 1 -- 172.21.15.59:0/2786475715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86981405f0 con 0x7f869806e900 2024-04-25T09:07:42.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.300+0000 7f868fe00640 1 -- 172.21.15.59:0/2786475715 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f868801a020 con 0x7f869806e900 2024-04-25T09:07:42.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.304+0000 7f868fe00640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8674066f60 0x7f8674069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:42.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.304+0000 7f868fe00640 1 -- 172.21.15.59:0/2786475715 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f86880845a0 con 0x7f869806e900 2024-04-25T09:07:42.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.304+0000 7f868ea00640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8674066f60 0x7f8674069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:42.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.304+0000 7f868ea00640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8674066f60 0x7f8674069420 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8698073cd0 tx=0x7f8680009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:42.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.308+0000 7f868fe00640 1 -- 172.21.15.59:0/2786475715 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8688055070 con 0x7f869806e900 2024-04-25T09:07:42.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:42.528+0000 7f869e200640 1 -- 172.21.15.59:0/2786475715 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7f8698073a20 con 0x7f869806e900 2024-04-25T09:07:43.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.444+0000 7f868fe00640 1 -- 172.21.15.59:0/2786475715 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v321) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8688059110 con 0x7f869806e900 2024-04-25T09:07:43.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.448+0000 7f869e200640 1 -- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8674066f60 msgr2=0x7f8674069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:43.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.448+0000 7f869e200640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8674066f60 0x7f8674069420 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8698073cd0 tx=0x7f8680009190 comp rx=0 tx=0).stop 2024-04-25T09:07:43.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.448+0000 7f869e200640 1 -- 172.21.15.59:0/2786475715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f869806e900 msgr2=0x7f869813f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:43.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.448+0000 7f869e200640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f869806e900 0x7f869813f5a0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f868800c370 tx=0x7f868800c830 comp rx=0 tx=0).stop 2024-04-25T09:07:43.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.448+0000 7f869e200640 1 -- 172.21.15.59:0/2786475715 shutdown_connections 2024-04-25T09:07:43.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.448+0000 7f869e200640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8674066f60 0x7f8674069420 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.448+0000 7f869e200640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8698144140 0x7f869813d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.448+0000 7f869e200640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f86980cef30 0x7f869814ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.448+0000 7f869e200640 1 --2- 172.21.15.59:0/2786475715 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f869806e900 0x7f869813f5a0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.448+0000 7f869e200640 1 -- 172.21.15.59:0/2786475715 >> 172.21.15.59:0/2786475715 conn(0x7f8698066fa0 msgr2=0x7f869815cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:43.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.448+0000 7f869e200640 1 -- 172.21.15.59:0/2786475715 shutdown_connections 2024-04-25T09:07:43.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.448+0000 7f869e200640 1 -- 172.21.15.59:0/2786475715 wait complete. 2024-04-25T09:07:43.461 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:07:43.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.620+0000 7f4bd1200640 1 Processor -- start 2024-04-25T09:07:43.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.620+0000 7f4bd1200640 1 -- start start 2024-04-25T09:07:43.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bd1200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4bcc15dc60 0x7f4bcc0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:43.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bd1200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4bcc09a170 0x7f4bcc0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:43.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bd1200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc15e040 con 0x7f4bcc06bf30 2024-04-25T09:07:43.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bd1200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc0cff80 con 0x7f4bcc09a170 2024-04-25T09:07:43.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bd1200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0d0260 con 0x7f4bcc15dc60 2024-04-25T09:07:43.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bca800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4bcc09a170 0x7f4bcc0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:43.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bc9e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4bcc15dc60 0x7f4bcc0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:43.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bc3e00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f4bcc06bf30 0x7f4bcc099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:52394/0 (socket says 172.21.15.59:52394) 2024-04-25T09:07:43.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bc3e00640 1 -- 172.21.15.59:0/2559742927 learned_addr learned my addr 172.21.15.59:0/2559742927 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:43.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bca800640 1 -- 172.21.15.59:0/2559742927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4bcc15dc60 msgr2=0x7f4bcc0d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:43.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bca800640 1 --2- 172.21.15.59:0/2559742927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4bcc15dc60 0x7f4bcc0d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bca800640 1 -- 172.21.15.59:0/2559742927 >> v1:172.21.15.178:6789/0 conn(0x7f4bcc06bf30 legacy=0x7f4bcc099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:43.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.624+0000 7f4bca800640 1 -- 172.21.15.59:0/2559742927 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0d0540 con 0x7f4bcc09a170 2024-04-25T09:07:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bca800640 1 --2- 172.21.15.59:0/2559742927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bcc09a170 0x7f4bcc0cf8a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009d90 tx=0x7f4bc401c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae811cd68319abe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:43.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bc9400640 1 -- 172.21.15.59:0/2559742927 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40b2070 con 0x7f4bcc09a170 2024-04-25T09:07:43.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bc9400640 1 -- 172.21.15.59:0/2559742927 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc40a5970 con 0x7f4bcc09a170 2024-04-25T09:07:43.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bc9400640 1 -- 172.21.15.59:0/2559742927 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40a5d40 con 0x7f4bcc09a170 2024-04-25T09:07:43.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bd1200640 1 -- 172.21.15.59:0/2559742927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bcc09a170 msgr2=0x7f4bcc0cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:43.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bd1200640 1 --2- 172.21.15.59:0/2559742927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bcc09a170 0x7f4bcc0cf8a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4009d90 tx=0x7f4bc401c8b0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bd1200640 1 -- 172.21.15.59:0/2559742927 shutdown_connections 2024-04-25T09:07:43.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bd1200640 1 --2- 172.21.15.59:0/2559742927 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bcc09a170 0x7f4bcc0cf8a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bd1200640 1 --2- 172.21.15.59:0/2559742927 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4bcc15dc60 0x7f4bcc0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bd1200640 1 -- 172.21.15.59:0/2559742927 >> 172.21.15.59:0/2559742927 conn(0x7f4bcc0b3200 msgr2=0x7f4bcc0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:43.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bd1200640 1 -- 172.21.15.59:0/2559742927 shutdown_connections 2024-04-25T09:07:43.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bd1200640 1 -- 172.21.15.59:0/2559742927 wait complete. 2024-04-25T09:07:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bd1200640 1 Processor -- start 2024-04-25T09:07:43.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bd1200640 1 -- start start 2024-04-25T09:07:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.628+0000 7f4bd1200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4bcc06bf30 0x7f4bcc14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bd1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc09a170 0x7f4bcc156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bd1200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bcc15dc60 0x7f4bcc157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bd1200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0cc6f0 con 0x7f4bcc09a170 2024-04-25T09:07:43.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bd1200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0cc570 con 0x7f4bcc15dc60 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bd1200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc0cc870 con 0x7f4bcc06bf30 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc09a170 0x7f4bcc156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc09a170 0x7f4bcc156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41298/0 (socket says 172.21.15.59:41298) 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc3e00640 1 -- 172.21.15.59:0/3250899212 learned_addr learned my addr 172.21.15.59:0/3250899212 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc9e00640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4bcc06bf30 0x7f4bcc14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bca800640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bcc15dc60 0x7f4bcc157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc3e00640 1 -- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4bcc06bf30 msgr2=0x7f4bcc14b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc3e00640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4bcc06bf30 0x7f4bcc14b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc3e00640 1 -- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bcc15dc60 msgr2=0x7f4bcc157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc3e00640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bcc15dc60 0x7f4bcc157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc3e00640 1 -- 172.21.15.59:0/3250899212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc14c730 con 0x7f4bcc09a170 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc3e00640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc09a170 0x7f4bcc156ac0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400c420 tx=0x7f4bb400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:43.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc2000640 1 -- 172.21.15.59:0/3250899212 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4017070 con 0x7f4bcc09a170 2024-04-25T09:07:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc2000640 1 -- 172.21.15.59:0/3250899212 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb4005cf0 con 0x7f4bcc09a170 2024-04-25T09:07:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc2000640 1 -- 172.21.15.59:0/3250899212 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb40072f0 con 0x7f4bcc09a170 2024-04-25T09:07:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bd1200640 1 -- 172.21.15.59:0/3250899212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc14ca10 con 0x7f4bcc09a170 2024-04-25T09:07:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bd1200640 1 -- 172.21.15.59:0/3250899212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc14ea90 con 0x7f4bcc09a170 2024-04-25T09:07:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bd1200640 1 -- 172.21.15.59:0/3250899212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc0745d0 con 0x7f4bcc09a170 2024-04-25T09:07:43.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.632+0000 7f4bc2000640 1 -- 172.21.15.59:0/3250899212 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4bb401a070 con 0x7f4bcc09a170 2024-04-25T09:07:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.636+0000 7f4bc2000640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4ba8066f60 0x7f4ba8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:43.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.636+0000 7f4bc2000640 1 -- 172.21.15.59:0/3250899212 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f4bb40842c0 con 0x7f4bcc09a170 2024-04-25T09:07:43.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.636+0000 7f4bc9e00640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4ba8066f60 0x7f4ba8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:43.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.636+0000 7f4bc9e00640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4ba8066f60 0x7f4ba8069420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009ac0 tx=0x7f4bbc009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:43.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.640+0000 7f4bc2000640 1 -- 172.21.15.59:0/3250899212 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4bb4054d00 con 0x7f4bcc09a170 2024-04-25T09:07:43.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.800+0000 7f4bd1200640 1 -- 172.21.15.59:0/3250899212 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4bcc0b7590 con 0x7f4bcc09a170 2024-04-25T09:07:43.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bc2000640 1 -- 172.21.15.59:0/3250899212 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4bb4058da0 con 0x7f4bcc09a170 2024-04-25T09:07:43.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bd1200640 1 -- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4ba8066f60 msgr2=0x7f4ba8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:43.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bd1200640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4ba8066f60 0x7f4ba8069420 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc009ac0 tx=0x7f4bbc009190 comp rx=0 tx=0).stop 2024-04-25T09:07:43.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bd1200640 1 -- 172.21.15.59:0/3250899212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc09a170 msgr2=0x7f4bcc156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:43.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bd1200640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc09a170 0x7f4bcc156ac0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f4bb400c420 tx=0x7f4bb400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bd1200640 1 -- 172.21.15.59:0/3250899212 shutdown_connections 2024-04-25T09:07:43.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bd1200640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4ba8066f60 0x7f4ba8069420 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bd1200640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4bcc15dc60 0x7f4bcc157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bd1200640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bcc09a170 0x7f4bcc156ac0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bd1200640 1 --2- 172.21.15.59:0/3250899212 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4bcc06bf30 0x7f4bcc14b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:43.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bd1200640 1 -- 172.21.15.59:0/3250899212 >> 172.21.15.59:0/3250899212 conn(0x7f4bcc0b3200 msgr2=0x7f4bcc0ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:43.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bd1200640 1 -- 172.21.15.59:0/3250899212 shutdown_connections 2024-04-25T09:07:43.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:43.808+0000 7f4bd1200640 1 -- 172.21.15.59:0/3250899212 wait complete. 2024-04-25T09:07:43.817 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:07:43.817 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:07:43.889 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:07:43.933 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:07:43.933 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:07:43.933 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:43.942 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:07:43.943 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:07:43.943 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:43.989 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:07:43.990 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:07:43.990 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:43.998 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:07:43.998 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:07:43.998 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:44.042 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:07:44.042 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:07:44.042 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.192+0000 7f37e5800640 1 Processor -- start 2024-04-25T09:07:44.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37e5800640 1 -- start start 2024-04-25T09:07:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37e5800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37e015b2f0 0x7f37e00b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37e5800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f37e00b2dc0 0x7f37e00b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37e5800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e015def0 con 0x7f37e006dad0 2024-04-25T09:07:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37e5800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e015e1b0 con 0x7f37e015b2f0 2024-04-25T09:07:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37e5800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e015e490 con 0x7f37e00b2dc0 2024-04-25T09:07:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37dea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37e015b2f0 0x7f37e00b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37dea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37e015b2f0 0x7f37e00b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41306/0 (socket says 172.21.15.59:41306) 2024-04-25T09:07:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37dea00640 1 -- 172.21.15.59:0/986659214 learned_addr learned my addr 172.21.15.59:0/986659214 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:44.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37d6000640 1 --2- 172.21.15.59:0/986659214 >> v2:172.21.15.178:3300/0 conn(0x7f37e00b2dc0 0x7f37e00b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37dea00640 1 -- 172.21.15.59:0/986659214 >> v2:172.21.15.178:3300/0 conn(0x7f37e00b2dc0 msgr2=0x7f37e00b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37dea00640 1 --2- 172.21.15.59:0/986659214 >> v2:172.21.15.178:3300/0 conn(0x7f37e00b2dc0 0x7f37e00b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37dea00640 1 -- 172.21.15.59:0/986659214 >> v1:172.21.15.178:6789/0 conn(0x7f37e006dad0 legacy=0x7f37e006dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37dea00640 1 -- 172.21.15.59:0/986659214 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e015e770 con 0x7f37e015b2f0 2024-04-25T09:07:44.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.196+0000 7f37d6000640 1 --2- 172.21.15.59:0/986659214 >> v2:172.21.15.178:3300/0 conn(0x7f37e00b2dc0 0x7f37e00b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:44.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37dea00640 1 --2- 172.21.15.59:0/986659214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e015b2f0 0x7f37e00b3240 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f37e0067200 tx=0x7f37d001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2c678a7dd591ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37de000640 1 -- 172.21.15.59:0/986659214 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e015b8e0 con 0x7f37e015b2f0 2024-04-25T09:07:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37de000640 1 -- 172.21.15.59:0/986659214 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d00af070 con 0x7f37e015b2f0 2024-04-25T09:07:44.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37de000640 1 -- 172.21.15.59:0/986659214 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d00aa650 con 0x7f37e015b2f0 2024-04-25T09:07:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37e5800640 1 -- 172.21.15.59:0/986659214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e015b2f0 msgr2=0x7f37e00b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37e5800640 1 --2- 172.21.15.59:0/986659214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e015b2f0 0x7f37e00b3240 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f37e0067200 tx=0x7f37d001c4b0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37e5800640 1 -- 172.21.15.59:0/986659214 shutdown_connections 2024-04-25T09:07:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37e5800640 1 --2- 172.21.15.59:0/986659214 >> v2:172.21.15.178:3300/0 conn(0x7f37e00b2dc0 0x7f37e00b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37e5800640 1 --2- 172.21.15.59:0/986659214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e015b2f0 0x7f37e00b3240 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37e5800640 1 -- 172.21.15.59:0/986659214 >> 172.21.15.59:0/986659214 conn(0x7f37e00b23b0 msgr2=0x7f37e00cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37e5800640 1 -- 172.21.15.59:0/986659214 shutdown_connections 2024-04-25T09:07:44.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37e5800640 1 -- 172.21.15.59:0/986659214 wait complete. 2024-04-25T09:07:44.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37e5800640 1 Processor -- start 2024-04-25T09:07:44.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.200+0000 7f37e5800640 1 -- start start 2024-04-25T09:07:44.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37e5800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e006dad0 0x7f37e01fa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:44.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37e5800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37e00b2dc0 0x7f37e0155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:44.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37e5800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37e015b2f0 0x7f37e0152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:44.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37e5800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e016a880 con 0x7f37e006dad0 2024-04-25T09:07:44.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37e5800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e0161730 con 0x7f37e00b2dc0 2024-04-25T09:07:44.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37e5800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e016aa00 con 0x7f37e015b2f0 2024-04-25T09:07:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37dea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e006dad0 0x7f37e01fa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37dea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e006dad0 0x7f37e01fa9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41318/0 (socket says 172.21.15.59:41318) 2024-04-25T09:07:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37dea00640 1 -- 172.21.15.59:0/1053813908 learned_addr learned my addr 172.21.15.59:0/1053813908 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37dea00640 1 -- 172.21.15.59:0/1053813908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37e015b2f0 msgr2=0x7f37e0152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37dea00640 1 --2- 172.21.15.59:0/1053813908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37e015b2f0 0x7f37e0152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37dea00640 1 -- 172.21.15.59:0/1053813908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37e00b2dc0 msgr2=0x7f37e0155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37dea00640 1 --2- 172.21.15.59:0/1053813908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37e00b2dc0 0x7f37e0155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37dea00640 1 -- 172.21.15.59:0/1053813908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0153050 con 0x7f37e006dad0 2024-04-25T09:07:44.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37dea00640 1 --2- 172.21.15.59:0/1053813908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e006dad0 0x7f37e01fa9c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f37d00ac040 tx=0x7f37d001acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:44.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37d7400640 1 -- 172.21.15.59:0/1053813908 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d00b3800 con 0x7f37e006dad0 2024-04-25T09:07:44.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37d7400640 1 -- 172.21.15.59:0/1053813908 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d00b39c0 con 0x7f37e006dad0 2024-04-25T09:07:44.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37d7400640 1 -- 172.21.15.59:0/1053813908 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d00b3db0 con 0x7f37e006dad0 2024-04-25T09:07:44.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37e5800640 1 -- 172.21.15.59:0/1053813908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e0160f70 con 0x7f37e006dad0 2024-04-25T09:07:44.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37e5800640 1 -- 172.21.15.59:0/1053813908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e015f0c0 con 0x7f37e006dad0 2024-04-25T09:07:44.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37e5800640 1 -- 172.21.15.59:0/1053813908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e00745d0 con 0x7f37e006dad0 2024-04-25T09:07:44.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.204+0000 7f37d7400640 1 -- 172.21.15.59:0/1053813908 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f37d00b2380 con 0x7f37e006dad0 2024-04-25T09:07:44.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.208+0000 7f37d7400640 1 --2- 172.21.15.59:0/1053813908 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f37bc066f90 0x7f37bc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:44.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.208+0000 7f37d7400640 1 -- 172.21.15.59:0/1053813908 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f37d011f1d0 con 0x7f37e006dad0 2024-04-25T09:07:44.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.208+0000 7f37d6000640 1 --2- 172.21.15.59:0/1053813908 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f37bc066f90 0x7f37bc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:44.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.208+0000 7f37d6000640 1 --2- 172.21.15.59:0/1053813908 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f37bc066f90 0x7f37bc069450 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f37e01fb090 tx=0x7f37c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:44.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.212+0000 7f37d7400640 1 -- 172.21.15.59:0/1053813908 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f37d00160d0 con 0x7f37e006dad0 2024-04-25T09:07:44.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.408+0000 7f37e5800640 1 -- 172.21.15.59:0/1053813908 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37e00d0ab0 con 0x7f37e006dad0 2024-04-25T09:07:44.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37d7400640 1 -- 172.21.15.59:0/1053813908 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f37d00efca0 con 0x7f37e006dad0 2024-04-25T09:07:44.399 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:44.399 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":58,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6317,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2048935491","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2048935491},{"type":"v1","addr":"172.21.15.59:6834","nonce":2048935491}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":58},{"gid":6478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3888579342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3888579342},{"type":"v1","addr":"172.21.15.59:6835","nonce":3888579342}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6487,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3385398299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3385398299},{"type":"v1","addr":"172.21.15.178:6836","nonce":3385398299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43},{"gid":6490,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3247815669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3247815669},{"type":"v1","addr":"172.21.15.178:6837","nonce":3247815669}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[]} 2024-04-25T09:07:44.400 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 58 2024-04-25T09:07:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37e5800640 1 -- 172.21.15.59:0/1053813908 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f37bc066f90 msgr2=0x7f37bc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37e5800640 1 --2- 172.21.15.59:0/1053813908 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f37bc066f90 0x7f37bc069450 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f37e01fb090 tx=0x7f37c8008040 comp rx=0 tx=0).stop 2024-04-25T09:07:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37e5800640 1 -- 172.21.15.59:0/1053813908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e006dad0 msgr2=0x7f37e01fa9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37e5800640 1 --2- 172.21.15.59:0/1053813908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e006dad0 0x7f37e01fa9c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f37d00ac040 tx=0x7f37d001acf0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37e5800640 1 -- 172.21.15.59:0/1053813908 shutdown_connections 2024-04-25T09:07:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37e5800640 1 --2- 172.21.15.59:0/1053813908 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f37bc066f90 0x7f37bc069450 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37e5800640 1 --2- 172.21.15.59:0/1053813908 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f37e015b2f0 0x7f37e0152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37e5800640 1 --2- 172.21.15.59:0/1053813908 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f37e00b2dc0 0x7f37e0155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37e5800640 1 --2- 172.21.15.59:0/1053813908 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37e006dad0 0x7f37e01fa9c0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37e5800640 1 -- 172.21.15.59:0/1053813908 >> 172.21.15.59:0/1053813908 conn(0x7f37e00b23b0 msgr2=0x7f37e00cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:44.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37e5800640 1 -- 172.21.15.59:0/1053813908 shutdown_connections 2024-04-25T09:07:44.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.412+0000 7f37e5800640 1 -- 172.21.15.59:0/1053813908 wait complete. 2024-04-25T09:07:44.421 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:07:44.421 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:07:44.421 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:07:44.421 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:44.421 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:07:44.422 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:07:44.422 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:07:44.422 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:44.422 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:07:44.422 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:07:44.423 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:07:44.423 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:44.423 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:07:44.423 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:07:44.423 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:07:44.423 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:07:44.434 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:07:44.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:07:44.435 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:07:44.436 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:07:44.439 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:07:44.439 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:07:44.442 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:07:44.442 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:07:44.480 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:07:44.481 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:44.483 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:07:44.483 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:44.487 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:07:44.488 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:44.490 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:07:44.490 DEBUG:teuthology.parallel:result is None 2024-04-25T09:07:44.490 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:07:44.566 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T09:07:44.567 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:07:44.579 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-04-25T09:07:44.580 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-04-25T09:07:44.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.648+0000 7f6492a00640 1 Processor -- start 2024-04-25T09:07:44.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.648+0000 7f6492a00640 1 -- start start 2024-04-25T09:07:44.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.648+0000 7f6492a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f648c15dc00 0x7f648c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.648+0000 7f6492a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f648c0c72a0 0x7f648c0c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.648+0000 7f6492a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648c0b30d0 con 0x7f648c0d0150 2024-04-25T09:07:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.648+0000 7f6492a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c0cd860 con 0x7f648c0c72a0 2024-04-25T09:07:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.648+0000 7f6492a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648c0ccf30 con 0x7f648c15dc00 2024-04-25T09:07:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.648+0000 7f6490a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f648c0c72a0 0x7f648c0c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.648+0000 7f6490a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f648c0c72a0 0x7f648c0c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41356/0 (socket says 172.21.15.59:41356) 2024-04-25T09:07:44.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.648+0000 7f6490a00640 1 -- 172.21.15.59:0/2313620465 learned_addr learned my addr 172.21.15.59:0/2313620465 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f648be00640 1 --2- 172.21.15.59:0/2313620465 >> v2:172.21.15.178:3300/0 conn(0x7f648c15dc00 0x7f648c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f6490a00640 1 -- 172.21.15.59:0/2313620465 >> v2:172.21.15.178:3300/0 conn(0x7f648c15dc00 msgr2=0x7f648c0af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f6490a00640 1 --2- 172.21.15.59:0/2313620465 >> v2:172.21.15.178:3300/0 conn(0x7f648c15dc00 0x7f648c0af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f6490a00640 1 -- 172.21.15.59:0/2313620465 >> v1:172.21.15.178:6789/0 conn(0x7f648c0d0150 legacy=0x7f648c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f6490a00640 1 -- 172.21.15.59:0/2313620465 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c0cd210 con 0x7f648c0c72a0 2024-04-25T09:07:44.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f648be00640 1 --2- 172.21.15.59:0/2313620465 >> v2:172.21.15.178:3300/0 conn(0x7f648c15dc00 0x7f648c0af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:44.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f6490a00640 1 --2- 172.21.15.59:0/2313620465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c0c72a0 0x7f648c0c54b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f648c0b3300 tx=0x7f648401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1ae834da9afe3f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f648b400640 1 -- 172.21.15.59:0/2313620465 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840ac070 con 0x7f648c0c72a0 2024-04-25T09:07:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f648b400640 1 -- 172.21.15.59:0/2313620465 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64840a8420 con 0x7f648c0c72a0 2024-04-25T09:07:44.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f648b400640 1 -- 172.21.15.59:0/2313620465 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64840a87f0 con 0x7f648c0c72a0 2024-04-25T09:07:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f6492a00640 1 -- 172.21.15.59:0/2313620465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c0c72a0 msgr2=0x7f648c0c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f6492a00640 1 --2- 172.21.15.59:0/2313620465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c0c72a0 0x7f648c0c54b0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f648c0b3300 tx=0x7f648401c9b0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f6492a00640 1 -- 172.21.15.59:0/2313620465 shutdown_connections 2024-04-25T09:07:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f6492a00640 1 --2- 172.21.15.59:0/2313620465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c0c72a0 0x7f648c0c54b0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f6492a00640 1 --2- 172.21.15.59:0/2313620465 >> v2:172.21.15.178:3300/0 conn(0x7f648c15dc00 0x7f648c0af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.652+0000 7f6492a00640 1 -- 172.21.15.59:0/2313620465 >> 172.21.15.59:0/2313620465 conn(0x7f648c0b2240 msgr2=0x7f648c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6492a00640 1 -- 172.21.15.59:0/2313620465 shutdown_connections 2024-04-25T09:07:44.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6492a00640 1 -- 172.21.15.59:0/2313620465 wait complete. 2024-04-25T09:07:44.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6492a00640 1 Processor -- start 2024-04-25T09:07:44.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6492a00640 1 -- start start 2024-04-25T09:07:44.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6492a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f648c0c72a0 0x7f648c147c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:44.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6492a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c0d0150 0x7f648c14e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6492a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f648c15dc00 0x7f648c148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6492a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c16a7c0 con 0x7f648c0d0150 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6492a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c16a640 con 0x7f648c0c72a0 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6492a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648c16a940 con 0x7f648c15dc00 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6483e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c0d0150 0x7f648c14e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f648be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f648c0c72a0 0x7f648c147c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6483e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c0d0150 0x7f648c14e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41366/0 (socket says 172.21.15.59:41366) 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6483e00640 1 -- 172.21.15.59:0/724334154 learned_addr learned my addr 172.21.15.59:0/724334154 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6490a00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f648c15dc00 0x7f648c148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6483e00640 1 -- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f648c15dc00 msgr2=0x7f648c148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6483e00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f648c15dc00 0x7f648c148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6483e00640 1 -- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f648c0c72a0 msgr2=0x7f648c147c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6483e00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f648c0c72a0 0x7f648c147c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:44.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6483e00640 1 -- 172.21.15.59:0/724334154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f648c14ebc0 con 0x7f648c0d0150 2024-04-25T09:07:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.656+0000 7f6483e00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c0d0150 0x7f648c14e680 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f647400c450 tx=0x7f647400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.660+0000 7f6488c00640 1 -- 172.21.15.59:0/724334154 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474012830 con 0x7f648c0d0150 2024-04-25T09:07:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.660+0000 7f6488c00640 1 -- 172.21.15.59:0/724334154 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6474017070 con 0x7f648c0d0150 2024-04-25T09:07:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.660+0000 7f6488c00640 1 -- 172.21.15.59:0/724334154 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6474012c30 con 0x7f648c0d0150 2024-04-25T09:07:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.660+0000 7f6492a00640 1 -- 172.21.15.59:0/724334154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c14d5e0 con 0x7f648c0d0150 2024-04-25T09:07:44.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.660+0000 7f6492a00640 1 -- 172.21.15.59:0/724334154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c14dba0 con 0x7f648c0d0150 2024-04-25T09:07:44.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.660+0000 7f6492a00640 1 -- 172.21.15.59:0/724334154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c0745d0 con 0x7f648c0d0150 2024-04-25T09:07:44.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.660+0000 7f6488c00640 1 -- 172.21.15.59:0/724334154 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f647401c460 con 0x7f648c0d0150 2024-04-25T09:07:44.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.660+0000 7f6488c00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6468066f60 0x7f6468069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:44.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.660+0000 7f6488c00640 1 -- 172.21.15.59:0/724334154 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f6474084b90 con 0x7f648c0d0150 2024-04-25T09:07:44.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.660+0000 7f648be00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6468066f60 0x7f6468069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:44.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.664+0000 7f648be00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6468066f60 0x7f6468069420 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f647c006fd0 tx=0x7f647c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:44.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.664+0000 7f6488c00640 1 -- 172.21.15.59:0/724334154 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f64740555d0 con 0x7f648c0d0150 2024-04-25T09:07:44.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:44.840+0000 7f6492a00640 1 -- 172.21.15.59:0/724334154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f648c06fc80 con 0x7f648c0d0150 2024-04-25T09:07:45.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6488c00640 1 -- 172.21.15.59:0/724334154 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6474059670 con 0x7f648c0d0150 2024-04-25T09:07:45.451 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-04-25T09:07:45.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6492a00640 1 -- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6468066f60 msgr2=0x7f6468069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:45.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6492a00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6468066f60 0x7f6468069420 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f647c006fd0 tx=0x7f647c008040 comp rx=0 tx=0).stop 2024-04-25T09:07:45.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6492a00640 1 -- 172.21.15.59:0/724334154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c0d0150 msgr2=0x7f648c14e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:45.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6492a00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c0d0150 0x7f648c14e680 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f647400c450 tx=0x7f647400c910 comp rx=0 tx=0).stop 2024-04-25T09:07:45.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6492a00640 1 -- 172.21.15.59:0/724334154 shutdown_connections 2024-04-25T09:07:45.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6492a00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6468066f60 0x7f6468069420 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6492a00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f648c15dc00 0x7f648c148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6492a00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f648c0d0150 0x7f648c14e680 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6492a00640 1 --2- 172.21.15.59:0/724334154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f648c0c72a0 0x7f648c147c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6492a00640 1 -- 172.21.15.59:0/724334154 >> 172.21.15.59:0/724334154 conn(0x7f648c0b2240 msgr2=0x7f648c0adb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:45.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6492a00640 1 -- 172.21.15.59:0/724334154 shutdown_connections 2024-04-25T09:07:45.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.464+0000 7f6492a00640 1 -- 172.21.15.59:0/724334154 wait complete. 2024-04-25T09:07:45.481 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:07:45.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f5070c00640 1 Processor -- start 2024-04-25T09:07:45.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f5070c00640 1 -- start start 2024-04-25T09:07:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f5070c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c06e0d0 0x7f506c06d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f5070c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c06f5b0 con 0x7f506c157f00 2024-04-25T09:07:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f5070c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c06f890 con 0x7f506c06d9c0 2024-04-25T09:07:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f5070c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c06f390 con 0x7f506c06e0d0 2024-04-25T09:07:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f506c157f00 0x7f506c06ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50034/0 (socket says 172.21.15.59:50034) 2024-04-25T09:07:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506b400640 1 -- 172.21.15.59:0/3513469003 learned_addr learned my addr 172.21.15.59:0/3513469003 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f5063e00640 1 --2- 172.21.15.59:0/3513469003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c06e0d0 0x7f506c06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1553878795 0 0) 0x7f506c06f5b0 con 0x7f506c157f00 2024-04-25T09:07:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5050003530 con 0x7f506c157f00 2024-04-25T09:07:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013879539 0 0) 0x7f506c06f890 con 0x7f506c06d9c0 2024-04-25T09:07:45.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f506c06f5b0 con 0x7f506c06d9c0 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 733104527 0 0) 0x7f5050003530 con 0x7f506c157f00 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c06e0d0 msgr2=0x7f506c06d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 --2- 172.21.15.59:0/3513469003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c06e0d0 0x7f506c06d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 >> v1:172.21.15.178:6789/0 conn(0x7f506c06d9c0 legacy=0x7f506c0b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c06fb70 con 0x7f506c157f00 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f505c001680 con 0x7f506c157f00 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 >> v1:172.21.15.59:6789/0 conn(0x7f506c157f00 legacy=0x7f506c06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 --2- 172.21.15.59:0/3513469003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5050003b80 0x7f5050003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 --2- 172.21.15.59:0/3513469003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c06e0d0 0x7f5050004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 --2- 172.21.15.59:0/3513469003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5050004d50 0x7f50500051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c06f390 con 0x7f5050003b80 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505000bb60 con 0x7f5050004d50 2024-04-25T09:07:45.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505000bd30 con 0x7f506c06e0d0 2024-04-25T09:07:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506b400640 1 --2- 172.21.15.59:0/3513469003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5050003b80 0x7f5050003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f5063e00640 1 --2- 172.21.15.59:0/3513469003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c06e0d0 0x7f5050004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506be00640 1 --2- 172.21.15.59:0/3513469003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5050004d50 0x7f50500051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506b400640 1 -- 172.21.15.59:0/3513469003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c06e0d0 msgr2=0x7f5050004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506b400640 1 --2- 172.21.15.59:0/3513469003 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c06e0d0 0x7f5050004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506b400640 1 -- 172.21.15.59:0/3513469003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5050004d50 msgr2=0x7f50500051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506b400640 1 --2- 172.21.15.59:0/3513469003 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5050004d50 0x7f50500051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.636+0000 7f506b400640 1 -- 172.21.15.59:0/3513469003 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5050003530 con 0x7f5050003b80 2024-04-25T09:07:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.640+0000 7f506b400640 1 --2- 172.21.15.59:0/3513469003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5050003b80 0x7f5050003f80 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f505c00c0e0 tx=0x7f505c01cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885bd94f6ac2d6e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.640+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c007bf0 con 0x7f5050003b80 2024-04-25T09:07:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.640+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c0a9020 con 0x7f5050003b80 2024-04-25T09:07:45.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.640+0000 7f506aa00640 1 -- 172.21.15.59:0/3513469003 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c005b00 con 0x7f5050003b80 2024-04-25T09:07:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.640+0000 7f5070c00640 1 -- 172.21.15.59:0/3513469003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5050003b80 msgr2=0x7f5050003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.640+0000 7f5070c00640 1 --2- 172.21.15.59:0/3513469003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5050003b80 0x7f5050003f80 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f505c00c0e0 tx=0x7f505c01cb20 comp rx=0 tx=0).stop 2024-04-25T09:07:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.640+0000 7f506be00640 1 -- 172.21.15.59:0/3513469003 reap_dead start 2024-04-25T09:07:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.640+0000 7f5070c00640 1 -- 172.21.15.59:0/3513469003 shutdown_connections 2024-04-25T09:07:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.640+0000 7f5070c00640 1 -- 172.21.15.59:0/3513469003 >> 172.21.15.59:0/3513469003 conn(0x7f506c0cfdc0 msgr2=0x7f506c0b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.640+0000 7f5070c00640 1 -- 172.21.15.59:0/3513469003 shutdown_connections 2024-04-25T09:07:45.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.640+0000 7f5070c00640 1 -- 172.21.15.59:0/3513469003 wait complete. 2024-04-25T09:07:45.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5070c00640 1 Processor -- start 2024-04-25T09:07:45.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5070c00640 1 -- start start 2024-04-25T09:07:45.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5070c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5050003b80 0x7f506c0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:45.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5070c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c15aa70 0x7f506c0c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:45.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5070c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f506c160190 0x7f506c160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:45.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5070c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0b4000 con 0x7f5050003b80 2024-04-25T09:07:45.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5070c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c06de30 con 0x7f506c160190 2024-04-25T09:07:45.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5070c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c0b4180 con 0x7f506c15aa70 2024-04-25T09:07:45.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f506b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5050003b80 0x7f506c0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:45.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f506b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5050003b80 0x7f506c0c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41384/0 (socket says 172.21.15.59:41384) 2024-04-25T09:07:45.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5063e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c15aa70 0x7f506c0c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:45.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f506b400640 1 -- 172.21.15.59:0/3698865835 learned_addr learned my addr 172.21.15.59:0/3698865835 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:45.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f506be00640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f506c160190 0x7f506c160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f506b400640 1 -- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c15aa70 msgr2=0x7f506c0c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f506b400640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c15aa70 0x7f506c0c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f506b400640 1 -- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f506c160190 msgr2=0x7f506c160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f506b400640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f506c160190 0x7f506c160640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f506b400640 1 -- 172.21.15.59:0/3698865835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c15af00 con 0x7f5050003b80 2024-04-25T09:07:45.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f506b400640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5050003b80 0x7f506c0c5b70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f505c00c0e0 tx=0x7f5050005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5063400640 1 -- 172.21.15.59:0/3698865835 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c007bf0 con 0x7f5050003b80 2024-04-25T09:07:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5063400640 1 -- 172.21.15.59:0/3698865835 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505c0072d0 con 0x7f5050003b80 2024-04-25T09:07:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5063400640 1 -- 172.21.15.59:0/3698865835 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505c001b30 con 0x7f5050003b80 2024-04-25T09:07:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5070c00640 1 -- 172.21.15.59:0/3698865835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c15b1e0 con 0x7f5050003b80 2024-04-25T09:07:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.644+0000 7f5070c00640 1 -- 172.21.15.59:0/3698865835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c15b7a0 con 0x7f5050003b80 2024-04-25T09:07:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.648+0000 7f5070c00640 1 -- 172.21.15.59:0/3698865835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f506c04efa0 con 0x7f5050003b80 2024-04-25T09:07:45.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.648+0000 7f5063400640 1 -- 172.21.15.59:0/3698865835 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f505c0a5600 con 0x7f5050003b80 2024-04-25T09:07:45.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.648+0000 7f5063400640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5048066f60 0x7f5048069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:45.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.648+0000 7f5063400640 1 -- 172.21.15.59:0/3698865835 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f505c11e560 con 0x7f5050003b80 2024-04-25T09:07:45.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.648+0000 7f5063e00640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5048066f60 0x7f5048069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:45.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.648+0000 7f5063e00640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5048066f60 0x7f5048069420 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f506c161350 tx=0x7f5054009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:45.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.652+0000 7f5063400640 1 -- 172.21.15.59:0/3698865835 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f505c016830 con 0x7f5050003b80 2024-04-25T09:07:45.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 -- 172.21.15.59:0/3698865835 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f506c0cc1c0 con 0x7f5050003b80 2024-04-25T09:07:45.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5063400640 1 -- 172.21.15.59:0/3698865835 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f505c0ef720 con 0x7f5050003b80 2024-04-25T09:07:45.861 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:45.861 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:07:45.861 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-04-25T09:07:45.861 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.861 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-04-25T09:07:45.861 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmefAMLRAAyOhrYPGN2IYchV7wMDkkTQ==", 2024-04-25T09:07:45.861 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.861 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:07:45.861 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmcZtGORAA9RU5OkQHTCXe5nkpEp77Fw==", 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.862 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmF3skNBAAcKEUsLnvjEY8fz59SnjWtg==", 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm95/1BBAAsIbA6GBVS4dl7sZ8CoZoLA==", 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.863 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCsGypmmikBDRAAcxA0eWyo/w0bALsf4Fb3KQ==", 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.864 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCvGypm66dNFxAAzl06IBbHoxHorB3FuCFNOQ==", 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCyGypmQrwdIhAAyF53f8p7/vnJ6L4ZjXcKhQ==", 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.865 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC1GypmtETmLBAAM4p1FOPAiB0aOcdfIcl6vg==", 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.866 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC6GypmyXGCAhAAKJ2Yh0lezpRfFMPXjN4Asg==", 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC9GypmmfZZDBAAzw9IygUbRErERr2lXEfutA==", 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:45.867 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDAGypmS4KRFRAAXrvA1QNbuWF6+ln+cz6orQ==", 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.868 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDDGypmruPJHRAAWFONkZiSsYgvsr04uO9J9A==", 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg==", 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:07:45.869 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm8NCkEhAAEELIQ7EAUFHsANHAa5EnTA==", 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.870 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmdosADxAAxmQqp2O5lT5XenyqxyyMKw==", 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmsqWgGBAAIXaSazGZkKiY2hqcC+WApA==", 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.871 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypm5ldPEBAAepEqWPcDy8atp78XxKERYg==", 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.872 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmwOe7KBAAIvO6OJiUeb5hRdu9VX11cA==", 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmX2GpJBAA8RvpxNpdPFExISwQzT56fA==", 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:07:45.873 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:07:45.874 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:07:45.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.874 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:45.874 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-25T09:07:45.874 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:07:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 -- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5048066f60 msgr2=0x7f5048069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5048066f60 0x7f5048069420 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f506c161350 tx=0x7f5054009190 comp rx=0 tx=0).stop 2024-04-25T09:07:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 -- 172.21.15.59:0/3698865835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5050003b80 msgr2=0x7f506c0c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5050003b80 0x7f506c0c5b70 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f505c00c0e0 tx=0x7f5050005840 comp rx=0 tx=0).stop 2024-04-25T09:07:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 -- 172.21.15.59:0/3698865835 shutdown_connections 2024-04-25T09:07:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5048066f60 0x7f5048069420 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f506c160190 0x7f506c160640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f506c15aa70 0x7f506c0c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 --2- 172.21.15.59:0/3698865835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5050003b80 0x7f506c0c5b70 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:45.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 -- 172.21.15.59:0/3698865835 >> 172.21.15.59:0/3698865835 conn(0x7f506c0cfdc0 msgr2=0x7f506c0cea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:45.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 -- 172.21.15.59:0/3698865835 shutdown_connections 2024-04-25T09:07:45.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:45.872+0000 7f5070c00640 1 -- 172.21.15.59:0/3698865835 wait complete. 2024-04-25T09:07:45.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:46.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174fc00640 1 Processor -- start 2024-04-25T09:07:46.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174fc00640 1 -- start start 2024-04-25T09:07:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174fc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1748145020 0x7f1748072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174fc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1748145400 0x7f174806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174fc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f174806ac10 0x7f174806b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174fc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174806b5b0 con 0x7f174806ac10 2024-04-25T09:07:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174fc00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17480cd360 con 0x7f1748145400 2024-04-25T09:07:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174fc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480ce130 con 0x7f1748145020 2024-04-25T09:07:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f174806ac10 0x7f174806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174dc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f174806ac10 0x7f174806b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41390/0 (socket says 172.21.15.59:41390) 2024-04-25T09:07:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174dc00640 1 -- 172.21.15.59:0/3660646979 learned_addr learned my addr 172.21.15.59:0/3660646979 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174d200640 1 --2- 172.21.15.59:0/3660646979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1748145020 0x7f1748072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f173fe00640 1 --2- 172.21.15.59:0/3660646979 >> v2:172.21.15.178:3300/0 conn(0x7f1748145400 0x7f174806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174dc00640 1 -- 172.21.15.59:0/3660646979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1748145020 msgr2=0x7f1748072cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174dc00640 1 --2- 172.21.15.59:0/3660646979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1748145020 0x7f1748072cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174dc00640 1 -- 172.21.15.59:0/3660646979 >> v2:172.21.15.178:3300/0 conn(0x7f1748145400 msgr2=0x7f174806fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174dc00640 1 --2- 172.21.15.59:0/3660646979 >> v2:172.21.15.178:3300/0 conn(0x7f1748145400 0x7f174806fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.036+0000 7f174dc00640 1 -- 172.21.15.59:0/3660646979 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748073200 con 0x7f174806ac10 2024-04-25T09:07:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f174dc00640 1 --2- 172.21.15.59:0/3660646979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174806ac10 0x7f174806b070 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f17480b34c0 tx=0x7f174001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934048b4f5cc05e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f1747e00640 1 -- 172.21.15.59:0/3660646979 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400a5840 con 0x7f174806ac10 2024-04-25T09:07:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f1747e00640 1 -- 172.21.15.59:0/3660646979 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17400a59e0 con 0x7f174806ac10 2024-04-25T09:07:46.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f1747e00640 1 -- 172.21.15.59:0/3660646979 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400a5db0 con 0x7f174806ac10 2024-04-25T09:07:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f174fc00640 1 -- 172.21.15.59:0/3660646979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174806ac10 msgr2=0x7f174806b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f174fc00640 1 --2- 172.21.15.59:0/3660646979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174806ac10 0x7f174806b070 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f17480b34c0 tx=0x7f174001c9c0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f174fc00640 1 -- 172.21.15.59:0/3660646979 shutdown_connections 2024-04-25T09:07:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f174fc00640 1 --2- 172.21.15.59:0/3660646979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f174806ac10 0x7f174806b070 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f174fc00640 1 --2- 172.21.15.59:0/3660646979 >> v2:172.21.15.178:3300/0 conn(0x7f1748145400 0x7f174806fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f174fc00640 1 --2- 172.21.15.59:0/3660646979 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1748145020 0x7f1748072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f174fc00640 1 -- 172.21.15.59:0/3660646979 >> 172.21.15.59:0/3660646979 conn(0x7f17480b2400 msgr2=0x7f17480b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f174fc00640 1 -- 172.21.15.59:0/3660646979 shutdown_connections 2024-04-25T09:07:46.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.040+0000 7f174fc00640 1 -- 172.21.15.59:0/3660646979 wait complete. 2024-04-25T09:07:46.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174fc00640 1 Processor -- start 2024-04-25T09:07:46.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174fc00640 1 -- start start 2024-04-25T09:07:46.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174fc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f174806ac10 0x7f1748141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174fc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1748145020 0x7f17481439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174fc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1748145400 0x7f1748138100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174fc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1748070060 con 0x7f1748145400 2024-04-25T09:07:46.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174fc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17480cde50 con 0x7f174806ac10 2024-04-25T09:07:46.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174fc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17480d01e0 con 0x7f1748145020 2024-04-25T09:07:46.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1748145400 0x7f1748138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1748145400 0x7f1748138100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41404/0 (socket says 172.21.15.59:41404) 2024-04-25T09:07:46.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174dc00640 1 -- 172.21.15.59:0/3694386517 learned_addr learned my addr 172.21.15.59:0/3694386517 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:46.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174d200640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f174806ac10 0x7f1748141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f173fe00640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1748145020 0x7f17481439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174dc00640 1 -- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1748145020 msgr2=0x7f17481439d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174dc00640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1748145020 0x7f17481439d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174dc00640 1 -- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f174806ac10 msgr2=0x7f1748141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174dc00640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f174806ac10 0x7f1748141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174dc00640 1 -- 172.21.15.59:0/3694386517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17480b3800 con 0x7f1748145400 2024-04-25T09:07:46.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174dc00640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1748145400 0x7f1748138100 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f174001b070 tx=0x7f1740019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f1745600640 1 -- 172.21.15.59:0/3694386517 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400b8670 con 0x7f1748145400 2024-04-25T09:07:46.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f1745600640 1 -- 172.21.15.59:0/3694386517 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17400be070 con 0x7f1748145400 2024-04-25T09:07:46.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f1745600640 1 -- 172.21.15.59:0/3694386517 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400b8a50 con 0x7f1748145400 2024-04-25T09:07:46.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174fc00640 1 -- 172.21.15.59:0/3694386517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1748143f10 con 0x7f1748145400 2024-04-25T09:07:46.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174fc00640 1 -- 172.21.15.59:0/3694386517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174815c500 con 0x7f1748145400 2024-04-25T09:07:46.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.044+0000 7f174fc00640 1 -- 172.21.15.59:0/3694386517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17480745d0 con 0x7f1748145400 2024-04-25T09:07:46.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.048+0000 7f1745600640 1 -- 172.21.15.59:0/3694386517 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f17400b8bf0 con 0x7f1748145400 2024-04-25T09:07:46.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.048+0000 7f1745600640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1724066f60 0x7f1724069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.048+0000 7f1745600640 1 -- 172.21.15.59:0/3694386517 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1740120070 con 0x7f1748145400 2024-04-25T09:07:46.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.048+0000 7f174d200640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1724066f60 0x7f1724069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.048+0000 7f174d200640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1724066f60 0x7f1724069420 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f17380045f0 tx=0x7f1738008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.052+0000 7f1745600640 1 -- 172.21.15.59:0/3694386517 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f17480b3800 con 0x7f1748145400 2024-04-25T09:07:46.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 -- 172.21.15.59:0/3694386517 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1748072550 con 0x7f1748145400 2024-04-25T09:07:46.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f1745600640 1 -- 172.21.15.59:0/3694386517 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+13165 (secure 0 0 0) 0x7f17400165e0 con 0x7f1748145400 2024-04-25T09:07:46.205 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:46.205 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":88,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:07:45.472952+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 -- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1724066f60 msgr2=0x7f1724069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1724066f60 0x7f1724069420 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f17380045f0 tx=0x7f1738008040 comp rx=0 tx=0).stop 2024-04-25T09:07:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 -- 172.21.15.59:0/3694386517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1748145400 msgr2=0x7f1748138100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1748145400 0x7f1748138100 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f174001b070 tx=0x7f1740019760 comp rx=0 tx=0).stop 2024-04-25T09:07:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 -- 172.21.15.59:0/3694386517 shutdown_connections 2024-04-25T09:07:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1724066f60 0x7f1724069420 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1748145400 0x7f1748138100 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1748145020 0x7f17481439d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 --2- 172.21.15.59:0/3694386517 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f174806ac10 0x7f1748141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 -- 172.21.15.59:0/3694386517 >> 172.21.15.59:0/3694386517 conn(0x7f17480b2400 msgr2=0x7f174813e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 -- 172.21.15.59:0/3694386517 shutdown_connections 2024-04-25T09:07:46.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.216+0000 7f174fc00640 1 -- 172.21.15.59:0/3694386517 wait complete. 2024-04-25T09:07:46.226 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:07:46.226 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:07:46.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.380+0000 7f53ffa00640 1 Processor -- start 2024-04-25T09:07:46.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.380+0000 7f53ffa00640 1 -- start start 2024-04-25T09:07:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53ffa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f815dd90 0x7f53f8071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53ffa00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f53f8072040 0x7f53f8161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53ffa00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f8072460 con 0x7f53f8161cc0 2024-04-25T09:07:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53ffa00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f80b2dc0 con 0x7f53f8072040 2024-04-25T09:07:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53ffa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f806ac10 con 0x7f53f815dd90 2024-04-25T09:07:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53efe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f53f8072040 0x7f53f8161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53fd000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f815dd90 0x7f53f8071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53fda00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f53f8161cc0 0x7f53f80cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:52424/0 (socket says 172.21.15.59:52424) 2024-04-25T09:07:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53fda00640 1 -- 172.21.15.59:0/2752180055 learned_addr learned my addr 172.21.15.59:0/2752180055 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:46.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53efe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f53f8072040 0x7f53f8161780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:46922/0 (socket says 172.21.15.59:46922) 2024-04-25T09:07:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53fd000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f815dd90 0x7f53f8071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:60836/0 (socket says 172.21.15.59:60836) 2024-04-25T09:07:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53efe00640 1 -- 172.21.15.59:0/2752180055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f815dd90 msgr2=0x7f53f8071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53efe00640 1 --2- 172.21.15.59:0/2752180055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f815dd90 0x7f53f8071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53efe00640 1 -- 172.21.15.59:0/2752180055 >> v1:172.21.15.178:6789/0 conn(0x7f53f8161cc0 legacy=0x7f53f80cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53efe00640 1 -- 172.21.15.59:0/2752180055 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f806aeb0 con 0x7f53f8072040 2024-04-25T09:07:46.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.384+0000 7f53fd000640 1 --2- 172.21.15.59:0/2752180055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f815dd90 0x7f53f8071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:46.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.388+0000 7f53efe00640 1 --2- 172.21.15.59:0/2752180055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f8072040 0x7f53f8161780 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f53e00097c0 tx=0x7f53e001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=471184ed821744a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.388+0000 7f53f7e00640 1 -- 172.21.15.59:0/2752180055 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e00b0070 con 0x7f53f8072040 2024-04-25T09:07:46.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.388+0000 7f53f7e00640 1 -- 172.21.15.59:0/2752180055 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e00ab600 con 0x7f53f8072040 2024-04-25T09:07:46.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.388+0000 7f53f7e00640 1 -- 172.21.15.59:0/2752180055 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e00ab9d0 con 0x7f53f8072040 2024-04-25T09:07:46.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.388+0000 7f53ffa00640 1 -- 172.21.15.59:0/2752180055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f8072040 msgr2=0x7f53f8161780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.388+0000 7f53ffa00640 1 --2- 172.21.15.59:0/2752180055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f8072040 0x7f53f8161780 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f53e00097c0 tx=0x7f53e001c410 comp rx=0 tx=0).stop 2024-04-25T09:07:46.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.388+0000 7f53ffa00640 1 -- 172.21.15.59:0/2752180055 shutdown_connections 2024-04-25T09:07:46.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.388+0000 7f53ffa00640 1 --2- 172.21.15.59:0/2752180055 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f8072040 0x7f53f8161780 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.388+0000 7f53ffa00640 1 --2- 172.21.15.59:0/2752180055 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f815dd90 0x7f53f8071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.388+0000 7f53ffa00640 1 -- 172.21.15.59:0/2752180055 >> 172.21.15.59:0/2752180055 conn(0x7f53f80cfd90 msgr2=0x7f53f80d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:46.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.388+0000 7f53ffa00640 1 -- 172.21.15.59:0/2752180055 shutdown_connections 2024-04-25T09:07:46.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.388+0000 7f53ffa00640 1 -- 172.21.15.59:0/2752180055 wait complete. 2024-04-25T09:07:46.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53ffa00640 1 Processor -- start 2024-04-25T09:07:46.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53ffa00640 1 -- start start 2024-04-25T09:07:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53ffa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f8072040 0x7f53f81600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53ffa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f815dd90 0x7f53f8159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53ffa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f8161cc0 0x7f53f8159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53ffa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f816aac0 con 0x7f53f8072040 2024-04-25T09:07:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53ffa00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f81624e0 con 0x7f53f8161cc0 2024-04-25T09:07:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53ffa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f816ac40 con 0x7f53f815dd90 2024-04-25T09:07:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53fd000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f8072040 0x7f53f81600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53fd000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f8072040 0x7f53f81600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41412/0 (socket says 172.21.15.59:41412) 2024-04-25T09:07:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53fd000640 1 -- 172.21.15.59:0/1997596392 learned_addr learned my addr 172.21.15.59:0/1997596392 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53fd000640 1 -- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f815dd90 msgr2=0x7f53f8159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53fd000640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f815dd90 0x7f53f8159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53fd000640 1 -- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f8161cc0 msgr2=0x7f53f8159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53fda00640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f8161cc0 0x7f53f8159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53fd000640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f8161cc0 0x7f53f8159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53fd000640 1 -- 172.21.15.59:0/1997596392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f815ec90 con 0x7f53f8072040 2024-04-25T09:07:46.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53fda00640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f8161cc0 0x7f53f8159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:46.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53fd000640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f8072040 0x7f53f81600d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f53e800efc0 tx=0x7f53e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53f5600640 1 -- 172.21.15.59:0/1997596392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8018020 con 0x7f53f8072040 2024-04-25T09:07:46.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53f5600640 1 -- 172.21.15.59:0/1997596392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e8014680 con 0x7f53f8072040 2024-04-25T09:07:46.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53ffa00640 1 -- 172.21.15.59:0/1997596392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f815ef70 con 0x7f53f8072040 2024-04-25T09:07:46.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53f5600640 1 -- 172.21.15.59:0/1997596392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8014a50 con 0x7f53f8072040 2024-04-25T09:07:46.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53ffa00640 1 -- 172.21.15.59:0/1997596392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f815f530 con 0x7f53f8072040 2024-04-25T09:07:46.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.392+0000 7f53ffa00640 1 -- 172.21.15.59:0/1997596392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f80745d0 con 0x7f53f8072040 2024-04-25T09:07:46.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.396+0000 7f53f5600640 1 -- 172.21.15.59:0/1997596392 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f53e801b020 con 0x7f53f8072040 2024-04-25T09:07:46.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.396+0000 7f53f5600640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f53d4066f60 0x7f53d4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.396+0000 7f53f5600640 1 -- 172.21.15.59:0/1997596392 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f53e8085e10 con 0x7f53f8072040 2024-04-25T09:07:46.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.396+0000 7f53efe00640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f53d4066f60 0x7f53d4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.396+0000 7f53efe00640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f53d4066f60 0x7f53d4069420 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f53e00ad000 tx=0x7f53e0004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.400+0000 7f53f5600640 1 -- 172.21.15.59:0/1997596392 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f53e8089030 con 0x7f53f8072040 2024-04-25T09:07:46.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.564+0000 7f53ffa00640 1 -- 172.21.15.59:0/1997596392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f53f8161090 con 0x7f53f8072040 2024-04-25T09:07:46.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.564+0000 7f53f5600640 1 -- 172.21.15.59:0/1997596392 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f53e8022030 con 0x7f53f8072040 2024-04-25T09:07:46.554 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:07:46.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.568+0000 7f53ffa00640 1 -- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f53d4066f60 msgr2=0x7f53d4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.568+0000 7f53ffa00640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f53d4066f60 0x7f53d4069420 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f53e00ad000 tx=0x7f53e0004740 comp rx=0 tx=0).stop 2024-04-25T09:07:46.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.568+0000 7f53ffa00640 1 -- 172.21.15.59:0/1997596392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f8072040 msgr2=0x7f53f81600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.568+0000 7f53ffa00640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f8072040 0x7f53f81600d0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f53e800efc0 tx=0x7f53e800c490 comp rx=0 tx=0).stop 2024-04-25T09:07:46.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.568+0000 7f53ffa00640 1 -- 172.21.15.59:0/1997596392 shutdown_connections 2024-04-25T09:07:46.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.568+0000 7f53ffa00640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f53d4066f60 0x7f53d4069420 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.568+0000 7f53ffa00640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f53f8161cc0 0x7f53f8159670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.568+0000 7f53ffa00640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f53f815dd90 0x7f53f8159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.568+0000 7f53ffa00640 1 --2- 172.21.15.59:0/1997596392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f8072040 0x7f53f81600d0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.568+0000 7f53ffa00640 1 -- 172.21.15.59:0/1997596392 >> 172.21.15.59:0/1997596392 conn(0x7f53f80cfd90 msgr2=0x7f53f80b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:46.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.568+0000 7f53ffa00640 1 -- 172.21.15.59:0/1997596392 shutdown_connections 2024-04-25T09:07:46.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.568+0000 7f53ffa00640 1 -- 172.21.15.59:0/1997596392 wait complete. 2024-04-25T09:07:46.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:07:46.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bcae00640 1 Processor -- start 2024-04-25T09:07:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bcae00640 1 -- start start 2024-04-25T09:07:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bcae00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1bc40cf370 0x7f1bc4099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bcae00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1bc409a600 0x7f1bc40cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bcae00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc409a380 con 0x7f1bc4099a60 2024-04-25T09:07:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bcae00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc40d0410 con 0x7f1bc409a600 2024-04-25T09:07:46.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bcae00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc40cf800 con 0x7f1bc40cf370 2024-04-25T09:07:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bc3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1bc4099a60 0x7f1bc415bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50048/0 (socket says 172.21.15.59:50048) 2024-04-25T09:07:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bc3e00640 1 -- 172.21.15.59:0/3413645282 learned_addr learned my addr 172.21.15.59:0/3413645282 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bc8e00640 1 --2- 172.21.15.59:0/3413645282 >> v2:172.21.15.59:3300/0 conn(0x7f1bc409a600 0x7f1bc40cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bbbe00640 1 --2- 172.21.15.59:0/3413645282 >> v2:172.21.15.178:3300/0 conn(0x7f1bc40cf370 0x7f1bc4099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bc8e00640 1 -- 172.21.15.59:0/3413645282 >> v2:172.21.15.178:3300/0 conn(0x7f1bc40cf370 msgr2=0x7f1bc4099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bc8e00640 1 --2- 172.21.15.59:0/3413645282 >> v2:172.21.15.178:3300/0 conn(0x7f1bc40cf370 0x7f1bc4099e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bc8e00640 1 -- 172.21.15.59:0/3413645282 >> v1:172.21.15.59:6789/0 conn(0x7f1bc4099a60 legacy=0x7f1bc415bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bc8e00640 1 -- 172.21.15.59:0/3413645282 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40cfae0 con 0x7f1bc409a600 2024-04-25T09:07:46.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.728+0000 7f1bc3400640 1 -- 172.21.15.59:0/3413645282 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133693863 0 0) 0x7f1bc409a380 con 0x7f1bc4099a60 2024-04-25T09:07:46.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.732+0000 7f1bc8e00640 1 --2- 172.21.15.59:0/3413645282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc409a600 0x7f1bc40cc2b0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40d25f0 tx=0x7f1bbc01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e60c146aae14f77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.732+0000 7f1bc3400640 1 -- 172.21.15.59:0/3413645282 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0b2070 con 0x7f1bc409a600 2024-04-25T09:07:46.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.732+0000 7f1bc3400640 1 -- 172.21.15.59:0/3413645282 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0a58b0 con 0x7f1bc409a600 2024-04-25T09:07:46.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.732+0000 7f1bc3400640 1 -- 172.21.15.59:0/3413645282 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0a5c80 con 0x7f1bc409a600 2024-04-25T09:07:46.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.732+0000 7f1bcae00640 1 -- 172.21.15.59:0/3413645282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc409a600 msgr2=0x7f1bc40cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.732+0000 7f1bcae00640 1 --2- 172.21.15.59:0/3413645282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc409a600 0x7f1bc40cc2b0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40d25f0 tx=0x7f1bbc01c870 comp rx=0 tx=0).stop 2024-04-25T09:07:46.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.732+0000 7f1bcae00640 1 -- 172.21.15.59:0/3413645282 shutdown_connections 2024-04-25T09:07:46.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.732+0000 7f1bcae00640 1 --2- 172.21.15.59:0/3413645282 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc409a600 0x7f1bc40cc2b0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.732+0000 7f1bcae00640 1 --2- 172.21.15.59:0/3413645282 >> v2:172.21.15.178:3300/0 conn(0x7f1bc40cf370 0x7f1bc4099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.732+0000 7f1bcae00640 1 -- 172.21.15.59:0/3413645282 >> 172.21.15.59:0/3413645282 conn(0x7f1bc40d17a0 msgr2=0x7f1bc40d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:46.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.732+0000 7f1bcae00640 1 -- 172.21.15.59:0/3413645282 shutdown_connections 2024-04-25T09:07:46.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.732+0000 7f1bcae00640 1 -- 172.21.15.59:0/3413645282 wait complete. 2024-04-25T09:07:46.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bcae00640 1 Processor -- start 2024-04-25T09:07:46.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bcae00640 1 -- start start 2024-04-25T09:07:46.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bcae00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bc4099a60 0x7f1bc40c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bcae00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bc409a600 0x7f1bc40caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bcae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc4153720 0x7f1bc4155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bcae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40cd390 con 0x7f1bc4153720 2024-04-25T09:07:46.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bcae00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40cd210 con 0x7f1bc409a600 2024-04-25T09:07:46.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bcae00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc40cd510 con 0x7f1bc4099a60 2024-04-25T09:07:46.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc4153720 0x7f1bc4155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc8e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc4153720 0x7f1bc4155580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41428/0 (socket says 172.21.15.59:41428) 2024-04-25T09:07:46.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc8e00640 1 -- 172.21.15.59:0/162091867 learned_addr learned my addr 172.21.15.59:0/162091867 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:46.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc3e00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bc4099a60 0x7f1bc40c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bbbe00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bc409a600 0x7f1bc40caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc8e00640 1 -- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bc4099a60 msgr2=0x7f1bc40c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc8e00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bc4099a60 0x7f1bc40c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc8e00640 1 -- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bc409a600 msgr2=0x7f1bc40caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc8e00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bc409a600 0x7f1bc40caeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc8e00640 1 -- 172.21.15.59:0/162091867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40c9e10 con 0x7f1bc4153720 2024-04-25T09:07:46.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc3e00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bc4099a60 0x7f1bc40c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:46.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc8e00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc4153720 0x7f1bc4155580 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0b0040 tx=0x7f1bbc019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc0c00640 1 -- 172.21.15.59:0/162091867 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0bd030 con 0x7f1bc4153720 2024-04-25T09:07:46.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc0c00640 1 -- 172.21.15.59:0/162091867 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bbc0039a0 con 0x7f1bc4153720 2024-04-25T09:07:46.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bc0c00640 1 -- 172.21.15.59:0/162091867 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0b2040 con 0x7f1bc4153720 2024-04-25T09:07:46.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bcae00640 1 -- 172.21.15.59:0/162091867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc40ca0f0 con 0x7f1bc4153720 2024-04-25T09:07:46.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.736+0000 7f1bcae00640 1 -- 172.21.15.59:0/162091867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc40ca6b0 con 0x7f1bc4153720 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.740+0000 7f1bcae00640 1 -- 172.21.15.59:0/162091867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc40745d0 con 0x7f1bc4153720 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.740+0000 7f1bc0c00640 1 -- 172.21.15.59:0/162091867 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1bbc004020 con 0x7f1bc4153720 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.740+0000 7f1bc0c00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ba0066f60 0x7f1ba0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.740+0000 7f1bc0c00640 1 -- 172.21.15.59:0/162091867 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f1bbc11fc90 con 0x7f1bc4153720 2024-04-25T09:07:46.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.740+0000 7f1bc3e00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ba0066f60 0x7f1ba0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:46.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.740+0000 7f1bc3e00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ba0066f60 0x7f1ba0069420 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4000f70 tx=0x7f1bb4007cb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:46.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.744+0000 7f1bc0c00640 1 -- 172.21.15.59:0/162091867 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1bbc016520 con 0x7f1bc4153720 2024-04-25T09:07:46.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.908+0000 7f1bcae00640 1 -- 172.21.15.59:0/162091867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1bc40d2620 con 0x7f1bc4153720 2024-04-25T09:07:46.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.908+0000 7f1bc0c00640 1 -- 172.21.15.59:0/162091867 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v88) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1bbc0c13c0 con 0x7f1bc4153720 2024-04-25T09:07:46.898 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:46.898 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T09:07:46.898 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:07:46.899 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-04-25T09:07:46.899 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-04-25T09:07:46.899 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:07:46.899 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T09:07:46.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.912+0000 7f1bcae00640 1 -- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ba0066f60 msgr2=0x7f1ba0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.912+0000 7f1bcae00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ba0066f60 0x7f1ba0069420 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4000f70 tx=0x7f1bb4007cb0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.912+0000 7f1bcae00640 1 -- 172.21.15.59:0/162091867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc4153720 msgr2=0x7f1bc4155580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:46.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.912+0000 7f1bcae00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc4153720 0x7f1bc4155580 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0b0040 tx=0x7f1bbc019610 comp rx=0 tx=0).stop 2024-04-25T09:07:46.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.912+0000 7f1bcae00640 1 -- 172.21.15.59:0/162091867 shutdown_connections 2024-04-25T09:07:46.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.912+0000 7f1bcae00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1ba0066f60 0x7f1ba0069420 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.912+0000 7f1bcae00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1bc4153720 0x7f1bc4155580 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.912+0000 7f1bcae00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1bc409a600 0x7f1bc40caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.912+0000 7f1bcae00640 1 --2- 172.21.15.59:0/162091867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1bc4099a60 0x7f1bc40c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:46.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.912+0000 7f1bcae00640 1 -- 172.21.15.59:0/162091867 >> 172.21.15.59:0/162091867 conn(0x7f1bc40d17a0 msgr2=0x7f1bc40736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:46.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.912+0000 7f1bcae00640 1 -- 172.21.15.59:0/162091867 shutdown_connections 2024-04-25T09:07:46.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:46.912+0000 7f1bcae00640 1 -- 172.21.15.59:0/162091867 wait complete. 2024-04-25T09:07:46.919 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:07:46.919 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:07:47.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd70000640 1 Processor -- start 2024-04-25T09:07:47.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd70000640 1 -- start start 2024-04-25T09:07:47.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd70000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcd680cd880 0x7fcd680cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd70000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd680ce9b0 con 0x7fcd6806ee10 2024-04-25T09:07:47.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd70000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd680cec90 con 0x7fcd680b2d60 2024-04-25T09:07:47.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd70000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd680ce780 con 0x7fcd680cd880 2024-04-25T09:07:47.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd6d600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcd6806ee10 0x7fcd6806f1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50050/0 (socket says 172.21.15.59:50050) 2024-04-25T09:07:47.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd6d600640 1 -- 172.21.15.59:0/632165616 learned_addr learned my addr 172.21.15.59:0/632165616 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:47.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd6e000640 1 --2- 172.21.15.59:0/632165616 >> v2:172.21.15.59:3300/0 conn(0x7fcd680cd880 0x7fcd680cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd67e00640 1 -- 172.21.15.59:0/632165616 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2633341213 0 0) 0x7fcd680ce9b0 con 0x7fcd6806ee10 2024-04-25T09:07:47.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd67e00640 1 -- 172.21.15.59:0/632165616 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd50003530 con 0x7fcd6806ee10 2024-04-25T09:07:47.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd6e000640 1 -- 172.21.15.59:0/632165616 >> v1:172.21.15.178:6789/0 conn(0x7fcd680b2d60 legacy=0x7fcd680cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd6e000640 1 -- 172.21.15.59:0/632165616 >> v1:172.21.15.59:6789/0 conn(0x7fcd6806ee10 legacy=0x7fcd6806f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.076+0000 7fcd6e000640 1 -- 172.21.15.59:0/632165616 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd680cef70 con 0x7fcd680cd880 2024-04-25T09:07:47.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.080+0000 7fcd6e000640 1 --2- 172.21.15.59:0/632165616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd680cd880 0x7fcd680cf770 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009d90 tx=0x7fcd6001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c020611c1c4a1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.080+0000 7fcd67e00640 1 -- 172.21.15.59:0/632165616 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd600b2070 con 0x7fcd680cd880 2024-04-25T09:07:47.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.080+0000 7fcd67e00640 1 -- 172.21.15.59:0/632165616 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd600a5830 con 0x7fcd680cd880 2024-04-25T09:07:47.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.080+0000 7fcd67e00640 1 -- 172.21.15.59:0/632165616 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd600a5c00 con 0x7fcd680cd880 2024-04-25T09:07:47.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.080+0000 7fcd70000640 1 -- 172.21.15.59:0/632165616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd680cd880 msgr2=0x7fcd680cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.080+0000 7fcd70000640 1 --2- 172.21.15.59:0/632165616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd680cd880 0x7fcd680cf770 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009d90 tx=0x7fcd6001c970 comp rx=0 tx=0).stop 2024-04-25T09:07:47.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.080+0000 7fcd70000640 1 -- 172.21.15.59:0/632165616 shutdown_connections 2024-04-25T09:07:47.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.080+0000 7fcd70000640 1 --2- 172.21.15.59:0/632165616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd680cd880 0x7fcd680cf770 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.080+0000 7fcd70000640 1 -- 172.21.15.59:0/632165616 >> 172.21.15.59:0/632165616 conn(0x7fcd680b2240 msgr2=0x7fcd680b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:47.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.080+0000 7fcd70000640 1 -- 172.21.15.59:0/632165616 shutdown_connections 2024-04-25T09:07:47.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.080+0000 7fcd70000640 1 -- 172.21.15.59:0/632165616 wait complete. 2024-04-25T09:07:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd70000640 1 Processor -- start 2024-04-25T09:07:47.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd70000640 1 -- start start 2024-04-25T09:07:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd70000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd6806ee10 0x7fcd68153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd70000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd680b2d60 0x7fcd681535c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd70000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd680cd880 0x7fcd68159ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd70000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6815ab80 con 0x7fcd680b2d60 2024-04-25T09:07:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd70000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6815aa00 con 0x7fcd6806ee10 2024-04-25T09:07:47.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd70000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd68168b40 con 0x7fcd680cd880 2024-04-25T09:07:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd6cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd680b2d60 0x7fcd681535c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd6d600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd6806ee10 0x7fcd68153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd6cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd680b2d60 0x7fcd681535c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41452/0 (socket says 172.21.15.59:41452) 2024-04-25T09:07:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd6cc00640 1 -- 172.21.15.59:0/911971279 learned_addr learned my addr 172.21.15.59:0/911971279 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd6e000640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd680cd880 0x7fcd68159ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd6cc00640 1 -- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd680cd880 msgr2=0x7fcd68159ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd6cc00640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd680cd880 0x7fcd68159ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd6cc00640 1 -- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd6806ee10 msgr2=0x7fcd68153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd6cc00640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd6806ee10 0x7fcd68153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd6cc00640 1 -- 172.21.15.59:0/911971279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68158a40 con 0x7fcd680b2d60 2024-04-25T09:07:47.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd6e000640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd680cd880 0x7fcd68159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd6cc00640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd680b2d60 0x7fcd681535c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400c420 tx=0x7fcd5400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd65600640 1 -- 172.21.15.59:0/911971279 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd540052d0 con 0x7fcd680b2d60 2024-04-25T09:07:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd65600640 1 -- 172.21.15.59:0/911971279 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd54005470 con 0x7fcd680b2d60 2024-04-25T09:07:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd65600640 1 -- 172.21.15.59:0/911971279 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd54007260 con 0x7fcd680b2d60 2024-04-25T09:07:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd70000640 1 -- 172.21.15.59:0/911971279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd68158d20 con 0x7fcd680b2d60 2024-04-25T09:07:47.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd70000640 1 -- 172.21.15.59:0/911971279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd681592e0 con 0x7fcd680b2d60 2024-04-25T09:07:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.084+0000 7fcd70000640 1 -- 172.21.15.59:0/911971279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd680745d0 con 0x7fcd680b2d60 2024-04-25T09:07:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.088+0000 7fcd65600640 1 -- 172.21.15.59:0/911971279 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcd54007400 con 0x7fcd680b2d60 2024-04-25T09:07:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.088+0000 7fcd65600640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcd48066f60 0x7fcd48069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.088+0000 7fcd65600640 1 -- 172.21.15.59:0/911971279 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fcd54084390 con 0x7fcd680b2d60 2024-04-25T09:07:47.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.088+0000 7fcd6d600640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcd48066f60 0x7fcd48069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.088+0000 7fcd6d600640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcd48066f60 0x7fcd48069420 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0011f0 tx=0x7fcd5c007d40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.092+0000 7fcd65600640 1 -- 172.21.15.59:0/911971279 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcd54054e70 con 0x7fcd680b2d60 2024-04-25T09:07:47.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.252+0000 7fcd70000640 1 -- 172.21.15.59:0/911971279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcd68165d00 con 0x7fcd680b2d60 2024-04-25T09:07:47.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.476+0000 7fcd65600640 1 -- 172.21.15.59:0/911971279 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v89) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcd54058f10 con 0x7fcd680b2d60 2024-04-25T09:07:47.466 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-04-25T09:07:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.480+0000 7fcd70000640 1 -- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcd48066f60 msgr2=0x7fcd48069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.480+0000 7fcd70000640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcd48066f60 0x7fcd48069420 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c0011f0 tx=0x7fcd5c007d40 comp rx=0 tx=0).stop 2024-04-25T09:07:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.480+0000 7fcd70000640 1 -- 172.21.15.59:0/911971279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd680b2d60 msgr2=0x7fcd681535c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.480+0000 7fcd70000640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd680b2d60 0x7fcd681535c0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fcd5400c420 tx=0x7fcd5400c8e0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.480+0000 7fcd70000640 1 -- 172.21.15.59:0/911971279 shutdown_connections 2024-04-25T09:07:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.480+0000 7fcd70000640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcd48066f60 0x7fcd48069420 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.480+0000 7fcd70000640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcd680cd880 0x7fcd68159ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.480+0000 7fcd70000640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcd680b2d60 0x7fcd681535c0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.480+0000 7fcd70000640 1 --2- 172.21.15.59:0/911971279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcd6806ee10 0x7fcd68153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.480+0000 7fcd70000640 1 -- 172.21.15.59:0/911971279 >> 172.21.15.59:0/911971279 conn(0x7fcd680b2240 msgr2=0x7fcd6806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:47.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.480+0000 7fcd70000640 1 -- 172.21.15.59:0/911971279 shutdown_connections 2024-04-25T09:07:47.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.480+0000 7fcd70000640 1 -- 172.21.15.59:0/911971279 wait complete. 2024-04-25T09:07:47.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:07:47.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc855e00640 1 Processor -- start 2024-04-25T09:07:47.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc855e00640 1 -- start start 2024-04-25T09:07:47.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc855e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc85015c9b0 0x7fc85006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc855e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85015fc00 con 0x7fc850159320 2024-04-25T09:07:47.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc855e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85015fee0 con 0x7fc85006e010 2024-04-25T09:07:47.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc855e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85006d640 con 0x7fc85015c9b0 2024-04-25T09:07:47.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc846000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc85015c9b0 0x7fc85006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc84ea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc850159320 0x7fc85015f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50054/0 (socket says 172.21.15.59:50054) 2024-04-25T09:07:47.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc84ea00640 1 -- 172.21.15.59:0/1434525270 learned_addr learned my addr 172.21.15.59:0/1434525270 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:47.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc846000640 1 -- 172.21.15.59:0/1434525270 >> v1:172.21.15.178:6789/0 conn(0x7fc85006e010 legacy=0x7fc85006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:47.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc846000640 1 -- 172.21.15.59:0/1434525270 >> v1:172.21.15.59:6789/0 conn(0x7fc850159320 legacy=0x7fc85015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc846000640 1 -- 172.21.15.59:0/1434525270 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8501601c0 con 0x7fc85015c9b0 2024-04-25T09:07:47.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.652+0000 7fc84e000640 1 -- 172.21.15.59:0/1434525270 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1166836979 0 0) 0x7fc85015fc00 con 0x7fc850159320 2024-04-25T09:07:47.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.656+0000 7fc846000640 1 --2- 172.21.15.59:0/1434525270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc85015c9b0 0x7fc85006dad0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fc8380097c0 tx=0x7fc83801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe062e9a97ac867 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.656+0000 7fc84e000640 1 -- 172.21.15.59:0/1434525270 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8380b0070 con 0x7fc85015c9b0 2024-04-25T09:07:47.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.656+0000 7fc84e000640 1 -- 172.21.15.59:0/1434525270 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8380ab600 con 0x7fc85015c9b0 2024-04-25T09:07:47.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.656+0000 7fc84e000640 1 -- 172.21.15.59:0/1434525270 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8380ab9d0 con 0x7fc85015c9b0 2024-04-25T09:07:47.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.656+0000 7fc855e00640 1 -- 172.21.15.59:0/1434525270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc85015c9b0 msgr2=0x7fc85006dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.656+0000 7fc855e00640 1 --2- 172.21.15.59:0/1434525270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc85015c9b0 0x7fc85006dad0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fc8380097c0 tx=0x7fc83801c460 comp rx=0 tx=0).stop 2024-04-25T09:07:47.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.656+0000 7fc855e00640 1 -- 172.21.15.59:0/1434525270 shutdown_connections 2024-04-25T09:07:47.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.656+0000 7fc855e00640 1 --2- 172.21.15.59:0/1434525270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc85015c9b0 0x7fc85006dad0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.656+0000 7fc855e00640 1 -- 172.21.15.59:0/1434525270 >> 172.21.15.59:0/1434525270 conn(0x7fc850067080 msgr2=0x7fc85006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:47.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.656+0000 7fc855e00640 1 -- 172.21.15.59:0/1434525270 shutdown_connections 2024-04-25T09:07:47.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.656+0000 7fc855e00640 1 -- 172.21.15.59:0/1434525270 wait complete. 2024-04-25T09:07:47.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc855e00640 1 Processor -- start 2024-04-25T09:07:47.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc855e00640 1 -- start start 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc855e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc85006e010 0x7fc85015e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc855e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc850159320 0x7fc8501599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc855e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc85015c9b0 0x7fc8500b05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc855e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85006ed30 con 0x7fc850159320 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc855e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85006ebb0 con 0x7fc85015c9b0 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc855e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8501695a0 con 0x7fc85006e010 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc846000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc850159320 0x7fc8501599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc846000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc850159320 0x7fc8501599e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41468/0 (socket says 172.21.15.59:41468) 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc846000640 1 -- 172.21.15.59:0/3320073668 learned_addr learned my addr 172.21.15.59:0/3320073668 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc84ea00640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc85006e010 0x7fc85015e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc84f400640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc85015c9b0 0x7fc8500b05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc846000640 1 -- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc85006e010 msgr2=0x7fc85015e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc846000640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc85006e010 0x7fc85015e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc846000640 1 -- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc85015c9b0 msgr2=0x7fc8500b05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:47.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc846000640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc85015c9b0 0x7fc8500b05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:47.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc846000640 1 -- 172.21.15.59:0/3320073668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8500b43c0 con 0x7fc850159320 2024-04-25T09:07:47.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc846000640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc850159320 0x7fc8501599e0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fc838019070 tx=0x7fc83801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc847e00640 1 -- 172.21.15.59:0/3320073668 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8380b0050 con 0x7fc850159320 2024-04-25T09:07:47.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc847e00640 1 -- 172.21.15.59:0/3320073668 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8380bc070 con 0x7fc850159320 2024-04-25T09:07:47.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc855e00640 1 -- 172.21.15.59:0/3320073668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8500afdb0 con 0x7fc850159320 2024-04-25T09:07:47.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc847e00640 1 -- 172.21.15.59:0/3320073668 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8380b5a50 con 0x7fc850159320 2024-04-25T09:07:47.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc855e00640 1 -- 172.21.15.59:0/3320073668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc850159f20 con 0x7fc850159320 2024-04-25T09:07:47.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.660+0000 7fc855e00640 1 -- 172.21.15.59:0/3320073668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85015bc60 con 0x7fc850159320 2024-04-25T09:07:47.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.664+0000 7fc847e00640 1 -- 172.21.15.59:0/3320073668 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc8380ab4a0 con 0x7fc850159320 2024-04-25T09:07:47.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.664+0000 7fc847e00640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc82c066f60 0x7fc82c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:47.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.664+0000 7fc847e00640 1 -- 172.21.15.59:0/3320073668 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5619+0+0 (secure 0 0 0) 0x7fc838120530 con 0x7fc850159320 2024-04-25T09:07:47.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.664+0000 7fc84ea00640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc82c066f60 0x7fc82c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:47.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.664+0000 7fc84ea00640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc82c066f60 0x7fc82c069420 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc840000f70 tx=0x7fc840007b60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:47.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.668+0000 7fc847e00640 1 -- 172.21.15.59:0/3320073668 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc838016050 con 0x7fc850159320 2024-04-25T09:07:47.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:47.828+0000 7fc855e00640 1 -- 172.21.15.59:0/3320073668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc8500745d0 con 0x7fc850159320 2024-04-25T09:07:48.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.484+0000 7fc847e00640 1 -- 172.21.15.59:0/3320073668 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v90) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc8380aa3a0 con 0x7fc850159320 2024-04-25T09:07:48.474 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-04-25T09:07:48.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.488+0000 7fc855e00640 1 -- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc82c066f60 msgr2=0x7fc82c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:48.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.488+0000 7fc855e00640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc82c066f60 0x7fc82c069420 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc840000f70 tx=0x7fc840007b60 comp rx=0 tx=0).stop 2024-04-25T09:07:48.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.488+0000 7fc855e00640 1 -- 172.21.15.59:0/3320073668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc850159320 msgr2=0x7fc8501599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:48.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.488+0000 7fc855e00640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc850159320 0x7fc8501599e0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fc838019070 tx=0x7fc83801aca0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.488+0000 7fc855e00640 1 -- 172.21.15.59:0/3320073668 shutdown_connections 2024-04-25T09:07:48.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.488+0000 7fc855e00640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc82c066f60 0x7fc82c069420 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.488+0000 7fc855e00640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc85015c9b0 0x7fc8500b05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.488+0000 7fc855e00640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc850159320 0x7fc8501599e0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.488+0000 7fc855e00640 1 --2- 172.21.15.59:0/3320073668 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc85006e010 0x7fc85015e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.488+0000 7fc855e00640 1 -- 172.21.15.59:0/3320073668 >> 172.21.15.59:0/3320073668 conn(0x7fc850067080 msgr2=0x7fc8500cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:48.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.488+0000 7fc855e00640 1 -- 172.21.15.59:0/3320073668 shutdown_connections 2024-04-25T09:07:48.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.488+0000 7fc855e00640 1 -- 172.21.15.59:0/3320073668 wait complete. 2024-04-25T09:07:48.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:07:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8f400640 1 Processor -- start 2024-04-25T09:07:48.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8f400640 1 -- start start 2024-04-25T09:07:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea8815b7b0 0x7fea880cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8f400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fea8815fa90 0x7fea8815ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8f400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea880b5310 con 0x7fea880b4400 2024-04-25T09:07:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8f400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8815f600 con 0x7fea8815b7b0 2024-04-25T09:07:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8f400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea880b4a70 con 0x7fea8815fa90 2024-04-25T09:07:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8ca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea8815b7b0 0x7fea880cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8ca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea8815b7b0 0x7fea880cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41474/0 (socket says 172.21.15.59:41474) 2024-04-25T09:07:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8ca00640 1 -- 172.21.15.59:0/903161260 learned_addr learned my addr 172.21.15.59:0/903161260 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:48.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8d400640 1 --2- 172.21.15.59:0/903161260 >> v2:172.21.15.178:3300/0 conn(0x7fea8815fa90 0x7fea8815ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8ca00640 1 -- 172.21.15.59:0/903161260 >> v2:172.21.15.178:3300/0 conn(0x7fea8815fa90 msgr2=0x7fea8815ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8ca00640 1 --2- 172.21.15.59:0/903161260 >> v2:172.21.15.178:3300/0 conn(0x7fea8815fa90 0x7fea8815ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8ca00640 1 -- 172.21.15.59:0/903161260 >> v1:172.21.15.178:6789/0 conn(0x7fea880b4400 legacy=0x7fea8806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8ca00640 1 -- 172.21.15.59:0/903161260 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea880b4d50 con 0x7fea8815b7b0 2024-04-25T09:07:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea87e00640 1 -- 172.21.15.59:0/903161260 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771450717 0 0) 0x7fea880b5310 con 0x7fea880b4400 2024-04-25T09:07:48.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.676+0000 7fea8d400640 1 --2- 172.21.15.59:0/903161260 >> v2:172.21.15.178:3300/0 conn(0x7fea8815fa90 0x7fea8815ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.680+0000 7fea8ca00640 1 --2- 172.21.15.59:0/903161260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8815b7b0 0x7fea880cc2d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fea880b2b80 tx=0x7fea7801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48cb9e78bcf4c999 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.680+0000 7fea87e00640 1 -- 172.21.15.59:0/903161260 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780b0070 con 0x7fea8815b7b0 2024-04-25T09:07:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.680+0000 7fea87e00640 1 -- 172.21.15.59:0/903161260 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea780ab600 con 0x7fea8815b7b0 2024-04-25T09:07:48.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.680+0000 7fea87e00640 1 -- 172.21.15.59:0/903161260 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea780ab9d0 con 0x7fea8815b7b0 2024-04-25T09:07:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.680+0000 7fea8f400640 1 -- 172.21.15.59:0/903161260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8815b7b0 msgr2=0x7fea880cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.680+0000 7fea8f400640 1 --2- 172.21.15.59:0/903161260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8815b7b0 0x7fea880cc2d0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fea880b2b80 tx=0x7fea7801c520 comp rx=0 tx=0).stop 2024-04-25T09:07:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.680+0000 7fea8f400640 1 -- 172.21.15.59:0/903161260 shutdown_connections 2024-04-25T09:07:48.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.680+0000 7fea8f400640 1 --2- 172.21.15.59:0/903161260 >> v2:172.21.15.178:3300/0 conn(0x7fea8815fa90 0x7fea8815ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.680+0000 7fea8f400640 1 --2- 172.21.15.59:0/903161260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8815b7b0 0x7fea880cc2d0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.680+0000 7fea8f400640 1 -- 172.21.15.59:0/903161260 >> 172.21.15.59:0/903161260 conn(0x7fea880cfd90 msgr2=0x7fea880d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.680+0000 7fea8f400640 1 -- 172.21.15.59:0/903161260 shutdown_connections 2024-04-25T09:07:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.680+0000 7fea8f400640 1 -- 172.21.15.59:0/903161260 wait complete. 2024-04-25T09:07:48.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea8f400640 1 Processor -- start 2024-04-25T09:07:48.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea8f400640 1 -- start start 2024-04-25T09:07:48.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea8f400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea880b4400 0x7fea8813e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:48.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea8f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8815b7b0 0x7fea881f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea8f400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea8815fa90 0x7fea881f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea8f400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8815bd10 con 0x7fea8815b7b0 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea8f400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8815bb90 con 0x7fea880b4400 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea8f400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea88168800 con 0x7fea8815fa90 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea7fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8815b7b0 0x7fea881f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea7fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8815b7b0 0x7fea881f6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41488/0 (socket says 172.21.15.59:41488) 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea7fe00640 1 -- 172.21.15.59:0/1169763624 learned_addr learned my addr 172.21.15.59:0/1169763624 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea8d400640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea8815fa90 0x7fea881f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea8ca00640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea880b4400 0x7fea8813e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea7fe00640 1 -- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea8815fa90 msgr2=0x7fea881f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea7fe00640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea8815fa90 0x7fea881f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea7fe00640 1 -- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea880b4400 msgr2=0x7fea8813e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:48.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea7fe00640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea880b4400 0x7fea8813e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:48.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea7fe00640 1 -- 172.21.15.59:0/1169763624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea881527e0 con 0x7fea8815b7b0 2024-04-25T09:07:48.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea7fe00640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8815b7b0 0x7fea881f6970 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fea7000c4d0 tx=0x7fea7000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:48.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea85600640 1 -- 172.21.15.59:0/1169763624 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea70017070 con 0x7fea8815b7b0 2024-04-25T09:07:48.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea85600640 1 -- 172.21.15.59:0/1169763624 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea70003600 con 0x7fea8815b7b0 2024-04-25T09:07:48.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea85600640 1 -- 172.21.15.59:0/1169763624 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea700039f0 con 0x7fea8815b7b0 2024-04-25T09:07:48.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea8f400640 1 -- 172.21.15.59:0/1169763624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8806df70 con 0x7fea8815b7b0 2024-04-25T09:07:48.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.684+0000 7fea8f400640 1 -- 172.21.15.59:0/1169763624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea881f7840 con 0x7fea8815b7b0 2024-04-25T09:07:48.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.688+0000 7fea8f400640 1 -- 172.21.15.59:0/1169763624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea880745d0 con 0x7fea8815b7b0 2024-04-25T09:07:48.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.688+0000 7fea85600640 1 -- 172.21.15.59:0/1169763624 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fea7001a070 con 0x7fea8815b7b0 2024-04-25T09:07:48.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.688+0000 7fea85600640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fea64066f60 0x7fea64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:48.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.688+0000 7fea85600640 1 -- 172.21.15.59:0/1169763624 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6001+0+0 (secure 0 0 0) 0x7fea70084550 con 0x7fea8815b7b0 2024-04-25T09:07:48.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.688+0000 7fea8ca00640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fea64066f60 0x7fea64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:48.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.688+0000 7fea8ca00640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fea64066f60 0x7fea64069420 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fea780ad000 tx=0x7fea780a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:48.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.692+0000 7fea85600640 1 -- 172.21.15.59:0/1169763624 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fea70054e00 con 0x7fea8815b7b0 2024-04-25T09:07:48.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:48.888+0000 7fea8f400640 1 -- 172.21.15.59:0/1169763624 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fea8809dcd0 con 0x7fea8815b7b0 2024-04-25T09:07:49.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.488+0000 7fea85600640 1 -- 172.21.15.59:0/1169763624 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v61) v1 ==== 174+0+0 (secure 0 0 0) 0x7fea70058ea0 con 0x7fea8815b7b0 2024-04-25T09:07:49.477 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 13 and data pool 14 2024-04-25T09:07:49.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.492+0000 7fea8f400640 1 -- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fea64066f60 msgr2=0x7fea64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.492+0000 7fea8f400640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fea64066f60 0x7fea64069420 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fea780ad000 tx=0x7fea780a6000 comp rx=0 tx=0).stop 2024-04-25T09:07:49.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.492+0000 7fea8f400640 1 -- 172.21.15.59:0/1169763624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8815b7b0 msgr2=0x7fea881f6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.492+0000 7fea8f400640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8815b7b0 0x7fea881f6970 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fea7000c4d0 tx=0x7fea7000c8d0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.492+0000 7fea8f400640 1 -- 172.21.15.59:0/1169763624 shutdown_connections 2024-04-25T09:07:49.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.492+0000 7fea8f400640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fea64066f60 0x7fea64069420 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.492+0000 7fea8f400640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fea8815fa90 0x7fea881f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.492+0000 7fea8f400640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea8815b7b0 0x7fea881f6970 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.492+0000 7fea8f400640 1 --2- 172.21.15.59:0/1169763624 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fea880b4400 0x7fea8813e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.492+0000 7fea8f400640 1 -- 172.21.15.59:0/1169763624 >> 172.21.15.59:0/1169763624 conn(0x7fea880cfd90 msgr2=0x7fea880ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.492+0000 7fea8f400640 1 -- 172.21.15.59:0/1169763624 shutdown_connections 2024-04-25T09:07:49.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.492+0000 7fea8f400640 1 -- 172.21.15.59:0/1169763624 wait complete. 2024-04-25T09:07:49.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:49.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7d06000640 1 Processor -- start 2024-04-25T09:07:49.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7d06000640 1 -- start start 2024-04-25T09:07:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7d06000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7d000cc440 0x7f7d00166730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7d06000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d000ce7f0 con 0x7f7d0015b5a0 2024-04-25T09:07:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7d06000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d000cead0 con 0x7f7d0015b980 2024-04-25T09:07:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7d06000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d000ce5b0 con 0x7f7d000cc440 2024-04-25T09:07:49.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7cff400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7d0015b5a0 0x7f7d000cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50062/0 (socket says 172.21.15.59:50062) 2024-04-25T09:07:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7cff400640 1 -- 172.21.15.59:0/25910914 learned_addr learned my addr 172.21.15.59:0/25910914 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7cffe00640 1 --2- 172.21.15.59:0/25910914 >> v2:172.21.15.59:3300/0 conn(0x7f7d000cc440 0x7f7d00166730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7cfea00640 1 -- 172.21.15.59:0/25910914 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1616776053 0 0) 0x7f7d000ce7f0 con 0x7f7d0015b5a0 2024-04-25T09:07:49.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7cfea00640 1 -- 172.21.15.59:0/25910914 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce4003530 con 0x7f7d0015b5a0 2024-04-25T09:07:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7cffe00640 1 -- 172.21.15.59:0/25910914 >> v1:172.21.15.178:6789/0 conn(0x7f7d0015b980 legacy=0x7f7d000cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7cfea00640 1 -- 172.21.15.59:0/25910914 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84408635 0 0) 0x7f7d000cead0 con 0x7f7d0015b980 2024-04-25T09:07:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7cffe00640 1 -- 172.21.15.59:0/25910914 >> v1:172.21.15.59:6789/0 conn(0x7f7d0015b5a0 legacy=0x7f7d000cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.692+0000 7f7cffe00640 1 -- 172.21.15.59:0/25910914 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d000cf960 con 0x7f7d000cc440 2024-04-25T09:07:49.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.696+0000 7f7cffe00640 1 --2- 172.21.15.59:0/25910914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d000cc440 0x7f7d00166730 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009d90 tx=0x7f7cf801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a2765c9988e9a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:49.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.696+0000 7f7cfea00640 1 -- 172.21.15.59:0/25910914 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf80b2070 con 0x7f7d000cc440 2024-04-25T09:07:49.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.696+0000 7f7cfea00640 1 -- 172.21.15.59:0/25910914 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf80a5940 con 0x7f7d000cc440 2024-04-25T09:07:49.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.696+0000 7f7cfea00640 1 -- 172.21.15.59:0/25910914 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf80a5d10 con 0x7f7d000cc440 2024-04-25T09:07:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.696+0000 7f7d06000640 1 -- 172.21.15.59:0/25910914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d000cc440 msgr2=0x7f7d00166730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.696+0000 7f7d06000640 1 --2- 172.21.15.59:0/25910914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d000cc440 0x7f7d00166730 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f7cf8009d90 tx=0x7f7cf801c970 comp rx=0 tx=0).stop 2024-04-25T09:07:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.696+0000 7f7d06000640 1 -- 172.21.15.59:0/25910914 shutdown_connections 2024-04-25T09:07:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.696+0000 7f7d06000640 1 --2- 172.21.15.59:0/25910914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d000cc440 0x7f7d00166730 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.696+0000 7f7d06000640 1 -- 172.21.15.59:0/25910914 >> 172.21.15.59:0/25910914 conn(0x7f7d000b3390 msgr2=0x7f7d000b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.696+0000 7f7d06000640 1 -- 172.21.15.59:0/25910914 shutdown_connections 2024-04-25T09:07:49.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.696+0000 7f7d06000640 1 -- 172.21.15.59:0/25910914 wait complete. 2024-04-25T09:07:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7d06000640 1 Processor -- start 2024-04-25T09:07:49.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7d06000640 1 -- start start 2024-04-25T09:07:49.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7d06000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d000cc440 0x7f7d0013baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7d06000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d0015b5a0 0x7f7d0013b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7d06000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0015b980 0x7f7d0014fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7d06000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d00169820 con 0x7f7d0015b980 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7d06000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d001696a0 con 0x7f7d000cc440 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7d06000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d001699a0 con 0x7f7d0015b5a0 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0015b980 0x7f7d0014fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0015b980 0x7f7d0014fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41514/0 (socket says 172.21.15.59:41514) 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cffe00640 1 -- 172.21.15.59:0/2121082194 learned_addr learned my addr 172.21.15.59:0/2121082194 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cffe00640 1 -- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d0015b5a0 msgr2=0x7f7d0013b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cff400640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d000cc440 0x7f7d0013baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cf6a00640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d0015b5a0 0x7f7d0013b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cffe00640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d0015b5a0 0x7f7d0013b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cffe00640 1 -- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d000cc440 msgr2=0x7f7d0013baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cffe00640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d000cc440 0x7f7d0013baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cffe00640 1 -- 172.21.15.59:0/2121082194 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0013e590 con 0x7f7d0015b980 2024-04-25T09:07:49.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cf6a00640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d0015b5a0 0x7f7d0013b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:49.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cff400640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d000cc440 0x7f7d0013baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:49.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cffe00640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0015b980 0x7f7d0014fc00 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80b0040 tx=0x7f7cf8019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:49.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cf7e00640 1 -- 172.21.15.59:0/2121082194 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf80b2050 con 0x7f7d0015b980 2024-04-25T09:07:49.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cf7e00640 1 -- 172.21.15.59:0/2121082194 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf80b3040 con 0x7f7d0015b980 2024-04-25T09:07:49.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7cf7e00640 1 -- 172.21.15.59:0/2121082194 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf8009450 con 0x7f7d0015b980 2024-04-25T09:07:49.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7d06000640 1 -- 172.21.15.59:0/2121082194 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d0013e870 con 0x7f7d0015b980 2024-04-25T09:07:49.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7d06000640 1 -- 172.21.15.59:0/2121082194 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d0015c2e0 con 0x7f7d0015b980 2024-04-25T09:07:49.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.700+0000 7f7d06000640 1 -- 172.21.15.59:0/2121082194 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d0015c520 con 0x7f7d0015b980 2024-04-25T09:07:49.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.704+0000 7f7cf7e00640 1 -- 172.21.15.59:0/2121082194 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7cf80c1060 con 0x7f7d0015b980 2024-04-25T09:07:49.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.704+0000 7f7cf7e00640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7cdc066f90 0x7f7cdc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:49.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.704+0000 7f7cf7e00640 1 -- 172.21.15.59:0/2121082194 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7cf811f620 con 0x7f7d0015b980 2024-04-25T09:07:49.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.704+0000 7f7cff400640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7cdc066f90 0x7f7cdc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:49.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.704+0000 7f7cff400640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7cdc066f90 0x7f7cdc069450 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0005890 tx=0x7f7cf0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:49.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.708+0000 7f7cf7e00640 1 -- 172.21.15.59:0/2121082194 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7d0015c520 con 0x7f7d0015b980 2024-04-25T09:07:49.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.872+0000 7f7d06000640 1 -- 172.21.15.59:0/2121082194 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7d000745d0 con 0x7f7d0015b980 2024-04-25T09:07:49.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7cf7e00640 1 -- 172.21.15.59:0/2121082194 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16898 (secure 0 0 0) 0x7f7cf8016560 con 0x7f7d0015b980 2024-04-25T09:07:49.864 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:49.864 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":91,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:07:48.892504+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:47.301822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:47.878097+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7d06000640 1 -- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7cdc066f90 msgr2=0x7f7cdc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7d06000640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7cdc066f90 0x7f7cdc069450 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0005890 tx=0x7f7cf0009040 comp rx=0 tx=0).stop 2024-04-25T09:07:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7d06000640 1 -- 172.21.15.59:0/2121082194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0015b980 msgr2=0x7f7d0014fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7d06000640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0015b980 0x7f7d0014fc00 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7cf80b0040 tx=0x7f7cf8019710 comp rx=0 tx=0).stop 2024-04-25T09:07:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7d06000640 1 -- 172.21.15.59:0/2121082194 shutdown_connections 2024-04-25T09:07:49.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7d06000640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7cdc066f90 0x7f7cdc069450 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7d06000640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7d0015b980 0x7f7d0014fc00 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7d06000640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7d0015b5a0 0x7f7d0013b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7d06000640 1 --2- 172.21.15.59:0/2121082194 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7d000cc440 0x7f7d0013baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7d06000640 1 -- 172.21.15.59:0/2121082194 >> 172.21.15.59:0/2121082194 conn(0x7f7d000b3390 msgr2=0x7f7d000caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7d06000640 1 -- 172.21.15.59:0/2121082194 shutdown_connections 2024-04-25T09:07:49.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:49.876+0000 7f7d06000640 1 -- 172.21.15.59:0/2121082194 wait complete. 2024-04-25T09:07:49.886 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:50.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f896c000640 1 Processor -- start 2024-04-25T09:07:50.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f896c000640 1 -- start start 2024-04-25T09:07:50.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f896c000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8964145270 0x7f896415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:50.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f896c000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89640cd4d0 0x7f89640cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:50.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f896c000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89640cc4e0 con 0x7f89640b1750 2024-04-25T09:07:50.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f896c000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8964145650 con 0x7f8964145270 2024-04-25T09:07:50.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f896c000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640ce040 con 0x7f89640cd4d0 2024-04-25T09:07:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f8969600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8964145270 0x7f896415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f8968c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89640cd4d0 0x7f89640cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f8968c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89640cd4d0 0x7f89640cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:60894/0 (socket says 172.21.15.59:60894) 2024-04-25T09:07:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f8969600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8964145270 0x7f896415fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:46994/0 (socket says 172.21.15.59:46994) 2024-04-25T09:07:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f8969600640 1 -- 172.21.15.59:0/1886317752 learned_addr learned my addr 172.21.15.59:0/1886317752 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.040+0000 7f896a000640 1 --1- 172.21.15.59:0/1886317752 >> v1:172.21.15.178:6789/0 conn(0x7f89640b1750 0x7f896415bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:52472/0 (socket says 172.21.15.59:52472) 2024-04-25T09:07:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f8968c00640 1 -- 172.21.15.59:0/1886317752 >> v2:172.21.15.178:3300/0 conn(0x7f8964145270 msgr2=0x7f896415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f8968c00640 1 --2- 172.21.15.59:0/1886317752 >> v2:172.21.15.178:3300/0 conn(0x7f8964145270 0x7f896415fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f8968c00640 1 -- 172.21.15.59:0/1886317752 >> v1:172.21.15.178:6789/0 conn(0x7f89640b1750 legacy=0x7f896415bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f8968c00640 1 -- 172.21.15.59:0/1886317752 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640ce320 con 0x7f89640cd4d0 2024-04-25T09:07:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f8969600640 1 --2- 172.21.15.59:0/1886317752 >> v2:172.21.15.178:3300/0 conn(0x7f8964145270 0x7f896415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:50.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f8968c00640 1 --2- 172.21.15.59:0/1886317752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89640cd4d0 0x7f89640cd930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f89500097c0 tx=0x7f895001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b334325f8303550 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f8963e00640 1 -- 172.21.15.59:0/1886317752 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500b2070 con 0x7f89640cd4d0 2024-04-25T09:07:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f8963e00640 1 -- 172.21.15.59:0/1886317752 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89500ad640 con 0x7f89640cd4d0 2024-04-25T09:07:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f8963e00640 1 -- 172.21.15.59:0/1886317752 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500ada10 con 0x7f89640cd4d0 2024-04-25T09:07:50.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f896c000640 1 -- 172.21.15.59:0/1886317752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89640cd4d0 msgr2=0x7f89640cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:50.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f896c000640 1 --2- 172.21.15.59:0/1886317752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89640cd4d0 0x7f89640cd930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f89500097c0 tx=0x7f895001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f896c000640 1 -- 172.21.15.59:0/1886317752 shutdown_connections 2024-04-25T09:07:50.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f896c000640 1 --2- 172.21.15.59:0/1886317752 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89640cd4d0 0x7f89640cd930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f896c000640 1 --2- 172.21.15.59:0/1886317752 >> v2:172.21.15.178:3300/0 conn(0x7f8964145270 0x7f896415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f896c000640 1 -- 172.21.15.59:0/1886317752 >> 172.21.15.59:0/1886317752 conn(0x7f8964066fa0 msgr2=0x7f896406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:50.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f896c000640 1 -- 172.21.15.59:0/1886317752 shutdown_connections 2024-04-25T09:07:50.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.044+0000 7f896c000640 1 -- 172.21.15.59:0/1886317752 wait complete. 2024-04-25T09:07:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f896c000640 1 Processor -- start 2024-04-25T09:07:50.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f896c000640 1 -- start start 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f896c000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89640b1750 0x7f896413e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f896c000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89640cd4d0 0x7f896415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f896c000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964145270 0x7f89640b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f896c000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640b1f70 con 0x7f89640b1750 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f896c000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8964168710 con 0x7f89640cd4d0 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f896c000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8964139a90 con 0x7f8964145270 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8969600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89640b1750 0x7f896413e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8969600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89640b1750 0x7f896413e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41522/0 (socket says 172.21.15.59:41522) 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8969600640 1 -- 172.21.15.59:0/538932795 learned_addr learned my addr 172.21.15.59:0/538932795 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8968c00640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89640cd4d0 0x7f896415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f896a000640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964145270 0x7f89640b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8969600640 1 -- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964145270 msgr2=0x7f89640b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:50.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8969600640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964145270 0x7f89640b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8969600640 1 -- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89640cd4d0 msgr2=0x7f896415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:50.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8969600640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89640cd4d0 0x7f896415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8969600640 1 -- 172.21.15.59:0/538932795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f896413b620 con 0x7f89640b1750 2024-04-25T09:07:50.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8969600640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89640b1750 0x7f896413e6c0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f895800e930 tx=0x7f895800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:50.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8961600640 1 -- 172.21.15.59:0/538932795 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8958017070 con 0x7f89640b1750 2024-04-25T09:07:50.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8961600640 1 -- 172.21.15.59:0/538932795 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895800ca00 con 0x7f89640b1750 2024-04-25T09:07:50.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f8961600640 1 -- 172.21.15.59:0/538932795 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895800cdd0 con 0x7f89640b1750 2024-04-25T09:07:50.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f896c000640 1 -- 172.21.15.59:0/538932795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f896413dbe0 con 0x7f89640b1750 2024-04-25T09:07:50.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.048+0000 7f896c000640 1 -- 172.21.15.59:0/538932795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f896413e1a0 con 0x7f89640b1750 2024-04-25T09:07:50.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.052+0000 7f896c000640 1 -- 172.21.15.59:0/538932795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89640745d0 con 0x7f89640b1750 2024-04-25T09:07:50.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.052+0000 7f8961600640 1 -- 172.21.15.59:0/538932795 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f895801a070 con 0x7f89640b1750 2024-04-25T09:07:50.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.052+0000 7f8961600640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8944066f60 0x7f8944069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:50.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.052+0000 7f8961600640 1 -- 172.21.15.59:0/538932795 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f89580850a0 con 0x7f89640b1750 2024-04-25T09:07:50.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.052+0000 7f8968c00640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8944066f60 0x7f8944069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:50.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.052+0000 7f8968c00640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8944066f60 0x7f8944069420 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f89500af000 tx=0x7f8950008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:50.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.056+0000 7f8961600640 1 -- 172.21.15.59:0/538932795 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f89580558c0 con 0x7f89640b1750 2024-04-25T09:07:50.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.220+0000 7f896c000640 1 -- 172.21.15.59:0/538932795 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89640cc2c0 con 0x7f89640b1750 2024-04-25T09:07:50.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.220+0000 7f8961600640 1 -- 172.21.15.59:0/538932795 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16898 (secure 0 0 0) 0x7f8958059960 con 0x7f89640b1750 2024-04-25T09:07:50.210 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:50.210 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":91,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:07:48.892504+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:47.301822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:47.878097+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.224+0000 7f896c000640 1 -- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8944066f60 msgr2=0x7f8944069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.224+0000 7f896c000640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8944066f60 0x7f8944069420 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f89500af000 tx=0x7f8950008040 comp rx=0 tx=0).stop 2024-04-25T09:07:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.224+0000 7f896c000640 1 -- 172.21.15.59:0/538932795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89640b1750 msgr2=0x7f896413e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.224+0000 7f896c000640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89640b1750 0x7f896413e6c0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f895800e930 tx=0x7f895800edf0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.224+0000 7f896c000640 1 -- 172.21.15.59:0/538932795 shutdown_connections 2024-04-25T09:07:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.224+0000 7f896c000640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8944066f60 0x7f8944069420 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.224+0000 7f896c000640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8964145270 0x7f89640b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.224+0000 7f896c000640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89640cd4d0 0x7f896415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.224+0000 7f896c000640 1 --2- 172.21.15.59:0/538932795 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89640b1750 0x7f896413e6c0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.224+0000 7f896c000640 1 -- 172.21.15.59:0/538932795 >> 172.21.15.59:0/538932795 conn(0x7f8964066fa0 msgr2=0x7f8964143220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:50.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.224+0000 7f896c000640 1 -- 172.21.15.59:0/538932795 shutdown_connections 2024-04-25T09:07:50.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.224+0000 7f896c000640 1 -- 172.21.15.59:0/538932795 wait complete. 2024-04-25T09:07:50.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:07:50.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.384+0000 7fe899c00640 1 Processor -- start 2024-04-25T09:07:50.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.384+0000 7fe899c00640 1 -- start start 2024-04-25T09:07:50.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe899c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe894072210 0x7fe89406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:50.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe899c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe89415af40 0x7fe8940cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:50.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe899c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89415e9a0 con 0x7fe894150f40 2024-04-25T09:07:50.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe899c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89406f530 con 0x7fe89415af40 2024-04-25T09:07:50.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe899c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89415dbe0 con 0x7fe894072210 2024-04-25T09:07:50.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe88a000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe894072210 0x7fe89406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:50.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe893400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe89415af40 0x7fe8940cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:50.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe892a00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fe894150f40 0x7fe894071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:52484/0 (socket says 172.21.15.59:52484) 2024-04-25T09:07:50.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe88a000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe894072210 0x7fe89406ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:60912/0 (socket says 172.21.15.59:60912) 2024-04-25T09:07:50.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe892a00640 1 -- 172.21.15.59:0/1126305110 learned_addr learned my addr 172.21.15.59:0/1126305110 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:50.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe88a000640 1 -- 172.21.15.59:0/1126305110 >> v2:172.21.15.178:3300/0 conn(0x7fe89415af40 msgr2=0x7fe8940cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:50.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe88a000640 1 --2- 172.21.15.59:0/1126305110 >> v2:172.21.15.178:3300/0 conn(0x7fe89415af40 0x7fe8940cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe88a000640 1 -- 172.21.15.59:0/1126305110 >> v1:172.21.15.178:6789/0 conn(0x7fe894150f40 legacy=0x7fe894071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:50.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.388+0000 7fe88a000640 1 -- 172.21.15.59:0/1126305110 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89415dec0 con 0x7fe894072210 2024-04-25T09:07:50.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe88a000640 1 --2- 172.21.15.59:0/1126305110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe894072210 0x7fe89406ef50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0097c0 tx=0x7fe87c01c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=751125a41d398dbb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:50.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe892000640 1 -- 172.21.15.59:0/1126305110 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0b0070 con 0x7fe894072210 2024-04-25T09:07:50.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe892000640 1 -- 172.21.15.59:0/1126305110 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c0ab600 con 0x7fe894072210 2024-04-25T09:07:50.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe892000640 1 -- 172.21.15.59:0/1126305110 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c0ab9d0 con 0x7fe894072210 2024-04-25T09:07:50.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe899c00640 1 -- 172.21.15.59:0/1126305110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe894072210 msgr2=0x7fe89406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:50.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe899c00640 1 --2- 172.21.15.59:0/1126305110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe894072210 0x7fe89406ef50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0097c0 tx=0x7fe87c01c380 comp rx=0 tx=0).stop 2024-04-25T09:07:50.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe899c00640 1 -- 172.21.15.59:0/1126305110 shutdown_connections 2024-04-25T09:07:50.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe899c00640 1 --2- 172.21.15.59:0/1126305110 >> v2:172.21.15.178:3300/0 conn(0x7fe89415af40 0x7fe8940cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe899c00640 1 --2- 172.21.15.59:0/1126305110 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe894072210 0x7fe89406ef50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe899c00640 1 -- 172.21.15.59:0/1126305110 >> 172.21.15.59:0/1126305110 conn(0x7fe894067080 msgr2=0x7fe89406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:50.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe899c00640 1 -- 172.21.15.59:0/1126305110 shutdown_connections 2024-04-25T09:07:50.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe899c00640 1 -- 172.21.15.59:0/1126305110 wait complete. 2024-04-25T09:07:50.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe899c00640 1 Processor -- start 2024-04-25T09:07:50.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.392+0000 7fe899c00640 1 -- start start 2024-04-25T09:07:50.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe899c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe894072210 0x7fe894144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:50.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe899c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe894150f40 0x7fe894155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:50.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe899c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89415af40 0x7fe894146f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:50.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe899c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940ce380 con 0x7fe894072210 2024-04-25T09:07:50.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe899c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940ce200 con 0x7fe894150f40 2024-04-25T09:07:50.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe899c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8940ce500 con 0x7fe89415af40 2024-04-25T09:07:50.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe892a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe894072210 0x7fe894144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:50.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe892a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe894072210 0x7fe894144090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41532/0 (socket says 172.21.15.59:41532) 2024-04-25T09:07:50.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe892a00640 1 -- 172.21.15.59:0/4194009430 learned_addr learned my addr 172.21.15.59:0/4194009430 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe893400640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89415af40 0x7fe894146f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe88a000640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe894150f40 0x7fe894155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe892a00640 1 -- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89415af40 msgr2=0x7fe894146f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe892a00640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89415af40 0x7fe894146f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe892a00640 1 -- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe894150f40 msgr2=0x7fe894155940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe892a00640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe894150f40 0x7fe894155940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe892a00640 1 -- 172.21.15.59:0/4194009430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe894155e80 con 0x7fe894072210 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe88a000640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe894150f40 0x7fe894155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe892a00640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe894072210 0x7fe894144090 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe88400c450 tx=0x7fe88400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe88b400640 1 -- 172.21.15.59:0/4194009430 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884017070 con 0x7fe894072210 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe88b400640 1 -- 172.21.15.59:0/4194009430 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe884005cf0 con 0x7fe894072210 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe88b400640 1 -- 172.21.15.59:0/4194009430 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe884007290 con 0x7fe894072210 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe899c00640 1 -- 172.21.15.59:0/4194009430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe894157880 con 0x7fe894072210 2024-04-25T09:07:50.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe899c00640 1 -- 172.21.15.59:0/4194009430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe894154e60 con 0x7fe894072210 2024-04-25T09:07:50.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe899c00640 1 -- 172.21.15.59:0/4194009430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8940745d0 con 0x7fe894072210 2024-04-25T09:07:50.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.396+0000 7fe88b400640 1 -- 172.21.15.59:0/4194009430 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe88401a070 con 0x7fe894072210 2024-04-25T09:07:50.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.400+0000 7fe88b400640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe870066f90 0x7fe870069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:50.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.400+0000 7fe88b400640 1 -- 172.21.15.59:0/4194009430 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe884084420 con 0x7fe894072210 2024-04-25T09:07:50.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.400+0000 7fe88a000640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe870066f90 0x7fe870069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:50.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.400+0000 7fe88a000640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe870066f90 0x7fe870069450 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0ad000 tx=0x7fe87c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:50.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.404+0000 7fe88b400640 1 -- 172.21.15.59:0/4194009430 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe884054c40 con 0x7fe894072210 2024-04-25T09:07:50.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:50.600+0000 7fe899c00640 1 -- 172.21.15.59:0/4194009430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe894154790 con 0x7fe894072210 2024-04-25T09:07:51.457 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:07:51.468+0000 7fea68000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:07:51.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.516+0000 7fe88b400640 1 -- 172.21.15.59:0/4194009430 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v64) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe884058ce0 con 0x7fe894072210 2024-04-25T09:07:51.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.520+0000 7fe899c00640 1 -- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe870066f90 msgr2=0x7fe870069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:51.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.520+0000 7fe899c00640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe870066f90 0x7fe870069450 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0ad000 tx=0x7fe87c008040 comp rx=0 tx=0).stop 2024-04-25T09:07:51.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.520+0000 7fe899c00640 1 -- 172.21.15.59:0/4194009430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe894072210 msgr2=0x7fe894144090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:51.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.520+0000 7fe899c00640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe894072210 0x7fe894144090 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe88400c450 tx=0x7fe88400c910 comp rx=0 tx=0).stop 2024-04-25T09:07:51.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.520+0000 7fe899c00640 1 -- 172.21.15.59:0/4194009430 shutdown_connections 2024-04-25T09:07:51.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.520+0000 7fe899c00640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe870066f90 0x7fe870069450 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:51.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.520+0000 7fe899c00640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe89415af40 0x7fe894146f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:51.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.520+0000 7fe899c00640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe894150f40 0x7fe894155940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:51.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.520+0000 7fe899c00640 1 --2- 172.21.15.59:0/4194009430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe894072210 0x7fe894144090 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:51.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.520+0000 7fe899c00640 1 -- 172.21.15.59:0/4194009430 >> 172.21.15.59:0/4194009430 conn(0x7fe894067080 msgr2=0x7fe8940b0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:51.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.520+0000 7fe899c00640 1 -- 172.21.15.59:0/4194009430 shutdown_connections 2024-04-25T09:07:51.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.520+0000 7fe899c00640 1 -- 172.21.15.59:0/4194009430 wait complete. 2024-04-25T09:07:51.531 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:07:51.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:07:51.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f7390800640 1 Processor -- start 2024-04-25T09:07:51.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f7390800640 1 -- start start 2024-04-25T09:07:51.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f7390800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738815b9b0 0x7f738815fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:51.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f7390800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738806f8f0 con 0x7f73880cea20 2024-04-25T09:07:51.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f7390800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7388160310 con 0x7f73880b34b0 2024-04-25T09:07:51.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f7390800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738806fb90 con 0x7f738815b9b0 2024-04-25T09:07:51.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738d400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f73880cea20 0x7f73880ceea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47140/0 (socket says 172.21.15.59:47140) 2024-04-25T09:07:51.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738d400640 1 -- 172.21.15.59:0/765743518 learned_addr learned my addr 172.21.15.59:0/765743518 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738de00640 1 --2- 172.21.15.59:0/765743518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738815b9b0 0x7f738815fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3042507881 0 0) 0x7f738806f8f0 con 0x7f73880cea20 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7370003530 con 0x7f73880cea20 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333317656 0 0) 0x7f7388160310 con 0x7f73880b34b0 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f738806f8f0 con 0x7f73880b34b0 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1072207298 0 0) 0x7f7370003530 con 0x7f73880cea20 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738815b9b0 msgr2=0x7f738815fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 --2- 172.21.15.59:0/765743518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738815b9b0 0x7f738815fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 >> v1:172.21.15.178:6789/0 conn(0x7f73880b34b0 legacy=0x7f73880b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738806fe70 con 0x7f73880cea20 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f7378001680 con 0x7f73880cea20 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 >> v1:172.21.15.59:6789/0 conn(0x7f73880cea20 legacy=0x7f73880ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:51.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 --2- 172.21.15.59:0/765743518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7370003b80 0x7f7370003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 --2- 172.21.15.59:0/765743518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738815b9b0 0x7f7370004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 --2- 172.21.15.59:0/765743518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370004d50 0x7f73700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738806fb90 con 0x7f7370004d50 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737000ba80 con 0x7f7370003b80 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737000bc30 con 0x7f738815b9b0 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738e800640 1 --2- 172.21.15.59:0/765743518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370004d50 0x7f73700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738d400640 1 --2- 172.21.15.59:0/765743518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738815b9b0 0x7f7370004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.692+0000 7f738de00640 1 --2- 172.21.15.59:0/765743518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7370003b80 0x7f7370003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f738e800640 1 -- 172.21.15.59:0/765743518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738815b9b0 msgr2=0x7f7370004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f738e800640 1 --2- 172.21.15.59:0/765743518 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738815b9b0 0x7f7370004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f738e800640 1 -- 172.21.15.59:0/765743518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7370003b80 msgr2=0x7f7370003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f738e800640 1 --2- 172.21.15.59:0/765743518 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7370003b80 0x7f7370003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:51.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f738e800640 1 -- 172.21.15.59:0/765743518 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7370003530 con 0x7f7370004d50 2024-04-25T09:07:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f738e800640 1 --2- 172.21.15.59:0/765743518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370004d50 0x7f73700051d0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f7384001fd0 tx=0x7f738401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d830b0bd69b0b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384001c20 con 0x7f7370004d50 2024-04-25T09:07:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7384003ba0 con 0x7f7370004d50 2024-04-25T09:07:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f738ca00640 1 -- 172.21.15.59:0/765743518 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840050d0 con 0x7f7370004d50 2024-04-25T09:07:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f7390800640 1 -- 172.21.15.59:0/765743518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370004d50 msgr2=0x7f73700051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f7390800640 1 --2- 172.21.15.59:0/765743518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7370004d50 0x7f73700051d0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f7384001fd0 tx=0x7f738401c900 comp rx=0 tx=0).stop 2024-04-25T09:07:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f738e800640 1 -- 172.21.15.59:0/765743518 reap_dead start 2024-04-25T09:07:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f7390800640 1 -- 172.21.15.59:0/765743518 shutdown_connections 2024-04-25T09:07:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f7390800640 1 -- 172.21.15.59:0/765743518 >> 172.21.15.59:0/765743518 conn(0x7f73880cf9c0 msgr2=0x7f73880cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f7390800640 1 -- 172.21.15.59:0/765743518 shutdown_connections 2024-04-25T09:07:51.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.696+0000 7f7390800640 1 -- 172.21.15.59:0/765743518 wait complete. 2024-04-25T09:07:51.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7390800640 1 Processor -- start 2024-04-25T09:07:51.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7390800640 1 -- start start 2024-04-25T09:07:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7390800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7370004d50 0x7f738814b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7390800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7388159140 0x7f73881595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7390800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73880ab0c0 0x7f73880ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7390800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73880b2f90 con 0x7f7388159140 2024-04-25T09:07:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7390800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73880b2cb0 con 0x7f7370004d50 2024-04-25T09:07:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7390800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73880d0600 con 0x7f73880ab0c0 2024-04-25T09:07:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f738d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7388159140 0x7f73881595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f738d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7388159140 0x7f73881595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36356/0 (socket says 172.21.15.59:36356) 2024-04-25T09:07:51.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f738d400640 1 -- 172.21.15.59:0/2894616780 learned_addr learned my addr 172.21.15.59:0/2894616780 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f738de00640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7370004d50 0x7f738814b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f738e800640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73880ab0c0 0x7f73880ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f738d400640 1 -- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73880ab0c0 msgr2=0x7f73880ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f738d400640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73880ab0c0 0x7f73880ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f738d400640 1 -- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7370004d50 msgr2=0x7f738814b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f738d400640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7370004d50 0x7f738814b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f738d400640 1 -- 172.21.15.59:0/2894616780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388155980 con 0x7f7388159140 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f738e800640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73880ab0c0 0x7f73880ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f738d400640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7388159140 0x7f73881595c0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f7378011830 tx=0x7f7378011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7382000640 1 -- 172.21.15.59:0/2894616780 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7378010040 con 0x7f7388159140 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7382000640 1 -- 172.21.15.59:0/2894616780 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737801a070 con 0x7f7388159140 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7390800640 1 -- 172.21.15.59:0/2894616780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7388159ce0 con 0x7f7388159140 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7382000640 1 -- 172.21.15.59:0/2894616780 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737800fda0 con 0x7f7388159140 2024-04-25T09:07:51.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.700+0000 7f7390800640 1 -- 172.21.15.59:0/2894616780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738815a2a0 con 0x7f7388159140 2024-04-25T09:07:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.704+0000 7f7390800640 1 -- 172.21.15.59:0/2894616780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73880745d0 con 0x7f7388159140 2024-04-25T09:07:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.704+0000 7f7382000640 1 -- 172.21.15.59:0/2894616780 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f737801f460 con 0x7f7388159140 2024-04-25T09:07:51.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.704+0000 7f7382000640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f736c066f60 0x7f736c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.704+0000 7f7382000640 1 -- 172.21.15.59:0/2894616780 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7378088460 con 0x7f7388159140 2024-04-25T09:07:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.704+0000 7f738de00640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f736c066f60 0x7f736c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:51.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.704+0000 7f738de00640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f736c066f60 0x7f736c069420 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f737c009ae0 tx=0x7f737c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:51.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.708+0000 7f7382000640 1 -- 172.21.15.59:0/2894616780 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7378059240 con 0x7f7388159140 2024-04-25T09:07:51.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:51.908+0000 7f7390800640 1 -- 172.21.15.59:0/2894616780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7388068400 con 0x7f7388159140 2024-04-25T09:07:52.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7382000640 1 -- 172.21.15.59:0/2894616780 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v65) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7378058b40 con 0x7f7388159140 2024-04-25T09:07:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7390800640 1 -- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f736c066f60 msgr2=0x7f736c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7390800640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f736c066f60 0x7f736c069420 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f737c009ae0 tx=0x7f737c008040 comp rx=0 tx=0).stop 2024-04-25T09:07:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7390800640 1 -- 172.21.15.59:0/2894616780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7388159140 msgr2=0x7f73881595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7390800640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7388159140 0x7f73881595c0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f7378011830 tx=0x7f7378011cf0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7390800640 1 -- 172.21.15.59:0/2894616780 shutdown_connections 2024-04-25T09:07:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7390800640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f736c066f60 0x7f736c069420 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7390800640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f73880ab0c0 0x7f73880ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7390800640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7388159140 0x7f73881595c0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7390800640 1 --2- 172.21.15.59:0/2894616780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7370004d50 0x7f738814b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7390800640 1 -- 172.21.15.59:0/2894616780 >> 172.21.15.59:0/2894616780 conn(0x7f73880cf9c0 msgr2=0x7f73880b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:52.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7390800640 1 -- 172.21.15.59:0/2894616780 shutdown_connections 2024-04-25T09:07:52.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.524+0000 7f7390800640 1 -- 172.21.15.59:0/2894616780 wait complete. 2024-04-25T09:07:52.537 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:07:52.538 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bcb000640 1 Processor -- start 2024-04-25T09:07:52.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bcb000640 1 -- start start 2024-04-25T09:07:52.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bcb000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2bc40b18e0 0x7f2bc40b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:52.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bcb000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bc40b06d0 0x7f2bc406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:52.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bcb000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bc40b0ad0 con 0x7f2bc406e980 2024-04-25T09:07:52.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bcb000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc40cf540 con 0x7f2bc40b18e0 2024-04-25T09:07:52.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bcb000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc415b240 con 0x7f2bc40b06d0 2024-04-25T09:07:52.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bbb400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2bc40b18e0 0x7f2bc40b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:52.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bc9000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bc40b06d0 0x7f2bc406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:52.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bbb400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2bc40b18e0 0x7f2bc40b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:57552/0 (socket says 172.21.15.59:57552) 2024-04-25T09:07:52.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bbb400640 1 -- 172.21.15.59:0/2625134709 learned_addr learned my addr 172.21.15.59:0/2625134709 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:52.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bbb400640 1 -- 172.21.15.59:0/2625134709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bc40b06d0 msgr2=0x7f2bc406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bbb400640 1 --2- 172.21.15.59:0/2625134709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bc40b06d0 0x7f2bc406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bbb400640 1 -- 172.21.15.59:0/2625134709 >> v1:172.21.15.178:6789/0 conn(0x7f2bc406e980 legacy=0x7f2bc40cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bbb400640 1 -- 172.21.15.59:0/2625134709 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc40ce350 con 0x7f2bc40b18e0 2024-04-25T09:07:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bc3400640 1 -- 172.21.15.59:0/2625134709 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817014077 0 0) 0x7f2bc40b0ad0 con 0x7f2bc406e980 2024-04-25T09:07:52.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.696+0000 7f2bc9000640 1 --2- 172.21.15.59:0/2625134709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bc40b06d0 0x7f2bc406d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.700+0000 7f2bbb400640 1 --2- 172.21.15.59:0/2625134709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bc40b18e0 0x7f2bc40b0190 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009870 tx=0x7f2bac01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8116f720111b1f35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.700+0000 7f2bc3400640 1 -- 172.21.15.59:0/2625134709 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0ab620 con 0x7f2bc40b18e0 2024-04-25T09:07:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.700+0000 7f2bc3400640 1 -- 172.21.15.59:0/2625134709 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac0b0070 con 0x7f2bc40b18e0 2024-04-25T09:07:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.700+0000 7f2bc3400640 1 -- 172.21.15.59:0/2625134709 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0ab9e0 con 0x7f2bc40b18e0 2024-04-25T09:07:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.700+0000 7f2bcb000640 1 -- 172.21.15.59:0/2625134709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bc40b18e0 msgr2=0x7f2bc40b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.700+0000 7f2bcb000640 1 --2- 172.21.15.59:0/2625134709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bc40b18e0 0x7f2bc40b0190 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009870 tx=0x7f2bac01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.700+0000 7f2bcb000640 1 -- 172.21.15.59:0/2625134709 shutdown_connections 2024-04-25T09:07:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.700+0000 7f2bcb000640 1 --2- 172.21.15.59:0/2625134709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bc40b06d0 0x7f2bc406d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.700+0000 7f2bcb000640 1 --2- 172.21.15.59:0/2625134709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bc40b18e0 0x7f2bc40b0190 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.700+0000 7f2bcb000640 1 -- 172.21.15.59:0/2625134709 >> 172.21.15.59:0/2625134709 conn(0x7f2bc4066fa0 msgr2=0x7f2bc406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.700+0000 7f2bcb000640 1 -- 172.21.15.59:0/2625134709 shutdown_connections 2024-04-25T09:07:52.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.700+0000 7f2bcb000640 1 -- 172.21.15.59:0/2625134709 wait complete. 2024-04-25T09:07:52.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bcb000640 1 Processor -- start 2024-04-25T09:07:52.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bcb000640 1 -- start start 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bcb000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bc406e980 0x7f2bc40b2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bcb000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bc40b06d0 0x7f2bc40b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bcb000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc40b18e0 0x7f2bc41f66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bcb000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc40b0ef0 con 0x7f2bc40b18e0 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bcb000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc406dc00 con 0x7f2bc40b06d0 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bcb000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc415ae60 con 0x7f2bc406e980 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc40b18e0 0x7f2bc41f66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc9000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc40b18e0 0x7f2bc41f66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36364/0 (socket says 172.21.15.59:36364) 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc9000640 1 -- 172.21.15.59:0/2765210000 learned_addr learned my addr 172.21.15.59:0/2765210000 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc3e00640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bc406e980 0x7f2bc40b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bbb400640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bc40b06d0 0x7f2bc40b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc9000640 1 -- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bc406e980 msgr2=0x7f2bc40b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc9000640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bc406e980 0x7f2bc40b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc9000640 1 -- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bc40b06d0 msgr2=0x7f2bc40b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:52.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc9000640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bc40b06d0 0x7f2bc40b2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc9000640 1 -- 172.21.15.59:0/2765210000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc4149940 con 0x7f2bc40b18e0 2024-04-25T09:07:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc9000640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc40b18e0 0x7f2bc41f66c0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00efc0 tx=0x7f2bbc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc0c00640 1 -- 172.21.15.59:0/2765210000 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc018030 con 0x7f2bc40b18e0 2024-04-25T09:07:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc0c00640 1 -- 172.21.15.59:0/2765210000 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc00cdf0 con 0x7f2bc40b18e0 2024-04-25T09:07:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bcb000640 1 -- 172.21.15.59:0/2765210000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc41454a0 con 0x7f2bc40b18e0 2024-04-25T09:07:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bc0c00640 1 -- 172.21.15.59:0/2765210000 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc003bc0 con 0x7f2bc40b18e0 2024-04-25T09:07:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.704+0000 7f2bcb000640 1 -- 172.21.15.59:0/2765210000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc40b35e0 con 0x7f2bc40b18e0 2024-04-25T09:07:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.708+0000 7f2bcb000640 1 -- 172.21.15.59:0/2765210000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc4145670 con 0x7f2bc40b18e0 2024-04-25T09:07:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.708+0000 7f2bc0c00640 1 -- 172.21.15.59:0/2765210000 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2bbc01b070 con 0x7f2bc40b18e0 2024-04-25T09:07:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.708+0000 7f2bc0c00640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ba0066f60 0x7f2ba0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.708+0000 7f2bc0c00640 1 -- 172.21.15.59:0/2765210000 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2bbc085bf0 con 0x7f2bc40b18e0 2024-04-25T09:07:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.708+0000 7f2bc3e00640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ba0066f60 0x7f2ba0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:52.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.708+0000 7f2bc3e00640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ba0066f60 0x7f2ba0069420 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4000f70 tx=0x7f2bb4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:52.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.712+0000 7f2bc0c00640 1 -- 172.21.15.59:0/2765210000 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2bbc022070 con 0x7f2bc40b18e0 2024-04-25T09:07:52.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 -- 172.21.15.59:0/2765210000 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bc40745d0 con 0x7f2bc40b18e0 2024-04-25T09:07:52.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bc0c00640 1 -- 172.21.15.59:0/2765210000 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f2bbc010040 con 0x7f2bc40b18e0 2024-04-25T09:07:52.900 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:52.900 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:07:51.910911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7458":{"gid":7458,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3531112441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3531112441},{"type":"v1","addr":"172.21.15.59:6835","nonce":3531112441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:07:52.901 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 65 2024-04-25T09:07:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 -- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ba0066f60 msgr2=0x7f2ba0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ba0066f60 0x7f2ba0069420 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4000f70 tx=0x7f2bb4009040 comp rx=0 tx=0).stop 2024-04-25T09:07:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 -- 172.21.15.59:0/2765210000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc40b18e0 msgr2=0x7f2bc41f66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc40b18e0 0x7f2bc41f66c0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00efc0 tx=0x7f2bbc00c490 comp rx=0 tx=0).stop 2024-04-25T09:07:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 -- 172.21.15.59:0/2765210000 shutdown_connections 2024-04-25T09:07:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2ba0066f60 0x7f2ba0069420 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bc40b18e0 0x7f2bc41f66c0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2bc40b06d0 0x7f2bc40b2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 --2- 172.21.15.59:0/2765210000 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2bc406e980 0x7f2bc40b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 -- 172.21.15.59:0/2765210000 >> 172.21.15.59:0/2765210000 conn(0x7f2bc4066fa0 msgr2=0x7f2bc406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 -- 172.21.15.59:0/2765210000 shutdown_connections 2024-04-25T09:07:52.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:52.912+0000 7f2bcb000640 1 -- 172.21.15.59:0/2765210000 wait complete. 2024-04-25T09:07:52.921 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.072+0000 7fc48be00640 1 Processor -- start 2024-04-25T09:07:53.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.072+0000 7fc48be00640 1 -- start start 2024-04-25T09:07:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.072+0000 7fc48be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc48415da10 0x7fc4840afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.072+0000 7fc48be00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc4840d11b0 0x7fc48406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.072+0000 7fc48be00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48415ddf0 con 0x7fc4840b4210 2024-04-25T09:07:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.072+0000 7fc48be00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48406b480 con 0x7fc48415da10 2024-04-25T09:07:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.072+0000 7fc48be00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4840d06d0 con 0x7fc4840d11b0 2024-04-25T09:07:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.076+0000 7fc489400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc48415da10 0x7fc4840afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.076+0000 7fc489e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc4840b4210 0x7fc4840b4620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47146/0 (socket says 172.21.15.59:47146) 2024-04-25T09:07:53.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.076+0000 7fc489e00640 1 -- 172.21.15.59:0/4102590356 learned_addr learned my addr 172.21.15.59:0/4102590356 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:53.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.076+0000 7fc488a00640 1 --2- 172.21.15.59:0/4102590356 >> v2:172.21.15.178:3300/0 conn(0x7fc4840d11b0 0x7fc48406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.076+0000 7fc489400640 1 -- 172.21.15.59:0/4102590356 >> v2:172.21.15.178:3300/0 conn(0x7fc4840d11b0 msgr2=0x7fc48406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:53.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.076+0000 7fc489400640 1 --2- 172.21.15.59:0/4102590356 >> v2:172.21.15.178:3300/0 conn(0x7fc4840d11b0 0x7fc48406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.076+0000 7fc489400640 1 -- 172.21.15.59:0/4102590356 >> v1:172.21.15.59:6789/0 conn(0x7fc4840b4210 legacy=0x7fc4840b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.076+0000 7fc489400640 1 -- 172.21.15.59:0/4102590356 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840d09b0 con 0x7fc48415da10 2024-04-25T09:07:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.076+0000 7fc489400640 1 --2- 172.21.15.59:0/4102590356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48415da10 0x7fc4840afe20 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc484071d40 tx=0x7fc47801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a68fbf69b7f572 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.076+0000 7fc483e00640 1 -- 172.21.15.59:0/4102590356 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780b0070 con 0x7fc48415da10 2024-04-25T09:07:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.076+0000 7fc483e00640 1 -- 172.21.15.59:0/4102590356 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4780ab600 con 0x7fc48415da10 2024-04-25T09:07:53.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.076+0000 7fc483e00640 1 -- 172.21.15.59:0/4102590356 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4780ab9d0 con 0x7fc48415da10 2024-04-25T09:07:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 -- 172.21.15.59:0/4102590356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48415da10 msgr2=0x7fc4840afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 --2- 172.21.15.59:0/4102590356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48415da10 0x7fc4840afe20 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fc484071d40 tx=0x7fc47801c3f0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 -- 172.21.15.59:0/4102590356 shutdown_connections 2024-04-25T09:07:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 --2- 172.21.15.59:0/4102590356 >> v2:172.21.15.178:3300/0 conn(0x7fc4840d11b0 0x7fc48406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 --2- 172.21.15.59:0/4102590356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48415da10 0x7fc4840afe20 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 -- 172.21.15.59:0/4102590356 >> 172.21.15.59:0/4102590356 conn(0x7fc4840b2400 msgr2=0x7fc4840b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 -- 172.21.15.59:0/4102590356 shutdown_connections 2024-04-25T09:07:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 -- 172.21.15.59:0/4102590356 wait complete. 2024-04-25T09:07:53.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 Processor -- start 2024-04-25T09:07:53.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 -- start start 2024-04-25T09:07:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4840b4210 0x7fc4840cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4840d11b0 0x7fc48415e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48415da10 0x7fc484148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4841621d0 con 0x7fc4840d11b0 2024-04-25T09:07:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc484162050 con 0x7fc4840b4210 2024-04-25T09:07:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc48be00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc484162350 con 0x7fc48415da10 2024-04-25T09:07:53.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc488a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4840d11b0 0x7fc48415e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc488a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4840d11b0 0x7fc48415e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36380/0 (socket says 172.21.15.59:36380) 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc488a00640 1 -- 172.21.15.59:0/729045423 learned_addr learned my addr 172.21.15.59:0/729045423 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc489400640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4840b4210 0x7fc4840cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc489e00640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48415da10 0x7fc484148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc488a00640 1 -- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48415da10 msgr2=0x7fc484148870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc488a00640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48415da10 0x7fc484148870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc488a00640 1 -- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4840b4210 msgr2=0x7fc4840cffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc488a00640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4840b4210 0x7fc4840cffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc488a00640 1 -- 172.21.15.59:0/729045423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840cf1e0 con 0x7fc4840d11b0 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc488a00640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4840d11b0 0x7fc48415e960 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc47000d5f0 tx=0x7fc47000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.080+0000 7fc481600640 1 -- 172.21.15.59:0/729045423 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700125f0 con 0x7fc4840d11b0 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.084+0000 7fc481600640 1 -- 172.21.15.59:0/729045423 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470019070 con 0x7fc4840d11b0 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.084+0000 7fc481600640 1 -- 172.21.15.59:0/729045423 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4700129b0 con 0x7fc4840d11b0 2024-04-25T09:07:53.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.084+0000 7fc48be00640 1 -- 172.21.15.59:0/729045423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4840cf4c0 con 0x7fc4840d11b0 2024-04-25T09:07:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.084+0000 7fc48be00640 1 -- 172.21.15.59:0/729045423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4840cfa80 con 0x7fc4840d11b0 2024-04-25T09:07:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.084+0000 7fc48be00640 1 -- 172.21.15.59:0/729045423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4840745d0 con 0x7fc4840d11b0 2024-04-25T09:07:53.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.084+0000 7fc481600640 1 -- 172.21.15.59:0/729045423 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc470012b50 con 0x7fc4840d11b0 2024-04-25T09:07:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.084+0000 7fc481600640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc464066f60 0x7fc464069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.084+0000 7fc481600640 1 -- 172.21.15.59:0/729045423 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc470085550 con 0x7fc4840d11b0 2024-04-25T09:07:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.084+0000 7fc489400640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc464066f60 0x7fc464069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.088+0000 7fc489400640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc464066f60 0x7fc464069420 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc4780ad000 tx=0x7fc478008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:53.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.088+0000 7fc481600640 1 -- 172.21.15.59:0/729045423 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc470056460 con 0x7fc4840d11b0 2024-04-25T09:07:53.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 -- 172.21.15.59:0/729045423 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc48415fcb0 con 0x7fc4840d11b0 2024-04-25T09:07:53.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc481600640 1 -- 172.21.15.59:0/729045423 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16885 (secure 0 0 0) 0x7fc470055d60 con 0x7fc4840d11b0 2024-04-25T09:07:53.240 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:53.241 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":92,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:07:50.506465+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:47.301822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:47.878097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:53.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 -- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc464066f60 msgr2=0x7fc464069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc464066f60 0x7fc464069420 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fc4780ad000 tx=0x7fc478008040 comp rx=0 tx=0).stop 2024-04-25T09:07:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 -- 172.21.15.59:0/729045423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4840d11b0 msgr2=0x7fc48415e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4840d11b0 0x7fc48415e960 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fc47000d5f0 tx=0x7fc47000dab0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 -- 172.21.15.59:0/729045423 shutdown_connections 2024-04-25T09:07:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc464066f60 0x7fc464069420 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48415da10 0x7fc484148870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4840d11b0 0x7fc48415e960 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 --2- 172.21.15.59:0/729045423 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc4840b4210 0x7fc4840cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 -- 172.21.15.59:0/729045423 >> 172.21.15.59:0/729045423 conn(0x7fc4840b2400 msgr2=0x7fc4841498b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 -- 172.21.15.59:0/729045423 shutdown_connections 2024-04-25T09:07:53.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.252+0000 7fc48be00640 1 -- 172.21.15.59:0/729045423 wait complete. 2024-04-25T09:07:53.261 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:07:53.262 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:07:53.359 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:53.362 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:07:53.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.412+0000 7f878e400640 1 Processor -- start 2024-04-25T09:07:53.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.412+0000 7f878e400640 1 -- start start 2024-04-25T09:07:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f878e400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f878815da10 0x7f87880afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f878e400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f87880b4210 0x7f87880b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f878e400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f878815ddf0 con 0x7f87880d11b0 2024-04-25T09:07:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f878e400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87880b4bc0 con 0x7f87880b4210 2024-04-25T09:07:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f878e400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878806b480 con 0x7f878815da10 2024-04-25T09:07:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f877fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f87880d11b0 0x7f878806ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47152/0 (socket says 172.21.15.59:47152) 2024-04-25T09:07:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f877fe00640 1 -- 172.21.15.59:0/3331617291 learned_addr learned my addr 172.21.15.59:0/3331617291 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:53.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8787400640 1 --2- 172.21.15.59:0/3331617291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f878815da10 0x7f87880afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8787e00640 1 --2- 172.21.15.59:0/3331617291 >> v2:172.21.15.178:3300/0 conn(0x7f87880b4210 0x7f87880b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9835498 0 0) 0x7f878815ddf0 con 0x7f87880d11b0 2024-04-25T09:07:53.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f876c003530 con 0x7f87880d11b0 2024-04-25T09:07:53.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3792965157 0 0) 0x7f876c003530 con 0x7f87880d11b0 2024-04-25T09:07:53.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f878815da10 msgr2=0x7f87880afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:53.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 --2- 172.21.15.59:0/3331617291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f878815da10 0x7f87880afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 >> v2:172.21.15.178:3300/0 conn(0x7f87880b4210 msgr2=0x7f87880b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:53.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 --2- 172.21.15.59:0/3331617291 >> v2:172.21.15.178:3300/0 conn(0x7f87880b4210 0x7f87880b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880d06d0 con 0x7f87880d11b0 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f8770001680 con 0x7f87880d11b0 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 >> v1:172.21.15.59:6789/0 conn(0x7f87880d11b0 legacy=0x7f878806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 --2- 172.21.15.59:0/3331617291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f878815da10 0x7f876c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 --2- 172.21.15.59:0/3331617291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f876c003f90 0x7f876c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 --2- 172.21.15.59:0/3331617291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f876c004d50 0x7f876c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87880b4bc0 con 0x7f876c003f90 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878806b480 con 0x7f876c004d50 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c00ba80 con 0x7f878815da10 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f877fe00640 1 --2- 172.21.15.59:0/3331617291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f876c003f90 0x7f876c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8787400640 1 --2- 172.21.15.59:0/3331617291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f878815da10 0x7f876c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f8787e00640 1 --2- 172.21.15.59:0/3331617291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f876c004d50 0x7f876c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f877fe00640 1 -- 172.21.15.59:0/3331617291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f878815da10 msgr2=0x7f876c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f877fe00640 1 --2- 172.21.15.59:0/3331617291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f878815da10 0x7f876c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f877fe00640 1 -- 172.21.15.59:0/3331617291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f876c004d50 msgr2=0x7f876c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f877fe00640 1 --2- 172.21.15.59:0/3331617291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f876c004d50 0x7f876c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.416+0000 7f877fe00640 1 -- 172.21.15.59:0/3331617291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c003530 con 0x7f876c003f90 2024-04-25T09:07:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.420+0000 7f877fe00640 1 --2- 172.21.15.59:0/3331617291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f876c003f90 0x7f876c004810 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f877000c160 tx=0x7f877001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcb276a31e868b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.420+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8770007c90 con 0x7f876c003f90 2024-04-25T09:07:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.420+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87700a9020 con 0x7f876c003f90 2024-04-25T09:07:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.420+0000 7f8786a00640 1 -- 172.21.15.59:0/3331617291 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8770005ae0 con 0x7f876c003f90 2024-04-25T09:07:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.420+0000 7f878e400640 1 -- 172.21.15.59:0/3331617291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f876c003f90 msgr2=0x7f876c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.420+0000 7f878e400640 1 --2- 172.21.15.59:0/3331617291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f876c003f90 0x7f876c004810 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f877000c160 tx=0x7f877001cbe0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.420+0000 7f8787e00640 1 -- 172.21.15.59:0/3331617291 reap_dead start 2024-04-25T09:07:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.420+0000 7f878e400640 1 -- 172.21.15.59:0/3331617291 shutdown_connections 2024-04-25T09:07:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.420+0000 7f878e400640 1 -- 172.21.15.59:0/3331617291 >> 172.21.15.59:0/3331617291 conn(0x7f87880b2400 msgr2=0x7f87880b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.420+0000 7f878e400640 1 -- 172.21.15.59:0/3331617291 shutdown_connections 2024-04-25T09:07:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.420+0000 7f878e400640 1 -- 172.21.15.59:0/3331617291 wait complete. 2024-04-25T09:07:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f878e400640 1 Processor -- start 2024-04-25T09:07:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f878e400640 1 -- start start 2024-04-25T09:07:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f878e400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f876c003f90 0x7f87880cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f878e400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f878813f9b0 0x7f878815c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f878e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87881597e0 0x7f8788159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f878e400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8788162190 con 0x7f87881597e0 2024-04-25T09:07:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f878e400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8788162010 con 0x7f878813f9b0 2024-04-25T09:07:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f878e400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8788162310 con 0x7f876c003f90 2024-04-25T09:07:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f8787e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87881597e0 0x7f8788159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f8787e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87881597e0 0x7f8788159c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36394/0 (socket says 172.21.15.59:36394) 2024-04-25T09:07:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f8787e00640 1 -- 172.21.15.59:0/38921568 learned_addr learned my addr 172.21.15.59:0/38921568 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f877fe00640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f878813f9b0 0x7f878815c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f8787400640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f876c003f90 0x7f87880cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f8787e00640 1 -- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f876c003f90 msgr2=0x7f87880cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f8787e00640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f876c003f90 0x7f87880cf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f8787e00640 1 -- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f878813f9b0 msgr2=0x7f878815c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f8787e00640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f878813f9b0 0x7f878815c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f8787e00640 1 -- 172.21.15.59:0/38921568 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87880ca500 con 0x7f87881597e0 2024-04-25T09:07:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f877fe00640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f878813f9b0 0x7f878815c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f8787400640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f876c003f90 0x7f87880cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f8787e00640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87881597e0 0x7f8788159c60 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f87880afaf0 tx=0x7f87800115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f877f400640 1 -- 172.21.15.59:0/38921568 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8780011e40 con 0x7f87881597e0 2024-04-25T09:07:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f877f400640 1 -- 172.21.15.59:0/38921568 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f878001b070 con 0x7f87881597e0 2024-04-25T09:07:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f877f400640 1 -- 172.21.15.59:0/38921568 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87800039a0 con 0x7f87881597e0 2024-04-25T09:07:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f878e400640 1 -- 172.21.15.59:0/38921568 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87880ce550 con 0x7f87881597e0 2024-04-25T09:07:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f878e400640 1 -- 172.21.15.59:0/38921568 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87880ceb10 con 0x7f87881597e0 2024-04-25T09:07:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.424+0000 7f878e400640 1 -- 172.21.15.59:0/38921568 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87880745d0 con 0x7f87881597e0 2024-04-25T09:07:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.428+0000 7f877f400640 1 -- 172.21.15.59:0/38921568 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8780003b40 con 0x7f87881597e0 2024-04-25T09:07:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.428+0000 7f877f400640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8764066f60 0x7f8764069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.428+0000 7f877f400640 1 -- 172.21.15.59:0/38921568 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8780085ae0 con 0x7f87881597e0 2024-04-25T09:07:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.428+0000 7f8787400640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8764066f60 0x7f8764069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.428+0000 7f8787400640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8764066f60 0x7f8764069420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8778009a00 tx=0x7f8778008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.432+0000 7f877f400640 1 -- 172.21.15.59:0/38921568 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8780025020 con 0x7f87881597e0 2024-04-25T09:07:53.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.592+0000 7f878e400640 1 -- 172.21.15.59:0/38921568 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87880ca930 con 0x7f8764066f60 2024-04-25T09:07:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.600+0000 7f877f400640 1 -- 172.21.15.59:0/38921568 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252004 (secure 0 0 0) 0x7f87880ca930 con 0x7f8764066f60 2024-04-25T09:07:53.591 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:07:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.604+0000 7f878e400640 1 -- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8764066f60 msgr2=0x7f8764069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.604+0000 7f878e400640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8764066f60 0x7f8764069420 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8778009a00 tx=0x7f8778008040 comp rx=0 tx=0).stop 2024-04-25T09:07:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.604+0000 7f878e400640 1 -- 172.21.15.59:0/38921568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87881597e0 msgr2=0x7f8788159c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.604+0000 7f878e400640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87881597e0 0x7f8788159c60 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f87880afaf0 tx=0x7f87800115a0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.604+0000 7f878e400640 1 -- 172.21.15.59:0/38921568 shutdown_connections 2024-04-25T09:07:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.604+0000 7f878e400640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8764066f60 0x7f8764069420 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.604+0000 7f878e400640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87881597e0 0x7f8788159c60 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.604+0000 7f878e400640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f878813f9b0 0x7f878815c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.604+0000 7f878e400640 1 --2- 172.21.15.59:0/38921568 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f876c003f90 0x7f87880cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.604+0000 7f878e400640 1 -- 172.21.15.59:0/38921568 >> 172.21.15.59:0/38921568 conn(0x7f87880b2400 msgr2=0x7f87880b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.604+0000 7f878e400640 1 -- 172.21.15.59:0/38921568 shutdown_connections 2024-04-25T09:07:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.604+0000 7f878e400640 1 -- 172.21.15.59:0/38921568 wait complete. 2024-04-25T09:07:53.612 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-04-25T09:07:51.744960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259352,"kb_used_data":9876,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715368,"statfs":{"total":773094113280,"available":772828536832,"internally_reserved":0,"allocated":10113024,"data_stored":5273414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.262649"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.534392+0000","last_change":"2024-04-25T09:07:49.530148+0000","last_active":"2024-04-25T09:07:49.534392+0000","last_peered":"2024-04-25T09:07:49.534392+0000","last_clean":"2024-04-25T09:07:49.534392+0000","last_became_active":"2024-04-25T09:07:49.529862+0000","last_became_peered":"2024-04-25T09:07:49.529862+0000","last_unstale":"2024-04-25T09:07:49.534392+0000","last_undegraded":"2024-04-25T09:07:49.534392+0000","last_fullsized":"2024-04-25T09:07:49.534392+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:30.461365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.531635+0000","last_change":"2024-04-25T09:07:49.527914+0000","last_active":"2024-04-25T09:07:49.531635+0000","last_peered":"2024-04-25T09:07:49.531635+0000","last_clean":"2024-04-25T09:07:49.531635+0000","last_became_active":"2024-04-25T09:07:49.527624+0000","last_became_peered":"2024-04-25T09:07:49.527624+0000","last_unstale":"2024-04-25T09:07:49.531635+0000","last_undegraded":"2024-04-25T09:07:49.531635+0000","last_fullsized":"2024-04-25T09:07:49.531635+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:30.461365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530312+0000","last_change":"2024-04-25T09:07:49.513784+0000","last_active":"2024-04-25T09:07:49.530312+0000","last_peered":"2024-04-25T09:07:49.530312+0000","last_clean":"2024-04-25T09:07:49.530312+0000","last_became_active":"2024-04-25T09:07:49.513386+0000","last_became_peered":"2024-04-25T09:07:49.513386+0000","last_unstale":"2024-04-25T09:07:49.530312+0000","last_undegraded":"2024-04-25T09:07:49.530312+0000","last_fullsized":"2024-04-25T09:07:49.530312+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:07.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.526560+0000","last_change":"2024-04-25T09:07:49.520267+0000","last_active":"2024-04-25T09:07:49.526560+0000","last_peered":"2024-04-25T09:07:49.526560+0000","last_clean":"2024-04-25T09:07:49.526560+0000","last_became_active":"2024-04-25T09:07:49.520007+0000","last_became_peered":"2024-04-25T09:07:49.520007+0000","last_unstale":"2024-04-25T09:07:49.526560+0000","last_undegraded":"2024-04-25T09:07:49.526560+0000","last_fullsized":"2024-04-25T09:07:49.526560+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:04.832515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.509735+0000","last_change":"2024-04-25T09:07:49.508773+0000","last_active":"2024-04-25T09:07:49.509735+0000","last_peered":"2024-04-25T09:07:49.509735+0000","last_clean":"2024-04-25T09:07:49.509735+0000","last_became_active":"2024-04-25T09:07:49.508295+0000","last_became_peered":"2024-04-25T09:07:49.508295+0000","last_unstale":"2024-04-25T09:07:49.509735+0000","last_undegraded":"2024-04-25T09:07:49.509735+0000","last_fullsized":"2024-04-25T09:07:49.509735+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:19.058368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.540986+0000","last_change":"2024-04-25T09:07:49.538394+0000","last_active":"2024-04-25T09:07:49.540986+0000","last_peered":"2024-04-25T09:07:49.540986+0000","last_clean":"2024-04-25T09:07:49.540986+0000","last_became_active":"2024-04-25T09:07:49.537860+0000","last_became_peered":"2024-04-25T09:07:49.537860+0000","last_unstale":"2024-04-25T09:07:49.540986+0000","last_undegraded":"2024-04-25T09:07:49.540986+0000","last_fullsized":"2024-04-25T09:07:49.540986+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:53.099689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.529277+0000","last_change":"2024-04-25T09:07:49.523751+0000","last_active":"2024-04-25T09:07:49.529277+0000","last_peered":"2024-04-25T09:07:49.529277+0000","last_clean":"2024-04-25T09:07:49.529277+0000","last_became_active":"2024-04-25T09:07:49.523340+0000","last_became_peered":"2024-04-25T09:07:49.523340+0000","last_unstale":"2024-04-25T09:07:49.529277+0000","last_undegraded":"2024-04-25T09:07:49.529277+0000","last_fullsized":"2024-04-25T09:07:49.529277+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:25.010180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530008+0000","last_change":"2024-04-25T09:07:49.513600+0000","last_active":"2024-04-25T09:07:49.530008+0000","last_peered":"2024-04-25T09:07:49.530008+0000","last_clean":"2024-04-25T09:07:49.530008+0000","last_became_active":"2024-04-25T09:07:49.513345+0000","last_became_peered":"2024-04-25T09:07:49.513345+0000","last_unstale":"2024-04-25T09:07:49.530008+0000","last_undegraded":"2024-04-25T09:07:49.530008+0000","last_fullsized":"2024-04-25T09:07:49.530008+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:17.739224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.518080+0000","last_change":"2024-04-25T09:07:49.513357+0000","last_active":"2024-04-25T09:07:49.518080+0000","last_peered":"2024-04-25T09:07:49.518080+0000","last_clean":"2024-04-25T09:07:49.518080+0000","last_became_active":"2024-04-25T09:07:49.511358+0000","last_became_peered":"2024-04-25T09:07:49.511358+0000","last_unstale":"2024-04-25T09:07:49.518080+0000","last_undegraded":"2024-04-25T09:07:49.518080+0000","last_fullsized":"2024-04-25T09:07:49.518080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:22.335096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.524589+0000","last_change":"2024-04-25T09:07:49.520530+0000","last_active":"2024-04-25T09:07:49.524589+0000","last_peered":"2024-04-25T09:07:49.524589+0000","last_clean":"2024-04-25T09:07:49.524589+0000","last_became_active":"2024-04-25T09:07:49.520243+0000","last_became_peered":"2024-04-25T09:07:49.520243+0000","last_unstale":"2024-04-25T09:07:49.524589+0000","last_undegraded":"2024-04-25T09:07:49.524589+0000","last_fullsized":"2024-04-25T09:07:49.524589+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:58.786067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530029+0000","last_change":"2024-04-25T09:07:49.526378+0000","last_active":"2024-04-25T09:07:49.530029+0000","last_peered":"2024-04-25T09:07:49.530029+0000","last_clean":"2024-04-25T09:07:49.530029+0000","last_became_active":"2024-04-25T09:07:49.526113+0000","last_became_peered":"2024-04-25T09:07:49.526113+0000","last_unstale":"2024-04-25T09:07:49.530029+0000","last_undegraded":"2024-04-25T09:07:49.530029+0000","last_fullsized":"2024-04-25T09:07:49.530029+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:21.779492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.519128+0000","last_change":"2024-04-25T09:07:49.516146+0000","last_active":"2024-04-25T09:07:49.519128+0000","last_peered":"2024-04-25T09:07:49.519128+0000","last_clean":"2024-04-25T09:07:49.519128+0000","last_became_active":"2024-04-25T09:07:49.515879+0000","last_became_peered":"2024-04-25T09:07:49.515879+0000","last_unstale":"2024-04-25T09:07:49.519128+0000","last_undegraded":"2024-04-25T09:07:49.519128+0000","last_fullsized":"2024-04-25T09:07:49.519128+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:52.817963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.526613+0000","last_change":"2024-04-25T09:07:49.518716+0000","last_active":"2024-04-25T09:07:49.526613+0000","last_peered":"2024-04-25T09:07:49.526613+0000","last_clean":"2024-04-25T09:07:49.526613+0000","last_became_active":"2024-04-25T09:07:49.513903+0000","last_became_peered":"2024-04-25T09:07:49.513903+0000","last_unstale":"2024-04-25T09:07:49.526613+0000","last_undegraded":"2024-04-25T09:07:49.526613+0000","last_fullsized":"2024-04-25T09:07:49.526613+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:31.372132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.532031+0000","last_change":"2024-04-25T09:07:49.530483+0000","last_active":"2024-04-25T09:07:49.532031+0000","last_peered":"2024-04-25T09:07:49.532031+0000","last_clean":"2024-04-25T09:07:49.532031+0000","last_became_active":"2024-04-25T09:07:49.530142+0000","last_became_peered":"2024-04-25T09:07:49.530142+0000","last_unstale":"2024-04-25T09:07:49.532031+0000","last_undegraded":"2024-04-25T09:07:49.532031+0000","last_fullsized":"2024-04-25T09:07:49.532031+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:44.136753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530766+0000","last_change":"2024-04-25T09:07:49.526257+0000","last_active":"2024-04-25T09:07:49.530766+0000","last_peered":"2024-04-25T09:07:49.530766+0000","last_clean":"2024-04-25T09:07:49.530766+0000","last_became_active":"2024-04-25T09:07:49.525989+0000","last_became_peered":"2024-04-25T09:07:49.525989+0000","last_unstale":"2024-04-25T09:07:49.530766+0000","last_undegraded":"2024-04-25T09:07:49.530766+0000","last_fullsized":"2024-04-25T09:07:49.530766+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:59.975570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.536674+0000","last_change":"2024-04-25T09:07:49.532422+0000","last_active":"2024-04-25T09:07:49.536674+0000","last_peered":"2024-04-25T09:07:49.536674+0000","last_clean":"2024-04-25T09:07:49.536674+0000","last_became_active":"2024-04-25T09:07:49.531778+0000","last_became_peered":"2024-04-25T09:07:49.531778+0000","last_unstale":"2024-04-25T09:07:49.536674+0000","last_undegraded":"2024-04-25T09:07:49.536674+0000","last_fullsized":"2024-04-25T09:07:49.536674+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:29.045023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.539396+0000","last_change":"2024-04-25T09:07:49.533552+0000","last_active":"2024-04-25T09:07:49.539396+0000","last_peered":"2024-04-25T09:07:49.539396+0000","last_clean":"2024-04-25T09:07:49.539396+0000","last_became_active":"2024-04-25T09:07:49.533293+0000","last_became_peered":"2024-04-25T09:07:49.533293+0000","last_unstale":"2024-04-25T09:07:49.539396+0000","last_undegraded":"2024-04-25T09:07:49.539396+0000","last_fullsized":"2024-04-25T09:07:49.539396+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:45.644042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530423+0000","last_change":"2024-04-25T09:07:49.514347+0000","last_active":"2024-04-25T09:07:49.530423+0000","last_peered":"2024-04-25T09:07:49.530423+0000","last_clean":"2024-04-25T09:07:49.530423+0000","last_became_active":"2024-04-25T09:07:49.514084+0000","last_became_peered":"2024-04-25T09:07:49.514084+0000","last_unstale":"2024-04-25T09:07:49.530423+0000","last_undegraded":"2024-04-25T09:07:49.530423+0000","last_fullsized":"2024-04-25T09:07:49.530423+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:59.883717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.519218+0000","last_change":"2024-04-25T09:07:49.515104+0000","last_active":"2024-04-25T09:07:49.519218+0000","last_peered":"2024-04-25T09:07:49.519218+0000","last_clean":"2024-04-25T09:07:49.519218+0000","last_became_active":"2024-04-25T09:07:49.514788+0000","last_became_peered":"2024-04-25T09:07:49.514788+0000","last_unstale":"2024-04-25T09:07:49.519218+0000","last_undegraded":"2024-04-25T09:07:49.519218+0000","last_fullsized":"2024-04-25T09:07:49.519218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:43.697102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.536481+0000","last_change":"2024-04-25T09:07:49.528873+0000","last_active":"2024-04-25T09:07:49.536481+0000","last_peered":"2024-04-25T09:07:49.536481+0000","last_clean":"2024-04-25T09:07:49.536481+0000","last_became_active":"2024-04-25T09:07:49.528438+0000","last_became_peered":"2024-04-25T09:07:49.528438+0000","last_unstale":"2024-04-25T09:07:49.536481+0000","last_undegraded":"2024-04-25T09:07:49.536481+0000","last_fullsized":"2024-04-25T09:07:49.536481+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:29.822650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.518001+0000","last_change":"2024-04-25T09:07:49.511198+0000","last_active":"2024-04-25T09:07:49.518001+0000","last_peered":"2024-04-25T09:07:49.518001+0000","last_clean":"2024-04-25T09:07:49.518001+0000","last_became_active":"2024-04-25T09:07:49.510842+0000","last_became_peered":"2024-04-25T09:07:49.510842+0000","last_unstale":"2024-04-25T09:07:49.518001+0000","last_undegraded":"2024-04-25T09:07:49.518001+0000","last_fullsized":"2024-04-25T09:07:49.518001+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:46.062819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.525812+0000","last_change":"2024-04-25T09:07:49.524429+0000","last_active":"2024-04-25T09:07:49.525812+0000","last_peered":"2024-04-25T09:07:49.525812+0000","last_clean":"2024-04-25T09:07:49.525812+0000","last_became_active":"2024-04-25T09:07:49.524145+0000","last_became_peered":"2024-04-25T09:07:49.524145+0000","last_unstale":"2024-04-25T09:07:49.525812+0000","last_undegraded":"2024-04-25T09:07:49.525812+0000","last_fullsized":"2024-04-25T09:07:49.525812+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:05.770370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.531157+0000","last_change":"2024-04-25T09:07:49.529984+0000","last_active":"2024-04-25T09:07:49.531157+0000","last_peered":"2024-04-25T09:07:49.531157+0000","last_clean":"2024-04-25T09:07:49.531157+0000","last_became_active":"2024-04-25T09:07:49.529676+0000","last_became_peered":"2024-04-25T09:07:49.529676+0000","last_unstale":"2024-04-25T09:07:49.531157+0000","last_undegraded":"2024-04-25T09:07:49.531157+0000","last_fullsized":"2024-04-25T09:07:49.531157+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:30.442123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530485+0000","last_change":"2024-04-25T09:07:49.513633+0000","last_active":"2024-04-25T09:07:49.530485+0000","last_peered":"2024-04-25T09:07:49.530485+0000","last_clean":"2024-04-25T09:07:49.530485+0000","last_became_active":"2024-04-25T09:07:49.513269+0000","last_became_peered":"2024-04-25T09:07:49.513269+0000","last_unstale":"2024-04-25T09:07:49.530485+0000","last_undegraded":"2024-04-25T09:07:49.530485+0000","last_fullsized":"2024-04-25T09:07:49.530485+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:09.373865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.518975+0000","last_change":"2024-04-25T09:07:49.512142+0000","last_active":"2024-04-25T09:07:49.518975+0000","last_peered":"2024-04-25T09:07:49.518975+0000","last_clean":"2024-04-25T09:07:49.518975+0000","last_became_active":"2024-04-25T09:07:49.511742+0000","last_became_peered":"2024-04-25T09:07:49.511742+0000","last_unstale":"2024-04-25T09:07:49.518975+0000","last_undegraded":"2024-04-25T09:07:49.518975+0000","last_fullsized":"2024-04-25T09:07:49.518975+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:07.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.527765+0000","last_change":"2024-04-25T09:07:49.524659+0000","last_active":"2024-04-25T09:07:49.527765+0000","last_peered":"2024-04-25T09:07:49.527765+0000","last_clean":"2024-04-25T09:07:49.527765+0000","last_became_active":"2024-04-25T09:07:49.524292+0000","last_became_peered":"2024-04-25T09:07:49.524292+0000","last_unstale":"2024-04-25T09:07:49.527765+0000","last_undegraded":"2024-04-25T09:07:49.527765+0000","last_fullsized":"2024-04-25T09:07:49.527765+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:17.739224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.515180+0000","last_change":"2024-04-25T09:07:49.509072+0000","last_active":"2024-04-25T09:07:49.515180+0000","last_peered":"2024-04-25T09:07:49.515180+0000","last_clean":"2024-04-25T09:07:49.515180+0000","last_became_active":"2024-04-25T09:07:49.508756+0000","last_became_peered":"2024-04-25T09:07:49.508756+0000","last_unstale":"2024-04-25T09:07:49.515180+0000","last_undegraded":"2024-04-25T09:07:49.515180+0000","last_fullsized":"2024-04-25T09:07:49.515180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:44.364610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.526539+0000","last_change":"2024-04-25T09:07:49.519665+0000","last_active":"2024-04-25T09:07:49.526539+0000","last_peered":"2024-04-25T09:07:49.526539+0000","last_clean":"2024-04-25T09:07:49.526539+0000","last_became_active":"2024-04-25T09:07:49.519396+0000","last_became_peered":"2024-04-25T09:07:49.519396+0000","last_unstale":"2024-04-25T09:07:49.526539+0000","last_undegraded":"2024-04-25T09:07:49.526539+0000","last_fullsized":"2024-04-25T09:07:49.526539+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:16.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.512535+0000","last_change":"2024-04-25T09:07:49.509762+0000","last_active":"2024-04-25T09:07:49.512535+0000","last_peered":"2024-04-25T09:07:49.512535+0000","last_clean":"2024-04-25T09:07:49.512535+0000","last_became_active":"2024-04-25T09:07:49.509465+0000","last_became_peered":"2024-04-25T09:07:49.509465+0000","last_unstale":"2024-04-25T09:07:49.512535+0000","last_undegraded":"2024-04-25T09:07:49.512535+0000","last_fullsized":"2024-04-25T09:07:49.512535+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:34.153710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.518021+0000","last_change":"2024-04-25T09:07:49.511610+0000","last_active":"2024-04-25T09:07:49.518021+0000","last_peered":"2024-04-25T09:07:49.518021+0000","last_clean":"2024-04-25T09:07:49.518021+0000","last_became_active":"2024-04-25T09:07:49.511100+0000","last_became_peered":"2024-04-25T09:07:49.511100+0000","last_unstale":"2024-04-25T09:07:49.518021+0000","last_undegraded":"2024-04-25T09:07:49.518021+0000","last_fullsized":"2024-04-25T09:07:49.518021+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:47.813212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.518201+0000","last_change":"2024-04-25T09:07:49.517094+0000","last_active":"2024-04-25T09:07:49.518201+0000","last_peered":"2024-04-25T09:07:49.518201+0000","last_clean":"2024-04-25T09:07:49.518201+0000","last_became_active":"2024-04-25T09:07:49.516761+0000","last_became_peered":"2024-04-25T09:07:49.516761+0000","last_unstale":"2024-04-25T09:07:49.518201+0000","last_undegraded":"2024-04-25T09:07:49.518201+0000","last_fullsized":"2024-04-25T09:07:49.518201+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:59.883717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.536698+0000","last_change":"2024-04-25T09:07:49.532679+0000","last_active":"2024-04-25T09:07:49.536698+0000","last_peered":"2024-04-25T09:07:49.536698+0000","last_clean":"2024-04-25T09:07:49.536698+0000","last_became_active":"2024-04-25T09:07:49.532101+0000","last_became_peered":"2024-04-25T09:07:49.532101+0000","last_unstale":"2024-04-25T09:07:49.536698+0000","last_undegraded":"2024-04-25T09:07:49.536698+0000","last_fullsized":"2024-04-25T09:07:49.536698+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:54.268664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.535272+0000","last_change":"2024-04-25T09:07:49.524680+0000","last_active":"2024-04-25T09:07:49.535272+0000","last_peered":"2024-04-25T09:07:49.535272+0000","last_clean":"2024-04-25T09:07:49.535272+0000","last_became_active":"2024-04-25T09:07:49.524013+0000","last_became_peered":"2024-04-25T09:07:49.524013+0000","last_unstale":"2024-04-25T09:07:49.535272+0000","last_undegraded":"2024-04-25T09:07:49.535272+0000","last_fullsized":"2024-04-25T09:07:49.535272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:11.755393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"91'4","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.537354+0000","last_change":"2024-04-25T09:07:48.511822+0000","last_active":"2024-04-25T09:07:49.537354+0000","last_peered":"2024-04-25T09:07:49.537354+0000","last_clean":"2024-04-25T09:07:49.537354+0000","last_became_active":"2024-04-25T09:07:48.511480+0000","last_became_peered":"2024-04-25T09:07:48.511480+0000","last_unstale":"2024-04-25T09:07:49.537354+0000","last_undegraded":"2024-04-25T09:07:49.537354+0000","last_fullsized":"2024-04-25T09:07:49.537354+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:03.828137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.539440+0000","last_change":"2024-04-25T09:07:49.535987+0000","last_active":"2024-04-25T09:07:49.539440+0000","last_peered":"2024-04-25T09:07:49.539440+0000","last_clean":"2024-04-25T09:07:49.539440+0000","last_became_active":"2024-04-25T09:07:49.535560+0000","last_became_peered":"2024-04-25T09:07:49.535560+0000","last_unstale":"2024-04-25T09:07:49.539440+0000","last_undegraded":"2024-04-25T09:07:49.539440+0000","last_fullsized":"2024-04-25T09:07:49.539440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:37.160036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.519094+0000","last_change":"2024-04-25T09:07:48.506507+0000","last_active":"2024-04-25T09:07:49.519094+0000","last_peered":"2024-04-25T09:07:49.519094+0000","last_clean":"2024-04-25T09:07:49.519094+0000","last_became_active":"2024-04-25T09:07:48.505879+0000","last_became_peered":"2024-04-25T09:07:48.505879+0000","last_unstale":"2024-04-25T09:07:49.519094+0000","last_undegraded":"2024-04-25T09:07:49.519094+0000","last_fullsized":"2024-04-25T09:07:49.519094+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:40.819772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.529602+0000","last_change":"2024-04-25T09:07:49.524687+0000","last_active":"2024-04-25T09:07:49.529602+0000","last_peered":"2024-04-25T09:07:49.529602+0000","last_clean":"2024-04-25T09:07:49.529602+0000","last_became_active":"2024-04-25T09:07:49.524425+0000","last_became_peered":"2024-04-25T09:07:49.524425+0000","last_unstale":"2024-04-25T09:07:49.529602+0000","last_undegraded":"2024-04-25T09:07:49.529602+0000","last_fullsized":"2024-04-25T09:07:49.529602+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:12.345289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.532197+0000","last_change":"2024-04-25T09:07:48.516912+0000","last_active":"2024-04-25T09:07:49.532197+0000","last_peered":"2024-04-25T09:07:49.532197+0000","last_clean":"2024-04-25T09:07:49.532197+0000","last_became_active":"2024-04-25T09:07:48.516555+0000","last_became_peered":"2024-04-25T09:07:48.516555+0000","last_unstale":"2024-04-25T09:07:49.532197+0000","last_undegraded":"2024-04-25T09:07:49.532197+0000","last_fullsized":"2024-04-25T09:07:49.532197+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:59.294976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.522670+0000","last_change":"2024-04-25T09:07:49.515345+0000","last_active":"2024-04-25T09:07:49.522670+0000","last_peered":"2024-04-25T09:07:49.522670+0000","last_clean":"2024-04-25T09:07:49.522670+0000","last_became_active":"2024-04-25T09:07:49.515009+0000","last_became_peered":"2024-04-25T09:07:49.515009+0000","last_unstale":"2024-04-25T09:07:49.522670+0000","last_undegraded":"2024-04-25T09:07:49.522670+0000","last_fullsized":"2024-04-25T09:07:49.522670+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:04.771069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.538231+0000","last_change":"2024-04-25T09:07:48.521211+0000","last_active":"2024-04-25T09:07:49.538231+0000","last_peered":"2024-04-25T09:07:49.538231+0000","last_clean":"2024-04-25T09:07:49.538231+0000","last_became_active":"2024-04-25T09:07:48.520919+0000","last_became_peered":"2024-04-25T09:07:48.520919+0000","last_unstale":"2024-04-25T09:07:49.538231+0000","last_undegraded":"2024-04-25T09:07:49.538231+0000","last_fullsized":"2024-04-25T09:07:49.538231+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:35.839422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.533372+0000","last_change":"2024-04-25T09:07:49.528078+0000","last_active":"2024-04-25T09:07:49.533372+0000","last_peered":"2024-04-25T09:07:49.533372+0000","last_clean":"2024-04-25T09:07:49.533372+0000","last_became_active":"2024-04-25T09:07:49.527817+0000","last_became_peered":"2024-04-25T09:07:49.527817+0000","last_unstale":"2024-04-25T09:07:49.533372+0000","last_undegraded":"2024-04-25T09:07:49.533372+0000","last_fullsized":"2024-04-25T09:07:49.533372+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:07.498078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.521550+0000","last_change":"2024-04-25T09:07:48.521487+0000","last_active":"2024-04-25T09:07:49.521550+0000","last_peered":"2024-04-25T09:07:49.521550+0000","last_clean":"2024-04-25T09:07:49.521550+0000","last_became_active":"2024-04-25T09:07:48.521169+0000","last_became_peered":"2024-04-25T09:07:48.521169+0000","last_unstale":"2024-04-25T09:07:49.521550+0000","last_undegraded":"2024-04-25T09:07:49.521550+0000","last_fullsized":"2024-04-25T09:07:49.521550+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:21.131982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.519893+0000","last_change":"2024-04-25T09:07:49.518670+0000","last_active":"2024-04-25T09:07:49.519893+0000","last_peered":"2024-04-25T09:07:49.519893+0000","last_clean":"2024-04-25T09:07:49.519893+0000","last_became_active":"2024-04-25T09:07:49.518382+0000","last_became_peered":"2024-04-25T09:07:49.518382+0000","last_unstale":"2024-04-25T09:07:49.519893+0000","last_undegraded":"2024-04-25T09:07:49.519893+0000","last_fullsized":"2024-04-25T09:07:49.519893+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:40.914814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.537457+0000","last_change":"2024-04-25T09:07:48.516053+0000","last_active":"2024-04-25T09:07:49.537457+0000","last_peered":"2024-04-25T09:07:49.537457+0000","last_clean":"2024-04-25T09:07:49.537457+0000","last_became_active":"2024-04-25T09:07:48.515398+0000","last_became_peered":"2024-04-25T09:07:48.515398+0000","last_unstale":"2024-04-25T09:07:49.537457+0000","last_undegraded":"2024-04-25T09:07:49.537457+0000","last_fullsized":"2024-04-25T09:07:49.537457+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:43.132375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.541678+0000","last_change":"2024-04-25T09:07:49.540666+0000","last_active":"2024-04-25T09:07:49.541678+0000","last_peered":"2024-04-25T09:07:49.541678+0000","last_clean":"2024-04-25T09:07:49.541678+0000","last_became_active":"2024-04-25T09:07:49.540378+0000","last_became_peered":"2024-04-25T09:07:49.540378+0000","last_unstale":"2024-04-25T09:07:49.541678+0000","last_undegraded":"2024-04-25T09:07:49.541678+0000","last_fullsized":"2024-04-25T09:07:49.541678+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:53.511831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.502629+0000","last_change":"2024-04-25T09:07:48.507509+0000","last_active":"2024-04-25T09:07:49.502629+0000","last_peered":"2024-04-25T09:07:49.502629+0000","last_clean":"2024-04-25T09:07:49.502629+0000","last_became_active":"2024-04-25T09:07:48.507240+0000","last_became_peered":"2024-04-25T09:07:48.507240+0000","last_unstale":"2024-04-25T09:07:49.502629+0000","last_undegraded":"2024-04-25T09:07:49.502629+0000","last_fullsized":"2024-04-25T09:07:49.502629+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:29.437745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.526594+0000","last_change":"2024-04-25T09:07:49.512322+0000","last_active":"2024-04-25T09:07:49.526594+0000","last_peered":"2024-04-25T09:07:49.526594+0000","last_clean":"2024-04-25T09:07:49.526594+0000","last_became_active":"2024-04-25T09:07:49.512001+0000","last_became_peered":"2024-04-25T09:07:49.512001+0000","last_unstale":"2024-04-25T09:07:49.526594+0000","last_undegraded":"2024-04-25T09:07:49.526594+0000","last_fullsized":"2024-04-25T09:07:49.526594+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:21.779492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.495621+0000","last_change":"2024-04-25T09:07:48.521324+0000","last_active":"2024-04-25T09:07:49.495621+0000","last_peered":"2024-04-25T09:07:49.495621+0000","last_clean":"2024-04-25T09:07:49.495621+0000","last_became_active":"2024-04-25T09:07:48.520780+0000","last_became_peered":"2024-04-25T09:07:48.520780+0000","last_unstale":"2024-04-25T09:07:49.495621+0000","last_undegraded":"2024-04-25T09:07:49.495621+0000","last_fullsized":"2024-04-25T09:07:49.495621+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:34.850196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.522337+0000","last_change":"2024-04-25T09:07:49.521770+0000","last_active":"2024-04-25T09:07:49.522337+0000","last_peered":"2024-04-25T09:07:49.522337+0000","last_clean":"2024-04-25T09:07:49.522337+0000","last_became_active":"2024-04-25T09:07:49.521401+0000","last_became_peered":"2024-04-25T09:07:49.521401+0000","last_unstale":"2024-04-25T09:07:49.522337+0000","last_undegraded":"2024-04-25T09:07:49.522337+0000","last_fullsized":"2024-04-25T09:07:49.522337+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:26.672319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.498472+0000","last_change":"2024-04-25T09:07:48.514945+0000","last_active":"2024-04-25T09:07:49.498472+0000","last_peered":"2024-04-25T09:07:49.498472+0000","last_clean":"2024-04-25T09:07:49.498472+0000","last_became_active":"2024-04-25T09:07:48.514663+0000","last_became_peered":"2024-04-25T09:07:48.514663+0000","last_unstale":"2024-04-25T09:07:49.498472+0000","last_undegraded":"2024-04-25T09:07:49.498472+0000","last_fullsized":"2024-04-25T09:07:49.498472+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:21.285004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.512321+0000","last_change":"2024-04-25T09:07:49.510069+0000","last_active":"2024-04-25T09:07:49.512321+0000","last_peered":"2024-04-25T09:07:49.512321+0000","last_clean":"2024-04-25T09:07:49.512321+0000","last_became_active":"2024-04-25T09:07:49.507935+0000","last_became_peered":"2024-04-25T09:07:49.507935+0000","last_unstale":"2024-04-25T09:07:49.512321+0000","last_undegraded":"2024-04-25T09:07:49.512321+0000","last_fullsized":"2024-04-25T09:07:49.512321+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:11.755393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.507859+0000","last_change":"2024-04-25T09:07:48.518568+0000","last_active":"2024-04-25T09:07:49.507859+0000","last_peered":"2024-04-25T09:07:49.507859+0000","last_clean":"2024-04-25T09:07:49.507859+0000","last_became_active":"2024-04-25T09:07:48.518269+0000","last_became_peered":"2024-04-25T09:07:48.518269+0000","last_unstale":"2024-04-25T09:07:49.507859+0000","last_undegraded":"2024-04-25T09:07:49.507859+0000","last_fullsized":"2024-04-25T09:07:49.507859+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:21.285004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.531023+0000","last_change":"2024-04-25T09:07:49.523862+0000","last_active":"2024-04-25T09:07:49.531023+0000","last_peered":"2024-04-25T09:07:49.531023+0000","last_clean":"2024-04-25T09:07:49.531023+0000","last_became_active":"2024-04-25T09:07:49.523587+0000","last_became_peered":"2024-04-25T09:07:49.523587+0000","last_unstale":"2024-04-25T09:07:49.531023+0000","last_undegraded":"2024-04-25T09:07:49.531023+0000","last_fullsized":"2024-04-25T09:07:49.531023+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:35.854574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"91'3","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.540681+0000","last_change":"2024-04-25T09:07:48.517890+0000","last_active":"2024-04-25T09:07:49.540681+0000","last_peered":"2024-04-25T09:07:49.540681+0000","last_clean":"2024-04-25T09:07:49.540681+0000","last_became_active":"2024-04-25T09:07:48.517549+0000","last_became_peered":"2024-04-25T09:07:48.517549+0000","last_unstale":"2024-04-25T09:07:49.540681+0000","last_undegraded":"2024-04-25T09:07:49.540681+0000","last_fullsized":"2024-04-25T09:07:49.540681+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:28.850910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.527337+0000","last_change":"2024-04-25T09:07:49.523162+0000","last_active":"2024-04-25T09:07:49.527337+0000","last_peered":"2024-04-25T09:07:49.527337+0000","last_clean":"2024-04-25T09:07:49.527337+0000","last_became_active":"2024-04-25T09:07:49.522870+0000","last_became_peered":"2024-04-25T09:07:49.522870+0000","last_unstale":"2024-04-25T09:07:49.527337+0000","last_undegraded":"2024-04-25T09:07:49.527337+0000","last_fullsized":"2024-04-25T09:07:49.527337+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:36.843799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"91'6","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.542613+0000","last_change":"2024-04-25T09:07:48.513607+0000","last_active":"2024-04-25T09:07:49.542613+0000","last_peered":"2024-04-25T09:07:49.542613+0000","last_clean":"2024-04-25T09:07:49.542613+0000","last_became_active":"2024-04-25T09:07:48.513321+0000","last_became_peered":"2024-04-25T09:07:48.513321+0000","last_unstale":"2024-04-25T09:07:49.542613+0000","last_undegraded":"2024-04-25T09:07:49.542613+0000","last_fullsized":"2024-04-25T09:07:49.542613+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:34.850196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.529988+0000","last_change":"2024-04-25T09:07:49.512320+0000","last_active":"2024-04-25T09:07:49.529988+0000","last_peered":"2024-04-25T09:07:49.529988+0000","last_clean":"2024-04-25T09:07:49.529988+0000","last_became_active":"2024-04-25T09:07:49.511956+0000","last_became_peered":"2024-04-25T09:07:49.511956+0000","last_unstale":"2024-04-25T09:07:49.529988+0000","last_undegraded":"2024-04-25T09:07:49.529988+0000","last_fullsized":"2024-04-25T09:07:49.529988+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:26.672319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.540478+0000","last_change":"2024-04-25T09:07:48.517726+0000","last_active":"2024-04-25T09:07:49.540478+0000","last_peered":"2024-04-25T09:07:49.540478+0000","last_clean":"2024-04-25T09:07:49.540478+0000","last_became_active":"2024-04-25T09:07:48.517391+0000","last_became_peered":"2024-04-25T09:07:48.517391+0000","last_unstale":"2024-04-25T09:07:49.540478+0000","last_undegraded":"2024-04-25T09:07:49.540478+0000","last_fullsized":"2024-04-25T09:07:49.540478+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:29.456988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.517917+0000","last_change":"2024-04-25T09:07:49.511339+0000","last_active":"2024-04-25T09:07:49.517917+0000","last_peered":"2024-04-25T09:07:49.517917+0000","last_clean":"2024-04-25T09:07:49.517917+0000","last_became_active":"2024-04-25T09:07:49.510379+0000","last_became_peered":"2024-04-25T09:07:49.510379+0000","last_unstale":"2024-04-25T09:07:49.517917+0000","last_undegraded":"2024-04-25T09:07:49.517917+0000","last_fullsized":"2024-04-25T09:07:49.517917+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:17.397256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.508801+0000","last_change":"2024-04-25T09:07:48.514375+0000","last_active":"2024-04-25T09:07:49.508801+0000","last_peered":"2024-04-25T09:07:49.508801+0000","last_clean":"2024-04-25T09:07:49.508801+0000","last_became_active":"2024-04-25T09:07:48.514090+0000","last_became_peered":"2024-04-25T09:07:48.514090+0000","last_unstale":"2024-04-25T09:07:49.508801+0000","last_undegraded":"2024-04-25T09:07:49.508801+0000","last_fullsized":"2024-04-25T09:07:49.508801+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:29.456988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.524443+0000","last_change":"2024-04-25T09:07:49.521364+0000","last_active":"2024-04-25T09:07:49.524443+0000","last_peered":"2024-04-25T09:07:49.524443+0000","last_clean":"2024-04-25T09:07:49.524443+0000","last_became_active":"2024-04-25T09:07:49.521067+0000","last_became_peered":"2024-04-25T09:07:49.521067+0000","last_unstale":"2024-04-25T09:07:49.524443+0000","last_undegraded":"2024-04-25T09:07:49.524443+0000","last_fullsized":"2024-04-25T09:07:49.524443+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:22.522862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.512521+0000","last_change":"2024-04-25T09:07:48.510400+0000","last_active":"2024-04-25T09:07:49.512521+0000","last_peered":"2024-04-25T09:07:49.512521+0000","last_clean":"2024-04-25T09:07:49.512521+0000","last_became_active":"2024-04-25T09:07:48.507979+0000","last_became_peered":"2024-04-25T09:07:48.507979+0000","last_unstale":"2024-04-25T09:07:49.512521+0000","last_undegraded":"2024-04-25T09:07:49.512521+0000","last_fullsized":"2024-04-25T09:07:49.512521+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:04.765993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.514586+0000","last_change":"2024-04-25T09:07:49.508272+0000","last_active":"2024-04-25T09:07:49.514586+0000","last_peered":"2024-04-25T09:07:49.514586+0000","last_clean":"2024-04-25T09:07:49.514586+0000","last_became_active":"2024-04-25T09:07:49.507981+0000","last_became_peered":"2024-04-25T09:07:49.507981+0000","last_unstale":"2024-04-25T09:07:49.514586+0000","last_undegraded":"2024-04-25T09:07:49.514586+0000","last_fullsized":"2024-04-25T09:07:49.514586+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:26.548548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"91'8","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.539749+0000","last_change":"2024-04-25T09:07:48.520095+0000","last_active":"2024-04-25T09:07:49.539749+0000","last_peered":"2024-04-25T09:07:49.539749+0000","last_clean":"2024-04-25T09:07:49.539749+0000","last_became_active":"2024-04-25T09:07:48.518758+0000","last_became_peered":"2024-04-25T09:07:48.518758+0000","last_unstale":"2024-04-25T09:07:49.539749+0000","last_undegraded":"2024-04-25T09:07:49.539749+0000","last_fullsized":"2024-04-25T09:07:49.539749+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.692724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.536971+0000","last_change":"2024-04-25T09:07:49.532114+0000","last_active":"2024-04-25T09:07:49.536971+0000","last_peered":"2024-04-25T09:07:49.536971+0000","last_clean":"2024-04-25T09:07:49.536971+0000","last_became_active":"2024-04-25T09:07:49.524406+0000","last_became_peered":"2024-04-25T09:07:49.524406+0000","last_unstale":"2024-04-25T09:07:49.536971+0000","last_undegraded":"2024-04-25T09:07:49.536971+0000","last_fullsized":"2024-04-25T09:07:49.536971+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:12.345289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.532455+0000","last_change":"2024-04-25T09:07:48.507398+0000","last_active":"2024-04-25T09:07:49.532455+0000","last_peered":"2024-04-25T09:07:49.532455+0000","last_clean":"2024-04-25T09:07:49.532455+0000","last_became_active":"2024-04-25T09:07:48.507115+0000","last_became_peered":"2024-04-25T09:07:48.507115+0000","last_unstale":"2024-04-25T09:07:49.532455+0000","last_undegraded":"2024-04-25T09:07:49.532455+0000","last_fullsized":"2024-04-25T09:07:49.532455+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:28.818273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.518624+0000","last_change":"2024-04-25T09:07:49.513747+0000","last_active":"2024-04-25T09:07:49.518624+0000","last_peered":"2024-04-25T09:07:49.518624+0000","last_clean":"2024-04-25T09:07:49.518624+0000","last_became_active":"2024-04-25T09:07:49.513433+0000","last_became_peered":"2024-04-25T09:07:49.513433+0000","last_unstale":"2024-04-25T09:07:49.518624+0000","last_undegraded":"2024-04-25T09:07:49.518624+0000","last_fullsized":"2024-04-25T09:07:49.518624+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:06.444919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.532279+0000","last_change":"2024-04-25T09:07:48.509394+0000","last_active":"2024-04-25T09:07:49.532279+0000","last_peered":"2024-04-25T09:07:49.532279+0000","last_clean":"2024-04-25T09:07:49.532279+0000","last_became_active":"2024-04-25T09:07:48.509121+0000","last_became_peered":"2024-04-25T09:07:48.509121+0000","last_unstale":"2024-04-25T09:07:49.532279+0000","last_undegraded":"2024-04-25T09:07:49.532279+0000","last_fullsized":"2024-04-25T09:07:49.532279+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:28.789460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.517965+0000","last_change":"2024-04-25T09:07:49.513611+0000","last_active":"2024-04-25T09:07:49.517965+0000","last_peered":"2024-04-25T09:07:49.517965+0000","last_clean":"2024-04-25T09:07:49.517965+0000","last_became_active":"2024-04-25T09:07:49.513341+0000","last_became_peered":"2024-04-25T09:07:49.513341+0000","last_unstale":"2024-04-25T09:07:49.517965+0000","last_undegraded":"2024-04-25T09:07:49.517965+0000","last_fullsized":"2024-04-25T09:07:49.517965+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:55.465043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.529969+0000","last_change":"2024-04-25T09:07:48.518531+0000","last_active":"2024-04-25T09:07:49.529969+0000","last_peered":"2024-04-25T09:07:49.529969+0000","last_clean":"2024-04-25T09:07:49.529969+0000","last_became_active":"2024-04-25T09:07:48.518242+0000","last_became_peered":"2024-04-25T09:07:48.518242+0000","last_unstale":"2024-04-25T09:07:49.529969+0000","last_undegraded":"2024-04-25T09:07:49.529969+0000","last_fullsized":"2024-04-25T09:07:49.529969+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:24.070394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.540962+0000","last_change":"2024-04-25T09:07:49.538403+0000","last_active":"2024-04-25T09:07:49.540962+0000","last_peered":"2024-04-25T09:07:49.540962+0000","last_clean":"2024-04-25T09:07:49.540962+0000","last_became_active":"2024-04-25T09:07:49.538058+0000","last_became_peered":"2024-04-25T09:07:49.538058+0000","last_unstale":"2024-04-25T09:07:49.540962+0000","last_undegraded":"2024-04-25T09:07:49.540962+0000","last_fullsized":"2024-04-25T09:07:49.540962+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:33.517552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.534126+0000","last_change":"2024-04-25T09:07:48.501180+0000","last_active":"2024-04-25T09:07:49.534126+0000","last_peered":"2024-04-25T09:07:49.534126+0000","last_clean":"2024-04-25T09:07:49.534126+0000","last_became_active":"2024-04-25T09:07:48.500867+0000","last_became_peered":"2024-04-25T09:07:48.500867+0000","last_unstale":"2024-04-25T09:07:49.534126+0000","last_undegraded":"2024-04-25T09:07:49.534126+0000","last_fullsized":"2024-04-25T09:07:49.534126+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:29.437745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.524945+0000","last_change":"2024-04-25T09:07:49.523814+0000","last_active":"2024-04-25T09:07:49.524945+0000","last_peered":"2024-04-25T09:07:49.524945+0000","last_clean":"2024-04-25T09:07:49.524945+0000","last_became_active":"2024-04-25T09:07:49.523451+0000","last_became_peered":"2024-04-25T09:07:49.523451+0000","last_unstale":"2024-04-25T09:07:49.524945+0000","last_undegraded":"2024-04-25T09:07:49.524945+0000","last_fullsized":"2024-04-25T09:07:49.524945+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:02.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.494726+0000","last_change":"2024-04-25T09:07:48.513913+0000","last_active":"2024-04-25T09:07:49.494726+0000","last_peered":"2024-04-25T09:07:49.494726+0000","last_clean":"2024-04-25T09:07:49.494726+0000","last_became_active":"2024-04-25T09:07:48.513611+0000","last_became_peered":"2024-04-25T09:07:48.513611+0000","last_unstale":"2024-04-25T09:07:49.494726+0000","last_undegraded":"2024-04-25T09:07:49.494726+0000","last_fullsized":"2024-04-25T09:07:49.494726+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:23.748660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530931+0000","last_change":"2024-04-25T09:07:49.526744+0000","last_active":"2024-04-25T09:07:49.530931+0000","last_peered":"2024-04-25T09:07:49.530931+0000","last_clean":"2024-04-25T09:07:49.530931+0000","last_became_active":"2024-04-25T09:07:49.526396+0000","last_became_peered":"2024-04-25T09:07:49.526396+0000","last_unstale":"2024-04-25T09:07:49.530931+0000","last_undegraded":"2024-04-25T09:07:49.530931+0000","last_fullsized":"2024-04-25T09:07:49.530931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:35.854574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.497668+0000","last_change":"2024-04-25T09:07:48.511723+0000","last_active":"2024-04-25T09:07:49.497668+0000","last_peered":"2024-04-25T09:07:49.497668+0000","last_clean":"2024-04-25T09:07:49.497668+0000","last_became_active":"2024-04-25T09:07:48.511403+0000","last_became_peered":"2024-04-25T09:07:48.511403+0000","last_unstale":"2024-04-25T09:07:49.497668+0000","last_undegraded":"2024-04-25T09:07:49.497668+0000","last_fullsized":"2024-04-25T09:07:49.497668+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:39.910436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.521459+0000","last_change":"2024-04-25T09:07:49.518391+0000","last_active":"2024-04-25T09:07:49.521459+0000","last_peered":"2024-04-25T09:07:49.521459+0000","last_clean":"2024-04-25T09:07:49.521459+0000","last_became_active":"2024-04-25T09:07:49.518095+0000","last_became_peered":"2024-04-25T09:07:49.518095+0000","last_unstale":"2024-04-25T09:07:49.521459+0000","last_undegraded":"2024-04-25T09:07:49.521459+0000","last_fullsized":"2024-04-25T09:07:49.521459+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:29.793838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.493614+0000","last_change":"2024-04-25T09:07:48.504709+0000","last_active":"2024-04-25T09:07:49.493614+0000","last_peered":"2024-04-25T09:07:49.493614+0000","last_clean":"2024-04-25T09:07:49.493614+0000","last_became_active":"2024-04-25T09:07:48.504417+0000","last_became_peered":"2024-04-25T09:07:48.504417+0000","last_unstale":"2024-04-25T09:07:49.493614+0000","last_undegraded":"2024-04-25T09:07:49.493614+0000","last_fullsized":"2024-04-25T09:07:49.493614+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:16.231226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.517530+0000","last_change":"2024-04-25T09:07:49.509943+0000","last_active":"2024-04-25T09:07:49.517530+0000","last_peered":"2024-04-25T09:07:49.517530+0000","last_clean":"2024-04-25T09:07:49.517530+0000","last_became_active":"2024-04-25T09:07:49.508063+0000","last_became_peered":"2024-04-25T09:07:49.508063+0000","last_unstale":"2024-04-25T09:07:49.517530+0000","last_undegraded":"2024-04-25T09:07:49.517530+0000","last_fullsized":"2024-04-25T09:07:49.517530+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:48.737408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.532295+0000","last_change":"2024-04-25T09:07:48.508962+0000","last_active":"2024-04-25T09:07:49.532295+0000","last_peered":"2024-04-25T09:07:49.532295+0000","last_clean":"2024-04-25T09:07:49.532295+0000","last_became_active":"2024-04-25T09:07:48.508700+0000","last_became_peered":"2024-04-25T09:07:48.508700+0000","last_unstale":"2024-04-25T09:07:49.532295+0000","last_undegraded":"2024-04-25T09:07:49.532295+0000","last_fullsized":"2024-04-25T09:07:49.532295+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:03.766692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.535899+0000","last_change":"2024-04-25T09:07:49.530624+0000","last_active":"2024-04-25T09:07:49.535899+0000","last_peered":"2024-04-25T09:07:49.535899+0000","last_clean":"2024-04-25T09:07:49.535899+0000","last_became_active":"2024-04-25T09:07:49.530343+0000","last_became_peered":"2024-04-25T09:07:49.530343+0000","last_unstale":"2024-04-25T09:07:49.535899+0000","last_undegraded":"2024-04-25T09:07:49.535899+0000","last_fullsized":"2024-04-25T09:07:49.535899+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:25.010180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.505576+0000","last_change":"2024-04-25T09:07:48.506737+0000","last_active":"2024-04-25T09:07:49.505576+0000","last_peered":"2024-04-25T09:07:49.505576+0000","last_clean":"2024-04-25T09:07:49.505576+0000","last_became_active":"2024-04-25T09:07:48.506247+0000","last_became_peered":"2024-04-25T09:07:48.506247+0000","last_unstale":"2024-04-25T09:07:49.505576+0000","last_undegraded":"2024-04-25T09:07:49.505576+0000","last_fullsized":"2024-04-25T09:07:49.505576+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:16.294802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530635+0000","last_change":"2024-04-25T09:07:49.521014+0000","last_active":"2024-04-25T09:07:49.530635+0000","last_peered":"2024-04-25T09:07:49.530635+0000","last_clean":"2024-04-25T09:07:49.530635+0000","last_became_active":"2024-04-25T09:07:49.520729+0000","last_became_peered":"2024-04-25T09:07:49.520729+0000","last_unstale":"2024-04-25T09:07:49.530635+0000","last_undegraded":"2024-04-25T09:07:49.530635+0000","last_fullsized":"2024-04-25T09:07:49.530635+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:34.153710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.504650+0000","last_change":"2024-04-25T09:07:48.515539+0000","last_active":"2024-04-25T09:07:49.504650+0000","last_peered":"2024-04-25T09:07:49.504650+0000","last_clean":"2024-04-25T09:07:49.504650+0000","last_became_active":"2024-04-25T09:07:48.515178+0000","last_became_peered":"2024-04-25T09:07:48.515178+0000","last_unstale":"2024-04-25T09:07:49.504650+0000","last_undegraded":"2024-04-25T09:07:49.504650+0000","last_fullsized":"2024-04-25T09:07:49.504650+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:25.070718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.512324+0000","last_change":"2024-04-25T09:07:49.507502+0000","last_active":"2024-04-25T09:07:49.512324+0000","last_peered":"2024-04-25T09:07:49.512324+0000","last_clean":"2024-04-25T09:07:49.512324+0000","last_became_active":"2024-04-25T09:07:49.507158+0000","last_became_peered":"2024-04-25T09:07:49.507158+0000","last_unstale":"2024-04-25T09:07:49.512324+0000","last_undegraded":"2024-04-25T09:07:49.512324+0000","last_fullsized":"2024-04-25T09:07:49.512324+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:09.373865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.501902+0000","last_change":"2024-04-25T09:07:48.511894+0000","last_active":"2024-04-25T09:07:49.501902+0000","last_peered":"2024-04-25T09:07:49.501902+0000","last_clean":"2024-04-25T09:07:49.501902+0000","last_became_active":"2024-04-25T09:07:48.510486+0000","last_became_peered":"2024-04-25T09:07:48.510486+0000","last_unstale":"2024-04-25T09:07:49.501902+0000","last_undegraded":"2024-04-25T09:07:49.501902+0000","last_fullsized":"2024-04-25T09:07:49.501902+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:58.971192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.539152+0000","last_change":"2024-04-25T09:07:49.536341+0000","last_active":"2024-04-25T09:07:49.539152+0000","last_peered":"2024-04-25T09:07:49.539152+0000","last_clean":"2024-04-25T09:07:49.539152+0000","last_became_active":"2024-04-25T09:07:49.535906+0000","last_became_peered":"2024-04-25T09:07:49.535906+0000","last_unstale":"2024-04-25T09:07:49.539152+0000","last_undegraded":"2024-04-25T09:07:49.539152+0000","last_fullsized":"2024-04-25T09:07:49.539152+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:43.587933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.509900+0000","last_change":"2024-04-25T09:07:48.507232+0000","last_active":"2024-04-25T09:07:49.509900+0000","last_peered":"2024-04-25T09:07:49.509900+0000","last_clean":"2024-04-25T09:07:49.509900+0000","last_became_active":"2024-04-25T09:07:48.506892+0000","last_became_peered":"2024-04-25T09:07:48.506892+0000","last_unstale":"2024-04-25T09:07:49.509900+0000","last_undegraded":"2024-04-25T09:07:49.509900+0000","last_fullsized":"2024-04-25T09:07:49.509900+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:59.294976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530834+0000","last_change":"2024-04-25T09:07:49.522333+0000","last_active":"2024-04-25T09:07:49.530834+0000","last_peered":"2024-04-25T09:07:49.530834+0000","last_clean":"2024-04-25T09:07:49.530834+0000","last_became_active":"2024-04-25T09:07:49.522018+0000","last_became_peered":"2024-04-25T09:07:49.522018+0000","last_unstale":"2024-04-25T09:07:49.530834+0000","last_undegraded":"2024-04-25T09:07:49.530834+0000","last_fullsized":"2024-04-25T09:07:49.530834+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:02.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.498160+0000","last_change":"2024-04-25T09:07:48.505550+0000","last_active":"2024-04-25T09:07:49.498160+0000","last_peered":"2024-04-25T09:07:49.498160+0000","last_clean":"2024-04-25T09:07:49.498160+0000","last_became_active":"2024-04-25T09:07:48.505271+0000","last_became_peered":"2024-04-25T09:07:48.505271+0000","last_unstale":"2024-04-25T09:07:49.498160+0000","last_undegraded":"2024-04-25T09:07:49.498160+0000","last_fullsized":"2024-04-25T09:07:49.498160+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:33:34.713867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530593+0000","last_change":"2024-04-25T09:07:49.527507+0000","last_active":"2024-04-25T09:07:49.530593+0000","last_peered":"2024-04-25T09:07:49.530593+0000","last_clean":"2024-04-25T09:07:49.530593+0000","last_became_active":"2024-04-25T09:07:49.525198+0000","last_became_peered":"2024-04-25T09:07:49.525198+0000","last_unstale":"2024-04-25T09:07:49.530593+0000","last_undegraded":"2024-04-25T09:07:49.530593+0000","last_fullsized":"2024-04-25T09:07:49.530593+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:33:35.718245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.502068+0000","last_change":"2024-04-25T09:07:48.511110+0000","last_active":"2024-04-25T09:07:49.502068+0000","last_peered":"2024-04-25T09:07:49.502068+0000","last_clean":"2024-04-25T09:07:49.502068+0000","last_became_active":"2024-04-25T09:07:48.510822+0000","last_became_peered":"2024-04-25T09:07:48.510822+0000","last_unstale":"2024-04-25T09:07:49.502068+0000","last_undegraded":"2024-04-25T09:07:49.502068+0000","last_fullsized":"2024-04-25T09:07:49.502068+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:06.493700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.538612+0000","last_change":"2024-04-25T09:07:49.534282+0000","last_active":"2024-04-25T09:07:49.538612+0000","last_peered":"2024-04-25T09:07:49.538612+0000","last_clean":"2024-04-25T09:07:49.538612+0000","last_became_active":"2024-04-25T09:07:49.534041+0000","last_became_peered":"2024-04-25T09:07:49.534041+0000","last_unstale":"2024-04-25T09:07:49.538612+0000","last_undegraded":"2024-04-25T09:07:49.538612+0000","last_fullsized":"2024-04-25T09:07:49.538612+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:24.701016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.495623+0000","last_change":"2024-04-25T09:07:48.519794+0000","last_active":"2024-04-25T09:07:49.495623+0000","last_peered":"2024-04-25T09:07:49.495623+0000","last_clean":"2024-04-25T09:07:49.495623+0000","last_became_active":"2024-04-25T09:07:48.519533+0000","last_became_peered":"2024-04-25T09:07:48.519533+0000","last_unstale":"2024-04-25T09:07:49.495623+0000","last_undegraded":"2024-04-25T09:07:49.495623+0000","last_fullsized":"2024-04-25T09:07:49.495623+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:01.712917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.531976+0000","last_change":"2024-04-25T09:07:49.528554+0000","last_active":"2024-04-25T09:07:49.531976+0000","last_peered":"2024-04-25T09:07:49.531976+0000","last_clean":"2024-04-25T09:07:49.531976+0000","last_became_active":"2024-04-25T09:07:49.528281+0000","last_became_peered":"2024-04-25T09:07:49.528281+0000","last_unstale":"2024-04-25T09:07:49.531976+0000","last_undegraded":"2024-04-25T09:07:49.531976+0000","last_fullsized":"2024-04-25T09:07:49.531976+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:29.045023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.519198+0000","last_change":"2024-04-25T09:07:48.518426+0000","last_active":"2024-04-25T09:07:49.519198+0000","last_peered":"2024-04-25T09:07:49.519198+0000","last_clean":"2024-04-25T09:07:49.519198+0000","last_became_active":"2024-04-25T09:07:48.516401+0000","last_became_peered":"2024-04-25T09:07:48.516401+0000","last_unstale":"2024-04-25T09:07:49.519198+0000","last_undegraded":"2024-04-25T09:07:49.519198+0000","last_fullsized":"2024-04-25T09:07:49.519198+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:35.349893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":302,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.495873+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:07:49.495873+0000","last_peered":"2024-04-25T09:07:49.495873+0000","last_clean":"2024-04-25T09:07:49.495873+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:07:49.495873+0000","last_undegraded":"2024-04-25T09:07:49.495873+0000","last_fullsized":"2024-04-25T09:07:49.495873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32844,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338996,"statfs":{"total":96636764160,"available":96603131904,"internally_reserved":0,"allocated":1703936,"data_stored":1099884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1142784,"data_stored":518899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1110016,"data_stored":509516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1110016,"data_stored":509516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1110016,"data_stored":509516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1122304,"data_stored":516683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1110016,"data_stored":509516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1703936,"data_stored":1099884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:07:53.616 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:07:53.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.804+0000 7f6359a00640 1 Processor -- start 2024-04-25T09:07:53.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.804+0000 7f6359a00640 1 -- start start 2024-04-25T09:07:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f6359a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63540cef30 0x7f635406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f6359a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f635406e900 0x7f63540b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f6359a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635415ac60 con 0x7f6354144140 2024-04-25T09:07:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f6359a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f635406ed50 con 0x7f63540cef30 2024-04-25T09:07:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f6359a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63540cf3e0 con 0x7f635406e900 2024-04-25T09:07:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f6352a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6354144140 0x7f63540ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47168/0 (socket says 172.21.15.59:47168) 2024-04-25T09:07:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f6352a00640 1 -- 172.21.15.59:0/1524667586 learned_addr learned my addr 172.21.15.59:0/1524667586 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f634be00640 1 --2- 172.21.15.59:0/1524667586 >> v2:172.21.15.59:3300/0 conn(0x7f63540cef30 0x7f635406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f6353400640 1 --2- 172.21.15.59:0/1524667586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f635406e900 0x7f63540b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f6352000640 1 -- 172.21.15.59:0/1524667586 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962389679 0 0) 0x7f635415ac60 con 0x7f6354144140 2024-04-25T09:07:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f634be00640 1 -- 172.21.15.59:0/1524667586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f635406e900 msgr2=0x7f63540b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f634be00640 1 --2- 172.21.15.59:0/1524667586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f635406e900 0x7f63540b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f634be00640 1 -- 172.21.15.59:0/1524667586 >> v1:172.21.15.59:6789/0 conn(0x7f6354144140 legacy=0x7f63540ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.808+0000 7f634be00640 1 -- 172.21.15.59:0/1524667586 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635415af20 con 0x7f63540cef30 2024-04-25T09:07:53.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f634be00640 1 --2- 172.21.15.59:0/1524667586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63540cef30 0x7f635406e3c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f633c0097c0 tx=0x7f633c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99bef313a797e908 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6352000640 1 -- 172.21.15.59:0/1524667586 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0b0070 con 0x7f63540cef30 2024-04-25T09:07:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6352000640 1 -- 172.21.15.59:0/1524667586 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633c0ab600 con 0x7f63540cef30 2024-04-25T09:07:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6352000640 1 -- 172.21.15.59:0/1524667586 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633c0ab9d0 con 0x7f63540cef30 2024-04-25T09:07:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6359a00640 1 -- 172.21.15.59:0/1524667586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63540cef30 msgr2=0x7f635406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6359a00640 1 --2- 172.21.15.59:0/1524667586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63540cef30 0x7f635406e3c0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f633c0097c0 tx=0x7f633c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6359a00640 1 -- 172.21.15.59:0/1524667586 shutdown_connections 2024-04-25T09:07:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6359a00640 1 --2- 172.21.15.59:0/1524667586 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f635406e900 0x7f63540b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6359a00640 1 --2- 172.21.15.59:0/1524667586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63540cef30 0x7f635406e3c0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6359a00640 1 -- 172.21.15.59:0/1524667586 >> 172.21.15.59:0/1524667586 conn(0x7f6354066fa0 msgr2=0x7f635406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6359a00640 1 -- 172.21.15.59:0/1524667586 shutdown_connections 2024-04-25T09:07:53.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6359a00640 1 -- 172.21.15.59:0/1524667586 wait complete. 2024-04-25T09:07:53.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6359a00640 1 Processor -- start 2024-04-25T09:07:53.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.812+0000 7f6359a00640 1 -- start start 2024-04-25T09:07:53.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6359a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f635406e900 0x7f6354151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6359a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63540cef30 0x7f63540b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6359a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6354144140 0x7f635415e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6359a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635415ba00 con 0x7f6354144140 2024-04-25T09:07:53.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6359a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6354144520 con 0x7f635406e900 2024-04-25T09:07:53.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6359a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635415bb80 con 0x7f63540cef30 2024-04-25T09:07:53.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6353400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6354144140 0x7f635415e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6353400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6354144140 0x7f635415e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36406/0 (socket says 172.21.15.59:36406) 2024-04-25T09:07:53.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6353400640 1 -- 172.21.15.59:0/233484534 learned_addr learned my addr 172.21.15.59:0/233484534 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:53.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6352a00640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f635406e900 0x7f6354151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f634be00640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63540cef30 0x7f63540b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6353400640 1 -- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63540cef30 msgr2=0x7f63540b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6353400640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63540cef30 0x7f63540b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6353400640 1 -- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f635406e900 msgr2=0x7f6354151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6353400640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f635406e900 0x7f6354151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6353400640 1 -- 172.21.15.59:0/233484534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635413bd90 con 0x7f6354144140 2024-04-25T09:07:53.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6353400640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6354144140 0x7f635415e320 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f634c007e40 tx=0x7f634c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:53.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f634aa00640 1 -- 172.21.15.59:0/233484534 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c014620 con 0x7f6354144140 2024-04-25T09:07:53.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f634aa00640 1 -- 172.21.15.59:0/233484534 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634c019070 con 0x7f6354144140 2024-04-25T09:07:53.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f634aa00640 1 -- 172.21.15.59:0/233484534 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634c014a20 con 0x7f6354144140 2024-04-25T09:07:53.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6359a00640 1 -- 172.21.15.59:0/233484534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635413c070 con 0x7f6354144140 2024-04-25T09:07:53.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6359a00640 1 -- 172.21.15.59:0/233484534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635413c630 con 0x7f6354144140 2024-04-25T09:07:53.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f6359a00640 1 -- 172.21.15.59:0/233484534 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63540745d0 con 0x7f6354144140 2024-04-25T09:07:53.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.816+0000 7f634aa00640 1 -- 172.21.15.59:0/233484534 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f634c014bc0 con 0x7f6354144140 2024-04-25T09:07:53.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.820+0000 7f634aa00640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6330066f60 0x7f6330069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:53.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.820+0000 7f634aa00640 1 -- 172.21.15.59:0/233484534 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f634c085930 con 0x7f6354144140 2024-04-25T09:07:53.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.820+0000 7f6352a00640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6330066f60 0x7f6330069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:53.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.820+0000 7f6352a00640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6330066f60 0x7f6330069420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6344000f70 tx=0x7f6344007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:53.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.824+0000 7f634aa00640 1 -- 172.21.15.59:0/233484534 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f634c056160 con 0x7f6354144140 2024-04-25T09:07:53.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.980+0000 7f6359a00640 1 -- 172.21.15.59:0/233484534 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63540cea30 con 0x7f6330066f60 2024-04-25T09:07:53.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.988+0000 7f634aa00640 1 -- 172.21.15.59:0/233484534 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252004 (secure 0 0 0) 0x7f63540cea30 con 0x7f6330066f60 2024-04-25T09:07:53.978 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:53.979 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:07:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.988+0000 7f6359a00640 1 -- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6330066f60 msgr2=0x7f6330069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.988+0000 7f6359a00640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6330066f60 0x7f6330069420 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6344000f70 tx=0x7f6344007df0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.988+0000 7f6359a00640 1 -- 172.21.15.59:0/233484534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6354144140 msgr2=0x7f635415e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.988+0000 7f6359a00640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6354144140 0x7f635415e320 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f634c007e40 tx=0x7f634c00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.992+0000 7f6359a00640 1 -- 172.21.15.59:0/233484534 shutdown_connections 2024-04-25T09:07:53.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.992+0000 7f6359a00640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6330066f60 0x7f6330069420 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.992+0000 7f6359a00640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6354144140 0x7f635415e320 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.992+0000 7f6359a00640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63540cef30 0x7f63540b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.992+0000 7f6359a00640 1 --2- 172.21.15.59:0/233484534 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f635406e900 0x7f6354151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.992+0000 7f6359a00640 1 -- 172.21.15.59:0/233484534 >> 172.21.15.59:0/233484534 conn(0x7f6354066fa0 msgr2=0x7f635406e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.992+0000 7f6359a00640 1 -- 172.21.15.59:0/233484534 shutdown_connections 2024-04-25T09:07:53.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:53.992+0000 7f6359a00640 1 -- 172.21.15.59:0/233484534 wait complete. 2024-04-25T09:07:53.998 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-04-25T09:07:53.745384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":49,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259352,"kb_used_data":9876,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715368,"statfs":{"total":773094113280,"available":772828536832,"internally_reserved":0,"allocated":10113024,"data_stored":5273414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001537"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.534392+0000","last_change":"2024-04-25T09:07:49.530148+0000","last_active":"2024-04-25T09:07:49.534392+0000","last_peered":"2024-04-25T09:07:49.534392+0000","last_clean":"2024-04-25T09:07:49.534392+0000","last_became_active":"2024-04-25T09:07:49.529862+0000","last_became_peered":"2024-04-25T09:07:49.529862+0000","last_unstale":"2024-04-25T09:07:49.534392+0000","last_undegraded":"2024-04-25T09:07:49.534392+0000","last_fullsized":"2024-04-25T09:07:49.534392+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:30.461365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.531635+0000","last_change":"2024-04-25T09:07:49.527914+0000","last_active":"2024-04-25T09:07:49.531635+0000","last_peered":"2024-04-25T09:07:49.531635+0000","last_clean":"2024-04-25T09:07:49.531635+0000","last_became_active":"2024-04-25T09:07:49.527624+0000","last_became_peered":"2024-04-25T09:07:49.527624+0000","last_unstale":"2024-04-25T09:07:49.531635+0000","last_undegraded":"2024-04-25T09:07:49.531635+0000","last_fullsized":"2024-04-25T09:07:49.531635+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:30.461365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530312+0000","last_change":"2024-04-25T09:07:49.513784+0000","last_active":"2024-04-25T09:07:49.530312+0000","last_peered":"2024-04-25T09:07:49.530312+0000","last_clean":"2024-04-25T09:07:49.530312+0000","last_became_active":"2024-04-25T09:07:49.513386+0000","last_became_peered":"2024-04-25T09:07:49.513386+0000","last_unstale":"2024-04-25T09:07:49.530312+0000","last_undegraded":"2024-04-25T09:07:49.530312+0000","last_fullsized":"2024-04-25T09:07:49.530312+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:07.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.526560+0000","last_change":"2024-04-25T09:07:49.520267+0000","last_active":"2024-04-25T09:07:49.526560+0000","last_peered":"2024-04-25T09:07:49.526560+0000","last_clean":"2024-04-25T09:07:49.526560+0000","last_became_active":"2024-04-25T09:07:49.520007+0000","last_became_peered":"2024-04-25T09:07:49.520007+0000","last_unstale":"2024-04-25T09:07:49.526560+0000","last_undegraded":"2024-04-25T09:07:49.526560+0000","last_fullsized":"2024-04-25T09:07:49.526560+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:04.832515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.509735+0000","last_change":"2024-04-25T09:07:49.508773+0000","last_active":"2024-04-25T09:07:49.509735+0000","last_peered":"2024-04-25T09:07:49.509735+0000","last_clean":"2024-04-25T09:07:49.509735+0000","last_became_active":"2024-04-25T09:07:49.508295+0000","last_became_peered":"2024-04-25T09:07:49.508295+0000","last_unstale":"2024-04-25T09:07:49.509735+0000","last_undegraded":"2024-04-25T09:07:49.509735+0000","last_fullsized":"2024-04-25T09:07:49.509735+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:11:19.058368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.540986+0000","last_change":"2024-04-25T09:07:49.538394+0000","last_active":"2024-04-25T09:07:49.540986+0000","last_peered":"2024-04-25T09:07:49.540986+0000","last_clean":"2024-04-25T09:07:49.540986+0000","last_became_active":"2024-04-25T09:07:49.537860+0000","last_became_peered":"2024-04-25T09:07:49.537860+0000","last_unstale":"2024-04-25T09:07:49.540986+0000","last_undegraded":"2024-04-25T09:07:49.540986+0000","last_fullsized":"2024-04-25T09:07:49.540986+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:53.099689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.529277+0000","last_change":"2024-04-25T09:07:49.523751+0000","last_active":"2024-04-25T09:07:49.529277+0000","last_peered":"2024-04-25T09:07:49.529277+0000","last_clean":"2024-04-25T09:07:49.529277+0000","last_became_active":"2024-04-25T09:07:49.523340+0000","last_became_peered":"2024-04-25T09:07:49.523340+0000","last_unstale":"2024-04-25T09:07:49.529277+0000","last_undegraded":"2024-04-25T09:07:49.529277+0000","last_fullsized":"2024-04-25T09:07:49.529277+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:25.010180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530008+0000","last_change":"2024-04-25T09:07:49.513600+0000","last_active":"2024-04-25T09:07:49.530008+0000","last_peered":"2024-04-25T09:07:49.530008+0000","last_clean":"2024-04-25T09:07:49.530008+0000","last_became_active":"2024-04-25T09:07:49.513345+0000","last_became_peered":"2024-04-25T09:07:49.513345+0000","last_unstale":"2024-04-25T09:07:49.530008+0000","last_undegraded":"2024-04-25T09:07:49.530008+0000","last_fullsized":"2024-04-25T09:07:49.530008+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:17.739224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.518080+0000","last_change":"2024-04-25T09:07:49.513357+0000","last_active":"2024-04-25T09:07:49.518080+0000","last_peered":"2024-04-25T09:07:49.518080+0000","last_clean":"2024-04-25T09:07:49.518080+0000","last_became_active":"2024-04-25T09:07:49.511358+0000","last_became_peered":"2024-04-25T09:07:49.511358+0000","last_unstale":"2024-04-25T09:07:49.518080+0000","last_undegraded":"2024-04-25T09:07:49.518080+0000","last_fullsized":"2024-04-25T09:07:49.518080+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:22.335096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.524589+0000","last_change":"2024-04-25T09:07:49.520530+0000","last_active":"2024-04-25T09:07:49.524589+0000","last_peered":"2024-04-25T09:07:49.524589+0000","last_clean":"2024-04-25T09:07:49.524589+0000","last_became_active":"2024-04-25T09:07:49.520243+0000","last_became_peered":"2024-04-25T09:07:49.520243+0000","last_unstale":"2024-04-25T09:07:49.524589+0000","last_undegraded":"2024-04-25T09:07:49.524589+0000","last_fullsized":"2024-04-25T09:07:49.524589+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:00:58.786067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530029+0000","last_change":"2024-04-25T09:07:49.526378+0000","last_active":"2024-04-25T09:07:49.530029+0000","last_peered":"2024-04-25T09:07:49.530029+0000","last_clean":"2024-04-25T09:07:49.530029+0000","last_became_active":"2024-04-25T09:07:49.526113+0000","last_became_peered":"2024-04-25T09:07:49.526113+0000","last_unstale":"2024-04-25T09:07:49.530029+0000","last_undegraded":"2024-04-25T09:07:49.530029+0000","last_fullsized":"2024-04-25T09:07:49.530029+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:21.779492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.519128+0000","last_change":"2024-04-25T09:07:49.516146+0000","last_active":"2024-04-25T09:07:49.519128+0000","last_peered":"2024-04-25T09:07:49.519128+0000","last_clean":"2024-04-25T09:07:49.519128+0000","last_became_active":"2024-04-25T09:07:49.515879+0000","last_became_peered":"2024-04-25T09:07:49.515879+0000","last_unstale":"2024-04-25T09:07:49.519128+0000","last_undegraded":"2024-04-25T09:07:49.519128+0000","last_fullsized":"2024-04-25T09:07:49.519128+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:40:52.817963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.526613+0000","last_change":"2024-04-25T09:07:49.518716+0000","last_active":"2024-04-25T09:07:49.526613+0000","last_peered":"2024-04-25T09:07:49.526613+0000","last_clean":"2024-04-25T09:07:49.526613+0000","last_became_active":"2024-04-25T09:07:49.513903+0000","last_became_peered":"2024-04-25T09:07:49.513903+0000","last_unstale":"2024-04-25T09:07:49.526613+0000","last_undegraded":"2024-04-25T09:07:49.526613+0000","last_fullsized":"2024-04-25T09:07:49.526613+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:31.372132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.532031+0000","last_change":"2024-04-25T09:07:49.530483+0000","last_active":"2024-04-25T09:07:49.532031+0000","last_peered":"2024-04-25T09:07:49.532031+0000","last_clean":"2024-04-25T09:07:49.532031+0000","last_became_active":"2024-04-25T09:07:49.530142+0000","last_became_peered":"2024-04-25T09:07:49.530142+0000","last_unstale":"2024-04-25T09:07:49.532031+0000","last_undegraded":"2024-04-25T09:07:49.532031+0000","last_fullsized":"2024-04-25T09:07:49.532031+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:44.136753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530766+0000","last_change":"2024-04-25T09:07:49.526257+0000","last_active":"2024-04-25T09:07:49.530766+0000","last_peered":"2024-04-25T09:07:49.530766+0000","last_clean":"2024-04-25T09:07:49.530766+0000","last_became_active":"2024-04-25T09:07:49.525989+0000","last_became_peered":"2024-04-25T09:07:49.525989+0000","last_unstale":"2024-04-25T09:07:49.530766+0000","last_undegraded":"2024-04-25T09:07:49.530766+0000","last_fullsized":"2024-04-25T09:07:49.530766+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:59.975570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.536674+0000","last_change":"2024-04-25T09:07:49.532422+0000","last_active":"2024-04-25T09:07:49.536674+0000","last_peered":"2024-04-25T09:07:49.536674+0000","last_clean":"2024-04-25T09:07:49.536674+0000","last_became_active":"2024-04-25T09:07:49.531778+0000","last_became_peered":"2024-04-25T09:07:49.531778+0000","last_unstale":"2024-04-25T09:07:49.536674+0000","last_undegraded":"2024-04-25T09:07:49.536674+0000","last_fullsized":"2024-04-25T09:07:49.536674+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:29.045023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.539396+0000","last_change":"2024-04-25T09:07:49.533552+0000","last_active":"2024-04-25T09:07:49.539396+0000","last_peered":"2024-04-25T09:07:49.539396+0000","last_clean":"2024-04-25T09:07:49.539396+0000","last_became_active":"2024-04-25T09:07:49.533293+0000","last_became_peered":"2024-04-25T09:07:49.533293+0000","last_unstale":"2024-04-25T09:07:49.539396+0000","last_undegraded":"2024-04-25T09:07:49.539396+0000","last_fullsized":"2024-04-25T09:07:49.539396+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:45.644042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530423+0000","last_change":"2024-04-25T09:07:49.514347+0000","last_active":"2024-04-25T09:07:49.530423+0000","last_peered":"2024-04-25T09:07:49.530423+0000","last_clean":"2024-04-25T09:07:49.530423+0000","last_became_active":"2024-04-25T09:07:49.514084+0000","last_became_peered":"2024-04-25T09:07:49.514084+0000","last_unstale":"2024-04-25T09:07:49.530423+0000","last_undegraded":"2024-04-25T09:07:49.530423+0000","last_fullsized":"2024-04-25T09:07:49.530423+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:59.883717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.519218+0000","last_change":"2024-04-25T09:07:49.515104+0000","last_active":"2024-04-25T09:07:49.519218+0000","last_peered":"2024-04-25T09:07:49.519218+0000","last_clean":"2024-04-25T09:07:49.519218+0000","last_became_active":"2024-04-25T09:07:49.514788+0000","last_became_peered":"2024-04-25T09:07:49.514788+0000","last_unstale":"2024-04-25T09:07:49.519218+0000","last_undegraded":"2024-04-25T09:07:49.519218+0000","last_fullsized":"2024-04-25T09:07:49.519218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:43.697102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.536481+0000","last_change":"2024-04-25T09:07:49.528873+0000","last_active":"2024-04-25T09:07:49.536481+0000","last_peered":"2024-04-25T09:07:49.536481+0000","last_clean":"2024-04-25T09:07:49.536481+0000","last_became_active":"2024-04-25T09:07:49.528438+0000","last_became_peered":"2024-04-25T09:07:49.528438+0000","last_unstale":"2024-04-25T09:07:49.536481+0000","last_undegraded":"2024-04-25T09:07:49.536481+0000","last_fullsized":"2024-04-25T09:07:49.536481+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:29.822650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.518001+0000","last_change":"2024-04-25T09:07:49.511198+0000","last_active":"2024-04-25T09:07:49.518001+0000","last_peered":"2024-04-25T09:07:49.518001+0000","last_clean":"2024-04-25T09:07:49.518001+0000","last_became_active":"2024-04-25T09:07:49.510842+0000","last_became_peered":"2024-04-25T09:07:49.510842+0000","last_unstale":"2024-04-25T09:07:49.518001+0000","last_undegraded":"2024-04-25T09:07:49.518001+0000","last_fullsized":"2024-04-25T09:07:49.518001+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:46.062819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.525812+0000","last_change":"2024-04-25T09:07:49.524429+0000","last_active":"2024-04-25T09:07:49.525812+0000","last_peered":"2024-04-25T09:07:49.525812+0000","last_clean":"2024-04-25T09:07:49.525812+0000","last_became_active":"2024-04-25T09:07:49.524145+0000","last_became_peered":"2024-04-25T09:07:49.524145+0000","last_unstale":"2024-04-25T09:07:49.525812+0000","last_undegraded":"2024-04-25T09:07:49.525812+0000","last_fullsized":"2024-04-25T09:07:49.525812+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:05.770370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.531157+0000","last_change":"2024-04-25T09:07:49.529984+0000","last_active":"2024-04-25T09:07:49.531157+0000","last_peered":"2024-04-25T09:07:49.531157+0000","last_clean":"2024-04-25T09:07:49.531157+0000","last_became_active":"2024-04-25T09:07:49.529676+0000","last_became_peered":"2024-04-25T09:07:49.529676+0000","last_unstale":"2024-04-25T09:07:49.531157+0000","last_undegraded":"2024-04-25T09:07:49.531157+0000","last_fullsized":"2024-04-25T09:07:49.531157+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:30.442123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530485+0000","last_change":"2024-04-25T09:07:49.513633+0000","last_active":"2024-04-25T09:07:49.530485+0000","last_peered":"2024-04-25T09:07:49.530485+0000","last_clean":"2024-04-25T09:07:49.530485+0000","last_became_active":"2024-04-25T09:07:49.513269+0000","last_became_peered":"2024-04-25T09:07:49.513269+0000","last_unstale":"2024-04-25T09:07:49.530485+0000","last_undegraded":"2024-04-25T09:07:49.530485+0000","last_fullsized":"2024-04-25T09:07:49.530485+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:09.373865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.518975+0000","last_change":"2024-04-25T09:07:49.512142+0000","last_active":"2024-04-25T09:07:49.518975+0000","last_peered":"2024-04-25T09:07:49.518975+0000","last_clean":"2024-04-25T09:07:49.518975+0000","last_became_active":"2024-04-25T09:07:49.511742+0000","last_became_peered":"2024-04-25T09:07:49.511742+0000","last_unstale":"2024-04-25T09:07:49.518975+0000","last_undegraded":"2024-04-25T09:07:49.518975+0000","last_fullsized":"2024-04-25T09:07:49.518975+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:00:07.036134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.527765+0000","last_change":"2024-04-25T09:07:49.524659+0000","last_active":"2024-04-25T09:07:49.527765+0000","last_peered":"2024-04-25T09:07:49.527765+0000","last_clean":"2024-04-25T09:07:49.527765+0000","last_became_active":"2024-04-25T09:07:49.524292+0000","last_became_peered":"2024-04-25T09:07:49.524292+0000","last_unstale":"2024-04-25T09:07:49.527765+0000","last_undegraded":"2024-04-25T09:07:49.527765+0000","last_fullsized":"2024-04-25T09:07:49.527765+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:17.739224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.515180+0000","last_change":"2024-04-25T09:07:49.509072+0000","last_active":"2024-04-25T09:07:49.515180+0000","last_peered":"2024-04-25T09:07:49.515180+0000","last_clean":"2024-04-25T09:07:49.515180+0000","last_became_active":"2024-04-25T09:07:49.508756+0000","last_became_peered":"2024-04-25T09:07:49.508756+0000","last_unstale":"2024-04-25T09:07:49.515180+0000","last_undegraded":"2024-04-25T09:07:49.515180+0000","last_fullsized":"2024-04-25T09:07:49.515180+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:44.364610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.526539+0000","last_change":"2024-04-25T09:07:49.519665+0000","last_active":"2024-04-25T09:07:49.526539+0000","last_peered":"2024-04-25T09:07:49.526539+0000","last_clean":"2024-04-25T09:07:49.526539+0000","last_became_active":"2024-04-25T09:07:49.519396+0000","last_became_peered":"2024-04-25T09:07:49.519396+0000","last_unstale":"2024-04-25T09:07:49.526539+0000","last_undegraded":"2024-04-25T09:07:49.526539+0000","last_fullsized":"2024-04-25T09:07:49.526539+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:39:16.879433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.512535+0000","last_change":"2024-04-25T09:07:49.509762+0000","last_active":"2024-04-25T09:07:49.512535+0000","last_peered":"2024-04-25T09:07:49.512535+0000","last_clean":"2024-04-25T09:07:49.512535+0000","last_became_active":"2024-04-25T09:07:49.509465+0000","last_became_peered":"2024-04-25T09:07:49.509465+0000","last_unstale":"2024-04-25T09:07:49.512535+0000","last_undegraded":"2024-04-25T09:07:49.512535+0000","last_fullsized":"2024-04-25T09:07:49.512535+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:34.153710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.518021+0000","last_change":"2024-04-25T09:07:49.511610+0000","last_active":"2024-04-25T09:07:49.518021+0000","last_peered":"2024-04-25T09:07:49.518021+0000","last_clean":"2024-04-25T09:07:49.518021+0000","last_became_active":"2024-04-25T09:07:49.511100+0000","last_became_peered":"2024-04-25T09:07:49.511100+0000","last_unstale":"2024-04-25T09:07:49.518021+0000","last_undegraded":"2024-04-25T09:07:49.518021+0000","last_fullsized":"2024-04-25T09:07:49.518021+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:47.813212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.518201+0000","last_change":"2024-04-25T09:07:49.517094+0000","last_active":"2024-04-25T09:07:49.518201+0000","last_peered":"2024-04-25T09:07:49.518201+0000","last_clean":"2024-04-25T09:07:49.518201+0000","last_became_active":"2024-04-25T09:07:49.516761+0000","last_became_peered":"2024-04-25T09:07:49.516761+0000","last_unstale":"2024-04-25T09:07:49.518201+0000","last_undegraded":"2024-04-25T09:07:49.518201+0000","last_fullsized":"2024-04-25T09:07:49.518201+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:42:59.883717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.536698+0000","last_change":"2024-04-25T09:07:49.532679+0000","last_active":"2024-04-25T09:07:49.536698+0000","last_peered":"2024-04-25T09:07:49.536698+0000","last_clean":"2024-04-25T09:07:49.536698+0000","last_became_active":"2024-04-25T09:07:49.532101+0000","last_became_peered":"2024-04-25T09:07:49.532101+0000","last_unstale":"2024-04-25T09:07:49.536698+0000","last_undegraded":"2024-04-25T09:07:49.536698+0000","last_fullsized":"2024-04-25T09:07:49.536698+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:54.268664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.535272+0000","last_change":"2024-04-25T09:07:49.524680+0000","last_active":"2024-04-25T09:07:49.535272+0000","last_peered":"2024-04-25T09:07:49.535272+0000","last_clean":"2024-04-25T09:07:49.535272+0000","last_became_active":"2024-04-25T09:07:49.524013+0000","last_became_peered":"2024-04-25T09:07:49.524013+0000","last_unstale":"2024-04-25T09:07:49.535272+0000","last_undegraded":"2024-04-25T09:07:49.535272+0000","last_fullsized":"2024-04-25T09:07:49.535272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:11.755393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"91'4","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.537354+0000","last_change":"2024-04-25T09:07:48.511822+0000","last_active":"2024-04-25T09:07:49.537354+0000","last_peered":"2024-04-25T09:07:49.537354+0000","last_clean":"2024-04-25T09:07:49.537354+0000","last_became_active":"2024-04-25T09:07:48.511480+0000","last_became_peered":"2024-04-25T09:07:48.511480+0000","last_unstale":"2024-04-25T09:07:49.537354+0000","last_undegraded":"2024-04-25T09:07:49.537354+0000","last_fullsized":"2024-04-25T09:07:49.537354+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:12:03.828137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.539440+0000","last_change":"2024-04-25T09:07:49.535987+0000","last_active":"2024-04-25T09:07:49.539440+0000","last_peered":"2024-04-25T09:07:49.539440+0000","last_clean":"2024-04-25T09:07:49.539440+0000","last_became_active":"2024-04-25T09:07:49.535560+0000","last_became_peered":"2024-04-25T09:07:49.535560+0000","last_unstale":"2024-04-25T09:07:49.539440+0000","last_undegraded":"2024-04-25T09:07:49.539440+0000","last_fullsized":"2024-04-25T09:07:49.539440+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:37.160036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.519094+0000","last_change":"2024-04-25T09:07:48.506507+0000","last_active":"2024-04-25T09:07:49.519094+0000","last_peered":"2024-04-25T09:07:49.519094+0000","last_clean":"2024-04-25T09:07:49.519094+0000","last_became_active":"2024-04-25T09:07:48.505879+0000","last_became_peered":"2024-04-25T09:07:48.505879+0000","last_unstale":"2024-04-25T09:07:49.519094+0000","last_undegraded":"2024-04-25T09:07:49.519094+0000","last_fullsized":"2024-04-25T09:07:49.519094+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:03:40.819772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.529602+0000","last_change":"2024-04-25T09:07:49.524687+0000","last_active":"2024-04-25T09:07:49.529602+0000","last_peered":"2024-04-25T09:07:49.529602+0000","last_clean":"2024-04-25T09:07:49.529602+0000","last_became_active":"2024-04-25T09:07:49.524425+0000","last_became_peered":"2024-04-25T09:07:49.524425+0000","last_unstale":"2024-04-25T09:07:49.529602+0000","last_undegraded":"2024-04-25T09:07:49.529602+0000","last_fullsized":"2024-04-25T09:07:49.529602+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:12.345289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.532197+0000","last_change":"2024-04-25T09:07:48.516912+0000","last_active":"2024-04-25T09:07:49.532197+0000","last_peered":"2024-04-25T09:07:49.532197+0000","last_clean":"2024-04-25T09:07:49.532197+0000","last_became_active":"2024-04-25T09:07:48.516555+0000","last_became_peered":"2024-04-25T09:07:48.516555+0000","last_unstale":"2024-04-25T09:07:49.532197+0000","last_undegraded":"2024-04-25T09:07:49.532197+0000","last_fullsized":"2024-04-25T09:07:49.532197+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:59.294976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.522670+0000","last_change":"2024-04-25T09:07:49.515345+0000","last_active":"2024-04-25T09:07:49.522670+0000","last_peered":"2024-04-25T09:07:49.522670+0000","last_clean":"2024-04-25T09:07:49.522670+0000","last_became_active":"2024-04-25T09:07:49.515009+0000","last_became_peered":"2024-04-25T09:07:49.515009+0000","last_unstale":"2024-04-25T09:07:49.522670+0000","last_undegraded":"2024-04-25T09:07:49.522670+0000","last_fullsized":"2024-04-25T09:07:49.522670+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:04.771069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.538231+0000","last_change":"2024-04-25T09:07:48.521211+0000","last_active":"2024-04-25T09:07:49.538231+0000","last_peered":"2024-04-25T09:07:49.538231+0000","last_clean":"2024-04-25T09:07:49.538231+0000","last_became_active":"2024-04-25T09:07:48.520919+0000","last_became_peered":"2024-04-25T09:07:48.520919+0000","last_unstale":"2024-04-25T09:07:49.538231+0000","last_undegraded":"2024-04-25T09:07:49.538231+0000","last_fullsized":"2024-04-25T09:07:49.538231+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:35.839422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.533372+0000","last_change":"2024-04-25T09:07:49.528078+0000","last_active":"2024-04-25T09:07:49.533372+0000","last_peered":"2024-04-25T09:07:49.533372+0000","last_clean":"2024-04-25T09:07:49.533372+0000","last_became_active":"2024-04-25T09:07:49.527817+0000","last_became_peered":"2024-04-25T09:07:49.527817+0000","last_unstale":"2024-04-25T09:07:49.533372+0000","last_undegraded":"2024-04-25T09:07:49.533372+0000","last_fullsized":"2024-04-25T09:07:49.533372+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:07.498078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.521550+0000","last_change":"2024-04-25T09:07:48.521487+0000","last_active":"2024-04-25T09:07:49.521550+0000","last_peered":"2024-04-25T09:07:49.521550+0000","last_clean":"2024-04-25T09:07:49.521550+0000","last_became_active":"2024-04-25T09:07:48.521169+0000","last_became_peered":"2024-04-25T09:07:48.521169+0000","last_unstale":"2024-04-25T09:07:49.521550+0000","last_undegraded":"2024-04-25T09:07:49.521550+0000","last_fullsized":"2024-04-25T09:07:49.521550+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:21.131982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.519893+0000","last_change":"2024-04-25T09:07:49.518670+0000","last_active":"2024-04-25T09:07:49.519893+0000","last_peered":"2024-04-25T09:07:49.519893+0000","last_clean":"2024-04-25T09:07:49.519893+0000","last_became_active":"2024-04-25T09:07:49.518382+0000","last_became_peered":"2024-04-25T09:07:49.518382+0000","last_unstale":"2024-04-25T09:07:49.519893+0000","last_undegraded":"2024-04-25T09:07:49.519893+0000","last_fullsized":"2024-04-25T09:07:49.519893+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:40.914814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.537457+0000","last_change":"2024-04-25T09:07:48.516053+0000","last_active":"2024-04-25T09:07:49.537457+0000","last_peered":"2024-04-25T09:07:49.537457+0000","last_clean":"2024-04-25T09:07:49.537457+0000","last_became_active":"2024-04-25T09:07:48.515398+0000","last_became_peered":"2024-04-25T09:07:48.515398+0000","last_unstale":"2024-04-25T09:07:49.537457+0000","last_undegraded":"2024-04-25T09:07:49.537457+0000","last_fullsized":"2024-04-25T09:07:49.537457+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:09:43.132375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.541678+0000","last_change":"2024-04-25T09:07:49.540666+0000","last_active":"2024-04-25T09:07:49.541678+0000","last_peered":"2024-04-25T09:07:49.541678+0000","last_clean":"2024-04-25T09:07:49.541678+0000","last_became_active":"2024-04-25T09:07:49.540378+0000","last_became_peered":"2024-04-25T09:07:49.540378+0000","last_unstale":"2024-04-25T09:07:49.541678+0000","last_undegraded":"2024-04-25T09:07:49.541678+0000","last_fullsized":"2024-04-25T09:07:49.541678+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:35:53.511831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.502629+0000","last_change":"2024-04-25T09:07:48.507509+0000","last_active":"2024-04-25T09:07:49.502629+0000","last_peered":"2024-04-25T09:07:49.502629+0000","last_clean":"2024-04-25T09:07:49.502629+0000","last_became_active":"2024-04-25T09:07:48.507240+0000","last_became_peered":"2024-04-25T09:07:48.507240+0000","last_unstale":"2024-04-25T09:07:49.502629+0000","last_undegraded":"2024-04-25T09:07:49.502629+0000","last_fullsized":"2024-04-25T09:07:49.502629+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:29.437745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.526594+0000","last_change":"2024-04-25T09:07:49.512322+0000","last_active":"2024-04-25T09:07:49.526594+0000","last_peered":"2024-04-25T09:07:49.526594+0000","last_clean":"2024-04-25T09:07:49.526594+0000","last_became_active":"2024-04-25T09:07:49.512001+0000","last_became_peered":"2024-04-25T09:07:49.512001+0000","last_unstale":"2024-04-25T09:07:49.526594+0000","last_undegraded":"2024-04-25T09:07:49.526594+0000","last_fullsized":"2024-04-25T09:07:49.526594+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:21.779492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.495621+0000","last_change":"2024-04-25T09:07:48.521324+0000","last_active":"2024-04-25T09:07:49.495621+0000","last_peered":"2024-04-25T09:07:49.495621+0000","last_clean":"2024-04-25T09:07:49.495621+0000","last_became_active":"2024-04-25T09:07:48.520780+0000","last_became_peered":"2024-04-25T09:07:48.520780+0000","last_unstale":"2024-04-25T09:07:49.495621+0000","last_undegraded":"2024-04-25T09:07:49.495621+0000","last_fullsized":"2024-04-25T09:07:49.495621+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:34.850196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.522337+0000","last_change":"2024-04-25T09:07:49.521770+0000","last_active":"2024-04-25T09:07:49.522337+0000","last_peered":"2024-04-25T09:07:49.522337+0000","last_clean":"2024-04-25T09:07:49.522337+0000","last_became_active":"2024-04-25T09:07:49.521401+0000","last_became_peered":"2024-04-25T09:07:49.521401+0000","last_unstale":"2024-04-25T09:07:49.522337+0000","last_undegraded":"2024-04-25T09:07:49.522337+0000","last_fullsized":"2024-04-25T09:07:49.522337+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:26.672319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.498472+0000","last_change":"2024-04-25T09:07:48.514945+0000","last_active":"2024-04-25T09:07:49.498472+0000","last_peered":"2024-04-25T09:07:49.498472+0000","last_clean":"2024-04-25T09:07:49.498472+0000","last_became_active":"2024-04-25T09:07:48.514663+0000","last_became_peered":"2024-04-25T09:07:48.514663+0000","last_unstale":"2024-04-25T09:07:49.498472+0000","last_undegraded":"2024-04-25T09:07:49.498472+0000","last_fullsized":"2024-04-25T09:07:49.498472+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:21.285004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.512321+0000","last_change":"2024-04-25T09:07:49.510069+0000","last_active":"2024-04-25T09:07:49.512321+0000","last_peered":"2024-04-25T09:07:49.512321+0000","last_clean":"2024-04-25T09:07:49.512321+0000","last_became_active":"2024-04-25T09:07:49.507935+0000","last_became_peered":"2024-04-25T09:07:49.507935+0000","last_unstale":"2024-04-25T09:07:49.512321+0000","last_undegraded":"2024-04-25T09:07:49.512321+0000","last_fullsized":"2024-04-25T09:07:49.512321+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:22:11.755393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.507859+0000","last_change":"2024-04-25T09:07:48.518568+0000","last_active":"2024-04-25T09:07:49.507859+0000","last_peered":"2024-04-25T09:07:49.507859+0000","last_clean":"2024-04-25T09:07:49.507859+0000","last_became_active":"2024-04-25T09:07:48.518269+0000","last_became_peered":"2024-04-25T09:07:48.518269+0000","last_unstale":"2024-04-25T09:07:49.507859+0000","last_undegraded":"2024-04-25T09:07:49.507859+0000","last_fullsized":"2024-04-25T09:07:49.507859+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:21.285004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.531023+0000","last_change":"2024-04-25T09:07:49.523862+0000","last_active":"2024-04-25T09:07:49.531023+0000","last_peered":"2024-04-25T09:07:49.531023+0000","last_clean":"2024-04-25T09:07:49.531023+0000","last_became_active":"2024-04-25T09:07:49.523587+0000","last_became_peered":"2024-04-25T09:07:49.523587+0000","last_unstale":"2024-04-25T09:07:49.531023+0000","last_undegraded":"2024-04-25T09:07:49.531023+0000","last_fullsized":"2024-04-25T09:07:49.531023+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:35.854574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"91'3","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.540681+0000","last_change":"2024-04-25T09:07:48.517890+0000","last_active":"2024-04-25T09:07:49.540681+0000","last_peered":"2024-04-25T09:07:49.540681+0000","last_clean":"2024-04-25T09:07:49.540681+0000","last_became_active":"2024-04-25T09:07:48.517549+0000","last_became_peered":"2024-04-25T09:07:48.517549+0000","last_unstale":"2024-04-25T09:07:49.540681+0000","last_undegraded":"2024-04-25T09:07:49.540681+0000","last_fullsized":"2024-04-25T09:07:49.540681+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:28.850910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.527337+0000","last_change":"2024-04-25T09:07:49.523162+0000","last_active":"2024-04-25T09:07:49.527337+0000","last_peered":"2024-04-25T09:07:49.527337+0000","last_clean":"2024-04-25T09:07:49.527337+0000","last_became_active":"2024-04-25T09:07:49.522870+0000","last_became_peered":"2024-04-25T09:07:49.522870+0000","last_unstale":"2024-04-25T09:07:49.527337+0000","last_undegraded":"2024-04-25T09:07:49.527337+0000","last_fullsized":"2024-04-25T09:07:49.527337+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:36.843799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"91'6","reported_seq":18,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.542613+0000","last_change":"2024-04-25T09:07:48.513607+0000","last_active":"2024-04-25T09:07:49.542613+0000","last_peered":"2024-04-25T09:07:49.542613+0000","last_clean":"2024-04-25T09:07:49.542613+0000","last_became_active":"2024-04-25T09:07:48.513321+0000","last_became_peered":"2024-04-25T09:07:48.513321+0000","last_unstale":"2024-04-25T09:07:49.542613+0000","last_undegraded":"2024-04-25T09:07:49.542613+0000","last_fullsized":"2024-04-25T09:07:49.542613+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:34.850196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.529988+0000","last_change":"2024-04-25T09:07:49.512320+0000","last_active":"2024-04-25T09:07:49.529988+0000","last_peered":"2024-04-25T09:07:49.529988+0000","last_clean":"2024-04-25T09:07:49.529988+0000","last_became_active":"2024-04-25T09:07:49.511956+0000","last_became_peered":"2024-04-25T09:07:49.511956+0000","last_unstale":"2024-04-25T09:07:49.529988+0000","last_undegraded":"2024-04-25T09:07:49.529988+0000","last_fullsized":"2024-04-25T09:07:49.529988+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:26.672319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.540478+0000","last_change":"2024-04-25T09:07:48.517726+0000","last_active":"2024-04-25T09:07:49.540478+0000","last_peered":"2024-04-25T09:07:49.540478+0000","last_clean":"2024-04-25T09:07:49.540478+0000","last_became_active":"2024-04-25T09:07:48.517391+0000","last_became_peered":"2024-04-25T09:07:48.517391+0000","last_unstale":"2024-04-25T09:07:49.540478+0000","last_undegraded":"2024-04-25T09:07:49.540478+0000","last_fullsized":"2024-04-25T09:07:49.540478+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:29.456988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.517917+0000","last_change":"2024-04-25T09:07:49.511339+0000","last_active":"2024-04-25T09:07:49.517917+0000","last_peered":"2024-04-25T09:07:49.517917+0000","last_clean":"2024-04-25T09:07:49.517917+0000","last_became_active":"2024-04-25T09:07:49.510379+0000","last_became_peered":"2024-04-25T09:07:49.510379+0000","last_unstale":"2024-04-25T09:07:49.517917+0000","last_undegraded":"2024-04-25T09:07:49.517917+0000","last_fullsized":"2024-04-25T09:07:49.517917+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:17.397256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.508801+0000","last_change":"2024-04-25T09:07:48.514375+0000","last_active":"2024-04-25T09:07:49.508801+0000","last_peered":"2024-04-25T09:07:49.508801+0000","last_clean":"2024-04-25T09:07:49.508801+0000","last_became_active":"2024-04-25T09:07:48.514090+0000","last_became_peered":"2024-04-25T09:07:48.514090+0000","last_unstale":"2024-04-25T09:07:49.508801+0000","last_undegraded":"2024-04-25T09:07:49.508801+0000","last_fullsized":"2024-04-25T09:07:49.508801+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:29.456988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.524443+0000","last_change":"2024-04-25T09:07:49.521364+0000","last_active":"2024-04-25T09:07:49.524443+0000","last_peered":"2024-04-25T09:07:49.524443+0000","last_clean":"2024-04-25T09:07:49.524443+0000","last_became_active":"2024-04-25T09:07:49.521067+0000","last_became_peered":"2024-04-25T09:07:49.521067+0000","last_unstale":"2024-04-25T09:07:49.524443+0000","last_undegraded":"2024-04-25T09:07:49.524443+0000","last_fullsized":"2024-04-25T09:07:49.524443+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:22.522862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.512521+0000","last_change":"2024-04-25T09:07:48.510400+0000","last_active":"2024-04-25T09:07:49.512521+0000","last_peered":"2024-04-25T09:07:49.512521+0000","last_clean":"2024-04-25T09:07:49.512521+0000","last_became_active":"2024-04-25T09:07:48.507979+0000","last_became_peered":"2024-04-25T09:07:48.507979+0000","last_unstale":"2024-04-25T09:07:49.512521+0000","last_undegraded":"2024-04-25T09:07:49.512521+0000","last_fullsized":"2024-04-25T09:07:49.512521+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:04.765993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.514586+0000","last_change":"2024-04-25T09:07:49.508272+0000","last_active":"2024-04-25T09:07:49.514586+0000","last_peered":"2024-04-25T09:07:49.514586+0000","last_clean":"2024-04-25T09:07:49.514586+0000","last_became_active":"2024-04-25T09:07:49.507981+0000","last_became_peered":"2024-04-25T09:07:49.507981+0000","last_unstale":"2024-04-25T09:07:49.514586+0000","last_undegraded":"2024-04-25T09:07:49.514586+0000","last_fullsized":"2024-04-25T09:07:49.514586+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:26.548548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"91'8","reported_seq":20,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.539749+0000","last_change":"2024-04-25T09:07:48.520095+0000","last_active":"2024-04-25T09:07:49.539749+0000","last_peered":"2024-04-25T09:07:49.539749+0000","last_clean":"2024-04-25T09:07:49.539749+0000","last_became_active":"2024-04-25T09:07:48.518758+0000","last_became_peered":"2024-04-25T09:07:48.518758+0000","last_unstale":"2024-04-25T09:07:49.539749+0000","last_undegraded":"2024-04-25T09:07:49.539749+0000","last_fullsized":"2024-04-25T09:07:49.539749+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:08:42.692724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.536971+0000","last_change":"2024-04-25T09:07:49.532114+0000","last_active":"2024-04-25T09:07:49.536971+0000","last_peered":"2024-04-25T09:07:49.536971+0000","last_clean":"2024-04-25T09:07:49.536971+0000","last_became_active":"2024-04-25T09:07:49.524406+0000","last_became_peered":"2024-04-25T09:07:49.524406+0000","last_unstale":"2024-04-25T09:07:49.536971+0000","last_undegraded":"2024-04-25T09:07:49.536971+0000","last_fullsized":"2024-04-25T09:07:49.536971+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:12.345289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.532455+0000","last_change":"2024-04-25T09:07:48.507398+0000","last_active":"2024-04-25T09:07:49.532455+0000","last_peered":"2024-04-25T09:07:49.532455+0000","last_clean":"2024-04-25T09:07:49.532455+0000","last_became_active":"2024-04-25T09:07:48.507115+0000","last_became_peered":"2024-04-25T09:07:48.507115+0000","last_unstale":"2024-04-25T09:07:49.532455+0000","last_undegraded":"2024-04-25T09:07:49.532455+0000","last_fullsized":"2024-04-25T09:07:49.532455+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:28.818273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.518624+0000","last_change":"2024-04-25T09:07:49.513747+0000","last_active":"2024-04-25T09:07:49.518624+0000","last_peered":"2024-04-25T09:07:49.518624+0000","last_clean":"2024-04-25T09:07:49.518624+0000","last_became_active":"2024-04-25T09:07:49.513433+0000","last_became_peered":"2024-04-25T09:07:49.513433+0000","last_unstale":"2024-04-25T09:07:49.518624+0000","last_undegraded":"2024-04-25T09:07:49.518624+0000","last_fullsized":"2024-04-25T09:07:49.518624+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:06.444919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.532279+0000","last_change":"2024-04-25T09:07:48.509394+0000","last_active":"2024-04-25T09:07:49.532279+0000","last_peered":"2024-04-25T09:07:49.532279+0000","last_clean":"2024-04-25T09:07:49.532279+0000","last_became_active":"2024-04-25T09:07:48.509121+0000","last_became_peered":"2024-04-25T09:07:48.509121+0000","last_unstale":"2024-04-25T09:07:49.532279+0000","last_undegraded":"2024-04-25T09:07:49.532279+0000","last_fullsized":"2024-04-25T09:07:49.532279+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:28.789460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.517965+0000","last_change":"2024-04-25T09:07:49.513611+0000","last_active":"2024-04-25T09:07:49.517965+0000","last_peered":"2024-04-25T09:07:49.517965+0000","last_clean":"2024-04-25T09:07:49.517965+0000","last_became_active":"2024-04-25T09:07:49.513341+0000","last_became_peered":"2024-04-25T09:07:49.513341+0000","last_unstale":"2024-04-25T09:07:49.517965+0000","last_undegraded":"2024-04-25T09:07:49.517965+0000","last_fullsized":"2024-04-25T09:07:49.517965+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:21:55.465043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"91'1","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.529969+0000","last_change":"2024-04-25T09:07:48.518531+0000","last_active":"2024-04-25T09:07:49.529969+0000","last_peered":"2024-04-25T09:07:49.529969+0000","last_clean":"2024-04-25T09:07:49.529969+0000","last_became_active":"2024-04-25T09:07:48.518242+0000","last_became_peered":"2024-04-25T09:07:48.518242+0000","last_unstale":"2024-04-25T09:07:49.529969+0000","last_undegraded":"2024-04-25T09:07:49.529969+0000","last_fullsized":"2024-04-25T09:07:49.529969+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:25:24.070394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.540962+0000","last_change":"2024-04-25T09:07:49.538403+0000","last_active":"2024-04-25T09:07:49.540962+0000","last_peered":"2024-04-25T09:07:49.540962+0000","last_clean":"2024-04-25T09:07:49.540962+0000","last_became_active":"2024-04-25T09:07:49.538058+0000","last_became_peered":"2024-04-25T09:07:49.538058+0000","last_unstale":"2024-04-25T09:07:49.540962+0000","last_undegraded":"2024-04-25T09:07:49.540962+0000","last_fullsized":"2024-04-25T09:07:49.540962+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:18:33.517552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.534126+0000","last_change":"2024-04-25T09:07:48.501180+0000","last_active":"2024-04-25T09:07:49.534126+0000","last_peered":"2024-04-25T09:07:49.534126+0000","last_clean":"2024-04-25T09:07:49.534126+0000","last_became_active":"2024-04-25T09:07:48.500867+0000","last_became_peered":"2024-04-25T09:07:48.500867+0000","last_unstale":"2024-04-25T09:07:49.534126+0000","last_undegraded":"2024-04-25T09:07:49.534126+0000","last_fullsized":"2024-04-25T09:07:49.534126+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:29.437745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.524945+0000","last_change":"2024-04-25T09:07:49.523814+0000","last_active":"2024-04-25T09:07:49.524945+0000","last_peered":"2024-04-25T09:07:49.524945+0000","last_clean":"2024-04-25T09:07:49.524945+0000","last_became_active":"2024-04-25T09:07:49.523451+0000","last_became_peered":"2024-04-25T09:07:49.523451+0000","last_unstale":"2024-04-25T09:07:49.524945+0000","last_undegraded":"2024-04-25T09:07:49.524945+0000","last_fullsized":"2024-04-25T09:07:49.524945+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:02.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.494726+0000","last_change":"2024-04-25T09:07:48.513913+0000","last_active":"2024-04-25T09:07:49.494726+0000","last_peered":"2024-04-25T09:07:49.494726+0000","last_clean":"2024-04-25T09:07:49.494726+0000","last_became_active":"2024-04-25T09:07:48.513611+0000","last_became_peered":"2024-04-25T09:07:48.513611+0000","last_unstale":"2024-04-25T09:07:49.494726+0000","last_undegraded":"2024-04-25T09:07:49.494726+0000","last_fullsized":"2024-04-25T09:07:49.494726+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:23.748660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530931+0000","last_change":"2024-04-25T09:07:49.526744+0000","last_active":"2024-04-25T09:07:49.530931+0000","last_peered":"2024-04-25T09:07:49.530931+0000","last_clean":"2024-04-25T09:07:49.530931+0000","last_became_active":"2024-04-25T09:07:49.526396+0000","last_became_peered":"2024-04-25T09:07:49.526396+0000","last_unstale":"2024-04-25T09:07:49.530931+0000","last_undegraded":"2024-04-25T09:07:49.530931+0000","last_fullsized":"2024-04-25T09:07:49.530931+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:35.854574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.497668+0000","last_change":"2024-04-25T09:07:48.511723+0000","last_active":"2024-04-25T09:07:49.497668+0000","last_peered":"2024-04-25T09:07:49.497668+0000","last_clean":"2024-04-25T09:07:49.497668+0000","last_became_active":"2024-04-25T09:07:48.511403+0000","last_became_peered":"2024-04-25T09:07:48.511403+0000","last_unstale":"2024-04-25T09:07:49.497668+0000","last_undegraded":"2024-04-25T09:07:49.497668+0000","last_fullsized":"2024-04-25T09:07:49.497668+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:03:39.910436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.521459+0000","last_change":"2024-04-25T09:07:49.518391+0000","last_active":"2024-04-25T09:07:49.521459+0000","last_peered":"2024-04-25T09:07:49.521459+0000","last_clean":"2024-04-25T09:07:49.521459+0000","last_became_active":"2024-04-25T09:07:49.518095+0000","last_became_peered":"2024-04-25T09:07:49.518095+0000","last_unstale":"2024-04-25T09:07:49.521459+0000","last_undegraded":"2024-04-25T09:07:49.521459+0000","last_fullsized":"2024-04-25T09:07:49.521459+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:28:29.793838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.493614+0000","last_change":"2024-04-25T09:07:48.504709+0000","last_active":"2024-04-25T09:07:49.493614+0000","last_peered":"2024-04-25T09:07:49.493614+0000","last_clean":"2024-04-25T09:07:49.493614+0000","last_became_active":"2024-04-25T09:07:48.504417+0000","last_became_peered":"2024-04-25T09:07:48.504417+0000","last_unstale":"2024-04-25T09:07:49.493614+0000","last_undegraded":"2024-04-25T09:07:49.493614+0000","last_fullsized":"2024-04-25T09:07:49.493614+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:46:16.231226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.517530+0000","last_change":"2024-04-25T09:07:49.509943+0000","last_active":"2024-04-25T09:07:49.517530+0000","last_peered":"2024-04-25T09:07:49.517530+0000","last_clean":"2024-04-25T09:07:49.517530+0000","last_became_active":"2024-04-25T09:07:49.508063+0000","last_became_peered":"2024-04-25T09:07:49.508063+0000","last_unstale":"2024-04-25T09:07:49.517530+0000","last_undegraded":"2024-04-25T09:07:49.517530+0000","last_fullsized":"2024-04-25T09:07:49.517530+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:55:48.737408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"91'2","reported_seq":14,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.532295+0000","last_change":"2024-04-25T09:07:48.508962+0000","last_active":"2024-04-25T09:07:49.532295+0000","last_peered":"2024-04-25T09:07:49.532295+0000","last_clean":"2024-04-25T09:07:49.532295+0000","last_became_active":"2024-04-25T09:07:48.508700+0000","last_became_peered":"2024-04-25T09:07:48.508700+0000","last_unstale":"2024-04-25T09:07:49.532295+0000","last_undegraded":"2024-04-25T09:07:49.532295+0000","last_fullsized":"2024-04-25T09:07:49.532295+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:03.766692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.535899+0000","last_change":"2024-04-25T09:07:49.530624+0000","last_active":"2024-04-25T09:07:49.535899+0000","last_peered":"2024-04-25T09:07:49.535899+0000","last_clean":"2024-04-25T09:07:49.535899+0000","last_became_active":"2024-04-25T09:07:49.530343+0000","last_became_peered":"2024-04-25T09:07:49.530343+0000","last_unstale":"2024-04-25T09:07:49.535899+0000","last_undegraded":"2024-04-25T09:07:49.535899+0000","last_fullsized":"2024-04-25T09:07:49.535899+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:25.010180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.505576+0000","last_change":"2024-04-25T09:07:48.506737+0000","last_active":"2024-04-25T09:07:49.505576+0000","last_peered":"2024-04-25T09:07:49.505576+0000","last_clean":"2024-04-25T09:07:49.505576+0000","last_became_active":"2024-04-25T09:07:48.506247+0000","last_became_peered":"2024-04-25T09:07:48.506247+0000","last_unstale":"2024-04-25T09:07:49.505576+0000","last_undegraded":"2024-04-25T09:07:49.505576+0000","last_fullsized":"2024-04-25T09:07:49.505576+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:16.294802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530635+0000","last_change":"2024-04-25T09:07:49.521014+0000","last_active":"2024-04-25T09:07:49.530635+0000","last_peered":"2024-04-25T09:07:49.530635+0000","last_clean":"2024-04-25T09:07:49.530635+0000","last_became_active":"2024-04-25T09:07:49.520729+0000","last_became_peered":"2024-04-25T09:07:49.520729+0000","last_unstale":"2024-04-25T09:07:49.530635+0000","last_undegraded":"2024-04-25T09:07:49.530635+0000","last_fullsized":"2024-04-25T09:07:49.530635+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:09:34.153710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.504650+0000","last_change":"2024-04-25T09:07:48.515539+0000","last_active":"2024-04-25T09:07:49.504650+0000","last_peered":"2024-04-25T09:07:49.504650+0000","last_clean":"2024-04-25T09:07:49.504650+0000","last_became_active":"2024-04-25T09:07:48.515178+0000","last_became_peered":"2024-04-25T09:07:48.515178+0000","last_unstale":"2024-04-25T09:07:49.504650+0000","last_undegraded":"2024-04-25T09:07:49.504650+0000","last_fullsized":"2024-04-25T09:07:49.504650+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:54:25.070718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.512324+0000","last_change":"2024-04-25T09:07:49.507502+0000","last_active":"2024-04-25T09:07:49.512324+0000","last_peered":"2024-04-25T09:07:49.512324+0000","last_clean":"2024-04-25T09:07:49.512324+0000","last_became_active":"2024-04-25T09:07:49.507158+0000","last_became_peered":"2024-04-25T09:07:49.507158+0000","last_unstale":"2024-04-25T09:07:49.512324+0000","last_undegraded":"2024-04-25T09:07:49.512324+0000","last_fullsized":"2024-04-25T09:07:49.512324+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:09.373865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.501902+0000","last_change":"2024-04-25T09:07:48.511894+0000","last_active":"2024-04-25T09:07:49.501902+0000","last_peered":"2024-04-25T09:07:49.501902+0000","last_clean":"2024-04-25T09:07:49.501902+0000","last_became_active":"2024-04-25T09:07:48.510486+0000","last_became_peered":"2024-04-25T09:07:48.510486+0000","last_unstale":"2024-04-25T09:07:49.501902+0000","last_undegraded":"2024-04-25T09:07:49.501902+0000","last_fullsized":"2024-04-25T09:07:49.501902+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:58.971192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.539152+0000","last_change":"2024-04-25T09:07:49.536341+0000","last_active":"2024-04-25T09:07:49.539152+0000","last_peered":"2024-04-25T09:07:49.539152+0000","last_clean":"2024-04-25T09:07:49.539152+0000","last_became_active":"2024-04-25T09:07:49.535906+0000","last_became_peered":"2024-04-25T09:07:49.535906+0000","last_unstale":"2024-04-25T09:07:49.539152+0000","last_undegraded":"2024-04-25T09:07:49.539152+0000","last_fullsized":"2024-04-25T09:07:49.539152+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:05:43.587933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.509900+0000","last_change":"2024-04-25T09:07:48.507232+0000","last_active":"2024-04-25T09:07:49.509900+0000","last_peered":"2024-04-25T09:07:49.509900+0000","last_clean":"2024-04-25T09:07:49.509900+0000","last_became_active":"2024-04-25T09:07:48.506892+0000","last_became_peered":"2024-04-25T09:07:48.506892+0000","last_unstale":"2024-04-25T09:07:49.509900+0000","last_undegraded":"2024-04-25T09:07:49.509900+0000","last_fullsized":"2024-04-25T09:07:49.509900+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:59.294976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530834+0000","last_change":"2024-04-25T09:07:49.522333+0000","last_active":"2024-04-25T09:07:49.530834+0000","last_peered":"2024-04-25T09:07:49.530834+0000","last_clean":"2024-04-25T09:07:49.530834+0000","last_became_active":"2024-04-25T09:07:49.522018+0000","last_became_peered":"2024-04-25T09:07:49.522018+0000","last_unstale":"2024-04-25T09:07:49.530834+0000","last_undegraded":"2024-04-25T09:07:49.530834+0000","last_fullsized":"2024-04-25T09:07:49.530834+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:02.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.498160+0000","last_change":"2024-04-25T09:07:48.505550+0000","last_active":"2024-04-25T09:07:49.498160+0000","last_peered":"2024-04-25T09:07:49.498160+0000","last_clean":"2024-04-25T09:07:49.498160+0000","last_became_active":"2024-04-25T09:07:48.505271+0000","last_became_peered":"2024-04-25T09:07:48.505271+0000","last_unstale":"2024-04-25T09:07:49.498160+0000","last_undegraded":"2024-04-25T09:07:49.498160+0000","last_fullsized":"2024-04-25T09:07:49.498160+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:33:34.713867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.530593+0000","last_change":"2024-04-25T09:07:49.527507+0000","last_active":"2024-04-25T09:07:49.530593+0000","last_peered":"2024-04-25T09:07:49.530593+0000","last_clean":"2024-04-25T09:07:49.530593+0000","last_became_active":"2024-04-25T09:07:49.525198+0000","last_became_peered":"2024-04-25T09:07:49.525198+0000","last_unstale":"2024-04-25T09:07:49.530593+0000","last_undegraded":"2024-04-25T09:07:49.530593+0000","last_fullsized":"2024-04-25T09:07:49.530593+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:33:35.718245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.502068+0000","last_change":"2024-04-25T09:07:48.511110+0000","last_active":"2024-04-25T09:07:49.502068+0000","last_peered":"2024-04-25T09:07:49.502068+0000","last_clean":"2024-04-25T09:07:49.502068+0000","last_became_active":"2024-04-25T09:07:48.510822+0000","last_became_peered":"2024-04-25T09:07:48.510822+0000","last_unstale":"2024-04-25T09:07:49.502068+0000","last_undegraded":"2024-04-25T09:07:49.502068+0000","last_fullsized":"2024-04-25T09:07:49.502068+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:26:06.493700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.538612+0000","last_change":"2024-04-25T09:07:49.534282+0000","last_active":"2024-04-25T09:07:49.538612+0000","last_peered":"2024-04-25T09:07:49.538612+0000","last_clean":"2024-04-25T09:07:49.538612+0000","last_became_active":"2024-04-25T09:07:49.534041+0000","last_became_peered":"2024-04-25T09:07:49.534041+0000","last_unstale":"2024-04-25T09:07:49.538612+0000","last_undegraded":"2024-04-25T09:07:49.538612+0000","last_fullsized":"2024-04-25T09:07:49.538612+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:24.701016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.495623+0000","last_change":"2024-04-25T09:07:48.519794+0000","last_active":"2024-04-25T09:07:49.495623+0000","last_peered":"2024-04-25T09:07:49.495623+0000","last_clean":"2024-04-25T09:07:49.495623+0000","last_became_active":"2024-04-25T09:07:48.519533+0000","last_became_peered":"2024-04-25T09:07:48.519533+0000","last_unstale":"2024-04-25T09:07:49.495623+0000","last_undegraded":"2024-04-25T09:07:49.495623+0000","last_fullsized":"2024-04-25T09:07:49.495623+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:01.712917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.531976+0000","last_change":"2024-04-25T09:07:49.528554+0000","last_active":"2024-04-25T09:07:49.531976+0000","last_peered":"2024-04-25T09:07:49.531976+0000","last_clean":"2024-04-25T09:07:49.531976+0000","last_became_active":"2024-04-25T09:07:49.528281+0000","last_became_peered":"2024-04-25T09:07:49.528281+0000","last_unstale":"2024-04-25T09:07:49.531976+0000","last_undegraded":"2024-04-25T09:07:49.531976+0000","last_fullsized":"2024-04-25T09:07:49.531976+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":90,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:48.480740+0000","last_clean_scrub_stamp":"2024-04-25T09:07:48.480740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:29:29.045023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.519198+0000","last_change":"2024-04-25T09:07:48.518426+0000","last_active":"2024-04-25T09:07:49.519198+0000","last_peered":"2024-04-25T09:07:49.519198+0000","last_clean":"2024-04-25T09:07:49.519198+0000","last_became_active":"2024-04-25T09:07:48.516401+0000","last_became_peered":"2024-04-25T09:07:48.516401+0000","last_unstale":"2024-04-25T09:07:49.519198+0000","last_undegraded":"2024-04-25T09:07:49.519198+0000","last_fullsized":"2024-04-25T09:07:49.519198+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:07:47.476362+0000","last_clean_scrub_stamp":"2024-04-25T09:07:47.476362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:35.349893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":302,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-04-25T09:07:49.495873+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:07:49.495873+0000","last_peered":"2024-04-25T09:07:49.495873+0000","last_clean":"2024-04-25T09:07:49.495873+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:07:49.495873+0000","last_undegraded":"2024-04-25T09:07:49.495873+0000","last_fullsized":"2024-04-25T09:07:49.495873+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574930,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32844,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338996,"statfs":{"total":96636764160,"available":96603131904,"internally_reserved":0,"allocated":1703936,"data_stored":1099884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1142784,"data_stored":518899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1110016,"data_stored":509516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574930,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1110016,"data_stored":509516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574930,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1110016,"data_stored":509516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574930,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32284,"kb_used_data":1096,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339556,"statfs":{"total":96636764160,"available":96603705344,"internally_reserved":0,"allocated":1122304,"data_stored":516683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32268,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339572,"statfs":{"total":96636764160,"available":96603721728,"internally_reserved":0,"allocated":1110016,"data_stored":509516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32848,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338992,"statfs":{"total":96636764160,"available":96603127808,"internally_reserved":0,"allocated":1703936,"data_stored":1099884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:07:54.001 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:07:54.001 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:07:54.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.200+0000 7f2691e00640 1 Processor -- start 2024-04-25T09:07:54.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.200+0000 7f2691e00640 1 -- start start 2024-04-25T09:07:54.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2691e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f268c15eff0 0x7f268c0b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:54.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2691e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f268c0cf800 0x7f268c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:54.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2691e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268c0cc150 con 0x7f268c15fed0 2024-04-25T09:07:54.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2691e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268c0ccd00 con 0x7f268c15eff0 2024-04-25T09:07:54.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2691e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f268c0d0150 con 0x7f268c0cf800 2024-04-25T09:07:54.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2690a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f268c15eff0 0x7f268c0b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:54.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2683e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f268c15fed0 0x7f268c0cd190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47180/0 (socket says 172.21.15.59:47180) 2024-04-25T09:07:54.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2683e00640 1 -- 172.21.15.59:0/3630656231 learned_addr learned my addr 172.21.15.59:0/3630656231 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:54.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2691400640 1 --2- 172.21.15.59:0/3630656231 >> v2:172.21.15.178:3300/0 conn(0x7f268c0cf800 0x7f268c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:54.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2690a00640 1 -- 172.21.15.59:0/3630656231 >> v2:172.21.15.178:3300/0 conn(0x7f268c0cf800 msgr2=0x7f268c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:54.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2690a00640 1 --2- 172.21.15.59:0/3630656231 >> v2:172.21.15.178:3300/0 conn(0x7f268c0cf800 0x7f268c0cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2690a00640 1 -- 172.21.15.59:0/3630656231 >> v1:172.21.15.59:6789/0 conn(0x7f268c15fed0 legacy=0x7f268c0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:54.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f2690a00640 1 -- 172.21.15.59:0/3630656231 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c0cc3d0 con 0x7f268c15eff0 2024-04-25T09:07:54.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.204+0000 7f268be00640 1 -- 172.21.15.59:0/3630656231 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3343624879 0 0) 0x7f2674001120 con 0x7f268c15fed0 2024-04-25T09:07:54.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2690a00640 1 --2- 172.21.15.59:0/3630656231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c15eff0 0x7f268c0b0930 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f268c0b7470 tx=0x7f267c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf31ddc3c914538 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:54.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f268be00640 1 -- 172.21.15.59:0/3630656231 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c0b0070 con 0x7f268c15eff0 2024-04-25T09:07:54.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f268be00640 1 -- 172.21.15.59:0/3630656231 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267c0ab600 con 0x7f268c15eff0 2024-04-25T09:07:54.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f268be00640 1 -- 172.21.15.59:0/3630656231 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c0ab9d0 con 0x7f268c15eff0 2024-04-25T09:07:54.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 -- 172.21.15.59:0/3630656231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c15eff0 msgr2=0x7f268c0b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:54.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 --2- 172.21.15.59:0/3630656231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c15eff0 0x7f268c0b0930 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f268c0b7470 tx=0x7f267c01c480 comp rx=0 tx=0).stop 2024-04-25T09:07:54.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 -- 172.21.15.59:0/3630656231 shutdown_connections 2024-04-25T09:07:54.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 --2- 172.21.15.59:0/3630656231 >> v2:172.21.15.178:3300/0 conn(0x7f268c0cf800 0x7f268c0cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 --2- 172.21.15.59:0/3630656231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c15eff0 0x7f268c0b0930 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 -- 172.21.15.59:0/3630656231 >> 172.21.15.59:0/3630656231 conn(0x7f268c0d1540 msgr2=0x7f268c0d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:54.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 -- 172.21.15.59:0/3630656231 shutdown_connections 2024-04-25T09:07:54.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 -- 172.21.15.59:0/3630656231 wait complete. 2024-04-25T09:07:54.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 Processor -- start 2024-04-25T09:07:54.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 -- start start 2024-04-25T09:07:54.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f268c0cf800 0x7f268c0b67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:54.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c15eff0 0x7f268c1547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:54.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f268c15fed0 0x7f268c154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:54.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c0b1830 con 0x7f268c15eff0 2024-04-25T09:07:54.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268c0b16b0 con 0x7f268c0cf800 2024-04-25T09:07:54.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.208+0000 7f2691e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c0b19b0 con 0x7f268c15fed0 2024-04-25T09:07:54.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2683e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c15eff0 0x7f268c1547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:54.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2683e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c15eff0 0x7f268c1547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36416/0 (socket says 172.21.15.59:36416) 2024-04-25T09:07:54.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2683e00640 1 -- 172.21.15.59:0/1868482897 learned_addr learned my addr 172.21.15.59:0/1868482897 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2683e00640 1 -- 172.21.15.59:0/1868482897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f268c15fed0 msgr2=0x7f268c154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2683e00640 1 --2- 172.21.15.59:0/1868482897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f268c15fed0 0x7f268c154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2683e00640 1 -- 172.21.15.59:0/1868482897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f268c0cf800 msgr2=0x7f268c0b67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2683e00640 1 --2- 172.21.15.59:0/1868482897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f268c0cf800 0x7f268c0b67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2683e00640 1 -- 172.21.15.59:0/1868482897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268c0c9f20 con 0x7f268c15eff0 2024-04-25T09:07:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2683e00640 1 --2- 172.21.15.59:0/1868482897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c15eff0 0x7f268c1547d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f267400c7b0 tx=0x7f267400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2689600640 1 -- 172.21.15.59:0/1868482897 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674018070 con 0x7f268c15eff0 2024-04-25T09:07:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2689600640 1 -- 172.21.15.59:0/1868482897 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26740072f0 con 0x7f268c15eff0 2024-04-25T09:07:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2689600640 1 -- 172.21.15.59:0/1868482897 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740047f0 con 0x7f268c15eff0 2024-04-25T09:07:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2691e00640 1 -- 172.21.15.59:0/1868482897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268c0ca200 con 0x7f268c15eff0 2024-04-25T09:07:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2691e00640 1 -- 172.21.15.59:0/1868482897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268c0ca4e0 con 0x7f268c15eff0 2024-04-25T09:07:54.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2691e00640 1 -- 172.21.15.59:0/1868482897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268c04efa0 con 0x7f268c15eff0 2024-04-25T09:07:54.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.212+0000 7f2689600640 1 -- 172.21.15.59:0/1868482897 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f267401b070 con 0x7f268c15eff0 2024-04-25T09:07:54.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.216+0000 7f2689600640 1 --2- 172.21.15.59:0/1868482897 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2668066f60 0x7f2668069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:54.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.216+0000 7f2689600640 1 -- 172.21.15.59:0/1868482897 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f2674084710 con 0x7f268c15eff0 2024-04-25T09:07:54.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.216+0000 7f2690a00640 1 --2- 172.21.15.59:0/1868482897 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2668066f60 0x7f2668069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:54.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.216+0000 7f2690a00640 1 --2- 172.21.15.59:0/1868482897 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2668066f60 0x7f2668069420 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f267c0ad000 tx=0x7f267c004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:54.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.220+0000 7f2689600640 1 -- 172.21.15.59:0/1868482897 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f268c0cc150 con 0x7f268c15eff0 2024-04-25T09:07:54.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.436+0000 7f2691e00640 1 -- 172.21.15.59:0/1868482897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f268c0b74c0 con 0x7f268c15eff0 2024-04-25T09:07:54.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.440+0000 7f2689600640 1 -- 172.21.15.59:0/1868482897 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f2674055460 con 0x7f268c15eff0 2024-04-25T09:07:54.429 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-04-25T09:07:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg== 2024-04-25T09:07:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-04-25T09:07:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-04-25T09:07:54.429 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:07:54.430 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-04-25T09:07:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.444+0000 7f2691e00640 1 -- 172.21.15.59:0/1868482897 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2668066f60 msgr2=0x7f2668069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.444+0000 7f2691e00640 1 --2- 172.21.15.59:0/1868482897 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2668066f60 0x7f2668069420 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f267c0ad000 tx=0x7f267c004740 comp rx=0 tx=0).stop 2024-04-25T09:07:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.444+0000 7f2691e00640 1 -- 172.21.15.59:0/1868482897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c15eff0 msgr2=0x7f268c1547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.444+0000 7f2691e00640 1 --2- 172.21.15.59:0/1868482897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c15eff0 0x7f268c1547d0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f267400c7b0 tx=0x7f267400cc70 comp rx=0 tx=0).stop 2024-04-25T09:07:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.444+0000 7f2691e00640 1 -- 172.21.15.59:0/1868482897 shutdown_connections 2024-04-25T09:07:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.444+0000 7f2691e00640 1 --2- 172.21.15.59:0/1868482897 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2668066f60 0x7f2668069420 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.444+0000 7f2691e00640 1 --2- 172.21.15.59:0/1868482897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f268c15fed0 0x7f268c154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.444+0000 7f2691e00640 1 --2- 172.21.15.59:0/1868482897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c15eff0 0x7f268c1547d0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.444+0000 7f2691e00640 1 --2- 172.21.15.59:0/1868482897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f268c0cf800 0x7f268c0b67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.444+0000 7f2691e00640 1 -- 172.21.15.59:0/1868482897 >> 172.21.15.59:0/1868482897 conn(0x7f268c0d1540 msgr2=0x7f268c0b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.444+0000 7f2691e00640 1 -- 172.21.15.59:0/1868482897 shutdown_connections 2024-04-25T09:07:54.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.444+0000 7f2691e00640 1 -- 172.21.15.59:0/1868482897 wait complete. 2024-04-25T09:07:54.452 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:54.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a62e00640 1 Processor -- start 2024-04-25T09:07:54.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a62e00640 1 -- start start 2024-04-25T09:07:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a62e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a5c15b780 0x7f1a5c0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a62e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 0x7f1a5c0cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a62e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c15bb60 con 0x7f1a5c0cf280 2024-04-25T09:07:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a62e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c09a250 con 0x7f1a5c15b780 2024-04-25T09:07:54.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a62e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c09adf0 con 0x7f1a5c0cfad0 2024-04-25T09:07:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a61a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a5c15b780 0x7f1a5c0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a62400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 0x7f1a5c0cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:54.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a61a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a5c15b780 0x7f1a5c0ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:57656/0 (socket says 172.21.15.59:57656) 2024-04-25T09:07:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a62400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 0x7f1a5c0cff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:48800/0 (socket says 172.21.15.59:48800) 2024-04-25T09:07:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a61a00640 1 -- 172.21.15.59:0/3932204989 learned_addr learned my addr 172.21.15.59:0/3932204989 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.604+0000 7f1a61000640 1 --1- 172.21.15.59:0/3932204989 >> v1:172.21.15.178:6789/0 conn(0x7f1a5c0cf280 0x7f1a5c09a6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:57558/0 (socket says 172.21.15.59:57558) 2024-04-25T09:07:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.608+0000 7f1a62400640 1 -- 172.21.15.59:0/3932204989 >> v2:172.21.15.178:3300/0 conn(0x7f1a5c15b780 msgr2=0x7f1a5c0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.608+0000 7f1a62400640 1 --2- 172.21.15.59:0/3932204989 >> v2:172.21.15.178:3300/0 conn(0x7f1a5c15b780 0x7f1a5c0ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.608+0000 7f1a62400640 1 -- 172.21.15.59:0/3932204989 >> v1:172.21.15.178:6789/0 conn(0x7f1a5c0cf280 legacy=0x7f1a5c09a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.608+0000 7f1a62400640 1 -- 172.21.15.59:0/3932204989 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c0cd230 con 0x7f1a5c0cfad0 2024-04-25T09:07:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.608+0000 7f1a61a00640 1 --2- 172.21.15.59:0/3932204989 >> v2:172.21.15.178:3300/0 conn(0x7f1a5c15b780 0x7f1a5c0ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:54.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.608+0000 7f1a5be00640 1 -- 172.21.15.59:0/3932204989 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913036600 0 0) 0x7f1a5c15bb60 con 0x7f1a5c0cf280 2024-04-25T09:07:54.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.608+0000 7f1a62400640 1 --2- 172.21.15.59:0/3932204989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 0x7f1a5c0cff60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009d90 tx=0x7f1a5401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=120a4b587b88653d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:54.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.608+0000 7f1a5be00640 1 -- 172.21.15.59:0/3932204989 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540b2070 con 0x7f1a5c0cfad0 2024-04-25T09:07:54.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.608+0000 7f1a5be00640 1 -- 172.21.15.59:0/3932204989 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a540a5830 con 0x7f1a5c0cfad0 2024-04-25T09:07:54.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.608+0000 7f1a5be00640 1 -- 172.21.15.59:0/3932204989 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540a5c00 con 0x7f1a5c0cfad0 2024-04-25T09:07:54.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 -- 172.21.15.59:0/3932204989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 msgr2=0x7f1a5c0cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:54.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 --2- 172.21.15.59:0/3932204989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 0x7f1a5c0cff60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009d90 tx=0x7f1a5401c970 comp rx=0 tx=0).stop 2024-04-25T09:07:54.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 -- 172.21.15.59:0/3932204989 shutdown_connections 2024-04-25T09:07:54.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 --2- 172.21.15.59:0/3932204989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 0x7f1a5c0cff60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 --2- 172.21.15.59:0/3932204989 >> v2:172.21.15.178:3300/0 conn(0x7f1a5c15b780 0x7f1a5c0ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 -- 172.21.15.59:0/3932204989 >> 172.21.15.59:0/3932204989 conn(0x7f1a5c0d14f0 msgr2=0x7f1a5c0d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:54.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 -- 172.21.15.59:0/3932204989 shutdown_connections 2024-04-25T09:07:54.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 -- 172.21.15.59:0/3932204989 wait complete. 2024-04-25T09:07:54.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 Processor -- start 2024-04-25T09:07:54.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 -- start start 2024-04-25T09:07:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c0cf280 0x7f1a5c0b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 0x7f1a5c155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a5c15b780 0x7f1a5c1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c168720 con 0x7f1a5c15b780 2024-04-25T09:07:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c1685a0 con 0x7f1a5c0cf280 2024-04-25T09:07:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c1688a0 con 0x7f1a5c0cfad0 2024-04-25T09:07:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a5c15b780 0x7f1a5c1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a5c15b780 0x7f1a5c1557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36426/0 (socket says 172.21.15.59:36426) 2024-04-25T09:07:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62400640 1 -- 172.21.15.59:0/707762404 learned_addr learned my addr 172.21.15.59:0/707762404 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:54.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a61000640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 0x7f1a5c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a61a00640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c0cf280 0x7f1a5c0b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62400640 1 -- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 msgr2=0x7f1a5c155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62400640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 0x7f1a5c155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62400640 1 -- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c0cf280 msgr2=0x7f1a5c0b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62400640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c0cf280 0x7f1a5c0b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a62400640 1 -- 172.21.15.59:0/707762404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c0af1d0 con 0x7f1a5c15b780 2024-04-25T09:07:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.612+0000 7f1a61000640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 0x7f1a5c155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:54.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.616+0000 7f1a62400640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a5c15b780 0x7f1a5c1557c0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1a540b0040 tx=0x7f1a54019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:54.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.616+0000 7f1a59600640 1 -- 172.21.15.59:0/707762404 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540b2050 con 0x7f1a5c15b780 2024-04-25T09:07:54.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.616+0000 7f1a59600640 1 -- 172.21.15.59:0/707762404 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a540b3040 con 0x7f1a5c15b780 2024-04-25T09:07:54.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.616+0000 7f1a62e00640 1 -- 172.21.15.59:0/707762404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c0af4b0 con 0x7f1a5c15b780 2024-04-25T09:07:54.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.616+0000 7f1a59600640 1 -- 172.21.15.59:0/707762404 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540ad850 con 0x7f1a5c15b780 2024-04-25T09:07:54.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.616+0000 7f1a62e00640 1 -- 172.21.15.59:0/707762404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c0afa70 con 0x7f1a5c15b780 2024-04-25T09:07:54.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.616+0000 7f1a62e00640 1 -- 172.21.15.59:0/707762404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c0cf090 con 0x7f1a5c15b780 2024-04-25T09:07:54.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.616+0000 7f1a59600640 1 -- 172.21.15.59:0/707762404 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1a540c0020 con 0x7f1a5c15b780 2024-04-25T09:07:54.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.616+0000 7f1a59600640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a3c066f60 0x7f1a3c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:54.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.616+0000 7f1a59600640 1 -- 172.21.15.59:0/707762404 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f1a5411fbf0 con 0x7f1a5c15b780 2024-04-25T09:07:54.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.620+0000 7f1a61a00640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a3c066f60 0x7f1a3c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:54.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.620+0000 7f1a61a00640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a3c066f60 0x7f1a3c069420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0c8570 tx=0x7f1a50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:54.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.620+0000 7f1a59600640 1 -- 172.21.15.59:0/707762404 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1a54016560 con 0x7f1a5c15b780 2024-04-25T09:07:54.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a62e00640 1 -- 172.21.15.59:0/707762404 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a5c04efa0 con 0x7f1a5c15b780 2024-04-25T09:07:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a59600640 1 -- 172.21.15.59:0/707762404 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f1a540f0af0 con 0x7f1a5c15b780 2024-04-25T09:07:54.809 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:54.809 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:07:51.910911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7458":{"gid":7458,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3531112441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3531112441},{"type":"v1","addr":"172.21.15.59:6835","nonce":3531112441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:07:54.809 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 65 2024-04-25T09:07:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a62e00640 1 -- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a3c066f60 msgr2=0x7f1a3c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a62e00640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a3c066f60 0x7f1a3c069420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c0c8570 tx=0x7f1a50008040 comp rx=0 tx=0).stop 2024-04-25T09:07:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a62e00640 1 -- 172.21.15.59:0/707762404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a5c15b780 msgr2=0x7f1a5c1557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a62e00640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a5c15b780 0x7f1a5c1557c0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f1a540b0040 tx=0x7f1a54019710 comp rx=0 tx=0).stop 2024-04-25T09:07:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a62e00640 1 -- 172.21.15.59:0/707762404 shutdown_connections 2024-04-25T09:07:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a62e00640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a3c066f60 0x7f1a3c069420 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a62e00640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a5c15b780 0x7f1a5c1557c0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a62e00640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a5c0cfad0 0x7f1a5c155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a62e00640 1 --2- 172.21.15.59:0/707762404 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a5c0cf280 0x7f1a5c0b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a62e00640 1 -- 172.21.15.59:0/707762404 >> 172.21.15.59:0/707762404 conn(0x7f1a5c0d14f0 msgr2=0x7f1a5c0cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:54.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.820+0000 7f1a62e00640 1 -- 172.21.15.59:0/707762404 shutdown_connections 2024-04-25T09:07:54.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:54.824+0000 7f1a62e00640 1 -- 172.21.15.59:0/707762404 wait complete. 2024-04-25T09:07:55.233 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:07:48.892826+0000', 'modified': '2024-04-25T09:07:51.910911+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7458}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7458': {'gid': 7458, 'name': 'a', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/3531112441', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 3531112441}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 3531112441}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:07:55.233 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:07:55.233 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:07:55.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.388+0000 7f549be00640 1 Processor -- start 2024-04-25T09:07:55.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.388+0000 7f549be00640 1 -- start start 2024-04-25T09:07:55.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.388+0000 7f549be00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f549415b910 0x7f54940cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.388+0000 7f549be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f549415bcf0 0x7f5494099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.388+0000 7f549be00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54940d02a0 con 0x7f54940cf3c0 2024-04-25T09:07:55.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.388+0000 7f549be00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54940cc350 con 0x7f549415b910 2024-04-25T09:07:55.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.388+0000 7f549be00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54940cc630 con 0x7f549415bcf0 2024-04-25T09:07:55.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.392+0000 7f5499e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f549415bcf0 0x7f5494099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.392+0000 7f5498a00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f54940cf3c0 0x7f54940cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:57574/0 (socket says 172.21.15.59:57574) 2024-04-25T09:07:55.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.392+0000 7f5498a00640 1 -- 172.21.15.59:0/1072390804 learned_addr learned my addr 172.21.15.59:0/1072390804 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:55.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.388+0000 7f5499400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f549415b910 0x7f54940cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.392+0000 7f5499e00640 1 -- 172.21.15.59:0/1072390804 >> v2:172.21.15.178:3300/0 conn(0x7f549415b910 msgr2=0x7f54940cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:55.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.392+0000 7f5499e00640 1 --2- 172.21.15.59:0/1072390804 >> v2:172.21.15.178:3300/0 conn(0x7f549415b910 0x7f54940cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.392+0000 7f5499e00640 1 -- 172.21.15.59:0/1072390804 >> v1:172.21.15.178:6789/0 conn(0x7f54940cf3c0 legacy=0x7f54940cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.392+0000 7f5499e00640 1 -- 172.21.15.59:0/1072390804 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54940cc910 con 0x7f549415bcf0 2024-04-25T09:07:55.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.392+0000 7f5499e00640 1 --2- 172.21.15.59:0/1072390804 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f549415bcf0 0x7f5494099a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f548c009d90 tx=0x7f548c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=409ab67a581a7621 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:55.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.392+0000 7f5493e00640 1 -- 172.21.15.59:0/1072390804 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0b2070 con 0x7f549415bcf0 2024-04-25T09:07:55.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.392+0000 7f5493e00640 1 -- 172.21.15.59:0/1072390804 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c0a5910 con 0x7f549415bcf0 2024-04-25T09:07:55.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.392+0000 7f5493e00640 1 -- 172.21.15.59:0/1072390804 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0a5ce0 con 0x7f549415bcf0 2024-04-25T09:07:55.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 -- 172.21.15.59:0/1072390804 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f549415bcf0 msgr2=0x7f5494099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 --2- 172.21.15.59:0/1072390804 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f549415bcf0 0x7f5494099a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f548c009d90 tx=0x7f548c01c940 comp rx=0 tx=0).stop 2024-04-25T09:07:55.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 -- 172.21.15.59:0/1072390804 shutdown_connections 2024-04-25T09:07:55.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 --2- 172.21.15.59:0/1072390804 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f549415bcf0 0x7f5494099a60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 --2- 172.21.15.59:0/1072390804 >> v2:172.21.15.178:3300/0 conn(0x7f549415b910 0x7f54940cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 -- 172.21.15.59:0/1072390804 >> 172.21.15.59:0/1072390804 conn(0x7f54940b3200 msgr2=0x7f54940b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:55.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 -- 172.21.15.59:0/1072390804 shutdown_connections 2024-04-25T09:07:55.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 -- 172.21.15.59:0/1072390804 wait complete. 2024-04-25T09:07:55.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 Processor -- start 2024-04-25T09:07:55.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 -- start start 2024-04-25T09:07:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54940cf3c0 0x7f549406c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f549415b910 0x7f54941587a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549415bcf0 0x7f5494164030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5494168b20 con 0x7f549415bcf0 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54941689a0 con 0x7f54940cf3c0 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f549be00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5494168ca0 con 0x7f549415b910 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f5499e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549415bcf0 0x7f5494164030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f5499e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549415bcf0 0x7f5494164030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36430/0 (socket says 172.21.15.59:36430) 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f5499e00640 1 -- 172.21.15.59:0/3096196389 learned_addr learned my addr 172.21.15.59:0/3096196389 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f5499400640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54940cf3c0 0x7f549406c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f5498a00640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f549415b910 0x7f54941587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f5499e00640 1 -- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f549415b910 msgr2=0x7f54941587a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f5499e00640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f549415b910 0x7f54941587a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f5499e00640 1 -- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54940cf3c0 msgr2=0x7f549406c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f5499e00640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54940cf3c0 0x7f549406c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.396+0000 7f5499e00640 1 -- 172.21.15.59:0/3096196389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549406c7a0 con 0x7f549415bcf0 2024-04-25T09:07:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.400+0000 7f5499e00640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549415bcf0 0x7f5494164030 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f548c009d90 tx=0x7f548c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.400+0000 7f5491600640 1 -- 172.21.15.59:0/3096196389 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0b2050 con 0x7f549415bcf0 2024-04-25T09:07:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.400+0000 7f5491600640 1 -- 172.21.15.59:0/3096196389 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c0be070 con 0x7f549415bcf0 2024-04-25T09:07:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.400+0000 7f5491600640 1 -- 172.21.15.59:0/3096196389 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0ada90 con 0x7f549415bcf0 2024-04-25T09:07:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.400+0000 7f549be00640 1 -- 172.21.15.59:0/3096196389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549406ca80 con 0x7f549415bcf0 2024-04-25T09:07:55.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.400+0000 7f549be00640 1 -- 172.21.15.59:0/3096196389 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549406d040 con 0x7f549415bcf0 2024-04-25T09:07:55.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.400+0000 7f5491600640 1 -- 172.21.15.59:0/3096196389 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f548c0adc30 con 0x7f549415bcf0 2024-04-25T09:07:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.400+0000 7f5491600640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5474066fb0 0x7f5474069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.400+0000 7f5491600640 1 -- 172.21.15.59:0/3096196389 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f548c120370 con 0x7f549415bcf0 2024-04-25T09:07:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.400+0000 7f5499400640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5474066fb0 0x7f5474069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.400+0000 7f549f35e000 1 Processor -- start 2024-04-25T09:07:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.400+0000 7f549f35e000 1 -- start start 2024-04-25T09:07:55.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5499400640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5474066fb0 0x7f5474069470 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5488009af0 tx=0x7f5488008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21858920 0x556b21858d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b2180e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b2180f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b216f65f0 con 0x556b2180ef30 2024-04-25T09:07:55.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b2165dda0 con 0x556b21858920 2024-04-25T09:07:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b215e6150 con 0x556b21859240 2024-04-25T09:07:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5499e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b2180f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5499e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b2180f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36438/0 (socket says 172.21.15.59:36438) 2024-04-25T09:07:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5498a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b2180e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5499e00640 1 -- 172.21.15.59:0/3142954701 learned_addr learned my addr 172.21.15.59:0/3142954701 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5499400640 1 --2- 172.21.15.59:0/3142954701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21858920 0x556b21858d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5499e00640 1 -- 172.21.15.59:0/3142954701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 msgr2=0x556b2180e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5499e00640 1 --2- 172.21.15.59:0/3142954701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b2180e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5499e00640 1 -- 172.21.15.59:0/3142954701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21858920 msgr2=0x556b21858d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5499e00640 1 --2- 172.21.15.59:0/3142954701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21858920 0x556b21858d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5499e00640 1 -- 172.21.15.59:0/3142954701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b215ffca0 con 0x556b2180ef30 2024-04-25T09:07:55.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5499e00640 1 --2- 172.21.15.59:0/3142954701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b2180f310 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f548c0f8cb0 tx=0x7f548c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b95369bd416083a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5486000640 1 -- 172.21.15.59:0/3142954701 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0f0ad0 con 0x556b2180ef30 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5486000640 1 -- 172.21.15.59:0/3142954701 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c0b3040 con 0x556b2180ef30 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f5486000640 1 -- 172.21.15.59:0/3142954701 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c0f4c20 con 0x556b2180ef30 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 -- 172.21.15.59:0/3142954701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 msgr2=0x556b2180f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 --2- 172.21.15.59:0/3142954701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b2180f310 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f548c0f8cb0 tx=0x7f548c009750 comp rx=0 tx=0).stop 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 -- 172.21.15.59:0/3142954701 shutdown_connections 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 --2- 172.21.15.59:0/3142954701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b2180f310 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 --2- 172.21.15.59:0/3142954701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b2180e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 --2- 172.21.15.59:0/3142954701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21858920 0x556b21858d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 -- 172.21.15.59:0/3142954701 >> 172.21.15.59:0/3142954701 conn(0x556b218152a0 msgr2=0x556b2180d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 -- 172.21.15.59:0/3142954701 shutdown_connections 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 -- 172.21.15.59:0/3142954701 wait complete. 2024-04-25T09:07:55.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 -- start start 2024-04-25T09:07:55.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.404+0000 7f549f35e000 1 Processor -- start 2024-04-25T09:07:55.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b2185fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21858920 0x556b218601c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b21812aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b21618990 con 0x556b2180ef30 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b21659e40 con 0x556b21858920 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b215e9900 con 0x556b21859240 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 10 client.0 _ll_register_callbacks cb 0x556b217111c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5499400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b2185fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5499400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b2185fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36448/0 (socket says 172.21.15.59:36448) 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5499400640 1 -- 172.21.15.59:0/639576156 learned_addr learned my addr 172.21.15.59:0/639576156 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5499e00640 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b21812aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5498a00640 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21858920 0x556b218601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5499400640 1 -- 172.21.15.59:0/639576156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 msgr2=0x556b21812aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5499400640 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b21812aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5499400640 1 -- 172.21.15.59:0/639576156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21858920 msgr2=0x556b218601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5499400640 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21858920 0x556b218601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5499400640 1 -- 172.21.15.59:0/639576156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b21616630 con 0x556b2180ef30 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5499400640 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b2185fc80 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f5488015890 tx=0x7f54880046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d5b30bfe65a20a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f547aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f547aa00640 1 -- 172.21.15.59:0/639576156 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488015e10 con 0x556b2180ef30 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f547aa00640 1 -- 172.21.15.59:0/639576156 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5488014960 con 0x556b2180ef30 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 1 -- 172.21.15.59:0/639576156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f548c0b3040 con 0x556b2180ef30 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f547aa00640 1 -- 172.21.15.59:0/639576156 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5488032050 con 0x556b2180ef30 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 10 client.7596 fetch_fsmap learned FSMap version 65 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 1 -- 172.21.15.59:0/639576156 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x556b215e63a0 con 0x556b2180ef30 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f547aa00640 1 -- 172.21.15.59:0/639576156 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c0b3040 con 0x556b2180ef30 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f547aa00640 1 -- 172.21.15.59:0/639576156 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f5488014b60 con 0x556b2180ef30 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 10 client.7596 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 10 client.7596 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 20 client.7596 populate_metadata read hostname 'smithi059' 2024-04-25T09:07:55.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.59:6833/3531112441,v1:172.21.15.59:6835/3531112441] conn(0x556b218134b0 0x556b21813890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 4 client.7596 mds_command: new command op to 7458 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:07:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f549f35e000 1 -- 172.21.15.59:0/639576156 --> [v2:172.21.15.59:6833/3531112441,v1:172.21.15.59:6835/3531112441] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b215f9a50 con 0x556b218134b0 2024-04-25T09:07:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5498a00640 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.59:6833/3531112441,v1:172.21.15.59:6835/3531112441] conn(0x556b218134b0 0x556b21813890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f5498a00640 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.59:6833/3531112441,v1:172.21.15.59:6835/3531112441] conn(0x556b218134b0 0x556b21813890 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12e50a00aa5711d server_cookie=2114a936a290727c in_seq=0 out_seq=0 2024-04-25T09:07:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f547aa00640 10 client.7596 ms_handle_connect on v2:172.21.15.59:6833/3531112441 2024-04-25T09:07:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.408+0000 7f547aa00640 1 -- 172.21.15.59:0/639576156 <== mds.0 v2:172.21.15.59:6833/3531112441 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556b215f9a50 con 0x556b218134b0 2024-04-25T09:07:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f547aa00640 10 client.7596 handle_command_reply: tid=0 2024-04-25T09:07:55.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f549f35e000 1 client.7596 shutdown 2024-04-25T09:07:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f549f35e000 1 -- 172.21.15.59:0/639576156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 msgr2=0x556b2185fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f549f35e000 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b2185fc80 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f5488015890 tx=0x7f54880046d0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f549f35e000 1 -- 172.21.15.59:0/639576156 shutdown_connections 2024-04-25T09:07:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f549f35e000 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.59:6833/3531112441,v1:172.21.15.59:6835/3531112441] conn(0x556b218134b0 0x556b21813890 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f549f35e000 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b21812aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f549f35e000 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21858920 0x556b218601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f549f35e000 1 --2- 172.21.15.59:0/639576156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b2185fc80 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f547aa00640 0 client.7596 ms_handle_reset on v2:172.21.15.59:6833/3531112441 2024-04-25T09:07:55.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f549f35e000 1 -- 172.21.15.59:0/639576156 >> 172.21.15.59:0/639576156 conn(0x556b218152a0 msgr2=0x556b2180d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:55.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f549f35e000 1 -- 172.21.15.59:0/639576156 shutdown_connections 2024-04-25T09:07:55.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f549f35e000 1 -- 172.21.15.59:0/639576156 wait complete. 2024-04-25T09:07:55.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.412+0000 7f549f35e000 20 client.7596 trim_cache size 0 max 16384 2024-04-25T09:07:55.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 Processor -- start 2024-04-25T09:07:55.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 -- start start 2024-04-25T09:07:55.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b218628b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21858920 0x556b21862df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21859240 0x556b21863330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5494202ae0 con 0x556b2180ef30 2024-04-25T09:07:55.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54940b60f0 con 0x556b21859240 2024-04-25T09:07:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54941f7ce0 con 0x556b21858920 2024-04-25T09:07:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5499400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b218628b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5499400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b218628b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36456/0 (socket says 172.21.15.59:36456) 2024-04-25T09:07:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5499400640 1 -- 172.21.15.59:0/4008466387 learned_addr learned my addr 172.21.15.59:0/4008466387 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5499e00640 1 --2- 172.21.15.59:0/4008466387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21859240 0x556b21863330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5498a00640 1 --2- 172.21.15.59:0/4008466387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21858920 0x556b21862df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5499400640 1 -- 172.21.15.59:0/4008466387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21858920 msgr2=0x556b21862df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5499400640 1 --2- 172.21.15.59:0/4008466387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21858920 0x556b21862df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5499400640 1 -- 172.21.15.59:0/4008466387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21859240 msgr2=0x556b21863330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5499400640 1 --2- 172.21.15.59:0/4008466387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21859240 0x556b21863330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5499400640 1 -- 172.21.15.59:0/4008466387 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b21859070 con 0x556b2180ef30 2024-04-25T09:07:55.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5499e00640 1 --2- 172.21.15.59:0/4008466387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21859240 0x556b21863330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5498a00640 1 --2- 172.21.15.59:0/4008466387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21858920 0x556b21862df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5499400640 1 --2- 172.21.15.59:0/4008466387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b218628b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f5488011a30 tx=0x7f5488023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5597470aa71646ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5485600640 1 -- 172.21.15.59:0/4008466387 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488015e10 con 0x556b2180ef30 2024-04-25T09:07:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5485600640 1 -- 172.21.15.59:0/4008466387 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548801a030 con 0x556b2180ef30 2024-04-25T09:07:55.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f5485600640 1 -- 172.21.15.59:0/4008466387 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54880149d0 con 0x556b2180ef30 2024-04-25T09:07:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 -- 172.21.15.59:0/4008466387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 msgr2=0x556b218628b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 --2- 172.21.15.59:0/4008466387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b218628b0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f5488011a30 tx=0x7f5488023000 comp rx=0 tx=0).stop 2024-04-25T09:07:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 -- 172.21.15.59:0/4008466387 shutdown_connections 2024-04-25T09:07:55.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 --2- 172.21.15.59:0/4008466387 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b21859240 0x556b21863330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 --2- 172.21.15.59:0/4008466387 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21858920 0x556b21862df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 --2- 172.21.15.59:0/4008466387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b2180ef30 0x556b218628b0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 -- 172.21.15.59:0/4008466387 >> 172.21.15.59:0/4008466387 conn(0x556b218152a0 msgr2=0x556b21844b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 -- 172.21.15.59:0/4008466387 shutdown_connections 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 -- 172.21.15.59:0/4008466387 wait complete. 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.428+0000 7f549f35e000 1 -- start start 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 Processor -- start 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b2180ef30 0x556b21865e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b21858920 0x556b218b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b218b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b216623d0 con 0x556b21858920 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b21719d50 con 0x556b2180ef30 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b215f8980 con 0x556b21859240 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 10 client.0 _ll_register_callbacks cb 0x7f548c009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:07:55.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5498a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b21858920 0x556b218b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5498a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b21858920 0x556b218b8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36464/0 (socket says 172.21.15.59:36464) 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5498a00640 1 -- 172.21.15.59:0/579864880 learned_addr learned my addr 172.21.15.59:0/579864880 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5499400640 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b2180ef30 0x556b21865e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5499e00640 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b218b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5498a00640 1 -- 172.21.15.59:0/579864880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 msgr2=0x556b218b8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5498a00640 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b218b8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5498a00640 1 -- 172.21.15.59:0/579864880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b2180ef30 msgr2=0x556b21865e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5498a00640 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b2180ef30 0x556b21865e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5498a00640 1 -- 172.21.15.59:0/579864880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b216df600 con 0x556b21858920 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5499e00640 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b218b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5498a00640 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b21858920 0x556b218b8760 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f5480000f70 tx=0x7f5480007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcdc36d0881dcc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f547aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f547aa00640 1 -- 172.21.15.59:0/579864880 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480018a70 con 0x556b21858920 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 -- 172.21.15.59:0/579864880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f548801a030 con 0x556b21858920 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f547aa00640 1 -- 172.21.15.59:0/579864880 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5480018c10 con 0x556b21858920 2024-04-25T09:07:55.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f547aa00640 1 -- 172.21.15.59:0/579864880 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f548002b050 con 0x556b21858920 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 10 client.7602 fetch_fsmap learned FSMap version 65 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 -- 172.21.15.59:0/579864880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) v3 -- 0x556b215f29b0 con 0x556b21858920 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f547aa00640 1 -- 172.21.15.59:0/579864880 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548801a030 con 0x556b21858920 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f547aa00640 1 -- 172.21.15.59:0/579864880 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 65) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f548002e020 con 0x556b21858920 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 10 client.7602 fetch_fsmap finished waiting for FSMap version 65 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 10 client.7602 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 20 client.7602 populate_metadata read hostname 'smithi059' 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.59:6833/3531112441,v1:172.21.15.59:6835/3531112441] conn(0x556b21874330 0x556b21874710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 4 client.7602 mds_command: new command op to 7458 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 -- 172.21.15.59:0/579864880 --> [v2:172.21.15.59:6833/3531112441,v1:172.21.15.59:6835/3531112441] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556b2166b2e0 con 0x556b21874330 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5499400640 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.59:6833/3531112441,v1:172.21.15.59:6835/3531112441] conn(0x556b21874330 0x556b21874710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f547aa00640 10 client.7602 ms_handle_connect on v2:172.21.15.59:6833/3531112441 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f5499400640 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.59:6833/3531112441,v1:172.21.15.59:6835/3531112441] conn(0x556b21874330 0x556b21874710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78e139f3b1c460c5 server_cookie=be0312aa7f7439e in_seq=0 out_seq=0 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f547aa00640 1 -- 172.21.15.59:0/579864880 <== mds.0 v2:172.21.15.59:6833/3531112441 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x556b2166b2e0 con 0x556b21874330 2024-04-25T09:07:55.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f547aa00640 10 client.7602 handle_command_reply: tid=0 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 client.7602 shutdown 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.432+0000 7f549f35e000 1 -- 172.21.15.59:0/579864880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b21858920 msgr2=0x556b218b8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549f35e000 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b21858920 0x556b218b8760 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f5480000f70 tx=0x7f5480007850 comp rx=0 tx=0).stop 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549f35e000 1 -- 172.21.15.59:0/579864880 shutdown_connections 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549f35e000 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.59:6833/3531112441,v1:172.21.15.59:6835/3531112441] conn(0x556b21874330 0x556b21874710 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549f35e000 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x556b21859240 0x556b218b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549f35e000 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556b21858920 0x556b218b8760 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f547aa00640 0 client.7602 ms_handle_reset on v2:172.21.15.59:6833/3531112441 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549f35e000 1 --2- 172.21.15.59:0/579864880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x556b2180ef30 0x556b21865e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549f35e000 1 -- 172.21.15.59:0/579864880 >> 172.21.15.59:0/579864880 conn(0x556b218152a0 msgr2=0x556b21811320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549f35e000 1 -- 172.21.15.59:0/579864880 shutdown_connections 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549f35e000 1 -- 172.21.15.59:0/579864880 wait complete. 2024-04-25T09:07:55.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549f35e000 20 client.7602 trim_cache size 0 max 16384 2024-04-25T09:07:55.428 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:07:55.428 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:07:55.428 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:07:55.428 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7458, 2024-04-25T09:07:55.428 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:07:55.428 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:07:55.428 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:07:55.428 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 5.9452964250000004, 2024-04-25T09:07:55.428 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 65, 2024-04-25T09:07:55.428 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 92, 2024-04-25T09:07:55.428 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 92, 2024-04-25T09:07:55.429 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 10.850929556000001 2024-04-25T09:07:55.429 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:07:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549be00640 1 -- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5474066fb0 msgr2=0x7f5474069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549be00640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5474066fb0 0x7f5474069470 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5488009af0 tx=0x7f5488008040 comp rx=0 tx=0).stop 2024-04-25T09:07:55.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549be00640 1 -- 172.21.15.59:0/3096196389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549415bcf0 msgr2=0x7f5494164030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549be00640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549415bcf0 0x7f5494164030 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f548c009d90 tx=0x7f548c0196e0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549be00640 1 -- 172.21.15.59:0/3096196389 shutdown_connections 2024-04-25T09:07:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549be00640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5474066fb0 0x7f5474069470 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549be00640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f549415bcf0 0x7f5494164030 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549be00640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f549415b910 0x7f54941587a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549be00640 1 --2- 172.21.15.59:0/3096196389 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f54940cf3c0 0x7f549406c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549be00640 1 -- 172.21.15.59:0/3096196389 >> 172.21.15.59:0/3096196389 conn(0x7f54940b3200 msgr2=0x7f549409a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549be00640 1 -- 172.21.15.59:0/3096196389 shutdown_connections 2024-04-25T09:07:55.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.436+0000 7f549be00640 1 -- 172.21.15.59:0/3096196389 wait complete. 2024-04-25T09:07:55.443 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:07:55.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.596+0000 7f9454c00640 1 Processor -- start 2024-04-25T09:07:55.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.596+0000 7f9454c00640 1 -- start start 2024-04-25T09:07:55.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f9454c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94500cef30 0x7f945006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f9454c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f945006e900 0x7f94500b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f9454c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f945015ac60 con 0x7f9450144140 2024-04-25T09:07:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f9454c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f945006ed50 con 0x7f94500cef30 2024-04-25T09:07:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f9454c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94500cf3e0 con 0x7f945006e900 2024-04-25T09:07:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f9445400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94500cef30 0x7f945006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f944de00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9450144140 0x7f94500ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47188/0 (socket says 172.21.15.59:47188) 2024-04-25T09:07:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f944de00640 1 -- 172.21.15.59:0/2163838547 learned_addr learned my addr 172.21.15.59:0/2163838547 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f944e800640 1 --2- 172.21.15.59:0/2163838547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f945006e900 0x7f94500b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f9445400640 1 -- 172.21.15.59:0/2163838547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f945006e900 msgr2=0x7f94500b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f9445400640 1 --2- 172.21.15.59:0/2163838547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f945006e900 0x7f94500b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f9445400640 1 -- 172.21.15.59:0/2163838547 >> v1:172.21.15.59:6789/0 conn(0x7f9450144140 legacy=0x7f94500ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.600+0000 7f9445400640 1 -- 172.21.15.59:0/2163838547 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f945015af20 con 0x7f94500cef30 2024-04-25T09:07:55.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f9445400640 1 --2- 172.21.15.59:0/2163838547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500cef30 0x7f945006e3c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f94380097c0 tx=0x7f943801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc745261ffde43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f944d400640 1 -- 172.21.15.59:0/2163838547 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94380b0070 con 0x7f94500cef30 2024-04-25T09:07:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f944d400640 1 -- 172.21.15.59:0/2163838547 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94380ab600 con 0x7f94500cef30 2024-04-25T09:07:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f944d400640 1 -- 172.21.15.59:0/2163838547 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94380ab9d0 con 0x7f94500cef30 2024-04-25T09:07:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f9454c00640 1 -- 172.21.15.59:0/2163838547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500cef30 msgr2=0x7f945006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f9454c00640 1 --2- 172.21.15.59:0/2163838547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500cef30 0x7f945006e3c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f94380097c0 tx=0x7f943801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f9454c00640 1 -- 172.21.15.59:0/2163838547 shutdown_connections 2024-04-25T09:07:55.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f9454c00640 1 --2- 172.21.15.59:0/2163838547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f945006e900 0x7f94500b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f9454c00640 1 --2- 172.21.15.59:0/2163838547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500cef30 0x7f945006e3c0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f9454c00640 1 -- 172.21.15.59:0/2163838547 >> 172.21.15.59:0/2163838547 conn(0x7f9450066fa0 msgr2=0x7f945006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:55.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f9454c00640 1 -- 172.21.15.59:0/2163838547 shutdown_connections 2024-04-25T09:07:55.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f9454c00640 1 -- 172.21.15.59:0/2163838547 wait complete. 2024-04-25T09:07:55.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f9454c00640 1 Processor -- start 2024-04-25T09:07:55.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.604+0000 7f9454c00640 1 -- start start 2024-04-25T09:07:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9454c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f945006e900 0x7f9450154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9454c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500cef30 0x7f9450151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9454c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9450144140 0x7f94500b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9454c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f945015ba00 con 0x7f94500cef30 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9454c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9450144520 con 0x7f945006e900 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9454c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f945015bb80 con 0x7f9450144140 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9445400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500cef30 0x7f9450151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9445400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500cef30 0x7f9450151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36482/0 (socket says 172.21.15.59:36482) 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9445400640 1 -- 172.21.15.59:0/370030784 learned_addr learned my addr 172.21.15.59:0/370030784 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f944e800640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9450144140 0x7f94500b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f944de00640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f945006e900 0x7f9450154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9445400640 1 -- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9450144140 msgr2=0x7f94500b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9445400640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9450144140 0x7f94500b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9445400640 1 -- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f945006e900 msgr2=0x7f9450154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9445400640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f945006e900 0x7f9450154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9445400640 1 -- 172.21.15.59:0/370030784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9450154cb0 con 0x7f94500cef30 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f944de00640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f945006e900 0x7f9450154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:55.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9445400640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500cef30 0x7f9450151190 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f94380ae040 tx=0x7f9438019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:55.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9446a00640 1 -- 172.21.15.59:0/370030784 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94380ba070 con 0x7f94500cef30 2024-04-25T09:07:55.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9446a00640 1 -- 172.21.15.59:0/370030784 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94380abbf0 con 0x7f94500cef30 2024-04-25T09:07:55.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9446a00640 1 -- 172.21.15.59:0/370030784 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94380b0040 con 0x7f94500cef30 2024-04-25T09:07:55.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9454c00640 1 -- 172.21.15.59:0/370030784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f945015f380 con 0x7f94500cef30 2024-04-25T09:07:55.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9454c00640 1 -- 172.21.15.59:0/370030784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f945015f940 con 0x7f94500cef30 2024-04-25T09:07:55.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9454c00640 1 -- 172.21.15.59:0/370030784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94500745d0 con 0x7f94500cef30 2024-04-25T09:07:55.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.608+0000 7f9446a00640 1 -- 172.21.15.59:0/370030784 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f94380b43f0 con 0x7f94500cef30 2024-04-25T09:07:55.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.612+0000 7f9446a00640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f942c066f50 0x7f942c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:55.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.612+0000 7f9446a00640 1 -- 172.21.15.59:0/370030784 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f943811e090 con 0x7f94500cef30 2024-04-25T09:07:55.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.612+0000 7f944de00640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f942c066f50 0x7f942c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:55.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.612+0000 7f944de00640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f942c066f50 0x7f942c069410 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9440007fd0 tx=0x7f9440009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:55.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.616+0000 7f9446a00640 1 -- 172.21.15.59:0/370030784 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9438016090 con 0x7f94500cef30 2024-04-25T09:07:55.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 -- 172.21.15.59:0/370030784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f945006d950 con 0x7f94500cef30 2024-04-25T09:07:55.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9446a00640 1 -- 172.21.15.59:0/370030784 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) v1 ==== 53+0+73 (secure 0 0 0) 0x7f94380eee70 con 0x7f94500cef30 2024-04-25T09:07:55.804 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:07:55.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 -- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f942c066f50 msgr2=0x7f942c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f942c066f50 0x7f942c069410 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f9440007fd0 tx=0x7f9440009040 comp rx=0 tx=0).stop 2024-04-25T09:07:55.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 -- 172.21.15.59:0/370030784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500cef30 msgr2=0x7f9450151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:55.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500cef30 0x7f9450151190 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f94380ae040 tx=0x7f9438019240 comp rx=0 tx=0).stop 2024-04-25T09:07:55.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 -- 172.21.15.59:0/370030784 shutdown_connections 2024-04-25T09:07:55.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f942c066f50 0x7f942c069410 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9450144140 0x7f94500b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500cef30 0x7f9450151190 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 --2- 172.21.15.59:0/370030784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f945006e900 0x7f9450154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:55.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 -- 172.21.15.59:0/370030784 >> 172.21.15.59:0/370030784 conn(0x7f9450066fa0 msgr2=0x7f945015bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:55.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 -- 172.21.15.59:0/370030784 shutdown_connections 2024-04-25T09:07:55.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:55.816+0000 7f9454c00640 1 -- 172.21.15.59:0/370030784 wait complete. 2024-04-25T09:07:55.826 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:07:55.827 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:07:55.827 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:07:55.827 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:07:55.827 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:55.827 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:07:55.827 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:07:55.827 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:07:55.827 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:07:55.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:55.827 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:07:55.837 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42092sec preferred_lft 42092sec 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:55.838 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:07:55.839 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:07:55.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:55.840 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:07:55.900 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:07:55.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:55.903 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:07:55.956 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:07:55.956 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:07:55.956 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:07:55.956 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:07:55.956 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:07:55.956 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:07:55.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:55.957 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:07:55.957 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:07:55.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:07:55.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:07:55.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:07:55.957 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:07:56.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:56.049 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:07:56.058 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:07:56.059 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:07:56.059 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:07:56.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:56.059 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:07:56.122 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:07:56.122 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:56.170 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:07:56.171 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:07:56.171 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:56.222 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:07:56.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:56.223 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:56.312 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:56.312 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:07:56.312 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:07:56.327 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:56.328 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:07:56.328 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:07:56.328 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:07:56.328 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:07:56.337 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:07:56.337 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:07:56.337 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:07:56.337 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:07:56.337 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:07:56.337 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:07:56.337 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:07:56.337 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:07:56.341 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:07:56.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:56.341 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:56.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:56.361 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:07:56.421 INFO:teuthology.orchestra.run.smithi059.stdout:client6473 2024-04-25T09:07:56.421 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:07:56.421 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:56.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:56.470 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-04-25T09:07:56.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:56.532 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-04-25T09:07:56.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:56.585 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-04-25T09:07:56.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:56.637 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-04-25T09:07:56.693 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:07:56.693 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:07:56.693 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:07:56.693 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:07:56.693 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-04-25T09:07:56.693 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:07:56.801 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627776 2024-04-25T09:07:56.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:07:56.811 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:07:56.811 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:56.863 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:07:56.863 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:07:56.919 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:07:57.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.112+0000 7f6da3800640 1 Processor -- start 2024-04-25T09:07:57.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.112+0000 7f6da3800640 1 -- start start 2024-04-25T09:07:57.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.116+0000 7f6da3800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d9c15b2f0 0x7f6d9c0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.116+0000 7f6da3800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c06edc0 con 0x7f6d9c0b2dc0 2024-04-25T09:07:57.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.116+0000 7f6da3800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c15def0 con 0x7f6d9c06dad0 2024-04-25T09:07:57.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.116+0000 7f6da3800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9c15e1b0 con 0x7f6d9c15b2f0 2024-04-25T09:07:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.116+0000 7f6da0e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d9c15b2f0 0x7f6d9c0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.116+0000 7f6d9be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6d9c0b2dc0 0x7f6d9c06dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47204/0 (socket says 172.21.15.59:47204) 2024-04-25T09:07:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.116+0000 7f6d9be00640 1 -- 172.21.15.59:0/3864451861 learned_addr learned my addr 172.21.15.59:0/3864451861 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.116+0000 7f6da0e00640 1 -- 172.21.15.59:0/3864451861 >> v1:172.21.15.178:6789/0 conn(0x7f6d9c06dad0 legacy=0x7f6d9c06e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.116+0000 7f6da0e00640 1 -- 172.21.15.59:0/3864451861 >> v1:172.21.15.59:6789/0 conn(0x7f6d9c0b2dc0 legacy=0x7f6d9c06dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.116+0000 7f6da0e00640 1 -- 172.21.15.59:0/3864451861 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c15e490 con 0x7f6d9c15b2f0 2024-04-25T09:07:57.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.116+0000 7f6d9b400640 1 -- 172.21.15.59:0/3864451861 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158390110 0 0) 0x7f6d9c06edc0 con 0x7f6d9c0b2dc0 2024-04-25T09:07:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6da0e00640 1 --2- 172.21.15.59:0/3864451861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c15b2f0 0x7f6d9c0b3240 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f6d900097c0 tx=0x7f6d9001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7b7db97f087afb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6d9b400640 1 -- 172.21.15.59:0/3864451861 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d900a7070 con 0x7f6d9c15b2f0 2024-04-25T09:07:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6d9b400640 1 -- 172.21.15.59:0/3864451861 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d900b0070 con 0x7f6d9c15b2f0 2024-04-25T09:07:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6d9b400640 1 -- 172.21.15.59:0/3864451861 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d900ab890 con 0x7f6d9c15b2f0 2024-04-25T09:07:57.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6da3800640 1 -- 172.21.15.59:0/3864451861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c15b2f0 msgr2=0x7f6d9c0b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6da3800640 1 --2- 172.21.15.59:0/3864451861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c15b2f0 0x7f6d9c0b3240 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f6d900097c0 tx=0x7f6d9001c470 comp rx=0 tx=0).stop 2024-04-25T09:07:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6da3800640 1 -- 172.21.15.59:0/3864451861 shutdown_connections 2024-04-25T09:07:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6da3800640 1 --2- 172.21.15.59:0/3864451861 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c15b2f0 0x7f6d9c0b3240 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6da3800640 1 -- 172.21.15.59:0/3864451861 >> 172.21.15.59:0/3864451861 conn(0x7f6d9c0b23b0 msgr2=0x7f6d9c0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6da3800640 1 -- 172.21.15.59:0/3864451861 shutdown_connections 2024-04-25T09:07:57.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6da3800640 1 -- 172.21.15.59:0/3864451861 wait complete. 2024-04-25T09:07:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6da3800640 1 Processor -- start 2024-04-25T09:07:57.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.120+0000 7f6da3800640 1 -- start start 2024-04-25T09:07:57.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da3800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c06dad0 0x7f6d9c152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da3800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9c0b2dc0 0x7f6d9c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da3800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d9c15b2f0 0x7f6d9c160070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da3800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c0b3b90 con 0x7f6d9c06dad0 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da3800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c15b8e0 con 0x7f6d9c15b2f0 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da3800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c1614e0 con 0x7f6d9c0b2dc0 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c06dad0 0x7f6d9c152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c06dad0 0x7f6d9c152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36504/0 (socket says 172.21.15.59:36504) 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da0e00640 1 -- 172.21.15.59:0/2730063306 learned_addr learned my addr 172.21.15.59:0/2730063306 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da1800640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d9c15b2f0 0x7f6d9c160070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6d9be00640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9c0b2dc0 0x7f6d9c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da0e00640 1 -- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9c0b2dc0 msgr2=0x7f6d9c159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da0e00640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9c0b2dc0 0x7f6d9c159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da0e00640 1 -- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d9c15b2f0 msgr2=0x7f6d9c160070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da0e00640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d9c15b2f0 0x7f6d9c160070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da0e00640 1 -- 172.21.15.59:0/2730063306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c0cd0f0 con 0x7f6d9c06dad0 2024-04-25T09:07:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da0e00640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c06dad0 0x7f6d9c152ca0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6d900097c0 tx=0x7f6d9001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6d98c00640 1 -- 172.21.15.59:0/2730063306 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90004230 con 0x7f6d9c06dad0 2024-04-25T09:07:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6d98c00640 1 -- 172.21.15.59:0/2730063306 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d900043f0 con 0x7f6d9c06dad0 2024-04-25T09:07:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6d98c00640 1 -- 172.21.15.59:0/2730063306 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90003860 con 0x7f6d9c06dad0 2024-04-25T09:07:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da3800640 1 -- 172.21.15.59:0/2730063306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c15a9b0 con 0x7f6d9c06dad0 2024-04-25T09:07:57.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da3800640 1 -- 172.21.15.59:0/2730063306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c0cd390 con 0x7f6d9c06dad0 2024-04-25T09:07:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6da3800640 1 -- 172.21.15.59:0/2730063306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c0745d0 con 0x7f6d9c06dad0 2024-04-25T09:07:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.124+0000 7f6d98c00640 1 -- 172.21.15.59:0/2730063306 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d90003a00 con 0x7f6d9c06dad0 2024-04-25T09:07:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.128+0000 7f6d98c00640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d7c066f60 0x7f6d7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.128+0000 7f6d98c00640 1 -- 172.21.15.59:0/2730063306 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6d9011fe70 con 0x7f6d9c06dad0 2024-04-25T09:07:57.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.128+0000 7f6d9be00640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d7c066f60 0x7f6d7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.128+0000 7f6d9be00640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d7c066f60 0x7f6d7c069420 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c157370 tx=0x7f6d88007ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:57.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.132+0000 7f6d98c00640 1 -- 172.21.15.59:0/2730063306 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6d90016090 con 0x7f6d9c06dad0 2024-04-25T09:07:57.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.292+0000 7f6da3800640 1 -- 172.21.15.59:0/2730063306 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d9c0d0ab0 con 0x7f6d9c06dad0 2024-04-25T09:07:57.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.292+0000 7f6d98c00640 1 -- 172.21.15.59:0/2730063306 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) v1 ==== 74+0+16885 (secure 0 0 0) 0x7f6d900aae90 con 0x7f6d9c06dad0 2024-04-25T09:07:57.281 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:57.282 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":92,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:07:50.506465+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:47.301822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:47.878097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:07:57.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.296+0000 7f6da3800640 1 -- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d7c066f60 msgr2=0x7f6d7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.296+0000 7f6da3800640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d7c066f60 0x7f6d7c069420 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c157370 tx=0x7f6d88007ba0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.296+0000 7f6da3800640 1 -- 172.21.15.59:0/2730063306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c06dad0 msgr2=0x7f6d9c152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.296+0000 7f6da3800640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c06dad0 0x7f6d9c152ca0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f6d900097c0 tx=0x7f6d9001acb0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.296+0000 7f6da3800640 1 -- 172.21.15.59:0/2730063306 shutdown_connections 2024-04-25T09:07:57.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.296+0000 7f6da3800640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d7c066f60 0x7f6d7c069420 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.296+0000 7f6da3800640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d9c15b2f0 0x7f6d9c160070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.296+0000 7f6da3800640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9c0b2dc0 0x7f6d9c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.296+0000 7f6da3800640 1 --2- 172.21.15.59:0/2730063306 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d9c06dad0 0x7f6d9c152ca0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.296+0000 7f6da3800640 1 -- 172.21.15.59:0/2730063306 >> 172.21.15.59:0/2730063306 conn(0x7f6d9c0b23b0 msgr2=0x7f6d9c0b1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:57.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.296+0000 7f6da3800640 1 -- 172.21.15.59:0/2730063306 shutdown_connections 2024-04-25T09:07:57.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.296+0000 7f6da3800640 1 -- 172.21.15.59:0/2730063306 wait complete. 2024-04-25T09:07:57.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:07:47.301822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:07:47.878097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:07:57.303 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:07:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d5cc00640 1 Processor -- start 2024-04-25T09:07:57.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d5cc00640 1 -- start start 2024-04-25T09:07:57.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d5cc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d58150f40 0x7f6d5806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d5cc00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5815e9a0 con 0x7f6d58072210 2024-04-25T09:07:57.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d5cc00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d5815b3d0 con 0x7f6d5815af40 2024-04-25T09:07:57.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d5cc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d5806f530 con 0x7f6d58150f40 2024-04-25T09:07:57.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d55e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d58150f40 0x7f6d5806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d55e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d58150f40 0x7f6d5806ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36510/0 (socket says 172.21.15.59:36510) 2024-04-25T09:07:57.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d55e00640 1 -- 172.21.15.59:0/1143669946 learned_addr learned my addr 172.21.15.59:0/1143669946 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:57.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d56800640 1 --1- 172.21.15.59:0/1143669946 >> v1:172.21.15.59:6789/0 conn(0x7f6d58072210 0x7f6d580cdcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47210/0 (socket says 172.21.15.59:47210) 2024-04-25T09:07:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d55e00640 1 -- 172.21.15.59:0/1143669946 >> v1:172.21.15.178:6789/0 conn(0x7f6d5815af40 legacy=0x7f6d58071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d55e00640 1 -- 172.21.15.59:0/1143669946 >> v1:172.21.15.59:6789/0 conn(0x7f6d58072210 legacy=0x7f6d580cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.460+0000 7f6d55e00640 1 -- 172.21.15.59:0/1143669946 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d5815dbe0 con 0x7f6d58150f40 2024-04-25T09:07:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.464+0000 7f6d55e00640 1 --2- 172.21.15.59:0/1143669946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58150f40 0x7f6d5806ef50 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009e50 tx=0x7f6d4801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b53b4fcfc02cb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:57.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.464+0000 7f6d55400640 1 -- 172.21.15.59:0/1143669946 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d480a5550 con 0x7f6d58150f40 2024-04-25T09:07:57.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.464+0000 7f6d55400640 1 -- 172.21.15.59:0/1143669946 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d480a56f0 con 0x7f6d58150f40 2024-04-25T09:07:57.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.464+0000 7f6d55400640 1 -- 172.21.15.59:0/1143669946 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d480a5ac0 con 0x7f6d58150f40 2024-04-25T09:07:57.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.464+0000 7f6d5cc00640 1 -- 172.21.15.59:0/1143669946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58150f40 msgr2=0x7f6d5806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.464+0000 7f6d5cc00640 1 --2- 172.21.15.59:0/1143669946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58150f40 0x7f6d5806ef50 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009e50 tx=0x7f6d4801c910 comp rx=0 tx=0).stop 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.464+0000 7f6d5cc00640 1 -- 172.21.15.59:0/1143669946 shutdown_connections 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.464+0000 7f6d5cc00640 1 --2- 172.21.15.59:0/1143669946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58150f40 0x7f6d5806ef50 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.464+0000 7f6d5cc00640 1 -- 172.21.15.59:0/1143669946 >> 172.21.15.59:0/1143669946 conn(0x7f6d58067080 msgr2=0x7f6d5806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.464+0000 7f6d5cc00640 1 -- 172.21.15.59:0/1143669946 shutdown_connections 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.464+0000 7f6d5cc00640 1 -- 172.21.15.59:0/1143669946 wait complete. 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d5cc00640 1 Processor -- start 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d5cc00640 1 -- start start 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d5cc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d58072210 0x7f6d58157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d5cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58150f40 0x7f6d5814eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d5cc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d5815af40 0x7f6d580b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d5cc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580ce550 con 0x7f6d58150f40 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d5cc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580ce3d0 con 0x7f6d5815af40 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d5cc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d580ce6d0 con 0x7f6d58072210 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d4d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58150f40 0x7f6d5814eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d4d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58150f40 0x7f6d5814eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36516/0 (socket says 172.21.15.59:36516) 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d4d400640 1 -- 172.21.15.59:0/974166754 learned_addr learned my addr 172.21.15.59:0/974166754 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d55e00640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d58072210 0x7f6d58157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d56800640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d5815af40 0x7f6d580b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d4d400640 1 -- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d58072210 msgr2=0x7f6d58157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d4d400640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d58072210 0x7f6d58157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d4d400640 1 -- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d5815af40 msgr2=0x7f6d580b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d4d400640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d5815af40 0x7f6d580b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d4d400640 1 -- 172.21.15.59:0/974166754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d580b05a0 con 0x7f6d58150f40 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d4d400640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58150f40 0x7f6d5814eb70 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000c370 tx=0x7f6d4000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d4ea00640 1 -- 172.21.15.59:0/974166754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d400052d0 con 0x7f6d58150f40 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d4ea00640 1 -- 172.21.15.59:0/974166754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d40005470 con 0x7f6d58150f40 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d4ea00640 1 -- 172.21.15.59:0/974166754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40007260 con 0x7f6d58150f40 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d5cc00640 1 -- 172.21.15.59:0/974166754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d580b0880 con 0x7f6d58150f40 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.468+0000 7f6d5cc00640 1 -- 172.21.15.59:0/974166754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5814f0b0 con 0x7f6d58150f40 2024-04-25T09:07:57.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.472+0000 7f6d5cc00640 1 -- 172.21.15.59:0/974166754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d58154b80 con 0x7f6d58150f40 2024-04-25T09:07:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.472+0000 7f6d4ea00640 1 -- 172.21.15.59:0/974166754 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d40007400 con 0x7f6d58150f40 2024-04-25T09:07:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.472+0000 7f6d4ea00640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d34066f60 0x7f6d34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.472+0000 7f6d4ea00640 1 -- 172.21.15.59:0/974166754 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6d40084580 con 0x7f6d58150f40 2024-04-25T09:07:57.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.472+0000 7f6d55e00640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d34066f60 0x7f6d34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.472+0000 7f6d55e00640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d34066f60 0x7f6d34069420 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6d480ae000 tx=0x7f6d480a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:57.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.476+0000 7f6d4ea00640 1 -- 172.21.15.59:0/974166754 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6d40054da0 con 0x7f6d58150f40 2024-04-25T09:07:57.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.644+0000 7f6d5cc00640 1 -- 172.21.15.59:0/974166754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d580745d0 con 0x7f6d58150f40 2024-04-25T09:07:57.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d4ea00640 1 -- 172.21.15.59:0/974166754 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6d40058e40 con 0x7f6d58150f40 2024-04-25T09:07:57.635 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:07:57.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d5cc00640 1 -- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d34066f60 msgr2=0x7f6d34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d5cc00640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d34066f60 0x7f6d34069420 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6d480ae000 tx=0x7f6d480a7070 comp rx=0 tx=0).stop 2024-04-25T09:07:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d5cc00640 1 -- 172.21.15.59:0/974166754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58150f40 msgr2=0x7f6d5814eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d5cc00640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58150f40 0x7f6d5814eb70 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6d4000c370 tx=0x7f6d4000c830 comp rx=0 tx=0).stop 2024-04-25T09:07:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d5cc00640 1 -- 172.21.15.59:0/974166754 shutdown_connections 2024-04-25T09:07:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d5cc00640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d34066f60 0x7f6d34069420 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d5cc00640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d5815af40 0x7f6d580b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d5cc00640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d58150f40 0x7f6d5814eb70 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d5cc00640 1 --2- 172.21.15.59:0/974166754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d58072210 0x7f6d58157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d5cc00640 1 -- 172.21.15.59:0/974166754 >> 172.21.15.59:0/974166754 conn(0x7f6d58067080 msgr2=0x7f6d5806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d5cc00640 1 -- 172.21.15.59:0/974166754 shutdown_connections 2024-04-25T09:07:57.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.648+0000 7f6d5cc00640 1 -- 172.21.15.59:0/974166754 wait complete. 2024-04-25T09:07:57.657 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:07:57.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.812+0000 7fdd2c800640 1 Processor -- start 2024-04-25T09:07:57.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.812+0000 7fdd2c800640 1 -- start start 2024-04-25T09:07:57.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.812+0000 7fdd2c800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdd2415dc00 0x7fdd240af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.812+0000 7fdd2c800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd240d0150 0x7fdd240c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.812+0000 7fdd2c800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd240c70d0 0x7fdd2406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.812+0000 7fdd2c800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd240cd860 con 0x7fdd240c70d0 2024-04-25T09:07:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.812+0000 7fdd2c800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd240b30d0 con 0x7fdd2415dc00 2024-04-25T09:07:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.812+0000 7fdd2c800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd240ccf30 con 0x7fdd240d0150 2024-04-25T09:07:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd2a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd240c70d0 0x7fdd2406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd2a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd240c70d0 0x7fdd2406ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36526/0 (socket says 172.21.15.59:36526) 2024-04-25T09:07:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd2a800640 1 -- 172.21.15.59:0/3571151545 learned_addr learned my addr 172.21.15.59:0/3571151545 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd29400640 1 --2- 172.21.15.59:0/3571151545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd240d0150 0x7fdd240c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd29e00640 1 --2- 172.21.15.59:0/3571151545 >> v2:172.21.15.178:3300/0 conn(0x7fdd2415dc00 0x7fdd240af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd2a800640 1 -- 172.21.15.59:0/3571151545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd240d0150 msgr2=0x7fdd240c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd2a800640 1 --2- 172.21.15.59:0/3571151545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd240d0150 0x7fdd240c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd2a800640 1 -- 172.21.15.59:0/3571151545 >> v2:172.21.15.178:3300/0 conn(0x7fdd2415dc00 msgr2=0x7fdd240af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd2a800640 1 --2- 172.21.15.59:0/3571151545 >> v2:172.21.15.178:3300/0 conn(0x7fdd2415dc00 0x7fdd240af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd2a800640 1 -- 172.21.15.59:0/3571151545 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd240cd210 con 0x7fdd240c70d0 2024-04-25T09:07:57.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd2a800640 1 --2- 172.21.15.59:0/3571151545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd240c70d0 0x7fdd2406ac10 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fdd240b3300 tx=0x7fdd2001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff9387b65f3414d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:57.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd28a00640 1 -- 172.21.15.59:0/3571151545 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd200a64d0 con 0x7fdd240c70d0 2024-04-25T09:07:57.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd28a00640 1 -- 172.21.15.59:0/3571151545 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd200a6670 con 0x7fdd240c70d0 2024-04-25T09:07:57.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.816+0000 7fdd28a00640 1 -- 172.21.15.59:0/3571151545 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd200a6a40 con 0x7fdd240c70d0 2024-04-25T09:07:57.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 -- 172.21.15.59:0/3571151545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd240c70d0 msgr2=0x7fdd2406ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 --2- 172.21.15.59:0/3571151545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd240c70d0 0x7fdd2406ac10 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fdd240b3300 tx=0x7fdd2001c730 comp rx=0 tx=0).stop 2024-04-25T09:07:57.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 -- 172.21.15.59:0/3571151545 shutdown_connections 2024-04-25T09:07:57.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 --2- 172.21.15.59:0/3571151545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd240c70d0 0x7fdd2406ac10 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 --2- 172.21.15.59:0/3571151545 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd240d0150 0x7fdd240c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 --2- 172.21.15.59:0/3571151545 >> v2:172.21.15.178:3300/0 conn(0x7fdd2415dc00 0x7fdd240af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 -- 172.21.15.59:0/3571151545 >> 172.21.15.59:0/3571151545 conn(0x7fdd240b2240 msgr2=0x7fdd240b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:57.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 -- 172.21.15.59:0/3571151545 shutdown_connections 2024-04-25T09:07:57.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 -- 172.21.15.59:0/3571151545 wait complete. 2024-04-25T09:07:57.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 Processor -- start 2024-04-25T09:07:57.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 -- start start 2024-04-25T09:07:57.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd240c70d0 0x7fdd24155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd240d0150 0x7fdd24157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd2415dc00 0x7fdd2414db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd240c54b0 con 0x7fdd240c70d0 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd240cdee0 con 0x7fdd240d0150 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2c800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd240c5630 con 0x7fdd2415dc00 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd29e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd240c70d0 0x7fdd24155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd29e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd240c70d0 0x7fdd24155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36530/0 (socket says 172.21.15.59:36530) 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd29e00640 1 -- 172.21.15.59:0/883793036 learned_addr learned my addr 172.21.15.59:0/883793036 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd29400640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd240d0150 0x7fdd24157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd2a800640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd2415dc00 0x7fdd2414db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd29e00640 1 -- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd2415dc00 msgr2=0x7fdd2414db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd29e00640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd2415dc00 0x7fdd2414db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd29e00640 1 -- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd240d0150 msgr2=0x7fdd24157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd29e00640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd240d0150 0x7fdd24157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd29e00640 1 -- 172.21.15.59:0/883793036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd241583d0 con 0x7fdd240c70d0 2024-04-25T09:07:57.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.820+0000 7fdd29400640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd240d0150 0x7fdd24157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.824+0000 7fdd29e00640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd240c70d0 0x7fdd24155680 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800d620 tx=0x7fdd1800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.824+0000 7fdd1e000640 1 -- 172.21.15.59:0/883793036 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1800b620 con 0x7fdd240c70d0 2024-04-25T09:07:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.824+0000 7fdd1e000640 1 -- 172.21.15.59:0/883793036 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd18019070 con 0x7fdd240c70d0 2024-04-25T09:07:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.824+0000 7fdd1e000640 1 -- 172.21.15.59:0/883793036 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd1800b9e0 con 0x7fdd240c70d0 2024-04-25T09:07:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.824+0000 7fdd2c800640 1 -- 172.21.15.59:0/883793036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd2414e060 con 0x7fdd240c70d0 2024-04-25T09:07:57.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.824+0000 7fdd2c800640 1 -- 172.21.15.59:0/883793036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd2414f040 con 0x7fdd240c70d0 2024-04-25T09:07:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.824+0000 7fdd2c800640 1 -- 172.21.15.59:0/883793036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd240745d0 con 0x7fdd240c70d0 2024-04-25T09:07:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.824+0000 7fdd1e000640 1 -- 172.21.15.59:0/883793036 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdd1800bb80 con 0x7fdd240c70d0 2024-04-25T09:07:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.824+0000 7fdd1e000640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd08066f90 0x7fdd08069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.824+0000 7fdd1e000640 1 -- 172.21.15.59:0/883793036 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fdd180855e0 con 0x7fdd240c70d0 2024-04-25T09:07:57.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.824+0000 7fdd29400640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd08066f90 0x7fdd08069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:57.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.828+0000 7fdd29400640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd08066f90 0x7fdd08069450 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdd14004660 tx=0x7fdd14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:57.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:57.828+0000 7fdd1e000640 1 -- 172.21.15.59:0/883793036 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd18056450 con 0x7fdd240c70d0 2024-04-25T09:07:57.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 -- 172.21.15.59:0/883793036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdd240cfc00 con 0x7fdd240c70d0 2024-04-25T09:07:57.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd1e000640 1 -- 172.21.15.59:0/883793036 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdd18055d50 con 0x7fdd240c70d0 2024-04-25T09:07:57.987 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:07:57.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 -- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd08066f90 msgr2=0x7fdd08069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd08066f90 0x7fdd08069450 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fdd14004660 tx=0x7fdd14008040 comp rx=0 tx=0).stop 2024-04-25T09:07:57.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 -- 172.21.15.59:0/883793036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd240c70d0 msgr2=0x7fdd24155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:57.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd240c70d0 0x7fdd24155680 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800d620 tx=0x7fdd1800dae0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 -- 172.21.15.59:0/883793036 shutdown_connections 2024-04-25T09:07:57.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd08066f90 0x7fdd08069450 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd2415dc00 0x7fdd2414db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd240d0150 0x7fdd24157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 --2- 172.21.15.59:0/883793036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd240c70d0 0x7fdd24155680 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:57.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 -- 172.21.15.59:0/883793036 >> 172.21.15.59:0/883793036 conn(0x7fdd240b2240 msgr2=0x7fdd240d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:57.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 -- 172.21.15.59:0/883793036 shutdown_connections 2024-04-25T09:07:57.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.000+0000 7fdd2c800640 1 -- 172.21.15.59:0/883793036 wait complete. 2024-04-25T09:07:58.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:07:58.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.164+0000 7ff2d8600640 1 Processor -- start 2024-04-25T09:07:58.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.164+0000 7ff2d8600640 1 -- start start 2024-04-25T09:07:58.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.164+0000 7ff2d8600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff2d015eb50 0x7ff2d015f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.164+0000 7ff2d8600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d015efe0 con 0x7ff2d0071270 2024-04-25T09:07:58.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.164+0000 7ff2d8600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d006db20 con 0x7ff2d015e770 2024-04-25T09:07:58.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.164+0000 7ff2d8600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d006de00 con 0x7ff2d015eb50 2024-04-25T09:07:58.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.164+0000 7ff2d6600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff2d0071270 0x7ff2d00ae560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47220/0 (socket says 172.21.15.59:47220) 2024-04-25T09:07:58.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.164+0000 7ff2d6600640 1 -- 172.21.15.59:0/1145430532 learned_addr learned my addr 172.21.15.59:0/1145430532 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:07:58.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.164+0000 7ff2d5200640 1 --2- 172.21.15.59:0/1145430532 >> v2:172.21.15.178:3300/0 conn(0x7ff2d015eb50 0x7ff2d015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.164+0000 7ff2cfe00640 1 -- 172.21.15.59:0/1145430532 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701610653 0 0) 0x7ff2d015efe0 con 0x7ff2d0071270 2024-04-25T09:07:58.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.164+0000 7ff2cfe00640 1 -- 172.21.15.59:0/1145430532 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2b8003530 con 0x7ff2d0071270 2024-04-25T09:07:58.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.164+0000 7ff2d5200640 1 -- 172.21.15.59:0/1145430532 >> v1:172.21.15.178:6789/0 conn(0x7ff2d015e770 legacy=0x7ff2d006d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.168+0000 7ff2d5200640 1 -- 172.21.15.59:0/1145430532 >> v1:172.21.15.59:6789/0 conn(0x7ff2d0071270 legacy=0x7ff2d00ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.168+0000 7ff2d5200640 1 -- 172.21.15.59:0/1145430532 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d006e0e0 con 0x7ff2d015eb50 2024-04-25T09:07:58.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.168+0000 7ff2d5200640 1 --2- 172.21.15.59:0/1145430532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d015eb50 0x7ff2d015f230 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0097c0 tx=0x7ff2bc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42d21534d19549d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.168+0000 7ff2cfe00640 1 -- 172.21.15.59:0/1145430532 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0b0070 con 0x7ff2d015eb50 2024-04-25T09:07:58.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.168+0000 7ff2cfe00640 1 -- 172.21.15.59:0/1145430532 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc0ab600 con 0x7ff2d015eb50 2024-04-25T09:07:58.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.168+0000 7ff2cfe00640 1 -- 172.21.15.59:0/1145430532 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0ab9d0 con 0x7ff2d015eb50 2024-04-25T09:07:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.168+0000 7ff2d8600640 1 -- 172.21.15.59:0/1145430532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d015eb50 msgr2=0x7ff2d015f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.168+0000 7ff2d8600640 1 --2- 172.21.15.59:0/1145430532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d015eb50 0x7ff2d015f230 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0097c0 tx=0x7ff2bc01c410 comp rx=0 tx=0).stop 2024-04-25T09:07:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 -- 172.21.15.59:0/1145430532 shutdown_connections 2024-04-25T09:07:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 --2- 172.21.15.59:0/1145430532 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d015eb50 0x7ff2d015f230 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 -- 172.21.15.59:0/1145430532 >> 172.21.15.59:0/1145430532 conn(0x7ff2d0067080 msgr2=0x7ff2d006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 -- 172.21.15.59:0/1145430532 shutdown_connections 2024-04-25T09:07:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 -- 172.21.15.59:0/1145430532 wait complete. 2024-04-25T09:07:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 Processor -- start 2024-04-25T09:07:58.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 -- start start 2024-04-25T09:07:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d0071270 0x7ff2d0153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d015e770 0x7ff2d013c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d015eb50 0x7ff2d013cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0071a90 con 0x7ff2d015eb50 2024-04-25T09:07:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d016c220 con 0x7ff2d015e770 2024-04-25T09:07:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d8600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d0152c80 con 0x7ff2d0071270 2024-04-25T09:07:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d015eb50 0x7ff2d013cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d5c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d0071270 0x7ff2d0153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d5200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d015e770 0x7ff2d013c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d015eb50 0x7ff2d013cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36540/0 (socket says 172.21.15.59:36540) 2024-04-25T09:07:58.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d6600640 1 -- 172.21.15.59:0/919730741 learned_addr learned my addr 172.21.15.59:0/919730741 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d6600640 1 -- 172.21.15.59:0/919730741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d0071270 msgr2=0x7ff2d0153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d6600640 1 --2- 172.21.15.59:0/919730741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d0071270 0x7ff2d0153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d6600640 1 -- 172.21.15.59:0/919730741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d015e770 msgr2=0x7ff2d013c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d6600640 1 --2- 172.21.15.59:0/919730741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d015e770 0x7ff2d013c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d6600640 1 -- 172.21.15.59:0/919730741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d00b4510 con 0x7ff2d015eb50 2024-04-25T09:07:58.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.172+0000 7ff2d6600640 1 --2- 172.21.15.59:0/919730741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d015eb50 0x7ff2d013cf20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800caa0 tx=0x7ff2c800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.176+0000 7ff2cd600640 1 -- 172.21.15.59:0/919730741 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8017070 con 0x7ff2d015eb50 2024-04-25T09:07:58.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.176+0000 7ff2cd600640 1 -- 172.21.15.59:0/919730741 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c800ac00 con 0x7ff2d015eb50 2024-04-25T09:07:58.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.176+0000 7ff2cd600640 1 -- 172.21.15.59:0/919730741 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8012400 con 0x7ff2d015eb50 2024-04-25T09:07:58.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.176+0000 7ff2d8600640 1 -- 172.21.15.59:0/919730741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d0152070 con 0x7ff2d015eb50 2024-04-25T09:07:58.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.176+0000 7ff2d8600640 1 -- 172.21.15.59:0/919730741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d0152630 con 0x7ff2d015eb50 2024-04-25T09:07:58.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.176+0000 7ff2d8600640 1 -- 172.21.15.59:0/919730741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d00745d0 con 0x7ff2d015eb50 2024-04-25T09:07:58.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.176+0000 7ff2cd600640 1 -- 172.21.15.59:0/919730741 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff2c801a070 con 0x7ff2d015eb50 2024-04-25T09:07:58.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.176+0000 7ff2cd600640 1 --2- 172.21.15.59:0/919730741 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2b0066f60 0x7ff2b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.176+0000 7ff2cd600640 1 -- 172.21.15.59:0/919730741 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff2c8084ec0 con 0x7ff2d015eb50 2024-04-25T09:07:58.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.176+0000 7ff2d5c00640 1 --2- 172.21.15.59:0/919730741 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2b0066f60 0x7ff2b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.180+0000 7ff2d5c00640 1 --2- 172.21.15.59:0/919730741 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2b0066f60 0x7ff2b0069420 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4001770 tx=0x7ff2c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.180+0000 7ff2cd600640 1 -- 172.21.15.59:0/919730741 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff2c80556f0 con 0x7ff2d015eb50 2024-04-25T09:07:58.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 -- 172.21.15.59:0/919730741 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2d006e8d0 con 0x7ff2d015eb50 2024-04-25T09:07:58.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2cd600640 1 -- 172.21.15.59:0/919730741 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2c8059790 con 0x7ff2d015eb50 2024-04-25T09:07:58.336 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:07:58.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 -- 172.21.15.59:0/919730741 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2b0066f60 msgr2=0x7ff2b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 --2- 172.21.15.59:0/919730741 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2b0066f60 0x7ff2b0069420 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4001770 tx=0x7ff2c4009040 comp rx=0 tx=0).stop 2024-04-25T09:07:58.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 -- 172.21.15.59:0/919730741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d015eb50 msgr2=0x7ff2d013cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 --2- 172.21.15.59:0/919730741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d015eb50 0x7ff2d013cf20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800caa0 tx=0x7ff2c800cf60 comp rx=0 tx=0).stop 2024-04-25T09:07:58.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 -- 172.21.15.59:0/919730741 shutdown_connections 2024-04-25T09:07:58.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 --2- 172.21.15.59:0/919730741 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff2b0066f60 0x7ff2b0069420 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 --2- 172.21.15.59:0/919730741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2d015eb50 0x7ff2d013cf20 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 --2- 172.21.15.59:0/919730741 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff2d015e770 0x7ff2d013c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 --2- 172.21.15.59:0/919730741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff2d0071270 0x7ff2d0153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 -- 172.21.15.59:0/919730741 >> 172.21.15.59:0/919730741 conn(0x7ff2d0067080 msgr2=0x7ff2d006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:58.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 -- 172.21.15.59:0/919730741 shutdown_connections 2024-04-25T09:07:58.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.348+0000 7ff2d8600640 1 -- 172.21.15.59:0/919730741 wait complete. 2024-04-25T09:07:58.357 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:07:58.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.508+0000 7fa26b800640 1 Processor -- start 2024-04-25T09:07:58.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.508+0000 7fa26b800640 1 -- start start 2024-04-25T09:07:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa26b800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa26415dd90 0x7fa264071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa26b800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa264161e90 0x7fa2640ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa26b800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa264072460 con 0x7fa264072040 2024-04-25T09:07:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa26b800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2640b2dc0 con 0x7fa264161e90 2024-04-25T09:07:58.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa26b800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26406ac10 con 0x7fa26415dd90 2024-04-25T09:07:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa268e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa26415dd90 0x7fa264071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa269800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa264161e90 0x7fa2640ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa268e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa26415dd90 0x7fa264071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:48890/0 (socket says 172.21.15.59:48890) 2024-04-25T09:07:58.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa25be00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fa264072040 0x7fa264161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:57608/0 (socket says 172.21.15.59:57608) 2024-04-25T09:07:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa269800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa264161e90 0x7fa2640ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:57808/0 (socket says 172.21.15.59:57808) 2024-04-25T09:07:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa268e00640 1 -- 172.21.15.59:0/1498894460 learned_addr learned my addr 172.21.15.59:0/1498894460 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa269800640 1 -- 172.21.15.59:0/1498894460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa26415dd90 msgr2=0x7fa264071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa269800640 1 --2- 172.21.15.59:0/1498894460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa26415dd90 0x7fa264071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa269800640 1 -- 172.21.15.59:0/1498894460 >> v1:172.21.15.178:6789/0 conn(0x7fa264072040 legacy=0x7fa264161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa269800640 1 -- 172.21.15.59:0/1498894460 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26406aeb0 con 0x7fa264161e90 2024-04-25T09:07:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa263e00640 1 -- 172.21.15.59:0/1498894460 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612750984 0 0) 0x7fa264072460 con 0x7fa264072040 2024-04-25T09:07:58.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.512+0000 7fa268e00640 1 --2- 172.21.15.59:0/1498894460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa26415dd90 0x7fa264071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:58.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.516+0000 7fa269800640 1 --2- 172.21.15.59:0/1498894460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa264161e90 0x7fa2640ceca0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009d90 tx=0x7fa25c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0fe3cad828db984 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.516+0000 7fa263e00640 1 -- 172.21.15.59:0/1498894460 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0b2070 con 0x7fa264161e90 2024-04-25T09:07:58.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.516+0000 7fa263e00640 1 -- 172.21.15.59:0/1498894460 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c0a5890 con 0x7fa264161e90 2024-04-25T09:07:58.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.516+0000 7fa263e00640 1 -- 172.21.15.59:0/1498894460 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0a5c60 con 0x7fa264161e90 2024-04-25T09:07:58.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.516+0000 7fa26b800640 1 -- 172.21.15.59:0/1498894460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa264161e90 msgr2=0x7fa2640ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.516+0000 7fa26b800640 1 --2- 172.21.15.59:0/1498894460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa264161e90 0x7fa2640ceca0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa25c009d90 tx=0x7fa25c01c8e0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.516+0000 7fa26b800640 1 -- 172.21.15.59:0/1498894460 shutdown_connections 2024-04-25T09:07:58.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.516+0000 7fa26b800640 1 --2- 172.21.15.59:0/1498894460 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa264161e90 0x7fa2640ceca0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.516+0000 7fa26b800640 1 --2- 172.21.15.59:0/1498894460 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa26415dd90 0x7fa264071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.516+0000 7fa26b800640 1 -- 172.21.15.59:0/1498894460 >> 172.21.15.59:0/1498894460 conn(0x7fa2640cfd90 msgr2=0x7fa2640d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:58.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.516+0000 7fa26b800640 1 -- 172.21.15.59:0/1498894460 shutdown_connections 2024-04-25T09:07:58.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.516+0000 7fa26b800640 1 -- 172.21.15.59:0/1498894460 wait complete. 2024-04-25T09:07:58.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa26b800640 1 Processor -- start 2024-04-25T09:07:58.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa26b800640 1 -- start start 2024-04-25T09:07:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa26b800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa264072040 0x7fa264148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa26b800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa26415dd90 0x7fa26414b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa26b800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa264161e90 0x7fa2640acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa26b800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26416ac40 con 0x7fa26415dd90 2024-04-25T09:07:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa26b800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26416aac0 con 0x7fa264072040 2024-04-25T09:07:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa26b800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26416adc0 con 0x7fa264161e90 2024-04-25T09:07:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa25be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa26415dd90 0x7fa26414b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa25be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa26415dd90 0x7fa26414b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36552/0 (socket says 172.21.15.59:36552) 2024-04-25T09:07:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa25be00640 1 -- 172.21.15.59:0/1645328046 learned_addr learned my addr 172.21.15.59:0/1645328046 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa268e00640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa264072040 0x7fa264148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa269800640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa264161e90 0x7fa2640acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa268e00640 1 -- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa264161e90 msgr2=0x7fa2640acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa268e00640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa264161e90 0x7fa2640acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa268e00640 1 -- 172.21.15.59:0/1645328046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa26415dd90 msgr2=0x7fa26414b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa268e00640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa26415dd90 0x7fa26414b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa268e00640 1 -- 172.21.15.59:0/1645328046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2641493e0 con 0x7fa264072040 2024-04-25T09:07:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa25be00640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa26415dd90 0x7fa26414b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:07:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa268e00640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa264072040 0x7fa264148ea0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa25400e8b0 tx=0x7fa25400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa261600640 1 -- 172.21.15.59:0/1645328046 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254004030 con 0x7fa264072040 2024-04-25T09:07:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa261600640 1 -- 172.21.15.59:0/1645328046 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2540041d0 con 0x7fa264072040 2024-04-25T09:07:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa26b800640 1 -- 172.21.15.59:0/1645328046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2640ad840 con 0x7fa264072040 2024-04-25T09:07:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa261600640 1 -- 172.21.15.59:0/1645328046 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25400c940 con 0x7fa264072040 2024-04-25T09:07:58.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa26b800640 1 -- 172.21.15.59:0/1645328046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa264149840 con 0x7fa264072040 2024-04-25T09:07:58.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.520+0000 7fa26b800640 1 -- 172.21.15.59:0/1645328046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa264149630 con 0x7fa264072040 2024-04-25T09:07:58.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.524+0000 7fa261600640 1 -- 172.21.15.59:0/1645328046 <== mon.1 v2:172.21.15.178:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa25400cae0 con 0x7fa264072040 2024-04-25T09:07:58.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.524+0000 7fa261600640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa240066f60 0x7fa240069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.524+0000 7fa261600640 1 -- 172.21.15.59:0/1645328046 <== mon.1 v2:172.21.15.178:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa2540850e0 con 0x7fa264072040 2024-04-25T09:07:58.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.524+0000 7fa25be00640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa240066f60 0x7fa240069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.524+0000 7fa25be00640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa240066f60 0x7fa240069420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa26406f860 tx=0x7fa24c007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.528+0000 7fa261600640 1 -- 172.21.15.59:0/1645328046 <== mon.1 v2:172.21.15.178:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa254017020 con 0x7fa264072040 2024-04-25T09:07:58.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.704+0000 7fa26b800640 1 -- 172.21.15.59:0/1645328046 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa2640745d0 con 0x7fa264072040 2024-04-25T09:07:58.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.704+0000 7fa261600640 1 -- 172.21.15.59:0/1645328046 <== mon.1 v2:172.21.15.178:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v92) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa254055870 con 0x7fa264072040 2024-04-25T09:07:58.693 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:07:58.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.708+0000 7fa26b800640 1 -- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa240066f60 msgr2=0x7fa240069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.708+0000 7fa26b800640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa240066f60 0x7fa240069420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa26406f860 tx=0x7fa24c007eb0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.708+0000 7fa26b800640 1 -- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa264072040 msgr2=0x7fa264148ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.708+0000 7fa26b800640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa264072040 0x7fa264148ea0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa25400e8b0 tx=0x7fa25400ed70 comp rx=0 tx=0).stop 2024-04-25T09:07:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.708+0000 7fa26b800640 1 -- 172.21.15.59:0/1645328046 shutdown_connections 2024-04-25T09:07:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.708+0000 7fa26b800640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa240066f60 0x7fa240069420 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.708+0000 7fa26b800640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa264161e90 0x7fa2640acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.708+0000 7fa26b800640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa26415dd90 0x7fa26414b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.708+0000 7fa26b800640 1 --2- 172.21.15.59:0/1645328046 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa264072040 0x7fa264148ea0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.708+0000 7fa26b800640 1 -- 172.21.15.59:0/1645328046 >> 172.21.15.59:0/1645328046 conn(0x7fa2640cfd90 msgr2=0x7fa2640b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.708+0000 7fa26b800640 1 -- 172.21.15.59:0/1645328046 shutdown_connections 2024-04-25T09:07:58.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.708+0000 7fa26b800640 1 -- 172.21.15.59:0/1645328046 wait complete. 2024-04-25T09:07:58.715 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:07:58.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:58.715 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:07:58.769 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:07:58.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:07:58.770 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:07:58.789 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:07:58.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.980+0000 7fc1ed400640 1 Processor -- start 2024-04-25T09:07:58.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.980+0000 7fc1ed400640 1 -- start start 2024-04-25T09:07:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1ed400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1e8144140 0x7fc1e80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1ed400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc1e80ced60 0x7fc1e806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1ed400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1e806e900 0x7fc1e815e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1ed400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e806ed70 con 0x7fc1e806e900 2024-04-25T09:07:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1ed400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1e815ac60 con 0x7fc1e80ced60 2024-04-25T09:07:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1ed400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e80cf3e0 con 0x7fc1e8144140 2024-04-25T09:07:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1e7200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1e806e900 0x7fc1e815e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1e7200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1e806e900 0x7fc1e815e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36556/0 (socket says 172.21.15.59:36556) 2024-04-25T09:07:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1e7200640 1 -- 172.21.15.59:0/194237400 learned_addr learned my addr 172.21.15.59:0/194237400 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1e6800640 1 --2- 172.21.15.59:0/194237400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1e8144140 0x7fc1e80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1dde00640 1 --2- 172.21.15.59:0/194237400 >> v2:172.21.15.178:3300/0 conn(0x7fc1e80ced60 0x7fc1e806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1e7200640 1 -- 172.21.15.59:0/194237400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1e8144140 msgr2=0x7fc1e80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1e7200640 1 --2- 172.21.15.59:0/194237400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1e8144140 0x7fc1e80ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1e7200640 1 -- 172.21.15.59:0/194237400 >> v2:172.21.15.178:3300/0 conn(0x7fc1e80ced60 msgr2=0x7fc1e806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1e7200640 1 --2- 172.21.15.59:0/194237400 >> v2:172.21.15.178:3300/0 conn(0x7fc1e80ced60 0x7fc1e806e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1e7200640 1 -- 172.21.15.59:0/194237400 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e815af20 con 0x7fc1e806e900 2024-04-25T09:07:58.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.984+0000 7fc1dde00640 1 --2- 172.21.15.59:0/194237400 >> v2:172.21.15.178:3300/0 conn(0x7fc1e80ced60 0x7fc1e806e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:07:58.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1e7200640 1 --2- 172.21.15.59:0/194237400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1e806e900 0x7fc1e815e250 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fc1e806f6d0 tx=0x7fc1e001e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3f67ebd081f159a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1e5e00640 1 -- 172.21.15.59:0/194237400 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000b2d0 con 0x7fc1e806e900 2024-04-25T09:07:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1e5e00640 1 -- 172.21.15.59:0/194237400 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e000b470 con 0x7fc1e806e900 2024-04-25T09:07:58.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1e5e00640 1 -- 172.21.15.59:0/194237400 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0009820 con 0x7fc1e806e900 2024-04-25T09:07:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1ed400640 1 -- 172.21.15.59:0/194237400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1e806e900 msgr2=0x7fc1e815e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1ed400640 1 --2- 172.21.15.59:0/194237400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1e806e900 0x7fc1e815e250 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fc1e806f6d0 tx=0x7fc1e001e930 comp rx=0 tx=0).stop 2024-04-25T09:07:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1ed400640 1 -- 172.21.15.59:0/194237400 shutdown_connections 2024-04-25T09:07:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1ed400640 1 --2- 172.21.15.59:0/194237400 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1e806e900 0x7fc1e815e250 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1ed400640 1 --2- 172.21.15.59:0/194237400 >> v2:172.21.15.178:3300/0 conn(0x7fc1e80ced60 0x7fc1e806e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1ed400640 1 --2- 172.21.15.59:0/194237400 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1e8144140 0x7fc1e80ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1ed400640 1 -- 172.21.15.59:0/194237400 >> 172.21.15.59:0/194237400 conn(0x7fc1e8066fa0 msgr2=0x7fc1e806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1ed400640 1 -- 172.21.15.59:0/194237400 shutdown_connections 2024-04-25T09:07:58.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1ed400640 1 -- 172.21.15.59:0/194237400 wait complete. 2024-04-25T09:07:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1ed400640 1 Processor -- start 2024-04-25T09:07:58.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.988+0000 7fc1ed400640 1 -- start start 2024-04-25T09:07:58.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1ed400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1e806e900 0x7fc1e8142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1ed400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1e80ced60 0x7fc1e8163360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1ed400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1e8144140 0x7fc1e81638a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1ed400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e815ba00 con 0x7fc1e80ced60 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1ed400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e8144520 con 0x7fc1e806e900 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1ed400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e815bb80 con 0x7fc1e8144140 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1dde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1e80ced60 0x7fc1e8163360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1dde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1e80ced60 0x7fc1e8163360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36564/0 (socket says 172.21.15.59:36564) 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1dde00640 1 -- 172.21.15.59:0/3502225943 learned_addr learned my addr 172.21.15.59:0/3502225943 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1e6800640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1e806e900 0x7fc1e8142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1e7200640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1e8144140 0x7fc1e81638a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1dde00640 1 -- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1e8144140 msgr2=0x7fc1e81638a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1dde00640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1e8144140 0x7fc1e81638a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1dde00640 1 -- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1e806e900 msgr2=0x7fc1e8142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1dde00640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1e806e900 0x7fc1e8142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1dde00640 1 -- 172.21.15.59:0/3502225943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e81301f0 con 0x7fc1e80ced60 2024-04-25T09:07:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1dde00640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1e80ced60 0x7fc1e8163360 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000c7c0 tx=0x7fc1d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1df400640 1 -- 172.21.15.59:0/3502225943 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d0007a30 con 0x7fc1e80ced60 2024-04-25T09:07:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1df400640 1 -- 172.21.15.59:0/3502225943 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1d0007bd0 con 0x7fc1e80ced60 2024-04-25T09:07:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1df400640 1 -- 172.21.15.59:0/3502225943 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1d00113f0 con 0x7fc1e80ced60 2024-04-25T09:07:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1ed400640 1 -- 172.21.15.59:0/3502225943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e81304d0 con 0x7fc1e80ced60 2024-04-25T09:07:58.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1ed400640 1 -- 172.21.15.59:0/3502225943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e8143230 con 0x7fc1e80ced60 2024-04-25T09:07:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1ed400640 1 -- 172.21.15.59:0/3502225943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e80745d0 con 0x7fc1e80ced60 2024-04-25T09:07:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.992+0000 7fc1df400640 1 -- 172.21.15.59:0/3502225943 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc1d0011590 con 0x7fc1e80ced60 2024-04-25T09:07:58.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.996+0000 7fc1df400640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc1c4066f60 0x7fc1c4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.996+0000 7fc1df400640 1 -- 172.21.15.59:0/3502225943 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc1d0085390 con 0x7fc1e80ced60 2024-04-25T09:07:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.996+0000 7fc1e6800640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc1c4066f60 0x7fc1c4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:58.996+0000 7fc1e6800640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc1c4066f60 0x7fc1c4069420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8007940 tx=0x7fc1d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:58.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.000+0000 7fc1df400640 1 -- 172.21.15.59:0/3502225943 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc1d0015020 con 0x7fc1e80ced60 2024-04-25T09:07:59.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.192+0000 7fc1ed400640 1 -- 172.21.15.59:0/3502225943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1e815c2a0 con 0x7fc1e80ced60 2024-04-25T09:07:59.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1df400640 1 -- 172.21.15.59:0/3502225943 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fc1d0055b20 con 0x7fc1e80ced60 2024-04-25T09:07:59.183 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:07:59.184 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:07:51.910911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7458},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7458":{"gid":7458,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/3531112441","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3531112441},{"type":"v1","addr":"172.21.15.59:6835","nonce":3531112441}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:07:59.184 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 65 2024-04-25T09:07:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1ed400640 1 -- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc1c4066f60 msgr2=0x7fc1c4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1ed400640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc1c4066f60 0x7fc1c4069420 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8007940 tx=0x7fc1d8008040 comp rx=0 tx=0).stop 2024-04-25T09:07:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1ed400640 1 -- 172.21.15.59:0/3502225943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1e80ced60 msgr2=0x7fc1e8163360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1ed400640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1e80ced60 0x7fc1e8163360 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fc1d000c7c0 tx=0x7fc1d000cc80 comp rx=0 tx=0).stop 2024-04-25T09:07:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1ed400640 1 -- 172.21.15.59:0/3502225943 shutdown_connections 2024-04-25T09:07:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1ed400640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc1c4066f60 0x7fc1c4069420 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1ed400640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1e8144140 0x7fc1e81638a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1ed400640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1e80ced60 0x7fc1e8163360 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1ed400640 1 --2- 172.21.15.59:0/3502225943 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1e806e900 0x7fc1e8142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1ed400640 1 -- 172.21.15.59:0/3502225943 >> 172.21.15.59:0/3502225943 conn(0x7fc1e8066fa0 msgr2=0x7fc1e80b4640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1ed400640 1 -- 172.21.15.59:0/3502225943 shutdown_connections 2024-04-25T09:07:59.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.196+0000 7fc1ed400640 1 -- 172.21.15.59:0/3502225943 wait complete. 2024-04-25T09:07:59.204 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:07:59.373 INFO:teuthology.orchestra.run.smithi059.stdout:{"message":"","return_code":0} 2024-04-25T09:07:59.374 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:07:59.374 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:07:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5e00600640 1 Processor -- start 2024-04-25T09:07:59.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5e00600640 1 -- start start 2024-04-25T09:07:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5e00600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5df815acd0 0x7f5df815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5e00600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5df815ee60 0x7f5df80b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5e00600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df815bc40 con 0x7f5df8144120 2024-04-25T09:07:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5e00600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df815e490 con 0x7f5df815acd0 2024-04-25T09:07:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5e00600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df815b150 con 0x7f5df815ee60 2024-04-25T09:07:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5dfd200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5df815acd0 0x7f5df815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5dfd200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5df815acd0 0x7f5df815e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36568/0 (socket says 172.21.15.59:36568) 2024-04-25T09:07:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5dfd200640 1 -- 172.21.15.59:0/942658094 learned_addr learned my addr 172.21.15.59:0/942658094 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5dfe600640 1 --2- 172.21.15.59:0/942658094 >> v2:172.21.15.178:3300/0 conn(0x7f5df815ee60 0x7f5df80b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5dfd200640 1 -- 172.21.15.59:0/942658094 >> v2:172.21.15.178:3300/0 conn(0x7f5df815ee60 msgr2=0x7f5df80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5dfd200640 1 --2- 172.21.15.59:0/942658094 >> v2:172.21.15.178:3300/0 conn(0x7f5df815ee60 0x7f5df80b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5dfd200640 1 -- 172.21.15.59:0/942658094 >> v1:172.21.15.178:6789/0 conn(0x7f5df8144120 legacy=0x7f5df80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5dfd200640 1 -- 172.21.15.59:0/942658094 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df815b3a0 con 0x7f5df815acd0 2024-04-25T09:07:59.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.528+0000 7f5dfe600640 1 --2- 172.21.15.59:0/942658094 >> v2:172.21.15.178:3300/0 conn(0x7f5df815ee60 0x7f5df80b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:59.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.532+0000 7f5dfd200640 1 --2- 172.21.15.59:0/942658094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df815acd0 0x7f5df815e920 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5df806bb20 tx=0x7f5de401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9894712c11c0d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.532+0000 7f5df7e00640 1 -- 172.21.15.59:0/942658094 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40b4070 con 0x7f5df815acd0 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.532+0000 7f5df7e00640 1 -- 172.21.15.59:0/942658094 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de40a7b40 con 0x7f5df815acd0 2024-04-25T09:07:59.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.532+0000 7f5df7e00640 1 -- 172.21.15.59:0/942658094 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40af440 con 0x7f5df815acd0 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.532+0000 7f5e00600640 1 -- 172.21.15.59:0/942658094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df815acd0 msgr2=0x7f5df815e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.532+0000 7f5e00600640 1 --2- 172.21.15.59:0/942658094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df815acd0 0x7f5df815e920 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5df806bb20 tx=0x7f5de401eb60 comp rx=0 tx=0).stop 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.532+0000 7f5e00600640 1 -- 172.21.15.59:0/942658094 shutdown_connections 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.532+0000 7f5e00600640 1 --2- 172.21.15.59:0/942658094 >> v2:172.21.15.178:3300/0 conn(0x7f5df815ee60 0x7f5df80b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.532+0000 7f5e00600640 1 --2- 172.21.15.59:0/942658094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df815acd0 0x7f5df815e920 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.532+0000 7f5e00600640 1 -- 172.21.15.59:0/942658094 >> 172.21.15.59:0/942658094 conn(0x7f5df8067080 msgr2=0x7f5df806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.532+0000 7f5e00600640 1 -- 172.21.15.59:0/942658094 shutdown_connections 2024-04-25T09:07:59.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.532+0000 7f5e00600640 1 -- 172.21.15.59:0/942658094 wait complete. 2024-04-25T09:07:59.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5e00600640 1 Processor -- start 2024-04-25T09:07:59.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5e00600640 1 -- start start 2024-04-25T09:07:59.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5e00600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df8144120 0x7f5df813ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5e00600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5df815acd0 0x7f5df815d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5e00600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df815ee60 0x7f5df80b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5e00600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df806de70 con 0x7f5df8144120 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5e00600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df806dcf0 con 0x7f5df815acd0 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5e00600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df806dff0 con 0x7f5df815ee60 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5dfdc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df8144120 0x7f5df813ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5dfdc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df8144120 0x7f5df813ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36574/0 (socket says 172.21.15.59:36574) 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5dfdc00640 1 -- 172.21.15.59:0/1934377569 learned_addr learned my addr 172.21.15.59:0/1934377569 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5dfd200640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5df815acd0 0x7f5df815d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5dfe600640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df815ee60 0x7f5df80b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5dfdc00640 1 -- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df815ee60 msgr2=0x7f5df80b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5dfdc00640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df815ee60 0x7f5df80b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5dfdc00640 1 -- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5df815acd0 msgr2=0x7f5df815d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5dfdc00640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5df815acd0 0x7f5df815d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5dfdc00640 1 -- 172.21.15.59:0/1934377569 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df815c060 con 0x7f5df8144120 2024-04-25T09:07:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5dfd200640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5df815acd0 0x7f5df815d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5dfdc00640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df8144120 0x7f5df813ee20 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c500 tx=0x7f5dec00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5df5600640 1 -- 172.21.15.59:0/1934377569 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec016020 con 0x7f5df8144120 2024-04-25T09:07:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5df5600640 1 -- 172.21.15.59:0/1934377569 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec005220 con 0x7f5df8144120 2024-04-25T09:07:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5e00600640 1 -- 172.21.15.59:0/1934377569 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df815c340 con 0x7f5df8144120 2024-04-25T09:07:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5df5600640 1 -- 172.21.15.59:0/1934377569 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec007030 con 0x7f5df8144120 2024-04-25T09:07:59.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5e00600640 1 -- 172.21.15.59:0/1934377569 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df815c900 con 0x7f5df8144120 2024-04-25T09:07:59.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.536+0000 7f5e00600640 1 -- 172.21.15.59:0/1934377569 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df80745d0 con 0x7f5df8144120 2024-04-25T09:07:59.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.540+0000 7f5df5600640 1 -- 172.21.15.59:0/1934377569 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5dec0071f0 con 0x7f5df8144120 2024-04-25T09:07:59.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.540+0000 7f5df5600640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5dd8066f90 0x7f5dd8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.540+0000 7f5df5600640 1 -- 172.21.15.59:0/1934377569 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5dec084c20 con 0x7f5df8144120 2024-04-25T09:07:59.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.540+0000 7f5dfd200640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5dd8066f90 0x7f5dd8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.540+0000 7f5dfd200640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5dd8066f90 0x7f5dd8069450 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5de40b1000 tx=0x7f5de4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.544+0000 7f5df5600640 1 -- 172.21.15.59:0/1934377569 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5dec020020 con 0x7f5df8144120 2024-04-25T09:07:59.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.740+0000 7f5e00600640 1 -- 172.21.15.59:0/1934377569 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5df813f360 con 0x7f5df8144120 2024-04-25T09:07:59.728 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:07:59.740+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:07:59.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5df5600640 1 -- 172.21.15.59:0/1934377569 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v66) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5dec055a10 con 0x7f5df8144120 2024-04-25T09:07:59.731 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:07:59.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5e00600640 1 -- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5dd8066f90 msgr2=0x7f5dd8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5e00600640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5dd8066f90 0x7f5dd8069450 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f5de40b1000 tx=0x7f5de4008040 comp rx=0 tx=0).stop 2024-04-25T09:07:59.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5e00600640 1 -- 172.21.15.59:0/1934377569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df8144120 msgr2=0x7f5df813ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5e00600640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df8144120 0x7f5df813ee20 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c500 tx=0x7f5dec00c9c0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5e00600640 1 -- 172.21.15.59:0/1934377569 shutdown_connections 2024-04-25T09:07:59.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5e00600640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5dd8066f90 0x7f5dd8069450 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5e00600640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5df815ee60 0x7f5df80b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5e00600640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5df815acd0 0x7f5df815d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5e00600640 1 --2- 172.21.15.59:0/1934377569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5df8144120 0x7f5df813ee20 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5e00600640 1 -- 172.21.15.59:0/1934377569 >> 172.21.15.59:0/1934377569 conn(0x7f5df8067080 msgr2=0x7f5df8071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5e00600640 1 -- 172.21.15.59:0/1934377569 shutdown_connections 2024-04-25T09:07:59.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.744+0000 7f5e00600640 1 -- 172.21.15.59:0/1934377569 wait complete. 2024-04-25T09:07:59.742 INFO:tasks.ceph.mds.a.smithi059.stderr: -4873> 2024-04-25T09:07:51.468+0000 7fea68000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:07:59.755 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-04-25T09:07:59.793 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:07:59.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.812+0000 7fc0c8d57080 1 Processor -- start 2024-04-25T09:07:59.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.812+0000 7fc0c8d57080 1 -- start start 2024-04-25T09:07:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac0022e0 0x563e37294200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 0x563e37294740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563e371e8780 0x563e371e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e371639f0 con 0x563e372953f0 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e37167950 con 0x7fc0ac0022e0 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e37277b30 con 0x563e371e8780 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 0x563e37294740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 0x563e37294740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36628/0 (socket says 172.21.15.59:36628) 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c5600640 1 -- 172.21.15.59:0/3626449526 learned_addr learned my addr 172.21.15.59:0/3626449526 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c6000640 1 --2- 172.21.15.59:0/3626449526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac0022e0 0x563e37294200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c6a00640 1 --2- 172.21.15.59:0/3626449526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563e371e8780 0x563e371e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c5600640 1 -- 172.21.15.59:0/3626449526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563e371e8780 msgr2=0x563e371e8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c5600640 1 --2- 172.21.15.59:0/3626449526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563e371e8780 0x563e371e8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c5600640 1 -- 172.21.15.59:0/3626449526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac0022e0 msgr2=0x563e37294200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c5600640 1 --2- 172.21.15.59:0/3626449526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac0022e0 0x563e37294200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c5600640 1 -- 172.21.15.59:0/3626449526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e371ff310 con 0x563e372953f0 2024-04-25T09:07:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c6000640 1 --2- 172.21.15.59:0/3626449526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac0022e0 0x563e37294200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c5600640 1 --2- 172.21.15.59:0/3626449526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 0x563e37294740 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40099c0 tx=0x7fc0b4005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2185927b8a922fe2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0bfe00640 1 -- 172.21.15.59:0/3626449526 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4019030 con 0x563e372953f0 2024-04-25T09:07:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0bfe00640 1 -- 172.21.15.59:0/3626449526 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b4008b40 con 0x563e372953f0 2024-04-25T09:07:59.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0bfe00640 1 -- 172.21.15.59:0/3626449526 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4015470 con 0x563e372953f0 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3626449526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 msgr2=0x563e37294740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 --2- 172.21.15.59:0/3626449526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 0x563e37294740 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fc0b40099c0 tx=0x7fc0b4005a10 comp rx=0 tx=0).stop 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3626449526 shutdown_connections 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 --2- 172.21.15.59:0/3626449526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563e371e8780 0x563e371e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 --2- 172.21.15.59:0/3626449526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 0x563e37294740 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 --2- 172.21.15.59:0/3626449526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac0022e0 0x563e37294200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3626449526 >> 172.21.15.59:0/3626449526 conn(0x563e371bd400 msgr2=0x563e371ebd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3626449526 shutdown_connections 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3626449526 wait complete. 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 Processor -- start 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 -- start start 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563e371e8780 0x563e37323690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 0x563e37293e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac0022e0 0x563e373229a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e371ff5b0 con 0x563e372953f0 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563e37201030 con 0x7fc0ac0022e0 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.816+0000 7fc0c8d57080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x563e371ff850 con 0x563e371e8780 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 0x563e37293e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 0x563e37293e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36630/0 (socket says 172.21.15.59:36630) 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c5600640 1 -- 172.21.15.59:0/3113833393 learned_addr learned my addr 172.21.15.59:0/3113833393 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c6a00640 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac0022e0 0x563e373229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c6000640 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563e371e8780 0x563e37323690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c5600640 1 -- 172.21.15.59:0/3113833393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563e371e8780 msgr2=0x563e37323690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c5600640 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563e371e8780 0x563e37323690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c5600640 1 -- 172.21.15.59:0/3113833393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac0022e0 msgr2=0x563e373229a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c5600640 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0ac0022e0 0x563e373229a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c5600640 1 -- 172.21.15.59:0/3113833393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563e37320110 con 0x563e372953f0 2024-04-25T09:07:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c5600640 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 0x563e37293e00 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4008780 tx=0x7fc0b4002fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0bea00640 1 -- 172.21.15.59:0/3113833393 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4023070 con 0x563e372953f0 2024-04-25T09:07:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0bea00640 1 -- 172.21.15.59:0/3113833393 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b4028680 con 0x563e372953f0 2024-04-25T09:07:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3113833393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563e373203b0 con 0x563e372953f0 2024-04-25T09:07:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0bea00640 1 -- 172.21.15.59:0/3113833393 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4028a70 con 0x563e372953f0 2024-04-25T09:07:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3113833393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563e373208f0 con 0x563e372953f0 2024-04-25T09:07:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.820+0000 7fc0bea00640 1 -- 172.21.15.59:0/3113833393 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc0b401c070 con 0x563e372953f0 2024-04-25T09:07:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.824+0000 7fc0bea00640 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc0a8065970 0x7fc0a8067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.824+0000 7fc0bea00640 1 -- 172.21.15.59:0/3113833393 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fc0b4086ba0 con 0x563e372953f0 2024-04-25T09:07:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.824+0000 7fc0c8d57080 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x563e3731fc40 0x563e373255a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.824+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3113833393 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:1 13.10 13:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e93) v9 -- 0x563e37294340 con 0x563e3731fc40 2024-04-25T09:07:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.824+0000 7fc0c6000640 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc0a8065970 0x7fc0a8067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.824+0000 7fc0c6a00640 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x563e3731fc40 0x563e373255a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.824+0000 7fc0c6000640 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc0a8065970 0x7fc0a8067e30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80a3fd0 tx=0x7fc0b80011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.824+0000 7fc0c6a00640 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x563e3731fc40 0x563e373255a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.828+0000 7fc0c6a00640 1 -- 172.21.15.59:0/3113833393 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v93'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fc0c0006140 con 0x563e3731fc40 2024-04-25T09:07:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.828+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3113833393 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x563e3731fc40 msgr2=0x563e373255a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.828+0000 7fc0c8d57080 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x563e3731fc40 0x563e373255a0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.828+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3113833393 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc0a8065970 msgr2=0x7fc0a8067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.828+0000 7fc0c8d57080 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc0a8065970 0x7fc0a8067e30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80a3fd0 tx=0x7fc0b80011a0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.828+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3113833393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 msgr2=0x563e37293e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.828+0000 7fc0c8d57080 1 --2- 172.21.15.59:0/3113833393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563e372953f0 0x563e37293e00 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4008780 tx=0x7fc0b4002fc0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.828+0000 7fc0c6a00640 1 -- 172.21.15.59:0/3113833393 reap_dead start 2024-04-25T09:07:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.828+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3113833393 shutdown_connections 2024-04-25T09:07:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.828+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3113833393 >> 172.21.15.59:0/3113833393 conn(0x563e371bd400 msgr2=0x563e37294a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.828+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3113833393 shutdown_connections 2024-04-25T09:07:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.828+0000 7fc0c8d57080 1 -- 172.21.15.59:0/3113833393 wait complete. 2024-04-25T09:07:59.822 DEBUG:teuthology.orchestra.run.smithi059:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-04-25T09:07:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.916+0000 7f21ec3d7400 1 -- start start 2024-04-25T09:07:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.916+0000 7f21ec3d7400 1 Processor -- start 2024-04-25T09:07:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ad3a9800 0x5616ad562580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ad3a9400 0x5616ad562b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ad3a9000 0x5616ad563080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ad43e180 con 0x5616ad3a9800 2024-04-25T09:07:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ad43e300 con 0x5616ad3a9400 2024-04-25T09:07:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616ad43e480 con 0x5616ad3a9000 2024-04-25T09:07:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ea400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ad3a9800 0x5616ad562580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ea400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ad3a9800 0x5616ad562580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36640/0 (socket says 172.21.15.59:36640) 2024-04-25T09:07:59.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ea400640 1 -- 172.21.15.59:0/3535440138 learned_addr learned my addr 172.21.15.59:0/3535440138 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:59.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21eae00640 1 --2- 172.21.15.59:0/3535440138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ad3a9000 0x5616ad563080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21e9a00640 1 --2- 172.21.15.59:0/3535440138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ad3a9400 0x5616ad562b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ea400640 1 -- 172.21.15.59:0/3535440138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ad3a9000 msgr2=0x5616ad563080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ea400640 1 --2- 172.21.15.59:0/3535440138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ad3a9000 0x5616ad563080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ea400640 1 -- 172.21.15.59:0/3535440138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ad3a9400 msgr2=0x5616ad562b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ea400640 1 --2- 172.21.15.59:0/3535440138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ad3a9400 0x5616ad562b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ea400640 1 -- 172.21.15.59:0/3535440138 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ad480b40 con 0x5616ad3a9800 2024-04-25T09:07:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ea400640 1 --2- 172.21.15.59:0/3535440138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ad3a9800 0x5616ad562580 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x5616ae2129f0 tx=0x5616ae17c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d308a34e6e39da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21e7200640 1 -- 172.21.15.59:0/3535440138 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5616ad3de9c0 con 0x5616ad3a9800 2024-04-25T09:07:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3535440138 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616ad480d20 con 0x5616ad3a9800 2024-04-25T09:07:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21e7200640 1 -- 172.21.15.59:0/3535440138 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5616ad3f2e00 con 0x5616ad3a9800 2024-04-25T09:07:59.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3535440138 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5616ad480f00 con 0x5616ad3a9800 2024-04-25T09:07:59.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 4 waiting for MDS map... 2024-04-25T09:07:59.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21e7200640 1 -- 172.21.15.59:0/3535440138 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5616ad3de4e0 con 0x5616ad3a9800 2024-04-25T09:07:59.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21e7200640 1 -- 172.21.15.59:0/3535440138 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x5616ae2c4200 con 0x5616ad3a9800 2024-04-25T09:07:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21e7200640 1 -- 172.21.15.59:0/3535440138 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 66) v1 ==== 2723+0+0 (secure 0 0 0) 0x5616ad3ff180 con 0x5616ad3a9800 2024-04-25T09:07:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 4 Got MDS map 66 2024-04-25T09:07:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 10 main: JournalTool::main 2024-04-25T09:07:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 4 main: JournalTool: connecting to RADOS... 2024-04-25T09:07:59.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 Processor -- start 2024-04-25T09:07:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 -- start start 2024-04-25T09:07:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae181800 0x5616ad563600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae181c00 0x5616ad563b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae320000 0x5616ad564100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ad43e600 con 0x5616ae320000 2024-04-25T09:07:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ad43e780 con 0x5616ae181800 2024-04-25T09:07:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.920+0000 7f21ec3d7400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616ad43e900 con 0x5616ae181c00 2024-04-25T09:07:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae320000 0x5616ad564100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21eae00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae181800 0x5616ad563600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae320000 0x5616ad564100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36642/0 (socket says 172.21.15.59:36642) 2024-04-25T09:07:59.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 -- 172.21.15.59:0/2712452662 learned_addr learned my addr 172.21.15.59:0/2712452662 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ea400640 1 --2- 172.21.15.59:0/2712452662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae181c00 0x5616ad563b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 -- 172.21.15.59:0/2712452662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae181c00 msgr2=0x5616ad563b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 --2- 172.21.15.59:0/2712452662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae181c00 0x5616ad563b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 -- 172.21.15.59:0/2712452662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae181800 msgr2=0x5616ad563600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 --2- 172.21.15.59:0/2712452662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae181800 0x5616ad563600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 -- 172.21.15.59:0/2712452662 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ad4801e0 con 0x5616ae320000 2024-04-25T09:07:59.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ea400640 1 --2- 172.21.15.59:0/2712452662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae181c00 0x5616ad563b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 --2- 172.21.15.59:0/2712452662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae320000 0x5616ad564100 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x5616ae1708d0 tx=0x5616ae178c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124b455ece41fee1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e4a00640 1 -- 172.21.15.59:0/2712452662 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5616ad3de9c0 con 0x5616ae320000 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e4a00640 1 -- 172.21.15.59:0/2712452662 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5616ad3f2a80 con 0x5616ae320000 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e4a00640 1 -- 172.21.15.59:0/2712452662 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5616ad3de4e0 con 0x5616ae320000 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2712452662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae320000 msgr2=0x5616ad564100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2712452662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae320000 0x5616ad564100 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x5616ae1708d0 tx=0x5616ae178c00 comp rx=0 tx=0).stop 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2712452662 shutdown_connections 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2712452662 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae320000 0x5616ad564100 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2712452662 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae181c00 0x5616ad563b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2712452662 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae181800 0x5616ad563600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2712452662 >> 172.21.15.59:0/2712452662 conn(0x5616ad3a8c00 msgr2=0x5616ad3d7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2712452662 shutdown_connections 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2712452662 wait complete. 2024-04-25T09:07:59.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 Processor -- start 2024-04-25T09:07:59.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 -- start start 2024-04-25T09:07:59.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae181c00 0x5616ad565180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae181800 0x5616ad564c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321800 0x5616ad564680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ad43fc80 con 0x5616ae321800 2024-04-25T09:07:59.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ad43fb00 con 0x5616ae181800 2024-04-25T09:07:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ec3d7400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616ad43f980 con 0x5616ae181c00 2024-04-25T09:07:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321800 0x5616ad564680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321800 0x5616ad564680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36650/0 (socket says 172.21.15.59:36650) 2024-04-25T09:07:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 -- 172.21.15.59:0/3263317036 learned_addr learned my addr 172.21.15.59:0/3263317036 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ea400640 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae181800 0x5616ad564c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21eae00640 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae181c00 0x5616ad565180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 -- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae181c00 msgr2=0x5616ad565180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae181c00 0x5616ad565180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 -- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae181800 msgr2=0x5616ad564c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae181800 0x5616ad564c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21e9a00640 1 -- 172.21.15.59:0/3263317036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ad481a40 con 0x5616ae321800 2024-04-25T09:07:59.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.924+0000 7f21ea400640 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae181800 0x5616ad564c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21e9a00640 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321800 0x5616ad564680 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x5616ae171590 tx=0x5616ae17c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21e2c00640 1 -- 172.21.15.59:0/3263317036 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5616ad3de000 con 0x5616ae321800 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21e2c00640 1 -- 172.21.15.59:0/3263317036 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5616ad3f3340 con 0x5616ae321800 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21e2c00640 1 -- 172.21.15.59:0/3263317036 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5616ad3de9c0 con 0x5616ae321800 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3263317036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5616ad481c20 con 0x5616ae321800 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3263317036 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616ad481a40 con 0x5616ae321800 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21ec3d7400 4 main: JournalTool: resolving pool 13 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21e2c00640 1 -- 172.21.15.59:0/3263317036 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x5616ae31ac00 con 0x5616ae321800 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21e2c00640 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x5616ae330800 0x5616ad565700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21e2c00640 1 -- 172.21.15.59:0/3263317036 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x5616ad6de400 con 0x5616ae321800 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21ec3d7400 4 main: JournalTool: creating IoCtx.. 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21ec3d7400 4 main: Executing for rank 0 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21eae00640 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x5616ae330800 0x5616ad565700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21eae00640 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x5616ae330800 0x5616ad565700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x5616ad4b6810 tx=0x5616ad7c7800 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21ec3d7400 1 -- start start 2024-04-25T09:07:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.928+0000 7f21ec3d7400 1 Processor -- start 2024-04-25T09:07:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ec3d7400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321000 0x5616ad564100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ec3d7400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae320c00 0x5616ad563b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ec3d7400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae320800 0x5616ad563600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ec3d7400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ad43f680 con 0x5616ae321000 2024-04-25T09:07:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ec3d7400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616ad43e600 con 0x5616ae320c00 2024-04-25T09:07:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ec3d7400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5616ad43e780 con 0x5616ae320800 2024-04-25T09:07:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21eae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321000 0x5616ad564100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21eae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321000 0x5616ad564100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36652/0 (socket says 172.21.15.59:36652) 2024-04-25T09:07:59.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21eae00640 1 -- 172.21.15.59:0/2838191045 learned_addr learned my addr 172.21.15.59:0/2838191045 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21e9a00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae320800 0x5616ad563600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ea400640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae320c00 0x5616ad563b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21eae00640 1 -- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae320800 msgr2=0x5616ad563600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21eae00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae320800 0x5616ad563600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21eae00640 1 -- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae320c00 msgr2=0x5616ad563b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21eae00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae320c00 0x5616ad563b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21eae00640 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616ad818780 con 0x5616ae321000 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21e9a00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae320800 0x5616ad563600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ea400640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae320c00 0x5616ad563b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21eae00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321000 0x5616ad564100 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x5616ad779920 tx=0x5616ad46c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350abca9d3a640d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21df000640 1 -- 172.21.15.59:0/2838191045 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5616ad712340 con 0x5616ae321000 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21df000640 1 -- 172.21.15.59:0/2838191045 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5616ad3f2540 con 0x5616ae321000 2024-04-25T09:07:59.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21df000640 1 -- 172.21.15.59:0/2838191045 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5616ad7121a0 con 0x5616ae321000 2024-04-25T09:07:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5616ad818960 con 0x5616ae321000 2024-04-25T09:07:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5616ad818b40 con 0x5616ae321000 2024-04-25T09:07:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ec3d7400 4 waiting for MDS map... 2024-04-25T09:07:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21df000640 1 -- 172.21.15.59:0/2838191045 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x5616ad828600 con 0x5616ae321000 2024-04-25T09:07:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21df000640 1 -- 172.21.15.59:0/2838191045 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 66) v1 ==== 2723+0+0 (secure 0 0 0) 0x5616ad834000 con 0x5616ae321000 2024-04-25T09:07:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ec3d7400 4 Got MDS map 66 2024-04-25T09:07:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x5616ae320400 0x5616ad842000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:1 13.f 13:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93) v9 -- 0x5616ae320000 con 0x5616ae320400 2024-04-25T09:07:59.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ea400640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x5616ae320400 0x5616ad842000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.932+0000 7f21ea400640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x5616ae320400 0x5616ad842000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=f091b3f89939f83b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.936+0000 7f21ea400640 1 -- 172.21.15.59:0/2838191045 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5616ad524000 con 0x5616ae320400 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.936+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x5616ad82a400 0x5616ad842580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.936+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:2 13.14 13:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e93) v9 -- 0x5616ad82a800 con 0x5616ad82a400 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.936+0000 7f21e9a00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x5616ad82a400 0x5616ad842580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.936+0000 7f21e9a00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x5616ad82a400 0x5616ad842580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=8db7d9e50ba7881b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.936+0000 7f21e9a00640 1 -- 172.21.15.59:0/2838191045 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv20 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5616ad524500 con 0x5616ad82a400 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.936+0000 7f21dd200640 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:3 13.14 13:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e93) v9 -- 0x5616ad84e000 con 0x5616ad82a400 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.936+0000 7f21dd200640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x5616ad84e400 0x5616ad844680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.936+0000 7f21dd200640 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:4 13.1b 13:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e93) v9 -- 0x5616ad84e800 con 0x5616ad84e400 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.936+0000 7f21e9a00640 1 -- 172.21.15.59:0/2838191045 <== osd.0 v2:172.21.15.59:6800/4129855307 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x5616ad524500 con 0x5616ad82a400 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21eae00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x5616ad84e400 0x5616ad844680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21eae00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x5616ad84e400 0x5616ad844680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=132dfb6d12f3c9d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21eae00640 1 -- 172.21.15.59:0/2838191045 <== osd.4 v2:172.21.15.178:6805/2278719369 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5616ad524780 con 0x5616ad84e400 2024-04-25T09:07:59.944 INFO:teuthology.orchestra.run.smithi059.stdout:old journal was 4212018~2030 2024-04-25T09:07:59.944 INFO:teuthology.orchestra.run.smithi059.stdout:new journal start will be 8388608 (4174560 bytes past old end) 2024-04-25T09:07:59.944 INFO:teuthology.orchestra.run.smithi059.stdout:writing journal head 2024-04-25T09:07:59.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:5 13.14 13:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) v9 -- 0x5616ad82ac00 con 0x5616ad82a400 2024-04-25T09:07:59.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21e9a00640 1 -- 172.21.15.59:0/2838191045 <== osd.0 v2:172.21.15.59:6800/4129855307 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v93'21 uv21 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5616ad524500 con 0x5616ad82a400 2024-04-25T09:07:59.945 INFO:teuthology.orchestra.run.smithi059.stdout:writing EResetJournal entry 2024-04-25T09:07:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:6 13.1b 13:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) v9 -- 0x5616ad82b000 con 0x5616ad84e400 2024-04-25T09:07:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x5616ad82b400 0x5616ad842b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:7 13.b 13:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) v9 -- 0x5616ad82b800 con 0x5616ad82b400 2024-04-25T09:07:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:8 13.1f 13:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) v9 -- 0x5616ad82bc00 con 0x5616ae320400 2024-04-25T09:07:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5616ad84ec00 0x5616ad843080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:9 13.1a 13:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) v9 -- 0x5616ad84f000 con 0x5616ad84ec00 2024-04-25T09:07:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:10 13.1e 13:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) v9 -- 0x5616ad84f400 con 0x5616ad84e400 2024-04-25T09:07:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x5616ad84f800 0x5616ad843600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:07:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:11 13.1d 13:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) v9 -- 0x5616ad84fc00 con 0x5616ad84f800 2024-04-25T09:07:59.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21e9a00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5616ad84ec00 0x5616ad843080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21ea400640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x5616ad82b400 0x5616ad842b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21eae00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x5616ad84f800 0x5616ad843600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.940+0000 7f21e9a00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5616ad84ec00 0x5616ad843080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=4788abba1d6321bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.944+0000 7f21ea400640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x5616ad82b400 0x5616ad842b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=f0c8b6714f649a6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.944+0000 7f21eae00640 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x5616ad84f800 0x5616ad843600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=ac34075066e15d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.944+0000 7f21eae00640 1 -- 172.21.15.59:0/2838191045 <== osd.4 v2:172.21.15.178:6805/2278719369 2 ==== osd_op_reply(10 200.00000006 [delete] v93'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5616ad524780 con 0x5616ad84e400 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.944+0000 7f21ea400640 1 -- 172.21.15.59:0/2838191045 <== osd.6 v2:172.21.15.178:6800/2032393933 2 ==== osd_op_reply(8 200.00000004 [delete] v93'7 uv6 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5616ad524000 con 0x5616ae320400 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.944+0000 7f21eae00640 1 -- 172.21.15.59:0/2838191045 <== osd.4 v2:172.21.15.178:6805/2278719369 3 ==== osd_op_reply(6 200.00000002 [delete] v93'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5616ad524780 con 0x5616ad84e400 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.944+0000 7f21e9a00640 1 -- 172.21.15.59:0/2838191045 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(9 200.00000005 [delete] v93'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5616ad524500 con 0x5616ad84ec00 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.944+0000 7f21ea400640 1 -- 172.21.15.59:0/2838191045 <== osd.5 v2:172.21.15.178:6802/3576783051 1 ==== osd_op_reply(7 200.00000003 [delete] v93'4 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5616ad524000 con 0x5616ad82b400 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.944+0000 7f21dd200640 1 -- 172.21.15.59:0/2838191045 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:12 13.1b 13:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e93) v9 -- 0x5616ad84e000 con 0x5616ad84e400 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.944+0000 7f21eae00640 1 -- 172.21.15.59:0/2838191045 <== osd.4 v2:172.21.15.178:6805/2278719369 4 ==== osd_op_reply(12 200.00000002 [write 0~48] v93'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5616ad524780 con 0x5616ad84e400 2024-04-25T09:07:59.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21eae00640 1 -- 172.21.15.59:0/2838191045 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== osd_op_reply(11 200.00000007 [delete] v93'3 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5616ad524780 con 0x5616ad84f800 2024-04-25T09:07:59.949 INFO:teuthology.orchestra.run.smithi059.stdout:done 2024-04-25T09:07:59.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x5616ad82a400 msgr2=0x5616ad842580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x5616ad82a400 0x5616ad842580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5616ad84ec00 msgr2=0x5616ad843080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5616ad84ec00 0x5616ad843080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x5616ad84e400 msgr2=0x5616ad844680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x5616ad84e400 0x5616ad844680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x5616ad82b400 msgr2=0x5616ad842b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x5616ad82b400 0x5616ad842b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x5616ae320400 msgr2=0x5616ad842000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x5616ae320400 0x5616ad842000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x5616ad84f800 msgr2=0x5616ad843600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x5616ad84f800 0x5616ad843600 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ea400640 1 -- 172.21.15.59:0/2838191045 reap_dead start 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ea400640 1 -- 172.21.15.59:0/2838191045 reap_dead start 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321000 msgr2=0x5616ad564100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/2838191045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321000 0x5616ad564100 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x5616ad779920 tx=0x5616ad46c5a0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ea400640 1 -- 172.21.15.59:0/2838191045 reap_dead start 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ea400640 1 -- 172.21.15.59:0/2838191045 reap_dead start 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 shutdown_connections 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 >> 172.21.15.59:0/2838191045 conn(0x5616ae321400 msgr2=0x5616ad812000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 shutdown_connections 2024-04-25T09:07:59.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/2838191045 wait complete. 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x5616ae330800 msgr2=0x5616ad565700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x5616ae330800 0x5616ad565700 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x5616ad4b6810 tx=0x5616ad7c7800 comp rx=0 tx=0).stop 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3263317036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321800 msgr2=0x5616ad564680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321800 0x5616ad564680 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x5616ae171590 tx=0x5616ae17c060 comp rx=0 tx=0).stop 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3263317036 shutdown_connections 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x5616ae330800 0x5616ad565700 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ae321800 0x5616ad564680 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ae181800 0x5616ad564c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/3263317036 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ae181c00 0x5616ad565180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3263317036 >> 172.21.15.59:0/3263317036 conn(0x5616ad3a8c00 msgr2=0x5616ad3d7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3263317036 shutdown_connections 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3263317036 wait complete. 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3535440138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ad3a9800 msgr2=0x5616ad562580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/3535440138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ad3a9800 0x5616ad562580 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x5616ae2129f0 tx=0x5616ae17c000 comp rx=0 tx=0).stop 2024-04-25T09:07:59.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3535440138 shutdown_connections 2024-04-25T09:07:59.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/3535440138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5616ad3a9000 0x5616ad563080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/3535440138 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5616ad3a9400 0x5616ad562b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 --2- 172.21.15.59:0/3535440138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5616ad3a9800 0x5616ad562580 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:07:59.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3535440138 >> 172.21.15.59:0/3535440138 conn(0x5616ad3a9c00 msgr2=0x5616ad3d7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:07:59.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3535440138 shutdown_connections 2024-04-25T09:07:59.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:07:59.948+0000 7f21ec3d7400 1 -- 172.21.15.59:0/3535440138 wait complete. 2024-04-25T09:07:59.954 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.132611, result: old journal was 4212018~2030 new journal start will be 8388608 (4174560 bytes past old end) writing journal head writing EResetJournal entry done 2024-04-25T09:07:59.954 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:08:00.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.152+0000 7ff655800640 1 Processor -- start 2024-04-25T09:08:00.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.152+0000 7ff655800640 1 -- start start 2024-04-25T09:08:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff655800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff650072210 0x7ff65006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff655800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff65015af40 0x7ff6500cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff655800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65015e9a0 con 0x7ff650150f40 2024-04-25T09:08:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff655800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65006f530 con 0x7ff650072210 2024-04-25T09:08:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff655800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff65015dbe0 con 0x7ff65015af40 2024-04-25T09:08:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff64ea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff650150f40 0x7ff650071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47252/0 (socket says 172.21.15.59:47252) 2024-04-25T09:08:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff64ea00640 1 -- 172.21.15.59:0/361624187 learned_addr learned my addr 172.21.15.59:0/361624187 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:08:00.143 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff646000640 1 --2- 172.21.15.59:0/361624187 >> v2:172.21.15.59:3300/0 conn(0x7ff650072210 0x7ff65006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff64f400640 1 --2- 172.21.15.59:0/361624187 >> v2:172.21.15.178:3300/0 conn(0x7ff65015af40 0x7ff6500cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff64e000640 1 -- 172.21.15.59:0/361624187 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923094173 0 0) 0x7ff65015e9a0 con 0x7ff650150f40 2024-04-25T09:08:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff646000640 1 -- 172.21.15.59:0/361624187 >> v2:172.21.15.178:3300/0 conn(0x7ff65015af40 msgr2=0x7ff6500cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff646000640 1 --2- 172.21.15.59:0/361624187 >> v2:172.21.15.178:3300/0 conn(0x7ff65015af40 0x7ff6500cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff646000640 1 -- 172.21.15.59:0/361624187 >> v1:172.21.15.59:6789/0 conn(0x7ff650150f40 legacy=0x7ff650071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff646000640 1 -- 172.21.15.59:0/361624187 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff65015dec0 con 0x7ff650072210 2024-04-25T09:08:00.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff646000640 1 --2- 172.21.15.59:0/361624187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff650072210 0x7ff65006ef50 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7ff65006eb00 tx=0x7ff63801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d97b24f2e2e240 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff64e000640 1 -- 172.21.15.59:0/361624187 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6380ac070 con 0x7ff650072210 2024-04-25T09:08:00.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff64e000640 1 -- 172.21.15.59:0/361624187 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6380a6480 con 0x7ff650072210 2024-04-25T09:08:00.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.156+0000 7ff64e000640 1 -- 172.21.15.59:0/361624187 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6380a6850 con 0x7ff650072210 2024-04-25T09:08:00.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 -- 172.21.15.59:0/361624187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff650072210 msgr2=0x7ff65006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 --2- 172.21.15.59:0/361624187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff650072210 0x7ff65006ef50 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7ff65006eb00 tx=0x7ff63801c830 comp rx=0 tx=0).stop 2024-04-25T09:08:00.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 -- 172.21.15.59:0/361624187 shutdown_connections 2024-04-25T09:08:00.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 --2- 172.21.15.59:0/361624187 >> v2:172.21.15.178:3300/0 conn(0x7ff65015af40 0x7ff6500cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 --2- 172.21.15.59:0/361624187 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff650072210 0x7ff65006ef50 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 -- 172.21.15.59:0/361624187 >> 172.21.15.59:0/361624187 conn(0x7ff650067080 msgr2=0x7ff65006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 -- 172.21.15.59:0/361624187 shutdown_connections 2024-04-25T09:08:00.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 -- 172.21.15.59:0/361624187 wait complete. 2024-04-25T09:08:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 Processor -- start 2024-04-25T09:08:00.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 -- start start 2024-04-25T09:08:00.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff650072210 0x7ff650154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff650150f40 0x7ff65013dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015af40 0x7ff6500b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500ce380 con 0x7ff650150f40 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500ce200 con 0x7ff650072210 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff655800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6500ce500 con 0x7ff65015af40 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff646000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff650150f40 0x7ff65013dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff646000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff650150f40 0x7ff65013dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36672/0 (socket says 172.21.15.59:36672) 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff646000640 1 -- 172.21.15.59:0/1188901361 learned_addr learned my addr 172.21.15.59:0/1188901361 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff64ea00640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff650072210 0x7ff650154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff64f400640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015af40 0x7ff6500b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff646000640 1 -- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015af40 msgr2=0x7ff6500b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff646000640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015af40 0x7ff6500b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff646000640 1 -- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff650072210 msgr2=0x7ff650154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff646000640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff650072210 0x7ff650154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff646000640 1 -- 172.21.15.59:0/1188901361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650163470 con 0x7ff650150f40 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.160+0000 7ff64ea00640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff650072210 0x7ff650154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:00.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.164+0000 7ff646000640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff650150f40 0x7ff65013dce0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff63801a460 tx=0x7ff6380195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.164+0000 7ff647400640 1 -- 172.21.15.59:0/1188901361 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6380ac040 con 0x7ff650150f40 2024-04-25T09:08:00.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.164+0000 7ff647400640 1 -- 172.21.15.59:0/1188901361 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6380a7660 con 0x7ff650150f40 2024-04-25T09:08:00.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.164+0000 7ff647400640 1 -- 172.21.15.59:0/1188901361 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63800a560 con 0x7ff650150f40 2024-04-25T09:08:00.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.164+0000 7ff655800640 1 -- 172.21.15.59:0/1188901361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff650163750 con 0x7ff650150f40 2024-04-25T09:08:00.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.164+0000 7ff655800640 1 -- 172.21.15.59:0/1188901361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff650163d10 con 0x7ff650150f40 2024-04-25T09:08:00.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.164+0000 7ff655800640 1 -- 172.21.15.59:0/1188901361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff650163f50 con 0x7ff650150f40 2024-04-25T09:08:00.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.164+0000 7ff647400640 1 -- 172.21.15.59:0/1188901361 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff6380af070 con 0x7ff650150f40 2024-04-25T09:08:00.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.164+0000 7ff647400640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff62c066f60 0x7ff62c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.164+0000 7ff647400640 1 -- 172.21.15.59:0/1188901361 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7ff63811f800 con 0x7ff650150f40 2024-04-25T09:08:00.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.164+0000 7ff64ea00640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff62c066f60 0x7ff62c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.168+0000 7ff64ea00640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff62c066f60 0x7ff62c069420 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff640000f70 tx=0x7ff640009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.168+0000 7ff647400640 1 -- 172.21.15.59:0/1188901361 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff650163f50 con 0x7ff650150f40 2024-04-25T09:08:00.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.364+0000 7ff655800640 1 -- 172.21.15.59:0/1188901361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7ff6500745d0 con 0x7ff650150f40 2024-04-25T09:08:00.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.748+0000 7ff647400640 1 -- 172.21.15.59:0/1188901361 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v67) v1 ==== 162+0+0 (secure 0 0 0) 0x7ff638016540 con 0x7ff650150f40 2024-04-25T09:08:00.737 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:08:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.752+0000 7ff655800640 1 -- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff62c066f60 msgr2=0x7ff62c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.752+0000 7ff655800640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff62c066f60 0x7ff62c069420 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff640000f70 tx=0x7ff640009040 comp rx=0 tx=0).stop 2024-04-25T09:08:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.752+0000 7ff655800640 1 -- 172.21.15.59:0/1188901361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff650150f40 msgr2=0x7ff65013dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.752+0000 7ff655800640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff650150f40 0x7ff65013dce0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff63801a460 tx=0x7ff6380195d0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.752+0000 7ff655800640 1 -- 172.21.15.59:0/1188901361 shutdown_connections 2024-04-25T09:08:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.752+0000 7ff655800640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff62c066f60 0x7ff62c069420 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.752+0000 7ff655800640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff65015af40 0x7ff6500b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.752+0000 7ff655800640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff650150f40 0x7ff65013dce0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.752+0000 7ff655800640 1 --2- 172.21.15.59:0/1188901361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff650072210 0x7ff650154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.752+0000 7ff655800640 1 -- 172.21.15.59:0/1188901361 >> 172.21.15.59:0/1188901361 conn(0x7ff650067080 msgr2=0x7ff65006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.752+0000 7ff655800640 1 -- 172.21.15.59:0/1188901361 shutdown_connections 2024-04-25T09:08:00.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.752+0000 7ff655800640 1 -- 172.21.15.59:0/1188901361 wait complete. 2024-04-25T09:08:00.765 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:00.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f178ca00640 1 Processor -- start 2024-04-25T09:08:00.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f178ca00640 1 -- start start 2024-04-25T09:08:00.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f178ca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178815b5a0 0x7f17880cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f178ca00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17880ce7f0 con 0x7f17880cc440 2024-04-25T09:08:00.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f178ca00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17880cead0 con 0x7f178815b980 2024-04-25T09:08:00.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f178ca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17880cfcd0 con 0x7f178815b5a0 2024-04-25T09:08:00.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1786800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f17880cc440 0x7f17880d0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54436/0 (socket says 172.21.15.59:54436) 2024-04-25T09:08:00.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1786800640 1 -- 172.21.15.59:0/2316679784 learned_addr learned my addr 172.21.15.59:0/2316679784 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:08:00.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785e00640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178815b5a0 0x7f17880cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548283250 0 0) 0x7f17880ce7f0 con 0x7f17880cc440 2024-04-25T09:08:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f176c003530 con 0x7f17880cc440 2024-04-25T09:08:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437453454 0 0) 0x7f17880cead0 con 0x7f178815b980 2024-04-25T09:08:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17880ce7f0 con 0x7f178815b980 2024-04-25T09:08:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2687154647 0 0) 0x7f176c003530 con 0x7f17880cc440 2024-04-25T09:08:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178815b5a0 msgr2=0x7f17880cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178815b5a0 0x7f17880cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 >> v1:172.21.15.178:6789/0 conn(0x7f178815b980 legacy=0x7f17880cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17880cf960 con 0x7f17880cc440 2024-04-25T09:08:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785e00640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178815b5a0 0x7f17880cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f1780001a00 con 0x7f17880cc440 2024-04-25T09:08:00.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 >> v1:172.21.15.59:6789/0 conn(0x7f17880cc440 legacy=0x7f17880d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f176c003b80 0x7f176c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178815b5a0 0x7f176c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176c004d50 0x7f176c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17880cfcd0 con 0x7f176c004d50 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c00ba80 con 0x7f176c003b80 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c00bc00 con 0x7f178815b5a0 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1786800640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176c004d50 0x7f176c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f1785e00640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f176c003b80 0x7f176c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.920+0000 7f177fe00640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178815b5a0 0x7f176c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f1786800640 1 -- 172.21.15.59:0/2316679784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178815b5a0 msgr2=0x7f176c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f1786800640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f178815b5a0 0x7f176c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f1786800640 1 -- 172.21.15.59:0/2316679784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f176c003b80 msgr2=0x7f176c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f1786800640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f176c003b80 0x7f176c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f1786800640 1 -- 172.21.15.59:0/2316679784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c003530 con 0x7f176c004d50 2024-04-25T09:08:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f1786800640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176c004d50 0x7f176c0051d0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f178000a7c0 tx=0x7f178001fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc670d27f188b821 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178000a410 con 0x7f176c004d50 2024-04-25T09:08:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17800aa650 con 0x7f176c004d50 2024-04-25T09:08:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f1785400640 1 -- 172.21.15.59:0/2316679784 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17800aaa40 con 0x7f176c004d50 2024-04-25T09:08:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f178ca00640 1 -- 172.21.15.59:0/2316679784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176c004d50 msgr2=0x7f176c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f178ca00640 1 --2- 172.21.15.59:0/2316679784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f176c004d50 0x7f176c0051d0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f178000a7c0 tx=0x7f178001fa00 comp rx=0 tx=0).stop 2024-04-25T09:08:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f1786800640 1 -- 172.21.15.59:0/2316679784 reap_dead start 2024-04-25T09:08:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f178ca00640 1 -- 172.21.15.59:0/2316679784 shutdown_connections 2024-04-25T09:08:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f178ca00640 1 -- 172.21.15.59:0/2316679784 >> 172.21.15.59:0/2316679784 conn(0x7f17880b3390 msgr2=0x7f17880b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f178ca00640 1 -- 172.21.15.59:0/2316679784 shutdown_connections 2024-04-25T09:08:00.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.924+0000 7f178ca00640 1 -- 172.21.15.59:0/2316679784 wait complete. 2024-04-25T09:08:00.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f178ca00640 1 Processor -- start 2024-04-25T09:08:00.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f178ca00640 1 -- start start 2024-04-25T09:08:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f178ca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f176c004d50 0x7f178814c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f178ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f178815ea40 0x7f1788151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f178ca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1788151b90 0x7f178814f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f178ca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17880cdea0 con 0x7f178815ea40 2024-04-25T09:08:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f178ca00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1788071c40 con 0x7f176c004d50 2024-04-25T09:08:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f178ca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17880ce020 con 0x7f1788151b90 2024-04-25T09:08:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f177fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f178815ea40 0x7f1788151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f177fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f178815ea40 0x7f1788151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60410/0 (socket says 172.21.15.59:60410) 2024-04-25T09:08:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f177fe00640 1 -- 172.21.15.59:0/4063037351 learned_addr learned my addr 172.21.15.59:0/4063037351 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f1785e00640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f176c004d50 0x7f178814c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f1786800640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1788151b90 0x7f178814f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f177fe00640 1 -- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1788151b90 msgr2=0x7f178814f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f177fe00640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1788151b90 0x7f178814f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f177fe00640 1 -- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f176c004d50 msgr2=0x7f178814c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f177fe00640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f176c004d50 0x7f178814c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f177fe00640 1 -- 172.21.15.59:0/4063037351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17881520c0 con 0x7f178815ea40 2024-04-25T09:08:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f177fe00640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f178815ea40 0x7f1788151650 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f177000f730 tx=0x7f177000fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f177e000640 1 -- 172.21.15.59:0/4063037351 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177000fe40 con 0x7f178815ea40 2024-04-25T09:08:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f177e000640 1 -- 172.21.15.59:0/4063037351 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1770018070 con 0x7f178815ea40 2024-04-25T09:08:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f177e000640 1 -- 172.21.15.59:0/4063037351 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177000d730 con 0x7f178815ea40 2024-04-25T09:08:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f178ca00640 1 -- 172.21.15.59:0/4063037351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17881523a0 con 0x7f178815ea40 2024-04-25T09:08:00.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.928+0000 7f178ca00640 1 -- 172.21.15.59:0/4063037351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1788152960 con 0x7f178815ea40 2024-04-25T09:08:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.932+0000 7f178ca00640 1 -- 172.21.15.59:0/4063037351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17880745d0 con 0x7f178815ea40 2024-04-25T09:08:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.932+0000 7f177e000640 1 -- 172.21.15.59:0/4063037351 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f177000d8d0 con 0x7f178815ea40 2024-04-25T09:08:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.932+0000 7f177e000640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1764066f90 0x7f1764069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:00.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.932+0000 7f177e000640 1 -- 172.21.15.59:0/4063037351 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f1770085260 con 0x7f178815ea40 2024-04-25T09:08:00.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.932+0000 7f1785e00640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1764066f90 0x7f1764069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:00.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.932+0000 7f1785e00640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1764066f90 0x7f1764069450 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1778009b30 tx=0x7f1778008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:00.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:00.936+0000 7f177e000640 1 -- 172.21.15.59:0/4063037351 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1770055ff0 con 0x7f178815ea40 2024-04-25T09:08:01.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.132+0000 7f178ca00640 1 -- 172.21.15.59:0/4063037351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17880cc960 con 0x7f178815ea40 2024-04-25T09:08:01.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.132+0000 7f177e000640 1 -- 172.21.15.59:0/4063037351 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f17700558f0 con 0x7f178815ea40 2024-04-25T09:08:01.122 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:08:01.122 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":68,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:08:00.752285+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7668},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7668":{"gid":7668,"name":"a","rank":0,"incarnation":68,"state":"up:replay","state_seq":1,"addr":"172.21.15.59:6835/4079513876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":4079513876},{"type":"v1","addr":"172.21.15.59:6835","nonce":4079513876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:08:01.123 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 68 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.136+0000 7f178ca00640 1 -- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1764066f90 msgr2=0x7f1764069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.136+0000 7f178ca00640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1764066f90 0x7f1764069450 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1778009b30 tx=0x7f1778008040 comp rx=0 tx=0).stop 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.136+0000 7f178ca00640 1 -- 172.21.15.59:0/4063037351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f178815ea40 msgr2=0x7f1788151650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.136+0000 7f178ca00640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f178815ea40 0x7f1788151650 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f177000f730 tx=0x7f177000fbf0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.136+0000 7f178ca00640 1 -- 172.21.15.59:0/4063037351 shutdown_connections 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.136+0000 7f178ca00640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1764066f90 0x7f1764069450 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.136+0000 7f178ca00640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1788151b90 0x7f178814f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.136+0000 7f178ca00640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f178815ea40 0x7f1788151650 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.136+0000 7f178ca00640 1 --2- 172.21.15.59:0/4063037351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f176c004d50 0x7f178814c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.136+0000 7f178ca00640 1 -- 172.21.15.59:0/4063037351 >> 172.21.15.59:0/4063037351 conn(0x7f17880b3390 msgr2=0x7f17880b7320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.136+0000 7f178ca00640 1 -- 172.21.15.59:0/4063037351 shutdown_connections 2024-04-25T09:08:01.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:01.136+0000 7f178ca00640 1 -- 172.21.15.59:0/4063037351 wait complete. 2024-04-25T09:08:01.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:07:48.892826+0000', 'modified': '2024-04-25T09:08:00.752285+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 93, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7668}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7668': {'gid': 7668, 'name': 'a', 'rank': 0, 'incarnation': 68, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.59:6835/4079513876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 4079513876}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 4079513876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:08:01.546 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7668:up:replay 2024-04-25T09:08:02.547 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.708+0000 7f9307a00640 1 Processor -- start 2024-04-25T09:08:02.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.708+0000 7f9307a00640 1 -- start start 2024-04-25T09:08:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f9307a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f930015da10 0x7f93000afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f9307a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000b4210 0x7f93000b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f9307a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930015ddf0 con 0x7f93000d11b0 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f9307a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93000b4ba0 con 0x7f930015da10 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f9307a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930006b480 con 0x7f93000b4210 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92f7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f93000d11b0 0x7f930006ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54440/0 (socket says 172.21.15.59:54440) 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92f7e00640 1 -- 172.21.15.59:0/1146103204 learned_addr learned my addr 172.21.15.59:0/1146103204 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f9305a00640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000b4210 0x7f93000b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f9305000640 1 --2- 172.21.15.59:0/1146103204 >> v2:172.21.15.178:3300/0 conn(0x7f930015da10 0x7f93000afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551066249 0 0) 0x7f930015ddf0 con 0x7f93000d11b0 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e4003530 con 0x7f93000d11b0 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1176793845 0 0) 0x7f92e4003530 con 0x7f93000d11b0 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000b4210 msgr2=0x7f93000b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000b4210 0x7f93000b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 >> v2:172.21.15.178:3300/0 conn(0x7f930015da10 msgr2=0x7f93000afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 --2- 172.21.15.59:0/1146103204 >> v2:172.21.15.178:3300/0 conn(0x7f930015da10 0x7f93000afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93000d06d0 con 0x7f93000d11b0 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f92e8001680 con 0x7f93000d11b0 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 >> v1:172.21.15.59:6789/0 conn(0x7f93000d11b0 legacy=0x7f930006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000b4210 0x7f92e40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92e4003f90 0x7f92e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92e4004d50 0x7f92e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93000b4ba0 con 0x7f92e4003f90 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930006b480 con 0x7f92e4004d50 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e400ba80 con 0x7f93000b4210 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92f7e00640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92e4003f90 0x7f92e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f9305a00640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92e4004d50 0x7f92e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f9305000640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000b4210 0x7f92e40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92f7e00640 1 -- 172.21.15.59:0/1146103204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000b4210 msgr2=0x7f92e40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92f7e00640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000b4210 0x7f92e40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92f7e00640 1 -- 172.21.15.59:0/1146103204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92e4004d50 msgr2=0x7f92e40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92f7e00640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92e4004d50 0x7f92e40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f92f7e00640 1 -- 172.21.15.59:0/1146103204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e4003530 con 0x7f92e4003f90 2024-04-25T09:08:02.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.712+0000 7f9305a00640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92e4004d50 0x7f92e40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.716+0000 7f92f7e00640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92e4003f90 0x7f92e4004810 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f92e800c160 tx=0x7f92e801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4618e55e0092b5ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.716+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8007c90 con 0x7f92e4003f90 2024-04-25T09:08:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.716+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e80a9020 con 0x7f92e4003f90 2024-04-25T09:08:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.716+0000 7f92ffe00640 1 -- 172.21.15.59:0/1146103204 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e8005ae0 con 0x7f92e4003f90 2024-04-25T09:08:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.716+0000 7f9307a00640 1 -- 172.21.15.59:0/1146103204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92e4003f90 msgr2=0x7f92e4004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.716+0000 7f9307a00640 1 --2- 172.21.15.59:0/1146103204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92e4003f90 0x7f92e4004810 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f92e800c160 tx=0x7f92e801cbe0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.716+0000 7f9305a00640 1 -- 172.21.15.59:0/1146103204 reap_dead start 2024-04-25T09:08:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.716+0000 7f9307a00640 1 -- 172.21.15.59:0/1146103204 shutdown_connections 2024-04-25T09:08:02.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.716+0000 7f9307a00640 1 -- 172.21.15.59:0/1146103204 >> 172.21.15.59:0/1146103204 conn(0x7f93000b2400 msgr2=0x7f93000b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:02.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.716+0000 7f9307a00640 1 -- 172.21.15.59:0/1146103204 shutdown_connections 2024-04-25T09:08:02.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.716+0000 7f9307a00640 1 -- 172.21.15.59:0/1146103204 wait complete. 2024-04-25T09:08:02.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9307a00640 1 Processor -- start 2024-04-25T09:08:02.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9307a00640 1 -- start start 2024-04-25T09:08:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9307a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92e4003f90 0x7f93000cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9307a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000cb690 0x7f93000cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9307a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93000cbb10 0x7f93000cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9307a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9300162190 con 0x7f93000cbb10 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9307a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9300162010 con 0x7f92e4003f90 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9307a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9300162310 con 0x7f93000cb690 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9305a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93000cbb10 0x7f93000cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9305a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93000cbb10 0x7f93000cdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60436/0 (socket says 172.21.15.59:60436) 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9305a00640 1 -- 172.21.15.59:0/2846649540 learned_addr learned my addr 172.21.15.59:0/2846649540 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9305000640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92e4003f90 0x7f93000cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f92f7e00640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000cb690 0x7f93000cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9305a00640 1 -- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000cb690 msgr2=0x7f93000cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9305a00640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000cb690 0x7f93000cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9305a00640 1 -- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92e4003f90 msgr2=0x7f93000cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9305a00640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92e4003f90 0x7f93000cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9305a00640 1 -- 172.21.15.59:0/2846649540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93000ca5f0 con 0x7f93000cbb10 2024-04-25T09:08:02.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9305a00640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93000cbb10 0x7f93000cdf90 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f93000cd200 tx=0x7f92f8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f92fd600640 1 -- 172.21.15.59:0/2846649540 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8010db0 con 0x7f93000cbb10 2024-04-25T09:08:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f92fd600640 1 -- 172.21.15.59:0/2846649540 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f80039a0 con 0x7f93000cbb10 2024-04-25T09:08:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f92fd600640 1 -- 172.21.15.59:0/2846649540 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f8003d90 con 0x7f93000cbb10 2024-04-25T09:08:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9307a00640 1 -- 172.21.15.59:0/2846649540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93000ca8d0 con 0x7f93000cbb10 2024-04-25T09:08:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.720+0000 7f9307a00640 1 -- 172.21.15.59:0/2846649540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93000cae90 con 0x7f93000cbb10 2024-04-25T09:08:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.724+0000 7f9307a00640 1 -- 172.21.15.59:0/2846649540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93000745d0 con 0x7f93000cbb10 2024-04-25T09:08:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.724+0000 7f92fd600640 1 -- 172.21.15.59:0/2846649540 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f92f801e020 con 0x7f93000cbb10 2024-04-25T09:08:02.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.724+0000 7f92fd600640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92dc066f60 0x7f92dc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.724+0000 7f92fd600640 1 -- 172.21.15.59:0/2846649540 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f92f8085740 con 0x7f93000cbb10 2024-04-25T09:08:02.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.724+0000 7f9305000640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92dc066f60 0x7f92dc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:02.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.724+0000 7f9305000640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92dc066f60 0x7f92dc069420 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009b60 tx=0x7f92f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:02.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.728+0000 7f92fd600640 1 -- 172.21.15.59:0/2846649540 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f92f8025020 con 0x7f93000cbb10 2024-04-25T09:08:02.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 -- 172.21.15.59:0/2846649540 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9300072860 con 0x7f93000cbb10 2024-04-25T09:08:02.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f92fd600640 1 -- 172.21.15.59:0/2846649540 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f92f8055e80 con 0x7f93000cbb10 2024-04-25T09:08:02.916 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:08:02.916 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":70,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:08:01.757785+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7668},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7668":{"gid":7668,"name":"a","rank":0,"incarnation":68,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.59:6835/4079513876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":4079513876},{"type":"v1","addr":"172.21.15.59:6835","nonce":4079513876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:08:02.916 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 70 2024-04-25T09:08:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 -- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92dc066f60 msgr2=0x7f92dc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92dc066f60 0x7f92dc069420 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f92f0009b60 tx=0x7f92f0008040 comp rx=0 tx=0).stop 2024-04-25T09:08:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 -- 172.21.15.59:0/2846649540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93000cbb10 msgr2=0x7f93000cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93000cbb10 0x7f93000cdf90 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f93000cd200 tx=0x7f92f8010590 comp rx=0 tx=0).stop 2024-04-25T09:08:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 -- 172.21.15.59:0/2846649540 shutdown_connections 2024-04-25T09:08:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92dc066f60 0x7f92dc069420 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93000cbb10 0x7f93000cdf90 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93000cb690 0x7f93000cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 --2- 172.21.15.59:0/2846649540 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92e4003f90 0x7f93000cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:02.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 -- 172.21.15.59:0/2846649540 >> 172.21.15.59:0/2846649540 conn(0x7f93000b2400 msgr2=0x7f930015e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:02.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 -- 172.21.15.59:0/2846649540 shutdown_connections 2024-04-25T09:08:02.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:02.928+0000 7f9307a00640 1 -- 172.21.15.59:0/2846649540 wait complete. 2024-04-25T09:08:03.339 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:07:48.892826+0000', 'modified': '2024-04-25T09:08:01.757785+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 93, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7668}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7668': {'gid': 7668, 'name': 'a', 'rank': 0, 'incarnation': 68, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.59:6835/4079513876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 4079513876}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 4079513876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:08:03.339 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7668:up:rejoin 2024-04-25T09:08:04.340 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:04.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.504+0000 7f6e73800640 1 Processor -- start 2024-04-25T09:08:04.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.504+0000 7f6e73800640 1 -- start start 2024-04-25T09:08:04.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.504+0000 7f6e73800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e6c144140 0x7f6e6c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.504+0000 7f6e73800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e6c06ead0 0x7f6e6c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.504+0000 7f6e73800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e6c15ac60 con 0x7f6e6c0ced60 2024-04-25T09:08:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.504+0000 7f6e73800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e6c0cf3e0 con 0x7f6e6c06ead0 2024-04-25T09:08:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.504+0000 7f6e73800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c15af20 con 0x7f6e6c144140 2024-04-25T09:08:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.504+0000 7f6e71800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e6c06ead0 0x7f6e6c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.504+0000 7f6e71800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6e6c06ead0 0x7f6e6c0b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60444/0 (socket says 172.21.15.59:60444) 2024-04-25T09:08:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.504+0000 7f6e71800640 1 -- 172.21.15.59:0/1592052263 learned_addr learned my addr 172.21.15.59:0/1592052263 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:04.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.504+0000 7f6e70e00640 1 --2- 172.21.15.59:0/1592052263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e6c144140 0x7f6e6c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.508+0000 7f6e71800640 1 -- 172.21.15.59:0/1592052263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e6c144140 msgr2=0x7f6e6c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:04.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.508+0000 7f6e71800640 1 --2- 172.21.15.59:0/1592052263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e6c144140 0x7f6e6c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.508+0000 7f6e71800640 1 -- 172.21.15.59:0/1592052263 >> v1:172.21.15.178:6789/0 conn(0x7f6e6c0ced60 legacy=0x7f6e6c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.508+0000 7f6e71800640 1 -- 172.21.15.59:0/1592052263 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c15b200 con 0x7f6e6c06ead0 2024-04-25T09:08:04.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.508+0000 7f6e71800640 1 --2- 172.21.15.59:0/1592052263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6c06ead0 0x7f6e6c0b0760 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400d150 tx=0x7f6e6401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e117f777d4936811 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:04.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.508+0000 7f6e6b400640 1 -- 172.21.15.59:0/1592052263 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6400b2d0 con 0x7f6e6c06ead0 2024-04-25T09:08:04.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.508+0000 7f6e6b400640 1 -- 172.21.15.59:0/1592052263 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6400b470 con 0x7f6e6c06ead0 2024-04-25T09:08:04.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.508+0000 7f6e6b400640 1 -- 172.21.15.59:0/1592052263 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64009820 con 0x7f6e6c06ead0 2024-04-25T09:08:04.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 -- 172.21.15.59:0/1592052263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6c06ead0 msgr2=0x7f6e6c0b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 --2- 172.21.15.59:0/1592052263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6c06ead0 0x7f6e6c0b0760 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400d150 tx=0x7f6e6401ec30 comp rx=0 tx=0).stop 2024-04-25T09:08:04.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 -- 172.21.15.59:0/1592052263 shutdown_connections 2024-04-25T09:08:04.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 --2- 172.21.15.59:0/1592052263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6c06ead0 0x7f6e6c0b0760 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 --2- 172.21.15.59:0/1592052263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e6c144140 0x7f6e6c0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 -- 172.21.15.59:0/1592052263 >> 172.21.15.59:0/1592052263 conn(0x7f6e6c066fa0 msgr2=0x7f6e6c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:04.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 -- 172.21.15.59:0/1592052263 shutdown_connections 2024-04-25T09:08:04.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 -- 172.21.15.59:0/1592052263 wait complete. 2024-04-25T09:08:04.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 Processor -- start 2024-04-25T09:08:04.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 -- start start 2024-04-25T09:08:04.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e6c06ead0 0x7f6e6c14e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e6c0ced60 0x7f6e6c137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6c144140 0x7f6e6c1388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c15bb80 con 0x7f6e6c144140 2024-04-25T09:08:04.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c15ba00 con 0x7f6e6c0ced60 2024-04-25T09:08:04.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e73800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6c06d2b0 con 0x7f6e6c06ead0 2024-04-25T09:08:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e71800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6c144140 0x7f6e6c1388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e71800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6c144140 0x7f6e6c1388d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60458/0 (socket says 172.21.15.59:60458) 2024-04-25T09:08:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e71800640 1 -- 172.21.15.59:0/809444180 learned_addr learned my addr 172.21.15.59:0/809444180 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e70e00640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e6c06ead0 0x7f6e6c14e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.512+0000 7f6e6be00640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e6c0ced60 0x7f6e6c137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e71800640 1 -- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e6c06ead0 msgr2=0x7f6e6c14e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e71800640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e6c06ead0 0x7f6e6c14e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e71800640 1 -- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e6c0ced60 msgr2=0x7f6e6c137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e71800640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e6c0ced60 0x7f6e6c137c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e71800640 1 -- 172.21.15.59:0/809444180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c13b090 con 0x7f6e6c144140 2024-04-25T09:08:04.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e71800640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6c144140 0x7f6e6c1388d0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f6e6401c860 tx=0x7f6e6401b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e68c00640 1 -- 172.21.15.59:0/809444180 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6400b720 con 0x7f6e6c144140 2024-04-25T09:08:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e68c00640 1 -- 172.21.15.59:0/809444180 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e640a7530 con 0x7f6e6c144140 2024-04-25T09:08:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e68c00640 1 -- 172.21.15.59:0/809444180 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e640a7900 con 0x7f6e6c144140 2024-04-25T09:08:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e73800640 1 -- 172.21.15.59:0/809444180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e6c13b330 con 0x7f6e6c144140 2024-04-25T09:08:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e73800640 1 -- 172.21.15.59:0/809444180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6c13b8f0 con 0x7f6e6c144140 2024-04-25T09:08:04.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e73800640 1 -- 172.21.15.59:0/809444180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e6c0745d0 con 0x7f6e6c144140 2024-04-25T09:08:04.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.516+0000 7f6e68c00640 1 -- 172.21.15.59:0/809444180 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6e640c0020 con 0x7f6e6c144140 2024-04-25T09:08:04.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.520+0000 7f6e68c00640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e4c066f60 0x7f6e4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:04.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.520+0000 7f6e68c00640 1 -- 172.21.15.59:0/809444180 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f6e6411f700 con 0x7f6e6c144140 2024-04-25T09:08:04.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.520+0000 7f6e70e00640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e4c066f60 0x7f6e4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:04.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.520+0000 7f6e70e00640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e4c066f60 0x7f6e4c069420 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009ac0 tx=0x7f6e60009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:04.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.524+0000 7f6e68c00640 1 -- 172.21.15.59:0/809444180 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6e640c7020 con 0x7f6e6c144140 2024-04-25T09:08:04.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 -- 172.21.15.59:0/809444180 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e6c15d500 con 0x7f6e6c144140 2024-04-25T09:08:04.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e68c00640 1 -- 172.21.15.59:0/809444180 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f6e64018820 con 0x7f6e6c144140 2024-04-25T09:08:04.708 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:08:04.708 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":71,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:08:02.759856+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7668},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7668":{"gid":7668,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/4079513876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":4079513876},{"type":"v1","addr":"172.21.15.59:6835","nonce":4079513876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:08:04.708 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 71 2024-04-25T09:08:04.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 -- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e4c066f60 msgr2=0x7f6e4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e4c066f60 0x7f6e4c069420 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009ac0 tx=0x7f6e60009190 comp rx=0 tx=0).stop 2024-04-25T09:08:04.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 -- 172.21.15.59:0/809444180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6c144140 msgr2=0x7f6e6c1388d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:04.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6c144140 0x7f6e6c1388d0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f6e6401c860 tx=0x7f6e6401b9d0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 -- 172.21.15.59:0/809444180 shutdown_connections 2024-04-25T09:08:04.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6e4c066f60 0x7f6e4c069420 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e6c144140 0x7f6e6c1388d0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6e6c0ced60 0x7f6e6c137c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 --2- 172.21.15.59:0/809444180 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6e6c06ead0 0x7f6e6c14e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 -- 172.21.15.59:0/809444180 >> 172.21.15.59:0/809444180 conn(0x7f6e6c066fa0 msgr2=0x7f6e6c15d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 -- 172.21.15.59:0/809444180 shutdown_connections 2024-04-25T09:08:04.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:04.720+0000 7f6e73800640 1 -- 172.21.15.59:0/809444180 wait complete. 2024-04-25T09:08:05.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 71, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:07:48.892826+0000', 'modified': '2024-04-25T09:08:02.759856+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 93, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7668}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7668': {'gid': 7668, 'name': 'a', 'rank': 0, 'incarnation': 68, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.59:6835/4079513876', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 4079513876}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 4079513876}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:08:05.132 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:08:05.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:08:05.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.288+0000 7fe5e5200640 1 Processor -- start 2024-04-25T09:08:05.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.288+0000 7fe5e5200640 1 -- start start 2024-04-25T09:08:05.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5e5200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe5e006e4a0 0x7fe5e006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5e5200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e015fc00 con 0x7fe5e015c9b0 2024-04-25T09:08:05.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5e5200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e015fee0 con 0x7fe5e0159320 2024-04-25T09:08:05.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5e5200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e006d640 con 0x7fe5e006e4a0 2024-04-25T09:08:05.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5d7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe5e015c9b0 0x7fe5e006dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54450/0 (socket says 172.21.15.59:54450) 2024-04-25T09:08:05.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5d7e00640 1 -- 172.21.15.59:0/1800271939 learned_addr learned my addr 172.21.15.59:0/1800271939 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:08:05.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5de800640 1 --2- 172.21.15.59:0/1800271939 >> v2:172.21.15.178:3300/0 conn(0x7fe5e006e4a0 0x7fe5e006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553644727 0 0) 0x7fe5e015fc00 con 0x7fe5e015c9b0 2024-04-25T09:08:05.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c4003530 con 0x7fe5e015c9b0 2024-04-25T09:08:05.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614212721 0 0) 0x7fe5e015fee0 con 0x7fe5e0159320 2024-04-25T09:08:05.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e015fc00 con 0x7fe5e0159320 2024-04-25T09:08:05.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1978771528 0 0) 0x7fe5c4003530 con 0x7fe5e015c9b0 2024-04-25T09:08:05.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 >> v2:172.21.15.178:3300/0 conn(0x7fe5e006e4a0 msgr2=0x7fe5e006e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 --2- 172.21.15.59:0/1800271939 >> v2:172.21.15.178:3300/0 conn(0x7fe5e006e4a0 0x7fe5e006e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 >> v1:172.21.15.178:6789/0 conn(0x7fe5e0159320 legacy=0x7fe5e015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e01601c0 con 0x7fe5e015c9b0 2024-04-25T09:08:05.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fe5c8001680 con 0x7fe5e015c9b0 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 >> v1:172.21.15.59:6789/0 conn(0x7fe5e015c9b0 legacy=0x7fe5e006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 --2- 172.21.15.59:0/1800271939 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5c4003ba0 0x7fe5c4003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 --2- 172.21.15.59:0/1800271939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5c4004810 0x7fe5c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 --2- 172.21.15.59:0/1800271939 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5c40051d0 0x7fe5c400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e006d640 con 0x7fe5c4004810 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c400c0d0 con 0x7fe5c40051d0 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c400c2d0 con 0x7fe5c4003ba0 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/1800271939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5c4004810 0x7fe5c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5dde00640 1 --2- 172.21.15.59:0/1800271939 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5c4003ba0 0x7fe5c4003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5de800640 1 --2- 172.21.15.59:0/1800271939 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5c40051d0 0x7fe5c400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5d7e00640 1 -- 172.21.15.59:0/1800271939 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5c4003ba0 msgr2=0x7fe5c4003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/1800271939 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5c4003ba0 0x7fe5c4003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5d7e00640 1 -- 172.21.15.59:0/1800271939 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5c40051d0 msgr2=0x7fe5c400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/1800271939 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5c40051d0 0x7fe5c400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5d7e00640 1 -- 172.21.15.59:0/1800271939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c4003530 con 0x7fe5c4004810 2024-04-25T09:08:05.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5de800640 1 --2- 172.21.15.59:0/1800271939 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5c40051d0 0x7fe5c400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:05.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.292+0000 7fe5de800640 1 -- 172.21.15.59:0/1800271939 reap_dead start 2024-04-25T09:08:05.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.296+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/1800271939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5c4004810 0x7fe5c4004c90 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8007fd0 tx=0x7fe5c801cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07c88e9fe12b7fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.296+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8007bf0 con 0x7fe5c4004810 2024-04-25T09:08:05.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.296+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5c80a9020 con 0x7fe5c4004810 2024-04-25T09:08:05.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.296+0000 7fe5dd400640 1 -- 172.21.15.59:0/1800271939 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8005b00 con 0x7fe5c4004810 2024-04-25T09:08:05.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.296+0000 7fe5e5200640 1 -- 172.21.15.59:0/1800271939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5c4004810 msgr2=0x7fe5c4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.296+0000 7fe5e5200640 1 --2- 172.21.15.59:0/1800271939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5c4004810 0x7fe5c4004c90 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8007fd0 tx=0x7fe5c801cb20 comp rx=0 tx=0).stop 2024-04-25T09:08:05.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.296+0000 7fe5e5200640 1 -- 172.21.15.59:0/1800271939 shutdown_connections 2024-04-25T09:08:05.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.296+0000 7fe5e5200640 1 --2- 172.21.15.59:0/1800271939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5c4004810 0x7fe5c4004c90 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.296+0000 7fe5e5200640 1 -- 172.21.15.59:0/1800271939 >> 172.21.15.59:0/1800271939 conn(0x7fe5e0067080 msgr2=0x7fe5e006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.296+0000 7fe5e5200640 1 -- 172.21.15.59:0/1800271939 shutdown_connections 2024-04-25T09:08:05.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.296+0000 7fe5e5200640 1 -- 172.21.15.59:0/1800271939 wait complete. 2024-04-25T09:08:05.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.296+0000 7fe5e5200640 1 Processor -- start 2024-04-25T09:08:05.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5e5200640 1 -- start start 2024-04-25T09:08:05.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5e5200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5c4004810 0x7fe5e0141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5e5200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5e0140070 0x7fe5e00b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5e5200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e0131fc0 0x7fe5e0132440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5e5200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e006e8d0 con 0x7fe5e0131fc0 2024-04-25T09:08:05.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5e5200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e0159700 con 0x7fe5c4004810 2024-04-25T09:08:05.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5e5200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e006ea50 con 0x7fe5e0140070 2024-04-25T09:08:05.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5de800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e0131fc0 0x7fe5e0132440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5de800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e0131fc0 0x7fe5e0132440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60472/0 (socket says 172.21.15.59:60472) 2024-04-25T09:08:05.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5de800640 1 -- 172.21.15.59:0/1564969253 learned_addr learned my addr 172.21.15.59:0/1564969253 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:05.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5dde00640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5c4004810 0x7fe5e0141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5e0140070 0x7fe5e00b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5de800640 1 -- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5e0140070 msgr2=0x7fe5e00b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5de800640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5e0140070 0x7fe5e00b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5de800640 1 -- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5c4004810 msgr2=0x7fe5e0141990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5de800640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5c4004810 0x7fe5e0141990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5de800640 1 -- 172.21.15.59:0/1564969253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e01432c0 con 0x7fe5e0131fc0 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5e0140070 0x7fe5e00b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5dde00640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5c4004810 0x7fe5e0141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5de800640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e0131fc0 0x7fe5e0132440 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00aeed0 tx=0x7fe5d800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5d6000640 1 -- 172.21.15.59:0/1564969253 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8016420 con 0x7fe5e0131fc0 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5d6000640 1 -- 172.21.15.59:0/1564969253 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d801b070 con 0x7fe5e0131fc0 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5d6000640 1 -- 172.21.15.59:0/1564969253 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d80167c0 con 0x7fe5e0131fc0 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5e5200640 1 -- 172.21.15.59:0/1564969253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e0142220 con 0x7fe5e0131fc0 2024-04-25T09:08:05.290 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.300+0000 7fe5e5200640 1 -- 172.21.15.59:0/1564969253 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e01427e0 con 0x7fe5e0131fc0 2024-04-25T09:08:05.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5d6000640 1 -- 172.21.15.59:0/1564969253 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe5d8016960 con 0x7fe5e0131fc0 2024-04-25T09:08:05.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5d6000640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe5bc066f60 0x7fe5bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5d6000640 1 -- 172.21.15.59:0/1564969253 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe5d8086070 con 0x7fe5e0131fc0 2024-04-25T09:08:05.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5e86a3000 1 Processor -- start 2024-04-25T09:08:05.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5e86a3000 1 -- start start 2024-04-25T09:08:05.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5dde00640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe5bc066f60 0x7fe5bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5e86a3000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db3ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5e86a3000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10db3f240 0x55d10daf49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5e86a3000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10daf4f30 0x55d10daf5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5e86a3000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d10d9dc5f0 con 0x55d10db3e920 2024-04-25T09:08:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5e86a3000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d10d943da0 con 0x55d10db3f240 2024-04-25T09:08:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5e86a3000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d10d8cc150 con 0x55d10daf4f30 2024-04-25T09:08:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5dde00640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe5bc066f60 0x7fe5bc069420 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0005630 tx=0x7fe5d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5dde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db3ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5de800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10daf4f30 0x55d10daf5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5d7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10db3f240 0x55d10daf49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5dde00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db3ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60488/0 (socket says 172.21.15.59:60488) 2024-04-25T09:08:05.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5dde00640 1 -- 172.21.15.59:0/2640654842 learned_addr learned my addr 172.21.15.59:0/2640654842 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:05.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5dde00640 1 -- 172.21.15.59:0/2640654842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10daf4f30 msgr2=0x55d10daf5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5dde00640 1 --2- 172.21.15.59:0/2640654842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10daf4f30 0x55d10daf5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5dde00640 1 -- 172.21.15.59:0/2640654842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10db3f240 msgr2=0x55d10daf49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5dde00640 1 --2- 172.21.15.59:0/2640654842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10db3f240 0x55d10daf49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5dde00640 1 -- 172.21.15.59:0/2640654842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d10d8e5ca0 con 0x55d10db3e920 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5de800640 1 --2- 172.21.15.59:0/2640654842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10daf4f30 0x55d10daf5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.304+0000 7fe5dde00640 1 --2- 172.21.15.59:0/2640654842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db3ed00 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0015620 tx=0x7fe5d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4c7dea5e8e2129 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5cea00640 1 -- 172.21.15.59:0/2640654842 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0029070 con 0x55d10db3e920 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5cea00640 1 -- 172.21.15.59:0/2640654842 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d0016730 con 0x55d10db3e920 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5cea00640 1 -- 172.21.15.59:0/2640654842 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d0010040 con 0x55d10db3e920 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2640654842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 msgr2=0x55d10db3ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/2640654842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db3ed00 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0015620 tx=0x7fe5d0016000 comp rx=0 tx=0).stop 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2640654842 shutdown_connections 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/2640654842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10daf4f30 0x55d10daf5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/2640654842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10db3f240 0x55d10daf49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/2640654842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db3ed00 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2640654842 >> 172.21.15.59:0/2640654842 conn(0x55d10dafb2a0 msgr2=0x55d10daf32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2640654842 shutdown_connections 2024-04-25T09:08:05.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2640654842 wait complete. 2024-04-25T09:08:05.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 -- start start 2024-04-25T09:08:05.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 Processor -- start 2024-04-25T09:08:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 0x55d10db45c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3f240 0x55d10daf8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d10d8fe990 con 0x55d10db3e920 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d10d93fe40 con 0x55d10daf4f30 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d10d8cf900 con 0x55d10db3f240 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 10 client.0 _ll_register_callbacks cb 0x55d10d9f71c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60496/0 (socket says 172.21.15.59:60496) 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5d7e00640 1 -- 172.21.15.59:0/1585275340 learned_addr learned my addr 172.21.15.59:0/1585275340 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5dde00640 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 0x55d10db45c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5de800640 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3f240 0x55d10daf8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5d7e00640 1 -- 172.21.15.59:0/1585275340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3f240 msgr2=0x55d10daf8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3f240 0x55d10daf8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5d7e00640 1 -- 172.21.15.59:0/1585275340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 msgr2=0x55d10db45c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 0x55d10db45c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5d7e00640 1 -- 172.21.15.59:0/1585275340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d10d8fc630 con 0x55d10db3e920 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db461c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8000c10 tx=0x7fe5c80198c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27cd6acb1f076bce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5c3400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5c3400640 1 -- 172.21.15.59:0/1585275340 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c80a5820 con 0x55d10db3e920 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5c3400640 1 -- 172.21.15.59:0/1585275340 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe5c80a59c0 con 0x55d10db3e920 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.308+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1585275340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe5d0016730 con 0x55d10db3e920 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5c3400640 1 -- 172.21.15.59:0/1585275340 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5c80be050 con 0x55d10db3e920 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 10 client.7725 fetch_fsmap learned FSMap version 71 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1585275340 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55d10d8cc3a0 con 0x55d10db3e920 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5c3400640 1 -- 172.21.15.59:0/1585275340 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d0016730 con 0x55d10db3e920 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5c3400640 1 -- 172.21.15.59:0/1585275340 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe5c80b6070 con 0x55d10db3e920 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 10 client.7725 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 10 client.7725 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:08:05.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 20 client.7725 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:05.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d10dafa160 0x55d10db4fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 4 client.7725 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:05.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1585275340 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d10d8dfa50 con 0x55d10dafa160 2024-04-25T09:08:05.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5dde00640 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d10dafa160 0x55d10db4fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5dde00640 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d10dafa160 0x55d10db4fce0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e146f3dded508fbd server_cookie=5416a10fe2fa2f5 in_seq=0 out_seq=0 2024-04-25T09:08:05.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5c3400640 10 client.7725 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:05.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5c3400640 1 -- 172.21.15.59:0/1585275340 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d10d8dfa50 con 0x55d10dafa160 2024-04-25T09:08:05.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5c3400640 10 client.7725 handle_command_reply: tid=0 2024-04-25T09:08:05.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 client.7725 shutdown 2024-04-25T09:08:05.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1585275340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 msgr2=0x55d10db461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db461c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fe5c8000c10 tx=0x7fe5c80198c0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1585275340 shutdown_connections 2024-04-25T09:08:05.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d10dafa160 0x55d10db4fce0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3f240 0x55d10daf8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db461c0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/1585275340 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 0x55d10db45c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5c3400640 0 client.7725 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:05.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1585275340 >> 172.21.15.59:0/1585275340 conn(0x55d10dafb2a0 msgr2=0x55d10daf39e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1585275340 shutdown_connections 2024-04-25T09:08:05.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1585275340 wait complete. 2024-04-25T09:08:05.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.312+0000 7fe5e86a3000 20 client.7725 trim_cache size 0 max 16384 2024-04-25T09:08:05.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5e86a3000 1 Processor -- start 2024-04-25T09:08:05.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5e86a3000 1 -- start start 2024-04-25T09:08:05.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5e86a3000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 0x55d10db9a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5e86a3000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3e920 0x55d10db9a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5e86a3000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3f240 0x55d10db9ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5e86a3000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e01ffd30 con 0x55d10db3f240 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5e86a3000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e01ff130 con 0x55d10daf4f30 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5e86a3000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e01ff730 con 0x55d10db3e920 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5de800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3f240 0x55d10db9ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5de800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3f240 0x55d10db9ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60510/0 (socket says 172.21.15.59:60510) 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5de800640 1 -- 172.21.15.59:0/1105758483 learned_addr learned my addr 172.21.15.59:0/1105758483 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/1105758483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3e920 0x55d10db9a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5dde00640 1 --2- 172.21.15.59:0/1105758483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 0x55d10db9a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5de800640 1 -- 172.21.15.59:0/1105758483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3e920 msgr2=0x55d10db9a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5de800640 1 --2- 172.21.15.59:0/1105758483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3e920 0x55d10db9a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5de800640 1 -- 172.21.15.59:0/1105758483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 msgr2=0x55d10db9a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5de800640 1 --2- 172.21.15.59:0/1105758483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 0x55d10db9a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.328+0000 7fe5de800640 1 -- 172.21.15.59:0/1105758483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d10db3f070 con 0x55d10db3f240 2024-04-25T09:08:05.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5de800640 1 --2- 172.21.15.59:0/1105758483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3f240 0x55d10db9ac10 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80563b0 tx=0x7fe5d8052ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aca7e647d36a5be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5ce000640 1 -- 172.21.15.59:0/1105758483 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8054a00 con 0x55d10db3f240 2024-04-25T09:08:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5ce000640 1 -- 172.21.15.59:0/1105758483 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d8082070 con 0x55d10db3f240 2024-04-25T09:08:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5ce000640 1 -- 172.21.15.59:0/1105758483 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8052d70 con 0x55d10db3f240 2024-04-25T09:08:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1105758483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3f240 msgr2=0x55d10db9ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/1105758483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3f240 0x55d10db9ac10 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe5d80563b0 tx=0x7fe5d8052ad0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1105758483 shutdown_connections 2024-04-25T09:08:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/1105758483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3f240 0x55d10db9ac10 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/1105758483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3e920 0x55d10db9a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/1105758483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 0x55d10db9a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1105758483 >> 172.21.15.59:0/1105758483 conn(0x55d10dafb2a0 msgr2=0x55d10daf8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1105758483 shutdown_connections 2024-04-25T09:08:05.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 -- 172.21.15.59:0/1105758483 wait complete. 2024-04-25T09:08:05.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 -- start start 2024-04-25T09:08:05.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 Processor -- start 2024-04-25T09:08:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 0x55d10db4ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db4b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3f240 0x55d10db83430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d10d9483d0 con 0x55d10db3e920 2024-04-25T09:08:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d10d9ffd50 con 0x55d10daf4f30 2024-04-25T09:08:05.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d10d8de980 con 0x55d10db3f240 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5e86a3000 10 client.0 _ll_register_callbacks cb 0x7fe5d0007320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db4b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5dde00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 0x55d10db4ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db4b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60526/0 (socket says 172.21.15.59:60526) 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5d7e00640 1 -- 172.21.15.59:0/2659941238 learned_addr learned my addr 172.21.15.59:0/2659941238 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5de800640 1 --2- 172.21.15.59:0/2659941238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3f240 0x55d10db83430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5d7e00640 1 -- 172.21.15.59:0/2659941238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3f240 msgr2=0x55d10db83430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/2659941238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3f240 0x55d10db83430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5d7e00640 1 -- 172.21.15.59:0/2659941238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 msgr2=0x55d10db4ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/2659941238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 0x55d10db4ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5d7e00640 1 -- 172.21.15.59:0/2659941238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d10d9c5600 con 0x55d10db3e920 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5d7e00640 1 --2- 172.21.15.59:0/2659941238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db4b1d0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fe5c801d3c0 tx=0x7fe5c80a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eec3864d1245d91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.332+0000 7fe5c3400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5c3400640 1 -- 172.21.15.59:0/2659941238 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c8001b30 con 0x55d10db3e920 2024-04-25T09:08:05.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5c3400640 1 -- 172.21.15.59:0/2659941238 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe5c80c3cc0 con 0x55d10db3e920 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2659941238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe5d8082070 con 0x55d10db3e920 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5c3400640 1 -- 172.21.15.59:0/2659941238 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5c80c3ec0 con 0x55d10db3e920 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 10 client.7731 fetch_fsmap learned FSMap version 71 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2659941238 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55d10d8d89b0 con 0x55d10db3e920 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5c3400640 1 -- 172.21.15.59:0/2659941238 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d8082070 con 0x55d10db3e920 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5c3400640 1 -- 172.21.15.59:0/2659941238 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe5c80b6070 con 0x55d10db3e920 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 10 client.7731 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 10 client.7731 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 20 client.7731 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/2659941238 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d10db82e40 0x55d10db83970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 4 client.7731 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2659941238 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d10d9512e0 con 0x55d10db82e40 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5dde00640 1 --2- 172.21.15.59:0/2659941238 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d10db82e40 0x55d10db83970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5dde00640 1 --2- 172.21.15.59:0/2659941238 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d10db82e40 0x55d10db83970 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67c36d0eff4de604 server_cookie=e31c500923283db in_seq=0 out_seq=0 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5c3400640 10 client.7731 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5c3400640 1 -- 172.21.15.59:0/2659941238 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d10d9512e0 con 0x55d10db82e40 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5c3400640 10 client.7731 handle_command_reply: tid=0 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 client.7731 shutdown 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2659941238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 msgr2=0x55d10db4b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/2659941238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db4b1d0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fe5c801d3c0 tx=0x7fe5c80a7070 comp rx=0 tx=0).stop 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2659941238 shutdown_connections 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/2659941238 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d10db82e40 0x55d10db83970 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/2659941238 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d10db3f240 0x55d10db83430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/2659941238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d10db3e920 0x55d10db4b1d0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5c3400640 0 client.7731 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 --2- 172.21.15.59:0/2659941238 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d10daf4f30 0x55d10db4ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2659941238 >> 172.21.15.59:0/2659941238 conn(0x55d10dafb2a0 msgr2=0x55d10db467a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2659941238 shutdown_connections 2024-04-25T09:08:05.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 1 -- 172.21.15.59:0/2659941238 wait complete. 2024-04-25T09:08:05.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e86a3000 20 client.7731 trim_cache size 0 max 16384 2024-04-25T09:08:05.329 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:08:05.329 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:08:05.329 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:08:05.329 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7668, 2024-04-25T09:08:05.329 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:08:05.329 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:08:05.329 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:08:05.329 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 4.5806071719999997, 2024-04-25T09:08:05.329 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 71, 2024-04-25T09:08:05.330 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 93, 2024-04-25T09:08:05.330 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 93, 2024-04-25T09:08:05.330 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 5.5273532410000001 2024-04-25T09:08:05.330 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:08:05.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e5200640 1 -- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe5bc066f60 msgr2=0x7fe5bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e5200640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe5bc066f60 0x7fe5bc069420 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0005630 tx=0x7fe5d0009040 comp rx=0 tx=0).stop 2024-04-25T09:08:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e5200640 1 -- 172.21.15.59:0/1564969253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e0131fc0 msgr2=0x7fe5e0132440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e5200640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e0131fc0 0x7fe5e0132440 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fe5e00aeed0 tx=0x7fe5d800f520 comp rx=0 tx=0).stop 2024-04-25T09:08:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e5200640 1 -- 172.21.15.59:0/1564969253 shutdown_connections 2024-04-25T09:08:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e5200640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe5bc066f60 0x7fe5bc069420 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e5200640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e0131fc0 0x7fe5e0132440 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e5200640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe5e0140070 0x7fe5e00b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e5200640 1 --2- 172.21.15.59:0/1564969253 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe5c4004810 0x7fe5e0141990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e5200640 1 -- 172.21.15.59:0/1564969253 >> 172.21.15.59:0/1564969253 conn(0x7fe5e0067080 msgr2=0x7fe5e006d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e5200640 1 -- 172.21.15.59:0/1564969253 shutdown_connections 2024-04-25T09:08:05.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.336+0000 7fe5e5200640 1 -- 172.21.15.59:0/1564969253 wait complete. 2024-04-25T09:08:05.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:08:05.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.496+0000 7f5240800640 1 Processor -- start 2024-04-25T09:08:05.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.496+0000 7f5240800640 1 -- start start 2024-04-25T09:08:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f5240800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5238145270 0x7f523815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f5240800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380cd4d0 0x7f52380cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f5240800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380cc4e0 con 0x7f52380b1750 2024-04-25T09:08:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f5240800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5238145650 con 0x7f5238145270 2024-04-25T09:08:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f5240800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52380ce040 con 0x7f52380cd4d0 2024-04-25T09:08:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f523de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5238145270 0x7f523815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f523de00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5238145270 0x7f523815fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60532/0 (socket says 172.21.15.59:60532) 2024-04-25T09:08:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f523de00640 1 -- 172.21.15.59:0/3553471043 learned_addr learned my addr 172.21.15.59:0/3553471043 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f523d400640 1 --2- 172.21.15.59:0/3553471043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380cd4d0 0x7f52380cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f523de00640 1 -- 172.21.15.59:0/3553471043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380cd4d0 msgr2=0x7f52380cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.488 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f523de00640 1 --2- 172.21.15.59:0/3553471043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380cd4d0 0x7f52380cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f523de00640 1 -- 172.21.15.59:0/3553471043 >> v1:172.21.15.178:6789/0 conn(0x7f52380b1750 legacy=0x7f523815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:05.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.500+0000 7f523de00640 1 -- 172.21.15.59:0/3553471043 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380ce320 con 0x7f5238145270 2024-04-25T09:08:05.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f523de00640 1 --2- 172.21.15.59:0/3553471043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5238145270 0x7f523815fe50 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f522c009870 tx=0x7f522c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4355cb245df9dac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f523ca00640 1 -- 172.21.15.59:0/3553471043 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c0ab650 con 0x7f5238145270 2024-04-25T09:08:05.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f523ca00640 1 -- 172.21.15.59:0/3553471043 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c0b0070 con 0x7f5238145270 2024-04-25T09:08:05.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f523ca00640 1 -- 172.21.15.59:0/3553471043 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c0aba10 con 0x7f5238145270 2024-04-25T09:08:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 -- 172.21.15.59:0/3553471043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5238145270 msgr2=0x7f523815fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 --2- 172.21.15.59:0/3553471043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5238145270 0x7f523815fe50 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f522c009870 tx=0x7f522c01c560 comp rx=0 tx=0).stop 2024-04-25T09:08:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 -- 172.21.15.59:0/3553471043 shutdown_connections 2024-04-25T09:08:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 --2- 172.21.15.59:0/3553471043 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380cd4d0 0x7f52380cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 --2- 172.21.15.59:0/3553471043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5238145270 0x7f523815fe50 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 -- 172.21.15.59:0/3553471043 >> 172.21.15.59:0/3553471043 conn(0x7f5238066fa0 msgr2=0x7f523806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 -- 172.21.15.59:0/3553471043 shutdown_connections 2024-04-25T09:08:05.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 -- 172.21.15.59:0/3553471043 wait complete. 2024-04-25T09:08:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 Processor -- start 2024-04-25T09:08:05.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 -- start start 2024-04-25T09:08:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380b1750 0x7f52381f9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52380cd4d0 0x7f523813e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5238145270 0x7f523813ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52380b1f70 con 0x7f5238145270 2024-04-25T09:08:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5238168710 con 0x7f52380cd4d0 2024-04-25T09:08:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f5240800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523813d7f0 con 0x7f52380b1750 2024-04-25T09:08:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f523e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5238145270 0x7f523813ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f523de00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380b1750 0x7f52381f9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f523e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5238145270 0x7f523813ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60536/0 (socket says 172.21.15.59:60536) 2024-04-25T09:08:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f523e800640 1 -- 172.21.15.59:0/2746575290 learned_addr learned my addr 172.21.15.59:0/2746575290 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.504+0000 7f523d400640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52380cd4d0 0x7f523813e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f523e800640 1 -- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380b1750 msgr2=0x7f52381f9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f523e800640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380b1750 0x7f52381f9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f523e800640 1 -- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52380cd4d0 msgr2=0x7f523813e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f523e800640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52380cd4d0 0x7f523813e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f523e800640 1 -- 172.21.15.59:0/2746575290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523813f0a0 con 0x7f5238145270 2024-04-25T09:08:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f523e800640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5238145270 0x7f523813ea20 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f523400c770 tx=0x7f523400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f5232000640 1 -- 172.21.15.59:0/2746575290 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234003b80 con 0x7f5238145270 2024-04-25T09:08:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f5232000640 1 -- 172.21.15.59:0/2746575290 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5234003d20 con 0x7f5238145270 2024-04-25T09:08:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f5240800640 1 -- 172.21.15.59:0/2746575290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523813f380 con 0x7f5238145270 2024-04-25T09:08:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f5232000640 1 -- 172.21.15.59:0/2746575290 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523400aa90 con 0x7f5238145270 2024-04-25T09:08:05.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f5240800640 1 -- 172.21.15.59:0/2746575290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523813f940 con 0x7f5238145270 2024-04-25T09:08:05.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f5240800640 1 -- 172.21.15.59:0/2746575290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52380745d0 con 0x7f5238145270 2024-04-25T09:08:05.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f5232000640 1 -- 172.21.15.59:0/2746575290 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f523400ac30 con 0x7f5238145270 2024-04-25T09:08:05.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f5232000640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f521c066f60 0x7f521c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:05.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.508+0000 7f5232000640 1 -- 172.21.15.59:0/2746575290 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f5234084ff0 con 0x7f5238145270 2024-04-25T09:08:05.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.512+0000 7f523de00640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f521c066f60 0x7f521c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:05.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.512+0000 7f523de00640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f521c066f60 0x7f521c069420 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f522c0af000 tx=0x7f522c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:05.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.516+0000 7f5232000640 1 -- 172.21.15.59:0/2746575290 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f52340557e0 con 0x7f5238145270 2024-04-25T09:08:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 -- 172.21.15.59:0/2746575290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f523806b8e0 con 0x7f5238145270 2024-04-25T09:08:05.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5232000640 1 -- 172.21.15.59:0/2746575290 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v71) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5234059880 con 0x7f5238145270 2024-04-25T09:08:05.703 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:08:05.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 -- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f521c066f60 msgr2=0x7f521c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f521c066f60 0x7f521c069420 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f522c0af000 tx=0x7f522c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:05.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 -- 172.21.15.59:0/2746575290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5238145270 msgr2=0x7f523813ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5238145270 0x7f523813ea20 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f523400c770 tx=0x7f523400cc30 comp rx=0 tx=0).stop 2024-04-25T09:08:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 -- 172.21.15.59:0/2746575290 shutdown_connections 2024-04-25T09:08:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f521c066f60 0x7f521c069420 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5238145270 0x7f523813ea20 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f52380cd4d0 0x7f523813e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 --2- 172.21.15.59:0/2746575290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f52380b1750 0x7f52381f9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 -- 172.21.15.59:0/2746575290 >> 172.21.15.59:0/2746575290 conn(0x7f5238066fa0 msgr2=0x7f523815dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 -- 172.21.15.59:0/2746575290 shutdown_connections 2024-04-25T09:08:05.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:05.716+0000 7f5240800640 1 -- 172.21.15.59:0/2746575290 wait complete. 2024-04-25T09:08:05.725 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:08:05.725 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:08:05.725 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:08:05.725 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:08:05.725 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:05.725 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:08:05.725 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:08:05.725 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:08:05.725 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:08:05.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:05.725 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:08:05.736 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:08:05.736 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:08:05.736 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:08:05.736 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:05.736 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:08:05.736 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:05.736 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:08:05.737 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:05.737 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:08:05.737 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:08:05.737 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:05.737 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:08:05.737 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:08:05.737 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:05.737 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:08:05.737 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:08:05.737 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42082sec preferred_lft 42082sec 2024-04-25T09:08:05.737 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:08:05.737 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:05.738 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:08:05.738 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:05.738 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:08:05.738 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:08:05.738 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:05.738 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:08:05.738 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:05.738 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:08:05.738 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:08:05.738 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:08:05.738 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:05.739 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:08:05.739 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:05.739 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:08:05.739 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:08:05.739 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:08:05.739 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:05.739 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:08:05.739 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:08:05.739 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:08:05.739 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:08:05.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:05.740 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:08:05.746 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:08:05.756+0000 7f2ae7000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:08:05.764 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:08:05.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:05.767 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:08:05.820 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:08:05.820 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:08:05.820 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:08:05.821 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:08:05.821 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:08:05.821 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:08:05.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:05.821 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:08:05.821 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:08:05.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:08:05.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:08:05.821 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:08:05.821 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:08:05.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:05.912 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:08:05.921 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:08:05.921 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:08:05.922 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:08:05.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:05.922 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:08:05.986 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:08:05.986 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:06.039 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:08:06.039 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:08:06.039 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:06.094 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:08:06.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:06.094 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:08:06.184 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:08:06.184 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:08:06.184 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:08:06.199 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:08:06.199 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:08:06.199 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:08:06.199 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:08:06.199 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:08:06.208 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:08:06.208 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:08:06.209 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:08:06.209 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:08:06.209 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:08:06.209 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:08:06.209 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:08:06.209 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:08:06.213 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:08:06.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:06.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:08:06.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:06.233 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:08:06.290 INFO:teuthology.orchestra.run.smithi059.stdout:client7740 2024-04-25T09:08:06.290 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:08:06.290 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:08:06.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:06.339 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-04-25T09:08:06.394 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:08:06.404+0000 7f2ae2000640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-25T09:08:06.395 INFO:teuthology.orchestra.run.smithi059.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-04-25T09:08:06.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:08:06.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:06.396 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-04-25T09:08:06.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb9c200640 1 Processor -- start 2024-04-25T09:08:06.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb9c200640 1 -- start start 2024-04-25T09:08:06.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb9c200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb94071e40 0x7fbb9406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb9c200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbb9406e900 0x7fbb9415e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb9c200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb940cf490 con 0x7fbb94144080 2024-04-25T09:08:06.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb9c200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb940719b0 con 0x7fbb9406e900 2024-04-25T09:08:06.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb9c200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940cf1b0 con 0x7fbb94071e40 2024-04-25T09:08:06.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb99800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbb94144080 0x7fbb940ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:54456/0 (socket says 172.21.15.59:54456) 2024-04-25T09:08:06.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb99800640 1 -- 172.21.15.59:0/766493089 learned_addr learned my addr 172.21.15.59:0/766493089 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:08:06.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb98e00640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb94071e40 0x7fbb9406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb9a200640 1 --2- 172.21.15.59:0/766493089 >> v2:172.21.15.178:3300/0 conn(0x7fbb9406e900 0x7fbb9415e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621621087 0 0) 0x7fbb940cf490 con 0x7fbb94144080 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c005740 con 0x7fbb94144080 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3437019396 0 0) 0x7fbb7c005740 con 0x7fbb94144080 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb94071e40 msgr2=0x7fbb9406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb94071e40 0x7fbb9406e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 >> v2:172.21.15.178:3300/0 conn(0x7fbb9406e900 msgr2=0x7fbb9415e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 --2- 172.21.15.59:0/766493089 >> v2:172.21.15.178:3300/0 conn(0x7fbb9406e900 0x7fbb9415e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb94071360 con 0x7fbb94144080 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fbb88001680 con 0x7fbb94144080 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 >> v1:172.21.15.59:6789/0 conn(0x7fbb94144080 legacy=0x7fbb940ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb7c005bd0 0x7fbb7c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c006580 0x7fbb7c006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb94071e40 0x7fbb7c007160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940719b0 con 0x7fbb7c006580 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940cf1b0 con 0x7fbb7c005bd0 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.596+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c00dbe0 con 0x7fbb94071e40 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb98e00640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c006580 0x7fbb7c006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb9a200640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb94071e40 0x7fbb7c007160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb99800640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb7c005bd0 0x7fbb7c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb98e00640 1 -- 172.21.15.59:0/766493089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb94071e40 msgr2=0x7fbb7c007160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb98e00640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb94071e40 0x7fbb7c007160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb98e00640 1 -- 172.21.15.59:0/766493089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb7c005bd0 msgr2=0x7fbb7c005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb98e00640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb7c005bd0 0x7fbb7c005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb98e00640 1 -- 172.21.15.59:0/766493089 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c005740 con 0x7fbb7c006580 2024-04-25T09:08:06.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb9a200640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb94071e40 0x7fbb7c007160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:06.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb98e00640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c006580 0x7fbb7c006a60 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009ab0 tx=0x7fbb8001c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29bbd60caed4f338 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800096b0 con 0x7fbb7c006580 2024-04-25T09:08:06.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb800b0400 con 0x7fbb7c006580 2024-04-25T09:08:06.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb93e00640 1 -- 172.21.15.59:0/766493089 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800b07b0 con 0x7fbb7c006580 2024-04-25T09:08:06.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb9c200640 1 -- 172.21.15.59:0/766493089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c006580 msgr2=0x7fbb7c006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.600+0000 7fbb9c200640 1 --2- 172.21.15.59:0/766493089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb7c006580 0x7fbb7c006a60 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009ab0 tx=0x7fbb8001c790 comp rx=0 tx=0).stop 2024-04-25T09:08:06.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9a200640 1 -- 172.21.15.59:0/766493089 reap_dead start 2024-04-25T09:08:06.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9c200640 1 -- 172.21.15.59:0/766493089 shutdown_connections 2024-04-25T09:08:06.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9c200640 1 -- 172.21.15.59:0/766493089 >> 172.21.15.59:0/766493089 conn(0x7fbb9406ac10 msgr2=0x7fbb9406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9c200640 1 -- 172.21.15.59:0/766493089 shutdown_connections 2024-04-25T09:08:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9c200640 1 -- 172.21.15.59:0/766493089 wait complete. 2024-04-25T09:08:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9c200640 1 Processor -- start 2024-04-25T09:08:06.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9c200640 1 -- start start 2024-04-25T09:08:06.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9c200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb7c006580 0x7fbb9413af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9c200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb94153b20 0x7fbb940ac8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9c200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb94153fa0 0x7fbb940ace10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9c200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940b4950 con 0x7fbb94153fa0 2024-04-25T09:08:06.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9c200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94144460 con 0x7fbb94153b20 2024-04-25T09:08:06.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9c200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940b4ad0 con 0x7fbb7c006580 2024-04-25T09:08:06.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb94153fa0 0x7fbb940ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb94153fa0 0x7fbb940ace10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60562/0 (socket says 172.21.15.59:60562) 2024-04-25T09:08:06.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9a200640 1 -- 172.21.15.59:0/4070848967 learned_addr learned my addr 172.21.15.59:0/4070848967 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:06.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb99800640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb7c006580 0x7fbb9413af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb98e00640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb94153b20 0x7fbb940ac8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9a200640 1 -- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb7c006580 msgr2=0x7fbb9413af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9a200640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb7c006580 0x7fbb9413af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9a200640 1 -- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb94153b20 msgr2=0x7fbb940ac8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9a200640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb94153b20 0x7fbb940ac8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9a200640 1 -- 172.21.15.59:0/4070848967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb9413b4a0 con 0x7fbb94153fa0 2024-04-25T09:08:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.604+0000 7fbb9a200640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb94153fa0 0x7fbb940ace10 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fbb9406ba60 tx=0x7fbb8c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.608+0000 7fbb91600640 1 -- 172.21.15.59:0/4070848967 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c010e20 con 0x7fbb94153fa0 2024-04-25T09:08:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.608+0000 7fbb91600640 1 -- 172.21.15.59:0/4070848967 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c0039a0 con 0x7fbb94153fa0 2024-04-25T09:08:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.608+0000 7fbb91600640 1 -- 172.21.15.59:0/4070848967 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c003dd0 con 0x7fbb94153fa0 2024-04-25T09:08:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.608+0000 7fbb9c200640 1 -- 172.21.15.59:0/4070848967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb94154500 con 0x7fbb94153fa0 2024-04-25T09:08:06.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.608+0000 7fbb9c200640 1 -- 172.21.15.59:0/4070848967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb94154ac0 con 0x7fbb94153fa0 2024-04-25T09:08:06.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.608+0000 7fbb91600640 1 -- 172.21.15.59:0/4070848967 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbb8c01e020 con 0x7fbb94153fa0 2024-04-25T09:08:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.608+0000 7fbb91600640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb74066f60 0x7fbb74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.608+0000 7fbb91600640 1 -- 172.21.15.59:0/4070848967 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fbb8c085850 con 0x7fbb94153fa0 2024-04-25T09:08:06.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.608+0000 7fbb99800640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb74066f60 0x7fbb74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.608+0000 7fbb9f6dc000 1 Processor -- start 2024-04-25T09:08:06.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.608+0000 7fbb9f6dc000 1 -- start start 2024-04-25T09:08:06.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb99800640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb74066f60 0x7fbb74069420 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbb88001060 tx=0x7fbb88000bd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b8f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b739d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7c7992fd0 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7c791b170 con 0x55e7c7b8fad0 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7c798f070 con 0x55e7c7b73f10 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb99800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b8f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb99800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b8f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60564/0 (socket says 172.21.15.59:60564) 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb99800640 1 -- 172.21.15.59:0/2974552754 learned_addr learned my addr 172.21.15.59:0/2974552754 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9a200640 1 --2- 172.21.15.59:0/2974552754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb98e00640 1 --2- 172.21.15.59:0/2974552754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b739d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb99800640 1 -- 172.21.15.59:0/2974552754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 msgr2=0x55e7c7b742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb99800640 1 --2- 172.21.15.59:0/2974552754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb99800640 1 -- 172.21.15.59:0/2974552754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8fad0 msgr2=0x55e7c7b739d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb99800640 1 --2- 172.21.15.59:0/2974552754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b739d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb99800640 1 -- 172.21.15.59:0/2974552754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7c79d9d20 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb98e00640 1 --2- 172.21.15.59:0/2974552754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:06.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb99800640 1 --2- 172.21.15.59:0/2974552754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b8f590 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fbb88004900 tx=0x7fbb88017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff36a554bc8ecd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb86000640 1 -- 172.21.15.59:0/2974552754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8802a070 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb86000640 1 -- 172.21.15.59:0/2974552754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88017a90 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb86000640 1 -- 172.21.15.59:0/2974552754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb88017e40 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2974552754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 msgr2=0x55e7c7b8f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/2974552754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b8f590 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fbb88004900 tx=0x7fbb88017000 comp rx=0 tx=0).stop 2024-04-25T09:08:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2974552754 shutdown_connections 2024-04-25T09:08:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/2974552754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/2974552754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/2974552754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b8f590 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2974552754 >> 172.21.15.59:0/2974552754 conn(0x55e7c7b4b710 msgr2=0x55e7c7b4baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2974552754 shutdown_connections 2024-04-25T09:08:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2974552754 wait complete. 2024-04-25T09:08:06.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 -- start start 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.612+0000 7fbb9f6dc000 1 Processor -- start 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b96930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b96e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b742f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7c7a50c10 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7c794d680 con 0x55e7c7b8fad0 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7c7997600 con 0x55e7c7b73f10 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 10 client.0 _ll_register_callbacks cb 0x55e7c7a48080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb98e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b96e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb98e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b96e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60566/0 (socket says 172.21.15.59:60566) 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb98e00640 1 -- 172.21.15.59:0/1681600295 learned_addr learned my addr 172.21.15.59:0/1681600295 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9a200640 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb99800640 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b96930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb98e00640 1 -- 172.21.15.59:0/1681600295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 msgr2=0x55e7c7b96930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb98e00640 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b96930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb98e00640 1 -- 172.21.15.59:0/1681600295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8fad0 msgr2=0x55e7c7b742f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb98e00640 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b742f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb98e00640 1 -- 172.21.15.59:0/1681600295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7c796ad30 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb99800640 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b96930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:06.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb98e00640 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b96e70 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fbb80006f90 tx=0x7fbb80019530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9f7dd523816ee3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb7aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:06.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb7aa00640 1 -- 172.21.15.59:0/1681600295 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800c0060 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb7aa00640 1 -- 172.21.15.59:0/1681600295 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fbb800096b0 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/1681600295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbb88017a90 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb7aa00640 1 -- 172.21.15.59:0/1681600295 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb800b09e0 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 10 client.7752 fetch_fsmap learned FSMap version 71 2024-04-25T09:08:06.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/1681600295 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55e7c791b3c0 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb7aa00640 1 -- 172.21.15.59:0/1681600295 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb88017a90 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb7aa00640 1 -- 172.21.15.59:0/1681600295 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbb800b0b80 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 10 client.7752 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 10 client.7752 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 20 client.7752 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55e7c7b75060 0x55e7c7b75440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 4 client.7752 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/1681600295 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7c792ee00 con 0x55e7c7b75060 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb99800640 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55e7c7b75060 0x55e7c7b75440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb7aa00640 10 client.7752 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.616+0000 7fbb99800640 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55e7c7b75060 0x55e7c7b75440 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f440733195a3395 server_cookie=3a54700611bc32dd in_seq=0 out_seq=0 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb7aa00640 1 -- 172.21.15.59:0/1681600295 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e7c792ee00 con 0x55e7c7b75060 2024-04-25T09:08:06.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb7aa00640 10 client.7752 handle_command_reply: tid=0 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb9f6dc000 1 client.7752 shutdown 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/1681600295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 msgr2=0x55e7c7b96e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b96e70 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fbb80006f90 tx=0x7fbb80019530 comp rx=0 tx=0).stop 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/1681600295 shutdown_connections 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55e7c7b75060 0x55e7c7b75440 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b742f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b96e70 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb7aa00640 0 client.7752 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/1681600295 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b96930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/1681600295 >> 172.21.15.59:0/1681600295 conn(0x55e7c7b4b710 msgr2=0x55e7c7b43950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/1681600295 shutdown_connections 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/1681600295 wait complete. 2024-04-25T09:08:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.620+0000 7fbb9f6dc000 20 client.7752 trim_cache size 0 max 16384 2024-04-25T09:08:06.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 Processor -- start 2024-04-25T09:08:06.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 -- start start 2024-04-25T09:08:06.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b4acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b8d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b8da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94200ba0 con 0x55e7c7b8fad0 2024-04-25T09:08:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb941ffd70 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb941565c0 con 0x55e7c7b73f10 2024-04-25T09:08:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b8da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b8da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60582/0 (socket says 172.21.15.59:60582) 2024-04-25T09:08:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9a200640 1 -- 172.21.15.59:0/371742291 learned_addr learned my addr 172.21.15.59:0/371742291 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb99800640 1 --2- 172.21.15.59:0/371742291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b4acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb98e00640 1 --2- 172.21.15.59:0/371742291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b8d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9a200640 1 -- 172.21.15.59:0/371742291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 msgr2=0x55e7c7b4acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9a200640 1 --2- 172.21.15.59:0/371742291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b4acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9a200640 1 -- 172.21.15.59:0/371742291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8f1b0 msgr2=0x55e7c7b8d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9a200640 1 --2- 172.21.15.59:0/371742291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b8d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9a200640 1 -- 172.21.15.59:0/371742291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7c7b74660 con 0x55e7c7b8fad0 2024-04-25T09:08:06.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9a200640 1 --2- 172.21.15.59:0/371742291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b8da40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c055f20 tx=0x7fbb8c018040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72867b34ebed7a0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb85600640 1 -- 172.21.15.59:0/371742291 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c082070 con 0x55e7c7b8fad0 2024-04-25T09:08:06.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb85600640 1 -- 172.21.15.59:0/371742291 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c05e5f0 con 0x55e7c7b8fad0 2024-04-25T09:08:06.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb85600640 1 -- 172.21.15.59:0/371742291 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c052600 con 0x55e7c7b8fad0 2024-04-25T09:08:06.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/371742291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 msgr2=0x55e7c7b8da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/371742291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b8da40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c055f20 tx=0x7fbb8c018040 comp rx=0 tx=0).stop 2024-04-25T09:08:06.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/371742291 shutdown_connections 2024-04-25T09:08:06.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/371742291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b8da40 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/371742291 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b8f1b0 0x55e7c7b8d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/371742291 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b73f10 0x55e7c7b4acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/371742291 >> 172.21.15.59:0/371742291 conn(0x55e7c7b4b710 msgr2=0x55e7c7b72f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/371742291 shutdown_connections 2024-04-25T09:08:06.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/371742291 wait complete. 2024-04-25T09:08:06.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 -- start start 2024-04-25T09:08:06.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.636+0000 7fbb9f6dc000 1 Processor -- start 2024-04-25T09:08:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b73f10 0x55e7c7befa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b8f1b0 0x55e7c7beff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b44620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7c794bf30 con 0x55e7c7b8fad0 2024-04-25T09:08:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb941ff770 con 0x55e7c7b73f10 2024-04-25T09:08:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7c7a50c10 con 0x55e7c7b8f1b0 2024-04-25T09:08:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 10 client.0 _ll_register_callbacks cb 0x55e7c7930b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b44620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b44620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60584/0 (socket says 172.21.15.59:60584) 2024-04-25T09:08:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9a200640 1 -- 172.21.15.59:0/2165783613 learned_addr learned my addr 172.21.15.59:0/2165783613 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb98e00640 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b8f1b0 0x55e7c7beff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb99800640 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b73f10 0x55e7c7befa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9a200640 1 -- 172.21.15.59:0/2165783613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b8f1b0 msgr2=0x55e7c7beff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9a200640 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b8f1b0 0x55e7c7beff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9a200640 1 -- 172.21.15.59:0/2165783613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b73f10 msgr2=0x55e7c7befa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9a200640 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b73f10 0x55e7c7befa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9a200640 1 -- 172.21.15.59:0/2165783613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e7c7a150f0 con 0x55e7c7b8fad0 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9a200640 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b44620 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0523f0 tx=0x7fbb8c0839d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5e1359b71abfe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb7aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb7aa00640 1 -- 172.21.15.59:0/2165783613 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c082040 con 0x55e7c7b8fad0 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb7aa00640 1 -- 172.21.15.59:0/2165783613 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fbb8c0563f0 con 0x55e7c7b8fad0 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2165783613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbb8c05e5f0 con 0x55e7c7b8fad0 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb7aa00640 1 -- 172.21.15.59:0/2165783613 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb8c07c050 con 0x55e7c7b8fad0 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 10 client.7758 fetch_fsmap learned FSMap version 71 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2165783613 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x55e7c7927d20 con 0x55e7c7b8fad0 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb7aa00640 1 -- 172.21.15.59:0/2165783613 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c05e5f0 con 0x55e7c7b8fad0 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb7aa00640 1 -- 172.21.15.59:0/2165783613 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fbb8c05e160 con 0x55e7c7b8fad0 2024-04-25T09:08:06.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 10 client.7758 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 10 client.7758 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 20 client.7758 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55e7c7b44f50 0x55e7c7b45360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 4 client.7758 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2165783613 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) v1 -- 0x55e7c79a0510 con 0x55e7c7b44f50 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb99800640 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55e7c7b44f50 0x55e7c7b45360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb7aa00640 10 client.7758 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb99800640 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55e7c7b44f50 0x55e7c7b45360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7d74cc090861f08 server_cookie=cdebb16aa1ee2bff in_seq=0 out_seq=0 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb7aa00640 1 -- 172.21.15.59:0/2165783613 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e7c79a0510 con 0x55e7c7b44f50 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb7aa00640 10 client.7758 handle_command_reply: tid=0 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 client.7758 shutdown 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2165783613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 msgr2=0x55e7c7b44620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.640+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b44620 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c0523f0 tx=0x7fbb8c0839d0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2165783613 shutdown_connections 2024-04-25T09:08:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55e7c7b44f50 0x55e7c7b45360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e7c7b8fad0 0x55e7c7b44620 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e7c7b8f1b0 0x55e7c7beff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9f6dc000 1 --2- 172.21.15.59:0/2165783613 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e7c7b73f10 0x55e7c7befa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2165783613 >> 172.21.15.59:0/2165783613 conn(0x55e7c7b4b710 msgr2=0x55e7c7b73640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb7aa00640 0 client.7758 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:06.634 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:08:06.644+0000 7f2ae2000640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-25T09:07:56.592552+0000 1=1+0) n(v0 rc2024-04-25T09:07:56.700551+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x56455cf41b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T09:07:56.592552+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T09:07:56.700551+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-25T09:08:06.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2165783613 shutdown_connections 2024-04-25T09:08:06.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9f6dc000 1 -- 172.21.15.59:0/2165783613 wait complete. 2024-04-25T09:08:06.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9f6dc000 20 client.7758 trim_cache size 0 max 16384 2024-04-25T09:08:06.635 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:08:06.636 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-04-25T09:08:06.636 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "4838f196-e957-424c-9dcb-cec4ed9521b0", 2024-04-25T09:08:06.636 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-04-25T09:08:06.636 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:08:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9c200640 1 -- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb74066f60 msgr2=0x7fbb74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9c200640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb74066f60 0x7fbb74069420 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fbb88001060 tx=0x7fbb88000bd0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9c200640 1 -- 172.21.15.59:0/4070848967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb94153fa0 msgr2=0x7fbb940ace10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9c200640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb94153fa0 0x7fbb940ace10 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fbb9406ba60 tx=0x7fbb8c009f90 comp rx=0 tx=0).stop 2024-04-25T09:08:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9c200640 1 -- 172.21.15.59:0/4070848967 shutdown_connections 2024-04-25T09:08:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9c200640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb74066f60 0x7fbb74069420 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9c200640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb94153fa0 0x7fbb940ace10 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9c200640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb94153b20 0x7fbb940ac8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9c200640 1 --2- 172.21.15.59:0/4070848967 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb7c006580 0x7fbb9413af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9c200640 1 -- 172.21.15.59:0/4070848967 >> 172.21.15.59:0/4070848967 conn(0x7fbb9406ac10 msgr2=0x7fbb940ae0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9c200640 1 -- 172.21.15.59:0/4070848967 shutdown_connections 2024-04-25T09:08:06.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.644+0000 7fbb9c200640 1 -- 172.21.15.59:0/4070848967 wait complete. 2024-04-25T09:08:06.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:06.651 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:08:06.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.804+0000 7f8aff600640 1 Processor -- start 2024-04-25T09:08:06.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8aff600640 1 -- start start 2024-04-25T09:08:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8aff600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b4810 0x7f8af80d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8aff600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8af8161cf0 0x7f8af80b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8aff600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af806e5f0 con 0x7f8af806e0f0 2024-04-25T09:08:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8aff600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af806e8d0 con 0x7f8af8161cf0 2024-04-25T09:08:06.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8aff600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af806ebb0 con 0x7f8af80b4810 2024-04-25T09:08:06.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8afcc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b4810 0x7f8af80d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8afd600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8af8161cf0 0x7f8af80b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8afcc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b4810 0x7f8af80d04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:33310/0 (socket says 172.21.15.59:33310) 2024-04-25T09:08:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8afcc00640 1 -- 172.21.15.59:0/1257261341 learned_addr learned my addr 172.21.15.59:0/1257261341 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8af7400640 1 -- 172.21.15.59:0/1257261341 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2190821673 0 0) 0x7f8af806e5f0 con 0x7f8af806e0f0 2024-04-25T09:08:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8af7400640 1 -- 172.21.15.59:0/1257261341 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ae0003530 con 0x7f8af806e0f0 2024-04-25T09:08:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8afd600640 1 -- 172.21.15.59:0/1257261341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b4810 msgr2=0x7f8af80d04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8afd600640 1 --2- 172.21.15.59:0/1257261341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b4810 0x7f8af80d04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8afd600640 1 -- 172.21.15.59:0/1257261341 >> v1:172.21.15.178:6789/0 conn(0x7f8af806e0f0 legacy=0x7f8af81615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8afd600640 1 -- 172.21.15.59:0/1257261341 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af806ee90 con 0x7f8af8161cf0 2024-04-25T09:08:06.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.808+0000 7f8afcc00640 1 --2- 172.21.15.59:0/1257261341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b4810 0x7f8af80d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:06.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.812+0000 7f8afd600640 1 --2- 172.21.15.59:0/1257261341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af8161cf0 0x7f8af80b2d40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009d90 tx=0x7f8af001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43660cfe34270727 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.812+0000 7f8af7400640 1 -- 172.21.15.59:0/1257261341 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00b2070 con 0x7f8af8161cf0 2024-04-25T09:08:06.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.812+0000 7f8af7400640 1 -- 172.21.15.59:0/1257261341 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af00a57c0 con 0x7f8af8161cf0 2024-04-25T09:08:06.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.812+0000 7f8af7400640 1 -- 172.21.15.59:0/1257261341 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00a5b90 con 0x7f8af8161cf0 2024-04-25T09:08:06.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.812+0000 7f8aff600640 1 -- 172.21.15.59:0/1257261341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af8161cf0 msgr2=0x7f8af80b2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.812+0000 7f8aff600640 1 --2- 172.21.15.59:0/1257261341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af8161cf0 0x7f8af80b2d40 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009d90 tx=0x7f8af001c8e0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.812+0000 7f8aff600640 1 -- 172.21.15.59:0/1257261341 shutdown_connections 2024-04-25T09:08:06.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.812+0000 7f8aff600640 1 --2- 172.21.15.59:0/1257261341 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af8161cf0 0x7f8af80b2d40 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.812+0000 7f8aff600640 1 --2- 172.21.15.59:0/1257261341 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b4810 0x7f8af80d04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.812+0000 7f8aff600640 1 -- 172.21.15.59:0/1257261341 >> 172.21.15.59:0/1257261341 conn(0x7f8af80cf9c0 msgr2=0x7f8af80cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.812+0000 7f8aff600640 1 -- 172.21.15.59:0/1257261341 shutdown_connections 2024-04-25T09:08:06.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.812+0000 7f8aff600640 1 -- 172.21.15.59:0/1257261341 wait complete. 2024-04-25T09:08:06.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8aff600640 1 Processor -- start 2024-04-25T09:08:06.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8aff600640 1 -- start start 2024-04-25T09:08:06.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8aff600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af806e0f0 0x7f8af8143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8aff600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80b4810 0x7f8af80acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8aff600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af8161cf0 0x7f8af8151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8aff600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80b3e20 con 0x7f8af806e0f0 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8aff600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80b3ca0 con 0x7f8af80b4810 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8aff600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80b3fa0 con 0x7f8af8161cf0 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8afcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af806e0f0 0x7f8af8143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8afcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af806e0f0 0x7f8af8143da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60594/0 (socket says 172.21.15.59:60594) 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8afcc00640 1 -- 172.21.15.59:0/1613592452 learned_addr learned my addr 172.21.15.59:0/1613592452 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8afd600640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af8161cf0 0x7f8af8151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8af7e00640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80b4810 0x7f8af80acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8afcc00640 1 -- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af8161cf0 msgr2=0x7f8af8151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8afcc00640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af8161cf0 0x7f8af8151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8afcc00640 1 -- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80b4810 msgr2=0x7f8af80acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8afcc00640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80b4810 0x7f8af80acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8afcc00640 1 -- 172.21.15.59:0/1613592452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af8161b20 con 0x7f8af806e0f0 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8af7e00640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80b4810 0x7f8af80acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8afcc00640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af806e0f0 0x7f8af8143da0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00ea00 tx=0x7f8aec00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8af4c00640 1 -- 172.21.15.59:0/1613592452 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec017070 con 0x7f8af806e0f0 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8af4c00640 1 -- 172.21.15.59:0/1613592452 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aec00ca60 con 0x7f8af806e0f0 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8aff600640 1 -- 172.21.15.59:0/1613592452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af81442e0 con 0x7f8af806e0f0 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8af4c00640 1 -- 172.21.15.59:0/1613592452 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aec00ce10 con 0x7f8af806e0f0 2024-04-25T09:08:06.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.816+0000 7f8aff600640 1 -- 172.21.15.59:0/1613592452 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af8150df0 con 0x7f8af806e0f0 2024-04-25T09:08:06.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8af4c00640 1 -- 172.21.15.59:0/1613592452 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8aec01a070 con 0x7f8af806e0f0 2024-04-25T09:08:06.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8af4c00640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad8066f60 0x7f8ad8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8af4c00640 1 -- 172.21.15.59:0/1613592452 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8aec0851d0 con 0x7f8af806e0f0 2024-04-25T09:08:06.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8b02ad2000 1 Processor -- start 2024-04-25T09:08:06.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8af7e00640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad8066f60 0x7f8ad8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8b02ad2000 1 -- start start 2024-04-25T09:08:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8af7e00640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad8066f60 0x7f8ad8069420 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8af81f9980 tx=0x7f8ae4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8b02ad2000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd103f9d0 0x563cd103fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8b02ad2000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd10402f0 0x563cd0ff5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8b02ad2000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd0ff60a0 0x563cd0ff6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8b02ad2000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd0e42ff0 con 0x563cd0ff60a0 2024-04-25T09:08:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8b02ad2000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd0dcb150 con 0x563cd10402f0 2024-04-25T09:08:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8b02ad2000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cd0e3f090 con 0x563cd103f9d0 2024-04-25T09:08:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8afd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd0ff60a0 0x563cd0ff6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8afd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd0ff60a0 0x563cd0ff6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60610/0 (socket says 172.21.15.59:60610) 2024-04-25T09:08:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8afd600640 1 -- 172.21.15.59:0/2803939431 learned_addr learned my addr 172.21.15.59:0/2803939431 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8afcc00640 1 --2- 172.21.15.59:0/2803939431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd103f9d0 0x563cd103fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8af7e00640 1 --2- 172.21.15.59:0/2803939431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd10402f0 0x563cd0ff5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8afd600640 1 -- 172.21.15.59:0/2803939431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd103f9d0 msgr2=0x563cd103fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8afd600640 1 --2- 172.21.15.59:0/2803939431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd103f9d0 0x563cd103fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8afd600640 1 -- 172.21.15.59:0/2803939431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd10402f0 msgr2=0x563cd0ff5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8afd600640 1 --2- 172.21.15.59:0/2803939431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd10402f0 0x563cd0ff5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8afd600640 1 -- 172.21.15.59:0/2803939431 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cd0fd90d0 con 0x563cd0ff60a0 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.820+0000 7f8af7e00640 1 --2- 172.21.15.59:0/2803939431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd10402f0 0x563cd0ff5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8afd600640 1 --2- 172.21.15.59:0/2803939431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd0ff60a0 0x563cd0ff6480 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f8af001af90 tx=0x7f8af0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e5261564bcc55b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8ae9600640 1 -- 172.21.15.59:0/2803939431 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00b2040 con 0x563cd0ff60a0 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8ae9600640 1 -- 172.21.15.59:0/2803939431 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af00a57c0 con 0x563cd0ff60a0 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8ae9600640 1 -- 172.21.15.59:0/2803939431 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00a5b90 con 0x563cd0ff60a0 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 -- 172.21.15.59:0/2803939431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd0ff60a0 msgr2=0x563cd0ff6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/2803939431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd0ff60a0 0x563cd0ff6480 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f8af001af90 tx=0x7f8af0004ac0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 -- 172.21.15.59:0/2803939431 shutdown_connections 2024-04-25T09:08:06.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/2803939431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd0ff60a0 0x563cd0ff6480 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/2803939431 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd10402f0 0x563cd0ff5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/2803939431 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd103f9d0 0x563cd103fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 -- 172.21.15.59:0/2803939431 >> 172.21.15.59:0/2803939431 conn(0x563cd0ff2020 msgr2=0x563cd0ff4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 -- 172.21.15.59:0/2803939431 shutdown_connections 2024-04-25T09:08:06.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 -- 172.21.15.59:0/2803939431 wait complete. 2024-04-25T09:08:06.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 -- start start 2024-04-25T09:08:06.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 Processor -- start 2024-04-25T09:08:06.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd0ff60a0 0x563cd10247f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd103f9d0 0x563cd1024d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 0x563cd1025270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd0e07250 con 0x563cd10402f0 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd0dfd690 con 0x563cd0ff60a0 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cd0dcba40 con 0x563cd103f9d0 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8b02ad2000 10 client.0 _ll_register_callbacks cb 0x563cd0fe0e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8afd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 0x563cd1025270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8afd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 0x563cd1025270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60616/0 (socket says 172.21.15.59:60616) 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8afd600640 1 -- 172.21.15.59:0/1904551457 learned_addr learned my addr 172.21.15.59:0/1904551457 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8afcc00640 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd0ff60a0 0x563cd10247f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8af7e00640 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd103f9d0 0x563cd1024d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8afd600640 1 -- 172.21.15.59:0/1904551457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd103f9d0 msgr2=0x563cd1024d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8afd600640 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd103f9d0 0x563cd1024d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8afd600640 1 -- 172.21.15.59:0/1904551457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd0ff60a0 msgr2=0x563cd10247f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8afd600640 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd0ff60a0 0x563cd10247f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8afd600640 1 -- 172.21.15.59:0/1904551457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cd0ef01c0 con 0x563cd10402f0 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.824+0000 7f8afd600640 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 0x563cd1025270 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f8af001af90 tx=0x7f8af001b120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b2909f3da1297a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8ade000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8ade000640 1 -- 172.21.15.59:0/1904551457 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00c5070 con 0x563cd10402f0 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8ade000640 1 -- 172.21.15.59:0/1904551457 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8af00ca460 con 0x563cd10402f0 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1904551457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8af00a57c0 con 0x563cd10402f0 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8ade000640 1 -- 172.21.15.59:0/1904551457 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8af00d2050 con 0x563cd10402f0 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 10 client.7767 fetch_fsmap learned FSMap version 71 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1904551457 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x563cd0eec170 con 0x563cd10402f0 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8ade000640 1 -- 172.21.15.59:0/1904551457 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af00a57c0 con 0x563cd10402f0 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8ade000640 1 -- 172.21.15.59:0/1904551457 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8af00d5020 con 0x563cd10402f0 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 10 client.7767 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 10 client.7767 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:08:06.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 20 client.7767 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x563cd104fc80 0x563cd1052070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 4 client.7767 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1904551457 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563cd0ddec60 con 0x563cd104fc80 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8afcc00640 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x563cd104fc80 0x563cd1052070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8afcc00640 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x563cd104fc80 0x563cd1052070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fec3c1ec50d5eb53 server_cookie=ea4d139aab537ca1 in_seq=0 out_seq=0 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8ade000640 10 client.7767 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8ade000640 1 -- 172.21.15.59:0/1904551457 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x563cd0ddec60 con 0x563cd104fc80 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8ade000640 10 client.7767 handle_command_reply: tid=0 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 client.7767 shutdown 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1904551457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 msgr2=0x563cd1025270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 0x563cd1025270 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f8af001af90 tx=0x7f8af001b120 comp rx=0 tx=0).stop 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1904551457 shutdown_connections 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x563cd104fc80 0x563cd1052070 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 0x563cd1025270 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd103f9d0 0x563cd1024d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8ade000640 0 client.7767 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:06.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/1904551457 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd0ff60a0 0x563cd10247f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1904551457 >> 172.21.15.59:0/1904551457 conn(0x563cd0ff2020 msgr2=0x563cd0ff4ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1904551457 shutdown_connections 2024-04-25T09:08:06.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1904551457 wait complete. 2024-04-25T09:08:06.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.828+0000 7f8b02ad2000 20 client.7767 trim_cache size 0 max 16384 2024-04-25T09:08:06.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8b02ad2000 1 Processor -- start 2024-04-25T09:08:06.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8b02ad2000 1 -- start start 2024-04-25T09:08:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8b02ad2000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd0ff60a0 0x563cd109bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8b02ad2000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd103f9d0 0x563cd109c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8b02ad2000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd10402f0 0x563cd109c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8b02ad2000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af8203030 con 0x563cd103f9d0 2024-04-25T09:08:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8b02ad2000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af82021f0 con 0x563cd0ff60a0 2024-04-25T09:08:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8b02ad2000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af81453a0 con 0x563cd10402f0 2024-04-25T09:08:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8af7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd103f9d0 0x563cd109c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8af7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd103f9d0 0x563cd109c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60628/0 (socket says 172.21.15.59:60628) 2024-04-25T09:08:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8af7e00640 1 -- 172.21.15.59:0/3848922761 learned_addr learned my addr 172.21.15.59:0/3848922761 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8afcc00640 1 --2- 172.21.15.59:0/3848922761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd0ff60a0 0x563cd109bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8afd600640 1 --2- 172.21.15.59:0/3848922761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd10402f0 0x563cd109c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8af7e00640 1 -- 172.21.15.59:0/3848922761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd10402f0 msgr2=0x563cd109c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8af7e00640 1 --2- 172.21.15.59:0/3848922761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd10402f0 0x563cd109c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8af7e00640 1 -- 172.21.15.59:0/3848922761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd0ff60a0 msgr2=0x563cd109bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8af7e00640 1 --2- 172.21.15.59:0/3848922761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd0ff60a0 0x563cd109bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8af7e00640 1 -- 172.21.15.59:0/3848922761 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cd0e89de0 con 0x563cd103f9d0 2024-04-25T09:08:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8afd600640 1 --2- 172.21.15.59:0/3848922761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd10402f0 0x563cd109c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8af7e00640 1 --2- 172.21.15.59:0/3848922761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd103f9d0 0x563cd109c420 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400d7d0 tx=0x7f8ae4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f953a9b8e20c8c5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8ae8c00640 1 -- 172.21.15.59:0/3848922761 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4027070 con 0x563cd103f9d0 2024-04-25T09:08:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8ae8c00640 1 -- 172.21.15.59:0/3848922761 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae4005110 con 0x563cd103f9d0 2024-04-25T09:08:06.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.844+0000 7f8ae8c00640 1 -- 172.21.15.59:0/3848922761 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae40054c0 con 0x563cd103f9d0 2024-04-25T09:08:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 -- 172.21.15.59:0/3848922761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd103f9d0 msgr2=0x563cd109c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/3848922761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd103f9d0 0x563cd109c420 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400d7d0 tx=0x7f8ae4013000 comp rx=0 tx=0).stop 2024-04-25T09:08:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 -- 172.21.15.59:0/3848922761 shutdown_connections 2024-04-25T09:08:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/3848922761 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd10402f0 0x563cd109c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/3848922761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd103f9d0 0x563cd109c420 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/3848922761 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd0ff60a0 0x563cd109bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 -- 172.21.15.59:0/3848922761 >> 172.21.15.59:0/3848922761 conn(0x563cd0ff2020 msgr2=0x563cd104cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 -- 172.21.15.59:0/3848922761 shutdown_connections 2024-04-25T09:08:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 -- 172.21.15.59:0/3848922761 wait complete. 2024-04-25T09:08:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 -- start start 2024-04-25T09:08:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 Processor -- start 2024-04-25T09:08:06.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd0ff60a0 0x563cd1052380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd103f9d0 0x563cd10528c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 0x563cd1052e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd0ddde00 con 0x563cd10402f0 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af8201c70 con 0x563cd103f9d0 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cd0e42300 con 0x563cd0ff60a0 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 10 client.0 _ll_register_callbacks cb 0x563cd0fc1040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8afd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 0x563cd1052e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8afcc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd0ff60a0 0x563cd1052380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8afd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 0x563cd1052e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60630/0 (socket says 172.21.15.59:60630) 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8afd600640 1 -- 172.21.15.59:0/1947296471 learned_addr learned my addr 172.21.15.59:0/1947296471 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8af7e00640 1 --2- 172.21.15.59:0/1947296471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd103f9d0 0x563cd10528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8afd600640 1 -- 172.21.15.59:0/1947296471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd0ff60a0 msgr2=0x563cd1052380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8afd600640 1 --2- 172.21.15.59:0/1947296471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd0ff60a0 0x563cd1052380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8afd600640 1 -- 172.21.15.59:0/1947296471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd103f9d0 msgr2=0x563cd10528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8afd600640 1 --2- 172.21.15.59:0/1947296471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd103f9d0 0x563cd10528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8afd600640 1 -- 172.21.15.59:0/1947296471 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cd0de48e0 con 0x563cd10402f0 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8afd600640 1 --2- 172.21.15.59:0/1947296471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 0x563cd1052e00 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f8af001d180 tx=0x7f8af00a7070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575c18e5615e030c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8ade000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8ade000640 1 -- 172.21.15.59:0/1947296471 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af00c5070 con 0x563cd10402f0 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8ade000640 1 -- 172.21.15.59:0/1947296471 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(93..93 src has 1..93) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f8af00cc8d0 con 0x563cd10402f0 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1947296471 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ae4005110 con 0x563cd10402f0 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8ade000640 1 -- 172.21.15.59:0/1947296471 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8af00b2050 con 0x563cd10402f0 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 10 client.7773 fetch_fsmap learned FSMap version 71 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.848+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1947296471 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=2+}) v3 -- 0x563cd0e9c8f0 con 0x563cd10402f0 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8ade000640 1 -- 172.21.15.59:0/1947296471 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae4005110 con 0x563cd10402f0 2024-04-25T09:08:06.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8ade000640 1 -- 172.21.15.59:0/1947296471 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 71) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8af00d5040 con 0x563cd10402f0 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 10 client.7773 fetch_fsmap finished waiting for FSMap version 71 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 10 client.7773 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 20 client.7773 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/1947296471 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x563cd1053340 0x563cd1053750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 4 client.7773 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1947296471 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x563cd0e50530 con 0x563cd1053340 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8afcc00640 1 --2- 172.21.15.59:0/1947296471 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x563cd1053340 0x563cd1053750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8afcc00640 1 --2- 172.21.15.59:0/1947296471 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x563cd1053340 0x563cd1053750 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9de2c146ac75a105 server_cookie=5cef27ed3e917914 in_seq=0 out_seq=0 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8ade000640 10 client.7773 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8ade000640 1 -- 172.21.15.59:0/1947296471 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+256 (crc 0 0 0) 0x563cd0e50530 con 0x563cd1053340 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8ade000640 10 client.7773 handle_command_reply: tid=0 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 client.7773 shutdown 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1947296471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 msgr2=0x563cd1052e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/1947296471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 0x563cd1052e00 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f8af001d180 tx=0x7f8af00a7070 comp rx=0 tx=0).stop 2024-04-25T09:08:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1947296471 shutdown_connections 2024-04-25T09:08:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/1947296471 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x563cd1053340 0x563cd1053750 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/1947296471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563cd10402f0 0x563cd1052e00 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/1947296471 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x563cd103f9d0 0x563cd10528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 --2- 172.21.15.59:0/1947296471 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x563cd0ff60a0 0x563cd1052380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8ade000640 0 client.7773 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1947296471 >> 172.21.15.59:0/1947296471 conn(0x563cd0ff2020 msgr2=0x563cd103e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1947296471 shutdown_connections 2024-04-25T09:08:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 1 -- 172.21.15.59:0/1947296471 wait complete. 2024-04-25T09:08:06.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8b02ad2000 20 client.7773 trim_cache size 0 max 16384 2024-04-25T09:08:06.845 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:08:06.846 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:08:06.846 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-04-25T09:08:06.846 INFO:teuthology.orchestra.run.smithi059.stdout: "4838f196-e957-424c-9dcb-cec4ed9521b0": { 2024-04-25T09:08:06.846 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/dir", 2024-04-25T09:08:06.846 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "4838f196-e957-424c-9dcb-cec4ed9521b0", 2024-04-25T09:08:06.846 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive" 2024-04-25T09:08:06.846 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:08:06.846 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:08:06.846 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:08:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8aff600640 1 -- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad8066f60 msgr2=0x7f8ad8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8aff600640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad8066f60 0x7f8ad8069420 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8af81f9980 tx=0x7f8ae4009040 comp rx=0 tx=0).stop 2024-04-25T09:08:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8aff600640 1 -- 172.21.15.59:0/1613592452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af806e0f0 msgr2=0x7f8af8143da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8aff600640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af806e0f0 0x7f8af8143da0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00ea00 tx=0x7f8aec00eec0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8aff600640 1 -- 172.21.15.59:0/1613592452 shutdown_connections 2024-04-25T09:08:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8aff600640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad8066f60 0x7f8ad8069420 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8aff600640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af8161cf0 0x7f8af8151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8aff600640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80b4810 0x7f8af80acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8aff600640 1 --2- 172.21.15.59:0/1613592452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af806e0f0 0x7f8af8143da0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8aff600640 1 -- 172.21.15.59:0/1613592452 >> 172.21.15.59:0/1613592452 conn(0x7f8af80cf9c0 msgr2=0x7f8af80afd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8aff600640 1 -- 172.21.15.59:0/1613592452 shutdown_connections 2024-04-25T09:08:06.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:06.852+0000 7f8aff600640 1 -- 172.21.15.59:0/1613592452 wait complete. 2024-04-25T09:08:06.860 INFO:tasks.cephfs.filesystem:scrub status for tag:4838f196-e957-424c-9dcb-cec4ed9521b0 - {'path': '/dir', 'tag': '4838f196-e957-424c-9dcb-cec4ed9521b0', 'options': 'recursive'} 2024-04-25T09:08:10.785 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:08:10.796+0000 7f1096a00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-25T09:08:23.413 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:08:23.417 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:08:36.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:36.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:08:37.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe689400640 1 Processor -- start 2024-04-25T09:08:37.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe689400640 1 -- start start 2024-04-25T09:08:37.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe689400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe684144120 0x7fe68415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe689400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe6840ccbf0 0x7fe68415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe689400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68415bc40 con 0x7fe68415ee60 2024-04-25T09:08:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe689400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68415e490 con 0x7fe684144120 2024-04-25T09:08:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe689400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68415b3a0 con 0x7fe6840ccbf0 2024-04-25T09:08:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe682800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe684144120 0x7fe68415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe682800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe684144120 0x7fe68415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58690/0 (socket says 172.21.15.59:58690) 2024-04-25T09:08:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe682800640 1 -- 172.21.15.59:0/133981807 learned_addr learned my addr 172.21.15.59:0/133981807 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe679e00640 1 --2- 172.21.15.59:0/133981807 >> v2:172.21.15.178:3300/0 conn(0x7fe6840ccbf0 0x7fe68415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe682800640 1 -- 172.21.15.59:0/133981807 >> v2:172.21.15.178:3300/0 conn(0x7fe6840ccbf0 msgr2=0x7fe68415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe682800640 1 --2- 172.21.15.59:0/133981807 >> v2:172.21.15.178:3300/0 conn(0x7fe6840ccbf0 0x7fe68415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe682800640 1 -- 172.21.15.59:0/133981807 >> v1:172.21.15.178:6789/0 conn(0x7fe68415ee60 legacy=0x7fe6840b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.028+0000 7fe682800640 1 -- 172.21.15.59:0/133981807 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68415b680 con 0x7fe684144120 2024-04-25T09:08:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.032+0000 7fe682800640 1 --2- 172.21.15.59:0/133981807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe684144120 0x7fe68415acd0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fe68406b870 tx=0x7fe67401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d520d8776a5a5fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.032+0000 7fe681e00640 1 -- 172.21.15.59:0/133981807 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6740b4070 con 0x7fe684144120 2024-04-25T09:08:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.032+0000 7fe681e00640 1 -- 172.21.15.59:0/133981807 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6740a7b40 con 0x7fe684144120 2024-04-25T09:08:37.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.032+0000 7fe681e00640 1 -- 172.21.15.59:0/133981807 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6740af440 con 0x7fe684144120 2024-04-25T09:08:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.032+0000 7fe689400640 1 -- 172.21.15.59:0/133981807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe684144120 msgr2=0x7fe68415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.032+0000 7fe689400640 1 --2- 172.21.15.59:0/133981807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe684144120 0x7fe68415acd0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fe68406b870 tx=0x7fe67401eb60 comp rx=0 tx=0).stop 2024-04-25T09:08:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.032+0000 7fe689400640 1 -- 172.21.15.59:0/133981807 shutdown_connections 2024-04-25T09:08:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.032+0000 7fe689400640 1 --2- 172.21.15.59:0/133981807 >> v2:172.21.15.178:3300/0 conn(0x7fe6840ccbf0 0x7fe68415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.032+0000 7fe689400640 1 --2- 172.21.15.59:0/133981807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe684144120 0x7fe68415acd0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.032+0000 7fe689400640 1 -- 172.21.15.59:0/133981807 >> 172.21.15.59:0/133981807 conn(0x7fe684067080 msgr2=0x7fe68406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.032+0000 7fe689400640 1 -- 172.21.15.59:0/133981807 shutdown_connections 2024-04-25T09:08:37.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.032+0000 7fe689400640 1 -- 172.21.15.59:0/133981807 wait complete. 2024-04-25T09:08:37.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe689400640 1 Processor -- start 2024-04-25T09:08:37.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe689400640 1 -- start start 2024-04-25T09:08:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe689400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6840ccbf0 0x7fe68415a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe689400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe684144120 0x7fe6841637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe689400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68415ee60 0x7fe68413e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe689400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68406dc60 con 0x7fe68415ee60 2024-04-25T09:08:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe689400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68406dae0 con 0x7fe6840ccbf0 2024-04-25T09:08:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe689400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68406dde0 con 0x7fe684144120 2024-04-25T09:08:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe683200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68415ee60 0x7fe68413e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe683200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68415ee60 0x7fe68413e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58706/0 (socket says 172.21.15.59:58706) 2024-04-25T09:08:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe683200640 1 -- 172.21.15.59:0/1435552338 learned_addr learned my addr 172.21.15.59:0/1435552338 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe682800640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6840ccbf0 0x7fe68415a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe679e00640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe684144120 0x7fe6841637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe683200640 1 -- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe684144120 msgr2=0x7fe6841637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe683200640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe684144120 0x7fe6841637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe683200640 1 -- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6840ccbf0 msgr2=0x7fe68415a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe683200640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6840ccbf0 0x7fe68415a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe683200640 1 -- 172.21.15.59:0/1435552338 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68415de90 con 0x7fe68415ee60 2024-04-25T09:08:37.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe683200640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68415ee60 0x7fe68413e560 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00c340 tx=0x7fe67c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe67b400640 1 -- 172.21.15.59:0/1435552338 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c005220 con 0x7fe68415ee60 2024-04-25T09:08:37.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe67b400640 1 -- 172.21.15.59:0/1435552338 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c0053c0 con 0x7fe68415ee60 2024-04-25T09:08:37.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe67b400640 1 -- 172.21.15.59:0/1435552338 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c007270 con 0x7fe68415ee60 2024-04-25T09:08:37.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe689400640 1 -- 172.21.15.59:0/1435552338 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68415d8d0 con 0x7fe68415ee60 2024-04-25T09:08:37.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.036+0000 7fe689400640 1 -- 172.21.15.59:0/1435552338 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68415bf20 con 0x7fe68415ee60 2024-04-25T09:08:37.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe67b400640 1 -- 172.21.15.59:0/1435552338 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe67c019020 con 0x7fe68415ee60 2024-04-25T09:08:37.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe67b400640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe660066f60 0x7fe660069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe67b400640 1 -- 172.21.15.59:0/1435552338 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fe67c0844b0 con 0x7fe68415ee60 2024-04-25T09:08:37.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe682800640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe660066f60 0x7fe660069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe68c961000 1 Processor -- start 2024-04-25T09:08:37.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe68c961000 1 -- start start 2024-04-25T09:08:37.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe682800640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe660066f60 0x7fe660069420 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe6740b1000 tx=0x7fe6740a9070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe68c961000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 0x559673ba6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe68c961000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 0x559673b5cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe68c961000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 0x559673b5d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe68c961000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596739a9ff0 con 0x559673ba72f0 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe68c961000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x559673932150 con 0x559673b5d0a0 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.040+0000 7fe68c961000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596739a6090 con 0x559673ba69d0 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe679e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 0x559673b5cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe679e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 0x559673b5cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58718/0 (socket says 172.21.15.59:58718) 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe679e00640 1 -- 172.21.15.59:0/215721547 learned_addr learned my addr 172.21.15.59:0/215721547 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe682800640 1 --2- 172.21.15.59:0/215721547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 0x559673ba6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe683200640 1 --2- 172.21.15.59:0/215721547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 0x559673b5d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe679e00640 1 -- 172.21.15.59:0/215721547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 msgr2=0x559673ba6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe679e00640 1 --2- 172.21.15.59:0/215721547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 0x559673ba6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe679e00640 1 -- 172.21.15.59:0/215721547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 msgr2=0x559673b5d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe679e00640 1 --2- 172.21.15.59:0/215721547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 0x559673b5d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe679e00640 1 -- 172.21.15.59:0/215721547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559673b400d0 con 0x559673ba72f0 2024-04-25T09:08:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe683200640 1 --2- 172.21.15.59:0/215721547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 0x559673b5d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe679e00640 1 --2- 172.21.15.59:0/215721547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 0x559673b5cb60 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0039d0 tx=0x7fe66c003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6b1af065c03001 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe673400640 1 -- 172.21.15.59:0/215721547 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c015420 con 0x559673ba72f0 2024-04-25T09:08:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe673400640 1 -- 172.21.15.59:0/215721547 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c01a070 con 0x559673ba72f0 2024-04-25T09:08:37.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe673400640 1 -- 172.21.15.59:0/215721547 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c015800 con 0x559673ba72f0 2024-04-25T09:08:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 -- 172.21.15.59:0/215721547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 msgr2=0x559673b5cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 --2- 172.21.15.59:0/215721547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 0x559673b5cb60 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fe66c0039d0 tx=0x7fe66c003e90 comp rx=0 tx=0).stop 2024-04-25T09:08:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 -- 172.21.15.59:0/215721547 shutdown_connections 2024-04-25T09:08:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 --2- 172.21.15.59:0/215721547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 0x559673b5d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 --2- 172.21.15.59:0/215721547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 0x559673b5cb60 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 --2- 172.21.15.59:0/215721547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 0x559673ba6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 -- 172.21.15.59:0/215721547 >> 172.21.15.59:0/215721547 conn(0x559673b59020 msgr2=0x559673b5b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 -- 172.21.15.59:0/215721547 shutdown_connections 2024-04-25T09:08:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 -- 172.21.15.59:0/215721547 wait complete. 2024-04-25T09:08:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 -- start start 2024-04-25T09:08:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 Processor -- start 2024-04-25T09:08:37.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673b5d0a0 0x559673b8b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 0x559673b8bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673ba72f0 0x559673b8c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967396e250 con 0x559673b5d0a0 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x559673964690 con 0x559673ba72f0 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x559673932a40 con 0x559673ba69d0 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe68c961000 10 client.0 _ll_register_callbacks cb 0x559673b47e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.044+0000 7fe682800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673b5d0a0 0x559673b8b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe682800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673b5d0a0 0x559673b8b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58726/0 (socket says 172.21.15.59:58726) 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe682800640 1 -- 172.21.15.59:0/1104097285 learned_addr learned my addr 172.21.15.59:0/1104097285 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe683200640 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673ba72f0 0x559673b8c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe679e00640 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 0x559673b8bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe682800640 1 -- 172.21.15.59:0/1104097285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 msgr2=0x559673b8bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe682800640 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 0x559673b8bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe682800640 1 -- 172.21.15.59:0/1104097285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673ba72f0 msgr2=0x559673b8c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe682800640 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673ba72f0 0x559673b8c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe682800640 1 -- 172.21.15.59:0/1104097285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559673a571c0 con 0x559673b5d0a0 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe682800640 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673b5d0a0 0x559673b8b7f0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe67401c790 tx=0x7fe67401d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6deb6cf73ed4f2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe667e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe667e00640 1 -- 172.21.15.59:0/1104097285 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6740b4040 con 0x559673b5d0a0 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe667e00640 1 -- 172.21.15.59:0/1104097285 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fe6740b9b30 con 0x559673b5d0a0 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 -- 172.21.15.59:0/1104097285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe66c01a070 con 0x559673b5d0a0 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe667e00640 1 -- 172.21.15.59:0/1104097285 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6740d1050 con 0x559673b5d0a0 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 10 client.7785 fetch_fsmap learned FSMap version 72 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 -- 172.21.15.59:0/1104097285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x559673a53170 con 0x559673b5d0a0 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe667e00640 1 -- 172.21.15.59:0/1104097285 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c01a070 con 0x559673b5d0a0 2024-04-25T09:08:37.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe667e00640 1 -- 172.21.15.59:0/1104097285 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe6740d4020 con 0x559673b5d0a0 2024-04-25T09:08:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 10 client.7785 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:08:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 10 client.7785 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:08:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 20 client.7785 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x559673bb6c80 0x559673bb9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 4 client.7785 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 -- 172.21.15.59:0/1104097285 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559673945c60 con 0x559673bb6c80 2024-04-25T09:08:37.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe679e00640 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x559673bb6c80 0x559673bb9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe679e00640 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x559673bb6c80 0x559673bb9070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a10a13f73523dcc6 server_cookie=57fafd5ede363b4e in_seq=0 out_seq=0 2024-04-25T09:08:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe667e00640 10 client.7785 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe667e00640 1 -- 172.21.15.59:0/1104097285 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x559673945c60 con 0x559673bb6c80 2024-04-25T09:08:37.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe667e00640 10 client.7785 handle_command_reply: tid=0 2024-04-25T09:08:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 client.7785 shutdown 2024-04-25T09:08:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 -- 172.21.15.59:0/1104097285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673b5d0a0 msgr2=0x559673b8b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673b5d0a0 0x559673b8b7f0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fe67401c790 tx=0x7fe67401d3a0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 -- 172.21.15.59:0/1104097285 shutdown_connections 2024-04-25T09:08:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x559673bb6c80 0x559673bb9070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673ba72f0 0x559673b8c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 0x559673b8bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe667e00640 0 client.7785 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 --2- 172.21.15.59:0/1104097285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673b5d0a0 0x559673b8b7f0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 -- 172.21.15.59:0/1104097285 >> 172.21.15.59:0/1104097285 conn(0x559673b59020 msgr2=0x559673b5bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 -- 172.21.15.59:0/1104097285 shutdown_connections 2024-04-25T09:08:37.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 1 -- 172.21.15.59:0/1104097285 wait complete. 2024-04-25T09:08:37.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.048+0000 7fe68c961000 20 client.7785 trim_cache size 0 max 16384 2024-04-25T09:08:37.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.064+0000 7fe68c961000 1 Processor -- start 2024-04-25T09:08:37.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.064+0000 7fe68c961000 1 -- start start 2024-04-25T09:08:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.064+0000 7fe68c961000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673b5d0a0 0x559673b5b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.064+0000 7fe68c961000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba69d0 0x559673b5b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.064+0000 7fe68c961000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673ba72f0 0x559673b5be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.064+0000 7fe68c961000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe684203460 con 0x559673ba69d0 2024-04-25T09:08:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.064+0000 7fe68c961000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe684202620 con 0x559673ba72f0 2024-04-25T09:08:37.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.064+0000 7fe68c961000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68413b330 con 0x559673b5d0a0 2024-04-25T09:08:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe679e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba69d0 0x559673b5b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe682800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673b5d0a0 0x559673b5b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe679e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba69d0 0x559673b5b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58742/0 (socket says 172.21.15.59:58742) 2024-04-25T09:08:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe679e00640 1 -- 172.21.15.59:0/2075840432 learned_addr learned my addr 172.21.15.59:0/2075840432 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe683200640 1 --2- 172.21.15.59:0/2075840432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673ba72f0 0x559673b5be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe679e00640 1 -- 172.21.15.59:0/2075840432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673b5d0a0 msgr2=0x559673b5b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe679e00640 1 --2- 172.21.15.59:0/2075840432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673b5d0a0 0x559673b5b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe679e00640 1 -- 172.21.15.59:0/2075840432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673ba72f0 msgr2=0x559673b5be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe679e00640 1 --2- 172.21.15.59:0/2075840432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673ba72f0 0x559673b5be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe679e00640 1 -- 172.21.15.59:0/2075840432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596739f0de0 con 0x559673ba69d0 2024-04-25T09:08:37.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe679e00640 1 --2- 172.21.15.59:0/2075840432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba69d0 0x559673b5b950 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe66c000f90 tx=0x7fe66c00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74082e2d3a0060eb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe672a00640 1 -- 172.21.15.59:0/2075840432 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c030070 con 0x559673ba69d0 2024-04-25T09:08:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe672a00640 1 -- 172.21.15.59:0/2075840432 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c01a070 con 0x559673ba69d0 2024-04-25T09:08:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe672a00640 1 -- 172.21.15.59:0/2075840432 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c02a6c0 con 0x559673ba69d0 2024-04-25T09:08:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 -- 172.21.15.59:0/2075840432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba69d0 msgr2=0x559673b5b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 --2- 172.21.15.59:0/2075840432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba69d0 0x559673b5b950 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fe66c000f90 tx=0x7fe66c00e000 comp rx=0 tx=0).stop 2024-04-25T09:08:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 -- 172.21.15.59:0/2075840432 shutdown_connections 2024-04-25T09:08:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 --2- 172.21.15.59:0/2075840432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673ba72f0 0x559673b5be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 --2- 172.21.15.59:0/2075840432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba69d0 0x559673b5b950 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 --2- 172.21.15.59:0/2075840432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673b5d0a0 0x559673b5b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 -- 172.21.15.59:0/2075840432 >> 172.21.15.59:0/2075840432 conn(0x559673b59020 msgr2=0x559673bb3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 -- 172.21.15.59:0/2075840432 shutdown_connections 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 -- 172.21.15.59:0/2075840432 wait complete. 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 -- start start 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 Processor -- start 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 0x559673c06720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 0x559673c06c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 0x559673bb8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x559673944e00 con 0x559673ba72f0 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe684202020 con 0x559673b5d0a0 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596739a9300 con 0x559673ba69d0 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe68c961000 10 client.0 _ll_register_callbacks cb 0x559673b28040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe683200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 0x559673bb8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe682800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 0x559673c06720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe682800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 0x559673c06720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:59528/0 (socket says 172.21.15.59:59528) 2024-04-25T09:08:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe682800640 1 -- 172.21.15.59:0/3579473434 learned_addr learned my addr 172.21.15.59:0/3579473434 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe683200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 0x559673bb8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58744/0 (socket says 172.21.15.59:58744) 2024-04-25T09:08:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.068+0000 7fe679e00640 1 --2- 172.21.15.59:0/3579473434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 0x559673c06c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe682800640 1 -- 172.21.15.59:0/3579473434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 msgr2=0x559673c06c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe682800640 1 --2- 172.21.15.59:0/3579473434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 0x559673c06c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe682800640 1 -- 172.21.15.59:0/3579473434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 msgr2=0x559673bb8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe682800640 1 --2- 172.21.15.59:0/3579473434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 0x559673bb8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe682800640 1 -- 172.21.15.59:0/3579473434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55967394b8e0 con 0x559673b5d0a0 2024-04-25T09:08:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe682800640 1 --2- 172.21.15.59:0/3579473434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 0x559673c06720 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe6740b2040 tx=0x7fe6740b7000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9ec07ec864c225b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe667e00640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-04-25T09:08:37.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe667e00640 1 -- 172.21.15.59:0/3579473434 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6740b4050 con 0x559673b5d0a0 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe667e00640 1 -- 172.21.15.59:0/3579473434 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fe674003620 con 0x559673b5d0a0 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 -- 172.21.15.59:0/3579473434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe66c01a070 con 0x559673b5d0a0 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe667e00640 1 -- 172.21.15.59:0/3579473434 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe674003820 con 0x559673b5d0a0 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 10 client.7390 fetch_fsmap learned FSMap version 72 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 -- 172.21.15.59:0/3579473434 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x559673a038f0 con 0x559673b5d0a0 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe667e00640 1 -- 172.21.15.59:0/3579473434 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c01a070 con 0x559673b5d0a0 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe667e00640 1 -- 172.21.15.59:0/3579473434 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe6740d4040 con 0x559673b5d0a0 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 10 client.7390 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 10 client.7390 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 20 client.7390 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 --2- 172.21.15.59:0/3579473434 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x559673bb96b0 0x559673bb9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 4 client.7390 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:08:37.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 -- 172.21.15.59:0/3579473434 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5596739b7530 con 0x559673bb96b0 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe679e00640 1 --2- 172.21.15.59:0/3579473434 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x559673bb96b0 0x559673bb9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe679e00640 1 --2- 172.21.15.59:0/3579473434 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x559673bb96b0 0x559673bb9ac0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c40f64bc8d22fbb server_cookie=b8cf70e192bcd071 in_seq=0 out_seq=0 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe667e00640 10 client.7390 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe667e00640 1 -- 172.21.15.59:0/3579473434 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5596739b7530 con 0x559673bb96b0 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe667e00640 10 client.7390 handle_command_reply: tid=0 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 client.7390 shutdown 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 -- 172.21.15.59:0/3579473434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 msgr2=0x559673c06720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 --2- 172.21.15.59:0/3579473434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 0x559673c06720 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe6740b2040 tx=0x7fe6740b7000 comp rx=0 tx=0).stop 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 -- 172.21.15.59:0/3579473434 shutdown_connections 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 --2- 172.21.15.59:0/3579473434 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x559673bb96b0 0x559673bb9ac0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 --2- 172.21.15.59:0/3579473434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x559673ba72f0 0x559673bb8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 --2- 172.21.15.59:0/3579473434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x559673ba69d0 0x559673c06c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 --2- 172.21.15.59:0/3579473434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x559673b5d0a0 0x559673c06720 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe667e00640 0 client.7390 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 -- 172.21.15.59:0/3579473434 >> 172.21.15.59:0/3579473434 conn(0x559673b59020 msgr2=0x559673bb3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 -- 172.21.15.59:0/3579473434 shutdown_connections 2024-04-25T09:08:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 1 -- 172.21.15.59:0/3579473434 wait complete. 2024-04-25T09:08:37.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe68c961000 20 client.7390 trim_cache size 0 max 16384 2024-04-25T09:08:37.066 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:08:37.066 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-04-25T09:08:37.066 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2024-04-25T09:08:37.066 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:08:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe689400640 1 -- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe660066f60 msgr2=0x7fe660069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe689400640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe660066f60 0x7fe660069420 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe6740b1000 tx=0x7fe6740a9070 comp rx=0 tx=0).stop 2024-04-25T09:08:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe689400640 1 -- 172.21.15.59:0/1435552338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68415ee60 msgr2=0x7fe68413e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe689400640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68415ee60 0x7fe68413e560 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00c340 tx=0x7fe67c00c800 comp rx=0 tx=0).stop 2024-04-25T09:08:37.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe689400640 1 -- 172.21.15.59:0/1435552338 shutdown_connections 2024-04-25T09:08:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe689400640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe660066f60 0x7fe660069420 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe689400640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe68415ee60 0x7fe68413e560 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe689400640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe684144120 0x7fe6841637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe689400640 1 --2- 172.21.15.59:0/1435552338 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe6840ccbf0 0x7fe68415a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe689400640 1 -- 172.21.15.59:0/1435552338 >> 172.21.15.59:0/1435552338 conn(0x7fe684067080 msgr2=0x7fe68413b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.072+0000 7fe689400640 1 -- 172.21.15.59:0/1435552338 shutdown_connections 2024-04-25T09:08:37.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.076+0000 7fe689400640 1 -- 172.21.15.59:0/1435552338 wait complete. 2024-04-25T09:08:37.082 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:08:37.082 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:08:37.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.232+0000 7fab20e00640 1 Processor -- start 2024-04-25T09:08:37.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.232+0000 7fab20e00640 1 -- start start 2024-04-25T09:08:37.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab20e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab1c144140 0x7fab1c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab20e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fab1c0ced60 0x7fab1c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab20e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab1c15ac60 con 0x7fab1c06e900 2024-04-25T09:08:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab20e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c06ed30 con 0x7fab1c144140 2024-04-25T09:08:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab20e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab1c0cf3e0 con 0x7fab1c0ced60 2024-04-25T09:08:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab19e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab1c144140 0x7fab1c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab19e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab1c144140 0x7fab1c0ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58754/0 (socket says 172.21.15.59:58754) 2024-04-25T09:08:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab19e00640 1 -- 172.21.15.59:0/2549355957 learned_addr learned my addr 172.21.15.59:0/2549355957 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab19e00640 1 -- 172.21.15.59:0/2549355957 >> v2:172.21.15.178:3300/0 conn(0x7fab1c0ced60 msgr2=0x7fab1c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab19e00640 1 --2- 172.21.15.59:0/2549355957 >> v2:172.21.15.178:3300/0 conn(0x7fab1c0ced60 0x7fab1c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab19e00640 1 -- 172.21.15.59:0/2549355957 >> v1:172.21.15.178:6789/0 conn(0x7fab1c06e900 legacy=0x7fab1c15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab19e00640 1 -- 172.21.15.59:0/2549355957 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c15af20 con 0x7fab1c144140 2024-04-25T09:08:37.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.236+0000 7fab19e00640 1 --2- 172.21.15.59:0/2549355957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1c144140 0x7fab1c0ce820 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fab1c06efb0 tx=0x7fab0c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08da27f231b4bb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab19400640 1 -- 172.21.15.59:0/2549355957 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c0b0070 con 0x7fab1c144140 2024-04-25T09:08:37.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab19400640 1 -- 172.21.15.59:0/2549355957 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0c0ab600 con 0x7fab1c144140 2024-04-25T09:08:37.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab19400640 1 -- 172.21.15.59:0/2549355957 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0c0ab9d0 con 0x7fab1c144140 2024-04-25T09:08:37.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 -- 172.21.15.59:0/2549355957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1c144140 msgr2=0x7fab1c0ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 --2- 172.21.15.59:0/2549355957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1c144140 0x7fab1c0ce820 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fab1c06efb0 tx=0x7fab0c01c4e0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 -- 172.21.15.59:0/2549355957 shutdown_connections 2024-04-25T09:08:37.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 --2- 172.21.15.59:0/2549355957 >> v2:172.21.15.178:3300/0 conn(0x7fab1c0ced60 0x7fab1c06e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 --2- 172.21.15.59:0/2549355957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1c144140 0x7fab1c0ce820 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 -- 172.21.15.59:0/2549355957 >> 172.21.15.59:0/2549355957 conn(0x7fab1c066fa0 msgr2=0x7fab1c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 -- 172.21.15.59:0/2549355957 shutdown_connections 2024-04-25T09:08:37.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 -- 172.21.15.59:0/2549355957 wait complete. 2024-04-25T09:08:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 Processor -- start 2024-04-25T09:08:37.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 -- start start 2024-04-25T09:08:37.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab1c06e900 0x7fab1c134f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1c0ced60 0x7fab1c1f68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab1c144140 0x7fab1c06d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c15ba00 con 0x7fab1c0ced60 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c144520 con 0x7fab1c144140 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab20e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1c15bb80 con 0x7fab1c06e900 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab13e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1c0ced60 0x7fab1c1f68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab13e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1c0ced60 0x7fab1c1f68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58762/0 (socket says 172.21.15.59:58762) 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.240+0000 7fab13e00640 1 -- 172.21.15.59:0/2076946820 learned_addr learned my addr 172.21.15.59:0/2076946820 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab19e00640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab1c06e900 0x7fab1c134f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab1a800640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab1c144140 0x7fab1c06d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab13e00640 1 -- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab1c06e900 msgr2=0x7fab1c134f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab13e00640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab1c06e900 0x7fab1c134f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab13e00640 1 -- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab1c144140 msgr2=0x7fab1c06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab13e00640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab1c144140 0x7fab1c06d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab13e00640 1 -- 172.21.15.59:0/2076946820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab1c15f500 con 0x7fab1c0ced60 2024-04-25T09:08:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab1a800640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab1c144140 0x7fab1c06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab13e00640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1c0ced60 0x7fab1c1f68e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fab0400b580 tx=0x7fab0400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab12000640 1 -- 172.21.15.59:0/2076946820 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab04014070 con 0x7fab1c0ced60 2024-04-25T09:08:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab12000640 1 -- 172.21.15.59:0/2076946820 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab04010890 con 0x7fab1c0ced60 2024-04-25T09:08:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab12000640 1 -- 172.21.15.59:0/2076946820 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab04010c80 con 0x7fab1c0ced60 2024-04-25T09:08:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab20e00640 1 -- 172.21.15.59:0/2076946820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab1c15f7e0 con 0x7fab1c0ced60 2024-04-25T09:08:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab20e00640 1 -- 172.21.15.59:0/2076946820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab1c15fda0 con 0x7fab1c0ced60 2024-04-25T09:08:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab20e00640 1 -- 172.21.15.59:0/2076946820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1c0745d0 con 0x7fab1c0ced60 2024-04-25T09:08:37.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab12000640 1 -- 172.21.15.59:0/2076946820 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fab04017070 con 0x7fab1c0ced60 2024-04-25T09:08:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab12000640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faaf8066fb0 0x7faaf8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.244+0000 7fab12000640 1 -- 172.21.15.59:0/2076946820 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fab04084fb0 con 0x7fab1c0ced60 2024-04-25T09:08:37.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.248+0000 7fab19e00640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faaf8066fb0 0x7faaf8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.248+0000 7fab19e00640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faaf8066fb0 0x7faaf8069470 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0ad000 tx=0x7fab0c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.252+0000 7fab12000640 1 -- 172.21.15.59:0/2076946820 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fab04055710 con 0x7fab1c0ced60 2024-04-25T09:08:37.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.444+0000 7fab20e00640 1 -- 172.21.15.59:0/2076946820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab1c0b1550 con 0x7fab1c0ced60 2024-04-25T09:08:37.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.444+0000 7fab12000640 1 -- 172.21.15.59:0/2076946820 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fab04010e20 con 0x7fab1c0ced60 2024-04-25T09:08:37.434 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:08:37.434 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:08:10.759050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7668},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7668":{"gid":7668,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":6,"addr":"172.21.15.59:6835/4079513876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":4079513876},{"type":"v1","addr":"172.21.15.59:6835","nonce":4079513876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:08:37.434 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 72 2024-04-25T09:08:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.448+0000 7fab20e00640 1 -- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faaf8066fb0 msgr2=0x7faaf8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.448+0000 7fab20e00640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faaf8066fb0 0x7faaf8069470 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0ad000 tx=0x7fab0c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:08:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.448+0000 7fab20e00640 1 -- 172.21.15.59:0/2076946820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1c0ced60 msgr2=0x7fab1c1f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.448+0000 7fab20e00640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1c0ced60 0x7fab1c1f68e0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fab0400b580 tx=0x7fab0400ba40 comp rx=0 tx=0).stop 2024-04-25T09:08:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.448+0000 7fab20e00640 1 -- 172.21.15.59:0/2076946820 shutdown_connections 2024-04-25T09:08:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.448+0000 7fab20e00640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faaf8066fb0 0x7faaf8069470 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.448+0000 7fab20e00640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab1c144140 0x7fab1c06d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.448+0000 7fab20e00640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab1c0ced60 0x7fab1c1f68e0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.448+0000 7fab20e00640 1 --2- 172.21.15.59:0/2076946820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab1c06e900 0x7fab1c134f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.448+0000 7fab20e00640 1 -- 172.21.15.59:0/2076946820 >> 172.21.15.59:0/2076946820 conn(0x7fab1c066fa0 msgr2=0x7fab1c15d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.448+0000 7fab20e00640 1 -- 172.21.15.59:0/2076946820 shutdown_connections 2024-04-25T09:08:37.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.448+0000 7fab20e00640 1 -- 172.21.15.59:0/2076946820 wait complete. 2024-04-25T09:08:37.455 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T09:08:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.612+0000 7fa300000640 1 Processor -- start 2024-04-25T09:08:37.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.612+0000 7fa300000640 1 -- start start 2024-04-25T09:08:37.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa300000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa2f80cf3c0 0x7fa2f80cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa300000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80cd370 0x7fa2f8099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa300000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f80d02a0 con 0x7fa2f815b910 2024-04-25T09:08:37.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa300000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f80cc350 con 0x7fa2f80cf3c0 2024-04-25T09:08:37.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa300000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80cc630 con 0x7fa2f80cd370 2024-04-25T09:08:37.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fd600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa2f815b910 0x7fa2f80cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36354/0 (socket says 172.21.15.59:36354) 2024-04-25T09:08:37.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fd600640 1 -- 172.21.15.59:0/3605933553 learned_addr learned my addr 172.21.15.59:0/3605933553 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:08:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fe000640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80cd370 0x7fa2f8099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/3605933553 >> v2:172.21.15.178:3300/0 conn(0x7fa2f80cf3c0 0x7fa2f80cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240431483 0 0) 0x7fa2f80d02a0 con 0x7fa2f815b910 2024-04-25T09:08:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e0003530 con 0x7fa2f815b910 2024-04-25T09:08:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2663954422 0 0) 0x7fa2e0003530 con 0x7fa2f815b910 2024-04-25T09:08:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80cd370 msgr2=0x7fa2f8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80cd370 0x7fa2f8099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 >> v2:172.21.15.178:3300/0 conn(0x7fa2f80cf3c0 msgr2=0x7fa2f80cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 --2- 172.21.15.59:0/3605933553 >> v2:172.21.15.178:3300/0 conn(0x7fa2f80cf3c0 0x7fa2f80cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f80cc910 con 0x7fa2f815b910 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fa2ec0016a0 con 0x7fa2f815b910 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 >> v1:172.21.15.59:6789/0 conn(0x7fa2f815b910 legacy=0x7fa2f80cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fe000640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80cd370 0x7fa2f8099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2e00039c0 0x7fa2e0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e00043b0 0x7fa2e0004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2e0004f00 0x7fa2e000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80cc350 con 0x7fa2e00043b0 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f80cc630 con 0x7fa2e0004f00 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e000bf10 con 0x7fa2e00039c0 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e00043b0 0x7fa2e0004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fd600640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2e00039c0 0x7fa2e0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fe000640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2e0004f00 0x7fa2e000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fcc00640 1 -- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2e00039c0 msgr2=0x7fa2e0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2e00039c0 0x7fa2e0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fcc00640 1 -- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2e0004f00 msgr2=0x7fa2e000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2e0004f00 0x7fa2e000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fcc00640 1 -- 172.21.15.59:0/3605933553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e0003530 con 0x7fa2e00043b0 2024-04-25T09:08:37.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.616+0000 7fa2fe000640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2e0004f00 0x7fa2e000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:37.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.620+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e00043b0 0x7fa2e0004890 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009ab0 tx=0x7fa2e401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6846ca405e32268 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.620+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40b2070 con 0x7fa2e00043b0 2024-04-25T09:08:37.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.620+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e40a5680 con 0x7fa2e00043b0 2024-04-25T09:08:37.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.620+0000 7fa2f7e00640 1 -- 172.21.15.59:0/3605933553 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40096b0 con 0x7fa2e00043b0 2024-04-25T09:08:37.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.620+0000 7fa300000640 1 -- 172.21.15.59:0/3605933553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e00043b0 msgr2=0x7fa2e0004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.620+0000 7fa300000640 1 --2- 172.21.15.59:0/3605933553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e00043b0 0x7fa2e0004890 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009ab0 tx=0x7fa2e401ca90 comp rx=0 tx=0).stop 2024-04-25T09:08:37.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.620+0000 7fa2fe000640 1 -- 172.21.15.59:0/3605933553 reap_dead start 2024-04-25T09:08:37.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.620+0000 7fa300000640 1 -- 172.21.15.59:0/3605933553 shutdown_connections 2024-04-25T09:08:37.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.620+0000 7fa300000640 1 -- 172.21.15.59:0/3605933553 >> 172.21.15.59:0/3605933553 conn(0x7fa2f80b3200 msgr2=0x7fa2f80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.620+0000 7fa300000640 1 -- 172.21.15.59:0/3605933553 shutdown_connections 2024-04-25T09:08:37.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.620+0000 7fa300000640 1 -- 172.21.15.59:0/3605933553 wait complete. 2024-04-25T09:08:37.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.620+0000 7fa300000640 1 Processor -- start 2024-04-25T09:08:37.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa300000640 1 -- start start 2024-04-25T09:08:37.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa300000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e00043b0 0x7fa2f80cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa300000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80b6510 0x7fa2f8158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa300000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f80c6290 0x7fa2f80c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa300000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f815be70 con 0x7fa2e00043b0 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa300000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f815bcf0 con 0x7fa2f80c6290 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa300000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f8099a60 con 0x7fa2f80b6510 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2fd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e00043b0 0x7fa2f80cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2fd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e00043b0 0x7fa2f80cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58776/0 (socket says 172.21.15.59:58776) 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2fd600640 1 -- 172.21.15.59:0/3949670546 learned_addr learned my addr 172.21.15.59:0/3949670546 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2fe000640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f80c6290 0x7fa2f80c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80b6510 0x7fa2f8158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2fd600640 1 -- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80b6510 msgr2=0x7fa2f8158b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2fd600640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80b6510 0x7fa2f8158b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2fd600640 1 -- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f80c6290 msgr2=0x7fa2f80c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2fd600640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f80c6290 0x7fa2f80c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2fd600640 1 -- 172.21.15.59:0/3949670546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f80b6990 con 0x7fa2e00043b0 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2fe000640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f80c6290 0x7fa2f80c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:37.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2fd600640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e00043b0 0x7fa2f80cb620 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec005840 tx=0x7fa2ec005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2f5600640 1 -- 172.21.15.59:0/3949670546 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec01c070 con 0x7fa2e00043b0 2024-04-25T09:08:37.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2f5600640 1 -- 172.21.15.59:0/3949670546 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec014770 con 0x7fa2e00043b0 2024-04-25T09:08:37.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa300000640 1 -- 172.21.15.59:0/3949670546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f80b6c20 con 0x7fa2e00043b0 2024-04-25T09:08:37.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa2f5600640 1 -- 172.21.15.59:0/3949670546 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec014b60 con 0x7fa2e00043b0 2024-04-25T09:08:37.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.624+0000 7fa300000640 1 -- 172.21.15.59:0/3949670546 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f815c090 con 0x7fa2e00043b0 2024-04-25T09:08:37.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2f5600640 1 -- 172.21.15.59:0/3949670546 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa2ec01f070 con 0x7fa2e00043b0 2024-04-25T09:08:37.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2f5600640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa2d8066f90 0x7fa2d8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2f5600640 1 -- 172.21.15.59:0/3949670546 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fa2ec087ad0 con 0x7fa2e00043b0 2024-04-25T09:08:37.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa3034f7000 1 Processor -- start 2024-04-25T09:08:37.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa2d8066f90 0x7fa2d8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa3034f7000 1 -- start start 2024-04-25T09:08:37.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa2d8066f90 0x7fa2d8069450 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40af000 tx=0x7fa2e4004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa3034f7000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fb2e0 0x55d1548fb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa3034f7000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548fbc00 0x55d1548b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa3034f7000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548b18e0 0x55d1548b1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa3034f7000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d154798ba0 con 0x55d1548fbc00 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa3034f7000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1546fe090 con 0x55d1548b18e0 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa3034f7000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d154686160 con 0x55d1548fb2e0 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548fbc00 0x55d1548b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fd600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fb2e0 0x55d1548fb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548fbc00 0x55d1548b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58778/0 (socket says 172.21.15.59:58778) 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fcc00640 1 -- 172.21.15.59:0/2368144188 learned_addr learned my addr 172.21.15.59:0/2368144188 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fe000640 1 --2- 172.21.15.59:0/2368144188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548b18e0 0x55d1548b1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fcc00640 1 -- 172.21.15.59:0/2368144188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fb2e0 msgr2=0x55d1548fb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/2368144188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fb2e0 0x55d1548fb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fcc00640 1 -- 172.21.15.59:0/2368144188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548b18e0 msgr2=0x55d1548b1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/2368144188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548b18e0 0x55d1548b1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fcc00640 1 -- 172.21.15.59:0/2368144188 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1547a7c20 con 0x55d1548fbc00 2024-04-25T09:08:37.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fe000640 1 --2- 172.21.15.59:0/2368144188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548b18e0 0x55d1548b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:37.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.628+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/2368144188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548fbc00 0x55d1548b13a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009ab0 tx=0x7fa2e401b2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f5624ac23b1ec1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2ea000640 1 -- 172.21.15.59:0/2368144188 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40b2040 con 0x55d1548fbc00 2024-04-25T09:08:37.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2ea000640 1 -- 172.21.15.59:0/2368144188 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e40a5c10 con 0x55d1548fbc00 2024-04-25T09:08:37.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2ea000640 1 -- 172.21.15.59:0/2368144188 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40b9460 con 0x55d1548fbc00 2024-04-25T09:08:37.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 -- 172.21.15.59:0/2368144188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548fbc00 msgr2=0x55d1548b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 --2- 172.21.15.59:0/2368144188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548fbc00 0x55d1548b13a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009ab0 tx=0x7fa2e401b2d0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 -- 172.21.15.59:0/2368144188 shutdown_connections 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 --2- 172.21.15.59:0/2368144188 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548b18e0 0x55d1548b1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 --2- 172.21.15.59:0/2368144188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548fbc00 0x55d1548b13a0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 --2- 172.21.15.59:0/2368144188 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fb2e0 0x55d1548fb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 -- 172.21.15.59:0/2368144188 >> 172.21.15.59:0/2368144188 conn(0x55d1548ad890 msgr2=0x55d1548afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 -- 172.21.15.59:0/2368144188 shutdown_connections 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 -- 172.21.15.59:0/2368144188 wait complete. 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 -- start start 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 Processor -- start 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d154902640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d154902b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 0x55d1548e9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1546fa130 con 0x55d1548b18e0 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1546c2130 con 0x55d1548fb2e0 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1547bc300 con 0x55d1548fbc00 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 10 client.0 _ll_register_callbacks cb 0x55d15489cbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2fd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d154902640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2fd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d154902640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58792/0 (socket says 172.21.15.59:58792) 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2fd600640 1 -- 172.21.15.59:0/4056163005 learned_addr learned my addr 172.21.15.59:0/4056163005 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d154902b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2fe000640 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 0x55d1548e9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2fd600640 1 -- 172.21.15.59:0/4056163005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 msgr2=0x55d1548e9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2fd600640 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 0x55d1548e9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2fd600640 1 -- 172.21.15.59:0/4056163005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 msgr2=0x55d154902b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2fd600640 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d154902b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2fd600640 1 -- 172.21.15.59:0/4056163005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1546db060 con 0x55d1548b18e0 2024-04-25T09:08:37.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2fd600640 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d154902640 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0581c0 tx=0x7fa2ec05c200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b334959fb5e9c58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2dea00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2dea00640 1 -- 172.21.15.59:0/4056163005 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec084060 con 0x55d1548b18e0 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2dea00640 1 -- 172.21.15.59:0/4056163005 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fa2ec057680 con 0x55d1548b18e0 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 -- 172.21.15.59:0/4056163005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2e40a5c10 con 0x55d1548b18e0 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa2dea00640 1 -- 172.21.15.59:0/4056163005 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2ec074050 con 0x55d1548b18e0 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 10 client.7809 fetch_fsmap learned FSMap version 72 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.632+0000 7fa3034f7000 1 -- 172.21.15.59:0/4056163005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55d15469f7c0 con 0x55d1548b18e0 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa2dea00640 1 -- 172.21.15.59:0/4056163005 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e40a5c10 con 0x55d1548b18e0 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa2dea00640 1 -- 172.21.15.59:0/4056163005 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa2ec05e260 con 0x55d1548b18e0 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 10 client.7809 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 10 client.7809 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 20 client.7809 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d1548e9e30 0x55d1548ea210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 4 client.7809 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:37.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 -- 172.21.15.59:0/4056163005 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d154699cd0 con 0x55d1548e9e30 2024-04-25T09:08:37.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d1548e9e30 0x55d1548ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d1548e9e30 0x55d1548ea210 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d11cb9a8a5524b31 server_cookie=17642b598523ae04 in_seq=0 out_seq=0 2024-04-25T09:08:37.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa2dea00640 10 client.7809 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa2dea00640 1 -- 172.21.15.59:0/4056163005 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d154699cd0 con 0x55d1548e9e30 2024-04-25T09:08:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa2dea00640 10 client.7809 handle_command_reply: tid=0 2024-04-25T09:08:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 client.7809 shutdown 2024-04-25T09:08:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 -- 172.21.15.59:0/4056163005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 msgr2=0x55d154902640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d154902640 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0581c0 tx=0x7fa2ec05c200 comp rx=0 tx=0).stop 2024-04-25T09:08:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 -- 172.21.15.59:0/4056163005 shutdown_connections 2024-04-25T09:08:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d1548e9e30 0x55d1548ea210 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 0x55d1548e9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d154902b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 --2- 172.21.15.59:0/4056163005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d154902640 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa2dea00640 0 client.7809 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:37.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 -- 172.21.15.59:0/4056163005 >> 172.21.15.59:0/4056163005 conn(0x55d1548ad890 msgr2=0x55d1548b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 -- 172.21.15.59:0/4056163005 shutdown_connections 2024-04-25T09:08:37.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 1 -- 172.21.15.59:0/4056163005 wait complete. 2024-04-25T09:08:37.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.636+0000 7fa3034f7000 20 client.7809 trim_cache size 0 max 16384 2024-04-25T09:08:37.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.648+0000 7fa3034f7000 1 Processor -- start 2024-04-25T09:08:37.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.648+0000 7fa3034f7000 1 -- start start 2024-04-25T09:08:37.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.648+0000 7fa3034f7000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d1548b12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.648+0000 7fa3034f7000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d1548e81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.648+0000 7fa3034f7000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 0x55d1548e8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.648+0000 7fa3034f7000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f81fbbe0 con 0x55d1548b18e0 2024-04-25T09:08:37.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.648+0000 7fa3034f7000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f81fafc0 con 0x55d1548fb2e0 2024-04-25T09:08:37.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.648+0000 7fa3034f7000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f81fb5c0 con 0x55d1548fbc00 2024-04-25T09:08:37.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.648+0000 7fa2fd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d1548b12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.648+0000 7fa2fd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d1548b12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58806/0 (socket says 172.21.15.59:58806) 2024-04-25T09:08:37.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.648+0000 7fa2fd600640 1 -- 172.21.15.59:0/2103163708 learned_addr learned my addr 172.21.15.59:0/2103163708 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 -- 172.21.15.59:0/2103163708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 msgr2=0x55d1548e8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 --2- 172.21.15.59:0/2103163708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 0x55d1548e8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 -- 172.21.15.59:0/2103163708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 msgr2=0x55d1548e81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/2103163708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d1548e81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 --2- 172.21.15.59:0/2103163708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d1548e81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 -- 172.21.15.59:0/2103163708 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d1546b9fc0 con 0x55d1548b18e0 2024-04-25T09:08:37.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/2103163708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d1548e81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:08:37.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 --2- 172.21.15.59:0/2103163708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d1548b12c0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec056760 tx=0x7fa2ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d369c6b23d4fbaa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2e9600640 1 -- 172.21.15.59:0/2103163708 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec087040 con 0x55d1548b18e0 2024-04-25T09:08:37.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2e9600640 1 -- 172.21.15.59:0/2103163708 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec05c0c0 con 0x55d1548b18e0 2024-04-25T09:08:37.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2e9600640 1 -- 172.21.15.59:0/2103163708 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec057680 con 0x55d1548b18e0 2024-04-25T09:08:37.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 -- 172.21.15.59:0/2103163708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 msgr2=0x55d1548b12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 --2- 172.21.15.59:0/2103163708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d1548b12c0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec056760 tx=0x7fa2ec019000 comp rx=0 tx=0).stop 2024-04-25T09:08:37.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 -- 172.21.15.59:0/2103163708 shutdown_connections 2024-04-25T09:08:37.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 --2- 172.21.15.59:0/2103163708 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 0x55d1548e8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 --2- 172.21.15.59:0/2103163708 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d1548e81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 --2- 172.21.15.59:0/2103163708 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d1548b12c0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 -- 172.21.15.59:0/2103163708 >> 172.21.15.59:0/2103163708 conn(0x55d1548ad890 msgr2=0x55d154908d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 -- 172.21.15.59:0/2103163708 shutdown_connections 2024-04-25T09:08:37.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 -- 172.21.15.59:0/2103163708 wait complete. 2024-04-25T09:08:37.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 -- start start 2024-04-25T09:08:37.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 Processor -- start 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d15495ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d15495b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 0x55d1548ff040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d154698e70 con 0x55d1548b18e0 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d154686a50 con 0x55d1548fb2e0 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d1546fd3a0 con 0x55d1548fbc00 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa3034f7000 10 client.0 _ll_register_callbacks cb 0x55d1546aa240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d15495ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d15495ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58820/0 (socket says 172.21.15.59:58820) 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 -- 172.21.15.59:0/18574458 learned_addr learned my addr 172.21.15.59:0/18574458 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d15495b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fe000640 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 0x55d1548ff040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 -- 172.21.15.59:0/18574458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 msgr2=0x55d1548ff040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 0x55d1548ff040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 -- 172.21.15.59:0/18574458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 msgr2=0x55d15495b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d15495b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 -- 172.21.15.59:0/18574458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d1547579e0 con 0x55d1548b18e0 2024-04-25T09:08:37.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2fd600640 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d15495ad40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0581c0 tx=0x7fa2ec085c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d0d32a726c77fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.652+0000 7fa2dea00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:37.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa2dea00640 1 -- 172.21.15.59:0/18574458 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec057880 con 0x55d1548b18e0 2024-04-25T09:08:37.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa2dea00640 1 -- 172.21.15.59:0/18574458 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fa2ec060ae0 con 0x55d1548b18e0 2024-04-25T09:08:37.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 -- 172.21.15.59:0/18574458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2ec05c0c0 con 0x55d1548b18e0 2024-04-25T09:08:37.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa2dea00640 1 -- 172.21.15.59:0/18574458 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2ec060d00 con 0x55d1548b18e0 2024-04-25T09:08:37.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 10 client.7815 fetch_fsmap learned FSMap version 72 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 -- 172.21.15.59:0/18574458 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x55d15469d630 con 0x55d1548b18e0 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa2dea00640 1 -- 172.21.15.59:0/18574458 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec05c0c0 con 0x55d1548b18e0 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa2dea00640 1 -- 172.21.15.59:0/18574458 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa2ec053f80 con 0x55d1548b18e0 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 10 client.7815 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 10 client.7815 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 20 client.7815 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d1548ffa00 0x55d1548ffde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 4 client.7815 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 -- 172.21.15.59:0/18574458 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55d15470b5d0 con 0x55d1548ffa00 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d1548ffa00 0x55d1548ffde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa2fcc00640 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d1548ffa00 0x55d1548ffde0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=166949eddb448170 server_cookie=700be8967b77fa2e in_seq=0 out_seq=0 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa2dea00640 10 client.7815 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa2dea00640 1 -- 172.21.15.59:0/18574458 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+419 (crc 0 0 0) 0x55d15470b5d0 con 0x55d1548ffa00 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa2dea00640 10 client.7815 handle_command_reply: tid=0 2024-04-25T09:08:37.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 client.7815 shutdown 2024-04-25T09:08:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 -- 172.21.15.59:0/18574458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 msgr2=0x55d15495ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d15495ad40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0581c0 tx=0x7fa2ec085c70 comp rx=0 tx=0).stop 2024-04-25T09:08:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 -- 172.21.15.59:0/18574458 shutdown_connections 2024-04-25T09:08:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x55d1548ffa00 0x55d1548ffde0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d1548fbc00 0x55d1548ff040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d1548fb2e0 0x55d15495b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 --2- 172.21.15.59:0/18574458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d1548b18e0 0x55d15495ad40 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa2dea00640 0 client.7815 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 -- 172.21.15.59:0/18574458 >> 172.21.15.59:0/18574458 conn(0x55d1548ad890 msgr2=0x55d154908d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 -- 172.21.15.59:0/18574458 shutdown_connections 2024-04-25T09:08:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 1 -- 172.21.15.59:0/18574458 wait complete. 2024-04-25T09:08:37.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa3034f7000 20 client.7815 trim_cache size 0 max 16384 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "damage_type": "dir_frag", 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 738337953, 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 1099511627776, 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "frag": "*", 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/dir" 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "damage_type": "backtrace", 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2160775777, 2024-04-25T09:08:37.651 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 1099511627776, 2024-04-25T09:08:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/dir" 2024-04-25T09:08:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:08:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:08:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "damage_type": "backtrace", 2024-04-25T09:08:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2944867564, 2024-04-25T09:08:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 1099511627777, 2024-04-25T09:08:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/testdir/hardlink" 2024-04-25T09:08:37.652 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:08:37.652 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T09:08:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa300000640 1 -- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa2d8066f90 msgr2=0x7fa2d8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa300000640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa2d8066f90 0x7fa2d8069450 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40af000 tx=0x7fa2e4004740 comp rx=0 tx=0).stop 2024-04-25T09:08:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa300000640 1 -- 172.21.15.59:0/3949670546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e00043b0 msgr2=0x7fa2f80cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa300000640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e00043b0 0x7fa2f80cb620 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec005840 tx=0x7fa2ec005870 comp rx=0 tx=0).stop 2024-04-25T09:08:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa300000640 1 -- 172.21.15.59:0/3949670546 shutdown_connections 2024-04-25T09:08:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa300000640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa2d8066f90 0x7fa2d8069450 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa300000640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa2f80c6290 0x7fa2f80c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa300000640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa2f80b6510 0x7fa2f8158b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa300000640 1 --2- 172.21.15.59:0/3949670546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2e00043b0 0x7fa2f80cb620 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa300000640 1 -- 172.21.15.59:0/3949670546 >> 172.21.15.59:0/3949670546 conn(0x7fa2f80b3200 msgr2=0x7fa2f809a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa300000640 1 -- 172.21.15.59:0/3949670546 shutdown_connections 2024-04-25T09:08:37.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.656+0000 7fa300000640 1 -- 172.21.15.59:0/3949670546 wait complete. 2024-04-25T09:08:37.664 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:08:37.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.816+0000 7f4c48400640 1 Processor -- start 2024-04-25T09:08:37.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.816+0000 7f4c48400640 1 -- start start 2024-04-25T09:08:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.816+0000 7f4c48400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4c4015dad0 0x7f4c401621e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.816+0000 7f4c48400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c4015deb0 0x7f4c400d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.816+0000 7f4c48400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c400ce810 con 0x7f4c400ce250 2024-04-25T09:08:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.816+0000 7f4c48400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c400d1be0 con 0x7f4c4015deb0 2024-04-25T09:08:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.816+0000 7f4c48400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c40162720 con 0x7f4c4015dad0 2024-04-25T09:08:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.816+0000 7f4c45000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c4015deb0 0x7f4c400d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.816+0000 7f4c45000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c4015deb0 0x7f4c400d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58824/0 (socket says 172.21.15.59:58824) 2024-04-25T09:08:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.816+0000 7f4c45000640 1 -- 172.21.15.59:0/2851222473 learned_addr learned my addr 172.21.15.59:0/2851222473 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.816+0000 7f4c45a00640 1 --2- 172.21.15.59:0/2851222473 >> v2:172.21.15.178:3300/0 conn(0x7f4c4015dad0 0x7f4c401621e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c45000640 1 -- 172.21.15.59:0/2851222473 >> v2:172.21.15.178:3300/0 conn(0x7f4c4015dad0 msgr2=0x7f4c401621e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c45000640 1 --2- 172.21.15.59:0/2851222473 >> v2:172.21.15.178:3300/0 conn(0x7f4c4015dad0 0x7f4c401621e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c45000640 1 -- 172.21.15.59:0/2851222473 >> v1:172.21.15.178:6789/0 conn(0x7f4c400ce250 legacy=0x7f4c4006c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c45000640 1 -- 172.21.15.59:0/2851222473 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c400ceaf0 con 0x7f4c4015deb0 2024-04-25T09:08:37.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c45000640 1 --2- 172.21.15.59:0/2851222473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4015deb0 0x7f4c400d0770 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f4c4008c880 tx=0x7f4c2c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79372e9c46cf5352 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c3fe00640 1 -- 172.21.15.59:0/2851222473 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c0ab600 con 0x7f4c4015deb0 2024-04-25T09:08:37.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c3fe00640 1 -- 172.21.15.59:0/2851222473 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c0b0070 con 0x7f4c4015deb0 2024-04-25T09:08:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c3fe00640 1 -- 172.21.15.59:0/2851222473 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c0ab9c0 con 0x7f4c4015deb0 2024-04-25T09:08:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c48400640 1 -- 172.21.15.59:0/2851222473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4015deb0 msgr2=0x7f4c400d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c48400640 1 --2- 172.21.15.59:0/2851222473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4015deb0 0x7f4c400d0770 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f4c4008c880 tx=0x7f4c2c01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c48400640 1 -- 172.21.15.59:0/2851222473 shutdown_connections 2024-04-25T09:08:37.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c48400640 1 --2- 172.21.15.59:0/2851222473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4015deb0 0x7f4c400d0770 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c48400640 1 --2- 172.21.15.59:0/2851222473 >> v2:172.21.15.178:3300/0 conn(0x7f4c4015dad0 0x7f4c401621e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c48400640 1 -- 172.21.15.59:0/2851222473 >> 172.21.15.59:0/2851222473 conn(0x7f4c400b5900 msgr2=0x7f4c400b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:37.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c48400640 1 -- 172.21.15.59:0/2851222473 shutdown_connections 2024-04-25T09:08:37.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.820+0000 7f4c48400640 1 -- 172.21.15.59:0/2851222473 wait complete. 2024-04-25T09:08:37.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c48400640 1 Processor -- start 2024-04-25T09:08:37.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c48400640 1 -- start start 2024-04-25T09:08:37.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c48400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c400ce250 0x7f4c40159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c48400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c4015dad0 0x7f4c40159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c48400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4015deb0 0x7f4c40157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c48400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4016ad20 con 0x7f4c400ce250 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c48400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c400d10c0 con 0x7f4c4015deb0 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c48400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4016aea0 con 0x7f4c4015dad0 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c45a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c400ce250 0x7f4c40159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c45a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c400ce250 0x7f4c40159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58838/0 (socket says 172.21.15.59:58838) 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c45a00640 1 -- 172.21.15.59:0/582396005 learned_addr learned my addr 172.21.15.59:0/582396005 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c45000640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c4015dad0 0x7f4c40159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c46400640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4015deb0 0x7f4c40157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c45a00640 1 -- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c4015dad0 msgr2=0x7f4c40159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c45a00640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c4015dad0 0x7f4c40159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c45a00640 1 -- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4015deb0 msgr2=0x7f4c40157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c45a00640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4015deb0 0x7f4c40157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c45a00640 1 -- 172.21.15.59:0/582396005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c40157e50 con 0x7f4c400ce250 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c46400640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4015deb0 0x7f4c40157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:37.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c45000640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c4015dad0 0x7f4c40159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c45a00640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c400ce250 0x7f4c40159230 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400e930 tx=0x7f4c3400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c3d600640 1 -- 172.21.15.59:0/582396005 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34017070 con 0x7f4c400ce250 2024-04-25T09:08:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c3d600640 1 -- 172.21.15.59:0/582396005 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3400ca00 con 0x7f4c400ce250 2024-04-25T09:08:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c3d600640 1 -- 172.21.15.59:0/582396005 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3400cdb0 con 0x7f4c400ce250 2024-04-25T09:08:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c48400640 1 -- 172.21.15.59:0/582396005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c40158190 con 0x7f4c400ce250 2024-04-25T09:08:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.824+0000 7f4c48400640 1 -- 172.21.15.59:0/582396005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c40158750 con 0x7f4c400ce250 2024-04-25T09:08:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.828+0000 7f4c48400640 1 -- 172.21.15.59:0/582396005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c400745d0 con 0x7f4c400ce250 2024-04-25T09:08:37.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.828+0000 7f4c3d600640 1 -- 172.21.15.59:0/582396005 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4c3401a070 con 0x7f4c400ce250 2024-04-25T09:08:37.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.828+0000 7f4c3d600640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4c20066f90 0x7f4c20069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:37.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.828+0000 7f4c3d600640 1 -- 172.21.15.59:0/582396005 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f4c34085340 con 0x7f4c400ce250 2024-04-25T09:08:37.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.828+0000 7f4c45000640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4c20066f90 0x7f4c20069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:37.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.828+0000 7f4c45000640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4c20066f90 0x7f4c20069450 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0af000 tx=0x7f4c2c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:37.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:37.832+0000 7f4c3d600640 1 -- 172.21.15.59:0/582396005 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4c34056120 con 0x7f4c400ce250 2024-04-25T09:08:38.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.028+0000 7f4c48400640 1 -- 172.21.15.59:0/582396005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4c400d1700 con 0x7f4c400ce250 2024-04-25T09:08:38.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.028+0000 7f4c3d600640 1 -- 172.21.15.59:0/582396005 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f4c34055a20 con 0x7f4c400ce250 2024-04-25T09:08:38.017 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:08:38.018 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-25T09:08:38.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.032+0000 7f4c48400640 1 -- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4c20066f90 msgr2=0x7f4c20069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.032+0000 7f4c48400640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4c20066f90 0x7f4c20069450 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c0af000 tx=0x7f4c2c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.032+0000 7f4c48400640 1 -- 172.21.15.59:0/582396005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c400ce250 msgr2=0x7f4c40159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.032+0000 7f4c48400640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c400ce250 0x7f4c40159230 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400e930 tx=0x7f4c3400edf0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.032+0000 7f4c48400640 1 -- 172.21.15.59:0/582396005 shutdown_connections 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.032+0000 7f4c48400640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4c20066f90 0x7f4c20069450 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.032+0000 7f4c48400640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4c4015deb0 0x7f4c40157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.032+0000 7f4c48400640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4c4015dad0 0x7f4c40159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.032+0000 7f4c48400640 1 --2- 172.21.15.59:0/582396005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c400ce250 0x7f4c40159230 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.032+0000 7f4c48400640 1 -- 172.21.15.59:0/582396005 >> 172.21.15.59:0/582396005 conn(0x7f4c400b5900 msgr2=0x7f4c400b90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.032+0000 7f4c48400640 1 -- 172.21.15.59:0/582396005 shutdown_connections 2024-04-25T09:08:38.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.032+0000 7f4c48400640 1 -- 172.21.15.59:0/582396005 wait complete. 2024-04-25T09:08:38.038 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:08:38.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:38.038 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-25T09:08:38.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.196+0000 7f7394000640 1 Processor -- start 2024-04-25T09:08:38.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.196+0000 7f7394000640 1 -- start start 2024-04-25T09:08:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.196+0000 7f7394000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f738c15dab0 0x7f738c0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.196+0000 7f7394000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c15de90 con 0x7f738c0b0c00 2024-04-25T09:08:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.196+0000 7f7394000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c071a70 con 0x7f738c0713c0 2024-04-25T09:08:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.196+0000 7f7394000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c0b57a0 con 0x7f738c15dab0 2024-04-25T09:08:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.196+0000 7f7391600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f738c15dab0 0x7f738c0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.196+0000 7f7390c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f738c0b0c00 0x7f738c070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36360/0 (socket says 172.21.15.59:36360) 2024-04-25T09:08:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.196+0000 7f7390c00640 1 -- 172.21.15.59:0/3380127394 learned_addr learned my addr 172.21.15.59:0/3380127394 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:08:38.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.196+0000 7f7391600640 1 -- 172.21.15.59:0/3380127394 >> v1:172.21.15.178:6789/0 conn(0x7f738c0713c0 legacy=0x7f738c06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.196+0000 7f7391600640 1 -- 172.21.15.59:0/3380127394 >> v1:172.21.15.59:6789/0 conn(0x7f738c0b0c00 legacy=0x7f738c070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.196+0000 7f7391600640 1 -- 172.21.15.59:0/3380127394 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c06bec0 con 0x7f738c15dab0 2024-04-25T09:08:38.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.200+0000 7f7391600640 1 --2- 172.21.15.59:0/3380127394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738c15dab0 0x7f738c0b5110 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f73800097c0 tx=0x7f738001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79faa51684f3988 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.200+0000 7f738be00640 1 -- 172.21.15.59:0/3380127394 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800b0070 con 0x7f738c15dab0 2024-04-25T09:08:38.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.200+0000 7f738be00640 1 -- 172.21.15.59:0/3380127394 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73800ab600 con 0x7f738c15dab0 2024-04-25T09:08:38.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.200+0000 7f738be00640 1 -- 172.21.15.59:0/3380127394 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800ab9d0 con 0x7f738c15dab0 2024-04-25T09:08:38.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.200+0000 7f7394000640 1 -- 172.21.15.59:0/3380127394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738c15dab0 msgr2=0x7f738c0b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.200+0000 7f7394000640 1 --2- 172.21.15.59:0/3380127394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738c15dab0 0x7f738c0b5110 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f73800097c0 tx=0x7f738001c430 comp rx=0 tx=0).stop 2024-04-25T09:08:38.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.200+0000 7f7394000640 1 -- 172.21.15.59:0/3380127394 shutdown_connections 2024-04-25T09:08:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.200+0000 7f7394000640 1 --2- 172.21.15.59:0/3380127394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738c15dab0 0x7f738c0b5110 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.200+0000 7f7394000640 1 -- 172.21.15.59:0/3380127394 >> 172.21.15.59:0/3380127394 conn(0x7f738c06f510 msgr2=0x7f738c06f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.200+0000 7f7394000640 1 -- 172.21.15.59:0/3380127394 shutdown_connections 2024-04-25T09:08:38.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.200+0000 7f7394000640 1 -- 172.21.15.59:0/3380127394 wait complete. 2024-04-25T09:08:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7394000640 1 Processor -- start 2024-04-25T09:08:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7394000640 1 -- start start 2024-04-25T09:08:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7394000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738c0713c0 0x7f738c15e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7394000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738c0b0c00 0x7f738c160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7394000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f738c15dab0 0x7f738c160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7394000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c06dc50 con 0x7f738c0b0c00 2024-04-25T09:08:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7394000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c06dad0 con 0x7f738c15dab0 2024-04-25T09:08:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7394000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c16b940 con 0x7f738c0713c0 2024-04-25T09:08:38.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7390c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738c0b0c00 0x7f738c160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7390c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738c0b0c00 0x7f738c160240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58860/0 (socket says 172.21.15.59:58860) 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7390c00640 1 -- 172.21.15.59:0/150315465 learned_addr learned my addr 172.21.15.59:0/150315465 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7391600640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738c0713c0 0x7f738c15e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7392000640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f738c15dab0 0x7f738c160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7390c00640 1 -- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738c0713c0 msgr2=0x7f738c15e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7390c00640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738c0713c0 0x7f738c15e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7390c00640 1 -- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f738c15dab0 msgr2=0x7f738c160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7390c00640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f738c15dab0 0x7f738c160780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7390c00640 1 -- 172.21.15.59:0/150315465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c15edc0 con 0x7f738c0b0c00 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7390c00640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738c0b0c00 0x7f738c160240 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f737800c450 tx=0x7f737800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7389600640 1 -- 172.21.15.59:0/150315465 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7378017070 con 0x7f738c0b0c00 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7389600640 1 -- 172.21.15.59:0/150315465 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7378005cf0 con 0x7f738c0b0c00 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7389600640 1 -- 172.21.15.59:0/150315465 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7378007290 con 0x7f738c0b0c00 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7394000640 1 -- 172.21.15.59:0/150315465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c15eae0 con 0x7f738c0b0c00 2024-04-25T09:08:38.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.204+0000 7f7394000640 1 -- 172.21.15.59:0/150315465 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c153d60 con 0x7f738c0b0c00 2024-04-25T09:08:38.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7389600640 1 -- 172.21.15.59:0/150315465 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f737801a070 con 0x7f738c0b0c00 2024-04-25T09:08:38.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7389600640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f736c066f60 0x7f736c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7389600640 1 -- 172.21.15.59:0/150315465 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f73780844f0 con 0x7f738c0b0c00 2024-04-25T09:08:38.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7397546000 1 Processor -- start 2024-04-25T09:08:38.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7391600640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f736c066f60 0x7f736c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7397546000 1 -- start start 2024-04-25T09:08:38.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7391600640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f736c066f60 0x7f736c069420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f738c06efe0 tx=0x7f73800a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7397546000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf34c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7397546000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf34c5b0 0x562eaf301d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7397546000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf302290 0x562eaf302670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7397546000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eaf1e8f40 con 0x562eaf34bc90 2024-04-25T09:08:38.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7397546000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eaf150070 con 0x562eaf302290 2024-04-25T09:08:38.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7397546000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x562eaf0d81a0 con 0x562eaf34c5b0 2024-04-25T09:08:38.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.208+0000 7f7391600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf34c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7391600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf34c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58874/0 (socket says 172.21.15.59:58874) 2024-04-25T09:08:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7391600640 1 -- 172.21.15.59:0/2512834112 learned_addr learned my addr 172.21.15.59:0/2512834112 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7390c00640 1 --2- 172.21.15.59:0/2512834112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf34c5b0 0x562eaf301d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7392000640 1 --2- 172.21.15.59:0/2512834112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf302290 0x562eaf302670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7391600640 1 -- 172.21.15.59:0/2512834112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf34c5b0 msgr2=0x562eaf301d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7391600640 1 --2- 172.21.15.59:0/2512834112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf34c5b0 0x562eaf301d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7391600640 1 -- 172.21.15.59:0/2512834112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf302290 msgr2=0x562eaf302670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7391600640 1 --2- 172.21.15.59:0/2512834112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf302290 0x562eaf302670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7391600640 1 -- 172.21.15.59:0/2512834112 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562eaf0d6510 con 0x562eaf34bc90 2024-04-25T09:08:38.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7391600640 1 --2- 172.21.15.59:0/2512834112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf34c070 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f7380097e10 tx=0x7f7380004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35e39cef0d51c8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f737e000640 1 -- 172.21.15.59:0/2512834112 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800c7070 con 0x562eaf34bc90 2024-04-25T09:08:38.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f737e000640 1 -- 172.21.15.59:0/2512834112 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73800b7460 con 0x562eaf34bc90 2024-04-25T09:08:38.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f737e000640 1 -- 172.21.15.59:0/2512834112 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73800b0040 con 0x562eaf34bc90 2024-04-25T09:08:38.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 -- 172.21.15.59:0/2512834112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 msgr2=0x562eaf34c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 --2- 172.21.15.59:0/2512834112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf34c070 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f7380097e10 tx=0x7f7380004740 comp rx=0 tx=0).stop 2024-04-25T09:08:38.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 -- 172.21.15.59:0/2512834112 shutdown_connections 2024-04-25T09:08:38.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 --2- 172.21.15.59:0/2512834112 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf302290 0x562eaf302670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 --2- 172.21.15.59:0/2512834112 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf34c5b0 0x562eaf301d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 --2- 172.21.15.59:0/2512834112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf34c070 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 -- 172.21.15.59:0/2512834112 >> 172.21.15.59:0/2512834112 conn(0x562eaf2fe240 msgr2=0x562eaf300630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 -- 172.21.15.59:0/2512834112 shutdown_connections 2024-04-25T09:08:38.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 -- 172.21.15.59:0/2512834112 wait complete. 2024-04-25T09:08:38.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 -- start start 2024-04-25T09:08:38.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 Processor -- start 2024-04-25T09:08:38.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf302290 0x562eaf30ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf30d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf34c5b0 0x562eaf30d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eaf10a6c0 con 0x562eaf34bc90 2024-04-25T09:08:38.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eaf14c110 con 0x562eaf34c5b0 2024-04-25T09:08:38.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x562eaf14f380 con 0x562eaf302290 2024-04-25T09:08:38.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.212+0000 7f7397546000 10 client.0 _ll_register_callbacks cb 0x562eaf2ed570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:38.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7390c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf30d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7390c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf30d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58880/0 (socket says 172.21.15.59:58880) 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7390c00640 1 -- 172.21.15.59:0/1092578838 learned_addr learned my addr 172.21.15.59:0/1092578838 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7392000640 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf34c5b0 0x562eaf30d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7391600640 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf302290 0x562eaf30ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7390c00640 1 -- 172.21.15.59:0/1092578838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf302290 msgr2=0x562eaf30ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7390c00640 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf302290 0x562eaf30ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7390c00640 1 -- 172.21.15.59:0/1092578838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf34c5b0 msgr2=0x562eaf30d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7390c00640 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf34c5b0 0x562eaf30d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7390c00640 1 -- 172.21.15.59:0/1092578838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562eaf0d83b0 con 0x562eaf34bc90 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7390c00640 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf30d370 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f7378054bd0 tx=0x7f7378055480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f19c3a00c8fca94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7372a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7372a00640 1 -- 172.21.15.59:0/1092578838 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73780842c0 con 0x562eaf34bc90 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7372a00640 1 -- 172.21.15.59:0/1092578838 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f737805cec0 con 0x562eaf34bc90 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 -- 172.21.15.59:0/1092578838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f73800b7460 con 0x562eaf34bc90 2024-04-25T09:08:38.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7372a00640 1 -- 172.21.15.59:0/1092578838 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f737805d350 con 0x562eaf34bc90 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 10 client.7836 fetch_fsmap learned FSMap version 72 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 -- 172.21.15.59:0/1092578838 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x562eaf1d1e00 con 0x562eaf34bc90 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7372a00640 1 -- 172.21.15.59:0/1092578838 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73800b7460 con 0x562eaf34bc90 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7372a00640 1 -- 172.21.15.59:0/1092578838 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7378054090 con 0x562eaf34bc90 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 10 client.7836 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 10 client.7836 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 20 client.7836 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x562eaf30e180 0x562eaf35d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 4 client.7836 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 -- 172.21.15.59:0/1092578838 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562eaf0ebd60 con 0x562eaf30e180 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7391600640 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x562eaf30e180 0x562eaf35d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7391600640 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x562eaf30e180 0x562eaf35d410 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db9c7f4a90635cca server_cookie=e4c557531cbe323 in_seq=0 out_seq=0 2024-04-25T09:08:38.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7372a00640 10 client.7836 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7372a00640 1 -- 172.21.15.59:0/1092578838 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562eaf0ebd60 con 0x562eaf30e180 2024-04-25T09:08:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7372a00640 10 client.7836 handle_command_reply: tid=0 2024-04-25T09:08:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 client.7836 shutdown 2024-04-25T09:08:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 -- 172.21.15.59:0/1092578838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 msgr2=0x562eaf30d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf30d370 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f7378054bd0 tx=0x7f7378055480 comp rx=0 tx=0).stop 2024-04-25T09:08:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 -- 172.21.15.59:0/1092578838 shutdown_connections 2024-04-25T09:08:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x562eaf30e180 0x562eaf35d410 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf34c5b0 0x562eaf30d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf30d370 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7372a00640 0 client.7836 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 --2- 172.21.15.59:0/1092578838 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf302290 0x562eaf30ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 -- 172.21.15.59:0/1092578838 >> 172.21.15.59:0/1092578838 conn(0x562eaf2fe240 msgr2=0x562eaf300ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 -- 172.21.15.59:0/1092578838 shutdown_connections 2024-04-25T09:08:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 1 -- 172.21.15.59:0/1092578838 wait complete. 2024-04-25T09:08:38.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.216+0000 7f7397546000 20 client.7836 trim_cache size 0 max 16384 2024-04-25T09:08:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.232+0000 7f7397546000 1 Processor -- start 2024-04-25T09:08:38.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.232+0000 7f7397546000 1 -- start start 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.232+0000 7f7397546000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf302290 0x562eaf35f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.232+0000 7f7397546000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf35f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.232+0000 7f7397546000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf34c5b0 0x562eaf3ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.232+0000 7f7397546000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c203390 con 0x562eaf34bc90 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.232+0000 7f7397546000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c2026d0 con 0x562eaf34c5b0 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.232+0000 7f7397546000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c14d850 con 0x562eaf302290 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.232+0000 7f7390c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf35f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7390c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf35f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58892/0 (socket says 172.21.15.59:58892) 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7390c00640 1 -- 172.21.15.59:0/284409315 learned_addr learned my addr 172.21.15.59:0/284409315 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7392000640 1 --2- 172.21.15.59:0/284409315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf34c5b0 0x562eaf3ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7391600640 1 --2- 172.21.15.59:0/284409315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf302290 0x562eaf35f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7390c00640 1 -- 172.21.15.59:0/284409315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf302290 msgr2=0x562eaf35f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7390c00640 1 --2- 172.21.15.59:0/284409315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf302290 0x562eaf35f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7390c00640 1 -- 172.21.15.59:0/284409315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf34c5b0 msgr2=0x562eaf3ad2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7390c00640 1 --2- 172.21.15.59:0/284409315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf34c5b0 0x562eaf3ad2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7390c00640 1 -- 172.21.15.59:0/284409315 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562eaf1a7c50 con 0x562eaf34bc90 2024-04-25T09:08:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7390c00640 1 --2- 172.21.15.59:0/284409315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf35f960 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f7378058f50 tx=0x7f7378084050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e45f541ccbe056 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f737d600640 1 -- 172.21.15.59:0/284409315 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737805cec0 con 0x562eaf34bc90 2024-04-25T09:08:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f737d600640 1 -- 172.21.15.59:0/284409315 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737805d060 con 0x562eaf34bc90 2024-04-25T09:08:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f737d600640 1 -- 172.21.15.59:0/284409315 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73780842c0 con 0x562eaf34bc90 2024-04-25T09:08:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 -- 172.21.15.59:0/284409315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 msgr2=0x562eaf35f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 --2- 172.21.15.59:0/284409315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf35f960 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f7378058f50 tx=0x7f7378084050 comp rx=0 tx=0).stop 2024-04-25T09:08:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 -- 172.21.15.59:0/284409315 shutdown_connections 2024-04-25T09:08:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 --2- 172.21.15.59:0/284409315 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf34c5b0 0x562eaf3ad2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 --2- 172.21.15.59:0/284409315 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34bc90 0x562eaf35f960 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 --2- 172.21.15.59:0/284409315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf302290 0x562eaf35f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 -- 172.21.15.59:0/284409315 >> 172.21.15.59:0/284409315 conn(0x562eaf2fe240 msgr2=0x562eaf306d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 -- 172.21.15.59:0/284409315 shutdown_connections 2024-04-25T09:08:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 -- 172.21.15.59:0/284409315 wait complete. 2024-04-25T09:08:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 -- start start 2024-04-25T09:08:38.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 Processor -- start 2024-04-25T09:08:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf302290 0x562eaf35f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf34bc90 0x562eaf367ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34c5b0 0x562eaf368420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eaf30b200 con 0x562eaf34c5b0 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c1551a0 con 0x562eaf302290 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x562eaf14f380 con 0x562eaf34bc90 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7397546000 10 client.0 _ll_register_callbacks cb 0x7f73800ae070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7392000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34c5b0 0x562eaf368420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7392000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34c5b0 0x562eaf368420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58898/0 (socket says 172.21.15.59:58898) 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7392000640 1 -- 172.21.15.59:0/2733691950 learned_addr learned my addr 172.21.15.59:0/2733691950 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7391600640 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf302290 0x562eaf35f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.236+0000 7f7390c00640 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf34bc90 0x562eaf367ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7392000640 1 -- 172.21.15.59:0/2733691950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf34bc90 msgr2=0x562eaf367ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7392000640 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf34bc90 0x562eaf367ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7392000640 1 -- 172.21.15.59:0/2733691950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf302290 msgr2=0x562eaf35f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7392000640 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf302290 0x562eaf35f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7392000640 1 -- 172.21.15.59:0/2733691950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562eaf118120 con 0x562eaf34c5b0 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7392000640 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34c5b0 0x562eaf368420 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f7384016660 tx=0x7f7384016b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e17aa220efb577 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7372a00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7372a00640 1 -- 172.21.15.59:0/2733691950 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73840148a0 con 0x562eaf34c5b0 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7372a00640 1 -- 172.21.15.59:0/2733691950 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f7384021d70 con 0x562eaf34c5b0 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 -- 172.21.15.59:0/2733691950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f737805d060 con 0x562eaf34c5b0 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7372a00640 1 -- 172.21.15.59:0/2733691950 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7384014a40 con 0x562eaf34c5b0 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 10 client.7842 fetch_fsmap learned FSMap version 72 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 -- 172.21.15.59:0/2733691950 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x562eaf0f7170 con 0x562eaf34c5b0 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7372a00640 1 -- 172.21.15.59:0/2733691950 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737805d060 con 0x562eaf34c5b0 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7372a00640 1 -- 172.21.15.59:0/2733691950 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7384014be0 con 0x562eaf34c5b0 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 10 client.7842 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 10 client.7842 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 20 client.7842 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:38.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x562eaf3abe40 0x562eaf3ac250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 4 client.7842 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-25T09:08:38.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 -- 172.21.15.59:0/2733691950 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x562eaf15d5b0 con 0x562eaf3abe40 2024-04-25T09:08:38.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7391600640 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x562eaf3abe40 0x562eaf3ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7391600640 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x562eaf3abe40 0x562eaf3ac250 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=987f773c4eded4f5 server_cookie=19eba72214a51211 in_seq=0 out_seq=0 2024-04-25T09:08:38.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7372a00640 10 client.7842 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7372a00640 1 -- 172.21.15.59:0/2733691950 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562eaf15d5b0 con 0x562eaf3abe40 2024-04-25T09:08:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7372a00640 10 client.7842 handle_command_reply: tid=0 2024-04-25T09:08:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 client.7842 shutdown 2024-04-25T09:08:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 -- 172.21.15.59:0/2733691950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34c5b0 msgr2=0x562eaf368420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34c5b0 0x562eaf368420 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f7384016660 tx=0x7f7384016b20 comp rx=0 tx=0).stop 2024-04-25T09:08:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 -- 172.21.15.59:0/2733691950 shutdown_connections 2024-04-25T09:08:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x562eaf3abe40 0x562eaf3ac250 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562eaf34c5b0 0x562eaf368420 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x562eaf34bc90 0x562eaf367ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 --2- 172.21.15.59:0/2733691950 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x562eaf302290 0x562eaf35f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 -- 172.21.15.59:0/2733691950 >> 172.21.15.59:0/2733691950 conn(0x562eaf2fe240 msgr2=0x562eaf307460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7372a00640 0 client.7842 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 -- 172.21.15.59:0/2733691950 shutdown_connections 2024-04-25T09:08:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 1 -- 172.21.15.59:0/2733691950 wait complete. 2024-04-25T09:08:38.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7397546000 20 client.7842 trim_cache size 0 max 16384 2024-04-25T09:08:38.233 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f2ae2000640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv18 ap=3 DIRTYPARENT f(v0 m2024-04-25T09:07:56.592552+0000 1=1+0)->f(v1 m2024-04-25T09:07:56.592552+0000) n(v0 rc2024-04-25T09:07:56.700551+0000 2=1+1)->n(v0 rc2024-04-25T09:07:56.700551+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyrstat=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x56455cf41b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T09:07:56.592552+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T09:07:56.700551+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-25T09:08:38.233 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:08:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-04-25T09:08:38.233 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "a13e806f-6f13-4be5-8f56-0c7f177f3dd4", 2024-04-25T09:08:38.234 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-04-25T09:08:38.234 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:08:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7394000640 1 -- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f736c066f60 msgr2=0x7f736c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7394000640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f736c066f60 0x7f736c069420 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f738c06efe0 tx=0x7f73800a6000 comp rx=0 tx=0).stop 2024-04-25T09:08:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7394000640 1 -- 172.21.15.59:0/150315465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738c0b0c00 msgr2=0x7f738c160240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.240+0000 7f7394000640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738c0b0c00 0x7f738c160240 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f737800c450 tx=0x7f737800c910 comp rx=0 tx=0).stop 2024-04-25T09:08:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.244+0000 7f7394000640 1 -- 172.21.15.59:0/150315465 shutdown_connections 2024-04-25T09:08:38.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.244+0000 7f7394000640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f736c066f60 0x7f736c069420 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.244+0000 7f7394000640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f738c15dab0 0x7f738c160780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.244+0000 7f7394000640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f738c0b0c00 0x7f738c160240 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.244+0000 7f7394000640 1 --2- 172.21.15.59:0/150315465 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f738c0713c0 0x7f738c15e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.244+0000 7f7394000640 1 -- 172.21.15.59:0/150315465 >> 172.21.15.59:0/150315465 conn(0x7f738c06f510 msgr2=0x7f738c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.244+0000 7f7394000640 1 -- 172.21.15.59:0/150315465 shutdown_connections 2024-04-25T09:08:38.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.244+0000 7f7394000640 1 -- 172.21.15.59:0/150315465 wait complete. 2024-04-25T09:08:38.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:08:38.250 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:08:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.404+0000 7f18b7200640 1 Processor -- start 2024-04-25T09:08:38.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.404+0000 7f18b7200640 1 -- start start 2024-04-25T09:08:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.404+0000 7f18b7200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815b9e0 0x7f18b80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.404+0000 7f18b7200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b809ade0 con 0x7f18b815fac0 2024-04-25T09:08:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.404+0000 7f18b7200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b8099a60 con 0x7f18b80d0080 2024-04-25T09:08:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.404+0000 7f18b7200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8099d40 con 0x7f18b815b9e0 2024-04-25T09:08:38.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.404+0000 7f18b6800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f18b815fac0 0x7f18b80cc050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36376/0 (socket says 172.21.15.59:36376) 2024-04-25T09:08:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.404+0000 7f18b6800640 1 -- 172.21.15.59:0/3079003971 learned_addr learned my addr 172.21.15.59:0/3079003971 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:08:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.404+0000 7f18b5e00640 1 --2- 172.21.15.59:0/3079003971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815b9e0 0x7f18b80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.408+0000 7f18b5400640 1 -- 172.21.15.59:0/3079003971 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244300805 0 0) 0x7f18b00014a0 con 0x7f18b815fac0 2024-04-25T09:08:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.408+0000 7f18b5400640 1 -- 172.21.15.59:0/3079003971 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f189c003530 con 0x7f18b815fac0 2024-04-25T09:08:38.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.408+0000 7f18b5400640 1 -- 172.21.15.59:0/3079003971 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752957568 0 0) 0x7f18b8099a60 con 0x7f18b80d0080 2024-04-25T09:08:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.408+0000 7f18b5400640 1 -- 172.21.15.59:0/3079003971 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18b00014a0 con 0x7f18b80d0080 2024-04-25T09:08:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.408+0000 7f18b5e00640 1 -- 172.21.15.59:0/3079003971 >> v1:172.21.15.178:6789/0 conn(0x7f18b80d0080 legacy=0x7f18b815f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.408+0000 7f18b5e00640 1 -- 172.21.15.59:0/3079003971 >> v1:172.21.15.59:6789/0 conn(0x7f18b815fac0 legacy=0x7f18b80cc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.408+0000 7f18b5e00640 1 -- 172.21.15.59:0/3079003971 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b809a020 con 0x7f18b815b9e0 2024-04-25T09:08:38.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.408+0000 7f18b5e00640 1 --2- 172.21.15.59:0/3079003971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815b9e0 0x7f18b80cfb40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18a80097f0 tx=0x7f18a801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f102ad6a09a83cb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.408+0000 7f18b5400640 1 -- 172.21.15.59:0/3079003971 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80a6040 con 0x7f18b815b9e0 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.408+0000 7f18b5400640 1 -- 172.21.15.59:0/3079003971 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a80af070 con 0x7f18b815b9e0 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.408+0000 7f18b5400640 1 -- 172.21.15.59:0/3079003971 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80aa860 con 0x7f18b815b9e0 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 -- 172.21.15.59:0/3079003971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815b9e0 msgr2=0x7f18b80cfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 --2- 172.21.15.59:0/3079003971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815b9e0 0x7f18b80cfb40 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f18a80097f0 tx=0x7f18a801c4e0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 -- 172.21.15.59:0/3079003971 shutdown_connections 2024-04-25T09:08:38.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 --2- 172.21.15.59:0/3079003971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b815b9e0 0x7f18b80cfb40 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 -- 172.21.15.59:0/3079003971 >> 172.21.15.59:0/3079003971 conn(0x7f18b80b3030 msgr2=0x7f18b80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 -- 172.21.15.59:0/3079003971 shutdown_connections 2024-04-25T09:08:38.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 -- 172.21.15.59:0/3079003971 wait complete. 2024-04-25T09:08:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 Processor -- start 2024-04-25T09:08:38.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 -- start start 2024-04-25T09:08:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b80d0080 0x7f18b814f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18b815b9e0 0x7f18b80b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b815fac0 0x7f18b80b0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80cd0f0 con 0x7f18b815fac0 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80ccf70 con 0x7f18b815b9e0 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b7200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b80cd270 con 0x7f18b80d0080 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b815fac0 0x7f18b80b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b815fac0 0x7f18b80b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58904/0 (socket says 172.21.15.59:58904) 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b6800640 1 -- 172.21.15.59:0/505911072 learned_addr learned my addr 172.21.15.59:0/505911072 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18ad400640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18b815b9e0 0x7f18b80b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b5e00640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b80d0080 0x7f18b814f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b6800640 1 -- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b80d0080 msgr2=0x7f18b814f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b6800640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b80d0080 0x7f18b814f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b6800640 1 -- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18b815b9e0 msgr2=0x7f18b80b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b6800640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18b815b9e0 0x7f18b80b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.412+0000 7f18b6800640 1 -- 172.21.15.59:0/505911072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b8166890 con 0x7f18b815fac0 2024-04-25T09:08:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.416+0000 7f18b6800640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b815fac0 0x7f18b80b0730 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f18b000cfd0 tx=0x7f18b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.416+0000 7f18aea00640 1 -- 172.21.15.59:0/505911072 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0017070 con 0x7f18b815fac0 2024-04-25T09:08:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.416+0000 7f18aea00640 1 -- 172.21.15.59:0/505911072 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b0012400 con 0x7f18b815fac0 2024-04-25T09:08:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.416+0000 7f18aea00640 1 -- 172.21.15.59:0/505911072 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00127d0 con 0x7f18b815fac0 2024-04-25T09:08:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.416+0000 7f18b7200640 1 -- 172.21.15.59:0/505911072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b8166b70 con 0x7f18b815fac0 2024-04-25T09:08:38.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.416+0000 7f18b7200640 1 -- 172.21.15.59:0/505911072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b8167130 con 0x7f18b815fac0 2024-04-25T09:08:38.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.416+0000 7f18aea00640 1 -- 172.21.15.59:0/505911072 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f18b001a070 con 0x7f18b815fac0 2024-04-25T09:08:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.416+0000 7f18aea00640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1894066fb0 0x7f1894069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.416+0000 7f18aea00640 1 -- 172.21.15.59:0/505911072 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f18b0085120 con 0x7f18b815fac0 2024-04-25T09:08:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.416+0000 7f18b5e00640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1894066fb0 0x7f1894069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 Processor -- start 2024-04-25T09:08:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 -- start start 2024-04-25T09:08:38.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18b5e00640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1894066fb0 0x7f1894069470 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f18a80ae000 tx=0x7f18a80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517709d0 0x562351770db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517712f0 0x562351726b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517270a0 0x562351727480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562351573ff0 con 0x5623517712f0 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623514fc150 con 0x5623517270a0 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x562351570090 con 0x5623517709d0 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517712f0 0x562351726b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18b5e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517709d0 0x562351770db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18b6800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517270a0 0x562351727480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517712f0 0x562351726b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58906/0 (socket says 172.21.15.59:58906) 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18ad400640 1 -- 172.21.15.59:0/2637146342 learned_addr learned my addr 172.21.15.59:0/2637146342 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18ad400640 1 -- 172.21.15.59:0/2637146342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517709d0 msgr2=0x562351770db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18ad400640 1 --2- 172.21.15.59:0/2637146342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517709d0 0x562351770db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18ad400640 1 -- 172.21.15.59:0/2637146342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517270a0 msgr2=0x562351727480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18ad400640 1 --2- 172.21.15.59:0/2637146342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517270a0 0x562351727480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18ad400640 1 -- 172.21.15.59:0/2637146342 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56235170a0d0 con 0x5623517712f0 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18b6800640 1 --2- 172.21.15.59:0/2637146342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517270a0 0x562351727480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18ad400640 1 --2- 172.21.15.59:0/2637146342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517712f0 0x562351726b60 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f18a00011f0 tx=0x7f18a00018b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=607e3a957c78d94a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18a6a00640 1 -- 172.21.15.59:0/2637146342 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0019070 con 0x5623517712f0 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18a6a00640 1 -- 172.21.15.59:0/2637146342 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a00052e0 con 0x5623517712f0 2024-04-25T09:08:38.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18a6a00640 1 -- 172.21.15.59:0/2637146342 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0003820 con 0x5623517712f0 2024-04-25T09:08:38.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 -- 172.21.15.59:0/2637146342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517712f0 msgr2=0x562351726b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 --2- 172.21.15.59:0/2637146342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517712f0 0x562351726b60 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f18a00011f0 tx=0x7f18a00018b0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 -- 172.21.15.59:0/2637146342 shutdown_connections 2024-04-25T09:08:38.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 --2- 172.21.15.59:0/2637146342 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517270a0 0x562351727480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 --2- 172.21.15.59:0/2637146342 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517712f0 0x562351726b60 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 --2- 172.21.15.59:0/2637146342 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517709d0 0x562351770db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 -- 172.21.15.59:0/2637146342 >> 172.21.15.59:0/2637146342 conn(0x562351723020 msgr2=0x562351725440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 -- 172.21.15.59:0/2637146342 shutdown_connections 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.420+0000 7f18c0092000 1 -- 172.21.15.59:0/2637146342 wait complete. 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 1 -- start start 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 1 Processor -- start 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517270a0 0x5623517557f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517709d0 0x562351755d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517712f0 0x562351756270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562351538250 con 0x5623517709d0 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56235152e690 con 0x5623517712f0 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623514fca40 con 0x5623517270a0 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 10 client.0 _ll_register_callbacks cb 0x562351711e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517709d0 0x562351755d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18ad400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517709d0 0x562351755d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58908/0 (socket says 172.21.15.59:58908) 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18ad400640 1 -- 172.21.15.59:0/2958203210 learned_addr learned my addr 172.21.15.59:0/2958203210 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18b5e00640 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517270a0 0x5623517557f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18b6800640 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517712f0 0x562351756270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18ad400640 1 -- 172.21.15.59:0/2958203210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517270a0 msgr2=0x5623517557f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18ad400640 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517270a0 0x5623517557f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18ad400640 1 -- 172.21.15.59:0/2958203210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517712f0 msgr2=0x562351756270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18ad400640 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517712f0 0x562351756270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18ad400640 1 -- 172.21.15.59:0/2958203210 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623516211c0 con 0x5623517709d0 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18b6800640 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517712f0 0x562351756270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18ad400640 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517709d0 0x562351755d30 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x5623515303d0 tx=0x7f18a0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7309100ae3fe454 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f189b400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f189b400640 1 -- 172.21.15.59:0/2958203210 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a0023020 con 0x5623517709d0 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f189b400640 1 -- 172.21.15.59:0/2958203210 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f18a0003c40 con 0x5623517709d0 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 1 -- 172.21.15.59:0/2958203210 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18a00052e0 con 0x5623517709d0 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f189b400640 1 -- 172.21.15.59:0/2958203210 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18a0019070 con 0x5623517709d0 2024-04-25T09:08:38.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 10 client.7854 fetch_fsmap learned FSMap version 72 2024-04-25T09:08:38.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 1 -- 172.21.15.59:0/2958203210 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x56235161d170 con 0x5623517709d0 2024-04-25T09:08:38.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f189b400640 1 -- 172.21.15.59:0/2958203210 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a00052e0 con 0x5623517709d0 2024-04-25T09:08:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f189b400640 1 -- 172.21.15.59:0/2958203210 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f18a0028420 con 0x5623517709d0 2024-04-25T09:08:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 10 client.7854 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:08:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 10 client.7854 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:08:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 20 client.7854 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x562351780c80 0x562351783070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 4 client.7854 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:08:38.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18c0092000 1 -- 172.21.15.59:0/2958203210 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56235150fc60 con 0x562351780c80 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.424+0000 7f18b5e00640 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x562351780c80 0x562351783070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18b5e00640 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x562351780c80 0x562351783070 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aa45328ea0fba7c server_cookie=ca4b497b8060d031 in_seq=0 out_seq=0 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f189b400640 10 client.7854 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f189b400640 1 -- 172.21.15.59:0/2958203210 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56235150fc60 con 0x562351780c80 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f189b400640 10 client.7854 handle_command_reply: tid=0 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18c0092000 1 client.7854 shutdown 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18c0092000 1 -- 172.21.15.59:0/2958203210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517709d0 msgr2=0x562351755d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18c0092000 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517709d0 0x562351755d30 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x5623515303d0 tx=0x7f18a0000ee0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18c0092000 1 -- 172.21.15.59:0/2958203210 shutdown_connections 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18c0092000 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x562351780c80 0x562351783070 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18c0092000 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517712f0 0x562351756270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18c0092000 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517709d0 0x562351755d30 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18c0092000 1 --2- 172.21.15.59:0/2958203210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517270a0 0x5623517557f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18c0092000 1 -- 172.21.15.59:0/2958203210 >> 172.21.15.59:0/2958203210 conn(0x562351723020 msgr2=0x562351725ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f189b400640 0 client.7854 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18c0092000 1 -- 172.21.15.59:0/2958203210 shutdown_connections 2024-04-25T09:08:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18c0092000 1 -- 172.21.15.59:0/2958203210 wait complete. 2024-04-25T09:08:38.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.428+0000 7f18c0092000 20 client.7854 trim_cache size 0 max 16384 2024-04-25T09:08:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 Processor -- start 2024-04-25T09:08:38.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 -- start start 2024-04-25T09:08:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517270a0 0x562351726a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517712f0 0x56235177de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56235177e380 0x562351725410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b82030b0 con 0x56235177e380 2024-04-25T09:08:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b8202330 con 0x5623517270a0 2024-04-25T09:08:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b815e1b0 con 0x5623517712f0 2024-04-25T09:08:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18b6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56235177e380 0x562351725410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18b6800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56235177e380 0x562351725410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58920/0 (socket says 172.21.15.59:58920) 2024-04-25T09:08:38.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18b6800640 1 -- 172.21.15.59:0/1118294357 learned_addr learned my addr 172.21.15.59:0/1118294357 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:38.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18b5e00640 1 --2- 172.21.15.59:0/1118294357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517270a0 0x562351726a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18ad400640 1 --2- 172.21.15.59:0/1118294357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517712f0 0x56235177de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18b6800640 1 -- 172.21.15.59:0/1118294357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517712f0 msgr2=0x56235177de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18b6800640 1 --2- 172.21.15.59:0/1118294357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517712f0 0x56235177de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18b6800640 1 -- 172.21.15.59:0/1118294357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517270a0 msgr2=0x562351726a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18b6800640 1 --2- 172.21.15.59:0/1118294357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517270a0 0x562351726a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18b6800640 1 -- 172.21.15.59:0/1118294357 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623515bade0 con 0x56235177e380 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18b6800640 1 --2- 172.21.15.59:0/1118294357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56235177e380 0x562351725410 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f18b005db30 tx=0x7f18b00016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a149959f46dae02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18a6000640 1 -- 172.21.15.59:0/1118294357 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0051fc0 con 0x56235177e380 2024-04-25T09:08:38.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18a6000640 1 -- 172.21.15.59:0/1118294357 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b005dbd0 con 0x56235177e380 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18a6000640 1 -- 172.21.15.59:0/1118294357 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0052160 con 0x56235177e380 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 -- 172.21.15.59:0/1118294357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56235177e380 msgr2=0x562351725410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 --2- 172.21.15.59:0/1118294357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56235177e380 0x562351725410 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f18b005db30 tx=0x7f18b00016b0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 -- 172.21.15.59:0/1118294357 shutdown_connections 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 --2- 172.21.15.59:0/1118294357 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56235177e380 0x562351725410 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 --2- 172.21.15.59:0/1118294357 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5623517712f0 0x56235177de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 --2- 172.21.15.59:0/1118294357 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517270a0 0x562351726a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 -- 172.21.15.59:0/1118294357 >> 172.21.15.59:0/1118294357 conn(0x562351723020 msgr2=0x56235177d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 -- 172.21.15.59:0/1118294357 shutdown_connections 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 -- 172.21.15.59:0/1118294357 wait complete. 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 -- start start 2024-04-25T09:08:38.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.444+0000 7f18c0092000 1 Processor -- start 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517270a0 0x562351783590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517712f0 0x562351783ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56235177e380 0x562351784010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56235150ee00 con 0x5623517270a0 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b815e7b0 con 0x5623517712f0 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x562351573300 con 0x56235177e380 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 10 client.0 _ll_register_callbacks cb 0x5623516f2040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18b5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517270a0 0x562351783590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18b5e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517270a0 0x562351783590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:58934/0 (socket says 172.21.15.59:58934) 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18b5e00640 1 -- 172.21.15.59:0/2902105114 learned_addr learned my addr 172.21.15.59:0/2902105114 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18ad400640 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517712f0 0x562351783ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18b6800640 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56235177e380 0x562351784010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18b5e00640 1 -- 172.21.15.59:0/2902105114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56235177e380 msgr2=0x562351784010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18b5e00640 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56235177e380 0x562351784010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18b5e00640 1 -- 172.21.15.59:0/2902105114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517712f0 msgr2=0x562351783ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18b5e00640 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517712f0 0x562351783ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18b5e00640 1 -- 172.21.15.59:0/2902105114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623515158e0 con 0x5623517270a0 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18ad400640 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517712f0 0x562351783ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18b6800640 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56235177e380 0x562351784010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18b5e00640 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517270a0 0x562351783590 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f18a80097f0 tx=0x7f18a80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b92ad2567019175 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f189b400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f189b400640 1 -- 172.21.15.59:0/2902105114 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a80b9070 con 0x5623517270a0 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f189b400640 1 -- 172.21.15.59:0/2902105114 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f18a80aacd0 con 0x5623517270a0 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 -- 172.21.15.59:0/2902105114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18b005dbd0 con 0x5623517270a0 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f189b400640 1 -- 172.21.15.59:0/2902105114 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18a80db050 con 0x5623517270a0 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 10 client.7860 fetch_fsmap learned FSMap version 72 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 -- 172.21.15.59:0/2902105114 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5623515cd8f0 con 0x5623517270a0 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f189b400640 1 -- 172.21.15.59:0/2902105114 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b005dbd0 con 0x5623517270a0 2024-04-25T09:08:38.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f189b400640 1 -- 172.21.15.59:0/2902105114 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f18a80de020 con 0x5623517270a0 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 10 client.7860 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 10 client.7860 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 20 client.7860 populate_metadata read hostname 'smithi059' 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x5623517d6f50 0x5623517d9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 4 client.7860 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 -- 172.21.15.59:0/2902105114 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562351581530 con 0x5623517d6f50 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18ad400640 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x5623517d6f50 0x5623517d9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18ad400640 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x5623517d6f50 0x5623517d9340 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b431919573f0424 server_cookie=62e9e3da473618b8 in_seq=0 out_seq=0 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f189b400640 10 client.7860 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f189b400640 1 -- 172.21.15.59:0/2902105114 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x562351581530 con 0x5623517d6f50 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f189b400640 10 client.7860 handle_command_reply: tid=0 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 client.7860 shutdown 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 -- 172.21.15.59:0/2902105114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517270a0 msgr2=0x562351783590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517270a0 0x562351783590 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f18a80097f0 tx=0x7f18a80046d0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 -- 172.21.15.59:0/2902105114 shutdown_connections 2024-04-25T09:08:38.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x5623517d6f50 0x5623517d9340 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56235177e380 0x562351784010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5623517712f0 0x562351783ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 --2- 172.21.15.59:0/2902105114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5623517270a0 0x562351783590 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 -- 172.21.15.59:0/2902105114 >> 172.21.15.59:0/2902105114 conn(0x562351723020 msgr2=0x56235176f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f189b400640 0 client.7860 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:08:38.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 -- 172.21.15.59:0/2902105114 shutdown_connections 2024-04-25T09:08:38.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 1 -- 172.21.15.59:0/2902105114 wait complete. 2024-04-25T09:08:38.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.448+0000 7f18c0092000 20 client.7860 trim_cache size 0 max 16384 2024-04-25T09:08:38.442 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:08:38.442 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:08:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-04-25T09:08:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "a13e806f-6f13-4be5-8f56-0c7f177f3dd4": { 2024-04-25T09:08:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/dir", 2024-04-25T09:08:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "a13e806f-6f13-4be5-8f56-0c7f177f3dd4", 2024-04-25T09:08:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,repair" 2024-04-25T09:08:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:08:38.443 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:08:38.443 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:08:38.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.452+0000 7f18b7200640 1 -- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1894066fb0 msgr2=0x7f1894069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.452+0000 7f18b7200640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1894066fb0 0x7f1894069470 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f18a80ae000 tx=0x7f18a80a7000 comp rx=0 tx=0).stop 2024-04-25T09:08:38.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.452+0000 7f18b7200640 1 -- 172.21.15.59:0/505911072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b815fac0 msgr2=0x7f18b80b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:08:38.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.452+0000 7f18b7200640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b815fac0 0x7f18b80b0730 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f18b000cfd0 tx=0x7f18b000a430 comp rx=0 tx=0).stop 2024-04-25T09:08:38.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.452+0000 7f18b7200640 1 -- 172.21.15.59:0/505911072 shutdown_connections 2024-04-25T09:08:38.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.452+0000 7f18b7200640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1894066fb0 0x7f1894069470 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.452+0000 7f18b7200640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18b815fac0 0x7f18b80b0730 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.452+0000 7f18b7200640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18b815b9e0 0x7f18b80b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.452+0000 7f18b7200640 1 --2- 172.21.15.59:0/505911072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f18b80d0080 0x7f18b814f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:08:38.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.452+0000 7f18b7200640 1 -- 172.21.15.59:0/505911072 >> 172.21.15.59:0/505911072 conn(0x7f18b80b3030 msgr2=0x7f18b80b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:08:38.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.452+0000 7f18b7200640 1 -- 172.21.15.59:0/505911072 shutdown_connections 2024-04-25T09:08:38.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:08:38.452+0000 7f18b7200640 1 -- 172.21.15.59:0/505911072 wait complete. 2024-04-25T09:08:38.458 INFO:tasks.cephfs.filesystem:scrub status for tag:a13e806f-6f13-4be5-8f56-0c7f177f3dd4 - {'path': '/dir', 'tag': 'a13e806f-6f13-4be5-8f56-0c7f177f3dd4', 'options': 'recursive,repair'} 2024-04-25T09:08:53.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:08:53.480 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:08.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:08.460 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:09:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.627+0000 7f6c5ac00640 1 Processor -- start 2024-04-25T09:09:08.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.627+0000 7f6c5ac00640 1 -- start start 2024-04-25T09:09:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.627+0000 7f6c5ac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c54144e20 0x7f6c5406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.627+0000 7f6c5ac00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6c5406d900 0x7f6c540b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.627+0000 7f6c5ac00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c540b4190 0x7f6c540b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.627+0000 7f6c5ac00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540b30f0 con 0x7f6c540b4190 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.627+0000 7f6c5ac00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540b33d0 con 0x7f6c5406d900 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.627+0000 7f6c5ac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540b36b0 con 0x7f6c54144e20 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.627+0000 7f6c5a200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c540b4190 0x7f6c540b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.627+0000 7f6c5a200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c540b4190 0x7f6c540b0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51612/0 (socket says 172.21.15.59:51612) 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.627+0000 7f6c5a200640 1 -- 172.21.15.59:0/820498088 learned_addr learned my addr 172.21.15.59:0/820498088 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.631+0000 7f6c5a200640 1 -- 172.21.15.59:0/820498088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c54144e20 msgr2=0x7f6c5406d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.631+0000 7f6c5a200640 1 --2- 172.21.15.59:0/820498088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c54144e20 0x7f6c5406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.631+0000 7f6c5a200640 1 -- 172.21.15.59:0/820498088 >> v2:172.21.15.178:3300/0 conn(0x7f6c5406d900 msgr2=0x7f6c540b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.631+0000 7f6c5a200640 1 --2- 172.21.15.59:0/820498088 >> v2:172.21.15.178:3300/0 conn(0x7f6c5406d900 0x7f6c540b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.631+0000 7f6c5a200640 1 -- 172.21.15.59:0/820498088 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540b3990 con 0x7f6c540b4190 2024-04-25T09:09:08.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.631+0000 7f6c5a200640 1 --2- 172.21.15.59:0/820498088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c540b4190 0x7f6c540b0c90 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f6c54073360 tx=0x7f6c4c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9f3175f0566e6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.631+0000 7f6c53e00640 1 -- 172.21.15.59:0/820498088 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0a5750 con 0x7f6c540b4190 2024-04-25T09:09:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.631+0000 7f6c53e00640 1 -- 172.21.15.59:0/820498088 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c0a58f0 con 0x7f6c540b4190 2024-04-25T09:09:08.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.631+0000 7f6c53e00640 1 -- 172.21.15.59:0/820498088 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0a5cc0 con 0x7f6c540b4190 2024-04-25T09:09:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.631+0000 7f6c5ac00640 1 -- 172.21.15.59:0/820498088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c540b4190 msgr2=0x7f6c540b0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.631+0000 7f6c5ac00640 1 --2- 172.21.15.59:0/820498088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c540b4190 0x7f6c540b0c90 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f6c54073360 tx=0x7f6c4c01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 -- 172.21.15.59:0/820498088 shutdown_connections 2024-04-25T09:09:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 --2- 172.21.15.59:0/820498088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c540b4190 0x7f6c540b0c90 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 --2- 172.21.15.59:0/820498088 >> v2:172.21.15.178:3300/0 conn(0x7f6c5406d900 0x7f6c540b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 --2- 172.21.15.59:0/820498088 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c54144e20 0x7f6c5406d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 -- 172.21.15.59:0/820498088 >> 172.21.15.59:0/820498088 conn(0x7f6c54066fa0 msgr2=0x7f6c5406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 -- 172.21.15.59:0/820498088 shutdown_connections 2024-04-25T09:09:08.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 -- 172.21.15.59:0/820498088 wait complete. 2024-04-25T09:09:08.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 Processor -- start 2024-04-25T09:09:08.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 -- start start 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c5406d900 0x7f6c5415e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c540b4190 0x7f6c5415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c54144e20 0x7f6c540caae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540cc7b0 con 0x7f6c5406d900 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54145410 con 0x7f6c540b4190 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540cc930 con 0x7f6c54144e20 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c59800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c5406d900 0x7f6c5415e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c59800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c5406d900 0x7f6c5415e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51616/0 (socket says 172.21.15.59:51616) 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c59800640 1 -- 172.21.15.59:0/1545657428 learned_addr learned my addr 172.21.15.59:0/1545657428 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c58e00640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c540b4190 0x7f6c5415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5a200640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c54144e20 0x7f6c540caae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c59800640 1 -- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c54144e20 msgr2=0x7f6c540caae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c59800640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c54144e20 0x7f6c540caae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c59800640 1 -- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c540b4190 msgr2=0x7f6c5415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c59800640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c540b4190 0x7f6c5415a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c59800640 1 -- 172.21.15.59:0/1545657428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5415b210 con 0x7f6c5406d900 2024-04-25T09:09:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c58e00640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c540b4190 0x7f6c5415a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:08.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c59800640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c5406d900 0x7f6c5415e670 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800b440 tx=0x7f6c4800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c51600640 1 -- 172.21.15.59:0/1545657428 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48015020 con 0x7f6c5406d900 2024-04-25T09:09:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c51600640 1 -- 172.21.15.59:0/1545657428 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c480118b0 con 0x7f6c5406d900 2024-04-25T09:09:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c5ac00640 1 -- 172.21.15.59:0/1545657428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c54152760 con 0x7f6c5406d900 2024-04-25T09:09:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.635+0000 7f6c51600640 1 -- 172.21.15.59:0/1545657428 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48011ca0 con 0x7f6c5406d900 2024-04-25T09:09:08.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.639+0000 7f6c5ac00640 1 -- 172.21.15.59:0/1545657428 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c54152d20 con 0x7f6c5406d900 2024-04-25T09:09:08.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.639+0000 7f6c51600640 1 -- 172.21.15.59:0/1545657428 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6c48018020 con 0x7f6c5406d900 2024-04-25T09:09:08.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.639+0000 7f6c51600640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c34066f60 0x7f6c34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.639+0000 7f6c51600640 1 -- 172.21.15.59:0/1545657428 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f6c48085390 con 0x7f6c5406d900 2024-04-25T09:09:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 Processor -- start 2024-04-25T09:09:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c58e00640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c34066f60 0x7f6c34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 -- start start 2024-04-25T09:09:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c58e00640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c34066f60 0x7f6c34069420 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6c40006fd0 tx=0x7f6c40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff39d0 0x561b41ff3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff42f0 0x561b41fa9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 0x561b41faa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b41df6ff0 con 0x561b41faa0a0 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b41d7f150 con 0x561b41ff39d0 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b41df3090 con 0x561b41ff42f0 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 0x561b41faa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c59800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff39d0 0x561b41ff3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c59800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff39d0 0x561b41ff3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:58544/0 (socket says 172.21.15.59:58544) 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c58e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff42f0 0x561b41fa9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c59800640 1 -- 172.21.15.59:0/2562651113 learned_addr learned my addr 172.21.15.59:0/2562651113 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 0x561b41faa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51628/0 (socket says 172.21.15.59:51628) 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c59800640 1 -- 172.21.15.59:0/2562651113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff42f0 msgr2=0x561b41fa9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c59800640 1 --2- 172.21.15.59:0/2562651113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff42f0 0x561b41fa9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c59800640 1 -- 172.21.15.59:0/2562651113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 msgr2=0x561b41faa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c59800640 1 --2- 172.21.15.59:0/2562651113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 0x561b41faa480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c59800640 1 -- 172.21.15.59:0/2562651113 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b41f8d0d0 con 0x561b41ff39d0 2024-04-25T09:09:08.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5a200640 1 --2- 172.21.15.59:0/2562651113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 0x561b41faa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c59800640 1 --2- 172.21.15.59:0/2562651113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff39d0 0x561b41ff3db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6c48083540 tx=0x7f6c48055620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e789950a5523c54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c46000640 1 -- 172.21.15.59:0/2562651113 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4805e0c0 con 0x561b41ff39d0 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c46000640 1 -- 172.21.15.59:0/2562651113 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c480850c0 con 0x561b41ff39d0 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c46000640 1 -- 172.21.15.59:0/2562651113 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c48052020 con 0x561b41ff39d0 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 -- 172.21.15.59:0/2562651113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff39d0 msgr2=0x561b41ff3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 --2- 172.21.15.59:0/2562651113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff39d0 0x561b41ff3db0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f6c48083540 tx=0x7f6c48055620 comp rx=0 tx=0).stop 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 -- 172.21.15.59:0/2562651113 shutdown_connections 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 --2- 172.21.15.59:0/2562651113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 0x561b41faa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 --2- 172.21.15.59:0/2562651113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff42f0 0x561b41fa9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 --2- 172.21.15.59:0/2562651113 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff39d0 0x561b41ff3db0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 -- 172.21.15.59:0/2562651113 >> 172.21.15.59:0/2562651113 conn(0x561b41fa6020 msgr2=0x561b41fa8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 -- 172.21.15.59:0/2562651113 shutdown_connections 2024-04-25T09:09:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.643+0000 7f6c5f600000 1 -- 172.21.15.59:0/2562651113 wait complete. 2024-04-25T09:09:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 1 -- start start 2024-04-25T09:09:08.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 1 Processor -- start 2024-04-25T09:09:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 0x561b41fd87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff39d0 0x561b41fd8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff42f0 0x561b41fd9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b41dbb250 con 0x561b41faa0a0 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b41db1690 con 0x561b41ff39d0 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b41d7fa40 con 0x561b41ff42f0 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 10 client.0 _ll_register_callbacks cb 0x561b41f94e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c59800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 0x561b41fd87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c59800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 0x561b41fd87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51644/0 (socket says 172.21.15.59:51644) 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c59800640 1 -- 172.21.15.59:0/1240699388 learned_addr learned my addr 172.21.15.59:0/1240699388 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c58e00640 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff39d0 0x561b41fd8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5a200640 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff42f0 0x561b41fd9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c59800640 1 -- 172.21.15.59:0/1240699388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff42f0 msgr2=0x561b41fd9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c59800640 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff42f0 0x561b41fd9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c59800640 1 -- 172.21.15.59:0/1240699388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff39d0 msgr2=0x561b41fd8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c59800640 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff39d0 0x561b41fd8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c59800640 1 -- 172.21.15.59:0/1240699388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b41ea41c0 con 0x561b41faa0a0 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c59800640 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 0x561b41fd87f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f6c4806b040 tx=0x7f6c48000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d49bebcd3ed91fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c3aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c3aa00640 1 -- 172.21.15.59:0/1240699388 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4805e0c0 con 0x561b41faa0a0 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c3aa00640 1 -- 172.21.15.59:0/1240699388 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f6c48054e00 con 0x561b41faa0a0 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 1 -- 172.21.15.59:0/1240699388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c480850c0 con 0x561b41faa0a0 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c3aa00640 1 -- 172.21.15.59:0/1240699388 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c4807b050 con 0x561b41faa0a0 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 10 client.7872 fetch_fsmap learned FSMap version 72 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 1 -- 172.21.15.59:0/1240699388 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x561b41ea0170 con 0x561b41faa0a0 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c3aa00640 1 -- 172.21.15.59:0/1240699388 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c480850c0 con 0x561b41faa0a0 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c3aa00640 1 -- 172.21.15.59:0/1240699388 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6c48056ce0 con 0x561b41faa0a0 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 10 client.7872 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 10 client.7872 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 20 client.7872 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:08.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x561b42003c80 0x561b42006070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 4 client.7872 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c5f600000 1 -- 172.21.15.59:0/1240699388 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b41d92c60 con 0x561b42003c80 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c58e00640 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x561b42003c80 0x561b42006070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c58e00640 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x561b42003c80 0x561b42006070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb3dc9261dce5a6b server_cookie=dab726bd71c79c1d in_seq=0 out_seq=0 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.647+0000 7f6c3aa00640 10 client.7872 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c3aa00640 1 -- 172.21.15.59:0/1240699388 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x561b41d92c60 con 0x561b42003c80 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c3aa00640 10 client.7872 handle_command_reply: tid=0 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c5f600000 1 client.7872 shutdown 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c5f600000 1 -- 172.21.15.59:0/1240699388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 msgr2=0x561b41fd87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c5f600000 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 0x561b41fd87f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f6c4806b040 tx=0x7f6c48000bd0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c5f600000 1 -- 172.21.15.59:0/1240699388 shutdown_connections 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c5f600000 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x561b42003c80 0x561b42006070 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c5f600000 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff42f0 0x561b41fd9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c5f600000 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff39d0 0x561b41fd8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c5f600000 1 --2- 172.21.15.59:0/1240699388 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41faa0a0 0x561b41fd87f0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c5f600000 1 -- 172.21.15.59:0/1240699388 >> 172.21.15.59:0/1240699388 conn(0x561b41fa6020 msgr2=0x561b41fa8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c3aa00640 0 client.7872 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c5f600000 1 -- 172.21.15.59:0/1240699388 shutdown_connections 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c5f600000 1 -- 172.21.15.59:0/1240699388 wait complete. 2024-04-25T09:09:08.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.651+0000 7f6c5f600000 20 client.7872 trim_cache size 0 max 16384 2024-04-25T09:09:08.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 Processor -- start 2024-04-25T09:09:08.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 -- start start 2024-04-25T09:09:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41faa0a0 0x561b41fa9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff39d0 0x561b42000e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff42f0 0x561b42001380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54203280 con 0x561b41ff39d0 2024-04-25T09:09:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54202400 con 0x561b41ff42f0 2024-04-25T09:09:08.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54154050 con 0x561b41faa0a0 2024-04-25T09:09:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c58e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff39d0 0x561b42000e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c58e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff39d0 0x561b42000e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51660/0 (socket says 172.21.15.59:51660) 2024-04-25T09:09:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c58e00640 1 -- 172.21.15.59:0/162267419 learned_addr learned my addr 172.21.15.59:0/162267419 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5a200640 1 --2- 172.21.15.59:0/162267419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff42f0 0x561b42001380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c59800640 1 --2- 172.21.15.59:0/162267419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41faa0a0 0x561b41fa9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c58e00640 1 -- 172.21.15.59:0/162267419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41faa0a0 msgr2=0x561b41fa9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c58e00640 1 --2- 172.21.15.59:0/162267419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41faa0a0 0x561b41fa9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c58e00640 1 -- 172.21.15.59:0/162267419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff42f0 msgr2=0x561b42001380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c58e00640 1 --2- 172.21.15.59:0/162267419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff42f0 0x561b42001380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c58e00640 1 -- 172.21.15.59:0/162267419 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b41e3dde0 con 0x561b41ff39d0 2024-04-25T09:09:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c59800640 1 --2- 172.21.15.59:0/162267419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41faa0a0 0x561b41fa9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:08.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c58e00640 1 --2- 172.21.15.59:0/162267419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff39d0 0x561b42000e40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f6c5406dd20 tx=0x7f6c40013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf910297346a71d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c45600640 1 -- 172.21.15.59:0/162267419 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4000dd70 con 0x561b41ff39d0 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c45600640 1 -- 172.21.15.59:0/162267419 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4002b030 con 0x561b41ff39d0 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c45600640 1 -- 172.21.15.59:0/162267419 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c40014830 con 0x561b41ff39d0 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 -- 172.21.15.59:0/162267419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff39d0 msgr2=0x561b42000e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 --2- 172.21.15.59:0/162267419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff39d0 0x561b42000e40 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f6c5406dd20 tx=0x7f6c40013000 comp rx=0 tx=0).stop 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 -- 172.21.15.59:0/162267419 shutdown_connections 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 --2- 172.21.15.59:0/162267419 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41ff42f0 0x561b42001380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 --2- 172.21.15.59:0/162267419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff39d0 0x561b42000e40 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 --2- 172.21.15.59:0/162267419 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41faa0a0 0x561b41fa9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 -- 172.21.15.59:0/162267419 >> 172.21.15.59:0/162267419 conn(0x561b41fa6020 msgr2=0x561b42000730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 -- 172.21.15.59:0/162267419 shutdown_connections 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 -- 172.21.15.59:0/162267419 wait complete. 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 -- start start 2024-04-25T09:09:08.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.667+0000 7f6c5f600000 1 Processor -- start 2024-04-25T09:09:08.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41faa0a0 0x561b42053510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff39d0 0x561b42053a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff42f0 0x561b42005a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b41d91e00 con 0x561b41ff42f0 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c54201fb0 con 0x561b41faa0a0 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x561b41df6300 con 0x561b41ff39d0 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 10 client.0 _ll_register_callbacks cb 0x561b41f75040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff42f0 0x561b42005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff42f0 0x561b42005a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51676/0 (socket says 172.21.15.59:51676) 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5a200640 1 -- 172.21.15.59:0/3753216884 learned_addr learned my addr 172.21.15.59:0/3753216884 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c59800640 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41faa0a0 0x561b42053510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c58e00640 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff39d0 0x561b42053a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5a200640 1 -- 172.21.15.59:0/3753216884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff39d0 msgr2=0x561b42053a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5a200640 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff39d0 0x561b42053a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5a200640 1 -- 172.21.15.59:0/3753216884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41faa0a0 msgr2=0x561b42053510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5a200640 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41faa0a0 0x561b42053510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5a200640 1 -- 172.21.15.59:0/3753216884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b41d988e0 con 0x561b41ff42f0 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c58e00640 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff39d0 0x561b42053a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5a200640 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff42f0 0x561b42005a20 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c01b070 tx=0x7f6c4c01b200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af93916b4435e19 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c3aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c3aa00640 1 -- 172.21.15.59:0/3753216884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c0c6060 con 0x561b41ff42f0 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c3aa00640 1 -- 172.21.15.59:0/3753216884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f6c4c0a5c60 con 0x561b41ff42f0 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 -- 172.21.15.59:0/3753216884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c4002b030 con 0x561b41ff42f0 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c3aa00640 1 -- 172.21.15.59:0/3753216884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c4c0cc050 con 0x561b41ff42f0 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 10 client.7878 fetch_fsmap learned FSMap version 72 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 -- 172.21.15.59:0/3753216884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x561b41e508f0 con 0x561b41ff42f0 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c3aa00640 1 -- 172.21.15.59:0/3753216884 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4002b030 con 0x561b41ff42f0 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c3aa00640 1 -- 172.21.15.59:0/3753216884 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f6c4c0cf020 con 0x561b41ff42f0 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 10 client.7878 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 10 client.7878 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:08.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 20 client.7878 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:08.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x561b420066a0 0x561b42006ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 4 client.7878 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:09:08.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 -- 172.21.15.59:0/3753216884 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561b41e04530 con 0x561b420066a0 2024-04-25T09:09:08.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c59800640 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x561b420066a0 0x561b42006ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c3aa00640 10 client.7878 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:09:08.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c59800640 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x561b420066a0 0x561b42006ab0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70771493f1f56a63 server_cookie=7d973f203307a9f7 in_seq=0 out_seq=0 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c3aa00640 1 -- 172.21.15.59:0/3753216884 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561b41e04530 con 0x561b420066a0 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c3aa00640 10 client.7878 handle_command_reply: tid=0 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 client.7878 shutdown 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 -- 172.21.15.59:0/3753216884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff42f0 msgr2=0x561b42005a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff42f0 0x561b42005a20 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c01b070 tx=0x7f6c4c01b200 comp rx=0 tx=0).stop 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 -- 172.21.15.59:0/3753216884 shutdown_connections 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x561b420066a0 0x561b42006ab0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x561b41ff42f0 0x561b42005a20 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x561b41ff39d0 0x561b42053a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 --2- 172.21.15.59:0/3753216884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x561b41faa0a0 0x561b42053510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c3aa00640 0 client.7878 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.671+0000 7f6c5f600000 1 -- 172.21.15.59:0/3753216884 >> 172.21.15.59:0/3753216884 conn(0x561b41fa6020 msgr2=0x561b42000fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5f600000 1 -- 172.21.15.59:0/3753216884 shutdown_connections 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5f600000 1 -- 172.21.15.59:0/3753216884 wait complete. 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5f600000 20 client.7878 trim_cache size 0 max 16384 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2024-04-25T09:09:08.666 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5ac00640 1 -- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c34066f60 msgr2=0x7f6c34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5ac00640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c34066f60 0x7f6c34069420 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f6c40006fd0 tx=0x7f6c40008040 comp rx=0 tx=0).stop 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5ac00640 1 -- 172.21.15.59:0/1545657428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c5406d900 msgr2=0x7f6c5415e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5ac00640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c5406d900 0x7f6c5415e670 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f6c4800b440 tx=0x7f6c4800b900 comp rx=0 tx=0).stop 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5ac00640 1 -- 172.21.15.59:0/1545657428 shutdown_connections 2024-04-25T09:09:08.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5ac00640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c34066f60 0x7f6c34069420 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5ac00640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6c54144e20 0x7f6c540caae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5ac00640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6c540b4190 0x7f6c5415a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5ac00640 1 --2- 172.21.15.59:0/1545657428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c5406d900 0x7f6c5415e670 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5ac00640 1 -- 172.21.15.59:0/1545657428 >> 172.21.15.59:0/1545657428 conn(0x7f6c54066fa0 msgr2=0x7f6c54142290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5ac00640 1 -- 172.21.15.59:0/1545657428 shutdown_connections 2024-04-25T09:09:08.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.675+0000 7f6c5ac00640 1 -- 172.21.15.59:0/1545657428 wait complete. 2024-04-25T09:09:08.682 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:09:08.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:08.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6fffc00640 1 Processor -- start 2024-04-25T09:09:08.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6fffc00640 1 -- start start 2024-04-25T09:09:08.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6fffc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ff815fe50 0x7f6ff80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6fffc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ff80b1c90 0x7f6ff815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6fffc00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ff80cc4e0 con 0x7f6ff8145270 2024-04-25T09:09:08.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6fffc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ff8145650 con 0x7f6ff815fe50 2024-04-25T09:09:08.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6fffc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff81602b0 con 0x7f6ff80b1c90 2024-04-25T09:09:08.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6ff7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ff815fe50 0x7f6ff80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6ff7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ff815fe50 0x7f6ff80b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51692/0 (socket says 172.21.15.59:51692) 2024-04-25T09:09:08.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6ff7e00640 1 -- 172.21.15.59:0/177196334 learned_addr learned my addr 172.21.15.59:0/177196334 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:08.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6ffdc00640 1 --2- 172.21.15.59:0/177196334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ff80b1c90 0x7f6ff815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6ff7e00640 1 -- 172.21.15.59:0/177196334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ff80b1c90 msgr2=0x7f6ff815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:08.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6ff7e00640 1 --2- 172.21.15.59:0/177196334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ff80b1c90 0x7f6ff815bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6ff7e00640 1 -- 172.21.15.59:0/177196334 >> v1:172.21.15.178:6789/0 conn(0x7f6ff8145270 legacy=0x7f6ff80cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6ff7e00640 1 -- 172.21.15.59:0/177196334 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff80ce040 con 0x7f6ff815fe50 2024-04-25T09:09:08.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.835+0000 7f6ffdc00640 1 --2- 172.21.15.59:0/177196334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ff80b1c90 0x7f6ff815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:08.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.839+0000 7f6ff7e00640 1 --2- 172.21.15.59:0/177196334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff815fe50 0x7f6ff80b1750 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009870 tx=0x7f6fe401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad47c7bbd213615 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.839+0000 7f6ff7400640 1 -- 172.21.15.59:0/177196334 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40ab650 con 0x7f6ff815fe50 2024-04-25T09:09:08.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.839+0000 7f6ff7400640 1 -- 172.21.15.59:0/177196334 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe40b0070 con 0x7f6ff815fe50 2024-04-25T09:09:08.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.839+0000 7f6ff7400640 1 -- 172.21.15.59:0/177196334 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40aba10 con 0x7f6ff815fe50 2024-04-25T09:09:08.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.839+0000 7f6fffc00640 1 -- 172.21.15.59:0/177196334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff815fe50 msgr2=0x7f6ff80b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.839+0000 7f6fffc00640 1 --2- 172.21.15.59:0/177196334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff815fe50 0x7f6ff80b1750 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4009870 tx=0x7f6fe401c560 comp rx=0 tx=0).stop 2024-04-25T09:09:08.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.839+0000 7f6fffc00640 1 -- 172.21.15.59:0/177196334 shutdown_connections 2024-04-25T09:09:08.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.839+0000 7f6fffc00640 1 --2- 172.21.15.59:0/177196334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ff80b1c90 0x7f6ff815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.839+0000 7f6fffc00640 1 --2- 172.21.15.59:0/177196334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff815fe50 0x7f6ff80b1750 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.839+0000 7f6fffc00640 1 -- 172.21.15.59:0/177196334 >> 172.21.15.59:0/177196334 conn(0x7f6ff8066fa0 msgr2=0x7f6ff806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.839+0000 7f6fffc00640 1 -- 172.21.15.59:0/177196334 shutdown_connections 2024-04-25T09:09:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.839+0000 7f6fffc00640 1 -- 172.21.15.59:0/177196334 wait complete. 2024-04-25T09:09:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6fffc00640 1 Processor -- start 2024-04-25T09:09:08.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6fffc00640 1 -- start start 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6fffc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ff80b1c90 0x7f6ff813b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6fffc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ff8145270 0x7f6ff815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6fffc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff815fe50 0x7f6ff815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6fffc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80cdbe0 con 0x7f6ff815fe50 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6fffc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff815f930 con 0x7f6ff80b1c90 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6fffc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ff80cdd60 con 0x7f6ff8145270 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ffdc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff815fe50 0x7f6ff815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ffdc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff815fe50 0x7f6ff815b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51706/0 (socket says 172.21.15.59:51706) 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ffdc00640 1 -- 172.21.15.59:0/2465613184 learned_addr learned my addr 172.21.15.59:0/2465613184 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ffd200640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ff80b1c90 0x7f6ff813b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ff7e00640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ff8145270 0x7f6ff815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ffdc00640 1 -- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ff8145270 msgr2=0x7f6ff815ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ffdc00640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ff8145270 0x7f6ff815ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ffdc00640 1 -- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ff80b1c90 msgr2=0x7f6ff813b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ffdc00640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ff80b1c90 0x7f6ff813b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ffdc00640 1 -- 172.21.15.59:0/2465613184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff80b3a40 con 0x7f6ff815fe50 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ffdc00640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff815fe50 0x7f6ff815b1c0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0007ef0 tx=0x7f6ff000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ff4c00640 1 -- 172.21.15.59:0/2465613184 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff001a070 con 0x7f6ff815fe50 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ff4c00640 1 -- 172.21.15.59:0/2465613184 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff0003ba0 con 0x7f6ff815fe50 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6ff4c00640 1 -- 172.21.15.59:0/2465613184 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff0004030 con 0x7f6ff815fe50 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6fffc00640 1 -- 172.21.15.59:0/2465613184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ff80b3d20 con 0x7f6ff815fe50 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.843+0000 7f6fffc00640 1 -- 172.21.15.59:0/2465613184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ff80b42e0 con 0x7f6ff815fe50 2024-04-25T09:09:08.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.847+0000 7f6fffc00640 1 -- 172.21.15.59:0/2465613184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ff80745d0 con 0x7f6ff815fe50 2024-04-25T09:09:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.847+0000 7f6ff4c00640 1 -- 172.21.15.59:0/2465613184 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6ff001d070 con 0x7f6ff815fe50 2024-04-25T09:09:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.847+0000 7f6ff4c00640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fd8066f90 0x7f6fd8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:08.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.847+0000 7f6ff4c00640 1 -- 172.21.15.59:0/2465613184 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f6ff0085490 con 0x7f6ff815fe50 2024-04-25T09:09:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.847+0000 7f6ffd200640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fd8066f90 0x7f6fd8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:08.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.847+0000 7f6ffd200640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fd8066f90 0x7f6fd8069450 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6fec001810 tx=0x7f6fec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:08.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:08.851+0000 7f6ff4c00640 1 -- 172.21.15.59:0/2465613184 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6ff0010070 con 0x7f6ff815fe50 2024-04-25T09:09:09.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 -- 172.21.15.59:0/2465613184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ff806ec30 con 0x7f6ff815fe50 2024-04-25T09:09:09.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6ff4c00640 1 -- 172.21.15.59:0/2465613184 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f6ff0055bf0 con 0x7f6ff815fe50 2024-04-25T09:09:09.039 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:09.039 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:08:10.759050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7668},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7668":{"gid":7668,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":6,"addr":"172.21.15.59:6835/4079513876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":4079513876},{"type":"v1","addr":"172.21.15.59:6835","nonce":4079513876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:09:09.040 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 72 2024-04-25T09:09:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 -- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fd8066f90 msgr2=0x7f6fd8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fd8066f90 0x7f6fd8069450 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6fec001810 tx=0x7f6fec009040 comp rx=0 tx=0).stop 2024-04-25T09:09:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 -- 172.21.15.59:0/2465613184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff815fe50 msgr2=0x7f6ff815b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff815fe50 0x7f6ff815b1c0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0007ef0 tx=0x7f6ff000d4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 -- 172.21.15.59:0/2465613184 shutdown_connections 2024-04-25T09:09:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fd8066f90 0x7f6fd8069450 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ff815fe50 0x7f6ff815b1c0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6ff8145270 0x7f6ff815ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 --2- 172.21.15.59:0/2465613184 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6ff80b1c90 0x7f6ff813b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 -- 172.21.15.59:0/2465613184 >> 172.21.15.59:0/2465613184 conn(0x7f6ff8066fa0 msgr2=0x7f6ff813bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 -- 172.21.15.59:0/2465613184 shutdown_connections 2024-04-25T09:09:09.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.051+0000 7f6fffc00640 1 -- 172.21.15.59:0/2465613184 wait complete. 2024-04-25T09:09:09.060 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T09:09:09.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f0302000640 1 Processor -- start 2024-04-25T09:09:09.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f0302000640 1 -- start start 2024-04-25T09:09:09.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f0302000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02fc15dc60 0x7f02fc0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f0302000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f02fc09a170 0x7f02fc0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f0302000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02fc15e040 con 0x7f02fc06bf30 2024-04-25T09:09:09.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f0302000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc0cff80 con 0x7f02fc15dc60 2024-04-25T09:09:09.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f0302000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02fc0d0260 con 0x7f02fc09a170 2024-04-25T09:09:09.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f02fb400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02fc15dc60 0x7f02fc0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f02fb400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f02fc15dc60 0x7f02fc0d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51714/0 (socket says 172.21.15.59:51714) 2024-04-25T09:09:09.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f02f3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f02fc06bf30 0x7f02fc099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34968/0 (socket says 172.21.15.59:34968) 2024-04-25T09:09:09.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f02fb400640 1 -- 172.21.15.59:0/3813061252 learned_addr learned my addr 172.21.15.59:0/3813061252 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:09.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f02fbe00640 1 --2- 172.21.15.59:0/3813061252 >> v2:172.21.15.178:3300/0 conn(0x7f02fc09a170 0x7f02fc0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f02fb400640 1 -- 172.21.15.59:0/3813061252 >> v2:172.21.15.178:3300/0 conn(0x7f02fc09a170 msgr2=0x7f02fc0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f02fb400640 1 --2- 172.21.15.59:0/3813061252 >> v2:172.21.15.178:3300/0 conn(0x7f02fc09a170 0x7f02fc0cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f02fb400640 1 -- 172.21.15.59:0/3813061252 >> v1:172.21.15.59:6789/0 conn(0x7f02fc06bf30 legacy=0x7f02fc099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f02fb400640 1 -- 172.21.15.59:0/3813061252 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc0d0540 con 0x7f02fc15dc60 2024-04-25T09:09:09.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.215+0000 7f02faa00640 1 -- 172.21.15.59:0/3813061252 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476005213 0 0) 0x7f02fc15e040 con 0x7f02fc06bf30 2024-04-25T09:09:09.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f02fb400640 1 --2- 172.21.15.59:0/3813061252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc15dc60 0x7f02fc0d1020 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f02fc072a70 tx=0x7f02ec01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644447486c3821e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f02faa00640 1 -- 172.21.15.59:0/3813061252 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0ab660 con 0x7f02fc15dc60 2024-04-25T09:09:09.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f02faa00640 1 -- 172.21.15.59:0/3813061252 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec0b0070 con 0x7f02fc15dc60 2024-04-25T09:09:09.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f02faa00640 1 -- 172.21.15.59:0/3813061252 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0aba20 con 0x7f02fc15dc60 2024-04-25T09:09:09.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f0302000640 1 -- 172.21.15.59:0/3813061252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc15dc60 msgr2=0x7f02fc0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f0302000640 1 --2- 172.21.15.59:0/3813061252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc15dc60 0x7f02fc0d1020 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f02fc072a70 tx=0x7f02ec01c460 comp rx=0 tx=0).stop 2024-04-25T09:09:09.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f0302000640 1 -- 172.21.15.59:0/3813061252 shutdown_connections 2024-04-25T09:09:09.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f0302000640 1 --2- 172.21.15.59:0/3813061252 >> v2:172.21.15.178:3300/0 conn(0x7f02fc09a170 0x7f02fc0cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f0302000640 1 --2- 172.21.15.59:0/3813061252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc15dc60 0x7f02fc0d1020 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f0302000640 1 -- 172.21.15.59:0/3813061252 >> 172.21.15.59:0/3813061252 conn(0x7f02fc0b3200 msgr2=0x7f02fc0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f0302000640 1 -- 172.21.15.59:0/3813061252 shutdown_connections 2024-04-25T09:09:09.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f0302000640 1 -- 172.21.15.59:0/3813061252 wait complete. 2024-04-25T09:09:09.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f0302000640 1 Processor -- start 2024-04-25T09:09:09.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.219+0000 7f0302000640 1 -- start start 2024-04-25T09:09:09.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f0302000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc06bf30 0x7f02fc155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f0302000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc09a170 0x7f02fc0ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f0302000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02fc15dc60 0x7f02fc0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f0302000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0cc6f0 con 0x7f02fc09a170 2024-04-25T09:09:09.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f0302000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0cc570 con 0x7f02fc15dc60 2024-04-25T09:09:09.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f0302000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0cc870 con 0x7f02fc06bf30 2024-04-25T09:09:09.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02f3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc09a170 0x7f02fc0ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02f3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc09a170 0x7f02fc0ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51728/0 (socket says 172.21.15.59:51728) 2024-04-25T09:09:09.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02f3e00640 1 -- 172.21.15.59:0/667445573 learned_addr learned my addr 172.21.15.59:0/667445573 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:09.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02fb400640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc06bf30 0x7f02fc155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02fbe00640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02fc15dc60 0x7f02fc0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02f3e00640 1 -- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc06bf30 msgr2=0x7f02fc155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02f3e00640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc06bf30 0x7f02fc155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02f3e00640 1 -- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02fc15dc60 msgr2=0x7f02fc0c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02f3e00640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02fc15dc60 0x7f02fc0c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02f3e00640 1 -- 172.21.15.59:0/667445573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02fc0c9230 con 0x7f02fc09a170 2024-04-25T09:09:09.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02f3e00640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc09a170 0x7f02fc0ca530 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f02e40011f0 tx=0x7f02e400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02f3400640 1 -- 172.21.15.59:0/667445573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4018070 con 0x7f02fc09a170 2024-04-25T09:09:09.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02f3400640 1 -- 172.21.15.59:0/667445573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e40074e0 con 0x7f02fc09a170 2024-04-25T09:09:09.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f02f3400640 1 -- 172.21.15.59:0/667445573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4004a10 con 0x7f02fc09a170 2024-04-25T09:09:09.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f0302000640 1 -- 172.21.15.59:0/667445573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc0c9510 con 0x7f02fc09a170 2024-04-25T09:09:09.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.223+0000 7f0302000640 1 -- 172.21.15.59:0/667445573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02fc0ca010 con 0x7f02fc09a170 2024-04-25T09:09:09.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02f3400640 1 -- 172.21.15.59:0/667445573 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f02e401b070 con 0x7f02fc09a170 2024-04-25T09:09:09.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02f3400640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f02d8066f60 0x7f02d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02f3400640 1 -- 172.21.15.59:0/667445573 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f02e40845d0 con 0x7f02fc09a170 2024-04-25T09:09:09.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02fb400640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f02d8066f60 0x7f02d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f0305488000 1 Processor -- start 2024-04-25T09:09:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f0305488000 1 -- start start 2024-04-25T09:09:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02fb400640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f02d8066f60 0x7f02d8069420 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0af000 tx=0x7f02ec0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f0305488000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6ca2e0 0x5563da6ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f0305488000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6cac00 0x5563da6803a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f0305488000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6808e0 0x5563da680cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f0305488000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563da567ba0 con 0x5563da6808e0 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f0305488000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563da4cd090 con 0x5563da6cac00 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f0305488000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563da455160 con 0x5563da6ca2e0 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02fbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6808e0 0x5563da680cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02fbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6808e0 0x5563da680cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51734/0 (socket says 172.21.15.59:51734) 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02fbe00640 1 -- 172.21.15.59:0/1163408293 learned_addr learned my addr 172.21.15.59:0/1163408293 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02fb400640 1 --2- 172.21.15.59:0/1163408293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6ca2e0 0x5563da6ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02f3e00640 1 --2- 172.21.15.59:0/1163408293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6cac00 0x5563da6803a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02fbe00640 1 -- 172.21.15.59:0/1163408293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6ca2e0 msgr2=0x5563da6ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02fbe00640 1 --2- 172.21.15.59:0/1163408293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6ca2e0 0x5563da6ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02fbe00640 1 -- 172.21.15.59:0/1163408293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6cac00 msgr2=0x5563da6803a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02fbe00640 1 --2- 172.21.15.59:0/1163408293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6cac00 0x5563da6803a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.227+0000 7f02fbe00640 1 -- 172.21.15.59:0/1163408293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563da576c20 con 0x5563da6808e0 2024-04-25T09:09:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02fbe00640 1 --2- 172.21.15.59:0/1163408293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6808e0 0x5563da680cc0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009f40 tx=0x7f02f4003e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe50f3fcf078e3d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02ebe00640 1 -- 172.21.15.59:0/1163408293 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4015420 con 0x5563da6808e0 2024-04-25T09:09:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02ebe00640 1 -- 172.21.15.59:0/1163408293 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f401a070 con 0x5563da6808e0 2024-04-25T09:09:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02ebe00640 1 -- 172.21.15.59:0/1163408293 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f40157e0 con 0x5563da6808e0 2024-04-25T09:09:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 -- 172.21.15.59:0/1163408293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6808e0 msgr2=0x5563da680cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 --2- 172.21.15.59:0/1163408293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6808e0 0x5563da680cc0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f02f4009f40 tx=0x7f02f4003e30 comp rx=0 tx=0).stop 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 -- 172.21.15.59:0/1163408293 shutdown_connections 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 --2- 172.21.15.59:0/1163408293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6808e0 0x5563da680cc0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 --2- 172.21.15.59:0/1163408293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6cac00 0x5563da6803a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 --2- 172.21.15.59:0/1163408293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6ca2e0 0x5563da6ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 -- 172.21.15.59:0/1163408293 >> 172.21.15.59:0/1163408293 conn(0x5563da67c890 msgr2=0x5563da67ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 -- 172.21.15.59:0/1163408293 shutdown_connections 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 -- 172.21.15.59:0/1163408293 wait complete. 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 -- start start 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 Processor -- start 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6808e0 0x5563da6d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6ca2e0 0x5563da6d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6cac00 0x5563da6b8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563da4c9130 con 0x5563da6cac00 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563da491130 con 0x5563da6ca2e0 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563da58b300 con 0x5563da6808e0 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f0305488000 10 client.0 _ll_register_callbacks cb 0x5563da66bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02fbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6cac00 0x5563da6b8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02fbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6cac00 0x5563da6b8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51738/0 (socket says 172.21.15.59:51738) 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02fbe00640 1 -- 172.21.15.59:0/3217282929 learned_addr learned my addr 172.21.15.59:0/3217282929 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02fb400640 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6808e0 0x5563da6d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02f3e00640 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6ca2e0 0x5563da6d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02fbe00640 1 -- 172.21.15.59:0/3217282929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6808e0 msgr2=0x5563da6d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02fbe00640 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6808e0 0x5563da6d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02fbe00640 1 -- 172.21.15.59:0/3217282929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6ca2e0 msgr2=0x5563da6d1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02fbe00640 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6ca2e0 0x5563da6d1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02fbe00640 1 -- 172.21.15.59:0/3217282929 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563da4aa060 con 0x5563da6cac00 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.231+0000 7f02fb400640 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6808e0 0x5563da6d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02fbe00640 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6cac00 0x5563da6b8090 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f02f400b000 tx=0x7f02f4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a979ba064b2cea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02e8c00640 1 -- 172.21.15.59:0/3217282929 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4015be0 con 0x5563da6cac00 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02e8c00640 1 -- 172.21.15.59:0/3217282929 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f02f4015d80 con 0x5563da6cac00 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 -- 172.21.15.59:0/3217282929 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02f401a070 con 0x5563da6cac00 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02e8c00640 1 -- 172.21.15.59:0/3217282929 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02f4028470 con 0x5563da6cac00 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 10 client.7899 fetch_fsmap learned FSMap version 72 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 -- 172.21.15.59:0/3217282929 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5563da46e7c0 con 0x5563da6cac00 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02e8c00640 1 -- 172.21.15.59:0/3217282929 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f401a070 con 0x5563da6cac00 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02e8c00640 1 -- 172.21.15.59:0/3217282929 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f02f4028610 con 0x5563da6cac00 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 10 client.7899 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 10 client.7899 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 20 client.7899 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x5563da6b8e30 0x5563da6b9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 4 client.7899 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 -- 172.21.15.59:0/3217282929 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563da468cd0 con 0x5563da6b8e30 2024-04-25T09:09:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02fb400640 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x5563da6b8e30 0x5563da6b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02e8c00640 10 client.7899 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:09:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02fb400640 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x5563da6b8e30 0x5563da6b9210 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1c0715bbba54a0e server_cookie=348aafd9281398eb in_seq=0 out_seq=0 2024-04-25T09:09:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02e8c00640 1 -- 172.21.15.59:0/3217282929 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5563da468cd0 con 0x5563da6b8e30 2024-04-25T09:09:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02e8c00640 10 client.7899 handle_command_reply: tid=0 2024-04-25T09:09:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 client.7899 shutdown 2024-04-25T09:09:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 -- 172.21.15.59:0/3217282929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6cac00 msgr2=0x5563da6b8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6cac00 0x5563da6b8090 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f02f400b000 tx=0x7f02f4004ac0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 -- 172.21.15.59:0/3217282929 shutdown_connections 2024-04-25T09:09:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x5563da6b8e30 0x5563da6b9210 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6cac00 0x5563da6b8090 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6ca2e0 0x5563da6d1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 --2- 172.21.15.59:0/3217282929 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6808e0 0x5563da6d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f02e8c00640 0 client.7899 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:09:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 -- 172.21.15.59:0/3217282929 >> 172.21.15.59:0/3217282929 conn(0x5563da67c890 msgr2=0x5563da67f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 -- 172.21.15.59:0/3217282929 shutdown_connections 2024-04-25T09:09:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 1 -- 172.21.15.59:0/3217282929 wait complete. 2024-04-25T09:09:09.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.235+0000 7f0305488000 20 client.7899 trim_cache size 0 max 16384 2024-04-25T09:09:09.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.247+0000 7f0305488000 1 Processor -- start 2024-04-25T09:09:09.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.247+0000 7f0305488000 1 -- start start 2024-04-25T09:09:09.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.247+0000 7f0305488000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da67c890 0x5563da726500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.247+0000 7f0305488000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6808e0 0x5563da726a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6ca2e0 0x5563da726f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc2022e0 con 0x5563da67c890 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc09c5b0 con 0x5563da6808e0 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02fc0b7080 con 0x5563da6ca2e0 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02fb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da67c890 0x5563da726500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02fb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da67c890 0x5563da726500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51742/0 (socket says 172.21.15.59:51742) 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02fb400640 1 -- 172.21.15.59:0/294643183 learned_addr learned my addr 172.21.15.59:0/294643183 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02fb400640 1 -- 172.21.15.59:0/294643183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6ca2e0 msgr2=0x5563da726f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02fb400640 1 --2- 172.21.15.59:0/294643183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6ca2e0 0x5563da726f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02fb400640 1 -- 172.21.15.59:0/294643183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6808e0 msgr2=0x5563da726a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02fb400640 1 --2- 172.21.15.59:0/294643183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6808e0 0x5563da726a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02fb400640 1 -- 172.21.15.59:0/294643183 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563da488fc0 con 0x5563da67c890 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02fb400640 1 --2- 172.21.15.59:0/294643183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da67c890 0x5563da726500 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009630 tx=0x7f02ec004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8ba7e17749ba46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02eb400640 1 -- 172.21.15.59:0/294643183 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0d1070 con 0x5563da67c890 2024-04-25T09:09:09.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02eb400640 1 -- 172.21.15.59:0/294643183 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec0b0040 con 0x5563da67c890 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02eb400640 1 -- 172.21.15.59:0/294643183 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec0ab7f0 con 0x5563da67c890 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 -- 172.21.15.59:0/294643183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da67c890 msgr2=0x5563da726500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 --2- 172.21.15.59:0/294643183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da67c890 0x5563da726500 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009630 tx=0x7f02ec004740 comp rx=0 tx=0).stop 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 -- 172.21.15.59:0/294643183 shutdown_connections 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 --2- 172.21.15.59:0/294643183 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da6ca2e0 0x5563da726f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 --2- 172.21.15.59:0/294643183 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6808e0 0x5563da726a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 --2- 172.21.15.59:0/294643183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da67c890 0x5563da726500 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 -- 172.21.15.59:0/294643183 >> 172.21.15.59:0/294643183 conn(0x5563da685ba0 msgr2=0x5563da6c9290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 -- 172.21.15.59:0/294643183 shutdown_connections 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 -- 172.21.15.59:0/294643183 wait complete. 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 -- start start 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 Processor -- start 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da67c890 0x5563da72a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6808e0 0x5563da72ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6ca2e0 0x5563da6ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563da467e70 con 0x5563da6ca2e0 2024-04-25T09:09:09.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563da455a50 con 0x5563da6808e0 2024-04-25T09:09:09.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5563da4cc3a0 con 0x5563da67c890 2024-04-25T09:09:09.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f0305488000 10 client.0 _ll_register_callbacks cb 0x5563da479240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:09.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02fbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6ca2e0 0x5563da6ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02fbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6ca2e0 0x5563da6ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51754/0 (socket says 172.21.15.59:51754) 2024-04-25T09:09:09.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.251+0000 7f02fbe00640 1 -- 172.21.15.59:0/956185416 learned_addr learned my addr 172.21.15.59:0/956185416 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:09.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02f3e00640 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6808e0 0x5563da72ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02fb400640 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da67c890 0x5563da72a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02fbe00640 1 -- 172.21.15.59:0/956185416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da67c890 msgr2=0x5563da72a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02fbe00640 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da67c890 0x5563da72a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02fbe00640 1 -- 172.21.15.59:0/956185416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6808e0 msgr2=0x5563da72ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02fbe00640 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6808e0 0x5563da72ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02fbe00640 1 -- 172.21.15.59:0/956185416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5563da5269e0 con 0x5563da6ca2e0 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02f3e00640 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6808e0 0x5563da72ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02fb400640 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da67c890 0x5563da72a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02fbe00640 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6ca2e0 0x5563da6ce9b0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f02f4000f90 tx=0x7f02f4004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162f43c39956f96b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02e8c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02e8c00640 1 -- 172.21.15.59:0/956185416 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4015630 con 0x5563da6ca2e0 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 -- 172.21.15.59:0/956185416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02ec0b0040 con 0x5563da6ca2e0 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02e8c00640 1 -- 172.21.15.59:0/956185416 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f02f4015dc0 con 0x5563da6ca2e0 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02e8c00640 1 -- 172.21.15.59:0/956185416 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02f4040050 con 0x5563da6ca2e0 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 10 client.7905 fetch_fsmap learned FSMap version 72 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 -- 172.21.15.59:0/956185416 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=2+}) v3 -- 0x5563da46c630 con 0x5563da6ca2e0 2024-04-25T09:09:09.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02e8c00640 1 -- 172.21.15.59:0/956185416 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec0b0040 con 0x5563da6ca2e0 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02e8c00640 1 -- 172.21.15.59:0/956185416 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 72) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f02f4043020 con 0x5563da6ca2e0 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 10 client.7905 fetch_fsmap finished waiting for FSMap version 72 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 10 client.7905 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 20 client.7905 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x5563da6cac00 0x5563da6cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 4 client.7905 mds_command: new command op to 7668 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 -- 172.21.15.59:0/956185416 --> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5563da4da5d0 con 0x5563da6cac00 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02fb400640 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x5563da6cac00 0x5563da6cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02fb400640 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x5563da6cac00 0x5563da6cf2e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cab54fb560364b62 server_cookie=143ef0e80f78b17b in_seq=0 out_seq=0 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02e8c00640 10 client.7905 ms_handle_connect on v2:172.21.15.59:6833/4079513876 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02e8c00640 1 -- 172.21.15.59:0/956185416 <== mds.0 v2:172.21.15.59:6833/4079513876 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+144 (crc 0 0 0) 0x5563da4da5d0 con 0x5563da6cac00 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02e8c00640 10 client.7905 handle_command_reply: tid=0 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 client.7905 shutdown 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 -- 172.21.15.59:0/956185416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6ca2e0 msgr2=0x5563da6ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6ca2e0 0x5563da6ce9b0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f02f4000f90 tx=0x7f02f4004a50 comp rx=0 tx=0).stop 2024-04-25T09:09:09.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 -- 172.21.15.59:0/956185416 shutdown_connections 2024-04-25T09:09:09.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.59:6833/4079513876,v1:172.21.15.59:6835/4079513876] conn(0x5563da6cac00 0x5563da6cf2e0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5563da6ca2e0 0x5563da6ce9b0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5563da6808e0 0x5563da72ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 --2- 172.21.15.59:0/956185416 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5563da67c890 0x5563da72a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f02e8c00640 0 client.7905 ms_handle_reset on v2:172.21.15.59:6833/4079513876 2024-04-25T09:09:09.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 -- 172.21.15.59:0/956185416 >> 172.21.15.59:0/956185416 conn(0x5563da685ba0 msgr2=0x5563da6c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 -- 172.21.15.59:0/956185416 shutdown_connections 2024-04-25T09:09:09.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 1 -- 172.21.15.59:0/956185416 wait complete. 2024-04-25T09:09:09.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0305488000 20 client.7905 trim_cache size 0 max 16384 2024-04-25T09:09:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:09.253 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T09:09:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:09:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: "damage_type": "backtrace", 2024-04-25T09:09:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 2944867564, 2024-04-25T09:09:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: "ino": 1099511627777, 2024-04-25T09:09:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/testdir/hardlink" 2024-04-25T09:09:09.253 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:09:09.253 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T09:09:09.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0302000640 1 -- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f02d8066f60 msgr2=0x7f02d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0302000640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f02d8066f60 0x7f02d8069420 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f02ec0af000 tx=0x7f02ec0a7000 comp rx=0 tx=0).stop 2024-04-25T09:09:09.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0302000640 1 -- 172.21.15.59:0/667445573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc09a170 msgr2=0x7f02fc0ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0302000640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc09a170 0x7f02fc0ca530 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f02e40011f0 tx=0x7f02e400c9b0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0302000640 1 -- 172.21.15.59:0/667445573 shutdown_connections 2024-04-25T09:09:09.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0302000640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f02d8066f60 0x7f02d8069420 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0302000640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f02fc15dc60 0x7f02fc0c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0302000640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f02fc09a170 0x7f02fc0ca530 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0302000640 1 --2- 172.21.15.59:0/667445573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f02fc06bf30 0x7f02fc155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.255+0000 7f0302000640 1 -- 172.21.15.59:0/667445573 >> 172.21.15.59:0/667445573 conn(0x7f02fc0b3200 msgr2=0x7f02fc15a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.259+0000 7f0302000640 1 -- 172.21.15.59:0/667445573 shutdown_connections 2024-04-25T09:09:09.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.259+0000 7f0302000640 1 -- 172.21.15.59:0/667445573 wait complete. 2024-04-25T09:09:09.266 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:09:09.266 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:09.275 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:09:09.275 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:09.326 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8d5400640 1 Processor -- start 2024-04-25T09:09:09.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8d5400640 1 -- start start 2024-04-25T09:09:09.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8d5400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8d0160f20 0x7fe8d009a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8d5400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d006bfa0 0x7fe8d00d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8d5400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe8d0099a60 0x7fe8d0099ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8d5400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d009a410 con 0x7fe8d0160f20 2024-04-25T09:09:09.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8d5400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d00cf760 con 0x7fe8d0099a60 2024-04-25T09:09:09.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8d5400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d00cfa40 con 0x7fe8d006bfa0 2024-04-25T09:09:09.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8cfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8d0160f20 0x7fe8d009a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8cfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8d0160f20 0x7fe8d009a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51756/0 (socket says 172.21.15.59:51756) 2024-04-25T09:09:09.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8cfe00640 1 -- 172.21.15.59:0/1949672589 learned_addr learned my addr 172.21.15.59:0/1949672589 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:09.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8d4a00640 1 --2- 172.21.15.59:0/1949672589 >> v2:172.21.15.178:3300/0 conn(0x7fe8d0099a60 0x7fe8d0099ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8cf400640 1 --2- 172.21.15.59:0/1949672589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d006bfa0 0x7fe8d00d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8cfe00640 1 -- 172.21.15.59:0/1949672589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d006bfa0 msgr2=0x7fe8d00d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8cfe00640 1 --2- 172.21.15.59:0/1949672589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d006bfa0 0x7fe8d00d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8cfe00640 1 -- 172.21.15.59:0/1949672589 >> v2:172.21.15.178:3300/0 conn(0x7fe8d0099a60 msgr2=0x7fe8d0099ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8cfe00640 1 --2- 172.21.15.59:0/1949672589 >> v2:172.21.15.178:3300/0 conn(0x7fe8d0099a60 0x7fe8d0099ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8cfe00640 1 -- 172.21.15.59:0/1949672589 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d00cfd20 con 0x7fe8d0160f20 2024-04-25T09:09:09.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.527+0000 7fe8cf400640 1 --2- 172.21.15.59:0/1949672589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d006bfa0 0x7fe8d00d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:09.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8cfe00640 1 --2- 172.21.15.59:0/1949672589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d0160f20 0x7fe8d009a6e0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0072790 tx=0x7fe8c001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738e3b06af532227 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8cea00640 1 -- 172.21.15.59:0/1949672589 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00aa5f0 con 0x7fe8d0160f20 2024-04-25T09:09:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8cea00640 1 -- 172.21.15.59:0/1949672589 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c00af070 con 0x7fe8d0160f20 2024-04-25T09:09:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8cea00640 1 -- 172.21.15.59:0/1949672589 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c00aa9b0 con 0x7fe8d0160f20 2024-04-25T09:09:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8d5400640 1 -- 172.21.15.59:0/1949672589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d0160f20 msgr2=0x7fe8d009a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8d5400640 1 --2- 172.21.15.59:0/1949672589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d0160f20 0x7fe8d009a6e0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0072790 tx=0x7fe8c001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8d5400640 1 -- 172.21.15.59:0/1949672589 shutdown_connections 2024-04-25T09:09:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8d5400640 1 --2- 172.21.15.59:0/1949672589 >> v2:172.21.15.178:3300/0 conn(0x7fe8d0099a60 0x7fe8d0099ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8d5400640 1 --2- 172.21.15.59:0/1949672589 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d006bfa0 0x7fe8d00d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8d5400640 1 --2- 172.21.15.59:0/1949672589 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d0160f20 0x7fe8d009a6e0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8d5400640 1 -- 172.21.15.59:0/1949672589 >> 172.21.15.59:0/1949672589 conn(0x7fe8d00d1450 msgr2=0x7fe8d00d1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8d5400640 1 -- 172.21.15.59:0/1949672589 shutdown_connections 2024-04-25T09:09:09.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.531+0000 7fe8d5400640 1 -- 172.21.15.59:0/1949672589 wait complete. 2024-04-25T09:09:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d5400640 1 Processor -- start 2024-04-25T09:09:09.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d5400640 1 -- start start 2024-04-25T09:09:09.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d5400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8d006bfa0 0x7fe8d0151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d5400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d0099a60 0x7fe8d0151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d5400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d0160f20 0x7fe8d0151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d5400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d006c500 con 0x7fe8d0160f20 2024-04-25T09:09:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d5400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d006c380 con 0x7fe8d006bfa0 2024-04-25T09:09:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d5400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d0161300 con 0x7fe8d0099a60 2024-04-25T09:09:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d0160f20 0x7fe8d0151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d0160f20 0x7fe8d0151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51762/0 (socket says 172.21.15.59:51762) 2024-04-25T09:09:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d4a00640 1 -- 172.21.15.59:0/3214637730 learned_addr learned my addr 172.21.15.59:0/3214637730 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8cfe00640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8d006bfa0 0x7fe8d0151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8cf400640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d0099a60 0x7fe8d0151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d4a00640 1 -- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d0099a60 msgr2=0x7fe8d0151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d4a00640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d0099a60 0x7fe8d0151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d4a00640 1 -- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8d006bfa0 msgr2=0x7fe8d0151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d4a00640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8d006bfa0 0x7fe8d0151260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d4a00640 1 -- 172.21.15.59:0/3214637730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d006db20 con 0x7fe8d0160f20 2024-04-25T09:09:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d4a00640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d0160f20 0x7fe8d0151d40 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009dd0 tx=0x7fe8c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3214637730 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8018020 con 0x7fe8d0160f20 2024-04-25T09:09:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3214637730 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c8014480 con 0x7fe8d0160f20 2024-04-25T09:09:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d5400640 1 -- 172.21.15.59:0/3214637730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d01523e0 con 0x7fe8d0160f20 2024-04-25T09:09:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3214637730 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8014870 con 0x7fe8d0160f20 2024-04-25T09:09:09.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d5400640 1 -- 172.21.15.59:0/3214637730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d01529a0 con 0x7fe8d0160f20 2024-04-25T09:09:09.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.535+0000 7fe8d5400640 1 -- 172.21.15.59:0/3214637730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d004efa0 con 0x7fe8d0160f20 2024-04-25T09:09:09.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.539+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3214637730 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe8c801b020 con 0x7fe8d0160f20 2024-04-25T09:09:09.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.539+0000 7fe8c7e00640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8b0066f60 0x7fe8b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.539+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3214637730 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fe8c8085be0 con 0x7fe8d0160f20 2024-04-25T09:09:09.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.539+0000 7fe8cfe00640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8b0066f60 0x7fe8b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.539+0000 7fe8cfe00640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8b0066f60 0x7fe8b0069420 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00ae000 tx=0x7fe8c00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.543+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3214637730 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe8c8022070 con 0x7fe8d0160f20 2024-04-25T09:09:09.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.707+0000 7fe8d5400640 1 -- 172.21.15.59:0/3214637730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8d00d2040 con 0x7fe8d0160f20 2024-04-25T09:09:09.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.707+0000 7fe8c7e00640 1 -- 172.21.15.59:0/3214637730 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v95) v1 ==== 74+0+17208 (secure 0 0 0) 0x7fe8c8010040 con 0x7fe8d0160f20 2024-04-25T09:09:09.698 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:09.698 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":95,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:08:10.793586+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:47.301822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:47.878097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.12","mappings":[{"from":1,"to":5}]},{"pgid":"14.1a","mappings":[{"from":1,"to":2}]},{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.38","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/3531112441":"2024-04-26T09:07:59.742787+0000","172.21.15.59:6833/3531112441":"2024-04-26T09:07:59.742787+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:09.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.711+0000 7fe8d5400640 1 -- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8b0066f60 msgr2=0x7fe8b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.711+0000 7fe8d5400640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8b0066f60 0x7fe8b0069420 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00ae000 tx=0x7fe8c00a7000 comp rx=0 tx=0).stop 2024-04-25T09:09:09.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.711+0000 7fe8d5400640 1 -- 172.21.15.59:0/3214637730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d0160f20 msgr2=0x7fe8d0151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.711+0000 7fe8d5400640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d0160f20 0x7fe8d0151d40 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8009dd0 tx=0x7fe8c800c490 comp rx=0 tx=0).stop 2024-04-25T09:09:09.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.711+0000 7fe8d5400640 1 -- 172.21.15.59:0/3214637730 shutdown_connections 2024-04-25T09:09:09.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.711+0000 7fe8d5400640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe8b0066f60 0x7fe8b0069420 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.711+0000 7fe8d5400640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8d0160f20 0x7fe8d0151d40 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.711+0000 7fe8d5400640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe8d0099a60 0x7fe8d0151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.711+0000 7fe8d5400640 1 --2- 172.21.15.59:0/3214637730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe8d006bfa0 0x7fe8d0151260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.711+0000 7fe8d5400640 1 -- 172.21.15.59:0/3214637730 >> 172.21.15.59:0/3214637730 conn(0x7fe8d00d1450 msgr2=0x7fe8d006c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.711+0000 7fe8d5400640 1 -- 172.21.15.59:0/3214637730 shutdown_connections 2024-04-25T09:09:09.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.711+0000 7fe8d5400640 1 -- 172.21.15.59:0/3214637730 wait complete. 2024-04-25T09:09:09.720 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:07:47.301822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:07:47.878097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:09:09.720 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:09:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.875+0000 7f8723e00640 1 Processor -- start 2024-04-25T09:09:09.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.875+0000 7f8723e00640 1 -- start start 2024-04-25T09:09:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.875+0000 7f8723e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f871c159320 0x7f871c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.875+0000 7f8723e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871c15f440 0x7f871c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.875+0000 7f8723e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f871c06e010 0x7f871c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.875+0000 7f8723e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c06d640 con 0x7f871c159320 2024-04-25T09:09:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.875+0000 7f8723e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871c15fc00 con 0x7f871c06e010 2024-04-25T09:09:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.875+0000 7f8723e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c15fee0 con 0x7f871c15f440 2024-04-25T09:09:09.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.879+0000 7f8721400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f871c159320 0x7f871c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.879+0000 7f8721400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f871c159320 0x7f871c15c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51764/0 (socket says 172.21.15.59:51764) 2024-04-25T09:09:09.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.879+0000 7f8721400640 1 -- 172.21.15.59:0/1334550237 learned_addr learned my addr 172.21.15.59:0/1334550237 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:09.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.879+0000 7f8721e00640 1 --2- 172.21.15.59:0/1334550237 >> v2:172.21.15.178:3300/0 conn(0x7f871c06e010 0x7f871c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.879+0000 7f8720a00640 1 --2- 172.21.15.59:0/1334550237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871c15f440 0x7f871c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.879+0000 7f8721400640 1 -- 172.21.15.59:0/1334550237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871c15f440 msgr2=0x7f871c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.879+0000 7f8721400640 1 --2- 172.21.15.59:0/1334550237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871c15f440 0x7f871c06dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.879+0000 7f8721400640 1 -- 172.21.15.59:0/1334550237 >> v2:172.21.15.178:3300/0 conn(0x7f871c06e010 msgr2=0x7f871c06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:09.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.879+0000 7f8721400640 1 --2- 172.21.15.59:0/1334550237 >> v2:172.21.15.178:3300/0 conn(0x7f871c06e010 0x7f871c06e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.879+0000 7f8721400640 1 -- 172.21.15.59:0/1334550237 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c1601c0 con 0x7f871c159320 2024-04-25T09:09:09.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.879+0000 7f8721400640 1 --2- 172.21.15.59:0/1334550237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f871c159320 0x7f871c15c9b0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f871c1604a0 tx=0x7f871001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa705e16c4ad725 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.879+0000 7f871be00640 1 -- 172.21.15.59:0/1334550237 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87100b0070 con 0x7f871c159320 2024-04-25T09:09:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f871be00640 1 -- 172.21.15.59:0/1334550237 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87100ab600 con 0x7f871c159320 2024-04-25T09:09:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f871be00640 1 -- 172.21.15.59:0/1334550237 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87100ab9d0 con 0x7f871c159320 2024-04-25T09:09:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 -- 172.21.15.59:0/1334550237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f871c159320 msgr2=0x7f871c15c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 --2- 172.21.15.59:0/1334550237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f871c159320 0x7f871c15c9b0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f871c1604a0 tx=0x7f871001c460 comp rx=0 tx=0).stop 2024-04-25T09:09:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 -- 172.21.15.59:0/1334550237 shutdown_connections 2024-04-25T09:09:09.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 --2- 172.21.15.59:0/1334550237 >> v2:172.21.15.178:3300/0 conn(0x7f871c06e010 0x7f871c06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 --2- 172.21.15.59:0/1334550237 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871c15f440 0x7f871c06dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 --2- 172.21.15.59:0/1334550237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f871c159320 0x7f871c15c9b0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 -- 172.21.15.59:0/1334550237 >> 172.21.15.59:0/1334550237 conn(0x7f871c067080 msgr2=0x7f871c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 -- 172.21.15.59:0/1334550237 shutdown_connections 2024-04-25T09:09:09.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 -- 172.21.15.59:0/1334550237 wait complete. 2024-04-25T09:09:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 Processor -- start 2024-04-25T09:09:09.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 -- start start 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f871c06e010 0x7f871c13ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871c159320 0x7f871c142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f871c15f440 0x7f871c140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0cc440 con 0x7f871c15f440 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0cc2c0 con 0x7f871c06e010 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8723e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871c0cc5c0 con 0x7f871c159320 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8721e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f871c15f440 0x7f871c140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8721e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f871c15f440 0x7f871c140280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51768/0 (socket says 172.21.15.59:51768) 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.883+0000 7f8721e00640 1 -- 172.21.15.59:0/649897949 learned_addr learned my addr 172.21.15.59:0/649897949 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8720a00640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871c159320 0x7f871c142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8721400640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f871c06e010 0x7f871c13ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8721e00640 1 -- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871c159320 msgr2=0x7f871c142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8721e00640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871c159320 0x7f871c142940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8721e00640 1 -- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f871c06e010 msgr2=0x7f871c13ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8721e00640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f871c06e010 0x7f871c13ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8721e00640 1 -- 172.21.15.59:0/649897949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871c0b2440 con 0x7f871c15f440 2024-04-25T09:09:09.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8721e00640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f871c15f440 0x7f871c140280 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f8714007d90 tx=0x7f871400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8719600640 1 -- 172.21.15.59:0/649897949 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714014420 con 0x7f871c15f440 2024-04-25T09:09:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8719600640 1 -- 172.21.15.59:0/649897949 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8714019070 con 0x7f871c15f440 2024-04-25T09:09:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8723e00640 1 -- 172.21.15.59:0/649897949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871c0b2720 con 0x7f871c15f440 2024-04-25T09:09:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8719600640 1 -- 172.21.15.59:0/649897949 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8714014820 con 0x7f871c15f440 2024-04-25T09:09:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8723e00640 1 -- 172.21.15.59:0/649897949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f871c0b2ce0 con 0x7f871c15f440 2024-04-25T09:09:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8723e00640 1 -- 172.21.15.59:0/649897949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871c0745d0 con 0x7f871c15f440 2024-04-25T09:09:09.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8719600640 1 -- 172.21.15.59:0/649897949 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f87140149c0 con 0x7f871c15f440 2024-04-25T09:09:09.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8719600640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f86fc066f60 0x7f86fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:09.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.887+0000 7f8719600640 1 -- 172.21.15.59:0/649897949 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f8714085b40 con 0x7f871c15f440 2024-04-25T09:09:09.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.891+0000 7f8721400640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f86fc066f60 0x7f86fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:09.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.891+0000 7f8721400640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f86fc066f60 0x7f86fc069420 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f87100ad000 tx=0x7f8710008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:09.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:09.891+0000 7f8719600640 1 -- 172.21.15.59:0/649897949 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8714056860 con 0x7f871c15f440 2024-04-25T09:09:10.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 -- 172.21.15.59:0/649897949 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f871c13d340 con 0x7f871c15f440 2024-04-25T09:09:10.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8719600640 1 -- 172.21.15.59:0/649897949 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v95) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8714056160 con 0x7f871c15f440 2024-04-25T09:09:10.043 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:09:10.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 -- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f86fc066f60 msgr2=0x7f86fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f86fc066f60 0x7f86fc069420 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f87100ad000 tx=0x7f8710008040 comp rx=0 tx=0).stop 2024-04-25T09:09:10.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 -- 172.21.15.59:0/649897949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f871c15f440 msgr2=0x7f871c140280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f871c15f440 0x7f871c140280 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f8714007d90 tx=0x7f871400e4b0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 -- 172.21.15.59:0/649897949 shutdown_connections 2024-04-25T09:09:10.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f86fc066f60 0x7f86fc069420 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f871c15f440 0x7f871c140280 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f871c159320 0x7f871c142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 --2- 172.21.15.59:0/649897949 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f871c06e010 0x7f871c13ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 -- 172.21.15.59:0/649897949 >> 172.21.15.59:0/649897949 conn(0x7f871c067080 msgr2=0x7f871c15d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:10.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 -- 172.21.15.59:0/649897949 shutdown_connections 2024-04-25T09:09:10.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.055+0000 7f8723e00640 1 -- 172.21.15.59:0/649897949 wait complete. 2024-04-25T09:09:10.064 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:09:10.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdcef400640 1 Processor -- start 2024-04-25T09:09:10.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdcef400640 1 -- start start 2024-04-25T09:09:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdcef400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdce8159320 0x7fdce815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdcef400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce815fc00 con 0x7fdce815f440 2024-04-25T09:09:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdcef400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce815fee0 con 0x7fdce806e4a0 2024-04-25T09:09:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdcef400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce806d640 con 0x7fdce8159320 2024-04-25T09:09:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdceca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdce8159320 0x7fdce815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdceca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdce8159320 0x7fdce815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51782/0 (socket says 172.21.15.59:51782) 2024-04-25T09:09:10.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdceca00640 1 -- 172.21.15.59:0/3527627359 learned_addr learned my addr 172.21.15.59:0/3527627359 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdce7e00640 1 --1- 172.21.15.59:0/3527627359 >> v1:172.21.15.59:6789/0 conn(0x7fdce815f440 0x7fdce806dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34984/0 (socket says 172.21.15.59:34984) 2024-04-25T09:09:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdceca00640 1 -- 172.21.15.59:0/3527627359 >> v1:172.21.15.178:6789/0 conn(0x7fdce806e4a0 legacy=0x7fdce8071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdceca00640 1 -- 172.21.15.59:0/3527627359 >> v1:172.21.15.59:6789/0 conn(0x7fdce815f440 legacy=0x7fdce806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdceca00640 1 -- 172.21.15.59:0/3527627359 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce81601c0 con 0x7fdce8159320 2024-04-25T09:09:10.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.219+0000 7fdce7400640 1 -- 172.21.15.59:0/3527627359 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2241985416 0 0) 0x7fdce815fc00 con 0x7fdce815f440 2024-04-25T09:09:10.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdceca00640 1 --2- 172.21.15.59:0/3527627359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce8159320 0x7fdce815c9b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fdce806d7c0 tx=0x7fdcdc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5097bd7771d2444f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdce7400640 1 -- 172.21.15.59:0/3527627359 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0ab620 con 0x7fdce8159320 2024-04-25T09:09:10.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdce7400640 1 -- 172.21.15.59:0/3527627359 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcdc0b0070 con 0x7fdce8159320 2024-04-25T09:09:10.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdce7400640 1 -- 172.21.15.59:0/3527627359 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcdc0ab9e0 con 0x7fdce8159320 2024-04-25T09:09:10.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdcef400640 1 -- 172.21.15.59:0/3527627359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce8159320 msgr2=0x7fdce815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdcef400640 1 --2- 172.21.15.59:0/3527627359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce8159320 0x7fdce815c9b0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fdce806d7c0 tx=0x7fdcdc01c480 comp rx=0 tx=0).stop 2024-04-25T09:09:10.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdcef400640 1 -- 172.21.15.59:0/3527627359 shutdown_connections 2024-04-25T09:09:10.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdcef400640 1 --2- 172.21.15.59:0/3527627359 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce8159320 0x7fdce815c9b0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdcef400640 1 -- 172.21.15.59:0/3527627359 >> 172.21.15.59:0/3527627359 conn(0x7fdce8067080 msgr2=0x7fdce806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:10.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdcef400640 1 -- 172.21.15.59:0/3527627359 shutdown_connections 2024-04-25T09:09:10.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdcef400640 1 -- 172.21.15.59:0/3527627359 wait complete. 2024-04-25T09:09:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdcef400640 1 Processor -- start 2024-04-25T09:09:10.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.223+0000 7fdcef400640 1 -- start start 2024-04-25T09:09:10.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdcef400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce806e4a0 0x7fdce8151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdcef400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdce8159320 0x7fdce8151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdcef400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce815f440 0x7fdce8157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdcef400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce815f9e0 con 0x7fdce815f440 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdcef400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce815f860 con 0x7fdce806e4a0 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdcef400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdce8071980 con 0x7fdce8159320 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdced400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce815f440 0x7fdce8157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdced400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce815f440 0x7fdce8157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:51798/0 (socket says 172.21.15.59:51798) 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdced400640 1 -- 172.21.15.59:0/743768365 learned_addr learned my addr 172.21.15.59:0/743768365 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdceca00640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce806e4a0 0x7fdce8151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdce7e00640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdce8159320 0x7fdce8151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdced400640 1 -- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdce8159320 msgr2=0x7fdce8151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdced400640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdce8159320 0x7fdce8151750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdced400640 1 -- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce806e4a0 msgr2=0x7fdce8151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdced400640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce806e4a0 0x7fdce8151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdced400640 1 -- 172.21.15.59:0/743768365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce8155c00 con 0x7fdce815f440 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdced400640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce815f440 0x7fdce8157120 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fdce000c7a0 tx=0x7fdce000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdce4c00640 1 -- 172.21.15.59:0/743768365 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce0003b80 con 0x7fdce815f440 2024-04-25T09:09:10.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdce4c00640 1 -- 172.21.15.59:0/743768365 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce0003d20 con 0x7fdce815f440 2024-04-25T09:09:10.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdce4c00640 1 -- 172.21.15.59:0/743768365 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce000aa90 con 0x7fdce815f440 2024-04-25T09:09:10.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdcef400640 1 -- 172.21.15.59:0/743768365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce8155ee0 con 0x7fdce815f440 2024-04-25T09:09:10.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdcef400640 1 -- 172.21.15.59:0/743768365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce81569c0 con 0x7fdce815f440 2024-04-25T09:09:10.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.227+0000 7fdcef400640 1 -- 172.21.15.59:0/743768365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce80745d0 con 0x7fdce815f440 2024-04-25T09:09:10.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.231+0000 7fdce4c00640 1 -- 172.21.15.59:0/743768365 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdce000ac30 con 0x7fdce815f440 2024-04-25T09:09:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.231+0000 7fdce4c00640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdcc8066f60 0x7fdcc8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.231+0000 7fdce4c00640 1 -- 172.21.15.59:0/743768365 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7fdce0084fd0 con 0x7fdce815f440 2024-04-25T09:09:10.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.231+0000 7fdceca00640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdcc8066f60 0x7fdcc8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.231+0000 7fdceca00640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdcc8066f60 0x7fdcc8069420 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0af000 tx=0x7fdcdc0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.235+0000 7fdce4c00640 1 -- 172.21.15.59:0/743768365 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdce00557d0 con 0x7fdce815f440 2024-04-25T09:09:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.395+0000 7fdcef400640 1 -- 172.21.15.59:0/743768365 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdce806af90 con 0x7fdce815f440 2024-04-25T09:09:10.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.395+0000 7fdce4c00640 1 -- 172.21.15.59:0/743768365 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v95) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdce0059870 con 0x7fdce815f440 2024-04-25T09:09:10.385 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:09:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.399+0000 7fdcef400640 1 -- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdcc8066f60 msgr2=0x7fdcc8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.399+0000 7fdcef400640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdcc8066f60 0x7fdcc8069420 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0af000 tx=0x7fdcdc0a7000 comp rx=0 tx=0).stop 2024-04-25T09:09:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.399+0000 7fdcef400640 1 -- 172.21.15.59:0/743768365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce815f440 msgr2=0x7fdce8157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.399+0000 7fdcef400640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce815f440 0x7fdce8157120 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fdce000c7a0 tx=0x7fdce000cc60 comp rx=0 tx=0).stop 2024-04-25T09:09:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.399+0000 7fdcef400640 1 -- 172.21.15.59:0/743768365 shutdown_connections 2024-04-25T09:09:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.399+0000 7fdcef400640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdcc8066f60 0x7fdcc8069420 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.399+0000 7fdcef400640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdce815f440 0x7fdce8157120 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.399+0000 7fdcef400640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdce8159320 0x7fdce8151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.399+0000 7fdcef400640 1 --2- 172.21.15.59:0/743768365 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdce806e4a0 0x7fdce8151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.399+0000 7fdcef400640 1 -- 172.21.15.59:0/743768365 >> 172.21.15.59:0/743768365 conn(0x7fdce8067080 msgr2=0x7fdce815e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:10.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.399+0000 7fdcef400640 1 -- 172.21.15.59:0/743768365 shutdown_connections 2024-04-25T09:09:10.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.399+0000 7fdcef400640 1 -- 172.21.15.59:0/743768365 wait complete. 2024-04-25T09:09:10.407 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:09:10.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.559+0000 7f9a8a200640 1 Processor -- start 2024-04-25T09:09:10.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a8a200640 1 -- start start 2024-04-25T09:09:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a8a200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9a84159320 0x7f9a8415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a8a200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9a8415f440 0x7f9a8406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a8a200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8415fc00 con 0x7f9a8406e010 2024-04-25T09:09:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a8a200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a8406d640 con 0x7f9a8415f440 2024-04-25T09:09:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a8a200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a8415fee0 con 0x7f9a84159320 2024-04-25T09:09:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a7be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9a8415f440 0x7f9a8406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a7be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9a8415f440 0x7f9a8406dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46700/0 (socket says 172.21.15.59:46700) 2024-04-25T09:09:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a7be00640 1 -- 172.21.15.59:0/4194110490 learned_addr learned my addr 172.21.15.59:0/4194110490 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a7be00640 1 -- 172.21.15.59:0/4194110490 >> v2:172.21.15.178:3300/0 conn(0x7f9a84159320 msgr2=0x7f9a8415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a7be00640 1 --2- 172.21.15.59:0/4194110490 >> v2:172.21.15.178:3300/0 conn(0x7f9a84159320 0x7f9a8415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a7be00640 1 -- 172.21.15.59:0/4194110490 >> v1:172.21.15.178:6789/0 conn(0x7f9a8406e010 legacy=0x7f9a8406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:10.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.563+0000 7f9a7be00640 1 -- 172.21.15.59:0/4194110490 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a841601c0 con 0x7f9a8415f440 2024-04-25T09:09:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a7be00640 1 --2- 172.21.15.59:0/4194110490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8415f440 0x7f9a8406dad0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f9a8406e470 tx=0x7f9a6c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1705676e6b7dcab5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a82a00640 1 -- 172.21.15.59:0/4194110490 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c0ab640 con 0x7f9a8415f440 2024-04-25T09:09:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a82a00640 1 -- 172.21.15.59:0/4194110490 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6c0b0070 con 0x7f9a8415f440 2024-04-25T09:09:10.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a82a00640 1 -- 172.21.15.59:0/4194110490 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c0aba00 con 0x7f9a8415f440 2024-04-25T09:09:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a8a200640 1 -- 172.21.15.59:0/4194110490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8415f440 msgr2=0x7f9a8406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a8a200640 1 --2- 172.21.15.59:0/4194110490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8415f440 0x7f9a8406dad0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f9a8406e470 tx=0x7f9a6c01c420 comp rx=0 tx=0).stop 2024-04-25T09:09:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a8a200640 1 -- 172.21.15.59:0/4194110490 shutdown_connections 2024-04-25T09:09:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a8a200640 1 --2- 172.21.15.59:0/4194110490 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8415f440 0x7f9a8406dad0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a8a200640 1 --2- 172.21.15.59:0/4194110490 >> v2:172.21.15.178:3300/0 conn(0x7f9a84159320 0x7f9a8415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a8a200640 1 -- 172.21.15.59:0/4194110490 >> 172.21.15.59:0/4194110490 conn(0x7f9a84067080 msgr2=0x7f9a8406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:10.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a8a200640 1 -- 172.21.15.59:0/4194110490 shutdown_connections 2024-04-25T09:09:10.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a8a200640 1 -- 172.21.15.59:0/4194110490 wait complete. 2024-04-25T09:09:10.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a8a200640 1 Processor -- start 2024-04-25T09:09:10.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.567+0000 7f9a8a200640 1 -- start start 2024-04-25T09:09:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a8a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8406e010 0x7f9a841574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a8a200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a84159320 0x7f9a84142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a8a200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a8415f440 0x7f9a84142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a8a200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a84071c00 con 0x7f9a8406e010 2024-04-25T09:09:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a8a200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a84071a80 con 0x7f9a84159320 2024-04-25T09:09:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a8a200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8406ebb0 con 0x7f9a8415f440 2024-04-25T09:09:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a83400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8406e010 0x7f9a841574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a83400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8406e010 0x7f9a841574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46716/0 (socket says 172.21.15.59:46716) 2024-04-25T09:09:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a83400640 1 -- 172.21.15.59:0/3830979521 learned_addr learned my addr 172.21.15.59:0/3830979521 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a7be00640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a84159320 0x7f9a84142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a83e00640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a8415f440 0x7f9a84142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a83400640 1 -- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a8415f440 msgr2=0x7f9a84142670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a83400640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a8415f440 0x7f9a84142670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a83400640 1 -- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a84159320 msgr2=0x7f9a84142130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a83400640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a84159320 0x7f9a84142130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a83400640 1 -- 172.21.15.59:0/3830979521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a84142ca0 con 0x7f9a8406e010 2024-04-25T09:09:10.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a83400640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8406e010 0x7f9a841574e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400b550 tx=0x7f9a7400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a7b400640 1 -- 172.21.15.59:0/3830979521 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74014070 con 0x7f9a8406e010 2024-04-25T09:09:10.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a7b400640 1 -- 172.21.15.59:0/3830979521 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a74010890 con 0x7f9a8406e010 2024-04-25T09:09:10.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a8a200640 1 -- 172.21.15.59:0/3830979521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a84142f80 con 0x7f9a8406e010 2024-04-25T09:09:10.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a7b400640 1 -- 172.21.15.59:0/3830979521 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74010c80 con 0x7f9a8406e010 2024-04-25T09:09:10.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a8a200640 1 -- 172.21.15.59:0/3830979521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8413db00 con 0x7f9a8406e010 2024-04-25T09:09:10.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.571+0000 7f9a8a200640 1 -- 172.21.15.59:0/3830979521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a840745d0 con 0x7f9a8406e010 2024-04-25T09:09:10.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.575+0000 7f9a7b400640 1 -- 172.21.15.59:0/3830979521 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9a74017070 con 0x7f9a8406e010 2024-04-25T09:09:10.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.575+0000 7f9a7b400640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9a60066f60 0x7f9a60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.575+0000 7f9a7b400640 1 -- 172.21.15.59:0/3830979521 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f9a740850d0 con 0x7f9a8406e010 2024-04-25T09:09:10.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.575+0000 7f9a7be00640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9a60066f60 0x7f9a60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.575+0000 7f9a7be00640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9a60066f60 0x7f9a60069420 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0af000 tx=0x7f9a6c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.579+0000 7f9a7b400640 1 -- 172.21.15.59:0/3830979521 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9a74055710 con 0x7f9a8406e010 2024-04-25T09:09:10.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.739+0000 7f9a8a200640 1 -- 172.21.15.59:0/3830979521 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a840cd2f0 con 0x7f9a8406e010 2024-04-25T09:09:10.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.739+0000 7f9a7b400640 1 -- 172.21.15.59:0/3830979521 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v95) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a74010e20 con 0x7f9a8406e010 2024-04-25T09:09:10.730 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:09:10.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.743+0000 7f9a8a200640 1 -- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9a60066f60 msgr2=0x7f9a60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.743+0000 7f9a8a200640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9a60066f60 0x7f9a60069420 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0af000 tx=0x7f9a6c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:09:10.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.743+0000 7f9a8a200640 1 -- 172.21.15.59:0/3830979521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8406e010 msgr2=0x7f9a841574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.743+0000 7f9a8a200640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8406e010 0x7f9a841574e0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400b550 tx=0x7f9a7400ba10 comp rx=0 tx=0).stop 2024-04-25T09:09:10.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.743+0000 7f9a8a200640 1 -- 172.21.15.59:0/3830979521 shutdown_connections 2024-04-25T09:09:10.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.743+0000 7f9a8a200640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9a60066f60 0x7f9a60069420 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.743+0000 7f9a8a200640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9a8415f440 0x7f9a84142670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.743+0000 7f9a8a200640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9a84159320 0x7f9a84142130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.743+0000 7f9a8a200640 1 --2- 172.21.15.59:0/3830979521 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a8406e010 0x7f9a841574e0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.743+0000 7f9a8a200640 1 -- 172.21.15.59:0/3830979521 >> 172.21.15.59:0/3830979521 conn(0x7f9a84067080 msgr2=0x7f9a8415cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:10.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.743+0000 7f9a8a200640 1 -- 172.21.15.59:0/3830979521 shutdown_connections 2024-04-25T09:09:10.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.743+0000 7f9a8a200640 1 -- 172.21.15.59:0/3830979521 wait complete. 2024-04-25T09:09:10.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:09:10.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.903+0000 7f43c2800640 1 Processor -- start 2024-04-25T09:09:10.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.903+0000 7f43c2800640 1 -- start start 2024-04-25T09:09:10.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.907+0000 7f43c2800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43bc0b3090 0x7f43bc0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.907+0000 7f43c2800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc15bc40 con 0x7f43bc144120 2024-04-25T09:09:10.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.907+0000 7f43c2800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43bc15b3a0 con 0x7f43bc15acd0 2024-04-25T09:09:10.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.907+0000 7f43c2800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43bc15e490 con 0x7f43bc0b3090 2024-04-25T09:09:10.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.907+0000 7f43bbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43bc0b3090 0x7f43bc0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.907+0000 7f43bb400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f43bc144120 0x7f43bc0ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38746/0 (socket says 172.21.15.59:38746) 2024-04-25T09:09:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.907+0000 7f43bb400640 1 -- 172.21.15.59:0/2033116639 learned_addr learned my addr 172.21.15.59:0/2033116639 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.907+0000 7f43bbe00640 1 -- 172.21.15.59:0/2033116639 >> v1:172.21.15.178:6789/0 conn(0x7f43bc15acd0 legacy=0x7f43bc15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.907+0000 7f43bbe00640 1 -- 172.21.15.59:0/2033116639 >> v1:172.21.15.59:6789/0 conn(0x7f43bc144120 legacy=0x7f43bc0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.907+0000 7f43bbe00640 1 -- 172.21.15.59:0/2033116639 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc15b680 con 0x7f43bc0b3090 2024-04-25T09:09:10.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.907+0000 7f43baa00640 1 -- 172.21.15.59:0/2033116639 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857434254 0 0) 0x7f43bc15bc40 con 0x7f43bc144120 2024-04-25T09:09:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43bbe00640 1 --2- 172.21.15.59:0/2033116639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43bc0b3090 0x7f43bc0b3520 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009d90 tx=0x7f43b401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6adb21cb05d1bf5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43baa00640 1 -- 172.21.15.59:0/2033116639 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40b2070 con 0x7f43bc0b3090 2024-04-25T09:09:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43baa00640 1 -- 172.21.15.59:0/2033116639 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b40a5890 con 0x7f43bc0b3090 2024-04-25T09:09:10.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43baa00640 1 -- 172.21.15.59:0/2033116639 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40a5c60 con 0x7f43bc0b3090 2024-04-25T09:09:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 -- 172.21.15.59:0/2033116639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43bc0b3090 msgr2=0x7f43bc0b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 --2- 172.21.15.59:0/2033116639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43bc0b3090 0x7f43bc0b3520 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009d90 tx=0x7f43b401c8e0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 -- 172.21.15.59:0/2033116639 shutdown_connections 2024-04-25T09:09:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 --2- 172.21.15.59:0/2033116639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43bc0b3090 0x7f43bc0b3520 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 -- 172.21.15.59:0/2033116639 >> 172.21.15.59:0/2033116639 conn(0x7f43bc067080 msgr2=0x7f43bc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 -- 172.21.15.59:0/2033116639 shutdown_connections 2024-04-25T09:09:10.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 -- 172.21.15.59:0/2033116639 wait complete. 2024-04-25T09:09:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 Processor -- start 2024-04-25T09:09:10.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 -- start start 2024-04-25T09:09:10.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc0b3090 0x7f43bc13dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43bc144120 0x7f43bc13a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43bc15acd0 0x7f43bc13ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc1685d0 con 0x7f43bc15acd0 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc168450 con 0x7f43bc144120 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.911+0000 7f43c2800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43bc168750 con 0x7f43bc0b3090 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43bbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43bc15acd0 0x7f43bc13ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43bbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43bc15acd0 0x7f43bc13ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46744/0 (socket says 172.21.15.59:46744) 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43bbe00640 1 -- 172.21.15.59:0/3779613134 learned_addr learned my addr 172.21.15.59:0/3779613134 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43b3e00640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43bc144120 0x7f43bc13a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43bbe00640 1 -- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc0b3090 msgr2=0x7f43bc13dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43bb400640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc0b3090 0x7f43bc13dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43bbe00640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc0b3090 0x7f43bc13dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43bbe00640 1 -- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43bc144120 msgr2=0x7f43bc13a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:10.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43bbe00640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43bc144120 0x7f43bc13a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43bbe00640 1 -- 172.21.15.59:0/3779613134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc15d550 con 0x7f43bc15acd0 2024-04-25T09:09:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43b3e00640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43bc144120 0x7f43bc13a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43bb400640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc0b3090 0x7f43bc13dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43bbe00640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43bc15acd0 0x7f43bc13ae70 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f43b40b0040 tx=0x7f43b4019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43b3400640 1 -- 172.21.15.59:0/3779613134 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40b2040 con 0x7f43bc15acd0 2024-04-25T09:09:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43b3400640 1 -- 172.21.15.59:0/3779613134 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b40b8530 con 0x7f43bc15acd0 2024-04-25T09:09:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43b3400640 1 -- 172.21.15.59:0/3779613134 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b40b8920 con 0x7f43bc15acd0 2024-04-25T09:09:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43c2800640 1 -- 172.21.15.59:0/3779613134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43bc15d830 con 0x7f43bc15acd0 2024-04-25T09:09:10.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43c2800640 1 -- 172.21.15.59:0/3779613134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43bc15ddf0 con 0x7f43bc15acd0 2024-04-25T09:09:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43c2800640 1 -- 172.21.15.59:0/3779613134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43bc0745d0 con 0x7f43bc15acd0 2024-04-25T09:09:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.915+0000 7f43b3400640 1 -- 172.21.15.59:0/3779613134 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f43b40c1020 con 0x7f43bc15acd0 2024-04-25T09:09:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.919+0000 7f43b3400640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4398066f60 0x7f4398069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:10.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.919+0000 7f43b3400640 1 -- 172.21.15.59:0/3779613134 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f43b411fd90 con 0x7f43bc15acd0 2024-04-25T09:09:10.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.919+0000 7f43bb400640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4398066f60 0x7f4398069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:10.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.919+0000 7f43bb400640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4398066f60 0x7f4398069420 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f43ac000f70 tx=0x7f43ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:10.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:10.919+0000 7f43b3400640 1 -- 172.21.15.59:0/3779613134 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f43b40c8020 con 0x7f43bc15acd0 2024-04-25T09:09:11.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 -- 172.21.15.59:0/3779613134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f43bc0b4270 con 0x7f43bc15acd0 2024-04-25T09:09:11.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43b3400640 1 -- 172.21.15.59:0/3779613134 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v95) v1 ==== 80+0+122 (secure 0 0 0) 0x7f43b4016560 con 0x7f43bc15acd0 2024-04-25T09:09:11.084 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6835/3531112441 2024-04-26T09:07:59.742787+0000 2024-04-25T09:09:11.084 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6833/3531112441 2024-04-26T09:07:59.742787+0000 2024-04-25T09:09:11.084 INFO:teuthology.orchestra.run.smithi059.stderr:listed 2 entries 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 -- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4398066f60 msgr2=0x7f4398069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4398066f60 0x7f4398069420 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f43ac000f70 tx=0x7f43ac009040 comp rx=0 tx=0).stop 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 -- 172.21.15.59:0/3779613134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43bc15acd0 msgr2=0x7f43bc13ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43bc15acd0 0x7f43bc13ae70 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f43b40b0040 tx=0x7f43b4019680 comp rx=0 tx=0).stop 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 -- 172.21.15.59:0/3779613134 shutdown_connections 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4398066f60 0x7f4398069420 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43bc15acd0 0x7f43bc13ae70 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43bc144120 0x7f43bc13a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 --2- 172.21.15.59:0/3779613134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43bc0b3090 0x7f43bc13dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 -- 172.21.15.59:0/3779613134 >> 172.21.15.59:0/3779613134 conn(0x7f43bc067080 msgr2=0x7f43bc0b4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 -- 172.21.15.59:0/3779613134 shutdown_connections 2024-04-25T09:09:11.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.095+0000 7f43c2800640 1 -- 172.21.15.59:0/3779613134 wait complete. 2024-04-25T09:09:11.105 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:09:11.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:11.105 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:11.131 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:09:11.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:11.131 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:09:11.187 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.379+0000 7f556a000640 1 Processor -- start 2024-04-25T09:09:11.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.379+0000 7f556a000640 1 -- start start 2024-04-25T09:09:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f556a000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f556415dcd0 0x7f5564099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f556a000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55640cd460 0x7f5564099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f556a000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556406d740 con 0x7f556409a7a0 2024-04-25T09:09:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f556a000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55640cbfc0 con 0x7f556415dcd0 2024-04-25T09:09:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f556a000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556406cea0 con 0x7f55640cd460 2024-04-25T09:09:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f5568c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f556415dcd0 0x7f5564099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f5568c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f556415dcd0 0x7f5564099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46746/0 (socket says 172.21.15.59:46746) 2024-04-25T09:09:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f5568c00640 1 -- 172.21.15.59:0/655378276 learned_addr learned my addr 172.21.15.59:0/655378276 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f5569600640 1 --2- 172.21.15.59:0/655378276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55640cd460 0x7f5564099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f5568c00640 1 -- 172.21.15.59:0/655378276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55640cd460 msgr2=0x7f5564099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f5568c00640 1 --2- 172.21.15.59:0/655378276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55640cd460 0x7f5564099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f5568c00640 1 -- 172.21.15.59:0/655378276 >> v1:172.21.15.178:6789/0 conn(0x7f556409a7a0 legacy=0x7f55640cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.383+0000 7f5568c00640 1 -- 172.21.15.59:0/655378276 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f556406d180 con 0x7f556415dcd0 2024-04-25T09:09:11.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f5568c00640 1 --2- 172.21.15.59:0/655378276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f556415dcd0 0x7f5564099a60 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5386c9c22124cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f5563e00640 1 -- 172.21.15.59:0/655378276 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55540a95f0 con 0x7f556415dcd0 2024-04-25T09:09:11.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f5563e00640 1 -- 172.21.15.59:0/655378276 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55540a9790 con 0x7f556415dcd0 2024-04-25T09:09:11.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f5563e00640 1 -- 172.21.15.59:0/655378276 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55540a9b60 con 0x7f556415dcd0 2024-04-25T09:09:11.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f556a000640 1 -- 172.21.15.59:0/655378276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f556415dcd0 msgr2=0x7f5564099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f556a000640 1 --2- 172.21.15.59:0/655378276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f556415dcd0 0x7f5564099a60 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f5554009870 tx=0x7f555401c530 comp rx=0 tx=0).stop 2024-04-25T09:09:11.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f556a000640 1 -- 172.21.15.59:0/655378276 shutdown_connections 2024-04-25T09:09:11.376 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f556a000640 1 --2- 172.21.15.59:0/655378276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55640cd460 0x7f5564099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f556a000640 1 --2- 172.21.15.59:0/655378276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f556415dcd0 0x7f5564099a60 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f556a000640 1 -- 172.21.15.59:0/655378276 >> 172.21.15.59:0/655378276 conn(0x7f55640b3050 msgr2=0x7f55640b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f556a000640 1 -- 172.21.15.59:0/655378276 shutdown_connections 2024-04-25T09:09:11.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f556a000640 1 -- 172.21.15.59:0/655378276 wait complete. 2024-04-25T09:09:11.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f556a000640 1 Processor -- start 2024-04-25T09:09:11.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.387+0000 7f556a000640 1 -- start start 2024-04-25T09:09:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f556a000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f556409a7a0 0x7f55640c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f556a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55640cd460 0x7f5564151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f556a000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f556415dcd0 0x7f55641553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f556a000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556416aa20 con 0x7f55640cd460 2024-04-25T09:09:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f556a000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556416a8a0 con 0x7f556409a7a0 2024-04-25T09:09:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f556a000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556416aba0 con 0x7f556415dcd0 2024-04-25T09:09:11.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f555be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55640cd460 0x7f5564151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f555be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55640cd460 0x7f5564151d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46760/0 (socket says 172.21.15.59:46760) 2024-04-25T09:09:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f555be00640 1 -- 172.21.15.59:0/3904406382 learned_addr learned my addr 172.21.15.59:0/3904406382 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f5569600640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f556415dcd0 0x7f55641553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f5568c00640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f556409a7a0 0x7f55640c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f555be00640 1 -- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f556415dcd0 msgr2=0x7f55641553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f555be00640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f556415dcd0 0x7f55641553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f555be00640 1 -- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f556409a7a0 msgr2=0x7f55640c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f555be00640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f556409a7a0 0x7f55640c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.380 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f555be00640 1 -- 172.21.15.59:0/3904406382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55640af980 con 0x7f55640cd460 2024-04-25T09:09:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f555be00640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55640cd460 0x7f5564151d10 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f554c00c3a0 tx=0x7f554c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f5561600640 1 -- 172.21.15.59:0/3904406382 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c0052d0 con 0x7f55640cd460 2024-04-25T09:09:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f5561600640 1 -- 172.21.15.59:0/3904406382 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554c005470 con 0x7f55640cd460 2024-04-25T09:09:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f5561600640 1 -- 172.21.15.59:0/3904406382 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554c007260 con 0x7f55640cd460 2024-04-25T09:09:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f556a000640 1 -- 172.21.15.59:0/3904406382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55640c5140 con 0x7f55640cd460 2024-04-25T09:09:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f556a000640 1 -- 172.21.15.59:0/3904406382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55640b03e0 con 0x7f55640cd460 2024-04-25T09:09:11.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f556a000640 1 -- 172.21.15.59:0/3904406382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f556404efa0 con 0x7f55640cd460 2024-04-25T09:09:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.391+0000 7f5561600640 1 -- 172.21.15.59:0/3904406382 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f554c007400 con 0x7f55640cd460 2024-04-25T09:09:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.395+0000 7f5561600640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5540066f60 0x7f5540069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.395+0000 7f5561600640 1 -- 172.21.15.59:0/3904406382 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f554c084670 con 0x7f55640cd460 2024-04-25T09:09:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.395+0000 7f5568c00640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5540066f60 0x7f5540069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.395+0000 7f5568c00640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5540066f60 0x7f5540069420 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f55540ae000 tx=0x7f55540b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.399+0000 7f5561600640 1 -- 172.21.15.59:0/3904406382 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f554c054dd0 con 0x7f55640cd460 2024-04-25T09:09:11.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.591+0000 7f556a000640 1 -- 172.21.15.59:0/3904406382 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55640cecb0 con 0x7f55640cd460 2024-04-25T09:09:11.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.591+0000 7f5561600640 1 -- 172.21.15.59:0/3904406382 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f554c058e70 con 0x7f55640cd460 2024-04-25T09:09:11.582 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:11.582 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:08:10.759050+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":93,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7668},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7668":{"gid":7668,"name":"a","rank":0,"incarnation":68,"state":"up:active","state_seq":6,"addr":"172.21.15.59:6835/4079513876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":4079513876},{"type":"v1","addr":"172.21.15.59:6835","nonce":4079513876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:09:11.582 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 72 2024-04-25T09:09:11.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.595+0000 7f556a000640 1 -- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5540066f60 msgr2=0x7f5540069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.595+0000 7f556a000640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5540066f60 0x7f5540069420 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f55540ae000 tx=0x7f55540b3040 comp rx=0 tx=0).stop 2024-04-25T09:09:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.595+0000 7f556a000640 1 -- 172.21.15.59:0/3904406382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55640cd460 msgr2=0x7f5564151d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.595+0000 7f556a000640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55640cd460 0x7f5564151d10 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f554c00c3a0 tx=0x7f554c00c860 comp rx=0 tx=0).stop 2024-04-25T09:09:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.595+0000 7f556a000640 1 -- 172.21.15.59:0/3904406382 shutdown_connections 2024-04-25T09:09:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.595+0000 7f556a000640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5540066f60 0x7f5540069420 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.595+0000 7f556a000640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f556415dcd0 0x7f55641553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.595+0000 7f556a000640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55640cd460 0x7f5564151d10 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.595+0000 7f556a000640 1 --2- 172.21.15.59:0/3904406382 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f556409a7a0 0x7f55640c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.595+0000 7f556a000640 1 -- 172.21.15.59:0/3904406382 >> 172.21.15.59:0/3904406382 conn(0x7f55640b3050 msgr2=0x7f55641567b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.595+0000 7f556a000640 1 -- 172.21.15.59:0/3904406382 shutdown_connections 2024-04-25T09:09:11.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.595+0000 7f556a000640 1 -- 172.21.15.59:0/3904406382 wait complete. 2024-04-25T09:09:11.604 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:09:11.774 INFO:teuthology.orchestra.run.smithi059.stdout:{"message":"","return_code":0} 2024-04-25T09:09:11.775 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:09:11.775 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:09:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.927+0000 7f5269400640 1 Processor -- start 2024-04-25T09:09:11.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.927+0000 7f5269400640 1 -- start start 2024-04-25T09:09:11.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.927+0000 7f5269400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f526415dc60 0x7f52640d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.927+0000 7f5269400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f526406bf30 0x7f52640cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.927+0000 7f5269400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f526415e040 con 0x7f5264099a60 2024-04-25T09:09:11.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.927+0000 7f5269400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52640cff80 con 0x7f526406bf30 2024-04-25T09:09:11.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.927+0000 7f5269400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52640d0260 con 0x7f526415dc60 2024-04-25T09:09:11.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.927+0000 7f525be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f526406bf30 0x7f52640cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.927+0000 7f5263200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5264099a60 0x7f52640cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38762/0 (socket says 172.21.15.59:38762) 2024-04-25T09:09:11.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.927+0000 7f5263200640 1 -- 172.21.15.59:0/289565070 learned_addr learned my addr 172.21.15.59:0/289565070 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:11.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.927+0000 7f5262800640 1 --2- 172.21.15.59:0/289565070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f526415dc60 0x7f52640d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f525be00640 1 -- 172.21.15.59:0/289565070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f526415dc60 msgr2=0x7f52640d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:11.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f525be00640 1 --2- 172.21.15.59:0/289565070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f526415dc60 0x7f52640d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f525be00640 1 -- 172.21.15.59:0/289565070 >> v1:172.21.15.59:6789/0 conn(0x7f5264099a60 legacy=0x7f52640cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f525be00640 1 -- 172.21.15.59:0/289565070 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52640d0540 con 0x7f526406bf30 2024-04-25T09:09:11.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f5261e00640 1 -- 172.21.15.59:0/289565070 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2745363506 0 0) 0x7f526415e040 con 0x7f5264099a60 2024-04-25T09:09:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f525be00640 1 --2- 172.21.15.59:0/289565070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526406bf30 0x7f52640cf8a0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f524c0097c0 tx=0x7f524c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d6ba61c572606f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f5261e00640 1 -- 172.21.15.59:0/289565070 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c0b1070 con 0x7f526406bf30 2024-04-25T09:09:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f5261e00640 1 -- 172.21.15.59:0/289565070 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524c0a8050 con 0x7f526406bf30 2024-04-25T09:09:11.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f5261e00640 1 -- 172.21.15.59:0/289565070 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524c0ac860 con 0x7f526406bf30 2024-04-25T09:09:11.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f5269400640 1 -- 172.21.15.59:0/289565070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526406bf30 msgr2=0x7f52640cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f5269400640 1 --2- 172.21.15.59:0/289565070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526406bf30 0x7f52640cf8a0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f524c0097c0 tx=0x7f524c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f5269400640 1 -- 172.21.15.59:0/289565070 shutdown_connections 2024-04-25T09:09:11.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f5269400640 1 --2- 172.21.15.59:0/289565070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526406bf30 0x7f52640cf8a0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f5269400640 1 --2- 172.21.15.59:0/289565070 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f526415dc60 0x7f52640d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f5269400640 1 -- 172.21.15.59:0/289565070 >> 172.21.15.59:0/289565070 conn(0x7f52640b3200 msgr2=0x7f52640b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f5269400640 1 -- 172.21.15.59:0/289565070 shutdown_connections 2024-04-25T09:09:11.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.931+0000 7f5269400640 1 -- 172.21.15.59:0/289565070 wait complete. 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5269400640 1 Processor -- start 2024-04-25T09:09:11.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5269400640 1 -- start start 2024-04-25T09:09:11.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5269400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f526406bf30 0x7f52640cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5269400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5264099a60 0x7f5264159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5269400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526415dc60 0x7f526415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5269400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526406cfa0 con 0x7f526415dc60 2024-04-25T09:09:11.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5269400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52640cc880 con 0x7f5264099a60 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5269400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52640b5e00 con 0x7f526406bf30 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5263200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526415dc60 0x7f526415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5263200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526415dc60 0x7f526415ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46782/0 (socket says 172.21.15.59:46782) 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5263200640 1 -- 172.21.15.59:0/2701903871 learned_addr learned my addr 172.21.15.59:0/2701903871 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5262800640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f526406bf30 0x7f52640cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f525be00640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5264099a60 0x7f5264159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5263200640 1 -- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f526406bf30 msgr2=0x7f52640cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5263200640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f526406bf30 0x7f52640cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5263200640 1 -- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5264099a60 msgr2=0x7f5264159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5263200640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5264099a60 0x7f5264159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5263200640 1 -- 172.21.15.59:0/2701903871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52641559b0 con 0x7f526415dc60 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5263200640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526415dc60 0x7f526415ba80 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c7a0 tx=0x7f525c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f525aa00640 1 -- 172.21.15.59:0/2701903871 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c018070 con 0x7f526415dc60 2024-04-25T09:09:11.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f525aa00640 1 -- 172.21.15.59:0/2701903871 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c00a640 con 0x7f526415dc60 2024-04-25T09:09:11.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f525aa00640 1 -- 172.21.15.59:0/2701903871 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c00aab0 con 0x7f526415dc60 2024-04-25T09:09:11.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.935+0000 7f5269400640 1 -- 172.21.15.59:0/2701903871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52640c8da0 con 0x7f526415dc60 2024-04-25T09:09:11.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.939+0000 7f5269400640 1 -- 172.21.15.59:0/2701903871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52640b5a90 con 0x7f526415dc60 2024-04-25T09:09:11.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.939+0000 7f5269400640 1 -- 172.21.15.59:0/2701903871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52640745d0 con 0x7f526415dc60 2024-04-25T09:09:11.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.939+0000 7f525aa00640 1 -- 172.21.15.59:0/2701903871 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f525c01b070 con 0x7f526415dc60 2024-04-25T09:09:11.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.939+0000 7f525aa00640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5240066f60 0x7f5240069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:11.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.939+0000 7f525aa00640 1 -- 172.21.15.59:0/2701903871 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6303+0+0 (secure 0 0 0) 0x7f525c084860 con 0x7f526415dc60 2024-04-25T09:09:11.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.939+0000 7f5262800640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5240066f60 0x7f5240069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:11.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.943+0000 7f5262800640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5240066f60 0x7f5240069420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f52540079c0 tx=0x7f5254008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:11.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:11.943+0000 7f525aa00640 1 -- 172.21.15.59:0/2701903871 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f525c054f30 con 0x7f526415dc60 2024-04-25T09:09:12.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.139+0000 7f5269400640 1 -- 172.21.15.59:0/2701903871 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f52640b7590 con 0x7f526415dc60 2024-04-25T09:09:12.129 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:09:12.139+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:09:12.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.143+0000 7f525aa00640 1 -- 172.21.15.59:0/2701903871 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7f525c058fd0 con 0x7f526415dc60 2024-04-25T09:09:12.132 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:09:12.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.147+0000 7f5269400640 1 -- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5240066f60 msgr2=0x7f5240069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.147+0000 7f5269400640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5240066f60 0x7f5240069420 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f52540079c0 tx=0x7f5254008040 comp rx=0 tx=0).stop 2024-04-25T09:09:12.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.147+0000 7f5269400640 1 -- 172.21.15.59:0/2701903871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526415dc60 msgr2=0x7f526415ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.147+0000 7f5269400640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526415dc60 0x7f526415ba80 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f525c00c7a0 tx=0x7f525c00cc60 comp rx=0 tx=0).stop 2024-04-25T09:09:12.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.147+0000 7f5269400640 1 -- 172.21.15.59:0/2701903871 shutdown_connections 2024-04-25T09:09:12.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.147+0000 7f5269400640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5240066f60 0x7f5240069420 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.147+0000 7f5269400640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f526415dc60 0x7f526415ba80 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.147+0000 7f5269400640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5264099a60 0x7f5264159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.147+0000 7f5269400640 1 --2- 172.21.15.59:0/2701903871 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f526406bf30 0x7f52640cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.147+0000 7f5269400640 1 -- 172.21.15.59:0/2701903871 >> 172.21.15.59:0/2701903871 conn(0x7f52640b3200 msgr2=0x7f52640cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.147+0000 7f5269400640 1 -- 172.21.15.59:0/2701903871 shutdown_connections 2024-04-25T09:09:12.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.147+0000 7f5269400640 1 -- 172.21.15.59:0/2701903871 wait complete. 2024-04-25T09:09:12.143 INFO:tasks.ceph.mds.a.smithi059.stderr: -4505> 2024-04-25T09:08:05.756+0000 7f2ae7000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:09:12.144 INFO:tasks.ceph.mds.a.smithi059.stderr: -4171> 2024-04-25T09:08:06.404+0000 7f2ae2000640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-25T09:09:12.144 INFO:tasks.ceph.mds.a.smithi059.stderr: -4012> 2024-04-25T09:08:06.644+0000 7f2ae2000640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 ap=1 f(v0 m2024-04-25T09:07:56.592552+0000 1=1+0) n(v0 rc2024-04-25T09:07:56.700551+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x56455cf41b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T09:07:56.592552+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T09:07:56.700551+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-25T09:09:12.148 INFO:tasks.ceph.mds.a.smithi059.stderr: -2265> 2024-04-25T09:08:38.240+0000 7f2ae2000640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v15 pv18 ap=3 DIRTYPARENT f(v0 m2024-04-25T09:07:56.592552+0000 1=1+0)->f(v1 m2024-04-25T09:07:56.592552+0000) n(v0 rc2024-04-25T09:07:56.700551+0000 2=1+1)->n(v0 rc2024-04-25T09:07:56.700551+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyrstat=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x56455cf41b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(13)0x10000000000:[<0x1/dir v15>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-25T09:07:56.592552+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-25T09:07:56.700551+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-25T09:09:12.156 DEBUG:teuthology.orchestra.run.smithi059:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-25T09:09:12.192 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:09:12.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.211+0000 7f6b91a398c0 1 -- start start 2024-04-25T09:09:12.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.211+0000 7f6b91a398c0 1 Processor -- start 2024-04-25T09:09:12.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.211+0000 7f6b91a398c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d415f5800 0x557d417afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.211+0000 7f6b91a398c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d415f5400 0x557d417af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.211+0000 7f6b91a398c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d415f5000 0x557d417af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.211+0000 7f6b91a398c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d416f2180 con 0x557d415f5000 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.211+0000 7f6b91a398c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d41654900 con 0x557d415f5400 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.211+0000 7f6b91a398c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d41654480 con 0x557d415f5800 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.211+0000 7f6b90400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d415f5000 0x557d417af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.211+0000 7f6b90400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d415f5000 0x557d417af080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46812/0 (socket says 172.21.15.59:46812) 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.211+0000 7f6b90400640 1 -- 172.21.15.59:0/2341060817 learned_addr learned my addr 172.21.15.59:0/2341060817 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8f000640 1 --2- 172.21.15.59:0/2341060817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d415f5400 0x557d417af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8fa00640 1 --2- 172.21.15.59:0/2341060817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d415f5800 0x557d417afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b90400640 1 -- 172.21.15.59:0/2341060817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d415f5800 msgr2=0x557d417afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b90400640 1 --2- 172.21.15.59:0/2341060817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d415f5800 0x557d417afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b90400640 1 -- 172.21.15.59:0/2341060817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d415f5400 msgr2=0x557d417af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b90400640 1 --2- 172.21.15.59:0/2341060817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d415f5400 0x557d417af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b90400640 1 -- 172.21.15.59:0/2341060817 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d4161a1e0 con 0x557d415f5000 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8f000640 1 --2- 172.21.15.59:0/2341060817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d415f5400 0x557d417af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b90400640 1 --2- 172.21.15.59:0/2341060817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d415f5000 0x557d417af080 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x557d42439c50 tx=0x557d416cf1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58af22fa4187ad7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8c800640 1 -- 172.21.15.59:0/2341060817 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557d4162a4e0 con 0x557d415f5000 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8c800640 1 -- 172.21.15.59:0/2341060817 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557d4163e1c0 con 0x557d415f5000 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8c800640 1 -- 172.21.15.59:0/2341060817 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557d4162ab60 con 0x557d415f5000 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 1 -- 172.21.15.59:0/2341060817 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d4161b2c0 con 0x557d415f5000 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 1 -- 172.21.15.59:0/2341060817 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x557d4161ba40 con 0x557d415f5000 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 4 waiting for MDS map... 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8c800640 1 -- 172.21.15.59:0/2341060817 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x557d4250a600 con 0x557d415f5000 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8c800640 1 -- 172.21.15.59:0/2341060817 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 73) v1 ==== 2723+0+0 (secure 0 0 0) 0x557d4164b180 con 0x557d415f5000 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 4 Got MDS map 73 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 4 datascan.main: Using metadata pool output 2024-04-25T09:09:12.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 4 datascan.main: connecting to RADOS... 2024-04-25T09:09:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 1 Processor -- start 2024-04-25T09:09:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 1 -- start start 2024-04-25T09:09:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d4250ec00 0x557d417aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 0x557d417ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d4250f400 0x557d417b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d41654180 con 0x557d4250f000 2024-04-25T09:09:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d416f2d80 con 0x557d4250f400 2024-04-25T09:09:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b91a398c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d416f2f00 con 0x557d4250ec00 2024-04-25T09:09:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8fa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 0x557d417ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8fa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 0x557d417ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46824/0 (socket says 172.21.15.59:46824) 2024-04-25T09:09:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1049398227 learned_addr learned my addr 172.21.15.59:0/1049398227 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:12.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8f000640 1 --2- 172.21.15.59:0/1049398227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d4250ec00 0x557d417aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8f000640 1 --2- 172.21.15.59:0/1049398227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d4250f400 0x557d417b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1049398227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d4250ec00 msgr2=0x557d417aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8fa00640 1 --2- 172.21.15.59:0/1049398227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d4250ec00 0x557d417aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1049398227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d4250f400 msgr2=0x557d417b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8fa00640 1 --2- 172.21.15.59:0/1049398227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d4250f400 0x557d417b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1049398227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d4161bc20 con 0x557d4250f000 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.215+0000 7f6b8fa00640 1 --2- 172.21.15.59:0/1049398227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 0x557d417ae580 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x557d42504a50 tx=0x557d42526c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de3165eb8192fe6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8a000640 1 -- 172.21.15.59:0/1049398227 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557d4162a4e0 con 0x557d4250f000 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8a000640 1 -- 172.21.15.59:0/1049398227 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557d4163ee00 con 0x557d4250f000 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8a000640 1 -- 172.21.15.59:0/1049398227 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557d4162ab60 con 0x557d4250f000 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1049398227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 msgr2=0x557d417ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1049398227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 0x557d417ae580 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x557d42504a50 tx=0x557d42526c00 comp rx=0 tx=0).stop 2024-04-25T09:09:12.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1049398227 shutdown_connections 2024-04-25T09:09:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1049398227 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d4250f400 0x557d417b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1049398227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 0x557d417ae580 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1049398227 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d4250ec00 0x557d417aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1049398227 >> 172.21.15.59:0/1049398227 conn(0x557d415f4c00 msgr2=0x557d41623800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1049398227 shutdown_connections 2024-04-25T09:09:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1049398227 wait complete. 2024-04-25T09:09:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 Processor -- start 2024-04-25T09:09:12.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 -- start start 2024-04-25T09:09:12.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d4250ec00 0x557d417aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 0x557d417ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d4250f400 0x557d417b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d416f3200 con 0x557d4250f000 2024-04-25T09:09:12.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d416f3080 con 0x557d4250ec00 2024-04-25T09:09:12.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d416f3380 con 0x557d4250f400 2024-04-25T09:09:12.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8fa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 0x557d417ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8fa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 0x557d417ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46826/0 (socket says 172.21.15.59:46826) 2024-04-25T09:09:12.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 learned_addr learned my addr 172.21.15.59:0/1433716563 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:12.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8f000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d4250ec00 0x557d417aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8f000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d4250f400 0x557d417b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d4250f400 msgr2=0x557d417b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8fa00640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d4250f400 0x557d417b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d4250ec00 msgr2=0x557d417aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8fa00640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d4250ec00 0x557d417aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d4161a1e0 con 0x557d4250f000 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b8fa00640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 0x557d417ae580 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x557d42505d10 tx=0x557d416b8de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b88200640 1 -- 172.21.15.59:0/1433716563 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557d4162a000 con 0x557d4250f000 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b88200640 1 -- 172.21.15.59:0/1433716563 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557d4163e540 con 0x557d4250f000 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557d4161b2c0 con 0x557d4250f000 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b88200640 1 -- 172.21.15.59:0/1433716563 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557d4162a4e0 con 0x557d4250f000 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d4161be00 con 0x557d4250f000 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.219+0000 7f6b91a398c0 4 datascan.init: resolving metadata pool 13 2024-04-25T09:09:12.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.223+0000 7f6b88200640 1 -- 172.21.15.59:0/1433716563 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x557d4191ec00 con 0x557d4250f000 2024-04-25T09:09:12.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.223+0000 7f6b88200640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x557d41928c00 0x557d41a14000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.223+0000 7f6b88200640 1 -- 172.21.15.59:0/1433716563 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x557d4191ca00 con 0x557d4250f000 2024-04-25T09:09:12.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.223+0000 7f6b91a398c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:09:12.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.223+0000 7f6b91a398c0 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-04-25T09:09:12.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.223+0000 7f6b91a398c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T09:09:12.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.223+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x557d4250f800 0x557d417b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.223+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:1 14.0 14:00000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d4250fc00 con 0x557d4250f800 2024-04-25T09:09:12.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.223+0000 7f6b8f000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x557d41928c00 0x557d41a14000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.223+0000 7f6b8f000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x557d4250f800 0x557d417b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.223+0000 7f6b8f000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x557d4250f800 0x557d417b0680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.223+0000 7f6b8f000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x557d41928c00 0x557d41a14000 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x557d42438f60 tx=0x557d41696300 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.227+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.2 v2:172.21.15.59:6824/4113007731 1 ==== osd_op_reply(1 [pgnls start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d4250f800 2024-04-25T09:09:12.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.227+0000 7f6b89600640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x557d41929000 0x557d41a14580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.227+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:2 14.20 14:04000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41929400 con 0x557d41929000 2024-04-25T09:09:12.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.227+0000 7f6b90400640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x557d41929000 0x557d41a14580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.227+0000 7f6b90400640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x557d41929000 0x557d41a14580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.227+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== osd_op_reply(2 [pgnls start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.227+0000 7f6b8a000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x557d41929c00 0x557d41a14b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.227+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:3 14.10 14:08000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a38000 con 0x557d41929c00 2024-04-25T09:09:12.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.227+0000 7f6b8fa00640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x557d41929c00 0x557d41a14b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.227+0000 7f6b8fa00640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x557d41929c00 0x557d41a14b00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.231+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(3 [pgnls start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41929c00 2024-04-25T09:09:12.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.231+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:4 14.30 14:0c000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41929800 con 0x557d41929000 2024-04-25T09:09:12.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.231+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 2 ==== osd_op_reply(4 [pgnls start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.231+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:5 14.8 14:10000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a38400 con 0x557d41929000 2024-04-25T09:09:12.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.231+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 3 ==== osd_op_reply(5 [pgnls start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.231+0000 7f6b89600640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x557d41929400 0x557d41a15080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.231+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:6 14.28 14:14000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d4250e800 con 0x557d41929400 2024-04-25T09:09:12.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.231+0000 7f6b8f000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x557d41929400 0x557d41a15080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.231+0000 7f6b8f000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x557d41929400 0x557d41a15080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.235+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.3 v2:172.21.15.59:6808/3810214969 1 ==== osd_op_reply(6 [pgnls start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d41929400 2024-04-25T09:09:12.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.235+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:7 14.18 14:18000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a38400 con 0x557d41929c00 2024-04-25T09:09:12.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.235+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.1 v2:172.21.15.59:6809/1450066050 2 ==== osd_op_reply(7 [pgnls start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41929c00 2024-04-25T09:09:12.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.235+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:8 14.38 14:1c000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d4250e400 con 0x557d4250f800 2024-04-25T09:09:12.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.235+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.2 v2:172.21.15.59:6824/4113007731 2 ==== osd_op_reply(8 [pgnls start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d4250f800 2024-04-25T09:09:12.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.235+0000 7f6b8a000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x557d41a38800 0x557d41a15b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.235+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:9 14.4 14:20000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41929800 con 0x557d41a38800 2024-04-25T09:09:12.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.235+0000 7f6b90400640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x557d41a38800 0x557d41a15b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.235+0000 7f6b90400640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x557d41a38800 0x557d41a15b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.239+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(9 [pgnls start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41a38800 2024-04-25T09:09:12.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.239+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:10 14.24 14:24000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d4250fc00 con 0x557d41929c00 2024-04-25T09:09:12.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.239+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.1 v2:172.21.15.59:6809/1450066050 3 ==== osd_op_reply(10 [pgnls start_epoch 96 out=49b] v92'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41929c00 2024-04-25T09:09:12.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.239+0000 7f6b8a000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x557d41a38c00 0x557d41a16100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.239+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:11 14.14 14:28000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a39000 con 0x557d41a38c00 2024-04-25T09:09:12.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.239+0000 7f6b8fa00640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x557d41a38c00 0x557d41a16100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.239+0000 7f6b8fa00640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x557d41a38c00 0x557d41a16100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.239+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.4 v2:172.21.15.178:6805/2278719369 1 ==== osd_op_reply(11 [pgnls start_epoch 96 out=49b] v92'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41a38c00 2024-04-25T09:09:12.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.239+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:12 14.34 14:2c000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d4250e800 con 0x557d4250f800 2024-04-25T09:09:12.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.239+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.2 v2:172.21.15.59:6824/4113007731 3 ==== osd_op_reply(12 [pgnls start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d4250f800 2024-04-25T09:09:12.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.239+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:13 14.c 14:30000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a39400 con 0x557d41929000 2024-04-25T09:09:12.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 4 ==== osd_op_reply(13 [pgnls start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:14 14.2c 14:34000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d423c9400 con 0x557d41929c00 2024-04-25T09:09:12.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.1 v2:172.21.15.59:6809/1450066050 4 ==== osd_op_reply(14 [pgnls start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41929c00 2024-04-25T09:09:12.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:15 14.1c 14:38000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d4250e400 con 0x557d41929000 2024-04-25T09:09:12.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 5 ==== osd_op_reply(15 [pgnls start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:16 14.3c 14:3c000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d423c9000 con 0x557d41929c00 2024-04-25T09:09:12.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.1 v2:172.21.15.59:6809/1450066050 5 ==== osd_op_reply(16 [pgnls start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41929c00 2024-04-25T09:09:12.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:17 14.2 14:40000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a38000 con 0x557d41a38800 2024-04-25T09:09:12.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.6 v2:172.21.15.178:6800/2032393933 2 ==== osd_op_reply(17 [pgnls start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41a38800 2024-04-25T09:09:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:18 14.22 14:44000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a39c00 con 0x557d41a38c00 2024-04-25T09:09:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.4 v2:172.21.15.178:6805/2278719369 2 ==== osd_op_reply(18 [pgnls start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41a38c00 2024-04-25T09:09:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:19 14.12 14:48000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a38400 con 0x557d4250f800 2024-04-25T09:09:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.2 v2:172.21.15.59:6824/4113007731 4 ==== osd_op_reply(19 [pgnls start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d4250f800 2024-04-25T09:09:12.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:20 14.32 14:4c000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4c000 con 0x557d41a38c00 2024-04-25T09:09:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.4 v2:172.21.15.178:6805/2278719369 3 ==== osd_op_reply(20 [pgnls start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41a38c00 2024-04-25T09:09:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8a000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x557d41a39000 0x557d41a16680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:21 14.a 14:50000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a39800 con 0x557d41a39000 2024-04-25T09:09:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8f000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x557d41a39000 0x557d41a16680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8f000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x557d41a39000 0x557d41a16680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.243+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.5 v2:172.21.15.178:6802/3576783051 1 ==== osd_op_reply(21 [pgnls start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d41a39000 2024-04-25T09:09:12.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:22 14.2a 14:54000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4c400 con 0x557d41a38c00 2024-04-25T09:09:12.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.4 v2:172.21.15.178:6805/2278719369 4 ==== osd_op_reply(22 [pgnls start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41a38c00 2024-04-25T09:09:12.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:23 14.1a 14:58000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d4250fc00 con 0x557d41929000 2024-04-25T09:09:12.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 6 ==== osd_op_reply(23 [pgnls start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:24 14.3a 14:5c000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4c800 con 0x557d41929000 2024-04-25T09:09:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 7 ==== osd_op_reply(24 [pgnls start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:25 14.6 14:60000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a39400 con 0x557d41929000 2024-04-25T09:09:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 8 ==== osd_op_reply(25 [pgnls start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:26 14.26 14:64000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4cc00 con 0x557d41a38c00 2024-04-25T09:09:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.4 v2:172.21.15.178:6805/2278719369 5 ==== osd_op_reply(26 [pgnls start_epoch 96 out=49b] v92'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41a38c00 2024-04-25T09:09:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:27 14.16 14:68000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d423c9400 con 0x557d41929400 2024-04-25T09:09:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.3 v2:172.21.15.59:6808/3810214969 2 ==== osd_op_reply(27 [pgnls start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d41929400 2024-04-25T09:09:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:28 14.36 14:6c000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4d000 con 0x557d4250f800 2024-04-25T09:09:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.2 v2:172.21.15.59:6824/4113007731 5 ==== osd_op_reply(28 [pgnls start_epoch 96 out=49b] v92'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d4250f800 2024-04-25T09:09:12.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:29 14.e 14:70000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d423c9000 con 0x557d41a38c00 2024-04-25T09:09:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.4 v2:172.21.15.178:6805/2278719369 6 ==== osd_op_reply(29 [pgnls start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41a38c00 2024-04-25T09:09:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:30 14.2e 14:74000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4d400 con 0x557d41929400 2024-04-25T09:09:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.3 v2:172.21.15.59:6808/3810214969 3 ==== osd_op_reply(30 [pgnls start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d41929400 2024-04-25T09:09:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b8a000640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x557d4250e400 0x557d41a16c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:31 14.1e 14:78000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d4250fc00 con 0x557d4250e400 2024-04-25T09:09:12.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.247+0000 7f6b90400640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x557d4250e400 0x557d41a16c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.251+0000 7f6b90400640 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x557d4250e400 0x557d41a16c00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.251+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== osd_op_reply(31 [pgnls start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d4250e400 2024-04-25T09:09:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.251+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:32 14.3e 14:7c000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4d000 con 0x557d41a39000 2024-04-25T09:09:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.251+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.5 v2:172.21.15.178:6802/3576783051 2 ==== osd_op_reply(32 [pgnls start_epoch 96 out=49b] v92'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d41a39000 2024-04-25T09:09:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.251+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:33 14.1 14:80000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41929800 con 0x557d41929400 2024-04-25T09:09:12.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.3 v2:172.21.15.59:6808/3810214969 4 ==== osd_op_reply(33 [pgnls start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d41929400 2024-04-25T09:09:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:34 14.21 14:84000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a38400 con 0x557d41a39000 2024-04-25T09:09:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.5 v2:172.21.15.178:6802/3576783051 3 ==== osd_op_reply(34 [pgnls start_epoch 96 out=49b] v92'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d41a39000 2024-04-25T09:09:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:35 14.11 14:88000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4d400 con 0x557d41a38c00 2024-04-25T09:09:12.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.4 v2:172.21.15.178:6805/2278719369 7 ==== osd_op_reply(35 [pgnls start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41a38c00 2024-04-25T09:09:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:36 14.31 14:8c000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a39800 con 0x557d41929c00 2024-04-25T09:09:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.1 v2:172.21.15.59:6809/1450066050 6 ==== osd_op_reply(36 [pgnls start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41929c00 2024-04-25T09:09:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:37 14.9 14:90000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4c800 con 0x557d41a39000 2024-04-25T09:09:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.5 v2:172.21.15.178:6802/3576783051 4 ==== osd_op_reply(37 [pgnls start_epoch 96 out=49b] v92'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d41a39000 2024-04-25T09:09:12.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:38 14.29 14:94000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a38000 con 0x557d41a38800 2024-04-25T09:09:12.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.6 v2:172.21.15.178:6800/2032393933 3 ==== osd_op_reply(38 [pgnls start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41a38800 2024-04-25T09:09:12.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:39 14.19 14:98000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4c000 con 0x557d41a38800 2024-04-25T09:09:12.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.6 v2:172.21.15.178:6800/2032393933 4 ==== osd_op_reply(39 [pgnls start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41a38800 2024-04-25T09:09:12.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:40 14.39 14:9c000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a39c00 con 0x557d4250e400 2024-04-25T09:09:12.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.7 v2:172.21.15.178:6824/965369534 2 ==== osd_op_reply(40 [pgnls start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d4250e400 2024-04-25T09:09:12.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.255+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:41 14.5 14:a0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4c400 con 0x557d41929000 2024-04-25T09:09:12.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 9 ==== osd_op_reply(41 [pgnls start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:42 14.25 14:a4000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d423c9400 con 0x557d4250f800 2024-04-25T09:09:12.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.2 v2:172.21.15.59:6824/4113007731 6 ==== osd_op_reply(42 [pgnls start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d4250f800 2024-04-25T09:09:12.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:43 14.15 14:a8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4d800 con 0x557d4250e400 2024-04-25T09:09:12.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.7 v2:172.21.15.178:6824/965369534 3 ==== osd_op_reply(43 [pgnls start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d4250e400 2024-04-25T09:09:12.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:44 14.35 14:ac000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d4250e800 con 0x557d41a38c00 2024-04-25T09:09:12.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.4 v2:172.21.15.178:6805/2278719369 8 ==== osd_op_reply(44 [pgnls start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41a38c00 2024-04-25T09:09:12.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:45 14.d 14:b0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4dc00 con 0x557d41a38800 2024-04-25T09:09:12.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.6 v2:172.21.15.178:6800/2032393933 5 ==== osd_op_reply(45 [pgnls start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41a38800 2024-04-25T09:09:12.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:46 14.2d 14:b4000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4c000 con 0x557d41a38c00 2024-04-25T09:09:12.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.4 v2:172.21.15.178:6805/2278719369 9 ==== osd_op_reply(46 [pgnls start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41a38c00 2024-04-25T09:09:12.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:47 14.1d 14:b8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4cc00 con 0x557d41929000 2024-04-25T09:09:12.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 10 ==== osd_op_reply(47 [pgnls start_epoch 96 out=49b] v92'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:48 14.3d 14:bc000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4c400 con 0x557d41929400 2024-04-25T09:09:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.3 v2:172.21.15.59:6808/3810214969 5 ==== osd_op_reply(48 [pgnls start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d41929400 2024-04-25T09:09:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:49 14.3 14:c0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4d400 con 0x557d41929000 2024-04-25T09:09:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 11 ==== osd_op_reply(49 [pgnls start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:50 14.23 14:c4000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4d800 con 0x557d4250e400 2024-04-25T09:09:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.7 v2:172.21.15.178:6824/965369534 4 ==== osd_op_reply(50 [pgnls start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d4250e400 2024-04-25T09:09:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.259+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:51 14.13 14:c8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4c000 con 0x557d4250f800 2024-04-25T09:09:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.2 v2:172.21.15.59:6824/4113007731 7 ==== osd_op_reply(51 [pgnls start_epoch 96 out=49b] v92'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d4250f800 2024-04-25T09:09:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:52 14.33 14:cc000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a39400 con 0x557d41929c00 2024-04-25T09:09:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.1 v2:172.21.15.59:6809/1450066050 7 ==== osd_op_reply(52 [pgnls start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41929c00 2024-04-25T09:09:12.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:53 14.b 14:d0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d4250e800 con 0x557d41929000 2024-04-25T09:09:12.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 12 ==== osd_op_reply(53 [pgnls start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:54 14.2b 14:d4000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a38000 con 0x557d41a38c00 2024-04-25T09:09:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.4 v2:172.21.15.178:6805/2278719369 10 ==== osd_op_reply(54 [pgnls start_epoch 96 out=49b] v92'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41a38c00 2024-04-25T09:09:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:55 14.1b 14:d8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a39800 con 0x557d4250e400 2024-04-25T09:09:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.7 v2:172.21.15.178:6824/965369534 5 ==== osd_op_reply(55 [pgnls start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d4250e400 2024-04-25T09:09:12.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:56 14.3b 14:dc000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a39c00 con 0x557d41a38c00 2024-04-25T09:09:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.4 v2:172.21.15.178:6805/2278719369 11 ==== osd_op_reply(56 [pgnls start_epoch 96 out=49b] v92'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41a38c00 2024-04-25T09:09:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:57 14.7 14:e0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d423c9000 con 0x557d41a39000 2024-04-25T09:09:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.5 v2:172.21.15.178:6802/3576783051 5 ==== osd_op_reply(57 [pgnls start_epoch 96 out=81b] v92'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x557d41704000 con 0x557d41a39000 2024-04-25T09:09:12.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:58 14.7 14:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4d000 con 0x557d41a39000 2024-04-25T09:09:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.5 v2:172.21.15.178:6802/3576783051 6 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x557d41704000 con 0x557d41a39000 2024-04-25T09:09:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b91a398c0 10 datascan.operator(): handling object 1099511627777.0 2024-04-25T09:09:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.263+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:59 14.7 14:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4c800 con 0x557d41a39000 2024-04-25T09:09:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.5 v2:172.21.15.178:6802/3576783051 7 ==== osd_op_reply(59 10000000001.00000000 [call] v96'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x557d41704000 con 0x557d41a39000 2024-04-25T09:09:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:60 14.27 14:e4000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a4c400 con 0x557d41a39000 2024-04-25T09:09:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.5 v2:172.21.15.178:6802/3576783051 8 ==== osd_op_reply(60 [pgnls start_epoch 96 out=49b] v92'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d41a39000 2024-04-25T09:09:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:61 14.17 14:e8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a5a000 con 0x557d41929c00 2024-04-25T09:09:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.1 v2:172.21.15.59:6809/1450066050 8 ==== osd_op_reply(61 [pgnls start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41929c00 2024-04-25T09:09:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:62 14.37 14:ec000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d4250fc00 con 0x557d41a38c00 2024-04-25T09:09:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 <== osd.4 v2:172.21.15.178:6805/2278719369 12 ==== osd_op_reply(62 [pgnls start_epoch 96 out=49b] v92'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704780 con 0x557d41a38c00 2024-04-25T09:09:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:63 14.f 14:f0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a5a400 con 0x557d4250e400 2024-04-25T09:09:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.7 v2:172.21.15.178:6824/965369534 6 ==== osd_op_reply(63 [pgnls start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d4250e400 2024-04-25T09:09:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:64 14.2f 14:f4000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a5e000 con 0x557d41929000 2024-04-25T09:09:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 13 ==== osd_op_reply(64 [pgnls start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b8a000640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:65 14.1f 14:f8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a5a800 con 0x557d41929000 2024-04-25T09:09:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b90400640 1 -- 172.21.15.59:0/1433716563 <== osd.0 v2:172.21.15.59:6800/4129855307 14 ==== osd_op_reply(65 [pgnls start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704500 con 0x557d41929000 2024-04-25T09:09:12.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b89600640 1 -- 172.21.15.59:0/1433716563 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:66 14.3f 14:fc000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x557d41a5e400 con 0x557d41929400 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b8f000640 1 -- 172.21.15.59:0/1433716563 <== osd.3 v2:172.21.15.59:6808/3810214969 6 ==== osd_op_reply(66 [pgnls start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557d41704000 con 0x557d41929400 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x557d41929000 msgr2=0x557d41a14580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x557d41929000 0x557d41a14580 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x557d41929c00 msgr2=0x557d41a14b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x557d41929c00 0x557d41a14b00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x557d4250f800 msgr2=0x557d417b0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x557d4250f800 0x557d417b0680 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x557d41929400 msgr2=0x557d41a15080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x557d41929400 0x557d41a15080 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x557d41a38c00 msgr2=0x557d41a16100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x557d41a38c00 0x557d41a16100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x557d41a39000 msgr2=0x557d41a16680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x557d41a39000 0x557d41a16680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x557d41a38800 msgr2=0x557d41a15b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x557d41a38800 0x557d41a15b80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x557d4250e400 msgr2=0x557d41a16c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x557d4250e400 0x557d41a16c00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 reap_dead start 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 reap_dead start 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 reap_dead start 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b8fa00640 1 -- 172.21.15.59:0/1433716563 reap_dead start 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x557d41928c00 msgr2=0x557d41a14000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x557d41928c00 0x557d41a14000 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x557d42438f60 tx=0x557d41696300 comp rx=0 tx=0).stop 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 msgr2=0x557d417ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.267+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 0x557d417ae580 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x557d42505d10 tx=0x557d416b8de0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 shutdown_connections 2024-04-25T09:09:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x557d41928c00 0x557d41a14000 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/1433716563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d4250f000 0x557d417ae580 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 >> 172.21.15.59:0/1433716563 conn(0x557d415f4c00 msgr2=0x557d41623800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 shutdown_connections 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 -- 172.21.15.59:0/1433716563 wait complete. 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 -- 172.21.15.59:0/2341060817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d415f5000 msgr2=0x557d417af080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/2341060817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d415f5000 0x557d417af080 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x557d42439c50 tx=0x557d416cf1a0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 -- 172.21.15.59:0/2341060817 shutdown_connections 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/2341060817 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d415f5000 0x557d417af080 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/2341060817 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d415f5400 0x557d417af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 --2- 172.21.15.59:0/2341060817 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d415f5800 0x557d417afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 -- 172.21.15.59:0/2341060817 >> 172.21.15.59:0/2341060817 conn(0x557d415f5c00 msgr2=0x557d41623000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 -- 172.21.15.59:0/2341060817 shutdown_connections 2024-04-25T09:09:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.271+0000 7f6b91a398c0 1 -- 172.21.15.59:0/2341060817 wait complete. 2024-04-25T09:09:12.264 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.108109, result: 2024-04-25T09:09:12.264 DEBUG:teuthology.orchestra.run.smithi059:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-04-25T09:09:12.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9068c058c0 1 -- start start 2024-04-25T09:09:12.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9068c058c0 1 Processor -- start 2024-04-25T09:09:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9068c058c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984a40400 0x555984afd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9068c058c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984943c00 0x555984afcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9068c058c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555984943800 0x555984afdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9068c058c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555985858000 con 0x555984943c00 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9068c058c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555985858180 con 0x555984a40400 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9068c058c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x555985858300 con 0x555984943800 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9066200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984943c00 0x555984afcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9066200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984943c00 0x555984afcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46836/0 (socket says 172.21.15.59:46836) 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9066200640 1 -- 172.21.15.59:0/2332753522 learned_addr learned my addr 172.21.15.59:0/2332753522 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9066c00640 1 --2- 172.21.15.59:0/2332753522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984a40400 0x555984afd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.359+0000 7f9067600640 1 --2- 172.21.15.59:0/2332753522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555984943800 0x555984afdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9066200640 1 -- 172.21.15.59:0/2332753522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555984943800 msgr2=0x555984afdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9066200640 1 --2- 172.21.15.59:0/2332753522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555984943800 0x555984afdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9066200640 1 -- 172.21.15.59:0/2332753522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984a40400 msgr2=0x555984afd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9066200640 1 --2- 172.21.15.59:0/2332753522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984a40400 0x555984afd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9066200640 1 -- 172.21.15.59:0/2332753522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559849681e0 con 0x555984943c00 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9066c00640 1 --2- 172.21.15.59:0/2332753522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984a40400 0x555984afd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9066200640 1 --2- 172.21.15.59:0/2332753522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984943c00 0x555984afcb00 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x555985793380 tx=0x5559849e4180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323d6278ef2318cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9063a00640 1 -- 172.21.15.59:0/2332753522 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5559849781a0 con 0x555984943c00 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9063a00640 1 -- 172.21.15.59:0/2332753522 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55598498c540 con 0x555984943c00 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9063a00640 1 -- 172.21.15.59:0/2332753522 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5559849784e0 con 0x555984943c00 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 1 -- 172.21.15.59:0/2332753522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555984969c20 con 0x555984943c00 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 1 -- 172.21.15.59:0/2332753522 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5559849683c0 con 0x555984943c00 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 4 waiting for MDS map... 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9063a00640 1 -- 172.21.15.59:0/2332753522 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x555985872200 con 0x555984943c00 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9063a00640 1 -- 172.21.15.59:0/2332753522 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 73) v1 ==== 2723+0+0 (secure 0 0 0) 0x555984999180 con 0x555984943c00 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 4 Got MDS map 73 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 4 datascan.main: Using metadata pool output 2024-04-25T09:09:12.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 4 datascan.main: connecting to RADOS... 2024-04-25T09:09:12.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 1 Processor -- start 2024-04-25T09:09:12.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 1 -- start start 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984a40000 0x555984afd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984c72000 0x555984afc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555984c72400 0x555984afe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555985858480 con 0x555984a40000 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555985858600 con 0x555984c72000 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9068c058c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x555985858780 con 0x555984c72400 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9067600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984a40000 0x555984afd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9067600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984a40000 0x555984afd080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46846/0 (socket says 172.21.15.59:46846) 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9067600640 1 -- 172.21.15.59:0/2225556090 learned_addr learned my addr 172.21.15.59:0/2225556090 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9066c00640 1 --2- 172.21.15.59:0/2225556090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984c72000 0x555984afc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9066200640 1 --2- 172.21.15.59:0/2225556090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555984c72400 0x555984afe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9067600640 1 -- 172.21.15.59:0/2225556090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555984c72400 msgr2=0x555984afe100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9067600640 1 --2- 172.21.15.59:0/2225556090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555984c72400 0x555984afe100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9067600640 1 -- 172.21.15.59:0/2225556090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984c72000 msgr2=0x555984afc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9067600640 1 --2- 172.21.15.59:0/2225556090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984c72000 0x555984afc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9067600640 1 -- 172.21.15.59:0/2225556090 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555984969a40 con 0x555984a40000 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9066c00640 1 --2- 172.21.15.59:0/2225556090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984c72000 0x555984afc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9067600640 1 --2- 172.21.15.59:0/2225556090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984a40000 0x555984afd080 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x555985880750 tx=0x55598588ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1620b5f722cf1d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9061200640 1 -- 172.21.15.59:0/2225556090 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5559849781a0 con 0x555984a40000 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9061200640 1 -- 172.21.15.59:0/2225556090 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55598498cc40 con 0x555984a40000 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.363+0000 7f9061200640 1 -- 172.21.15.59:0/2225556090 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5559849784e0 con 0x555984a40000 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 -- 172.21.15.59:0/2225556090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984a40000 msgr2=0x555984afd080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 --2- 172.21.15.59:0/2225556090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984a40000 0x555984afd080 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x555985880750 tx=0x55598588ec00 comp rx=0 tx=0).stop 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 -- 172.21.15.59:0/2225556090 shutdown_connections 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 --2- 172.21.15.59:0/2225556090 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555984c72400 0x555984afe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 --2- 172.21.15.59:0/2225556090 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984c72000 0x555984afc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 --2- 172.21.15.59:0/2225556090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984a40000 0x555984afd080 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 -- 172.21.15.59:0/2225556090 >> 172.21.15.59:0/2225556090 conn(0x555984a40800 msgr2=0x55598496f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 -- 172.21.15.59:0/2225556090 shutdown_connections 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 -- 172.21.15.59:0/2225556090 wait complete. 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 Processor -- start 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 -- start start 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984a40800 0x555984aff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55598586a000 0x555984afec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55598586a400 0x555984afe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x555985859e00 con 0x55598586a000 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x555985859c80 con 0x555984a40800 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x555985859b00 con 0x55598586a400 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9066c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55598586a000 0x555984afec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9066c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55598586a000 0x555984afec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46858/0 (socket says 172.21.15.59:46858) 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 learned_addr learned my addr 172.21.15.59:0/1390315678 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:12.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9067600640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984a40800 0x555984aff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9066200640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55598586a400 0x555984afe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55598586a400 msgr2=0x555984afe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9066c00640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55598586a400 0x555984afe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984a40800 msgr2=0x555984aff180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9066c00640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984a40800 0x555984aff180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5559849681e0 con 0x55598586a000 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9066c00640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55598586a000 0x555984afec00 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x555985881a40 tx=0x55598588ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f905f400640 1 -- 172.21.15.59:0/1390315678 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5559849781a0 con 0x55598586a000 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f905f400640 1 -- 172.21.15.59:0/1390315678 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55598498d340 con 0x55598586a000 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5559849694a0 con 0x55598586a000 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f905f400640 1 -- 172.21.15.59:0/1390315678 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5559849784e0 con 0x55598586a000 2024-04-25T09:09:12.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5559849692c0 con 0x55598586a000 2024-04-25T09:09:12.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.367+0000 7f9068c058c0 4 datascan.init: resolving metadata pool 13 2024-04-25T09:09:12.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f905f400640 1 -- 172.21.15.59:0/1390315678 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x555984c72c00 con 0x55598586a000 2024-04-25T09:09:12.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f905f400640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55598586cc00 0x555984aff700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f905f400640 1 -- 172.21.15.59:0/1390315678 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x555984c79a00 con 0x55598586a000 2024-04-25T09:09:12.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9068c058c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:09:12.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9068c058c0 4 datascan.main: data pool 'cephfs_data' has ID 14 2024-04-25T09:09:12.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9068c058c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T09:09:12.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55598586a800 0x555984afe100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:1 13.14 13:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586ac00 con 0x55598586a800 2024-04-25T09:09:12.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9067600640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55598586cc00 0x555984aff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9066200640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55598586a800 0x555984afe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9066200640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55598586a800 0x555984afe100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9067600640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55598586cc00 0x555984aff700 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x555985880750 tx=0x5559849e42a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv25 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55598586b000 0x555984afc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:2 13.1f 13:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586b400 con 0x55598586b000 2024-04-25T09:09:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9067600640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55598586b000 0x555984afc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.371+0000 7f9067600640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55598586b000 0x555984afc580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x555984a52500 con 0x55598586b000 2024-04-25T09:09:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55598586b800 0x555984afd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:3 14.0 14:00000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586bc00 con 0x55598586b800 2024-04-25T09:09:12.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9066c00640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55598586b800 0x555984afd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9066c00640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55598586b800 0x555984afd080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:4 14.20 14:04000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586d000 con 0x55598586a800 2024-04-25T09:09:12.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9061200640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55598586d400 0x555984d88000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:5 14.10 14:08000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586d800 con 0x55598586d400 2024-04-25T09:09:12.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9066200640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55598586d400 0x555984d88000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9066200640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55598586d400 0x555984d88000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:6 14.30 14:0c000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94000 con 0x55598586a800 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 3 ==== osd_op_reply(6 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:7 14.8 14:10000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586dc00 con 0x55598586a800 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 4 ==== osd_op_reply(7 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9060800640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x555984d94400 0x555984d88580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:8 14.28 14:14000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586d000 con 0x555984d94400 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.375+0000 7f9067600640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x555984d94400 0x555984d88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9067600640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x555984d94400 0x555984d88580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.3 v2:172.21.15.59:6808/3810214969 1 ==== osd_op_reply(8 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94400 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:9 14.18 14:18000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94000 con 0x55598586d400 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 2 ==== osd_op_reply(9 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:10 14.38 14:1c000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586d800 con 0x55598586b800 2024-04-25T09:09:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:11 14.4 14:20000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94800 con 0x55598586b000 2024-04-25T09:09:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.6 v2:172.21.15.178:6800/2032393933 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x55598586b000 2024-04-25T09:09:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:12 14.24 14:24000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586ac00 con 0x55598586d400 2024-04-25T09:09:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 3 ==== osd_op_reply(12 [pgnls-filter start_epoch 96 out=49b] v92'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9061200640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55598586dc00 0x555984d88b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:13 14.14 14:28000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94800 con 0x55598586dc00 2024-04-25T09:09:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9066c00640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55598586dc00 0x555984d88b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9066c00640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55598586dc00 0x555984d88b00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 96 out=49b] v92'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:14 14.34 14:2c000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95000 con 0x55598586b800 2024-04-25T09:09:12.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 3 ==== osd_op_reply(14 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.379+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:15 14.c 14:30000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94c00 con 0x55598586a800 2024-04-25T09:09:12.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 5 ==== osd_op_reply(15 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:16 14.2c 14:34000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95400 con 0x55598586d400 2024-04-25T09:09:12.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 4 ==== osd_op_reply(16 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:17 14.1c 14:38000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586d000 con 0x55598586a800 2024-04-25T09:09:12.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 6 ==== osd_op_reply(17 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:18 14.3c 14:3c000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95800 con 0x55598586d400 2024-04-25T09:09:12.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 5 ==== osd_op_reply(18 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:19 14.2 14:40000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586b400 con 0x55598586b000 2024-04-25T09:09:12.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.6 v2:172.21.15.178:6800/2032393933 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x55598586b000 2024-04-25T09:09:12.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:20 14.22 14:44000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95c00 con 0x55598586dc00 2024-04-25T09:09:12.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:21 14.12 14:48000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94000 con 0x55598586b800 2024-04-25T09:09:12.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 4 ==== osd_op_reply(21 [pgnls-filter start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:22 14.32 14:4c000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94c00 con 0x55598586dc00 2024-04-25T09:09:12.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 3 ==== osd_op_reply(22 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9061200640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55598586d000 0x555984d89080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:23 14.a 14:50000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586d800 con 0x55598586d000 2024-04-25T09:09:12.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9066200640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55598586d000 0x555984d89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9066200640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55598586d000 0x555984d89080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.383+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.5 v2:172.21.15.178:6802/3576783051 1 ==== osd_op_reply(23 [pgnls-filter start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d000 2024-04-25T09:09:12.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:24 14.2a 14:54000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95400 con 0x55598586dc00 2024-04-25T09:09:12.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:25 14.1a 14:58000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586ac00 con 0x55598586a800 2024-04-25T09:09:12.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 7 ==== osd_op_reply(25 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:26 14.3a 14:5c000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95800 con 0x55598586a800 2024-04-25T09:09:12.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 8 ==== osd_op_reply(26 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:27 14.6 14:60000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586bc00 con 0x55598586a800 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 9 ==== osd_op_reply(27 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:28 14.26 14:64000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94800 con 0x55598586dc00 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 5 ==== osd_op_reply(28 [pgnls-filter start_epoch 96 out=49b] v92'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:29 14.16 14:68000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95c00 con 0x555984d94400 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.3 v2:172.21.15.59:6808/3810214969 2 ==== osd_op_reply(29 [pgnls-filter start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94400 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:30 14.36 14:6c000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95000 con 0x55598586b800 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 5 ==== osd_op_reply(30 [pgnls-filter start_epoch 96 out=49b] v92'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:31 14.e 14:70000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94000 con 0x55598586dc00 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 6 ==== osd_op_reply(31 [pgnls-filter start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:32 14.2e 14:74000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6000 con 0x555984d94400 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.3 v2:172.21.15.59:6808/3810214969 3 ==== osd_op_reply(32 [pgnls-filter start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94400 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9061200640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x555984d94c00 0x555984d89600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:33 14.1e 14:78000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95400 con 0x555984d94c00 2024-04-25T09:09:12.379 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.387+0000 7f9067600640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x555984d94c00 0x555984d89600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9067600640 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x555984d94c00 0x555984d89600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== osd_op_reply(33 [pgnls-filter start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94c00 2024-04-25T09:09:12.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:34 14.3e 14:7c000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6400 con 0x55598586d000 2024-04-25T09:09:12.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.5 v2:172.21.15.178:6802/3576783051 2 ==== osd_op_reply(34 [pgnls-filter start_epoch 96 out=49b] v92'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d000 2024-04-25T09:09:12.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:35 14.1 14:80000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94800 con 0x555984d94400 2024-04-25T09:09:12.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.3 v2:172.21.15.59:6808/3810214969 4 ==== osd_op_reply(35 [pgnls-filter start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94400 2024-04-25T09:09:12.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:36 14.21 14:84000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6800 con 0x55598586d000 2024-04-25T09:09:12.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.5 v2:172.21.15.178:6802/3576783051 3 ==== osd_op_reply(36 [pgnls-filter start_epoch 96 out=49b] v92'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d000 2024-04-25T09:09:12.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:37 14.11 14:88000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6000 con 0x55598586dc00 2024-04-25T09:09:12.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 7 ==== osd_op_reply(37 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:38 14.31 14:8c000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6c00 con 0x55598586d400 2024-04-25T09:09:12.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 6 ==== osd_op_reply(38 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:39 14.9 14:90000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da7800 con 0x55598586d000 2024-04-25T09:09:12.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.5 v2:172.21.15.178:6802/3576783051 4 ==== osd_op_reply(39 [pgnls-filter start_epoch 96 out=49b] v92'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d000 2024-04-25T09:09:12.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:40 14.29 14:94000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da7000 con 0x55598586b000 2024-04-25T09:09:12.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.6 v2:172.21.15.178:6800/2032393933 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x55598586b000 2024-04-25T09:09:12.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.391+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:41 14.19 14:98000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da7c00 con 0x55598586b000 2024-04-25T09:09:12.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.6 v2:172.21.15.178:6800/2032393933 5 ==== osd_op_reply(41 [pgnls-filter start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x55598586b000 2024-04-25T09:09:12.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:42 14.39 14:9c000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da7400 con 0x555984d94c00 2024-04-25T09:09:12.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.7 v2:172.21.15.178:6824/965369534 2 ==== osd_op_reply(42 [pgnls-filter start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94c00 2024-04-25T09:09:12.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:43 14.5 14:a0000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95c00 con 0x55598586a800 2024-04-25T09:09:12.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 10 ==== osd_op_reply(43 [pgnls-filter start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:44 14.25 14:a4000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6400 con 0x55598586b800 2024-04-25T09:09:12.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 6 ==== osd_op_reply(44 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:45 14.15 14:a8000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95400 con 0x555984d94c00 2024-04-25T09:09:12.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.7 v2:172.21.15.178:6824/965369534 3 ==== osd_op_reply(45 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94c00 2024-04-25T09:09:12.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:46 14.35 14:ac000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6800 con 0x55598586dc00 2024-04-25T09:09:12.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 8 ==== osd_op_reply(46 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:47 14.d 14:b0000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586b400 con 0x55598586b000 2024-04-25T09:09:12.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.6 v2:172.21.15.178:6800/2032393933 6 ==== osd_op_reply(47 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x55598586b000 2024-04-25T09:09:12.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:48 14.2d 14:b4000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6c00 con 0x55598586dc00 2024-04-25T09:09:12.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 9 ==== osd_op_reply(48 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:49 14.1d 14:b8000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95000 con 0x55598586a800 2024-04-25T09:09:12.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 11 ==== osd_op_reply(49 [pgnls-filter start_epoch 96 out=49b] v92'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:50 14.3d 14:bc000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586ac00 con 0x555984d94400 2024-04-25T09:09:12.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.3 v2:172.21.15.59:6808/3810214969 5 ==== osd_op_reply(50 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94400 2024-04-25T09:09:12.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:51 14.3 14:c0000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6000 con 0x55598586a800 2024-04-25T09:09:12.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 12 ==== osd_op_reply(51 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.395+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:52 14.23 14:c4000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586bc00 con 0x555984d94c00 2024-04-25T09:09:12.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.7 v2:172.21.15.178:6824/965369534 4 ==== osd_op_reply(52 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94c00 2024-04-25T09:09:12.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:53 14.13 14:c8000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6400 con 0x55598586b800 2024-04-25T09:09:12.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 7 ==== osd_op_reply(53 [pgnls-filter start_epoch 96 out=49b] v92'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:54 14.33 14:cc000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95800 con 0x55598586d400 2024-04-25T09:09:12.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 7 ==== osd_op_reply(54 [pgnls-filter start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:55 14.b 14:d0000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6800 con 0x55598586a800 2024-04-25T09:09:12.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 13 ==== osd_op_reply(55 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:56 14.2b 14:d4000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586d800 con 0x55598586dc00 2024-04-25T09:09:12.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 10 ==== osd_op_reply(56 [pgnls-filter start_epoch 96 out=49b] v92'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:57 14.1b 14:d8000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6c00 con 0x555984d94c00 2024-04-25T09:09:12.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.7 v2:172.21.15.178:6824/965369534 5 ==== osd_op_reply(57 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94c00 2024-04-25T09:09:12.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:58 14.3b 14:dc000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94000 con 0x55598586dc00 2024-04-25T09:09:12.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 11 ==== osd_op_reply(58 [pgnls-filter start_epoch 96 out=49b] v92'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:59 14.7 14:e0000000::::head [pgnls-filter start_epoch 96 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da7000 con 0x55598586d000 2024-04-25T09:09:12.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.5 v2:172.21.15.178:6802/3576783051 5 ==== osd_op_reply(59 [pgnls-filter start_epoch 96 out=81b] v96'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x555984a52000 con 0x55598586d000 2024-04-25T09:09:12.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:60 14.0 14:00000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db6000 con 0x55598586b800 2024-04-25T09:09:12.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 8 ==== osd_op_reply(60 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:61 14.20 14:04000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da7c00 con 0x55598586a800 2024-04-25T09:09:12.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 14 ==== osd_op_reply(61 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.399+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:62 14.10 14:08000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94800 con 0x55598586d400 2024-04-25T09:09:12.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 8 ==== osd_op_reply(62 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:63 14.30 14:0c000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da7400 con 0x55598586a800 2024-04-25T09:09:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 15 ==== osd_op_reply(63 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:64 14.8 14:10000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95400 con 0x55598586a800 2024-04-25T09:09:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 16 ==== osd_op_reply(64 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:65 14.28 14:14000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da7800 con 0x555984d94400 2024-04-25T09:09:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.3 v2:172.21.15.59:6808/3810214969 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94400 2024-04-25T09:09:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:66 14.18 14:18000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db8000 con 0x55598586d400 2024-04-25T09:09:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 9 ==== osd_op_reply(66 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:67 14.38 14:1c000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6000 con 0x55598586b800 2024-04-25T09:09:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 9 ==== osd_op_reply(67 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:68 14.4 14:20000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db8400 con 0x55598586b000 2024-04-25T09:09:12.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.6 v2:172.21.15.178:6800/2032393933 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x55598586b000 2024-04-25T09:09:12.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:69 14.24 14:24000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da6800 con 0x55598586d400 2024-04-25T09:09:12.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 10 ==== osd_op_reply(69 [pgnls-filter start_epoch 96 out=49b] v92'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:70 14.14 14:28000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db8800 con 0x55598586dc00 2024-04-25T09:09:12.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 12 ==== osd_op_reply(70 [pgnls-filter start_epoch 96 out=49b] v92'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:71 14.34 14:2c000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da7000 con 0x55598586b800 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 10 ==== osd_op_reply(71 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:72 14.c 14:30000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db8c00 con 0x55598586a800 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 17 ==== osd_op_reply(72 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.403+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:73 14.2c 14:34000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984da7c00 con 0x55598586d400 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 11 ==== osd_op_reply(73 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:74 14.1c 14:38000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db9000 con 0x55598586a800 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 18 ==== osd_op_reply(74 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:75 14.3c 14:3c000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95c00 con 0x55598586d400 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 12 ==== osd_op_reply(75 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:76 14.2 14:40000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db9400 con 0x55598586b000 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.6 v2:172.21.15.178:6800/2032393933 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x55598586b000 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:77 14.22 14:44000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95000 con 0x55598586dc00 2024-04-25T09:09:12.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 13 ==== osd_op_reply(77 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:78 14.12 14:48000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db9800 con 0x55598586b800 2024-04-25T09:09:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 11 ==== osd_op_reply(78 [pgnls-filter start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:79 14.32 14:4c000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95800 con 0x55598586dc00 2024-04-25T09:09:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 14 ==== osd_op_reply(79 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:80 14.a 14:50000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db9c00 con 0x55598586d000 2024-04-25T09:09:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.5 v2:172.21.15.178:6802/3576783051 6 ==== osd_op_reply(80 [pgnls-filter start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d000 2024-04-25T09:09:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:81 14.2a 14:54000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db8000 con 0x55598586dc00 2024-04-25T09:09:12.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 15 ==== osd_op_reply(81 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:82 14.1a 14:58000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db8c00 con 0x55598586a800 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 19 ==== osd_op_reply(82 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:83 14.3a 14:5c000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586b400 con 0x55598586a800 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 20 ==== osd_op_reply(83 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.407+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:84 14.6 14:60000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db9000 con 0x55598586a800 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 21 ==== osd_op_reply(84 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:85 14.26 14:64000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586ac00 con 0x55598586dc00 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 16 ==== osd_op_reply(85 [pgnls-filter start_epoch 96 out=49b] v92'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:86 14.16 14:68000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db8800 con 0x555984d94400 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.3 v2:172.21.15.59:6808/3810214969 7 ==== osd_op_reply(86 [pgnls-filter start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94400 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:87 14.36 14:6c000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586bc00 con 0x55598586b800 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 12 ==== osd_op_reply(87 [pgnls-filter start_epoch 96 out=49b] v92'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:88 14.e 14:70000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db8400 con 0x55598586dc00 2024-04-25T09:09:12.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 17 ==== osd_op_reply(88 [pgnls-filter start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:89 14.2e 14:74000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db6000 con 0x555984d94400 2024-04-25T09:09:12.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.3 v2:172.21.15.59:6808/3810214969 8 ==== osd_op_reply(89 [pgnls-filter start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94400 2024-04-25T09:09:12.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:90 14.1e 14:78000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dba000 con 0x555984d94c00 2024-04-25T09:09:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.7 v2:172.21.15.178:6824/965369534 6 ==== osd_op_reply(90 [pgnls-filter start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94c00 2024-04-25T09:09:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:91 14.3e 14:7c000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94800 con 0x55598586d000 2024-04-25T09:09:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.5 v2:172.21.15.178:6802/3576783051 7 ==== osd_op_reply(91 [pgnls-filter start_epoch 96 out=49b] v92'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d000 2024-04-25T09:09:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:92 14.1 14:80000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dba400 con 0x555984d94400 2024-04-25T09:09:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.3 v2:172.21.15.59:6808/3810214969 9 ==== osd_op_reply(92 [pgnls-filter start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94400 2024-04-25T09:09:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:93 14.21 14:84000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95400 con 0x55598586d000 2024-04-25T09:09:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.5 v2:172.21.15.178:6802/3576783051 8 ==== osd_op_reply(93 [pgnls-filter start_epoch 96 out=49b] v92'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d000 2024-04-25T09:09:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:94 14.11 14:88000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dba800 con 0x55598586dc00 2024-04-25T09:09:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 18 ==== osd_op_reply(94 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.411+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:95 14.31 14:8c000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95c00 con 0x55598586d400 2024-04-25T09:09:12.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 13 ==== osd_op_reply(95 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:96 14.9 14:90000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dbac00 con 0x55598586d000 2024-04-25T09:09:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.5 v2:172.21.15.178:6802/3576783051 9 ==== osd_op_reply(96 [pgnls-filter start_epoch 96 out=49b] v92'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d000 2024-04-25T09:09:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:97 14.29 14:94000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94000 con 0x55598586b000 2024-04-25T09:09:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.6 v2:172.21.15.178:6800/2032393933 9 ==== osd_op_reply(97 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x55598586b000 2024-04-25T09:09:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:98 14.19 14:98000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dbb000 con 0x55598586b000 2024-04-25T09:09:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.6 v2:172.21.15.178:6800/2032393933 10 ==== osd_op_reply(98 [pgnls-filter start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x55598586b000 2024-04-25T09:09:12.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:99 14.39 14:9c000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586d800 con 0x555984d94c00 2024-04-25T09:09:12.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.7 v2:172.21.15.178:6824/965369534 7 ==== osd_op_reply(99 [pgnls-filter start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94c00 2024-04-25T09:09:12.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:100 14.5 14:a0000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dbb400 con 0x55598586a800 2024-04-25T09:09:12.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 22 ==== osd_op_reply(100 [pgnls-filter start_epoch 96 out=49b] v92'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:101 14.25 14:a4000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db9400 con 0x55598586b800 2024-04-25T09:09:12.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 13 ==== osd_op_reply(101 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:102 14.15 14:a8000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dbb800 con 0x555984d94c00 2024-04-25T09:09:12.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.7 v2:172.21.15.178:6824/965369534 8 ==== osd_op_reply(102 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94c00 2024-04-25T09:09:12.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:103 14.35 14:ac000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db8800 con 0x55598586dc00 2024-04-25T09:09:12.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 19 ==== osd_op_reply(103 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.415+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:104 14.d 14:b0000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dbbc00 con 0x55598586b000 2024-04-25T09:09:12.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.6 v2:172.21.15.178:6800/2032393933 11 ==== osd_op_reply(104 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x55598586b000 2024-04-25T09:09:12.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:105 14.2d 14:b4000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db9800 con 0x55598586dc00 2024-04-25T09:09:12.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 20 ==== osd_op_reply(105 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:106 14.1d 14:b8000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dba000 con 0x55598586a800 2024-04-25T09:09:12.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 23 ==== osd_op_reply(106 [pgnls-filter start_epoch 96 out=49b] v92'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:107 14.3d 14:bc000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db8000 con 0x555984d94400 2024-04-25T09:09:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.3 v2:172.21.15.59:6808/3810214969 10 ==== osd_op_reply(107 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94400 2024-04-25T09:09:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:108 14.3 14:c0000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dba400 con 0x55598586a800 2024-04-25T09:09:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 24 ==== osd_op_reply(108 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:109 14.23 14:c4000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db8400 con 0x555984d94c00 2024-04-25T09:09:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.7 v2:172.21.15.178:6824/965369534 9 ==== osd_op_reply(109 [pgnls-filter start_epoch 96 out=49b] v92'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94c00 2024-04-25T09:09:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:110 14.13 14:c8000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dbb000 con 0x55598586b800 2024-04-25T09:09:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.2 v2:172.21.15.59:6824/4113007731 14 ==== osd_op_reply(110 [pgnls-filter start_epoch 96 out=49b] v92'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586b800 2024-04-25T09:09:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:111 14.33 14:cc000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586ac00 con 0x55598586d400 2024-04-25T09:09:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 14 ==== osd_op_reply(111 [pgnls-filter start_epoch 96 out=49b] v92'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:112 14.b 14:d0000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dba800 con 0x55598586a800 2024-04-25T09:09:12.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 25 ==== osd_op_reply(112 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:113 14.2b 14:d4000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55598586bc00 con 0x55598586dc00 2024-04-25T09:09:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 21 ==== osd_op_reply(113 [pgnls-filter start_epoch 96 out=49b] v92'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:114 14.1b 14:d8000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dbac00 con 0x555984d94c00 2024-04-25T09:09:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.7 v2:172.21.15.178:6824/965369534 10 ==== osd_op_reply(114 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94c00 2024-04-25T09:09:12.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.419+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:115 14.3b 14:dc000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94000 con 0x55598586dc00 2024-04-25T09:09:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 22 ==== osd_op_reply(115 [pgnls-filter start_epoch 96 out=49b] v92'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:116 14.7 14:e0000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dbb400 con 0x55598586d000 2024-04-25T09:09:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.5 v2:172.21.15.178:6802/3576783051 10 ==== osd_op_reply(116 [pgnls-filter start_epoch 96 out=81b] v96'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x555984a52000 con 0x55598586d000 2024-04-25T09:09:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-04-25T09:09:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 10 datascan.operator(): handling object 10000000001.0 2024-04-25T09:09:12.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:117 14.7 14:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db6800 con 0x55598586d000 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.5 v2:172.21.15.178:6802/3576783051 11 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x555984a52000 con 0x55598586d000 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:118 13.10 13:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db6c00 con 0x55598586d400 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 15 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+59 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:119 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db7000 con 0x55598586b000 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.6 v2:172.21.15.178:6800/2032393933 12 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+520 (crc 0 0 0) 0x555984a52500 con 0x55598586b000 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 20 datascan.get_frag_of: frag is * 2024-04-25T09:09:12.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:120 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db7400 con 0x55598586d400 2024-04-25T09:09:12.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 16 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 10 datascan.find_or_create_dirfrag: read_version = 17 2024-04-25T09:09:12.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-04-25T09:09:12.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:121 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db7800 con 0x55598586d400 2024-04-25T09:09:12.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 17 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T09:09:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 20 datascan.read_dentry: file_head not found in result 2024-04-25T09:09:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-04-25T09:09:12.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.423+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:122 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db7c00 con 0x55598586d400 2024-04-25T09:09:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 18 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v96'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T09:09:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:123 14.27 14:e4000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x5559857a2000 con 0x55598586d000 2024-04-25T09:09:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.5 v2:172.21.15.178:6802/3576783051 12 ==== osd_op_reply(123 [pgnls-filter start_epoch 96 out=49b] v92'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d000 2024-04-25T09:09:12.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:124 14.17 14:e8000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984dba000 con 0x55598586d400 2024-04-25T09:09:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.1 v2:172.21.15.59:6809/1450066050 19 ==== osd_op_reply(124 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586d400 2024-04-25T09:09:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:125 14.37 14:ec000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95000 con 0x55598586dc00 2024-04-25T09:09:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 <== osd.4 v2:172.21.15.178:6805/2278719369 23 ==== osd_op_reply(125 [pgnls-filter start_epoch 96 out=49b] v92'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52780 con 0x55598586dc00 2024-04-25T09:09:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:126 14.f 14:f0000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d94800 con 0x555984d94c00 2024-04-25T09:09:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.7 v2:172.21.15.178:6824/965369534 11 ==== osd_op_reply(126 [pgnls-filter start_epoch 96 out=49b] v92'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94c00 2024-04-25T09:09:12.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:127 14.2f 14:f4000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95800 con 0x55598586a800 2024-04-25T09:09:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 26 ==== osd_op_reply(127 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9060800640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:128 14.1f 14:f8000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984d95400 con 0x55598586a800 2024-04-25T09:09:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9066200640 1 -- 172.21.15.59:0/1390315678 <== osd.0 v2:172.21.15.59:6800/4129855307 27 ==== osd_op_reply(128 [pgnls-filter start_epoch 96 out=49b] v92'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52000 con 0x55598586a800 2024-04-25T09:09:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9061200640 1 -- 172.21.15.59:0/1390315678 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:129 14.3f 14:fc000000::::head [pgnls-filter start_epoch 96 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x555984db6000 con 0x555984d94400 2024-04-25T09:09:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9067600640 1 -- 172.21.15.59:0/1390315678 <== osd.3 v2:172.21.15.59:6808/3810214969 11 ==== osd_op_reply(129 [pgnls-filter start_epoch 96 out=49b] v92'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555984a52500 con 0x555984d94400 2024-04-25T09:09:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55598586a800 msgr2=0x555984afe100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55598586a800 0x555984afe100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55598586d400 msgr2=0x555984d88000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55598586d400 0x555984d88000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55598586b800 msgr2=0x555984afd080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55598586b800 0x555984afd080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x555984d94400 msgr2=0x555984d88580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x555984d94400 0x555984d88580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 reap_dead start 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55598586dc00 msgr2=0x555984d88b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55598586dc00 0x555984d88b00 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55598586d000 msgr2=0x555984d89080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55598586d000 0x555984d89080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55598586b000 msgr2=0x555984afc580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55598586b000 0x555984afc580 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x555984d94c00 msgr2=0x555984d89600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x555984d94c00 0x555984d89600 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9066c00640 1 -- 172.21.15.59:0/1390315678 reap_dead start 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55598586cc00 msgr2=0x555984aff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55598586cc00 0x555984aff700 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x555985880750 tx=0x5559849e42a0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55598586a000 msgr2=0x555984afec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55598586a000 0x555984afec00 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x555985881a40 tx=0x55598588ed20 comp rx=0 tx=0).stop 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 shutdown_connections 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55598586cc00 0x555984aff700 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 --2- 172.21.15.59:0/1390315678 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55598586a000 0x555984afec00 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 >> 172.21.15.59:0/1390315678 conn(0x555984a40000 msgr2=0x55598496f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 shutdown_connections 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.427+0000 7f9068c058c0 1 -- 172.21.15.59:0/1390315678 wait complete. 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.431+0000 7f9068c058c0 1 -- 172.21.15.59:0/2332753522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984943c00 msgr2=0x555984afcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.431+0000 7f9068c058c0 1 --2- 172.21.15.59:0/2332753522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984943c00 0x555984afcb00 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x555985793380 tx=0x5559849e4180 comp rx=0 tx=0).stop 2024-04-25T09:09:12.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.431+0000 7f9068c058c0 1 -- 172.21.15.59:0/2332753522 shutdown_connections 2024-04-25T09:09:12.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.431+0000 7f9068c058c0 1 --2- 172.21.15.59:0/2332753522 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x555984943800 0x555984afdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.431+0000 7f9068c058c0 1 --2- 172.21.15.59:0/2332753522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x555984943c00 0x555984afcb00 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.431+0000 7f9068c058c0 1 --2- 172.21.15.59:0/2332753522 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x555984a40400 0x555984afd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.431+0000 7f9068c058c0 1 -- 172.21.15.59:0/2332753522 >> 172.21.15.59:0/2332753522 conn(0x555984942c00 msgr2=0x555984970800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.431+0000 7f9068c058c0 1 -- 172.21.15.59:0/2332753522 shutdown_connections 2024-04-25T09:09:12.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.431+0000 7f9068c058c0 1 -- 172.21.15.59:0/2332753522 wait complete. 2024-04-25T09:09:12.424 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.159373, result: 2024-04-25T09:09:12.424 DEBUG:teuthology.orchestra.run.smithi059:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-25T09:09:12.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 1 -- start start 2024-04-25T09:09:12.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 1 Processor -- start 2024-04-25T09:09:12.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91396f800 0x55c913b28580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91396f400 0x55c913b28b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91396f000 0x55c913b29080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c913a6c600 con 0x55c91396f800 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c913a6c480 con 0x55c91396f000 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c913a6c300 con 0x55c91396f400 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4882e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91396f800 0x55c913b28580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4883800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91396f000 0x55c913b29080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4882e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91396f800 0x55c913b28580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46874/0 (socket says 172.21.15.59:46874) 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4882e00640 1 -- 172.21.15.59:0/1658373204 learned_addr learned my addr 172.21.15.59:0/1658373204 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:12.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4882400640 1 --2- 172.21.15.59:0/1658373204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91396f400 0x55c913b28b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4882e00640 1 -- 172.21.15.59:0/1658373204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91396f400 msgr2=0x55c913b28b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4882e00640 1 --2- 172.21.15.59:0/1658373204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91396f400 0x55c913b28b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4882e00640 1 -- 172.21.15.59:0/1658373204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91396f000 msgr2=0x55c913b29080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4882e00640 1 --2- 172.21.15.59:0/1658373204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91396f000 0x55c913b29080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4882e00640 1 -- 172.21.15.59:0/1658373204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9139941e0 con 0x55c91396f800 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4882e00640 1 --2- 172.21.15.59:0/1658373204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91396f800 0x55c913b28580 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x55c9147af8c0 tx=0x55c913a48ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6beaaa3c471f7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f487fc00640 1 -- 172.21.15.59:0/1658373204 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9139a44e0 con 0x55c91396f800 2024-04-25T09:09:12.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f487fc00640 1 -- 172.21.15.59:0/1658373204 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9139b8c40 con 0x55c91396f800 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f487fc00640 1 -- 172.21.15.59:0/1658373204 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9139a4b60 con 0x55c91396f800 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/1658373204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9139954a0 con 0x55c91396f800 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/1658373204 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c913995a40 con 0x55c91396f800 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 4 waiting for MDS map... 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f487fc00640 1 -- 172.21.15.59:0/1658373204 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x55c914894600 con 0x55c91396f800 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f487fc00640 1 -- 172.21.15.59:0/1658373204 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 73) v1 ==== 2723+0+0 (secure 0 0 0) 0x55c9139c5180 con 0x55c91396f800 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 4 Got MDS map 73 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 4 datascan.main: Using metadata pool output 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.523+0000 7f4884d2c8c0 4 datascan.main: connecting to RADOS... 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 Processor -- start 2024-04-25T09:09:12.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 -- start start 2024-04-25T09:09:12.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91488ac00 0x55c913b29600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488b000 0x55c913b29b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91488b400 0x55c913b2a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c913a6c180 con 0x55c91488b000 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9139ce480 con 0x55c91488ac00 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9139ce900 con 0x55c91488b400 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4882e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488b000 0x55c913b29b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4882e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488b000 0x55c913b29b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46888/0 (socket says 172.21.15.59:46888) 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4882e00640 1 -- 172.21.15.59:0/1228309851 learned_addr learned my addr 172.21.15.59:0/1228309851 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4883800640 1 --2- 172.21.15.59:0/1228309851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91488ac00 0x55c913b29600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4882400640 1 --2- 172.21.15.59:0/1228309851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91488b400 0x55c913b2a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4882e00640 1 -- 172.21.15.59:0/1228309851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91488b400 msgr2=0x55c913b2a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4882e00640 1 --2- 172.21.15.59:0/1228309851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91488b400 0x55c913b2a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4882e00640 1 -- 172.21.15.59:0/1228309851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91488ac00 msgr2=0x55c913b29600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4882e00640 1 --2- 172.21.15.59:0/1228309851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91488ac00 0x55c913b29600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4882e00640 1 -- 172.21.15.59:0/1228309851 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c913995c20 con 0x55c91488b000 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4882e00640 1 --2- 172.21.15.59:0/1228309851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488b000 0x55c913b29b80 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x55c914878c60 tx=0x55c913a32600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26bb0612e6669d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f487d400640 1 -- 172.21.15.59:0/1228309851 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9139a4340 con 0x55c91488b000 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f487d400640 1 -- 172.21.15.59:0/1228309851 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9139b8a80 con 0x55c91488b000 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f487d400640 1 -- 172.21.15.59:0/1228309851 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9139a44e0 con 0x55c91488b000 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/1228309851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488b000 msgr2=0x55c913b29b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/1228309851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488b000 0x55c913b29b80 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x55c914878c60 tx=0x55c913a32600 comp rx=0 tx=0).stop 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/1228309851 shutdown_connections 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/1228309851 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91488b400 0x55c913b2a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/1228309851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488b000 0x55c913b29b80 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/1228309851 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91488ac00 0x55c913b29600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/1228309851 >> 172.21.15.59:0/1228309851 conn(0x55c91396ec00 msgr2=0x55c91399b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/1228309851 shutdown_connections 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/1228309851 wait complete. 2024-04-25T09:09:12.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 Processor -- start 2024-04-25T09:09:12.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.527+0000 7f4884d2c8c0 1 -- start start 2024-04-25T09:09:12.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4884d2c8c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488ac00 0x55c913b2b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4884d2c8c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91488b000 0x55c913b2ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4884d2c8c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91488b400 0x55c913b2a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4884d2c8c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c913a6d380 con 0x55c91488ac00 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4884d2c8c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c913a6d500 con 0x55c91488b000 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4884d2c8c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c913a6c180 con 0x55c91488b400 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4883800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488ac00 0x55c913b2b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4883800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488ac00 0x55c913b2b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46900/0 (socket says 172.21.15.59:46900) 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 learned_addr learned my addr 172.21.15.59:0/400626654 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4882e00640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91488b000 0x55c913b2ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4882400640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91488b400 0x55c913b2a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91488b400 msgr2=0x55c913b2a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4883800640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91488b400 0x55c913b2a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91488b000 msgr2=0x55c913b2ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4883800640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91488b000 0x55c913b2ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9139941e0 con 0x55c91488ac00 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4883800640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488ac00 0x55c913b2b180 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x55c9148798f0 tx=0x55c913a10000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f487b600640 1 -- 172.21.15.59:0/400626654 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9139a49c0 con 0x55c91488ac00 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f487b600640 1 -- 172.21.15.59:0/400626654 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9139b9500 con 0x55c91488ac00 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f487b600640 1 -- 172.21.15.59:0/400626654 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9139a4340 con 0x55c91488ac00 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c9139954a0 con 0x55c91488ac00 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c913995e00 con 0x55c91488ac00 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f4884d2c8c0 4 datascan.init: resolving metadata pool 13 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f487b600640 1 -- 172.21.15.59:0/400626654 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55c9148f6c00 con 0x55c91488ac00 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.531+0000 7f487b600640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55c913d86000 0x55c913b2b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f487b600640 1 -- 172.21.15.59:0/400626654 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x55c9148f2400 con 0x55c91488ac00 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4884d2c8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:09:12.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4884d2c8c0 4 datascan.main: resolving metadata pool 13 2024-04-25T09:09:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55c91488b800 0x55c913b2a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c91488bc00 con 0x55c91488b800 2024-04-25T09:09:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4882e00640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55c913d86000 0x55c913b2b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4882400640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55c91488b800 0x55c913b2a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4882e00640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55c913d86000 0x55c913b2b700 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x55c914878c60 tx=0x55c914886c00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4882400640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55c91488b800 0x55c913b2a100 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== osd_op_reply(1 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4882400640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55c91488bc00 0x55c913d96000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:2 13.10 13:08000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d86400 con 0x55c91488bc00 2024-04-25T09:09:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4883800640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55c91488bc00 0x55c913d96000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4883800640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55c91488bc00 0x55c913d96000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(2 [pgnls start_epoch 96 out=177b] v96'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4883800640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55c913d86400 0x55c913d96580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:3 13.8 13:10000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c91473f400 con 0x55c913d86400 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4882e00640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55c913d86400 0x55c913d96580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4882e00640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55c913d86400 0x55c913d96580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.2 v2:172.21.15.59:6824/4113007731 1 ==== osd_op_reply(3 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86400 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.535+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:4 13.18 13:18000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c91473f400 con 0x55c91488b800 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 2 ==== osd_op_reply(4 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4882400640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55c91473f400 0x55c913d96b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:5 13.4 13:20000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d86800 con 0x55c91473f400 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4882400640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55c91473f400 0x55c913d96b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4882400640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55c91473f400 0x55c913d96b00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(5 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4882400640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c913d86800 0x55c913d97080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:6 13.14 13:28000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d86c00 con 0x55c913d86800 2024-04-25T09:09:12.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4883800640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c913d86800 0x55c913d97080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4883800640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c913d86800 0x55c913d97080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== osd_op_reply(6 [pgnls start_epoch 96 out=149b] v95'28 uv28 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55c913a7e500 con 0x55c913d86800 2024-04-25T09:09:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:7 13.c 13:30000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d86c00 con 0x55c91488bc00 2024-04-25T09:09:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 2 ==== osd_op_reply(7 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:8 13.1c 13:38000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d86c00 con 0x55c91473f400 2024-04-25T09:09:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 2 ==== osd_op_reply(8 [pgnls start_epoch 96 out=73b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4882400640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55c913d86c00 0x55c913d97600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:9 13.2 13:40000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87000 con 0x55c913d86c00 2024-04-25T09:09:12.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.539+0000 7f4882e00640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55c913d86c00 0x55c913d97600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4882e00640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55c913d86c00 0x55c913d97600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.5 v2:172.21.15.178:6802/3576783051 1 ==== osd_op_reply(9 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86c00 2024-04-25T09:09:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:10 13.12 13:48000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87000 con 0x55c913d86800 2024-04-25T09:09:12.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.0 v2:172.21.15.59:6800/4129855307 2 ==== osd_op_reply(10 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c913d86800 2024-04-25T09:09:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:11 13.a 13:50000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87000 con 0x55c913d86400 2024-04-25T09:09:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.2 v2:172.21.15.59:6824/4113007731 2 ==== osd_op_reply(11 [pgnls start_epoch 96 out=81b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86400 2024-04-25T09:09:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:12 13.1a 13:58000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87000 con 0x55c91488bc00 2024-04-25T09:09:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 3 ==== osd_op_reply(12 [pgnls start_epoch 96 out=49b] v93'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4883800640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55c913d87000 0x55c913d98680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:13 13.6 13:60000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87c00 con 0x55c913d87000 2024-04-25T09:09:12.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4882400640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55c913d87000 0x55c913d98680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4882400640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55c913d87000 0x55c913d98680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 1 ==== osd_op_reply(13 [pgnls start_epoch 96 out=77b] v95'6 uv6 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4882400640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55c913d87c00 0x55c913d97b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:14 13.16 13:68000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c913d87c00 2024-04-25T09:09:12.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.543+0000 7f4883800640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55c913d87c00 0x55c913d97b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4883800640 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55c913d87c00 0x55c913d97b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.3 v2:172.21.15.59:6808/3810214969 1 ==== osd_op_reply(14 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c913d87c00 2024-04-25T09:09:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:15 13.e 13:70000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c91488b800 2024-04-25T09:09:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 3 ==== osd_op_reply(15 [pgnls start_epoch 96 out=73b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:16 13.1e 13:78000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c913d87000 2024-04-25T09:09:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 2 ==== osd_op_reply(16 [pgnls start_epoch 96 out=49b] v93'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:17 13.1 13:80000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c91473f400 2024-04-25T09:09:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 3 ==== osd_op_reply(17 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:18 13.11 13:88000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c91488bc00 2024-04-25T09:09:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 4 ==== osd_op_reply(18 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:19 13.9 13:90000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c913d86c00 2024-04-25T09:09:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.5 v2:172.21.15.178:6802/3576783051 2 ==== osd_op_reply(19 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86c00 2024-04-25T09:09:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:20 13.19 13:98000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c913d87c00 2024-04-25T09:09:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.3 v2:172.21.15.59:6808/3810214969 2 ==== osd_op_reply(20 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c913d87c00 2024-04-25T09:09:12.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:21 13.5 13:a0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c913d87000 2024-04-25T09:09:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 3 ==== osd_op_reply(21 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:22 13.15 13:a8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c913d87000 2024-04-25T09:09:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 4 ==== osd_op_reply(22 [pgnls start_epoch 96 out=97b] v95'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:23 13.d 13:b0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c913d87000 2024-04-25T09:09:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 5 ==== osd_op_reply(23 [pgnls start_epoch 96 out=74b] v91'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.547+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:24 13.1d 13:b8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c91488b800 2024-04-25T09:09:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 4 ==== osd_op_reply(24 [pgnls start_epoch 96 out=73b] v95'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:25 13.3 13:c0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c913d86800 2024-04-25T09:09:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.0 v2:172.21.15.59:6800/4129855307 3 ==== osd_op_reply(25 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c913d86800 2024-04-25T09:09:12.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:26 13.13 13:c8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c91488b800 2024-04-25T09:09:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 5 ==== osd_op_reply(26 [pgnls start_epoch 96 out=98b] v95'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:27 13.b 13:d0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c913d86c00 2024-04-25T09:09:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.5 v2:172.21.15.178:6802/3576783051 3 ==== osd_op_reply(27 [pgnls start_epoch 96 out=76b] v95'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86c00 2024-04-25T09:09:12.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:28 13.1b 13:d8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c913d87000 2024-04-25T09:09:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 6 ==== osd_op_reply(28 [pgnls start_epoch 96 out=73b] v95'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:29 13.7 13:e0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c91488b800 2024-04-25T09:09:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 6 ==== osd_op_reply(29 [pgnls start_epoch 96 out=73b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:30 13.17 13:e8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c913d86c00 2024-04-25T09:09:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.5 v2:172.21.15.178:6802/3576783051 4 ==== osd_op_reply(30 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86c00 2024-04-25T09:09:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:31 13.f 13:f0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c91473f400 2024-04-25T09:09:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 4 ==== osd_op_reply(31 [pgnls start_epoch 96 out=73b] v91'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.551+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:32 13.1f 13:f8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c91473f400 2024-04-25T09:09:12.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 5 ==== osd_op_reply(32 [pgnls start_epoch 96 out=101b] v95'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:33 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8000 con 0x55c91488bc00 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 5 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:34 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8400 con 0x55c91488bc00 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 6 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:35 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8800 con 0x55c91488bc00 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 7 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 20 datascan.scan_links: injected ino detected 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:36 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8c00 con 0x55c91488bc00 2024-04-25T09:09:12.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 8 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-25T09:09:12.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:37 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9000 con 0x55c91488bc00 2024-04-25T09:09:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 9 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-25T09:09:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T09:09:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-25T09:09:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T09:09:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-25T09:09:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T09:09:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-25T09:09:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:38 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9400 con 0x55c913d86800 2024-04-25T09:09:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.0 v2:172.21.15.59:6800/4129855307 4 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e500 con 0x55c913d86800 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:39 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91473f400 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 6 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:40 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8000 con 0x55c913d86400 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.2 v2:172.21.15.59:6824/4113007731 3 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86400 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:41 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8400 con 0x55c91488b800 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 7 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:42 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8800 con 0x55c913d87000 2024-04-25T09:09:12.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 7 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.555+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:43 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8c00 con 0x55c91488b800 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 8 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:44 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9000 con 0x55c91488b800 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 9 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-25T09:09:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T09:09:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 200.00000002 2024-04-25T09:09:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-25T09:09:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-25T09:09:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:45 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9400 con 0x55c91488b800 2024-04-25T09:09:12.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 10 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:46 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9c00 con 0x55c91473f400 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 7 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1041 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:47 13.0 13:00000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91488b800 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 11 ==== osd_op_reply(47 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:48 13.10 13:08000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91488bc00 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 10 ==== osd_op_reply(48 [pgnls start_epoch 96 out=177b] v96'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:49 13.8 13:10000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d86400 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.2 v2:172.21.15.59:6824/4113007731 4 ==== osd_op_reply(49 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86400 2024-04-25T09:09:12.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:50 13.18 13:18000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91488b800 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 12 ==== osd_op_reply(50 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:51 13.4 13:20000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91473f400 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 8 ==== osd_op_reply(51 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:52 13.14 13:28000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d86800 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.0 v2:172.21.15.59:6800/4129855307 5 ==== osd_op_reply(52 [pgnls start_epoch 96 out=149b] v95'28 uv28 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55c913a7e500 con 0x55c913d86800 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.559+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:53 13.c 13:30000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91488bc00 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 11 ==== osd_op_reply(53 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:54 13.1c 13:38000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91473f400 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 9 ==== osd_op_reply(54 [pgnls start_epoch 96 out=73b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:55 13.2 13:40000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d86c00 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.5 v2:172.21.15.178:6802/3576783051 5 ==== osd_op_reply(55 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86c00 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:56 13.12 13:48000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d86800 2024-04-25T09:09:12.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.0 v2:172.21.15.59:6800/4129855307 6 ==== osd_op_reply(56 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c913d86800 2024-04-25T09:09:12.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:57 13.a 13:50000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d86400 2024-04-25T09:09:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.2 v2:172.21.15.59:6824/4113007731 5 ==== osd_op_reply(57 [pgnls start_epoch 96 out=81b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86400 2024-04-25T09:09:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:58 13.1a 13:58000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91488bc00 2024-04-25T09:09:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 12 ==== osd_op_reply(58 [pgnls start_epoch 96 out=49b] v93'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:59 13.6 13:60000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d87000 2024-04-25T09:09:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 8 ==== osd_op_reply(59 [pgnls start_epoch 96 out=77b] v95'6 uv6 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:60 13.16 13:68000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d87c00 2024-04-25T09:09:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.3 v2:172.21.15.59:6808/3810214969 3 ==== osd_op_reply(60 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c913d87c00 2024-04-25T09:09:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:61 13.e 13:70000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91488b800 2024-04-25T09:09:12.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 13 ==== osd_op_reply(61 [pgnls start_epoch 96 out=73b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:62 13.1e 13:78000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d87000 2024-04-25T09:09:12.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 9 ==== osd_op_reply(62 [pgnls start_epoch 96 out=49b] v93'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:63 13.1 13:80000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91473f400 2024-04-25T09:09:12.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 10 ==== osd_op_reply(63 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.563+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:64 13.11 13:88000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91488bc00 2024-04-25T09:09:12.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 13 ==== osd_op_reply(64 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:65 13.9 13:90000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d86c00 2024-04-25T09:09:12.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.5 v2:172.21.15.178:6802/3576783051 6 ==== osd_op_reply(65 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86c00 2024-04-25T09:09:12.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:66 13.19 13:98000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d87c00 2024-04-25T09:09:12.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.3 v2:172.21.15.59:6808/3810214969 4 ==== osd_op_reply(66 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c913d87c00 2024-04-25T09:09:12.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:67 13.5 13:a0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d87000 2024-04-25T09:09:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 10 ==== osd_op_reply(67 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:68 13.15 13:a8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d87000 2024-04-25T09:09:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 11 ==== osd_op_reply(68 [pgnls start_epoch 96 out=97b] v95'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:69 13.d 13:b0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d87000 2024-04-25T09:09:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 12 ==== osd_op_reply(69 [pgnls start_epoch 96 out=74b] v91'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:70 13.1d 13:b8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91488b800 2024-04-25T09:09:12.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 14 ==== osd_op_reply(70 [pgnls start_epoch 96 out=73b] v95'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:71 13.3 13:c0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d86800 2024-04-25T09:09:12.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.0 v2:172.21.15.59:6800/4129855307 7 ==== osd_op_reply(71 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e500 con 0x55c913d86800 2024-04-25T09:09:12.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:72 13.13 13:c8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91488b800 2024-04-25T09:09:12.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 15 ==== osd_op_reply(72 [pgnls start_epoch 96 out=98b] v95'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.567+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:73 13.b 13:d0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d86c00 2024-04-25T09:09:12.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.5 v2:172.21.15.178:6802/3576783051 7 ==== osd_op_reply(73 [pgnls start_epoch 96 out=76b] v95'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86c00 2024-04-25T09:09:12.558 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:74 13.1b 13:d8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d87000 2024-04-25T09:09:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 13 ==== osd_op_reply(74 [pgnls start_epoch 96 out=73b] v95'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:75 13.7 13:e0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91488b800 2024-04-25T09:09:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 16 ==== osd_op_reply(75 [pgnls start_epoch 96 out=73b] v95'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:76 13.17 13:e8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c913d86c00 2024-04-25T09:09:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.5 v2:172.21.15.178:6802/3576783051 8 ==== osd_op_reply(76 [pgnls start_epoch 96 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86c00 2024-04-25T09:09:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:77 13.f 13:f0000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91473f400 2024-04-25T09:09:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 11 ==== osd_op_reply(77 [pgnls start_epoch 96 out=73b] v91'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:78 13.1f 13:f8000000::::head [pgnls start_epoch 96 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91473f400 2024-04-25T09:09:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 12 ==== osd_op_reply(78 [pgnls start_epoch 96 out=101b] v95'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-25T09:09:12.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:79 13.10 13:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8400 con 0x55c91488bc00 2024-04-25T09:09:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 14 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-25T09:09:12.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:80 13.10 13:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8800 con 0x55c91488bc00 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 15 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:81 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87800 con 0x55c91488bc00 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 16 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 20 datascan.scan_links: injected ino detected 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:82 13.10 13:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913d87400 con 0x55c91488bc00 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 17 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:83 13.10 13:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913dc6000 con 0x55c91488bc00 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 18 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-25T09:09:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T09:09:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-25T09:09:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T09:09:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-25T09:09:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T09:09:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-25T09:09:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.571+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:84 13.14 13:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913dc6400 con 0x55c913d86800 2024-04-25T09:09:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.0 v2:172.21.15.59:6800/4129855307 8 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv26 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e500 con 0x55c913d86800 2024-04-25T09:09:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-25T09:09:12.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:85 13.1c 13:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913dc6800 con 0x55c91473f400 2024-04-25T09:09:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 13 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-04-25T09:09:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:86 13.a 13:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913dc6c00 con 0x55c913d86400 2024-04-25T09:09:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4882e00640 1 -- 172.21.15.59:0/400626654 <== osd.2 v2:172.21.15.59:6824/4113007731 6 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x55c913a7e780 con 0x55c913d86400 2024-04-25T09:09:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-25T09:09:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T09:09:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-25T09:09:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:87 13.e 13:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913dc7000 con 0x55c91488b800 2024-04-25T09:09:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 17 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-25T09:09:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:88 13.15 13:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913dc7400 con 0x55c913d87000 2024-04-25T09:09:12.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 14 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:89 13.1d 13:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913dc7800 con 0x55c91488b800 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 18 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:90 13.13 13:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913dc7c00 con 0x55c91488b800 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 19 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T09:09:12.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 200.00000002 2024-04-25T09:09:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-25T09:09:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-25T09:09:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:91 13.7 13:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913dc6800 con 0x55c91488b800 2024-04-25T09:09:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 20 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-25T09:09:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T09:09:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-25T09:09:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T09:09:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-25T09:09:12.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:92 13.1f 13:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8c00 con 0x55c91473f400 2024-04-25T09:09:12.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.6 v2:172.21.15.178:6800/2032393933 14 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1041 (crc 0 0 0) 0x55c913a7e000 con 0x55c91473f400 2024-04-25T09:09:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-04-25T09:09:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-25T09:09:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-04-25T09:09:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-04-25T09:09:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.575+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:93 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9000 con 0x55c91488bc00 2024-04-25T09:09:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 19 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4884d2c8c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T09:09:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:94 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9400 con 0x55c91488bc00 2024-04-25T09:09:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 20 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v96'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4884d2c8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T09:09:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4884d2c8c0 10 datascan.scan_links: processing 1 injected_inos 2024-04-25T09:09:12.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4884d2c8c0 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-04-25T09:09:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4884d2c8c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-04-25T09:09:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:95 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9c00 con 0x55c91488bc00 2024-04-25T09:09:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 21 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4884d2c8c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-25T09:09:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4884d2c8c0 20 datascan.scan_links: first is now 2 2024-04-25T09:09:12.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.579+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:96 13.10 13:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9800 con 0x55c91488bc00 2024-04-25T09:09:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4883800640 1 -- 172.21.15.59:0/400626654 <== osd.1 v2:172.21.15.59:6809/1450066050 22 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v96'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c913a7e500 con 0x55c91488bc00 2024-04-25T09:09:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-25T09:09:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 10 datascan.scan_links: updating inotable 2024-04-25T09:09:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:97 13.13 13:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8400 con 0x55c91488b800 2024-04-25T09:09:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 21 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+50 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-04-25T09:09:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-04-25T09:09:12.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:98 13.13 13:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db8800 con 0x55c91488b800 2024-04-25T09:09:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.7 v2:172.21.15.178:6824/965369534 22 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v96'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55c913a7e000 con 0x55c91488b800 2024-04-25T09:09:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 10 datascan.scan_links: updating snaptable 2024-04-25T09:09:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:99 13.d 13:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96) v9 -- 0x55c913db9000 con 0x55c913d87000 2024-04-25T09:09:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 <== osd.4 v2:172.21.15.178:6805/2278719369 15 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55c913a7e000 con 0x55c913d87000 2024-04-25T09:09:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c913d86800 msgr2=0x55c913d97080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c913d86800 0x55c913d97080 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55c91488bc00 msgr2=0x55c913d96000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55c91488bc00 0x55c913d96000 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55c913d86400 msgr2=0x55c913d96580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55c913d86400 0x55c913d96580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55c913d87c00 msgr2=0x55c913d97b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55c913d87c00 0x55c913d97b80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 reap_dead start 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55c913d87000 msgr2=0x55c913d98680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55c913d87000 0x55c913d98680 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55c913d86c00 msgr2=0x55c913d97600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 reap_dead start 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55c913d86c00 0x55c913d97600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55c91473f400 msgr2=0x55c913d96b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55c91473f400 0x55c913d96b00 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55c91488b800 msgr2=0x55c913b2a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55c91488b800 0x55c913b2a100 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55c913d86000 msgr2=0x55c913b2b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55c913d86000 0x55c913b2b700 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x55c914878c60 tx=0x55c914886c00 comp rx=0 tx=0).stop 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488ac00 msgr2=0x55c913b2b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/400626654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91488ac00 0x55c913b2b180 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x55c9148798f0 tx=0x55c913a10000 comp rx=0 tx=0).stop 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4882400640 1 -- 172.21.15.59:0/400626654 reap_dead start 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 shutdown_connections 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 >> 172.21.15.59:0/400626654 conn(0x55c91396ec00 msgr2=0x55c91399b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 shutdown_connections 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/400626654 wait complete. 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/1658373204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91396f800 msgr2=0x55c913b28580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/1658373204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91396f800 0x55c913b28580 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x55c9147af8c0 tx=0x55c913a48ae0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/1658373204 shutdown_connections 2024-04-25T09:09:12.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/1658373204 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c91396f000 0x55c913b29080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/1658373204 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c91396f400 0x55c913b28b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 --2- 172.21.15.59:0/1658373204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c91396f800 0x55c913b28580 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/1658373204 >> 172.21.15.59:0/1658373204 conn(0x55c91396fc00 msgr2=0x55c91399b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/1658373204 shutdown_connections 2024-04-25T09:09:12.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.583+0000 7f4884d2c8c0 1 -- 172.21.15.59:0/1658373204 wait complete. 2024-04-25T09:09:12.580 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.155764, result: 2024-04-25T09:09:12.580 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:09:12.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.779+0000 7f46ac000640 1 Processor -- start 2024-04-25T09:09:12.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.779+0000 7f46ac000640 1 -- start start 2024-04-25T09:09:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.779+0000 7f46ac000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a4159320 0x7f46a415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.779+0000 7f46ac000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46a415f440 0x7f46a406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.779+0000 7f46ac000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a415fc00 con 0x7f46a406e010 2024-04-25T09:09:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.779+0000 7f46ac000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a406d640 con 0x7f46a415f440 2024-04-25T09:09:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.779+0000 7f46ac000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a415fee0 con 0x7f46a4159320 2024-04-25T09:09:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.779+0000 7f46a8c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46a415f440 0x7f46a406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.779+0000 7f46a8c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46a415f440 0x7f46a406dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46916/0 (socket says 172.21.15.59:46916) 2024-04-25T09:09:12.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.779+0000 7f46a8c00640 1 -- 172.21.15.59:0/452839863 learned_addr learned my addr 172.21.15.59:0/452839863 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:12.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.783+0000 7f46a9600640 1 --2- 172.21.15.59:0/452839863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a4159320 0x7f46a415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.783+0000 7f46a8c00640 1 -- 172.21.15.59:0/452839863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a4159320 msgr2=0x7f46a415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:12.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.783+0000 7f46a8c00640 1 --2- 172.21.15.59:0/452839863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a4159320 0x7f46a415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.783+0000 7f46a8c00640 1 -- 172.21.15.59:0/452839863 >> v1:172.21.15.178:6789/0 conn(0x7f46a406e010 legacy=0x7f46a406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.783+0000 7f46a8c00640 1 -- 172.21.15.59:0/452839863 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a41601c0 con 0x7f46a415f440 2024-04-25T09:09:12.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.783+0000 7f46a8c00640 1 --2- 172.21.15.59:0/452839863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a415f440 0x7f46a406dad0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f4690009870 tx=0x7f469001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8278295633e5463b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.783+0000 7f46a3e00640 1 -- 172.21.15.59:0/452839863 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900aa620 con 0x7f46a415f440 2024-04-25T09:09:12.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.783+0000 7f46a3e00640 1 -- 172.21.15.59:0/452839863 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46900af070 con 0x7f46a415f440 2024-04-25T09:09:12.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.783+0000 7f46a3e00640 1 -- 172.21.15.59:0/452839863 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900aa9e0 con 0x7f46a415f440 2024-04-25T09:09:12.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 -- 172.21.15.59:0/452839863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a415f440 msgr2=0x7f46a406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 --2- 172.21.15.59:0/452839863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a415f440 0x7f46a406dad0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f4690009870 tx=0x7f469001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 -- 172.21.15.59:0/452839863 shutdown_connections 2024-04-25T09:09:12.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 --2- 172.21.15.59:0/452839863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a415f440 0x7f46a406dad0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 --2- 172.21.15.59:0/452839863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a4159320 0x7f46a415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 -- 172.21.15.59:0/452839863 >> 172.21.15.59:0/452839863 conn(0x7f46a4067080 msgr2=0x7f46a406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:12.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 -- 172.21.15.59:0/452839863 shutdown_connections 2024-04-25T09:09:12.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 -- 172.21.15.59:0/452839863 wait complete. 2024-04-25T09:09:12.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 Processor -- start 2024-04-25T09:09:12.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 -- start start 2024-04-25T09:09:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a406e010 0x7f46a40b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a4159320 0x7f46a40afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a415f440 0x7f46a415e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a4071c00 con 0x7f46a4159320 2024-04-25T09:09:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a4071a80 con 0x7f46a415f440 2024-04-25T09:09:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46ac000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a406ebb0 con 0x7f46a406e010 2024-04-25T09:09:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46a9600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a406e010 0x7f46a40b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46a8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a4159320 0x7f46a40afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46a9600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a406e010 0x7f46a40b0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:56892/0 (socket says 172.21.15.59:56892) 2024-04-25T09:09:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46a9600640 1 -- 172.21.15.59:0/1684533015 learned_addr learned my addr 172.21.15.59:0/1684533015 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46aa000640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a415f440 0x7f46a415e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46a8c00640 1 -- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a406e010 msgr2=0x7f46a40b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46a8c00640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a406e010 0x7f46a40b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46a8c00640 1 -- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a415f440 msgr2=0x7f46a415e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46a8c00640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a415f440 0x7f46a415e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46a8c00640 1 -- 172.21.15.59:0/1684533015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a412cba0 con 0x7f46a4159320 2024-04-25T09:09:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.787+0000 7f46a8c00640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a4159320 0x7f46a40afc80 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f46900ab000 tx=0x7f469001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.791+0000 7f46a1600640 1 -- 172.21.15.59:0/1684533015 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900aad10 con 0x7f46a4159320 2024-04-25T09:09:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.791+0000 7f46a1600640 1 -- 172.21.15.59:0/1684533015 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46900bd3f0 con 0x7f46a4159320 2024-04-25T09:09:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.791+0000 7f46a1600640 1 -- 172.21.15.59:0/1684533015 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46900bd7e0 con 0x7f46a4159320 2024-04-25T09:09:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.791+0000 7f46ac000640 1 -- 172.21.15.59:0/1684533015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a412ce80 con 0x7f46a4159320 2024-04-25T09:09:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.791+0000 7f46ac000640 1 -- 172.21.15.59:0/1684533015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a412d440 con 0x7f46a4159320 2024-04-25T09:09:12.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.791+0000 7f46ac000640 1 -- 172.21.15.59:0/1684533015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a40745d0 con 0x7f46a4159320 2024-04-25T09:09:12.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.791+0000 7f46a1600640 1 -- 172.21.15.59:0/1684533015 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f46900b33f0 con 0x7f46a4159320 2024-04-25T09:09:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.791+0000 7f46a1600640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4684066f60 0x7f4684069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.791+0000 7f46a1600640 1 -- 172.21.15.59:0/1684533015 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f469011eef0 con 0x7f46a4159320 2024-04-25T09:09:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.791+0000 7f46a9600640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4684066f60 0x7f4684069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.795+0000 7f46a9600640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4684066f60 0x7f4684069420 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4698007b10 tx=0x7f4698008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:12.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.795+0000 7f46a1600640 1 -- 172.21.15.59:0/1684533015 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4690016150 con 0x7f46a4159320 2024-04-25T09:09:12.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:12.995+0000 7f46ac000640 1 -- 172.21.15.59:0/1684533015 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f46a406acb0 con 0x7f46a4159320 2024-04-25T09:09:13.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.143+0000 7f46a1600640 1 -- 172.21.15.59:0/1684533015 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v74) v1 ==== 162+0+0 (secure 0 0 0) 0x7f46900ef560 con 0x7f46a4159320 2024-04-25T09:09:13.134 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:09:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.147+0000 7f46ac000640 1 -- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4684066f60 msgr2=0x7f4684069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.147+0000 7f46ac000640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4684066f60 0x7f4684069420 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f4698007b10 tx=0x7f4698008040 comp rx=0 tx=0).stop 2024-04-25T09:09:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.147+0000 7f46ac000640 1 -- 172.21.15.59:0/1684533015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a4159320 msgr2=0x7f46a40afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.147+0000 7f46ac000640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a4159320 0x7f46a40afc80 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f46900ab000 tx=0x7f469001ace0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.147+0000 7f46ac000640 1 -- 172.21.15.59:0/1684533015 shutdown_connections 2024-04-25T09:09:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.147+0000 7f46ac000640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4684066f60 0x7f4684069420 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.147+0000 7f46ac000640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f46a415f440 0x7f46a415e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.147+0000 7f46ac000640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46a4159320 0x7f46a40afc80 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.147+0000 7f46ac000640 1 --2- 172.21.15.59:0/1684533015 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f46a406e010 0x7f46a40b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.147+0000 7f46ac000640 1 -- 172.21.15.59:0/1684533015 >> 172.21.15.59:0/1684533015 conn(0x7f46a4067080 msgr2=0x7f46a4144ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.147+0000 7f46ac000640 1 -- 172.21.15.59:0/1684533015 shutdown_connections 2024-04-25T09:09:13.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.147+0000 7f46ac000640 1 -- 172.21.15.59:0/1684533015 wait complete. 2024-04-25T09:09:13.160 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:13.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.311+0000 7f3f5ca00640 1 Processor -- start 2024-04-25T09:09:13.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.311+0000 7f3f5ca00640 1 -- start start 2024-04-25T09:09:13.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.311+0000 7f3f5ca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f580b44a0 0x7f3f5806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.311+0000 7f3f5ca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f580ce650 0x7f3f580b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f5ca00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f580685a0 con 0x7f3f5806e800 2024-04-25T09:09:13.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f5ca00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f580ce1c0 con 0x7f3f580b44a0 2024-04-25T09:09:13.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f5ca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f580b49e0 con 0x7f3f580ce650 2024-04-25T09:09:13.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f4d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f580b44a0 0x7f3f5806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f4d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3f580b44a0 0x7f3f5806ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46934/0 (socket says 172.21.15.59:46934) 2024-04-25T09:09:13.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f4d400640 1 -- 172.21.15.59:0/3458857231 learned_addr learned my addr 172.21.15.59:0/3458857231 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:13.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f56800640 1 --2- 172.21.15.59:0/3458857231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f580ce650 0x7f3f580b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f4d400640 1 -- 172.21.15.59:0/3458857231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f580ce650 msgr2=0x7f3f580b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:13.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f4d400640 1 --2- 172.21.15.59:0/3458857231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f580ce650 0x7f3f580b2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f4d400640 1 -- 172.21.15.59:0/3458857231 >> v1:172.21.15.178:6789/0 conn(0x7f3f5806e800 legacy=0x7f3f5815b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f4d400640 1 -- 172.21.15.59:0/3458857231 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580b4cc0 con 0x7f3f580b44a0 2024-04-25T09:09:13.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f4d400640 1 --2- 172.21.15.59:0/3458857231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f580b44a0 0x7f3f5806ebe0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009870 tx=0x7f3f4801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51c93115986ec77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f55400640 1 -- 172.21.15.59:0/3458857231 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480b2070 con 0x7f3f580b44a0 2024-04-25T09:09:13.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f55400640 1 -- 172.21.15.59:0/3458857231 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f480a9070 con 0x7f3f580b44a0 2024-04-25T09:09:13.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.315+0000 7f3f55400640 1 -- 172.21.15.59:0/3458857231 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480ad880 con 0x7f3f580b44a0 2024-04-25T09:09:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 -- 172.21.15.59:0/3458857231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f580b44a0 msgr2=0x7f3f5806ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 --2- 172.21.15.59:0/3458857231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f580b44a0 0x7f3f5806ebe0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009870 tx=0x7f3f4801c560 comp rx=0 tx=0).stop 2024-04-25T09:09:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 -- 172.21.15.59:0/3458857231 shutdown_connections 2024-04-25T09:09:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 --2- 172.21.15.59:0/3458857231 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f580ce650 0x7f3f580b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 --2- 172.21.15.59:0/3458857231 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f580b44a0 0x7f3f5806ebe0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 -- 172.21.15.59:0/3458857231 >> 172.21.15.59:0/3458857231 conn(0x7f3f580b17b0 msgr2=0x7f3f580b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 -- 172.21.15.59:0/3458857231 shutdown_connections 2024-04-25T09:09:13.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 -- 172.21.15.59:0/3458857231 wait complete. 2024-04-25T09:09:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 Processor -- start 2024-04-25T09:09:13.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 -- start start 2024-04-25T09:09:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f5806e800 0x7f3f580ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f580b44a0 0x7f3f5815b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f580ce650 0x7f3f580aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f58167b60 con 0x7f3f5806e800 2024-04-25T09:09:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f580b3400 con 0x7f3f580b44a0 2024-04-25T09:09:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f5ca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f58167ce0 con 0x7f3f580ce650 2024-04-25T09:09:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f55e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f5806e800 0x7f3f580ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f55e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f5806e800 0x7f3f580ae5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46950/0 (socket says 172.21.15.59:46950) 2024-04-25T09:09:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f55e00640 1 -- 172.21.15.59:0/835610807 learned_addr learned my addr 172.21.15.59:0/835610807 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:13.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f56800640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f580ce650 0x7f3f580aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f55e00640 1 -- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f580ce650 msgr2=0x7f3f580aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f4d400640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f580b44a0 0x7f3f5815b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f55e00640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f580ce650 0x7f3f580aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f55e00640 1 -- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f580b44a0 msgr2=0x7f3f5815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.319+0000 7f3f55e00640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f580b44a0 0x7f3f5815b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f55e00640 1 -- 172.21.15.59:0/835610807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580ad520 con 0x7f3f5806e800 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f4d400640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f580b44a0 0x7f3f5815b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f55e00640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f5806e800 0x7f3f580ae5c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000c420 tx=0x7f3f4000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f4ea00640 1 -- 172.21.15.59:0/835610807 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f400052d0 con 0x7f3f5806e800 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f4ea00640 1 -- 172.21.15.59:0/835610807 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f40005470 con 0x7f3f5806e800 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f4ea00640 1 -- 172.21.15.59:0/835610807 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40007260 con 0x7f3f5806e800 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f5ca00640 1 -- 172.21.15.59:0/835610807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f580ad800 con 0x7f3f5806e800 2024-04-25T09:09:13.312 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f5ca00640 1 -- 172.21.15.59:0/835610807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f580addc0 con 0x7f3f5806e800 2024-04-25T09:09:13.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f5ca00640 1 -- 172.21.15.59:0/835610807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f580ae1f0 con 0x7f3f5806e800 2024-04-25T09:09:13.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f4ea00640 1 -- 172.21.15.59:0/835610807 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3f40007400 con 0x7f3f5806e800 2024-04-25T09:09:13.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f4ea00640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3f34066f60 0x7f3f34069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:13.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f4ea00640 1 -- 172.21.15.59:0/835610807 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f3f40084820 con 0x7f3f5806e800 2024-04-25T09:09:13.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.323+0000 7f3f4d400640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3f34066f60 0x7f3f34069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:13.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.327+0000 7f3f4d400640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3f34066f60 0x7f3f34069420 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3f480af000 tx=0x7f3f48008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:13.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.327+0000 7f3f4ea00640 1 -- 172.21.15.59:0/835610807 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3f40055570 con 0x7f3f5806e800 2024-04-25T09:09:13.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.527+0000 7f3f5ca00640 1 -- 172.21.15.59:0/835610807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f580745d0 con 0x7f3f5806e800 2024-04-25T09:09:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.527+0000 7f3f4ea00640 1 -- 172.21.15.59:0/835610807 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f3f40082e20 con 0x7f3f5806e800 2024-04-25T09:09:13.517 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:13.517 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":75,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:09:13.150786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7965":{"gid":7965,"name":"a","rank":0,"incarnation":75,"state":"up:replay","state_seq":1,"addr":"172.21.15.59:6835/1467736863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1467736863},{"type":"v1","addr":"172.21.15.59:6835","nonce":1467736863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:09:13.517 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 75 2024-04-25T09:09:13.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.531+0000 7f3f5ca00640 1 -- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3f34066f60 msgr2=0x7f3f34069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.531+0000 7f3f5ca00640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3f34066f60 0x7f3f34069420 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3f480af000 tx=0x7f3f48008040 comp rx=0 tx=0).stop 2024-04-25T09:09:13.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.531+0000 7f3f5ca00640 1 -- 172.21.15.59:0/835610807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f5806e800 msgr2=0x7f3f580ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:13.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.531+0000 7f3f5ca00640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f5806e800 0x7f3f580ae5c0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000c420 tx=0x7f3f4000c8e0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.531+0000 7f3f5ca00640 1 -- 172.21.15.59:0/835610807 shutdown_connections 2024-04-25T09:09:13.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.531+0000 7f3f5ca00640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3f34066f60 0x7f3f34069420 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.531+0000 7f3f5ca00640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3f580ce650 0x7f3f580aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.531+0000 7f3f5ca00640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3f580b44a0 0x7f3f5815b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.531+0000 7f3f5ca00640 1 --2- 172.21.15.59:0/835610807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f5806e800 0x7f3f580ae5c0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:13.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.531+0000 7f3f5ca00640 1 -- 172.21.15.59:0/835610807 >> 172.21.15.59:0/835610807 conn(0x7f3f580b17b0 msgr2=0x7f3f58159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:13.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.531+0000 7f3f5ca00640 1 -- 172.21.15.59:0/835610807 shutdown_connections 2024-04-25T09:09:13.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:13.531+0000 7f3f5ca00640 1 -- 172.21.15.59:0/835610807 wait complete. 2024-04-25T09:09:13.940 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:07:48.892826+0000', 'modified': '2024-04-25T09:09:13.150786+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 96, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7965}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7965': {'gid': 7965, 'name': 'a', 'rank': 0, 'incarnation': 75, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.59:6835/1467736863', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 1467736863}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 1467736863}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:09:13.941 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7965:up:replay 2024-04-25T09:09:14.942 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:15.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.103+0000 7f8673600640 1 Processor -- start 2024-04-25T09:09:15.094 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.103+0000 7f8673600640 1 -- start start 2024-04-25T09:09:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f8673600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f866c0cef30 0x7f866c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f8673600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c06e900 0x7f866c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f8673600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866c15ac60 con 0x7f866c144140 2024-04-25T09:09:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f8673600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c06ed50 con 0x7f866c0cef30 2024-04-25T09:09:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f8673600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0cf3e0 con 0x7f866c06e900 2024-04-25T09:09:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f866be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f866c0cef30 0x7f866c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f8670c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f866c144140 0x7f866c0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38786/0 (socket says 172.21.15.59:38786) 2024-04-25T09:09:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f8670c00640 1 -- 172.21.15.59:0/2676314777 learned_addr learned my addr 172.21.15.59:0/2676314777 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:15.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f8671600640 1 --2- 172.21.15.59:0/2676314777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c06e900 0x7f866c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f866be00640 1 -- 172.21.15.59:0/2676314777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c06e900 msgr2=0x7f866c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f866be00640 1 --2- 172.21.15.59:0/2676314777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c06e900 0x7f866c0b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f866be00640 1 -- 172.21.15.59:0/2676314777 >> v1:172.21.15.59:6789/0 conn(0x7f866c144140 legacy=0x7f866c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f866be00640 1 -- 172.21.15.59:0/2676314777 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c15af20 con 0x7f866c0cef30 2024-04-25T09:09:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f866b400640 1 -- 172.21.15.59:0/2676314777 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3399113591 0 0) 0x7f866c15ac60 con 0x7f866c144140 2024-04-25T09:09:15.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.107+0000 7f8671600640 1 --2- 172.21.15.59:0/2676314777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c06e900 0x7f866c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f866be00640 1 --2- 172.21.15.59:0/2676314777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c0cef30 0x7f866c06e3c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f865800ba60 tx=0x7f865801eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7146533ebaef09a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f866b400640 1 -- 172.21.15.59:0/2676314777 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86580b4070 con 0x7f866c0cef30 2024-04-25T09:09:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f866b400640 1 -- 172.21.15.59:0/2676314777 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86580a7760 con 0x7f866c0cef30 2024-04-25T09:09:15.099 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f866b400640 1 -- 172.21.15.59:0/2676314777 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86580a7b30 con 0x7f866c0cef30 2024-04-25T09:09:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f8673600640 1 -- 172.21.15.59:0/2676314777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c0cef30 msgr2=0x7f866c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f8673600640 1 --2- 172.21.15.59:0/2676314777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c0cef30 0x7f866c06e3c0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f865800ba60 tx=0x7f865801eb70 comp rx=0 tx=0).stop 2024-04-25T09:09:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f8673600640 1 -- 172.21.15.59:0/2676314777 shutdown_connections 2024-04-25T09:09:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f8673600640 1 --2- 172.21.15.59:0/2676314777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c06e900 0x7f866c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f8673600640 1 --2- 172.21.15.59:0/2676314777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c0cef30 0x7f866c06e3c0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.100 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f8673600640 1 -- 172.21.15.59:0/2676314777 >> 172.21.15.59:0/2676314777 conn(0x7f866c066fa0 msgr2=0x7f866c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f8673600640 1 -- 172.21.15.59:0/2676314777 shutdown_connections 2024-04-25T09:09:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f8673600640 1 -- 172.21.15.59:0/2676314777 wait complete. 2024-04-25T09:09:15.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f8673600640 1 Processor -- start 2024-04-25T09:09:15.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.111+0000 7f8673600640 1 -- start start 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8673600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c06e900 0x7f866c131e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8673600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c0cef30 0x7f866c163790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8673600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f866c144140 0x7f866c163cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8673600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c15ba00 con 0x7f866c0cef30 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8673600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c144520 con 0x7f866c144140 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8673600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c15bb80 con 0x7f866c06e900 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f866be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c0cef30 0x7f866c163790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f866be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c0cef30 0x7f866c163790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46972/0 (socket says 172.21.15.59:46972) 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f866be00640 1 -- 172.21.15.59:0/222474016 learned_addr learned my addr 172.21.15.59:0/222474016 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8670c00640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c06e900 0x7f866c131e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8671600640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f866c144140 0x7f866c163cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f866be00640 1 -- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c06e900 msgr2=0x7f866c131e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:15.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f866be00640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c06e900 0x7f866c131e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f866be00640 1 -- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f866c144140 msgr2=0x7f866c163cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:15.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f866be00640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f866c144140 0x7f866c163cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f866be00640 1 -- 172.21.15.59:0/222474016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c154300 con 0x7f866c0cef30 2024-04-25T09:09:15.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f866be00640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c0cef30 0x7f866c163790 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f865801c7a0 tx=0x7f865801b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:15.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8668c00640 1 -- 172.21.15.59:0/222474016 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86580bd070 con 0x7f866c0cef30 2024-04-25T09:09:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8668c00640 1 -- 172.21.15.59:0/222474016 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86580af660 con 0x7f866c0cef30 2024-04-25T09:09:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8673600640 1 -- 172.21.15.59:0/222474016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c151c00 con 0x7f866c0cef30 2024-04-25T09:09:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8668c00640 1 -- 172.21.15.59:0/222474016 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86580b4040 con 0x7f866c0cef30 2024-04-25T09:09:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8673600640 1 -- 172.21.15.59:0/222474016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c1521c0 con 0x7f866c0cef30 2024-04-25T09:09:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.115+0000 7f8673600640 1 -- 172.21.15.59:0/222474016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c0745d0 con 0x7f866c0cef30 2024-04-25T09:09:15.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.119+0000 7f8668c00640 1 -- 172.21.15.59:0/222474016 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f86580c0070 con 0x7f866c0cef30 2024-04-25T09:09:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.119+0000 7f8668c00640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f864c066f60 0x7f864c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.119+0000 7f8668c00640 1 -- 172.21.15.59:0/222474016 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f865811e9b0 con 0x7f866c0cef30 2024-04-25T09:09:15.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.119+0000 7f8670c00640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f864c066f60 0x7f864c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:15.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.119+0000 7f8670c00640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f864c066f60 0x7f864c069420 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8660000f70 tx=0x7f8660007df0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:15.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.123+0000 7f8668c00640 1 -- 172.21.15.59:0/222474016 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f866c154300 con 0x7f866c0cef30 2024-04-25T09:09:15.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.319+0000 7f8673600640 1 -- 172.21.15.59:0/222474016 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f866c1323c0 con 0x7f866c0cef30 2024-04-25T09:09:15.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8668c00640 1 -- 172.21.15.59:0/222474016 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f8658018760 con 0x7f866c0cef30 2024-04-25T09:09:15.311 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:15.311 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":77,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:09:14.156870+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7965":{"gid":7965,"name":"a","rank":0,"incarnation":75,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.59:6835/1467736863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1467736863},{"type":"v1","addr":"172.21.15.59:6835","nonce":1467736863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:09:15.311 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 77 2024-04-25T09:09:15.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8673600640 1 -- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f864c066f60 msgr2=0x7f864c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:15.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8673600640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f864c066f60 0x7f864c069420 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8660000f70 tx=0x7f8660007df0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8673600640 1 -- 172.21.15.59:0/222474016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c0cef30 msgr2=0x7f866c163790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:15.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8673600640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c0cef30 0x7f866c163790 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f865801c7a0 tx=0x7f865801b910 comp rx=0 tx=0).stop 2024-04-25T09:09:15.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8673600640 1 -- 172.21.15.59:0/222474016 shutdown_connections 2024-04-25T09:09:15.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8673600640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f864c066f60 0x7f864c069420 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8673600640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f866c144140 0x7f866c163cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8673600640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f866c0cef30 0x7f866c163790 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8673600640 1 --2- 172.21.15.59:0/222474016 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f866c06e900 0x7f866c131e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:15.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8673600640 1 -- 172.21.15.59:0/222474016 >> 172.21.15.59:0/222474016 conn(0x7f866c066fa0 msgr2=0x7f866c0ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:15.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8673600640 1 -- 172.21.15.59:0/222474016 shutdown_connections 2024-04-25T09:09:15.314 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:15.323+0000 7f8673600640 1 -- 172.21.15.59:0/222474016 wait complete. 2024-04-25T09:09:15.734 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 77, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:07:48.892826+0000', 'modified': '2024-04-25T09:09:14.156870+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 96, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7965}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7965': {'gid': 7965, 'name': 'a', 'rank': 0, 'incarnation': 75, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.59:6835/1467736863', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 1467736863}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 1467736863}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:09:15.735 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7965:up:rejoin 2024-04-25T09:09:16.736 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:16.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.899+0000 7faae0000640 1 Processor -- start 2024-04-25T09:09:16.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.899+0000 7faae0000640 1 -- start start 2024-04-25T09:09:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.899+0000 7faae0000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad80cef30 0x7faad806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.899+0000 7faae0000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad815ac60 con 0x7faad806e900 2024-04-25T09:09:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.899+0000 7faae0000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad80cf3e0 con 0x7faad8144140 2024-04-25T09:09:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.899+0000 7faae0000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad806ed30 con 0x7faad80cef30 2024-04-25T09:09:16.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faade000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faad806e900 0x7faad80b0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38798/0 (socket says 172.21.15.59:38798) 2024-04-25T09:09:16.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faade000640 1 -- 172.21.15.59:0/377695746 learned_addr learned my addr 172.21.15.59:0/377695746 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faadcc00640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad80cef30 0x7faad806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899154835 0 0) 0x7faad815ac60 con 0x7faad806e900 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac0003530 con 0x7faad806e900 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 219434241 0 0) 0x7faac0003530 con 0x7faad806e900 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad80cef30 msgr2=0x7faad806e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad80cef30 0x7faad806e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 >> v1:172.21.15.178:6789/0 conn(0x7faad8144140 legacy=0x7faad80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad815af20 con 0x7faad806e900 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7faad0001a00 con 0x7faad806e900 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 >> v1:172.21.15.59:6789/0 conn(0x7faad806e900 legacy=0x7faad80b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad80cef30 0x7faac00039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0003f30 0x7faac0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faac0004d50 0x7faac00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad806ed30 con 0x7faac0003f30 2024-04-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac000ba80 con 0x7faac0004d50 2024-04-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac000de90 con 0x7faad80cef30 2024-04-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faadcc00640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0003f30 0x7faac0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faadd600640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad80cef30 0x7faac00039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faade000640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faac0004d50 0x7faac00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faadcc00640 1 -- 172.21.15.59:0/377695746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad80cef30 msgr2=0x7faac00039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faadcc00640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad80cef30 0x7faac00039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faadcc00640 1 -- 172.21.15.59:0/377695746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faac0004d50 msgr2=0x7faac00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faadcc00640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faac0004d50 0x7faac00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faadcc00640 1 -- 172.21.15.59:0/377695746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac0003530 con 0x7faac0003f30 2024-04-25T09:09:16.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.903+0000 7faadd600640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad80cef30 0x7faac00039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:16.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faadcc00640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0003f30 0x7faac0004810 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7faac4009ab0 tx=0x7faac401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ed2f3c57bcf8a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:16.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40b2070 con 0x7faac0003f30 2024-04-25T09:09:16.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac40a5640 con 0x7faac0003f30 2024-04-25T09:09:16.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faad7e00640 1 -- 172.21.15.59:0/377695746 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac40096b0 con 0x7faac0003f30 2024-04-25T09:09:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faae0000640 1 -- 172.21.15.59:0/377695746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0003f30 msgr2=0x7faac0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faae0000640 1 --2- 172.21.15.59:0/377695746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0003f30 0x7faac0004810 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7faac4009ab0 tx=0x7faac401ca50 comp rx=0 tx=0).stop 2024-04-25T09:09:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faade000640 1 -- 172.21.15.59:0/377695746 reap_dead start 2024-04-25T09:09:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faae0000640 1 -- 172.21.15.59:0/377695746 shutdown_connections 2024-04-25T09:09:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faae0000640 1 -- 172.21.15.59:0/377695746 >> 172.21.15.59:0/377695746 conn(0x7faad8066fa0 msgr2=0x7faad806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:16.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faae0000640 1 -- 172.21.15.59:0/377695746 shutdown_connections 2024-04-25T09:09:16.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faae0000640 1 -- 172.21.15.59:0/377695746 wait complete. 2024-04-25T09:09:16.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faae0000640 1 Processor -- start 2024-04-25T09:09:16.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.907+0000 7faae0000640 1 -- start start 2024-04-25T09:09:16.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faae0000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0003f30 0x7faad813a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faae0000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8151d80 0x7faad8156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faae0000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad8152200 0x7faad81570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faae0000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad80b1f30 con 0x7faac0003f30 2024-04-25T09:09:16.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faae0000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad815b4e0 con 0x7faad8151d80 2024-04-25T09:09:16.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faae0000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad8144520 con 0x7faad8152200 2024-04-25T09:09:16.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faadd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0003f30 0x7faad813a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faadd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0003f30 0x7faad813a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46996/0 (socket says 172.21.15.59:46996) 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faadd600640 1 -- 172.21.15.59:0/2297800679 learned_addr learned my addr 172.21.15.59:0/2297800679 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faadcc00640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8151d80 0x7faad8156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faade000640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad8152200 0x7faad81570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faadd600640 1 -- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad8152200 msgr2=0x7faad81570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faadd600640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad8152200 0x7faad81570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faadd600640 1 -- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8151d80 msgr2=0x7faad8156b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faadd600640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8151d80 0x7faad8156b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faadd600640 1 -- 172.21.15.59:0/2297800679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad813f530 con 0x7faac0003f30 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faadcc00640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8151d80 0x7faad8156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faadd600640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0003f30 0x7faad813a9c0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7faacc011b70 tx=0x7faacc00f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faad5600640 1 -- 172.21.15.59:0/2297800679 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc019020 con 0x7faac0003f30 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faad5600640 1 -- 172.21.15.59:0/2297800679 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc011c60 con 0x7faac0003f30 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faad5600640 1 -- 172.21.15.59:0/2297800679 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0050d0 con 0x7faac0003f30 2024-04-25T09:09:16.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faae0000640 1 -- 172.21.15.59:0/2297800679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad813f810 con 0x7faac0003f30 2024-04-25T09:09:16.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faae0000640 1 -- 172.21.15.59:0/2297800679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad81590e0 con 0x7faac0003f30 2024-04-25T09:09:16.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faae0000640 1 -- 172.21.15.59:0/2297800679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad80745d0 con 0x7faac0003f30 2024-04-25T09:09:16.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.911+0000 7faad5600640 1 -- 172.21.15.59:0/2297800679 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faacc01c020 con 0x7faac0003f30 2024-04-25T09:09:16.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.915+0000 7faad5600640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faab8066f60 0x7faab8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:16.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.915+0000 7faad5600640 1 -- 172.21.15.59:0/2297800679 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7faacc088820 con 0x7faac0003f30 2024-04-25T09:09:16.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.915+0000 7faadcc00640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faab8066f60 0x7faab8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:16.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.915+0000 7faadcc00640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faab8066f60 0x7faab8069420 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7faac4009ab0 tx=0x7faac40046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:16.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:16.919+0000 7faad5600640 1 -- 172.21.15.59:0/2297800679 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faacc023030 con 0x7faac0003f30 2024-04-25T09:09:17.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 -- 172.21.15.59:0/2297800679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faad813af30 con 0x7faac0003f30 2024-04-25T09:09:17.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faad5600640 1 -- 172.21.15.59:0/2297800679 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4947 (secure 0 0 0) 0x7faacc01b2c0 con 0x7faac0003f30 2024-04-25T09:09:17.104 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:17.104 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:09:15.158723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7965":{"gid":7965,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1467736863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1467736863},{"type":"v1","addr":"172.21.15.59:6835","nonce":1467736863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:09:17.104 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 78 2024-04-25T09:09:17.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 -- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faab8066f60 msgr2=0x7faab8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faab8066f60 0x7faab8069420 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7faac4009ab0 tx=0x7faac40046d0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 -- 172.21.15.59:0/2297800679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0003f30 msgr2=0x7faad813a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0003f30 0x7faad813a9c0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7faacc011b70 tx=0x7faacc00f5a0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 -- 172.21.15.59:0/2297800679 shutdown_connections 2024-04-25T09:09:17.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faab8066f60 0x7faab8069420 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faad8152200 0x7faad81570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faad8151d80 0x7faad8156b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 --2- 172.21.15.59:0/2297800679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faac0003f30 0x7faad813a9c0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 -- 172.21.15.59:0/2297800679 >> 172.21.15.59:0/2297800679 conn(0x7faad8066fa0 msgr2=0x7faad815d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:17.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 -- 172.21.15.59:0/2297800679 shutdown_connections 2024-04-25T09:09:17.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.115+0000 7faae0000640 1 -- 172.21.15.59:0/2297800679 wait complete. 2024-04-25T09:09:17.527 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:07:48.892826+0000', 'modified': '2024-04-25T09:09:15.158723+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 96, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7965}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7965': {'gid': 7965, 'name': 'a', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.59:6835/1467736863', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 1467736863}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 1467736863}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:09:17.528 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:09:17.528 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:09:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c31e00640 1 Processor -- start 2024-04-25T09:09:17.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c31e00640 1 -- start start 2024-04-25T09:09:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c31e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c2c15dc60 0x7f7c2c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c31e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c06bf30 0x7f7c2c0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c31e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c15e040 con 0x7f7c2c099a60 2024-04-25T09:09:17.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c31e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c0cff80 con 0x7f7c2c15dc60 2024-04-25T09:09:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c31e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0d0260 con 0x7f7c2c06bf30 2024-04-25T09:09:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c2aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c2c15dc60 0x7f7c2c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c2aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c2c15dc60 0x7f7c2c0d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47004/0 (socket says 172.21.15.59:47004) 2024-04-25T09:09:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c2aa00640 1 -- 172.21.15.59:0/1643767807 learned_addr learned my addr 172.21.15.59:0/1643767807 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:17.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c22000640 1 --2- 172.21.15.59:0/1643767807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c06bf30 0x7f7c2c0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c2aa00640 1 -- 172.21.15.59:0/1643767807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c06bf30 msgr2=0x7f7c2c0cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/1643767807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c06bf30 0x7f7c2c0cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c2aa00640 1 -- 172.21.15.59:0/1643767807 >> v1:172.21.15.178:6789/0 conn(0x7f7c2c099a60 legacy=0x7f7c2c0cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c2aa00640 1 -- 172.21.15.59:0/1643767807 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0d0540 con 0x7f7c2c15dc60 2024-04-25T09:09:17.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.683+0000 7f7c22000640 1 --2- 172.21.15.59:0/1643767807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c06bf30 0x7f7c2c0cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.687+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/1643767807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2c15dc60 0x7f7c2c0d1020 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009870 tx=0x7f7c1c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaec927b775a46b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.687+0000 7f7c2a000640 1 -- 172.21.15.59:0/1643767807 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0ab620 con 0x7f7c2c15dc60 2024-04-25T09:09:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.687+0000 7f7c2a000640 1 -- 172.21.15.59:0/1643767807 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0b0070 con 0x7f7c2c15dc60 2024-04-25T09:09:17.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.687+0000 7f7c2a000640 1 -- 172.21.15.59:0/1643767807 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0ab9e0 con 0x7f7c2c15dc60 2024-04-25T09:09:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.687+0000 7f7c31e00640 1 -- 172.21.15.59:0/1643767807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2c15dc60 msgr2=0x7f7c2c0d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.687+0000 7f7c31e00640 1 --2- 172.21.15.59:0/1643767807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2c15dc60 0x7f7c2c0d1020 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009870 tx=0x7f7c1c01c460 comp rx=0 tx=0).stop 2024-04-25T09:09:17.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.687+0000 7f7c31e00640 1 -- 172.21.15.59:0/1643767807 shutdown_connections 2024-04-25T09:09:17.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.687+0000 7f7c31e00640 1 --2- 172.21.15.59:0/1643767807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c06bf30 0x7f7c2c0cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.687+0000 7f7c31e00640 1 --2- 172.21.15.59:0/1643767807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2c15dc60 0x7f7c2c0d1020 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.687+0000 7f7c31e00640 1 -- 172.21.15.59:0/1643767807 >> 172.21.15.59:0/1643767807 conn(0x7f7c2c0b3200 msgr2=0x7f7c2c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:17.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.687+0000 7f7c31e00640 1 -- 172.21.15.59:0/1643767807 shutdown_connections 2024-04-25T09:09:17.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.687+0000 7f7c31e00640 1 -- 172.21.15.59:0/1643767807 wait complete. 2024-04-25T09:09:17.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c31e00640 1 Processor -- start 2024-04-25T09:09:17.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c31e00640 1 -- start start 2024-04-25T09:09:17.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c31e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2c06bf30 0x7f7c2c14c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c31e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2c099a60 0x7f7c2c0b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c31e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c15dc60 0x7f7c2c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c31e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c06cfa0 con 0x7f7c2c06bf30 2024-04-25T09:09:17.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c31e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c0cc880 con 0x7f7c2c099a60 2024-04-25T09:09:17.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c31e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c14cf50 con 0x7f7c2c15dc60 2024-04-25T09:09:17.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c2aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2c06bf30 0x7f7c2c14c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c2aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2c06bf30 0x7f7c2c14c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47010/0 (socket says 172.21.15.59:47010) 2024-04-25T09:09:17.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c2aa00640 1 -- 172.21.15.59:0/2384565092 learned_addr learned my addr 172.21.15.59:0/2384565092 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:17.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c22000640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2c099a60 0x7f7c2c0b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c2b400640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c15dc60 0x7f7c2c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c2aa00640 1 -- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c15dc60 msgr2=0x7f7c2c0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c15dc60 0x7f7c2c0b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c2aa00640 1 -- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2c099a60 msgr2=0x7f7c2c0b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2c099a60 0x7f7c2c0b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c2aa00640 1 -- 172.21.15.59:0/2384565092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0b6790 con 0x7f7c2c06bf30 2024-04-25T09:09:17.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2c06bf30 0x7f7c2c14c650 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ad040 tx=0x7f7c1c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c23e00640 1 -- 172.21.15.59:0/2384565092 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0abde0 con 0x7f7c2c06bf30 2024-04-25T09:09:17.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c23e00640 1 -- 172.21.15.59:0/2384565092 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0be3f0 con 0x7f7c2c06bf30 2024-04-25T09:09:17.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c31e00640 1 -- 172.21.15.59:0/2384565092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c0b6a70 con 0x7f7c2c06bf30 2024-04-25T09:09:17.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c23e00640 1 -- 172.21.15.59:0/2384565092 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0be7e0 con 0x7f7c2c06bf30 2024-04-25T09:09:17.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.691+0000 7f7c31e00640 1 -- 172.21.15.59:0/2384565092 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c15ac90 con 0x7f7c2c06bf30 2024-04-25T09:09:17.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.695+0000 7f7c23e00640 1 -- 172.21.15.59:0/2384565092 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7c1c0c7430 con 0x7f7c2c06bf30 2024-04-25T09:09:17.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.695+0000 7f7c23e00640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c08066f60 0x7f7c08069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.695+0000 7f7c23e00640 1 -- 172.21.15.59:0/2384565092 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f7c1c11f890 con 0x7f7c2c06bf30 2024-04-25T09:09:17.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.695+0000 7f7c22000640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c08066f60 0x7f7c08069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.695+0000 7f7c351dc000 1 Processor -- start 2024-04-25T09:09:17.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.695+0000 7f7c351dc000 1 -- start start 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.695+0000 7f7c22000640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c08066f60 0x7f7c08069420 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c1596b0 tx=0x7f7c14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bcf920 0x55fb93bcfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93bd0240 0x55fb93b859f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93b85f30 0x55fb93b86310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb93a6d5f0 con 0x55fb93b85f30 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb939d4da0 con 0x55fb93bd0240 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb9395d150 con 0x55fb93bcf920 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c2b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93b85f30 0x55fb93b86310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c2b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93b85f30 0x55fb93b86310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47022/0 (socket says 172.21.15.59:47022) 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c2b400640 1 -- 172.21.15.59:0/4286136797 learned_addr learned my addr 172.21.15.59:0/4286136797 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c22000640 1 --2- 172.21.15.59:0/4286136797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93bd0240 0x55fb93b859f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/4286136797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bcf920 0x55fb93bcfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c2b400640 1 -- 172.21.15.59:0/4286136797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bcf920 msgr2=0x55fb93bcfd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c2b400640 1 --2- 172.21.15.59:0/4286136797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bcf920 0x55fb93bcfd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c2b400640 1 -- 172.21.15.59:0/4286136797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93bd0240 msgr2=0x55fb93b859f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c2b400640 1 --2- 172.21.15.59:0/4286136797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93bd0240 0x55fb93b859f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c2b400640 1 -- 172.21.15.59:0/4286136797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb93976ca0 con 0x55fb93b85f30 2024-04-25T09:09:17.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c2b400640 1 --2- 172.21.15.59:0/4286136797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93b85f30 0x55fb93b86310 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f7c240056d0 tx=0x7f7c2400f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f27c71fbc9b5c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c1be00640 1 -- 172.21.15.59:0/4286136797 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24018020 con 0x55fb93b85f30 2024-04-25T09:09:17.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c1be00640 1 -- 172.21.15.59:0/4286136797 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24014470 con 0x55fb93b85f30 2024-04-25T09:09:17.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c1be00640 1 -- 172.21.15.59:0/4286136797 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24014840 con 0x55fb93b85f30 2024-04-25T09:09:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 -- 172.21.15.59:0/4286136797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93b85f30 msgr2=0x55fb93b86310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 --2- 172.21.15.59:0/4286136797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93b85f30 0x55fb93b86310 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f7c240056d0 tx=0x7f7c2400f5a0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 -- 172.21.15.59:0/4286136797 shutdown_connections 2024-04-25T09:09:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 --2- 172.21.15.59:0/4286136797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93b85f30 0x55fb93b86310 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 --2- 172.21.15.59:0/4286136797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93bd0240 0x55fb93b859f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 --2- 172.21.15.59:0/4286136797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bcf920 0x55fb93bcfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 -- 172.21.15.59:0/4286136797 >> 172.21.15.59:0/4286136797 conn(0x55fb93b8c2a0 msgr2=0x55fb93b842d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 -- 172.21.15.59:0/4286136797 shutdown_connections 2024-04-25T09:09:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 -- 172.21.15.59:0/4286136797 wait complete. 2024-04-25T09:09:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 -- start start 2024-04-25T09:09:17.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.699+0000 7f7c351dc000 1 Processor -- start 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93b85f30 0x55fb93bd6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 0x55fb93bd7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bd0240 0x55fb93b89aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb9398f990 con 0x55fb93bcf920 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb939d0e40 con 0x55fb93b85f30 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb93960900 con 0x55fb93bd0240 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 10 client.0 _ll_register_callbacks cb 0x55fb93a881c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c22000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 0x55fb93bd7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c22000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 0x55fb93bd7230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47026/0 (socket says 172.21.15.59:47026) 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c22000640 1 -- 172.21.15.59:0/911242060 learned_addr learned my addr 172.21.15.59:0/911242060 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93b85f30 0x55fb93bd6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c2b400640 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bd0240 0x55fb93b89aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c22000640 1 -- 172.21.15.59:0/911242060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bd0240 msgr2=0x55fb93b89aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c22000640 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bd0240 0x55fb93b89aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c22000640 1 -- 172.21.15.59:0/911242060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93b85f30 msgr2=0x55fb93bd6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c22000640 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93b85f30 0x55fb93bd6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c22000640 1 -- 172.21.15.59:0/911242060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb9398d630 con 0x55fb93bcf920 2024-04-25T09:09:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c22000640 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 0x55fb93bd7230 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400ff90 tx=0x7f7c140046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d84625aa69b1a5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c18c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c18c00640 1 -- 172.21.15.59:0/911242060 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14025070 con 0x55fb93bcf920 2024-04-25T09:09:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c18c00640 1 -- 172.21.15.59:0/911242060 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f7c14013930 con 0x55fb93bcf920 2024-04-25T09:09:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 -- 172.21.15.59:0/911242060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c24014470 con 0x55fb93bcf920 2024-04-25T09:09:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c18c00640 1 -- 172.21.15.59:0/911242060 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c14030050 con 0x55fb93bcf920 2024-04-25T09:09:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 10 client.8040 fetch_fsmap learned FSMap version 78 2024-04-25T09:09:17.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 -- 172.21.15.59:0/911242060 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55fb9395d3a0 con 0x55fb93bcf920 2024-04-25T09:09:17.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c18c00640 1 -- 172.21.15.59:0/911242060 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c24014470 con 0x55fb93bcf920 2024-04-25T09:09:17.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c18c00640 1 -- 172.21.15.59:0/911242060 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7c14033020 con 0x55fb93bcf920 2024-04-25T09:09:17.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 10 client.8040 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:09:17.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 10 client.8040 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:09:17.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 20 client.8040 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:17.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55fb93b8b160 0x55fb93be0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 4 client.8040 mds_command: new command op to 7965 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 -- 172.21.15.59:0/911242060 --> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb93970a50 con 0x55fb93b8b160 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55fb93b8b160 0x55fb93be0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55fb93b8b160 0x55fb93be0d50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7df28d6986aff6c server_cookie=6d6181e783aabbdc in_seq=0 out_seq=0 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c18c00640 10 client.8040 ms_handle_connect on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c18c00640 1 -- 172.21.15.59:0/911242060 <== mds.0 v2:172.21.15.59:6833/1467736863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55fb93970a50 con 0x55fb93b8b160 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c18c00640 10 client.8040 handle_command_reply: tid=0 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 client.8040 shutdown 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 -- 172.21.15.59:0/911242060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 msgr2=0x55fb93bd7230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 0x55fb93bd7230 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400ff90 tx=0x7f7c140046d0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 -- 172.21.15.59:0/911242060 shutdown_connections 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55fb93b8b160 0x55fb93be0d50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.703+0000 7f7c351dc000 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bd0240 0x55fb93b89aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.707+0000 7f7c351dc000 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 0x55fb93bd7230 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.707+0000 7f7c351dc000 1 --2- 172.21.15.59:0/911242060 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93b85f30 0x55fb93bd6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.707+0000 7f7c18c00640 0 client.8040 ms_handle_reset on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:17.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.707+0000 7f7c351dc000 1 -- 172.21.15.59:0/911242060 >> 172.21.15.59:0/911242060 conn(0x55fb93b8c2a0 msgr2=0x55fb93b849e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:17.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.707+0000 7f7c351dc000 1 -- 172.21.15.59:0/911242060 shutdown_connections 2024-04-25T09:09:17.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.707+0000 7f7c351dc000 1 -- 172.21.15.59:0/911242060 wait complete. 2024-04-25T09:09:17.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.707+0000 7f7c351dc000 20 client.8040 trim_cache size 0 max 16384 2024-04-25T09:09:17.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 Processor -- start 2024-04-25T09:09:17.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 -- start start 2024-04-25T09:09:17.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93b85f30 0x55fb93c2b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 0x55fb93c2b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93bd0240 0x55fb93c2be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c202d20 con 0x55fb93bcf920 2024-04-25T09:09:17.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c15bd30 con 0x55fb93bd0240 2024-04-25T09:09:17.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c15c330 con 0x55fb93b85f30 2024-04-25T09:09:17.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c22000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 0x55fb93c2b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c22000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 0x55fb93c2b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47032/0 (socket says 172.21.15.59:47032) 2024-04-25T09:09:17.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c22000640 1 -- 172.21.15.59:0/3887662385 learned_addr learned my addr 172.21.15.59:0/3887662385 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:17.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/3887662385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93b85f30 0x55fb93c2b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c2b400640 1 --2- 172.21.15.59:0/3887662385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93bd0240 0x55fb93c2be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c22000640 1 -- 172.21.15.59:0/3887662385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93b85f30 msgr2=0x55fb93c2b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c22000640 1 --2- 172.21.15.59:0/3887662385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93b85f30 0x55fb93c2b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c22000640 1 -- 172.21.15.59:0/3887662385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93bd0240 msgr2=0x55fb93c2be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c22000640 1 --2- 172.21.15.59:0/3887662385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93bd0240 0x55fb93c2be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c22000640 1 -- 172.21.15.59:0/3887662385 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb93bd0070 con 0x55fb93bcf920 2024-04-25T09:09:17.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/3887662385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93b85f30 0x55fb93c2b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:17.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c2b400640 1 --2- 172.21.15.59:0/3887662385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93bd0240 0x55fb93c2be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:17.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c22000640 1 --2- 172.21.15.59:0/3887662385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 0x55fb93c2b950 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f7c140040b0 tx=0x7f7c14022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40616f09f7fd3de1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c1b400640 1 -- 172.21.15.59:0/3887662385 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14039070 con 0x55fb93bcf920 2024-04-25T09:09:17.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c1b400640 1 -- 172.21.15.59:0/3887662385 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1401c040 con 0x55fb93bcf920 2024-04-25T09:09:17.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c1b400640 1 -- 172.21.15.59:0/3887662385 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14025040 con 0x55fb93bcf920 2024-04-25T09:09:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 -- 172.21.15.59:0/3887662385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 msgr2=0x55fb93c2b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 --2- 172.21.15.59:0/3887662385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 0x55fb93c2b950 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f7c140040b0 tx=0x7f7c14022000 comp rx=0 tx=0).stop 2024-04-25T09:09:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 -- 172.21.15.59:0/3887662385 shutdown_connections 2024-04-25T09:09:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 --2- 172.21.15.59:0/3887662385 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93bd0240 0x55fb93c2be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 --2- 172.21.15.59:0/3887662385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bcf920 0x55fb93c2b950 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 --2- 172.21.15.59:0/3887662385 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93b85f30 0x55fb93c2b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 -- 172.21.15.59:0/3887662385 >> 172.21.15.59:0/3887662385 conn(0x55fb93b8c2a0 msgr2=0x55fb93b89220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 -- 172.21.15.59:0/3887662385 shutdown_connections 2024-04-25T09:09:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 -- 172.21.15.59:0/3887662385 wait complete. 2024-04-25T09:09:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 -- start start 2024-04-25T09:09:17.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.723+0000 7f7c351dc000 1 Processor -- start 2024-04-25T09:09:17.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93b85f30 0x55fb93bdc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bcf920 0x55fb93bea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bd0240 0x55fb93bead10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb939d93d0 con 0x55fb93bd0240 2024-04-25T09:09:17.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb93a90d50 con 0x55fb93b85f30 2024-04-25T09:09:17.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fb9396f980 con 0x55fb93bcf920 2024-04-25T09:09:17.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 10 client.0 _ll_register_callbacks cb 0x7f7c240050f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:17.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c2b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bd0240 0x55fb93bead10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c2b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bd0240 0x55fb93bead10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47046/0 (socket says 172.21.15.59:47046) 2024-04-25T09:09:17.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c2b400640 1 -- 172.21.15.59:0/1485581448 learned_addr learned my addr 172.21.15.59:0/1485581448 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:17.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93b85f30 0x55fb93bdc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c22000640 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bcf920 0x55fb93bea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c2b400640 1 -- 172.21.15.59:0/1485581448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bcf920 msgr2=0x55fb93bea7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c2b400640 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bcf920 0x55fb93bea7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c2b400640 1 -- 172.21.15.59:0/1485581448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93b85f30 msgr2=0x55fb93bdc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c2b400640 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93b85f30 0x55fb93bdc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c2b400640 1 -- 172.21.15.59:0/1485581448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb93a56600 con 0x55fb93bd0240 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c2b400640 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bd0240 0x55fb93bead10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x55fb93978200 tx=0x7f7c24003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc382c972711388d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c18c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c18c00640 1 -- 172.21.15.59:0/1485581448 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24018040 con 0x55fb93bd0240 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c18c00640 1 -- 172.21.15.59:0/1485581448 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f7c24014930 con 0x55fb93bd0240 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 1 -- 172.21.15.59:0/1485581448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c1401c040 con 0x55fb93bd0240 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c18c00640 1 -- 172.21.15.59:0/1485581448 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c24030050 con 0x55fb93bd0240 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 10 client.8046 fetch_fsmap learned FSMap version 78 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 1 -- 172.21.15.59:0/1485581448 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55fb939699b0 con 0x55fb93bd0240 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c18c00640 1 -- 172.21.15.59:0/1485581448 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1401c040 con 0x55fb93bd0240 2024-04-25T09:09:17.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c18c00640 1 -- 172.21.15.59:0/1485581448 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7c24033020 con 0x55fb93bd0240 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 10 client.8046 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 10 client.8046 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 20 client.8046 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55fb93beb250 0x55fb93c38e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 4 client.8046 mds_command: new command op to 7965 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 1 -- 172.21.15.59:0/1485581448 --> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fb939e22e0 con 0x55fb93beb250 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55fb93beb250 0x55fb93c38e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c2aa00640 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55fb93beb250 0x55fb93c38e80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3bff6cf90cd423b server_cookie=6bdc6de2f9f4a380 in_seq=0 out_seq=0 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c18c00640 10 client.8046 ms_handle_connect on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c18c00640 1 -- 172.21.15.59:0/1485581448 <== mds.0 v2:172.21.15.59:6833/1467736863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55fb939e22e0 con 0x55fb93beb250 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c18c00640 10 client.8046 handle_command_reply: tid=0 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.727+0000 7f7c351dc000 1 client.8046 shutdown 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c351dc000 1 -- 172.21.15.59:0/1485581448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bd0240 msgr2=0x55fb93bead10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c351dc000 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bd0240 0x55fb93bead10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x55fb93978200 tx=0x7f7c24003a80 comp rx=0 tx=0).stop 2024-04-25T09:09:17.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c351dc000 1 -- 172.21.15.59:0/1485581448 shutdown_connections 2024-04-25T09:09:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c351dc000 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55fb93beb250 0x55fb93c38e80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c351dc000 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fb93bd0240 0x55fb93bead10 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c351dc000 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55fb93bcf920 0x55fb93bea7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c351dc000 1 --2- 172.21.15.59:0/1485581448 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55fb93b85f30 0x55fb93bdc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c18c00640 0 client.8046 ms_handle_reset on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c351dc000 1 -- 172.21.15.59:0/1485581448 >> 172.21.15.59:0/1485581448 conn(0x55fb93b8c2a0 msgr2=0x55fb93bd78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c351dc000 1 -- 172.21.15.59:0/1485581448 shutdown_connections 2024-04-25T09:09:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c351dc000 1 -- 172.21.15.59:0/1485581448 wait complete. 2024-04-25T09:09:17.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c351dc000 20 client.8046 trim_cache size 0 max 16384 2024-04-25T09:09:17.722 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:09:17.723 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:09:17.723 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:09:17.723 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 7965, 2024-04-25T09:09:17.723 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:09:17.723 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:09:17.723 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:09:17.723 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 4.5767904100000001, 2024-04-25T09:09:17.723 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 78, 2024-04-25T09:09:17.723 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 96, 2024-04-25T09:09:17.723 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 96, 2024-04-25T09:09:17.723 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 5.5218269769999999 2024-04-25T09:09:17.723 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:09:17.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c31e00640 1 -- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c08066f60 msgr2=0x7f7c08069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c31e00640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c08066f60 0x7f7c08069420 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c1596b0 tx=0x7f7c14008040 comp rx=0 tx=0).stop 2024-04-25T09:09:17.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c31e00640 1 -- 172.21.15.59:0/2384565092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2c06bf30 msgr2=0x7f7c2c14c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c31e00640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2c06bf30 0x7f7c2c14c650 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0ad040 tx=0x7f7c1c01aca0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c31e00640 1 -- 172.21.15.59:0/2384565092 shutdown_connections 2024-04-25T09:09:17.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c31e00640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c08066f60 0x7f7c08069420 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c31e00640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c2c15dc60 0x7f7c2c0b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c31e00640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c2c099a60 0x7f7c2c0b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c31e00640 1 --2- 172.21.15.59:0/2384565092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c2c06bf30 0x7f7c2c14c650 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c31e00640 1 -- 172.21.15.59:0/2384565092 >> 172.21.15.59:0/2384565092 conn(0x7f7c2c0b3200 msgr2=0x7f7c2c0cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:17.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c31e00640 1 -- 172.21.15.59:0/2384565092 shutdown_connections 2024-04-25T09:09:17.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.731+0000 7f7c31e00640 1 -- 172.21.15.59:0/2384565092 wait complete. 2024-04-25T09:09:17.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:09:17.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff42e000640 1 Processor -- start 2024-04-25T09:09:17.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff42e000640 1 -- start start 2024-04-25T09:09:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff42e000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff42815b5a0 0x7ff4280cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff42e000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff42815b980 0x7ff4280cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff42e000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4280ce7f0 con 0x7ff428071970 2024-04-25T09:09:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff42e000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4280cfcd0 con 0x7ff42815b980 2024-04-25T09:09:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff42e000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280cead0 con 0x7ff42815b5a0 2024-04-25T09:09:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff427e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff428071970 0x7ff42815f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38810/0 (socket says 172.21.15.59:38810) 2024-04-25T09:09:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff427e00640 1 -- 172.21.15.59:0/3741019398 learned_addr learned my addr 172.21.15.59:0/3741019398 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff41ea00640 1 --2- 172.21.15.59:0/3741019398 >> v2:172.21.15.178:3300/0 conn(0x7ff42815b980 0x7ff4280cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff427400640 1 --2- 172.21.15.59:0/3741019398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff42815b5a0 0x7ff4280cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff426a00640 1 -- 172.21.15.59:0/3741019398 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43173920 0 0) 0x7ff4280ce7f0 con 0x7ff428071970 2024-04-25T09:09:17.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff426a00640 1 -- 172.21.15.59:0/3741019398 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff40c003530 con 0x7ff428071970 2024-04-25T09:09:17.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff41ea00640 1 -- 172.21.15.59:0/3741019398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff42815b5a0 msgr2=0x7ff4280cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:17.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff41ea00640 1 --2- 172.21.15.59:0/3741019398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff42815b5a0 0x7ff4280cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff41ea00640 1 -- 172.21.15.59:0/3741019398 >> v1:172.21.15.59:6789/0 conn(0x7ff428071970 legacy=0x7ff42815f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.891+0000 7ff41ea00640 1 -- 172.21.15.59:0/3741019398 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4280cf960 con 0x7ff42815b980 2024-04-25T09:09:17.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.895+0000 7ff41ea00640 1 --2- 172.21.15.59:0/3741019398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff42815b980 0x7ff4280cbd30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff4100097c0 tx=0x7ff41001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30965fa6fe6ad069 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.895+0000 7ff426a00640 1 -- 172.21.15.59:0/3741019398 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100aa620 con 0x7ff42815b980 2024-04-25T09:09:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.895+0000 7ff426a00640 1 -- 172.21.15.59:0/3741019398 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4100af070 con 0x7ff42815b980 2024-04-25T09:09:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.895+0000 7ff426a00640 1 -- 172.21.15.59:0/3741019398 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100aa9e0 con 0x7ff42815b980 2024-04-25T09:09:17.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.895+0000 7ff42e000640 1 -- 172.21.15.59:0/3741019398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff42815b980 msgr2=0x7ff4280cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.895+0000 7ff42e000640 1 --2- 172.21.15.59:0/3741019398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff42815b980 0x7ff4280cbd30 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff4100097c0 tx=0x7ff41001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.895+0000 7ff42e000640 1 -- 172.21.15.59:0/3741019398 shutdown_connections 2024-04-25T09:09:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.895+0000 7ff42e000640 1 --2- 172.21.15.59:0/3741019398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff42815b980 0x7ff4280cbd30 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.895+0000 7ff42e000640 1 --2- 172.21.15.59:0/3741019398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff42815b5a0 0x7ff4280cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.895+0000 7ff42e000640 1 -- 172.21.15.59:0/3741019398 >> 172.21.15.59:0/3741019398 conn(0x7ff4280b3390 msgr2=0x7ff4280b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.895+0000 7ff42e000640 1 -- 172.21.15.59:0/3741019398 shutdown_connections 2024-04-25T09:09:17.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.895+0000 7ff42e000640 1 -- 172.21.15.59:0/3741019398 wait complete. 2024-04-25T09:09:17.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff42e000640 1 Processor -- start 2024-04-25T09:09:17.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff42e000640 1 -- start start 2024-04-25T09:09:17.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff42e000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff428071970 0x7ff42806cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff42e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42815b5a0 0x7ff4280cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff42e000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff42815b980 0x7ff428142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff42e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff428168ad0 con 0x7ff42815b5a0 2024-04-25T09:09:17.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff42e000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff428168950 con 0x7ff428071970 2024-04-25T09:09:17.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff42e000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff428168c50 con 0x7ff42815b980 2024-04-25T09:09:17.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff41ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42815b5a0 0x7ff4280cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff41ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42815b5a0 0x7ff4280cac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47054/0 (socket says 172.21.15.59:47054) 2024-04-25T09:09:17.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff41ea00640 1 -- 172.21.15.59:0/3309783316 learned_addr learned my addr 172.21.15.59:0/3309783316 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff427400640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff428071970 0x7ff42806cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff427e00640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff42815b980 0x7ff428142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff41ea00640 1 -- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff42815b980 msgr2=0x7ff428142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff41ea00640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff42815b980 0x7ff428142ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff41ea00640 1 -- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff428071970 msgr2=0x7ff42806cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff41ea00640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff428071970 0x7ff42806cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff41ea00640 1 -- 172.21.15.59:0/3309783316 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42806bea0 con 0x7ff42815b5a0 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff41ea00640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42815b5a0 0x7ff4280cac70 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ff41001a0d0 tx=0x7ff41001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff41fe00640 1 -- 172.21.15.59:0/3309783316 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100aadf0 con 0x7ff42815b5a0 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff42e000640 1 -- 172.21.15.59:0/3309783316 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42806c180 con 0x7ff42815b5a0 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff41fe00640 1 -- 172.21.15.59:0/3309783316 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4100be410 con 0x7ff42815b5a0 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff41fe00640 1 -- 172.21.15.59:0/3309783316 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100be800 con 0x7ff42815b5a0 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.899+0000 7ff42e000640 1 -- 172.21.15.59:0/3309783316 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42806c740 con 0x7ff42815b5a0 2024-04-25T09:09:17.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.903+0000 7ff42e000640 1 -- 172.21.15.59:0/3309783316 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4280745d0 con 0x7ff42815b5a0 2024-04-25T09:09:17.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.903+0000 7ff41fe00640 1 -- 172.21.15.59:0/3309783316 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff4100bc020 con 0x7ff42815b5a0 2024-04-25T09:09:17.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.903+0000 7ff41fe00640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff404066f60 0x7ff404069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:17.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.903+0000 7ff41fe00640 1 -- 172.21.15.59:0/3309783316 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7ff41011f2e0 con 0x7ff42815b5a0 2024-04-25T09:09:17.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.903+0000 7ff427400640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff404066f60 0x7ff404069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:17.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.903+0000 7ff427400640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff404066f60 0x7ff404069420 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff418009af0 tx=0x7ff418008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:17.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:17.907+0000 7ff41fe00640 1 -- 172.21.15.59:0/3309783316 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff4100c5030 con 0x7ff42815b5a0 2024-04-25T09:09:18.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.103+0000 7ff42e000640 1 -- 172.21.15.59:0/3309783316 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff4280ceeb0 con 0x7ff42815b5a0 2024-04-25T09:09:18.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.103+0000 7ff41fe00640 1 -- 172.21.15.59:0/3309783316 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff4280cc680 con 0x7ff42815b5a0 2024-04-25T09:09:18.093 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:09:18.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.107+0000 7ff42e000640 1 -- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff404066f60 msgr2=0x7ff404069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.107+0000 7ff42e000640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff404066f60 0x7ff404069420 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff418009af0 tx=0x7ff418008040 comp rx=0 tx=0).stop 2024-04-25T09:09:18.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.107+0000 7ff42e000640 1 -- 172.21.15.59:0/3309783316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42815b5a0 msgr2=0x7ff4280cac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.107+0000 7ff42e000640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42815b5a0 0x7ff4280cac70 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7ff41001a0d0 tx=0x7ff41001ace0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.107+0000 7ff42e000640 1 -- 172.21.15.59:0/3309783316 shutdown_connections 2024-04-25T09:09:18.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.107+0000 7ff42e000640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff404066f60 0x7ff404069420 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.107+0000 7ff42e000640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff42815b980 0x7ff428142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.107+0000 7ff42e000640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff42815b5a0 0x7ff4280cac70 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.107+0000 7ff42e000640 1 --2- 172.21.15.59:0/3309783316 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff428071970 0x7ff42806cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.107+0000 7ff42e000640 1 -- 172.21.15.59:0/3309783316 >> 172.21.15.59:0/3309783316 conn(0x7ff4280b3390 msgr2=0x7ff428153f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:18.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.107+0000 7ff42e000640 1 -- 172.21.15.59:0/3309783316 shutdown_connections 2024-04-25T09:09:18.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.107+0000 7ff42e000640 1 -- 172.21.15.59:0/3309783316 wait complete. 2024-04-25T09:09:18.114 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:09:18.114 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:09:18.114 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:09:18.114 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:09:18.114 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:18.114 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:09:18.114 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:09:18.114 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:09:18.114 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:09:18.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:18.115 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:09:18.124 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42009sec preferred_lft 42009sec 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:09:18.125 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:09:18.126 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:09:18.126 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:18.126 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:09:18.126 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:18.126 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:09:18.126 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:09:18.126 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:09:18.126 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:18.126 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:09:18.126 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:09:18.126 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:09:18.126 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:09:18.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:18.127 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:09:18.192 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:09:18.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:18.194 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:09:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:09:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:09:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:09:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:09:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:09:18.251 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:09:18.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:18.252 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:09:18.252 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:09:18.252 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:09:18.252 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:09:18.252 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:09:18.252 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:09:18.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:18.344 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:09:18.353 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:09:18.353 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:09:18.354 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:09:18.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:18.354 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:09:18.418 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:09:18.418 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:18.467 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:09:18.467 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:09:18.467 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:18.521 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:09:18.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:18.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:09:18.615 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:09:18.615 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:09:18.616 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:09:18.630 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:09:18.631 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:09:18.631 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:09:18.631 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:09:18.631 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:09:18.642 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:09:18.642 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:09:18.642 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:09:18.643 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:09:18.643 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:09:18.643 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:09:18.643 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:09:18.643 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:09:18.646 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:09:18.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:18.649 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:18.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:18.669 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:09:18.721 INFO:teuthology.orchestra.run.smithi059.stdout:client7594 2024-04-25T09:09:18.721 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:09:18.721 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:18.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:18.774 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-25T09:09:18.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.971+0000 7fab5b600640 1 Processor -- start 2024-04-25T09:09:18.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.971+0000 7fab5b600640 1 -- start start 2024-04-25T09:09:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab5b600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab54144080 0x7fab540ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab5b600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fab54071e40 0x7fab540ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab5b600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab5406e3c0 0x7fab5406e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab5b600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab540719b0 con 0x7fab54144080 2024-04-25T09:09:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab5b600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab540cf490 con 0x7fab54071e40 2024-04-25T09:09:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab5b600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab540cf1b0 con 0x7fab5406e3c0 2024-04-25T09:09:18.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab58c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab54144080 0x7fab540ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab58c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fab54144080 0x7fab540ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47070/0 (socket says 172.21.15.59:47070) 2024-04-25T09:09:18.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab58c00640 1 -- 172.21.15.59:0/387638997 learned_addr learned my addr 172.21.15.59:0/387638997 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:18.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab4be00640 1 --2- 172.21.15.59:0/387638997 >> v2:172.21.15.178:3300/0 conn(0x7fab54071e40 0x7fab540ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab59600640 1 --2- 172.21.15.59:0/387638997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab5406e3c0 0x7fab5406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab58c00640 1 -- 172.21.15.59:0/387638997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab5406e3c0 msgr2=0x7fab5406e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:18.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab58c00640 1 --2- 172.21.15.59:0/387638997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab5406e3c0 0x7fab5406e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab58c00640 1 -- 172.21.15.59:0/387638997 >> v2:172.21.15.178:3300/0 conn(0x7fab54071e40 msgr2=0x7fab540ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:18.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab58c00640 1 --2- 172.21.15.59:0/387638997 >> v2:172.21.15.178:3300/0 conn(0x7fab54071e40 0x7fab540ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.975+0000 7fab58c00640 1 -- 172.21.15.59:0/387638997 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54071360 con 0x7fab54144080 2024-04-25T09:09:18.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab58c00640 1 --2- 172.21.15.59:0/387638997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54144080 0x7fab540ce660 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fab44009870 tx=0x7fab4401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c531f955937387 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab53e00640 1 -- 172.21.15.59:0/387638997 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440b1070 con 0x7fab54144080 2024-04-25T09:09:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab53e00640 1 -- 172.21.15.59:0/387638997 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab440ac410 con 0x7fab54144080 2024-04-25T09:09:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab53e00640 1 -- 172.21.15.59:0/387638997 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440ac7e0 con 0x7fab54144080 2024-04-25T09:09:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab5b600640 1 -- 172.21.15.59:0/387638997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54144080 msgr2=0x7fab540ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab5b600640 1 --2- 172.21.15.59:0/387638997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54144080 0x7fab540ce660 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fab44009870 tx=0x7fab4401c520 comp rx=0 tx=0).stop 2024-04-25T09:09:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab5b600640 1 -- 172.21.15.59:0/387638997 shutdown_connections 2024-04-25T09:09:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab5b600640 1 --2- 172.21.15.59:0/387638997 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab5406e3c0 0x7fab5406e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab5b600640 1 --2- 172.21.15.59:0/387638997 >> v2:172.21.15.178:3300/0 conn(0x7fab54071e40 0x7fab540ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab5b600640 1 --2- 172.21.15.59:0/387638997 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54144080 0x7fab540ce660 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab5b600640 1 -- 172.21.15.59:0/387638997 >> 172.21.15.59:0/387638997 conn(0x7fab5406ac10 msgr2=0x7fab5406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:18.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab5b600640 1 -- 172.21.15.59:0/387638997 shutdown_connections 2024-04-25T09:09:18.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab5b600640 1 -- 172.21.15.59:0/387638997 wait complete. 2024-04-25T09:09:18.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab5b600640 1 Processor -- start 2024-04-25T09:09:18.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.979+0000 7fab5b600640 1 -- start start 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab5b600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab5406e3c0 0x7fab540ad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab5b600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab54071e40 0x7fab54150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab5b600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54144080 0x7fab540afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab5b600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab540b3b70 con 0x7fab54144080 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab5b600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab540b39f0 con 0x7fab54071e40 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab5b600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab540b3cf0 con 0x7fab5406e3c0 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab59600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54144080 0x7fab540afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab59600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54144080 0x7fab540afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47080/0 (socket says 172.21.15.59:47080) 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab59600640 1 -- 172.21.15.59:0/3677208996 learned_addr learned my addr 172.21.15.59:0/3677208996 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab58c00640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab5406e3c0 0x7fab540ad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab4be00640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab54071e40 0x7fab54150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab59600640 1 -- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab5406e3c0 msgr2=0x7fab540ad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab59600640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab5406e3c0 0x7fab540ad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab59600640 1 -- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab54071e40 msgr2=0x7fab54150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab59600640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab54071e40 0x7fab54150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab59600640 1 -- 172.21.15.59:0/3677208996 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540addd0 con 0x7fab54144080 2024-04-25T09:09:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab4be00640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab54071e40 0x7fab54150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab59600640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54144080 0x7fab540afc80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fab4c007e60 tx=0x7fab4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab51600640 1 -- 172.21.15.59:0/3677208996 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c014620 con 0x7fab54144080 2024-04-25T09:09:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab51600640 1 -- 172.21.15.59:0/3677208996 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c019070 con 0x7fab54144080 2024-04-25T09:09:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab51600640 1 -- 172.21.15.59:0/3677208996 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c014a20 con 0x7fab54144080 2024-04-25T09:09:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab5b600640 1 -- 172.21.15.59:0/3677208996 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab540ae0b0 con 0x7fab54144080 2024-04-25T09:09:18.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab5b600640 1 -- 172.21.15.59:0/3677208996 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab54151470 con 0x7fab54144080 2024-04-25T09:09:18.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.983+0000 7fab51600640 1 -- 172.21.15.59:0/3677208996 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fab4c014bc0 con 0x7fab54144080 2024-04-25T09:09:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab51600640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fab30066f60 0x7fab30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab51600640 1 -- 172.21.15.59:0/3677208996 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fab4c085c90 con 0x7fab54144080 2024-04-25T09:09:18.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab58c00640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fab30066f60 0x7fab30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab5e9df000 1 Processor -- start 2024-04-25T09:09:18.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab5e9df000 1 -- start start 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab58c00640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fab30066f60 0x7fab30069420 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fab440ae000 tx=0x7fab44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab5e9df000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 0x55e495d51070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab5e9df000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d515b0 0x55e495d06d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab5e9df000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 0x55e495d07670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab5e9df000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e495bedf40 con 0x55e495d07290 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab5e9df000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e495b55070 con 0x55e495d50c90 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab5e9df000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e495add1a0 con 0x55e495d515b0 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab59600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 0x55e495d07670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab59600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 0x55e495d07670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47092/0 (socket says 172.21.15.59:47092) 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab59600640 1 -- 172.21.15.59:0/1700677563 learned_addr learned my addr 172.21.15.59:0/1700677563 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:18.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab4be00640 1 --2- 172.21.15.59:0/1700677563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d515b0 0x55e495d06d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab58c00640 1 --2- 172.21.15.59:0/1700677563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 0x55e495d51070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab59600640 1 -- 172.21.15.59:0/1700677563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d515b0 msgr2=0x55e495d06d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab59600640 1 --2- 172.21.15.59:0/1700677563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d515b0 0x55e495d06d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab59600640 1 -- 172.21.15.59:0/1700677563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 msgr2=0x55e495d51070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab59600640 1 --2- 172.21.15.59:0/1700677563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 0x55e495d51070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab59600640 1 -- 172.21.15.59:0/1700677563 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e495adb510 con 0x55e495d07290 2024-04-25T09:09:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab58c00640 1 --2- 172.21.15.59:0/1700677563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 0x55e495d51070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab59600640 1 --2- 172.21.15.59:0/1700677563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 0x55e495d07670 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c040 tx=0x7fab4c056990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31c47b59ee2560f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab49600640 1 -- 172.21.15.59:0/1700677563 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c05a120 con 0x55e495d07290 2024-04-25T09:09:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab49600640 1 -- 172.21.15.59:0/1700677563 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c05e8e0 con 0x55e495d07290 2024-04-25T09:09:18.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.987+0000 7fab49600640 1 -- 172.21.15.59:0/1700677563 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c052840 con 0x55e495d07290 2024-04-25T09:09:18.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 -- 172.21.15.59:0/1700677563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 msgr2=0x55e495d07670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 --2- 172.21.15.59:0/1700677563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 0x55e495d07670 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c040 tx=0x7fab4c056990 comp rx=0 tx=0).stop 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 -- 172.21.15.59:0/1700677563 shutdown_connections 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 --2- 172.21.15.59:0/1700677563 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 0x55e495d07670 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 --2- 172.21.15.59:0/1700677563 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d515b0 0x55e495d06d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 --2- 172.21.15.59:0/1700677563 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 0x55e495d51070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 -- 172.21.15.59:0/1700677563 >> 172.21.15.59:0/1700677563 conn(0x55e495d03240 msgr2=0x55e495d05630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 -- 172.21.15.59:0/1700677563 shutdown_connections 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 -- 172.21.15.59:0/1700677563 wait complete. 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 -- start start 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 Processor -- start 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d07290 0x55e495d11e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 0x55e495d12370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 0x55e495d128b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e495b0f6c0 con 0x55e495d515b0 2024-04-25T09:09:18.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e495b51110 con 0x55e495d50c90 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e495d10200 con 0x55e495d07290 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 10 client.0 _ll_register_callbacks cb 0x55e495cf2570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab59600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 0x55e495d128b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab59600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 0x55e495d128b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47108/0 (socket says 172.21.15.59:47108) 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab59600640 1 -- 172.21.15.59:0/2924882197 learned_addr learned my addr 172.21.15.59:0/2924882197 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab4be00640 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 0x55e495d12370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab58c00640 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d07290 0x55e495d11e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab59600640 1 -- 172.21.15.59:0/2924882197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d07290 msgr2=0x55e495d11e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab59600640 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d07290 0x55e495d11e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab59600640 1 -- 172.21.15.59:0/2924882197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 msgr2=0x55e495d12370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab59600640 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 0x55e495d12370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab59600640 1 -- 172.21.15.59:0/2924882197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e495add3b0 con 0x55e495d515b0 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab59600640 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 0x55e495d128b0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00e9b0 tx=0x7fab4c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab09210a9c8ea92a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab42000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:18.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab42000640 1 -- 172.21.15.59:0/2924882197 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c052840 con 0x55e495d515b0 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab42000640 1 -- 172.21.15.59:0/2924882197 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fab4c056430 con 0x55e495d515b0 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 -- 172.21.15.59:0/2924882197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab4c05e8e0 con 0x55e495d515b0 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab42000640 1 -- 172.21.15.59:0/2924882197 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab4c0529e0 con 0x55e495d515b0 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 10 client.8064 fetch_fsmap learned FSMap version 78 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 1 -- 172.21.15.59:0/2924882197 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55e495bd6e00 con 0x55e495d515b0 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab42000640 1 -- 172.21.15.59:0/2924882197 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c05e8e0 con 0x55e495d515b0 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab42000640 1 -- 172.21.15.59:0/2924882197 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fab4c05e450 con 0x55e495d515b0 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 10 client.8064 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 10 client.8064 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.991+0000 7fab5e9df000 20 client.8064 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55e495d13150 0x55e495d62410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 4 client.8064 mds_command: new command op to 7965 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:18.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 -- 172.21.15.59:0/2924882197 --> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e495af0d60 con 0x55e495d13150 2024-04-25T09:09:18.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab58c00640 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55e495d13150 0x55e495d62410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab42000640 10 client.8064 ms_handle_connect on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab58c00640 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55e495d13150 0x55e495d62410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e96139123657d96 server_cookie=f3a18e5f18919080 in_seq=0 out_seq=0 2024-04-25T09:09:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab42000640 1 -- 172.21.15.59:0/2924882197 <== mds.0 v2:172.21.15.59:6833/1467736863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55e495af0d60 con 0x55e495d13150 2024-04-25T09:09:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab42000640 10 client.8064 handle_command_reply: tid=0 2024-04-25T09:09:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 client.8064 shutdown 2024-04-25T09:09:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 -- 172.21.15.59:0/2924882197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 msgr2=0x55e495d128b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 0x55e495d128b0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00e9b0 tx=0x7fab4c007f50 comp rx=0 tx=0).stop 2024-04-25T09:09:18.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 -- 172.21.15.59:0/2924882197 shutdown_connections 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55e495d13150 0x55e495d62410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 0x55e495d128b0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 0x55e495d12370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 --2- 172.21.15.59:0/2924882197 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d07290 0x55e495d11e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 -- 172.21.15.59:0/2924882197 >> 172.21.15.59:0/2924882197 conn(0x55e495d03240 msgr2=0x55e495d05ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab42000640 0 client.8064 ms_handle_reset on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 -- 172.21.15.59:0/2924882197 shutdown_connections 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 1 -- 172.21.15.59:0/2924882197 wait complete. 2024-04-25T09:09:18.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:18.995+0000 7fab5e9df000 20 client.8064 trim_cache size 0 max 16384 2024-04-25T09:09:18.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 Processor -- start 2024-04-25T09:09:18.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 -- start start 2024-04-25T09:09:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d07290 0x55e495d06640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 0x55e495d06b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 0x55e495d62410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab542034e0 con 0x55e495d515b0 2024-04-25T09:09:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab542026e0 con 0x55e495d50c90 2024-04-25T09:09:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5413d0b0 con 0x55e495d07290 2024-04-25T09:09:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab59600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 0x55e495d62410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab59600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 0x55e495d62410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47124/0 (socket says 172.21.15.59:47124) 2024-04-25T09:09:19.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab59600640 1 -- 172.21.15.59:0/720461454 learned_addr learned my addr 172.21.15.59:0/720461454 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:19.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab59600640 1 -- 172.21.15.59:0/720461454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d07290 msgr2=0x55e495d06640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab59600640 1 --2- 172.21.15.59:0/720461454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d07290 0x55e495d06640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab59600640 1 -- 172.21.15.59:0/720461454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 msgr2=0x55e495d06b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab59600640 1 --2- 172.21.15.59:0/720461454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 0x55e495d06b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab59600640 1 -- 172.21.15.59:0/720461454 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e495bacc50 con 0x55e495d515b0 2024-04-25T09:09:19.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab59600640 1 --2- 172.21.15.59:0/720461454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 0x55e495d62410 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fab4c05a4e0 tx=0x7fab4c06f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ead185ad1a9357 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab48c00640 1 -- 172.21.15.59:0/720461454 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c063070 con 0x55e495d515b0 2024-04-25T09:09:19.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab48c00640 1 -- 172.21.15.59:0/720461454 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c056680 con 0x55e495d515b0 2024-04-25T09:09:19.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab48c00640 1 -- 172.21.15.59:0/720461454 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c05a120 con 0x55e495d515b0 2024-04-25T09:09:19.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 -- 172.21.15.59:0/720461454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 msgr2=0x55e495d62410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 --2- 172.21.15.59:0/720461454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 0x55e495d62410 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fab4c05a4e0 tx=0x7fab4c06f000 comp rx=0 tx=0).stop 2024-04-25T09:09:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 -- 172.21.15.59:0/720461454 shutdown_connections 2024-04-25T09:09:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 --2- 172.21.15.59:0/720461454 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d515b0 0x55e495d62410 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 --2- 172.21.15.59:0/720461454 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d50c90 0x55e495d06b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 --2- 172.21.15.59:0/720461454 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d07290 0x55e495d06640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 -- 172.21.15.59:0/720461454 >> 172.21.15.59:0/720461454 conn(0x55e495d03240 msgr2=0x55e495d0bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 -- 172.21.15.59:0/720461454 shutdown_connections 2024-04-25T09:09:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.011+0000 7fab5e9df000 1 -- 172.21.15.59:0/720461454 wait complete. 2024-04-25T09:09:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 1 -- start start 2024-04-25T09:09:19.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 1 Processor -- start 2024-04-25T09:09:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 0x55e495db1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d50c90 0x55e495db1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d515b0 0x55e495d6be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e495d030c0 con 0x55e495d07290 2024-04-25T09:09:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab542020e0 con 0x55e495d515b0 2024-04-25T09:09:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e495d10200 con 0x55e495d50c90 2024-04-25T09:09:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 10 client.0 _ll_register_callbacks cb 0x7fab4c0099a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab58c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 0x55e495db1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab58c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 0x55e495db1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47134/0 (socket says 172.21.15.59:47134) 2024-04-25T09:09:19.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab58c00640 1 -- 172.21.15.59:0/1122530279 learned_addr learned my addr 172.21.15.59:0/1122530279 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab4be00640 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d50c90 0x55e495db1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab59600640 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d515b0 0x55e495d6be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab58c00640 1 -- 172.21.15.59:0/1122530279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d50c90 msgr2=0x55e495db1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab58c00640 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d50c90 0x55e495db1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab58c00640 1 -- 172.21.15.59:0/1122530279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d515b0 msgr2=0x55e495d6be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab58c00640 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d515b0 0x55e495d6be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab58c00640 1 -- 172.21.15.59:0/1122530279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e495b1d120 con 0x55e495d07290 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab59600640 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d515b0 0x55e495d6be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab58c00640 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 0x55e495db1050 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fab44009630 tx=0x7fab440192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60815a1216b61a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab42000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab42000640 1 -- 172.21.15.59:0/1122530279 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440b1040 con 0x55e495d07290 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab42000640 1 -- 172.21.15.59:0/1122530279 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fab440c3650 con 0x55e495d07290 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 1 -- 172.21.15.59:0/1122530279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab4c056680 con 0x55e495d07290 2024-04-25T09:09:19.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab42000640 1 -- 172.21.15.59:0/1122530279 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab440059a0 con 0x55e495d07290 2024-04-25T09:09:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 10 client.8070 fetch_fsmap learned FSMap version 78 2024-04-25T09:09:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 1 -- 172.21.15.59:0/1122530279 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55e495afc170 con 0x55e495d07290 2024-04-25T09:09:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab42000640 1 -- 172.21.15.59:0/1122530279 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c056680 con 0x55e495d07290 2024-04-25T09:09:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab42000640 1 -- 172.21.15.59:0/1122530279 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fab440d0030 con 0x55e495d07290 2024-04-25T09:09:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 10 client.8070 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:09:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 10 client.8070 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 20 client.8070 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55e495d6cb20 0x55e495d6cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 4 client.8070 mds_command: new command op to 7965 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-25T09:09:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab5e9df000 1 -- 172.21.15.59:0/1122530279 --> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x55e495b625b0 con 0x55e495d6cb20 2024-04-25T09:09:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.015+0000 7fab4be00640 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55e495d6cb20 0x55e495d6cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab4be00640 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55e495d6cb20 0x55e495d6cf30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3426bec2e6faadf server_cookie=818b7df0d3c6c971 in_seq=0 out_seq=0 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab42000640 10 client.8070 ms_handle_connect on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab42000640 1 -- 172.21.15.59:0/1122530279 <== mds.0 v2:172.21.15.59:6833/1467736863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e495b625b0 con 0x55e495d6cb20 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab42000640 10 client.8070 handle_command_reply: tid=0 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5e9df000 1 client.8070 shutdown 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5e9df000 1 -- 172.21.15.59:0/1122530279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 msgr2=0x55e495db1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5e9df000 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 0x55e495db1050 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fab44009630 tx=0x7fab440192c0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5e9df000 1 -- 172.21.15.59:0/1122530279 shutdown_connections 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5e9df000 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55e495d6cb20 0x55e495d6cf30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5e9df000 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e495d515b0 0x55e495d6be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5e9df000 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e495d50c90 0x55e495db1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5e9df000 1 --2- 172.21.15.59:0/1122530279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e495d07290 0x55e495db1050 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5e9df000 1 -- 172.21.15.59:0/1122530279 >> 172.21.15.59:0/1122530279 conn(0x55e495d03240 msgr2=0x55e495d0c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab42000640 0 client.8070 ms_handle_reset on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:19.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5e9df000 1 -- 172.21.15.59:0/1122530279 shutdown_connections 2024-04-25T09:09:19.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5e9df000 1 -- 172.21.15.59:0/1122530279 wait complete. 2024-04-25T09:09:19.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5e9df000 20 client.8070 trim_cache size 0 max 16384 2024-04-25T09:09:19.012 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:09:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-04-25T09:09:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "0c6a1e14-0025-46d8-b4d8-a599fcd77c98", 2024-04-25T09:09:19.012 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-04-25T09:09:19.012 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:09:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5b600640 1 -- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fab30066f60 msgr2=0x7fab30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5b600640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fab30066f60 0x7fab30069420 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fab440ae000 tx=0x7fab44008040 comp rx=0 tx=0).stop 2024-04-25T09:09:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5b600640 1 -- 172.21.15.59:0/3677208996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54144080 msgr2=0x7fab540afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5b600640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54144080 0x7fab540afc80 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fab4c007e60 tx=0x7fab4c00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5b600640 1 -- 172.21.15.59:0/3677208996 shutdown_connections 2024-04-25T09:09:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5b600640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fab30066f60 0x7fab30069420 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5b600640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fab54144080 0x7fab540afc80 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5b600640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fab54071e40 0x7fab54150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5b600640 1 --2- 172.21.15.59:0/3677208996 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fab5406e3c0 0x7fab540ad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5b600640 1 -- 172.21.15.59:0/3677208996 >> 172.21.15.59:0/3677208996 conn(0x7fab5406ac10 msgr2=0x7fab5415fbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5b600640 1 -- 172.21.15.59:0/3677208996 shutdown_connections 2024-04-25T09:09:19.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.019+0000 7fab5b600640 1 -- 172.21.15.59:0/3677208996 wait complete. 2024-04-25T09:09:19.014 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:09:19.019+0000 7f7373a00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cfb6a92100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:09:19.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:19.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:09:19.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.179+0000 7fb1a0c00640 1 Processor -- start 2024-04-25T09:09:19.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.179+0000 7fb1a0c00640 1 -- start start 2024-04-25T09:09:19.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb1a0c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19c159320 0x7fb19c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb1a0c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb19c15f440 0x7fb19c06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb1a0c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb19c06e010 0x7fb19c06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb1a0c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c06d640 con 0x7fb19c15f440 2024-04-25T09:09:19.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb1a0c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19c15fc00 con 0x7fb19c06e010 2024-04-25T09:09:19.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb1a0c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c15fee0 con 0x7fb19c159320 2024-04-25T09:09:19.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb193e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb19c15f440 0x7fb19c06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb193e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb19c15f440 0x7fb19c06dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47142/0 (socket says 172.21.15.59:47142) 2024-04-25T09:09:19.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb193e00640 1 -- 172.21.15.59:0/1262003882 learned_addr learned my addr 172.21.15.59:0/1262003882 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:19.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb199e00640 1 --2- 172.21.15.59:0/1262003882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19c159320 0x7fb19c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb193e00640 1 -- 172.21.15.59:0/1262003882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19c159320 msgr2=0x7fb19c15c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb193e00640 1 --2- 172.21.15.59:0/1262003882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19c159320 0x7fb19c15c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb193e00640 1 -- 172.21.15.59:0/1262003882 >> v2:172.21.15.178:3300/0 conn(0x7fb19c06e010 msgr2=0x7fb19c06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb19a800640 1 --2- 172.21.15.59:0/1262003882 >> v2:172.21.15.178:3300/0 conn(0x7fb19c06e010 0x7fb19c06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb193e00640 1 --2- 172.21.15.59:0/1262003882 >> v2:172.21.15.178:3300/0 conn(0x7fb19c06e010 0x7fb19c06e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb193e00640 1 -- 172.21.15.59:0/1262003882 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c1601c0 con 0x7fb19c15f440 2024-04-25T09:09:19.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb199e00640 1 --2- 172.21.15.59:0/1262003882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19c159320 0x7fb19c15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:19.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.183+0000 7fb19a800640 1 --2- 172.21.15.59:0/1262003882 >> v2:172.21.15.178:3300/0 conn(0x7fb19c06e010 0x7fb19c06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:19.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb193e00640 1 --2- 172.21.15.59:0/1262003882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb19c15f440 0x7fb19c06dad0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fb19c1604a0 tx=0x7fb18401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97cfd8013dc9274 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb199400640 1 -- 172.21.15.59:0/1262003882 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1840b0070 con 0x7fb19c15f440 2024-04-25T09:09:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb199400640 1 -- 172.21.15.59:0/1262003882 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1840ab600 con 0x7fb19c15f440 2024-04-25T09:09:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb199400640 1 -- 172.21.15.59:0/1262003882 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1840ab9d0 con 0x7fb19c15f440 2024-04-25T09:09:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 -- 172.21.15.59:0/1262003882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb19c15f440 msgr2=0x7fb19c06dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 --2- 172.21.15.59:0/1262003882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb19c15f440 0x7fb19c06dad0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fb19c1604a0 tx=0x7fb18401c460 comp rx=0 tx=0).stop 2024-04-25T09:09:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 -- 172.21.15.59:0/1262003882 shutdown_connections 2024-04-25T09:09:19.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 --2- 172.21.15.59:0/1262003882 >> v2:172.21.15.178:3300/0 conn(0x7fb19c06e010 0x7fb19c06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 --2- 172.21.15.59:0/1262003882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb19c15f440 0x7fb19c06dad0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 --2- 172.21.15.59:0/1262003882 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19c159320 0x7fb19c15c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 -- 172.21.15.59:0/1262003882 >> 172.21.15.59:0/1262003882 conn(0x7fb19c067080 msgr2=0x7fb19c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 -- 172.21.15.59:0/1262003882 shutdown_connections 2024-04-25T09:09:19.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 -- 172.21.15.59:0/1262003882 wait complete. 2024-04-25T09:09:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 Processor -- start 2024-04-25T09:09:19.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 -- start start 2024-04-25T09:09:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19c06e010 0x7fb19c1651f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb19c159320 0x7fb19c15e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb19c15f440 0x7fb19c1f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0cc440 con 0x7fb19c15f440 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0cc2c0 con 0x7fb19c159320 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb1a0c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0cc5c0 con 0x7fb19c06e010 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.187+0000 7fb19a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb19c15f440 0x7fb19c1f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb19a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb19c15f440 0x7fb19c1f7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47158/0 (socket says 172.21.15.59:47158) 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb19a800640 1 -- 172.21.15.59:0/3346497107 learned_addr learned my addr 172.21.15.59:0/3346497107 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb193e00640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb19c159320 0x7fb19c15e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb199e00640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19c06e010 0x7fb19c1651f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb19a800640 1 -- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19c06e010 msgr2=0x7fb19c1651f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb19a800640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19c06e010 0x7fb19c1651f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb19a800640 1 -- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb19c159320 msgr2=0x7fb19c15e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb19a800640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb19c159320 0x7fb19c15e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb19a800640 1 -- 172.21.15.59:0/3346497107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c15b660 con 0x7fb19c15f440 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb19a800640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb19c15f440 0x7fb19c1f7b00 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fb19400cdd0 tx=0x7fb19400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb192000640 1 -- 172.21.15.59:0/3346497107 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19401a070 con 0x7fb19c15f440 2024-04-25T09:09:19.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb192000640 1 -- 172.21.15.59:0/3346497107 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19400d840 con 0x7fb19c15f440 2024-04-25T09:09:19.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb192000640 1 -- 172.21.15.59:0/3346497107 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400dc30 con 0x7fb19c15f440 2024-04-25T09:09:19.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb1a0c00640 1 -- 172.21.15.59:0/3346497107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb19c161580 con 0x7fb19c15f440 2024-04-25T09:09:19.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb1a0c00640 1 -- 172.21.15.59:0/3346497107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb19c15b940 con 0x7fb19c15f440 2024-04-25T09:09:19.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.191+0000 7fb192000640 1 -- 172.21.15.59:0/3346497107 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb19401d070 con 0x7fb19c15f440 2024-04-25T09:09:19.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb192000640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb178066f90 0x7fb178069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb192000640 1 -- 172.21.15.59:0/3346497107 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fb194085af0 con 0x7fb19c15f440 2024-04-25T09:09:19.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb199e00640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb178066f90 0x7fb178069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 Processor -- start 2024-04-25T09:09:19.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 -- start start 2024-04-25T09:09:19.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb199e00640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb178066f90 0x7fb178069450 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00ab60 tx=0x7fb18c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19319d0 0x564ab1931db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 0x564ab18e7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab18e80a0 0x564ab18e8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab1734ff0 con 0x564ab19322f0 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab16bd150 con 0x564ab18e80a0 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ab1731090 con 0x564ab19319d0 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb193e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 0x564ab18e7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb199e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19319d0 0x564ab1931db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb193e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 0x564ab18e7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47166/0 (socket says 172.21.15.59:47166) 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb193e00640 1 -- 172.21.15.59:0/73141128 learned_addr learned my addr 172.21.15.59:0/73141128 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb19a800640 1 --2- 172.21.15.59:0/73141128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab18e80a0 0x564ab18e8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb193e00640 1 -- 172.21.15.59:0/73141128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19319d0 msgr2=0x564ab1931db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb193e00640 1 --2- 172.21.15.59:0/73141128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19319d0 0x564ab1931db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb193e00640 1 -- 172.21.15.59:0/73141128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab18e80a0 msgr2=0x564ab18e8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb193e00640 1 --2- 172.21.15.59:0/73141128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab18e80a0 0x564ab18e8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb193e00640 1 -- 172.21.15.59:0/73141128 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ab18cb0d0 con 0x564ab19322f0 2024-04-25T09:09:19.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb193e00640 1 --2- 172.21.15.59:0/73141128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 0x564ab18e7b60 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fb1840ae040 tx=0x7fb1840a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed377e01f789380a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb18aa00640 1 -- 172.21.15.59:0/73141128 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1840b0040 con 0x564ab19322f0 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb18aa00640 1 -- 172.21.15.59:0/73141128 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1840ab980 con 0x564ab19322f0 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb18aa00640 1 -- 172.21.15.59:0/73141128 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1840abd30 con 0x564ab19322f0 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/73141128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 msgr2=0x564ab18e7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/73141128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 0x564ab18e7b60 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fb1840ae040 tx=0x7fb1840a6000 comp rx=0 tx=0).stop 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/73141128 shutdown_connections 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/73141128 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab18e80a0 0x564ab18e8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/73141128 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 0x564ab18e7b60 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/73141128 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19319d0 0x564ab1931db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/73141128 >> 172.21.15.59:0/73141128 conn(0x564ab18e4020 msgr2=0x564ab18e6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/73141128 shutdown_connections 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.195+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/73141128 wait complete. 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 1 -- start start 2024-04-25T09:09:19.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 1 Processor -- start 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab18e80a0 0x564ab191aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab19319d0 0x564ab191b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19322f0 0x564ab191ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab16f9250 con 0x564ab18e80a0 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab16ef690 con 0x564ab19319d0 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ab16bda40 con 0x564ab19322f0 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 10 client.0 _ll_register_callbacks cb 0x564ab18d2e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb199e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab18e80a0 0x564ab191aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb199e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab18e80a0 0x564ab191aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47180/0 (socket says 172.21.15.59:47180) 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb199e00640 1 -- 172.21.15.59:0/165222079 learned_addr learned my addr 172.21.15.59:0/165222079 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb193e00640 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab19319d0 0x564ab191b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb19a800640 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19322f0 0x564ab191ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb199e00640 1 -- 172.21.15.59:0/165222079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19322f0 msgr2=0x564ab191ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb199e00640 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19322f0 0x564ab191ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb199e00640 1 -- 172.21.15.59:0/165222079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab19319d0 msgr2=0x564ab191b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb199e00640 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab19319d0 0x564ab191b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb199e00640 1 -- 172.21.15.59:0/165222079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ab17e21c0 con 0x564ab18e80a0 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb199e00640 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab18e80a0 0x564ab191aff0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00ffd0 tx=0x7fb18c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9bcbcd7e54777e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb17f400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb17f400640 1 -- 172.21.15.59:0/165222079 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18c025070 con 0x564ab18e80a0 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb17f400640 1 -- 172.21.15.59:0/165222079 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fb18c0139b0 con 0x564ab18e80a0 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/165222079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1840ab980 con 0x564ab18e80a0 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb17f400640 1 -- 172.21.15.59:0/165222079 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb18c030050 con 0x564ab18e80a0 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 10 client.8082 fetch_fsmap learned FSMap version 78 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/165222079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x564ab17de170 con 0x564ab18e80a0 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb17f400640 1 -- 172.21.15.59:0/165222079 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1840ab980 con 0x564ab18e80a0 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb17f400640 1 -- 172.21.15.59:0/165222079 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb18c033020 con 0x564ab18e80a0 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 10 client.8082 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 10 client.8082 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:19.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 20 client.8082 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:19.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x564ab191c340 0x564ab19481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 4 client.8082 mds_command: new command op to 7965 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:19.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/165222079 --> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ab16d0c60 con 0x564ab191c340 2024-04-25T09:09:19.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.199+0000 7fb193e00640 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x564ab191c340 0x564ab19481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb193e00640 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x564ab191c340 0x564ab19481a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77516289a2f4dc87 server_cookie=f32c36a16ac03ac1 in_seq=0 out_seq=0 2024-04-25T09:09:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb17f400640 10 client.8082 ms_handle_connect on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb17f400640 1 -- 172.21.15.59:0/165222079 <== mds.0 v2:172.21.15.59:6833/1467736863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564ab16d0c60 con 0x564ab191c340 2024-04-25T09:09:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb17f400640 10 client.8082 handle_command_reply: tid=0 2024-04-25T09:09:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb1a3fc5000 1 client.8082 shutdown 2024-04-25T09:09:19.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/165222079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab18e80a0 msgr2=0x564ab191aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab18e80a0 0x564ab191aff0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00ffd0 tx=0x7fb18c0046d0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/165222079 shutdown_connections 2024-04-25T09:09:19.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x564ab191c340 0x564ab19481a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19322f0 0x564ab191ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab19319d0 0x564ab191b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb17f400640 0 client.8082 ms_handle_reset on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:19.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/165222079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab18e80a0 0x564ab191aff0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/165222079 >> 172.21.15.59:0/165222079 conn(0x564ab18e4020 msgr2=0x564ab18e6ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/165222079 shutdown_connections 2024-04-25T09:09:19.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/165222079 wait complete. 2024-04-25T09:09:19.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.203+0000 7fb1a3fc5000 20 client.8082 trim_cache size 0 max 16384 2024-04-25T09:09:19.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 Processor -- start 2024-04-25T09:09:19.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 -- start start 2024-04-25T09:09:19.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab18e80a0 0x564ab19307c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab19319d0 0x564ab1930d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 0x564ab18e7420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c1ff490 con 0x564ab19322f0 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0b41a0 con 0x564ab19319d0 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c1422c0 con 0x564ab18e80a0 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb19a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 0x564ab18e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb19a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 0x564ab18e7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47196/0 (socket says 172.21.15.59:47196) 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb19a800640 1 -- 172.21.15.59:0/936475395 learned_addr learned my addr 172.21.15.59:0/936475395 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb199e00640 1 --2- 172.21.15.59:0/936475395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab18e80a0 0x564ab19307c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb193e00640 1 --2- 172.21.15.59:0/936475395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab19319d0 0x564ab1930d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb19a800640 1 -- 172.21.15.59:0/936475395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab18e80a0 msgr2=0x564ab19307c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb19a800640 1 --2- 172.21.15.59:0/936475395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab18e80a0 0x564ab19307c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb19a800640 1 -- 172.21.15.59:0/936475395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab19319d0 msgr2=0x564ab1930d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb19a800640 1 --2- 172.21.15.59:0/936475395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab19319d0 0x564ab1930d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb19a800640 1 -- 172.21.15.59:0/936475395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ab177bde0 con 0x564ab19322f0 2024-04-25T09:09:19.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb193e00640 1 --2- 172.21.15.59:0/936475395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab19319d0 0x564ab1930d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:19.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb19a800640 1 --2- 172.21.15.59:0/936475395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 0x564ab18e7420 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fb194056060 tx=0x7fb19405e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8657e3f7cf11e163 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb18a000640 1 -- 172.21.15.59:0/936475395 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19400adc0 con 0x564ab19322f0 2024-04-25T09:09:19.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb18a000640 1 -- 172.21.15.59:0/936475395 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19406d050 con 0x564ab19322f0 2024-04-25T09:09:19.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb18a000640 1 -- 172.21.15.59:0/936475395 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb194052740 con 0x564ab19322f0 2024-04-25T09:09:19.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/936475395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 msgr2=0x564ab18e7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/936475395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 0x564ab18e7420 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fb194056060 tx=0x7fb19405e7c0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/936475395 shutdown_connections 2024-04-25T09:09:19.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/936475395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19322f0 0x564ab18e7420 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/936475395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab19319d0 0x564ab1930d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/936475395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab18e80a0 0x564ab19307c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/936475395 >> 172.21.15.59:0/936475395 conn(0x564ab18e4020 msgr2=0x564ab1914d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/936475395 shutdown_connections 2024-04-25T09:09:19.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/936475395 wait complete. 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 -- start start 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.219+0000 7fb1a3fc5000 1 Processor -- start 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab18e80a0 0x564ab19481a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19319d0 0x564ab19486e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19322f0 0x564ab1948c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab16cfe00 con 0x564ab19319d0 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19c0b3ba0 con 0x564ab18e80a0 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564ab1734300 con 0x564ab19322f0 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 10 client.0 _ll_register_callbacks cb 0x564ab18b3040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb193e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19319d0 0x564ab19486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb193e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19319d0 0x564ab19486e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47210/0 (socket says 172.21.15.59:47210) 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb193e00640 1 -- 172.21.15.59:0/22855213 learned_addr learned my addr 172.21.15.59:0/22855213 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb199e00640 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab18e80a0 0x564ab19481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb19a800640 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19322f0 0x564ab1948c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb193e00640 1 -- 172.21.15.59:0/22855213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19322f0 msgr2=0x564ab1948c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb193e00640 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19322f0 0x564ab1948c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb193e00640 1 -- 172.21.15.59:0/22855213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab18e80a0 msgr2=0x564ab19481a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb193e00640 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab18e80a0 0x564ab19481a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb193e00640 1 -- 172.21.15.59:0/22855213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ab16d68e0 con 0x564ab19319d0 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb193e00640 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19319d0 0x564ab19486e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fb18401ab10 tx=0x7fb18401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae56705ca094dfb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb17f400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb17f400640 1 -- 172.21.15.59:0/22855213 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1840b0040 con 0x564ab19319d0 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb17f400640 1 -- 172.21.15.59:0/22855213 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fb184004240 con 0x564ab19319d0 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/22855213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb19406d050 con 0x564ab19319d0 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb17f400640 1 -- 172.21.15.59:0/22855213 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1840d1050 con 0x564ab19319d0 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 10 client.8088 fetch_fsmap learned FSMap version 78 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/22855213 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x564ab178e8f0 con 0x564ab19319d0 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb17f400640 1 -- 172.21.15.59:0/22855213 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19406d050 con 0x564ab19319d0 2024-04-25T09:09:19.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb17f400640 1 -- 172.21.15.59:0/22855213 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb1840d4020 con 0x564ab19319d0 2024-04-25T09:09:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 10 client.8088 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:09:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 10 client.8088 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 20 client.8088 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x564ab1949610 0x564ab199e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 4 client.8088 mds_command: new command op to 7965 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:09:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/22855213 --> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564ab1742530 con 0x564ab1949610 2024-04-25T09:09:19.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb199e00640 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x564ab1949610 0x564ab199e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:19.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb17f400640 10 client.8088 ms_handle_connect on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:19.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb199e00640 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x564ab1949610 0x564ab199e090 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e13a663efd378460 server_cookie=fe51a21bc9910719 in_seq=0 out_seq=0 2024-04-25T09:09:19.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb17f400640 1 -- 172.21.15.59:0/22855213 <== mds.0 v2:172.21.15.59:6833/1467736863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x564ab1742530 con 0x564ab1949610 2024-04-25T09:09:19.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb17f400640 10 client.8088 handle_command_reply: tid=0 2024-04-25T09:09:19.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 client.8088 shutdown 2024-04-25T09:09:19.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/22855213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19319d0 msgr2=0x564ab19486e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.223+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19319d0 0x564ab19486e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fb18401ab10 tx=0x7fb18401aca0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/22855213 shutdown_connections 2024-04-25T09:09:19.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x564ab1949610 0x564ab199e090 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564ab19322f0 0x564ab1948c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564ab19319d0 0x564ab19486e0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a3fc5000 1 --2- 172.21.15.59:0/22855213 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564ab18e80a0 0x564ab19481a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/22855213 >> 172.21.15.59:0/22855213 conn(0x564ab18e4020 msgr2=0x564ab19307c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb17f400640 0 client.8088 ms_handle_reset on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:19.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/22855213 shutdown_connections 2024-04-25T09:09:19.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a3fc5000 1 -- 172.21.15.59:0/22855213 wait complete. 2024-04-25T09:09:19.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a3fc5000 20 client.8088 trim_cache size 0 max 16384 2024-04-25T09:09:19.219 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:09:19.219 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:09:19.219 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-04-25T09:09:19.219 INFO:teuthology.orchestra.run.smithi059.stdout: "0c6a1e14-0025-46d8-b4d8-a599fcd77c98": { 2024-04-25T09:09:19.219 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/dir", 2024-04-25T09:09:19.219 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "0c6a1e14-0025-46d8-b4d8-a599fcd77c98", 2024-04-25T09:09:19.219 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,repair" 2024-04-25T09:09:19.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:09:19.219 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:09:19.219 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:09:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a0c00640 1 -- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb178066f90 msgr2=0x7fb178069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a0c00640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb178066f90 0x7fb178069450 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb18c00ab60 tx=0x7fb18c008040 comp rx=0 tx=0).stop 2024-04-25T09:09:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a0c00640 1 -- 172.21.15.59:0/3346497107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb19c15f440 msgr2=0x7fb19c1f7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a0c00640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb19c15f440 0x7fb19c1f7b00 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fb19400cdd0 tx=0x7fb19400a710 comp rx=0 tx=0).stop 2024-04-25T09:09:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a0c00640 1 -- 172.21.15.59:0/3346497107 shutdown_connections 2024-04-25T09:09:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a0c00640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb178066f90 0x7fb178069450 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a0c00640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb19c15f440 0x7fb19c1f7b00 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a0c00640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb19c159320 0x7fb19c15e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a0c00640 1 --2- 172.21.15.59:0/3346497107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb19c06e010 0x7fb19c1651f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:19.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a0c00640 1 -- 172.21.15.59:0/3346497107 >> 172.21.15.59:0/3346497107 conn(0x7fb19c067080 msgr2=0x7fb19c159910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:19.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a0c00640 1 -- 172.21.15.59:0/3346497107 shutdown_connections 2024-04-25T09:09:19.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:19.227+0000 7fb1a0c00640 1 -- 172.21.15.59:0/3346497107 wait complete. 2024-04-25T09:09:19.235 INFO:tasks.cephfs.filesystem:scrub status for tag:0c6a1e14-0025-46d8-b4d8-a599fcd77c98 - {'path': '/dir', 'tag': '0c6a1e14-0025-46d8-b4d8-a599fcd77c98', 'options': 'recursive,repair'} 2024-04-25T09:09:23.539 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:23.543 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:49.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:49.236 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-25T09:09:49.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e6ca00640 1 Processor -- start 2024-04-25T09:09:49.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e6ca00640 1 -- start start 2024-04-25T09:09:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e6ca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e680ce1e0 0x7f4e680cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e6ca00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e680ce670 con 0x7f4e680c6b90 2024-04-25T09:09:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e6ca00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e680c54b0 con 0x7f4e681621a0 2024-04-25T09:09:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e6ca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680d02b0 con 0x7f4e680ce1e0 2024-04-25T09:09:49.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4e680c6b90 0x7f4e680c6f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46850/0 (socket says 172.21.15.59:46850) 2024-04-25T09:09:49.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65e00640 1 -- 172.21.15.59:0/1917212153 learned_addr learned my addr 172.21.15.59:0/1917212153 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e66800640 1 --2- 172.21.15.59:0/1917212153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e680ce1e0 0x7f4e680cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774415769 0 0) 0x7f4e680ce670 con 0x7f4e680c6b90 2024-04-25T09:09:49.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e4c003530 con 0x7f4e680c6b90 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787591733 0 0) 0x7f4e680c54b0 con 0x7f4e681621a0 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e680ce670 con 0x7f4e681621a0 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2284949260 0 0) 0x7f4e4c003530 con 0x7f4e680c6b90 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e680ce1e0 msgr2=0x7f4e680cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 --2- 172.21.15.59:0/1917212153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e680ce1e0 0x7f4e680cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 >> v1:172.21.15.178:6789/0 conn(0x7f4e681621a0 legacy=0x7f4e680cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e680c5790 con 0x7f4e680c6b90 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f4e58001680 con 0x7f4e680c6b90 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 >> v1:172.21.15.59:6789/0 conn(0x7f4e680c6b90 legacy=0x7f4e680c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 --2- 172.21.15.59:0/1917212153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e4c003b80 0x7f4e4c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 --2- 172.21.15.59:0/1917212153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e4c004810 0x7f4e4c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 --2- 172.21.15.59:0/1917212153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e680ce1e0 0x7f4e4c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680d02b0 con 0x7f4e4c003b80 2024-04-25T09:09:49.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c00bb60 con 0x7f4e4c004810 2024-04-25T09:09:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c00bd30 con 0x7f4e680ce1e0 2024-04-25T09:09:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e65e00640 1 --2- 172.21.15.59:0/1917212153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e4c003b80 0x7f4e4c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e5d400640 1 --2- 172.21.15.59:0/1917212153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e4c004810 0x7f4e4c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.403+0000 7f4e66800640 1 --2- 172.21.15.59:0/1917212153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e680ce1e0 0x7f4e4c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e65e00640 1 -- 172.21.15.59:0/1917212153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e680ce1e0 msgr2=0x7f4e4c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e65e00640 1 --2- 172.21.15.59:0/1917212153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e680ce1e0 0x7f4e4c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e65e00640 1 -- 172.21.15.59:0/1917212153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e4c004810 msgr2=0x7f4e4c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e65e00640 1 --2- 172.21.15.59:0/1917212153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e4c004810 0x7f4e4c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e65e00640 1 -- 172.21.15.59:0/1917212153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c003530 con 0x7f4e4c003b80 2024-04-25T09:09:49.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e65e00640 1 --2- 172.21.15.59:0/1917212153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e4c003b80 0x7f4e4c003f80 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800c110 tx=0x7f4e5801cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0067746b0ea4fa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58007c10 con 0x7f4e4c003b80 2024-04-25T09:09:49.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e580a9070 con 0x7f4e4c003b80 2024-04-25T09:09:49.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e65400640 1 -- 172.21.15.59:0/1917212153 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58005d40 con 0x7f4e4c003b80 2024-04-25T09:09:49.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e6ca00640 1 -- 172.21.15.59:0/1917212153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e4c003b80 msgr2=0x7f4e4c003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e6ca00640 1 --2- 172.21.15.59:0/1917212153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e4c003b80 0x7f4e4c003f80 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800c110 tx=0x7f4e5801cb60 comp rx=0 tx=0).stop 2024-04-25T09:09:49.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e66800640 1 -- 172.21.15.59:0/1917212153 reap_dead start 2024-04-25T09:09:49.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e6ca00640 1 -- 172.21.15.59:0/1917212153 shutdown_connections 2024-04-25T09:09:49.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e6ca00640 1 -- 172.21.15.59:0/1917212153 >> 172.21.15.59:0/1917212153 conn(0x7f4e680b2240 msgr2=0x7f4e680b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e6ca00640 1 -- 172.21.15.59:0/1917212153 shutdown_connections 2024-04-25T09:09:49.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.407+0000 7f4e6ca00640 1 -- 172.21.15.59:0/1917212153 wait complete. 2024-04-25T09:09:49.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e6ca00640 1 Processor -- start 2024-04-25T09:09:49.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e6ca00640 1 -- start start 2024-04-25T09:09:49.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e6ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e4c003b80 0x7f4e681fb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e6ca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e68156650 0x7f4e680c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e6ca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e68156ad0 0x7f4e680c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e6ca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680b3030 con 0x7f4e4c003b80 2024-04-25T09:09:49.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e6ca00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680b2eb0 con 0x7f4e68156650 2024-04-25T09:09:49.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e6ca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680cdd20 con 0x7f4e68156ad0 2024-04-25T09:09:49.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e65e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e4c003b80 0x7f4e681fb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e65e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e4c003b80 0x7f4e681fb3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36258/0 (socket says 172.21.15.59:36258) 2024-04-25T09:09:49.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e65e00640 1 -- 172.21.15.59:0/2731899418 learned_addr learned my addr 172.21.15.59:0/2731899418 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:49.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e66800640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e68156ad0 0x7f4e680c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e5d400640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e68156650 0x7f4e680c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e65e00640 1 -- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e68156ad0 msgr2=0x7f4e680c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e65e00640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e68156ad0 0x7f4e680c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e65e00640 1 -- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e68156650 msgr2=0x7f4e680c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e65e00640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e68156650 0x7f4e680c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e65e00640 1 -- 172.21.15.59:0/2731899418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e680aee20 con 0x7f4e4c003b80 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e5d400640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e68156650 0x7f4e680c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e65e00640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e4c003b80 0x7f4e681fb3d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f4e58000c10 tx=0x7f4e4c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e5ea00640 1 -- 172.21.15.59:0/2731899418 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58007bf0 con 0x7f4e4c003b80 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e5ea00640 1 -- 172.21.15.59:0/2731899418 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58005d20 con 0x7f4e4c003b80 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e6ca00640 1 -- 172.21.15.59:0/2731899418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e680b3ea0 con 0x7f4e4c003b80 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e5ea00640 1 -- 172.21.15.59:0/2731899418 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58001680 con 0x7f4e4c003b80 2024-04-25T09:09:49.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.411+0000 7f4e6ca00640 1 -- 172.21.15.59:0/2731899418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e680b4460 con 0x7f4e4c003b80 2024-04-25T09:09:49.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.415+0000 7f4e5ea00640 1 -- 172.21.15.59:0/2731899418 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4e58007040 con 0x7f4e4c003b80 2024-04-25T09:09:49.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.415+0000 7f4e5ea00640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4e44066f60 0x7f4e44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.415+0000 7f4e5ea00640 1 -- 172.21.15.59:0/2731899418 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f4e5811ea30 con 0x7f4e4c003b80 2024-04-25T09:09:49.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.415+0000 7f4e5d400640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4e44066f60 0x7f4e44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 Processor -- start 2024-04-25T09:09:49.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 -- start start 2024-04-25T09:09:49.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e5d400640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4e44066f60 0x7f4e44069420 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4e50000c10 tx=0x7f4e50009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584aaf4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 0x55584aaaab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584aaab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584a8f7ff0 con 0x55584aaf52f0 2024-04-25T09:09:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584a880150 con 0x55584aaab0a0 2024-04-25T09:09:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55584a8f4090 con 0x55584aaf49d0 2024-04-25T09:09:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e5d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 0x55584aaaab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e5d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 0x55584aaaab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36264/0 (socket says 172.21.15.59:36264) 2024-04-25T09:09:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e5d400640 1 -- 172.21.15.59:0/3846243755 learned_addr learned my addr 172.21.15.59:0/3846243755 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e65e00640 1 --2- 172.21.15.59:0/3846243755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584aaf4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e66800640 1 --2- 172.21.15.59:0/3846243755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584aaab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e5d400640 1 -- 172.21.15.59:0/3846243755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 msgr2=0x55584aaf4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e5d400640 1 --2- 172.21.15.59:0/3846243755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584aaf4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e5d400640 1 -- 172.21.15.59:0/3846243755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 msgr2=0x55584aaab480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e5d400640 1 --2- 172.21.15.59:0/3846243755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584aaab480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e5d400640 1 -- 172.21.15.59:0/3846243755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55584aa8e0d0 con 0x55584aaf52f0 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e66800640 1 --2- 172.21.15.59:0/3846243755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584aaab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e5d400640 1 --2- 172.21.15.59:0/3846243755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 0x55584aaaab60 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f4e500016f0 tx=0x7f4e50013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6170f9b8fa7386ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e56a00640 1 -- 172.21.15.59:0/3846243755 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50027070 con 0x55584aaf52f0 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e56a00640 1 -- 172.21.15.59:0/3846243755 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e50014840 con 0x55584aaf52f0 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e56a00640 1 -- 172.21.15.59:0/3846243755 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e50014bf0 con 0x55584aaf52f0 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 -- 172.21.15.59:0/3846243755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 msgr2=0x55584aaaab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/3846243755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 0x55584aaaab60 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f4e500016f0 tx=0x7f4e50013000 comp rx=0 tx=0).stop 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 -- 172.21.15.59:0/3846243755 shutdown_connections 2024-04-25T09:09:49.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/3846243755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584aaab480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/3846243755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 0x55584aaaab60 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/3846243755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584aaf4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 -- 172.21.15.59:0/3846243755 >> 172.21.15.59:0/3846243755 conn(0x55584aaa7020 msgr2=0x55584aaa9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 -- 172.21.15.59:0/3846243755 shutdown_connections 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 -- 172.21.15.59:0/3846243755 wait complete. 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.419+0000 7f4e6fecd000 1 -- start start 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 1 Processor -- start 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584aad97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf49d0 0x55584aad9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf52f0 0x55584aada270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584a8bc250 con 0x55584aaf49d0 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584a8b2690 con 0x55584aaab0a0 2024-04-25T09:09:49.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55584a880a40 con 0x55584aaf52f0 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 10 client.0 _ll_register_callbacks cb 0x55584aa95e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e5d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf49d0 0x55584aad9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e5d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf49d0 0x55584aad9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36276/0 (socket says 172.21.15.59:36276) 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e5d400640 1 -- 172.21.15.59:0/2633241870 learned_addr learned my addr 172.21.15.59:0/2633241870 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e65e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584aad97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e66800640 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf52f0 0x55584aada270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e65e00640 1 -- 172.21.15.59:0/2633241870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf52f0 msgr2=0x55584aada270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e65e00640 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf52f0 0x55584aada270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e65e00640 1 -- 172.21.15.59:0/2633241870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf49d0 msgr2=0x55584aad9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e65e00640 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf49d0 0x55584aad9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e65e00640 1 -- 172.21.15.59:0/2633241870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55584a9a51c0 con 0x55584aaab0a0 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e5d400640 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf49d0 0x55584aad9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e65e00640 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584aad97f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4e5801cba0 tx=0x7f4e580ef700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4368bca594d08415 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e4b400640 10 client.0 ms_handle_connect on v2:172.21.15.178:3300/0 2024-04-25T09:09:49.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e4b400640 1 -- 172.21.15.59:0/2633241870 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580f7710 con 0x55584aaab0a0 2024-04-25T09:09:49.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e4b400640 1 -- 172.21.15.59:0/2633241870 <== mon.1 v2:172.21.15.178:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f4e580f7280 con 0x55584aaab0a0 2024-04-25T09:09:49.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 1 -- 172.21.15.59:0/2633241870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e50014840 con 0x55584aaab0a0 2024-04-25T09:09:49.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e4b400640 1 -- 172.21.15.59:0/2633241870 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e580f7480 con 0x55584aaab0a0 2024-04-25T09:09:49.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 10 client.7627 fetch_fsmap learned FSMap version 78 2024-04-25T09:09:49.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 1 -- 172.21.15.59:0/2633241870 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55584a9a1170 con 0x55584aaab0a0 2024-04-25T09:09:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e4b400640 1 -- 172.21.15.59:0/2633241870 <== mon.1 v2:172.21.15.178:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e50014840 con 0x55584aaab0a0 2024-04-25T09:09:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e4b400640 1 -- 172.21.15.59:0/2633241870 <== mon.1 v2:172.21.15.178:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4e580ee450 con 0x55584aaab0a0 2024-04-25T09:09:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 10 client.7627 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:09:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 10 client.7627 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 20 client.7627 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:49.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55584ab04c80 0x55584ab07070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 4 client.7627 mds_command: new command op to 7965 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:49.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e6fecd000 1 -- 172.21.15.59:0/2633241870 --> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55584a893c60 con 0x55584ab04c80 2024-04-25T09:09:49.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.423+0000 7f4e5d400640 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55584ab04c80 0x55584ab07070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e5d400640 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55584ab04c80 0x55584ab07070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a7b3f53d90ac4c server_cookie=e23d9a1bebae58a6 in_seq=0 out_seq=0 2024-04-25T09:09:49.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e4b400640 10 client.7627 ms_handle_connect on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:49.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e4b400640 1 -- 172.21.15.59:0/2633241870 <== mds.0 v2:172.21.15.59:6833/1467736863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55584a893c60 con 0x55584ab04c80 2024-04-25T09:09:49.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e4b400640 10 client.7627 handle_command_reply: tid=0 2024-04-25T09:09:49.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e6fecd000 1 client.7627 shutdown 2024-04-25T09:09:49.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e6fecd000 1 -- 172.21.15.59:0/2633241870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 msgr2=0x55584aad97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584aad97f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4e5801cba0 tx=0x7f4e580ef700 comp rx=0 tx=0).stop 2024-04-25T09:09:49.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e6fecd000 1 -- 172.21.15.59:0/2633241870 shutdown_connections 2024-04-25T09:09:49.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55584ab04c80 0x55584ab07070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf52f0 0x55584aada270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e4b400640 0 client.7627 ms_handle_reset on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:49.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf49d0 0x55584aad9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/2633241870 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584aad97f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e6fecd000 1 -- 172.21.15.59:0/2633241870 >> 172.21.15.59:0/2633241870 conn(0x55584aaa7020 msgr2=0x55584aaa9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e6fecd000 1 -- 172.21.15.59:0/2633241870 shutdown_connections 2024-04-25T09:09:49.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e6fecd000 1 -- 172.21.15.59:0/2633241870 wait complete. 2024-04-25T09:09:49.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.427+0000 7f4e6fecd000 20 client.7627 trim_cache size 0 max 16384 2024-04-25T09:09:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 Processor -- start 2024-04-25T09:09:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 -- start start 2024-04-25T09:09:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584ab51300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584ab51840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 0x55584ab51d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68208750 con 0x55584aaf52f0 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68207890 con 0x55584aaab0a0 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68206c90 con 0x55584aaf49d0 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e66800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 0x55584ab51d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e66800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 0x55584ab51d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36284/0 (socket says 172.21.15.59:36284) 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e66800640 1 -- 172.21.15.59:0/3385251373 learned_addr learned my addr 172.21.15.59:0/3385251373 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e5d400640 1 --2- 172.21.15.59:0/3385251373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584ab51840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e65e00640 1 --2- 172.21.15.59:0/3385251373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584ab51300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e66800640 1 -- 172.21.15.59:0/3385251373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 msgr2=0x55584ab51840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e66800640 1 --2- 172.21.15.59:0/3385251373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584ab51840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e66800640 1 -- 172.21.15.59:0/3385251373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 msgr2=0x55584ab51300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e66800640 1 --2- 172.21.15.59:0/3385251373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584ab51300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e66800640 1 -- 172.21.15.59:0/3385251373 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55584a93ede0 con 0x55584aaf52f0 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e5d400640 1 --2- 172.21.15.59:0/3385251373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584ab51840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e65e00640 1 --2- 172.21.15.59:0/3385251373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584ab51300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:49.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e66800640 1 --2- 172.21.15.59:0/3385251373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 0x55584ab51d80 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f4e680d16c0 tx=0x7f4e60009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3b2070beb50a94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e56000640 1 -- 172.21.15.59:0/3385251373 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60003e60 con 0x55584aaf52f0 2024-04-25T09:09:49.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e56000640 1 -- 172.21.15.59:0/3385251373 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e60021440 con 0x55584aaf52f0 2024-04-25T09:09:49.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e56000640 1 -- 172.21.15.59:0/3385251373 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60021830 con 0x55584aaf52f0 2024-04-25T09:09:49.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 -- 172.21.15.59:0/3385251373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 msgr2=0x55584ab51d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/3385251373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 0x55584ab51d80 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f4e680d16c0 tx=0x7f4e60009750 comp rx=0 tx=0).stop 2024-04-25T09:09:49.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 -- 172.21.15.59:0/3385251373 shutdown_connections 2024-04-25T09:09:49.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/3385251373 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaf52f0 0x55584ab51d80 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/3385251373 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584ab51840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/3385251373 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaab0a0 0x55584ab51300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 -- 172.21.15.59:0/3385251373 >> 172.21.15.59:0/3385251373 conn(0x55584aaa7020 msgr2=0x55584aaf30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 -- 172.21.15.59:0/3385251373 shutdown_connections 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 -- 172.21.15.59:0/3385251373 wait complete. 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 -- start start 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.443+0000 7f4e6fecd000 1 Processor -- start 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaab0a0 0x55584ab07770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584ab07cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaf52f0 0x55584ab081f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55584a892e00 con 0x55584aaab0a0 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68207290 con 0x55584aaf52f0 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55584a8f7300 con 0x55584aaf49d0 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 10 client.0 _ll_register_callbacks cb 0x55584aa76040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e65e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaab0a0 0x55584ab07770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e65e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaab0a0 0x55584ab07770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36286/0 (socket says 172.21.15.59:36286) 2024-04-25T09:09:49.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e65e00640 1 -- 172.21.15.59:0/825540642 learned_addr learned my addr 172.21.15.59:0/825540642 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e5d400640 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584ab07cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e66800640 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaf52f0 0x55584ab081f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e65e00640 1 -- 172.21.15.59:0/825540642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 msgr2=0x55584ab07cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e65e00640 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584ab07cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e65e00640 1 -- 172.21.15.59:0/825540642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaf52f0 msgr2=0x55584ab081f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e65e00640 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaf52f0 0x55584ab081f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e65e00640 1 -- 172.21.15.59:0/825540642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55584a8998e0 con 0x55584aaab0a0 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e65e00640 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaab0a0 0x55584ab07770 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f4e580eb980 tx=0x7f4e5811cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67298b3e1444abfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e4b400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e4b400640 1 -- 172.21.15.59:0/825540642 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580f7710 con 0x55584aaab0a0 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e4b400640 1 -- 172.21.15.59:0/825540642 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f4e580eaf60 con 0x55584aaab0a0 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 -- 172.21.15.59:0/825540642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e60021440 con 0x55584aaab0a0 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e4b400640 1 -- 172.21.15.59:0/825540642 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e580eeb40 con 0x55584aaab0a0 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 10 client.8106 fetch_fsmap learned FSMap version 78 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 -- 172.21.15.59:0/825540642 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55584a9518f0 con 0x55584aaab0a0 2024-04-25T09:09:49.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e4b400640 1 -- 172.21.15.59:0/825540642 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e60021440 con 0x55584aaab0a0 2024-04-25T09:09:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e4b400640 1 -- 172.21.15.59:0/825540642 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4e580edec0 con 0x55584aaab0a0 2024-04-25T09:09:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 10 client.8106 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:09:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 10 client.8106 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-25T09:09:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 20 client.8106 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55584ab5af50 0x55584ab5d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 4 client.8106 mds_command: new command op to 7965 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:09:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 -- 172.21.15.59:0/825540642 --> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55584a905530 con 0x55584ab5af50 2024-04-25T09:09:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e5d400640 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55584ab5af50 0x55584ab5d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e5d400640 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55584ab5af50 0x55584ab5d340 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d579b15f7af48f91 server_cookie=a94f758e1a225fe8 in_seq=0 out_seq=0 2024-04-25T09:09:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e4b400640 10 client.8106 ms_handle_connect on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e4b400640 1 -- 172.21.15.59:0/825540642 <== mds.0 v2:172.21.15.59:6833/1467736863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55584a905530 con 0x55584ab5af50 2024-04-25T09:09:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e4b400640 10 client.8106 handle_command_reply: tid=0 2024-04-25T09:09:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 client.8106 shutdown 2024-04-25T09:09:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 -- 172.21.15.59:0/825540642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaab0a0 msgr2=0x55584ab07770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaab0a0 0x55584ab07770 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f4e580eb980 tx=0x7f4e5811cb70 comp rx=0 tx=0).stop 2024-04-25T09:09:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 -- 172.21.15.59:0/825540642 shutdown_connections 2024-04-25T09:09:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x55584ab5af50 0x55584ab5d340 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55584aaf52f0 0x55584ab081f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55584aaf49d0 0x55584ab07cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e4b400640 0 client.8106 ms_handle_reset on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:49.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 --2- 172.21.15.59:0/825540642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55584aaab0a0 0x55584ab07770 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 -- 172.21.15.59:0/825540642 >> 172.21.15.59:0/825540642 conn(0x55584aaa7020 msgr2=0x55584aaf3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 -- 172.21.15.59:0/825540642 shutdown_connections 2024-04-25T09:09:49.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.447+0000 7f4e6fecd000 1 -- 172.21.15.59:0/825540642 wait complete. 2024-04-25T09:09:49.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6fecd000 20 client.8106 trim_cache size 0 max 16384 2024-04-25T09:09:49.444 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:09:49.444 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-04-25T09:09:49.444 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2024-04-25T09:09:49.445 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:09:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6ca00640 1 -- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4e44066f60 msgr2=0x7f4e44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6ca00640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4e44066f60 0x7f4e44069420 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4e50000c10 tx=0x7f4e50009040 comp rx=0 tx=0).stop 2024-04-25T09:09:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6ca00640 1 -- 172.21.15.59:0/2731899418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e4c003b80 msgr2=0x7f4e681fb3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6ca00640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e4c003b80 0x7f4e681fb3d0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f4e58000c10 tx=0x7f4e4c005840 comp rx=0 tx=0).stop 2024-04-25T09:09:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6ca00640 1 -- 172.21.15.59:0/2731899418 shutdown_connections 2024-04-25T09:09:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6ca00640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4e44066f60 0x7f4e44069420 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6ca00640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4e68156ad0 0x7f4e680c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6ca00640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4e68156650 0x7f4e680c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6ca00640 1 --2- 172.21.15.59:0/2731899418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e4c003b80 0x7f4e681fb3d0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6ca00640 1 -- 172.21.15.59:0/2731899418 >> 172.21.15.59:0/2731899418 conn(0x7f4e680b2240 msgr2=0x7f4e6806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6ca00640 1 -- 172.21.15.59:0/2731899418 shutdown_connections 2024-04-25T09:09:49.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.451+0000 7f4e6ca00640 1 -- 172.21.15.59:0/2731899418 wait complete. 2024-04-25T09:09:49.457 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:09:49.458 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.611+0000 7fbe59800640 1 Processor -- start 2024-04-25T09:09:49.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe59800640 1 -- start start 2024-04-25T09:09:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe59800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe5415b5a0 0x7fbe540cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe59800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe540ce7f0 con 0x7fbe5415b980 2024-04-25T09:09:49.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe59800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe540cead0 con 0x7fbe540cc440 2024-04-25T09:09:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe59800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540cfcd0 con 0x7fbe5415b5a0 2024-04-25T09:09:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe4be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbe5415b980 0x7fbe540cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46852/0 (socket says 172.21.15.59:46852) 2024-04-25T09:09:49.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe4be00640 1 -- 172.21.15.59:0/4009426 learned_addr learned my addr 172.21.15.59:0/4009426 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe52a00640 1 --2- 172.21.15.59:0/4009426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe5415b5a0 0x7fbe540cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe52000640 1 -- 172.21.15.59:0/4009426 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730798277 0 0) 0x7fbe540ce7f0 con 0x7fbe5415b980 2024-04-25T09:09:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe52000640 1 -- 172.21.15.59:0/4009426 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe38003530 con 0x7fbe5415b980 2024-04-25T09:09:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe52000640 1 -- 172.21.15.59:0/4009426 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441218608 0 0) 0x7fbe540cead0 con 0x7fbe540cc440 2024-04-25T09:09:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe52000640 1 -- 172.21.15.59:0/4009426 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe540ce7f0 con 0x7fbe540cc440 2024-04-25T09:09:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe52a00640 1 -- 172.21.15.59:0/4009426 >> v1:172.21.15.178:6789/0 conn(0x7fbe540cc440 legacy=0x7fbe540d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe52a00640 1 -- 172.21.15.59:0/4009426 >> v1:172.21.15.59:6789/0 conn(0x7fbe5415b980 legacy=0x7fbe540cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.615+0000 7fbe52a00640 1 -- 172.21.15.59:0/4009426 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe540cf960 con 0x7fbe5415b5a0 2024-04-25T09:09:49.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe52a00640 1 --2- 172.21.15.59:0/4009426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe5415b5a0 0x7fbe540cdea0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097f0 tx=0x7fbe4401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c23d05cd6179d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe52000640 1 -- 172.21.15.59:0/4009426 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440aa660 con 0x7fbe5415b5a0 2024-04-25T09:09:49.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe52000640 1 -- 172.21.15.59:0/4009426 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe440af070 con 0x7fbe5415b5a0 2024-04-25T09:09:49.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe52000640 1 -- 172.21.15.59:0/4009426 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440aaa20 con 0x7fbe5415b5a0 2024-04-25T09:09:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe59800640 1 -- 172.21.15.59:0/4009426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe5415b5a0 msgr2=0x7fbe540cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe59800640 1 --2- 172.21.15.59:0/4009426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe5415b5a0 0x7fbe540cdea0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe440097f0 tx=0x7fbe4401c4e0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe59800640 1 -- 172.21.15.59:0/4009426 shutdown_connections 2024-04-25T09:09:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe59800640 1 --2- 172.21.15.59:0/4009426 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe5415b5a0 0x7fbe540cdea0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe59800640 1 -- 172.21.15.59:0/4009426 >> 172.21.15.59:0/4009426 conn(0x7fbe540b3390 msgr2=0x7fbe540b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe59800640 1 -- 172.21.15.59:0/4009426 shutdown_connections 2024-04-25T09:09:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe59800640 1 -- 172.21.15.59:0/4009426 wait complete. 2024-04-25T09:09:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe59800640 1 Processor -- start 2024-04-25T09:09:49.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.619+0000 7fbe59800640 1 -- start start 2024-04-25T09:09:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe59800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe540cc440 0x7fbe5415c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe59800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe5415b5a0 0x7fbe54162b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe59800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe5415b980 0x7fbe5414ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe59800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540d1490 con 0x7fbe540cc440 2024-04-25T09:09:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe59800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe540d1310 con 0x7fbe5415b980 2024-04-25T09:09:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe59800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe54169750 con 0x7fbe5415b5a0 2024-04-25T09:09:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe52a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe540cc440 0x7fbe5415c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe52a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe540cc440 0x7fbe5415c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36294/0 (socket says 172.21.15.59:36294) 2024-04-25T09:09:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe52a00640 1 -- 172.21.15.59:0/2390871936 learned_addr learned my addr 172.21.15.59:0/2390871936 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe4be00640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe5415b5a0 0x7fbe54162b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe53400640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe5415b980 0x7fbe5414ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe52a00640 1 -- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe5415b5a0 msgr2=0x7fbe54162b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe52a00640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe5415b5a0 0x7fbe54162b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe52a00640 1 -- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe5415b980 msgr2=0x7fbe5414ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe52a00640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe5415b980 0x7fbe5414ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe52a00640 1 -- 172.21.15.59:0/2390871936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5415d760 con 0x7fbe540cc440 2024-04-25T09:09:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe53400640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe5415b980 0x7fbe5414ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe4be00640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe5415b5a0 0x7fbe54162b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe52a00640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe540cc440 0x7fbe5415c800 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009740 tx=0x7fbe4401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe4aa00640 1 -- 172.21.15.59:0/2390871936 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe44006e20 con 0x7fbe540cc440 2024-04-25T09:09:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe4aa00640 1 -- 172.21.15.59:0/2390871936 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe440b4810 con 0x7fbe540cc440 2024-04-25T09:09:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe4aa00640 1 -- 172.21.15.59:0/2390871936 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe440b4c00 con 0x7fbe540cc440 2024-04-25T09:09:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe59800640 1 -- 172.21.15.59:0/2390871936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5415cec0 con 0x7fbe540cc440 2024-04-25T09:09:49.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe59800640 1 -- 172.21.15.59:0/2390871936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5415d480 con 0x7fbe540cc440 2024-04-25T09:09:49.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.623+0000 7fbe59800640 1 -- 172.21.15.59:0/2390871936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe540b1110 con 0x7fbe540cc440 2024-04-25T09:09:49.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.627+0000 7fbe4aa00640 1 -- 172.21.15.59:0/2390871936 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbe440bc020 con 0x7fbe540cc440 2024-04-25T09:09:49.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.627+0000 7fbe4aa00640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe30066f60 0x7fbe30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.627+0000 7fbe4aa00640 1 -- 172.21.15.59:0/2390871936 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fbe4411fba0 con 0x7fbe540cc440 2024-04-25T09:09:49.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.627+0000 7fbe4be00640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe30066f60 0x7fbe30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.627+0000 7fbe4be00640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe30066f60 0x7fbe30069420 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbe5415e9b0 tx=0x7fbe3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.631+0000 7fbe4aa00640 1 -- 172.21.15.59:0/2390871936 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbe440160d0 con 0x7fbe540cc440 2024-04-25T09:09:49.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 -- 172.21.15.59:0/2390871936 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe540745d0 con 0x7fbe540cc440 2024-04-25T09:09:49.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe4aa00640 1 -- 172.21.15.59:0/2390871936 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fbe440f0210 con 0x7fbe540cc440 2024-04-25T09:09:49.816 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:49.816 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:09:15.158723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7965":{"gid":7965,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1467736863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1467736863},{"type":"v1","addr":"172.21.15.59:6835","nonce":1467736863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:09:49.816 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 78 2024-04-25T09:09:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 -- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe30066f60 msgr2=0x7fbe30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe30066f60 0x7fbe30069420 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbe5415e9b0 tx=0x7fbe3c009040 comp rx=0 tx=0).stop 2024-04-25T09:09:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 -- 172.21.15.59:0/2390871936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe540cc440 msgr2=0x7fbe5415c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe540cc440 0x7fbe5415c800 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fbe44009740 tx=0x7fbe4401ad20 comp rx=0 tx=0).stop 2024-04-25T09:09:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 -- 172.21.15.59:0/2390871936 shutdown_connections 2024-04-25T09:09:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe30066f60 0x7fbe30069420 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe5415b980 0x7fbe5414ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe5415b5a0 0x7fbe54162b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 --2- 172.21.15.59:0/2390871936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe540cc440 0x7fbe5415c800 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 -- 172.21.15.59:0/2390871936 >> 172.21.15.59:0/2390871936 conn(0x7fbe540b3390 msgr2=0x7fbe540b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 -- 172.21.15.59:0/2390871936 shutdown_connections 2024-04-25T09:09:49.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.827+0000 7fbe59800640 1 -- 172.21.15.59:0/2390871936 wait complete. 2024-04-25T09:09:49.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-25T09:09:49.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.991+0000 7f9b40000640 1 Processor -- start 2024-04-25T09:09:49.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.991+0000 7f9b40000640 1 -- start start 2024-04-25T09:09:49.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.991+0000 7f9b40000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b38159320 0x7f9b3815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.991+0000 7f9b40000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3815f440 0x7f9b3806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.991+0000 7f9b40000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3815fc00 con 0x7f9b3806e010 2024-04-25T09:09:49.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.991+0000 7f9b40000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3806d640 con 0x7f9b38159320 2024-04-25T09:09:49.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.991+0000 7f9b40000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3815fee0 con 0x7f9b3815f440 2024-04-25T09:09:49.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.995+0000 7f9b3d600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b38159320 0x7f9b3815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.995+0000 7f9b3cc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3815f440 0x7f9b3806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.995+0000 7f9b3d600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9b38159320 0x7f9b3815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:55148/0 (socket says 172.21.15.59:55148) 2024-04-25T09:09:49.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.995+0000 7f9b3d600640 1 -- 172.21.15.59:0/3243573800 learned_addr learned my addr 172.21.15.59:0/3243573800 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:49.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.995+0000 7f9b3d600640 1 -- 172.21.15.59:0/3243573800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3815f440 msgr2=0x7f9b3806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:49.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.995+0000 7f9b3d600640 1 --2- 172.21.15.59:0/3243573800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3815f440 0x7f9b3806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.995+0000 7f9b3d600640 1 -- 172.21.15.59:0/3243573800 >> v1:172.21.15.178:6789/0 conn(0x7f9b3806e010 legacy=0x7f9b3806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.995+0000 7f9b3d600640 1 -- 172.21.15.59:0/3243573800 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b381601c0 con 0x7f9b38159320 2024-04-25T09:09:49.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.995+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/3243573800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3815f440 0x7f9b3806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:49.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.995+0000 7f9b37e00640 1 -- 172.21.15.59:0/3243573800 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036751385 0 0) 0x7f9b3815fc00 con 0x7f9b3806e010 2024-04-25T09:09:49.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.995+0000 7f9b3d600640 1 --2- 172.21.15.59:0/3243573800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b38159320 0x7f9b3815c9b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009870 tx=0x7f9b2c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d433b38fcbdfb34 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b37e00640 1 -- 172.21.15.59:0/3243573800 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0aa620 con 0x7f9b38159320 2024-04-25T09:09:49.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b37e00640 1 -- 172.21.15.59:0/3243573800 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2c0af070 con 0x7f9b38159320 2024-04-25T09:09:49.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b37e00640 1 -- 172.21.15.59:0/3243573800 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0aa9e0 con 0x7f9b38159320 2024-04-25T09:09:49.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b40000640 1 -- 172.21.15.59:0/3243573800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b38159320 msgr2=0x7f9b3815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b40000640 1 --2- 172.21.15.59:0/3243573800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b38159320 0x7f9b3815c9b0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c009870 tx=0x7f9b2c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b40000640 1 -- 172.21.15.59:0/3243573800 shutdown_connections 2024-04-25T09:09:49.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b40000640 1 --2- 172.21.15.59:0/3243573800 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3815f440 0x7f9b3806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b40000640 1 --2- 172.21.15.59:0/3243573800 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b38159320 0x7f9b3815c9b0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b40000640 1 -- 172.21.15.59:0/3243573800 >> 172.21.15.59:0/3243573800 conn(0x7f9b38067080 msgr2=0x7f9b3806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:49.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b40000640 1 -- 172.21.15.59:0/3243573800 shutdown_connections 2024-04-25T09:09:49.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b40000640 1 -- 172.21.15.59:0/3243573800 wait complete. 2024-04-25T09:09:49.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b40000640 1 Processor -- start 2024-04-25T09:09:49.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:49.999+0000 7f9b40000640 1 -- start start 2024-04-25T09:09:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b40000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3806e010 0x7f9b3812cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b40000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b38159320 0x7f9b3813c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b40000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b3815f440 0x7f9b381f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b40000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3815f9a0 con 0x7f9b38159320 2024-04-25T09:09:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b40000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3815f820 con 0x7f9b3815f440 2024-04-25T09:09:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b40000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3806ebb0 con 0x7f9b3806e010 2024-04-25T09:09:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b3cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b38159320 0x7f9b3813c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b3cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b38159320 0x7f9b3813c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36302/0 (socket says 172.21.15.59:36302) 2024-04-25T09:09:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b3cc00640 1 -- 172.21.15.59:0/3653208176 learned_addr learned my addr 172.21.15.59:0/3653208176 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b3d600640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3806e010 0x7f9b3812cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b3e000640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b3815f440 0x7f9b381f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b3cc00640 1 -- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3806e010 msgr2=0x7f9b3812cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3806e010 0x7f9b3812cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b3cc00640 1 -- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b3815f440 msgr2=0x7f9b381f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:49.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b3815f440 0x7f9b381f68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:49.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b3cc00640 1 -- 172.21.15.59:0/3653208176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b381599e0 con 0x7f9b38159320 2024-04-25T09:09:49.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b38159320 0x7f9b3813c220 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400ebe0 tx=0x7f9b2400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b35600640 1 -- 172.21.15.59:0/3653208176 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24017070 con 0x7f9b38159320 2024-04-25T09:09:49.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b35600640 1 -- 172.21.15.59:0/3653208176 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2400cc30 con 0x7f9b38159320 2024-04-25T09:09:49.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b35600640 1 -- 172.21.15.59:0/3653208176 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24013470 con 0x7f9b38159320 2024-04-25T09:09:49.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b40000640 1 -- 172.21.15.59:0/3653208176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3813a620 con 0x7f9b38159320 2024-04-25T09:09:49.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.003+0000 7f9b40000640 1 -- 172.21.15.59:0/3653208176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b3813abe0 con 0x7f9b38159320 2024-04-25T09:09:49.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b35600640 1 -- 172.21.15.59:0/3653208176 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9b2401a070 con 0x7f9b38159320 2024-04-25T09:09:49.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b35600640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9b18066f60 0x7f9b18069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b35600640 1 -- 172.21.15.59:0/3653208176 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f9b24085230 con 0x7f9b38159320 2024-04-25T09:09:49.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b4344e000 1 Processor -- start 2024-04-25T09:09:49.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b3d600640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9b18066f60 0x7f9b18069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:49.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b4344e000 1 -- start start 2024-04-25T09:09:49.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b3d600640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9b18066f60 0x7f9b18069420 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0ae000 tx=0x7f9b2c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:49.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b4344e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x56083834b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b4344e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834bc00 0x5608383013a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b4344e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5608383018e0 0x560838301cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:49.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b4344e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608381e8ba0 con 0x56083834bc00 2024-04-25T09:09:49.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b4344e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56083814e090 con 0x56083834b2e0 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.007+0000 7f9b4344e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5608380d6160 con 0x5608383018e0 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834bc00 0x5608383013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834bc00 0x5608383013a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36316/0 (socket says 172.21.15.59:36316) 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3cc00640 1 -- 172.21.15.59:0/3622720414 learned_addr learned my addr 172.21.15.59:0/3622720414 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3d600640 1 --2- 172.21.15.59:0/3622720414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x56083834b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3e000640 1 --2- 172.21.15.59:0/3622720414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5608383018e0 0x560838301cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3cc00640 1 -- 172.21.15.59:0/3622720414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5608383018e0 msgr2=0x560838301cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/3622720414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5608383018e0 0x560838301cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3cc00640 1 -- 172.21.15.59:0/3622720414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 msgr2=0x56083834b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/3622720414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x56083834b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3cc00640 1 -- 172.21.15.59:0/3622720414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5608381f7c20 con 0x56083834bc00 2024-04-25T09:09:50.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3d600640 1 --2- 172.21.15.59:0/3622720414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x56083834b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:50.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3e000640 1 --2- 172.21.15.59:0/3622720414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5608383018e0 0x560838301cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:50.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/3622720414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834bc00 0x5608383013a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9b2405d9d0 tx=0x7f9b240558a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7160581892efbd1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b2a000640 1 -- 172.21.15.59:0/3622720414 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24021040 con 0x56083834bc00 2024-04-25T09:09:50.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b2a000640 1 -- 172.21.15.59:0/3622720414 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2405df00 con 0x56083834bc00 2024-04-25T09:09:50.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b2a000640 1 -- 172.21.15.59:0/3622720414 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24051f10 con 0x56083834bc00 2024-04-25T09:09:50.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 -- 172.21.15.59:0/3622720414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834bc00 msgr2=0x5608383013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 --2- 172.21.15.59:0/3622720414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834bc00 0x5608383013a0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f9b2405d9d0 tx=0x7f9b240558a0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 -- 172.21.15.59:0/3622720414 shutdown_connections 2024-04-25T09:09:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 --2- 172.21.15.59:0/3622720414 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5608383018e0 0x560838301cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 --2- 172.21.15.59:0/3622720414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834bc00 0x5608383013a0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 --2- 172.21.15.59:0/3622720414 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x56083834b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 -- 172.21.15.59:0/3622720414 >> 172.21.15.59:0/3622720414 conn(0x5608382fd890 msgr2=0x5608382ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 -- 172.21.15.59:0/3622720414 shutdown_connections 2024-04-25T09:09:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 -- 172.21.15.59:0/3622720414 wait complete. 2024-04-25T09:09:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 -- start start 2024-04-25T09:09:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 Processor -- start 2024-04-25T09:09:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 0x560838352640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x560838352b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x560838339090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56083814a130 con 0x5608383018e0 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560838112130 con 0x56083834b2e0 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56083820c300 con 0x56083834bc00 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b4344e000 10 client.0 _ll_register_callbacks cb 0x5608382ecbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.011+0000 7f9b3d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 0x560838352640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b3d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 0x560838352640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36330/0 (socket says 172.21.15.59:36330) 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b3d600640 1 -- 172.21.15.59:0/2810872126 learned_addr learned my addr 172.21.15.59:0/2810872126 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b3e000640 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x560838339090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x560838352b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b3d600640 1 -- 172.21.15.59:0/2810872126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 msgr2=0x560838339090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b3d600640 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x560838339090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b3d600640 1 -- 172.21.15.59:0/2810872126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 msgr2=0x560838352b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b3d600640 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x560838352b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b3d600640 1 -- 172.21.15.59:0/2810872126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56083812b060 con 0x5608383018e0 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b3d600640 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 0x560838352640 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c01cd40 tx=0x7f9b2c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8345504dea233118 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b1ea00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b1ea00640 1 -- 172.21.15.59:0/2810872126 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c003d70 con 0x5608383018e0 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b1ea00640 1 -- 172.21.15.59:0/2810872126 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f9b2c0cbda0 con 0x5608383018e0 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 -- 172.21.15.59:0/2810872126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b2405df00 con 0x5608383018e0 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b1ea00640 1 -- 172.21.15.59:0/2810872126 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b2c0d2050 con 0x5608383018e0 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 10 client.8121 fetch_fsmap learned FSMap version 78 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 -- 172.21.15.59:0/2810872126 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x5608380ef7c0 con 0x5608383018e0 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b1ea00640 1 -- 172.21.15.59:0/2810872126 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2405df00 con 0x5608383018e0 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b1ea00640 1 -- 172.21.15.59:0/2810872126 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9b2c0d5020 con 0x5608383018e0 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 10 client.8121 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 10 client.8121 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 20 client.8121 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:50.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x560838339e30 0x56083833a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 4 client.8121 mds_command: new command op to 7965 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 -- 172.21.15.59:0/2810872126 --> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5608380e9cd0 con 0x560838339e30 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x560838339e30 0x56083833a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x560838339e30 0x56083833a210 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d79b4d244b6167b3 server_cookie=b2a54d26ba4606b6 in_seq=0 out_seq=0 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b1ea00640 10 client.8121 ms_handle_connect on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b1ea00640 1 -- 172.21.15.59:0/2810872126 <== mds.0 v2:172.21.15.59:6833/1467736863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5608380e9cd0 con 0x560838339e30 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b1ea00640 10 client.8121 handle_command_reply: tid=0 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 client.8121 shutdown 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 -- 172.21.15.59:0/2810872126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 msgr2=0x560838352640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 0x560838352640 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c01cd40 tx=0x7f9b2c01ace0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 -- 172.21.15.59:0/2810872126 shutdown_connections 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x560838339e30 0x56083833a210 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x560838339090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x560838352b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 --2- 172.21.15.59:0/2810872126 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 0x560838352640 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b1ea00640 0 client.8121 ms_handle_reset on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:50.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 -- 172.21.15.59:0/2810872126 >> 172.21.15.59:0/2810872126 conn(0x5608382fd890 msgr2=0x560838300510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 -- 172.21.15.59:0/2810872126 shutdown_connections 2024-04-25T09:09:50.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 1 -- 172.21.15.59:0/2810872126 wait complete. 2024-04-25T09:09:50.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.015+0000 7f9b4344e000 20 client.8121 trim_cache size 0 max 16384 2024-04-25T09:09:50.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.027+0000 7f9b4344e000 1 Processor -- start 2024-04-25T09:09:50.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.027+0000 7f9b4344e000 1 -- start start 2024-04-25T09:09:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608383018e0 0x5608383a7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834b2e0 0x5608383a7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x5608383a7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b382024a0 con 0x56083834b2e0 2024-04-25T09:09:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38140f70 con 0x5608383018e0 2024-04-25T09:09:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b382020c0 con 0x56083834bc00 2024-04-25T09:09:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b3cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834b2e0 0x5608383a7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b3cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834b2e0 0x5608383a7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36336/0 (socket says 172.21.15.59:36336) 2024-04-25T09:09:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b3cc00640 1 -- 172.21.15.59:0/4209537093 learned_addr learned my addr 172.21.15.59:0/4209537093 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b3d600640 1 --2- 172.21.15.59:0/4209537093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608383018e0 0x5608383a7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b3e000640 1 --2- 172.21.15.59:0/4209537093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x5608383a7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b3cc00640 1 -- 172.21.15.59:0/4209537093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 msgr2=0x5608383a7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/4209537093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x5608383a7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b3cc00640 1 -- 172.21.15.59:0/4209537093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608383018e0 msgr2=0x5608383a7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/4209537093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608383018e0 0x5608383a7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b3cc00640 1 -- 172.21.15.59:0/4209537093 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560838109fc0 con 0x56083834b2e0 2024-04-25T09:09:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b3e000640 1 --2- 172.21.15.59:0/4209537093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x5608383a7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/4209537093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834b2e0 0x5608383a7a40 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400ebb0 tx=0x7f9b24085000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4aa92fb829ec87 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b29600640 1 -- 172.21.15.59:0/4209537093 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24021040 con 0x56083834b2e0 2024-04-25T09:09:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b29600640 1 -- 172.21.15.59:0/4209537093 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b24053c60 con 0x56083834b2e0 2024-04-25T09:09:50.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b29600640 1 -- 172.21.15.59:0/4209537093 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24054cf0 con 0x56083834b2e0 2024-04-25T09:09:50.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 -- 172.21.15.59:0/4209537093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834b2e0 msgr2=0x5608383a7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 --2- 172.21.15.59:0/4209537093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834b2e0 0x5608383a7a40 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400ebb0 tx=0x7f9b24085000 comp rx=0 tx=0).stop 2024-04-25T09:09:50.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 -- 172.21.15.59:0/4209537093 shutdown_connections 2024-04-25T09:09:50.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 --2- 172.21.15.59:0/4209537093 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x5608383a7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 --2- 172.21.15.59:0/4209537093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56083834b2e0 0x5608383a7a40 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 --2- 172.21.15.59:0/4209537093 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5608383018e0 0x5608383a7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 -- 172.21.15.59:0/4209537093 >> 172.21.15.59:0/4209537093 conn(0x5608382fd890 msgr2=0x56083834a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 -- 172.21.15.59:0/4209537093 shutdown_connections 2024-04-25T09:09:50.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 -- 172.21.15.59:0/4209537093 wait complete. 2024-04-25T09:09:50.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 -- start start 2024-04-25T09:09:50.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.031+0000 7f9b4344e000 1 Processor -- start 2024-04-25T09:09:50.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 0x5608383ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x5608383aba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x56083834f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608380e8e70 con 0x5608383018e0 2024-04-25T09:09:50.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5608380d6a50 con 0x56083834b2e0 2024-04-25T09:09:50.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56083814d3a0 con 0x56083834bc00 2024-04-25T09:09:50.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 10 client.0 _ll_register_callbacks cb 0x5608380fa240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:09:50.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 0x5608383ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3d600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 0x5608383ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36352/0 (socket says 172.21.15.59:36352) 2024-04-25T09:09:50.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3d600640 1 -- 172.21.15.59:0/479666152 learned_addr learned my addr 172.21.15.59:0/479666152 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:50.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x5608383aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3e000640 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x56083834f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3d600640 1 -- 172.21.15.59:0/479666152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 msgr2=0x56083834f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3d600640 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x56083834f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3d600640 1 -- 172.21.15.59:0/479666152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 msgr2=0x5608383aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3d600640 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x5608383aba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3d600640 1 -- 172.21.15.59:0/479666152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5608381a79e0 con 0x5608383018e0 2024-04-25T09:09:50.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x5608383aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:50.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3d600640 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 0x5608383ab510 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c01ca10 tx=0x7f9b2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f1dc35c99ab3a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b1ea00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:09:50.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b1ea00640 1 -- 172.21.15.59:0/479666152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c0ca9c0 con 0x5608383018e0 2024-04-25T09:09:50.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b1ea00640 1 -- 172.21.15.59:0/479666152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f9b2c0cab60 con 0x5608383018e0 2024-04-25T09:09:50.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 -- 172.21.15.59:0/479666152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56083815b5d0 con 0x5608383018e0 2024-04-25T09:09:50.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b1ea00640 1 -- 172.21.15.59:0/479666152 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b2c0cad60 con 0x5608383018e0 2024-04-25T09:09:50.030 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 10 client.8127 fetch_fsmap learned FSMap version 78 2024-04-25T09:09:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 -- 172.21.15.59:0/479666152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x5608380ed630 con 0x5608383018e0 2024-04-25T09:09:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b1ea00640 1 -- 172.21.15.59:0/479666152 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56083815b5d0 con 0x5608383018e0 2024-04-25T09:09:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b1ea00640 1 -- 172.21.15.59:0/479666152 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 78) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9b2c0d5040 con 0x5608383018e0 2024-04-25T09:09:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 10 client.8127 fetch_fsmap finished waiting for FSMap version 78 2024-04-25T09:09:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 10 client.8127 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:09:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 20 client.8127 populate_metadata read hostname 'smithi059' 2024-04-25T09:09:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x5608383b2370 0x5608383b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 4 client.8127 mds_command: new command op to 7965 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-25T09:09:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 -- 172.21.15.59:0/479666152 --> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x560838155920 con 0x5608383b2370 2024-04-25T09:09:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x5608383b2370 0x5608383b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b3cc00640 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x5608383b2370 0x5608383b4760 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fc6f7e7805f81aa server_cookie=ceb0a0df216401f6 in_seq=0 out_seq=0 2024-04-25T09:09:50.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b1ea00640 10 client.8127 ms_handle_connect on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b1ea00640 1 -- 172.21.15.59:0/479666152 <== mds.0 v2:172.21.15.59:6833/1467736863 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560838155920 con 0x5608383b2370 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b1ea00640 10 client.8127 handle_command_reply: tid=0 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 client.8127 shutdown 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 -- 172.21.15.59:0/479666152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 msgr2=0x5608383ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 0x5608383ab510 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c01ca10 tx=0x7f9b2c008040 comp rx=0 tx=0).stop 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 -- 172.21.15.59:0/479666152 shutdown_connections 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.59:6833/1467736863,v1:172.21.15.59:6835/1467736863] conn(0x5608383b2370 0x5608383b4760 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56083834bc00 0x56083834f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56083834b2e0 0x5608383aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b1ea00640 0 client.8127 ms_handle_reset on v2:172.21.15.59:6833/1467736863 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 --2- 172.21.15.59:0/479666152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5608383018e0 0x5608383ab510 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 -- 172.21.15.59:0/479666152 >> 172.21.15.59:0/479666152 conn(0x5608382fd890 msgr2=0x56083834ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 -- 172.21.15.59:0/479666152 shutdown_connections 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 1 -- 172.21.15.59:0/479666152 wait complete. 2024-04-25T09:09:50.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.035+0000 7f9b4344e000 20 client.8127 trim_cache size 0 max 16384 2024-04-25T09:09:50.033 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:50.033 INFO:teuthology.orchestra.run.smithi059.stdout:[] 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.039+0000 7f9b40000640 1 -- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9b18066f60 msgr2=0x7f9b18069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.039+0000 7f9b40000640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9b18066f60 0x7f9b18069420 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0ae000 tx=0x7f9b2c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.039+0000 7f9b40000640 1 -- 172.21.15.59:0/3653208176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b38159320 msgr2=0x7f9b3813c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.039+0000 7f9b40000640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b38159320 0x7f9b3813c220 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f9b2400ebe0 tx=0x7f9b2400c520 comp rx=0 tx=0).stop 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.039+0000 7f9b40000640 1 -- 172.21.15.59:0/3653208176 shutdown_connections 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.039+0000 7f9b40000640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9b18066f60 0x7f9b18069420 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.039+0000 7f9b40000640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9b3815f440 0x7f9b381f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.039+0000 7f9b40000640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b38159320 0x7f9b3813c220 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.039+0000 7f9b40000640 1 --2- 172.21.15.59:0/3653208176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9b3806e010 0x7f9b3812cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.039+0000 7f9b40000640 1 -- 172.21.15.59:0/3653208176 >> 172.21.15.59:0/3653208176 conn(0x7f9b38067080 msgr2=0x7f9b381439c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.039+0000 7f9b40000640 1 -- 172.21.15.59:0/3653208176 shutdown_connections 2024-04-25T09:09:50.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.039+0000 7f9b40000640 1 -- 172.21.15.59:0/3653208176 wait complete. 2024-04-25T09:09:50.045 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T09:09:50.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca1ce00640 1 Processor -- start 2024-04-25T09:09:50.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca1ce00640 1 -- start start 2024-04-25T09:09:50.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca1ce00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fca18144140 0x7fca180ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca1ce00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca180ced60 0x7fca1806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca1ce00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1815ac60 con 0x7fca1806e900 2024-04-25T09:09:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca1ce00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1806ed30 con 0x7fca180ced60 2024-04-25T09:09:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca1ce00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca180cf3e0 con 0x7fca18144140 2024-04-25T09:09:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca0d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca180ced60 0x7fca1806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca0d400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fca180ced60 0x7fca1806e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36360/0 (socket says 172.21.15.59:36360) 2024-04-25T09:09:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca16800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fca1806e900 0x7fca1815e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:46866/0 (socket says 172.21.15.59:46866) 2024-04-25T09:09:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca0d400640 1 -- 172.21.15.59:0/2242928035 learned_addr learned my addr 172.21.15.59:0/2242928035 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:50.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca15e00640 1 --2- 172.21.15.59:0/2242928035 >> v2:172.21.15.178:3300/0 conn(0x7fca18144140 0x7fca180ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca0d400640 1 -- 172.21.15.59:0/2242928035 >> v2:172.21.15.178:3300/0 conn(0x7fca18144140 msgr2=0x7fca180ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca0d400640 1 --2- 172.21.15.59:0/2242928035 >> v2:172.21.15.178:3300/0 conn(0x7fca18144140 0x7fca180ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca0d400640 1 -- 172.21.15.59:0/2242928035 >> v1:172.21.15.59:6789/0 conn(0x7fca1806e900 legacy=0x7fca1815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.195+0000 7fca0d400640 1 -- 172.21.15.59:0/2242928035 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1815af20 con 0x7fca180ced60 2024-04-25T09:09:50.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.199+0000 7fca0d400640 1 --2- 172.21.15.59:0/2242928035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca180ced60 0x7fca1806e3c0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fca1806eef0 tx=0x7fca0001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d89fedf6751d41f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.199+0000 7fca15400640 1 -- 172.21.15.59:0/2242928035 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000b0070 con 0x7fca180ced60 2024-04-25T09:09:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.199+0000 7fca15400640 1 -- 172.21.15.59:0/2242928035 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca000ab600 con 0x7fca180ced60 2024-04-25T09:09:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.199+0000 7fca15400640 1 -- 172.21.15.59:0/2242928035 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000ab9d0 con 0x7fca180ced60 2024-04-25T09:09:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.199+0000 7fca1ce00640 1 -- 172.21.15.59:0/2242928035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca180ced60 msgr2=0x7fca1806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.199+0000 7fca1ce00640 1 --2- 172.21.15.59:0/2242928035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca180ced60 0x7fca1806e3c0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fca1806eef0 tx=0x7fca0001c520 comp rx=0 tx=0).stop 2024-04-25T09:09:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.199+0000 7fca1ce00640 1 -- 172.21.15.59:0/2242928035 shutdown_connections 2024-04-25T09:09:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.199+0000 7fca1ce00640 1 --2- 172.21.15.59:0/2242928035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca180ced60 0x7fca1806e3c0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.199+0000 7fca1ce00640 1 --2- 172.21.15.59:0/2242928035 >> v2:172.21.15.178:3300/0 conn(0x7fca18144140 0x7fca180ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.199+0000 7fca1ce00640 1 -- 172.21.15.59:0/2242928035 >> 172.21.15.59:0/2242928035 conn(0x7fca18066fa0 msgr2=0x7fca1806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.199+0000 7fca1ce00640 1 -- 172.21.15.59:0/2242928035 shutdown_connections 2024-04-25T09:09:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.199+0000 7fca1ce00640 1 -- 172.21.15.59:0/2242928035 wait complete. 2024-04-25T09:09:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca1ce00640 1 Processor -- start 2024-04-25T09:09:50.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca1ce00640 1 -- start start 2024-04-25T09:09:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca1ce00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca1806e900 0x7fca1813a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca1ce00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca180ced60 0x7fca18142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca1ce00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca18144140 0x7fca18159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca1ce00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca1815ba00 con 0x7fca18144140 2024-04-25T09:09:50.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca1ce00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca18144520 con 0x7fca1806e900 2024-04-25T09:09:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca1ce00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca1815bb80 con 0x7fca180ced60 2024-04-25T09:09:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca16800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca18144140 0x7fca18159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca16800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca18144140 0x7fca18159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36364/0 (socket says 172.21.15.59:36364) 2024-04-25T09:09:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca16800640 1 -- 172.21.15.59:0/2699839018 learned_addr learned my addr 172.21.15.59:0/2699839018 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca15e00640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca1806e900 0x7fca1813a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca0d400640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca180ced60 0x7fca18142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca16800640 1 -- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca180ced60 msgr2=0x7fca18142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca16800640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca180ced60 0x7fca18142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca16800640 1 -- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca1806e900 msgr2=0x7fca1813a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca16800640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca1806e900 0x7fca1813a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca16800640 1 -- 172.21.15.59:0/2699839018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca181433f0 con 0x7fca18144140 2024-04-25T09:09:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca15e00640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca1806e900 0x7fca1813a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca16800640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca18144140 0x7fca18159730 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c7a0 tx=0x7fca1000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca0ea00640 1 -- 172.21.15.59:0/2699839018 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10017070 con 0x7fca18144140 2024-04-25T09:09:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca0ea00640 1 -- 172.21.15.59:0/2699839018 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1000a640 con 0x7fca18144140 2024-04-25T09:09:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca1ce00640 1 -- 172.21.15.59:0/2699839018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca181436d0 con 0x7fca18144140 2024-04-25T09:09:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca0ea00640 1 -- 172.21.15.59:0/2699839018 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1000a9f0 con 0x7fca18144140 2024-04-25T09:09:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.203+0000 7fca1ce00640 1 -- 172.21.15.59:0/2699839018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca18167c10 con 0x7fca18144140 2024-04-25T09:09:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.207+0000 7fca1ce00640 1 -- 172.21.15.59:0/2699839018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca180745d0 con 0x7fca18144140 2024-04-25T09:09:50.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.207+0000 7fca0ea00640 1 -- 172.21.15.59:0/2699839018 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fca1001a070 con 0x7fca18144140 2024-04-25T09:09:50.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.207+0000 7fca0ea00640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc9f4066f60 0x7fc9f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.207+0000 7fca0ea00640 1 -- 172.21.15.59:0/2699839018 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fca100848a0 con 0x7fca18144140 2024-04-25T09:09:50.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.207+0000 7fca15e00640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc9f4066f60 0x7fc9f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.207+0000 7fca15e00640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc9f4066f60 0x7fc9f4069420 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fca08009eb0 tx=0x7fca08009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.211+0000 7fca0ea00640 1 -- 172.21.15.59:0/2699839018 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fca10054fa0 con 0x7fca18144140 2024-04-25T09:09:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.407+0000 7fca1ce00640 1 -- 172.21.15.59:0/2699839018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fca180cd370 con 0x7fca18144140 2024-04-25T09:09:50.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.407+0000 7fca0ea00640 1 -- 172.21.15.59:0/2699839018 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fca10059040 con 0x7fca18144140 2024-04-25T09:09:50.398 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:50.398 INFO:teuthology.orchestra.run.smithi059.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T09:09:50.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.411+0000 7fca1ce00640 1 -- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc9f4066f60 msgr2=0x7fc9f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.411+0000 7fca1ce00640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc9f4066f60 0x7fc9f4069420 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fca08009eb0 tx=0x7fca08009190 comp rx=0 tx=0).stop 2024-04-25T09:09:50.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.411+0000 7fca1ce00640 1 -- 172.21.15.59:0/2699839018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca18144140 msgr2=0x7fca18159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.411+0000 7fca1ce00640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca18144140 0x7fca18159730 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fca1000c7a0 tx=0x7fca1000cc60 comp rx=0 tx=0).stop 2024-04-25T09:09:50.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.411+0000 7fca1ce00640 1 -- 172.21.15.59:0/2699839018 shutdown_connections 2024-04-25T09:09:50.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.411+0000 7fca1ce00640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc9f4066f60 0x7fc9f4069420 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.411+0000 7fca1ce00640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca18144140 0x7fca18159730 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.411+0000 7fca1ce00640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fca180ced60 0x7fca18142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.411+0000 7fca1ce00640 1 --2- 172.21.15.59:0/2699839018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fca1806e900 0x7fca1813a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.411+0000 7fca1ce00640 1 -- 172.21.15.59:0/2699839018 >> 172.21.15.59:0/2699839018 conn(0x7fca18066fa0 msgr2=0x7fca180b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.411+0000 7fca1ce00640 1 -- 172.21.15.59:0/2699839018 shutdown_connections 2024-04-25T09:09:50.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.411+0000 7fca1ce00640 1 -- 172.21.15.59:0/2699839018 wait complete. 2024-04-25T09:09:50.419 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-25T09:09:50.419 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:09:50.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:09:50.532 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:09:50.647 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:09:50.647 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:09:50.647 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:50.656 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:09:50.656 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:50.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.903+0000 7f5aa4000640 1 Processor -- start 2024-04-25T09:09:50.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.903+0000 7f5aa4000640 1 -- start start 2024-04-25T09:09:50.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa4000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a9c0cef30 0x7f5a9c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa4000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f5a9c06e900 0x7f5a9c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa4000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a9c15ac60 con 0x7f5a9c144140 2024-04-25T09:09:50.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa4000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c06ed50 con 0x7f5a9c0cef30 2024-04-25T09:09:50.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa4000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a9c0cf3e0 con 0x7f5a9c06e900 2024-04-25T09:09:50.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa0c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a9c0cef30 0x7f5a9c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa1600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5a9c144140 0x7f5a9c0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38458/0 (socket says 172.21.15.59:38458) 2024-04-25T09:09:50.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa0c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a9c0cef30 0x7f5a9c06e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40134/0 (socket says 172.21.15.59:40134) 2024-04-25T09:09:50.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa1600640 1 -- 172.21.15.59:0/3383414094 learned_addr learned my addr 172.21.15.59:0/3383414094 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa2000640 1 --2- 172.21.15.59:0/3383414094 >> v2:172.21.15.178:3300/0 conn(0x7f5a9c06e900 0x7f5a9c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa0c00640 1 -- 172.21.15.59:0/3383414094 >> v2:172.21.15.178:3300/0 conn(0x7f5a9c06e900 msgr2=0x7f5a9c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa0c00640 1 --2- 172.21.15.59:0/3383414094 >> v2:172.21.15.178:3300/0 conn(0x7f5a9c06e900 0x7f5a9c0b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa0c00640 1 -- 172.21.15.59:0/3383414094 >> v1:172.21.15.59:6789/0 conn(0x7f5a9c144140 legacy=0x7f5a9c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.907+0000 7f5aa0c00640 1 -- 172.21.15.59:0/3383414094 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c15af20 con 0x7f5a9c0cef30 2024-04-25T09:09:50.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa0c00640 1 --2- 172.21.15.59:0/3383414094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a9c0cef30 0x7f5a9c06e3c0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0cddd0 tx=0x7f5a8801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a4cb3f33a4fc42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5a9be00640 1 -- 172.21.15.59:0/3383414094 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a880b0070 con 0x7f5a9c0cef30 2024-04-25T09:09:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5a9be00640 1 -- 172.21.15.59:0/3383414094 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a880ab600 con 0x7f5a9c0cef30 2024-04-25T09:09:50.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5a9be00640 1 -- 172.21.15.59:0/3383414094 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a880ab9d0 con 0x7f5a9c0cef30 2024-04-25T09:09:50.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 -- 172.21.15.59:0/3383414094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a9c0cef30 msgr2=0x7f5a9c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 --2- 172.21.15.59:0/3383414094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a9c0cef30 0x7f5a9c06e3c0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c0cddd0 tx=0x7f5a8801c480 comp rx=0 tx=0).stop 2024-04-25T09:09:50.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 -- 172.21.15.59:0/3383414094 shutdown_connections 2024-04-25T09:09:50.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 --2- 172.21.15.59:0/3383414094 >> v2:172.21.15.178:3300/0 conn(0x7f5a9c06e900 0x7f5a9c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 --2- 172.21.15.59:0/3383414094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a9c0cef30 0x7f5a9c06e3c0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 -- 172.21.15.59:0/3383414094 >> 172.21.15.59:0/3383414094 conn(0x7f5a9c066fa0 msgr2=0x7f5a9c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:50.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 -- 172.21.15.59:0/3383414094 shutdown_connections 2024-04-25T09:09:50.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 -- 172.21.15.59:0/3383414094 wait complete. 2024-04-25T09:09:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 Processor -- start 2024-04-25T09:09:50.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 -- start start 2024-04-25T09:09:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a9c06e900 0x7f5a9c13c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a9c0cef30 0x7f5a9c13ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a9c144140 0x7f5a9c135be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c15ba00 con 0x7f5a9c0cef30 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c144520 con 0x7f5a9c06e900 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa4000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c15bb80 con 0x7f5a9c144140 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a9c0cef30 0x7f5a9c13ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a9c0cef30 0x7f5a9c13ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40144/0 (socket says 172.21.15.59:40144) 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.911+0000 7f5aa0c00640 1 -- 172.21.15.59:0/2801237582 learned_addr learned my addr 172.21.15.59:0/2801237582 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5aa1600640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a9c06e900 0x7f5a9c13c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5aa2000640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a9c144140 0x7f5a9c135be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5aa0c00640 1 -- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a9c144140 msgr2=0x7f5a9c135be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5aa0c00640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a9c144140 0x7f5a9c135be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5aa0c00640 1 -- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a9c06e900 msgr2=0x7f5a9c13c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5aa0c00640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a9c06e900 0x7f5a9c13c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5aa0c00640 1 -- 172.21.15.59:0/2801237582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c13a920 con 0x7f5a9c0cef30 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5aa0c00640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a9c0cef30 0x7f5a9c13ed10 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f5a880ae040 tx=0x7f5a88019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5a99600640 1 -- 172.21.15.59:0/2801237582 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a880b0040 con 0x7f5a9c0cef30 2024-04-25T09:09:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5a99600640 1 -- 172.21.15.59:0/2801237582 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a880b9070 con 0x7f5a9c0cef30 2024-04-25T09:09:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5a99600640 1 -- 172.21.15.59:0/2801237582 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a880b4650 con 0x7f5a9c0cef30 2024-04-25T09:09:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5aa4000640 1 -- 172.21.15.59:0/2801237582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9c152ef0 con 0x7f5a9c0cef30 2024-04-25T09:09:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5aa4000640 1 -- 172.21.15.59:0/2801237582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9c13c9b0 con 0x7f5a9c0cef30 2024-04-25T09:09:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5aa4000640 1 -- 172.21.15.59:0/2801237582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a9c1530c0 con 0x7f5a9c0cef30 2024-04-25T09:09:50.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.915+0000 7f5a99600640 1 -- 172.21.15.59:0/2801237582 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5a880b47f0 con 0x7f5a9c0cef30 2024-04-25T09:09:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.919+0000 7f5a99600640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5a7c066f60 0x7f5a7c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:50.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.919+0000 7f5a99600640 1 -- 172.21.15.59:0/2801237582 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f5a8811f0d0 con 0x7f5a9c0cef30 2024-04-25T09:09:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.919+0000 7f5aa1600640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5a7c066f60 0x7f5a7c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:50.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.919+0000 7f5aa1600640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5a7c066f60 0x7f5a7c069420 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5a90000f70 tx=0x7f5a90009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:50.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:50.923+0000 7f5a99600640 1 -- 172.21.15.59:0/2801237582 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5a88016070 con 0x7f5a9c0cef30 2024-04-25T09:09:51.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.083+0000 7f5aa4000640 1 -- 172.21.15.59:0/2801237582 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a9c0745d0 con 0x7f5a9c0cef30 2024-04-25T09:09:51.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.083+0000 7f5a99600640 1 -- 172.21.15.59:0/2801237582 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+17338 (secure 0 0 0) 0x7f5a880efe20 con 0x7f5a9c0cef30 2024-04-25T09:09:51.074 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:51.074 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":96,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:09:12.143679+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:47.301822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:47.878097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.12","mappings":[{"from":1,"to":5}]},{"pgid":"14.1a","mappings":[{"from":1,"to":2}]},{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.38","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/4079513876":"2024-04-26T09:09:12.143656+0000","172.21.15.59:6833/4079513876":"2024-04-26T09:09:12.143656+0000","172.21.15.59:6835/3531112441":"2024-04-26T09:07:59.742787+0000","172.21.15.59:6833/3531112441":"2024-04-26T09:07:59.742787+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:51.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.087+0000 7f5aa4000640 1 -- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5a7c066f60 msgr2=0x7f5a7c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.087+0000 7f5aa4000640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5a7c066f60 0x7f5a7c069420 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5a90000f70 tx=0x7f5a90009040 comp rx=0 tx=0).stop 2024-04-25T09:09:51.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.087+0000 7f5aa4000640 1 -- 172.21.15.59:0/2801237582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a9c0cef30 msgr2=0x7f5a9c13ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.087+0000 7f5aa4000640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a9c0cef30 0x7f5a9c13ed10 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f5a880ae040 tx=0x7f5a88019220 comp rx=0 tx=0).stop 2024-04-25T09:09:51.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.087+0000 7f5aa4000640 1 -- 172.21.15.59:0/2801237582 shutdown_connections 2024-04-25T09:09:51.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.087+0000 7f5aa4000640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5a7c066f60 0x7f5a7c069420 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.087+0000 7f5aa4000640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5a9c144140 0x7f5a9c135be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.087+0000 7f5aa4000640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a9c0cef30 0x7f5a9c13ed10 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.087+0000 7f5aa4000640 1 --2- 172.21.15.59:0/2801237582 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5a9c06e900 0x7f5a9c13c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.087+0000 7f5aa4000640 1 -- 172.21.15.59:0/2801237582 >> 172.21.15.59:0/2801237582 conn(0x7f5a9c066fa0 msgr2=0x7f5a9c151d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:51.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.087+0000 7f5aa4000640 1 -- 172.21.15.59:0/2801237582 shutdown_connections 2024-04-25T09:09:51.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.087+0000 7f5aa4000640 1 -- 172.21.15.59:0/2801237582 wait complete. 2024-04-25T09:09:51.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:07:47.301822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:07:47.878097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:09:51.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:09:51.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d96200640 1 Processor -- start 2024-04-25T09:09:51.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d96200640 1 -- start start 2024-04-25T09:09:51.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d96200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d9015eb50 0x7f2d9015f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d96200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d90071270 0x7f2d90071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d96200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d9006db20 con 0x7f2d9015e770 2024-04-25T09:09:51.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d96200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d9006de00 con 0x7f2d90071270 2024-04-25T09:09:51.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d96200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9006e0e0 con 0x7f2d9015eb50 2024-04-25T09:09:51.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d87e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d9015eb50 0x7f2d9015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d8fe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d90071270 0x7f2d90071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d87e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d9015eb50 0x7f2d9015f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:60102/0 (socket says 172.21.15.59:60102) 2024-04-25T09:09:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d8fe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2d90071270 0x7f2d90071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:38250/0 (socket says 172.21.15.59:38250) 2024-04-25T09:09:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d87e00640 1 -- 172.21.15.59:0/634210429 learned_addr learned my addr 172.21.15.59:0/634210429 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d8fe00640 1 -- 172.21.15.59:0/634210429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d9015eb50 msgr2=0x7f2d9015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d8fe00640 1 --2- 172.21.15.59:0/634210429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d9015eb50 0x7f2d9015f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d8fe00640 1 -- 172.21.15.59:0/634210429 >> v1:172.21.15.178:6789/0 conn(0x7f2d9015e770 legacy=0x7f2d9006d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.251+0000 7f2d8fe00640 1 -- 172.21.15.59:0/634210429 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d900ae040 con 0x7f2d90071270 2024-04-25T09:09:51.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.255+0000 7f2d8fe00640 1 --2- 172.21.15.59:0/634210429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90071270 0x7f2d90071700 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009d90 tx=0x7f2d8801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c28fc881d13377f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.255+0000 7f2d8ea00640 1 -- 172.21.15.59:0/634210429 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d880b2070 con 0x7f2d90071270 2024-04-25T09:09:51.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.255+0000 7f2d8ea00640 1 -- 172.21.15.59:0/634210429 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d880a58b0 con 0x7f2d90071270 2024-04-25T09:09:51.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.255+0000 7f2d8ea00640 1 -- 172.21.15.59:0/634210429 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d880a5c80 con 0x7f2d90071270 2024-04-25T09:09:51.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.255+0000 7f2d96200640 1 -- 172.21.15.59:0/634210429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90071270 msgr2=0x7f2d90071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.255+0000 7f2d96200640 1 --2- 172.21.15.59:0/634210429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90071270 0x7f2d90071700 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009d90 tx=0x7f2d8801c8e0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.255+0000 7f2d96200640 1 -- 172.21.15.59:0/634210429 shutdown_connections 2024-04-25T09:09:51.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.255+0000 7f2d96200640 1 --2- 172.21.15.59:0/634210429 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90071270 0x7f2d90071700 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.255+0000 7f2d96200640 1 --2- 172.21.15.59:0/634210429 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d9015eb50 0x7f2d9015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.255+0000 7f2d96200640 1 -- 172.21.15.59:0/634210429 >> 172.21.15.59:0/634210429 conn(0x7f2d90067080 msgr2=0x7f2d9006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:51.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.255+0000 7f2d96200640 1 -- 172.21.15.59:0/634210429 shutdown_connections 2024-04-25T09:09:51.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.255+0000 7f2d96200640 1 -- 172.21.15.59:0/634210429 wait complete. 2024-04-25T09:09:51.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d96200640 1 Processor -- start 2024-04-25T09:09:51.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d96200640 1 -- start start 2024-04-25T09:09:51.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d96200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90071270 0x7f2d901520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d96200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d9015e770 0x7f2d9015b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d96200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9015eb50 0x7f2d90149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d96200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900aeef0 con 0x7f2d9015eb50 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d96200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900aed70 con 0x7f2d90071270 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d96200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900af070 con 0x7f2d9015e770 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d8fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9015eb50 0x7f2d90149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d8fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9015eb50 0x7f2d90149710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40154/0 (socket says 172.21.15.59:40154) 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d8fe00640 1 -- 172.21.15.59:0/4269072989 learned_addr learned my addr 172.21.15.59:0/4269072989 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d8f400640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90071270 0x7f2d901520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d87e00640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d9015e770 0x7f2d9015b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d8fe00640 1 -- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d9015e770 msgr2=0x7f2d9015b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d8fe00640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d9015e770 0x7f2d9015b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d8fe00640 1 -- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90071270 msgr2=0x7f2d901520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d8fe00640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90071270 0x7f2d901520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d8fe00640 1 -- 172.21.15.59:0/4269072989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9015a020 con 0x7f2d9015eb50 2024-04-25T09:09:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d8fe00640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9015eb50 0x7f2d90149710 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f2d880b0040 tx=0x7f2d88019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d87400640 1 -- 172.21.15.59:0/4269072989 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d880b2050 con 0x7f2d9015eb50 2024-04-25T09:09:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d87400640 1 -- 172.21.15.59:0/4269072989 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d880be070 con 0x7f2d9015eb50 2024-04-25T09:09:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d96200640 1 -- 172.21.15.59:0/4269072989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9015a290 con 0x7f2d9015eb50 2024-04-25T09:09:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d87400640 1 -- 172.21.15.59:0/4269072989 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d880ad850 con 0x7f2d9015eb50 2024-04-25T09:09:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.259+0000 7f2d96200640 1 -- 172.21.15.59:0/4269072989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9015a850 con 0x7f2d9015eb50 2024-04-25T09:09:51.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.263+0000 7f2d96200640 1 -- 172.21.15.59:0/4269072989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d900745d0 con 0x7f2d9015eb50 2024-04-25T09:09:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.263+0000 7f2d87400640 1 -- 172.21.15.59:0/4269072989 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2d880ad9f0 con 0x7f2d9015eb50 2024-04-25T09:09:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.263+0000 7f2d87400640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2d6c066f60 0x7f2d6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.263+0000 7f2d87400640 1 -- 172.21.15.59:0/4269072989 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f2d88120200 con 0x7f2d9015eb50 2024-04-25T09:09:51.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.263+0000 7f2d8f400640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2d6c066f60 0x7f2d6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.263+0000 7f2d8f400640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2d6c066f60 0x7f2d6c069420 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2d901689c0 tx=0x7f2d80009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.267+0000 7f2d87400640 1 -- 172.21.15.59:0/4269072989 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2d88016560 con 0x7f2d9015eb50 2024-04-25T09:09:51.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.431+0000 7f2d96200640 1 -- 172.21.15.59:0/4269072989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d900acb30 con 0x7f2d9015eb50 2024-04-25T09:09:51.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.431+0000 7f2d87400640 1 -- 172.21.15.59:0/4269072989 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d880f0870 con 0x7f2d9015eb50 2024-04-25T09:09:51.421 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:09:51.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.435+0000 7f2d96200640 1 -- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2d6c066f60 msgr2=0x7f2d6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.435+0000 7f2d96200640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2d6c066f60 0x7f2d6c069420 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2d901689c0 tx=0x7f2d80009040 comp rx=0 tx=0).stop 2024-04-25T09:09:51.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.435+0000 7f2d96200640 1 -- 172.21.15.59:0/4269072989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9015eb50 msgr2=0x7f2d90149710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.435+0000 7f2d96200640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9015eb50 0x7f2d90149710 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f2d880b0040 tx=0x7f2d88019680 comp rx=0 tx=0).stop 2024-04-25T09:09:51.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.435+0000 7f2d96200640 1 -- 172.21.15.59:0/4269072989 shutdown_connections 2024-04-25T09:09:51.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.435+0000 7f2d96200640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2d6c066f60 0x7f2d6c069420 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.435+0000 7f2d96200640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d9015eb50 0x7f2d90149710 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.435+0000 7f2d96200640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2d9015e770 0x7f2d9015b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.435+0000 7f2d96200640 1 --2- 172.21.15.59:0/4269072989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2d90071270 0x7f2d901520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.435+0000 7f2d96200640 1 -- 172.21.15.59:0/4269072989 >> 172.21.15.59:0/4269072989 conn(0x7f2d90067080 msgr2=0x7f2d901600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:51.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.435+0000 7f2d96200640 1 -- 172.21.15.59:0/4269072989 shutdown_connections 2024-04-25T09:09:51.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.435+0000 7f2d96200640 1 -- 172.21.15.59:0/4269072989 wait complete. 2024-04-25T09:09:51.442 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:09:51.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f2638000640 1 Processor -- start 2024-04-25T09:09:51.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f2638000640 1 -- start start 2024-04-25T09:09:51.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f2638000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263009a170 0x7f26300d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f2638000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263015e040 con 0x7f263015dc60 2024-04-25T09:09:51.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f2638000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26300cff80 con 0x7f263006bf30 2024-04-25T09:09:51.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f2638000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26300d0260 con 0x7f263009a170 2024-04-25T09:09:51.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f2635600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f263015dc60 0x7f2630099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38460/0 (socket says 172.21.15.59:38460) 2024-04-25T09:09:51.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f2635600640 1 -- 172.21.15.59:0/1628161864 learned_addr learned my addr 172.21.15.59:0/1628161864 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:51.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f2634c00640 1 --2- 172.21.15.59:0/1628161864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263009a170 0x7f26300d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603044350 0 0) 0x7f263015e040 con 0x7f263015dc60 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2618003530 con 0x7f263015dc60 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2938788500 0 0) 0x7f2618003530 con 0x7f263015dc60 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263009a170 msgr2=0x7f26300d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 --2- 172.21.15.59:0/1628161864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263009a170 0x7f26300d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 >> v1:172.21.15.178:6789/0 conn(0x7f263006bf30 legacy=0x7f26300cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300d0540 con 0x7f263015dc60 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f2624001680 con 0x7f263015dc60 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 >> v1:172.21.15.59:6789/0 conn(0x7f263015dc60 legacy=0x7f2630099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 --2- 172.21.15.59:0/1628161864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26180039f0 0x7f2618003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 --2- 172.21.15.59:0/1628161864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2618004810 0x7f2618004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 --2- 172.21.15.59:0/1628161864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263009a170 0x7f26180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300d0260 con 0x7f26180039f0 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261800bad0 con 0x7f2618004810 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261800bcd0 con 0x7f263009a170 2024-04-25T09:09:51.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f2635600640 1 --2- 172.21.15.59:0/1628161864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26180039f0 0x7f2618003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f2634c00640 1 --2- 172.21.15.59:0/1628161864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2618004810 0x7f2618004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.599+0000 7f2636000640 1 --2- 172.21.15.59:0/1628161864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263009a170 0x7f26180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2635600640 1 -- 172.21.15.59:0/1628161864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263009a170 msgr2=0x7f26180051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2635600640 1 --2- 172.21.15.59:0/1628161864 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f263009a170 0x7f26180051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2635600640 1 -- 172.21.15.59:0/1628161864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2618004810 msgr2=0x7f2618004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2635600640 1 --2- 172.21.15.59:0/1628161864 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2618004810 0x7f2618004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2635600640 1 -- 172.21.15.59:0/1628161864 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2618003530 con 0x7f26180039f0 2024-04-25T09:09:51.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2635600640 1 --2- 172.21.15.59:0/1628161864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26180039f0 0x7f2618003dd0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f262400c190 tx=0x7f262401cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304cc3923e44f30b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2624007c70 con 0x7f26180039f0 2024-04-25T09:09:51.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26240a9070 con 0x7f26180039f0 2024-04-25T09:09:51.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f262fe00640 1 -- 172.21.15.59:0/1628161864 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2624005d20 con 0x7f26180039f0 2024-04-25T09:09:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2638000640 1 -- 172.21.15.59:0/1628161864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26180039f0 msgr2=0x7f2618003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2638000640 1 --2- 172.21.15.59:0/1628161864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26180039f0 0x7f2618003dd0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f262400c190 tx=0x7f262401cbb0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2636000640 1 -- 172.21.15.59:0/1628161864 reap_dead start 2024-04-25T09:09:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2638000640 1 -- 172.21.15.59:0/1628161864 shutdown_connections 2024-04-25T09:09:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2638000640 1 -- 172.21.15.59:0/1628161864 >> 172.21.15.59:0/1628161864 conn(0x7f26300b3200 msgr2=0x7f26300b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2638000640 1 -- 172.21.15.59:0/1628161864 shutdown_connections 2024-04-25T09:09:51.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.603+0000 7f2638000640 1 -- 172.21.15.59:0/1628161864 wait complete. 2024-04-25T09:09:51.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2638000640 1 Processor -- start 2024-04-25T09:09:51.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2638000640 1 -- start start 2024-04-25T09:09:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2638000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26180039f0 0x7f2630155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2638000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26301566a0 0x7f263015c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2638000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2630142500 0x7f26301688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2638000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263006cfa0 con 0x7f26180039f0 2024-04-25T09:09:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2638000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300cc470 con 0x7f26301566a0 2024-04-25T09:09:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2638000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26300cad20 con 0x7f2630142500 2024-04-25T09:09:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2635600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26180039f0 0x7f2630155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2635600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26180039f0 0x7f2630155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40180/0 (socket says 172.21.15.59:40180) 2024-04-25T09:09:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2635600640 1 -- 172.21.15.59:0/643716689 learned_addr learned my addr 172.21.15.59:0/643716689 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2634c00640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26301566a0 0x7f263015c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2635600640 1 -- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2630142500 msgr2=0x7f26301688a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2635600640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2630142500 0x7f26301688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2635600640 1 -- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26301566a0 msgr2=0x7f263015c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2635600640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26301566a0 0x7f263015c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2635600640 1 -- 172.21.15.59:0/643716689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263015cbc0 con 0x7f26180039f0 2024-04-25T09:09:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2634c00640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26301566a0 0x7f263015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2635600640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26180039f0 0x7f2630155f80 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f262400c190 tx=0x7f2618005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f262d600640 1 -- 172.21.15.59:0/643716689 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2624000fa0 con 0x7f26180039f0 2024-04-25T09:09:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f262d600640 1 -- 172.21.15.59:0/643716689 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2624005d00 con 0x7f26180039f0 2024-04-25T09:09:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f262d600640 1 -- 172.21.15.59:0/643716689 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26240015c0 con 0x7f26180039f0 2024-04-25T09:09:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2638000640 1 -- 172.21.15.59:0/643716689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26300ca3f0 con 0x7f26180039f0 2024-04-25T09:09:51.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.607+0000 7f2638000640 1 -- 172.21.15.59:0/643716689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26300ca9b0 con 0x7f26180039f0 2024-04-25T09:09:51.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.611+0000 7f2638000640 1 -- 172.21.15.59:0/643716689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26300745d0 con 0x7f26180039f0 2024-04-25T09:09:51.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.611+0000 7f262d600640 1 -- 172.21.15.59:0/643716689 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2624007040 con 0x7f26180039f0 2024-04-25T09:09:51.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.611+0000 7f262d600640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2610066f90 0x7f2610069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.611+0000 7f262d600640 1 -- 172.21.15.59:0/643716689 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f262411de00 con 0x7f26180039f0 2024-04-25T09:09:51.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.611+0000 7f2634c00640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2610066f90 0x7f2610069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.611+0000 7f2634c00640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2610066f90 0x7f2610069450 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f263015a7a0 tx=0x7f261c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.615+0000 7f262d600640 1 -- 172.21.15.59:0/643716689 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f26240168f0 con 0x7f26180039f0 2024-04-25T09:09:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.775+0000 7f2638000640 1 -- 172.21.15.59:0/643716689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f26300b7590 con 0x7f26180039f0 2024-04-25T09:09:51.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.775+0000 7f262d600640 1 -- 172.21.15.59:0/643716689 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7f26240eea30 con 0x7f26180039f0 2024-04-25T09:09:51.766 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:09:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.779+0000 7f2638000640 1 -- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2610066f90 msgr2=0x7f2610069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.779+0000 7f2638000640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2610066f90 0x7f2610069450 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f263015a7a0 tx=0x7f261c008040 comp rx=0 tx=0).stop 2024-04-25T09:09:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.779+0000 7f2638000640 1 -- 172.21.15.59:0/643716689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26180039f0 msgr2=0x7f2630155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.779+0000 7f2638000640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26180039f0 0x7f2630155f80 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f262400c190 tx=0x7f2618005840 comp rx=0 tx=0).stop 2024-04-25T09:09:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.779+0000 7f2638000640 1 -- 172.21.15.59:0/643716689 shutdown_connections 2024-04-25T09:09:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.779+0000 7f2638000640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2610066f90 0x7f2610069450 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.779+0000 7f2638000640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2630142500 0x7f26301688a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.779+0000 7f2638000640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f26301566a0 0x7f263015c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.779+0000 7f2638000640 1 --2- 172.21.15.59:0/643716689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26180039f0 0x7f2630155f80 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.779+0000 7f2638000640 1 -- 172.21.15.59:0/643716689 >> 172.21.15.59:0/643716689 conn(0x7f26300b3200 msgr2=0x7f26301671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.779+0000 7f2638000640 1 -- 172.21.15.59:0/643716689 shutdown_connections 2024-04-25T09:09:51.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.779+0000 7f2638000640 1 -- 172.21.15.59:0/643716689 wait complete. 2024-04-25T09:09:51.787 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:09:51.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f206d000640 1 Processor -- start 2024-04-25T09:09:51.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f206d000640 1 -- start start 2024-04-25T09:09:51.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f206d000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206815dc60 0x7f20680d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f206d000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f206806bf30 0x7f20680cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f206d000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206815e040 con 0x7f2068099a60 2024-04-25T09:09:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f206d000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20680cff80 con 0x7f206806bf30 2024-04-25T09:09:51.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f206d000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20680d0260 con 0x7f206815dc60 2024-04-25T09:09:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2066800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2068099a60 0x7f20680cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38466/0 (socket says 172.21.15.59:38466) 2024-04-25T09:09:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2066800640 1 -- 172.21.15.59:0/1380989182 learned_addr learned my addr 172.21.15.59:0/1380989182 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065e00640 1 --2- 172.21.15.59:0/1380989182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206815dc60 0x7f20680d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f205d400640 1 --2- 172.21.15.59:0/1380989182 >> v2:172.21.15.178:3300/0 conn(0x7f206806bf30 0x7f20680cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401536508 0 0) 0x7f206815e040 con 0x7f2068099a60 2024-04-25T09:09:51.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f204c003530 con 0x7f2068099a60 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1342222360 0 0) 0x7f204c003530 con 0x7f2068099a60 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206815dc60 msgr2=0x7f20680d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 --2- 172.21.15.59:0/1380989182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206815dc60 0x7f20680d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 >> v2:172.21.15.178:3300/0 conn(0x7f206806bf30 msgr2=0x7f20680cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 --2- 172.21.15.59:0/1380989182 >> v2:172.21.15.178:3300/0 conn(0x7f206806bf30 0x7f20680cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20680d0540 con 0x7f2068099a60 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f2060001a00 con 0x7f2068099a60 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 >> v1:172.21.15.59:6789/0 conn(0x7f2068099a60 legacy=0x7f20680cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 --2- 172.21.15.59:0/1380989182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c0039c0 0x7f204c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 --2- 172.21.15.59:0/1380989182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f204c004810 0x7f204c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 --2- 172.21.15.59:0/1380989182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206815dc60 0x7f204c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20680cff80 con 0x7f204c0039c0 2024-04-25T09:09:51.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20680d0260 con 0x7f204c004810 2024-04-25T09:09:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.943+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c00b9d0 con 0x7f206815dc60 2024-04-25T09:09:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f2065e00640 1 --2- 172.21.15.59:0/1380989182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c0039c0 0x7f204c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f205d400640 1 --2- 172.21.15.59:0/1380989182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f204c004810 0x7f204c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f2066800640 1 --2- 172.21.15.59:0/1380989182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206815dc60 0x7f204c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f2065e00640 1 -- 172.21.15.59:0/1380989182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206815dc60 msgr2=0x7f204c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f2065e00640 1 --2- 172.21.15.59:0/1380989182 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206815dc60 0x7f204c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f2065e00640 1 -- 172.21.15.59:0/1380989182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f204c004810 msgr2=0x7f204c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f2065e00640 1 --2- 172.21.15.59:0/1380989182 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f204c004810 0x7f204c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f2065e00640 1 -- 172.21.15.59:0/1380989182 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c003530 con 0x7f204c0039c0 2024-04-25T09:09:51.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f2065e00640 1 --2- 172.21.15.59:0/1380989182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c0039c0 0x7f204c003de0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f2058009b10 tx=0x7f205801ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=803b98209014e9f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580096b0 con 0x7f204c0039c0 2024-04-25T09:09:51.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20580a6450 con 0x7f204c0039c0 2024-04-25T09:09:51.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f2065400640 1 -- 172.21.15.59:0/1380989182 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580a6840 con 0x7f204c0039c0 2024-04-25T09:09:51.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f206d000640 1 -- 172.21.15.59:0/1380989182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c0039c0 msgr2=0x7f204c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.947+0000 7f206d000640 1 --2- 172.21.15.59:0/1380989182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c0039c0 0x7f204c003de0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f2058009b10 tx=0x7f205801ca40 comp rx=0 tx=0).stop 2024-04-25T09:09:51.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f2066800640 1 -- 172.21.15.59:0/1380989182 reap_dead start 2024-04-25T09:09:51.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f206d000640 1 -- 172.21.15.59:0/1380989182 shutdown_connections 2024-04-25T09:09:51.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f206d000640 1 -- 172.21.15.59:0/1380989182 >> 172.21.15.59:0/1380989182 conn(0x7f20680b3200 msgr2=0x7f20680b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f206d000640 1 -- 172.21.15.59:0/1380989182 shutdown_connections 2024-04-25T09:09:51.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f206d000640 1 -- 172.21.15.59:0/1380989182 wait complete. 2024-04-25T09:09:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f206d000640 1 Processor -- start 2024-04-25T09:09:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f206d000640 1 -- start start 2024-04-25T09:09:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f206d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c0039c0 0x7f20680b69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f206d000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20681f7df0 0x7f2068164a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f206d000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20681f8270 0x7f2068164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f206d000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206809a280 con 0x7f204c0039c0 2024-04-25T09:09:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f206d000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20680cc470 con 0x7f20681f8270 2024-04-25T09:09:51.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f206d000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20680b7310 con 0x7f20681f7df0 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f2065e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c0039c0 0x7f20680b69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f2065e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c0039c0 0x7f20680b69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40202/0 (socket says 172.21.15.59:40202) 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f2065e00640 1 -- 172.21.15.59:0/2222514095 learned_addr learned my addr 172.21.15.59:0/2222514095 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f2066800640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20681f8270 0x7f2068164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f205d400640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20681f7df0 0x7f2068164a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f2065e00640 1 -- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20681f7df0 msgr2=0x7f2068164a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f2065e00640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20681f7df0 0x7f2068164a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f2065e00640 1 -- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20681f8270 msgr2=0x7f2068164fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f2065e00640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20681f8270 0x7f2068164fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f2065e00640 1 -- 172.21.15.59:0/2222514095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20680b4f20 con 0x7f204c0039c0 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f2065e00640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c0039c0 0x7f20680b69e0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f2058009a00 tx=0x7f204c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.951+0000 7f205ea00640 1 -- 172.21.15.59:0/2222514095 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580be070 con 0x7f204c0039c0 2024-04-25T09:09:51.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.955+0000 7f205ea00640 1 -- 172.21.15.59:0/2222514095 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205800f000 con 0x7f204c0039c0 2024-04-25T09:09:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.955+0000 7f205ea00640 1 -- 172.21.15.59:0/2222514095 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580a6e40 con 0x7f204c0039c0 2024-04-25T09:09:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.955+0000 7f206d000640 1 -- 172.21.15.59:0/2222514095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20680b5200 con 0x7f204c0039c0 2024-04-25T09:09:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.955+0000 7f206d000640 1 -- 172.21.15.59:0/2222514095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20680b6f20 con 0x7f204c0039c0 2024-04-25T09:09:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.955+0000 7f206d000640 1 -- 172.21.15.59:0/2222514095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20680745d0 con 0x7f204c0039c0 2024-04-25T09:09:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.955+0000 7f205ea00640 1 -- 172.21.15.59:0/2222514095 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f20580c1070 con 0x7f204c0039c0 2024-04-25T09:09:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.955+0000 7f205ea00640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2044066f60 0x7f2044069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.955+0000 7f205ea00640 1 -- 172.21.15.59:0/2222514095 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f205811ed30 con 0x7f204c0039c0 2024-04-25T09:09:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.955+0000 7f205d400640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2044066f60 0x7f2044069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:51.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.955+0000 7f205d400640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2044066f60 0x7f2044069420 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2068070bf0 tx=0x7f2050008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:51.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:51.959+0000 7f205ea00640 1 -- 172.21.15.59:0/2222514095 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f20580ac020 con 0x7f204c0039c0 2024-04-25T09:09:52.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.123+0000 7f206d000640 1 -- 172.21.15.59:0/2222514095 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f20680b7590 con 0x7f204c0039c0 2024-04-25T09:09:52.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.123+0000 7f205ea00640 1 -- 172.21.15.59:0/2222514095 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f20580167c0 con 0x7f204c0039c0 2024-04-25T09:09:52.112 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:09:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.127+0000 7f206d000640 1 -- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2044066f60 msgr2=0x7f2044069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.127+0000 7f206d000640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2044066f60 0x7f2044069420 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2068070bf0 tx=0x7f2050008040 comp rx=0 tx=0).stop 2024-04-25T09:09:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.127+0000 7f206d000640 1 -- 172.21.15.59:0/2222514095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c0039c0 msgr2=0x7f20680b69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.127+0000 7f206d000640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c0039c0 0x7f20680b69e0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f2058009a00 tx=0x7f204c005840 comp rx=0 tx=0).stop 2024-04-25T09:09:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.127+0000 7f206d000640 1 -- 172.21.15.59:0/2222514095 shutdown_connections 2024-04-25T09:09:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.127+0000 7f206d000640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2044066f60 0x7f2044069420 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.127+0000 7f206d000640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f20681f8270 0x7f2068164fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.127+0000 7f206d000640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f20681f7df0 0x7f2068164a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.127+0000 7f206d000640 1 --2- 172.21.15.59:0/2222514095 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f204c0039c0 0x7f20680b69e0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.127+0000 7f206d000640 1 -- 172.21.15.59:0/2222514095 >> 172.21.15.59:0/2222514095 conn(0x7f20680b3200 msgr2=0x7f20680737e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.127+0000 7f206d000640 1 -- 172.21.15.59:0/2222514095 shutdown_connections 2024-04-25T09:09:52.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.127+0000 7f206d000640 1 -- 172.21.15.59:0/2222514095 wait complete. 2024-04-25T09:09:52.134 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:09:52.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f806ba00640 1 Processor -- start 2024-04-25T09:09:52.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f806ba00640 1 -- start start 2024-04-25T09:09:52.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f806ba00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8064144120 0x7f806415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f806ba00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80640ccbf0 0x7f806415e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f806ba00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f806415ee60 0x7f80640b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f806ba00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806415e490 con 0x7f806415ee60 2024-04-25T09:09:52.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f806ba00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f806415bc40 con 0x7f8064144120 2024-04-25T09:09:52.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f806ba00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806415b3a0 con 0x7f80640ccbf0 2024-04-25T09:09:52.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f8069a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f806415ee60 0x7f80640b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f8069a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f806415ee60 0x7f80640b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40216/0 (socket says 172.21.15.59:40216) 2024-04-25T09:09:52.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f8069a00640 1 -- 172.21.15.59:0/1605441500 learned_addr learned my addr 172.21.15.59:0/1605441500 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:52.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f805be00640 1 --2- 172.21.15.59:0/1605441500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80640ccbf0 0x7f806415e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f8069000640 1 --2- 172.21.15.59:0/1605441500 >> v2:172.21.15.178:3300/0 conn(0x7f8064144120 0x7f806415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f8069a00640 1 -- 172.21.15.59:0/1605441500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80640ccbf0 msgr2=0x7f806415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:52.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f8069a00640 1 --2- 172.21.15.59:0/1605441500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80640ccbf0 0x7f806415e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f8069a00640 1 -- 172.21.15.59:0/1605441500 >> v2:172.21.15.178:3300/0 conn(0x7f8064144120 msgr2=0x7f806415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:52.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f8069a00640 1 --2- 172.21.15.59:0/1605441500 >> v2:172.21.15.178:3300/0 conn(0x7f8064144120 0x7f806415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f8069a00640 1 -- 172.21.15.59:0/1605441500 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806415b680 con 0x7f806415ee60 2024-04-25T09:09:52.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.287+0000 7f8069000640 1 --2- 172.21.15.59:0/1605441500 >> v2:172.21.15.178:3300/0 conn(0x7f8064144120 0x7f806415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:52.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f8069a00640 1 --2- 172.21.15.59:0/1605441500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f806415ee60 0x7f80640b3090 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f806406b9b0 tx=0x7f805c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3919e7eac32b08cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:52.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f8063e00640 1 -- 172.21.15.59:0/1605441500 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c0a55e0 con 0x7f806415ee60 2024-04-25T09:09:52.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f8063e00640 1 -- 172.21.15.59:0/1605441500 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805c0a5780 con 0x7f806415ee60 2024-04-25T09:09:52.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f8063e00640 1 -- 172.21.15.59:0/1605441500 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c0a5b50 con 0x7f806415ee60 2024-04-25T09:09:52.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f806ba00640 1 -- 172.21.15.59:0/1605441500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f806415ee60 msgr2=0x7f80640b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f806ba00640 1 --2- 172.21.15.59:0/1605441500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f806415ee60 0x7f80640b3090 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f806406b9b0 tx=0x7f805c01c960 comp rx=0 tx=0).stop 2024-04-25T09:09:52.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f806ba00640 1 -- 172.21.15.59:0/1605441500 shutdown_connections 2024-04-25T09:09:52.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f806ba00640 1 --2- 172.21.15.59:0/1605441500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f806415ee60 0x7f80640b3090 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f806ba00640 1 --2- 172.21.15.59:0/1605441500 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80640ccbf0 0x7f806415e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f806ba00640 1 --2- 172.21.15.59:0/1605441500 >> v2:172.21.15.178:3300/0 conn(0x7f8064144120 0x7f806415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f806ba00640 1 -- 172.21.15.59:0/1605441500 >> 172.21.15.59:0/1605441500 conn(0x7f8064067080 msgr2=0x7f806406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f806ba00640 1 -- 172.21.15.59:0/1605441500 shutdown_connections 2024-04-25T09:09:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.291+0000 7f806ba00640 1 -- 172.21.15.59:0/1605441500 wait complete. 2024-04-25T09:09:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f806ba00640 1 Processor -- start 2024-04-25T09:09:52.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f806ba00640 1 -- start start 2024-04-25T09:09:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f806ba00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640ccbf0 0x7f806413e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f806ba00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8064144120 0x7f8064163980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f806ba00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f806415ee60 0x7f8064142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f806ba00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064071600 con 0x7f80640ccbf0 2024-04-25T09:09:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f806ba00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8064071480 con 0x7f8064144120 2024-04-25T09:09:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f806ba00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8064071780 con 0x7f806415ee60 2024-04-25T09:09:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8069000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640ccbf0 0x7f806413e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8069000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640ccbf0 0x7f806413e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40224/0 (socket says 172.21.15.59:40224) 2024-04-25T09:09:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8069000640 1 -- 172.21.15.59:0/776458784 learned_addr learned my addr 172.21.15.59:0/776458784 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f805be00640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8064144120 0x7f8064163980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8069a00640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f806415ee60 0x7f8064142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8069000640 1 -- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f806415ee60 msgr2=0x7f8064142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8069000640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f806415ee60 0x7f8064142aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8069000640 1 -- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8064144120 msgr2=0x7f8064163980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8069000640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8064144120 0x7f8064163980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8069000640 1 -- 172.21.15.59:0/776458784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8064165260 con 0x7f80640ccbf0 2024-04-25T09:09:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f805be00640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8064144120 0x7f8064163980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8069000640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640ccbf0 0x7f806413e230 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f805400e810 tx=0x7f805400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8061600640 1 -- 172.21.15.59:0/776458784 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8054017070 con 0x7f80640ccbf0 2024-04-25T09:09:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8061600640 1 -- 172.21.15.59:0/776458784 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805400c8d0 con 0x7f80640ccbf0 2024-04-25T09:09:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f8061600640 1 -- 172.21.15.59:0/776458784 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805400f040 con 0x7f80640ccbf0 2024-04-25T09:09:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f806ba00640 1 -- 172.21.15.59:0/776458784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80640a8660 con 0x7f80640ccbf0 2024-04-25T09:09:52.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f806ba00640 1 -- 172.21.15.59:0/776458784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80640a8c20 con 0x7f80640ccbf0 2024-04-25T09:09:52.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.295+0000 7f806ba00640 1 -- 172.21.15.59:0/776458784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80640745d0 con 0x7f80640ccbf0 2024-04-25T09:09:52.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.299+0000 7f8061600640 1 -- 172.21.15.59:0/776458784 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f805401a070 con 0x7f80640ccbf0 2024-04-25T09:09:52.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.299+0000 7f8061600640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8040066f60 0x7f8040069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.299+0000 7f8061600640 1 -- 172.21.15.59:0/776458784 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f8054084f10 con 0x7f80640ccbf0 2024-04-25T09:09:52.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.299+0000 7f805be00640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8040066f60 0x7f8040069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.299+0000 7f805be00640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8040066f60 0x7f8040069420 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f806413fe10 tx=0x7f804c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:52.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.303+0000 7f8061600640 1 -- 172.21.15.59:0/776458784 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8054055c60 con 0x7f80640ccbf0 2024-04-25T09:09:52.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.475+0000 7f806ba00640 1 -- 172.21.15.59:0/776458784 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8064071d90 con 0x7f80640ccbf0 2024-04-25T09:09:52.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.475+0000 7f8061600640 1 -- 172.21.15.59:0/776458784 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v96) v1 ==== 80+0+244 (secure 0 0 0) 0x7f8054055560 con 0x7f80640ccbf0 2024-04-25T09:09:52.465 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6835/4079513876 2024-04-26T09:09:12.143656+0000 2024-04-25T09:09:52.465 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6833/4079513876 2024-04-26T09:09:12.143656+0000 2024-04-25T09:09:52.465 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6835/3531112441 2024-04-26T09:07:59.742787+0000 2024-04-25T09:09:52.465 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6833/3531112441 2024-04-26T09:07:59.742787+0000 2024-04-25T09:09:52.465 INFO:teuthology.orchestra.run.smithi059.stderr:listed 4 entries 2024-04-25T09:09:52.466 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.479+0000 7f806ba00640 1 -- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8040066f60 msgr2=0x7f8040069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.479+0000 7f806ba00640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8040066f60 0x7f8040069420 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f806413fe10 tx=0x7f804c008040 comp rx=0 tx=0).stop 2024-04-25T09:09:52.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.479+0000 7f806ba00640 1 -- 172.21.15.59:0/776458784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640ccbf0 msgr2=0x7f806413e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.479+0000 7f806ba00640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640ccbf0 0x7f806413e230 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f805400e810 tx=0x7f805400ecd0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.479+0000 7f806ba00640 1 -- 172.21.15.59:0/776458784 shutdown_connections 2024-04-25T09:09:52.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.479+0000 7f806ba00640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8040066f60 0x7f8040069420 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.479+0000 7f806ba00640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f806415ee60 0x7f8064142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.479+0000 7f806ba00640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8064144120 0x7f8064163980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.479+0000 7f806ba00640 1 --2- 172.21.15.59:0/776458784 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80640ccbf0 0x7f806413e230 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.479+0000 7f806ba00640 1 -- 172.21.15.59:0/776458784 >> 172.21.15.59:0/776458784 conn(0x7f8064067080 msgr2=0x7f806413ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:52.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.479+0000 7f806ba00640 1 -- 172.21.15.59:0/776458784 shutdown_connections 2024-04-25T09:09:52.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.479+0000 7f806ba00640 1 -- 172.21.15.59:0/776458784 wait complete. 2024-04-25T09:09:52.485 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:09:52.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:52.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:09:52.512 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:09:52.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:09:52.512 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:09:52.563 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:09:52.563 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:52.572 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:09:52.572 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:09:52.573 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:52.618 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:09:52.618 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:09:52.619 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:09:52.627 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:09:52.628 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:52.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.815+0000 7f6ac1200640 1 Processor -- start 2024-04-25T09:09:52.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.815+0000 7f6ac1200640 1 -- start start 2024-04-25T09:09:52.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ac1200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6abc144140 0x7f6abc0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ac1200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6abc06ead0 0x7f6abc0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ac1200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6abc15ac60 con 0x7f6abc0ced60 2024-04-25T09:09:52.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ac1200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6abc0cf3e0 con 0x7f6abc06ead0 2024-04-25T09:09:52.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ac1200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc15af20 con 0x7f6abc144140 2024-04-25T09:09:52.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab1400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6abc0ced60 0x7f6abc06e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38478/0 (socket says 172.21.15.59:38478) 2024-04-25T09:09:52.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab1400640 1 -- 172.21.15.59:0/480069845 learned_addr learned my addr 172.21.15.59:0/480069845 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:52.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6aba800640 1 --2- 172.21.15.59:0/480069845 >> v2:172.21.15.178:3300/0 conn(0x7f6abc06ead0 0x7f6abc0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041776322 0 0) 0x7f6abc15ac60 con 0x7f6abc0ced60 2024-04-25T09:09:52.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9e00640 1 --2- 172.21.15.59:0/480069845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6abc144140 0x7f6abc0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aa0005740 con 0x7f6abc0ced60 2024-04-25T09:09:52.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2131797499 0 0) 0x7f6aa0005740 con 0x7f6abc0ced60 2024-04-25T09:09:52.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6abc144140 msgr2=0x7f6abc0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:52.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 --2- 172.21.15.59:0/480069845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6abc144140 0x7f6abc0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 >> v2:172.21.15.178:3300/0 conn(0x7f6abc06ead0 msgr2=0x7f6abc0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:52.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 --2- 172.21.15.59:0/480069845 >> v2:172.21.15.178:3300/0 conn(0x7f6abc06ead0 0x7f6abc0b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc15b200 con 0x7f6abc0ced60 2024-04-25T09:09:52.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f6aa4001680 con 0x7f6abc0ced60 2024-04-25T09:09:52.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 >> v1:172.21.15.59:6789/0 conn(0x7f6abc0ced60 legacy=0x7f6abc06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 --2- 172.21.15.59:0/480069845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6abc144140 0x7f6aa0005bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 --2- 172.21.15.59:0/480069845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6aa00061a0 0x7f6aa0006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 --2- 172.21.15.59:0/480069845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa0006f60 0x7f6aa00073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0cf3e0 con 0x7f6aa0006f60 2024-04-25T09:09:52.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc15af20 con 0x7f6aa00061a0 2024-04-25T09:09:52.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa000dbe0 con 0x7f6abc144140 2024-04-25T09:09:52.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6aba800640 1 --2- 172.21.15.59:0/480069845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa0006f60 0x7f6aa00073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab1400640 1 --2- 172.21.15.59:0/480069845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6aa00061a0 0x7f6aa0006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6ab9e00640 1 --2- 172.21.15.59:0/480069845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6abc144140 0x7f6aa0005bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6aba800640 1 -- 172.21.15.59:0/480069845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6abc144140 msgr2=0x7f6aa0005bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:52.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6aba800640 1 --2- 172.21.15.59:0/480069845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6abc144140 0x7f6aa0005bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6aba800640 1 -- 172.21.15.59:0/480069845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6aa00061a0 msgr2=0x7f6aa0006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:52.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6aba800640 1 --2- 172.21.15.59:0/480069845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6aa00061a0 0x7f6aa0006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.819+0000 7f6aba800640 1 -- 172.21.15.59:0/480069845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa0005740 con 0x7f6aa0006f60 2024-04-25T09:09:52.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6aba800640 1 --2- 172.21.15.59:0/480069845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa0006f60 0x7f6aa00073e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009ab0 tx=0x7f6ab401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=172c616268b8c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:52.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40b2070 con 0x7f6aa0006f60 2024-04-25T09:09:52.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab40a5640 con 0x7f6aa0006f60 2024-04-25T09:09:52.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6ab9400640 1 -- 172.21.15.59:0/480069845 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40096b0 con 0x7f6aa0006f60 2024-04-25T09:09:52.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6ac1200640 1 -- 172.21.15.59:0/480069845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa0006f60 msgr2=0x7f6aa00073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6ac1200640 1 --2- 172.21.15.59:0/480069845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6aa0006f60 0x7f6aa00073e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f6ab4009ab0 tx=0x7f6ab401ca50 comp rx=0 tx=0).stop 2024-04-25T09:09:52.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6aba800640 1 -- 172.21.15.59:0/480069845 reap_dead start 2024-04-25T09:09:52.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6ac1200640 1 -- 172.21.15.59:0/480069845 shutdown_connections 2024-04-25T09:09:52.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6ac1200640 1 -- 172.21.15.59:0/480069845 >> 172.21.15.59:0/480069845 conn(0x7f6abc066fa0 msgr2=0x7f6abc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:52.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6ac1200640 1 -- 172.21.15.59:0/480069845 shutdown_connections 2024-04-25T09:09:52.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6ac1200640 1 -- 172.21.15.59:0/480069845 wait complete. 2024-04-25T09:09:52.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6ac1200640 1 Processor -- start 2024-04-25T09:09:52.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.823+0000 7f6ac1200640 1 -- start start 2024-04-25T09:09:52.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ac1200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6aa0006f60 0x7f6abc152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ac1200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6abc15c5f0 0x7f6abc0cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ac1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc15ca50 0x7f6abc0cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ac1200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc144520 con 0x7f6abc15ca50 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ac1200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0b1f30 con 0x7f6abc15c5f0 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ac1200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc15ba00 con 0x7f6aa0006f60 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6aba800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc15ca50 0x7f6abc0cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6aba800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc15ca50 0x7f6abc0cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40242/0 (socket says 172.21.15.59:40242) 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6aba800640 1 -- 172.21.15.59:0/802541975 learned_addr learned my addr 172.21.15.59:0/802541975 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ab1400640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6abc15c5f0 0x7f6abc0cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ab9e00640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6aa0006f60 0x7f6abc152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6aba800640 1 -- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6aa0006f60 msgr2=0x7f6abc152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6aba800640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6aa0006f60 0x7f6abc152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6aba800640 1 -- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6abc15c5f0 msgr2=0x7f6abc0cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6aba800640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6abc15c5f0 0x7f6abc0cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6aba800640 1 -- 172.21.15.59:0/802541975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc151980 con 0x7f6abc15ca50 2024-04-25T09:09:52.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6aba800640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc15ca50 0x7f6abc0cb130 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6ab401cf30 tx=0x7f6aa0007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:52.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ab2a00640 1 -- 172.21.15.59:0/802541975 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40bc070 con 0x7f6abc15ca50 2024-04-25T09:09:52.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ab2a00640 1 -- 172.21.15.59:0/802541975 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab4000e50 con 0x7f6abc15ca50 2024-04-25T09:09:52.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ac1200640 1 -- 172.21.15.59:0/802541975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc151c60 con 0x7f6abc15ca50 2024-04-25T09:09:52.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ab2a00640 1 -- 172.21.15.59:0/802541975 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40b2040 con 0x7f6abc15ca50 2024-04-25T09:09:52.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ac1200640 1 -- 172.21.15.59:0/802541975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc152220 con 0x7f6abc15ca50 2024-04-25T09:09:52.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.827+0000 7f6ac1200640 1 -- 172.21.15.59:0/802541975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc0745d0 con 0x7f6abc15ca50 2024-04-25T09:09:52.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.831+0000 7f6ab2a00640 1 -- 172.21.15.59:0/802541975 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6ab40bf070 con 0x7f6abc15ca50 2024-04-25T09:09:52.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.831+0000 7f6ab2a00640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a98066f60 0x7f6a98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:52.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.831+0000 7f6ab2a00640 1 -- 172.21.15.59:0/802541975 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f6ab411e830 con 0x7f6abc15ca50 2024-04-25T09:09:52.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.831+0000 7f6ab9e00640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a98066f60 0x7f6a98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:52.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.831+0000 7f6ab9e00640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a98066f60 0x7f6a98069420 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6aac014510 tx=0x7f6aac00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:52.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:52.835+0000 7f6ab2a00640 1 -- 172.21.15.59:0/802541975 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6ab40167a0 con 0x7f6abc15ca50 2024-04-25T09:09:53.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.031+0000 7f6ac1200640 1 -- 172.21.15.59:0/802541975 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6abc142230 con 0x7f6abc15ca50 2024-04-25T09:09:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.031+0000 7f6ab2a00640 1 -- 172.21.15.59:0/802541975 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f6ab40eee10 con 0x7f6abc15ca50 2024-04-25T09:09:53.021 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:53.021 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:09:15.158723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7965":{"gid":7965,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1467736863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1467736863},{"type":"v1","addr":"172.21.15.59:6835","nonce":1467736863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:09:53.021 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 78 2024-04-25T09:09:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.035+0000 7f6ac1200640 1 -- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a98066f60 msgr2=0x7f6a98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.035+0000 7f6ac1200640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a98066f60 0x7f6a98069420 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f6aac014510 tx=0x7f6aac00b040 comp rx=0 tx=0).stop 2024-04-25T09:09:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.035+0000 7f6ac1200640 1 -- 172.21.15.59:0/802541975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc15ca50 msgr2=0x7f6abc0cb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.035+0000 7f6ac1200640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc15ca50 0x7f6abc0cb130 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f6ab401cf30 tx=0x7f6aa0007a50 comp rx=0 tx=0).stop 2024-04-25T09:09:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.035+0000 7f6ac1200640 1 -- 172.21.15.59:0/802541975 shutdown_connections 2024-04-25T09:09:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.035+0000 7f6ac1200640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6a98066f60 0x7f6a98069420 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.035+0000 7f6ac1200640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6abc15ca50 0x7f6abc0cb130 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.035+0000 7f6ac1200640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6abc15c5f0 0x7f6abc0cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.035+0000 7f6ac1200640 1 --2- 172.21.15.59:0/802541975 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6aa0006f60 0x7f6abc152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.035+0000 7f6ac1200640 1 -- 172.21.15.59:0/802541975 >> 172.21.15.59:0/802541975 conn(0x7f6abc066fa0 msgr2=0x7f6abc141030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.035+0000 7f6ac1200640 1 -- 172.21.15.59:0/802541975 shutdown_connections 2024-04-25T09:09:53.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.035+0000 7f6ac1200640 1 -- 172.21.15.59:0/802541975 wait complete. 2024-04-25T09:09:53.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:53.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedff600640 1 Processor -- start 2024-04-25T09:09:53.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedff600640 1 -- start start 2024-04-25T09:09:53.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedff600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fedf815b5a0 0x7fedf80cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedff600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fedf80cc440 0x7fedf80d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedff600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf80ce7f0 con 0x7fedf815b980 2024-04-25T09:09:53.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedff600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf80cfcd0 con 0x7fedf80cc440 2024-04-25T09:09:53.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedff600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf80cead0 con 0x7fedf815b5a0 2024-04-25T09:09:53.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedfd600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fedf80cc440 0x7fedf80d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedfd600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fedf80cc440 0x7fedf80d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40244/0 (socket says 172.21.15.59:40244) 2024-04-25T09:09:53.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedfd600640 1 -- 172.21.15.59:0/327912173 learned_addr learned my addr 172.21.15.59:0/327912173 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:53.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedfcc00640 1 --2- 172.21.15.59:0/327912173 >> v2:172.21.15.178:3300/0 conn(0x7fedf815b5a0 0x7fedf80cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedfd600640 1 -- 172.21.15.59:0/327912173 >> v2:172.21.15.178:3300/0 conn(0x7fedf815b5a0 msgr2=0x7fedf80cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:53.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedfd600640 1 --2- 172.21.15.59:0/327912173 >> v2:172.21.15.178:3300/0 conn(0x7fedf815b5a0 0x7fedf80cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedfd600640 1 -- 172.21.15.59:0/327912173 >> v1:172.21.15.178:6789/0 conn(0x7fedf815b980 legacy=0x7fedf80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.195+0000 7fedfd600640 1 -- 172.21.15.59:0/327912173 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf80cf960 con 0x7fedf80cc440 2024-04-25T09:09:53.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.199+0000 7fedfd600640 1 --2- 172.21.15.59:0/327912173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf80cc440 0x7fedf80d0160 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fedf8072e00 tx=0x7fedf001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0014c280a7f65c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:53.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.199+0000 7fedf7400640 1 -- 172.21.15.59:0/327912173 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00a58e0 con 0x7fedf80cc440 2024-04-25T09:09:53.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.199+0000 7fedf7400640 1 -- 172.21.15.59:0/327912173 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf00a5a80 con 0x7fedf80cc440 2024-04-25T09:09:53.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.199+0000 7fedf7400640 1 -- 172.21.15.59:0/327912173 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00a5e50 con 0x7fedf80cc440 2024-04-25T09:09:53.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.199+0000 7fedff600640 1 -- 172.21.15.59:0/327912173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf80cc440 msgr2=0x7fedf80d0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.199+0000 7fedff600640 1 --2- 172.21.15.59:0/327912173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf80cc440 0x7fedf80d0160 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fedf8072e00 tx=0x7fedf001c9f0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.199+0000 7fedff600640 1 -- 172.21.15.59:0/327912173 shutdown_connections 2024-04-25T09:09:53.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.199+0000 7fedff600640 1 --2- 172.21.15.59:0/327912173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf80cc440 0x7fedf80d0160 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.199+0000 7fedff600640 1 --2- 172.21.15.59:0/327912173 >> v2:172.21.15.178:3300/0 conn(0x7fedf815b5a0 0x7fedf80cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.199+0000 7fedff600640 1 -- 172.21.15.59:0/327912173 >> 172.21.15.59:0/327912173 conn(0x7fedf80b3390 msgr2=0x7fedf80b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:53.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.199+0000 7fedff600640 1 -- 172.21.15.59:0/327912173 shutdown_connections 2024-04-25T09:09:53.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.199+0000 7fedff600640 1 -- 172.21.15.59:0/327912173 wait complete. 2024-04-25T09:09:53.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedff600640 1 Processor -- start 2024-04-25T09:09:53.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedff600640 1 -- start start 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedff600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedf80cc440 0x7fedf813e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedff600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedf815b5a0 0x7fedf813acd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedff600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf815b980 0x7fedf80caa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedff600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80d1280 con 0x7fedf815b980 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedff600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80d1100 con 0x7fedf80cc440 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedff600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80d1400 con 0x7fedf815b5a0 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedfd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf815b980 0x7fedf80caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedfd600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf815b980 0x7fedf80caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40246/0 (socket says 172.21.15.59:40246) 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedfd600640 1 -- 172.21.15.59:0/806880815 learned_addr learned my addr 172.21.15.59:0/806880815 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedfcc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedf80cc440 0x7fedf813e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedf7e00640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedf815b5a0 0x7fedf813acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedfd600640 1 -- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedf815b5a0 msgr2=0x7fedf813acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedfd600640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedf815b5a0 0x7fedf813acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedfd600640 1 -- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedf80cc440 msgr2=0x7fedf813e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedfd600640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedf80cc440 0x7fedf813e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedfd600640 1 -- 172.21.15.59:0/806880815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf813e610 con 0x7fedf815b980 2024-04-25T09:09:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedfcc00640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedf80cc440 0x7fedf813e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedfd600640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf815b980 0x7fedf80caa10 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fedf00af040 tx=0x7fedf0019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:53.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedf4c00640 1 -- 172.21.15.59:0/806880815 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00bc020 con 0x7fedf815b980 2024-04-25T09:09:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedf4c00640 1 -- 172.21.15.59:0/806880815 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf00b8470 con 0x7fedf815b980 2024-04-25T09:09:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedf4c00640 1 -- 172.21.15.59:0/806880815 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00a58e0 con 0x7fedf815b980 2024-04-25T09:09:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedff600640 1 -- 172.21.15.59:0/806880815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf80b18a0 con 0x7fedf815b980 2024-04-25T09:09:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.203+0000 7fedff600640 1 -- 172.21.15.59:0/806880815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf80b1e60 con 0x7fedf815b980 2024-04-25T09:09:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.207+0000 7fedff600640 1 -- 172.21.15.59:0/806880815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf80745d0 con 0x7fedf815b980 2024-04-25T09:09:53.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.207+0000 7fedf4c00640 1 -- 172.21.15.59:0/806880815 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fedf00bf020 con 0x7fedf815b980 2024-04-25T09:09:53.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.207+0000 7fedf4c00640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fedd8066f60 0x7fedd8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.207+0000 7fedf4c00640 1 -- 172.21.15.59:0/806880815 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fedf0120470 con 0x7fedf815b980 2024-04-25T09:09:53.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.207+0000 7fedfcc00640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fedd8066f60 0x7fedd8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.207+0000 7fedfcc00640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fedd8066f60 0x7fedd8069420 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fedec009eb0 tx=0x7fedec009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.211+0000 7fedf4c00640 1 -- 172.21.15.59:0/806880815 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fedf00c6070 con 0x7fedf815b980 2024-04-25T09:09:53.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.375+0000 7fedff600640 1 -- 172.21.15.59:0/806880815 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedf80ceeb0 con 0x7fedf815b980 2024-04-25T09:09:53.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.375+0000 7fedf4c00640 1 -- 172.21.15.59:0/806880815 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+17338 (secure 0 0 0) 0x7fedf813e610 con 0x7fedf815b980 2024-04-25T09:09:53.365 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:53.365 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":96,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:09:12.143679+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:47.301822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:47.878097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.12","mappings":[{"from":1,"to":5}]},{"pgid":"14.1a","mappings":[{"from":1,"to":2}]},{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.38","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/4079513876":"2024-04-26T09:09:12.143656+0000","172.21.15.59:6833/4079513876":"2024-04-26T09:09:12.143656+0000","172.21.15.59:6835/3531112441":"2024-04-26T09:07:59.742787+0000","172.21.15.59:6833/3531112441":"2024-04-26T09:07:59.742787+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:53.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.379+0000 7fedff600640 1 -- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fedd8066f60 msgr2=0x7fedd8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.379+0000 7fedff600640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fedd8066f60 0x7fedd8069420 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fedec009eb0 tx=0x7fedec009190 comp rx=0 tx=0).stop 2024-04-25T09:09:53.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.379+0000 7fedff600640 1 -- 172.21.15.59:0/806880815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf815b980 msgr2=0x7fedf80caa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.379+0000 7fedff600640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf815b980 0x7fedf80caa10 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fedf00af040 tx=0x7fedf0019790 comp rx=0 tx=0).stop 2024-04-25T09:09:53.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.379+0000 7fedff600640 1 -- 172.21.15.59:0/806880815 shutdown_connections 2024-04-25T09:09:53.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.379+0000 7fedff600640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fedd8066f60 0x7fedd8069420 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.379+0000 7fedff600640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fedf815b980 0x7fedf80caa10 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.379+0000 7fedff600640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fedf815b5a0 0x7fedf813acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.379+0000 7fedff600640 1 --2- 172.21.15.59:0/806880815 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fedf80cc440 0x7fedf813e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.379+0000 7fedff600640 1 -- 172.21.15.59:0/806880815 >> 172.21.15.59:0/806880815 conn(0x7fedf80b3390 msgr2=0x7fedf80b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:53.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.379+0000 7fedff600640 1 -- 172.21.15.59:0/806880815 shutdown_connections 2024-04-25T09:09:53.368 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.379+0000 7fedff600640 1 -- 172.21.15.59:0/806880815 wait complete. 2024-04-25T09:09:53.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:07:47.301822+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:07:47.878097+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:09:53.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:09:53.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.543+0000 7f882b600640 1 Processor -- start 2024-04-25T09:09:53.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.543+0000 7f882b600640 1 -- start start 2024-04-25T09:09:53.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.543+0000 7f882b600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240b4810 0x7f88240d04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.543+0000 7f882b600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882406e5f0 con 0x7f882406e0f0 2024-04-25T09:09:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.543+0000 7f882b600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f882406e8d0 con 0x7f8824161cf0 2024-04-25T09:09:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.543+0000 7f882b600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882406ebb0 con 0x7f88240b4810 2024-04-25T09:09:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.543+0000 7f8823e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f882406e0f0 0x7f88241615e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38486/0 (socket says 172.21.15.59:38486) 2024-04-25T09:09:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.543+0000 7f8823e00640 1 -- 172.21.15.59:0/3817983889 learned_addr learned my addr 172.21.15.59:0/3817983889 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.543+0000 7f8828c00640 1 --2- 172.21.15.59:0/3817983889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240b4810 0x7f88240d04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.543+0000 7f8823400640 1 -- 172.21.15.59:0/3817983889 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1428221999 0 0) 0x7f882406e5f0 con 0x7f882406e0f0 2024-04-25T09:09:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.547+0000 7f8823400640 1 -- 172.21.15.59:0/3817983889 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f880c003530 con 0x7f882406e0f0 2024-04-25T09:09:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.547+0000 7f8823400640 1 -- 172.21.15.59:0/3817983889 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727359670 0 0) 0x7f882406e8d0 con 0x7f8824161cf0 2024-04-25T09:09:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.547+0000 7f8823400640 1 -- 172.21.15.59:0/3817983889 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f882406e5f0 con 0x7f8824161cf0 2024-04-25T09:09:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.547+0000 7f8828c00640 1 -- 172.21.15.59:0/3817983889 >> v1:172.21.15.178:6789/0 conn(0x7f8824161cf0 legacy=0x7f88240b2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.547+0000 7f8828c00640 1 -- 172.21.15.59:0/3817983889 >> v1:172.21.15.59:6789/0 conn(0x7f882406e0f0 legacy=0x7f88241615e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.547+0000 7f8828c00640 1 -- 172.21.15.59:0/3817983889 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f882406ee90 con 0x7f88240b4810 2024-04-25T09:09:53.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.547+0000 7f8828c00640 1 --2- 172.21.15.59:0/3817983889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240b4810 0x7f88240d04e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f88180097f0 tx=0x7f881801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acf9ac96c37fa59f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:53.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.547+0000 7f8823400640 1 -- 172.21.15.59:0/3817983889 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88180b0070 con 0x7f88240b4810 2024-04-25T09:09:53.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.547+0000 7f8823400640 1 -- 172.21.15.59:0/3817983889 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88180ab600 con 0x7f88240b4810 2024-04-25T09:09:53.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.547+0000 7f8823400640 1 -- 172.21.15.59:0/3817983889 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88180ab9d0 con 0x7f88240b4810 2024-04-25T09:09:53.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.547+0000 7f882b600640 1 -- 172.21.15.59:0/3817983889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240b4810 msgr2=0x7f88240d04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.547+0000 7f882b600640 1 --2- 172.21.15.59:0/3817983889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240b4810 0x7f88240d04e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f88180097f0 tx=0x7f881801c450 comp rx=0 tx=0).stop 2024-04-25T09:09:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 -- 172.21.15.59:0/3817983889 shutdown_connections 2024-04-25T09:09:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 --2- 172.21.15.59:0/3817983889 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f88240b4810 0x7f88240d04e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 -- 172.21.15.59:0/3817983889 >> 172.21.15.59:0/3817983889 conn(0x7f88240cf9c0 msgr2=0x7f88240cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 -- 172.21.15.59:0/3817983889 shutdown_connections 2024-04-25T09:09:53.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 -- 172.21.15.59:0/3817983889 wait complete. 2024-04-25T09:09:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 Processor -- start 2024-04-25T09:09:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 -- start start 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882406e0f0 0x7f88240cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88240b4810 0x7f8824150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8824161cf0 0x7f88241539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88240b3ff0 con 0x7f88240b4810 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88240b3e70 con 0x7f882406e0f0 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882416b990 con 0x7f8824161cf0 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8823e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88240b4810 0x7f8824150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8823e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88240b4810 0x7f8824150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40250/0 (socket says 172.21.15.59:40250) 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8823e00640 1 -- 172.21.15.59:0/75573346 learned_addr learned my addr 172.21.15.59:0/75573346 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8828c00640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882406e0f0 0x7f88240cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8829600640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8824161cf0 0x7f88241539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8823e00640 1 -- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8824161cf0 msgr2=0x7f88241539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8823e00640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8824161cf0 0x7f88241539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8823e00640 1 -- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882406e0f0 msgr2=0x7f88240cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8823e00640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882406e0f0 0x7f88240cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8823e00640 1 -- 172.21.15.59:0/75573346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88240ce8f0 con 0x7f88240b4810 2024-04-25T09:09:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8823e00640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88240b4810 0x7f8824150460 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f881000c4d0 tx=0x7f881000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8820c00640 1 -- 172.21.15.59:0/75573346 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8810017070 con 0x7f88240b4810 2024-04-25T09:09:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8820c00640 1 -- 172.21.15.59:0/75573346 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8810005cf0 con 0x7f88240b4810 2024-04-25T09:09:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f8820c00640 1 -- 172.21.15.59:0/75573346 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88100072b0 con 0x7f88240b4810 2024-04-25T09:09:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.551+0000 7f882b600640 1 -- 172.21.15.59:0/75573346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88240cebd0 con 0x7f88240b4810 2024-04-25T09:09:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.555+0000 7f882b600640 1 -- 172.21.15.59:0/75573346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f882414e060 con 0x7f88240b4810 2024-04-25T09:09:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.555+0000 7f882b600640 1 -- 172.21.15.59:0/75573346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88240745d0 con 0x7f88240b4810 2024-04-25T09:09:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.555+0000 7f8820c00640 1 -- 172.21.15.59:0/75573346 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f881001a070 con 0x7f88240b4810 2024-04-25T09:09:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.555+0000 7f8820c00640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8804066f60 0x7f8804069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.555+0000 7f8820c00640 1 -- 172.21.15.59:0/75573346 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f8810084640 con 0x7f88240b4810 2024-04-25T09:09:53.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.555+0000 7f8828c00640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8804066f60 0x7f8804069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.555+0000 7f8828c00640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8804066f60 0x7f8804069420 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f88180ad000 tx=0x7f8818008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.559+0000 7f8820c00640 1 -- 172.21.15.59:0/75573346 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8810054d40 con 0x7f88240b4810 2024-04-25T09:09:53.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:53.617 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:09:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 -- 172.21.15.59:0/75573346 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88240cbe00 con 0x7f88240b4810 2024-04-25T09:09:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f8820c00640 1 -- 172.21.15.59:0/75573346 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8810058de0 con 0x7f88240b4810 2024-04-25T09:09:53.711 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:09:53.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 -- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8804066f60 msgr2=0x7f8804069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8804066f60 0x7f8804069420 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f88180ad000 tx=0x7f8818008040 comp rx=0 tx=0).stop 2024-04-25T09:09:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 -- 172.21.15.59:0/75573346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88240b4810 msgr2=0x7f8824150460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88240b4810 0x7f8824150460 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f881000c4d0 tx=0x7f881000c990 comp rx=0 tx=0).stop 2024-04-25T09:09:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 -- 172.21.15.59:0/75573346 shutdown_connections 2024-04-25T09:09:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8804066f60 0x7f8804069420 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8824161cf0 0x7f88241539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88240b4810 0x7f8824150460 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 --2- 172.21.15.59:0/75573346 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f882406e0f0 0x7f88240cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 -- 172.21.15.59:0/75573346 >> 172.21.15.59:0/75573346 conn(0x7f88240cf9c0 msgr2=0x7f88240affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 -- 172.21.15.59:0/75573346 shutdown_connections 2024-04-25T09:09:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.723+0000 7f882b600640 1 -- 172.21.15.59:0/75573346 wait complete. 2024-04-25T09:09:53.734 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:09:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafec800640 1 Processor -- start 2024-04-25T09:09:53.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafec800640 1 -- start start 2024-04-25T09:09:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafec800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafe4072210 0x7fafe40cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafec800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fafe40ce1d0 0x7fafe40ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafec800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe406ac10 con 0x7fafe415dd90 2024-04-25T09:09:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafec800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe40b2dc0 con 0x7fafe40ce1d0 2024-04-25T09:09:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafec800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe406aeb0 con 0x7fafe4072210 2024-04-25T09:09:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafe9e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fafe415dd90 0x7fafe4071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38488/0 (socket says 172.21.15.59:38488) 2024-04-25T09:09:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafe9e00640 1 -- 172.21.15.59:0/3875940079 learned_addr learned my addr 172.21.15.59:0/3875940079 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafe9400640 1 --2- 172.21.15.59:0/3875940079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafe4072210 0x7fafe40cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafea800640 1 --2- 172.21.15.59:0/3875940079 >> v2:172.21.15.178:3300/0 conn(0x7fafe40ce1d0 0x7fafe40ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafe8a00640 1 -- 172.21.15.59:0/3875940079 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799951113 0 0) 0x7fafe406ac10 con 0x7fafe415dd90 2024-04-25T09:09:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafe8a00640 1 -- 172.21.15.59:0/3875940079 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafcc003530 con 0x7fafe415dd90 2024-04-25T09:09:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafe9400640 1 -- 172.21.15.59:0/3875940079 >> v2:172.21.15.178:3300/0 conn(0x7fafe40ce1d0 msgr2=0x7fafe40ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafe9400640 1 --2- 172.21.15.59:0/3875940079 >> v2:172.21.15.178:3300/0 conn(0x7fafe40ce1d0 0x7fafe40ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafe9400640 1 -- 172.21.15.59:0/3875940079 >> v1:172.21.15.59:6789/0 conn(0x7fafe415dd90 legacy=0x7fafe4071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafe9400640 1 -- 172.21.15.59:0/3875940079 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe406b190 con 0x7fafe4072210 2024-04-25T09:09:53.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.891+0000 7fafea800640 1 --2- 172.21.15.59:0/3875940079 >> v2:172.21.15.178:3300/0 conn(0x7fafe40ce1d0 0x7fafe40ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.895+0000 7fafe9400640 1 --2- 172.21.15.59:0/3875940079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafe4072210 0x7fafe40cdc90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fafd40097c0 tx=0x7fafd401c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97a1d663a57f8bfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.895+0000 7fafe8a00640 1 -- 172.21.15.59:0/3875940079 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd40b0070 con 0x7fafe4072210 2024-04-25T09:09:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.895+0000 7fafe8a00640 1 -- 172.21.15.59:0/3875940079 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd40ab600 con 0x7fafe4072210 2024-04-25T09:09:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.895+0000 7fafe8a00640 1 -- 172.21.15.59:0/3875940079 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd40ab9d0 con 0x7fafe4072210 2024-04-25T09:09:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.895+0000 7fafec800640 1 -- 172.21.15.59:0/3875940079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafe4072210 msgr2=0x7fafe40cdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.895+0000 7fafec800640 1 --2- 172.21.15.59:0/3875940079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafe4072210 0x7fafe40cdc90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fafd40097c0 tx=0x7fafd401c410 comp rx=0 tx=0).stop 2024-04-25T09:09:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.895+0000 7fafec800640 1 -- 172.21.15.59:0/3875940079 shutdown_connections 2024-04-25T09:09:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.895+0000 7fafec800640 1 --2- 172.21.15.59:0/3875940079 >> v2:172.21.15.178:3300/0 conn(0x7fafe40ce1d0 0x7fafe40ce640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.895+0000 7fafec800640 1 --2- 172.21.15.59:0/3875940079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafe4072210 0x7fafe40cdc90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.895+0000 7fafec800640 1 -- 172.21.15.59:0/3875940079 >> 172.21.15.59:0/3875940079 conn(0x7fafe40cfd90 msgr2=0x7fafe40d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.895+0000 7fafec800640 1 -- 172.21.15.59:0/3875940079 shutdown_connections 2024-04-25T09:09:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.895+0000 7fafec800640 1 -- 172.21.15.59:0/3875940079 wait complete. 2024-04-25T09:09:53.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafec800640 1 Processor -- start 2024-04-25T09:09:53.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafec800640 1 -- start start 2024-04-25T09:09:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafec800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafe4072210 0x7fafe40af780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafec800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafe40ce1d0 0x7fafe414fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafec800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafe415dd90 0x7fafe40ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafec800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40cf760 con 0x7fafe4072210 2024-04-25T09:09:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafec800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40cf5e0 con 0x7fafe415dd90 2024-04-25T09:09:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafec800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe40cf8e0 con 0x7fafe40ce1d0 2024-04-25T09:09:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafe9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafe4072210 0x7fafe40af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafe9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafe4072210 0x7fafe40af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40262/0 (socket says 172.21.15.59:40262) 2024-04-25T09:09:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafe9e00640 1 -- 172.21.15.59:0/239986432 learned_addr learned my addr 172.21.15.59:0/239986432 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafea800640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafe415dd90 0x7fafe40ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafe9400640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafe40ce1d0 0x7fafe414fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafe9e00640 1 -- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafe40ce1d0 msgr2=0x7fafe414fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafe9e00640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafe40ce1d0 0x7fafe414fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafe9e00640 1 -- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafe415dd90 msgr2=0x7fafe40ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:53.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafe9e00640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafe415dd90 0x7fafe40ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:53.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafe9e00640 1 -- 172.21.15.59:0/239986432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe415eae0 con 0x7fafe4072210 2024-04-25T09:09:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafe9e00640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafe4072210 0x7fafe40af780 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fafd800c3c0 tx=0x7fafd800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafde000640 1 -- 172.21.15.59:0/239986432 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd8017070 con 0x7fafe4072210 2024-04-25T09:09:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafde000640 1 -- 172.21.15.59:0/239986432 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd8005db0 con 0x7fafe4072210 2024-04-25T09:09:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafde000640 1 -- 172.21.15.59:0/239986432 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd80072f0 con 0x7fafe4072210 2024-04-25T09:09:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafec800640 1 -- 172.21.15.59:0/239986432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe415e320 con 0x7fafe4072210 2024-04-25T09:09:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafec800640 1 -- 172.21.15.59:0/239986432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe4156e90 con 0x7fafe4072210 2024-04-25T09:09:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.899+0000 7fafec800640 1 -- 172.21.15.59:0/239986432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe40745d0 con 0x7fafe4072210 2024-04-25T09:09:53.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.903+0000 7fafde000640 1 -- 172.21.15.59:0/239986432 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fafd801a070 con 0x7fafe4072210 2024-04-25T09:09:53.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.903+0000 7fafde000640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fafc8066f60 0x7fafc8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:53.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.903+0000 7fafde000640 1 -- 172.21.15.59:0/239986432 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fafd80846a0 con 0x7fafe4072210 2024-04-25T09:09:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.903+0000 7fafe9400640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fafc8066f60 0x7fafc8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:53.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.903+0000 7fafe9400640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fafc8066f60 0x7fafc8069420 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fafd40ad000 tx=0x7fafd4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:53.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:53.907+0000 7fafde000640 1 -- 172.21.15.59:0/239986432 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fafd8054da0 con 0x7fafe4072210 2024-04-25T09:09:54.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafec800640 1 -- 172.21.15.59:0/239986432 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fafe40ce960 con 0x7fafe4072210 2024-04-25T09:09:54.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafde000640 1 -- 172.21.15.59:0/239986432 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7fafd805b0f0 con 0x7fafe4072210 2024-04-25T09:09:54.056 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:09:54.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafec800640 1 -- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fafc8066f60 msgr2=0x7fafc8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafec800640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fafc8066f60 0x7fafc8069420 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fafd40ad000 tx=0x7fafd4008040 comp rx=0 tx=0).stop 2024-04-25T09:09:54.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafec800640 1 -- 172.21.15.59:0/239986432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafe4072210 msgr2=0x7fafe40af780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafec800640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafe4072210 0x7fafe40af780 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fafd800c3c0 tx=0x7fafd800c7c0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafec800640 1 -- 172.21.15.59:0/239986432 shutdown_connections 2024-04-25T09:09:54.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafec800640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fafc8066f60 0x7fafc8069420 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafec800640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fafe415dd90 0x7fafe40ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafec800640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fafe40ce1d0 0x7fafe414fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafec800640 1 --2- 172.21.15.59:0/239986432 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafe4072210 0x7fafe40af780 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafec800640 1 -- 172.21.15.59:0/239986432 >> 172.21.15.59:0/239986432 conn(0x7fafe40cfd90 msgr2=0x7fafe4161d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.067+0000 7fafec800640 1 -- 172.21.15.59:0/239986432 shutdown_connections 2024-04-25T09:09:54.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.071+0000 7fafec800640 1 -- 172.21.15.59:0/239986432 wait complete. 2024-04-25T09:09:54.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:09:54.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.231+0000 7f0bd7000640 1 Processor -- start 2024-04-25T09:09:54.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.231+0000 7f0bd7000640 1 -- start start 2024-04-25T09:09:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.231+0000 7f0bd7000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0bd015dd90 0x7f0bd0071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.231+0000 7f0bd7000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0bd0161e90 0x7f0bd00ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.231+0000 7f0bd7000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bd0072460 con 0x7f0bd0072040 2024-04-25T09:09:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.231+0000 7f0bd7000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd00b2dc0 con 0x7f0bd015dd90 2024-04-25T09:09:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.231+0000 7f0bd7000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bd006ac10 con 0x7f0bd0161e90 2024-04-25T09:09:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.231+0000 7f0bcfe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0bd015dd90 0x7f0bd0071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.231+0000 7f0bc7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0bd0072040 0x7f0bd0161780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38496/0 (socket says 172.21.15.59:38496) 2024-04-25T09:09:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.231+0000 7f0bc7400640 1 -- 172.21.15.59:0/844676811 learned_addr learned my addr 172.21.15.59:0/844676811 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bd5000640 1 --2- 172.21.15.59:0/844676811 >> v2:172.21.15.178:3300/0 conn(0x7f0bd0161e90 0x7f0bd00ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bcfe00640 1 -- 172.21.15.59:0/844676811 >> v2:172.21.15.178:3300/0 conn(0x7f0bd0161e90 msgr2=0x7f0bd00ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bcfe00640 1 --2- 172.21.15.59:0/844676811 >> v2:172.21.15.178:3300/0 conn(0x7f0bd0161e90 0x7f0bd00ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bcfe00640 1 -- 172.21.15.59:0/844676811 >> v1:172.21.15.59:6789/0 conn(0x7f0bd0072040 legacy=0x7f0bd0161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bcf400640 1 -- 172.21.15.59:0/844676811 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373139236 0 0) 0x7f0bd0072460 con 0x7f0bd0072040 2024-04-25T09:09:54.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bcfe00640 1 -- 172.21.15.59:0/844676811 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd006aeb0 con 0x7f0bd015dd90 2024-04-25T09:09:54.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bcfe00640 1 --2- 172.21.15.59:0/844676811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bd015dd90 0x7f0bd0071b00 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0162820 tx=0x7f0bc001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975cff285775e203 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bcf400640 1 -- 172.21.15.59:0/844676811 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00b2070 con 0x7f0bd015dd90 2024-04-25T09:09:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bcf400640 1 -- 172.21.15.59:0/844676811 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bc00a5850 con 0x7f0bd015dd90 2024-04-25T09:09:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bcf400640 1 -- 172.21.15.59:0/844676811 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc00a5c20 con 0x7f0bd015dd90 2024-04-25T09:09:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bd7000640 1 -- 172.21.15.59:0/844676811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bd015dd90 msgr2=0x7f0bd0071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bd7000640 1 --2- 172.21.15.59:0/844676811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bd015dd90 0x7f0bd0071b00 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0162820 tx=0x7f0bc001c8a0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bd7000640 1 -- 172.21.15.59:0/844676811 shutdown_connections 2024-04-25T09:09:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bd7000640 1 --2- 172.21.15.59:0/844676811 >> v2:172.21.15.178:3300/0 conn(0x7f0bd0161e90 0x7f0bd00ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bd7000640 1 --2- 172.21.15.59:0/844676811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bd015dd90 0x7f0bd0071b00 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bd7000640 1 -- 172.21.15.59:0/844676811 >> 172.21.15.59:0/844676811 conn(0x7f0bd00cfd90 msgr2=0x7f0bd00d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bd7000640 1 -- 172.21.15.59:0/844676811 shutdown_connections 2024-04-25T09:09:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.235+0000 7f0bd7000640 1 -- 172.21.15.59:0/844676811 wait complete. 2024-04-25T09:09:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bd7000640 1 Processor -- start 2024-04-25T09:09:54.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bd7000640 1 -- start start 2024-04-25T09:09:54.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bd7000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bd0072040 0x7f0bd00af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bd7000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bd015dd90 0x7f0bd0157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bd7000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bd0161e90 0x7f0bd0155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bd7000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd016ac40 con 0x7f0bd015dd90 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bd7000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd016aac0 con 0x7f0bd0161e90 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bd7000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd016adc0 con 0x7f0bd0072040 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bc7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bd015dd90 0x7f0bd0157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bc7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bd015dd90 0x7f0bd0157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40268/0 (socket says 172.21.15.59:40268) 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bc7400640 1 -- 172.21.15.59:0/366624573 learned_addr learned my addr 172.21.15.59:0/366624573 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bd5000640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bd0161e90 0x7f0bd0155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bcfe00640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bd0072040 0x7f0bd00af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bc7400640 1 -- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bd0072040 msgr2=0x7f0bd00af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bc7400640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bd0072040 0x7f0bd00af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bc7400640 1 -- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bd0161e90 msgr2=0x7f0bd0155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bc7400640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bd0161e90 0x7f0bd0155ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bc7400640 1 -- 172.21.15.59:0/366624573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd0159db0 con 0x7f0bd015dd90 2024-04-25T09:09:54.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bd5000640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bd0161e90 0x7f0bd0155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:54.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bc7400640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bd015dd90 0x7f0bd0157100 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800c4b0 tx=0x7f0bb800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bccc00640 1 -- 172.21.15.59:0/366624573 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8018070 con 0x7f0bd015dd90 2024-04-25T09:09:54.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bccc00640 1 -- 172.21.15.59:0/366624573 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb8007500 con 0x7f0bd015dd90 2024-04-25T09:09:54.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bccc00640 1 -- 172.21.15.59:0/366624573 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb8004a30 con 0x7f0bd015dd90 2024-04-25T09:09:54.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bd7000640 1 -- 172.21.15.59:0/366624573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd015a090 con 0x7f0bd015dd90 2024-04-25T09:09:54.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.239+0000 7f0bd7000640 1 -- 172.21.15.59:0/366624573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd015a650 con 0x7f0bd015dd90 2024-04-25T09:09:54.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.243+0000 7f0bd7000640 1 -- 172.21.15.59:0/366624573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bd00ace30 con 0x7f0bd015dd90 2024-04-25T09:09:54.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.243+0000 7f0bccc00640 1 -- 172.21.15.59:0/366624573 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0bb801b070 con 0x7f0bd015dd90 2024-04-25T09:09:54.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.243+0000 7f0bccc00640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0bac066f60 0x7f0bac069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.243+0000 7f0bccc00640 1 -- 172.21.15.59:0/366624573 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f0bb80845e0 con 0x7f0bd015dd90 2024-04-25T09:09:54.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.243+0000 7f0bcfe00640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0bac066f60 0x7f0bac069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.247+0000 7f0bcfe00640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0bac066f60 0x7f0bac069420 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00af000 tx=0x7f0bc00a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.247+0000 7f0bccc00640 1 -- 172.21.15.59:0/366624573 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0bb8055330 con 0x7f0bd015dd90 2024-04-25T09:09:54.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 -- 172.21.15.59:0/366624573 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0bd0067820 con 0x7f0bd015dd90 2024-04-25T09:09:54.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bccc00640 1 -- 172.21.15.59:0/366624573 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0bb8054c30 con 0x7f0bd015dd90 2024-04-25T09:09:54.400 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:09:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 -- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0bac066f60 msgr2=0x7f0bac069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0bac066f60 0x7f0bac069420 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0bc00af000 tx=0x7f0bc00a7070 comp rx=0 tx=0).stop 2024-04-25T09:09:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 -- 172.21.15.59:0/366624573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bd015dd90 msgr2=0x7f0bd0157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bd015dd90 0x7f0bd0157100 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f0bb800c4b0 tx=0x7f0bb800c970 comp rx=0 tx=0).stop 2024-04-25T09:09:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 -- 172.21.15.59:0/366624573 shutdown_connections 2024-04-25T09:09:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0bac066f60 0x7f0bac069420 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bd0161e90 0x7f0bd0155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bd015dd90 0x7f0bd0157100 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 --2- 172.21.15.59:0/366624573 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bd0072040 0x7f0bd00af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 -- 172.21.15.59:0/366624573 >> 172.21.15.59:0/366624573 conn(0x7f0bd00cfd90 msgr2=0x7f0bd00cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:54.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 -- 172.21.15.59:0/366624573 shutdown_connections 2024-04-25T09:09:54.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.411+0000 7f0bd7000640 1 -- 172.21.15.59:0/366624573 wait complete. 2024-04-25T09:09:54.421 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.571+0000 7f0b77a00640 1 Processor -- start 2024-04-25T09:09:54.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.571+0000 7f0b77a00640 1 -- start start 2024-04-25T09:09:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b77a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b7015fe50 0x7f0b700b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b77a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0b700b1c90 0x7f0b7015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b77a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b700b20a0 con 0x7f0b70145270 2024-04-25T09:09:54.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b77a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b70145650 con 0x7f0b7015fe50 2024-04-25T09:09:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b77a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b701602b0 con 0x7f0b700b1c90 2024-04-25T09:09:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b67e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0b7015fe50 0x7f0b700b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b75000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0b70145270 0x7f0b700cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38512/0 (socket says 172.21.15.59:38512) 2024-04-25T09:09:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b75000640 1 -- 172.21.15.59:0/1887625117 learned_addr learned my addr 172.21.15.59:0/1887625117 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:54.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b75a00640 1 --2- 172.21.15.59:0/1887625117 >> v2:172.21.15.178:3300/0 conn(0x7f0b700b1c90 0x7f0b7015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b67e00640 1 -- 172.21.15.59:0/1887625117 >> v2:172.21.15.178:3300/0 conn(0x7f0b700b1c90 msgr2=0x7f0b7015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:54.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b67e00640 1 --2- 172.21.15.59:0/1887625117 >> v2:172.21.15.178:3300/0 conn(0x7f0b700b1c90 0x7f0b7015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b67e00640 1 -- 172.21.15.59:0/1887625117 >> v1:172.21.15.59:6789/0 conn(0x7f0b70145270 legacy=0x7f0b700cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b67e00640 1 -- 172.21.15.59:0/1887625117 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b700cc4e0 con 0x7f0b7015fe50 2024-04-25T09:09:54.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b67e00640 1 --2- 172.21.15.59:0/1887625117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b7015fe50 0x7f0b700b1750 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f0b700b4b90 tx=0x7f0b5801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230d6a8bff6717b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.575+0000 7f0b6fe00640 1 -- 172.21.15.59:0/1887625117 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580ab430 con 0x7f0b7015fe50 2024-04-25T09:09:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b6fe00640 1 -- 172.21.15.59:0/1887625117 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580b0070 con 0x7f0b7015fe50 2024-04-25T09:09:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b6fe00640 1 -- 172.21.15.59:0/1887625117 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580ab7f0 con 0x7f0b7015fe50 2024-04-25T09:09:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 -- 172.21.15.59:0/1887625117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b7015fe50 msgr2=0x7f0b700b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 --2- 172.21.15.59:0/1887625117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b7015fe50 0x7f0b700b1750 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f0b700b4b90 tx=0x7f0b5801c430 comp rx=0 tx=0).stop 2024-04-25T09:09:54.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 -- 172.21.15.59:0/1887625117 shutdown_connections 2024-04-25T09:09:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 --2- 172.21.15.59:0/1887625117 >> v2:172.21.15.178:3300/0 conn(0x7f0b700b1c90 0x7f0b7015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 --2- 172.21.15.59:0/1887625117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b7015fe50 0x7f0b700b1750 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 -- 172.21.15.59:0/1887625117 >> 172.21.15.59:0/1887625117 conn(0x7f0b70066fa0 msgr2=0x7f0b7006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 -- 172.21.15.59:0/1887625117 shutdown_connections 2024-04-25T09:09:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 -- 172.21.15.59:0/1887625117 wait complete. 2024-04-25T09:09:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 Processor -- start 2024-04-25T09:09:54.568 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 -- start start 2024-04-25T09:09:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b700b1c90 0x7f0b7015aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b70145270 0x7f0b70140a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b7015fe50 0x7f0b70140f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7015f930 con 0x7f0b700b1c90 2024-04-25T09:09:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b7015f650 con 0x7f0b70145270 2024-04-25T09:09:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b77a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b700cdbe0 con 0x7f0b7015fe50 2024-04-25T09:09:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b75000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b700b1c90 0x7f0b7015aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b75000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b700b1c90 0x7f0b7015aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40274/0 (socket says 172.21.15.59:40274) 2024-04-25T09:09:54.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.579+0000 7f0b75000640 1 -- 172.21.15.59:0/267452005 learned_addr learned my addr 172.21.15.59:0/267452005 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b75000640 1 -- 172.21.15.59:0/267452005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b7015fe50 msgr2=0x7f0b70140f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b75000640 1 --2- 172.21.15.59:0/267452005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b7015fe50 0x7f0b70140f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b75000640 1 -- 172.21.15.59:0/267452005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b70145270 msgr2=0x7f0b70140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b75000640 1 --2- 172.21.15.59:0/267452005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b70145270 0x7f0b70140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b75000640 1 -- 172.21.15.59:0/267452005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b70141590 con 0x7f0b700b1c90 2024-04-25T09:09:54.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b75000640 1 --2- 172.21.15.59:0/267452005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b700b1c90 0x7f0b7015aa10 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000c450 tx=0x7f0b6000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b6d600640 1 -- 172.21.15.59:0/267452005 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60017070 con 0x7f0b700b1c90 2024-04-25T09:09:54.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b6d600640 1 -- 172.21.15.59:0/267452005 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b60005cf0 con 0x7f0b700b1c90 2024-04-25T09:09:54.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b77a00640 1 -- 172.21.15.59:0/267452005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b70141870 con 0x7f0b700b1c90 2024-04-25T09:09:54.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b6d600640 1 -- 172.21.15.59:0/267452005 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b60007270 con 0x7f0b700b1c90 2024-04-25T09:09:54.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b77a00640 1 -- 172.21.15.59:0/267452005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b70141e30 con 0x7f0b700b1c90 2024-04-25T09:09:54.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b77a00640 1 -- 172.21.15.59:0/267452005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b700745d0 con 0x7f0b700b1c90 2024-04-25T09:09:54.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b6d600640 1 -- 172.21.15.59:0/267452005 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0b6001a070 con 0x7f0b700b1c90 2024-04-25T09:09:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b6d600640 1 --2- 172.21.15.59:0/267452005 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0b4c066f60 0x7f0b4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.583+0000 7f0b6d600640 1 -- 172.21.15.59:0/267452005 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f0b60084580 con 0x7f0b700b1c90 2024-04-25T09:09:54.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.587+0000 7f0b67e00640 1 --2- 172.21.15.59:0/267452005 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0b4c066f60 0x7f0b4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.587+0000 7f0b67e00640 1 --2- 172.21.15.59:0/267452005 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0b4c066f60 0x7f0b4c069420 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0b580af000 tx=0x7f0b58004740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.587+0000 7f0b6d600640 1 -- 172.21.15.59:0/267452005 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0b700b20a0 con 0x7f0b700b1c90 2024-04-25T09:09:54.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.787+0000 7f0b77a00640 1 -- 172.21.15.59:0/267452005 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b7015b7e0 con 0x7f0b700b1c90 2024-04-25T09:09:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.787+0000 7f0b6d600640 1 -- 172.21.15.59:0/267452005 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f0b60054bf0 con 0x7f0b700b1c90 2024-04-25T09:09:54.777 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:54.777 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:09:15.158723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7965":{"gid":7965,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1467736863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1467736863},{"type":"v1","addr":"172.21.15.59:6835","nonce":1467736863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:09:54.777 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 78 2024-04-25T09:09:54.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.791+0000 7f0b77a00640 1 -- 172.21.15.59:0/267452005 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0b4c066f60 msgr2=0x7f0b4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.791+0000 7f0b77a00640 1 --2- 172.21.15.59:0/267452005 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0b4c066f60 0x7f0b4c069420 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0b580af000 tx=0x7f0b58004740 comp rx=0 tx=0).stop 2024-04-25T09:09:54.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.791+0000 7f0b77a00640 1 -- 172.21.15.59:0/267452005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b700b1c90 msgr2=0x7f0b7015aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.791+0000 7f0b77a00640 1 --2- 172.21.15.59:0/267452005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b700b1c90 0x7f0b7015aa10 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f0b6000c450 tx=0x7f0b6000c910 comp rx=0 tx=0).stop 2024-04-25T09:09:54.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.791+0000 7f0b77a00640 1 -- 172.21.15.59:0/267452005 shutdown_connections 2024-04-25T09:09:54.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.791+0000 7f0b77a00640 1 --2- 172.21.15.59:0/267452005 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0b4c066f60 0x7f0b4c069420 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.791+0000 7f0b77a00640 1 --2- 172.21.15.59:0/267452005 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0b7015fe50 0x7f0b70140f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.791+0000 7f0b77a00640 1 --2- 172.21.15.59:0/267452005 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0b70145270 0x7f0b70140a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.791+0000 7f0b77a00640 1 --2- 172.21.15.59:0/267452005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0b700b1c90 0x7f0b7015aa10 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.791+0000 7f0b77a00640 1 -- 172.21.15.59:0/267452005 >> 172.21.15.59:0/267452005 conn(0x7f0b70066fa0 msgr2=0x7f0b7013f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:54.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.791+0000 7f0b77a00640 1 -- 172.21.15.59:0/267452005 shutdown_connections 2024-04-25T09:09:54.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.791+0000 7f0b77a00640 1 -- 172.21.15.59:0/267452005 wait complete. 2024-04-25T09:09:54.799 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:54.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11e2800640 1 Processor -- start 2024-04-25T09:09:54.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11e2800640 1 -- start start 2024-04-25T09:09:54.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11e2800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11dc145270 0x7f11dc15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11e2800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11dc0b1e60 0x7f11dc0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11e2800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11dc0cc4e0 con 0x7f11dc0cd4d0 2024-04-25T09:09:54.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11e2800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11dc145650 con 0x7f11dc0b1e60 2024-04-25T09:09:54.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11e2800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc0ce040 con 0x7f11dc145270 2024-04-25T09:09:54.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11db400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11dc145270 0x7f11dc15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11dbe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f11dc0b1e60 0x7f11dc0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11db400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11dc145270 0x7f11dc15fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:60290/0 (socket says 172.21.15.59:60290) 2024-04-25T09:09:54.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11db400640 1 -- 172.21.15.59:0/1204966026 learned_addr learned my addr 172.21.15.59:0/1204966026 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:54.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11d3e00640 1 --1- 172.21.15.59:0/1204966026 >> v1:172.21.15.178:6789/0 conn(0x7f11dc0cd4d0 0x7f11dc0b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:40272/0 (socket says 172.21.15.59:40272) 2024-04-25T09:09:54.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11db400640 1 -- 172.21.15.59:0/1204966026 >> v2:172.21.15.178:3300/0 conn(0x7f11dc0b1e60 msgr2=0x7f11dc0cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:54.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11db400640 1 --2- 172.21.15.59:0/1204966026 >> v2:172.21.15.178:3300/0 conn(0x7f11dc0b1e60 0x7f11dc0cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11db400640 1 -- 172.21.15.59:0/1204966026 >> v1:172.21.15.178:6789/0 conn(0x7f11dc0cd4d0 legacy=0x7f11dc0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11db400640 1 -- 172.21.15.59:0/1204966026 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc0ce320 con 0x7f11dc145270 2024-04-25T09:09:54.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.951+0000 7f11dbe00640 1 --2- 172.21.15.59:0/1204966026 >> v2:172.21.15.178:3300/0 conn(0x7f11dc0b1e60 0x7f11dc0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:09:54.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.955+0000 7f11db400640 1 --2- 172.21.15.59:0/1204966026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11dc145270 0x7f11dc15fe50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009870 tx=0x7f11cc01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4715e2c0bf5d5ca8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.955+0000 7f11daa00640 1 -- 172.21.15.59:0/1204966026 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc0ab650 con 0x7f11dc145270 2024-04-25T09:09:54.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.955+0000 7f11daa00640 1 -- 172.21.15.59:0/1204966026 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc0b0070 con 0x7f11dc145270 2024-04-25T09:09:54.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.955+0000 7f11daa00640 1 -- 172.21.15.59:0/1204966026 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc0aba10 con 0x7f11dc145270 2024-04-25T09:09:54.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.955+0000 7f11e2800640 1 -- 172.21.15.59:0/1204966026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11dc145270 msgr2=0x7f11dc15fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.955+0000 7f11e2800640 1 --2- 172.21.15.59:0/1204966026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11dc145270 0x7f11dc15fe50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f11cc009870 tx=0x7f11cc01c560 comp rx=0 tx=0).stop 2024-04-25T09:09:54.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.955+0000 7f11e2800640 1 -- 172.21.15.59:0/1204966026 shutdown_connections 2024-04-25T09:09:54.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.955+0000 7f11e2800640 1 --2- 172.21.15.59:0/1204966026 >> v2:172.21.15.178:3300/0 conn(0x7f11dc0b1e60 0x7f11dc0cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.955+0000 7f11e2800640 1 --2- 172.21.15.59:0/1204966026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11dc145270 0x7f11dc15fe50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.955+0000 7f11e2800640 1 -- 172.21.15.59:0/1204966026 >> 172.21.15.59:0/1204966026 conn(0x7f11dc066fa0 msgr2=0x7f11dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:54.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.955+0000 7f11e2800640 1 -- 172.21.15.59:0/1204966026 shutdown_connections 2024-04-25T09:09:54.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.955+0000 7f11e2800640 1 -- 172.21.15.59:0/1204966026 wait complete. 2024-04-25T09:09:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11e2800640 1 Processor -- start 2024-04-25T09:09:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11e2800640 1 -- start start 2024-04-25T09:09:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11e2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc0b1e60 0x7f11dc142d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11e2800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11dc0cd4d0 0x7f11dc15b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11e2800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11dc145270 0x7f11dc0b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11e2800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15c710 con 0x7f11dc0b1e60 2024-04-25T09:09:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11e2800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15c590 con 0x7f11dc0cd4d0 2024-04-25T09:09:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11e2800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11dc15c890 con 0x7f11dc145270 2024-04-25T09:09:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11db400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc0b1e60 0x7f11dc142d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.951 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11db400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc0b1e60 0x7f11dc142d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40286/0 (socket says 172.21.15.59:40286) 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11db400640 1 -- 172.21.15.59:0/2095340504 learned_addr learned my addr 172.21.15.59:0/2095340504 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11dbe00640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11dc145270 0x7f11dc0b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11d3e00640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11dc0cd4d0 0x7f11dc15b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11db400640 1 -- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11dc145270 msgr2=0x7f11dc0b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11db400640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11dc145270 0x7f11dc0b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11db400640 1 -- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11dc0cd4d0 msgr2=0x7f11dc15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11db400640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11dc0cd4d0 0x7f11dc15b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11db400640 1 -- 172.21.15.59:0/2095340504 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11dc0b1c90 con 0x7f11dc0b1e60 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11db400640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc0b1e60 0x7f11dc142d40 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0ad040 tx=0x7f11cc01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11d3400640 1 -- 172.21.15.59:0/2095340504 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc0be5f0 con 0x7f11dc0b1e60 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11d3400640 1 -- 172.21.15.59:0/2095340504 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11cc0be790 con 0x7f11dc0b1e60 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11d3400640 1 -- 172.21.15.59:0/2095340504 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11cc0beb80 con 0x7f11dc0b1e60 2024-04-25T09:09:54.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11e2800640 1 -- 172.21.15.59:0/2095340504 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11dc138390 con 0x7f11dc0b1e60 2024-04-25T09:09:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.959+0000 7f11e2800640 1 -- 172.21.15.59:0/2095340504 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11dc138610 con 0x7f11dc0b1e60 2024-04-25T09:09:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.963+0000 7f11e2800640 1 -- 172.21.15.59:0/2095340504 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11dc0745d0 con 0x7f11dc0b1e60 2024-04-25T09:09:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.963+0000 7f11d3400640 1 -- 172.21.15.59:0/2095340504 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f11cc0b43f0 con 0x7f11dc0b1e60 2024-04-25T09:09:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.963+0000 7f11d3400640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f11b8066f60 0x7f11b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:54.953 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.963+0000 7f11d3400640 1 -- 172.21.15.59:0/2095340504 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f11cc11fcd0 con 0x7f11dc0b1e60 2024-04-25T09:09:54.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.963+0000 7f11d3e00640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f11b8066f60 0x7f11b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:54.954 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.963+0000 7f11d3e00640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f11b8066f60 0x7f11b8069420 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f11dc13a4c0 tx=0x7f11c4007cd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:54.957 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:54.967+0000 7f11d3400640 1 -- 172.21.15.59:0/2095340504 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f11dc138390 con 0x7f11dc0b1e60 2024-04-25T09:09:55.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.139+0000 7f11e2800640 1 -- 172.21.15.59:0/2095340504 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11dc06b8e0 con 0x7f11dc0b1e60 2024-04-25T09:09:55.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.139+0000 7f11d3400640 1 -- 172.21.15.59:0/2095340504 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+17338 (secure 0 0 0) 0x7f11cc016150 con 0x7f11dc0b1e60 2024-04-25T09:09:55.128 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:55.128 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":96,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:09:12.143679+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:47.301822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:47.878097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.12","mappings":[{"from":1,"to":5}]},{"pgid":"14.1a","mappings":[{"from":1,"to":2}]},{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.38","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/4079513876":"2024-04-26T09:09:12.143656+0000","172.21.15.59:6833/4079513876":"2024-04-26T09:09:12.143656+0000","172.21.15.59:6835/3531112441":"2024-04-26T09:07:59.742787+0000","172.21.15.59:6833/3531112441":"2024-04-26T09:07:59.742787+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:55.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.143+0000 7f11e2800640 1 -- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f11b8066f60 msgr2=0x7f11b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.143+0000 7f11e2800640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f11b8066f60 0x7f11b8069420 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f11dc13a4c0 tx=0x7f11c4007cd0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.143+0000 7f11e2800640 1 -- 172.21.15.59:0/2095340504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc0b1e60 msgr2=0x7f11dc142d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.143+0000 7f11e2800640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc0b1e60 0x7f11dc142d40 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f11cc0ad040 tx=0x7f11cc01ada0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.143+0000 7f11e2800640 1 -- 172.21.15.59:0/2095340504 shutdown_connections 2024-04-25T09:09:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.143+0000 7f11e2800640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f11b8066f60 0x7f11b8069420 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.143+0000 7f11e2800640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f11dc145270 0x7f11dc0b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.143+0000 7f11e2800640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f11dc0cd4d0 0x7f11dc15b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.143+0000 7f11e2800640 1 --2- 172.21.15.59:0/2095340504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11dc0b1e60 0x7f11dc142d40 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.143+0000 7f11e2800640 1 -- 172.21.15.59:0/2095340504 >> 172.21.15.59:0/2095340504 conn(0x7f11dc066fa0 msgr2=0x7f11dc144590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.143+0000 7f11e2800640 1 -- 172.21.15.59:0/2095340504 shutdown_connections 2024-04-25T09:09:55.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.143+0000 7f11e2800640 1 -- 172.21.15.59:0/2095340504 wait complete. 2024-04-25T09:09:55.150 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:09:55.151 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5d01000640 1 Processor -- start 2024-04-25T09:09:55.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5d01000640 1 -- start start 2024-04-25T09:09:55.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5d01000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cfc144140 0x7f5cfc0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5d01000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5cfc06ead0 0x7f5cfc0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5d01000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cfc15ac60 con 0x7f5cfc0ced60 2024-04-25T09:09:55.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5d01000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cfc0cf3e0 con 0x7f5cfc06ead0 2024-04-25T09:09:55.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5d01000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc15af20 con 0x7f5cfc144140 2024-04-25T09:09:55.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5cfa800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5cfc06ead0 0x7f5cfc0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5cfa800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5cfc06ead0 0x7f5cfc0b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40292/0 (socket says 172.21.15.59:40292) 2024-04-25T09:09:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5cfa800640 1 -- 172.21.15.59:0/3874996339 learned_addr learned my addr 172.21.15.59:0/3874996339 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5cf9e00640 1 --2- 172.21.15.59:0/3874996339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cfc144140 0x7f5cfc0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5cfa800640 1 -- 172.21.15.59:0/3874996339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cfc144140 msgr2=0x7f5cfc0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5cfa800640 1 --2- 172.21.15.59:0/3874996339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cfc144140 0x7f5cfc0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.294 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5cfa800640 1 -- 172.21.15.59:0/3874996339 >> v1:172.21.15.178:6789/0 conn(0x7f5cfc0ced60 legacy=0x7f5cfc06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:55.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.303+0000 7f5cfa800640 1 -- 172.21.15.59:0/3874996339 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc15b200 con 0x7f5cfc06ead0 2024-04-25T09:09:55.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.307+0000 7f5cfa800640 1 --2- 172.21.15.59:0/3874996339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cfc06ead0 0x7f5cfc0b0760 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009e50 tx=0x7f5cf401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8ab36eeded71e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:55.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.307+0000 7f5cf9400640 1 -- 172.21.15.59:0/3874996339 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf40a9440 con 0x7f5cfc06ead0 2024-04-25T09:09:55.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.307+0000 7f5cf9400640 1 -- 172.21.15.59:0/3874996339 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf40ae070 con 0x7f5cfc06ead0 2024-04-25T09:09:55.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.307+0000 7f5cf9400640 1 -- 172.21.15.59:0/3874996339 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf40a9800 con 0x7f5cfc06ead0 2024-04-25T09:09:55.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.307+0000 7f5d01000640 1 -- 172.21.15.59:0/3874996339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cfc06ead0 msgr2=0x7f5cfc0b0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.307+0000 7f5d01000640 1 --2- 172.21.15.59:0/3874996339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cfc06ead0 0x7f5cfc0b0760 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009e50 tx=0x7f5cf401ca30 comp rx=0 tx=0).stop 2024-04-25T09:09:55.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.307+0000 7f5d01000640 1 -- 172.21.15.59:0/3874996339 shutdown_connections 2024-04-25T09:09:55.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.307+0000 7f5d01000640 1 --2- 172.21.15.59:0/3874996339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cfc06ead0 0x7f5cfc0b0760 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.307+0000 7f5d01000640 1 --2- 172.21.15.59:0/3874996339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cfc144140 0x7f5cfc0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.307+0000 7f5d01000640 1 -- 172.21.15.59:0/3874996339 >> 172.21.15.59:0/3874996339 conn(0x7f5cfc066fa0 msgr2=0x7f5cfc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:55.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.307+0000 7f5d01000640 1 -- 172.21.15.59:0/3874996339 shutdown_connections 2024-04-25T09:09:55.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.307+0000 7f5d01000640 1 -- 172.21.15.59:0/3874996339 wait complete. 2024-04-25T09:09:55.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5d01000640 1 Processor -- start 2024-04-25T09:09:55.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5d01000640 1 -- start start 2024-04-25T09:09:55.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5d01000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cfc06ead0 0x7f5cfc1f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5d01000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cfc0ced60 0x7f5cfc141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5d01000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cfc144140 0x7f5cfc0c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5d01000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc15bb80 con 0x7f5cfc144140 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5d01000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc15ba00 con 0x7f5cfc0ced60 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5d01000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc06d2b0 con 0x7f5cfc06ead0 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cfa800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cfc144140 0x7f5cfc0c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cfa800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cfc144140 0x7f5cfc0c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40308/0 (socket says 172.21.15.59:40308) 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cfa800640 1 -- 172.21.15.59:0/2506983876 learned_addr learned my addr 172.21.15.59:0/2506983876 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cf9e00640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cfc06ead0 0x7f5cfc1f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cf1400640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cfc0ced60 0x7f5cfc141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cfa800640 1 -- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cfc06ead0 msgr2=0x7f5cfc1f6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cfa800640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cfc06ead0 0x7f5cfc1f6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cfa800640 1 -- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cfc0ced60 msgr2=0x7f5cfc141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cfa800640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cfc0ced60 0x7f5cfc141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cfa800640 1 -- 172.21.15.59:0/2506983876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc0c74f0 con 0x7f5cfc144140 2024-04-25T09:09:55.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cfa800640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cfc144140 0x7f5cfc0c69a0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5cf401a660 tx=0x7f5cf40197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cf2a00640 1 -- 172.21.15.59:0/2506983876 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf40b8070 con 0x7f5cfc144140 2024-04-25T09:09:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cf2a00640 1 -- 172.21.15.59:0/2506983876 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf40a9850 con 0x7f5cfc144140 2024-04-25T09:09:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5cf2a00640 1 -- 172.21.15.59:0/2506983876 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf40a9c40 con 0x7f5cfc144140 2024-04-25T09:09:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5d01000640 1 -- 172.21.15.59:0/2506983876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc0c77d0 con 0x7f5cfc144140 2024-04-25T09:09:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.311+0000 7f5d01000640 1 -- 172.21.15.59:0/2506983876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc0c7ff0 con 0x7f5cfc144140 2024-04-25T09:09:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.315+0000 7f5d01000640 1 -- 172.21.15.59:0/2506983876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cfc0745d0 con 0x7f5cfc144140 2024-04-25T09:09:55.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.315+0000 7f5cf2a00640 1 -- 172.21.15.59:0/2506983876 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5cf40c5440 con 0x7f5cfc144140 2024-04-25T09:09:55.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.315+0000 7f5cf2a00640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5cd8066f60 0x7f5cd8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.315+0000 7f5cf2a00640 1 -- 172.21.15.59:0/2506983876 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f5cf411f440 con 0x7f5cfc144140 2024-04-25T09:09:55.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.315+0000 7f5cf9e00640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5cd8066f60 0x7f5cd8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.315+0000 7f5cf9e00640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5cd8066f60 0x7f5cd8069420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0079c0 tx=0x7f5cec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:55.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.319+0000 7f5cf2a00640 1 -- 172.21.15.59:0/2506983876 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5cf4016620 con 0x7f5cfc144140 2024-04-25T09:09:55.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.511+0000 7f5d01000640 1 -- 172.21.15.59:0/2506983876 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cfc15e320 con 0x7f5cfc144140 2024-04-25T09:09:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.511+0000 7f5cf2a00640 1 -- 172.21.15.59:0/2506983876 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f5cf40efb40 con 0x7f5cfc144140 2024-04-25T09:09:55.502 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:55.502 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:09:15.158723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7965":{"gid":7965,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1467736863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1467736863},{"type":"v1","addr":"172.21.15.59:6835","nonce":1467736863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:09:55.502 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 78 2024-04-25T09:09:55.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.515+0000 7f5d01000640 1 -- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5cd8066f60 msgr2=0x7f5cd8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.515+0000 7f5d01000640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5cd8066f60 0x7f5cd8069420 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f5cec0079c0 tx=0x7f5cec008040 comp rx=0 tx=0).stop 2024-04-25T09:09:55.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.515+0000 7f5d01000640 1 -- 172.21.15.59:0/2506983876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cfc144140 msgr2=0x7f5cfc0c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.515+0000 7f5d01000640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cfc144140 0x7f5cfc0c69a0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5cf401a660 tx=0x7f5cf40197d0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.515+0000 7f5d01000640 1 -- 172.21.15.59:0/2506983876 shutdown_connections 2024-04-25T09:09:55.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.515+0000 7f5d01000640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5cd8066f60 0x7f5cd8069420 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.515+0000 7f5d01000640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cfc144140 0x7f5cfc0c69a0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.515+0000 7f5d01000640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5cfc0ced60 0x7f5cfc141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.515+0000 7f5d01000640 1 --2- 172.21.15.59:0/2506983876 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5cfc06ead0 0x7f5cfc1f6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.515+0000 7f5d01000640 1 -- 172.21.15.59:0/2506983876 >> 172.21.15.59:0/2506983876 conn(0x7f5cfc066fa0 msgr2=0x7f5cfc15bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:55.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.515+0000 7f5d01000640 1 -- 172.21.15.59:0/2506983876 shutdown_connections 2024-04-25T09:09:55.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.515+0000 7f5d01000640 1 -- 172.21.15.59:0/2506983876 wait complete. 2024-04-25T09:09:55.524 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:09:55.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.675+0000 7f2198c00640 1 Processor -- start 2024-04-25T09:09:55.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.675+0000 7f2198c00640 1 -- start start 2024-04-25T09:09:55.666 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2198c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f219415ee00 0x7f219406bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2198c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f21940cff30 0x7f21940d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2198c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f219406c650 con 0x7f2194099a60 2024-04-25T09:09:55.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2198c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f219406c930 con 0x7f21940cff30 2024-04-25T09:09:55.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2198c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219406cc10 con 0x7f219415ee00 2024-04-25T09:09:55.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2191400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f219415ee00 0x7f219406bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2191400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f219415ee00 0x7f219406bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:60324/0 (socket says 172.21.15.59:60324) 2024-04-25T09:09:55.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2191400640 1 -- 172.21.15.59:0/654622633 learned_addr learned my addr 172.21.15.59:0/654622633 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:55.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2192800640 1 --2- 172.21.15.59:0/654622633 >> v2:172.21.15.178:3300/0 conn(0x7f21940cff30 0x7f21940d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2191400640 1 -- 172.21.15.59:0/654622633 >> v2:172.21.15.178:3300/0 conn(0x7f21940cff30 msgr2=0x7f21940d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:55.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2191400640 1 --2- 172.21.15.59:0/654622633 >> v2:172.21.15.178:3300/0 conn(0x7f21940cff30 0x7f21940d03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2191400640 1 -- 172.21.15.59:0/654622633 >> v1:172.21.15.178:6789/0 conn(0x7f2194099a60 legacy=0x7f2194099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2191400640 1 -- 172.21.15.59:0/654622633 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219406cef0 con 0x7f219415ee00 2024-04-25T09:09:55.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.679+0000 7f2191400640 1 --2- 172.21.15.59:0/654622633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f219415ee00 0x7f219406bd20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2180009870 tx=0x7f218001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=488d36203b855644 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:55.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2190a00640 1 -- 172.21.15.59:0/654622633 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21800b2070 con 0x7f219415ee00 2024-04-25T09:09:55.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2190a00640 1 -- 172.21.15.59:0/654622633 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21800a9070 con 0x7f219415ee00 2024-04-25T09:09:55.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2190a00640 1 -- 172.21.15.59:0/654622633 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21800ad880 con 0x7f219415ee00 2024-04-25T09:09:55.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 -- 172.21.15.59:0/654622633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f219415ee00 msgr2=0x7f219406bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 --2- 172.21.15.59:0/654622633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f219415ee00 0x7f219406bd20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2180009870 tx=0x7f218001c560 comp rx=0 tx=0).stop 2024-04-25T09:09:55.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 -- 172.21.15.59:0/654622633 shutdown_connections 2024-04-25T09:09:55.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 --2- 172.21.15.59:0/654622633 >> v2:172.21.15.178:3300/0 conn(0x7f21940cff30 0x7f21940d03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 --2- 172.21.15.59:0/654622633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f219415ee00 0x7f219406bd20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 -- 172.21.15.59:0/654622633 >> 172.21.15.59:0/654622633 conn(0x7f21940d17a0 msgr2=0x7f21940d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:55.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 -- 172.21.15.59:0/654622633 shutdown_connections 2024-04-25T09:09:55.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 -- 172.21.15.59:0/654622633 wait complete. 2024-04-25T09:09:55.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 Processor -- start 2024-04-25T09:09:55.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 -- start start 2024-04-25T09:09:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2194099a60 0x7f219414e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21940cff30 0x7f21940cb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f219415ee00 0x7f21940c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219416ab80 con 0x7f2194099a60 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f219416aa00 con 0x7f219415ee00 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2198c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219416ad00 con 0x7f21940cff30 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2191e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2194099a60 0x7f219414e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2191e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2194099a60 0x7f219414e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40310/0 (socket says 172.21.15.59:40310) 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.683+0000 7f2191e00640 1 -- 172.21.15.59:0/2175219144 learned_addr learned my addr 172.21.15.59:0/2175219144 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f2191400640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21940cff30 0x7f21940cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f2192800640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f219415ee00 0x7f21940c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f2191e00640 1 -- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21940cff30 msgr2=0x7f21940cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f2191e00640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21940cff30 0x7f21940cb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f2191e00640 1 -- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f219415ee00 msgr2=0x7f21940c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f2191e00640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f219415ee00 0x7f21940c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f2191e00640 1 -- 172.21.15.59:0/2175219144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f219415c950 con 0x7f2194099a60 2024-04-25T09:09:55.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f2192800640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f219415ee00 0x7f21940c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:55.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f2191e00640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2194099a60 0x7f219414e3e0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f218400c3f0 tx=0x7f218400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:55.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f218a000640 1 -- 172.21.15.59:0/2175219144 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184017070 con 0x7f2194099a60 2024-04-25T09:09:55.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f218a000640 1 -- 172.21.15.59:0/2175219144 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21840052d0 con 0x7f2194099a60 2024-04-25T09:09:55.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f2198c00640 1 -- 172.21.15.59:0/2175219144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219415cc30 con 0x7f2194099a60 2024-04-25T09:09:55.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f218a000640 1 -- 172.21.15.59:0/2175219144 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2184003840 con 0x7f2194099a60 2024-04-25T09:09:55.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f2198c00640 1 -- 172.21.15.59:0/2175219144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f219415d4d0 con 0x7f2194099a60 2024-04-25T09:09:55.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f2198c00640 1 -- 172.21.15.59:0/2175219144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f219415d020 con 0x7f2194099a60 2024-04-25T09:09:55.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.687+0000 7f218a000640 1 -- 172.21.15.59:0/2175219144 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f218401a070 con 0x7f2194099a60 2024-04-25T09:09:55.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.691+0000 7f218a000640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2174066f60 0x7f2174069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:55.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.691+0000 7f218a000640 1 -- 172.21.15.59:0/2175219144 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f21840847c0 con 0x7f2194099a60 2024-04-25T09:09:55.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.691+0000 7f2191400640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2174066f60 0x7f2174069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:55.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.691+0000 7f2191400640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2174066f60 0x7f2174069420 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f21800af000 tx=0x7f2180008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:55.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.695+0000 7f218a000640 1 -- 172.21.15.59:0/2175219144 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2184005480 con 0x7f2194099a60 2024-04-25T09:09:55.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 -- 172.21.15.59:0/2175219144 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f21940745d0 con 0x7f2194099a60 2024-04-25T09:09:55.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f218a000640 1 -- 172.21.15.59:0/2175219144 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f2184055400 con 0x7f2194099a60 2024-04-25T09:09:55.880 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:55.880 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":78,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:07:48.892826+0000","modified":"2024-04-25T09:09:15.158723+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":96,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":7965},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7965":{"gid":7965,"name":"a","rank":0,"incarnation":75,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/1467736863","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1467736863},{"type":"v1","addr":"172.21.15.59:6835","nonce":1467736863}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-25T09:09:55.880 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 78 2024-04-25T09:09:55.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 -- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2174066f60 msgr2=0x7f2174069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2174066f60 0x7f2174069420 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f21800af000 tx=0x7f2180008040 comp rx=0 tx=0).stop 2024-04-25T09:09:55.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 -- 172.21.15.59:0/2175219144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2194099a60 msgr2=0x7f219414e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:55.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2194099a60 0x7f219414e3e0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f218400c3f0 tx=0x7f218400c8b0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 -- 172.21.15.59:0/2175219144 shutdown_connections 2024-04-25T09:09:55.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2174066f60 0x7f2174069420 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f219415ee00 0x7f21940c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f21940cff30 0x7f21940cb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 --2- 172.21.15.59:0/2175219144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2194099a60 0x7f219414e3e0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:55.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 -- 172.21.15.59:0/2175219144 >> 172.21.15.59:0/2175219144 conn(0x7f21940d17a0 msgr2=0x7f2194154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:55.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 -- 172.21.15.59:0/2175219144 shutdown_connections 2024-04-25T09:09:55.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:55.891+0000 7f2198c00640 1 -- 172.21.15.59:0/2175219144 wait complete. 2024-04-25T09:09:55.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:09:56.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.051+0000 7fed50e00640 1 Processor -- start 2024-04-25T09:09:56.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.051+0000 7fed50e00640 1 -- start start 2024-04-25T09:09:56.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed50e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed4c144140 0x7fed4c0ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed50e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed4c0ced60 0x7fed4c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed50e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c15ac60 con 0x7fed4c06e900 2024-04-25T09:09:56.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed50e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c06ed30 con 0x7fed4c0ced60 2024-04-25T09:09:56.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed50e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c0cf3e0 con 0x7fed4c144140 2024-04-25T09:09:56.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed41400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed4c0ced60 0x7fed4c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed41400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed4c0ced60 0x7fed4c06e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40326/0 (socket says 172.21.15.59:40326) 2024-04-25T09:09:56.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed41400640 1 -- 172.21.15.59:0/3158545221 learned_addr learned my addr 172.21.15.59:0/3158545221 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:56.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed4a800640 1 --1- 172.21.15.59:0/3158545221 >> v1:172.21.15.59:6789/0 conn(0x7fed4c06e900 0x7fed4c15e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38516/0 (socket says 172.21.15.59:38516) 2024-04-25T09:09:56.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed49e00640 1 --2- 172.21.15.59:0/3158545221 >> v2:172.21.15.178:3300/0 conn(0x7fed4c144140 0x7fed4c0ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed41400640 1 -- 172.21.15.59:0/3158545221 >> v2:172.21.15.178:3300/0 conn(0x7fed4c144140 msgr2=0x7fed4c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:56.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed41400640 1 --2- 172.21.15.59:0/3158545221 >> v2:172.21.15.178:3300/0 conn(0x7fed4c144140 0x7fed4c0ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed41400640 1 -- 172.21.15.59:0/3158545221 >> v1:172.21.15.59:6789/0 conn(0x7fed4c06e900 legacy=0x7fed4c15e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed41400640 1 -- 172.21.15.59:0/3158545221 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c15af20 con 0x7fed4c0ced60 2024-04-25T09:09:56.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed49e00640 1 --2- 172.21.15.59:0/3158545221 >> v2:172.21.15.178:3300/0 conn(0x7fed4c144140 0x7fed4c0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:56.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.055+0000 7fed49400640 1 -- 172.21.15.59:0/3158545221 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734185042 0 0) 0x7fed4c15ac60 con 0x7fed4c06e900 2024-04-25T09:09:56.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed41400640 1 --2- 172.21.15.59:0/3158545221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c0ced60 0x7fed4c06e3c0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fed4c06eef0 tx=0x7fed3401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74279149d2fda4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:56.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed49400640 1 -- 172.21.15.59:0/3158545221 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed340b0070 con 0x7fed4c0ced60 2024-04-25T09:09:56.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed49400640 1 -- 172.21.15.59:0/3158545221 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed340ab600 con 0x7fed4c0ced60 2024-04-25T09:09:56.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed49400640 1 -- 172.21.15.59:0/3158545221 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed340ab9d0 con 0x7fed4c0ced60 2024-04-25T09:09:56.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 -- 172.21.15.59:0/3158545221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c0ced60 msgr2=0x7fed4c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 --2- 172.21.15.59:0/3158545221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c0ced60 0x7fed4c06e3c0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fed4c06eef0 tx=0x7fed3401c520 comp rx=0 tx=0).stop 2024-04-25T09:09:56.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 -- 172.21.15.59:0/3158545221 shutdown_connections 2024-04-25T09:09:56.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 --2- 172.21.15.59:0/3158545221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c0ced60 0x7fed4c06e3c0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 --2- 172.21.15.59:0/3158545221 >> v2:172.21.15.178:3300/0 conn(0x7fed4c144140 0x7fed4c0ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 -- 172.21.15.59:0/3158545221 >> 172.21.15.59:0/3158545221 conn(0x7fed4c066fa0 msgr2=0x7fed4c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:56.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 -- 172.21.15.59:0/3158545221 shutdown_connections 2024-04-25T09:09:56.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 -- 172.21.15.59:0/3158545221 wait complete. 2024-04-25T09:09:56.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 Processor -- start 2024-04-25T09:09:56.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 -- start start 2024-04-25T09:09:56.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c06e900 0x7fed4c1537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed4c0ced60 0x7fed4c13c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed4c144140 0x7fed4c13ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c15ba00 con 0x7fed4c06e900 2024-04-25T09:09:56.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c144520 con 0x7fed4c0ced60 2024-04-25T09:09:56.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.059+0000 7fed50e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c15bb80 con 0x7fed4c144140 2024-04-25T09:09:56.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed49e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c06e900 0x7fed4c1537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed49e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c06e900 0x7fed4c1537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40336/0 (socket says 172.21.15.59:40336) 2024-04-25T09:09:56.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed49e00640 1 -- 172.21.15.59:0/2297010551 learned_addr learned my addr 172.21.15.59:0/2297010551 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:56.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed4a800640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed4c144140 0x7fed4c13ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed41400640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed4c0ced60 0x7fed4c13c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed49e00640 1 -- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed4c144140 msgr2=0x7fed4c13ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed49e00640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed4c144140 0x7fed4c13ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed49e00640 1 -- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed4c0ced60 msgr2=0x7fed4c13c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed49e00640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed4c0ced60 0x7fed4c13c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed49e00640 1 -- 172.21.15.59:0/2297010551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c153cf0 con 0x7fed4c06e900 2024-04-25T09:09:56.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed49e00640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c06e900 0x7fed4c1537b0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00d800 tx=0x7fed3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:56.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed42a00640 1 -- 172.21.15.59:0/2297010551 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00b6c0 con 0x7fed4c06e900 2024-04-25T09:09:56.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed42a00640 1 -- 172.21.15.59:0/2297010551 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c019070 con 0x7fed4c06e900 2024-04-25T09:09:56.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed42a00640 1 -- 172.21.15.59:0/2297010551 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c00baa0 con 0x7fed4c06e900 2024-04-25T09:09:56.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed50e00640 1 -- 172.21.15.59:0/2297010551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c13d350 con 0x7fed4c06e900 2024-04-25T09:09:56.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed50e00640 1 -- 172.21.15.59:0/2297010551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c13d910 con 0x7fed4c06e900 2024-04-25T09:09:56.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed50e00640 1 -- 172.21.15.59:0/2297010551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c0745d0 con 0x7fed4c06e900 2024-04-25T09:09:56.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.063+0000 7fed42a00640 1 -- 172.21.15.59:0/2297010551 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fed3c00bc40 con 0x7fed4c06e900 2024-04-25T09:09:56.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.067+0000 7fed42a00640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed28066f60 0x7fed28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.067+0000 7fed42a00640 1 -- 172.21.15.59:0/2297010551 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7fed3c0855b0 con 0x7fed4c06e900 2024-04-25T09:09:56.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.067+0000 7fed41400640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed28066f60 0x7fed28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.067+0000 7fed41400640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed28066f60 0x7fed28069420 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fed340ad000 tx=0x7fed340a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:56.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.071+0000 7fed42a00640 1 -- 172.21.15.59:0/2297010551 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fed3c055cb0 con 0x7fed4c06e900 2024-04-25T09:09:56.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.231+0000 7fed50e00640 1 -- 172.21.15.59:0/2297010551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed4c15ac60 con 0x7fed4c06e900 2024-04-25T09:09:56.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed42a00640 1 -- 172.21.15.59:0/2297010551 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+17338 (secure 0 0 0) 0x7fed3c059d50 con 0x7fed4c06e900 2024-04-25T09:09:56.223 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:09:56.223 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":96,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:09:12.143679+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:07:47.301822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_data","create_time":"2024-04-25T09:07:47.878097+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.12","mappings":[{"from":1,"to":5}]},{"pgid":"14.1a","mappings":[{"from":1,"to":2}]},{"pgid":"14.1b","mappings":[{"from":1,"to":7}]},{"pgid":"14.38","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/4079513876":"2024-04-26T09:09:12.143656+0000","172.21.15.59:6833/4079513876":"2024-04-26T09:09:12.143656+0000","172.21.15.59:6835/3531112441":"2024-04-26T09:07:59.742787+0000","172.21.15.59:6833/3531112441":"2024-04-26T09:07:59.742787+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:09:56.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed50e00640 1 -- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed28066f60 msgr2=0x7fed28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed50e00640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed28066f60 0x7fed28069420 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fed340ad000 tx=0x7fed340a6000 comp rx=0 tx=0).stop 2024-04-25T09:09:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed50e00640 1 -- 172.21.15.59:0/2297010551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c06e900 msgr2=0x7fed4c1537b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed50e00640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c06e900 0x7fed4c1537b0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00d800 tx=0x7fed3c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed50e00640 1 -- 172.21.15.59:0/2297010551 shutdown_connections 2024-04-25T09:09:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed50e00640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fed28066f60 0x7fed28069420 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed50e00640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed4c144140 0x7fed4c13ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed50e00640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed4c0ced60 0x7fed4c13c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed50e00640 1 --2- 172.21.15.59:0/2297010551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed4c06e900 0x7fed4c1537b0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed50e00640 1 -- 172.21.15.59:0/2297010551 >> 172.21.15.59:0/2297010551 conn(0x7fed4c066fa0 msgr2=0x7fed4c140830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed50e00640 1 -- 172.21.15.59:0/2297010551 shutdown_connections 2024-04-25T09:09:56.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.235+0000 7fed50e00640 1 -- 172.21.15.59:0/2297010551 wait complete. 2024-04-25T09:09:56.244 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:09:56.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.395+0000 7f271f600640 1 Processor -- start 2024-04-25T09:09:56.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271f600640 1 -- start start 2024-04-25T09:09:56.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271f600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f271815dc60 0x7f27180d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271f600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f271809a170 0x7f27180cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271f600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f271815e040 con 0x7f271806bf30 2024-04-25T09:09:56.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271f600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180cff80 con 0x7f271809a170 2024-04-25T09:09:56.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271f600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27180d0260 con 0x7f271815dc60 2024-04-25T09:09:56.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271d600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f271809a170 0x7f27180cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271d600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f271809a170 0x7f27180cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40342/0 (socket says 172.21.15.59:40342) 2024-04-25T09:09:56.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f2717e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f271806bf30 0x7f2718099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38532/0 (socket says 172.21.15.59:38532) 2024-04-25T09:09:56.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271d600640 1 -- 172.21.15.59:0/2787438750 learned_addr learned my addr 172.21.15.59:0/2787438750 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:56.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271cc00640 1 --2- 172.21.15.59:0/2787438750 >> v2:172.21.15.178:3300/0 conn(0x7f271815dc60 0x7f27180d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271d600640 1 -- 172.21.15.59:0/2787438750 >> v2:172.21.15.178:3300/0 conn(0x7f271815dc60 msgr2=0x7f27180d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:56.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271d600640 1 --2- 172.21.15.59:0/2787438750 >> v2:172.21.15.178:3300/0 conn(0x7f271815dc60 0x7f27180d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f2717400640 1 -- 172.21.15.59:0/2787438750 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2410814159 0 0) 0x7f271815e040 con 0x7f271806bf30 2024-04-25T09:09:56.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271d600640 1 -- 172.21.15.59:0/2787438750 >> v1:172.21.15.59:6789/0 conn(0x7f271806bf30 legacy=0x7f2718099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.399+0000 7f271d600640 1 -- 172.21.15.59:0/2787438750 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27180d0540 con 0x7f271809a170 2024-04-25T09:09:56.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f271d600640 1 --2- 172.21.15.59:0/2787438750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271809a170 0x7f27180cf8a0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f271809a6b0 tx=0x7f271001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5fc27880322ca0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:56.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f2717400640 1 -- 172.21.15.59:0/2787438750 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100a57f0 con 0x7f271809a170 2024-04-25T09:09:56.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f2717400640 1 -- 172.21.15.59:0/2787438750 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27100a5990 con 0x7f271809a170 2024-04-25T09:09:56.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f2717400640 1 -- 172.21.15.59:0/2787438750 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100a5d60 con 0x7f271809a170 2024-04-25T09:09:56.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f271f600640 1 -- 172.21.15.59:0/2787438750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271809a170 msgr2=0x7f27180cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f271f600640 1 --2- 172.21.15.59:0/2787438750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271809a170 0x7f27180cf8a0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f271809a6b0 tx=0x7f271001c930 comp rx=0 tx=0).stop 2024-04-25T09:09:56.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f271f600640 1 -- 172.21.15.59:0/2787438750 shutdown_connections 2024-04-25T09:09:56.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f271f600640 1 --2- 172.21.15.59:0/2787438750 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271809a170 0x7f27180cf8a0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f271f600640 1 --2- 172.21.15.59:0/2787438750 >> v2:172.21.15.178:3300/0 conn(0x7f271815dc60 0x7f27180d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f271f600640 1 -- 172.21.15.59:0/2787438750 >> 172.21.15.59:0/2787438750 conn(0x7f27180b3200 msgr2=0x7f27180b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:56.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f271f600640 1 -- 172.21.15.59:0/2787438750 shutdown_connections 2024-04-25T09:09:56.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f271f600640 1 -- 172.21.15.59:0/2787438750 wait complete. 2024-04-25T09:09:56.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f271f600640 1 Processor -- start 2024-04-25T09:09:56.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.403+0000 7f271f600640 1 -- start start 2024-04-25T09:09:56.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271f600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271806bf30 0x7f2718159410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271f600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f271809a170 0x7f2718146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271f600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f271815dc60 0x7f271809d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271f600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180cc6f0 con 0x7f271806bf30 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271f600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27180cc570 con 0x7f271809a170 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271f600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27180cc870 con 0x7f271815dc60 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271806bf30 0x7f2718159410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271806bf30 0x7f2718159410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40346/0 (socket says 172.21.15.59:40346) 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271cc00640 1 -- 172.21.15.59:0/3358148054 learned_addr learned my addr 172.21.15.59:0/3358148054 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f2717e00640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f271809a170 0x7f2718146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271d600640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f271815dc60 0x7f271809d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271cc00640 1 -- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f271815dc60 msgr2=0x7f271809d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271cc00640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f271815dc60 0x7f271809d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271cc00640 1 -- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f271809a170 msgr2=0x7f2718146af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271cc00640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f271809a170 0x7f2718146af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271cc00640 1 -- 172.21.15.59:0/3358148054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2718147030 con 0x7f271806bf30 2024-04-25T09:09:56.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271cc00640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271806bf30 0x7f2718159410 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f270c00d5f0 tx=0x7f270c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:56.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f2714c00640 1 -- 172.21.15.59:0/3358148054 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0125f0 con 0x7f271806bf30 2024-04-25T09:09:56.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f2714c00640 1 -- 172.21.15.59:0/3358148054 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c019070 con 0x7f271806bf30 2024-04-25T09:09:56.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f2714c00640 1 -- 172.21.15.59:0/3358148054 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c0129b0 con 0x7f271806bf30 2024-04-25T09:09:56.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271f600640 1 -- 172.21.15.59:0/3358148054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f271809baa0 con 0x7f271806bf30 2024-04-25T09:09:56.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271f600640 1 -- 172.21.15.59:0/3358148054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f271809c060 con 0x7f271806bf30 2024-04-25T09:09:56.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f271f600640 1 -- 172.21.15.59:0/3358148054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27180745d0 con 0x7f271806bf30 2024-04-25T09:09:56.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.407+0000 7f2714c00640 1 -- 172.21.15.59:0/3358148054 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f270c012b50 con 0x7f271806bf30 2024-04-25T09:09:56.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.411+0000 7f2714c00640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f26f8066f60 0x7f26f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.411+0000 7f2714c00640 1 -- 172.21.15.59:0/3358148054 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6389+0+0 (secure 0 0 0) 0x7f270c085670 con 0x7f271806bf30 2024-04-25T09:09:56.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.411+0000 7f2717e00640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f26f8066f60 0x7f26f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.411+0000 7f2717e00640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f26f8066f60 0x7f26f8069420 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f27181fa0e0 tx=0x7f2704007d60 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:56.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.415+0000 7f2714c00640 1 -- 172.21.15.59:0/3358148054 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f270c055c50 con 0x7f271806bf30 2024-04-25T09:09:56.606 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.615+0000 7f271f600640 1 -- 172.21.15.59:0/3358148054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f27180b28e0 con 0x7f271806bf30 2024-04-25T09:09:56.606 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:09:56.619+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:09:56.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.619+0000 7f2714c00640 1 -- 172.21.15.59:0/3358148054 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7f270c059cf0 con 0x7f271806bf30 2024-04-25T09:09:56.610 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:09:56.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.623+0000 7f271f600640 1 -- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f26f8066f60 msgr2=0x7f26f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.623+0000 7f271f600640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f26f8066f60 0x7f26f8069420 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f27181fa0e0 tx=0x7f2704007d60 comp rx=0 tx=0).stop 2024-04-25T09:09:56.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.623+0000 7f271f600640 1 -- 172.21.15.59:0/3358148054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271806bf30 msgr2=0x7f2718159410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.623+0000 7f271f600640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271806bf30 0x7f2718159410 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f270c00d5f0 tx=0x7f270c00dab0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.623+0000 7f271f600640 1 -- 172.21.15.59:0/3358148054 shutdown_connections 2024-04-25T09:09:56.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.623+0000 7f271f600640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f26f8066f60 0x7f26f8069420 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.623+0000 7f271f600640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f271815dc60 0x7f271809d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.623+0000 7f271f600640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f271809a170 0x7f2718146af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.623+0000 7f271f600640 1 --2- 172.21.15.59:0/3358148054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271806bf30 0x7f2718159410 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.623+0000 7f271f600640 1 -- 172.21.15.59:0/3358148054 >> 172.21.15.59:0/3358148054 conn(0x7f27180b3200 msgr2=0x7f2718159ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:56.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.623+0000 7f271f600640 1 -- 172.21.15.59:0/3358148054 shutdown_connections 2024-04-25T09:09:56.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.623+0000 7f271f600640 1 -- 172.21.15.59:0/3358148054 wait complete. 2024-04-25T09:09:56.621 INFO:tasks.ceph.mds.a.smithi059.stderr: -1949> 2024-04-25T09:09:19.019+0000 7f7373a00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cfb6a92100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(14)0x10000000001:[<0x10000000000/file v8>,<0x1/dir v15>]//[]","memoryvalue":"(14)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v22>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-25T09:09:56.634 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:09:56.666 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:09:56.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.791+0000 7f2f56200640 1 Processor -- start 2024-04-25T09:09:56.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.791+0000 7f2f56200640 1 -- start start 2024-04-25T09:09:56.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f56200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5015c9b0 0x7f2f5006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f56200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f2f5006e010 0x7f2f5006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f56200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f5015fc00 con 0x7f2f50159320 2024-04-25T09:09:56.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f56200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f5006d640 con 0x7f2f5006e010 2024-04-25T09:09:56.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f56200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5015fee0 con 0x7f2f5015c9b0 2024-04-25T09:09:56.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2f50159320 0x7f2f5015f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38548/0 (socket says 172.21.15.59:38548) 2024-04-25T09:09:56.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4f400640 1 -- 172.21.15.59:0/1789050730 learned_addr learned my addr 172.21.15.59:0/1789050730 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:56.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f46a00640 1 --2- 172.21.15.59:0/1789050730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5015c9b0 0x7f2f5006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4fe00640 1 --2- 172.21.15.59:0/1789050730 >> v2:172.21.15.178:3300/0 conn(0x7f2f5006e010 0x7f2f5006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 42876281 0 0) 0x7f2f5015fc00 con 0x7f2f50159320 2024-04-25T09:09:56.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f34003530 con 0x7f2f50159320 2024-04-25T09:09:56.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 656956224 0 0) 0x7f2f34003530 con 0x7f2f50159320 2024-04-25T09:09:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5015c9b0 msgr2=0x7f2f5006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 --2- 172.21.15.59:0/1789050730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5015c9b0 0x7f2f5006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 >> v2:172.21.15.178:3300/0 conn(0x7f2f5006e010 msgr2=0x7f2f5006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 --2- 172.21.15.59:0/1789050730 >> v2:172.21.15.178:3300/0 conn(0x7f2f5006e010 0x7f2f5006e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f501601c0 con 0x7f2f50159320 2024-04-25T09:09:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f2f40001a00 con 0x7f2f50159320 2024-04-25T09:09:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 >> v1:172.21.15.59:6789/0 conn(0x7f2f50159320 legacy=0x7f2f5015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 --2- 172.21.15.59:0/1789050730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5015c9b0 0x7f2f340039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 --2- 172.21.15.59:0/1789050730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f34003f40 0x7f2f34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 --2- 172.21.15.59:0/1789050730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f34004d50 0x7f2f340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5006d640 con 0x7f2f34003f40 2024-04-25T09:09:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5015fee0 con 0x7f2f34004d50 2024-04-25T09:09:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3400b9d0 con 0x7f2f5015c9b0 2024-04-25T09:09:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f46a00640 1 --2- 172.21.15.59:0/1789050730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f34003f40 0x7f2f34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4f400640 1 --2- 172.21.15.59:0/1789050730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5015c9b0 0x7f2f340039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f4fe00640 1 --2- 172.21.15.59:0/1789050730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f34004d50 0x7f2f340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f46a00640 1 -- 172.21.15.59:0/1789050730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5015c9b0 msgr2=0x7f2f340039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f46a00640 1 --2- 172.21.15.59:0/1789050730 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f5015c9b0 0x7f2f340039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f46a00640 1 -- 172.21.15.59:0/1789050730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f34004d50 msgr2=0x7f2f340051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f46a00640 1 --2- 172.21.15.59:0/1789050730 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f34004d50 0x7f2f340051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.795+0000 7f2f46a00640 1 -- 172.21.15.59:0/1789050730 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f34003530 con 0x7f2f34003f40 2024-04-25T09:09:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f46a00640 1 --2- 172.21.15.59:0/1789050730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f34003f40 0x7f2f34004810 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009ae0 tx=0x7f2f3801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85dcaa0e1cd0a6e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f380b2070 con 0x7f2f34003f40 2024-04-25T09:09:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f380a5660 con 0x7f2f34003f40 2024-04-25T09:09:56.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f4ea00640 1 -- 172.21.15.59:0/1789050730 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f380096b0 con 0x7f2f34003f40 2024-04-25T09:09:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f56200640 1 -- 172.21.15.59:0/1789050730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f34003f40 msgr2=0x7f2f34004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f56200640 1 --2- 172.21.15.59:0/1789050730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f34003f40 0x7f2f34004810 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009ae0 tx=0x7f2f3801ca10 comp rx=0 tx=0).stop 2024-04-25T09:09:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f4fe00640 1 -- 172.21.15.59:0/1789050730 reap_dead start 2024-04-25T09:09:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f56200640 1 -- 172.21.15.59:0/1789050730 shutdown_connections 2024-04-25T09:09:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f56200640 1 -- 172.21.15.59:0/1789050730 >> 172.21.15.59:0/1789050730 conn(0x7f2f50067080 msgr2=0x7f2f5006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f56200640 1 -- 172.21.15.59:0/1789050730 shutdown_connections 2024-04-25T09:09:56.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f56200640 1 -- 172.21.15.59:0/1789050730 wait complete. 2024-04-25T09:09:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f56200640 1 Processor -- start 2024-04-25T09:09:56.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.799+0000 7f2f56200640 1 -- start start 2024-04-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f56200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f34003f40 0x7f2f50139d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f56200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f500b1960 0x7f2f500afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f56200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f500b1de0 0x7f2f500affa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f56200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5006dad0 con 0x7f2f500b1de0 2024-04-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f56200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f50159700 con 0x7f2f34003f40 2024-04-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f56200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f5006dc50 con 0x7f2f500b1960 2024-04-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f4fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f500b1de0 0x7f2f500affa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f4fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f500b1de0 0x7f2f500affa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40370/0 (socket says 172.21.15.59:40370) 2024-04-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f4fe00640 1 -- 172.21.15.59:0/2095239972 learned_addr learned my addr 172.21.15.59:0/2095239972 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f4f400640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f34003f40 0x7f2f50139d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f46a00640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f500b1960 0x7f2f500afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f4fe00640 1 -- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f500b1960 msgr2=0x7f2f500afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f4fe00640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f500b1960 0x7f2f500afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f4fe00640 1 -- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f34003f40 msgr2=0x7f2f50139d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f4fe00640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f34003f40 0x7f2f50139d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f4fe00640 1 -- 172.21.15.59:0/2095239972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f5015aa80 con 0x7f2f500b1de0 2024-04-25T09:09:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f4fe00640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f500b1de0 0x7f2f500affa0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f2f500b4c90 tx=0x7f2f48011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f47e00640 1 -- 172.21.15.59:0/2095239972 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f48019020 con 0x7f2f500b1de0 2024-04-25T09:09:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f47e00640 1 -- 172.21.15.59:0/2095239972 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f48004240 con 0x7f2f500b1de0 2024-04-25T09:09:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f56200640 1 -- 172.21.15.59:0/2095239972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f5015ad20 con 0x7f2f500b1de0 2024-04-25T09:09:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f47e00640 1 -- 172.21.15.59:0/2095239972 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f4800f770 con 0x7f2f500b1de0 2024-04-25T09:09:56.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f56200640 1 -- 172.21.15.59:0/2095239972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f5015b2e0 con 0x7f2f500b1de0 2024-04-25T09:09:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f56200640 1 -- 172.21.15.59:0/2095239972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f500745d0 con 0x7f2f500b1de0 2024-04-25T09:09:56.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.803+0000 7f2f47e00640 1 -- 172.21.15.59:0/2095239972 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2f4801c020 con 0x7f2f500b1de0 2024-04-25T09:09:56.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.807+0000 7f2f47e00640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2f2c066f60 0x7f2f2c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:56.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.807+0000 7f2f47e00640 1 -- 172.21.15.59:0/2095239972 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6475+0+0 (secure 0 0 0) 0x7f2f48085550 con 0x7f2f500b1de0 2024-04-25T09:09:56.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.807+0000 7f2f4f400640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2f2c066f60 0x7f2f2c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:56.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.807+0000 7f2f4f400640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2f2c066f60 0x7f2f2c069420 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2f400018e0 tx=0x7f2f4000a060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:56.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:56.811+0000 7f2f47e00640 1 -- 172.21.15.59:0/2095239972 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2f48023020 con 0x7f2f500b1de0 2024-04-25T09:09:56.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.007+0000 7f2f56200640 1 -- 172.21.15.59:0/2095239972 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2f5015f4c0 con 0x7f2f500b1de0 2024-04-25T09:09:57.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.623+0000 7f2f47e00640 1 -- 172.21.15.59:0/2095239972 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2f48055c00 con 0x7f2f500b1de0 2024-04-25T09:09:57.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.627+0000 7f2f56200640 1 -- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2f2c066f60 msgr2=0x7f2f2c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.627+0000 7f2f56200640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2f2c066f60 0x7f2f2c069420 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2f400018e0 tx=0x7f2f4000a060 comp rx=0 tx=0).stop 2024-04-25T09:09:57.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.627+0000 7f2f56200640 1 -- 172.21.15.59:0/2095239972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f500b1de0 msgr2=0x7f2f500affa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.627+0000 7f2f56200640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f500b1de0 0x7f2f500affa0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f2f500b4c90 tx=0x7f2f48011cf0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.627+0000 7f2f56200640 1 -- 172.21.15.59:0/2095239972 shutdown_connections 2024-04-25T09:09:57.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.627+0000 7f2f56200640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2f2c066f60 0x7f2f2c069420 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.627+0000 7f2f56200640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f500b1de0 0x7f2f500affa0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.627+0000 7f2f56200640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2f500b1960 0x7f2f500afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.627+0000 7f2f56200640 1 --2- 172.21.15.59:0/2095239972 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2f34003f40 0x7f2f50139d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.627+0000 7f2f56200640 1 -- 172.21.15.59:0/2095239972 >> 172.21.15.59:0/2095239972 conn(0x7f2f50067080 msgr2=0x7f2f50071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:57.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.627+0000 7f2f56200640 1 -- 172.21.15.59:0/2095239972 shutdown_connections 2024-04-25T09:09:57.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.627+0000 7f2f56200640 1 -- 172.21.15.59:0/2095239972 wait complete. 2024-04-25T09:09:57.638 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:09:57.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.843+0000 7fbe97200640 1 Processor -- start 2024-04-25T09:09:57.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.843+0000 7fbe97200640 1 -- start start 2024-04-25T09:09:57.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe97200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbe9015dab0 0x7fbe900b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe97200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe900b0c00 0x7fbe90070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe97200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe900711f0 0x7fbe90161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe97200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe9015de90 con 0x7fbe900b0c00 2024-04-25T09:09:57.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe97200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe90071a70 con 0x7fbe9015dab0 2024-04-25T09:09:57.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe97200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe900b57a0 con 0x7fbe900711f0 2024-04-25T09:09:57.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe8f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe900b0c00 0x7fbe90070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe8f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe900b0c00 0x7fbe90070cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40386/0 (socket says 172.21.15.59:40386) 2024-04-25T09:09:57.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe8f400640 1 -- 172.21.15.59:0/3137647113 learned_addr learned my addr 172.21.15.59:0/3137647113 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:57.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe95200640 1 --2- 172.21.15.59:0/3137647113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe900711f0 0x7fbe90161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe8fe00640 1 --2- 172.21.15.59:0/3137647113 >> v2:172.21.15.178:3300/0 conn(0x7fbe9015dab0 0x7fbe900b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe8f400640 1 -- 172.21.15.59:0/3137647113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe900711f0 msgr2=0x7fbe90161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:57.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe8f400640 1 --2- 172.21.15.59:0/3137647113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe900711f0 0x7fbe90161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe8f400640 1 -- 172.21.15.59:0/3137647113 >> v2:172.21.15.178:3300/0 conn(0x7fbe9015dab0 msgr2=0x7fbe900b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:57.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe8f400640 1 --2- 172.21.15.59:0/3137647113 >> v2:172.21.15.178:3300/0 conn(0x7fbe9015dab0 0x7fbe900b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe8f400640 1 -- 172.21.15.59:0/3137647113 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe9006bec0 con 0x7fbe900b0c00 2024-04-25T09:09:57.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe95200640 1 --2- 172.21.15.59:0/3137647113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe900711f0 0x7fbe90161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:57.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.847+0000 7fbe8fe00640 1 --2- 172.21.15.59:0/3137647113 >> v2:172.21.15.178:3300/0 conn(0x7fbe9015dab0 0x7fbe900b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:09:57.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe8f400640 1 --2- 172.21.15.59:0/3137647113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe900b0c00 0x7fbe90070cb0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fbe9004f170 tx=0x7fbe7c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9567f059e00becd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:57.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe8ea00640 1 -- 172.21.15.59:0/3137647113 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0b0070 con 0x7fbe900b0c00 2024-04-25T09:09:57.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe8ea00640 1 -- 172.21.15.59:0/3137647113 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7c0ab600 con 0x7fbe900b0c00 2024-04-25T09:09:57.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe8ea00640 1 -- 172.21.15.59:0/3137647113 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c0ab9d0 con 0x7fbe900b0c00 2024-04-25T09:09:57.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 -- 172.21.15.59:0/3137647113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe900b0c00 msgr2=0x7fbe90070cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 --2- 172.21.15.59:0/3137647113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe900b0c00 0x7fbe90070cb0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fbe9004f170 tx=0x7fbe7c01c260 comp rx=0 tx=0).stop 2024-04-25T09:09:57.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 -- 172.21.15.59:0/3137647113 shutdown_connections 2024-04-25T09:09:57.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 --2- 172.21.15.59:0/3137647113 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe900711f0 0x7fbe90161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 --2- 172.21.15.59:0/3137647113 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe900b0c00 0x7fbe90070cb0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 --2- 172.21.15.59:0/3137647113 >> v2:172.21.15.178:3300/0 conn(0x7fbe9015dab0 0x7fbe900b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 -- 172.21.15.59:0/3137647113 >> 172.21.15.59:0/3137647113 conn(0x7fbe9006f510 msgr2=0x7fbe9006f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 -- 172.21.15.59:0/3137647113 shutdown_connections 2024-04-25T09:09:57.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 -- 172.21.15.59:0/3137647113 wait complete. 2024-04-25T09:09:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 Processor -- start 2024-04-25T09:09:57.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 -- start start 2024-04-25T09:09:57.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe900711f0 0x7fbe901584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe900b0c00 0x7fbe900cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9015dab0 0x7fbe9013eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9006cd30 con 0x7fbe9015dab0 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9006cbb0 con 0x7fbe900711f0 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe97200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe9006ceb0 con 0x7fbe900b0c00 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.851+0000 7fbe95200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9015dab0 0x7fbe9013eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe95200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9015dab0 0x7fbe9013eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40396/0 (socket says 172.21.15.59:40396) 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe95200640 1 -- 172.21.15.59:0/225787395 learned_addr learned my addr 172.21.15.59:0/225787395 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe8fe00640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe900711f0 0x7fbe901584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe8f400640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe900b0c00 0x7fbe900cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe95200640 1 -- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe900b0c00 msgr2=0x7fbe900cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe95200640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe900b0c00 0x7fbe900cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe95200640 1 -- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe900711f0 msgr2=0x7fbe901584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe95200640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe900711f0 0x7fbe901584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:57.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe95200640 1 -- 172.21.15.59:0/225787395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe90070d20 con 0x7fbe9015dab0 2024-04-25T09:09:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe95200640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9015dab0 0x7fbe9013eef0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800c7f0 tx=0x7fbe8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe87e00640 1 -- 172.21.15.59:0/225787395 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88015070 con 0x7fbe9015dab0 2024-04-25T09:09:57.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe87e00640 1 -- 172.21.15.59:0/225787395 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe88007820 con 0x7fbe9015dab0 2024-04-25T09:09:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe87e00640 1 -- 172.21.15.59:0/225787395 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe88007c10 con 0x7fbe9015dab0 2024-04-25T09:09:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe97200640 1 -- 172.21.15.59:0/225787395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe90159d40 con 0x7fbe9015dab0 2024-04-25T09:09:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe97200640 1 -- 172.21.15.59:0/225787395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe90158bc0 con 0x7fbe9015dab0 2024-04-25T09:09:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe97200640 1 -- 172.21.15.59:0/225787395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe900745d0 con 0x7fbe9015dab0 2024-04-25T09:09:57.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe87e00640 1 -- 172.21.15.59:0/225787395 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbe88018070 con 0x7fbe9015dab0 2024-04-25T09:09:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe87e00640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe70066f60 0x7fbe70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.855+0000 7fbe87e00640 1 -- 172.21.15.59:0/225787395 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 6475+0+0 (secure 0 0 0) 0x7fbe88085380 con 0x7fbe9015dab0 2024-04-25T09:09:57.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.859+0000 7fbe8fe00640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe70066f60 0x7fbe70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:57.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.859+0000 7fbe8fe00640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe70066f60 0x7fbe70069420 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000f500 tx=0x7fbe80007770 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:57.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:57.859+0000 7fbe87e00640 1 -- 172.21.15.59:0/225787395 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbe88055af0 con 0x7fbe9015dab0 2024-04-25T09:09:58.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.027+0000 7fbe97200640 1 -- 172.21.15.59:0/225787395 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbe900b1150 con 0x7fbe9015dab0 2024-04-25T09:09:58.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe87e00640 1 -- 172.21.15.59:0/225787395 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v98) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbe88059b90 con 0x7fbe9015dab0 2024-04-25T09:09:58.618 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:09:58.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe97200640 1 -- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe70066f60 msgr2=0x7fbe70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe97200640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe70066f60 0x7fbe70069420 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbe8000f500 tx=0x7fbe80007770 comp rx=0 tx=0).stop 2024-04-25T09:09:58.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe97200640 1 -- 172.21.15.59:0/225787395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9015dab0 msgr2=0x7fbe9013eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe97200640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9015dab0 0x7fbe9013eef0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fbe8800c7f0 tx=0x7fbe8800ccb0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe97200640 1 -- 172.21.15.59:0/225787395 shutdown_connections 2024-04-25T09:09:58.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe97200640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbe70066f60 0x7fbe70069420 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe97200640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe9015dab0 0x7fbe9013eef0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe97200640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbe900b0c00 0x7fbe900cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe97200640 1 --2- 172.21.15.59:0/225787395 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbe900711f0 0x7fbe901584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe97200640 1 -- 172.21.15.59:0/225787395 >> 172.21.15.59:0/225787395 conn(0x7fbe9006f510 msgr2=0x7fbe9006d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe97200640 1 -- 172.21.15.59:0/225787395 shutdown_connections 2024-04-25T09:09:58.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.631+0000 7fbe97200640 1 -- 172.21.15.59:0/225787395 wait complete. 2024-04-25T09:09:58.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:09:58.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7dec800640 1 Processor -- start 2024-04-25T09:09:58.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7dec800640 1 -- start start 2024-04-25T09:09:58.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7dec800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7de40d1220 0x7f7de40cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7dec800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de415f7d0 con 0x7f7de40713c0 2024-04-25T09:09:58.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7dec800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de415fab0 con 0x7f7de415b6d0 2024-04-25T09:09:58.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7dec800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de40ce4d0 con 0x7f7de40d1220 2024-04-25T09:09:58.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7de9400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7de40713c0 0x7f7de40b5e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:38556/0 (socket says 172.21.15.59:38556) 2024-04-25T09:09:58.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7de9400640 1 -- 172.21.15.59:0/1824002999 learned_addr learned my addr 172.21.15.59:0/1824002999 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:09:58.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7dea800640 1 --2- 172.21.15.59:0/1824002999 >> v2:172.21.15.59:3300/0 conn(0x7f7de40d1220 0x7f7de40cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7de8a00640 1 -- 172.21.15.59:0/1824002999 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 236120474 0 0) 0x7f7de415f7d0 con 0x7f7de40713c0 2024-04-25T09:09:58.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7de8a00640 1 -- 172.21.15.59:0/1824002999 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dcc003530 con 0x7f7de40713c0 2024-04-25T09:09:58.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7dea800640 1 -- 172.21.15.59:0/1824002999 >> v1:172.21.15.178:6789/0 conn(0x7f7de415b6d0 legacy=0x7f7de4070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7dea800640 1 -- 172.21.15.59:0/1824002999 >> v1:172.21.15.59:6789/0 conn(0x7f7de40713c0 legacy=0x7f7de40b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.803+0000 7f7dea800640 1 -- 172.21.15.59:0/1824002999 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de415fd90 con 0x7f7de40d1220 2024-04-25T09:09:58.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.807+0000 7f7dea800640 1 --2- 172.21.15.59:0/1824002999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de40d1220 0x7f7de40cdf90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009d90 tx=0x7f7de001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ed786d0f46495b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.807+0000 7f7de8a00640 1 -- 172.21.15.59:0/1824002999 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de00b2070 con 0x7f7de40d1220 2024-04-25T09:09:58.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.807+0000 7f7de8a00640 1 -- 172.21.15.59:0/1824002999 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de00a5940 con 0x7f7de40d1220 2024-04-25T09:09:58.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.807+0000 7f7de8a00640 1 -- 172.21.15.59:0/1824002999 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de415bcc0 con 0x7f7de40d1220 2024-04-25T09:09:58.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.807+0000 7f7dec800640 1 -- 172.21.15.59:0/1824002999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de40d1220 msgr2=0x7f7de40cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.807+0000 7f7dec800640 1 --2- 172.21.15.59:0/1824002999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de40d1220 0x7f7de40cdf90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f7de0009d90 tx=0x7f7de001c970 comp rx=0 tx=0).stop 2024-04-25T09:09:58.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.807+0000 7f7dec800640 1 -- 172.21.15.59:0/1824002999 shutdown_connections 2024-04-25T09:09:58.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.807+0000 7f7dec800640 1 --2- 172.21.15.59:0/1824002999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de40d1220 0x7f7de40cdf90 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.807+0000 7f7dec800640 1 -- 172.21.15.59:0/1824002999 >> 172.21.15.59:0/1824002999 conn(0x7f7de406f510 msgr2=0x7f7de406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:58.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.807+0000 7f7dec800640 1 -- 172.21.15.59:0/1824002999 shutdown_connections 2024-04-25T09:09:58.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.807+0000 7f7dec800640 1 -- 172.21.15.59:0/1824002999 wait complete. 2024-04-25T09:09:58.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dec800640 1 Processor -- start 2024-04-25T09:09:58.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dec800640 1 -- start start 2024-04-25T09:09:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dec800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de40713c0 0x7f7de41596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dec800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de40d1220 0x7f7de415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dec800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de415b6d0 0x7f7de415c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dec800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de415f4e0 con 0x7f7de40d1220 2024-04-25T09:09:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dec800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de415f360 con 0x7f7de415b6d0 2024-04-25T09:09:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dec800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de4169f20 con 0x7f7de40713c0 2024-04-25T09:09:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7de9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de40d1220 0x7f7de415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7de9400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de40d1220 0x7f7de415c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40426/0 (socket says 172.21.15.59:40426) 2024-04-25T09:09:58.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7de9400640 1 -- 172.21.15.59:0/2503165698 learned_addr learned my addr 172.21.15.59:0/2503165698 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7de9e00640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de40713c0 0x7f7de41596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dea800640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de415b6d0 0x7f7de415c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7de9400640 1 -- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de40713c0 msgr2=0x7f7de41596b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7de9400640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de40713c0 0x7f7de41596b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7de9400640 1 -- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de415b6d0 msgr2=0x7f7de415c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7de9400640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de415b6d0 0x7f7de415c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7de9400640 1 -- 172.21.15.59:0/2503165698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de40cadb0 con 0x7f7de40d1220 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dea800640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de415b6d0 0x7f7de415c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7de9400640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de40d1220 0x7f7de415c0d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400c4d0 tx=0x7f7dd400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dde000640 1 -- 172.21.15.59:0/2503165698 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4017070 con 0x7f7de40d1220 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dde000640 1 -- 172.21.15.59:0/2503165698 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd4005cf0 con 0x7f7de40d1220 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dde000640 1 -- 172.21.15.59:0/2503165698 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4007270 con 0x7f7de40d1220 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dec800640 1 -- 172.21.15.59:0/2503165698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de415cce0 con 0x7f7de40d1220 2024-04-25T09:09:58.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.811+0000 7f7dec800640 1 -- 172.21.15.59:0/2503165698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de415d2a0 con 0x7f7de40d1220 2024-04-25T09:09:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.815+0000 7f7dec800640 1 -- 172.21.15.59:0/2503165698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de40745d0 con 0x7f7de40d1220 2024-04-25T09:09:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.815+0000 7f7dde000640 1 -- 172.21.15.59:0/2503165698 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7dd401a070 con 0x7f7de40d1220 2024-04-25T09:09:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.815+0000 7f7dde000640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7dc8066f60 0x7f7dc8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.815+0000 7f7dde000640 1 -- 172.21.15.59:0/2503165698 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6037+0+0 (secure 0 0 0) 0x7f7dd4084500 con 0x7f7de40d1220 2024-04-25T09:09:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.815+0000 7f7de9e00640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7dc8066f60 0x7f7dc8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.815+0000 7f7de9e00640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7dc8066f60 0x7f7dc8069420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8000f70 tx=0x7f7dd8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:58.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.819+0000 7f7dde000640 1 -- 172.21.15.59:0/2503165698 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7de40cadb0 con 0x7f7de40d1220 2024-04-25T09:09:58.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:58.979+0000 7f7dec800640 1 -- 172.21.15.59:0/2503165698 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7de4070100 con 0x7f7de40d1220 2024-04-25T09:09:59.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.631+0000 7f7dde000640 1 -- 172.21.15.59:0/2503165698 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v99) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7dd4054cd0 con 0x7f7de40d1220 2024-04-25T09:09:59.621 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-04-25T09:09:59.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.635+0000 7f7dec800640 1 -- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7dc8066f60 msgr2=0x7f7dc8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.635+0000 7f7dec800640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7dc8066f60 0x7f7dc8069420 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8000f70 tx=0x7f7dd8009040 comp rx=0 tx=0).stop 2024-04-25T09:09:59.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.635+0000 7f7dec800640 1 -- 172.21.15.59:0/2503165698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de40d1220 msgr2=0x7f7de415c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.635+0000 7f7dec800640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de40d1220 0x7f7de415c0d0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400c4d0 tx=0x7f7dd400c990 comp rx=0 tx=0).stop 2024-04-25T09:09:59.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.639+0000 7f7dec800640 1 -- 172.21.15.59:0/2503165698 shutdown_connections 2024-04-25T09:09:59.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.639+0000 7f7dec800640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7dc8066f60 0x7f7dc8069420 secure :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8000f70 tx=0x7f7dd8009040 comp rx=0 tx=0).stop 2024-04-25T09:09:59.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.639+0000 7f7dec800640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7de415b6d0 0x7f7de415c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.639+0000 7f7dec800640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7de40d1220 0x7f7de415c0d0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.639+0000 7f7dec800640 1 --2- 172.21.15.59:0/2503165698 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7de40713c0 0x7f7de41596b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.639+0000 7f7dec800640 1 -- 172.21.15.59:0/2503165698 >> 172.21.15.59:0/2503165698 conn(0x7f7de406f510 msgr2=0x7f7de4070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:59.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.639+0000 7f7dec800640 1 -- 172.21.15.59:0/2503165698 shutdown_connections 2024-04-25T09:09:59.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.639+0000 7f7dec800640 1 -- 172.21.15.59:0/2503165698 wait complete. 2024-04-25T09:09:59.662 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:09:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.819+0000 7f97db200640 1 Processor -- start 2024-04-25T09:09:59.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.819+0000 7f97db200640 1 -- start start 2024-04-25T09:09:59.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.819+0000 7f97db200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97dc072f60 0x7f97dc0cf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.819+0000 7f97db200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97dc06b4e0 0x7f97dc1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.819+0000 7f97db200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97dc15dfc0 con 0x7f97dc0cfc20 2024-04-25T09:09:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.819+0000 7f97db200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97dc15e2a0 con 0x7f97dc072f60 2024-04-25T09:09:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.819+0000 7f97db200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc15e580 con 0x7f97dc06b4e0 2024-04-25T09:09:59.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.819+0000 7f97d9e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97dc072f60 0x7f97dc0cf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.819+0000 7f97d9e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97dc072f60 0x7f97dc0cf6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40430/0 (socket says 172.21.15.59:40430) 2024-04-25T09:09:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.819+0000 7f97d9e00640 1 -- 172.21.15.59:0/71232813 learned_addr learned my addr 172.21.15.59:0/71232813 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.819+0000 7f97da800640 1 --2- 172.21.15.59:0/71232813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97dc06b4e0 0x7f97dc1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97d9e00640 1 -- 172.21.15.59:0/71232813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97dc06b4e0 msgr2=0x7f97dc1576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:09:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97d9e00640 1 --2- 172.21.15.59:0/71232813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97dc06b4e0 0x7f97dc1576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97d9e00640 1 -- 172.21.15.59:0/71232813 >> v1:172.21.15.178:6789/0 conn(0x7f97dc0cfc20 legacy=0x7f97dc06add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97d9e00640 1 -- 172.21.15.59:0/71232813 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc15e860 con 0x7f97dc072f60 2024-04-25T09:09:59.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97da800640 1 --2- 172.21.15.59:0/71232813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97dc06b4e0 0x7f97dc1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:59.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97d9e00640 1 --2- 172.21.15.59:0/71232813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc072f60 0x7f97dc0cf6e0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009e50 tx=0x7f97cc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deafc216cf23548f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97d9400640 1 -- 172.21.15.59:0/71232813 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0a5700 con 0x7f97dc072f60 2024-04-25T09:09:59.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97d9400640 1 -- 172.21.15.59:0/71232813 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97cc0a58a0 con 0x7f97dc072f60 2024-04-25T09:09:59.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97d9400640 1 -- 172.21.15.59:0/71232813 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97cc0a5c70 con 0x7f97dc072f60 2024-04-25T09:09:59.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97db200640 1 -- 172.21.15.59:0/71232813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc072f60 msgr2=0x7f97dc0cf6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97db200640 1 --2- 172.21.15.59:0/71232813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc072f60 0x7f97dc0cf6e0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009e50 tx=0x7f97cc01ca30 comp rx=0 tx=0).stop 2024-04-25T09:09:59.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97db200640 1 -- 172.21.15.59:0/71232813 shutdown_connections 2024-04-25T09:09:59.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97db200640 1 --2- 172.21.15.59:0/71232813 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97dc06b4e0 0x7f97dc1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97db200640 1 --2- 172.21.15.59:0/71232813 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc072f60 0x7f97dc0cf6e0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.823+0000 7f97db200640 1 -- 172.21.15.59:0/71232813 >> 172.21.15.59:0/71232813 conn(0x7f97dc0b21a0 msgr2=0x7f97dc0b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:59.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97db200640 1 -- 172.21.15.59:0/71232813 shutdown_connections 2024-04-25T09:09:59.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97db200640 1 -- 172.21.15.59:0/71232813 wait complete. 2024-04-25T09:09:59.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97db200640 1 Processor -- start 2024-04-25T09:09:59.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97db200640 1 -- start start 2024-04-25T09:09:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97db200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97dc06b4e0 0x7f97dc158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97db200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97dc072f60 0x7f97dc14f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97db200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc0cfc20 0x7f97dc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97db200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc1618b0 con 0x7f97dc0cfc20 2024-04-25T09:09:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97db200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc161730 con 0x7f97dc072f60 2024-04-25T09:09:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97db200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc161a30 con 0x7f97dc06b4e0 2024-04-25T09:09:59.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97da800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc0cfc20 0x7f97dc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97da800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc0cfc20 0x7f97dc0b4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40440/0 (socket says 172.21.15.59:40440) 2024-04-25T09:09:59.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97da800640 1 -- 172.21.15.59:0/992868489 learned_addr learned my addr 172.21.15.59:0/992868489 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:09:59.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97d9e00640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97dc06b4e0 0x7f97dc158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97d1400640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97dc072f60 0x7f97dc14f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97da800640 1 -- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97dc06b4e0 msgr2=0x7f97dc158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97da800640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97dc06b4e0 0x7f97dc158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97da800640 1 -- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97dc072f60 msgr2=0x7f97dc14f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97da800640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97dc072f60 0x7f97dc14f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97da800640 1 -- 172.21.15.59:0/992868489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc14f930 con 0x7f97dc0cfc20 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97d9e00640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97dc06b4e0 0x7f97dc158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97da800640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc0cfc20 0x7f97dc0b4f10 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f97d400e810 tx=0x7f97d400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97d2a00640 1 -- 172.21.15.59:0/992868489 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d4017070 con 0x7f97dc0cfc20 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97d2a00640 1 -- 172.21.15.59:0/992868489 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d400c6d0 con 0x7f97dc0cfc20 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97d2a00640 1 -- 172.21.15.59:0/992868489 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d400f040 con 0x7f97dc0cfc20 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97db200640 1 -- 172.21.15.59:0/992868489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc152930 con 0x7f97dc0cfc20 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.827+0000 7f97db200640 1 -- 172.21.15.59:0/992868489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc152ef0 con 0x7f97dc0cfc20 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.831+0000 7f97db200640 1 -- 172.21.15.59:0/992868489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc0745d0 con 0x7f97dc0cfc20 2024-04-25T09:09:59.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.831+0000 7f97d2a00640 1 -- 172.21.15.59:0/992868489 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f97d401a070 con 0x7f97dc0cfc20 2024-04-25T09:09:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.831+0000 7f97d2a00640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f97b8066f60 0x7f97b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:09:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.831+0000 7f97d2a00640 1 -- 172.21.15.59:0/992868489 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f97d4084a60 con 0x7f97dc0cfc20 2024-04-25T09:09:59.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.831+0000 7f97d9e00640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f97b8066f60 0x7f97b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:09:59.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.831+0000 7f97d9e00640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f97b8066f60 0x7f97b8069420 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0ae000 tx=0x7f97cc0a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:09:59.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.835+0000 7f97d2a00640 1 -- 172.21.15.59:0/992868489 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f97d40554d0 con 0x7f97dc0cfc20 2024-04-25T09:09:59.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.999+0000 7f97db200640 1 -- 172.21.15.59:0/992868489 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f97dc072720 con 0x7f97dc0cfc20 2024-04-25T09:09:59.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:09:59.999+0000 7f97d2a00640 1 -- 172.21.15.59:0/992868489 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f97d4059570 con 0x7f97dc0cfc20 2024-04-25T09:09:59.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.003+0000 7f97db200640 1 -- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f97b8066f60 msgr2=0x7f97b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.003+0000 7f97db200640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f97b8066f60 0x7f97b8069420 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f97cc0ae000 tx=0x7f97cc0a7070 comp rx=0 tx=0).stop 2024-04-25T09:09:59.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.003+0000 7f97db200640 1 -- 172.21.15.59:0/992868489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc0cfc20 msgr2=0x7f97dc0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:09:59.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.003+0000 7f97db200640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc0cfc20 0x7f97dc0b4f10 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f97d400e810 tx=0x7f97d400ecd0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.003+0000 7f97db200640 1 -- 172.21.15.59:0/992868489 shutdown_connections 2024-04-25T09:09:59.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.003+0000 7f97db200640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f97b8066f60 0x7f97b8069420 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.003+0000 7f97db200640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97dc0cfc20 0x7f97dc0b4f10 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.003+0000 7f97db200640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f97dc072f60 0x7f97dc14f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.003+0000 7f97db200640 1 --2- 172.21.15.59:0/992868489 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f97dc06b4e0 0x7f97dc158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:09:59.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.003+0000 7f97db200640 1 -- 172.21.15.59:0/992868489 >> 172.21.15.59:0/992868489 conn(0x7f97dc0b21a0 msgr2=0x7f97dc15d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:09:59.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.003+0000 7f97db200640 1 -- 172.21.15.59:0/992868489 shutdown_connections 2024-04-25T09:09:59.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.003+0000 7f97db200640 1 -- 172.21.15.59:0/992868489 wait complete. 2024-04-25T09:10:00.013 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-25T09:10:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.167+0000 7f0bf8a00640 1 Processor -- start 2024-04-25T09:10:00.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.167+0000 7f0bf8a00640 1 -- start start 2024-04-25T09:10:00.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf8a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0bf4145270 0x7f0bf415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf8a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bf40b1e60 0x7f0bf40cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf8a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bf40cc4e0 con 0x7f0bf40cd4d0 2024-04-25T09:10:00.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf8a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf4145650 con 0x7f0bf4145270 2024-04-25T09:10:00.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf8a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40ce040 con 0x7f0bf40b1e60 2024-04-25T09:10:00.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf1e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0bf4145270 0x7f0bf415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf1400640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f0bf40cd4d0 0x7f0bf40b1750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:40324/0 (socket says 172.21.15.59:40324) 2024-04-25T09:10:00.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf2800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bf40b1e60 0x7f0bf40cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf1400640 1 -- 172.21.15.59:0/644658098 learned_addr learned my addr 172.21.15.59:0/644658098 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:00.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf1e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0bf4145270 0x7f0bf415fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:38550/0 (socket says 172.21.15.59:38550) 2024-04-25T09:10:00.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf1e00640 1 -- 172.21.15.59:0/644658098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bf40b1e60 msgr2=0x7f0bf40cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:00.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf1e00640 1 --2- 172.21.15.59:0/644658098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bf40b1e60 0x7f0bf40cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf1e00640 1 -- 172.21.15.59:0/644658098 >> v1:172.21.15.178:6789/0 conn(0x7f0bf40cd4d0 legacy=0x7f0bf40b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.171+0000 7f0bf1e00640 1 -- 172.21.15.59:0/644658098 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf40ce320 con 0x7f0bf4145270 2024-04-25T09:10:00.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf1e00640 1 --2- 172.21.15.59:0/644658098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bf4145270 0x7f0bf415fe50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0be40097c0 tx=0x7f0be401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aeae451fabc52f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf0a00640 1 -- 172.21.15.59:0/644658098 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40b2070 con 0x7f0bf4145270 2024-04-25T09:10:00.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf0a00640 1 -- 172.21.15.59:0/644658098 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be40ad640 con 0x7f0bf4145270 2024-04-25T09:10:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf0a00640 1 -- 172.21.15.59:0/644658098 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40ada10 con 0x7f0bf4145270 2024-04-25T09:10:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf8a00640 1 -- 172.21.15.59:0/644658098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bf4145270 msgr2=0x7f0bf415fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf8a00640 1 --2- 172.21.15.59:0/644658098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bf4145270 0x7f0bf415fe50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0be40097c0 tx=0x7f0be401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf8a00640 1 -- 172.21.15.59:0/644658098 shutdown_connections 2024-04-25T09:10:00.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf8a00640 1 --2- 172.21.15.59:0/644658098 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bf40b1e60 0x7f0bf40cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf8a00640 1 --2- 172.21.15.59:0/644658098 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bf4145270 0x7f0bf415fe50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf8a00640 1 -- 172.21.15.59:0/644658098 >> 172.21.15.59:0/644658098 conn(0x7f0bf4066fa0 msgr2=0x7f0bf406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf8a00640 1 -- 172.21.15.59:0/644658098 shutdown_connections 2024-04-25T09:10:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf8a00640 1 -- 172.21.15.59:0/644658098 wait complete. 2024-04-25T09:10:00.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf8a00640 1 Processor -- start 2024-04-25T09:10:00.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.175+0000 7f0bf8a00640 1 -- start start 2024-04-25T09:10:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf8a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bf40b1e60 0x7f0bf41610b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf8a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bf40cd4d0 0x7f0bf415b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf8a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bf4145270 0x7f0bf40b0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf8a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf415c710 con 0x7f0bf40b1e60 2024-04-25T09:10:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf8a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf415c590 con 0x7f0bf4145270 2024-04-25T09:10:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf8a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf415c890 con 0x7f0bf40cd4d0 2024-04-25T09:10:00.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bf40b1e60 0x7f0bf41610b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bf40b1e60 0x7f0bf41610b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40452/0 (socket says 172.21.15.59:40452) 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf1e00640 1 -- 172.21.15.59:0/2719686677 learned_addr learned my addr 172.21.15.59:0/2719686677 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf2800640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bf4145270 0x7f0bf40b0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf1400640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bf40cd4d0 0x7f0bf415b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf1e00640 1 -- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bf40cd4d0 msgr2=0x7f0bf415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf1e00640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bf40cd4d0 0x7f0bf415b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf1e00640 1 -- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bf4145270 msgr2=0x7f0bf40b0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf1e00640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bf4145270 0x7f0bf40b0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf1e00640 1 -- 172.21.15.59:0/2719686677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf4143e30 con 0x7f0bf40b1e60 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf1e00640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bf40b1e60 0x7f0bf41610b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f0be40b0040 tx=0x7f0be4019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bea000640 1 -- 172.21.15.59:0/2719686677 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40ba020 con 0x7f0bf40b1e60 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bea000640 1 -- 172.21.15.59:0/2719686677 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be40b6410 con 0x7f0bf40b1e60 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf8a00640 1 -- 172.21.15.59:0/2719686677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf4144110 con 0x7f0bf40b1e60 2024-04-25T09:10:00.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bea000640 1 -- 172.21.15.59:0/2719686677 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be40b2040 con 0x7f0bf40b1e60 2024-04-25T09:10:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf8a00640 1 -- 172.21.15.59:0/2719686677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf41446d0 con 0x7f0bf40b1e60 2024-04-25T09:10:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.179+0000 7f0bf8a00640 1 -- 172.21.15.59:0/2719686677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf40745d0 con 0x7f0bf40b1e60 2024-04-25T09:10:00.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.183+0000 7f0bea000640 1 -- 172.21.15.59:0/2719686677 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0be40bd020 con 0x7f0bf40b1e60 2024-04-25T09:10:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.183+0000 7f0bea000640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0bd4066f90 0x7f0bd4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.183+0000 7f0bea000640 1 -- 172.21.15.59:0/2719686677 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f0be411eb80 con 0x7f0bf40b1e60 2024-04-25T09:10:00.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.183+0000 7f0bf1400640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0bd4066f90 0x7f0bd4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.183+0000 7f0bf1400640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0bd4066f90 0x7f0bd4069450 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4143840 tx=0x7f0be0007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.187+0000 7f0bea000640 1 -- 172.21.15.59:0/2719686677 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0be40c4030 con 0x7f0bf40b1e60 2024-04-25T09:10:00.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.403+0000 7f0bf8a00640 1 -- 172.21.15.59:0/2719686677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7f0bf406b8e0 con 0x7f0bf40b1e60 2024-04-25T09:10:00.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.655+0000 7f0bea000640 1 -- 172.21.15.59:0/2719686677 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v417) v1 ==== 167+0+0 (secure 0 0 0) 0x7f0be4016090 con 0x7f0bf40b1e60 2024-04-25T09:10:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.659+0000 7f0bf8a00640 1 -- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0bd4066f90 msgr2=0x7f0bd4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.659+0000 7f0bf8a00640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0bd4066f90 0x7f0bd4069450 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4143840 tx=0x7f0be0007e90 comp rx=0 tx=0).stop 2024-04-25T09:10:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.659+0000 7f0bf8a00640 1 -- 172.21.15.59:0/2719686677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bf40b1e60 msgr2=0x7f0bf41610b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.659+0000 7f0bf8a00640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bf40b1e60 0x7f0bf41610b0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f0be40b0040 tx=0x7f0be4019240 comp rx=0 tx=0).stop 2024-04-25T09:10:00.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.659+0000 7f0bf8a00640 1 -- 172.21.15.59:0/2719686677 shutdown_connections 2024-04-25T09:10:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.659+0000 7f0bf8a00640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0bd4066f90 0x7f0bd4069450 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.659+0000 7f0bf8a00640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0bf4145270 0x7f0bf40b0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.659+0000 7f0bf8a00640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0bf40cd4d0 0x7f0bf415b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.659+0000 7f0bf8a00640 1 --2- 172.21.15.59:0/2719686677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bf40b1e60 0x7f0bf41610b0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.659+0000 7f0bf8a00640 1 -- 172.21.15.59:0/2719686677 >> 172.21.15.59:0/2719686677 conn(0x7f0bf4066fa0 msgr2=0x7f0bf40b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.659+0000 7f0bf8a00640 1 -- 172.21.15.59:0/2719686677 shutdown_connections 2024-04-25T09:10:00.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.659+0000 7f0bf8a00640 1 -- 172.21.15.59:0/2719686677 wait complete. 2024-04-25T09:10:00.668 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-25T09:10:00.668 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:10:00.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:00.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.819+0000 7fadc2800640 1 Processor -- start 2024-04-25T09:10:00.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.819+0000 7fadc2800640 1 -- start start 2024-04-25T09:10:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.819+0000 7fadc2800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fadbc15da10 0x7fadbc0afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.819+0000 7fadc2800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fadbc0d11b0 0x7fadbc06ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.819+0000 7fadc2800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc0b4210 0x7fadbc0b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.819+0000 7fadc2800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc0b4ba0 con 0x7fadbc0d11b0 2024-04-25T09:10:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.819+0000 7fadc2800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadbc15ddf0 con 0x7fadbc15da10 2024-04-25T09:10:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.819+0000 7fadc2800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc06b480 con 0x7fadbc0b4210 2024-04-25T09:10:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadb2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fadbc0d11b0 0x7fadbc06ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadb2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fadbc0d11b0 0x7fadbc06ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:54994/0 (socket says 172.21.15.59:54994) 2024-04-25T09:10:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadb2a00640 1 -- 172.21.15.59:0/1199681411 learned_addr learned my addr 172.21.15.59:0/1199681411 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadbb400640 1 --2- 172.21.15.59:0/1199681411 >> v2:172.21.15.178:3300/0 conn(0x7fadbc15da10 0x7fadbc0afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadbbe00640 1 --2- 172.21.15.59:0/1199681411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc0b4210 0x7fadbc0b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadb2a00640 1 -- 172.21.15.59:0/1199681411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc0b4210 msgr2=0x7fadbc0b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadb2a00640 1 --2- 172.21.15.59:0/1199681411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc0b4210 0x7fadbc0b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadb2a00640 1 -- 172.21.15.59:0/1199681411 >> v2:172.21.15.178:3300/0 conn(0x7fadbc15da10 msgr2=0x7fadbc0afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadb2a00640 1 --2- 172.21.15.59:0/1199681411 >> v2:172.21.15.178:3300/0 conn(0x7fadbc15da10 0x7fadbc0afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadb2a00640 1 -- 172.21.15.59:0/1199681411 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc0d06d0 con 0x7fadbc0d11b0 2024-04-25T09:10:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadbbe00640 1 --2- 172.21.15.59:0/1199681411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc0b4210 0x7fadbc0b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:00.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadbb400640 1 --2- 172.21.15.59:0/1199681411 >> v2:172.21.15.178:3300/0 conn(0x7fadbc15da10 0x7fadbc0afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:00.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadb2a00640 1 --2- 172.21.15.59:0/1199681411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc0d11b0 0x7fadbc06ac10 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0684f0 tx=0x7fada401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a18d3e0dfae947 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadbaa00640 1 -- 172.21.15.59:0/1199681411 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada40b0070 con 0x7fadbc0d11b0 2024-04-25T09:10:00.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadbaa00640 1 -- 172.21.15.59:0/1199681411 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada40ab600 con 0x7fadbc0d11b0 2024-04-25T09:10:00.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.823+0000 7fadbaa00640 1 -- 172.21.15.59:0/1199681411 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada40ab9d0 con 0x7fadbc0d11b0 2024-04-25T09:10:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 -- 172.21.15.59:0/1199681411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc0d11b0 msgr2=0x7fadbc06ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 --2- 172.21.15.59:0/1199681411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc0d11b0 0x7fadbc06ac10 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0684f0 tx=0x7fada401c490 comp rx=0 tx=0).stop 2024-04-25T09:10:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 -- 172.21.15.59:0/1199681411 shutdown_connections 2024-04-25T09:10:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 --2- 172.21.15.59:0/1199681411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc0b4210 0x7fadbc0b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 --2- 172.21.15.59:0/1199681411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc0d11b0 0x7fadbc06ac10 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 --2- 172.21.15.59:0/1199681411 >> v2:172.21.15.178:3300/0 conn(0x7fadbc15da10 0x7fadbc0afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 -- 172.21.15.59:0/1199681411 >> 172.21.15.59:0/1199681411 conn(0x7fadbc0b2400 msgr2=0x7fadbc0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 -- 172.21.15.59:0/1199681411 shutdown_connections 2024-04-25T09:10:00.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 -- 172.21.15.59:0/1199681411 wait complete. 2024-04-25T09:10:00.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 Processor -- start 2024-04-25T09:10:00.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 -- start start 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc0b4210 0x7fadbc1574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc0d11b0 0x7fadbc14ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadbc15da10 0x7fadbc15e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc0704b0 con 0x7fadbc0d11b0 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc070330 con 0x7fadbc15da10 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadc2800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadbc070630 con 0x7fadbc0b4210 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadb2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc0d11b0 0x7fadbc14ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadb2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc0d11b0 0x7fadbc14ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55002/0 (socket says 172.21.15.59:55002) 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadb2a00640 1 -- 172.21.15.59:0/1194892434 learned_addr learned my addr 172.21.15.59:0/1194892434 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadbb400640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc0b4210 0x7fadbc1574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadbbe00640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadbc15da10 0x7fadbc15e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadb2a00640 1 -- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc0b4210 msgr2=0x7fadbc1574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadb2a00640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc0b4210 0x7fadbc1574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadb2a00640 1 -- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadbc15da10 msgr2=0x7fadbc15e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadb2a00640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadbc15da10 0x7fadbc15e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadb2a00640 1 -- 172.21.15.59:0/1194892434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc150960 con 0x7fadbc0d11b0 2024-04-25T09:10:00.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadbbe00640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadbc15da10 0x7fadbc15e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:00.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.827+0000 7fadb2a00640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc0d11b0 0x7fadbc14ee00 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fada401cd30 tx=0x7fada4019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.831+0000 7fadb3e00640 1 -- 172.21.15.59:0/1194892434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada40b9070 con 0x7fadbc0d11b0 2024-04-25T09:10:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.831+0000 7fadb3e00640 1 -- 172.21.15.59:0/1194892434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada40b4420 con 0x7fadbc0d11b0 2024-04-25T09:10:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.831+0000 7fadc2800640 1 -- 172.21.15.59:0/1194892434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadbc15ed00 con 0x7fadbc0d11b0 2024-04-25T09:10:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.831+0000 7fadb3e00640 1 -- 172.21.15.59:0/1194892434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada40b0040 con 0x7fadbc0d11b0 2024-04-25T09:10:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.831+0000 7fadc2800640 1 -- 172.21.15.59:0/1194892434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadbc15f280 con 0x7fadbc0d11b0 2024-04-25T09:10:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.831+0000 7fadc2800640 1 -- 172.21.15.59:0/1194892434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadbc0745d0 con 0x7fadbc0d11b0 2024-04-25T09:10:00.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.831+0000 7fadb3e00640 1 -- 172.21.15.59:0/1194892434 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fada40bc070 con 0x7fadbc0d11b0 2024-04-25T09:10:00.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.831+0000 7fadb3e00640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad98066f60 0x7fad98069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:00.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.831+0000 7fadb3e00640 1 -- 172.21.15.59:0/1194892434 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fada411e160 con 0x7fadbc0d11b0 2024-04-25T09:10:00.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.831+0000 7fadbb400640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad98066f60 0x7fad98069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:00.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.835+0000 7fadbb400640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad98066f60 0x7fad98069420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fadbc158f40 tx=0x7fadac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:00.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.835+0000 7fadb3e00640 1 -- 172.21.15.59:0/1194892434 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fada4016110 con 0x7fadbc0d11b0 2024-04-25T09:10:00.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.999+0000 7fadc2800640 1 -- 172.21.15.59:0/1194892434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadbc06d360 con 0x7fadbc0d11b0 2024-04-25T09:10:00.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:00.999+0000 7fadb3e00640 1 -- 172.21.15.59:0/1194892434 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+13554 (secure 0 0 0) 0x7fada40ef220 con 0x7fadbc0d11b0 2024-04-25T09:10:00.989 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:00.989 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":99,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:09:59.633072+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/1467736863":"2024-04-26T09:09:56.621300+0000","172.21.15.59:6833/1467736863":"2024-04-26T09:09:56.621300+0000","172.21.15.59:6835/4079513876":"2024-04-26T09:09:12.143656+0000","172.21.15.59:6833/4079513876":"2024-04-26T09:09:12.143656+0000","172.21.15.59:6835/3531112441":"2024-04-26T09:07:59.742787+0000","172.21.15.59:6833/3531112441":"2024-04-26T09:07:59.742787+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:00.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.003+0000 7fadc2800640 1 -- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad98066f60 msgr2=0x7fad98069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.003+0000 7fadc2800640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad98066f60 0x7fad98069420 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fadbc158f40 tx=0x7fadac008040 comp rx=0 tx=0).stop 2024-04-25T09:10:00.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.003+0000 7fadc2800640 1 -- 172.21.15.59:0/1194892434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc0d11b0 msgr2=0x7fadbc14ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:00.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.003+0000 7fadc2800640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc0d11b0 0x7fadbc14ee00 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fada401cd30 tx=0x7fada4019230 comp rx=0 tx=0).stop 2024-04-25T09:10:00.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.003+0000 7fadc2800640 1 -- 172.21.15.59:0/1194892434 shutdown_connections 2024-04-25T09:10:00.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.003+0000 7fadc2800640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad98066f60 0x7fad98069420 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.003+0000 7fadc2800640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fadbc15da10 0x7fadbc15e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.003+0000 7fadc2800640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fadbc0d11b0 0x7fadbc14ee00 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.003+0000 7fadc2800640 1 --2- 172.21.15.59:0/1194892434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fadbc0b4210 0x7fadbc1574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:00.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.003+0000 7fadc2800640 1 -- 172.21.15.59:0/1194892434 >> 172.21.15.59:0/1194892434 conn(0x7fadbc0b2400 msgr2=0x7fadbc159250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:00.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.003+0000 7fadc2800640 1 -- 172.21.15.59:0/1194892434 shutdown_connections 2024-04-25T09:10:00.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.003+0000 7fadc2800640 1 -- 172.21.15.59:0/1194892434 wait complete. 2024-04-25T09:10:01.010 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:10:01.010 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:10:01.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.163+0000 7ff495000640 1 Processor -- start 2024-04-25T09:10:01.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff495000640 1 -- start start 2024-04-25T09:10:01.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff495000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49015dc60 0x7ff4900d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff495000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff49009a170 0x7ff4900cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff495000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49015e040 con 0x7ff49006bf30 2024-04-25T09:10:01.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff495000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4900cff80 con 0x7ff49009a170 2024-04-25T09:10:01.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff495000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900d0260 con 0x7ff49015dc60 2024-04-25T09:10:01.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff48e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff49009a170 0x7ff4900cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff48e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff49009a170 0x7ff4900cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55008/0 (socket says 172.21.15.59:55008) 2024-04-25T09:10:01.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff48e800640 1 -- 172.21.15.59:0/3838987992 learned_addr learned my addr 172.21.15.59:0/3838987992 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:01.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff48e800640 1 -- 172.21.15.59:0/3838987992 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49015dc60 msgr2=0x7ff4900d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:01.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff48de00640 1 --2- 172.21.15.59:0/3838987992 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49015dc60 0x7ff4900d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff48e800640 1 --2- 172.21.15.59:0/3838987992 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49015dc60 0x7ff4900d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff48e800640 1 -- 172.21.15.59:0/3838987992 >> v1:172.21.15.178:6789/0 conn(0x7ff49006bf30 legacy=0x7ff490099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:01.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff48e800640 1 -- 172.21.15.59:0/3838987992 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4900d0540 con 0x7ff49009a170 2024-04-25T09:10:01.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.167+0000 7ff48de00640 1 --2- 172.21.15.59:0/3838987992 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49015dc60 0x7ff4900d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:01.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff48e800640 1 --2- 172.21.15.59:0/3838987992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49009a170 0x7ff4900cf8a0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff488009e50 tx=0x7ff48801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46dcc3af7429408 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:01.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff48d400640 1 -- 172.21.15.59:0/3838987992 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880a57b0 con 0x7ff49009a170 2024-04-25T09:10:01.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff48d400640 1 -- 172.21.15.59:0/3838987992 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4880a5950 con 0x7ff49009a170 2024-04-25T09:10:01.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff48d400640 1 -- 172.21.15.59:0/3838987992 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880a5d20 con 0x7ff49009a170 2024-04-25T09:10:01.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff495000640 1 -- 172.21.15.59:0/3838987992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49009a170 msgr2=0x7ff4900cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff495000640 1 --2- 172.21.15.59:0/3838987992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49009a170 0x7ff4900cf8a0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7ff488009e50 tx=0x7ff48801c930 comp rx=0 tx=0).stop 2024-04-25T09:10:01.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff495000640 1 -- 172.21.15.59:0/3838987992 shutdown_connections 2024-04-25T09:10:01.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff495000640 1 --2- 172.21.15.59:0/3838987992 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49009a170 0x7ff4900cf8a0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff495000640 1 --2- 172.21.15.59:0/3838987992 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49015dc60 0x7ff4900d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff495000640 1 -- 172.21.15.59:0/3838987992 >> 172.21.15.59:0/3838987992 conn(0x7ff4900b3200 msgr2=0x7ff4900b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:01.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff495000640 1 -- 172.21.15.59:0/3838987992 shutdown_connections 2024-04-25T09:10:01.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff495000640 1 -- 172.21.15.59:0/3838987992 wait complete. 2024-04-25T09:10:01.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff495000640 1 Processor -- start 2024-04-25T09:10:01.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.171+0000 7ff495000640 1 -- start start 2024-04-25T09:10:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff495000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49006bf30 0x7ff49009e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff495000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49009a170 0x7ff4900b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff495000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49015dc60 0x7ff4900c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff495000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900cc6f0 con 0x7ff49015dc60 2024-04-25T09:10:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff495000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900cc570 con 0x7ff49006bf30 2024-04-25T09:10:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff495000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4900cc870 con 0x7ff49009a170 2024-04-25T09:10:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff48e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49015dc60 0x7ff4900c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff48e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49015dc60 0x7ff4900c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55010/0 (socket says 172.21.15.59:55010) 2024-04-25T09:10:01.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff48e800640 1 -- 172.21.15.59:0/1187947297 learned_addr learned my addr 172.21.15.59:0/1187947297 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:01.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff48de00640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49006bf30 0x7ff49009e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff485400640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49009a170 0x7ff4900b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff48e800640 1 -- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49009a170 msgr2=0x7ff4900b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff48e800640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49009a170 0x7ff4900b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff48e800640 1 -- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49006bf30 msgr2=0x7ff49009e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff48e800640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49006bf30 0x7ff49009e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff48e800640 1 -- 172.21.15.59:0/1187947297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49009d400 con 0x7ff49015dc60 2024-04-25T09:10:01.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff48e800640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49015dc60 0x7ff4900c87e0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff48801afe0 tx=0x7ff4880196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:01.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff486a00640 1 -- 172.21.15.59:0/1187947297 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880bc020 con 0x7ff49015dc60 2024-04-25T09:10:01.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff486a00640 1 -- 172.21.15.59:0/1187947297 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4880b8880 con 0x7ff49015dc60 2024-04-25T09:10:01.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff486a00640 1 -- 172.21.15.59:0/1187947297 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4880b8c70 con 0x7ff49015dc60 2024-04-25T09:10:01.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff495000640 1 -- 172.21.15.59:0/1187947297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff49009d6e0 con 0x7ff49015dc60 2024-04-25T09:10:01.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff495000640 1 -- 172.21.15.59:0/1187947297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff49009dca0 con 0x7ff49015dc60 2024-04-25T09:10:01.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff495000640 1 -- 172.21.15.59:0/1187947297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4900745d0 con 0x7ff49015dc60 2024-04-25T09:10:01.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.175+0000 7ff486a00640 1 -- 172.21.15.59:0/1187947297 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff4880bf020 con 0x7ff49015dc60 2024-04-25T09:10:01.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.179+0000 7ff486a00640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff46c066f90 0x7ff46c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.179+0000 7ff486a00640 1 -- 172.21.15.59:0/1187947297 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5507+0+0 (secure 0 0 0) 0x7ff488120350 con 0x7ff49015dc60 2024-04-25T09:10:01.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.179+0000 7ff48de00640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff46c066f90 0x7ff46c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.179+0000 7ff48de00640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff46c066f90 0x7ff46c069450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff47800a9a0 tx=0x7ff478008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:01.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.183+0000 7ff486a00640 1 -- 172.21.15.59:0/1187947297 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff4880c6030 con 0x7ff49015dc60 2024-04-25T09:10:01.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 -- 172.21.15.59:0/1187947297 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4900b7590 con 0x7ff49015dc60 2024-04-25T09:10:01.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff486a00640 1 -- 172.21.15.59:0/1187947297 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4880165e0 con 0x7ff49015dc60 2024-04-25T09:10:01.338 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:10:01.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 -- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff46c066f90 msgr2=0x7ff46c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff46c066f90 0x7ff46c069450 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7ff47800a9a0 tx=0x7ff478008040 comp rx=0 tx=0).stop 2024-04-25T09:10:01.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 -- 172.21.15.59:0/1187947297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49015dc60 msgr2=0x7ff4900c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49015dc60 0x7ff4900c87e0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7ff48801afe0 tx=0x7ff4880196d0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 -- 172.21.15.59:0/1187947297 shutdown_connections 2024-04-25T09:10:01.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff46c066f90 0x7ff46c069450 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff49015dc60 0x7ff4900c87e0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff49009a170 0x7ff4900b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 --2- 172.21.15.59:0/1187947297 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff49006bf30 0x7ff49009e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 -- 172.21.15.59:0/1187947297 >> 172.21.15.59:0/1187947297 conn(0x7ff4900b3200 msgr2=0x7ff4900ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:01.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 -- 172.21.15.59:0/1187947297 shutdown_connections 2024-04-25T09:10:01.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.347+0000 7ff495000640 1 -- 172.21.15.59:0/1187947297 wait complete. 2024-04-25T09:10:01.357 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-25T09:10:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.507+0000 7f09e1c00640 1 Processor -- start 2024-04-25T09:10:01.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.507+0000 7f09e1c00640 1 -- start start 2024-04-25T09:10:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09e1c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f09dc145270 0x7f09dc15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09e1c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09dc0cd4d0 0x7f09dc0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09e1c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09dc0b1750 0x7f09dc0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09e1c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09dc145650 con 0x7f09dc0cd4d0 2024-04-25T09:10:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09e1c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09dc0b20c0 con 0x7f09dc145270 2024-04-25T09:10:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09e1c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc0cc4e0 con 0x7f09dc0b1750 2024-04-25T09:10:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09d3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09dc0cd4d0 0x7f09dc0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09d3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09dc0cd4d0 0x7f09dc0cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55026/0 (socket says 172.21.15.59:55026) 2024-04-25T09:10:01.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09d3e00640 1 -- 172.21.15.59:0/1748907138 learned_addr learned my addr 172.21.15.59:0/1748907138 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:01.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09db400640 1 --2- 172.21.15.59:0/1748907138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09dc0b1750 0x7f09dc0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09daa00640 1 --2- 172.21.15.59:0/1748907138 >> v2:172.21.15.178:3300/0 conn(0x7f09dc145270 0x7f09dc15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09d3e00640 1 -- 172.21.15.59:0/1748907138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09dc0b1750 msgr2=0x7f09dc0b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:01.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09d3e00640 1 --2- 172.21.15.59:0/1748907138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09dc0b1750 0x7f09dc0b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09d3e00640 1 -- 172.21.15.59:0/1748907138 >> v2:172.21.15.178:3300/0 conn(0x7f09dc145270 msgr2=0x7f09dc15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:01.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09d3e00640 1 --2- 172.21.15.59:0/1748907138 >> v2:172.21.15.178:3300/0 conn(0x7f09dc145270 0x7f09dc15fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09d3e00640 1 -- 172.21.15.59:0/1748907138 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc0ce040 con 0x7f09dc0cd4d0 2024-04-25T09:10:01.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.511+0000 7f09d3e00640 1 --2- 172.21.15.59:0/1748907138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09dc0cd4d0 0x7f09dc0cd930 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f09dc06f3a0 tx=0x7f09c401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0901b8367c473e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09da000640 1 -- 172.21.15.59:0/1748907138 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c40b1070 con 0x7f09dc0cd4d0 2024-04-25T09:10:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09da000640 1 -- 172.21.15.59:0/1748907138 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c40ac630 con 0x7f09dc0cd4d0 2024-04-25T09:10:01.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09da000640 1 -- 172.21.15.59:0/1748907138 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c40a8050 con 0x7f09dc0cd4d0 2024-04-25T09:10:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 -- 172.21.15.59:0/1748907138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09dc0cd4d0 msgr2=0x7f09dc0cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 --2- 172.21.15.59:0/1748907138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09dc0cd4d0 0x7f09dc0cd930 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f09dc06f3a0 tx=0x7f09c401c520 comp rx=0 tx=0).stop 2024-04-25T09:10:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 -- 172.21.15.59:0/1748907138 shutdown_connections 2024-04-25T09:10:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 --2- 172.21.15.59:0/1748907138 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09dc0b1750 0x7f09dc0b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 --2- 172.21.15.59:0/1748907138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09dc0cd4d0 0x7f09dc0cd930 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 --2- 172.21.15.59:0/1748907138 >> v2:172.21.15.178:3300/0 conn(0x7f09dc145270 0x7f09dc15fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 -- 172.21.15.59:0/1748907138 >> 172.21.15.59:0/1748907138 conn(0x7f09dc066fa0 msgr2=0x7f09dc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 -- 172.21.15.59:0/1748907138 shutdown_connections 2024-04-25T09:10:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 -- 172.21.15.59:0/1748907138 wait complete. 2024-04-25T09:10:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 Processor -- start 2024-04-25T09:10:01.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 -- start start 2024-04-25T09:10:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09dc0b1750 0x7f09dc140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09dc0cd4d0 0x7f09dc13d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09dc145270 0x7f09dc147350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc15c590 con 0x7f09dc0b1750 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc15f930 con 0x7f09dc145270 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09e1c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09dc15c710 con 0x7f09dc0cd4d0 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09daa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09dc0b1750 0x7f09dc140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09daa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09dc0b1750 0x7f09dc140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55036/0 (socket says 172.21.15.59:55036) 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.515+0000 7f09daa00640 1 -- 172.21.15.59:0/4217768503 learned_addr learned my addr 172.21.15.59:0/4217768503 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09db400640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09dc145270 0x7f09dc147350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09d3e00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09dc0cd4d0 0x7f09dc13d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09daa00640 1 -- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09dc0cd4d0 msgr2=0x7f09dc13d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09daa00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09dc0cd4d0 0x7f09dc13d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09daa00640 1 -- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09dc145270 msgr2=0x7f09dc147350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09daa00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09dc145270 0x7f09dc147350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09daa00640 1 -- 172.21.15.59:0/4217768503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09dc147890 con 0x7f09dc0b1750 2024-04-25T09:10:01.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09daa00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09dc0b1750 0x7f09dc140df0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00d620 tx=0x7f09cc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:01.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09d2a00640 1 -- 172.21.15.59:0/4217768503 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0125f0 con 0x7f09dc0b1750 2024-04-25T09:10:01.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09d2a00640 1 -- 172.21.15.59:0/4217768503 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09cc019070 con 0x7f09dc0b1750 2024-04-25T09:10:01.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09e1c00640 1 -- 172.21.15.59:0/4217768503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09dc13e060 con 0x7f09dc0b1750 2024-04-25T09:10:01.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09d2a00640 1 -- 172.21.15.59:0/4217768503 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0129b0 con 0x7f09dc0b1750 2024-04-25T09:10:01.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09e1c00640 1 -- 172.21.15.59:0/4217768503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09dc13e620 con 0x7f09dc0b1750 2024-04-25T09:10:01.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09e1c00640 1 -- 172.21.15.59:0/4217768503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09dc0745d0 con 0x7f09dc0b1750 2024-04-25T09:10:01.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.519+0000 7f09d2a00640 1 -- 172.21.15.59:0/4217768503 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f09cc012b50 con 0x7f09dc0b1750 2024-04-25T09:10:01.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.523+0000 7f09d2a00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09b8066f60 0x7f09b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:01.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.523+0000 7f09d2a00640 1 -- 172.21.15.59:0/4217768503 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f09cc085de0 con 0x7f09dc0b1750 2024-04-25T09:10:01.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.523+0000 7f09d3e00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09b8066f60 0x7f09b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:01.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.523+0000 7f09d3e00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09b8066f60 0x7f09b8069420 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f09c40ae000 tx=0x7f09c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:01.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.523+0000 7f09d2a00640 1 -- 172.21.15.59:0/4217768503 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f09cc013390 con 0x7f09dc0b1750 2024-04-25T09:10:01.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:01.743+0000 7f09e1c00640 1 -- 172.21.15.59:0/4217768503 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f09dc06b8e0 con 0x7f09dc0b1750 2024-04-25T09:10:02.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.663+0000 7f09d2a00640 1 -- 172.21.15.59:0/4217768503 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v419) v1 ==== 149+0+0 (secure 0 0 0) 0x7f09cc056f20 con 0x7f09dc0b1750 2024-04-25T09:10:02.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.663+0000 7f09e1c00640 1 -- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09b8066f60 msgr2=0x7f09b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.663+0000 7f09e1c00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09b8066f60 0x7f09b8069420 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f09c40ae000 tx=0x7f09c4008040 comp rx=0 tx=0).stop 2024-04-25T09:10:02.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.667+0000 7f09e1c00640 1 -- 172.21.15.59:0/4217768503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09dc0b1750 msgr2=0x7f09dc140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.667+0000 7f09e1c00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09dc0b1750 0x7f09dc140df0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00d620 tx=0x7f09cc00dae0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.667+0000 7f09e1c00640 1 -- 172.21.15.59:0/4217768503 shutdown_connections 2024-04-25T09:10:02.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.667+0000 7f09e1c00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f09b8066f60 0x7f09b8069420 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.667+0000 7f09e1c00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f09dc145270 0x7f09dc147350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.667+0000 7f09e1c00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f09dc0cd4d0 0x7f09dc13d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.667+0000 7f09e1c00640 1 --2- 172.21.15.59:0/4217768503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f09dc0b1750 0x7f09dc140df0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.667+0000 7f09e1c00640 1 -- 172.21.15.59:0/4217768503 >> 172.21.15.59:0/4217768503 conn(0x7f09dc066fa0 msgr2=0x7f09dc15e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:02.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.667+0000 7f09e1c00640 1 -- 172.21.15.59:0/4217768503 shutdown_connections 2024-04-25T09:10:02.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.667+0000 7f09e1c00640 1 -- 172.21.15.59:0/4217768503 wait complete. 2024-04-25T09:10:02.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:10:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc489800640 1 Processor -- start 2024-04-25T09:10:02.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc489800640 1 -- start start 2024-04-25T09:10:02.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc489800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48406bf30 0x7fc4840d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc489800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48415e040 con 0x7fc48409a170 2024-04-25T09:10:02.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc489800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4840cff80 con 0x7fc48415dc60 2024-04-25T09:10:02.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc489800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840d0260 con 0x7fc48406bf30 2024-04-25T09:10:02.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc47a000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc48409a170 0x7fc4840cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60518/0 (socket says 172.21.15.59:60518) 2024-04-25T09:10:02.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc47a000640 1 -- 172.21.15.59:0/1066938719 learned_addr learned my addr 172.21.15.59:0/1066938719 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:02.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc483400640 1 --2- 172.21.15.59:0/1066938719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48406bf30 0x7fc4840d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc482000640 1 -- 172.21.15.59:0/1066938719 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604777236 0 0) 0x7fc48415e040 con 0x7fc48409a170 2024-04-25T09:10:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc482000640 1 -- 172.21.15.59:0/1066938719 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc468003530 con 0x7fc48409a170 2024-04-25T09:10:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc482000640 1 -- 172.21.15.59:0/1066938719 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671244206 0 0) 0x7fc4840cff80 con 0x7fc48415dc60 2024-04-25T09:10:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc482000640 1 -- 172.21.15.59:0/1066938719 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc48415e040 con 0x7fc48415dc60 2024-04-25T09:10:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc483400640 1 -- 172.21.15.59:0/1066938719 >> v1:172.21.15.178:6789/0 conn(0x7fc48415dc60 legacy=0x7fc484099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc483400640 1 -- 172.21.15.59:0/1066938719 >> v1:172.21.15.59:6789/0 conn(0x7fc48409a170 legacy=0x7fc4840cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.839+0000 7fc483400640 1 -- 172.21.15.59:0/1066938719 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840d0540 con 0x7fc48406bf30 2024-04-25T09:10:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.843+0000 7fc483400640 1 --2- 172.21.15.59:0/1066938719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48406bf30 0x7fc4840d1020 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009dc0 tx=0x7fc47c01c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75ca1a44f7dea803 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.843+0000 7fc482000640 1 -- 172.21.15.59:0/1066938719 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0b2070 con 0x7fc48406bf30 2024-04-25T09:10:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.843+0000 7fc482000640 1 -- 172.21.15.59:0/1066938719 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c0a5990 con 0x7fc48406bf30 2024-04-25T09:10:02.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.843+0000 7fc482000640 1 -- 172.21.15.59:0/1066938719 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0a5d40 con 0x7fc48406bf30 2024-04-25T09:10:02.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.843+0000 7fc489800640 1 -- 172.21.15.59:0/1066938719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48406bf30 msgr2=0x7fc4840d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.843+0000 7fc489800640 1 --2- 172.21.15.59:0/1066938719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48406bf30 0x7fc4840d1020 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009dc0 tx=0x7fc47c01c8d0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.843+0000 7fc489800640 1 -- 172.21.15.59:0/1066938719 shutdown_connections 2024-04-25T09:10:02.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.843+0000 7fc489800640 1 --2- 172.21.15.59:0/1066938719 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48406bf30 0x7fc4840d1020 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.843+0000 7fc489800640 1 -- 172.21.15.59:0/1066938719 >> 172.21.15.59:0/1066938719 conn(0x7fc4840b3200 msgr2=0x7fc4840b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:02.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.843+0000 7fc489800640 1 -- 172.21.15.59:0/1066938719 shutdown_connections 2024-04-25T09:10:02.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.843+0000 7fc489800640 1 -- 172.21.15.59:0/1066938719 wait complete. 2024-04-25T09:10:02.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc489800640 1 Processor -- start 2024-04-25T09:10:02.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc489800640 1 -- start start 2024-04-25T09:10:02.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc489800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc48406bf30 0x7fc484151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc489800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48409a170 0x7fc4840b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc489800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48415dc60 0x7fc484157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc489800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48406cfa0 con 0x7fc48409a170 2024-04-25T09:10:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc489800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840cc880 con 0x7fc48406bf30 2024-04-25T09:10:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc489800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840c9e30 con 0x7fc48415dc60 2024-04-25T09:10:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc47a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48409a170 0x7fc4840b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc47a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48409a170 0x7fc4840b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55038/0 (socket says 172.21.15.59:55038) 2024-04-25T09:10:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc47a000640 1 -- 172.21.15.59:0/3182648797 learned_addr learned my addr 172.21.15.59:0/3182648797 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc483400640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48415dc60 0x7fc484157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc482a00640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc48406bf30 0x7fc484151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc47a000640 1 -- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48415dc60 msgr2=0x7fc484157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc47a000640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48415dc60 0x7fc484157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc47a000640 1 -- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc48406bf30 msgr2=0x7fc484151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc47a000640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc48406bf30 0x7fc484151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc47a000640 1 -- 172.21.15.59:0/3182648797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4840c9290 con 0x7fc48409a170 2024-04-25T09:10:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc47a000640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48409a170 0x7fc4840b6170 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00c4d0 tx=0x7fc46c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc47b400640 1 -- 172.21.15.59:0/3182648797 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c017070 con 0x7fc48409a170 2024-04-25T09:10:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc47b400640 1 -- 172.21.15.59:0/3182648797 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c005cf0 con 0x7fc48409a170 2024-04-25T09:10:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc47b400640 1 -- 172.21.15.59:0/3182648797 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c0072b0 con 0x7fc48409a170 2024-04-25T09:10:02.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc489800640 1 -- 172.21.15.59:0/3182648797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4840c9560 con 0x7fc48409a170 2024-04-25T09:10:02.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc489800640 1 -- 172.21.15.59:0/3182648797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc484152250 con 0x7fc48409a170 2024-04-25T09:10:02.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.847+0000 7fc489800640 1 -- 172.21.15.59:0/3182648797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4840745d0 con 0x7fc48409a170 2024-04-25T09:10:02.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.851+0000 7fc47b400640 1 -- 172.21.15.59:0/3182648797 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc46c01a070 con 0x7fc48409a170 2024-04-25T09:10:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.851+0000 7fc47b400640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc460066f60 0x7fc460069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.851+0000 7fc47b400640 1 -- 172.21.15.59:0/3182648797 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fc46c084420 con 0x7fc48409a170 2024-04-25T09:10:02.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.851+0000 7fc482a00640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc460066f60 0x7fc460069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:02.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.851+0000 7fc482a00640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc460066f60 0x7fc460069420 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc4840c8470 tx=0x7fc474009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:02.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:02.855+0000 7fc47b400640 1 -- 172.21.15.59:0/3182648797 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc4840c9560 con 0x7fc48409a170 2024-04-25T09:10:03.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.019+0000 7fc489800640 1 -- 172.21.15.59:0/3182648797 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc4840b7590 con 0x7fc48409a170 2024-04-25T09:10:03.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.023+0000 7fc47b400640 1 -- 172.21.15.59:0/3182648797 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc46c055450 con 0x7fc48409a170 2024-04-25T09:10:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.027+0000 7fc489800640 1 -- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc460066f60 msgr2=0x7fc460069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.027+0000 7fc489800640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc460066f60 0x7fc460069420 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc4840c8470 tx=0x7fc474009040 comp rx=0 tx=0).stop 2024-04-25T09:10:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.027+0000 7fc489800640 1 -- 172.21.15.59:0/3182648797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48409a170 msgr2=0x7fc4840b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.027+0000 7fc489800640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48409a170 0x7fc4840b6170 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00c4d0 tx=0x7fc46c00c990 comp rx=0 tx=0).stop 2024-04-25T09:10:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.027+0000 7fc489800640 1 -- 172.21.15.59:0/3182648797 shutdown_connections 2024-04-25T09:10:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.027+0000 7fc489800640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc460066f60 0x7fc460069420 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.027+0000 7fc489800640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc48415dc60 0x7fc484157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.027+0000 7fc489800640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc48409a170 0x7fc4840b6170 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.027+0000 7fc489800640 1 --2- 172.21.15.59:0/3182648797 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc48406bf30 0x7fc484151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.027+0000 7fc489800640 1 -- 172.21.15.59:0/3182648797 >> 172.21.15.59:0/3182648797 conn(0x7fc4840b3200 msgr2=0x7fc4840ce7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.027+0000 7fc489800640 1 -- 172.21.15.59:0/3182648797 shutdown_connections 2024-04-25T09:10:03.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.027+0000 7fc489800640 1 -- 172.21.15.59:0/3182648797 wait complete. 2024-04-25T09:10:03.036 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:10:03.036 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:10:03.140 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:10:03.199 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:10:03.200 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:10:03.200 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:03.208 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:10:03.209 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:10:03.209 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:03.218 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:10:03.218 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:10:03.218 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:03.262 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:10:03.262 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:10:03.262 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:03.272 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:10:03.272 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:10:03.272 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.455+0000 7fe0be400640 1 Processor -- start 2024-04-25T09:10:03.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0be400640 1 -- start start 2024-04-25T09:10:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0be400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe0b815dcd0 0x7fe0b8099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0be400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0b80cd460 0x7fe0b8099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0be400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b806d740 con 0x7fe0b809a7a0 2024-04-25T09:10:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0be400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b80cbfc0 con 0x7fe0b815dcd0 2024-04-25T09:10:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0be400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b806cea0 con 0x7fe0b80cd460 2024-04-25T09:10:03.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0bd000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe0b815dcd0 0x7fe0b8099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0bd000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe0b815dcd0 0x7fe0b8099a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55052/0 (socket says 172.21.15.59:55052) 2024-04-25T09:10:03.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0bd000640 1 -- 172.21.15.59:0/2336935879 learned_addr learned my addr 172.21.15.59:0/2336935879 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:03.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0bda00640 1 --2- 172.21.15.59:0/2336935879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0b80cd460 0x7fe0b8099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0bd000640 1 -- 172.21.15.59:0/2336935879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0b80cd460 msgr2=0x7fe0b8099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:03.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0bd000640 1 --2- 172.21.15.59:0/2336935879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0b80cd460 0x7fe0b8099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0bd000640 1 -- 172.21.15.59:0/2336935879 >> v1:172.21.15.178:6789/0 conn(0x7fe0b809a7a0 legacy=0x7fe0b80cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:03.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.459+0000 7fe0bd000640 1 -- 172.21.15.59:0/2336935879 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b806d180 con 0x7fe0b815dcd0 2024-04-25T09:10:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0bd000640 1 --2- 172.21.15.59:0/2336935879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b815dcd0 0x7fe0b8099a60 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009870 tx=0x7fe0a801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa8064321c6bc23 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0b7e00640 1 -- 172.21.15.59:0/2336935879 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80a95f0 con 0x7fe0b815dcd0 2024-04-25T09:10:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0b7e00640 1 -- 172.21.15.59:0/2336935879 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a80a9790 con 0x7fe0b815dcd0 2024-04-25T09:10:03.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0b7e00640 1 -- 172.21.15.59:0/2336935879 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80a9b60 con 0x7fe0b815dcd0 2024-04-25T09:10:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0be400640 1 -- 172.21.15.59:0/2336935879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b815dcd0 msgr2=0x7fe0b8099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0be400640 1 --2- 172.21.15.59:0/2336935879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b815dcd0 0x7fe0b8099a60 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009870 tx=0x7fe0a801c530 comp rx=0 tx=0).stop 2024-04-25T09:10:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0be400640 1 -- 172.21.15.59:0/2336935879 shutdown_connections 2024-04-25T09:10:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0be400640 1 --2- 172.21.15.59:0/2336935879 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0b80cd460 0x7fe0b8099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0be400640 1 --2- 172.21.15.59:0/2336935879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b815dcd0 0x7fe0b8099a60 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0be400640 1 -- 172.21.15.59:0/2336935879 >> 172.21.15.59:0/2336935879 conn(0x7fe0b80b3050 msgr2=0x7fe0b80b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:03.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0be400640 1 -- 172.21.15.59:0/2336935879 shutdown_connections 2024-04-25T09:10:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0be400640 1 -- 172.21.15.59:0/2336935879 wait complete. 2024-04-25T09:10:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0be400640 1 Processor -- start 2024-04-25T09:10:03.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.463+0000 7fe0be400640 1 -- start start 2024-04-25T09:10:03.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0be400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b809a7a0 0x7fe0b8159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0be400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0b80cd460 0x7fe0b8153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0be400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0b815dcd0 0x7fe0b80af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0be400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b816aa20 con 0x7fe0b809a7a0 2024-04-25T09:10:03.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0be400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b816a8a0 con 0x7fe0b80cd460 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0be400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b816aba0 con 0x7fe0b815dcd0 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0bd000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b809a7a0 0x7fe0b8159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0bd000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b809a7a0 0x7fe0b8159910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55054/0 (socket says 172.21.15.59:55054) 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0bd000640 1 -- 172.21.15.59:0/1098847915 learned_addr learned my addr 172.21.15.59:0/1098847915 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0afe00640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0b80cd460 0x7fe0b8153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0bda00640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0b815dcd0 0x7fe0b80af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0bd000640 1 -- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0b815dcd0 msgr2=0x7fe0b80af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0bd000640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0b815dcd0 0x7fe0b80af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0bd000640 1 -- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0b80cd460 msgr2=0x7fe0b8153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0bd000640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0b80cd460 0x7fe0b8153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0bd000640 1 -- 172.21.15.59:0/1098847915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b815d8a0 con 0x7fe0b809a7a0 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0bda00640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0b815dcd0 0x7fe0b80af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:03.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0bd000640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b809a7a0 0x7fe0b8159910 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fe0a801a160 tx=0x7fe0a801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:03.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0b5600640 1 -- 172.21.15.59:0/1098847915 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80b1800 con 0x7fe0b809a7a0 2024-04-25T09:10:03.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0b5600640 1 -- 172.21.15.59:0/1098847915 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a80b19a0 con 0x7fe0b809a7a0 2024-04-25T09:10:03.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0b5600640 1 -- 172.21.15.59:0/1098847915 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80b1d70 con 0x7fe0b809a7a0 2024-04-25T09:10:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0be400640 1 -- 172.21.15.59:0/1098847915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b815b240 con 0x7fe0b809a7a0 2024-04-25T09:10:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0be400640 1 -- 172.21.15.59:0/1098847915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b815b800 con 0x7fe0b809a7a0 2024-04-25T09:10:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0be400640 1 -- 172.21.15.59:0/1098847915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b80b4df0 con 0x7fe0b809a7a0 2024-04-25T09:10:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.467+0000 7fe0b5600640 1 -- 172.21.15.59:0/1098847915 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe0a80a8350 con 0x7fe0b809a7a0 2024-04-25T09:10:03.458 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.471+0000 7fe0b5600640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe094066f60 0x7fe094069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.471+0000 7fe0b5600640 1 -- 172.21.15.59:0/1098847915 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fe0a811f6f0 con 0x7fe0b809a7a0 2024-04-25T09:10:03.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.471+0000 7fe0afe00640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe094066f60 0x7fe094069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.471+0000 7fe0afe00640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe094066f60 0x7fe094069420 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe0b815c770 tx=0x7fe0a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:03.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.475+0000 7fe0b5600640 1 -- 172.21.15.59:0/1098847915 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe0a80c3030 con 0x7fe0b809a7a0 2024-04-25T09:10:03.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.671+0000 7fe0be400640 1 -- 172.21.15.59:0/1098847915 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0b804efa0 con 0x7fe0b809a7a0 2024-04-25T09:10:03.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.671+0000 7fe0b5600640 1 -- 172.21.15.59:0/1098847915 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+3702 (secure 0 0 0) 0x7fe0a80ad020 con 0x7fe0b809a7a0 2024-04-25T09:10:03.662 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:03.662 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":80,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/2552791322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":2552791322},{"type":"v1","addr":"172.21.15.178:6836","nonce":2552791322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":6377,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/2830704194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":2830704194},{"type":"v1","addr":"172.21.15.178:6837","nonce":2830704194}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":60},{"gid":7455,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2930177136","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2930177136},{"type":"v1","addr":"172.21.15.59:6834","nonce":2930177136}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":59},{"gid":8241,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/249377689","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":249377689},{"type":"v1","addr":"172.21.15.59:6835","nonce":249377689}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":80}],"filesystems":[]} 2024-04-25T09:10:03.662 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 80 2024-04-25T09:10:03.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.675+0000 7fe0be400640 1 -- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe094066f60 msgr2=0x7fe094069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.675+0000 7fe0be400640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe094066f60 0x7fe094069420 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fe0b815c770 tx=0x7fe0a0009040 comp rx=0 tx=0).stop 2024-04-25T09:10:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.675+0000 7fe0be400640 1 -- 172.21.15.59:0/1098847915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b809a7a0 msgr2=0x7fe0b8159910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.675+0000 7fe0be400640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b809a7a0 0x7fe0b8159910 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fe0a801a160 tx=0x7fe0a801ad70 comp rx=0 tx=0).stop 2024-04-25T09:10:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.675+0000 7fe0be400640 1 -- 172.21.15.59:0/1098847915 shutdown_connections 2024-04-25T09:10:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.675+0000 7fe0be400640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe094066f60 0x7fe094069420 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.675+0000 7fe0be400640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe0b815dcd0 0x7fe0b80af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.675+0000 7fe0be400640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe0b80cd460 0x7fe0b8153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.675+0000 7fe0be400640 1 --2- 172.21.15.59:0/1098847915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0b809a7a0 0x7fe0b8159910 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.675+0000 7fe0be400640 1 -- 172.21.15.59:0/1098847915 >> 172.21.15.59:0/1098847915 conn(0x7fe0b80b3050 msgr2=0x7fe0b8156720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.675+0000 7fe0be400640 1 -- 172.21.15.59:0/1098847915 shutdown_connections 2024-04-25T09:10:03.665 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.675+0000 7fe0be400640 1 -- 172.21.15.59:0/1098847915 wait complete. 2024-04-25T09:10:03.684 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:10:03.684 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:10:03.684 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:10:03.684 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:10:03.685 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:10:03.685 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:10:03.685 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:10:03.685 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:10:03.685 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:10:03.685 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:10:03.686 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:10:03.686 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:10:03.686 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:10:03.686 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:10:03.686 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:10:03.686 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:10:03.698 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:10:03.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:10:03.700 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:10:03.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:10:03.701 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:10:03.701 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:10:03.702 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:10:03.702 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:10:03.746 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:10:03.746 DEBUG:teuthology.parallel:result is None 2024-04-25T09:10:03.748 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:10:03.748 DEBUG:teuthology.parallel:result is None 2024-04-25T09:10:03.748 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:10:03.749 DEBUG:teuthology.parallel:result is None 2024-04-25T09:10:03.750 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:10:03.750 DEBUG:teuthology.parallel:result is None 2024-04-25T09:10:03.750 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:10:03.835 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:10:03.836 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T09:10:03.837 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-04-25T09:10:03.837 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-04-25T09:10:03.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff89b200640 1 Processor -- start 2024-04-25T09:10:03.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff89b200640 1 -- start start 2024-04-25T09:10:03.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff89b200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff894145110 0x7ff89406b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff89b200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff89415bc60 0x7ff89415f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff89b200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8940cc450 con 0x7ff89415f750 2024-04-25T09:10:03.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff89b200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8940cc730 con 0x7ff89415bc60 2024-04-25T09:10:03.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff89b200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940cca10 con 0x7ff894145110 2024-04-25T09:10:03.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff89a800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff89415f750 0x7ff8940cd4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60530/0 (socket says 172.21.15.59:60530) 2024-04-25T09:10:03.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff89a800640 1 -- 172.21.15.59:0/3948405894 learned_addr learned my addr 172.21.15.59:0/3948405894 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:03.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff899400640 1 --2- 172.21.15.59:0/3948405894 >> v2:172.21.15.178:3300/0 conn(0x7ff89415bc60 0x7ff89415f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff899e00640 1 --2- 172.21.15.59:0/3948405894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff894145110 0x7ff89406b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff898a00640 1 -- 172.21.15.59:0/3948405894 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815748901 0 0) 0x7ff8940cc450 con 0x7ff89415f750 2024-04-25T09:10:03.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff898a00640 1 -- 172.21.15.59:0/3948405894 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff87c003530 con 0x7ff89415f750 2024-04-25T09:10:03.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff899e00640 1 -- 172.21.15.59:0/3948405894 >> v2:172.21.15.178:3300/0 conn(0x7ff89415bc60 msgr2=0x7ff89415f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:03.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff899e00640 1 --2- 172.21.15.59:0/3948405894 >> v2:172.21.15.178:3300/0 conn(0x7ff89415bc60 0x7ff89415f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff899e00640 1 -- 172.21.15.59:0/3948405894 >> v1:172.21.15.59:6789/0 conn(0x7ff89415f750 legacy=0x7ff8940cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff899e00640 1 -- 172.21.15.59:0/3948405894 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940cccf0 con 0x7ff894145110 2024-04-25T09:10:03.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.911+0000 7ff899400640 1 --2- 172.21.15.59:0/3948405894 >> v2:172.21.15.178:3300/0 conn(0x7ff89415bc60 0x7ff89415f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:03.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.915+0000 7ff899e00640 1 --2- 172.21.15.59:0/3948405894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff894145110 0x7ff89406b730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff8880097c0 tx=0x7ff88801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33044871f04ffe95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:03.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.915+0000 7ff898a00640 1 -- 172.21.15.59:0/3948405894 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880b0070 con 0x7ff894145110 2024-04-25T09:10:03.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.915+0000 7ff898a00640 1 -- 172.21.15.59:0/3948405894 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8880ab600 con 0x7ff894145110 2024-04-25T09:10:03.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.915+0000 7ff898a00640 1 -- 172.21.15.59:0/3948405894 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880ab9d0 con 0x7ff894145110 2024-04-25T09:10:03.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.915+0000 7ff89b200640 1 -- 172.21.15.59:0/3948405894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff894145110 msgr2=0x7ff89406b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.915+0000 7ff89b200640 1 --2- 172.21.15.59:0/3948405894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff894145110 0x7ff89406b730 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff8880097c0 tx=0x7ff88801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.915+0000 7ff89b200640 1 -- 172.21.15.59:0/3948405894 shutdown_connections 2024-04-25T09:10:03.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.915+0000 7ff89b200640 1 --2- 172.21.15.59:0/3948405894 >> v2:172.21.15.178:3300/0 conn(0x7ff89415bc60 0x7ff89415f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.915+0000 7ff89b200640 1 --2- 172.21.15.59:0/3948405894 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff894145110 0x7ff89406b730 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.915+0000 7ff89b200640 1 -- 172.21.15.59:0/3948405894 >> 172.21.15.59:0/3948405894 conn(0x7ff89406ac10 msgr2=0x7ff89406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:03.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.915+0000 7ff89b200640 1 -- 172.21.15.59:0/3948405894 shutdown_connections 2024-04-25T09:10:03.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.915+0000 7ff89b200640 1 -- 172.21.15.59:0/3948405894 wait complete. 2024-04-25T09:10:03.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89b200640 1 Processor -- start 2024-04-25T09:10:03.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89b200640 1 -- start start 2024-04-25T09:10:03.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89b200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff894145110 0x7ff894142070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89b200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff89415bc60 0x7ff8940b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89b200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89415f750 0x7ff89413e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89b200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89415c1c0 con 0x7ff894145110 2024-04-25T09:10:03.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89b200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89415c040 con 0x7ff89415bc60 2024-04-25T09:10:03.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89b200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8940cbfe0 con 0x7ff89415f750 2024-04-25T09:10:03.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff899e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff894145110 0x7ff894142070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff899e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff894145110 0x7ff894142070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55096/0 (socket says 172.21.15.59:55096) 2024-04-25T09:10:03.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff899e00640 1 -- 172.21.15.59:0/3061929966 learned_addr learned my addr 172.21.15.59:0/3061929966 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:03.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff899400640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff89415bc60 0x7ff8940b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89a800640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89415f750 0x7ff89413e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff899e00640 1 -- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89415f750 msgr2=0x7ff89413e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff899e00640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89415f750 0x7ff89413e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff899e00640 1 -- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff89415bc60 msgr2=0x7ff8940b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff899e00640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff89415bc60 0x7ff8940b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff899e00640 1 -- 172.21.15.59:0/3061929966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8940b4720 con 0x7ff894145110 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89a800640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89415f750 0x7ff89413e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff899e00640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff894145110 0x7ff894142070 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7ff8880097c0 tx=0x7ff888019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff88e000640 1 -- 172.21.15.59:0/3061929966 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880b0040 con 0x7ff894145110 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff88e000640 1 -- 172.21.15.59:0/3061929966 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8880b9070 con 0x7ff894145110 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff88e000640 1 -- 172.21.15.59:0/3061929966 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8880b4650 con 0x7ff894145110 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89b200640 1 -- 172.21.15.59:0/3061929966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8940b3360 con 0x7ff894145110 2024-04-25T09:10:03.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89b200640 1 -- 172.21.15.59:0/3061929966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8940b3920 con 0x7ff894145110 2024-04-25T09:10:03.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.919+0000 7ff89b200640 1 -- 172.21.15.59:0/3061929966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8940745d0 con 0x7ff894145110 2024-04-25T09:10:03.911 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.923+0000 7ff88e000640 1 -- 172.21.15.59:0/3061929966 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff8880b47f0 con 0x7ff894145110 2024-04-25T09:10:03.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.923+0000 7ff88e000640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff878066f60 0x7ff878069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:03.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.923+0000 7ff88e000640 1 -- 172.21.15.59:0/3061929966 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5507+0+0 (secure 0 0 0) 0x7ff88811ed10 con 0x7ff894145110 2024-04-25T09:10:03.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.923+0000 7ff899400640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff878066f60 0x7ff878069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:03.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.923+0000 7ff899400640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff878066f60 0x7ff878069420 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff884009580 tx=0x7ff884008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:03.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:03.927+0000 7ff88e000640 1 -- 172.21.15.59:0/3061929966 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff888124020 con 0x7ff894145110 2024-04-25T09:10:04.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.103+0000 7ff89b200640 1 -- 172.21.15.59:0/3061929966 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff8940cd690 con 0x7ff894145110 2024-04-25T09:10:04.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.675+0000 7ff88e000640 1 -- 172.21.15.59:0/3061929966 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v101) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff888016090 con 0x7ff894145110 2024-04-25T09:10:04.664 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-04-25T09:10:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.679+0000 7ff89b200640 1 -- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff878066f60 msgr2=0x7ff878069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.679+0000 7ff89b200640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff878066f60 0x7ff878069420 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7ff884009580 tx=0x7ff884008040 comp rx=0 tx=0).stop 2024-04-25T09:10:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.679+0000 7ff89b200640 1 -- 172.21.15.59:0/3061929966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff894145110 msgr2=0x7ff894142070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.679+0000 7ff89b200640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff894145110 0x7ff894142070 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7ff8880097c0 tx=0x7ff888019240 comp rx=0 tx=0).stop 2024-04-25T09:10:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.679+0000 7ff89b200640 1 -- 172.21.15.59:0/3061929966 shutdown_connections 2024-04-25T09:10:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.679+0000 7ff89b200640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff878066f60 0x7ff878069420 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.679+0000 7ff89b200640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff89415f750 0x7ff89413e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.679+0000 7ff89b200640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff89415bc60 0x7ff8940b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.679+0000 7ff89b200640 1 --2- 172.21.15.59:0/3061929966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff894145110 0x7ff894142070 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.679+0000 7ff89b200640 1 -- 172.21.15.59:0/3061929966 >> 172.21.15.59:0/3061929966 conn(0x7ff89406ac10 msgr2=0x7ff8940aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.679+0000 7ff89b200640 1 -- 172.21.15.59:0/3061929966 shutdown_connections 2024-04-25T09:10:04.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.679+0000 7ff89b200640 1 -- 172.21.15.59:0/3061929966 wait complete. 2024-04-25T09:10:04.691 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:10:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91e7000640 1 Processor -- start 2024-04-25T09:10:04.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91e7000640 1 -- start start 2024-04-25T09:10:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91e7000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e0146740 0x7f91e006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91e7000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f91e00af840 0x7f91e00b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91e7000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e00b23e0 con 0x7f91e00b1f20 2024-04-25T09:10:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91e7000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e0146b20 con 0x7f91e00af840 2024-04-25T09:10:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91e7000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00acb80 con 0x7f91e0146740 2024-04-25T09:10:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91e5000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f91e00b1f20 0x7f91e00aeb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60534/0 (socket says 172.21.15.59:60534) 2024-04-25T09:10:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91e5000640 1 -- 172.21.15.59:0/2885174962 learned_addr learned my addr 172.21.15.59:0/2885174962 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:04.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91dfe00640 1 --2- 172.21.15.59:0/2885174962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e0146740 0x7f91e006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91d7e00640 1 --2- 172.21.15.59:0/2885174962 >> v2:172.21.15.178:3300/0 conn(0x7f91e00af840 0x7f91e00b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91df400640 1 -- 172.21.15.59:0/2885174962 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276746220 0 0) 0x7f91e00b23e0 con 0x7f91e00b1f20 2024-04-25T09:10:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91df400640 1 -- 172.21.15.59:0/2885174962 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91c4003530 con 0x7f91e00b1f20 2024-04-25T09:10:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.847+0000 7f91dfe00640 1 -- 172.21.15.59:0/2885174962 >> v2:172.21.15.178:3300/0 conn(0x7f91e00af840 msgr2=0x7f91e00b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91dfe00640 1 --2- 172.21.15.59:0/2885174962 >> v2:172.21.15.178:3300/0 conn(0x7f91e00af840 0x7f91e00b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91dfe00640 1 -- 172.21.15.59:0/2885174962 >> v1:172.21.15.59:6789/0 conn(0x7f91e00b1f20 legacy=0x7f91e00aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91dfe00640 1 -- 172.21.15.59:0/2885174962 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e00ace60 con 0x7f91e0146740 2024-04-25T09:10:04.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91d7e00640 1 --2- 172.21.15.59:0/2885174962 >> v2:172.21.15.178:3300/0 conn(0x7f91e00af840 0x7f91e00b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:04.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91dfe00640 1 --2- 172.21.15.59:0/2885174962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e0146740 0x7f91e006d2b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f91d00097c0 tx=0x7f91d001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9d2d1dd9857ce53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91df400640 1 -- 172.21.15.59:0/2885174962 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00a7070 con 0x7f91e0146740 2024-04-25T09:10:04.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91df400640 1 -- 172.21.15.59:0/2885174962 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d00b0070 con 0x7f91e0146740 2024-04-25T09:10:04.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91df400640 1 -- 172.21.15.59:0/2885174962 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00ab890 con 0x7f91e0146740 2024-04-25T09:10:04.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91e7000640 1 -- 172.21.15.59:0/2885174962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e0146740 msgr2=0x7f91e006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91e7000640 1 --2- 172.21.15.59:0/2885174962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e0146740 0x7f91e006d2b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f91d00097c0 tx=0x7f91d001c470 comp rx=0 tx=0).stop 2024-04-25T09:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91e7000640 1 -- 172.21.15.59:0/2885174962 shutdown_connections 2024-04-25T09:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91e7000640 1 --2- 172.21.15.59:0/2885174962 >> v2:172.21.15.178:3300/0 conn(0x7f91e00af840 0x7f91e00b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91e7000640 1 --2- 172.21.15.59:0/2885174962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e0146740 0x7f91e006d2b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.851+0000 7f91e7000640 1 -- 172.21.15.59:0/2885174962 >> 172.21.15.59:0/2885174962 conn(0x7f91e0066fa0 msgr2=0x7f91e006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e7000640 1 -- 172.21.15.59:0/2885174962 shutdown_connections 2024-04-25T09:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e7000640 1 -- 172.21.15.59:0/2885174962 wait complete. 2024-04-25T09:10:04.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e7000640 1 Processor -- start 2024-04-25T09:10:04.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e7000640 1 -- start start 2024-04-25T09:10:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e7000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00af840 0x7f91e0134ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e7000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e00b1f20 0x7f91e015b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e7000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91e0146740 0x7f91e015fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e7000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00af3e0 con 0x7f91e00af840 2024-04-25T09:10:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e7000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00af260 con 0x7f91e0146740 2024-04-25T09:10:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e7000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e00ae150 con 0x7f91e00b1f20 2024-04-25T09:10:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91dfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00af840 0x7f91e0134ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91dfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00af840 0x7f91e0134ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55106/0 (socket says 172.21.15.59:55106) 2024-04-25T09:10:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91dfe00640 1 -- 172.21.15.59:0/2518092599 learned_addr learned my addr 172.21.15.59:0/2518092599 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:04.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e5000640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91e0146740 0x7f91e015fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91d7e00640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e00b1f20 0x7f91e015b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91dfe00640 1 -- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e00b1f20 msgr2=0x7f91e015b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91dfe00640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e00b1f20 0x7f91e015b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91dfe00640 1 -- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91e0146740 msgr2=0x7f91e015fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91dfe00640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91e0146740 0x7f91e015fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91dfe00640 1 -- 172.21.15.59:0/2518092599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e0160770 con 0x7f91e00af840 2024-04-25T09:10:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e5000640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91e0146740 0x7f91e015fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91d7e00640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e00b1f20 0x7f91e015b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91dfe00640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00af840 0x7f91e0134ea0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f91d001a0a0 tx=0x7f91d0019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91dcc00640 1 -- 172.21.15.59:0/2518092599 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00abc30 con 0x7f91e00af840 2024-04-25T09:10:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91dcc00640 1 -- 172.21.15.59:0/2518092599 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d00abdd0 con 0x7f91e00af840 2024-04-25T09:10:04.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91dcc00640 1 -- 172.21.15.59:0/2518092599 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d00bf690 con 0x7f91e00af840 2024-04-25T09:10:04.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.855+0000 7f91e7000640 1 -- 172.21.15.59:0/2518092599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91e0135d80 con 0x7f91e00af840 2024-04-25T09:10:04.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.859+0000 7f91e7000640 1 -- 172.21.15.59:0/2518092599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e0136340 con 0x7f91e00af840 2024-04-25T09:10:04.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.859+0000 7f91e7000640 1 -- 172.21.15.59:0/2518092599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e00745d0 con 0x7f91e00af840 2024-04-25T09:10:04.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.859+0000 7f91dcc00640 1 -- 172.21.15.59:0/2518092599 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f91d00bf830 con 0x7f91e00af840 2024-04-25T09:10:04.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.859+0000 7f91dcc00640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f91bc066f60 0x7f91bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:04.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.859+0000 7f91dcc00640 1 -- 172.21.15.59:0/2518092599 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f91d011f640 con 0x7f91e00af840 2024-04-25T09:10:04.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.859+0000 7f91d7e00640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f91bc066f60 0x7f91bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:04.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.859+0000 7f91d7e00640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f91bc066f60 0x7f91bc069420 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f91e013bf20 tx=0x7f91c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:04.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:04.863+0000 7f91dcc00640 1 -- 172.21.15.59:0/2518092599 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f91d0016090 con 0x7f91e00af840 2024-04-25T09:10:05.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 -- 172.21.15.59:0/2518092599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f91e0135b00 con 0x7f91e00af840 2024-04-25T09:10:05.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91dcc00640 1 -- 172.21.15.59:0/2518092599 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f91d00f0800 con 0x7f91e00af840 2024-04-25T09:10:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:05.072 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:10:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-04-25T09:10:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-04-25T09:10:05.072 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmefAMLRAAyOhrYPGN2IYchV7wMDkkTQ==", 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmcZtGORAA9RU5OkQHTCXe5nkpEp77Fw==", 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:10:05.073 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmF3skNBAAcKEUsLnvjEY8fz59SnjWtg==", 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.074 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm95/1BBAAsIbA6GBVS4dl7sZ8CoZoLA==", 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCsGypmmikBDRAAcxA0eWyo/w0bALsf4Fb3KQ==", 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:10:05.075 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCvGypm66dNFxAAzl06IBbHoxHorB3FuCFNOQ==", 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCyGypmQrwdIhAAyF53f8p7/vnJ6L4ZjXcKhQ==", 2024-04-25T09:10:05.076 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC1GypmtETmLBAAM4p1FOPAiB0aOcdfIcl6vg==", 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.077 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC6GypmyXGCAhAAKJ2Yh0lezpRfFMPXjN4Asg==", 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC9GypmmfZZDBAAzw9IygUbRErERr2lXEfutA==", 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:10:05.078 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDAGypmS4KRFRAAXrvA1QNbuWF6+ln+cz6orQ==", 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDDGypmruPJHRAAWFONkZiSsYgvsr04uO9J9A==", 2024-04-25T09:10:05.079 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg==", 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.080 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm8NCkEhAAEELIQ7EAUFHsANHAa5EnTA==", 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmdosADxAAxmQqp2O5lT5XenyqxyyMKw==", 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:10:05.081 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmsqWgGBAAIXaSazGZkKiY2hqcC+WApA==", 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-04-25T09:10:05.082 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypm5ldPEBAAepEqWPcDy8atp78XxKERYg==", 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmwOe7KBAAIvO6OJiUeb5hRdu9VX11cA==", 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.083 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:10:05.084 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:05.084 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-04-25T09:10:05.084 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmX2GpJBAA8RvpxNpdPFExISwQzT56fA==", 2024-04-25T09:10:05.084 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:10:05.084 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:10:05.084 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:10:05.084 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:10:05.084 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.084 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:05.084 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-25T09:10:05.084 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:10:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 -- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f91bc066f60 msgr2=0x7f91bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f91bc066f60 0x7f91bc069420 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f91e013bf20 tx=0x7f91c8008040 comp rx=0 tx=0).stop 2024-04-25T09:10:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 -- 172.21.15.59:0/2518092599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00af840 msgr2=0x7f91e0134ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00af840 0x7f91e0134ea0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f91d001a0a0 tx=0x7f91d0019210 comp rx=0 tx=0).stop 2024-04-25T09:10:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 -- 172.21.15.59:0/2518092599 shutdown_connections 2024-04-25T09:10:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f91bc066f60 0x7f91bc069420 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f91e0146740 0x7f91e015fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f91e00b1f20 0x7f91e015b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 --2- 172.21.15.59:0/2518092599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91e00af840 0x7f91e0134ea0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 -- 172.21.15.59:0/2518092599 >> 172.21.15.59:0/2518092599 conn(0x7f91e0066fa0 msgr2=0x7f91e00b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:05.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 -- 172.21.15.59:0/2518092599 shutdown_connections 2024-04-25T09:10:05.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.083+0000 7f91e7000640 1 -- 172.21.15.59:0/2518092599 wait complete. 2024-04-25T09:10:05.093 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:05.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.243+0000 7f9309800640 1 Processor -- start 2024-04-25T09:10:05.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.243+0000 7f9309800640 1 -- start start 2024-04-25T09:10:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9309800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9304145270 0x7f930415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9309800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93040cd4d0 0x7f93040cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9309800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93040b1750 0x7f93040b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9309800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93040b20e0 con 0x7f93040b1750 2024-04-25T09:10:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9309800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9304145650 con 0x7f9304145270 2024-04-25T09:10:05.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9309800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93040cc4e0 con 0x7f93040cd4d0 2024-04-25T09:10:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9303400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93040b1750 0x7f93040b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9303400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f93040b1750 0x7f93040b1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55112/0 (socket says 172.21.15.59:55112) 2024-04-25T09:10:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9303400640 1 -- 172.21.15.59:0/2768444072 learned_addr learned my addr 172.21.15.59:0/2768444072 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f92fbe00640 1 --2- 172.21.15.59:0/2768444072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93040cd4d0 0x7f93040cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9302a00640 1 --2- 172.21.15.59:0/2768444072 >> v2:172.21.15.178:3300/0 conn(0x7f9304145270 0x7f930415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9303400640 1 -- 172.21.15.59:0/2768444072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93040cd4d0 msgr2=0x7f93040cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9303400640 1 --2- 172.21.15.59:0/2768444072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93040cd4d0 0x7f93040cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9303400640 1 -- 172.21.15.59:0/2768444072 >> v2:172.21.15.178:3300/0 conn(0x7f9304145270 msgr2=0x7f930415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9303400640 1 --2- 172.21.15.59:0/2768444072 >> v2:172.21.15.178:3300/0 conn(0x7f9304145270 0x7f930415fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9303400640 1 -- 172.21.15.59:0/2768444072 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93040ce040 con 0x7f93040b1750 2024-04-25T09:10:05.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.247+0000 7f9302a00640 1 --2- 172.21.15.59:0/2768444072 >> v2:172.21.15.178:3300/0 conn(0x7f9304145270 0x7f930415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9303400640 1 --2- 172.21.15.59:0/2768444072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93040b1750 0x7f93040b1ba0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f930406f3a0 tx=0x7f92fc01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b460cb39abfbf155 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9302000640 1 -- 172.21.15.59:0/2768444072 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc0a5760 con 0x7f93040b1750 2024-04-25T09:10:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9302000640 1 -- 172.21.15.59:0/2768444072 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92fc0a5900 con 0x7f93040b1750 2024-04-25T09:10:05.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9302000640 1 -- 172.21.15.59:0/2768444072 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc0a5cd0 con 0x7f93040b1750 2024-04-25T09:10:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9309800640 1 -- 172.21.15.59:0/2768444072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93040b1750 msgr2=0x7f93040b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9309800640 1 --2- 172.21.15.59:0/2768444072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93040b1750 0x7f93040b1ba0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f930406f3a0 tx=0x7f92fc01c9f0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9309800640 1 -- 172.21.15.59:0/2768444072 shutdown_connections 2024-04-25T09:10:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9309800640 1 --2- 172.21.15.59:0/2768444072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93040b1750 0x7f93040b1ba0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9309800640 1 --2- 172.21.15.59:0/2768444072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93040cd4d0 0x7f93040cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9309800640 1 --2- 172.21.15.59:0/2768444072 >> v2:172.21.15.178:3300/0 conn(0x7f9304145270 0x7f930415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9309800640 1 -- 172.21.15.59:0/2768444072 >> 172.21.15.59:0/2768444072 conn(0x7f9304066fa0 msgr2=0x7f930406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9309800640 1 -- 172.21.15.59:0/2768444072 shutdown_connections 2024-04-25T09:10:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9309800640 1 -- 172.21.15.59:0/2768444072 wait complete. 2024-04-25T09:10:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9309800640 1 Processor -- start 2024-04-25T09:10:05.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.251+0000 7f9309800640 1 -- start start 2024-04-25T09:10:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9309800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93040b1750 0x7f930415ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9309800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93040cd4d0 0x7f9304141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9309800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9304145270 0x7f93040b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9309800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930415c590 con 0x7f93040b1750 2024-04-25T09:10:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9309800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f930415f930 con 0x7f9304145270 2024-04-25T09:10:05.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9309800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930415c710 con 0x7f93040cd4d0 2024-04-25T09:10:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9302a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93040b1750 0x7f930415ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9302a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93040b1750 0x7f930415ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55116/0 (socket says 172.21.15.59:55116) 2024-04-25T09:10:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9302a00640 1 -- 172.21.15.59:0/82608439 learned_addr learned my addr 172.21.15.59:0/82608439 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f92fbe00640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93040cd4d0 0x7f9304141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9303400640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9304145270 0x7f93040b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9302a00640 1 -- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93040cd4d0 msgr2=0x7f9304141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9302a00640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93040cd4d0 0x7f9304141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9302a00640 1 -- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9304145270 msgr2=0x7f93040b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9302a00640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9304145270 0x7f93040b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9302a00640 1 -- 172.21.15.59:0/82608439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930413d950 con 0x7f93040b1750 2024-04-25T09:10:05.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9303400640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9304145270 0x7f93040b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:05.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9302a00640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93040b1750 0x7f930415ab30 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f92f400c7f0 tx=0x7f92f400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f92faa00640 1 -- 172.21.15.59:0/82608439 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4015070 con 0x7f93040b1750 2024-04-25T09:10:05.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f92faa00640 1 -- 172.21.15.59:0/82608439 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f4007820 con 0x7f93040b1750 2024-04-25T09:10:05.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f92faa00640 1 -- 172.21.15.59:0/82608439 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4007c10 con 0x7f93040b1750 2024-04-25T09:10:05.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9309800640 1 -- 172.21.15.59:0/82608439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930413dc30 con 0x7f93040b1750 2024-04-25T09:10:05.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9309800640 1 -- 172.21.15.59:0/82608439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f930413e1f0 con 0x7f93040b1750 2024-04-25T09:10:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.255+0000 7f9309800640 1 -- 172.21.15.59:0/82608439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93040745d0 con 0x7f93040b1750 2024-04-25T09:10:05.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.259+0000 7f92faa00640 1 -- 172.21.15.59:0/82608439 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f92f4018070 con 0x7f93040b1750 2024-04-25T09:10:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.259+0000 7f92faa00640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92e0066f60 0x7f92e0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.259+0000 7f92faa00640 1 -- 172.21.15.59:0/82608439 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f92f4084fd0 con 0x7f93040b1750 2024-04-25T09:10:05.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.259+0000 7f92fbe00640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92e0066f60 0x7f92e0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.259+0000 7f92fbe00640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92e0066f60 0x7f92e0069420 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0045f0 tx=0x7f92ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.263+0000 7f92faa00640 1 -- 172.21.15.59:0/82608439 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f92f4055ab0 con 0x7f93040b1750 2024-04-25T09:10:05.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.423+0000 7f9309800640 1 -- 172.21.15.59:0/82608439 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f930415b070 con 0x7f93040b1750 2024-04-25T09:10:05.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f92faa00640 1 -- 172.21.15.59:0/82608439 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+13166 (secure 0 0 0) 0x7f92f4059b50 con 0x7f93040b1750 2024-04-25T09:10:05.417 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:05.417 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":103,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:10:04.686164+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f9309800640 1 -- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92e0066f60 msgr2=0x7f92e0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f9309800640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92e0066f60 0x7f92e0069420 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f92ec0045f0 tx=0x7f92ec008040 comp rx=0 tx=0).stop 2024-04-25T09:10:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f9309800640 1 -- 172.21.15.59:0/82608439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93040b1750 msgr2=0x7f930415ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f9309800640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93040b1750 0x7f930415ab30 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f92f400c7f0 tx=0x7f92f400ccb0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f9309800640 1 -- 172.21.15.59:0/82608439 shutdown_connections 2024-04-25T09:10:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f9309800640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92e0066f60 0x7f92e0069420 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f9309800640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9304145270 0x7f93040b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f9309800640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f93040cd4d0 0x7f9304141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f9309800640 1 --2- 172.21.15.59:0/82608439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f93040b1750 0x7f930415ab30 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f9309800640 1 -- 172.21.15.59:0/82608439 >> 172.21.15.59:0/82608439 conn(0x7f9304066fa0 msgr2=0x7f930415caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:05.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f9309800640 1 -- 172.21.15.59:0/82608439 shutdown_connections 2024-04-25T09:10:05.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.427+0000 7f9309800640 1 -- 172.21.15.59:0/82608439 wait complete. 2024-04-25T09:10:05.436 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:10:05.437 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:10:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.591+0000 7f402aa00640 1 Processor -- start 2024-04-25T09:10:05.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.591+0000 7f402aa00640 1 -- start start 2024-04-25T09:10:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.591+0000 7f402aa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415b910 0x7f40240cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f402aa00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f402415bcf0 0x7f4024099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f402aa00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240d02a0 con 0x7f40240cf3c0 2024-04-25T09:10:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f402aa00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40240cc350 con 0x7f402415bcf0 2024-04-25T09:10:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f402aa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40240cc630 con 0x7f402415b910 2024-04-25T09:10:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f401b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f40240cf3c0 0x7f40240cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60544/0 (socket says 172.21.15.59:60544) 2024-04-25T09:10:05.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f401b400640 1 -- 172.21.15.59:0/4245320916 learned_addr learned my addr 172.21.15.59:0/4245320916 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:05.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4028a00640 1 --2- 172.21.15.59:0/4245320916 >> v2:172.21.15.178:3300/0 conn(0x7f402415bcf0 0x7f4024099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364662576 0 0) 0x7f40240d02a0 con 0x7f40240cf3c0 2024-04-25T09:10:05.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4008003530 con 0x7f40240cf3c0 2024-04-25T09:10:05.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023e00640 1 --2- 172.21.15.59:0/4245320916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415b910 0x7f40240cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2381931146 0 0) 0x7f4008003530 con 0x7f40240cf3c0 2024-04-25T09:10:05.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415b910 msgr2=0x7f40240cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 --2- 172.21.15.59:0/4245320916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415b910 0x7f40240cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 >> v2:172.21.15.178:3300/0 conn(0x7f402415bcf0 msgr2=0x7f4024099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 --2- 172.21.15.59:0/4245320916 >> v2:172.21.15.178:3300/0 conn(0x7f402415bcf0 0x7f4024099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40240cc910 con 0x7f40240cf3c0 2024-04-25T09:10:05.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f400c001680 con 0x7f40240cf3c0 2024-04-25T09:10:05.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 >> v1:172.21.15.59:6789/0 conn(0x7f40240cf3c0 legacy=0x7f40240cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 --2- 172.21.15.59:0/4245320916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40080039c0 0x7f4008003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 --2- 172.21.15.59:0/4245320916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4008004810 0x7f4008004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 --2- 172.21.15.59:0/4245320916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415b910 0x7f40080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240cc350 con 0x7f4008004810 2024-04-25T09:10:05.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240cc630 con 0x7f40080039c0 2024-04-25T09:10:05.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f400800b9d0 con 0x7f402415b910 2024-04-25T09:10:05.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f401b400640 1 --2- 172.21.15.59:0/4245320916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4008004810 0x7f4008004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4023e00640 1 --2- 172.21.15.59:0/4245320916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40080039c0 0x7f4008003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f4028a00640 1 --2- 172.21.15.59:0/4245320916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415b910 0x7f40080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f401b400640 1 -- 172.21.15.59:0/4245320916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415b910 msgr2=0x7f40080051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f401b400640 1 --2- 172.21.15.59:0/4245320916 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415b910 0x7f40080051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f401b400640 1 -- 172.21.15.59:0/4245320916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40080039c0 msgr2=0x7f4008003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f401b400640 1 --2- 172.21.15.59:0/4245320916 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f40080039c0 0x7f4008003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.595+0000 7f401b400640 1 -- 172.21.15.59:0/4245320916 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4008003530 con 0x7f4008004810 2024-04-25T09:10:05.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f401b400640 1 --2- 172.21.15.59:0/4245320916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4008004810 0x7f4008004c90 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c210 tx=0x7f400c01f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=968d0a5a3113b3a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c007d60 con 0x7f4008004810 2024-04-25T09:10:05.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c005b00 con 0x7f4008004810 2024-04-25T09:10:05.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f4023400640 1 -- 172.21.15.59:0/4245320916 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c007070 con 0x7f4008004810 2024-04-25T09:10:05.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f402aa00640 1 -- 172.21.15.59:0/4245320916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4008004810 msgr2=0x7f4008004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f402aa00640 1 --2- 172.21.15.59:0/4245320916 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4008004810 0x7f4008004c90 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c210 tx=0x7f400c01f3f0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f4028a00640 1 -- 172.21.15.59:0/4245320916 reap_dead start 2024-04-25T09:10:05.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f402aa00640 1 -- 172.21.15.59:0/4245320916 shutdown_connections 2024-04-25T09:10:05.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f402aa00640 1 -- 172.21.15.59:0/4245320916 >> 172.21.15.59:0/4245320916 conn(0x7f40240b3200 msgr2=0x7f40240b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:05.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f402aa00640 1 -- 172.21.15.59:0/4245320916 shutdown_connections 2024-04-25T09:10:05.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f402aa00640 1 -- 172.21.15.59:0/4245320916 wait complete. 2024-04-25T09:10:05.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f402aa00640 1 Processor -- start 2024-04-25T09:10:05.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.599+0000 7f402aa00640 1 -- start start 2024-04-25T09:10:05.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f402aa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4008004810 0x7f402415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f402aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40240cb220 0x7f402415d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f402aa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415db50 0x7f40240b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f402aa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4024099fa0 con 0x7f40240cb220 2024-04-25T09:10:05.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f402aa00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240d0580 con 0x7f4008004810 2024-04-25T09:10:05.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f402aa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402409a120 con 0x7f402415db50 2024-04-25T09:10:05.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f401b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40240cb220 0x7f402415d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f401b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40240cb220 0x7f402415d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55130/0 (socket says 172.21.15.59:55130) 2024-04-25T09:10:05.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f401b400640 1 -- 172.21.15.59:0/1041486821 learned_addr learned my addr 172.21.15.59:0/1041486821 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:05.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f4023e00640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4008004810 0x7f402415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f4028a00640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415db50 0x7f40240b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f401b400640 1 -- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415db50 msgr2=0x7f40240b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f401b400640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415db50 0x7f40240b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f401b400640 1 -- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4008004810 msgr2=0x7f402415a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f401b400640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4008004810 0x7f402415a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f401b400640 1 -- 172.21.15.59:0/1041486821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402415a9d0 con 0x7f40240cb220 2024-04-25T09:10:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f401b400640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40240cb220 0x7f402415d610 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f400c01f220 tx=0x7f4008005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f4020c00640 1 -- 172.21.15.59:0/1041486821 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c001ca0 con 0x7f40240cb220 2024-04-25T09:10:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f4020c00640 1 -- 172.21.15.59:0/1041486821 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c005cb0 con 0x7f40240cb220 2024-04-25T09:10:05.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f4020c00640 1 -- 172.21.15.59:0/1041486821 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c005e60 con 0x7f40240cb220 2024-04-25T09:10:05.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f402aa00640 1 -- 172.21.15.59:0/1041486821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40241f6d50 con 0x7f40240cb220 2024-04-25T09:10:05.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f402aa00640 1 -- 172.21.15.59:0/1041486821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40241f7310 con 0x7f40240cb220 2024-04-25T09:10:05.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f402aa00640 1 -- 172.21.15.59:0/1041486821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40240745d0 con 0x7f40240cb220 2024-04-25T09:10:05.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.603+0000 7f4020c00640 1 -- 172.21.15.59:0/1041486821 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f400c007040 con 0x7f40240cb220 2024-04-25T09:10:05.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.607+0000 7f4020c00640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4000066f90 0x7f4000069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.607+0000 7f4020c00640 1 -- 172.21.15.59:0/1041486821 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f400c121760 con 0x7f40240cb220 2024-04-25T09:10:05.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.607+0000 7f4023e00640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4000066f90 0x7f4000069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.607+0000 7f4023e00640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4000066f90 0x7f4000069450 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f40240714a0 tx=0x7f4014009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.611+0000 7f4020c00640 1 -- 172.21.15.59:0/1041486821 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f400c0c3070 con 0x7f40240cb220 2024-04-25T09:10:05.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 -- 172.21.15.59:0/1041486821 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f402415df30 con 0x7f40240cb220 2024-04-25T09:10:05.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f4020c00640 1 -- 172.21.15.59:0/1041486821 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7f400c019100 con 0x7f40240cb220 2024-04-25T09:10:05.764 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:10:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 -- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4000066f90 msgr2=0x7f4000069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4000066f90 0x7f4000069450 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f40240714a0 tx=0x7f4014009190 comp rx=0 tx=0).stop 2024-04-25T09:10:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 -- 172.21.15.59:0/1041486821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40240cb220 msgr2=0x7f402415d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40240cb220 0x7f402415d610 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f400c01f220 tx=0x7f4008005840 comp rx=0 tx=0).stop 2024-04-25T09:10:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 -- 172.21.15.59:0/1041486821 shutdown_connections 2024-04-25T09:10:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4000066f90 0x7f4000069450 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f402415db50 0x7f40240b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40240cb220 0x7f402415d610 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 --2- 172.21.15.59:0/1041486821 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4008004810 0x7f402415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 -- 172.21.15.59:0/1041486821 >> 172.21.15.59:0/1041486821 conn(0x7f40240b3200 msgr2=0x7f40240c6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 -- 172.21.15.59:0/1041486821 shutdown_connections 2024-04-25T09:10:05.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.775+0000 7f402aa00640 1 -- 172.21.15.59:0/1041486821 wait complete. 2024-04-25T09:10:05.786 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:10:05.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.935+0000 7f809ca00640 1 Processor -- start 2024-04-25T09:10:05.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.935+0000 7f809ca00640 1 -- start start 2024-04-25T09:10:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.939+0000 7f809ca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8098161510 0x7f8098143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.939+0000 7f809ca00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80981435c0 0x7f809815e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.939+0000 7f809ca00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809806d090 con 0x7f8098070fe0 2024-04-25T09:10:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.939+0000 7f809ca00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8098071ad0 con 0x7f80981435c0 2024-04-25T09:10:05.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.939+0000 7f809ca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8098162390 con 0x7f8098161510 2024-04-25T09:10:05.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.939+0000 7f8096800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80981435c0 0x7f809815e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.939+0000 7f8096800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80981435c0 0x7f809815e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55138/0 (socket says 172.21.15.59:55138) 2024-04-25T09:10:05.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.939+0000 7f8096800640 1 -- 172.21.15.59:0/2348185311 learned_addr learned my addr 172.21.15.59:0/2348185311 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:05.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.939+0000 7f8096800640 1 -- 172.21.15.59:0/2348185311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8098161510 msgr2=0x7f8098143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.939+0000 7f8096800640 1 --2- 172.21.15.59:0/2348185311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8098161510 0x7f8098143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.939+0000 7f8096800640 1 -- 172.21.15.59:0/2348185311 >> v1:172.21.15.178:6789/0 conn(0x7f8098070fe0 legacy=0x7f80980713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:05.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.939+0000 7f8096800640 1 -- 172.21.15.59:0/2348185311 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8098161af0 con 0x7f80981435c0 2024-04-25T09:10:05.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f8096800640 1 --2- 172.21.15.59:0/2348185311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80981435c0 0x7f809815e550 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f8090009e50 tx=0x7f809001c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce73d218f222c42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f8094a00640 1 -- 172.21.15.59:0/2348185311 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80900a5570 con 0x7f80981435c0 2024-04-25T09:10:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f8094a00640 1 -- 172.21.15.59:0/2348185311 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80900a5710 con 0x7f80981435c0 2024-04-25T09:10:05.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f8094a00640 1 -- 172.21.15.59:0/2348185311 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80900a5ae0 con 0x7f80981435c0 2024-04-25T09:10:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f809ca00640 1 -- 172.21.15.59:0/2348185311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80981435c0 msgr2=0x7f809815e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f809ca00640 1 --2- 172.21.15.59:0/2348185311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80981435c0 0x7f809815e550 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f8090009e50 tx=0x7f809001c7e0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f809ca00640 1 -- 172.21.15.59:0/2348185311 shutdown_connections 2024-04-25T09:10:05.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f809ca00640 1 --2- 172.21.15.59:0/2348185311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80981435c0 0x7f809815e550 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f809ca00640 1 --2- 172.21.15.59:0/2348185311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8098161510 0x7f8098143080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f809ca00640 1 -- 172.21.15.59:0/2348185311 >> 172.21.15.59:0/2348185311 conn(0x7f80980b3390 msgr2=0x7f80980b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:05.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f809ca00640 1 -- 172.21.15.59:0/2348185311 shutdown_connections 2024-04-25T09:10:05.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f809ca00640 1 -- 172.21.15.59:0/2348185311 wait complete. 2024-04-25T09:10:05.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f809ca00640 1 Processor -- start 2024-04-25T09:10:05.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.943+0000 7f809ca00640 1 -- start start 2024-04-25T09:10:05.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f809ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8098070fe0 0x7f8098144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f809ca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80981435c0 0x7f80981425f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f809ca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8098161510 0x7f8098142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f809ca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80980b06c0 con 0x7f8098070fe0 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f809ca00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80980b0540 con 0x7f80981435c0 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f809ca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80980b0840 con 0x7f8098161510 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f8095e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8098070fe0 0x7f8098144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f8095e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8098070fe0 0x7f8098144290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55144/0 (socket says 172.21.15.59:55144) 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f8095e00640 1 -- 172.21.15.59:0/4156983062 learned_addr learned my addr 172.21.15.59:0/4156983062 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f8096800640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8098161510 0x7f8098142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f8095400640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80981435c0 0x7f80981425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f8095e00640 1 -- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8098161510 msgr2=0x7f8098142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f8095e00640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8098161510 0x7f8098142b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f8095e00640 1 -- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80981435c0 msgr2=0x7f80981425f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f8095e00640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80981435c0 0x7f80981425f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f8095e00640 1 -- 172.21.15.59:0/4156983062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809815fd10 con 0x7f8098070fe0 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f8095400640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80981435c0 0x7f80981425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:05.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f8095e00640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8098070fe0 0x7f8098144290 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f808800c490 tx=0x7f8088001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f808e000640 1 -- 172.21.15.59:0/4156983062 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8088017070 con 0x7f8098070fe0 2024-04-25T09:10:05.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f808e000640 1 -- 172.21.15.59:0/4156983062 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8088003600 con 0x7f8098070fe0 2024-04-25T09:10:05.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f808e000640 1 -- 172.21.15.59:0/4156983062 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8088003a30 con 0x7f8098070fe0 2024-04-25T09:10:05.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f809ca00640 1 -- 172.21.15.59:0/4156983062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80981fa430 con 0x7f8098070fe0 2024-04-25T09:10:05.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f809ca00640 1 -- 172.21.15.59:0/4156983062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80981faf10 con 0x7f8098070fe0 2024-04-25T09:10:05.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f809ca00640 1 -- 172.21.15.59:0/4156983062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80980745d0 con 0x7f8098070fe0 2024-04-25T09:10:05.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.947+0000 7f808e000640 1 -- 172.21.15.59:0/4156983062 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8088003bd0 con 0x7f8098070fe0 2024-04-25T09:10:05.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.951+0000 7f808e000640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8078066f60 0x7f8078069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:05.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.951+0000 7f808e000640 1 -- 172.21.15.59:0/4156983062 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f8088084170 con 0x7f8098070fe0 2024-04-25T09:10:05.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.951+0000 7f8095400640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8078066f60 0x7f8078069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:05.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.951+0000 7f8095400640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8078066f60 0x7f8078069420 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f80981fa140 tx=0x7f8084008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:05.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:05.951+0000 7f808e000640 1 -- 172.21.15.59:0/4156983062 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f80880553b0 con 0x7f8098070fe0 2024-04-25T09:10:06.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.115+0000 7f809ca00640 1 -- 172.21.15.59:0/4156983062 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f80980cb790 con 0x7f8098070fe0 2024-04-25T09:10:06.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.115+0000 7f808e000640 1 -- 172.21.15.59:0/4156983062 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v103) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8088054cb0 con 0x7f8098070fe0 2024-04-25T09:10:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:06.106 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T09:10:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:10:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-04-25T09:10:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-04-25T09:10:06.106 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:06.107 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T09:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.119+0000 7f809ca00640 1 -- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8078066f60 msgr2=0x7f8078069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.119+0000 7f809ca00640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8078066f60 0x7f8078069420 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f80981fa140 tx=0x7f8084008040 comp rx=0 tx=0).stop 2024-04-25T09:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.119+0000 7f809ca00640 1 -- 172.21.15.59:0/4156983062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8098070fe0 msgr2=0x7f8098144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.119+0000 7f809ca00640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8098070fe0 0x7f8098144290 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f808800c490 tx=0x7f8088001e80 comp rx=0 tx=0).stop 2024-04-25T09:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.119+0000 7f809ca00640 1 -- 172.21.15.59:0/4156983062 shutdown_connections 2024-04-25T09:10:06.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.119+0000 7f809ca00640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8078066f60 0x7f8078069420 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.119+0000 7f809ca00640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8098161510 0x7f8098142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.119+0000 7f809ca00640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80981435c0 0x7f80981425f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.119+0000 7f809ca00640 1 --2- 172.21.15.59:0/4156983062 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8098070fe0 0x7f8098144290 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.119+0000 7f809ca00640 1 -- 172.21.15.59:0/4156983062 >> 172.21.15.59:0/4156983062 conn(0x7f80980b3390 msgr2=0x7f80980caa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.119+0000 7f809ca00640 1 -- 172.21.15.59:0/4156983062 shutdown_connections 2024-04-25T09:10:06.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.119+0000 7f809ca00640 1 -- 172.21.15.59:0/4156983062 wait complete. 2024-04-25T09:10:06.127 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:10:06.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:10:06.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0088e00640 1 Processor -- start 2024-04-25T09:10:06.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0088e00640 1 -- start start 2024-04-25T09:10:06.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0088e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f00840af860 0x7f00840c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0088e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f00840c5ed0 0x7f00841676d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0088e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00840afcf0 con 0x7f008415dd00 2024-04-25T09:10:06.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0088e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00840d0430 con 0x7f00840c5ed0 2024-04-25T09:10:06.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0088e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00840c6dc0 con 0x7f00840af860 2024-04-25T09:10:06.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0082800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f00840c5ed0 0x7f00841676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0081e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f008415dd00 0x7f00840ce1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60554/0 (socket says 172.21.15.59:60554) 2024-04-25T09:10:06.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0081e00640 1 -- 172.21.15.59:0/405398580 learned_addr learned my addr 172.21.15.59:0/405398580 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:06.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f007be00640 1 --2- 172.21.15.59:0/405398580 >> v2:172.21.15.178:3300/0 conn(0x7f00840af860 0x7f00840c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0082800640 1 -- 172.21.15.59:0/405398580 >> v2:172.21.15.178:3300/0 conn(0x7f00840af860 msgr2=0x7f00840c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0082800640 1 --2- 172.21.15.59:0/405398580 >> v2:172.21.15.178:3300/0 conn(0x7f00840af860 0x7f00840c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0082800640 1 -- 172.21.15.59:0/405398580 >> v1:172.21.15.59:6789/0 conn(0x7f008415dd00 legacy=0x7f00840ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0082800640 1 -- 172.21.15.59:0/405398580 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840c70a0 con 0x7f00840c5ed0 2024-04-25T09:10:06.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.283+0000 7f0081400640 1 -- 172.21.15.59:0/405398580 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249664177 0 0) 0x7f00840afcf0 con 0x7f008415dd00 2024-04-25T09:10:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.287+0000 7f0082800640 1 --2- 172.21.15.59:0/405398580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840c5ed0 0x7f00841676d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f00840d1660 tx=0x7f007c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5e741826b8ea12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.287+0000 7f0081400640 1 -- 172.21.15.59:0/405398580 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c0b2070 con 0x7f00840c5ed0 2024-04-25T09:10:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.287+0000 7f0081400640 1 -- 172.21.15.59:0/405398580 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007c0a5900 con 0x7f00840c5ed0 2024-04-25T09:10:06.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.287+0000 7f0081400640 1 -- 172.21.15.59:0/405398580 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007c0a5cd0 con 0x7f00840c5ed0 2024-04-25T09:10:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.287+0000 7f0088e00640 1 -- 172.21.15.59:0/405398580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840c5ed0 msgr2=0x7f00841676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.287+0000 7f0088e00640 1 --2- 172.21.15.59:0/405398580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840c5ed0 0x7f00841676d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f00840d1660 tx=0x7f007c01c930 comp rx=0 tx=0).stop 2024-04-25T09:10:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.287+0000 7f0088e00640 1 -- 172.21.15.59:0/405398580 shutdown_connections 2024-04-25T09:10:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.287+0000 7f0088e00640 1 --2- 172.21.15.59:0/405398580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840c5ed0 0x7f00841676d0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.287+0000 7f0088e00640 1 --2- 172.21.15.59:0/405398580 >> v2:172.21.15.178:3300/0 conn(0x7f00840af860 0x7f00840c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.287+0000 7f0088e00640 1 -- 172.21.15.59:0/405398580 >> 172.21.15.59:0/405398580 conn(0x7f00840b2240 msgr2=0x7f00840b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.287+0000 7f0088e00640 1 -- 172.21.15.59:0/405398580 shutdown_connections 2024-04-25T09:10:06.278 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.287+0000 7f0088e00640 1 -- 172.21.15.59:0/405398580 wait complete. 2024-04-25T09:10:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0088e00640 1 Processor -- start 2024-04-25T09:10:06.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0088e00640 1 -- start start 2024-04-25T09:10:06.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0088e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840af860 0x7f0084151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0088e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840c5ed0 0x7f008409d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0088e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f008409d690 0x7f00841565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0088e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008416a7c0 con 0x7f00840af860 2024-04-25T09:10:06.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0088e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008416a640 con 0x7f008409d690 2024-04-25T09:10:06.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0088e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008416a940 con 0x7f00840c5ed0 2024-04-25T09:10:06.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0081e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840af860 0x7f0084151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0081e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840af860 0x7f0084151f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55162/0 (socket says 172.21.15.59:55162) 2024-04-25T09:10:06.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0081e00640 1 -- 172.21.15.59:0/2273487155 learned_addr learned my addr 172.21.15.59:0/2273487155 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:06.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f007be00640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840c5ed0 0x7f008409d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0082800640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f008409d690 0x7f00841565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0081e00640 1 -- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840c5ed0 msgr2=0x7f008409d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0081e00640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840c5ed0 0x7f008409d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0081e00640 1 -- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f008409d690 msgr2=0x7f00841565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0081e00640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f008409d690 0x7f00841565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0081e00640 1 -- 172.21.15.59:0/2273487155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0084152440 con 0x7f00840af860 2024-04-25T09:10:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0081e00640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840af860 0x7f0084151f00 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f007400c480 tx=0x7f007400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f007a000640 1 -- 172.21.15.59:0/2273487155 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074018070 con 0x7f00840af860 2024-04-25T09:10:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f007a000640 1 -- 172.21.15.59:0/2273487155 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0074007500 con 0x7f00840af860 2024-04-25T09:10:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f007a000640 1 -- 172.21.15.59:0/2273487155 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074004a30 con 0x7f00840af860 2024-04-25T09:10:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0088e00640 1 -- 172.21.15.59:0/2273487155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008409dca0 con 0x7f00840af860 2024-04-25T09:10:06.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.291+0000 7f0088e00640 1 -- 172.21.15.59:0/2273487155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008409e260 con 0x7f00840af860 2024-04-25T09:10:06.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.295+0000 7f0088e00640 1 -- 172.21.15.59:0/2273487155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00840745d0 con 0x7f00840af860 2024-04-25T09:10:06.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.295+0000 7f007a000640 1 -- 172.21.15.59:0/2273487155 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f007401b070 con 0x7f00840af860 2024-04-25T09:10:06.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.295+0000 7f007a000640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0060066f60 0x7f0060069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.295+0000 7f007a000640 1 -- 172.21.15.59:0/2273487155 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f0074084030 con 0x7f00840af860 2024-04-25T09:10:06.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.295+0000 7f007be00640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0060066f60 0x7f0060069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.295+0000 7f007be00640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0060066f60 0x7f0060069420 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0084157180 tx=0x7f006c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.299+0000 7f007a000640 1 -- 172.21.15.59:0/2273487155 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0074054c40 con 0x7f00840af860 2024-04-25T09:10:06.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.463+0000 7f0088e00640 1 -- 172.21.15.59:0/2273487155 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0084156210 con 0x7f00840af860 2024-04-25T09:10:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.683+0000 7f007a000640 1 -- 172.21.15.59:0/2273487155 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v104) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0074058ce0 con 0x7f00840af860 2024-04-25T09:10:06.673 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-04-25T09:10:06.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.687+0000 7f0088e00640 1 -- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0060066f60 msgr2=0x7f0060069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.687+0000 7f0088e00640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0060066f60 0x7f0060069420 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f0084157180 tx=0x7f006c009190 comp rx=0 tx=0).stop 2024-04-25T09:10:06.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.687+0000 7f0088e00640 1 -- 172.21.15.59:0/2273487155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840af860 msgr2=0x7f0084151f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.687+0000 7f0088e00640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840af860 0x7f0084151f00 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f007400c480 tx=0x7f007400c940 comp rx=0 tx=0).stop 2024-04-25T09:10:06.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.687+0000 7f0088e00640 1 -- 172.21.15.59:0/2273487155 shutdown_connections 2024-04-25T09:10:06.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.687+0000 7f0088e00640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0060066f60 0x7f0060069420 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.687+0000 7f0088e00640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f008409d690 0x7f00841565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.687+0000 7f0088e00640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f00840c5ed0 0x7f008409d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.687+0000 7f0088e00640 1 --2- 172.21.15.59:0/2273487155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00840af860 0x7f0084151f00 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.687+0000 7f0088e00640 1 -- 172.21.15.59:0/2273487155 >> 172.21.15.59:0/2273487155 conn(0x7f00840b2240 msgr2=0x7f00840ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:06.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.687+0000 7f0088e00640 1 -- 172.21.15.59:0/2273487155 shutdown_connections 2024-04-25T09:10:06.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.687+0000 7f0088e00640 1 -- 172.21.15.59:0/2273487155 wait complete. 2024-04-25T09:10:06.702 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:10:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df9800640 1 Processor -- start 2024-04-25T09:10:06.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df9800640 1 -- start start 2024-04-25T09:10:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df9800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1df415dc60 0x7f1df40d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df9800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1df409a170 0x7f1df40cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df9800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1df415e040 con 0x7f1df406bf30 2024-04-25T09:10:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df9800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df40cff80 con 0x7f1df415dc60 2024-04-25T09:10:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df9800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1df40d0260 con 0x7f1df409a170 2024-04-25T09:10:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1df415dc60 0x7f1df40d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1dea000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1df406bf30 0x7f1df4099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60568/0 (socket says 172.21.15.59:60568) 2024-04-25T09:10:06.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1dea000640 1 -- 172.21.15.59:0/3677970480 learned_addr learned my addr 172.21.15.59:0/3677970480 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df3400640 1 --2- 172.21.15.59:0/3677970480 >> v2:172.21.15.178:3300/0 conn(0x7f1df409a170 0x7f1df40cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df2a00640 1 -- 172.21.15.59:0/3677970480 >> v2:172.21.15.178:3300/0 conn(0x7f1df409a170 msgr2=0x7f1df40cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df2a00640 1 --2- 172.21.15.59:0/3677970480 >> v2:172.21.15.178:3300/0 conn(0x7f1df409a170 0x7f1df40cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df2a00640 1 -- 172.21.15.59:0/3677970480 >> v1:172.21.15.59:6789/0 conn(0x7f1df406bf30 legacy=0x7f1df4099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df2a00640 1 -- 172.21.15.59:0/3677970480 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df40d0540 con 0x7f1df415dc60 2024-04-25T09:10:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df3400640 1 --2- 172.21.15.59:0/3677970480 >> v2:172.21.15.178:3300/0 conn(0x7f1df409a170 0x7f1df40cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:06.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.863+0000 7f1df2000640 1 -- 172.21.15.59:0/3677970480 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304174766 0 0) 0x7f1df415e040 con 0x7f1df406bf30 2024-04-25T09:10:06.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df2a00640 1 --2- 172.21.15.59:0/3677970480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df415dc60 0x7f1df40d1020 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f1df4072a70 tx=0x7f1de401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3797a7cead8145 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df2000640 1 -- 172.21.15.59:0/3677970480 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de40b1070 con 0x7f1df415dc60 2024-04-25T09:10:06.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df2000640 1 -- 172.21.15.59:0/3677970480 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de40ac620 con 0x7f1df415dc60 2024-04-25T09:10:06.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df2000640 1 -- 172.21.15.59:0/3677970480 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de40ac9f0 con 0x7f1df415dc60 2024-04-25T09:10:06.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df9800640 1 -- 172.21.15.59:0/3677970480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df415dc60 msgr2=0x7f1df40d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df9800640 1 --2- 172.21.15.59:0/3677970480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df415dc60 0x7f1df40d1020 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f1df4072a70 tx=0x7f1de401c3c0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df9800640 1 -- 172.21.15.59:0/3677970480 shutdown_connections 2024-04-25T09:10:06.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df9800640 1 --2- 172.21.15.59:0/3677970480 >> v2:172.21.15.178:3300/0 conn(0x7f1df409a170 0x7f1df40cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df9800640 1 --2- 172.21.15.59:0/3677970480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df415dc60 0x7f1df40d1020 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df9800640 1 -- 172.21.15.59:0/3677970480 >> 172.21.15.59:0/3677970480 conn(0x7f1df40b3200 msgr2=0x7f1df40b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:06.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df9800640 1 -- 172.21.15.59:0/3677970480 shutdown_connections 2024-04-25T09:10:06.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df9800640 1 -- 172.21.15.59:0/3677970480 wait complete. 2024-04-25T09:10:06.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.867+0000 7f1df9800640 1 Processor -- start 2024-04-25T09:10:06.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df9800640 1 -- start start 2024-04-25T09:10:06.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df9800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1df406bf30 0x7f1df41435a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df9800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df409a170 0x7f1df4154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df9800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1df415dc60 0x7f1df4156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df9800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40cc6f0 con 0x7f1df409a170 2024-04-25T09:10:06.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df9800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40cc570 con 0x7f1df415dc60 2024-04-25T09:10:06.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df9800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1df40cc870 con 0x7f1df406bf30 2024-04-25T09:10:06.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1dea000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df409a170 0x7f1df4154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1dea000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df409a170 0x7f1df4154f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55190/0 (socket says 172.21.15.59:55190) 2024-04-25T09:10:06.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1dea000640 1 -- 172.21.15.59:0/3166541652 learned_addr learned my addr 172.21.15.59:0/3166541652 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:06.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df2a00640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1df406bf30 0x7f1df41435a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df3400640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1df415dc60 0x7f1df4156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1dea000640 1 -- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1df406bf30 msgr2=0x7f1df41435a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1dea000640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1df406bf30 0x7f1df41435a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1dea000640 1 -- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1df415dc60 msgr2=0x7f1df4156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:06.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1dea000640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1df415dc60 0x7f1df4156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:06.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1dea000640 1 -- 172.21.15.59:0/3166541652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df40c87e0 con 0x7f1df409a170 2024-04-25T09:10:06.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df3400640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1df415dc60 0x7f1df4156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:06.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1dea000640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df409a170 0x7f1df4154f70 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0011f0 tx=0x7f1ddc00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1deb400640 1 -- 172.21.15.59:0/3166541652 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc018070 con 0x7f1df409a170 2024-04-25T09:10:06.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1deb400640 1 -- 172.21.15.59:0/3166541652 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ddc0074e0 con 0x7f1df409a170 2024-04-25T09:10:06.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1deb400640 1 -- 172.21.15.59:0/3166541652 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ddc004a10 con 0x7f1df409a170 2024-04-25T09:10:06.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df9800640 1 -- 172.21.15.59:0/3166541652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1df40c8aa0 con 0x7f1df409a170 2024-04-25T09:10:06.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df9800640 1 -- 172.21.15.59:0/3166541652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1df40c9060 con 0x7f1df409a170 2024-04-25T09:10:06.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.871+0000 7f1df9800640 1 -- 172.21.15.59:0/3166541652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1df40745d0 con 0x7f1df409a170 2024-04-25T09:10:06.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.875+0000 7f1deb400640 1 -- 172.21.15.59:0/3166541652 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1ddc004bb0 con 0x7f1df409a170 2024-04-25T09:10:06.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.875+0000 7f1deb400640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1dd0066f60 0x7f1dd0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:06.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.875+0000 7f1deb400640 1 -- 172.21.15.59:0/3166541652 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f1ddc0843e0 con 0x7f1df409a170 2024-04-25T09:10:06.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.875+0000 7f1df2a00640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1dd0066f60 0x7f1dd0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:06.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.875+0000 7f1df2a00640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1dd0066f60 0x7f1dd0069420 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1de40ae000 tx=0x7f1de4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:06.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:06.879+0000 7f1deb400640 1 -- 172.21.15.59:0/3166541652 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1ddc055430 con 0x7f1df409a170 2024-04-25T09:10:07.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.043+0000 7f1df9800640 1 -- 172.21.15.59:0/3166541652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1df40b7590 con 0x7f1df409a170 2024-04-25T09:10:07.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.691+0000 7f1deb400640 1 -- 172.21.15.59:0/3166541652 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v105) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1ddc054d30 con 0x7f1df409a170 2024-04-25T09:10:07.681 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-04-25T09:10:07.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.695+0000 7f1df9800640 1 -- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1dd0066f60 msgr2=0x7f1dd0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.695+0000 7f1df9800640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1dd0066f60 0x7f1dd0069420 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1de40ae000 tx=0x7f1de4008040 comp rx=0 tx=0).stop 2024-04-25T09:10:07.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.695+0000 7f1df9800640 1 -- 172.21.15.59:0/3166541652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df409a170 msgr2=0x7f1df4154f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.695+0000 7f1df9800640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df409a170 0x7f1df4154f70 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f1ddc0011f0 tx=0x7f1ddc00c9b0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.695+0000 7f1df9800640 1 -- 172.21.15.59:0/3166541652 shutdown_connections 2024-04-25T09:10:07.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.695+0000 7f1df9800640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1dd0066f60 0x7f1dd0069420 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.695+0000 7f1df9800640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1df415dc60 0x7f1df4156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.695+0000 7f1df9800640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1df409a170 0x7f1df4154f70 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.695+0000 7f1df9800640 1 --2- 172.21.15.59:0/3166541652 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1df406bf30 0x7f1df41435a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.695+0000 7f1df9800640 1 -- 172.21.15.59:0/3166541652 >> 172.21.15.59:0/3166541652 conn(0x7f1df40b3200 msgr2=0x7f1df415a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:07.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.695+0000 7f1df9800640 1 -- 172.21.15.59:0/3166541652 shutdown_connections 2024-04-25T09:10:07.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.695+0000 7f1df9800640 1 -- 172.21.15.59:0/3166541652 wait complete. 2024-04-25T09:10:07.722 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:10:07.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effdcc00640 1 Processor -- start 2024-04-25T09:10:07.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effdcc00640 1 -- start start 2024-04-25T09:10:07.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effdcc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effd806ce40 0x7effd809a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effdcc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7effd806bf30 0x7effd815d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effdcc00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd809aef0 con 0x7effd80cd6c0 2024-04-25T09:10:07.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effdcc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd806f4e0 con 0x7effd806ce40 2024-04-25T09:10:07.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effdcc00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd806f7c0 con 0x7effd806bf30 2024-04-25T09:10:07.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effcea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effd806ce40 0x7effd809a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effcea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effd806ce40 0x7effd809a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55192/0 (socket says 172.21.15.59:55192) 2024-04-25T09:10:07.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effcea00640 1 -- 172.21.15.59:0/4138833071 learned_addr learned my addr 172.21.15.59:0/4138833071 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:07.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effd7e00640 1 --2- 172.21.15.59:0/4138833071 >> v2:172.21.15.178:3300/0 conn(0x7effd806bf30 0x7effd815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effcea00640 1 -- 172.21.15.59:0/4138833071 >> v2:172.21.15.178:3300/0 conn(0x7effd806bf30 msgr2=0x7effd815d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:07.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effcea00640 1 --2- 172.21.15.59:0/4138833071 >> v2:172.21.15.178:3300/0 conn(0x7effd806bf30 0x7effd815d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effcea00640 1 -- 172.21.15.59:0/4138833071 >> v1:172.21.15.178:6789/0 conn(0x7effd80cd6c0 legacy=0x7effd806c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effcea00640 1 -- 172.21.15.59:0/4138833071 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd806faa0 con 0x7effd806ce40 2024-04-25T09:10:07.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.883+0000 7effd7e00640 1 --2- 172.21.15.59:0/4138833071 >> v2:172.21.15.178:3300/0 conn(0x7effd806bf30 0x7effd815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:07.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.887+0000 7effcea00640 1 --2- 172.21.15.59:0/4138833071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd806ce40 0x7effd809a910 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7effd80b3d60 tx=0x7effc001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c13986424b2ab7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:07.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.887+0000 7effd6a00640 1 -- 172.21.15.59:0/4138833071 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00ab620 con 0x7effd806ce40 2024-04-25T09:10:07.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.887+0000 7effd6a00640 1 -- 172.21.15.59:0/4138833071 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc00b0070 con 0x7effd806ce40 2024-04-25T09:10:07.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.887+0000 7effd6a00640 1 -- 172.21.15.59:0/4138833071 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00ab9e0 con 0x7effd806ce40 2024-04-25T09:10:07.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.887+0000 7effdcc00640 1 -- 172.21.15.59:0/4138833071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd806ce40 msgr2=0x7effd809a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.887+0000 7effdcc00640 1 --2- 172.21.15.59:0/4138833071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd806ce40 0x7effd809a910 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7effd80b3d60 tx=0x7effc001c460 comp rx=0 tx=0).stop 2024-04-25T09:10:07.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.887+0000 7effdcc00640 1 -- 172.21.15.59:0/4138833071 shutdown_connections 2024-04-25T09:10:07.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.887+0000 7effdcc00640 1 --2- 172.21.15.59:0/4138833071 >> v2:172.21.15.178:3300/0 conn(0x7effd806bf30 0x7effd815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.887+0000 7effdcc00640 1 --2- 172.21.15.59:0/4138833071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd806ce40 0x7effd809a910 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.887+0000 7effdcc00640 1 -- 172.21.15.59:0/4138833071 >> 172.21.15.59:0/4138833071 conn(0x7effd80b3090 msgr2=0x7effd80b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:07.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.887+0000 7effdcc00640 1 -- 172.21.15.59:0/4138833071 shutdown_connections 2024-04-25T09:10:07.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.887+0000 7effdcc00640 1 -- 172.21.15.59:0/4138833071 wait complete. 2024-04-25T09:10:07.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effdcc00640 1 Processor -- start 2024-04-25T09:10:07.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effdcc00640 1 -- start start 2024-04-25T09:10:07.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effdcc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effd806bf30 0x7effd80af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effdcc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd806ce40 0x7effd8156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effdcc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effd80cd6c0 0x7effd814b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effdcc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd80cbd70 con 0x7effd806ce40 2024-04-25T09:10:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effdcc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd80cbbf0 con 0x7effd80cd6c0 2024-04-25T09:10:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effdcc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd80702a0 con 0x7effd806bf30 2024-04-25T09:10:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effcea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd806ce40 0x7effd8156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effd7400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effd806bf30 0x7effd80af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effcea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd806ce40 0x7effd8156dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55194/0 (socket says 172.21.15.59:55194) 2024-04-25T09:10:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effd7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effd80cd6c0 0x7effd814b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effcea00640 1 -- 172.21.15.59:0/762970603 learned_addr learned my addr 172.21.15.59:0/762970603 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effcea00640 1 -- 172.21.15.59:0/762970603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effd806bf30 msgr2=0x7effd80af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effcea00640 1 --2- 172.21.15.59:0/762970603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effd806bf30 0x7effd80af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effcea00640 1 -- 172.21.15.59:0/762970603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effd80cd6c0 msgr2=0x7effd814b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effcea00640 1 --2- 172.21.15.59:0/762970603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effd80cd6c0 0x7effd814b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:07.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effcea00640 1 -- 172.21.15.59:0/762970603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd80c9c30 con 0x7effd806ce40 2024-04-25T09:10:07.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effcea00640 1 --2- 172.21.15.59:0/762970603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd806ce40 0x7effd8156dc0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7effc0019070 tx=0x7effc001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:07.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effcfe00640 1 -- 172.21.15.59:0/762970603 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00abcc0 con 0x7effd806ce40 2024-04-25T09:10:07.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effcfe00640 1 -- 172.21.15.59:0/762970603 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc00be3f0 con 0x7effd806ce40 2024-04-25T09:10:07.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effdcc00640 1 -- 172.21.15.59:0/762970603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd80aede0 con 0x7effd806ce40 2024-04-25T09:10:07.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effcfe00640 1 -- 172.21.15.59:0/762970603 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00be7e0 con 0x7effd806ce40 2024-04-25T09:10:07.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.891+0000 7effdcc00640 1 -- 172.21.15.59:0/762970603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd80af3a0 con 0x7effd806ce40 2024-04-25T09:10:07.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.895+0000 7effdcc00640 1 -- 172.21.15.59:0/762970603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd80745d0 con 0x7effd806ce40 2024-04-25T09:10:07.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.895+0000 7effcfe00640 1 -- 172.21.15.59:0/762970603 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7effc00c7440 con 0x7effd806ce40 2024-04-25T09:10:07.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.895+0000 7effcfe00640 1 --2- 172.21.15.59:0/762970603 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effb4066f60 0x7effb4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:07.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.895+0000 7effcfe00640 1 -- 172.21.15.59:0/762970603 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 6001+0+0 (secure 0 0 0) 0x7effc011f450 con 0x7effd806ce40 2024-04-25T09:10:07.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.899+0000 7effd7400640 1 --2- 172.21.15.59:0/762970603 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effb4066f60 0x7effb4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:07.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.899+0000 7effd7400640 1 --2- 172.21.15.59:0/762970603 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effb4066f60 0x7effb4069420 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7effd80cb670 tx=0x7effc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:07.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:07.899+0000 7effcfe00640 1 -- 172.21.15.59:0/762970603 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7effc0016110 con 0x7effd806ce40 2024-04-25T09:10:08.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.095+0000 7effdcc00640 1 -- 172.21.15.59:0/762970603 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7effd8155db0 con 0x7effd806ce40 2024-04-25T09:10:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.695+0000 7effcfe00640 1 -- 172.21.15.59:0/762970603 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v83) v1 ==== 174+0+0 (secure 0 0 0) 0x7effc00efcd0 con 0x7effd806ce40 2024-04-25T09:10:08.683 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 15 and data pool 16 2024-04-25T09:10:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.699+0000 7effdcc00640 1 -- 172.21.15.59:0/762970603 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effb4066f60 msgr2=0x7effb4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.699+0000 7effdcc00640 1 --2- 172.21.15.59:0/762970603 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effb4066f60 0x7effb4069420 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7effd80cb670 tx=0x7effc8009040 comp rx=0 tx=0).stop 2024-04-25T09:10:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.699+0000 7effdcc00640 1 -- 172.21.15.59:0/762970603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd806ce40 msgr2=0x7effd8156dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.699+0000 7effdcc00640 1 --2- 172.21.15.59:0/762970603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd806ce40 0x7effd8156dc0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7effc0019070 tx=0x7effc001aca0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.699+0000 7effdcc00640 1 -- 172.21.15.59:0/762970603 shutdown_connections 2024-04-25T09:10:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.699+0000 7effdcc00640 1 --2- 172.21.15.59:0/762970603 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7effb4066f60 0x7effb4069420 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.699+0000 7effdcc00640 1 --2- 172.21.15.59:0/762970603 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7effd80cd6c0 0x7effd814b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.699+0000 7effdcc00640 1 --2- 172.21.15.59:0/762970603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effd806ce40 0x7effd8156dc0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.699+0000 7effdcc00640 1 --2- 172.21.15.59:0/762970603 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7effd806bf30 0x7effd80af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.699+0000 7effdcc00640 1 -- 172.21.15.59:0/762970603 >> 172.21.15.59:0/762970603 conn(0x7effd80b3090 msgr2=0x7effd806d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.699+0000 7effdcc00640 1 -- 172.21.15.59:0/762970603 shutdown_connections 2024-04-25T09:10:08.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.699+0000 7effdcc00640 1 -- 172.21.15.59:0/762970603 wait complete. 2024-04-25T09:10:08.729 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:08.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc935200640 1 Processor -- start 2024-04-25T09:10:08.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc935200640 1 -- start start 2024-04-25T09:10:08.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc935200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc930146740 0x7fc93006d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc935200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9300aeb50 0x7fc9300aef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc935200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9300b23e0 con 0x7fc9300af840 2024-04-25T09:10:08.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc935200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc930146b20 con 0x7fc930146740 2024-04-25T09:10:08.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc935200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300af4c0 con 0x7fc9300aeb50 2024-04-25T09:10:08.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc925400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc9300af840 0x7fc9300b19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:60578/0 (socket says 172.21.15.59:60578) 2024-04-25T09:10:08.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc925400640 1 -- 172.21.15.59:0/4179643493 learned_addr learned my addr 172.21.15.59:0/4179643493 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc92e800640 1 --2- 172.21.15.59:0/4179643493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9300aeb50 0x7fc9300aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc92de00640 1 --2- 172.21.15.59:0/4179643493 >> v2:172.21.15.178:3300/0 conn(0x7fc930146740 0x7fc93006d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc92d400640 1 -- 172.21.15.59:0/4179643493 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453405753 0 0) 0x7fc9300b23e0 con 0x7fc9300af840 2024-04-25T09:10:08.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc92d400640 1 -- 172.21.15.59:0/4179643493 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc914003530 con 0x7fc9300af840 2024-04-25T09:10:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc92d400640 1 -- 172.21.15.59:0/4179643493 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 734998982 0 0) 0x7fc914003530 con 0x7fc9300af840 2024-04-25T09:10:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc92de00640 1 -- 172.21.15.59:0/4179643493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9300aeb50 msgr2=0x7fc9300aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc92de00640 1 --2- 172.21.15.59:0/4179643493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9300aeb50 0x7fc9300aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc92de00640 1 -- 172.21.15.59:0/4179643493 >> v1:172.21.15.59:6789/0 conn(0x7fc9300af840 legacy=0x7fc9300b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc92de00640 1 -- 172.21.15.59:0/4179643493 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9300acb80 con 0x7fc930146740 2024-04-25T09:10:08.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.883+0000 7fc92e800640 1 --2- 172.21.15.59:0/4179643493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9300aeb50 0x7fc9300aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.887+0000 7fc92de00640 1 --2- 172.21.15.59:0/4179643493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc930146740 0x7fc93006d2b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc9200097c0 tx=0x7fc92001c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23818e428f3fce71 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.887+0000 7fc92d400640 1 -- 172.21.15.59:0/4179643493 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9200b0070 con 0x7fc930146740 2024-04-25T09:10:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.887+0000 7fc92d400640 1 -- 172.21.15.59:0/4179643493 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9200ab400 con 0x7fc930146740 2024-04-25T09:10:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.887+0000 7fc92d400640 1 -- 172.21.15.59:0/4179643493 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc918001680 con 0x7fc930146740 2024-04-25T09:10:08.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.887+0000 7fc935200640 1 -- 172.21.15.59:0/4179643493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc930146740 msgr2=0x7fc93006d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.887+0000 7fc935200640 1 --2- 172.21.15.59:0/4179643493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc930146740 0x7fc93006d2b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc9200097c0 tx=0x7fc92001c390 comp rx=0 tx=0).stop 2024-04-25T09:10:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.887+0000 7fc935200640 1 -- 172.21.15.59:0/4179643493 shutdown_connections 2024-04-25T09:10:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.887+0000 7fc935200640 1 --2- 172.21.15.59:0/4179643493 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc9300aeb50 0x7fc9300aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.887+0000 7fc935200640 1 --2- 172.21.15.59:0/4179643493 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc930146740 0x7fc93006d2b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.887+0000 7fc935200640 1 -- 172.21.15.59:0/4179643493 >> 172.21.15.59:0/4179643493 conn(0x7fc930066fa0 msgr2=0x7fc93006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.887+0000 7fc935200640 1 -- 172.21.15.59:0/4179643493 shutdown_connections 2024-04-25T09:10:08.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.887+0000 7fc935200640 1 -- 172.21.15.59:0/4179643493 wait complete. 2024-04-25T09:10:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc935200640 1 Processor -- start 2024-04-25T09:10:08.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc935200640 1 -- start start 2024-04-25T09:10:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc935200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300aeb50 0x7fc930139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc935200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9300af840 0x7fc93013e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc935200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc930146740 0x7fc93012b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc935200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93006d7f0 con 0x7fc9300aeb50 2024-04-25T09:10:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc935200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9300b20f0 con 0x7fc9300af840 2024-04-25T09:10:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc935200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93006d970 con 0x7fc930146740 2024-04-25T09:10:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc92de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300aeb50 0x7fc930139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc92de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300aeb50 0x7fc930139db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55204/0 (socket says 172.21.15.59:55204) 2024-04-25T09:10:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc92de00640 1 -- 172.21.15.59:0/260651343 learned_addr learned my addr 172.21.15.59:0/260651343 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:08.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc925400640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9300af840 0x7fc93013e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc92e800640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc930146740 0x7fc93012b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc92de00640 1 -- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc930146740 msgr2=0x7fc93012b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc92de00640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc930146740 0x7fc93012b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc92de00640 1 -- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9300af840 msgr2=0x7fc93013e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc92de00640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9300af840 0x7fc93013e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc92de00640 1 -- 172.21.15.59:0/260651343 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93013a490 con 0x7fc9300aeb50 2024-04-25T09:10:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc925400640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9300af840 0x7fc93013e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc92e800640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc930146740 0x7fc93012b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:08.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc92de00640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300aeb50 0x7fc930139db0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fc92001aa40 tx=0x7fc920019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc926a00640 1 -- 172.21.15.59:0/260651343 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9200b0040 con 0x7fc9300aeb50 2024-04-25T09:10:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc926a00640 1 -- 172.21.15.59:0/260651343 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9200bb070 con 0x7fc9300aeb50 2024-04-25T09:10:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc926a00640 1 -- 172.21.15.59:0/260651343 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920006e20 con 0x7fc9300aeb50 2024-04-25T09:10:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc935200640 1 -- 172.21.15.59:0/260651343 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93013a770 con 0x7fc9300aeb50 2024-04-25T09:10:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.891+0000 7fc935200640 1 -- 172.21.15.59:0/260651343 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93013ad30 con 0x7fc9300aeb50 2024-04-25T09:10:08.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.895+0000 7fc935200640 1 -- 172.21.15.59:0/260651343 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9300745d0 con 0x7fc9300aeb50 2024-04-25T09:10:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.895+0000 7fc926a00640 1 -- 172.21.15.59:0/260651343 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc9200b4650 con 0x7fc9300aeb50 2024-04-25T09:10:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.895+0000 7fc926a00640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc90c066f60 0x7fc90c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:08.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.895+0000 7fc926a00640 1 -- 172.21.15.59:0/260651343 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc92011ed70 con 0x7fc9300aeb50 2024-04-25T09:10:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.895+0000 7fc925400640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc90c066f60 0x7fc90c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:08.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.895+0000 7fc925400640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc90c066f60 0x7fc90c069420 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc93013e320 tx=0x7fc918009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:08.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:08.899+0000 7fc926a00640 1 -- 172.21.15.59:0/260651343 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc920015fb0 con 0x7fc9300aeb50 2024-04-25T09:10:09.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.063+0000 7fc935200640 1 -- 172.21.15.59:0/260651343 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9301474e0 con 0x7fc9300aeb50 2024-04-25T09:10:09.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.063+0000 7fc926a00640 1 -- 172.21.15.59:0/260651343 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16897 (secure 0 0 0) 0x7fc9200efb50 con 0x7fc9300aeb50 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:09.054 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":106,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:10:08.100453+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:06.512267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:07.092321+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.067+0000 7fc935200640 1 -- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc90c066f60 msgr2=0x7fc90c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.067+0000 7fc935200640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc90c066f60 0x7fc90c069420 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc93013e320 tx=0x7fc918009040 comp rx=0 tx=0).stop 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.067+0000 7fc935200640 1 -- 172.21.15.59:0/260651343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300aeb50 msgr2=0x7fc930139db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.067+0000 7fc935200640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300aeb50 0x7fc930139db0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fc92001aa40 tx=0x7fc920019130 comp rx=0 tx=0).stop 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.067+0000 7fc935200640 1 -- 172.21.15.59:0/260651343 shutdown_connections 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.067+0000 7fc935200640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc90c066f60 0x7fc90c069420 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.067+0000 7fc935200640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc930146740 0x7fc93012b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.067+0000 7fc935200640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc9300af840 0x7fc93013e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.067+0000 7fc935200640 1 --2- 172.21.15.59:0/260651343 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9300aeb50 0x7fc930139db0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.067+0000 7fc935200640 1 -- 172.21.15.59:0/260651343 >> 172.21.15.59:0/260651343 conn(0x7fc930066fa0 msgr2=0x7fc9300b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.067+0000 7fc935200640 1 -- 172.21.15.59:0/260651343 shutdown_connections 2024-04-25T09:10:09.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.067+0000 7fc935200640 1 -- 172.21.15.59:0/260651343 wait complete. 2024-04-25T09:10:09.075 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:09.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6946c00640 1 Processor -- start 2024-04-25T09:10:09.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6946c00640 1 -- start start 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6946c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f694015fe50 0x7f69400b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6946c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69400b1c90 0x7f694015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6946c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69400cc4e0 con 0x7f6940145270 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6946c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69400b20e0 con 0x7f69400b1c90 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6946c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6940145650 con 0x7f694015fe50 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6944c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69400b1c90 0x7f694015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6944c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69400b1c90 0x7f694015bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55210/0 (socket says 172.21.15.59:55210) 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6944c00640 1 -- 172.21.15.59:0/2011120667 learned_addr learned my addr 172.21.15.59:0/2011120667 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6937400640 1 --2- 172.21.15.59:0/2011120667 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f694015fe50 0x7f69400b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6944c00640 1 -- 172.21.15.59:0/2011120667 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f694015fe50 msgr2=0x7f69400b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6944c00640 1 --2- 172.21.15.59:0/2011120667 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f694015fe50 0x7f69400b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6944c00640 1 -- 172.21.15.59:0/2011120667 >> v1:172.21.15.178:6789/0 conn(0x7f6940145270 legacy=0x7f69400cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.227+0000 7f6944c00640 1 -- 172.21.15.59:0/2011120667 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69400ce040 con 0x7f69400b1c90 2024-04-25T09:10:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.231+0000 7f6944c00640 1 --2- 172.21.15.59:0/2011120667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69400b1c90 0x7f694015bd80 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f6938009e80 tx=0x7f693801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ebac8c316c2b96 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.231+0000 7f693f400640 1 -- 172.21.15.59:0/2011120667 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69380a5740 con 0x7f69400b1c90 2024-04-25T09:10:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.231+0000 7f693f400640 1 -- 172.21.15.59:0/2011120667 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69380a58e0 con 0x7f69400b1c90 2024-04-25T09:10:09.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.231+0000 7f693f400640 1 -- 172.21.15.59:0/2011120667 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69380a5cb0 con 0x7f69400b1c90 2024-04-25T09:10:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.231+0000 7f6946c00640 1 -- 172.21.15.59:0/2011120667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69400b1c90 msgr2=0x7f694015bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.231+0000 7f6946c00640 1 --2- 172.21.15.59:0/2011120667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69400b1c90 0x7f694015bd80 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f6938009e80 tx=0x7f693801c9d0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.231+0000 7f6946c00640 1 -- 172.21.15.59:0/2011120667 shutdown_connections 2024-04-25T09:10:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.231+0000 7f6946c00640 1 --2- 172.21.15.59:0/2011120667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69400b1c90 0x7f694015bd80 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.231+0000 7f6946c00640 1 --2- 172.21.15.59:0/2011120667 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f694015fe50 0x7f69400b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.231+0000 7f6946c00640 1 -- 172.21.15.59:0/2011120667 >> 172.21.15.59:0/2011120667 conn(0x7f6940066fa0 msgr2=0x7f694006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.231+0000 7f6946c00640 1 -- 172.21.15.59:0/2011120667 shutdown_connections 2024-04-25T09:10:09.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.231+0000 7f6946c00640 1 -- 172.21.15.59:0/2011120667 wait complete. 2024-04-25T09:10:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6946c00640 1 Processor -- start 2024-04-25T09:10:09.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6946c00640 1 -- start start 2024-04-25T09:10:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6946c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69400b1c90 0x7f69400b4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6946c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6940145270 0x7f6940143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6946c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f694015fe50 0x7f6940140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6946c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69400cdbe0 con 0x7f6940145270 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6946c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694015f930 con 0x7f694015fe50 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6946c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69400cdd60 con 0x7f69400b1c90 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6937400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6940145270 0x7f6940143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6937400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6940145270 0x7f6940143700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55212/0 (socket says 172.21.15.59:55212) 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6937400640 1 -- 172.21.15.59:0/1548446820 learned_addr learned my addr 172.21.15.59:0/1548446820 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6944c00640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f694015fe50 0x7f6940140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f693fe00640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69400b1c90 0x7f69400b4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6937400640 1 -- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69400b1c90 msgr2=0x7f69400b4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6937400640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69400b1c90 0x7f69400b4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6937400640 1 -- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f694015fe50 msgr2=0x7f6940140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6937400640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f694015fe50 0x7f6940140350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6937400640 1 -- 172.21.15.59:0/1548446820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6940142130 con 0x7f6940145270 2024-04-25T09:10:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6937400640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6940145270 0x7f6940143700 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f693000d620 tx=0x7f693000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f693cc00640 1 -- 172.21.15.59:0/1548446820 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693000b620 con 0x7f6940145270 2024-04-25T09:10:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f693cc00640 1 -- 172.21.15.59:0/1548446820 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6930019070 con 0x7f6940145270 2024-04-25T09:10:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f693cc00640 1 -- 172.21.15.59:0/1548446820 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693000b9e0 con 0x7f6940145270 2024-04-25T09:10:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6946c00640 1 -- 172.21.15.59:0/1548446820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6940142410 con 0x7f6940145270 2024-04-25T09:10:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6946c00640 1 -- 172.21.15.59:0/1548446820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69400b2b40 con 0x7f6940145270 2024-04-25T09:10:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.235+0000 7f6946c00640 1 -- 172.21.15.59:0/1548446820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69400745d0 con 0x7f6940145270 2024-04-25T09:10:09.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.239+0000 7f693cc00640 1 -- 172.21.15.59:0/1548446820 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f693000bb80 con 0x7f6940145270 2024-04-25T09:10:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.239+0000 7f693cc00640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f691c066f60 0x7f691c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.239+0000 7f693cc00640 1 -- 172.21.15.59:0/1548446820 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6930085470 con 0x7f6940145270 2024-04-25T09:10:09.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.239+0000 7f693fe00640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f691c066f60 0x7f691c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.239+0000 7f693fe00640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f691c066f60 0x7f691c069420 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f69400b4b60 tx=0x7f6928007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.243+0000 7f693cc00640 1 -- 172.21.15.59:0/1548446820 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6930055c90 con 0x7f6940145270 2024-04-25T09:10:09.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.403+0000 7f6946c00640 1 -- 172.21.15.59:0/1548446820 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f694006b8e0 con 0x7f6940145270 2024-04-25T09:10:09.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f693cc00640 1 -- 172.21.15.59:0/1548446820 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16897 (secure 0 0 0) 0x7f6930059d30 con 0x7f6940145270 2024-04-25T09:10:09.395 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:09.395 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":106,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:10:08.100453+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:06.512267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:07.092321+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f6946c00640 1 -- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f691c066f60 msgr2=0x7f691c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f6946c00640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f691c066f60 0x7f691c069420 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f69400b4b60 tx=0x7f6928007e40 comp rx=0 tx=0).stop 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f6946c00640 1 -- 172.21.15.59:0/1548446820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6940145270 msgr2=0x7f6940143700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f6946c00640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6940145270 0x7f6940143700 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f693000d620 tx=0x7f693000dae0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f6946c00640 1 -- 172.21.15.59:0/1548446820 shutdown_connections 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f6946c00640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f691c066f60 0x7f691c069420 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f6946c00640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f694015fe50 0x7f6940140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f6946c00640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6940145270 0x7f6940143700 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f6946c00640 1 --2- 172.21.15.59:0/1548446820 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69400b1c90 0x7f69400b4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f6946c00640 1 -- 172.21.15.59:0/1548446820 >> 172.21.15.59:0/1548446820 conn(0x7f6940066fa0 msgr2=0x7f694015d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f6946c00640 1 -- 172.21.15.59:0/1548446820 shutdown_connections 2024-04-25T09:10:09.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.407+0000 7f6946c00640 1 -- 172.21.15.59:0/1548446820 wait complete. 2024-04-25T09:10:09.416 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:10:09.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a3aa00640 1 Processor -- start 2024-04-25T09:10:09.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a3aa00640 1 -- start start 2024-04-25T09:10:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a3aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a3415b910 0x7f7a340cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a3aa00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7a340cf3c0 0x7f7a340cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a3aa00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a340d02a0 con 0x7f7a340cd370 2024-04-25T09:10:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a3aa00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a340cc350 con 0x7f7a3415b910 2024-04-25T09:10:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a3aa00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a340cc630 con 0x7f7a340cf3c0 2024-04-25T09:10:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a33e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a3415b910 0x7f7a340cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a33e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7a3415b910 0x7f7a340cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55218/0 (socket says 172.21.15.59:55218) 2024-04-25T09:10:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a33e00640 1 -- 172.21.15.59:0/99527308 learned_addr learned my addr 172.21.15.59:0/99527308 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a2b400640 1 --2- 172.21.15.59:0/99527308 >> v2:172.21.15.178:3300/0 conn(0x7f7a340cf3c0 0x7f7a340cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a33e00640 1 -- 172.21.15.59:0/99527308 >> v2:172.21.15.178:3300/0 conn(0x7f7a340cf3c0 msgr2=0x7f7a340cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a33e00640 1 --2- 172.21.15.59:0/99527308 >> v2:172.21.15.178:3300/0 conn(0x7f7a340cf3c0 0x7f7a340cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a33e00640 1 -- 172.21.15.59:0/99527308 >> v1:172.21.15.178:6789/0 conn(0x7f7a340cd370 legacy=0x7f7a34099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:09.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.571+0000 7f7a33e00640 1 -- 172.21.15.59:0/99527308 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a340cc910 con 0x7f7a3415b910 2024-04-25T09:10:09.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.575+0000 7f7a33e00640 1 --2- 172.21.15.59:0/99527308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a3415b910 0x7f7a340cf9a0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f7a34072e20 tx=0x7f7a2401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cb2f911a15bca1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.575+0000 7f7a33400640 1 -- 172.21.15.59:0/99527308 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240ab5f0 con 0x7f7a3415b910 2024-04-25T09:10:09.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.575+0000 7f7a33400640 1 -- 172.21.15.59:0/99527308 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a240b0070 con 0x7f7a3415b910 2024-04-25T09:10:09.564 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.575+0000 7f7a33400640 1 -- 172.21.15.59:0/99527308 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240ab9b0 con 0x7f7a3415b910 2024-04-25T09:10:09.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.575+0000 7f7a3aa00640 1 -- 172.21.15.59:0/99527308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a3415b910 msgr2=0x7f7a340cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.575+0000 7f7a3aa00640 1 --2- 172.21.15.59:0/99527308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a3415b910 0x7f7a340cf9a0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f7a34072e20 tx=0x7f7a2401c4e0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.575+0000 7f7a3aa00640 1 -- 172.21.15.59:0/99527308 shutdown_connections 2024-04-25T09:10:09.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.575+0000 7f7a3aa00640 1 --2- 172.21.15.59:0/99527308 >> v2:172.21.15.178:3300/0 conn(0x7f7a340cf3c0 0x7f7a340cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.575+0000 7f7a3aa00640 1 --2- 172.21.15.59:0/99527308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a3415b910 0x7f7a340cf9a0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.565 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.575+0000 7f7a3aa00640 1 -- 172.21.15.59:0/99527308 >> 172.21.15.59:0/99527308 conn(0x7f7a340b3200 msgr2=0x7f7a340b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:09.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.575+0000 7f7a3aa00640 1 -- 172.21.15.59:0/99527308 shutdown_connections 2024-04-25T09:10:09.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.575+0000 7f7a3aa00640 1 -- 172.21.15.59:0/99527308 wait complete. 2024-04-25T09:10:09.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a3aa00640 1 Processor -- start 2024-04-25T09:10:09.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a3aa00640 1 -- start start 2024-04-25T09:10:09.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a3aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a340cd370 0x7f7a340b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a3aa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a340cf3c0 0x7f7a341458c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a3aa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a3415b910 0x7f7a3406d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a3aa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3409a2f0 con 0x7f7a340cd370 2024-04-25T09:10:09.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a3aa00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3409a170 con 0x7f7a340cf3c0 2024-04-25T09:10:09.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a3aa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3415bcf0 con 0x7f7a3415b910 2024-04-25T09:10:09.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a33e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a340cd370 0x7f7a340b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a33e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a340cd370 0x7f7a340b6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:55220/0 (socket says 172.21.15.59:55220) 2024-04-25T09:10:09.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a33e00640 1 -- 172.21.15.59:0/1730174158 learned_addr learned my addr 172.21.15.59:0/1730174158 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:09.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a2b400640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a340cf3c0 0x7f7a341458c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a38a00640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a3415b910 0x7f7a3406d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a33e00640 1 -- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a3415b910 msgr2=0x7f7a3406d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a33e00640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a3415b910 0x7f7a3406d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a33e00640 1 -- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a340cf3c0 msgr2=0x7f7a341458c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a33e00640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a340cf3c0 0x7f7a341458c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a33e00640 1 -- 172.21.15.59:0/1730174158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a340b51b0 con 0x7f7a340cd370 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a38a00640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a3415b910 0x7f7a3406d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a33e00640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a340cd370 0x7f7a340b6de0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f7a240ad040 tx=0x7f7a2401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a30c00640 1 -- 172.21.15.59:0/1730174158 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240be5f0 con 0x7f7a340cd370 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a30c00640 1 -- 172.21.15.59:0/1730174158 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a240be790 con 0x7f7a340cd370 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a30c00640 1 -- 172.21.15.59:0/1730174158 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240beb80 con 0x7f7a340cd370 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a3aa00640 1 -- 172.21.15.59:0/1730174158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a340b5490 con 0x7f7a340cd370 2024-04-25T09:10:09.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.579+0000 7f7a3aa00640 1 -- 172.21.15.59:0/1730174158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3406cf80 con 0x7f7a340cd370 2024-04-25T09:10:09.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.583+0000 7f7a3aa00640 1 -- 172.21.15.59:0/1730174158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a340745d0 con 0x7f7a340cd370 2024-04-25T09:10:09.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.583+0000 7f7a30c00640 1 -- 172.21.15.59:0/1730174158 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7a240b43f0 con 0x7f7a340cd370 2024-04-25T09:10:09.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.583+0000 7f7a30c00640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7a10066f60 0x7f7a10069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:09.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.583+0000 7f7a30c00640 1 -- 172.21.15.59:0/1730174158 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f7a2411f7e0 con 0x7f7a340cd370 2024-04-25T09:10:09.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.583+0000 7f7a2b400640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7a10066f60 0x7f7a10069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:09.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.583+0000 7f7a2b400640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7a10066f60 0x7f7a10069420 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7a341f9f90 tx=0x7f7a1c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:09.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.587+0000 7f7a30c00640 1 -- 172.21.15.59:0/1730174158 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7a240160d0 con 0x7f7a340cd370 2024-04-25T09:10:09.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:09.787+0000 7f7a3aa00640 1 -- 172.21.15.59:0/1730174158 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7a340737e0 con 0x7f7a340cd370 2024-04-25T09:10:10.669 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:10:10.679+0000 7f4ca8000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:10:10.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.715+0000 7f7a30c00640 1 -- 172.21.15.59:0/1730174158 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v86) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7a240f0120 con 0x7f7a340cd370 2024-04-25T09:10:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.715+0000 7f7a3aa00640 1 -- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7a10066f60 msgr2=0x7f7a10069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.715+0000 7f7a3aa00640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7a10066f60 0x7f7a10069420 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7a341f9f90 tx=0x7f7a1c008040 comp rx=0 tx=0).stop 2024-04-25T09:10:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.715+0000 7f7a3aa00640 1 -- 172.21.15.59:0/1730174158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a340cd370 msgr2=0x7f7a340b6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.719+0000 7f7a3aa00640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a340cd370 0x7f7a340b6de0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f7a240ad040 tx=0x7f7a2401ad20 comp rx=0 tx=0).stop 2024-04-25T09:10:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.719+0000 7f7a3aa00640 1 -- 172.21.15.59:0/1730174158 shutdown_connections 2024-04-25T09:10:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.719+0000 7f7a3aa00640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7a10066f60 0x7f7a10069420 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.719+0000 7f7a3aa00640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7a3415b910 0x7f7a3406d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.719+0000 7f7a3aa00640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7a340cf3c0 0x7f7a341458c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.719+0000 7f7a3aa00640 1 --2- 172.21.15.59:0/1730174158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a340cd370 0x7f7a340b6de0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.719+0000 7f7a3aa00640 1 -- 172.21.15.59:0/1730174158 >> 172.21.15.59:0/1730174158 conn(0x7f7a340b3200 msgr2=0x7f7a3415e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.719+0000 7f7a3aa00640 1 -- 172.21.15.59:0/1730174158 shutdown_connections 2024-04-25T09:10:10.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.719+0000 7f7a3aa00640 1 -- 172.21.15.59:0/1730174158 wait complete. 2024-04-25T09:10:10.731 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:10:10.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:10:10.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df4200640 1 Processor -- start 2024-04-25T09:10:10.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df4200640 1 -- start start 2024-04-25T09:10:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df4200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9dec15b910 0x7f9dec0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df4200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9dec0cf3c0 0x7f9dec0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df4200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dec0d02a0 con 0x7f9dec0cd370 2024-04-25T09:10:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df4200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dec0cc350 con 0x7f9dec15b910 2024-04-25T09:10:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df4200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec0cc630 con 0x7f9dec0cf3c0 2024-04-25T09:10:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df1800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9dec15b910 0x7f9dec0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df1800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9dec15b910 0x7f9dec0cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60244/0 (socket says 172.21.15.59:60244) 2024-04-25T09:10:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df1800640 1 -- 172.21.15.59:0/2241926687 learned_addr learned my addr 172.21.15.59:0/2241926687 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df1800640 1 -- 172.21.15.59:0/2241926687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9dec0cf3c0 msgr2=0x7f9dec0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df0e00640 1 --2- 172.21.15.59:0/2241926687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9dec0cf3c0 0x7f9dec0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df1800640 1 --2- 172.21.15.59:0/2241926687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9dec0cf3c0 0x7f9dec0cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df1800640 1 -- 172.21.15.59:0/2241926687 >> v1:172.21.15.178:6789/0 conn(0x7f9dec0cd370 legacy=0x7f9dec099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:10.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df1800640 1 -- 172.21.15.59:0/2241926687 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec0cc910 con 0x7f9dec15b910 2024-04-25T09:10:10.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.887+0000 7f9df0e00640 1 --2- 172.21.15.59:0/2241926687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9dec0cf3c0 0x7f9dec0cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:10.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.891+0000 7f9df1800640 1 --2- 172.21.15.59:0/2241926687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dec15b910 0x7f9dec0cf9a0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009870 tx=0x7f9de001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7dc47961e86b4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.891+0000 7f9debe00640 1 -- 172.21.15.59:0/2241926687 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de00ab5f0 con 0x7f9dec15b910 2024-04-25T09:10:10.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.891+0000 7f9debe00640 1 -- 172.21.15.59:0/2241926687 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de00b0070 con 0x7f9dec15b910 2024-04-25T09:10:10.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.891+0000 7f9debe00640 1 -- 172.21.15.59:0/2241926687 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de00ab9b0 con 0x7f9dec15b910 2024-04-25T09:10:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.891+0000 7f9df4200640 1 -- 172.21.15.59:0/2241926687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dec15b910 msgr2=0x7f9dec0cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.891+0000 7f9df4200640 1 --2- 172.21.15.59:0/2241926687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dec15b910 0x7f9dec0cf9a0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9de0009870 tx=0x7f9de001c520 comp rx=0 tx=0).stop 2024-04-25T09:10:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.891+0000 7f9df4200640 1 -- 172.21.15.59:0/2241926687 shutdown_connections 2024-04-25T09:10:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.891+0000 7f9df4200640 1 --2- 172.21.15.59:0/2241926687 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9dec0cf3c0 0x7f9dec0cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.891+0000 7f9df4200640 1 --2- 172.21.15.59:0/2241926687 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dec15b910 0x7f9dec0cf9a0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.891+0000 7f9df4200640 1 -- 172.21.15.59:0/2241926687 >> 172.21.15.59:0/2241926687 conn(0x7f9dec0b3200 msgr2=0x7f9dec0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:10.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df4200640 1 -- 172.21.15.59:0/2241926687 shutdown_connections 2024-04-25T09:10:10.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df4200640 1 -- 172.21.15.59:0/2241926687 wait complete. 2024-04-25T09:10:10.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df4200640 1 Processor -- start 2024-04-25T09:10:10.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df4200640 1 -- start start 2024-04-25T09:10:10.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df4200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dec0cd370 0x7f9dec15d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df4200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dec0cf3c0 0x7f9dec15e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df4200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9dec15b910 0x7f9dec148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df4200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec09a2f0 con 0x7f9dec0cd370 2024-04-25T09:10:10.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df4200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec09a170 con 0x7f9dec0cf3c0 2024-04-25T09:10:10.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df4200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dec15bcf0 con 0x7f9dec15b910 2024-04-25T09:10:10.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dec0cd370 0x7f9dec15d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dec0cd370 0x7f9dec15d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60246/0 (socket says 172.21.15.59:60246) 2024-04-25T09:10:10.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df1800640 1 -- 172.21.15.59:0/2436634762 learned_addr learned my addr 172.21.15.59:0/2436634762 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df2200640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9dec15b910 0x7f9dec148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df0e00640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dec0cf3c0 0x7f9dec15e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df1800640 1 -- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9dec15b910 msgr2=0x7f9dec148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df1800640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9dec15b910 0x7f9dec148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df1800640 1 -- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dec0cf3c0 msgr2=0x7f9dec15e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df1800640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dec0cf3c0 0x7f9dec15e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df1800640 1 -- 172.21.15.59:0/2436634762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec15d8e0 con 0x7f9dec0cd370 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9df1800640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dec0cd370 0x7f9dec15d290 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9de00ad040 tx=0x7f9de001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.895+0000 7f9de9600640 1 -- 172.21.15.59:0/2436634762 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de00be5f0 con 0x7f9dec0cd370 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.899+0000 7f9de9600640 1 -- 172.21.15.59:0/2436634762 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de00be790 con 0x7f9dec0cd370 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.899+0000 7f9df4200640 1 -- 172.21.15.59:0/2436634762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dec15dbc0 con 0x7f9dec0cd370 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.899+0000 7f9de9600640 1 -- 172.21.15.59:0/2436634762 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de00beb80 con 0x7f9dec0cd370 2024-04-25T09:10:10.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.899+0000 7f9df4200640 1 -- 172.21.15.59:0/2436634762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dec15e180 con 0x7f9dec0cd370 2024-04-25T09:10:10.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.899+0000 7f9df4200640 1 -- 172.21.15.59:0/2436634762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dec0745d0 con 0x7f9dec0cd370 2024-04-25T09:10:10.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.899+0000 7f9de9600640 1 -- 172.21.15.59:0/2436634762 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9de00b43f0 con 0x7f9dec0cd370 2024-04-25T09:10:10.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.899+0000 7f9de9600640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9dcc066f60 0x7f9dcc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:10.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.899+0000 7f9de9600640 1 -- 172.21.15.59:0/2436634762 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9de011fbc0 con 0x7f9dec0cd370 2024-04-25T09:10:10.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.899+0000 7f9df0e00640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9dcc066f60 0x7f9dcc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:10.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.899+0000 7f9df0e00640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9dcc066f60 0x7f9dcc069420 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9dec15b3f0 tx=0x7f9dd8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:10.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:10.903+0000 7f9de9600640 1 -- 172.21.15.59:0/2436634762 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9de00c4060 con 0x7f9dec0cd370 2024-04-25T09:10:11.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.099+0000 7f9df4200640 1 -- 172.21.15.59:0/2436634762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9dec0cdcd0 con 0x7f9dec0cd370 2024-04-25T09:10:11.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.719+0000 7f9de9600640 1 -- 172.21.15.59:0/2436634762 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v87) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9de0016110 con 0x7f9dec0cd370 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.723+0000 7f9df4200640 1 -- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9dcc066f60 msgr2=0x7f9dcc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.723+0000 7f9df4200640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9dcc066f60 0x7f9dcc069420 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9dec15b3f0 tx=0x7f9dd8008040 comp rx=0 tx=0).stop 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.723+0000 7f9df4200640 1 -- 172.21.15.59:0/2436634762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dec0cd370 msgr2=0x7f9dec15d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.723+0000 7f9df4200640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dec0cd370 0x7f9dec15d290 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9de00ad040 tx=0x7f9de001ad60 comp rx=0 tx=0).stop 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.723+0000 7f9df4200640 1 -- 172.21.15.59:0/2436634762 shutdown_connections 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.723+0000 7f9df4200640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9dcc066f60 0x7f9dcc069420 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.723+0000 7f9df4200640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9dec15b910 0x7f9dec148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.723+0000 7f9df4200640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9dec0cf3c0 0x7f9dec15e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.723+0000 7f9df4200640 1 --2- 172.21.15.59:0/2436634762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dec0cd370 0x7f9dec15d290 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.723+0000 7f9df4200640 1 -- 172.21.15.59:0/2436634762 >> 172.21.15.59:0/2436634762 conn(0x7f9dec0b3200 msgr2=0x7f9dec099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.723+0000 7f9df4200640 1 -- 172.21.15.59:0/2436634762 shutdown_connections 2024-04-25T09:10:11.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.723+0000 7f9df4200640 1 -- 172.21.15.59:0/2436634762 wait complete. 2024-04-25T09:10:11.735 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:10:11.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:11.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe801c00640 1 Processor -- start 2024-04-25T09:10:11.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe801c00640 1 -- start start 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe801c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe7fc06e930 0x7fe7fc0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe801c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc0cc9d0 con 0x7fe7fc143c60 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe801c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7fc15e0a0 con 0x7fe7fc0cc560 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe801c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7fc0cf220 con 0x7fe7fc06e930 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe7f3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe7fc06e930 0x7fe7fc0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe7fbe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe7fc143c60 0x7fe7fc06e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50672/0 (socket says 172.21.15.59:50672) 2024-04-25T09:10:11.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe7fbe00640 1 -- 172.21.15.59:0/3853746497 learned_addr learned my addr 172.21.15.59:0/3853746497 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe7fb400640 1 -- 172.21.15.59:0/3853746497 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275526946 0 0) 0x7fe7fc0cc9d0 con 0x7fe7fc143c60 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe7fb400640 1 -- 172.21.15.59:0/3853746497 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7e0003530 con 0x7fe7fc143c60 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe7f3e00640 1 -- 172.21.15.59:0/3853746497 >> v1:172.21.15.178:6789/0 conn(0x7fe7fc0cc560 legacy=0x7fe7fc0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe7f3e00640 1 -- 172.21.15.59:0/3853746497 >> v1:172.21.15.59:6789/0 conn(0x7fe7fc143c60 legacy=0x7fe7fc06e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.891+0000 7fe7f3e00640 1 -- 172.21.15.59:0/3853746497 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc15e380 con 0x7fe7fc06e930 2024-04-25T09:10:11.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe7f3e00640 1 --2- 172.21.15.59:0/3853746497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc06e930 0x7fe7fc0cc020 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40097c0 tx=0x7fe7e401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd638723acf05275 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe7fb400640 1 -- 172.21.15.59:0/3853746497 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40b0070 con 0x7fe7fc06e930 2024-04-25T09:10:11.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe7fb400640 1 -- 172.21.15.59:0/3853746497 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7e40ab600 con 0x7fe7fc06e930 2024-04-25T09:10:11.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe7fb400640 1 -- 172.21.15.59:0/3853746497 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40ab9d0 con 0x7fe7fc06e930 2024-04-25T09:10:11.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe801c00640 1 -- 172.21.15.59:0/3853746497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc06e930 msgr2=0x7fe7fc0cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe801c00640 1 --2- 172.21.15.59:0/3853746497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc06e930 0x7fe7fc0cc020 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40097c0 tx=0x7fe7e401c410 comp rx=0 tx=0).stop 2024-04-25T09:10:11.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe801c00640 1 -- 172.21.15.59:0/3853746497 shutdown_connections 2024-04-25T09:10:11.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe801c00640 1 --2- 172.21.15.59:0/3853746497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc06e930 0x7fe7fc0cc020 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe801c00640 1 -- 172.21.15.59:0/3853746497 >> 172.21.15.59:0/3853746497 conn(0x7fe7fc066fa0 msgr2=0x7fe7fc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe801c00640 1 -- 172.21.15.59:0/3853746497 shutdown_connections 2024-04-25T09:10:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe801c00640 1 -- 172.21.15.59:0/3853746497 wait complete. 2024-04-25T09:10:11.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe801c00640 1 Processor -- start 2024-04-25T09:10:11.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.895+0000 7fe801c00640 1 -- start start 2024-04-25T09:10:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7fc06e930 0x7fe7fc13e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7fc0cc560 0x7fe7fc158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc143c60 0x7fe7fc140c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc1683b0 con 0x7fe7fc143c60 2024-04-25T09:10:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc15ee60 con 0x7fe7fc0cc560 2024-04-25T09:10:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc168530 con 0x7fe7fc06e930 2024-04-25T09:10:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc143c60 0x7fe7fc140c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc143c60 0x7fe7fc140c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60250/0 (socket says 172.21.15.59:60250) 2024-04-25T09:10:11.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801200640 1 -- 172.21.15.59:0/3503354539 learned_addr learned my addr 172.21.15.59:0/3503354539 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe7fbe00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7fc06e930 0x7fe7fc13e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe7f3e00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7fc0cc560 0x7fe7fc158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801200640 1 -- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7fc06e930 msgr2=0x7fe7fc13e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801200640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7fc06e930 0x7fe7fc13e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801200640 1 -- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7fc0cc560 msgr2=0x7fe7fc158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801200640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7fc0cc560 0x7fe7fc158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801200640 1 -- 172.21.15.59:0/3503354539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc13bcc0 con 0x7fe7fc143c60 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe7f3e00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7fc0cc560 0x7fe7fc158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe7fbe00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7fc06e930 0x7fe7fc13e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801200640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc143c60 0x7fe7fc140c60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400c770 tx=0x7fe7f400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe7f8c00640 1 -- 172.21.15.59:0/3503354539 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4003b80 con 0x7fe7fc143c60 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe7f8c00640 1 -- 172.21.15.59:0/3503354539 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f4003d20 con 0x7fe7fc143c60 2024-04-25T09:10:11.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe7f8c00640 1 -- 172.21.15.59:0/3503354539 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f400aa90 con 0x7fe7fc143c60 2024-04-25T09:10:11.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801c00640 1 -- 172.21.15.59:0/3503354539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7fc13b140 con 0x7fe7fc143c60 2024-04-25T09:10:11.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801c00640 1 -- 172.21.15.59:0/3503354539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc13b700 con 0x7fe7fc143c60 2024-04-25T09:10:11.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.899+0000 7fe801c00640 1 -- 172.21.15.59:0/3503354539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc13bef0 con 0x7fe7fc143c60 2024-04-25T09:10:11.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.903+0000 7fe7f8c00640 1 -- 172.21.15.59:0/3503354539 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe7f400ac30 con 0x7fe7fc143c60 2024-04-25T09:10:11.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.903+0000 7fe7f8c00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe7d8066f60 0x7fe7d8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:11.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.903+0000 7fe7f8c00640 1 -- 172.21.15.59:0/3503354539 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe7f4085210 con 0x7fe7fc143c60 2024-04-25T09:10:11.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.903+0000 7fe7fbe00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe7d8066f60 0x7fe7d8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:11.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.903+0000 7fe7fbe00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe7d8066f60 0x7fe7d8069420 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0011f0 tx=0x7fe7ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:11.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:11.907+0000 7fe7f8c00640 1 -- 172.21.15.59:0/3503354539 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe7f4055fc0 con 0x7fe7fc143c60 2024-04-25T09:10:12.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.103+0000 7fe801c00640 1 -- 172.21.15.59:0/3503354539 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7fc0b25f0 con 0x7fe7fc143c60 2024-04-25T09:10:12.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.103+0000 7fe7f8c00640 1 -- 172.21.15.59:0/3503354539 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fe7f40558c0 con 0x7fe7fc143c60 2024-04-25T09:10:12.093 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:12.094 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":87,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:08.100794+0000","modified":"2024-04-25T09:10:11.103823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8322":{"gid":8322,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2867303658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2867303658},{"type":"v1","addr":"172.21.15.59:6835","nonce":2867303658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:10:12.094 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 87 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.107+0000 7fe801c00640 1 -- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe7d8066f60 msgr2=0x7fe7d8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.107+0000 7fe801c00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe7d8066f60 0x7fe7d8069420 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec0011f0 tx=0x7fe7ec009040 comp rx=0 tx=0).stop 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.107+0000 7fe801c00640 1 -- 172.21.15.59:0/3503354539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc143c60 msgr2=0x7fe7fc140c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.107+0000 7fe801c00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc143c60 0x7fe7fc140c60 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400c770 tx=0x7fe7f400cc30 comp rx=0 tx=0).stop 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.107+0000 7fe801c00640 1 -- 172.21.15.59:0/3503354539 shutdown_connections 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.107+0000 7fe801c00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe7d8066f60 0x7fe7d8069420 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.107+0000 7fe801c00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7fc143c60 0x7fe7fc140c60 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.107+0000 7fe801c00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7fc0cc560 0x7fe7fc158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.107+0000 7fe801c00640 1 --2- 172.21.15.59:0/3503354539 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7fc06e930 0x7fe7fc13e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.107+0000 7fe801c00640 1 -- 172.21.15.59:0/3503354539 >> 172.21.15.59:0/3503354539 conn(0x7fe7fc066fa0 msgr2=0x7fe7fc06d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.107+0000 7fe801c00640 1 -- 172.21.15.59:0/3503354539 shutdown_connections 2024-04-25T09:10:12.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.107+0000 7fe801c00640 1 -- 172.21.15.59:0/3503354539 wait complete. 2024-04-25T09:10:12.115 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:12.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe4a2c00640 1 Processor -- start 2024-04-25T09:10:12.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe4a2c00640 1 -- start start 2024-04-25T09:10:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe4a2c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c0aeb50 0x7fe49c0aef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe4a2c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c0b23e0 con 0x7fe49c146740 2024-04-25T09:10:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe4a2c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c0acb80 con 0x7fe49c0af840 2024-04-25T09:10:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe4a2c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c06d9c0 con 0x7fe49c0aeb50 2024-04-25T09:10:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe49be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe49c146740 0x7fe49c06d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50682/0 (socket says 172.21.15.59:50682) 2024-04-25T09:10:12.257 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe49be00640 1 -- 172.21.15.59:0/3918226140 learned_addr learned my addr 172.21.15.59:0/3918226140 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982902902 0 0) 0x7fe49c0b23e0 con 0x7fe49c146740 2024-04-25T09:10:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe480003530 con 0x7fe49c146740 2024-04-25T09:10:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe4a0c00640 1 --2- 172.21.15.59:0/3918226140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c0aeb50 0x7fe49c0aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3013106354 0 0) 0x7fe480003530 con 0x7fe49c146740 2024-04-25T09:10:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c0aeb50 msgr2=0x7fe49c0aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe49b400640 1 --2- 172.21.15.59:0/3918226140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c0aeb50 0x7fe49c0aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 >> v1:172.21.15.178:6789/0 conn(0x7fe49c0af840 legacy=0x7fe49c0b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0ace60 con 0x7fe49c146740 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.267+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fe48c001680 con 0x7fe49c146740 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 >> v1:172.21.15.59:6789/0 conn(0x7fe49c146740 legacy=0x7fe49c06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe49b400640 1 --2- 172.21.15.59:0/3918226140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4800039f0 0x7fe480003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe49b400640 1 --2- 172.21.15.59:0/3918226140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe480004810 0x7fe480004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe49b400640 1 --2- 172.21.15.59:0/3918226140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c0aeb50 0x7fe480005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c06d9c0 con 0x7fe480004810 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe48000bb00 con 0x7fe4800039f0 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe48000bd00 con 0x7fe49c0aeb50 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe493e00640 1 --2- 172.21.15.59:0/3918226140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe480004810 0x7fe480004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe4a0c00640 1 --2- 172.21.15.59:0/3918226140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c0aeb50 0x7fe480005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe49be00640 1 --2- 172.21.15.59:0/3918226140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4800039f0 0x7fe480003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe493e00640 1 -- 172.21.15.59:0/3918226140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c0aeb50 msgr2=0x7fe480005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe493e00640 1 --2- 172.21.15.59:0/3918226140 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c0aeb50 0x7fe480005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe493e00640 1 -- 172.21.15.59:0/3918226140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4800039f0 msgr2=0x7fe480003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe493e00640 1 --2- 172.21.15.59:0/3918226140 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe4800039f0 0x7fe480003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe493e00640 1 -- 172.21.15.59:0/3918226140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe480003530 con 0x7fe480004810 2024-04-25T09:10:12.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe493e00640 1 --2- 172.21.15.59:0/3918226140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe480004810 0x7fe480004c90 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fe484001780 tx=0x7fe48401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53be173e7b10328 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840013a0 con 0x7fe480004810 2024-04-25T09:10:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4840052f0 con 0x7fe480004810 2024-04-25T09:10:12.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.271+0000 7fe49b400640 1 -- 172.21.15.59:0/3918226140 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484003840 con 0x7fe480004810 2024-04-25T09:10:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 -- 172.21.15.59:0/3918226140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe480004810 msgr2=0x7fe480004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 --2- 172.21.15.59:0/3918226140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe480004810 0x7fe480004c90 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fe484001780 tx=0x7fe48401c420 comp rx=0 tx=0).stop 2024-04-25T09:10:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a0c00640 1 -- 172.21.15.59:0/3918226140 reap_dead start 2024-04-25T09:10:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 -- 172.21.15.59:0/3918226140 shutdown_connections 2024-04-25T09:10:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 -- 172.21.15.59:0/3918226140 >> 172.21.15.59:0/3918226140 conn(0x7fe49c066fa0 msgr2=0x7fe49c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 -- 172.21.15.59:0/3918226140 shutdown_connections 2024-04-25T09:10:12.263 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 -- 172.21.15.59:0/3918226140 wait complete. 2024-04-25T09:10:12.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 Processor -- start 2024-04-25T09:10:12.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 -- start start 2024-04-25T09:10:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe480004810 0x7fe49c1f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c13c200 0x7fe49c1f4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe49c1f65b0 0x7fe49c140fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0ad420 con 0x7fe49c1f65b0 2024-04-25T09:10:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0b20f0 con 0x7fe480004810 2024-04-25T09:10:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a2c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0aef80 con 0x7fe49c13c200 2024-04-25T09:10:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe49c1f65b0 0x7fe49c140fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe49c1f65b0 0x7fe49c140fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60268/0 (socket says 172.21.15.59:60268) 2024-04-25T09:10:12.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.275+0000 7fe4a0c00640 1 -- 172.21.15.59:0/1317742225 learned_addr learned my addr 172.21.15.59:0/1317742225 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:12.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe49be00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe480004810 0x7fe49c1f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe4a0c00640 1 -- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c13c200 msgr2=0x7fe49c1f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.268 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe493e00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c13c200 0x7fe49c1f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe4a0c00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c13c200 0x7fe49c1f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe4a0c00640 1 -- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe480004810 msgr2=0x7fe49c1f37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe4a0c00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe480004810 0x7fe49c1f37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe4a0c00640 1 -- 172.21.15.59:0/1317742225 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c1f4770 con 0x7fe49c1f65b0 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe493e00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c13c200 0x7fe49c1f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe49be00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe480004810 0x7fe49c1f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe4a0c00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe49c1f65b0 0x7fe49c140fe0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fe49c06f510 tx=0x7fe494009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe498c00640 1 -- 172.21.15.59:0/1317742225 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494007d50 con 0x7fe49c1f65b0 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe498c00640 1 -- 172.21.15.59:0/1317742225 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494019070 con 0x7fe49c1f65b0 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe498c00640 1 -- 172.21.15.59:0/1317742225 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494014650 con 0x7fe49c1f65b0 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe4a2c00640 1 -- 172.21.15.59:0/1317742225 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c1f3ed0 con 0x7fe49c1f65b0 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe4a2c00640 1 -- 172.21.15.59:0/1317742225 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c1f4490 con 0x7fe49c1f65b0 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe4a2c00640 1 -- 172.21.15.59:0/1317742225 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c0745d0 con 0x7fe49c1f65b0 2024-04-25T09:10:12.269 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe498c00640 1 -- 172.21.15.59:0/1317742225 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe4940147f0 con 0x7fe49c1f65b0 2024-04-25T09:10:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe498c00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe478066f90 0x7fe478069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe498c00640 1 -- 172.21.15.59:0/1317742225 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe4940856b0 con 0x7fe49c1f65b0 2024-04-25T09:10:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.279+0000 7fe49be00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe478066f90 0x7fe478069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.283+0000 7fe49be00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe478066f90 0x7fe478069450 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe48c001210 tx=0x7fe48c001120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.283+0000 7fe498c00640 1 -- 172.21.15.59:0/1317742225 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe494056590 con 0x7fe49c1f65b0 2024-04-25T09:10:12.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.451+0000 7fe4a2c00640 1 -- 172.21.15.59:0/1317742225 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe49c06b870 con 0x7fe49c1f65b0 2024-04-25T09:10:12.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.451+0000 7fe498c00640 1 -- 172.21.15.59:0/1317742225 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16982 (secure 0 0 0) 0x7fe494055e90 con 0x7fe49c1f65b0 2024-04-25T09:10:12.441 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:12.441 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":109,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:10:11.719041+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:06.512267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:07.092321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.24","mappings":[{"from":5,"to":4}]},{"pgid":"16.36","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.455+0000 7fe4a2c00640 1 -- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe478066f90 msgr2=0x7fe478069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.455+0000 7fe4a2c00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe478066f90 0x7fe478069450 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe48c001210 tx=0x7fe48c001120 comp rx=0 tx=0).stop 2024-04-25T09:10:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.455+0000 7fe4a2c00640 1 -- 172.21.15.59:0/1317742225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe49c1f65b0 msgr2=0x7fe49c140fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.455+0000 7fe4a2c00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe49c1f65b0 0x7fe49c140fe0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fe49c06f510 tx=0x7fe494009dc0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.455+0000 7fe4a2c00640 1 -- 172.21.15.59:0/1317742225 shutdown_connections 2024-04-25T09:10:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.455+0000 7fe4a2c00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe478066f90 0x7fe478069450 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.455+0000 7fe4a2c00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe49c1f65b0 0x7fe49c140fe0 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.455+0000 7fe4a2c00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe49c13c200 0x7fe49c1f4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.455+0000 7fe4a2c00640 1 --2- 172.21.15.59:0/1317742225 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe480004810 0x7fe49c1f37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.455+0000 7fe4a2c00640 1 -- 172.21.15.59:0/1317742225 >> 172.21.15.59:0/1317742225 conn(0x7fe49c066fa0 msgr2=0x7fe49c071220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.455+0000 7fe4a2c00640 1 -- 172.21.15.59:0/1317742225 shutdown_connections 2024-04-25T09:10:12.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.455+0000 7fe4a2c00640 1 -- 172.21.15.59:0/1317742225 wait complete. 2024-04-25T09:10:12.462 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:10:12.462 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:10:12.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc2a2400640 1 Processor -- start 2024-04-25T09:10:12.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc2a2400640 1 -- start start 2024-04-25T09:10:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc2a2400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc29c070fe0 0x7fc29c161510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc2a2400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc29c071830 0x7fc29c15e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc2a2400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc29c06d090 con 0x7fc29c0713c0 2024-04-25T09:10:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc2a2400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c162390 con 0x7fc29c070fe0 2024-04-25T09:10:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc2a2400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc29c161af0 con 0x7fc29c071830 2024-04-25T09:10:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc29b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc29c070fe0 0x7fc29c161510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc29b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc29c070fe0 0x7fc29c161510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60270/0 (socket says 172.21.15.59:60270) 2024-04-25T09:10:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc29b400640 1 -- 172.21.15.59:0/2428181068 learned_addr learned my addr 172.21.15.59:0/2428181068 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc29be00640 1 --2- 172.21.15.59:0/2428181068 >> v2:172.21.15.178:3300/0 conn(0x7fc29c071830 0x7fc29c15e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc29b400640 1 -- 172.21.15.59:0/2428181068 >> v2:172.21.15.178:3300/0 conn(0x7fc29c071830 msgr2=0x7fc29c15e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc29b400640 1 --2- 172.21.15.59:0/2428181068 >> v2:172.21.15.178:3300/0 conn(0x7fc29c071830 0x7fc29c15e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc29b400640 1 -- 172.21.15.59:0/2428181068 >> v1:172.21.15.178:6789/0 conn(0x7fc29c0713c0 legacy=0x7fc29c143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc29b400640 1 -- 172.21.15.59:0/2428181068 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c161dd0 con 0x7fc29c070fe0 2024-04-25T09:10:12.605 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.615+0000 7fc29be00640 1 --2- 172.21.15.59:0/2428181068 >> v2:172.21.15.178:3300/0 conn(0x7fc29c071830 0x7fc29c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:12.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc29b400640 1 --2- 172.21.15.59:0/2428181068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29c070fe0 0x7fc29c161510 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fc29c147660 tx=0x7fc28c01c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b863041577b8f90a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc29a000640 1 -- 172.21.15.59:0/2428181068 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0b0070 con 0x7fc29c070fe0 2024-04-25T09:10:12.607 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc29a000640 1 -- 172.21.15.59:0/2428181068 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c0ab600 con 0x7fc29c070fe0 2024-04-25T09:10:12.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc29a000640 1 -- 172.21.15.59:0/2428181068 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0ab9d0 con 0x7fc29c070fe0 2024-04-25T09:10:12.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc2a2400640 1 -- 172.21.15.59:0/2428181068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29c070fe0 msgr2=0x7fc29c161510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc2a2400640 1 --2- 172.21.15.59:0/2428181068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29c070fe0 0x7fc29c161510 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fc29c147660 tx=0x7fc28c01c2d0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc2a2400640 1 -- 172.21.15.59:0/2428181068 shutdown_connections 2024-04-25T09:10:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc2a2400640 1 --2- 172.21.15.59:0/2428181068 >> v2:172.21.15.178:3300/0 conn(0x7fc29c071830 0x7fc29c15e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc2a2400640 1 --2- 172.21.15.59:0/2428181068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29c070fe0 0x7fc29c161510 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc2a2400640 1 -- 172.21.15.59:0/2428181068 >> 172.21.15.59:0/2428181068 conn(0x7fc29c0b3390 msgr2=0x7fc29c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc2a2400640 1 -- 172.21.15.59:0/2428181068 shutdown_connections 2024-04-25T09:10:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc2a2400640 1 -- 172.21.15.59:0/2428181068 wait complete. 2024-04-25T09:10:12.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc2a2400640 1 Processor -- start 2024-04-25T09:10:12.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.619+0000 7fc2a2400640 1 -- start start 2024-04-25T09:10:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc2a2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29c070fe0 0x7fc29c1470a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc2a2400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc29c0713c0 0x7fc29c0b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc2a2400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc29c071830 0x7fc29c13ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc2a2400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0b06c0 con 0x7fc29c070fe0 2024-04-25T09:10:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc2a2400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0b0540 con 0x7fc29c0713c0 2024-04-25T09:10:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc2a2400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc29c0b0840 con 0x7fc29c071830 2024-04-25T09:10:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc29b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29c070fe0 0x7fc29c1470a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc29b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29c070fe0 0x7fc29c1470a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60278/0 (socket says 172.21.15.59:60278) 2024-04-25T09:10:12.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc29b400640 1 -- 172.21.15.59:0/3603405987 learned_addr learned my addr 172.21.15.59:0/3603405987 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc29be00640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc29c071830 0x7fc29c13ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc29aa00640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc29c0713c0 0x7fc29c0b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc29b400640 1 -- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc29c071830 msgr2=0x7fc29c13ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc29b400640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc29c071830 0x7fc29c13ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc29b400640 1 -- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc29c0713c0 msgr2=0x7fc29c0b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc29b400640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc29c0713c0 0x7fc29c0b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc29b400640 1 -- 172.21.15.59:0/3603405987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0b1260 con 0x7fc29c070fe0 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc29b400640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29c070fe0 0x7fc29c1470a0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0ae040 tx=0x7fc28c019070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc293400640 1 -- 172.21.15.59:0/3603405987 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0b0040 con 0x7fc29c070fe0 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc293400640 1 -- 172.21.15.59:0/3603405987 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc28c0b9070 con 0x7fc29c070fe0 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc293400640 1 -- 172.21.15.59:0/3603405987 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28c0b48a0 con 0x7fc29c070fe0 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc2a2400640 1 -- 172.21.15.59:0/3603405987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29c13cbd0 con 0x7fc29c070fe0 2024-04-25T09:10:12.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc2a2400640 1 -- 172.21.15.59:0/3603405987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29c0b4800 con 0x7fc29c070fe0 2024-04-25T09:10:12.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc2a2400640 1 -- 172.21.15.59:0/3603405987 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29c0745d0 con 0x7fc29c070fe0 2024-04-25T09:10:12.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.623+0000 7fc293400640 1 -- 172.21.15.59:0/3603405987 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc28c0ab4c0 con 0x7fc29c070fe0 2024-04-25T09:10:12.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.627+0000 7fc293400640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc27c066f90 0x7fc27c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.627+0000 7fc293400640 1 -- 172.21.15.59:0/3603405987 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc28c11f0b0 con 0x7fc29c070fe0 2024-04-25T09:10:12.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.627+0000 7fc29aa00640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc27c066f90 0x7fc27c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.627+0000 7fc29aa00640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc27c066f90 0x7fc27c069450 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc29c1406e0 tx=0x7fc288009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.631+0000 7fc293400640 1 -- 172.21.15.59:0/3603405987 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc29c0b1260 con 0x7fc29c070fe0 2024-04-25T09:10:12.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.791+0000 7fc2a2400640 1 -- 172.21.15.59:0/3603405987 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc29c0cef80 con 0x7fc27c066f90 2024-04-25T09:10:12.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.799+0000 7fc293400640 1 -- 172.21.15.59:0/3603405987 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252468 (secure 0 0 0) 0x7fc29c0cef80 con 0x7fc27c066f90 2024-04-25T09:10:12.789 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:12.791 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:10:12.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.803+0000 7fc2a2400640 1 -- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc27c066f90 msgr2=0x7fc27c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.803+0000 7fc2a2400640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc27c066f90 0x7fc27c069450 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc29c1406e0 tx=0x7fc288009040 comp rx=0 tx=0).stop 2024-04-25T09:10:12.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.803+0000 7fc2a2400640 1 -- 172.21.15.59:0/3603405987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29c070fe0 msgr2=0x7fc29c1470a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.803+0000 7fc2a2400640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29c070fe0 0x7fc29c1470a0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fc28c0ae040 tx=0x7fc28c019070 comp rx=0 tx=0).stop 2024-04-25T09:10:12.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.803+0000 7fc2a2400640 1 -- 172.21.15.59:0/3603405987 shutdown_connections 2024-04-25T09:10:12.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.803+0000 7fc2a2400640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc27c066f90 0x7fc27c069450 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.803+0000 7fc2a2400640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc29c071830 0x7fc29c13ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.803+0000 7fc2a2400640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc29c0713c0 0x7fc29c0b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.803+0000 7fc2a2400640 1 --2- 172.21.15.59:0/3603405987 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc29c070fe0 0x7fc29c1470a0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.803+0000 7fc2a2400640 1 -- 172.21.15.59:0/3603405987 >> 172.21.15.59:0/3603405987 conn(0x7fc29c0b3390 msgr2=0x7fc29c0cd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:12.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.803+0000 7fc2a2400640 1 -- 172.21.15.59:0/3603405987 shutdown_connections 2024-04-25T09:10:12.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:12.803+0000 7fc2a2400640 1 -- 172.21.15.59:0/3603405987 wait complete. 2024-04-25T09:10:12.810 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":371,"stamp":"2024-04-25T09:10:11.782286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260944,"kb_used_data":11496,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713776,"statfs":{"total":773094113280,"available":772826906624,"internally_reserved":0,"allocated":11771904,"data_stored":6078492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001212"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715541+0000","last_change":"2024-04-25T09:10:08.733118+0000","last_active":"2024-04-25T09:10:09.715541+0000","last_peered":"2024-04-25T09:10:09.715541+0000","last_clean":"2024-04-25T09:10:09.715541+0000","last_became_active":"2024-04-25T09:10:08.732834+0000","last_became_peered":"2024-04-25T09:10:08.732834+0000","last_unstale":"2024-04-25T09:10:09.715541+0000","last_undegraded":"2024-04-25T09:10:09.715541+0000","last_fullsized":"2024-04-25T09:10:09.715541+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:18.483394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.726133+0000","last_change":"2024-04-25T09:10:08.723091+0000","last_active":"2024-04-25T09:10:08.726133+0000","last_peered":"2024-04-25T09:10:08.726133+0000","last_clean":"2024-04-25T09:10:08.726133+0000","last_became_active":"2024-04-25T09:10:08.722824+0000","last_became_peered":"2024-04-25T09:10:08.722824+0000","last_unstale":"2024-04-25T09:10:08.726133+0000","last_undegraded":"2024-04-25T09:10:08.726133+0000","last_fullsized":"2024-04-25T09:10:08.726133+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:38.123934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715335+0000","last_change":"2024-04-25T09:10:08.732024+0000","last_active":"2024-04-25T09:10:09.715335+0000","last_peered":"2024-04-25T09:10:09.715335+0000","last_clean":"2024-04-25T09:10:09.715335+0000","last_became_active":"2024-04-25T09:10:08.731767+0000","last_became_peered":"2024-04-25T09:10:08.731767+0000","last_unstale":"2024-04-25T09:10:09.715335+0000","last_undegraded":"2024-04-25T09:10:09.715335+0000","last_fullsized":"2024-04-25T09:10:09.715335+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:41.245580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.721581+0000","last_change":"2024-04-25T09:10:08.711867+0000","last_active":"2024-04-25T09:10:08.721581+0000","last_peered":"2024-04-25T09:10:08.721581+0000","last_clean":"2024-04-25T09:10:08.721581+0000","last_became_active":"2024-04-25T09:10:08.710447+0000","last_became_peered":"2024-04-25T09:10:08.710447+0000","last_unstale":"2024-04-25T09:10:08.721581+0000","last_undegraded":"2024-04-25T09:10:08.721581+0000","last_fullsized":"2024-04-25T09:10:08.721581+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:14.652212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.731022+0000","last_change":"2024-04-25T09:10:08.721764+0000","last_active":"2024-04-25T09:10:08.731022+0000","last_peered":"2024-04-25T09:10:08.731022+0000","last_clean":"2024-04-25T09:10:08.731022+0000","last_became_active":"2024-04-25T09:10:08.721100+0000","last_became_peered":"2024-04-25T09:10:08.721100+0000","last_unstale":"2024-04-25T09:10:08.731022+0000","last_undegraded":"2024-04-25T09:10:08.731022+0000","last_fullsized":"2024-04-25T09:10:08.731022+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:54.673832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.732520+0000","last_change":"2024-04-25T09:10:08.731076+0000","last_active":"2024-04-25T09:10:08.732520+0000","last_peered":"2024-04-25T09:10:08.732520+0000","last_clean":"2024-04-25T09:10:08.732520+0000","last_became_active":"2024-04-25T09:10:08.728185+0000","last_became_peered":"2024-04-25T09:10:08.728185+0000","last_unstale":"2024-04-25T09:10:08.732520+0000","last_undegraded":"2024-04-25T09:10:08.732520+0000","last_fullsized":"2024-04-25T09:10:08.732520+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:26.284268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.731836+0000","last_change":"2024-04-25T09:10:08.729709+0000","last_active":"2024-04-25T09:10:08.731836+0000","last_peered":"2024-04-25T09:10:08.731836+0000","last_clean":"2024-04-25T09:10:08.731836+0000","last_became_active":"2024-04-25T09:10:08.728219+0000","last_became_peered":"2024-04-25T09:10:08.728219+0000","last_unstale":"2024-04-25T09:10:08.731836+0000","last_undegraded":"2024-04-25T09:10:08.731836+0000","last_fullsized":"2024-04-25T09:10:08.731836+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:14.652212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.737703+0000","last_change":"2024-04-25T09:10:08.730769+0000","last_active":"2024-04-25T09:10:08.737703+0000","last_peered":"2024-04-25T09:10:08.737703+0000","last_clean":"2024-04-25T09:10:08.737703+0000","last_became_active":"2024-04-25T09:10:08.730488+0000","last_became_peered":"2024-04-25T09:10:08.730488+0000","last_unstale":"2024-04-25T09:10:08.737703+0000","last_undegraded":"2024-04-25T09:10:08.737703+0000","last_fullsized":"2024-04-25T09:10:08.737703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:31.736851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.732573+0000","last_change":"2024-04-25T09:10:08.730795+0000","last_active":"2024-04-25T09:10:08.732573+0000","last_peered":"2024-04-25T09:10:08.732573+0000","last_clean":"2024-04-25T09:10:08.732573+0000","last_became_active":"2024-04-25T09:10:08.730399+0000","last_became_peered":"2024-04-25T09:10:08.730399+0000","last_unstale":"2024-04-25T09:10:08.732573+0000","last_undegraded":"2024-04-25T09:10:08.732573+0000","last_fullsized":"2024-04-25T09:10:08.732573+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:29.432320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.732429+0000","last_change":"2024-04-25T09:10:08.723517+0000","last_active":"2024-04-25T09:10:08.732429+0000","last_peered":"2024-04-25T09:10:08.732429+0000","last_clean":"2024-04-25T09:10:08.732429+0000","last_became_active":"2024-04-25T09:10:08.723272+0000","last_became_peered":"2024-04-25T09:10:08.723272+0000","last_unstale":"2024-04-25T09:10:08.732429+0000","last_undegraded":"2024-04-25T09:10:08.732429+0000","last_fullsized":"2024-04-25T09:10:08.732429+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:38.123934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718419+0000","last_change":"2024-04-25T09:10:08.727157+0000","last_active":"2024-04-25T09:10:09.718419+0000","last_peered":"2024-04-25T09:10:09.718419+0000","last_clean":"2024-04-25T09:10:09.718419+0000","last_became_active":"2024-04-25T09:10:08.726049+0000","last_became_peered":"2024-04-25T09:10:08.726049+0000","last_unstale":"2024-04-25T09:10:09.718419+0000","last_undegraded":"2024-04-25T09:10:09.718419+0000","last_fullsized":"2024-04-25T09:10:09.718419+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:17.890880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719878+0000","last_change":"2024-04-25T09:10:08.714812+0000","last_active":"2024-04-25T09:10:09.719878+0000","last_peered":"2024-04-25T09:10:09.719878+0000","last_clean":"2024-04-25T09:10:09.719878+0000","last_became_active":"2024-04-25T09:10:08.714517+0000","last_became_peered":"2024-04-25T09:10:08.714517+0000","last_unstale":"2024-04-25T09:10:09.719878+0000","last_undegraded":"2024-04-25T09:10:09.719878+0000","last_fullsized":"2024-04-25T09:10:09.719878+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:14.652212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.720518+0000","last_change":"2024-04-25T09:10:08.708995+0000","last_active":"2024-04-25T09:10:08.720518+0000","last_peered":"2024-04-25T09:10:08.720518+0000","last_clean":"2024-04-25T09:10:08.720518+0000","last_became_active":"2024-04-25T09:10:08.708697+0000","last_became_peered":"2024-04-25T09:10:08.708697+0000","last_unstale":"2024-04-25T09:10:08.720518+0000","last_undegraded":"2024-04-25T09:10:08.720518+0000","last_fullsized":"2024-04-25T09:10:08.720518+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.299790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.733336+0000","last_change":"2024-04-25T09:10:08.730560+0000","last_active":"2024-04-25T09:10:08.733336+0000","last_peered":"2024-04-25T09:10:08.733336+0000","last_clean":"2024-04-25T09:10:08.733336+0000","last_became_active":"2024-04-25T09:10:08.730254+0000","last_became_peered":"2024-04-25T09:10:08.730254+0000","last_unstale":"2024-04-25T09:10:08.733336+0000","last_undegraded":"2024-04-25T09:10:08.733336+0000","last_fullsized":"2024-04-25T09:10:08.733336+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:44.676281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.729954+0000","last_change":"2024-04-25T09:10:08.726267+0000","last_active":"2024-04-25T09:10:08.729954+0000","last_peered":"2024-04-25T09:10:08.729954+0000","last_clean":"2024-04-25T09:10:08.729954+0000","last_became_active":"2024-04-25T09:10:08.725407+0000","last_became_peered":"2024-04-25T09:10:08.725407+0000","last_unstale":"2024-04-25T09:10:08.729954+0000","last_undegraded":"2024-04-25T09:10:08.729954+0000","last_fullsized":"2024-04-25T09:10:08.729954+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:08.720962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.736208+0000","last_change":"2024-04-25T09:10:08.734957+0000","last_active":"2024-04-25T09:10:08.736208+0000","last_peered":"2024-04-25T09:10:08.736208+0000","last_clean":"2024-04-25T09:10:08.736208+0000","last_became_active":"2024-04-25T09:10:08.734599+0000","last_became_peered":"2024-04-25T09:10:08.734599+0000","last_unstale":"2024-04-25T09:10:08.736208+0000","last_undegraded":"2024-04-25T09:10:08.736208+0000","last_fullsized":"2024-04-25T09:10:08.736208+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:00.931580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715630+0000","last_change":"2024-04-25T09:10:08.734855+0000","last_active":"2024-04-25T09:10:09.715630+0000","last_peered":"2024-04-25T09:10:09.715630+0000","last_clean":"2024-04-25T09:10:09.715630+0000","last_became_active":"2024-04-25T09:10:08.734571+0000","last_became_peered":"2024-04-25T09:10:08.734571+0000","last_unstale":"2024-04-25T09:10:09.715630+0000","last_undegraded":"2024-04-25T09:10:09.715630+0000","last_fullsized":"2024-04-25T09:10:09.715630+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:48.509164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.729055+0000","last_change":"2024-04-25T09:10:08.727669+0000","last_active":"2024-04-25T09:10:08.729055+0000","last_peered":"2024-04-25T09:10:08.729055+0000","last_clean":"2024-04-25T09:10:08.729055+0000","last_became_active":"2024-04-25T09:10:08.727361+0000","last_became_peered":"2024-04-25T09:10:08.727361+0000","last_unstale":"2024-04-25T09:10:08.729055+0000","last_undegraded":"2024-04-25T09:10:08.729055+0000","last_fullsized":"2024-04-25T09:10:08.729055+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.299790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715468+0000","last_change":"2024-04-25T09:10:08.731864+0000","last_active":"2024-04-25T09:10:09.715468+0000","last_peered":"2024-04-25T09:10:09.715468+0000","last_clean":"2024-04-25T09:10:09.715468+0000","last_became_active":"2024-04-25T09:10:08.731627+0000","last_became_peered":"2024-04-25T09:10:08.731627+0000","last_unstale":"2024-04-25T09:10:09.715468+0000","last_undegraded":"2024-04-25T09:10:09.715468+0000","last_fullsized":"2024-04-25T09:10:09.715468+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:57.267504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719930+0000","last_change":"2024-04-25T09:10:08.720103+0000","last_active":"2024-04-25T09:10:09.719930+0000","last_peered":"2024-04-25T09:10:09.719930+0000","last_clean":"2024-04-25T09:10:09.719930+0000","last_became_active":"2024-04-25T09:10:08.719696+0000","last_became_peered":"2024-04-25T09:10:08.719696+0000","last_unstale":"2024-04-25T09:10:09.719930+0000","last_undegraded":"2024-04-25T09:10:09.719930+0000","last_fullsized":"2024-04-25T09:10:09.719930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:29.432320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.737508+0000","last_change":"2024-04-25T09:10:08.729512+0000","last_active":"2024-04-25T09:10:08.737508+0000","last_peered":"2024-04-25T09:10:08.737508+0000","last_clean":"2024-04-25T09:10:08.737508+0000","last_became_active":"2024-04-25T09:10:08.729212+0000","last_became_peered":"2024-04-25T09:10:08.729212+0000","last_unstale":"2024-04-25T09:10:08.737508+0000","last_undegraded":"2024-04-25T09:10:08.737508+0000","last_fullsized":"2024-04-25T09:10:08.737508+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:12.719534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.728263+0000","last_change":"2024-04-25T09:10:08.720358+0000","last_active":"2024-04-25T09:10:08.728263+0000","last_peered":"2024-04-25T09:10:08.728263+0000","last_clean":"2024-04-25T09:10:08.728263+0000","last_became_active":"2024-04-25T09:10:08.719925+0000","last_became_peered":"2024-04-25T09:10:08.719925+0000","last_unstale":"2024-04-25T09:10:08.728263+0000","last_undegraded":"2024-04-25T09:10:08.728263+0000","last_fullsized":"2024-04-25T09:10:08.728263+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:23.382152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.714941+0000","last_change":"2024-04-25T09:10:08.733954+0000","last_active":"2024-04-25T09:10:09.714941+0000","last_peered":"2024-04-25T09:10:09.714941+0000","last_clean":"2024-04-25T09:10:09.714941+0000","last_became_active":"2024-04-25T09:10:08.733586+0000","last_became_peered":"2024-04-25T09:10:08.733586+0000","last_unstale":"2024-04-25T09:10:09.714941+0000","last_undegraded":"2024-04-25T09:10:09.714941+0000","last_fullsized":"2024-04-25T09:10:09.714941+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:50:02.991847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.742016+0000","last_change":"2024-04-25T09:10:08.735869+0000","last_active":"2024-04-25T09:10:08.742016+0000","last_peered":"2024-04-25T09:10:08.742016+0000","last_clean":"2024-04-25T09:10:08.742016+0000","last_became_active":"2024-04-25T09:10:08.735612+0000","last_became_peered":"2024-04-25T09:10:08.735612+0000","last_unstale":"2024-04-25T09:10:08.742016+0000","last_undegraded":"2024-04-25T09:10:08.742016+0000","last_fullsized":"2024-04-25T09:10:08.742016+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:05.458369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.720066+0000","last_change":"2024-04-25T09:10:08.709454+0000","last_active":"2024-04-25T09:10:09.720066+0000","last_peered":"2024-04-25T09:10:09.720066+0000","last_clean":"2024-04-25T09:10:09.720066+0000","last_became_active":"2024-04-25T09:10:08.709165+0000","last_became_peered":"2024-04-25T09:10:08.709165+0000","last_unstale":"2024-04-25T09:10:09.720066+0000","last_undegraded":"2024-04-25T09:10:09.720066+0000","last_fullsized":"2024-04-25T09:10:09.720066+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:26.284268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.720109+0000","last_change":"2024-04-25T09:10:08.724135+0000","last_active":"2024-04-25T09:10:09.720109+0000","last_peered":"2024-04-25T09:10:09.720109+0000","last_clean":"2024-04-25T09:10:09.720109+0000","last_became_active":"2024-04-25T09:10:08.723871+0000","last_became_peered":"2024-04-25T09:10:08.723871+0000","last_unstale":"2024-04-25T09:10:09.720109+0000","last_undegraded":"2024-04-25T09:10:09.720109+0000","last_fullsized":"2024-04-25T09:10:09.720109+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:39.153268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718531+0000","last_change":"2024-04-25T09:10:08.721740+0000","last_active":"2024-04-25T09:10:09.718531+0000","last_peered":"2024-04-25T09:10:09.718531+0000","last_clean":"2024-04-25T09:10:09.718531+0000","last_became_active":"2024-04-25T09:10:08.720997+0000","last_became_peered":"2024-04-25T09:10:08.720997+0000","last_unstale":"2024-04-25T09:10:09.718531+0000","last_undegraded":"2024-04-25T09:10:09.718531+0000","last_fullsized":"2024-04-25T09:10:09.718531+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:53.039804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.727455+0000","last_change":"2024-04-25T09:10:08.724335+0000","last_active":"2024-04-25T09:10:08.727455+0000","last_peered":"2024-04-25T09:10:08.727455+0000","last_clean":"2024-04-25T09:10:08.727455+0000","last_became_active":"2024-04-25T09:10:08.723848+0000","last_became_peered":"2024-04-25T09:10:08.723848+0000","last_unstale":"2024-04-25T09:10:08.727455+0000","last_undegraded":"2024-04-25T09:10:08.727455+0000","last_fullsized":"2024-04-25T09:10:08.727455+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:11.044280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.736691+0000","last_change":"2024-04-25T09:10:08.726144+0000","last_active":"2024-04-25T09:10:08.736691+0000","last_peered":"2024-04-25T09:10:08.736691+0000","last_clean":"2024-04-25T09:10:08.736691+0000","last_became_active":"2024-04-25T09:10:08.724350+0000","last_became_peered":"2024-04-25T09:10:08.724350+0000","last_unstale":"2024-04-25T09:10:08.736691+0000","last_undegraded":"2024-04-25T09:10:08.736691+0000","last_fullsized":"2024-04-25T09:10:08.736691+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:56.367739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719317+0000","last_change":"2024-04-25T09:10:08.713765+0000","last_active":"2024-04-25T09:10:09.719317+0000","last_peered":"2024-04-25T09:10:09.719317+0000","last_clean":"2024-04-25T09:10:09.719317+0000","last_became_active":"2024-04-25T09:10:08.713243+0000","last_became_peered":"2024-04-25T09:10:08.713243+0000","last_unstale":"2024-04-25T09:10:09.719317+0000","last_undegraded":"2024-04-25T09:10:09.719317+0000","last_fullsized":"2024-04-25T09:10:09.719317+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.299790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.737782+0000","last_change":"2024-04-25T09:10:08.736907+0000","last_active":"2024-04-25T09:10:08.737782+0000","last_peered":"2024-04-25T09:10:08.737782+0000","last_clean":"2024-04-25T09:10:08.737782+0000","last_became_active":"2024-04-25T09:10:08.736281+0000","last_became_peered":"2024-04-25T09:10:08.736281+0000","last_unstale":"2024-04-25T09:10:08.737782+0000","last_undegraded":"2024-04-25T09:10:08.737782+0000","last_fullsized":"2024-04-25T09:10:08.737782+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:11.961665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.737681+0000","last_change":"2024-04-25T09:10:08.727900+0000","last_active":"2024-04-25T09:10:08.737681+0000","last_peered":"2024-04-25T09:10:08.737681+0000","last_clean":"2024-04-25T09:10:08.737681+0000","last_became_active":"2024-04-25T09:10:08.727500+0000","last_became_peered":"2024-04-25T09:10:08.727500+0000","last_unstale":"2024-04-25T09:10:08.737681+0000","last_undegraded":"2024-04-25T09:10:08.737681+0000","last_fullsized":"2024-04-25T09:10:08.737681+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:12.307392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715207+0000","last_change":"2024-04-25T09:10:08.727657+0000","last_active":"2024-04-25T09:10:09.715207+0000","last_peered":"2024-04-25T09:10:09.715207+0000","last_clean":"2024-04-25T09:10:09.715207+0000","last_became_active":"2024-04-25T09:10:08.725974+0000","last_became_peered":"2024-04-25T09:10:08.725974+0000","last_unstale":"2024-04-25T09:10:09.715207+0000","last_undegraded":"2024-04-25T09:10:09.715207+0000","last_fullsized":"2024-04-25T09:10:09.715207+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.401852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"106'4","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.736319+0000","last_change":"2024-04-25T09:10:07.717346+0000","last_active":"2024-04-25T09:10:08.736319+0000","last_peered":"2024-04-25T09:10:08.736319+0000","last_clean":"2024-04-25T09:10:08.736319+0000","last_became_active":"2024-04-25T09:10:07.714777+0000","last_became_peered":"2024-04-25T09:10:07.714777+0000","last_unstale":"2024-04-25T09:10:08.736319+0000","last_undegraded":"2024-04-25T09:10:08.736319+0000","last_fullsized":"2024-04-25T09:10:08.736319+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:04.451212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.737955+0000","last_change":"2024-04-25T09:10:08.727457+0000","last_active":"2024-04-25T09:10:08.737955+0000","last_peered":"2024-04-25T09:10:08.737955+0000","last_clean":"2024-04-25T09:10:08.737955+0000","last_became_active":"2024-04-25T09:10:08.727114+0000","last_became_peered":"2024-04-25T09:10:08.727114+0000","last_unstale":"2024-04-25T09:10:08.737955+0000","last_undegraded":"2024-04-25T09:10:08.737955+0000","last_fullsized":"2024-04-25T09:10:08.737955+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:52.725255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.731895+0000","last_change":"2024-04-25T09:10:07.721074+0000","last_active":"2024-04-25T09:10:08.731895+0000","last_peered":"2024-04-25T09:10:08.731895+0000","last_clean":"2024-04-25T09:10:08.731895+0000","last_became_active":"2024-04-25T09:10:07.720757+0000","last_became_peered":"2024-04-25T09:10:07.720757+0000","last_unstale":"2024-04-25T09:10:08.731895+0000","last_undegraded":"2024-04-25T09:10:08.731895+0000","last_fullsized":"2024-04-25T09:10:08.731895+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:47.245569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719308+0000","last_change":"2024-04-25T09:10:08.716104+0000","last_active":"2024-04-25T09:10:09.719308+0000","last_peered":"2024-04-25T09:10:09.719308+0000","last_clean":"2024-04-25T09:10:09.719308+0000","last_became_active":"2024-04-25T09:10:08.715779+0000","last_became_peered":"2024-04-25T09:10:08.715779+0000","last_unstale":"2024-04-25T09:10:09.719308+0000","last_undegraded":"2024-04-25T09:10:09.719308+0000","last_fullsized":"2024-04-25T09:10:09.719308+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:05.458369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719944+0000","last_change":"2024-04-25T09:10:07.711695+0000","last_active":"2024-04-25T09:10:09.719944+0000","last_peered":"2024-04-25T09:10:09.719944+0000","last_clean":"2024-04-25T09:10:09.719944+0000","last_became_active":"2024-04-25T09:10:07.711395+0000","last_became_peered":"2024-04-25T09:10:07.711395+0000","last_unstale":"2024-04-25T09:10:09.719944+0000","last_undegraded":"2024-04-25T09:10:09.719944+0000","last_fullsized":"2024-04-25T09:10:09.719944+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:32.933967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718497+0000","last_change":"2024-04-25T09:10:08.711490+0000","last_active":"2024-04-25T09:10:09.718497+0000","last_peered":"2024-04-25T09:10:09.718497+0000","last_clean":"2024-04-25T09:10:09.718497+0000","last_became_active":"2024-04-25T09:10:08.711179+0000","last_became_peered":"2024-04-25T09:10:08.711179+0000","last_unstale":"2024-04-25T09:10:09.718497+0000","last_undegraded":"2024-04-25T09:10:09.718497+0000","last_fullsized":"2024-04-25T09:10:09.718497+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:41.864845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.736879+0000","last_change":"2024-04-25T09:10:07.712662+0000","last_active":"2024-04-25T09:10:08.736879+0000","last_peered":"2024-04-25T09:10:08.736879+0000","last_clean":"2024-04-25T09:10:08.736879+0000","last_became_active":"2024-04-25T09:10:07.712361+0000","last_became_peered":"2024-04-25T09:10:07.712361+0000","last_unstale":"2024-04-25T09:10:08.736879+0000","last_undegraded":"2024-04-25T09:10:08.736879+0000","last_fullsized":"2024-04-25T09:10:08.736879+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:53.359144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.728767+0000","last_change":"2024-04-25T09:10:08.722120+0000","last_active":"2024-04-25T09:10:08.728767+0000","last_peered":"2024-04-25T09:10:08.728767+0000","last_clean":"2024-04-25T09:10:08.728767+0000","last_became_active":"2024-04-25T09:10:08.721869+0000","last_became_peered":"2024-04-25T09:10:08.721869+0000","last_unstale":"2024-04-25T09:10:08.728767+0000","last_undegraded":"2024-04-25T09:10:08.728767+0000","last_fullsized":"2024-04-25T09:10:08.728767+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:26.284268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.727382+0000","last_change":"2024-04-25T09:10:07.722094+0000","last_active":"2024-04-25T09:10:08.727382+0000","last_peered":"2024-04-25T09:10:08.727382+0000","last_clean":"2024-04-25T09:10:08.727382+0000","last_became_active":"2024-04-25T09:10:07.721355+0000","last_became_peered":"2024-04-25T09:10:07.721355+0000","last_unstale":"2024-04-25T09:10:08.727382+0000","last_undegraded":"2024-04-25T09:10:08.727382+0000","last_fullsized":"2024-04-25T09:10:08.727382+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:52.032647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715737+0000","last_change":"2024-04-25T09:10:08.731438+0000","last_active":"2024-04-25T09:10:09.715737+0000","last_peered":"2024-04-25T09:10:09.715737+0000","last_clean":"2024-04-25T09:10:09.715737+0000","last_became_active":"2024-04-25T09:10:08.730639+0000","last_became_peered":"2024-04-25T09:10:08.730639+0000","last_unstale":"2024-04-25T09:10:09.715737+0000","last_undegraded":"2024-04-25T09:10:09.715737+0000","last_fullsized":"2024-04-25T09:10:09.715737+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:47.239156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718119+0000","last_change":"2024-04-25T09:10:07.713340+0000","last_active":"2024-04-25T09:10:09.718119+0000","last_peered":"2024-04-25T09:10:09.718119+0000","last_clean":"2024-04-25T09:10:09.718119+0000","last_became_active":"2024-04-25T09:10:07.713057+0000","last_became_peered":"2024-04-25T09:10:07.713057+0000","last_unstale":"2024-04-25T09:10:09.718119+0000","last_undegraded":"2024-04-25T09:10:09.718119+0000","last_fullsized":"2024-04-25T09:10:09.718119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:22.438644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.723244+0000","last_change":"2024-04-25T09:10:08.720716+0000","last_active":"2024-04-25T09:10:08.723244+0000","last_peered":"2024-04-25T09:10:08.723244+0000","last_clean":"2024-04-25T09:10:08.723244+0000","last_became_active":"2024-04-25T09:10:08.720370+0000","last_became_peered":"2024-04-25T09:10:08.720370+0000","last_unstale":"2024-04-25T09:10:08.723244+0000","last_undegraded":"2024-04-25T09:10:08.723244+0000","last_fullsized":"2024-04-25T09:10:08.723244+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:23.445801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719331+0000","last_change":"2024-04-25T09:10:07.711841+0000","last_active":"2024-04-25T09:10:09.719331+0000","last_peered":"2024-04-25T09:10:09.719331+0000","last_clean":"2024-04-25T09:10:09.719331+0000","last_became_active":"2024-04-25T09:10:07.711562+0000","last_became_peered":"2024-04-25T09:10:07.711562+0000","last_unstale":"2024-04-25T09:10:09.719331+0000","last_undegraded":"2024-04-25T09:10:09.719331+0000","last_fullsized":"2024-04-25T09:10:09.719331+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:56.713711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.742094+0000","last_change":"2024-04-25T09:10:08.735758+0000","last_active":"2024-04-25T09:10:08.742094+0000","last_peered":"2024-04-25T09:10:08.742094+0000","last_clean":"2024-04-25T09:10:08.742094+0000","last_became_active":"2024-04-25T09:10:08.735519+0000","last_became_peered":"2024-04-25T09:10:08.735519+0000","last_unstale":"2024-04-25T09:10:08.742094+0000","last_undegraded":"2024-04-25T09:10:08.742094+0000","last_fullsized":"2024-04-25T09:10:08.742094+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:11.961665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.700890+0000","last_change":"2024-04-25T09:10:07.717585+0000","last_active":"2024-04-25T09:10:08.700890+0000","last_peered":"2024-04-25T09:10:08.700890+0000","last_clean":"2024-04-25T09:10:08.700890+0000","last_became_active":"2024-04-25T09:10:07.717195+0000","last_became_peered":"2024-04-25T09:10:07.717195+0000","last_unstale":"2024-04-25T09:10:08.700890+0000","last_undegraded":"2024-04-25T09:10:08.700890+0000","last_fullsized":"2024-04-25T09:10:08.700890+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:37.116777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.714992+0000","last_change":"2024-04-25T09:10:08.728328+0000","last_active":"2024-04-25T09:10:09.714992+0000","last_peered":"2024-04-25T09:10:09.714992+0000","last_clean":"2024-04-25T09:10:09.714992+0000","last_became_active":"2024-04-25T09:10:08.727402+0000","last_became_peered":"2024-04-25T09:10:08.727402+0000","last_unstale":"2024-04-25T09:10:09.714992+0000","last_undegraded":"2024-04-25T09:10:09.714992+0000","last_fullsized":"2024-04-25T09:10:09.714992+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:04.414034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.720028+0000","last_change":"2024-04-25T09:10:07.718778+0000","last_active":"2024-04-25T09:10:09.720028+0000","last_peered":"2024-04-25T09:10:09.720028+0000","last_clean":"2024-04-25T09:10:09.720028+0000","last_became_active":"2024-04-25T09:10:07.718514+0000","last_became_peered":"2024-04-25T09:10:07.718514+0000","last_unstale":"2024-04-25T09:10:09.720028+0000","last_undegraded":"2024-04-25T09:10:09.720028+0000","last_fullsized":"2024-04-25T09:10:09.720028+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:03.938312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.741871+0000","last_change":"2024-04-25T09:10:08.735051+0000","last_active":"2024-04-25T09:10:08.741871+0000","last_peered":"2024-04-25T09:10:08.741871+0000","last_clean":"2024-04-25T09:10:08.741871+0000","last_became_active":"2024-04-25T09:10:08.734580+0000","last_became_peered":"2024-04-25T09:10:08.734580+0000","last_unstale":"2024-04-25T09:10:08.741871+0000","last_undegraded":"2024-04-25T09:10:08.741871+0000","last_fullsized":"2024-04-25T09:10:08.741871+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:11.044280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715229+0000","last_change":"2024-04-25T09:10:07.713222+0000","last_active":"2024-04-25T09:10:09.715229+0000","last_peered":"2024-04-25T09:10:09.715229+0000","last_clean":"2024-04-25T09:10:09.715229+0000","last_became_active":"2024-04-25T09:10:07.712897+0000","last_became_peered":"2024-04-25T09:10:07.712897+0000","last_unstale":"2024-04-25T09:10:09.715229+0000","last_undegraded":"2024-04-25T09:10:09.715229+0000","last_fullsized":"2024-04-25T09:10:09.715229+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:10.661404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.739988+0000","last_change":"2024-04-25T09:10:08.730487+0000","last_active":"2024-04-25T09:10:08.739988+0000","last_peered":"2024-04-25T09:10:08.739988+0000","last_clean":"2024-04-25T09:10:08.739988+0000","last_became_active":"2024-04-25T09:10:08.730206+0000","last_became_peered":"2024-04-25T09:10:08.730206+0000","last_unstale":"2024-04-25T09:10:08.739988+0000","last_undegraded":"2024-04-25T09:10:08.739988+0000","last_fullsized":"2024-04-25T09:10:08.739988+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:41.088334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"106'3","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.742294+0000","last_change":"2024-04-25T09:10:07.722457+0000","last_active":"2024-04-25T09:10:08.742294+0000","last_peered":"2024-04-25T09:10:08.742294+0000","last_clean":"2024-04-25T09:10:08.742294+0000","last_became_active":"2024-04-25T09:10:07.721865+0000","last_became_peered":"2024-04-25T09:10:07.721865+0000","last_unstale":"2024-04-25T09:10:08.742294+0000","last_undegraded":"2024-04-25T09:10:08.742294+0000","last_fullsized":"2024-04-25T09:10:08.742294+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:27.051176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.742083+0000","last_change":"2024-04-25T09:10:08.737460+0000","last_active":"2024-04-25T09:10:08.742083+0000","last_peered":"2024-04-25T09:10:08.742083+0000","last_clean":"2024-04-25T09:10:08.742083+0000","last_became_active":"2024-04-25T09:10:08.734968+0000","last_became_peered":"2024-04-25T09:10:08.734968+0000","last_unstale":"2024-04-25T09:10:08.742083+0000","last_undegraded":"2024-04-25T09:10:08.742083+0000","last_fullsized":"2024-04-25T09:10:08.742083+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.299790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"106'6","reported_seq":18,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.744594+0000","last_change":"2024-04-25T09:10:07.720773+0000","last_active":"2024-04-25T09:10:08.744594+0000","last_peered":"2024-04-25T09:10:08.744594+0000","last_clean":"2024-04-25T09:10:08.744594+0000","last_became_active":"2024-04-25T09:10:07.719659+0000","last_became_peered":"2024-04-25T09:10:07.719659+0000","last_unstale":"2024-04-25T09:10:08.744594+0000","last_undegraded":"2024-04-25T09:10:08.744594+0000","last_fullsized":"2024-04-25T09:10:08.744594+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:22.374995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718668+0000","last_change":"2024-04-25T09:10:08.733801+0000","last_active":"2024-04-25T09:10:09.718668+0000","last_peered":"2024-04-25T09:10:09.718668+0000","last_clean":"2024-04-25T09:10:09.718668+0000","last_became_active":"2024-04-25T09:10:08.733480+0000","last_became_peered":"2024-04-25T09:10:08.733480+0000","last_unstale":"2024-04-25T09:10:09.718668+0000","last_undegraded":"2024-04-25T09:10:09.718668+0000","last_fullsized":"2024-04-25T09:10:09.718668+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:28.058333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.740763+0000","last_change":"2024-04-25T09:10:07.723233+0000","last_active":"2024-04-25T09:10:08.740763+0000","last_peered":"2024-04-25T09:10:08.740763+0000","last_clean":"2024-04-25T09:10:08.740763+0000","last_became_active":"2024-04-25T09:10:07.722946+0000","last_became_peered":"2024-04-25T09:10:07.722946+0000","last_unstale":"2024-04-25T09:10:08.740763+0000","last_undegraded":"2024-04-25T09:10:08.740763+0000","last_fullsized":"2024-04-25T09:10:08.740763+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:48.975124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.727514+0000","last_change":"2024-04-25T09:10:08.724632+0000","last_active":"2024-04-25T09:10:08.727514+0000","last_peered":"2024-04-25T09:10:08.727514+0000","last_clean":"2024-04-25T09:10:08.727514+0000","last_became_active":"2024-04-25T09:10:08.722357+0000","last_became_peered":"2024-04-25T09:10:08.722357+0000","last_unstale":"2024-04-25T09:10:08.727514+0000","last_undegraded":"2024-04-25T09:10:08.727514+0000","last_fullsized":"2024-04-25T09:10:08.727514+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:05.458369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.700956+0000","last_change":"2024-04-25T09:10:07.722102+0000","last_active":"2024-04-25T09:10:08.700956+0000","last_peered":"2024-04-25T09:10:08.700956+0000","last_clean":"2024-04-25T09:10:08.700956+0000","last_became_active":"2024-04-25T09:10:07.721810+0000","last_became_peered":"2024-04-25T09:10:07.721810+0000","last_unstale":"2024-04-25T09:10:08.700956+0000","last_undegraded":"2024-04-25T09:10:08.700956+0000","last_fullsized":"2024-04-25T09:10:08.700956+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:10.037123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.734784+0000","last_change":"2024-04-25T09:10:08.724857+0000","last_active":"2024-04-25T09:10:08.734784+0000","last_peered":"2024-04-25T09:10:08.734784+0000","last_clean":"2024-04-25T09:10:08.734784+0000","last_became_active":"2024-04-25T09:10:08.724481+0000","last_became_peered":"2024-04-25T09:10:08.724481+0000","last_unstale":"2024-04-25T09:10:08.734784+0000","last_undegraded":"2024-04-25T09:10:08.734784+0000","last_fullsized":"2024-04-25T09:10:08.734784+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:43.908719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.718643+0000","last_change":"2024-04-25T09:10:07.724167+0000","last_active":"2024-04-25T09:10:08.718643+0000","last_peered":"2024-04-25T09:10:08.718643+0000","last_clean":"2024-04-25T09:10:08.718643+0000","last_became_active":"2024-04-25T09:10:07.723664+0000","last_became_peered":"2024-04-25T09:10:07.723664+0000","last_unstale":"2024-04-25T09:10:08.718643+0000","last_undegraded":"2024-04-25T09:10:08.718643+0000","last_fullsized":"2024-04-25T09:10:08.718643+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:03.844587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715680+0000","last_change":"2024-04-25T09:10:08.733081+0000","last_active":"2024-04-25T09:10:09.715680+0000","last_peered":"2024-04-25T09:10:09.715680+0000","last_clean":"2024-04-25T09:10:09.715680+0000","last_became_active":"2024-04-25T09:10:08.732797+0000","last_became_peered":"2024-04-25T09:10:08.732797+0000","last_unstale":"2024-04-25T09:10:09.715680+0000","last_undegraded":"2024-04-25T09:10:09.715680+0000","last_fullsized":"2024-04-25T09:10:09.715680+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:52.821963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"106'8","reported_seq":22,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719221+0000","last_change":"2024-04-25T09:10:07.712396+0000","last_active":"2024-04-25T09:10:09.719221+0000","last_peered":"2024-04-25T09:10:09.719221+0000","last_clean":"2024-04-25T09:10:09.719221+0000","last_became_active":"2024-04-25T09:10:07.710954+0000","last_became_peered":"2024-04-25T09:10:07.710954+0000","last_unstale":"2024-04-25T09:10:09.719221+0000","last_undegraded":"2024-04-25T09:10:09.719221+0000","last_fullsized":"2024-04-25T09:10:09.719221+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:04.679827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.741109+0000","last_change":"2024-04-25T09:10:08.733823+0000","last_active":"2024-04-25T09:10:08.741109+0000","last_peered":"2024-04-25T09:10:08.741109+0000","last_clean":"2024-04-25T09:10:08.741109+0000","last_became_active":"2024-04-25T09:10:08.733319+0000","last_became_peered":"2024-04-25T09:10:08.733319+0000","last_unstale":"2024-04-25T09:10:08.741109+0000","last_undegraded":"2024-04-25T09:10:08.741109+0000","last_fullsized":"2024-04-25T09:10:08.741109+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:49.701031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.730637+0000","last_change":"2024-04-25T09:10:07.720582+0000","last_active":"2024-04-25T09:10:08.730637+0000","last_peered":"2024-04-25T09:10:08.730637+0000","last_clean":"2024-04-25T09:10:08.730637+0000","last_became_active":"2024-04-25T09:10:07.720310+0000","last_became_peered":"2024-04-25T09:10:07.720310+0000","last_unstale":"2024-04-25T09:10:08.730637+0000","last_undegraded":"2024-04-25T09:10:08.730637+0000","last_fullsized":"2024-04-25T09:10:08.730637+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:53.666675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.737284+0000","last_change":"2024-04-25T09:10:08.734443+0000","last_active":"2024-04-25T09:10:08.737284+0000","last_peered":"2024-04-25T09:10:08.737284+0000","last_clean":"2024-04-25T09:10:08.737284+0000","last_became_active":"2024-04-25T09:10:08.734183+0000","last_became_peered":"2024-04-25T09:10:08.734183+0000","last_unstale":"2024-04-25T09:10:08.737284+0000","last_undegraded":"2024-04-25T09:10:08.737284+0000","last_fullsized":"2024-04-25T09:10:08.737284+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:39.153268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.735292+0000","last_change":"2024-04-25T09:10:07.722689+0000","last_active":"2024-04-25T09:10:08.735292+0000","last_peered":"2024-04-25T09:10:08.735292+0000","last_clean":"2024-04-25T09:10:08.735292+0000","last_became_active":"2024-04-25T09:10:07.722166+0000","last_became_peered":"2024-04-25T09:10:07.722166+0000","last_unstale":"2024-04-25T09:10:08.735292+0000","last_undegraded":"2024-04-25T09:10:08.735292+0000","last_fullsized":"2024-04-25T09:10:08.735292+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:07.439928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.731046+0000","last_change":"2024-04-25T09:10:08.721990+0000","last_active":"2024-04-25T09:10:08.731046+0000","last_peered":"2024-04-25T09:10:08.731046+0000","last_clean":"2024-04-25T09:10:08.731046+0000","last_became_active":"2024-04-25T09:10:08.721468+0000","last_became_peered":"2024-04-25T09:10:08.721468+0000","last_unstale":"2024-04-25T09:10:08.731046+0000","last_undegraded":"2024-04-25T09:10:08.731046+0000","last_fullsized":"2024-04-25T09:10:08.731046+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:23.445801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718643+0000","last_change":"2024-04-25T09:10:07.716311+0000","last_active":"2024-04-25T09:10:09.718643+0000","last_peered":"2024-04-25T09:10:09.718643+0000","last_clean":"2024-04-25T09:10:09.718643+0000","last_became_active":"2024-04-25T09:10:07.716033+0000","last_became_peered":"2024-04-25T09:10:07.716033+0000","last_unstale":"2024-04-25T09:10:09.718643+0000","last_undegraded":"2024-04-25T09:10:09.718643+0000","last_fullsized":"2024-04-25T09:10:09.718643+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:37.116777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715197+0000","last_change":"2024-04-25T09:10:08.731202+0000","last_active":"2024-04-25T09:10:09.715197+0000","last_peered":"2024-04-25T09:10:09.715197+0000","last_clean":"2024-04-25T09:10:09.715197+0000","last_became_active":"2024-04-25T09:10:08.730903+0000","last_became_peered":"2024-04-25T09:10:08.730903+0000","last_unstale":"2024-04-25T09:10:09.715197+0000","last_undegraded":"2024-04-25T09:10:09.715197+0000","last_fullsized":"2024-04-25T09:10:09.715197+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:04.024366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.740754+0000","last_change":"2024-04-25T09:10:07.721491+0000","last_active":"2024-04-25T09:10:08.740754+0000","last_peered":"2024-04-25T09:10:08.740754+0000","last_clean":"2024-04-25T09:10:08.740754+0000","last_became_active":"2024-04-25T09:10:07.721055+0000","last_became_peered":"2024-04-25T09:10:07.721055+0000","last_unstale":"2024-04-25T09:10:08.740754+0000","last_undegraded":"2024-04-25T09:10:08.740754+0000","last_fullsized":"2024-04-25T09:10:08.740754+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:12.469209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715609+0000","last_change":"2024-04-25T09:10:08.731395+0000","last_active":"2024-04-25T09:10:09.715609+0000","last_peered":"2024-04-25T09:10:09.715609+0000","last_clean":"2024-04-25T09:10:09.715609+0000","last_became_active":"2024-04-25T09:10:08.730256+0000","last_became_peered":"2024-04-25T09:10:08.730256+0000","last_unstale":"2024-04-25T09:10:09.715609+0000","last_undegraded":"2024-04-25T09:10:09.715609+0000","last_fullsized":"2024-04-25T09:10:09.715609+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:01.116038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.716379+0000","last_change":"2024-04-25T09:10:07.726461+0000","last_active":"2024-04-25T09:10:08.716379+0000","last_peered":"2024-04-25T09:10:08.716379+0000","last_clean":"2024-04-25T09:10:08.716379+0000","last_became_active":"2024-04-25T09:10:07.726197+0000","last_became_peered":"2024-04-25T09:10:07.726197+0000","last_unstale":"2024-04-25T09:10:08.716379+0000","last_undegraded":"2024-04-25T09:10:08.716379+0000","last_fullsized":"2024-04-25T09:10:08.716379+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:47.994383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.735462+0000","last_change":"2024-04-25T09:10:08.727069+0000","last_active":"2024-04-25T09:10:08.735462+0000","last_peered":"2024-04-25T09:10:08.735462+0000","last_clean":"2024-04-25T09:10:08.735462+0000","last_became_active":"2024-04-25T09:10:08.726738+0000","last_became_peered":"2024-04-25T09:10:08.726738+0000","last_unstale":"2024-04-25T09:10:08.735462+0000","last_undegraded":"2024-04-25T09:10:08.735462+0000","last_fullsized":"2024-04-25T09:10:08.735462+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:39.153268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.712689+0000","last_change":"2024-04-25T09:10:07.724442+0000","last_active":"2024-04-25T09:10:08.712689+0000","last_peered":"2024-04-25T09:10:08.712689+0000","last_clean":"2024-04-25T09:10:08.712689+0000","last_became_active":"2024-04-25T09:10:07.724149+0000","last_became_peered":"2024-04-25T09:10:07.724149+0000","last_unstale":"2024-04-25T09:10:08.712689+0000","last_undegraded":"2024-04-25T09:10:08.712689+0000","last_fullsized":"2024-04-25T09:10:08.712689+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:48.975124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.738977+0000","last_change":"2024-04-25T09:10:08.730525+0000","last_active":"2024-04-25T09:10:08.738977+0000","last_peered":"2024-04-25T09:10:08.738977+0000","last_clean":"2024-04-25T09:10:08.738977+0000","last_became_active":"2024-04-25T09:10:08.730258+0000","last_became_peered":"2024-04-25T09:10:08.730258+0000","last_unstale":"2024-04-25T09:10:08.738977+0000","last_undegraded":"2024-04-25T09:10:08.738977+0000","last_fullsized":"2024-04-25T09:10:08.738977+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:23.802222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.716788+0000","last_change":"2024-04-25T09:10:07.720730+0000","last_active":"2024-04-25T09:10:08.716788+0000","last_peered":"2024-04-25T09:10:08.716788+0000","last_clean":"2024-04-25T09:10:08.716788+0000","last_became_active":"2024-04-25T09:10:07.720398+0000","last_became_peered":"2024-04-25T09:10:07.720398+0000","last_unstale":"2024-04-25T09:10:08.716788+0000","last_undegraded":"2024-04-25T09:10:08.716788+0000","last_fullsized":"2024-04-25T09:10:08.716788+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:29.955939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.714998+0000","last_change":"2024-04-25T09:10:08.730523+0000","last_active":"2024-04-25T09:10:09.714998+0000","last_peered":"2024-04-25T09:10:09.714998+0000","last_clean":"2024-04-25T09:10:09.714998+0000","last_became_active":"2024-04-25T09:10:08.730226+0000","last_became_peered":"2024-04-25T09:10:08.730226+0000","last_unstale":"2024-04-25T09:10:09.714998+0000","last_undegraded":"2024-04-25T09:10:09.714998+0000","last_fullsized":"2024-04-25T09:10:09.714998+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:11.407527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.741155+0000","last_change":"2024-04-25T09:10:07.722544+0000","last_active":"2024-04-25T09:10:08.741155+0000","last_peered":"2024-04-25T09:10:08.741155+0000","last_clean":"2024-04-25T09:10:08.741155+0000","last_became_active":"2024-04-25T09:10:07.722236+0000","last_became_peered":"2024-04-25T09:10:07.722236+0000","last_unstale":"2024-04-25T09:10:08.741155+0000","last_undegraded":"2024-04-25T09:10:08.741155+0000","last_fullsized":"2024-04-25T09:10:08.741155+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:58.390235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719296+0000","last_change":"2024-04-25T09:10:08.709802+0000","last_active":"2024-04-25T09:10:09.719296+0000","last_peered":"2024-04-25T09:10:09.719296+0000","last_clean":"2024-04-25T09:10:09.719296+0000","last_became_active":"2024-04-25T09:10:08.709532+0000","last_became_peered":"2024-04-25T09:10:08.709532+0000","last_unstale":"2024-04-25T09:10:09.719296+0000","last_undegraded":"2024-04-25T09:10:09.719296+0000","last_fullsized":"2024-04-25T09:10:09.719296+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:11.044280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715309+0000","last_change":"2024-04-25T09:10:07.709929+0000","last_active":"2024-04-25T09:10:09.715309+0000","last_peered":"2024-04-25T09:10:09.715309+0000","last_clean":"2024-04-25T09:10:09.715309+0000","last_became_active":"2024-04-25T09:10:07.709599+0000","last_became_peered":"2024-04-25T09:10:07.709599+0000","last_unstale":"2024-04-25T09:10:09.715309+0000","last_undegraded":"2024-04-25T09:10:09.715309+0000","last_fullsized":"2024-04-25T09:10:09.715309+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:39.007402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.720931+0000","last_change":"2024-04-25T09:10:08.712712+0000","last_active":"2024-04-25T09:10:08.720931+0000","last_peered":"2024-04-25T09:10:08.720931+0000","last_clean":"2024-04-25T09:10:08.720931+0000","last_became_active":"2024-04-25T09:10:08.712449+0000","last_became_peered":"2024-04-25T09:10:08.712449+0000","last_unstale":"2024-04-25T09:10:08.720931+0000","last_undegraded":"2024-04-25T09:10:08.720931+0000","last_fullsized":"2024-04-25T09:10:08.720931+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:29.432320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.713334+0000","last_change":"2024-04-25T09:10:07.722075+0000","last_active":"2024-04-25T09:10:08.713334+0000","last_peered":"2024-04-25T09:10:08.713334+0000","last_clean":"2024-04-25T09:10:08.713334+0000","last_became_active":"2024-04-25T09:10:07.721766+0000","last_became_peered":"2024-04-25T09:10:07.721766+0000","last_unstale":"2024-04-25T09:10:08.713334+0000","last_undegraded":"2024-04-25T09:10:08.713334+0000","last_fullsized":"2024-04-25T09:10:08.713334+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:58.390235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718333+0000","last_change":"2024-04-25T09:10:08.716552+0000","last_active":"2024-04-25T09:10:09.718333+0000","last_peered":"2024-04-25T09:10:09.718333+0000","last_clean":"2024-04-25T09:10:09.718333+0000","last_became_active":"2024-04-25T09:10:08.715747+0000","last_became_peered":"2024-04-25T09:10:08.715747+0000","last_unstale":"2024-04-25T09:10:09.718333+0000","last_undegraded":"2024-04-25T09:10:09.718333+0000","last_fullsized":"2024-04-25T09:10:09.718333+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:18.671723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.707805+0000","last_change":"2024-04-25T09:10:07.718918+0000","last_active":"2024-04-25T09:10:08.707805+0000","last_peered":"2024-04-25T09:10:08.707805+0000","last_clean":"2024-04-25T09:10:08.707805+0000","last_became_active":"2024-04-25T09:10:07.715622+0000","last_became_peered":"2024-04-25T09:10:07.715622+0000","last_unstale":"2024-04-25T09:10:08.707805+0000","last_undegraded":"2024-04-25T09:10:08.707805+0000","last_fullsized":"2024-04-25T09:10:08.707805+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:37.552896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.739269+0000","last_change":"2024-04-25T09:10:08.731227+0000","last_active":"2024-04-25T09:10:08.739269+0000","last_peered":"2024-04-25T09:10:08.739269+0000","last_clean":"2024-04-25T09:10:08.739269+0000","last_became_active":"2024-04-25T09:10:08.730157+0000","last_became_peered":"2024-04-25T09:10:08.730157+0000","last_unstale":"2024-04-25T09:10:08.739269+0000","last_undegraded":"2024-04-25T09:10:08.739269+0000","last_fullsized":"2024-04-25T09:10:08.739269+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:22.430224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719565+0000","last_change":"2024-04-25T09:10:07.717958+0000","last_active":"2024-04-25T09:10:09.719565+0000","last_peered":"2024-04-25T09:10:09.719565+0000","last_clean":"2024-04-25T09:10:09.719565+0000","last_became_active":"2024-04-25T09:10:07.717672+0000","last_became_peered":"2024-04-25T09:10:07.717672+0000","last_unstale":"2024-04-25T09:10:09.719565+0000","last_undegraded":"2024-04-25T09:10:09.719565+0000","last_fullsized":"2024-04-25T09:10:09.719565+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:06.775010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.738886+0000","last_change":"2024-04-25T09:10:08.728079+0000","last_active":"2024-04-25T09:10:08.738886+0000","last_peered":"2024-04-25T09:10:08.738886+0000","last_clean":"2024-04-25T09:10:08.738886+0000","last_became_active":"2024-04-25T09:10:08.727814+0000","last_became_peered":"2024-04-25T09:10:08.727814+0000","last_unstale":"2024-04-25T09:10:08.738886+0000","last_undegraded":"2024-04-25T09:10:08.738886+0000","last_fullsized":"2024-04-25T09:10:08.738886+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:24.058870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.716546+0000","last_change":"2024-04-25T09:10:07.724010+0000","last_active":"2024-04-25T09:10:08.716546+0000","last_peered":"2024-04-25T09:10:08.716546+0000","last_clean":"2024-04-25T09:10:08.716546+0000","last_became_active":"2024-04-25T09:10:07.723745+0000","last_became_peered":"2024-04-25T09:10:07.723745+0000","last_unstale":"2024-04-25T09:10:08.716546+0000","last_undegraded":"2024-04-25T09:10:08.716546+0000","last_fullsized":"2024-04-25T09:10:08.716546+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:52.354256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.733315+0000","last_change":"2024-04-25T09:10:08.731386+0000","last_active":"2024-04-25T09:10:08.733315+0000","last_peered":"2024-04-25T09:10:08.733315+0000","last_clean":"2024-04-25T09:10:08.733315+0000","last_became_active":"2024-04-25T09:10:08.731132+0000","last_became_peered":"2024-04-25T09:10:08.731132+0000","last_unstale":"2024-04-25T09:10:08.733315+0000","last_undegraded":"2024-04-25T09:10:08.733315+0000","last_fullsized":"2024-04-25T09:10:08.733315+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:37.526495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.713044+0000","last_change":"2024-04-25T09:10:07.717210+0000","last_active":"2024-04-25T09:10:08.713044+0000","last_peered":"2024-04-25T09:10:08.713044+0000","last_clean":"2024-04-25T09:10:08.713044+0000","last_became_active":"2024-04-25T09:10:07.716918+0000","last_became_peered":"2024-04-25T09:10:07.716918+0000","last_unstale":"2024-04-25T09:10:08.713044+0000","last_undegraded":"2024-04-25T09:10:08.713044+0000","last_fullsized":"2024-04-25T09:10:08.713044+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:37.552896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718586+0000","last_change":"2024-04-25T09:10:08.719489+0000","last_active":"2024-04-25T09:10:09.718586+0000","last_peered":"2024-04-25T09:10:09.718586+0000","last_clean":"2024-04-25T09:10:09.718586+0000","last_became_active":"2024-04-25T09:10:08.718706+0000","last_became_peered":"2024-04-25T09:10:08.718706+0000","last_unstale":"2024-04-25T09:10:09.718586+0000","last_undegraded":"2024-04-25T09:10:09.718586+0000","last_fullsized":"2024-04-25T09:10:09.718586+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:08.447085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.716933+0000","last_change":"2024-04-25T09:10:07.722837+0000","last_active":"2024-04-25T09:10:08.716933+0000","last_peered":"2024-04-25T09:10:08.716933+0000","last_clean":"2024-04-25T09:10:08.716933+0000","last_became_active":"2024-04-25T09:10:07.722504+0000","last_became_peered":"2024-04-25T09:10:07.722504+0000","last_unstale":"2024-04-25T09:10:08.716933+0000","last_undegraded":"2024-04-25T09:10:08.716933+0000","last_fullsized":"2024-04-25T09:10:08.716933+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:43.210725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718130+0000","last_change":"2024-04-25T09:10:08.736858+0000","last_active":"2024-04-25T09:10:09.718130+0000","last_peered":"2024-04-25T09:10:09.718130+0000","last_clean":"2024-04-25T09:10:09.718130+0000","last_became_active":"2024-04-25T09:10:08.736446+0000","last_became_peered":"2024-04-25T09:10:08.736446+0000","last_unstale":"2024-04-25T09:10:09.718130+0000","last_undegraded":"2024-04-25T09:10:09.718130+0000","last_fullsized":"2024-04-25T09:10:09.718130+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:11.961665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.736937+0000","last_change":"2024-04-25T09:10:07.721340+0000","last_active":"2024-04-25T09:10:08.736937+0000","last_peered":"2024-04-25T09:10:08.736937+0000","last_clean":"2024-04-25T09:10:08.736937+0000","last_became_active":"2024-04-25T09:10:07.721027+0000","last_became_peered":"2024-04-25T09:10:07.721027+0000","last_unstale":"2024-04-25T09:10:08.736937+0000","last_undegraded":"2024-04-25T09:10:08.736937+0000","last_fullsized":"2024-04-25T09:10:08.736937+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:30.545835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":331,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.713672+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:10:08.713672+0000","last_peered":"2024-04-25T09:10:08.713672+0000","last_clean":"2024-04-25T09:10:08.713672+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:10:08.713672+0000","last_undegraded":"2024-04-25T09:10:08.713672+0000","last_fullsized":"2024-04-25T09:10:08.713672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33060,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":1916928,"data_stored":1202145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574957,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1335296,"data_stored":613833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1314816,"data_stored":611617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1323008,"data_stored":611709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574958,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":612199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":611651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":611651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574957,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33060,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":1925120,"data_stored":1203687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:10:12.815 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:10:12.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.003+0000 7f8e4de00640 1 Processor -- start 2024-04-25T09:10:12.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.003+0000 7f8e4de00640 1 -- start start 2024-04-25T09:10:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e4de00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b2dc0 0x7f8e4806ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e4de00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8e480b3950 0x7f8e4806b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e4de00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e4815def0 con 0x7f8e4815b2f0 2024-04-25T09:10:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e4de00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e4815e1b0 con 0x7f8e480b3950 2024-04-25T09:10:12.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e4de00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4815e490 con 0x7f8e480b2dc0 2024-04-25T09:10:12.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e3fe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b2dc0 0x7f8e4806ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e47400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8e480b3950 0x7f8e4806b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:12.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e3fe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b2dc0 0x7f8e4806ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:50278/0 (socket says 172.21.15.59:50278) 2024-04-25T09:10:12.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e3fe00640 1 -- 172.21.15.59:0/2504100210 learned_addr learned my addr 172.21.15.59:0/2504100210 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:12.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e46a00640 1 --1- 172.21.15.59:0/2504100210 >> v1:172.21.15.178:6789/0 conn(0x7f8e4815b2f0 0x7f8e480b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:35454/0 (socket says 172.21.15.59:35454) 2024-04-25T09:10:12.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e47400640 1 -- 172.21.15.59:0/2504100210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b2dc0 msgr2=0x7f8e4806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:12.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e47400640 1 --2- 172.21.15.59:0/2504100210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b2dc0 0x7f8e4806ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:12.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e47400640 1 -- 172.21.15.59:0/2504100210 >> v1:172.21.15.178:6789/0 conn(0x7f8e4815b2f0 legacy=0x7f8e480b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:12.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e47400640 1 -- 172.21.15.59:0/2504100210 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4815e770 con 0x7f8e480b3950 2024-04-25T09:10:12.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e46000640 1 -- 172.21.15.59:0/2504100210 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095982287 0 0) 0x7f8e4815def0 con 0x7f8e4815b2f0 2024-04-25T09:10:12.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.007+0000 7f8e3fe00640 1 --2- 172.21.15.59:0/2504100210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b2dc0 0x7f8e4806ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:12.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e47400640 1 --2- 172.21.15.59:0/2504100210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e480b3950 0x7f8e4806b150 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009dc0 tx=0x7f8e4001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=467538a359df16fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:12.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e46000640 1 -- 172.21.15.59:0/2504100210 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e400b2070 con 0x7f8e480b3950 2024-04-25T09:10:12.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e46000640 1 -- 172.21.15.59:0/2504100210 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e400a5a00 con 0x7f8e480b3950 2024-04-25T09:10:12.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e46000640 1 -- 172.21.15.59:0/2504100210 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4815b8e0 con 0x7f8e480b3950 2024-04-25T09:10:13.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e4de00640 1 -- 172.21.15.59:0/2504100210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e480b3950 msgr2=0x7f8e4806b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e4de00640 1 --2- 172.21.15.59:0/2504100210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e480b3950 0x7f8e4806b150 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8e40009dc0 tx=0x7f8e4001c920 comp rx=0 tx=0).stop 2024-04-25T09:10:13.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e4de00640 1 -- 172.21.15.59:0/2504100210 shutdown_connections 2024-04-25T09:10:13.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e4de00640 1 --2- 172.21.15.59:0/2504100210 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e480b3950 0x7f8e4806b150 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e4de00640 1 --2- 172.21.15.59:0/2504100210 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b2dc0 0x7f8e4806ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e4de00640 1 -- 172.21.15.59:0/2504100210 >> 172.21.15.59:0/2504100210 conn(0x7f8e480b23b0 msgr2=0x7f8e480cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:13.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e4de00640 1 -- 172.21.15.59:0/2504100210 shutdown_connections 2024-04-25T09:10:13.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e4de00640 1 -- 172.21.15.59:0/2504100210 wait complete. 2024-04-25T09:10:13.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e4de00640 1 Processor -- start 2024-04-25T09:10:13.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.011+0000 7f8e4de00640 1 -- start start 2024-04-25T09:10:13.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e4de00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e480b2dc0 0x7f8e4815a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e4de00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b3950 0x7f8e480ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e4de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4815b2f0 0x7f8e480cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e4de00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4816a880 con 0x7f8e4815b2f0 2024-04-25T09:10:13.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e4de00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e481616f0 con 0x7f8e480b2dc0 2024-04-25T09:10:13.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e4de00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4816aa00 con 0x7f8e480b3950 2024-04-25T09:10:13.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e47400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4815b2f0 0x7f8e480cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e47400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4815b2f0 0x7f8e480cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60290/0 (socket says 172.21.15.59:60290) 2024-04-25T09:10:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e47400640 1 -- 172.21.15.59:0/3166442577 learned_addr learned my addr 172.21.15.59:0/3166442577 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e3fe00640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b3950 0x7f8e480ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e46a00640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e480b2dc0 0x7f8e4815a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e47400640 1 -- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b3950 msgr2=0x7f8e480ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e47400640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b3950 0x7f8e480ce2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e47400640 1 -- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e480b2dc0 msgr2=0x7f8e4815a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e47400640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e480b2dc0 0x7f8e4815a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e47400640 1 -- 172.21.15.59:0/3166442577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48159000 con 0x7f8e4815b2f0 2024-04-25T09:10:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e3fe00640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b3950 0x7f8e480ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:13.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e47400640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4815b2f0 0x7f8e480cbf50 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f8e4001a550 tx=0x7f8e400196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e3f400640 1 -- 172.21.15.59:0/3166442577 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e400b2050 con 0x7f8e4815b2f0 2024-04-25T09:10:13.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e3f400640 1 -- 172.21.15.59:0/3166442577 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e400be070 con 0x7f8e4815b2f0 2024-04-25T09:10:13.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e3f400640 1 -- 172.21.15.59:0/3166442577 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e400adb10 con 0x7f8e4815b2f0 2024-04-25T09:10:13.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e4de00640 1 -- 172.21.15.59:0/3166442577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e48159270 con 0x7f8e4815b2f0 2024-04-25T09:10:13.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e4de00640 1 -- 172.21.15.59:0/3166442577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e48157580 con 0x7f8e4815b2f0 2024-04-25T09:10:13.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e4de00640 1 -- 172.21.15.59:0/3166442577 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e480745d0 con 0x7f8e4815b2f0 2024-04-25T09:10:13.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.015+0000 7f8e3f400640 1 -- 172.21.15.59:0/3166442577 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8e400adcb0 con 0x7f8e4815b2f0 2024-04-25T09:10:13.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.019+0000 7f8e3f400640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e24066f60 0x7f8e24069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.019+0000 7f8e3f400640 1 -- 172.21.15.59:0/3166442577 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8e40120630 con 0x7f8e4815b2f0 2024-04-25T09:10:13.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.019+0000 7f8e46a00640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e24066f60 0x7f8e24069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.019+0000 7f8e46a00640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e24066f60 0x7f8e24069420 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8e38000f70 tx=0x7f8e38007c10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.023+0000 7f8e3f400640 1 -- 172.21.15.59:0/3166442577 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8e40016540 con 0x7f8e4815b2f0 2024-04-25T09:10:13.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.183+0000 7f8e4de00640 1 -- 172.21.15.59:0/3166442577 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e480cf190 con 0x7f8e24066f60 2024-04-25T09:10:13.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.187+0000 7f8e3f400640 1 -- 172.21.15.59:0/3166442577 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252468 (secure 0 0 0) 0x7f8e480cf190 con 0x7f8e24066f60 2024-04-25T09:10:13.180 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:13.182 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:10:13.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.191+0000 7f8e4de00640 1 -- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e24066f60 msgr2=0x7f8e24069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.191+0000 7f8e4de00640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e24066f60 0x7f8e24069420 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f8e38000f70 tx=0x7f8e38007c10 comp rx=0 tx=0).stop 2024-04-25T09:10:13.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.191+0000 7f8e4de00640 1 -- 172.21.15.59:0/3166442577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4815b2f0 msgr2=0x7f8e480cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.191+0000 7f8e4de00640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4815b2f0 0x7f8e480cbf50 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f8e4001a550 tx=0x7f8e400196c0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.191+0000 7f8e4de00640 1 -- 172.21.15.59:0/3166442577 shutdown_connections 2024-04-25T09:10:13.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.191+0000 7f8e4de00640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e24066f60 0x7f8e24069420 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.191+0000 7f8e4de00640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e4815b2f0 0x7f8e480cbf50 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.191+0000 7f8e4de00640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e480b3950 0x7f8e480ce2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.191+0000 7f8e4de00640 1 --2- 172.21.15.59:0/3166442577 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e480b2dc0 0x7f8e4815a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.191+0000 7f8e4de00640 1 -- 172.21.15.59:0/3166442577 >> 172.21.15.59:0/3166442577 conn(0x7f8e480b23b0 msgr2=0x7f8e480ace50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:13.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.191+0000 7f8e4de00640 1 -- 172.21.15.59:0/3166442577 shutdown_connections 2024-04-25T09:10:13.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.191+0000 7f8e4de00640 1 -- 172.21.15.59:0/3166442577 wait complete. 2024-04-25T09:10:13.201 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":371,"stamp":"2024-04-25T09:10:11.782286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":142,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260944,"kb_used_data":11496,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754713776,"statfs":{"total":773094113280,"available":772826906624,"internally_reserved":0,"allocated":11771904,"data_stored":6078492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001212"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715541+0000","last_change":"2024-04-25T09:10:08.733118+0000","last_active":"2024-04-25T09:10:09.715541+0000","last_peered":"2024-04-25T09:10:09.715541+0000","last_clean":"2024-04-25T09:10:09.715541+0000","last_became_active":"2024-04-25T09:10:08.732834+0000","last_became_peered":"2024-04-25T09:10:08.732834+0000","last_unstale":"2024-04-25T09:10:09.715541+0000","last_undegraded":"2024-04-25T09:10:09.715541+0000","last_fullsized":"2024-04-25T09:10:09.715541+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:18.483394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.726133+0000","last_change":"2024-04-25T09:10:08.723091+0000","last_active":"2024-04-25T09:10:08.726133+0000","last_peered":"2024-04-25T09:10:08.726133+0000","last_clean":"2024-04-25T09:10:08.726133+0000","last_became_active":"2024-04-25T09:10:08.722824+0000","last_became_peered":"2024-04-25T09:10:08.722824+0000","last_unstale":"2024-04-25T09:10:08.726133+0000","last_undegraded":"2024-04-25T09:10:08.726133+0000","last_fullsized":"2024-04-25T09:10:08.726133+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:38.123934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715335+0000","last_change":"2024-04-25T09:10:08.732024+0000","last_active":"2024-04-25T09:10:09.715335+0000","last_peered":"2024-04-25T09:10:09.715335+0000","last_clean":"2024-04-25T09:10:09.715335+0000","last_became_active":"2024-04-25T09:10:08.731767+0000","last_became_peered":"2024-04-25T09:10:08.731767+0000","last_unstale":"2024-04-25T09:10:09.715335+0000","last_undegraded":"2024-04-25T09:10:09.715335+0000","last_fullsized":"2024-04-25T09:10:09.715335+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:42:41.245580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.721581+0000","last_change":"2024-04-25T09:10:08.711867+0000","last_active":"2024-04-25T09:10:08.721581+0000","last_peered":"2024-04-25T09:10:08.721581+0000","last_clean":"2024-04-25T09:10:08.721581+0000","last_became_active":"2024-04-25T09:10:08.710447+0000","last_became_peered":"2024-04-25T09:10:08.710447+0000","last_unstale":"2024-04-25T09:10:08.721581+0000","last_undegraded":"2024-04-25T09:10:08.721581+0000","last_fullsized":"2024-04-25T09:10:08.721581+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:14.652212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.731022+0000","last_change":"2024-04-25T09:10:08.721764+0000","last_active":"2024-04-25T09:10:08.731022+0000","last_peered":"2024-04-25T09:10:08.731022+0000","last_clean":"2024-04-25T09:10:08.731022+0000","last_became_active":"2024-04-25T09:10:08.721100+0000","last_became_peered":"2024-04-25T09:10:08.721100+0000","last_unstale":"2024-04-25T09:10:08.731022+0000","last_undegraded":"2024-04-25T09:10:08.731022+0000","last_fullsized":"2024-04-25T09:10:08.731022+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:54.673832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.732520+0000","last_change":"2024-04-25T09:10:08.731076+0000","last_active":"2024-04-25T09:10:08.732520+0000","last_peered":"2024-04-25T09:10:08.732520+0000","last_clean":"2024-04-25T09:10:08.732520+0000","last_became_active":"2024-04-25T09:10:08.728185+0000","last_became_peered":"2024-04-25T09:10:08.728185+0000","last_unstale":"2024-04-25T09:10:08.732520+0000","last_undegraded":"2024-04-25T09:10:08.732520+0000","last_fullsized":"2024-04-25T09:10:08.732520+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:26.284268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.731836+0000","last_change":"2024-04-25T09:10:08.729709+0000","last_active":"2024-04-25T09:10:08.731836+0000","last_peered":"2024-04-25T09:10:08.731836+0000","last_clean":"2024-04-25T09:10:08.731836+0000","last_became_active":"2024-04-25T09:10:08.728219+0000","last_became_peered":"2024-04-25T09:10:08.728219+0000","last_unstale":"2024-04-25T09:10:08.731836+0000","last_undegraded":"2024-04-25T09:10:08.731836+0000","last_fullsized":"2024-04-25T09:10:08.731836+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:14.652212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.737703+0000","last_change":"2024-04-25T09:10:08.730769+0000","last_active":"2024-04-25T09:10:08.737703+0000","last_peered":"2024-04-25T09:10:08.737703+0000","last_clean":"2024-04-25T09:10:08.737703+0000","last_became_active":"2024-04-25T09:10:08.730488+0000","last_became_peered":"2024-04-25T09:10:08.730488+0000","last_unstale":"2024-04-25T09:10:08.737703+0000","last_undegraded":"2024-04-25T09:10:08.737703+0000","last_fullsized":"2024-04-25T09:10:08.737703+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:31.736851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.732573+0000","last_change":"2024-04-25T09:10:08.730795+0000","last_active":"2024-04-25T09:10:08.732573+0000","last_peered":"2024-04-25T09:10:08.732573+0000","last_clean":"2024-04-25T09:10:08.732573+0000","last_became_active":"2024-04-25T09:10:08.730399+0000","last_became_peered":"2024-04-25T09:10:08.730399+0000","last_unstale":"2024-04-25T09:10:08.732573+0000","last_undegraded":"2024-04-25T09:10:08.732573+0000","last_fullsized":"2024-04-25T09:10:08.732573+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:29.432320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.732429+0000","last_change":"2024-04-25T09:10:08.723517+0000","last_active":"2024-04-25T09:10:08.732429+0000","last_peered":"2024-04-25T09:10:08.732429+0000","last_clean":"2024-04-25T09:10:08.732429+0000","last_became_active":"2024-04-25T09:10:08.723272+0000","last_became_peered":"2024-04-25T09:10:08.723272+0000","last_unstale":"2024-04-25T09:10:08.732429+0000","last_undegraded":"2024-04-25T09:10:08.732429+0000","last_fullsized":"2024-04-25T09:10:08.732429+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:38.123934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718419+0000","last_change":"2024-04-25T09:10:08.727157+0000","last_active":"2024-04-25T09:10:09.718419+0000","last_peered":"2024-04-25T09:10:09.718419+0000","last_clean":"2024-04-25T09:10:09.718419+0000","last_became_active":"2024-04-25T09:10:08.726049+0000","last_became_peered":"2024-04-25T09:10:08.726049+0000","last_unstale":"2024-04-25T09:10:09.718419+0000","last_undegraded":"2024-04-25T09:10:09.718419+0000","last_fullsized":"2024-04-25T09:10:09.718419+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:27:17.890880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719878+0000","last_change":"2024-04-25T09:10:08.714812+0000","last_active":"2024-04-25T09:10:09.719878+0000","last_peered":"2024-04-25T09:10:09.719878+0000","last_clean":"2024-04-25T09:10:09.719878+0000","last_became_active":"2024-04-25T09:10:08.714517+0000","last_became_peered":"2024-04-25T09:10:08.714517+0000","last_unstale":"2024-04-25T09:10:09.719878+0000","last_undegraded":"2024-04-25T09:10:09.719878+0000","last_fullsized":"2024-04-25T09:10:09.719878+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:14.652212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.720518+0000","last_change":"2024-04-25T09:10:08.708995+0000","last_active":"2024-04-25T09:10:08.720518+0000","last_peered":"2024-04-25T09:10:08.720518+0000","last_clean":"2024-04-25T09:10:08.720518+0000","last_became_active":"2024-04-25T09:10:08.708697+0000","last_became_peered":"2024-04-25T09:10:08.708697+0000","last_unstale":"2024-04-25T09:10:08.720518+0000","last_undegraded":"2024-04-25T09:10:08.720518+0000","last_fullsized":"2024-04-25T09:10:08.720518+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.299790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.733336+0000","last_change":"2024-04-25T09:10:08.730560+0000","last_active":"2024-04-25T09:10:08.733336+0000","last_peered":"2024-04-25T09:10:08.733336+0000","last_clean":"2024-04-25T09:10:08.733336+0000","last_became_active":"2024-04-25T09:10:08.730254+0000","last_became_peered":"2024-04-25T09:10:08.730254+0000","last_unstale":"2024-04-25T09:10:08.733336+0000","last_undegraded":"2024-04-25T09:10:08.733336+0000","last_fullsized":"2024-04-25T09:10:08.733336+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:20:44.676281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.729954+0000","last_change":"2024-04-25T09:10:08.726267+0000","last_active":"2024-04-25T09:10:08.729954+0000","last_peered":"2024-04-25T09:10:08.729954+0000","last_clean":"2024-04-25T09:10:08.729954+0000","last_became_active":"2024-04-25T09:10:08.725407+0000","last_became_peered":"2024-04-25T09:10:08.725407+0000","last_unstale":"2024-04-25T09:10:08.729954+0000","last_undegraded":"2024-04-25T09:10:08.729954+0000","last_fullsized":"2024-04-25T09:10:08.729954+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:10:08.720962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.736208+0000","last_change":"2024-04-25T09:10:08.734957+0000","last_active":"2024-04-25T09:10:08.736208+0000","last_peered":"2024-04-25T09:10:08.736208+0000","last_clean":"2024-04-25T09:10:08.736208+0000","last_became_active":"2024-04-25T09:10:08.734599+0000","last_became_peered":"2024-04-25T09:10:08.734599+0000","last_unstale":"2024-04-25T09:10:08.736208+0000","last_undegraded":"2024-04-25T09:10:08.736208+0000","last_fullsized":"2024-04-25T09:10:08.736208+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:30:00.931580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715630+0000","last_change":"2024-04-25T09:10:08.734855+0000","last_active":"2024-04-25T09:10:09.715630+0000","last_peered":"2024-04-25T09:10:09.715630+0000","last_clean":"2024-04-25T09:10:09.715630+0000","last_became_active":"2024-04-25T09:10:08.734571+0000","last_became_peered":"2024-04-25T09:10:08.734571+0000","last_unstale":"2024-04-25T09:10:09.715630+0000","last_undegraded":"2024-04-25T09:10:09.715630+0000","last_fullsized":"2024-04-25T09:10:09.715630+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:48:48.509164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.729055+0000","last_change":"2024-04-25T09:10:08.727669+0000","last_active":"2024-04-25T09:10:08.729055+0000","last_peered":"2024-04-25T09:10:08.729055+0000","last_clean":"2024-04-25T09:10:08.729055+0000","last_became_active":"2024-04-25T09:10:08.727361+0000","last_became_peered":"2024-04-25T09:10:08.727361+0000","last_unstale":"2024-04-25T09:10:08.729055+0000","last_undegraded":"2024-04-25T09:10:08.729055+0000","last_fullsized":"2024-04-25T09:10:08.729055+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.299790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715468+0000","last_change":"2024-04-25T09:10:08.731864+0000","last_active":"2024-04-25T09:10:09.715468+0000","last_peered":"2024-04-25T09:10:09.715468+0000","last_clean":"2024-04-25T09:10:09.715468+0000","last_became_active":"2024-04-25T09:10:08.731627+0000","last_became_peered":"2024-04-25T09:10:08.731627+0000","last_unstale":"2024-04-25T09:10:09.715468+0000","last_undegraded":"2024-04-25T09:10:09.715468+0000","last_fullsized":"2024-04-25T09:10:09.715468+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:09:57.267504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719930+0000","last_change":"2024-04-25T09:10:08.720103+0000","last_active":"2024-04-25T09:10:09.719930+0000","last_peered":"2024-04-25T09:10:09.719930+0000","last_clean":"2024-04-25T09:10:09.719930+0000","last_became_active":"2024-04-25T09:10:08.719696+0000","last_became_peered":"2024-04-25T09:10:08.719696+0000","last_unstale":"2024-04-25T09:10:09.719930+0000","last_undegraded":"2024-04-25T09:10:09.719930+0000","last_fullsized":"2024-04-25T09:10:09.719930+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:29.432320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.737508+0000","last_change":"2024-04-25T09:10:08.729512+0000","last_active":"2024-04-25T09:10:08.737508+0000","last_peered":"2024-04-25T09:10:08.737508+0000","last_clean":"2024-04-25T09:10:08.737508+0000","last_became_active":"2024-04-25T09:10:08.729212+0000","last_became_peered":"2024-04-25T09:10:08.729212+0000","last_unstale":"2024-04-25T09:10:08.737508+0000","last_undegraded":"2024-04-25T09:10:08.737508+0000","last_fullsized":"2024-04-25T09:10:08.737508+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:38:12.719534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.728263+0000","last_change":"2024-04-25T09:10:08.720358+0000","last_active":"2024-04-25T09:10:08.728263+0000","last_peered":"2024-04-25T09:10:08.728263+0000","last_clean":"2024-04-25T09:10:08.728263+0000","last_became_active":"2024-04-25T09:10:08.719925+0000","last_became_peered":"2024-04-25T09:10:08.719925+0000","last_unstale":"2024-04-25T09:10:08.728263+0000","last_undegraded":"2024-04-25T09:10:08.728263+0000","last_fullsized":"2024-04-25T09:10:08.728263+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:23.382152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.714941+0000","last_change":"2024-04-25T09:10:08.733954+0000","last_active":"2024-04-25T09:10:09.714941+0000","last_peered":"2024-04-25T09:10:09.714941+0000","last_clean":"2024-04-25T09:10:09.714941+0000","last_became_active":"2024-04-25T09:10:08.733586+0000","last_became_peered":"2024-04-25T09:10:08.733586+0000","last_unstale":"2024-04-25T09:10:09.714941+0000","last_undegraded":"2024-04-25T09:10:09.714941+0000","last_fullsized":"2024-04-25T09:10:09.714941+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:50:02.991847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.742016+0000","last_change":"2024-04-25T09:10:08.735869+0000","last_active":"2024-04-25T09:10:08.742016+0000","last_peered":"2024-04-25T09:10:08.742016+0000","last_clean":"2024-04-25T09:10:08.742016+0000","last_became_active":"2024-04-25T09:10:08.735612+0000","last_became_peered":"2024-04-25T09:10:08.735612+0000","last_unstale":"2024-04-25T09:10:08.742016+0000","last_undegraded":"2024-04-25T09:10:08.742016+0000","last_fullsized":"2024-04-25T09:10:08.742016+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:05.458369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.720066+0000","last_change":"2024-04-25T09:10:08.709454+0000","last_active":"2024-04-25T09:10:09.720066+0000","last_peered":"2024-04-25T09:10:09.720066+0000","last_clean":"2024-04-25T09:10:09.720066+0000","last_became_active":"2024-04-25T09:10:08.709165+0000","last_became_peered":"2024-04-25T09:10:08.709165+0000","last_unstale":"2024-04-25T09:10:09.720066+0000","last_undegraded":"2024-04-25T09:10:09.720066+0000","last_fullsized":"2024-04-25T09:10:09.720066+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:26.284268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.720109+0000","last_change":"2024-04-25T09:10:08.724135+0000","last_active":"2024-04-25T09:10:09.720109+0000","last_peered":"2024-04-25T09:10:09.720109+0000","last_clean":"2024-04-25T09:10:09.720109+0000","last_became_active":"2024-04-25T09:10:08.723871+0000","last_became_peered":"2024-04-25T09:10:08.723871+0000","last_unstale":"2024-04-25T09:10:09.720109+0000","last_undegraded":"2024-04-25T09:10:09.720109+0000","last_fullsized":"2024-04-25T09:10:09.720109+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:39.153268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718531+0000","last_change":"2024-04-25T09:10:08.721740+0000","last_active":"2024-04-25T09:10:09.718531+0000","last_peered":"2024-04-25T09:10:09.718531+0000","last_clean":"2024-04-25T09:10:09.718531+0000","last_became_active":"2024-04-25T09:10:08.720997+0000","last_became_peered":"2024-04-25T09:10:08.720997+0000","last_unstale":"2024-04-25T09:10:09.718531+0000","last_undegraded":"2024-04-25T09:10:09.718531+0000","last_fullsized":"2024-04-25T09:10:09.718531+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:53.039804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.727455+0000","last_change":"2024-04-25T09:10:08.724335+0000","last_active":"2024-04-25T09:10:08.727455+0000","last_peered":"2024-04-25T09:10:08.727455+0000","last_clean":"2024-04-25T09:10:08.727455+0000","last_became_active":"2024-04-25T09:10:08.723848+0000","last_became_peered":"2024-04-25T09:10:08.723848+0000","last_unstale":"2024-04-25T09:10:08.727455+0000","last_undegraded":"2024-04-25T09:10:08.727455+0000","last_fullsized":"2024-04-25T09:10:08.727455+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:11.044280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.736691+0000","last_change":"2024-04-25T09:10:08.726144+0000","last_active":"2024-04-25T09:10:08.736691+0000","last_peered":"2024-04-25T09:10:08.736691+0000","last_clean":"2024-04-25T09:10:08.736691+0000","last_became_active":"2024-04-25T09:10:08.724350+0000","last_became_peered":"2024-04-25T09:10:08.724350+0000","last_unstale":"2024-04-25T09:10:08.736691+0000","last_undegraded":"2024-04-25T09:10:08.736691+0000","last_fullsized":"2024-04-25T09:10:08.736691+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:33:56.367739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719317+0000","last_change":"2024-04-25T09:10:08.713765+0000","last_active":"2024-04-25T09:10:09.719317+0000","last_peered":"2024-04-25T09:10:09.719317+0000","last_clean":"2024-04-25T09:10:09.719317+0000","last_became_active":"2024-04-25T09:10:08.713243+0000","last_became_peered":"2024-04-25T09:10:08.713243+0000","last_unstale":"2024-04-25T09:10:09.719317+0000","last_undegraded":"2024-04-25T09:10:09.719317+0000","last_fullsized":"2024-04-25T09:10:09.719317+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.299790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.737782+0000","last_change":"2024-04-25T09:10:08.736907+0000","last_active":"2024-04-25T09:10:08.737782+0000","last_peered":"2024-04-25T09:10:08.737782+0000","last_clean":"2024-04-25T09:10:08.737782+0000","last_became_active":"2024-04-25T09:10:08.736281+0000","last_became_peered":"2024-04-25T09:10:08.736281+0000","last_unstale":"2024-04-25T09:10:08.737782+0000","last_undegraded":"2024-04-25T09:10:08.737782+0000","last_fullsized":"2024-04-25T09:10:08.737782+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:11.961665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.737681+0000","last_change":"2024-04-25T09:10:08.727900+0000","last_active":"2024-04-25T09:10:08.737681+0000","last_peered":"2024-04-25T09:10:08.737681+0000","last_clean":"2024-04-25T09:10:08.737681+0000","last_became_active":"2024-04-25T09:10:08.727500+0000","last_became_peered":"2024-04-25T09:10:08.727500+0000","last_unstale":"2024-04-25T09:10:08.737681+0000","last_undegraded":"2024-04-25T09:10:08.737681+0000","last_fullsized":"2024-04-25T09:10:08.737681+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:05:12.307392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715207+0000","last_change":"2024-04-25T09:10:08.727657+0000","last_active":"2024-04-25T09:10:09.715207+0000","last_peered":"2024-04-25T09:10:09.715207+0000","last_clean":"2024-04-25T09:10:09.715207+0000","last_became_active":"2024-04-25T09:10:08.725974+0000","last_became_peered":"2024-04-25T09:10:08.725974+0000","last_unstale":"2024-04-25T09:10:09.715207+0000","last_undegraded":"2024-04-25T09:10:09.715207+0000","last_fullsized":"2024-04-25T09:10:09.715207+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.401852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"106'4","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.736319+0000","last_change":"2024-04-25T09:10:07.717346+0000","last_active":"2024-04-25T09:10:08.736319+0000","last_peered":"2024-04-25T09:10:08.736319+0000","last_clean":"2024-04-25T09:10:08.736319+0000","last_became_active":"2024-04-25T09:10:07.714777+0000","last_became_peered":"2024-04-25T09:10:07.714777+0000","last_unstale":"2024-04-25T09:10:08.736319+0000","last_undegraded":"2024-04-25T09:10:08.736319+0000","last_fullsized":"2024-04-25T09:10:08.736319+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:04.451212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.737955+0000","last_change":"2024-04-25T09:10:08.727457+0000","last_active":"2024-04-25T09:10:08.737955+0000","last_peered":"2024-04-25T09:10:08.737955+0000","last_clean":"2024-04-25T09:10:08.737955+0000","last_became_active":"2024-04-25T09:10:08.727114+0000","last_became_peered":"2024-04-25T09:10:08.727114+0000","last_unstale":"2024-04-25T09:10:08.737955+0000","last_undegraded":"2024-04-25T09:10:08.737955+0000","last_fullsized":"2024-04-25T09:10:08.737955+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:52.725255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.731895+0000","last_change":"2024-04-25T09:10:07.721074+0000","last_active":"2024-04-25T09:10:08.731895+0000","last_peered":"2024-04-25T09:10:08.731895+0000","last_clean":"2024-04-25T09:10:08.731895+0000","last_became_active":"2024-04-25T09:10:07.720757+0000","last_became_peered":"2024-04-25T09:10:07.720757+0000","last_unstale":"2024-04-25T09:10:08.731895+0000","last_undegraded":"2024-04-25T09:10:08.731895+0000","last_fullsized":"2024-04-25T09:10:08.731895+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:31:47.245569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719308+0000","last_change":"2024-04-25T09:10:08.716104+0000","last_active":"2024-04-25T09:10:09.719308+0000","last_peered":"2024-04-25T09:10:09.719308+0000","last_clean":"2024-04-25T09:10:09.719308+0000","last_became_active":"2024-04-25T09:10:08.715779+0000","last_became_peered":"2024-04-25T09:10:08.715779+0000","last_unstale":"2024-04-25T09:10:09.719308+0000","last_undegraded":"2024-04-25T09:10:09.719308+0000","last_fullsized":"2024-04-25T09:10:09.719308+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:05.458369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"106'2","reported_seq":16,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719944+0000","last_change":"2024-04-25T09:10:07.711695+0000","last_active":"2024-04-25T09:10:09.719944+0000","last_peered":"2024-04-25T09:10:09.719944+0000","last_clean":"2024-04-25T09:10:09.719944+0000","last_became_active":"2024-04-25T09:10:07.711395+0000","last_became_peered":"2024-04-25T09:10:07.711395+0000","last_unstale":"2024-04-25T09:10:09.719944+0000","last_undegraded":"2024-04-25T09:10:09.719944+0000","last_fullsized":"2024-04-25T09:10:09.719944+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:32.933967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718497+0000","last_change":"2024-04-25T09:10:08.711490+0000","last_active":"2024-04-25T09:10:09.718497+0000","last_peered":"2024-04-25T09:10:09.718497+0000","last_clean":"2024-04-25T09:10:09.718497+0000","last_became_active":"2024-04-25T09:10:08.711179+0000","last_became_peered":"2024-04-25T09:10:08.711179+0000","last_unstale":"2024-04-25T09:10:09.718497+0000","last_undegraded":"2024-04-25T09:10:09.718497+0000","last_fullsized":"2024-04-25T09:10:09.718497+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:27:41.864845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.736879+0000","last_change":"2024-04-25T09:10:07.712662+0000","last_active":"2024-04-25T09:10:08.736879+0000","last_peered":"2024-04-25T09:10:08.736879+0000","last_clean":"2024-04-25T09:10:08.736879+0000","last_became_active":"2024-04-25T09:10:07.712361+0000","last_became_peered":"2024-04-25T09:10:07.712361+0000","last_unstale":"2024-04-25T09:10:08.736879+0000","last_undegraded":"2024-04-25T09:10:08.736879+0000","last_fullsized":"2024-04-25T09:10:08.736879+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:53.359144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.728767+0000","last_change":"2024-04-25T09:10:08.722120+0000","last_active":"2024-04-25T09:10:08.728767+0000","last_peered":"2024-04-25T09:10:08.728767+0000","last_clean":"2024-04-25T09:10:08.728767+0000","last_became_active":"2024-04-25T09:10:08.721869+0000","last_became_peered":"2024-04-25T09:10:08.721869+0000","last_unstale":"2024-04-25T09:10:08.728767+0000","last_undegraded":"2024-04-25T09:10:08.728767+0000","last_fullsized":"2024-04-25T09:10:08.728767+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:26.284268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.727382+0000","last_change":"2024-04-25T09:10:07.722094+0000","last_active":"2024-04-25T09:10:08.727382+0000","last_peered":"2024-04-25T09:10:08.727382+0000","last_clean":"2024-04-25T09:10:08.727382+0000","last_became_active":"2024-04-25T09:10:07.721355+0000","last_became_peered":"2024-04-25T09:10:07.721355+0000","last_unstale":"2024-04-25T09:10:08.727382+0000","last_undegraded":"2024-04-25T09:10:08.727382+0000","last_fullsized":"2024-04-25T09:10:08.727382+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:11:52.032647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715737+0000","last_change":"2024-04-25T09:10:08.731438+0000","last_active":"2024-04-25T09:10:09.715737+0000","last_peered":"2024-04-25T09:10:09.715737+0000","last_clean":"2024-04-25T09:10:09.715737+0000","last_became_active":"2024-04-25T09:10:08.730639+0000","last_became_peered":"2024-04-25T09:10:08.730639+0000","last_unstale":"2024-04-25T09:10:09.715737+0000","last_undegraded":"2024-04-25T09:10:09.715737+0000","last_fullsized":"2024-04-25T09:10:09.715737+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:47.239156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"106'1","reported_seq":15,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718119+0000","last_change":"2024-04-25T09:10:07.713340+0000","last_active":"2024-04-25T09:10:09.718119+0000","last_peered":"2024-04-25T09:10:09.718119+0000","last_clean":"2024-04-25T09:10:09.718119+0000","last_became_active":"2024-04-25T09:10:07.713057+0000","last_became_peered":"2024-04-25T09:10:07.713057+0000","last_unstale":"2024-04-25T09:10:09.718119+0000","last_undegraded":"2024-04-25T09:10:09.718119+0000","last_fullsized":"2024-04-25T09:10:09.718119+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:22.438644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.723244+0000","last_change":"2024-04-25T09:10:08.720716+0000","last_active":"2024-04-25T09:10:08.723244+0000","last_peered":"2024-04-25T09:10:08.723244+0000","last_clean":"2024-04-25T09:10:08.723244+0000","last_became_active":"2024-04-25T09:10:08.720370+0000","last_became_peered":"2024-04-25T09:10:08.720370+0000","last_unstale":"2024-04-25T09:10:08.723244+0000","last_undegraded":"2024-04-25T09:10:08.723244+0000","last_fullsized":"2024-04-25T09:10:08.723244+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:23.445801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719331+0000","last_change":"2024-04-25T09:10:07.711841+0000","last_active":"2024-04-25T09:10:09.719331+0000","last_peered":"2024-04-25T09:10:09.719331+0000","last_clean":"2024-04-25T09:10:09.719331+0000","last_became_active":"2024-04-25T09:10:07.711562+0000","last_became_peered":"2024-04-25T09:10:07.711562+0000","last_unstale":"2024-04-25T09:10:09.719331+0000","last_undegraded":"2024-04-25T09:10:09.719331+0000","last_fullsized":"2024-04-25T09:10:09.719331+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:56.713711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.742094+0000","last_change":"2024-04-25T09:10:08.735758+0000","last_active":"2024-04-25T09:10:08.742094+0000","last_peered":"2024-04-25T09:10:08.742094+0000","last_clean":"2024-04-25T09:10:08.742094+0000","last_became_active":"2024-04-25T09:10:08.735519+0000","last_became_peered":"2024-04-25T09:10:08.735519+0000","last_unstale":"2024-04-25T09:10:08.742094+0000","last_undegraded":"2024-04-25T09:10:08.742094+0000","last_fullsized":"2024-04-25T09:10:08.742094+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:11.961665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.700890+0000","last_change":"2024-04-25T09:10:07.717585+0000","last_active":"2024-04-25T09:10:08.700890+0000","last_peered":"2024-04-25T09:10:08.700890+0000","last_clean":"2024-04-25T09:10:08.700890+0000","last_became_active":"2024-04-25T09:10:07.717195+0000","last_became_peered":"2024-04-25T09:10:07.717195+0000","last_unstale":"2024-04-25T09:10:08.700890+0000","last_undegraded":"2024-04-25T09:10:08.700890+0000","last_fullsized":"2024-04-25T09:10:08.700890+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:37.116777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.714992+0000","last_change":"2024-04-25T09:10:08.728328+0000","last_active":"2024-04-25T09:10:09.714992+0000","last_peered":"2024-04-25T09:10:09.714992+0000","last_clean":"2024-04-25T09:10:09.714992+0000","last_became_active":"2024-04-25T09:10:08.727402+0000","last_became_peered":"2024-04-25T09:10:08.727402+0000","last_unstale":"2024-04-25T09:10:09.714992+0000","last_undegraded":"2024-04-25T09:10:09.714992+0000","last_fullsized":"2024-04-25T09:10:09.714992+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:04.414034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.720028+0000","last_change":"2024-04-25T09:10:07.718778+0000","last_active":"2024-04-25T09:10:09.720028+0000","last_peered":"2024-04-25T09:10:09.720028+0000","last_clean":"2024-04-25T09:10:09.720028+0000","last_became_active":"2024-04-25T09:10:07.718514+0000","last_became_peered":"2024-04-25T09:10:07.718514+0000","last_unstale":"2024-04-25T09:10:09.720028+0000","last_undegraded":"2024-04-25T09:10:09.720028+0000","last_fullsized":"2024-04-25T09:10:09.720028+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:41:03.938312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.741871+0000","last_change":"2024-04-25T09:10:08.735051+0000","last_active":"2024-04-25T09:10:08.741871+0000","last_peered":"2024-04-25T09:10:08.741871+0000","last_clean":"2024-04-25T09:10:08.741871+0000","last_became_active":"2024-04-25T09:10:08.734580+0000","last_became_peered":"2024-04-25T09:10:08.734580+0000","last_unstale":"2024-04-25T09:10:08.741871+0000","last_undegraded":"2024-04-25T09:10:08.741871+0000","last_fullsized":"2024-04-25T09:10:08.741871+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:11.044280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715229+0000","last_change":"2024-04-25T09:10:07.713222+0000","last_active":"2024-04-25T09:10:09.715229+0000","last_peered":"2024-04-25T09:10:09.715229+0000","last_clean":"2024-04-25T09:10:09.715229+0000","last_became_active":"2024-04-25T09:10:07.712897+0000","last_became_peered":"2024-04-25T09:10:07.712897+0000","last_unstale":"2024-04-25T09:10:09.715229+0000","last_undegraded":"2024-04-25T09:10:09.715229+0000","last_fullsized":"2024-04-25T09:10:09.715229+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:07:10.661404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.739988+0000","last_change":"2024-04-25T09:10:08.730487+0000","last_active":"2024-04-25T09:10:08.739988+0000","last_peered":"2024-04-25T09:10:08.739988+0000","last_clean":"2024-04-25T09:10:08.739988+0000","last_became_active":"2024-04-25T09:10:08.730206+0000","last_became_peered":"2024-04-25T09:10:08.730206+0000","last_unstale":"2024-04-25T09:10:08.739988+0000","last_undegraded":"2024-04-25T09:10:08.739988+0000","last_fullsized":"2024-04-25T09:10:08.739988+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:15:41.088334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"106'3","reported_seq":15,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.742294+0000","last_change":"2024-04-25T09:10:07.722457+0000","last_active":"2024-04-25T09:10:08.742294+0000","last_peered":"2024-04-25T09:10:08.742294+0000","last_clean":"2024-04-25T09:10:08.742294+0000","last_became_active":"2024-04-25T09:10:07.721865+0000","last_became_peered":"2024-04-25T09:10:07.721865+0000","last_unstale":"2024-04-25T09:10:08.742294+0000","last_undegraded":"2024-04-25T09:10:08.742294+0000","last_fullsized":"2024-04-25T09:10:08.742294+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:27.051176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.742083+0000","last_change":"2024-04-25T09:10:08.737460+0000","last_active":"2024-04-25T09:10:08.742083+0000","last_peered":"2024-04-25T09:10:08.742083+0000","last_clean":"2024-04-25T09:10:08.742083+0000","last_became_active":"2024-04-25T09:10:08.734968+0000","last_became_peered":"2024-04-25T09:10:08.734968+0000","last_unstale":"2024-04-25T09:10:08.742083+0000","last_undegraded":"2024-04-25T09:10:08.742083+0000","last_fullsized":"2024-04-25T09:10:08.742083+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:11:45.299790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"106'6","reported_seq":18,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.744594+0000","last_change":"2024-04-25T09:10:07.720773+0000","last_active":"2024-04-25T09:10:08.744594+0000","last_peered":"2024-04-25T09:10:08.744594+0000","last_clean":"2024-04-25T09:10:08.744594+0000","last_became_active":"2024-04-25T09:10:07.719659+0000","last_became_peered":"2024-04-25T09:10:07.719659+0000","last_unstale":"2024-04-25T09:10:08.744594+0000","last_undegraded":"2024-04-25T09:10:08.744594+0000","last_fullsized":"2024-04-25T09:10:08.744594+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:22.374995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718668+0000","last_change":"2024-04-25T09:10:08.733801+0000","last_active":"2024-04-25T09:10:09.718668+0000","last_peered":"2024-04-25T09:10:09.718668+0000","last_clean":"2024-04-25T09:10:09.718668+0000","last_became_active":"2024-04-25T09:10:08.733480+0000","last_became_peered":"2024-04-25T09:10:08.733480+0000","last_unstale":"2024-04-25T09:10:09.718668+0000","last_undegraded":"2024-04-25T09:10:09.718668+0000","last_fullsized":"2024-04-25T09:10:09.718668+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:28.058333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.740763+0000","last_change":"2024-04-25T09:10:07.723233+0000","last_active":"2024-04-25T09:10:08.740763+0000","last_peered":"2024-04-25T09:10:08.740763+0000","last_clean":"2024-04-25T09:10:08.740763+0000","last_became_active":"2024-04-25T09:10:07.722946+0000","last_became_peered":"2024-04-25T09:10:07.722946+0000","last_unstale":"2024-04-25T09:10:08.740763+0000","last_undegraded":"2024-04-25T09:10:08.740763+0000","last_fullsized":"2024-04-25T09:10:08.740763+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:48.975124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.727514+0000","last_change":"2024-04-25T09:10:08.724632+0000","last_active":"2024-04-25T09:10:08.727514+0000","last_peered":"2024-04-25T09:10:08.727514+0000","last_clean":"2024-04-25T09:10:08.727514+0000","last_became_active":"2024-04-25T09:10:08.722357+0000","last_became_peered":"2024-04-25T09:10:08.722357+0000","last_unstale":"2024-04-25T09:10:08.727514+0000","last_undegraded":"2024-04-25T09:10:08.727514+0000","last_fullsized":"2024-04-25T09:10:08.727514+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:17:05.458369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.700956+0000","last_change":"2024-04-25T09:10:07.722102+0000","last_active":"2024-04-25T09:10:08.700956+0000","last_peered":"2024-04-25T09:10:08.700956+0000","last_clean":"2024-04-25T09:10:08.700956+0000","last_became_active":"2024-04-25T09:10:07.721810+0000","last_became_peered":"2024-04-25T09:10:07.721810+0000","last_unstale":"2024-04-25T09:10:08.700956+0000","last_undegraded":"2024-04-25T09:10:08.700956+0000","last_fullsized":"2024-04-25T09:10:08.700956+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:10.037123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.734784+0000","last_change":"2024-04-25T09:10:08.724857+0000","last_active":"2024-04-25T09:10:08.734784+0000","last_peered":"2024-04-25T09:10:08.734784+0000","last_clean":"2024-04-25T09:10:08.734784+0000","last_became_active":"2024-04-25T09:10:08.724481+0000","last_became_peered":"2024-04-25T09:10:08.724481+0000","last_unstale":"2024-04-25T09:10:08.734784+0000","last_undegraded":"2024-04-25T09:10:08.734784+0000","last_fullsized":"2024-04-25T09:10:08.734784+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:33:43.908719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.718643+0000","last_change":"2024-04-25T09:10:07.724167+0000","last_active":"2024-04-25T09:10:08.718643+0000","last_peered":"2024-04-25T09:10:08.718643+0000","last_clean":"2024-04-25T09:10:08.718643+0000","last_became_active":"2024-04-25T09:10:07.723664+0000","last_became_peered":"2024-04-25T09:10:07.723664+0000","last_unstale":"2024-04-25T09:10:08.718643+0000","last_undegraded":"2024-04-25T09:10:08.718643+0000","last_fullsized":"2024-04-25T09:10:08.718643+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:31:03.844587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715680+0000","last_change":"2024-04-25T09:10:08.733081+0000","last_active":"2024-04-25T09:10:09.715680+0000","last_peered":"2024-04-25T09:10:09.715680+0000","last_clean":"2024-04-25T09:10:09.715680+0000","last_became_active":"2024-04-25T09:10:08.732797+0000","last_became_peered":"2024-04-25T09:10:08.732797+0000","last_unstale":"2024-04-25T09:10:09.715680+0000","last_undegraded":"2024-04-25T09:10:09.715680+0000","last_fullsized":"2024-04-25T09:10:09.715680+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:52.821963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"106'8","reported_seq":22,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719221+0000","last_change":"2024-04-25T09:10:07.712396+0000","last_active":"2024-04-25T09:10:09.719221+0000","last_peered":"2024-04-25T09:10:09.719221+0000","last_clean":"2024-04-25T09:10:09.719221+0000","last_became_active":"2024-04-25T09:10:07.710954+0000","last_became_peered":"2024-04-25T09:10:07.710954+0000","last_unstale":"2024-04-25T09:10:09.719221+0000","last_undegraded":"2024-04-25T09:10:09.719221+0000","last_fullsized":"2024-04-25T09:10:09.719221+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:29:04.679827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.741109+0000","last_change":"2024-04-25T09:10:08.733823+0000","last_active":"2024-04-25T09:10:08.741109+0000","last_peered":"2024-04-25T09:10:08.741109+0000","last_clean":"2024-04-25T09:10:08.741109+0000","last_became_active":"2024-04-25T09:10:08.733319+0000","last_became_peered":"2024-04-25T09:10:08.733319+0000","last_unstale":"2024-04-25T09:10:08.741109+0000","last_undegraded":"2024-04-25T09:10:08.741109+0000","last_fullsized":"2024-04-25T09:10:08.741109+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:49.701031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.730637+0000","last_change":"2024-04-25T09:10:07.720582+0000","last_active":"2024-04-25T09:10:08.730637+0000","last_peered":"2024-04-25T09:10:08.730637+0000","last_clean":"2024-04-25T09:10:08.730637+0000","last_became_active":"2024-04-25T09:10:07.720310+0000","last_became_peered":"2024-04-25T09:10:07.720310+0000","last_unstale":"2024-04-25T09:10:08.730637+0000","last_undegraded":"2024-04-25T09:10:08.730637+0000","last_fullsized":"2024-04-25T09:10:08.730637+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:55:53.666675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.737284+0000","last_change":"2024-04-25T09:10:08.734443+0000","last_active":"2024-04-25T09:10:08.737284+0000","last_peered":"2024-04-25T09:10:08.737284+0000","last_clean":"2024-04-25T09:10:08.737284+0000","last_became_active":"2024-04-25T09:10:08.734183+0000","last_became_peered":"2024-04-25T09:10:08.734183+0000","last_unstale":"2024-04-25T09:10:08.737284+0000","last_undegraded":"2024-04-25T09:10:08.737284+0000","last_fullsized":"2024-04-25T09:10:08.737284+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:39.153268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"106'1","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.735292+0000","last_change":"2024-04-25T09:10:07.722689+0000","last_active":"2024-04-25T09:10:08.735292+0000","last_peered":"2024-04-25T09:10:08.735292+0000","last_clean":"2024-04-25T09:10:08.735292+0000","last_became_active":"2024-04-25T09:10:07.722166+0000","last_became_peered":"2024-04-25T09:10:07.722166+0000","last_unstale":"2024-04-25T09:10:08.735292+0000","last_undegraded":"2024-04-25T09:10:08.735292+0000","last_fullsized":"2024-04-25T09:10:08.735292+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:07.439928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.731046+0000","last_change":"2024-04-25T09:10:08.721990+0000","last_active":"2024-04-25T09:10:08.731046+0000","last_peered":"2024-04-25T09:10:08.731046+0000","last_clean":"2024-04-25T09:10:08.731046+0000","last_became_active":"2024-04-25T09:10:08.721468+0000","last_became_peered":"2024-04-25T09:10:08.721468+0000","last_unstale":"2024-04-25T09:10:08.731046+0000","last_undegraded":"2024-04-25T09:10:08.731046+0000","last_fullsized":"2024-04-25T09:10:08.731046+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:07:23.445801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718643+0000","last_change":"2024-04-25T09:10:07.716311+0000","last_active":"2024-04-25T09:10:09.718643+0000","last_peered":"2024-04-25T09:10:09.718643+0000","last_clean":"2024-04-25T09:10:09.718643+0000","last_became_active":"2024-04-25T09:10:07.716033+0000","last_became_peered":"2024-04-25T09:10:07.716033+0000","last_unstale":"2024-04-25T09:10:09.718643+0000","last_undegraded":"2024-04-25T09:10:09.718643+0000","last_fullsized":"2024-04-25T09:10:09.718643+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:36:37.116777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715197+0000","last_change":"2024-04-25T09:10:08.731202+0000","last_active":"2024-04-25T09:10:09.715197+0000","last_peered":"2024-04-25T09:10:09.715197+0000","last_clean":"2024-04-25T09:10:09.715197+0000","last_became_active":"2024-04-25T09:10:08.730903+0000","last_became_peered":"2024-04-25T09:10:08.730903+0000","last_unstale":"2024-04-25T09:10:09.715197+0000","last_undegraded":"2024-04-25T09:10:09.715197+0000","last_fullsized":"2024-04-25T09:10:09.715197+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:04.024366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.740754+0000","last_change":"2024-04-25T09:10:07.721491+0000","last_active":"2024-04-25T09:10:08.740754+0000","last_peered":"2024-04-25T09:10:08.740754+0000","last_clean":"2024-04-25T09:10:08.740754+0000","last_became_active":"2024-04-25T09:10:07.721055+0000","last_became_peered":"2024-04-25T09:10:07.721055+0000","last_unstale":"2024-04-25T09:10:08.740754+0000","last_undegraded":"2024-04-25T09:10:08.740754+0000","last_fullsized":"2024-04-25T09:10:08.740754+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:09:12.469209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715609+0000","last_change":"2024-04-25T09:10:08.731395+0000","last_active":"2024-04-25T09:10:09.715609+0000","last_peered":"2024-04-25T09:10:09.715609+0000","last_clean":"2024-04-25T09:10:09.715609+0000","last_became_active":"2024-04-25T09:10:08.730256+0000","last_became_peered":"2024-04-25T09:10:08.730256+0000","last_unstale":"2024-04-25T09:10:09.715609+0000","last_undegraded":"2024-04-25T09:10:09.715609+0000","last_fullsized":"2024-04-25T09:10:09.715609+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:20:01.116038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.716379+0000","last_change":"2024-04-25T09:10:07.726461+0000","last_active":"2024-04-25T09:10:08.716379+0000","last_peered":"2024-04-25T09:10:08.716379+0000","last_clean":"2024-04-25T09:10:08.716379+0000","last_became_active":"2024-04-25T09:10:07.726197+0000","last_became_peered":"2024-04-25T09:10:07.726197+0000","last_unstale":"2024-04-25T09:10:08.716379+0000","last_undegraded":"2024-04-25T09:10:08.716379+0000","last_fullsized":"2024-04-25T09:10:08.716379+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:47.994383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.735462+0000","last_change":"2024-04-25T09:10:08.727069+0000","last_active":"2024-04-25T09:10:08.735462+0000","last_peered":"2024-04-25T09:10:08.735462+0000","last_clean":"2024-04-25T09:10:08.735462+0000","last_became_active":"2024-04-25T09:10:08.726738+0000","last_became_peered":"2024-04-25T09:10:08.726738+0000","last_unstale":"2024-04-25T09:10:08.735462+0000","last_undegraded":"2024-04-25T09:10:08.735462+0000","last_fullsized":"2024-04-25T09:10:08.735462+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:39.153268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.712689+0000","last_change":"2024-04-25T09:10:07.724442+0000","last_active":"2024-04-25T09:10:08.712689+0000","last_peered":"2024-04-25T09:10:08.712689+0000","last_clean":"2024-04-25T09:10:08.712689+0000","last_became_active":"2024-04-25T09:10:07.724149+0000","last_became_peered":"2024-04-25T09:10:07.724149+0000","last_unstale":"2024-04-25T09:10:08.712689+0000","last_undegraded":"2024-04-25T09:10:08.712689+0000","last_fullsized":"2024-04-25T09:10:08.712689+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:51:48.975124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.738977+0000","last_change":"2024-04-25T09:10:08.730525+0000","last_active":"2024-04-25T09:10:08.738977+0000","last_peered":"2024-04-25T09:10:08.738977+0000","last_clean":"2024-04-25T09:10:08.738977+0000","last_became_active":"2024-04-25T09:10:08.730258+0000","last_became_peered":"2024-04-25T09:10:08.730258+0000","last_unstale":"2024-04-25T09:10:08.738977+0000","last_undegraded":"2024-04-25T09:10:08.738977+0000","last_fullsized":"2024-04-25T09:10:08.738977+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:11:23.802222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.716788+0000","last_change":"2024-04-25T09:10:07.720730+0000","last_active":"2024-04-25T09:10:08.716788+0000","last_peered":"2024-04-25T09:10:08.716788+0000","last_clean":"2024-04-25T09:10:08.716788+0000","last_became_active":"2024-04-25T09:10:07.720398+0000","last_became_peered":"2024-04-25T09:10:07.720398+0000","last_unstale":"2024-04-25T09:10:08.716788+0000","last_undegraded":"2024-04-25T09:10:08.716788+0000","last_fullsized":"2024-04-25T09:10:08.716788+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:24:29.955939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.714998+0000","last_change":"2024-04-25T09:10:08.730523+0000","last_active":"2024-04-25T09:10:09.714998+0000","last_peered":"2024-04-25T09:10:09.714998+0000","last_clean":"2024-04-25T09:10:09.714998+0000","last_became_active":"2024-04-25T09:10:08.730226+0000","last_became_peered":"2024-04-25T09:10:08.730226+0000","last_unstale":"2024-04-25T09:10:09.714998+0000","last_undegraded":"2024-04-25T09:10:09.714998+0000","last_fullsized":"2024-04-25T09:10:09.714998+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:11.407527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.741155+0000","last_change":"2024-04-25T09:10:07.722544+0000","last_active":"2024-04-25T09:10:08.741155+0000","last_peered":"2024-04-25T09:10:08.741155+0000","last_clean":"2024-04-25T09:10:08.741155+0000","last_became_active":"2024-04-25T09:10:07.722236+0000","last_became_peered":"2024-04-25T09:10:07.722236+0000","last_unstale":"2024-04-25T09:10:08.741155+0000","last_undegraded":"2024-04-25T09:10:08.741155+0000","last_fullsized":"2024-04-25T09:10:08.741155+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:58.390235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719296+0000","last_change":"2024-04-25T09:10:08.709802+0000","last_active":"2024-04-25T09:10:09.719296+0000","last_peered":"2024-04-25T09:10:09.719296+0000","last_clean":"2024-04-25T09:10:09.719296+0000","last_became_active":"2024-04-25T09:10:08.709532+0000","last_became_peered":"2024-04-25T09:10:08.709532+0000","last_unstale":"2024-04-25T09:10:09.719296+0000","last_undegraded":"2024-04-25T09:10:09.719296+0000","last_fullsized":"2024-04-25T09:10:09.719296+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:11.044280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.715309+0000","last_change":"2024-04-25T09:10:07.709929+0000","last_active":"2024-04-25T09:10:09.715309+0000","last_peered":"2024-04-25T09:10:09.715309+0000","last_clean":"2024-04-25T09:10:09.715309+0000","last_became_active":"2024-04-25T09:10:07.709599+0000","last_became_peered":"2024-04-25T09:10:07.709599+0000","last_unstale":"2024-04-25T09:10:09.715309+0000","last_undegraded":"2024-04-25T09:10:09.715309+0000","last_fullsized":"2024-04-25T09:10:09.715309+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:39.007402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.720931+0000","last_change":"2024-04-25T09:10:08.712712+0000","last_active":"2024-04-25T09:10:08.720931+0000","last_peered":"2024-04-25T09:10:08.720931+0000","last_clean":"2024-04-25T09:10:08.720931+0000","last_became_active":"2024-04-25T09:10:08.712449+0000","last_became_peered":"2024-04-25T09:10:08.712449+0000","last_unstale":"2024-04-25T09:10:08.720931+0000","last_undegraded":"2024-04-25T09:10:08.720931+0000","last_fullsized":"2024-04-25T09:10:08.720931+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:01:29.432320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.713334+0000","last_change":"2024-04-25T09:10:07.722075+0000","last_active":"2024-04-25T09:10:08.713334+0000","last_peered":"2024-04-25T09:10:08.713334+0000","last_clean":"2024-04-25T09:10:08.713334+0000","last_became_active":"2024-04-25T09:10:07.721766+0000","last_became_peered":"2024-04-25T09:10:07.721766+0000","last_unstale":"2024-04-25T09:10:08.713334+0000","last_undegraded":"2024-04-25T09:10:08.713334+0000","last_fullsized":"2024-04-25T09:10:08.713334+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:20:58.390235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718333+0000","last_change":"2024-04-25T09:10:08.716552+0000","last_active":"2024-04-25T09:10:09.718333+0000","last_peered":"2024-04-25T09:10:09.718333+0000","last_clean":"2024-04-25T09:10:09.718333+0000","last_became_active":"2024-04-25T09:10:08.715747+0000","last_became_peered":"2024-04-25T09:10:08.715747+0000","last_unstale":"2024-04-25T09:10:09.718333+0000","last_undegraded":"2024-04-25T09:10:09.718333+0000","last_fullsized":"2024-04-25T09:10:09.718333+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:18.671723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.707805+0000","last_change":"2024-04-25T09:10:07.718918+0000","last_active":"2024-04-25T09:10:08.707805+0000","last_peered":"2024-04-25T09:10:08.707805+0000","last_clean":"2024-04-25T09:10:08.707805+0000","last_became_active":"2024-04-25T09:10:07.715622+0000","last_became_peered":"2024-04-25T09:10:07.715622+0000","last_unstale":"2024-04-25T09:10:08.707805+0000","last_undegraded":"2024-04-25T09:10:08.707805+0000","last_fullsized":"2024-04-25T09:10:08.707805+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:37.552896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.739269+0000","last_change":"2024-04-25T09:10:08.731227+0000","last_active":"2024-04-25T09:10:08.739269+0000","last_peered":"2024-04-25T09:10:08.739269+0000","last_clean":"2024-04-25T09:10:08.739269+0000","last_became_active":"2024-04-25T09:10:08.730157+0000","last_became_peered":"2024-04-25T09:10:08.730157+0000","last_unstale":"2024-04-25T09:10:08.739269+0000","last_undegraded":"2024-04-25T09:10:08.739269+0000","last_fullsized":"2024-04-25T09:10:08.739269+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:22.430224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":14,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.719565+0000","last_change":"2024-04-25T09:10:07.717958+0000","last_active":"2024-04-25T09:10:09.719565+0000","last_peered":"2024-04-25T09:10:09.719565+0000","last_clean":"2024-04-25T09:10:09.719565+0000","last_became_active":"2024-04-25T09:10:07.717672+0000","last_became_peered":"2024-04-25T09:10:07.717672+0000","last_unstale":"2024-04-25T09:10:09.719565+0000","last_undegraded":"2024-04-25T09:10:09.719565+0000","last_fullsized":"2024-04-25T09:10:09.719565+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:20:06.775010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.738886+0000","last_change":"2024-04-25T09:10:08.728079+0000","last_active":"2024-04-25T09:10:08.738886+0000","last_peered":"2024-04-25T09:10:08.738886+0000","last_clean":"2024-04-25T09:10:08.738886+0000","last_became_active":"2024-04-25T09:10:08.727814+0000","last_became_peered":"2024-04-25T09:10:08.727814+0000","last_unstale":"2024-04-25T09:10:08.738886+0000","last_undegraded":"2024-04-25T09:10:08.738886+0000","last_fullsized":"2024-04-25T09:10:08.738886+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:24.058870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.716546+0000","last_change":"2024-04-25T09:10:07.724010+0000","last_active":"2024-04-25T09:10:08.716546+0000","last_peered":"2024-04-25T09:10:08.716546+0000","last_clean":"2024-04-25T09:10:08.716546+0000","last_became_active":"2024-04-25T09:10:07.723745+0000","last_became_peered":"2024-04-25T09:10:07.723745+0000","last_unstale":"2024-04-25T09:10:08.716546+0000","last_undegraded":"2024-04-25T09:10:08.716546+0000","last_fullsized":"2024-04-25T09:10:08.716546+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:52.354256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.733315+0000","last_change":"2024-04-25T09:10:08.731386+0000","last_active":"2024-04-25T09:10:08.733315+0000","last_peered":"2024-04-25T09:10:08.733315+0000","last_clean":"2024-04-25T09:10:08.733315+0000","last_became_active":"2024-04-25T09:10:08.731132+0000","last_became_peered":"2024-04-25T09:10:08.731132+0000","last_unstale":"2024-04-25T09:10:08.733315+0000","last_undegraded":"2024-04-25T09:10:08.733315+0000","last_fullsized":"2024-04-25T09:10:08.733315+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:21:37.526495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.713044+0000","last_change":"2024-04-25T09:10:07.717210+0000","last_active":"2024-04-25T09:10:08.713044+0000","last_peered":"2024-04-25T09:10:08.713044+0000","last_clean":"2024-04-25T09:10:08.713044+0000","last_became_active":"2024-04-25T09:10:07.716918+0000","last_became_peered":"2024-04-25T09:10:07.716918+0000","last_unstale":"2024-04-25T09:10:08.713044+0000","last_undegraded":"2024-04-25T09:10:08.713044+0000","last_fullsized":"2024-04-25T09:10:08.713044+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:54:37.552896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718586+0000","last_change":"2024-04-25T09:10:08.719489+0000","last_active":"2024-04-25T09:10:09.718586+0000","last_peered":"2024-04-25T09:10:09.718586+0000","last_clean":"2024-04-25T09:10:09.718586+0000","last_became_active":"2024-04-25T09:10:08.718706+0000","last_became_peered":"2024-04-25T09:10:08.718706+0000","last_unstale":"2024-04-25T09:10:09.718586+0000","last_undegraded":"2024-04-25T09:10:09.718586+0000","last_fullsized":"2024-04-25T09:10:09.718586+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:53:08.447085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.716933+0000","last_change":"2024-04-25T09:10:07.722837+0000","last_active":"2024-04-25T09:10:08.716933+0000","last_peered":"2024-04-25T09:10:08.716933+0000","last_clean":"2024-04-25T09:10:08.716933+0000","last_became_active":"2024-04-25T09:10:07.722504+0000","last_became_peered":"2024-04-25T09:10:07.722504+0000","last_unstale":"2024-04-25T09:10:08.716933+0000","last_undegraded":"2024-04-25T09:10:08.716933+0000","last_fullsized":"2024-04-25T09:10:08.716933+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:43.210725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":107,"state":"active+clean","last_fresh":"2024-04-25T09:10:09.718130+0000","last_change":"2024-04-25T09:10:08.736858+0000","last_active":"2024-04-25T09:10:09.718130+0000","last_peered":"2024-04-25T09:10:09.718130+0000","last_clean":"2024-04-25T09:10:09.718130+0000","last_became_active":"2024-04-25T09:10:08.736446+0000","last_became_peered":"2024-04-25T09:10:08.736446+0000","last_unstale":"2024-04-25T09:10:09.718130+0000","last_undegraded":"2024-04-25T09:10:09.718130+0000","last_fullsized":"2024-04-25T09:10:09.718130+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:07.688443+0000","last_clean_scrub_stamp":"2024-04-25T09:10:07.688443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:38:11.961665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"106'2","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.736937+0000","last_change":"2024-04-25T09:10:07.721340+0000","last_active":"2024-04-25T09:10:08.736937+0000","last_peered":"2024-04-25T09:10:08.736937+0000","last_clean":"2024-04-25T09:10:08.736937+0000","last_became_active":"2024-04-25T09:10:07.721027+0000","last_became_peered":"2024-04-25T09:10:07.721027+0000","last_unstale":"2024-04-25T09:10:08.736937+0000","last_undegraded":"2024-04-25T09:10:08.736937+0000","last_fullsized":"2024-04-25T09:10:08.736937+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:10:06.681285+0000","last_clean_scrub_stamp":"2024-04-25T09:10:06.681285+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:30.545835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":331,"reported_epoch":106,"state":"active+clean","last_fresh":"2024-04-25T09:10:08.713672+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:10:08.713672+0000","last_peered":"2024-04-25T09:10:08.713672+0000","last_clean":"2024-04-25T09:10:08.713672+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:10:08.713672+0000","last_undegraded":"2024-04-25T09:10:08.713672+0000","last_fullsized":"2024-04-25T09:10:08.713672+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574958,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33060,"kb_used_data":1872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":1916928,"data_stored":1202145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574957,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32484,"kb_used_data":1304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339356,"statfs":{"total":96636764160,"available":96603500544,"internally_reserved":0,"allocated":1335296,"data_stored":613833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574957,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1314816,"data_stored":611617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574958,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":1323008,"data_stored":611709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574958,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":612199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574958,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":611651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32468,"kb_used_data":1288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339372,"statfs":{"total":96636764160,"available":96603516928,"internally_reserved":0,"allocated":1318912,"data_stored":611651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,4],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574957,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33060,"kb_used_data":1880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":1925120,"data_stored":1203687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:10:13.205 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:10:13.205 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:10:13.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.403+0000 7ff184400640 1 Processor -- start 2024-04-25T09:10:13.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.403+0000 7ff184400640 1 -- start start 2024-04-25T09:10:13.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff184400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff17c150f40 0x7ff17c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff184400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff17c15af40 0x7ff17c071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff184400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff17c072040 0x7ff17c06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff184400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17c072490 con 0x7ff17c150f40 2024-04-25T09:10:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff184400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17c06f530 con 0x7ff17c15af40 2024-04-25T09:10:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff184400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c15e9a0 con 0x7ff17c072040 2024-04-25T09:10:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff181a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff17c150f40 0x7ff17c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff181a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff17c150f40 0x7ff17c06ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60304/0 (socket says 172.21.15.59:60304) 2024-04-25T09:10:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff181a00640 1 -- 172.21.15.59:0/49571189 learned_addr learned my addr 172.21.15.59:0/49571189 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff181a00640 1 -- 172.21.15.59:0/49571189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff17c072040 msgr2=0x7ff17c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff181a00640 1 --2- 172.21.15.59:0/49571189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff17c072040 0x7ff17c06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff181000640 1 --2- 172.21.15.59:0/49571189 >> v2:172.21.15.178:3300/0 conn(0x7ff17c15af40 0x7ff17c071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff181a00640 1 -- 172.21.15.59:0/49571189 >> v2:172.21.15.178:3300/0 conn(0x7ff17c15af40 msgr2=0x7ff17c071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:13.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff181a00640 1 --2- 172.21.15.59:0/49571189 >> v2:172.21.15.178:3300/0 conn(0x7ff17c15af40 0x7ff17c071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff181a00640 1 -- 172.21.15.59:0/49571189 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c15b3d0 con 0x7ff17c150f40 2024-04-25T09:10:13.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.407+0000 7ff181000640 1 --2- 172.21.15.59:0/49571189 >> v2:172.21.15.178:3300/0 conn(0x7ff17c15af40 0x7ff17c071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff181a00640 1 --2- 172.21.15.59:0/49571189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c150f40 0x7ff17c06ef50 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7ff17c072710 tx=0x7ff17001e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29eb0eb8667b5921 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff17be00640 1 -- 172.21.15.59:0/49571189 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170004230 con 0x7ff17c150f40 2024-04-25T09:10:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff17be00640 1 -- 172.21.15.59:0/49571189 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1700043d0 con 0x7ff17c150f40 2024-04-25T09:10:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff17be00640 1 -- 172.21.15.59:0/49571189 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff170003820 con 0x7ff17c150f40 2024-04-25T09:10:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff184400640 1 -- 172.21.15.59:0/49571189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c150f40 msgr2=0x7ff17c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff184400640 1 --2- 172.21.15.59:0/49571189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c150f40 0x7ff17c06ef50 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7ff17c072710 tx=0x7ff17001e8b0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff184400640 1 -- 172.21.15.59:0/49571189 shutdown_connections 2024-04-25T09:10:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff184400640 1 --2- 172.21.15.59:0/49571189 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff17c072040 0x7ff17c06d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff184400640 1 --2- 172.21.15.59:0/49571189 >> v2:172.21.15.178:3300/0 conn(0x7ff17c15af40 0x7ff17c071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff184400640 1 --2- 172.21.15.59:0/49571189 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c150f40 0x7ff17c06ef50 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff184400640 1 -- 172.21.15.59:0/49571189 >> 172.21.15.59:0/49571189 conn(0x7ff17c067080 msgr2=0x7ff17c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:13.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff184400640 1 -- 172.21.15.59:0/49571189 shutdown_connections 2024-04-25T09:10:13.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff184400640 1 -- 172.21.15.59:0/49571189 wait complete. 2024-04-25T09:10:13.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff184400640 1 Processor -- start 2024-04-25T09:10:13.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.411+0000 7ff184400640 1 -- start start 2024-04-25T09:10:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff184400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff17c072040 0x7ff17c0ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff184400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff17c150f40 0x7ff17c14b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff184400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c15af40 0x7ff17c158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff184400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c06d810 con 0x7ff17c15af40 2024-04-25T09:10:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff184400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c151320 con 0x7ff17c072040 2024-04-25T09:10:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff184400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c06d990 con 0x7ff17c150f40 2024-04-25T09:10:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff182400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c15af40 0x7ff17c158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff181a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff17c072040 0x7ff17c0ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff182400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c15af40 0x7ff17c158a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60312/0 (socket says 172.21.15.59:60312) 2024-04-25T09:10:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff181000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff17c150f40 0x7ff17c14b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff182400640 1 -- 172.21.15.59:0/1460036907 learned_addr learned my addr 172.21.15.59:0/1460036907 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff182400640 1 -- 172.21.15.59:0/1460036907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff17c150f40 msgr2=0x7ff17c14b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff182400640 1 --2- 172.21.15.59:0/1460036907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff17c150f40 0x7ff17c14b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff182400640 1 -- 172.21.15.59:0/1460036907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff17c072040 msgr2=0x7ff17c0ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff182400640 1 --2- 172.21.15.59:0/1460036907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff17c072040 0x7ff17c0ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff182400640 1 -- 172.21.15.59:0/1460036907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c14b970 con 0x7ff17c15af40 2024-04-25T09:10:13.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff182400640 1 --2- 172.21.15.59:0/1460036907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c15af40 0x7ff17c158a40 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7ff17400b970 tx=0x7ff17400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff179600640 1 -- 172.21.15.59:0/1460036907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174019070 con 0x7ff17c15af40 2024-04-25T09:10:13.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff179600640 1 -- 172.21.15.59:0/1460036907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17400cb60 con 0x7ff17c15af40 2024-04-25T09:10:13.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff179600640 1 -- 172.21.15.59:0/1460036907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174014440 con 0x7ff17c15af40 2024-04-25T09:10:13.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff184400640 1 -- 172.21.15.59:0/1460036907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17c0b0a30 con 0x7ff17c15af40 2024-04-25T09:10:13.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff184400640 1 -- 172.21.15.59:0/1460036907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17c1564e0 con 0x7ff17c15af40 2024-04-25T09:10:13.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff184400640 1 -- 172.21.15.59:0/1460036907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17c0745d0 con 0x7ff17c15af40 2024-04-25T09:10:13.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.415+0000 7ff179600640 1 -- 172.21.15.59:0/1460036907 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff17401c070 con 0x7ff17c15af40 2024-04-25T09:10:13.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.419+0000 7ff179600640 1 --2- 172.21.15.59:0/1460036907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff15c066f90 0x7ff15c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.419+0000 7ff179600640 1 -- 172.21.15.59:0/1460036907 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff174084e70 con 0x7ff17c15af40 2024-04-25T09:10:13.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.419+0000 7ff181a00640 1 --2- 172.21.15.59:0/1460036907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff15c066f90 0x7ff15c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.419+0000 7ff181a00640 1 --2- 172.21.15.59:0/1460036907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff15c066f90 0x7ff15c069450 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff1700b1000 tx=0x7ff1700a9000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.423+0000 7ff179600640 1 -- 172.21.15.59:0/1460036907 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff174055660 con 0x7ff17c15af40 2024-04-25T09:10:13.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.639+0000 7ff184400640 1 -- 172.21.15.59:0/1460036907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff17c0ceff0 con 0x7ff17c15af40 2024-04-25T09:10:13.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff179600640 1 -- 172.21.15.59:0/1460036907 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+147 (secure 0 0 0) 0x7ff174059700 con 0x7ff17c15af40 2024-04-25T09:10:13.631 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-04-25T09:10:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg== 2024-04-25T09:10:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-04-25T09:10:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-04-25T09:10:13.631 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:10:13.631 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-04-25T09:10:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff184400640 1 -- 172.21.15.59:0/1460036907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff15c066f90 msgr2=0x7ff15c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff184400640 1 --2- 172.21.15.59:0/1460036907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff15c066f90 0x7ff15c069450 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff1700b1000 tx=0x7ff1700a9000 comp rx=0 tx=0).stop 2024-04-25T09:10:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff184400640 1 -- 172.21.15.59:0/1460036907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c15af40 msgr2=0x7ff17c158a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff184400640 1 --2- 172.21.15.59:0/1460036907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c15af40 0x7ff17c158a40 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7ff17400b970 tx=0x7ff17400be30 comp rx=0 tx=0).stop 2024-04-25T09:10:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff184400640 1 -- 172.21.15.59:0/1460036907 shutdown_connections 2024-04-25T09:10:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff184400640 1 --2- 172.21.15.59:0/1460036907 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff15c066f90 0x7ff15c069450 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff184400640 1 --2- 172.21.15.59:0/1460036907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff17c15af40 0x7ff17c158a40 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff184400640 1 --2- 172.21.15.59:0/1460036907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff17c150f40 0x7ff17c14b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff184400640 1 --2- 172.21.15.59:0/1460036907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff17c072040 0x7ff17c0ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.633 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff184400640 1 -- 172.21.15.59:0/1460036907 >> 172.21.15.59:0/1460036907 conn(0x7ff17c067080 msgr2=0x7ff17c164210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff184400640 1 -- 172.21.15.59:0/1460036907 shutdown_connections 2024-04-25T09:10:13.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.643+0000 7ff184400640 1 -- 172.21.15.59:0/1460036907 wait complete. 2024-04-25T09:10:13.653 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb9e200640 1 Processor -- start 2024-04-25T09:10:13.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb9e200640 1 -- start start 2024-04-25T09:10:13.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb9e200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb98145020 0x7fbb98072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb9e200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb98145400 0x7fbb9806fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb9e200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb980ce130 con 0x7fbb9806ac10 2024-04-25T09:10:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb9e200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb980cd360 con 0x7fbb98145020 2024-04-25T09:10:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb9e200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98073200 con 0x7fbb98145400 2024-04-25T09:10:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb97400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb98145020 0x7fbb98072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb97400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb98145020 0x7fbb98072cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60324/0 (socket says 172.21.15.59:60324) 2024-04-25T09:10:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb97400640 1 -- 172.21.15.59:0/4097247185 learned_addr learned my addr 172.21.15.59:0/4097247185 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb8fe00640 1 --2- 172.21.15.59:0/4097247185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb98145400 0x7fbb9806fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb97400640 1 -- 172.21.15.59:0/4097247185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb98145400 msgr2=0x7fbb9806fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb97400640 1 --2- 172.21.15.59:0/4097247185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb98145400 0x7fbb9806fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb97400640 1 -- 172.21.15.59:0/4097247185 >> v1:172.21.15.178:6789/0 conn(0x7fbb9806ac10 legacy=0x7fbb9815f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:13.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.807+0000 7fbb97400640 1 -- 172.21.15.59:0/4097247185 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb980cd5b0 con 0x7fbb98145020 2024-04-25T09:10:13.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.811+0000 7fbb97400640 1 --2- 172.21.15.59:0/4097247185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb98145020 0x7fbb98072cc0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009870 tx=0x7fbb8801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbd30057c43144c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.811+0000 7fbb96a00640 1 -- 172.21.15.59:0/4097247185 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880b1070 con 0x7fbb98145020 2024-04-25T09:10:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.811+0000 7fbb96a00640 1 -- 172.21.15.59:0/4097247185 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb880ac620 con 0x7fbb98145020 2024-04-25T09:10:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.811+0000 7fbb96a00640 1 -- 172.21.15.59:0/4097247185 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880ac9f0 con 0x7fbb98145020 2024-04-25T09:10:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.811+0000 7fbb9e200640 1 -- 172.21.15.59:0/4097247185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb98145020 msgr2=0x7fbb98072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.811+0000 7fbb9e200640 1 --2- 172.21.15.59:0/4097247185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb98145020 0x7fbb98072cc0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009870 tx=0x7fbb8801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.811+0000 7fbb9e200640 1 -- 172.21.15.59:0/4097247185 shutdown_connections 2024-04-25T09:10:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.811+0000 7fbb9e200640 1 --2- 172.21.15.59:0/4097247185 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb98145400 0x7fbb9806fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.811+0000 7fbb9e200640 1 --2- 172.21.15.59:0/4097247185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb98145020 0x7fbb98072cc0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.811+0000 7fbb9e200640 1 -- 172.21.15.59:0/4097247185 >> 172.21.15.59:0/4097247185 conn(0x7fbb980b2400 msgr2=0x7fbb980b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.811+0000 7fbb9e200640 1 -- 172.21.15.59:0/4097247185 shutdown_connections 2024-04-25T09:10:13.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.811+0000 7fbb9e200640 1 -- 172.21.15.59:0/4097247185 wait complete. 2024-04-25T09:10:13.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb9e200640 1 Processor -- start 2024-04-25T09:10:13.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb9e200640 1 -- start start 2024-04-25T09:10:13.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb9e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806ac10 0x7fbb9815a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb9e200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb98145020 0x7fbb9813f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb9e200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb98145400 0x7fbb9815abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb9e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb9806b480 con 0x7fbb9806ac10 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb9e200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98070060 con 0x7fbb98145020 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb9e200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980d01e0 con 0x7fbb98145400 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb97400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806ac10 0x7fbb9815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb97400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806ac10 0x7fbb9815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60334/0 (socket says 172.21.15.59:60334) 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb97400640 1 -- 172.21.15.59:0/145603580 learned_addr learned my addr 172.21.15.59:0/145603580 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb8fe00640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb98145020 0x7fbb9813f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb97e00640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb98145400 0x7fbb9815abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb97400640 1 -- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb98145400 msgr2=0x7fbb9815abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb97400640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb98145400 0x7fbb9815abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb97400640 1 -- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb98145020 msgr2=0x7fbb9813f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb97400640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb98145020 0x7fbb9813f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb97400640 1 -- 172.21.15.59:0/145603580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb98140110 con 0x7fbb9806ac10 2024-04-25T09:10:13.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb97400640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806ac10 0x7fbb9815a400 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fbb880af040 tx=0x7fbb8801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb8f400640 1 -- 172.21.15.59:0/145603580 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880b1040 con 0x7fbb9806ac10 2024-04-25T09:10:13.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb8f400640 1 -- 172.21.15.59:0/145603580 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb880bd070 con 0x7fbb9806ac10 2024-04-25T09:10:13.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb8f400640 1 -- 172.21.15.59:0/145603580 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb880b7880 con 0x7fbb9806ac10 2024-04-25T09:10:13.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb9e200640 1 -- 172.21.15.59:0/145603580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb98140ba0 con 0x7fbb9806ac10 2024-04-25T09:10:13.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb9e200640 1 -- 172.21.15.59:0/145603580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9813eb10 con 0x7fbb9806ac10 2024-04-25T09:10:13.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.815+0000 7fbb9e200640 1 -- 172.21.15.59:0/145603580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb980745d0 con 0x7fbb9806ac10 2024-04-25T09:10:13.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.819+0000 7fbb8f400640 1 -- 172.21.15.59:0/145603580 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbb880ac4e0 con 0x7fbb9806ac10 2024-04-25T09:10:13.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.819+0000 7fbb8f400640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb74066f60 0x7fbb74069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:13.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.819+0000 7fbb8f400640 1 -- 172.21.15.59:0/145603580 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbb8811f770 con 0x7fbb9806ac10 2024-04-25T09:10:13.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.819+0000 7fbb8fe00640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb74066f60 0x7fbb74069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:13.808 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.819+0000 7fbb8fe00640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb74066f60 0x7fbb74069420 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbb9815d9b0 tx=0x7fbb80008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:13.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:13.823+0000 7fbb8f400640 1 -- 172.21.15.59:0/145603580 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbb88016110 con 0x7fbb9806ac10 2024-04-25T09:10:14.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 -- 172.21.15.59:0/145603580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb9815a940 con 0x7fbb9806ac10 2024-04-25T09:10:14.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb8f400640 1 -- 172.21.15.59:0/145603580 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fbb880f0520 con 0x7fbb9806ac10 2024-04-25T09:10:14.007 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:14.007 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":87,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:08.100794+0000","modified":"2024-04-25T09:10:11.103823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8322":{"gid":8322,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2867303658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2867303658},{"type":"v1","addr":"172.21.15.59:6835","nonce":2867303658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:10:14.007 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 87 2024-04-25T09:10:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 -- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb74066f60 msgr2=0x7fbb74069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb74066f60 0x7fbb74069420 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fbb9815d9b0 tx=0x7fbb80008040 comp rx=0 tx=0).stop 2024-04-25T09:10:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 -- 172.21.15.59:0/145603580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806ac10 msgr2=0x7fbb9815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806ac10 0x7fbb9815a400 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fbb880af040 tx=0x7fbb8801ad30 comp rx=0 tx=0).stop 2024-04-25T09:10:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 -- 172.21.15.59:0/145603580 shutdown_connections 2024-04-25T09:10:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb74066f60 0x7fbb74069420 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb98145400 0x7fbb9815abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb98145020 0x7fbb9813f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 --2- 172.21.15.59:0/145603580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb9806ac10 0x7fbb9815a400 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 -- 172.21.15.59:0/145603580 >> 172.21.15.59:0/145603580 conn(0x7fbb980b2400 msgr2=0x7fbb980b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 -- 172.21.15.59:0/145603580 shutdown_connections 2024-04-25T09:10:14.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.019+0000 7fbb9e200640 1 -- 172.21.15.59:0/145603580 wait complete. 2024-04-25T09:10:14.430 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 87, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:10:08.100794+0000', 'modified': '2024-04-25T09:10:11.103823+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8322': {'gid': 8322, 'name': 'a', 'rank': 0, 'incarnation': 83, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/2867303658', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 2867303658}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2867303658}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:10:14.430 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:10:14.430 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:10:14.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f1305000640 1 Processor -- start 2024-04-25T09:10:14.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f1305000640 1 -- start start 2024-04-25T09:10:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f1305000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000af2f0 0x7f130015e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f1305000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f130006c330 0x7f13000b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f1305000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130006e900 con 0x7f130006e140 2024-04-25T09:10:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f1305000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13000b2ce0 con 0x7f130006c330 2024-04-25T09:10:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f1305000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130006ebe0 con 0x7f13000af2f0 2024-04-25T09:10:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12f6a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f130006e140 0x7f130006bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50698/0 (socket says 172.21.15.59:50698) 2024-04-25T09:10:14.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12f6a00640 1 -- 172.21.15.59:0/1445304154 learned_addr learned my addr 172.21.15.59:0/1445304154 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:14.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12ff400640 1 --2- 172.21.15.59:0/1445304154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000af2f0 0x7f130015e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12ffe00640 1 --2- 172.21.15.59:0/1445304154 >> v2:172.21.15.178:3300/0 conn(0x7f130006c330 0x7f13000b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1658623075 0 0) 0x7f130006e900 con 0x7f130006e140 2024-04-25T09:10:14.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12e4003530 con 0x7f130006e140 2024-04-25T09:10:14.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3567571178 0 0) 0x7f12e4003530 con 0x7f130006e140 2024-04-25T09:10:14.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000af2f0 msgr2=0x7f130015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12fea00640 1 --2- 172.21.15.59:0/1445304154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000af2f0 0x7f130015e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 >> v2:172.21.15.178:3300/0 conn(0x7f130006c330 msgr2=0x7f13000b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12fea00640 1 --2- 172.21.15.59:0/1445304154 >> v2:172.21.15.178:3300/0 conn(0x7f130006c330 0x7f13000b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130006eec0 con 0x7f130006e140 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.587+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f12e8001a00 con 0x7f130006e140 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 >> v1:172.21.15.59:6789/0 conn(0x7f130006e140 legacy=0x7f130006bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12fea00640 1 --2- 172.21.15.59:0/1445304154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000af2f0 0x7f12e40039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12fea00640 1 --2- 172.21.15.59:0/1445304154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12e4003f40 0x7f12e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12fea00640 1 --2- 172.21.15.59:0/1445304154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4004d50 0x7f12e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13000b2ce0 con 0x7f12e4004d50 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130006ebe0 con 0x7f12e4003f40 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e400b9d0 con 0x7f13000af2f0 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12ffe00640 1 --2- 172.21.15.59:0/1445304154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4004d50 0x7f12e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12ff400640 1 --2- 172.21.15.59:0/1445304154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000af2f0 0x7f12e40039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12f6a00640 1 --2- 172.21.15.59:0/1445304154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12e4003f40 0x7f12e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12ffe00640 1 -- 172.21.15.59:0/1445304154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000af2f0 msgr2=0x7f12e40039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12ffe00640 1 --2- 172.21.15.59:0/1445304154 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f13000af2f0 0x7f12e40039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12ffe00640 1 -- 172.21.15.59:0/1445304154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12e4003f40 msgr2=0x7f12e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12ffe00640 1 --2- 172.21.15.59:0/1445304154 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f12e4003f40 0x7f12e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12ffe00640 1 -- 172.21.15.59:0/1445304154 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e4003530 con 0x7f12e4004d50 2024-04-25T09:10:14.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12ffe00640 1 --2- 172.21.15.59:0/1445304154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4004d50 0x7f12e40051d0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009ae0 tx=0x7f12f801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58da66fff1d827bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f80b2070 con 0x7f12e4004d50 2024-04-25T09:10:14.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f80a56a0 con 0x7f12e4004d50 2024-04-25T09:10:14.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.591+0000 7f12fea00640 1 -- 172.21.15.59:0/1445304154 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f80096b0 con 0x7f12e4004d50 2024-04-25T09:10:14.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 -- 172.21.15.59:0/1445304154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4004d50 msgr2=0x7f12e40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 --2- 172.21.15.59:0/1445304154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e4004d50 0x7f12e40051d0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f12f8009ae0 tx=0x7f12f801ca50 comp rx=0 tx=0).stop 2024-04-25T09:10:14.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f12ffe00640 1 -- 172.21.15.59:0/1445304154 reap_dead start 2024-04-25T09:10:14.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 -- 172.21.15.59:0/1445304154 shutdown_connections 2024-04-25T09:10:14.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 -- 172.21.15.59:0/1445304154 >> 172.21.15.59:0/1445304154 conn(0x7f1300071930 msgr2=0x7f1300071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 -- 172.21.15.59:0/1445304154 shutdown_connections 2024-04-25T09:10:14.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 -- 172.21.15.59:0/1445304154 wait complete. 2024-04-25T09:10:14.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 Processor -- start 2024-04-25T09:10:14.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 -- start start 2024-04-25T09:10:14.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12e4004d50 0x7f130014b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13000b40c0 0x7f13000b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1300158130 0x7f13001585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.586 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130015e8b0 con 0x7f1300158130 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130006f1a0 con 0x7f13000b40c0 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f1305000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130015ea30 con 0x7f12e4004d50 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f12ffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1300158130 0x7f13001585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f12ffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1300158130 0x7f13001585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60340/0 (socket says 172.21.15.59:60340) 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f12ffe00640 1 -- 172.21.15.59:0/1425397999 learned_addr learned my addr 172.21.15.59:0/1425397999 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f12ff400640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12e4004d50 0x7f130014b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f12f6a00640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13000b40c0 0x7f13000b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f12ffe00640 1 -- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12e4004d50 msgr2=0x7f130014b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f12ffe00640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12e4004d50 0x7f130014b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f12ffe00640 1 -- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13000b40c0 msgr2=0x7f13000b4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f12ffe00640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13000b40c0 0x7f13000b4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.595+0000 7f12ffe00640 1 -- 172.21.15.59:0/1425397999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13000cd6c0 con 0x7f1300158130 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.599+0000 7f12ffe00640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1300158130 0x7f13001585b0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f12f80b0040 tx=0x7f12e4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.599+0000 7f12f7e00640 1 -- 172.21.15.59:0/1425397999 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f80b2040 con 0x7f1300158130 2024-04-25T09:10:14.587 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.599+0000 7f12f7e00640 1 -- 172.21.15.59:0/1425397999 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f8000e50 con 0x7f1300158130 2024-04-25T09:10:14.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.599+0000 7f12f7e00640 1 -- 172.21.15.59:0/1425397999 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f80096b0 con 0x7f1300158130 2024-04-25T09:10:14.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.599+0000 7f1305000640 1 -- 172.21.15.59:0/1425397999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1300158ea0 con 0x7f1300158130 2024-04-25T09:10:14.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.599+0000 7f1305000640 1 -- 172.21.15.59:0/1425397999 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1300159460 con 0x7f1300158130 2024-04-25T09:10:14.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.599+0000 7f12f7e00640 1 -- 172.21.15.59:0/1425397999 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f12f8004240 con 0x7f1300158130 2024-04-25T09:10:14.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12f7e00640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f12dc066f90 0x7f12dc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12f7e00640 1 -- 172.21.15.59:0/1425397999 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f12f811e9c0 con 0x7f1300158130 2024-04-25T09:10:14.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 Processor -- start 2024-04-25T09:10:14.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12ff400640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f12dc066f90 0x7f12dc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 -- start start 2024-04-25T09:10:14.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12ff400640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f12dc066f90 0x7f12dc069450 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009b20 tx=0x7f12f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 0x55af122d4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d5240 0x55af1228a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af1228af30 0x55af1228b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af121725f0 con 0x55af122d4920 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af120d9da0 con 0x55af122d5240 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af12062150 con 0x55af1228af30 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12ff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 0x55af122d4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12ff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 0x55af122d4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60342/0 (socket says 172.21.15.59:60342) 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12ff400640 1 -- 172.21.15.59:0/1522830206 learned_addr learned my addr 172.21.15.59:0/1522830206 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12ff400640 1 -- 172.21.15.59:0/1522830206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af1228af30 msgr2=0x55af1228b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12ff400640 1 --2- 172.21.15.59:0/1522830206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af1228af30 0x55af1228b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12ff400640 1 -- 172.21.15.59:0/1522830206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d5240 msgr2=0x55af1228a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12ff400640 1 --2- 172.21.15.59:0/1522830206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d5240 0x55af1228a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12ff400640 1 -- 172.21.15.59:0/1522830206 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af1207bca0 con 0x55af122d4920 2024-04-25T09:10:14.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12ff400640 1 --2- 172.21.15.59:0/1522830206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 0x55af122d4d00 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f12f0014e40 tx=0x7f12f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a397f3230b59e61d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12efe00640 1 -- 172.21.15.59:0/1522830206 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0027070 con 0x55af122d4920 2024-04-25T09:10:14.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12efe00640 1 -- 172.21.15.59:0/1522830206 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f0009770 con 0x55af122d4920 2024-04-25T09:10:14.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f12efe00640 1 -- 172.21.15.59:0/1522830206 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0023860 con 0x55af122d4920 2024-04-25T09:10:14.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 -- 172.21.15.59:0/1522830206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 msgr2=0x55af122d4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 --2- 172.21.15.59:0/1522830206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 0x55af122d4d00 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f12f0014e40 tx=0x7f12f0017000 comp rx=0 tx=0).stop 2024-04-25T09:10:14.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 -- 172.21.15.59:0/1522830206 shutdown_connections 2024-04-25T09:10:14.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 --2- 172.21.15.59:0/1522830206 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af1228af30 0x55af1228b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 --2- 172.21.15.59:0/1522830206 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d5240 0x55af1228a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 --2- 172.21.15.59:0/1522830206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 0x55af122d4d00 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 -- 172.21.15.59:0/1522830206 >> 172.21.15.59:0/1522830206 conn(0x55af122912a0 msgr2=0x55af122892d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 -- 172.21.15.59:0/1522830206 shutdown_connections 2024-04-25T09:10:14.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.603+0000 7f13099f4000 1 -- 172.21.15.59:0/1522830206 wait complete. 2024-04-25T09:10:14.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 1 -- start start 2024-04-25T09:10:14.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 1 Processor -- start 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af1228af30 0x55af122dbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af122d4920 0x55af122dc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d5240 0x55af1228eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af12094990 con 0x55af1228af30 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af120d5e40 con 0x55af122d5240 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af12065900 con 0x55af122d4920 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 10 client.0 _ll_register_callbacks cb 0x55af1218d1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af1228af30 0x55af122dbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ff400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af1228af30 0x55af122dbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60354/0 (socket says 172.21.15.59:60354) 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ff400640 1 -- 172.21.15.59:0/4121723121 learned_addr learned my addr 172.21.15.59:0/4121723121 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ffe00640 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d5240 0x55af1228eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12f6a00640 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af122d4920 0x55af122dc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ff400640 1 -- 172.21.15.59:0/4121723121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af122d4920 msgr2=0x55af122dc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ff400640 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af122d4920 0x55af122dc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ff400640 1 -- 172.21.15.59:0/4121723121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d5240 msgr2=0x55af1228eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ff400640 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d5240 0x55af1228eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ff400640 1 -- 172.21.15.59:0/4121723121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55af12092630 con 0x55af1228af30 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ffe00640 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d5240 0x55af1228eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ff400640 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af1228af30 0x55af122dbf00 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f12f0008010 tx=0x7f12f0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334171adce179e2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ecc00640 1 -- 172.21.15.59:0/4121723121 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0032070 con 0x55af1228af30 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 1 -- 172.21.15.59:0/4121723121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af12075a50 con 0x55af1228af30 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ecc00640 1 -- 172.21.15.59:0/4121723121 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f12f002c650 con 0x55af1228af30 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ecc00640 1 -- 172.21.15.59:0/4121723121 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12f0040050 con 0x55af1228af30 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 10 client.8454 fetch_fsmap learned FSMap version 87 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 1 -- 172.21.15.59:0/4121723121 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x55af120623a0 con 0x55af1228af30 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ecc00640 1 -- 172.21.15.59:0/4121723121 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55af12075a50 con 0x55af1228af30 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12ecc00640 1 -- 172.21.15.59:0/4121723121 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 87) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f12f0043020 con 0x55af1228af30 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 10 client.8454 fetch_fsmap finished waiting for FSMap version 87 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 10 client.8454 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:10:14.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 20 client.8454 populate_metadata read hostname 'smithi059' 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55af12290160 0x55af122e5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 4 client.8454 mds_command: new command op to 8322 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f13099f4000 1 -- 172.21.15.59:0/4121723121 --> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af120e72e0 con 0x55af12290160 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.607+0000 7f12f6a00640 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55af12290160 0x55af122e5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f12f6a00640 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55af12290160 0x55af122e5f60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=109a2e20322c07ee server_cookie=4cda757b81457da1 in_seq=0 out_seq=0 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f12ecc00640 10 client.8454 ms_handle_connect on v2:172.21.15.59:6833/2867303658 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f12ecc00640 1 -- 172.21.15.59:0/4121723121 <== mds.0 v2:172.21.15.59:6833/2867303658 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55af120e72e0 con 0x55af12290160 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f12ecc00640 10 client.8454 handle_command_reply: tid=0 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f13099f4000 1 client.8454 shutdown 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f13099f4000 1 -- 172.21.15.59:0/4121723121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af1228af30 msgr2=0x55af122dbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f13099f4000 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af1228af30 0x55af122dbf00 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f12f0008010 tx=0x7f12f0004740 comp rx=0 tx=0).stop 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f13099f4000 1 -- 172.21.15.59:0/4121723121 shutdown_connections 2024-04-25T09:10:14.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f13099f4000 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d5240 0x55af1228eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f13099f4000 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af122d4920 0x55af122dc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f13099f4000 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55af12290160 0x55af122e5f60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f13099f4000 1 --2- 172.21.15.59:0/4121723121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af1228af30 0x55af122dbf00 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f13099f4000 1 -- 172.21.15.59:0/4121723121 >> 172.21.15.59:0/4121723121 conn(0x55af122912a0 msgr2=0x55af122899e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f12ecc00640 0 client.8454 ms_handle_reset on v2:172.21.15.59:6833/2867303658 2024-04-25T09:10:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f13099f4000 1 -- 172.21.15.59:0/4121723121 shutdown_connections 2024-04-25T09:10:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f13099f4000 1 -- 172.21.15.59:0/4121723121 wait complete. 2024-04-25T09:10:14.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.611+0000 7f13099f4000 20 client.8454 trim_cache size 0 max 16384 2024-04-25T09:10:14.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 Processor -- start 2024-04-25T09:10:14.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 -- start start 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af1228af30 0x55af12330410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d4920 0x55af12330950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d5240 0x55af12330e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13001ff770 con 0x55af122d5240 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13001fec40 con 0x55af122d4920 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13001ff170 con 0x55af1228af30 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f12ffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d5240 0x55af12330e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f12ffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d5240 0x55af12330e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60358/0 (socket says 172.21.15.59:60358) 2024-04-25T09:10:14.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f12ffe00640 1 -- 172.21.15.59:0/3238068384 learned_addr learned my addr 172.21.15.59:0/3238068384 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f12ffe00640 1 -- 172.21.15.59:0/3238068384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af1228af30 msgr2=0x55af12330410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f12ffe00640 1 --2- 172.21.15.59:0/3238068384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af1228af30 0x55af12330410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f12ffe00640 1 -- 172.21.15.59:0/3238068384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d4920 msgr2=0x55af12330950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f12ffe00640 1 --2- 172.21.15.59:0/3238068384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d4920 0x55af12330950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f12ffe00640 1 -- 172.21.15.59:0/3238068384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af122d5070 con 0x55af122d5240 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f12ffe00640 1 --2- 172.21.15.59:0/3238068384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d5240 0x55af12330e90 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f12f801cfc0 tx=0x7f12f80eec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8953e0259df453bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f12ef400640 1 -- 172.21.15.59:0/3238068384 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8106070 con 0x55af122d5240 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f12ef400640 1 -- 172.21.15.59:0/3238068384 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f80a56a0 con 0x55af122d5240 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f12ef400640 1 -- 172.21.15.59:0/3238068384 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f80ef090 con 0x55af122d5240 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 -- 172.21.15.59:0/3238068384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d5240 msgr2=0x55af12330e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 --2- 172.21.15.59:0/3238068384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d5240 0x55af12330e90 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f12f801cfc0 tx=0x7f12f80eec90 comp rx=0 tx=0).stop 2024-04-25T09:10:14.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 -- 172.21.15.59:0/3238068384 shutdown_connections 2024-04-25T09:10:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 --2- 172.21.15.59:0/3238068384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d5240 0x55af12330e90 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 --2- 172.21.15.59:0/3238068384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af122d4920 0x55af12330950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 --2- 172.21.15.59:0/3238068384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af1228af30 0x55af12330410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 -- 172.21.15.59:0/3238068384 >> 172.21.15.59:0/3238068384 conn(0x55af122912a0 msgr2=0x55af122d2300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 -- 172.21.15.59:0/3238068384 shutdown_connections 2024-04-25T09:10:14.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.627+0000 7f13099f4000 1 -- 172.21.15.59:0/3238068384 wait complete. 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 1 -- start start 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 1 Processor -- start 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1228af30 0x55af122e0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 0x55af123192a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af122d5240 0x55af123197e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af120de3d0 con 0x55af122d4920 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af12195d50 con 0x55af1228af30 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af12074980 con 0x55af122d5240 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 10 client.0 _ll_register_callbacks cb 0x7f12f001a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12f6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 0x55af123192a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12f6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 0x55af123192a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60360/0 (socket says 172.21.15.59:60360) 2024-04-25T09:10:14.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12f6a00640 1 -- 172.21.15.59:0/3348891854 learned_addr learned my addr 172.21.15.59:0/3348891854 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12ffe00640 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af122d5240 0x55af123197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12ff400640 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1228af30 0x55af122e0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12f6a00640 1 -- 172.21.15.59:0/3348891854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af122d5240 msgr2=0x55af123197e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12f6a00640 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af122d5240 0x55af123197e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12f6a00640 1 -- 172.21.15.59:0/3348891854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1228af30 msgr2=0x55af122e0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12f6a00640 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1228af30 0x55af122e0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12f6a00640 1 -- 172.21.15.59:0/3348891854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55af1215b600 con 0x55af122d4920 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12f6a00640 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 0x55af123192a0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f12e8004c20 tx=0x7f12e801b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa215410bba979f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12ecc00640 1 -- 172.21.15.59:0/3348891854 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8007570 con 0x55af122d4920 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12ecc00640 1 -- 172.21.15.59:0/3348891854 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f12e8007710 con 0x55af122d4920 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 1 -- 172.21.15.59:0/3348891854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f12f80a56a0 con 0x55af122d4920 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12ecc00640 1 -- 172.21.15.59:0/3348891854 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12e802b050 con 0x55af122d4920 2024-04-25T09:10:14.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 10 client.8460 fetch_fsmap learned FSMap version 87 2024-04-25T09:10:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 1 -- 172.21.15.59:0/3348891854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x55af1206e9b0 con 0x55af122d4920 2024-04-25T09:10:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12ecc00640 1 -- 172.21.15.59:0/3348891854 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f80a56a0 con 0x55af122d4920 2024-04-25T09:10:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12ecc00640 1 -- 172.21.15.59:0/3348891854 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 87) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f12e802e020 con 0x55af122d4920 2024-04-25T09:10:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 10 client.8460 fetch_fsmap finished waiting for FSMap version 87 2024-04-25T09:10:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 10 client.8460 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:10:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 20 client.8460 populate_metadata read hostname 'smithi059' 2024-04-25T09:10:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55af12319d20 0x55af12335250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 4 client.8460 mds_command: new command op to 8322 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:10:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f13099f4000 1 -- 172.21.15.59:0/3348891854 --> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55af120e1630 con 0x55af12319d20 2024-04-25T09:10:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12ff400640 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55af12319d20 0x55af12335250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12ff400640 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55af12319d20 0x55af12335250 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df42e63c452af87d server_cookie=f2e68994af0e8db7 in_seq=0 out_seq=0 2024-04-25T09:10:14.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.631+0000 7f12ecc00640 10 client.8460 ms_handle_connect on v2:172.21.15.59:6833/2867303658 2024-04-25T09:10:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f12ecc00640 1 -- 172.21.15.59:0/3348891854 <== mds.0 v2:172.21.15.59:6833/2867303658 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55af120e1630 con 0x55af12319d20 2024-04-25T09:10:14.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f12ecc00640 10 client.8460 handle_command_reply: tid=0 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f13099f4000 1 client.8460 shutdown 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f13099f4000 1 -- 172.21.15.59:0/3348891854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 msgr2=0x55af123192a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f13099f4000 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 0x55af123192a0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f12e8004c20 tx=0x7f12e801b4d0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f13099f4000 1 -- 172.21.15.59:0/3348891854 shutdown_connections 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f13099f4000 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55af122d5240 0x55af123197e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f13099f4000 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55af12319d20 0x55af12335250 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f13099f4000 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55af122d4920 0x55af123192a0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f13099f4000 1 --2- 172.21.15.59:0/3348891854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55af1228af30 0x55af122e0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f12ecc00640 0 client.8460 ms_handle_reset on v2:172.21.15.59:6833/2867303658 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f13099f4000 1 -- 172.21.15.59:0/3348891854 >> 172.21.15.59:0/3348891854 conn(0x55af122912a0 msgr2=0x55af122d32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f13099f4000 1 -- 172.21.15.59:0/3348891854 shutdown_connections 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f13099f4000 1 -- 172.21.15.59:0/3348891854 wait complete. 2024-04-25T09:10:14.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f13099f4000 20 client.8460 trim_cache size 0 max 16384 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8322, 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 5.9382691330000004, 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 87, 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 109, 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 108, 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 10.7818004 2024-04-25T09:10:14.627 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:10:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f1305000640 1 -- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f12dc066f90 msgr2=0x7f12dc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f1305000640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f12dc066f90 0x7f12dc069450 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009b20 tx=0x7f12f0008040 comp rx=0 tx=0).stop 2024-04-25T09:10:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f1305000640 1 -- 172.21.15.59:0/1425397999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1300158130 msgr2=0x7f13001585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f1305000640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1300158130 0x7f13001585b0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f12f80b0040 tx=0x7f12e4005840 comp rx=0 tx=0).stop 2024-04-25T09:10:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f1305000640 1 -- 172.21.15.59:0/1425397999 shutdown_connections 2024-04-25T09:10:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f1305000640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f12dc066f90 0x7f12dc069450 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f1305000640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1300158130 0x7f13001585b0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f1305000640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f13000b40c0 0x7f13000b4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f1305000640 1 --2- 172.21.15.59:0/1425397999 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12e4004d50 0x7f130014b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f1305000640 1 -- 172.21.15.59:0/1425397999 >> 172.21.15.59:0/1425397999 conn(0x7f1300071930 msgr2=0x7f13001551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f1305000640 1 -- 172.21.15.59:0/1425397999 shutdown_connections 2024-04-25T09:10:14.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.635+0000 7f1305000640 1 -- 172.21.15.59:0/1425397999 wait complete. 2024-04-25T09:10:14.643 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:10:14.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f245ac00640 1 Processor -- start 2024-04-25T09:10:14.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f245ac00640 1 -- start start 2024-04-25T09:10:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f245ac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454144140 0x7f24540ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f245ac00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f245406ead0 0x7f24540b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f245ac00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245415ac60 con 0x7f24540ced60 2024-04-25T09:10:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f245ac00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24540cf3e0 con 0x7f245406ead0 2024-04-25T09:10:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f245ac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245415af20 con 0x7f2454144140 2024-04-25T09:10:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f244b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f24540ced60 0x7f245406e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50706/0 (socket says 172.21.15.59:50706) 2024-04-25T09:10:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f244b400640 1 -- 172.21.15.59:0/55250380 learned_addr learned my addr 172.21.15.59:0/55250380 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:14.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f2458c00640 1 --2- 172.21.15.59:0/55250380 >> v2:172.21.15.178:3300/0 conn(0x7f245406ead0 0x7f24540b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f2453e00640 1 --2- 172.21.15.59:0/55250380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454144140 0x7f24540ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564654863 0 0) 0x7f245415ac60 con 0x7f24540ced60 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.795+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2438003530 con 0x7f24540ced60 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2339522998 0 0) 0x7f2438003530 con 0x7f24540ced60 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454144140 msgr2=0x7f24540ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 --2- 172.21.15.59:0/55250380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454144140 0x7f24540ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 >> v2:172.21.15.178:3300/0 conn(0x7f245406ead0 msgr2=0x7f24540b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 --2- 172.21.15.59:0/55250380 >> v2:172.21.15.178:3300/0 conn(0x7f245406ead0 0x7f24540b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245415b200 con 0x7f24540ced60 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f2444001680 con 0x7f24540ced60 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 >> v1:172.21.15.59:6789/0 conn(0x7f24540ced60 legacy=0x7f245406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 --2- 172.21.15.59:0/55250380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454144140 0x7f24380039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 --2- 172.21.15.59:0/55250380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2438003f40 0x7f2438004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 --2- 172.21.15.59:0/55250380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2438004d50 0x7f24380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24540cf3e0 con 0x7f2438004d50 2024-04-25T09:10:14.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245415af20 con 0x7f2438003f40 2024-04-25T09:10:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243800b9d0 con 0x7f2454144140 2024-04-25T09:10:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2458c00640 1 --2- 172.21.15.59:0/55250380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2438004d50 0x7f24380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2453e00640 1 --2- 172.21.15.59:0/55250380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454144140 0x7f24380039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f244b400640 1 --2- 172.21.15.59:0/55250380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2438003f40 0x7f2438004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2458c00640 1 -- 172.21.15.59:0/55250380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454144140 msgr2=0x7f24380039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2458c00640 1 --2- 172.21.15.59:0/55250380 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454144140 0x7f24380039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2458c00640 1 -- 172.21.15.59:0/55250380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2438003f40 msgr2=0x7f2438004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2458c00640 1 --2- 172.21.15.59:0/55250380 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2438003f40 0x7f2438004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2458c00640 1 -- 172.21.15.59:0/55250380 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2438003530 con 0x7f2438004d50 2024-04-25T09:10:14.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.799+0000 7f2458c00640 1 --2- 172.21.15.59:0/55250380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2438004d50 0x7f24380051d0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f24540cc540 tx=0x7f244c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fdb92b4918d76d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0b2070 con 0x7f2438004d50 2024-04-25T09:10:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c0a5c70 con 0x7f2438004d50 2024-04-25T09:10:14.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f2453400640 1 -- 172.21.15.59:0/55250380 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c009c10 con 0x7f2438004d50 2024-04-25T09:10:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 -- 172.21.15.59:0/55250380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2438004d50 msgr2=0x7f24380051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 --2- 172.21.15.59:0/55250380 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2438004d50 0x7f24380051d0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f24540cc540 tx=0x7f244c01cc00 comp rx=0 tx=0).stop 2024-04-25T09:10:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f2458c00640 1 -- 172.21.15.59:0/55250380 reap_dead start 2024-04-25T09:10:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 -- 172.21.15.59:0/55250380 shutdown_connections 2024-04-25T09:10:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 -- 172.21.15.59:0/55250380 >> 172.21.15.59:0/55250380 conn(0x7f2454066fa0 msgr2=0x7f245406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 -- 172.21.15.59:0/55250380 shutdown_connections 2024-04-25T09:10:14.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 -- 172.21.15.59:0/55250380 wait complete. 2024-04-25T09:10:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 Processor -- start 2024-04-25T09:10:14.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 -- start start 2024-04-25T09:10:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2438004d50 0x7f245415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454136b20 0x7f2454137ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2454136fa0 0x7f24541383e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2454144520 con 0x7f2438004d50 2024-04-25T09:10:14.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24540b1f30 con 0x7f2454136fa0 2024-04-25T09:10:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f245ac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245415ba00 con 0x7f2454136b20 2024-04-25T09:10:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f2453e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2438004d50 0x7f245415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f2453e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2438004d50 0x7f245415ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60380/0 (socket says 172.21.15.59:60380) 2024-04-25T09:10:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f2453e00640 1 -- 172.21.15.59:0/817869420 learned_addr learned my addr 172.21.15.59:0/817869420 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f244b400640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454136b20 0x7f2454137ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.803+0000 7f2458c00640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2454136fa0 0x7f24541383e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f2453e00640 1 -- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454136b20 msgr2=0x7f2454137ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f2453e00640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454136b20 0x7f2454137ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f2453e00640 1 -- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2454136fa0 msgr2=0x7f24541383e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f2453e00640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2454136fa0 0x7f24541383e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f2453e00640 1 -- 172.21.15.59:0/817869420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24540c9cb0 con 0x7f2438004d50 2024-04-25T09:10:14.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f2453e00640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2438004d50 0x7f245415ead0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f243c011a00 tx=0x7f243c011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f2450c00640 1 -- 172.21.15.59:0/817869420 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c00faf0 con 0x7f2438004d50 2024-04-25T09:10:14.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f2450c00640 1 -- 172.21.15.59:0/817869420 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f243c00fc90 con 0x7f2438004d50 2024-04-25T09:10:14.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f2450c00640 1 -- 172.21.15.59:0/817869420 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243c014440 con 0x7f2438004d50 2024-04-25T09:10:14.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f245ac00640 1 -- 172.21.15.59:0/817869420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245413a860 con 0x7f2438004d50 2024-04-25T09:10:14.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f245ac00640 1 -- 172.21.15.59:0/817869420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245413a2a0 con 0x7f2438004d50 2024-04-25T09:10:14.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f245ac00640 1 -- 172.21.15.59:0/817869420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24540745d0 con 0x7f2438004d50 2024-04-25T09:10:14.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.807+0000 7f2450c00640 1 -- 172.21.15.59:0/817869420 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f243c012040 con 0x7f2438004d50 2024-04-25T09:10:14.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.811+0000 7f2450c00640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2430066f30 0x7f24300693f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:14.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.811+0000 7f2450c00640 1 -- 172.21.15.59:0/817869420 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f243c085780 con 0x7f2438004d50 2024-04-25T09:10:14.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.811+0000 7f244b400640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2430066f30 0x7f24300693f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:14.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.811+0000 7f244b400640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2430066f30 0x7f24300693f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f24540b4cd0 tx=0x7f2444007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:14.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:14.815+0000 7f2450c00640 1 -- 172.21.15.59:0/817869420 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f24540c9cb0 con 0x7f2438004d50 2024-04-25T09:10:14.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.007+0000 7f245ac00640 1 -- 172.21.15.59:0/817869420 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f24540b18b0 con 0x7f2438004d50 2024-04-25T09:10:14.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.007+0000 7f2450c00640 1 -- 172.21.15.59:0/817869420 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v87) v1 ==== 53+0+73 (secure 0 0 0) 0x7f243c019030 con 0x7f2438004d50 2024-04-25T09:10:14.997 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:10:14.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.011+0000 7f245ac00640 1 -- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2430066f30 msgr2=0x7f24300693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.011+0000 7f245ac00640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2430066f30 0x7f24300693f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f24540b4cd0 tx=0x7f2444007900 comp rx=0 tx=0).stop 2024-04-25T09:10:14.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.011+0000 7f245ac00640 1 -- 172.21.15.59:0/817869420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2438004d50 msgr2=0x7f245415ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:14.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.011+0000 7f245ac00640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2438004d50 0x7f245415ead0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f243c011a00 tx=0x7f243c011e00 comp rx=0 tx=0).stop 2024-04-25T09:10:14.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.011+0000 7f245ac00640 1 -- 172.21.15.59:0/817869420 shutdown_connections 2024-04-25T09:10:15.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.011+0000 7f245ac00640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2430066f30 0x7f24300693f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.011+0000 7f245ac00640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2454136fa0 0x7f24541383e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.011+0000 7f245ac00640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f2454136b20 0x7f2454137ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.011+0000 7f245ac00640 1 --2- 172.21.15.59:0/817869420 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2438004d50 0x7f245415ead0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:15.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.011+0000 7f245ac00640 1 -- 172.21.15.59:0/817869420 >> 172.21.15.59:0/817869420 conn(0x7f2454066fa0 msgr2=0x7f24540cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:15.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.011+0000 7f245ac00640 1 -- 172.21.15.59:0/817869420 shutdown_connections 2024-04-25T09:10:15.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:15.011+0000 7f245ac00640 1 -- 172.21.15.59:0/817869420 wait complete. 2024-04-25T09:10:15.019 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:10:15.019 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:10:15.019 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:10:15.019 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:10:15.019 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:15.019 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:10:15.019 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:10:15.019 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:10:15.019 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:15.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:15.020 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:10:15.029 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:10:15.029 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:10:15.029 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41953sec preferred_lft 41953sec 2024-04-25T09:10:15.030 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:15.031 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:10:15.032 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:10:15.032 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:10:15.032 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:15.032 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:10:15.032 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:10:15.032 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:10:15.032 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:15.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:15.032 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:10:15.095 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:10:15.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:15.098 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:10:15.151 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:10:15.151 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:10:15.151 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:10:15.151 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:10:15.151 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:10:15.151 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:10:15.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:15.151 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:10:15.152 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:10:15.152 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:10:15.152 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:10:15.152 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:10:15.152 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:10:15.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:15.244 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:10:15.252 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:10:15.252 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:10:15.253 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:15.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:15.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:10:15.318 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:10:15.318 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:15.369 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:15.370 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:10:15.370 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:15.421 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:10:15.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:15.421 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:15.510 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:15.510 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:15.510 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:10:15.526 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:15.526 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:15.526 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:10:15.526 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:10:15.526 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:10:15.537 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:15.537 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:15.537 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:10:15.537 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:10:15.537 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:10:15.537 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:10:15.537 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:10:15.537 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:10:15.541 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:10:15.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:15.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:15.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:15.561 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:10:15.623 INFO:teuthology.orchestra.run.smithi059.stdout:client7127 2024-04-25T09:10:15.623 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:10:15.623 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:15.678 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:10:15.678 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:15.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:15.730 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T09:10:15.875 INFO:teuthology.orchestra.run.smithi059.stderr:6+0 records in 2024-04-25T09:10:15.875 INFO:teuthology.orchestra.run.smithi059.stderr:6+0 records out 2024-04-25T09:10:15.875 INFO:teuthology.orchestra.run.smithi059.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0875779 s, 71.8 MB/s 2024-04-25T09:10:15.876 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:10:15.876 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:15.885 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:10:15.885 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:15.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:16.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.131+0000 7f9066000640 1 Processor -- start 2024-04-25T09:10:16.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.131+0000 7f9066000640 1 -- start start 2024-04-25T09:10:16.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9066000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9060144140 0x7f90600ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9066000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90600ced60 0x7f906006e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9066000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906006e900 0x7f906015e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9066000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906006ed70 con 0x7f90600ced60 2024-04-25T09:10:16.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9066000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906015ac60 con 0x7f9060144140 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9066000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90600cf3e0 con 0x7f906006e900 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9057e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90600ced60 0x7f906006e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9057e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90600ced60 0x7f906006e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60394/0 (socket says 172.21.15.59:60394) 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9057e00640 1 -- 172.21.15.59:0/539762164 learned_addr learned my addr 172.21.15.59:0/539762164 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f905f400640 1 --2- 172.21.15.59:0/539762164 >> v2:172.21.15.178:3300/0 conn(0x7f9060144140 0x7f90600ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9057e00640 1 -- 172.21.15.59:0/539762164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906006e900 msgr2=0x7f906015e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f905fe00640 1 --2- 172.21.15.59:0/539762164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906006e900 0x7f906015e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9057e00640 1 --2- 172.21.15.59:0/539762164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906006e900 0x7f906015e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9057e00640 1 -- 172.21.15.59:0/539762164 >> v2:172.21.15.178:3300/0 conn(0x7f9060144140 msgr2=0x7f90600ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9057e00640 1 --2- 172.21.15.59:0/539762164 >> v2:172.21.15.178:3300/0 conn(0x7f9060144140 0x7f90600ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9057e00640 1 -- 172.21.15.59:0/539762164 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906015af20 con 0x7f90600ced60 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f905f400640 1 --2- 172.21.15.59:0/539762164 >> v2:172.21.15.178:3300/0 conn(0x7f9060144140 0x7f90600ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:16.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f905fe00640 1 --2- 172.21.15.59:0/539762164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906006e900 0x7f906015e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:16.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f9057e00640 1 --2- 172.21.15.59:0/539762164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90600ced60 0x7f906006e3c0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f906006eef0 tx=0x7f904801c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4452b69e1383eaf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.135+0000 7f905ea00640 1 -- 172.21.15.59:0/539762164 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90480b0070 con 0x7f90600ced60 2024-04-25T09:10:16.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f905ea00640 1 -- 172.21.15.59:0/539762164 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90480ab600 con 0x7f90600ced60 2024-04-25T09:10:16.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f905ea00640 1 -- 172.21.15.59:0/539762164 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90480ab9d0 con 0x7f90600ced60 2024-04-25T09:10:16.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 -- 172.21.15.59:0/539762164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90600ced60 msgr2=0x7f906006e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 --2- 172.21.15.59:0/539762164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90600ced60 0x7f906006e3c0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f906006eef0 tx=0x7f904801c260 comp rx=0 tx=0).stop 2024-04-25T09:10:16.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 -- 172.21.15.59:0/539762164 shutdown_connections 2024-04-25T09:10:16.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 --2- 172.21.15.59:0/539762164 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f906006e900 0x7f906015e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 --2- 172.21.15.59:0/539762164 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90600ced60 0x7f906006e3c0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 --2- 172.21.15.59:0/539762164 >> v2:172.21.15.178:3300/0 conn(0x7f9060144140 0x7f90600ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 -- 172.21.15.59:0/539762164 >> 172.21.15.59:0/539762164 conn(0x7f9060066fa0 msgr2=0x7f906006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:16.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 -- 172.21.15.59:0/539762164 shutdown_connections 2024-04-25T09:10:16.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 -- 172.21.15.59:0/539762164 wait complete. 2024-04-25T09:10:16.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 Processor -- start 2024-04-25T09:10:16.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 -- start start 2024-04-25T09:10:16.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906006e900 0x7f9060139650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90600ced60 0x7f90601643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9060144140 0x7f9060161860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906015ba00 con 0x7f906006e900 2024-04-25T09:10:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9060144520 con 0x7f90600ced60 2024-04-25T09:10:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9066000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906015bb80 con 0x7f9060144140 2024-04-25T09:10:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f905f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906006e900 0x7f9060139650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f905f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906006e900 0x7f9060139650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60410/0 (socket says 172.21.15.59:60410) 2024-04-25T09:10:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f905f400640 1 -- 172.21.15.59:0/176744444 learned_addr learned my addr 172.21.15.59:0/176744444 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f9057e00640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90600ced60 0x7f90601643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f905fe00640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9060144140 0x7f9060161860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.139+0000 7f905f400640 1 -- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9060144140 msgr2=0x7f9060161860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f905f400640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9060144140 0x7f9060161860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f905f400640 1 -- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90600ced60 msgr2=0x7f90601643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f905f400640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90600ced60 0x7f90601643e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f905f400640 1 -- 172.21.15.59:0/176744444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9060164d50 con 0x7f906006e900 2024-04-25T09:10:16.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f905fe00640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9060144140 0x7f9060161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:16.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f905f400640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906006e900 0x7f9060139650 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f905000c7c0 tx=0x7f905000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f9057400640 1 -- 172.21.15.59:0/176744444 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9050007a30 con 0x7f906006e900 2024-04-25T09:10:16.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f9057400640 1 -- 172.21.15.59:0/176744444 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9050007bd0 con 0x7f906006e900 2024-04-25T09:10:16.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f9057400640 1 -- 172.21.15.59:0/176744444 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90500113f0 con 0x7f906006e900 2024-04-25T09:10:16.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f9066000640 1 -- 172.21.15.59:0/176744444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9060165030 con 0x7f906006e900 2024-04-25T09:10:16.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f9066000640 1 -- 172.21.15.59:0/176744444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906013e950 con 0x7f906006e900 2024-04-25T09:10:16.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f9066000640 1 -- 172.21.15.59:0/176744444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90600745d0 con 0x7f906006e900 2024-04-25T09:10:16.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f9057400640 1 -- 172.21.15.59:0/176744444 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9050011590 con 0x7f906006e900 2024-04-25T09:10:16.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f9057400640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f903c066f60 0x7f903c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f9057400640 1 -- 172.21.15.59:0/176744444 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f90500852f0 con 0x7f906006e900 2024-04-25T09:10:16.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.143+0000 7f9057e00640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f903c066f60 0x7f903c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.147+0000 7f9057e00640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f903c066f60 0x7f903c069420 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f90480ad000 tx=0x7f9048008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.138 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.147+0000 7f9057400640 1 -- 172.21.15.59:0/176744444 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9050015020 con 0x7f906006e900 2024-04-25T09:10:16.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.311+0000 7f9066000640 1 -- 172.21.15.59:0/176744444 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90600cbcd0 con 0x7f906006e900 2024-04-25T09:10:16.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.311+0000 7f9057400640 1 -- 172.21.15.59:0/176744444 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16982 (secure 0 0 0) 0x7f9050055ae0 con 0x7f906006e900 2024-04-25T09:10:16.302 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:16.302 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":109,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:10:11.719041+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:06.512267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:07.092321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.24","mappings":[{"from":5,"to":4}]},{"pgid":"16.36","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.315+0000 7f9066000640 1 -- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f903c066f60 msgr2=0x7f903c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.315+0000 7f9066000640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f903c066f60 0x7f903c069420 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f90480ad000 tx=0x7f9048008040 comp rx=0 tx=0).stop 2024-04-25T09:10:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.315+0000 7f9066000640 1 -- 172.21.15.59:0/176744444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906006e900 msgr2=0x7f9060139650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.315+0000 7f9066000640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906006e900 0x7f9060139650 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f905000c7c0 tx=0x7f905000cc80 comp rx=0 tx=0).stop 2024-04-25T09:10:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.315+0000 7f9066000640 1 -- 172.21.15.59:0/176744444 shutdown_connections 2024-04-25T09:10:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.315+0000 7f9066000640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f903c066f60 0x7f903c069420 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.315+0000 7f9066000640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9060144140 0x7f9060161860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.315+0000 7f9066000640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90600ced60 0x7f90601643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.315+0000 7f9066000640 1 --2- 172.21.15.59:0/176744444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f906006e900 0x7f9060139650 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.315+0000 7f9066000640 1 -- 172.21.15.59:0/176744444 >> 172.21.15.59:0/176744444 conn(0x7f9060066fa0 msgr2=0x7f906013ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.315+0000 7f9066000640 1 -- 172.21.15.59:0/176744444 shutdown_connections 2024-04-25T09:10:16.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.315+0000 7f9066000640 1 -- 172.21.15.59:0/176744444 wait complete. 2024-04-25T09:10:16.323 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:10:06.512267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:10:07.092321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:10:16.324 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:10:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.479+0000 7f8e64600640 1 Processor -- start 2024-04-25T09:10:16.469 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.479+0000 7f8e64600640 1 -- start start 2024-04-25T09:10:16.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.479+0000 7f8e64600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8e5c15dd90 0x7f8e5c071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e64600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e5c072040 0x7f8e5c161780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e64600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c072460 con 0x7f8e5c161cc0 2024-04-25T09:10:16.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e64600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c0b2dc0 con 0x7f8e5c072040 2024-04-25T09:10:16.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e64600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c06ac10 con 0x7f8e5c15dd90 2024-04-25T09:10:16.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e61200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e5c072040 0x7f8e5c161780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e61200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e5c072040 0x7f8e5c161780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60420/0 (socket says 172.21.15.59:60420) 2024-04-25T09:10:16.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e61200640 1 -- 172.21.15.59:0/3968697108 learned_addr learned my addr 172.21.15.59:0/3968697108 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:16.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e61200640 1 -- 172.21.15.59:0/3968697108 >> v2:172.21.15.178:3300/0 conn(0x7f8e5c15dd90 msgr2=0x7f8e5c071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:16.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e61c00640 1 --2- 172.21.15.59:0/3968697108 >> v2:172.21.15.178:3300/0 conn(0x7f8e5c15dd90 0x7f8e5c071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e61200640 1 --2- 172.21.15.59:0/3968697108 >> v2:172.21.15.178:3300/0 conn(0x7f8e5c15dd90 0x7f8e5c071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e61200640 1 -- 172.21.15.59:0/3968697108 >> v1:172.21.15.178:6789/0 conn(0x7f8e5c161cc0 legacy=0x7f8e5c0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:16.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e61200640 1 -- 172.21.15.59:0/3968697108 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c06aeb0 con 0x7f8e5c072040 2024-04-25T09:10:16.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e61c00640 1 --2- 172.21.15.59:0/3968697108 >> v2:172.21.15.178:3300/0 conn(0x7f8e5c15dd90 0x7f8e5c071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e61200640 1 --2- 172.21.15.59:0/3968697108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5c072040 0x7f8e5c161780 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c070be0 tx=0x7f8e4801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242d8f90c5a319ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.483+0000 7f8e5be00640 1 -- 172.21.15.59:0/3968697108 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480b0070 con 0x7f8e5c072040 2024-04-25T09:10:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e5be00640 1 -- 172.21.15.59:0/3968697108 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e480ab600 con 0x7f8e5c072040 2024-04-25T09:10:16.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e5be00640 1 -- 172.21.15.59:0/3968697108 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480ab9d0 con 0x7f8e5c072040 2024-04-25T09:10:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 -- 172.21.15.59:0/3968697108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5c072040 msgr2=0x7f8e5c161780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 --2- 172.21.15.59:0/3968697108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5c072040 0x7f8e5c161780 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c070be0 tx=0x7f8e4801c450 comp rx=0 tx=0).stop 2024-04-25T09:10:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 -- 172.21.15.59:0/3968697108 shutdown_connections 2024-04-25T09:10:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 --2- 172.21.15.59:0/3968697108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5c072040 0x7f8e5c161780 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 --2- 172.21.15.59:0/3968697108 >> v2:172.21.15.178:3300/0 conn(0x7f8e5c15dd90 0x7f8e5c071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 -- 172.21.15.59:0/3968697108 >> 172.21.15.59:0/3968697108 conn(0x7f8e5c0cfd90 msgr2=0x7f8e5c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:16.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 -- 172.21.15.59:0/3968697108 shutdown_connections 2024-04-25T09:10:16.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 -- 172.21.15.59:0/3968697108 wait complete. 2024-04-25T09:10:16.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 Processor -- start 2024-04-25T09:10:16.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 -- start start 2024-04-25T09:10:16.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e5c072040 0x7f8e5c0af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5c15dd90 0x7f8e5c15a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e5c161cc0 0x7f8e5c150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c16aac0 con 0x7f8e5c15dd90 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1624e0 con 0x7f8e5c161cc0 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e64600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c16ac40 con 0x7f8e5c072040 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e61200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5c15dd90 0x7f8e5c15a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e61200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5c15dd90 0x7f8e5c15a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60436/0 (socket says 172.21.15.59:60436) 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e61200640 1 -- 172.21.15.59:0/4069806701 learned_addr learned my addr 172.21.15.59:0/4069806701 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e61200640 1 -- 172.21.15.59:0/4069806701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e5c072040 msgr2=0x7f8e5c0af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e61200640 1 --2- 172.21.15.59:0/4069806701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e5c072040 0x7f8e5c0af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e61200640 1 -- 172.21.15.59:0/4069806701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e5c161cc0 msgr2=0x7f8e5c150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e61200640 1 --2- 172.21.15.59:0/4069806701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e5c161cc0 0x7f8e5c150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.487+0000 7f8e61200640 1 -- 172.21.15.59:0/4069806701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c0acda0 con 0x7f8e5c15dd90 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.491+0000 7f8e61200640 1 --2- 172.21.15.59:0/4069806701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5c15dd90 0x7f8e5c15a940 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f8e4801a080 tx=0x7f8e480191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.491+0000 7f8e59600640 1 -- 172.21.15.59:0/4069806701 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480b0040 con 0x7f8e5c15dd90 2024-04-25T09:10:16.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.491+0000 7f8e59600640 1 -- 172.21.15.59:0/4069806701 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e480b4440 con 0x7f8e5c15dd90 2024-04-25T09:10:16.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.491+0000 7f8e59600640 1 -- 172.21.15.59:0/4069806701 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e480b4850 con 0x7f8e5c15dd90 2024-04-25T09:10:16.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.491+0000 7f8e64600640 1 -- 172.21.15.59:0/4069806701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c1fa2b0 con 0x7f8e5c15dd90 2024-04-25T09:10:16.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.491+0000 7f8e64600640 1 -- 172.21.15.59:0/4069806701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c1fa870 con 0x7f8e5c15dd90 2024-04-25T09:10:16.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.491+0000 7f8e64600640 1 -- 172.21.15.59:0/4069806701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c0745d0 con 0x7f8e5c15dd90 2024-04-25T09:10:16.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.491+0000 7f8e59600640 1 -- 172.21.15.59:0/4069806701 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8e480bb020 con 0x7f8e5c15dd90 2024-04-25T09:10:16.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.491+0000 7f8e59600640 1 --2- 172.21.15.59:0/4069806701 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e3c066f90 0x7f8e3c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.491+0000 7f8e59600640 1 -- 172.21.15.59:0/4069806701 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8e4811e670 con 0x7f8e5c15dd90 2024-04-25T09:10:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.491+0000 7f8e61c00640 1 --2- 172.21.15.59:0/4069806701 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e3c066f90 0x7f8e3c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.495+0000 7f8e61c00640 1 --2- 172.21.15.59:0/4069806701 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e3c066f90 0x7f8e3c069450 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c159a50 tx=0x7f8e50008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.495+0000 7f8e59600640 1 -- 172.21.15.59:0/4069806701 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8e480c2020 con 0x7f8e5c15dd90 2024-04-25T09:10:16.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 -- 172.21.15.59:0/4069806701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8e5c157620 con 0x7f8e5c15dd90 2024-04-25T09:10:16.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e59600640 1 -- 172.21.15.59:0/4069806701 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e480f3e20 con 0x7f8e5c15dd90 2024-04-25T09:10:16.651 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:10:16.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 -- 172.21.15.59:0/4069806701 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e3c066f90 msgr2=0x7f8e3c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 --2- 172.21.15.59:0/4069806701 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e3c066f90 0x7f8e3c069450 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c159a50 tx=0x7f8e50008040 comp rx=0 tx=0).stop 2024-04-25T09:10:16.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 -- 172.21.15.59:0/4069806701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5c15dd90 msgr2=0x7f8e5c15a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 --2- 172.21.15.59:0/4069806701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5c15dd90 0x7f8e5c15a940 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f8e4801a080 tx=0x7f8e480191f0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 -- 172.21.15.59:0/4069806701 shutdown_connections 2024-04-25T09:10:16.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 --2- 172.21.15.59:0/4069806701 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8e3c066f90 0x7f8e3c069450 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 --2- 172.21.15.59:0/4069806701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8e5c161cc0 0x7f8e5c150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 --2- 172.21.15.59:0/4069806701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e5c15dd90 0x7f8e5c15a940 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 --2- 172.21.15.59:0/4069806701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8e5c072040 0x7f8e5c0af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 -- 172.21.15.59:0/4069806701 >> 172.21.15.59:0/4069806701 conn(0x7f8e5c0cfd90 msgr2=0x7f8e5c0d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:16.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 -- 172.21.15.59:0/4069806701 shutdown_connections 2024-04-25T09:10:16.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.659+0000 7f8e64600640 1 -- 172.21.15.59:0/4069806701 wait complete. 2024-04-25T09:10:16.669 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:10:16.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.831+0000 7f8822200640 1 Processor -- start 2024-04-25T09:10:16.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.831+0000 7f8822200640 1 -- start start 2024-04-25T09:10:16.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.831+0000 7f8822200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f881c071270 0x7f881c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.831+0000 7f8822200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c15efe0 con 0x7f881c15eb50 2024-04-25T09:10:16.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.831+0000 7f8822200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c06db20 con 0x7f881c15e770 2024-04-25T09:10:16.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.831+0000 7f8822200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c071be0 con 0x7f881c071270 2024-04-25T09:10:16.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.831+0000 7f881be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f881c071270 0x7f881c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.831+0000 7f8812a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f881c15eb50 0x7f881c15f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50718/0 (socket says 172.21.15.59:50718) 2024-04-25T09:10:16.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.831+0000 7f8812a00640 1 -- 172.21.15.59:0/1066156714 learned_addr learned my addr 172.21.15.59:0/1066156714 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:16.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.831+0000 7f881be00640 1 -- 172.21.15.59:0/1066156714 >> v1:172.21.15.178:6789/0 conn(0x7f881c15e770 legacy=0x7f881c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.831+0000 7f881be00640 1 -- 172.21.15.59:0/1066156714 >> v1:172.21.15.59:6789/0 conn(0x7f881c15eb50 legacy=0x7f881c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.831+0000 7f881be00640 1 -- 172.21.15.59:0/1066156714 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c06de00 con 0x7f881c071270 2024-04-25T09:10:16.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.835+0000 7f881be00640 1 --2- 172.21.15.59:0/1066156714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f881c071270 0x7f881c0716a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8814009d90 tx=0x7f881401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c878157565cf1c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.835+0000 7f881aa00640 1 -- 172.21.15.59:0/1066156714 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140b2070 con 0x7f881c071270 2024-04-25T09:10:16.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.835+0000 7f881aa00640 1 -- 172.21.15.59:0/1066156714 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88140a59a0 con 0x7f881c071270 2024-04-25T09:10:16.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.835+0000 7f881aa00640 1 -- 172.21.15.59:0/1066156714 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140a5d70 con 0x7f881c071270 2024-04-25T09:10:16.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.835+0000 7f8822200640 1 -- 172.21.15.59:0/1066156714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f881c071270 msgr2=0x7f881c0716a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.835+0000 7f8822200640 1 --2- 172.21.15.59:0/1066156714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f881c071270 0x7f881c0716a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8814009d90 tx=0x7f881401c8e0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.835+0000 7f8822200640 1 -- 172.21.15.59:0/1066156714 shutdown_connections 2024-04-25T09:10:16.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.835+0000 7f8822200640 1 --2- 172.21.15.59:0/1066156714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f881c071270 0x7f881c0716a0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.835+0000 7f8822200640 1 -- 172.21.15.59:0/1066156714 >> 172.21.15.59:0/1066156714 conn(0x7f881c067080 msgr2=0x7f881c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:16.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.835+0000 7f8822200640 1 -- 172.21.15.59:0/1066156714 shutdown_connections 2024-04-25T09:10:16.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.835+0000 7f8822200640 1 -- 172.21.15.59:0/1066156714 wait complete. 2024-04-25T09:10:16.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8822200640 1 Processor -- start 2024-04-25T09:10:16.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8822200640 1 -- start start 2024-04-25T09:10:16.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8822200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f881c071270 0x7f881c1455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8822200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f881c15e770 0x7f881c14c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8822200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f881c15eb50 0x7f881c14c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8822200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c0aeef0 con 0x7f881c15eb50 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8822200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c0aed70 con 0x7f881c15e770 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8822200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c0af070 con 0x7f881c071270 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f881be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f881c15eb50 0x7f881c14c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f881be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f881c15eb50 0x7f881c14c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60466/0 (socket says 172.21.15.59:60466) 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f881be00640 1 -- 172.21.15.59:0/1367437218 learned_addr learned my addr 172.21.15.59:0/1367437218 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8812a00640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f881c15e770 0x7f881c14c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f881b400640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f881c071270 0x7f881c1455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f881be00640 1 -- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f881c071270 msgr2=0x7f881c1455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f881be00640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f881c071270 0x7f881c1455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f881be00640 1 -- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f881c15e770 msgr2=0x7f881c14c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f881be00640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f881c15e770 0x7f881c14c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f881be00640 1 -- 172.21.15.59:0/1367437218 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c1505d0 con 0x7f881c15eb50 2024-04-25T09:10:16.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f881b400640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f881c071270 0x7f881c1455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:16.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8812a00640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f881c15e770 0x7f881c14c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:16.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f881be00640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f881c15eb50 0x7f881c14c580 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f881401a510 tx=0x7f8814019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8813e00640 1 -- 172.21.15.59:0/1367437218 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140b2050 con 0x7f881c15eb50 2024-04-25T09:10:16.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8813e00640 1 -- 172.21.15.59:0/1367437218 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88140be070 con 0x7f881c15eb50 2024-04-25T09:10:16.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8813e00640 1 -- 172.21.15.59:0/1367437218 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88140adad0 con 0x7f881c15eb50 2024-04-25T09:10:16.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8822200640 1 -- 172.21.15.59:0/1367437218 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c1508b0 con 0x7f881c15eb50 2024-04-25T09:10:16.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8822200640 1 -- 172.21.15.59:0/1367437218 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c152b40 con 0x7f881c15eb50 2024-04-25T09:10:16.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.839+0000 7f8822200640 1 -- 172.21.15.59:0/1367437218 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c0745d0 con 0x7f881c15eb50 2024-04-25T09:10:16.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.843+0000 7f8813e00640 1 -- 172.21.15.59:0/1367437218 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f88140adc70 con 0x7f881c15eb50 2024-04-25T09:10:16.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.843+0000 7f8813e00640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f87f8066f90 0x7f87f8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:16.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.843+0000 7f8813e00640 1 -- 172.21.15.59:0/1367437218 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f881411fec0 con 0x7f881c15eb50 2024-04-25T09:10:16.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.843+0000 7f881b400640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f87f8066f90 0x7f87f8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:16.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.843+0000 7f881b400640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f87f8066f90 0x7f87f8069450 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f881c06b000 tx=0x7f880c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:16.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:16.847+0000 7f8813e00640 1 -- 172.21.15.59:0/1367437218 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f88140c7020 con 0x7f881c15eb50 2024-04-25T09:10:16.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.007+0000 7f8822200640 1 -- 172.21.15.59:0/1367437218 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f881c06e8d0 con 0x7f881c15eb50 2024-04-25T09:10:16.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.007+0000 7f8813e00640 1 -- 172.21.15.59:0/1367437218 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v109) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8814016560 con 0x7f881c15eb50 2024-04-25T09:10:16.996 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:10:16.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.007+0000 7f8822200640 1 -- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f87f8066f90 msgr2=0x7f87f8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.007+0000 7f8822200640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f87f8066f90 0x7f87f8069450 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f881c06b000 tx=0x7f880c009040 comp rx=0 tx=0).stop 2024-04-25T09:10:16.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.007+0000 7f8822200640 1 -- 172.21.15.59:0/1367437218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f881c15eb50 msgr2=0x7f881c14c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:16.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.007+0000 7f8822200640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f881c15eb50 0x7f881c14c580 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f881401a510 tx=0x7f8814019680 comp rx=0 tx=0).stop 2024-04-25T09:10:16.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.007+0000 7f8822200640 1 -- 172.21.15.59:0/1367437218 shutdown_connections 2024-04-25T09:10:16.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.007+0000 7f8822200640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f87f8066f90 0x7f87f8069450 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.007+0000 7f8822200640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f881c15eb50 0x7f881c14c580 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.007+0000 7f8822200640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f881c15e770 0x7f881c14c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.007+0000 7f8822200640 1 --2- 172.21.15.59:0/1367437218 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f881c071270 0x7f881c1455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:16.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.007+0000 7f8822200640 1 -- 172.21.15.59:0/1367437218 >> 172.21.15.59:0/1367437218 conn(0x7f881c067080 msgr2=0x7f881c158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:16.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.011+0000 7f8822200640 1 -- 172.21.15.59:0/1367437218 shutdown_connections 2024-04-25T09:10:16.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.011+0000 7f8822200640 1 -- 172.21.15.59:0/1367437218 wait complete. 2024-04-25T09:10:17.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:10:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.171+0000 7efc85600640 1 Processor -- start 2024-04-25T09:10:17.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.171+0000 7efc85600640 1 -- start start 2024-04-25T09:10:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.171+0000 7efc85600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc8015acd0 0x7efc8015e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.171+0000 7efc85600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8015bc40 con 0x7efc80144120 2024-04-25T09:10:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.171+0000 7efc85600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8015b3a0 con 0x7efc8015ee60 2024-04-25T09:10:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.171+0000 7efc85600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8015e490 con 0x7efc8015acd0 2024-04-25T09:10:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.171+0000 7efc7ea00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efc80144120 0x7efc800ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50720/0 (socket says 172.21.15.59:50720) 2024-04-25T09:10:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.171+0000 7efc7ea00640 1 -- 172.21.15.59:0/2207538473 learned_addr learned my addr 172.21.15.59:0/2207538473 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.171+0000 7efc76000640 1 --2- 172.21.15.59:0/2207538473 >> v2:172.21.15.59:3300/0 conn(0x7efc8015acd0 0x7efc8015e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc76000640 1 -- 172.21.15.59:0/2207538473 >> v1:172.21.15.178:6789/0 conn(0x7efc8015ee60 legacy=0x7efc800b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc7e000640 1 -- 172.21.15.59:0/2207538473 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2642897780 0 0) 0x7efc8015bc40 con 0x7efc80144120 2024-04-25T09:10:17.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc76000640 1 -- 172.21.15.59:0/2207538473 >> v1:172.21.15.59:6789/0 conn(0x7efc80144120 legacy=0x7efc800ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc76000640 1 -- 172.21.15.59:0/2207538473 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8015b680 con 0x7efc8015acd0 2024-04-25T09:10:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc76000640 1 --2- 172.21.15.59:0/2207538473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8015acd0 0x7efc8015e920 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7efc680097c0 tx=0x7efc6801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb3c098a7861173 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc7e000640 1 -- 172.21.15.59:0/2207538473 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc680b0070 con 0x7efc8015acd0 2024-04-25T09:10:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc7e000640 1 -- 172.21.15.59:0/2207538473 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc680ab600 con 0x7efc8015acd0 2024-04-25T09:10:17.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc7e000640 1 -- 172.21.15.59:0/2207538473 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc680ab9d0 con 0x7efc8015acd0 2024-04-25T09:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc85600640 1 -- 172.21.15.59:0/2207538473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8015acd0 msgr2=0x7efc8015e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc85600640 1 --2- 172.21.15.59:0/2207538473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8015acd0 0x7efc8015e920 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7efc680097c0 tx=0x7efc6801c410 comp rx=0 tx=0).stop 2024-04-25T09:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc85600640 1 -- 172.21.15.59:0/2207538473 shutdown_connections 2024-04-25T09:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc85600640 1 --2- 172.21.15.59:0/2207538473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8015acd0 0x7efc8015e920 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc85600640 1 -- 172.21.15.59:0/2207538473 >> 172.21.15.59:0/2207538473 conn(0x7efc80067080 msgr2=0x7efc8006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc85600640 1 -- 172.21.15.59:0/2207538473 shutdown_connections 2024-04-25T09:10:17.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.175+0000 7efc85600640 1 -- 172.21.15.59:0/2207538473 wait complete. 2024-04-25T09:10:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc85600640 1 Processor -- start 2024-04-25T09:10:17.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc85600640 1 -- start start 2024-04-25T09:10:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc85600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc80144120 0x7efc800b0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc85600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8015acd0 0x7efc80158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc85600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc8015ee60 0x7efc80140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc85600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80168660 con 0x7efc8015acd0 2024-04-25T09:10:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc85600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8015b150 con 0x7efc80144120 2024-04-25T09:10:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc85600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc801687e0 con 0x7efc8015ee60 2024-04-25T09:10:17.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc76000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8015acd0 0x7efc80158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc76000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8015acd0 0x7efc80158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60480/0 (socket says 172.21.15.59:60480) 2024-04-25T09:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc76000640 1 -- 172.21.15.59:0/4042167021 learned_addr learned my addr 172.21.15.59:0/4042167021 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc76000640 1 -- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc8015ee60 msgr2=0x7efc80140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc7ea00640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc80144120 0x7efc800b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc7f400640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc8015ee60 0x7efc80140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc76000640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc8015ee60 0x7efc80140110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc76000640 1 -- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc80144120 msgr2=0x7efc800b0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc76000640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc80144120 0x7efc800b0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc76000640 1 -- 172.21.15.59:0/4042167021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc800b0ad0 con 0x7efc8015acd0 2024-04-25T09:10:17.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc7ea00640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc80144120 0x7efc800b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc7f400640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc8015ee60 0x7efc80140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:17.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc76000640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8015acd0 0x7efc80158790 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7efc680ae040 tx=0x7efc6801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc77400640 1 -- 172.21.15.59:0/4042167021 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc680b0050 con 0x7efc8015acd0 2024-04-25T09:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc77400640 1 -- 172.21.15.59:0/4042167021 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc680bc070 con 0x7efc8015acd0 2024-04-25T09:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc77400640 1 -- 172.21.15.59:0/4042167021 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc680b5a50 con 0x7efc8015acd0 2024-04-25T09:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc85600640 1 -- 172.21.15.59:0/4042167021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc800af4f0 con 0x7efc8015acd0 2024-04-25T09:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.179+0000 7efc85600640 1 -- 172.21.15.59:0/4042167021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc800afab0 con 0x7efc8015acd0 2024-04-25T09:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.183+0000 7efc85600640 1 -- 172.21.15.59:0/4042167021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc800745d0 con 0x7efc8015acd0 2024-04-25T09:10:17.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.183+0000 7efc77400640 1 -- 172.21.15.59:0/4042167021 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efc680ab4a0 con 0x7efc8015acd0 2024-04-25T09:10:17.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.183+0000 7efc77400640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efc5c066f60 0x7efc5c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.183+0000 7efc77400640 1 -- 172.21.15.59:0/4042167021 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7efc6811fae0 con 0x7efc8015acd0 2024-04-25T09:10:17.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.183+0000 7efc7ea00640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efc5c066f60 0x7efc5c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.183+0000 7efc7ea00640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efc5c066f60 0x7efc5c069420 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efc70000f70 tx=0x7efc70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:17.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.187+0000 7efc77400640 1 -- 172.21.15.59:0/4042167021 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7efc68016090 con 0x7efc8015acd0 2024-04-25T09:10:17.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 -- 172.21.15.59:0/4042167021 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc80140c30 con 0x7efc8015acd0 2024-04-25T09:10:17.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc77400640 1 -- 172.21.15.59:0/4042167021 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v109) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc680f0890 con 0x7efc8015acd0 2024-04-25T09:10:17.344 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:10:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 -- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efc5c066f60 msgr2=0x7efc5c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efc5c066f60 0x7efc5c069420 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7efc70000f70 tx=0x7efc70009040 comp rx=0 tx=0).stop 2024-04-25T09:10:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 -- 172.21.15.59:0/4042167021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8015acd0 msgr2=0x7efc80158790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8015acd0 0x7efc80158790 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7efc680ae040 tx=0x7efc6801ac50 comp rx=0 tx=0).stop 2024-04-25T09:10:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 -- 172.21.15.59:0/4042167021 shutdown_connections 2024-04-25T09:10:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efc5c066f60 0x7efc5c069420 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc8015ee60 0x7efc80140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.346 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc8015acd0 0x7efc80158790 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 --2- 172.21.15.59:0/4042167021 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc80144120 0x7efc800b0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 -- 172.21.15.59:0/4042167021 >> 172.21.15.59:0/4042167021 conn(0x7efc80067080 msgr2=0x7efc800b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:17.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 -- 172.21.15.59:0/4042167021 shutdown_connections 2024-04-25T09:10:17.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.355+0000 7efc85600640 1 -- 172.21.15.59:0/4042167021 wait complete. 2024-04-25T09:10:17.365 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:10:17.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f53a1400640 1 Processor -- start 2024-04-25T09:10:17.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f53a1400640 1 -- start start 2024-04-25T09:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f53a1400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f539c072210 0x7f539c0cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f53a1400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f539c0ce1d0 0x7f539c0ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f53a1400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539c06ac10 con 0x7f539c15dd90 2024-04-25T09:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f53a1400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539c0b2dc0 con 0x7f539c0ce1d0 2024-04-25T09:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f53a1400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c06aeb0 con 0x7f539c072210 2024-04-25T09:10:17.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f539a800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f539c15dd90 0x7f539c071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50726/0 (socket says 172.21.15.59:50726) 2024-04-25T09:10:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f539a800640 1 -- 172.21.15.59:0/3017980360 learned_addr learned my addr 172.21.15.59:0/3017980360 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f539b200640 1 --2- 172.21.15.59:0/3017980360 >> v2:172.21.15.59:3300/0 conn(0x7f539c0ce1d0 0x7f539c0ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f5393e00640 1 --2- 172.21.15.59:0/3017980360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f539c072210 0x7f539c0cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f5399e00640 1 -- 172.21.15.59:0/3017980360 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1874171774 0 0) 0x7f539c06ac10 con 0x7f539c15dd90 2024-04-25T09:10:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f5399e00640 1 -- 172.21.15.59:0/3017980360 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5380003530 con 0x7f539c15dd90 2024-04-25T09:10:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f539b200640 1 -- 172.21.15.59:0/3017980360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f539c072210 msgr2=0x7f539c0cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f539b200640 1 --2- 172.21.15.59:0/3017980360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f539c072210 0x7f539c0cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f539b200640 1 -- 172.21.15.59:0/3017980360 >> v1:172.21.15.59:6789/0 conn(0x7f539c15dd90 legacy=0x7f539c071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.519+0000 7f539b200640 1 -- 172.21.15.59:0/3017980360 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c06b190 con 0x7f539c0ce1d0 2024-04-25T09:10:17.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f539b200640 1 --2- 172.21.15.59:0/3017980360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c0ce1d0 0x7f539c0ce640 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f5394009d90 tx=0x7f539401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573ec591573ff0a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:17.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f5399e00640 1 -- 172.21.15.59:0/3017980360 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940b2070 con 0x7f539c0ce1d0 2024-04-25T09:10:17.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f5399e00640 1 -- 172.21.15.59:0/3017980360 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53940a5850 con 0x7f539c0ce1d0 2024-04-25T09:10:17.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f5399e00640 1 -- 172.21.15.59:0/3017980360 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53940a5c20 con 0x7f539c0ce1d0 2024-04-25T09:10:17.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f53a1400640 1 -- 172.21.15.59:0/3017980360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c0ce1d0 msgr2=0x7f539c0ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f53a1400640 1 --2- 172.21.15.59:0/3017980360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c0ce1d0 0x7f539c0ce640 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f5394009d90 tx=0x7f539401c8e0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f53a1400640 1 -- 172.21.15.59:0/3017980360 shutdown_connections 2024-04-25T09:10:17.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f53a1400640 1 --2- 172.21.15.59:0/3017980360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c0ce1d0 0x7f539c0ce640 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f53a1400640 1 --2- 172.21.15.59:0/3017980360 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f539c072210 0x7f539c0cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f53a1400640 1 -- 172.21.15.59:0/3017980360 >> 172.21.15.59:0/3017980360 conn(0x7f539c0cfd90 msgr2=0x7f539c0d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:17.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f53a1400640 1 -- 172.21.15.59:0/3017980360 shutdown_connections 2024-04-25T09:10:17.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f53a1400640 1 -- 172.21.15.59:0/3017980360 wait complete. 2024-04-25T09:10:17.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.523+0000 7f53a1400640 1 Processor -- start 2024-04-25T09:10:17.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f53a1400640 1 -- start start 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f53a1400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f539c072210 0x7f539c14a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f53a1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c0ce1d0 0x7f539c155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f53a1400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f539c15dd90 0x7f539c0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f53a1400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0cf720 con 0x7f539c0ce1d0 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f53a1400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0cf5a0 con 0x7f539c15dd90 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f53a1400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539c0cf8a0 con 0x7f539c072210 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f5393e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c0ce1d0 0x7f539c155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f5393e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c0ce1d0 0x7f539c155fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60490/0 (socket says 172.21.15.59:60490) 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f5393e00640 1 -- 172.21.15.59:0/2210332774 learned_addr learned my addr 172.21.15.59:0/2210332774 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f539a800640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f539c072210 0x7f539c14a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f539b200640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f539c15dd90 0x7f539c0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f5393e00640 1 -- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f539c072210 msgr2=0x7f539c14a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f5393e00640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f539c072210 0x7f539c14a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f5393e00640 1 -- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f539c15dd90 msgr2=0x7f539c0ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f5393e00640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f539c15dd90 0x7f539c0ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f5393e00640 1 -- 172.21.15.59:0/2210332774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539c0adcc0 con 0x7f539c0ce1d0 2024-04-25T09:10:17.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f5393e00640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c0ce1d0 0x7f539c155fd0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f538400e870 tx=0x7f538400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:17.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f5392a00640 1 -- 172.21.15.59:0/2210332774 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384017070 con 0x7f539c0ce1d0 2024-04-25T09:10:17.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f5392a00640 1 -- 172.21.15.59:0/2210332774 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538400c8e0 con 0x7f539c0ce1d0 2024-04-25T09:10:17.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f5392a00640 1 -- 172.21.15.59:0/2210332774 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538400cc90 con 0x7f539c0ce1d0 2024-04-25T09:10:17.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f53a1400640 1 -- 172.21.15.59:0/2210332774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c154610 con 0x7f539c0ce1d0 2024-04-25T09:10:17.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f53a1400640 1 -- 172.21.15.59:0/2210332774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c154bd0 con 0x7f539c0ce1d0 2024-04-25T09:10:17.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.527+0000 7f53a1400640 1 -- 172.21.15.59:0/2210332774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539c0745d0 con 0x7f539c0ce1d0 2024-04-25T09:10:17.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.531+0000 7f5392a00640 1 -- 172.21.15.59:0/2210332774 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f538401a070 con 0x7f539c0ce1d0 2024-04-25T09:10:17.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.531+0000 7f5392a00640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5378066f60 0x7f5378069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.531+0000 7f5392a00640 1 -- 172.21.15.59:0/2210332774 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5384084fa0 con 0x7f539c0ce1d0 2024-04-25T09:10:17.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.531+0000 7f539a800640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5378066f60 0x7f5378069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.531+0000 7f539a800640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5378066f60 0x7f5378069420 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f538c007fd0 tx=0x7f538c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:17.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.535+0000 7f5392a00640 1 -- 172.21.15.59:0/2210332774 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5384055790 con 0x7f539c0ce1d0 2024-04-25T09:10:17.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 -- 172.21.15.59:0/2210332774 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f539c072700 con 0x7f539c0ce1d0 2024-04-25T09:10:17.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f5392a00640 1 -- 172.21.15.59:0/2210332774 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v109) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5384059830 con 0x7f539c0ce1d0 2024-04-25T09:10:17.699 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:10:17.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 -- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5378066f60 msgr2=0x7f5378069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5378066f60 0x7f5378069420 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f538c007fd0 tx=0x7f538c009040 comp rx=0 tx=0).stop 2024-04-25T09:10:17.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 -- 172.21.15.59:0/2210332774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c0ce1d0 msgr2=0x7f539c155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c0ce1d0 0x7f539c155fd0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f538400e870 tx=0x7f538400ec70 comp rx=0 tx=0).stop 2024-04-25T09:10:17.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 -- 172.21.15.59:0/2210332774 shutdown_connections 2024-04-25T09:10:17.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5378066f60 0x7f5378069420 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f539c15dd90 0x7f539c0ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f539c0ce1d0 0x7f539c155fd0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 --2- 172.21.15.59:0/2210332774 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f539c072210 0x7f539c14a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 -- 172.21.15.59:0/2210332774 >> 172.21.15.59:0/2210332774 conn(0x7f539c0cfd90 msgr2=0x7f539c071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:17.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 -- 172.21.15.59:0/2210332774 shutdown_connections 2024-04-25T09:10:17.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:17.711+0000 7f53a1400640 1 -- 172.21.15.59:0/2210332774 wait complete. 2024-04-25T09:10:17.720 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:10:17.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:17.721 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:17.754 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:10:17.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:17.754 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:10:17.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:17.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.003+0000 7f6d43200640 1 Processor -- start 2024-04-25T09:10:17.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.003+0000 7f6d43200640 1 -- start start 2024-04-25T09:10:17.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d43200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6d4409a170 0x7f6d440cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d43200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d4409a7a0 0x7f6d440cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:17.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d43200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d4406d740 con 0x7f6d4415dcd0 2024-04-25T09:10:17.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d43200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d440cbfc0 con 0x7f6d4409a170 2024-04-25T09:10:17.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d43200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4406cea0 con 0x7f6d4409a7a0 2024-04-25T09:10:17.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d41e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6d4415dcd0 0x7f6d44099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50736/0 (socket says 172.21.15.59:50736) 2024-04-25T09:10:17.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d41e00640 1 -- 172.21.15.59:0/3734517139 learned_addr learned my addr 172.21.15.59:0/3734517139 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:17.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d3be00640 1 --2- 172.21.15.59:0/3734517139 >> v2:172.21.15.178:3300/0 conn(0x7f6d4409a170 0x7f6d440cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d42800640 1 --2- 172.21.15.59:0/3734517139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d4409a7a0 0x7f6d440cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d41400640 1 -- 172.21.15.59:0/3734517139 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169778117 0 0) 0x7f6d4406d740 con 0x7f6d4415dcd0 2024-04-25T09:10:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d41400640 1 -- 172.21.15.59:0/3734517139 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d28003530 con 0x7f6d4415dcd0 2024-04-25T09:10:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d3be00640 1 -- 172.21.15.59:0/3734517139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d4409a7a0 msgr2=0x7f6d440cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d3be00640 1 --2- 172.21.15.59:0/3734517139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d4409a7a0 0x7f6d440cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d3be00640 1 -- 172.21.15.59:0/3734517139 >> v1:172.21.15.59:6789/0 conn(0x7f6d4415dcd0 legacy=0x7f6d44099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d41400640 1 -- 172.21.15.59:0/3734517139 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2952645722 0 0) 0x7f6d28003530 con 0x7f6d4415dcd0 2024-04-25T09:10:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.007+0000 7f6d3be00640 1 -- 172.21.15.59:0/3734517139 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4406d180 con 0x7f6d4409a170 2024-04-25T09:10:17.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d3be00640 1 --2- 172.21.15.59:0/3734517139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4409a170 0x7f6d440cc450 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0097c0 tx=0x7f6d2c01c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d932ad7bb79058e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:17.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d41400640 1 -- 172.21.15.59:0/3734517139 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c0b0070 con 0x7f6d4409a170 2024-04-25T09:10:17.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d41400640 1 -- 172.21.15.59:0/3734517139 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2c0ab400 con 0x7f6d4409a170 2024-04-25T09:10:17.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d41400640 1 -- 172.21.15.59:0/3734517139 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34001680 con 0x7f6d4409a170 2024-04-25T09:10:17.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d43200640 1 -- 172.21.15.59:0/3734517139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4409a170 msgr2=0x7f6d440cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:17.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d43200640 1 --2- 172.21.15.59:0/3734517139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4409a170 0x7f6d440cc450 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0097c0 tx=0x7f6d2c01c390 comp rx=0 tx=0).stop 2024-04-25T09:10:17.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d43200640 1 -- 172.21.15.59:0/3734517139 shutdown_connections 2024-04-25T09:10:18.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d43200640 1 --2- 172.21.15.59:0/3734517139 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d4409a7a0 0x7f6d440cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d43200640 1 --2- 172.21.15.59:0/3734517139 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4409a170 0x7f6d440cc450 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d43200640 1 -- 172.21.15.59:0/3734517139 >> 172.21.15.59:0/3734517139 conn(0x7f6d440b3050 msgr2=0x7f6d440b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:18.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d43200640 1 -- 172.21.15.59:0/3734517139 shutdown_connections 2024-04-25T09:10:18.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d43200640 1 -- 172.21.15.59:0/3734517139 wait complete. 2024-04-25T09:10:18.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d43200640 1 Processor -- start 2024-04-25T09:10:18.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d43200640 1 -- start start 2024-04-25T09:10:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d43200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d4409a170 0x7f6d441542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.011+0000 7f6d43200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d4409a7a0 0x7f6d44151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d43200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4415dcd0 0x7f6d44143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d43200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4416aa20 con 0x7f6d4409a170 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d43200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4416a8a0 con 0x7f6d4415dcd0 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d43200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4416aba0 con 0x7f6d4409a7a0 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d41e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d4409a170 0x7f6d441542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d41e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d4409a170 0x7f6d441542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60494/0 (socket says 172.21.15.59:60494) 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d41e00640 1 -- 172.21.15.59:0/1027558430 learned_addr learned my addr 172.21.15.59:0/1027558430 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d3be00640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d4409a7a0 0x7f6d44151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d42800640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4415dcd0 0x7f6d44143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d41e00640 1 -- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d4409a7a0 msgr2=0x7f6d44151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d41e00640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d4409a7a0 0x7f6d44151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d41e00640 1 -- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4415dcd0 msgr2=0x7f6d44143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d41e00640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4415dcd0 0x7f6d44143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d41e00640 1 -- 172.21.15.59:0/1027558430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d44154b40 con 0x7f6d4409a170 2024-04-25T09:10:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d42800640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4415dcd0 0x7f6d44143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d41e00640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d4409a170 0x7f6d441542f0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400c780 tx=0x7f6d3400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d3a000640 1 -- 172.21.15.59:0/1027558430 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d34005ae0 con 0x7f6d4409a170 2024-04-25T09:10:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d3a000640 1 -- 172.21.15.59:0/1027558430 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d34005ca0 con 0x7f6d4409a170 2024-04-25T09:10:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d43200640 1 -- 172.21.15.59:0/1027558430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d44154e20 con 0x7f6d4409a170 2024-04-25T09:10:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d3a000640 1 -- 172.21.15.59:0/1027558430 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d340072b0 con 0x7f6d4409a170 2024-04-25T09:10:18.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d43200640 1 -- 172.21.15.59:0/1027558430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d441553e0 con 0x7f6d4409a170 2024-04-25T09:10:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d43200640 1 -- 172.21.15.59:0/1027558430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d4404efa0 con 0x7f6d4409a170 2024-04-25T09:10:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d3a000640 1 -- 172.21.15.59:0/1027558430 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d34007450 con 0x7f6d4409a170 2024-04-25T09:10:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.015+0000 7f6d3a000640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d20066f60 0x7f6d20069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.019+0000 7f6d3a000640 1 -- 172.21.15.59:0/1027558430 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6d340850b0 con 0x7f6d4409a170 2024-04-25T09:10:18.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.019+0000 7f6d3be00640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d20066f60 0x7f6d20069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.019+0000 7f6d3be00640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d20066f60 0x7f6d20069420 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0ad000 tx=0x7f6d2c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.023+0000 7f6d3a000640 1 -- 172.21.15.59:0/1027558430 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6d34055ef0 con 0x7f6d4409a170 2024-04-25T09:10:18.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.215+0000 7f6d43200640 1 -- 172.21.15.59:0/1027558430 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d4406e1e0 con 0x7f6d4409a170 2024-04-25T09:10:18.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d3a000640 1 -- 172.21.15.59:0/1027558430 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f6d340557f0 con 0x7f6d4409a170 2024-04-25T09:10:18.207 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:18.207 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":87,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:08.100794+0000","modified":"2024-04-25T09:10:11.103823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8322":{"gid":8322,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2867303658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2867303658},{"type":"v1","addr":"172.21.15.59:6835","nonce":2867303658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:10:18.207 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 87 2024-04-25T09:10:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d43200640 1 -- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d20066f60 msgr2=0x7f6d20069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d43200640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d20066f60 0x7f6d20069420 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0ad000 tx=0x7f6d2c008040 comp rx=0 tx=0).stop 2024-04-25T09:10:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d43200640 1 -- 172.21.15.59:0/1027558430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d4409a170 msgr2=0x7f6d441542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d43200640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d4409a170 0x7f6d441542f0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f6d3400c780 tx=0x7f6d3400cc40 comp rx=0 tx=0).stop 2024-04-25T09:10:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d43200640 1 -- 172.21.15.59:0/1027558430 shutdown_connections 2024-04-25T09:10:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d43200640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d20066f60 0x7f6d20069420 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d43200640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d4415dcd0 0x7f6d44143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d43200640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d4409a7a0 0x7f6d44151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d43200640 1 --2- 172.21.15.59:0/1027558430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d4409a170 0x7f6d441542f0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d43200640 1 -- 172.21.15.59:0/1027558430 >> 172.21.15.59:0/1027558430 conn(0x7f6d440b3050 msgr2=0x7f6d4406f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d43200640 1 -- 172.21.15.59:0/1027558430 shutdown_connections 2024-04-25T09:10:18.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.219+0000 7f6d43200640 1 -- 172.21.15.59:0/1027558430 wait complete. 2024-04-25T09:10:18.228 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:10:18.396 INFO:teuthology.orchestra.run.smithi059.stdout:{"message":"","return_code":0} 2024-04-25T09:10:18.396 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:10:18.397 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:18.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.547+0000 7f560fe00640 1 Processor -- start 2024-04-25T09:10:18.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.547+0000 7f560fe00640 1 -- start start 2024-04-25T09:10:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.551+0000 7f560fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f561015da00 0x7f561006ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.551+0000 7f560fe00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561006b660 con 0x7f561006b150 2024-04-25T09:10:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.551+0000 7f560fe00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561015e350 con 0x7f5610070030 2024-04-25T09:10:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.551+0000 7f560fe00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561015e630 con 0x7f561015da00 2024-04-25T09:10:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.551+0000 7f560ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f561015da00 0x7f561006ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.551+0000 7f5607e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f561006b150 0x7f561006f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50744/0 (socket says 172.21.15.59:50744) 2024-04-25T09:10:18.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.551+0000 7f5607e00640 1 -- 172.21.15.59:0/1189367085 learned_addr learned my addr 172.21.15.59:0/1189367085 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.551+0000 7f560ea00640 1 -- 172.21.15.59:0/1189367085 >> v1:172.21.15.178:6789/0 conn(0x7f5610070030 legacy=0x7f561006e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.551+0000 7f560ea00640 1 -- 172.21.15.59:0/1189367085 >> v1:172.21.15.59:6789/0 conn(0x7f561006b150 legacy=0x7f561006f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.551+0000 7f560ea00640 1 -- 172.21.15.59:0/1189367085 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561015e910 con 0x7f561015da00 2024-04-25T09:10:18.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.551+0000 7f560e000640 1 -- 172.21.15.59:0/1189367085 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726215361 0 0) 0x7f561006b660 con 0x7f561006b150 2024-04-25T09:10:18.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560ea00640 1 --2- 172.21.15.59:0/1189367085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561015da00 0x7f561006ac10 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f56000097c0 tx=0x7f560001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed9c02eb84bb703 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560e000640 1 -- 172.21.15.59:0/1189367085 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000b1070 con 0x7f561015da00 2024-04-25T09:10:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560e000640 1 -- 172.21.15.59:0/1189367085 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56000ac410 con 0x7f561015da00 2024-04-25T09:10:18.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560e000640 1 -- 172.21.15.59:0/1189367085 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000ac5e0 con 0x7f561015da00 2024-04-25T09:10:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560fe00640 1 -- 172.21.15.59:0/1189367085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561015da00 msgr2=0x7f561006ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560fe00640 1 --2- 172.21.15.59:0/1189367085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561015da00 0x7f561006ac10 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f56000097c0 tx=0x7f560001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560fe00640 1 -- 172.21.15.59:0/1189367085 shutdown_connections 2024-04-25T09:10:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560fe00640 1 --2- 172.21.15.59:0/1189367085 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561015da00 0x7f561006ac10 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560fe00640 1 -- 172.21.15.59:0/1189367085 >> 172.21.15.59:0/1189367085 conn(0x7f5610099a60 msgr2=0x7f56100b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560fe00640 1 -- 172.21.15.59:0/1189367085 shutdown_connections 2024-04-25T09:10:18.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560fe00640 1 -- 172.21.15.59:0/1189367085 wait complete. 2024-04-25T09:10:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560fe00640 1 Processor -- start 2024-04-25T09:10:18.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.555+0000 7f560fe00640 1 -- start start 2024-04-25T09:10:18.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561006b150 0x7f5610153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560fe00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5610070030 0x7f56100b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560fe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561015da00 0x7f56100b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560fe00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561016bbb0 con 0x7f561006b150 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560fe00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561016ba30 con 0x7f5610070030 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560fe00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561016bd30 con 0x7f561015da00 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561006b150 0x7f5610153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561006b150 0x7f5610153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60500/0 (socket says 172.21.15.59:60500) 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560ea00640 1 -- 172.21.15.59:0/1961810605 learned_addr learned my addr 172.21.15.59:0/1961810605 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560ea00640 1 -- 172.21.15.59:0/1961810605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561015da00 msgr2=0x7f56100b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560ea00640 1 --2- 172.21.15.59:0/1961810605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561015da00 0x7f56100b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560ea00640 1 -- 172.21.15.59:0/1961810605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5610070030 msgr2=0x7f56100b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560ea00640 1 --2- 172.21.15.59:0/1961810605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5610070030 0x7f56100b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560ea00640 1 -- 172.21.15.59:0/1961810605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5610153f00 con 0x7f561006b150 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560ea00640 1 --2- 172.21.15.59:0/1961810605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561006b150 0x7f5610153530 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f56000097c0 tx=0x7f560001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f5606a00640 1 -- 172.21.15.59:0/1961810605 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000bd070 con 0x7f561006b150 2024-04-25T09:10:18.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f5606a00640 1 -- 172.21.15.59:0/1961810605 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56000b2040 con 0x7f561006b150 2024-04-25T09:10:18.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f5606a00640 1 -- 172.21.15.59:0/1961810605 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000b1050 con 0x7f561006b150 2024-04-25T09:10:18.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560fe00640 1 -- 172.21.15.59:0/1961810605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561015bd30 con 0x7f561006b150 2024-04-25T09:10:18.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560fe00640 1 -- 172.21.15.59:0/1961810605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561015c2f0 con 0x7f561006b150 2024-04-25T09:10:18.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f560fe00640 1 -- 172.21.15.59:0/1961810605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56100b2910 con 0x7f561006b150 2024-04-25T09:10:18.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.559+0000 7f5606a00640 1 -- 172.21.15.59:0/1961810605 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5600004270 con 0x7f561006b150 2024-04-25T09:10:18.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.563+0000 7f5606a00640 1 --2- 172.21.15.59:0/1961810605 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f55ec066f60 0x7f55ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.563+0000 7f5606a00640 1 -- 172.21.15.59:0/1961810605 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f560011ec90 con 0x7f561006b150 2024-04-25T09:10:18.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.563+0000 7f5607e00640 1 --2- 172.21.15.59:0/1961810605 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f55ec066f60 0x7f55ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.563+0000 7f5607e00640 1 --2- 172.21.15.59:0/1961810605 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f55ec066f60 0x7f55ec069420 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f55f8000c10 tx=0x7f55f8007910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.567+0000 7f5606a00640 1 -- 172.21.15.59:0/1961810605 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5610153f00 con 0x7f561006b150 2024-04-25T09:10:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.767+0000 7f560fe00640 1 -- 172.21.15.59:0/1961810605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f561004efa0 con 0x7f561006b150 2024-04-25T09:10:18.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f5606a00640 1 -- 172.21.15.59:0/1961810605 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f5600016090 con 0x7f561006b150 2024-04-25T09:10:18.759 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:18.759 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":87,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:08.100794+0000","modified":"2024-04-25T09:10:11.103823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8322":{"gid":8322,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2867303658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2867303658},{"type":"v1","addr":"172.21.15.59:6835","nonce":2867303658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:10:18.759 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 87 2024-04-25T09:10:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f560fe00640 1 -- 172.21.15.59:0/1961810605 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f55ec066f60 msgr2=0x7f55ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f560fe00640 1 --2- 172.21.15.59:0/1961810605 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f55ec066f60 0x7f55ec069420 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f55f8000c10 tx=0x7f55f8007910 comp rx=0 tx=0).stop 2024-04-25T09:10:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f560fe00640 1 -- 172.21.15.59:0/1961810605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561006b150 msgr2=0x7f5610153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f560fe00640 1 --2- 172.21.15.59:0/1961810605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561006b150 0x7f5610153530 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f56000097c0 tx=0x7f560001ace0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f560fe00640 1 -- 172.21.15.59:0/1961810605 shutdown_connections 2024-04-25T09:10:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f560fe00640 1 --2- 172.21.15.59:0/1961810605 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f55ec066f60 0x7f55ec069420 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f560fe00640 1 --2- 172.21.15.59:0/1961810605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f561015da00 0x7f56100b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f560fe00640 1 --2- 172.21.15.59:0/1961810605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5610070030 0x7f56100b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f560fe00640 1 --2- 172.21.15.59:0/1961810605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f561006b150 0x7f5610153530 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f560fe00640 1 -- 172.21.15.59:0/1961810605 >> 172.21.15.59:0/1961810605 conn(0x7f5610099a60 msgr2=0x7f561006e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f560fe00640 1 -- 172.21.15.59:0/1961810605 shutdown_connections 2024-04-25T09:10:18.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.771+0000 7f560fe00640 1 -- 172.21.15.59:0/1961810605 wait complete. 2024-04-25T09:10:18.780 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-04-25T09:10:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 Processor -- start 2024-04-25T09:10:18.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 -- start start 2024-04-25T09:10:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 0x56115d4213b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56115d4ae490 0x56115d4218f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56115d4ae870 0x56115d423e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115d4b0b90 con 0x56115d3f8e80 2024-04-25T09:10:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115d39c9f0 con 0x56115d4ae490 2024-04-25T09:10:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56115d4af3b0 con 0x56115d4ae870 2024-04-25T09:10:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d83800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 0x56115d4213b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d83800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 0x56115d4213b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60512/0 (socket says 172.21.15.59:60512) 2024-04-25T09:10:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d83800640 1 -- 172.21.15.59:0/4285327526 learned_addr learned my addr 172.21.15.59:0/4285327526 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d82e00640 1 --2- 172.21.15.59:0/4285327526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56115d4ae490 0x56115d4218f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d84200640 1 --2- 172.21.15.59:0/4285327526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56115d4ae870 0x56115d423e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d83800640 1 -- 172.21.15.59:0/4285327526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56115d4ae870 msgr2=0x56115d423e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d83800640 1 --2- 172.21.15.59:0/4285327526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56115d4ae870 0x56115d423e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d83800640 1 -- 172.21.15.59:0/4285327526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56115d4ae490 msgr2=0x56115d4218f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d83800640 1 --2- 172.21.15.59:0/4285327526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56115d4ae490 0x56115d4218f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d83800640 1 -- 172.21.15.59:0/4285327526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56115d424b20 con 0x56115d3f8e80 2024-04-25T09:10:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d83800640 1 --2- 172.21.15.59:0/4285327526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 0x56115d4213b0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400a750 tx=0x7f1d7400ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b8997e5be9de24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d81a00640 1 -- 172.21.15.59:0/4285327526 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74008ba0 con 0x56115d3f8e80 2024-04-25T09:10:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d81a00640 1 -- 172.21.15.59:0/4285327526 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d74008d40 con 0x56115d3f8e80 2024-04-25T09:10:18.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d81a00640 1 -- 172.21.15.59:0/4285327526 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d740133f0 con 0x56115d3f8e80 2024-04-25T09:10:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 -- 172.21.15.59:0/4285327526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 msgr2=0x56115d4213b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 --2- 172.21.15.59:0/4285327526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 0x56115d4213b0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400a750 tx=0x7f1d7400ac10 comp rx=0 tx=0).stop 2024-04-25T09:10:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 -- 172.21.15.59:0/4285327526 shutdown_connections 2024-04-25T09:10:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 --2- 172.21.15.59:0/4285327526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56115d4ae870 0x56115d423e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 --2- 172.21.15.59:0/4285327526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56115d4ae490 0x56115d4218f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 --2- 172.21.15.59:0/4285327526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 0x56115d4213b0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 -- 172.21.15.59:0/4285327526 >> 172.21.15.59:0/4285327526 conn(0x56115d3f6400 msgr2=0x56115d4cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 -- 172.21.15.59:0/4285327526 shutdown_connections 2024-04-25T09:10:18.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.839+0000 7f1d865a0080 1 -- 172.21.15.59:0/4285327526 wait complete. 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d865a0080 1 Processor -- start 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d865a0080 1 -- start start 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d865a0080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 0x56115d4c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d865a0080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56115d4ae490 0x56115d5699f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d865a0080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56115d4ae870 0x56115d569f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d865a0080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115d424dc0 con 0x56115d3f8e80 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d865a0080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56115d425060 con 0x56115d4ae870 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d865a0080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56115d4cd110 con 0x56115d4ae490 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d83800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 0x56115d4c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d83800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 0x56115d4c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60516/0 (socket says 172.21.15.59:60516) 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d82e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56115d4ae490 0x56115d5699f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d83800640 1 -- 172.21.15.59:0/2039319308 learned_addr learned my addr 172.21.15.59:0/2039319308 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d84200640 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56115d4ae870 0x56115d569f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.834 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d83800640 1 -- 172.21.15.59:0/2039319308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56115d4ae490 msgr2=0x56115d5699f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d83800640 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56115d4ae490 0x56115d5699f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d83800640 1 -- 172.21.15.59:0/2039319308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56115d4ae870 msgr2=0x56115d569f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d83800640 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56115d4ae870 0x56115d569f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d83800640 1 -- 172.21.15.59:0/2039319308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56115d568ad0 con 0x56115d3f8e80 2024-04-25T09:10:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d83800640 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 0x56115d4c6f80 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f1d74013ef0 tx=0x7f1d74003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d7be00640 1 -- 172.21.15.59:0/2039319308 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74020070 con 0x56115d3f8e80 2024-04-25T09:10:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d7be00640 1 -- 172.21.15.59:0/2039319308 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d740058d0 con 0x56115d3f8e80 2024-04-25T09:10:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d7be00640 1 -- 172.21.15.59:0/2039319308 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d74008ba0 con 0x56115d3f8e80 2024-04-25T09:10:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d865a0080 1 -- 172.21.15.59:0/2039319308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56115d568d70 con 0x56115d3f8e80 2024-04-25T09:10:18.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.843+0000 7f1d865a0080 1 -- 172.21.15.59:0/2039319308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56115d5692b0 con 0x56115d3f8e80 2024-04-25T09:10:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d7be00640 1 -- 172.21.15.59:0/2039319308 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1d74023070 con 0x56115d3f8e80 2024-04-25T09:10:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d7be00640 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d64065970 0x7f1d64067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d7be00640 1 -- 172.21.15.59:0/2039319308 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1d74010020 con 0x56115d3f8e80 2024-04-25T09:10:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d865a0080 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56115d4216c0 0x56115d43bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d865a0080 1 -- 172.21.15.59:0/2039319308 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e109) v9 -- 0x56115d43c110 con 0x56115d4216c0 2024-04-25T09:10:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d82e00640 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d64065970 0x7f1d64067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d84200640 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56115d4216c0 0x56115d43bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d84200640 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56115d4216c0 0x56115d43bbd0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d82e00640 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d64065970 0x7f1d64067e30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1d70003f20 tx=0x7f1d700038a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:18.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d84200640 1 -- 172.21.15.59:0/2039319308 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x7f1d7c0b3040 con 0x56115d4216c0 2024-04-25T09:10:18.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d865a0080 1 -- 172.21.15.59:0/2039319308 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56115d4216c0 msgr2=0x56115d43bbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d865a0080 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56115d4216c0 0x56115d43bbd0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d865a0080 1 -- 172.21.15.59:0/2039319308 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d64065970 msgr2=0x7f1d64067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d865a0080 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d64065970 0x7f1d64067e30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1d70003f20 tx=0x7f1d700038a0 comp rx=0 tx=0).stop 2024-04-25T09:10:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d865a0080 1 -- 172.21.15.59:0/2039319308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 msgr2=0x56115d4c6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d865a0080 1 --2- 172.21.15.59:0/2039319308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56115d3f8e80 0x56115d4c6f80 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f1d74013ef0 tx=0x7f1d74003030 comp rx=0 tx=0).stop 2024-04-25T09:10:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d84200640 1 -- 172.21.15.59:0/2039319308 reap_dead start 2024-04-25T09:10:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d865a0080 1 -- 172.21.15.59:0/2039319308 shutdown_connections 2024-04-25T09:10:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d865a0080 1 -- 172.21.15.59:0/2039319308 >> 172.21.15.59:0/2039319308 conn(0x56115d3f6400 msgr2=0x56115d4cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d865a0080 1 -- 172.21.15.59:0/2039319308 shutdown_connections 2024-04-25T09:10:18.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:18.847+0000 7f1d865a0080 1 -- 172.21.15.59:0/2039319308 wait complete. 2024-04-25T09:10:18.842 INFO:teuthology.orchestra.run.smithi059.stdout:����� 2024-04-25T09:10:18.842 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:10:19.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f253a400640 1 Processor -- start 2024-04-25T09:10:19.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f253a400640 1 -- start start 2024-04-25T09:10:19.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f253a400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2534161510 0x7f2534143080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f253a400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253406d090 con 0x7f25341435c0 2024-04-25T09:10:19.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f253a400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2534071ad0 con 0x7f2534070fe0 2024-04-25T09:10:19.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f253a400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2534162390 con 0x7f2534161510 2024-04-25T09:10:19.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f2533e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f25341435c0 0x7f253415e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:50748/0 (socket says 172.21.15.59:50748) 2024-04-25T09:10:19.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f2533e00640 1 -- 172.21.15.59:0/2413422057 learned_addr learned my addr 172.21.15.59:0/2413422057 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:19.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f252aa00640 1 --2- 172.21.15.59:0/2413422057 >> v2:172.21.15.59:3300/0 conn(0x7f2534161510 0x7f2534143080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f2532a00640 1 -- 172.21.15.59:0/2413422057 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2505367482 0 0) 0x7f252c001120 con 0x7f25341435c0 2024-04-25T09:10:19.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f2532a00640 1 -- 172.21.15.59:0/2413422057 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2518003530 con 0x7f25341435c0 2024-04-25T09:10:19.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f252aa00640 1 -- 172.21.15.59:0/2413422057 >> v1:172.21.15.178:6789/0 conn(0x7f2534070fe0 legacy=0x7f25340713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f252aa00640 1 -- 172.21.15.59:0/2413422057 >> v1:172.21.15.59:6789/0 conn(0x7f25341435c0 legacy=0x7f253415e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.043+0000 7f252aa00640 1 -- 172.21.15.59:0/2413422057 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534161af0 con 0x7f2534161510 2024-04-25T09:10:19.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.047+0000 7f252aa00640 1 --2- 172.21.15.59:0/2413422057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2534161510 0x7f2534143080 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f251c009d90 tx=0x7f251c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3c4372d5f21514 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.047+0000 7f2532a00640 1 -- 172.21.15.59:0/2413422057 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c0b2070 con 0x7f2534161510 2024-04-25T09:10:19.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.047+0000 7f2532a00640 1 -- 172.21.15.59:0/2413422057 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251c0a5a00 con 0x7f2534161510 2024-04-25T09:10:19.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.047+0000 7f2532a00640 1 -- 172.21.15.59:0/2413422057 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251c0a5dd0 con 0x7f2534161510 2024-04-25T09:10:19.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.047+0000 7f253a400640 1 -- 172.21.15.59:0/2413422057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2534161510 msgr2=0x7f2534143080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.047+0000 7f253a400640 1 --2- 172.21.15.59:0/2413422057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2534161510 0x7f2534143080 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f251c009d90 tx=0x7f251c01c940 comp rx=0 tx=0).stop 2024-04-25T09:10:19.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.047+0000 7f253a400640 1 -- 172.21.15.59:0/2413422057 shutdown_connections 2024-04-25T09:10:19.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.047+0000 7f253a400640 1 --2- 172.21.15.59:0/2413422057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2534161510 0x7f2534143080 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.047+0000 7f253a400640 1 -- 172.21.15.59:0/2413422057 >> 172.21.15.59:0/2413422057 conn(0x7f25340b3390 msgr2=0x7f25340b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:19.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.047+0000 7f253a400640 1 -- 172.21.15.59:0/2413422057 shutdown_connections 2024-04-25T09:10:19.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.047+0000 7f253a400640 1 -- 172.21.15.59:0/2413422057 wait complete. 2024-04-25T09:10:19.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f253a400640 1 Processor -- start 2024-04-25T09:10:19.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f253a400640 1 -- start start 2024-04-25T09:10:19.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f253a400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534070fe0 0x7f25340d1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f253a400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25341435c0 0x7f25340b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f253a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2534161510 0x7f25340b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f253a400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253415ede0 con 0x7f2534161510 2024-04-25T09:10:19.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f253a400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253415ec60 con 0x7f2534070fe0 2024-04-25T09:10:19.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f253a400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25340b0540 con 0x7f25341435c0 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f2533e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2534161510 0x7f25340b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f2533e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2534161510 0x7f25340b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:60522/0 (socket says 172.21.15.59:60522) 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f2533e00640 1 -- 172.21.15.59:0/893421124 learned_addr learned my addr 172.21.15.59:0/893421124 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f252aa00640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25341435c0 0x7f25340b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f2533400640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534070fe0 0x7f25340d1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f2533e00640 1 -- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25341435c0 msgr2=0x7f25340b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f2533e00640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25341435c0 0x7f25340b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f2533e00640 1 -- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534070fe0 msgr2=0x7f25340d1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f2533e00640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534070fe0 0x7f25340d1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f2533e00640 1 -- 172.21.15.59:0/893421124 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25340b2130 con 0x7f2534161510 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f2533e00640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2534161510 0x7f25340b18d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f252c00c760 tx=0x7f252c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f252be00640 1 -- 172.21.15.59:0/893421124 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c017070 con 0x7f2534161510 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f252be00640 1 -- 172.21.15.59:0/893421124 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c0058c0 con 0x7f2534161510 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f252be00640 1 -- 172.21.15.59:0/893421124 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c005c90 con 0x7f2534161510 2024-04-25T09:10:19.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f253a400640 1 -- 172.21.15.59:0/893421124 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253413dde0 con 0x7f2534161510 2024-04-25T09:10:19.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.051+0000 7f253a400640 1 -- 172.21.15.59:0/893421124 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25340b1e10 con 0x7f2534161510 2024-04-25T09:10:19.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.055+0000 7f253a400640 1 -- 172.21.15.59:0/893421124 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25340745d0 con 0x7f2534161510 2024-04-25T09:10:19.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.055+0000 7f252be00640 1 -- 172.21.15.59:0/893421124 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f252c01a070 con 0x7f2534161510 2024-04-25T09:10:19.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.055+0000 7f252be00640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2510066f60 0x7f2510069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:19.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.055+0000 7f252be00640 1 -- 172.21.15.59:0/893421124 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f252c084590 con 0x7f2534161510 2024-04-25T09:10:19.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.055+0000 7f2533400640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2510066f60 0x7f2510069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:19.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.055+0000 7f2533400640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2510066f60 0x7f2510069420 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2524007fd0 tx=0x7f2524009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:19.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.059+0000 7f252be00640 1 -- 172.21.15.59:0/893421124 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f253406d090 con 0x7f2534161510 2024-04-25T09:10:19.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 -- 172.21.15.59:0/893421124 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f25340cef80 con 0x7f2534161510 2024-04-25T09:10:19.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f252be00640 1 -- 172.21.15.59:0/893421124 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v87) v1 ==== 53+0+73 (secure 0 0 0) 0x7f252c054cf0 con 0x7f2534161510 2024-04-25T09:10:19.244 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:10:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 -- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2510066f60 msgr2=0x7f2510069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2510066f60 0x7f2510069420 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f2524007fd0 tx=0x7f2524009040 comp rx=0 tx=0).stop 2024-04-25T09:10:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 -- 172.21.15.59:0/893421124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2534161510 msgr2=0x7f25340b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2534161510 0x7f25340b18d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f252c00c760 tx=0x7f252c00cc20 comp rx=0 tx=0).stop 2024-04-25T09:10:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 -- 172.21.15.59:0/893421124 shutdown_connections 2024-04-25T09:10:19.246 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2510066f60 0x7f2510069420 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2534161510 0x7f25340b18d0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f25341435c0 0x7f25340b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 --2- 172.21.15.59:0/893421124 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2534070fe0 0x7f25340d1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:19.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 -- 172.21.15.59:0/893421124 >> 172.21.15.59:0/893421124 conn(0x7f25340b3390 msgr2=0x7f2534141880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:19.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 -- 172.21.15.59:0/893421124 shutdown_connections 2024-04-25T09:10:19.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:19.255+0000 7f253a400640 1 -- 172.21.15.59:0/893421124 wait complete. 2024-04-25T09:10:19.265 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:10:19.265 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:10:19.265 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:10:19.265 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:10:19.265 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:19.265 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:10:19.266 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:10:19.266 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:10:19.266 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:19.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:19.266 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:10:19.275 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:10:19.275 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:10:19.275 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:10:19.275 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:19.275 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:10:19.275 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:19.275 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:19.275 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:19.275 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:10:19.276 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:19.276 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:19.276 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:10:19.276 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:10:19.276 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41948sec preferred_lft 41948sec 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:10:19.277 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:10:19.278 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:10:19.278 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:19.278 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:10:19.278 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:19.278 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:10:19.278 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:10:19.278 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:10:19.278 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:19.278 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:10:19.278 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:10:19.278 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:10:19.278 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:10:19.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:19.280 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:10:19.343 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:10:19.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:19.346 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:10:19.399 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:10:19.399 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:10:19.399 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:10:19.399 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:10:19.399 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:10:19.399 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:10:19.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:19.400 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:10:19.400 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:10:19.400 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:10:19.400 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:10:19.400 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:10:19.400 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:10:19.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:19.495 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:10:19.506 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:10:19.506 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:10:19.506 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:19.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:19.507 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:10:19.570 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:10:19.570 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:19.621 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:10:19.622 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:10:19.622 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:19.673 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:10:19.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:19.674 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:19.768 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:19.769 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:19.769 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:10:19.784 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:19.784 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:19.784 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:10:19.784 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:10:19.784 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:10:19.794 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:10:19.794 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:10:19.794 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:10:19.794 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:10:19.794 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:10:19.794 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:10:19.794 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:10:19.795 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:10:19.798 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:10:19.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:19.798 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:19.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:19.818 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:10:19.876 INFO:teuthology.orchestra.run.smithi059.stdout:client7978 2024-04-25T09:10:19.877 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:10:19.877 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:19.930 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:10:19.930 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:19.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:19.981 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T09:10:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:6+0 records in 2024-04-25T09:10:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:6+0 records out 2024-04-25T09:10:20.141 INFO:teuthology.orchestra.run.smithi059.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.105784 s, 59.5 MB/s 2024-04-25T09:10:20.142 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:10:20.143 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:20.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:20.152 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-25T09:10:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:6+0 records in 2024-04-25T09:10:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:6+0 records out 2024-04-25T09:10:20.309 INFO:teuthology.orchestra.run.smithi059.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.105819 s, 59.5 MB/s 2024-04-25T09:10:20.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:20.310 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:10:20.321 INFO:teuthology.orchestra.run.smithi059.stdout:./ 2024-04-25T09:10:20.321 INFO:teuthology.orchestra.run.smithi059.stdout:./file2_sixmegs 2024-04-25T09:10:20.321 INFO:teuthology.orchestra.run.smithi059.stdout:./file3_sixmegs 2024-04-25T09:10:20.321 INFO:teuthology.orchestra.run.smithi059.stdout:./file1_sixmegs 2024-04-25T09:10:20.322 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:10:20.323 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:10:20.323 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:10:20.323 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:10:20.323 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:10:20.323 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:10:20.435 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:10:20.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:10:20.445 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:10:20.445 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:10:20.445 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:10:20.445 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:10:20.445 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-04-25T09:10:20.445 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:10:20.556 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627777 2024-04-25T09:10:20.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:10:20.565 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:10:20.565 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:10:20.565 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:10:20.565 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:10:20.565 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-04-25T09:10:20.566 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:10:20.671 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627778 2024-04-25T09:10:20.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:10:20.680 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:10:20.680 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:10:20.680 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:10:20.680 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:10:20.680 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-04-25T09:10:20.680 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:10:20.793 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627776 2024-04-25T09:10:20.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:10:20.802 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:10:20.802 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:20.859 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:10:20.859 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:20.914 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:10:21.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59c2c00640 1 Processor -- start 2024-04-25T09:10:21.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59c2c00640 1 -- start start 2024-04-25T09:10:21.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59c2c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f59bc15aba0 0x7f59bc0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59c2c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59bc09db30 0x7f59bc0ce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59c2c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc0cf620 con 0x7f59bc0ce750 2024-04-25T09:10:21.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59c2c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc15af80 con 0x7f59bc15aba0 2024-04-25T09:10:21.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59c2c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc0aec80 con 0x7f59bc09db30 2024-04-25T09:10:21.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59c0c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f59bc0ce750 0x7f59bc0ad920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58816/0 (socket says 172.21.15.59:58816) 2024-04-25T09:10:21.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59c0c00640 1 -- 172.21.15.59:0/3104444381 learned_addr learned my addr 172.21.15.59:0/3104444381 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:21.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59bbe00640 1 --2- 172.21.15.59:0/3104444381 >> v2:172.21.15.59:3300/0 conn(0x7f59bc15aba0 0x7f59bc0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59bb400640 1 --2- 172.21.15.59:0/3104444381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59bc09db30 0x7f59bc0ce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59baa00640 1 -- 172.21.15.59:0/3104444381 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 179231847 0 0) 0x7f59bc0cf620 con 0x7f59bc0ce750 2024-04-25T09:10:21.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59bbe00640 1 -- 172.21.15.59:0/3104444381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59bc09db30 msgr2=0x7f59bc0ce210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59bbe00640 1 --2- 172.21.15.59:0/3104444381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59bc09db30 0x7f59bc0ce210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59bbe00640 1 -- 172.21.15.59:0/3104444381 >> v1:172.21.15.59:6789/0 conn(0x7f59bc0ce750 legacy=0x7f59bc0ad920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.115+0000 7f59bbe00640 1 -- 172.21.15.59:0/3104444381 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc0ced80 con 0x7f59bc15aba0 2024-04-25T09:10:21.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59bbe00640 1 --2- 172.21.15.59:0/3104444381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59bc15aba0 0x7f59bc0cdcd0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0097c0 tx=0x7f59ac01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfae6d232a478892 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59baa00640 1 -- 172.21.15.59:0/3104444381 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac0b0070 con 0x7f59bc15aba0 2024-04-25T09:10:21.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59baa00640 1 -- 172.21.15.59:0/3104444381 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac0ab600 con 0x7f59bc15aba0 2024-04-25T09:10:21.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59baa00640 1 -- 172.21.15.59:0/3104444381 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac0ab9d0 con 0x7f59bc15aba0 2024-04-25T09:10:21.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59c2c00640 1 -- 172.21.15.59:0/3104444381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59bc15aba0 msgr2=0x7f59bc0cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59c2c00640 1 --2- 172.21.15.59:0/3104444381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59bc15aba0 0x7f59bc0cdcd0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0097c0 tx=0x7f59ac01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59c2c00640 1 -- 172.21.15.59:0/3104444381 shutdown_connections 2024-04-25T09:10:21.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59c2c00640 1 --2- 172.21.15.59:0/3104444381 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59bc09db30 0x7f59bc0ce210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59c2c00640 1 --2- 172.21.15.59:0/3104444381 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59bc15aba0 0x7f59bc0cdcd0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59c2c00640 1 -- 172.21.15.59:0/3104444381 >> 172.21.15.59:0/3104444381 conn(0x7f59bc0cc850 msgr2=0x7f59bc0ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59c2c00640 1 -- 172.21.15.59:0/3104444381 shutdown_connections 2024-04-25T09:10:21.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59c2c00640 1 -- 172.21.15.59:0/3104444381 wait complete. 2024-04-25T09:10:21.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59c2c00640 1 Processor -- start 2024-04-25T09:10:21.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.119+0000 7f59c2c00640 1 -- start start 2024-04-25T09:10:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59c2c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59bc09db30 0x7f59bc1511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59c2c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59bc0ce750 0x7f59bc09a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59c2c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59bc15aba0 0x7f59bc06b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59c2c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc167a00 con 0x7f59bc0ce750 2024-04-25T09:10:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59c2c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc167880 con 0x7f59bc15aba0 2024-04-25T09:10:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59c2c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc167b80 con 0x7f59bc09db30 2024-04-25T09:10:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59bb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59bc0ce750 0x7f59bc09a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59bb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59bc0ce750 0x7f59bc09a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41872/0 (socket says 172.21.15.59:41872) 2024-04-25T09:10:21.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59bb400640 1 -- 172.21.15.59:0/351308955 learned_addr learned my addr 172.21.15.59:0/351308955 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59bbe00640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59bc09db30 0x7f59bc1511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59c0c00640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59bc15aba0 0x7f59bc06b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59bb400640 1 -- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59bc09db30 msgr2=0x7f59bc1511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59bb400640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59bc09db30 0x7f59bc1511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59bb400640 1 -- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59bc15aba0 msgr2=0x7f59bc06b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59bb400640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59bc15aba0 0x7f59bc06b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59bb400640 1 -- 172.21.15.59:0/351308955 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc15b120 con 0x7f59bc0ce750 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59c0c00640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59bc15aba0 0x7f59bc06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59bb400640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59bc0ce750 0x7f59bc09a970 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f59a800d830 tx=0x7f59a800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59b3e00640 1 -- 172.21.15.59:0/351308955 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a800b6c0 con 0x7f59bc0ce750 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59b3e00640 1 -- 172.21.15.59:0/351308955 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a8019070 con 0x7f59bc0ce750 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59c2c00640 1 -- 172.21.15.59:0/351308955 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc15b3c0 con 0x7f59bc0ce750 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59b3e00640 1 -- 172.21.15.59:0/351308955 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a800ba60 con 0x7f59bc0ce750 2024-04-25T09:10:21.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59c2c00640 1 -- 172.21.15.59:0/351308955 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc15b980 con 0x7f59bc0ce750 2024-04-25T09:10:21.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.123+0000 7f59c2c00640 1 -- 172.21.15.59:0/351308955 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc0adda0 con 0x7f59bc0ce750 2024-04-25T09:10:21.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.127+0000 7f59b3e00640 1 -- 172.21.15.59:0/351308955 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f59a801e460 con 0x7f59bc0ce750 2024-04-25T09:10:21.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.127+0000 7f59b3e00640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f599c066f60 0x7f599c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.127+0000 7f59b3e00640 1 -- 172.21.15.59:0/351308955 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f59a80858e0 con 0x7f59bc0ce750 2024-04-25T09:10:21.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.127+0000 7f59bbe00640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f599c066f60 0x7f599c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.127+0000 7f59bbe00640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f599c066f60 0x7f599c069420 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0ad000 tx=0x7f59ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.131+0000 7f59b3e00640 1 -- 172.21.15.59:0/351308955 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f59a8056690 con 0x7f59bc0ce750 2024-04-25T09:10:21.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 -- 172.21.15.59:0/351308955 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59bc067820 con 0x7f59bc0ce750 2024-04-25T09:10:21.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59b3e00640 1 -- 172.21.15.59:0/351308955 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16982 (secure 0 0 0) 0x7f59a8055f90 con 0x7f59bc0ce750 2024-04-25T09:10:21.284 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:21.284 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":109,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:10:11.719041+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:06.512267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:07.092321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.24","mappings":[{"from":5,"to":4}]},{"pgid":"16.36","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:10:21.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 -- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f599c066f60 msgr2=0x7f599c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f599c066f60 0x7f599c069420 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f59ac0ad000 tx=0x7f59ac008040 comp rx=0 tx=0).stop 2024-04-25T09:10:21.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 -- 172.21.15.59:0/351308955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59bc0ce750 msgr2=0x7f59bc09a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59bc0ce750 0x7f59bc09a970 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f59a800d830 tx=0x7f59a800dcf0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 -- 172.21.15.59:0/351308955 shutdown_connections 2024-04-25T09:10:21.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f599c066f60 0x7f599c069420 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f59bc15aba0 0x7f59bc06b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59bc0ce750 0x7f59bc09a970 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 --2- 172.21.15.59:0/351308955 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f59bc09db30 0x7f59bc1511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 -- 172.21.15.59:0/351308955 >> 172.21.15.59:0/351308955 conn(0x7f59bc0cc850 msgr2=0x7f59bc158a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 -- 172.21.15.59:0/351308955 shutdown_connections 2024-04-25T09:10:21.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.295+0000 7f59c2c00640 1 -- 172.21.15.59:0/351308955 wait complete. 2024-04-25T09:10:21.305 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:10:06.512267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:10:07.092321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:10:21.305 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:10:21.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.459+0000 7f29dac00640 1 Processor -- start 2024-04-25T09:10:21.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.459+0000 7f29dac00640 1 -- start start 2024-04-25T09:10:21.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29dac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d40b3090 0x7f29d40b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29dac00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d415bc40 con 0x7f29d415acd0 2024-04-25T09:10:21.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29dac00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d415b3a0 con 0x7f29d4144120 2024-04-25T09:10:21.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29dac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d415e490 con 0x7f29d40b3090 2024-04-25T09:10:21.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29cbe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f29d415acd0 0x7f29d415e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58828/0 (socket says 172.21.15.59:58828) 2024-04-25T09:10:21.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29cbe00640 1 -- 172.21.15.59:0/3499250269 learned_addr learned my addr 172.21.15.59:0/3499250269 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:21.452 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d8c00640 1 --2- 172.21.15.59:0/3499250269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d40b3090 0x7f29d40b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194236685 0 0) 0x7f29d415bc40 con 0x7f29d415acd0 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29b8003530 con 0x7f29d415acd0 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 996399184 0 0) 0x7f29b8003530 con 0x7f29d415acd0 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d40b3090 msgr2=0x7f29d40b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 --2- 172.21.15.59:0/3499250269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d40b3090 0x7f29d40b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 >> v1:172.21.15.178:6789/0 conn(0x7f29d4144120 legacy=0x7f29d40ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d415b680 con 0x7f29d415acd0 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f29bc001680 con 0x7f29d415acd0 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 >> v1:172.21.15.59:6789/0 conn(0x7f29d415acd0 legacy=0x7f29d415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 --2- 172.21.15.59:0/3499250269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29b80039f0 0x7f29b8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 --2- 172.21.15.59:0/3499250269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b80043c0 0x7f29b8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 --2- 172.21.15.59:0/3499250269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d40b3090 0x7f29b8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d415e490 con 0x7f29b80043c0 2024-04-25T09:10:21.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b800bab0 con 0x7f29b80039f0 2024-04-25T09:10:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b800dec0 con 0x7f29d40b3090 2024-04-25T09:10:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29cbe00640 1 --2- 172.21.15.59:0/3499250269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b80043c0 0x7f29b8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d3e00640 1 --2- 172.21.15.59:0/3499250269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29b80039f0 0x7f29b8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29d8c00640 1 --2- 172.21.15.59:0/3499250269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d40b3090 0x7f29b8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29cbe00640 1 -- 172.21.15.59:0/3499250269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d40b3090 msgr2=0x7f29b8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29cbe00640 1 --2- 172.21.15.59:0/3499250269 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29d40b3090 0x7f29b8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29cbe00640 1 -- 172.21.15.59:0/3499250269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29b80039f0 msgr2=0x7f29b8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29cbe00640 1 --2- 172.21.15.59:0/3499250269 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29b80039f0 0x7f29b8003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.463+0000 7f29cbe00640 1 -- 172.21.15.59:0/3499250269 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b8003530 con 0x7f29b80043c0 2024-04-25T09:10:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29cbe00640 1 --2- 172.21.15.59:0/3499250269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b80043c0 0x7f29b8004890 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00c240 tx=0x7f29bc01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eee135744bc1b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc007d20 con 0x7f29b80043c0 2024-04-25T09:10:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc0a9020 con 0x7f29b80043c0 2024-04-25T09:10:21.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29d3400640 1 -- 172.21.15.59:0/3499250269 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc005b00 con 0x7f29b80043c0 2024-04-25T09:10:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29dac00640 1 -- 172.21.15.59:0/3499250269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b80043c0 msgr2=0x7f29b8004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29dac00640 1 --2- 172.21.15.59:0/3499250269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29b80043c0 0x7f29b8004890 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f29bc00c240 tx=0x7f29bc01cc60 comp rx=0 tx=0).stop 2024-04-25T09:10:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29d8c00640 1 -- 172.21.15.59:0/3499250269 reap_dead start 2024-04-25T09:10:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29dac00640 1 -- 172.21.15.59:0/3499250269 shutdown_connections 2024-04-25T09:10:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29dac00640 1 -- 172.21.15.59:0/3499250269 >> 172.21.15.59:0/3499250269 conn(0x7f29d4067080 msgr2=0x7f29d406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29dac00640 1 -- 172.21.15.59:0/3499250269 shutdown_connections 2024-04-25T09:10:21.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29dac00640 1 -- 172.21.15.59:0/3499250269 wait complete. 2024-04-25T09:10:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29dac00640 1 Processor -- start 2024-04-25T09:10:21.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.467+0000 7f29dac00640 1 -- start start 2024-04-25T09:10:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29dac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29b80043c0 0x7f29d40b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29dac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d413dd30 0x7f29d40cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29dac00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29d40af110 0x7f29d41637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.459 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29dac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d406dc60 con 0x7f29d413dd30 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29dac00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d406dae0 con 0x7f29d40af110 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29dac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d406dde0 con 0x7f29b80043c0 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29cbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d413dd30 0x7f29d40cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29cbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d413dd30 0x7f29d40cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41892/0 (socket says 172.21.15.59:41892) 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29cbe00640 1 -- 172.21.15.59:0/1798327405 learned_addr learned my addr 172.21.15.59:0/1798327405 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29d8c00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29d40af110 0x7f29d41637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29d3e00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29b80043c0 0x7f29d40b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29cbe00640 1 -- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29b80043c0 msgr2=0x7f29d40b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29cbe00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29b80043c0 0x7f29d40b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29cbe00640 1 -- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29d40af110 msgr2=0x7f29d41637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29cbe00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29d40af110 0x7f29d41637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29cbe00640 1 -- 172.21.15.59:0/1798327405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40afaf0 con 0x7f29d413dd30 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29d3e00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29b80043c0 0x7f29d40b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:21.460 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29cbe00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d413dd30 0x7f29d40cbc20 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0ab040 tx=0x7f29b8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29d0c00640 1 -- 172.21.15.59:0/1798327405 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0049f0 con 0x7f29d413dd30 2024-04-25T09:10:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29d0c00640 1 -- 172.21.15.59:0/1798327405 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29bc004b90 con 0x7f29d413dd30 2024-04-25T09:10:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29dac00640 1 -- 172.21.15.59:0/1798327405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d40afdd0 con 0x7f29d413dd30 2024-04-25T09:10:21.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29d0c00640 1 -- 172.21.15.59:0/1798327405 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29bc0070d0 con 0x7f29d413dd30 2024-04-25T09:10:21.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29dac00640 1 -- 172.21.15.59:0/1798327405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d40b0390 con 0x7f29d413dd30 2024-04-25T09:10:21.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.471+0000 7f29dac00640 1 -- 172.21.15.59:0/1798327405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d40745d0 con 0x7f29d413dd30 2024-04-25T09:10:21.462 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.475+0000 7f29d0c00640 1 -- 172.21.15.59:0/1798327405 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f29bc007270 con 0x7f29d413dd30 2024-04-25T09:10:21.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.475+0000 7f29d0c00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f29b0066f60 0x7f29b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.463 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.475+0000 7f29d0c00640 1 -- 172.21.15.59:0/1798327405 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f29bc11e6c0 con 0x7f29d413dd30 2024-04-25T09:10:21.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.475+0000 7f29d3e00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f29b0066f60 0x7f29b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.464 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.475+0000 7f29d3e00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f29b0066f60 0x7f29b0069420 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f29c4007fd0 tx=0x7f29c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.479+0000 7f29d0c00640 1 -- 172.21.15.59:0/1798327405 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f29bc0be060 con 0x7f29d413dd30 2024-04-25T09:10:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.643+0000 7f29dac00640 1 -- 172.21.15.59:0/1798327405 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29d415dfc0 con 0x7f29d413dd30 2024-04-25T09:10:21.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.643+0000 7f29d0c00640 1 -- 172.21.15.59:0/1798327405 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29bc016970 con 0x7f29d413dd30 2024-04-25T09:10:21.633 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:10:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.647+0000 7f29dac00640 1 -- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f29b0066f60 msgr2=0x7f29b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.647+0000 7f29dac00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f29b0066f60 0x7f29b0069420 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f29c4007fd0 tx=0x7f29c4009040 comp rx=0 tx=0).stop 2024-04-25T09:10:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.647+0000 7f29dac00640 1 -- 172.21.15.59:0/1798327405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d413dd30 msgr2=0x7f29d40cbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.647+0000 7f29dac00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d413dd30 0x7f29d40cbc20 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f29bc0ab040 tx=0x7f29b8005840 comp rx=0 tx=0).stop 2024-04-25T09:10:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.647+0000 7f29dac00640 1 -- 172.21.15.59:0/1798327405 shutdown_connections 2024-04-25T09:10:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.647+0000 7f29dac00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f29b0066f60 0x7f29b0069420 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.647+0000 7f29dac00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f29d40af110 0x7f29d41637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.647+0000 7f29dac00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29d413dd30 0x7f29d40cbc20 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.647+0000 7f29dac00640 1 --2- 172.21.15.59:0/1798327405 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f29b80043c0 0x7f29d40b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.647+0000 7f29dac00640 1 -- 172.21.15.59:0/1798327405 >> 172.21.15.59:0/1798327405 conn(0x7f29d4067080 msgr2=0x7f29d41402c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.647+0000 7f29dac00640 1 -- 172.21.15.59:0/1798327405 shutdown_connections 2024-04-25T09:10:21.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.647+0000 7f29dac00640 1 -- 172.21.15.59:0/1798327405 wait complete. 2024-04-25T09:10:21.655 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:10:21.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f81a1e00640 1 Processor -- start 2024-04-25T09:10:21.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f81a1e00640 1 -- start start 2024-04-25T09:10:21.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f81a1e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f819c15b910 0x7f819c0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f81a1e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f819c0cf3c0 0x7f819c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f81a1e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c0d02a0 con 0x7f819c0cd370 2024-04-25T09:10:21.800 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f81a1e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c0cc350 con 0x7f819c0cf3c0 2024-04-25T09:10:21.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f81a1e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c0cc630 con 0x7f819c15b910 2024-04-25T09:10:21.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f819b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f819c0cd370 0x7f819c099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58842/0 (socket says 172.21.15.59:58842) 2024-04-25T09:10:21.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f819b400640 1 -- 172.21.15.59:0/580096603 learned_addr learned my addr 172.21.15.59:0/580096603 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:21.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f8192000640 1 --2- 172.21.15.59:0/580096603 >> v2:172.21.15.59:3300/0 conn(0x7f819c0cf3c0 0x7f819c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f819aa00640 1 --2- 172.21.15.59:0/580096603 >> v2:172.21.15.178:3300/0 conn(0x7f819c15b910 0x7f819c0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f819a000640 1 -- 172.21.15.59:0/580096603 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598371255 0 0) 0x7f819c0d02a0 con 0x7f819c0cd370 2024-04-25T09:10:21.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f819a000640 1 -- 172.21.15.59:0/580096603 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8180003530 con 0x7f819c0cd370 2024-04-25T09:10:21.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f8192000640 1 -- 172.21.15.59:0/580096603 >> v2:172.21.15.178:3300/0 conn(0x7f819c15b910 msgr2=0x7f819c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:21.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f8192000640 1 --2- 172.21.15.59:0/580096603 >> v2:172.21.15.178:3300/0 conn(0x7f819c15b910 0x7f819c0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f8192000640 1 -- 172.21.15.59:0/580096603 >> v1:172.21.15.59:6789/0 conn(0x7f819c0cd370 legacy=0x7f819c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f8192000640 1 -- 172.21.15.59:0/580096603 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c0cc910 con 0x7f819c0cf3c0 2024-04-25T09:10:21.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.811+0000 7f819aa00640 1 --2- 172.21.15.59:0/580096603 >> v2:172.21.15.178:3300/0 conn(0x7f819c15b910 0x7f819c0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.815+0000 7f8192000640 1 --2- 172.21.15.59:0/580096603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f819c0cf3c0 0x7f819c0cce30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f819c072650 tx=0x7f818401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d732842d0e64901 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.815+0000 7f819a000640 1 -- 172.21.15.59:0/580096603 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840b1070 con 0x7f819c0cf3c0 2024-04-25T09:10:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.815+0000 7f819a000640 1 -- 172.21.15.59:0/580096603 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81840ac5f0 con 0x7f819c0cf3c0 2024-04-25T09:10:21.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.815+0000 7f819a000640 1 -- 172.21.15.59:0/580096603 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840ac9a0 con 0x7f819c0cf3c0 2024-04-25T09:10:21.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.815+0000 7f81a1e00640 1 -- 172.21.15.59:0/580096603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f819c0cf3c0 msgr2=0x7f819c0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.815+0000 7f81a1e00640 1 --2- 172.21.15.59:0/580096603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f819c0cf3c0 0x7f819c0cce30 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f819c072650 tx=0x7f818401c480 comp rx=0 tx=0).stop 2024-04-25T09:10:21.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.815+0000 7f81a1e00640 1 -- 172.21.15.59:0/580096603 shutdown_connections 2024-04-25T09:10:21.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.815+0000 7f81a1e00640 1 --2- 172.21.15.59:0/580096603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f819c0cf3c0 0x7f819c0cce30 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.815+0000 7f81a1e00640 1 --2- 172.21.15.59:0/580096603 >> v2:172.21.15.178:3300/0 conn(0x7f819c15b910 0x7f819c0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.815+0000 7f81a1e00640 1 -- 172.21.15.59:0/580096603 >> 172.21.15.59:0/580096603 conn(0x7f819c0b3200 msgr2=0x7f819c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.815+0000 7f81a1e00640 1 -- 172.21.15.59:0/580096603 shutdown_connections 2024-04-25T09:10:21.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.815+0000 7f81a1e00640 1 -- 172.21.15.59:0/580096603 wait complete. 2024-04-25T09:10:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f81a1e00640 1 Processor -- start 2024-04-25T09:10:21.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f81a1e00640 1 -- start start 2024-04-25T09:10:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f81a1e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f819c0cd370 0x7f819c15c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f81a1e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f819c0cf3c0 0x7f819c14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f81a1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f819c15b910 0x7f819c14f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f81a1e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c09a2f0 con 0x7f819c15b910 2024-04-25T09:10:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f81a1e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c09a170 con 0x7f819c0cf3c0 2024-04-25T09:10:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f81a1e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c15bcf0 con 0x7f819c0cd370 2024-04-25T09:10:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f819b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f819c15b910 0x7f819c14f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f819b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f819c15b910 0x7f819c14f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41908/0 (socket says 172.21.15.59:41908) 2024-04-25T09:10:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f819b400640 1 -- 172.21.15.59:0/172716418 learned_addr learned my addr 172.21.15.59:0/172716418 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f8192000640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f819c0cf3c0 0x7f819c14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f819aa00640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f819c0cd370 0x7f819c15c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f819b400640 1 -- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f819c0cd370 msgr2=0x7f819c15c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f819b400640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f819c0cd370 0x7f819c15c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f819b400640 1 -- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f819c0cf3c0 msgr2=0x7f819c14ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f819b400640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f819c0cf3c0 0x7f819c14ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f819b400640 1 -- 172.21.15.59:0/172716418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c15ce40 con 0x7f819c15b910 2024-04-25T09:10:21.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f819b400640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f819c15b910 0x7f819c14f170 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f819400cb70 tx=0x7f819400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f8193e00640 1 -- 172.21.15.59:0/172716418 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194017070 con 0x7f819c15b910 2024-04-25T09:10:21.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f8193e00640 1 -- 172.21.15.59:0/172716418 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819400ad40 con 0x7f819c15b910 2024-04-25T09:10:21.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f8193e00640 1 -- 172.21.15.59:0/172716418 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194012620 con 0x7f819c15b910 2024-04-25T09:10:21.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f81a1e00640 1 -- 172.21.15.59:0/172716418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c15d100 con 0x7f819c15b910 2024-04-25T09:10:21.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.819+0000 7f81a1e00640 1 -- 172.21.15.59:0/172716418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c15d6c0 con 0x7f819c15b910 2024-04-25T09:10:21.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.823+0000 7f81a1e00640 1 -- 172.21.15.59:0/172716418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c0c6720 con 0x7f819c15b910 2024-04-25T09:10:21.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.823+0000 7f8193e00640 1 -- 172.21.15.59:0/172716418 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f819401a070 con 0x7f819c15b910 2024-04-25T09:10:21.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.823+0000 7f8193e00640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8178066f60 0x7f8178069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:21.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.823+0000 7f8193e00640 1 -- 172.21.15.59:0/172716418 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8194084fc0 con 0x7f819c15b910 2024-04-25T09:10:21.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.823+0000 7f819aa00640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8178066f60 0x7f8178069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:21.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.823+0000 7f819aa00640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8178066f60 0x7f8178069420 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f818c009580 tx=0x7f818c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:21.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.827+0000 7f8193e00640 1 -- 172.21.15.59:0/172716418 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8194055720 con 0x7f819c15b910 2024-04-25T09:10:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 -- 172.21.15.59:0/172716418 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f819c0745d0 con 0x7f819c15b910 2024-04-25T09:10:21.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f8193e00640 1 -- 172.21.15.59:0/172716418 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v109) v1 ==== 104+0+11 (secure 0 0 0) 0x7f81940597c0 con 0x7f819c15b910 2024-04-25T09:10:21.980 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:10:21.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 -- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8178066f60 msgr2=0x7f8178069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8178066f60 0x7f8178069420 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f818c009580 tx=0x7f818c009190 comp rx=0 tx=0).stop 2024-04-25T09:10:21.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 -- 172.21.15.59:0/172716418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f819c15b910 msgr2=0x7f819c14f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:21.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f819c15b910 0x7f819c14f170 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f819400cb70 tx=0x7f819400a430 comp rx=0 tx=0).stop 2024-04-25T09:10:21.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 -- 172.21.15.59:0/172716418 shutdown_connections 2024-04-25T09:10:21.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8178066f60 0x7f8178069420 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f819c15b910 0x7f819c14f170 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f819c0cf3c0 0x7f819c14ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 --2- 172.21.15.59:0/172716418 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f819c0cd370 0x7f819c15c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 -- 172.21.15.59:0/172716418 >> 172.21.15.59:0/172716418 conn(0x7f819c0b3200 msgr2=0x7f819c099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 -- 172.21.15.59:0/172716418 shutdown_connections 2024-04-25T09:10:21.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:21.991+0000 7f81a1e00640 1 -- 172.21.15.59:0/172716418 wait complete. 2024-04-25T09:10:22.002 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:10:22.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.155+0000 7f7956800640 1 Processor -- start 2024-04-25T09:10:22.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.155+0000 7f7956800640 1 -- start start 2024-04-25T09:10:22.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.159+0000 7f7956800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7950072210 0x7f79500cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.159+0000 7f7956800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795015dcb0 con 0x7f795006bb90 2024-04-25T09:10:22.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.159+0000 7f7956800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795015df90 con 0x7f795006ac10 2024-04-25T09:10:22.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.159+0000 7f7956800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795015e8c0 con 0x7f7950072210 2024-04-25T09:10:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.159+0000 7f7946a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7950072210 0x7f79500cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.159+0000 7f794f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f795006bb90 0x7f7950071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58858/0 (socket says 172.21.15.59:58858) 2024-04-25T09:10:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.159+0000 7f794f400640 1 -- 172.21.15.59:0/3322791957 learned_addr learned my addr 172.21.15.59:0/3322791957 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.159+0000 7f7946a00640 1 -- 172.21.15.59:0/3322791957 >> v1:172.21.15.178:6789/0 conn(0x7f795006ac10 legacy=0x7f795015a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.159+0000 7f7946a00640 1 -- 172.21.15.59:0/3322791957 >> v1:172.21.15.59:6789/0 conn(0x7f795006bb90 legacy=0x7f7950071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.159+0000 7f7946a00640 1 -- 172.21.15.59:0/3322791957 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795015e270 con 0x7f7950072210 2024-04-25T09:10:22.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f7946a00640 1 --2- 172.21.15.59:0/3322791957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7950072210 0x7f79500cf0e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f79380097c0 tx=0x7f793801d5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a70b098af1cfa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:22.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f794ea00640 1 -- 172.21.15.59:0/3322791957 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79380b1070 con 0x7f7950072210 2024-04-25T09:10:22.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f794ea00640 1 -- 172.21.15.59:0/3322791957 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79380ac600 con 0x7f7950072210 2024-04-25T09:10:22.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f794ea00640 1 -- 172.21.15.59:0/3322791957 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79380ac9d0 con 0x7f7950072210 2024-04-25T09:10:22.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f7956800640 1 -- 172.21.15.59:0/3322791957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7950072210 msgr2=0x7f79500cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f7956800640 1 --2- 172.21.15.59:0/3322791957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7950072210 0x7f79500cf0e0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f79380097c0 tx=0x7f793801d5b0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f7956800640 1 -- 172.21.15.59:0/3322791957 shutdown_connections 2024-04-25T09:10:22.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f7956800640 1 --2- 172.21.15.59:0/3322791957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7950072210 0x7f79500cf0e0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f7956800640 1 -- 172.21.15.59:0/3322791957 >> 172.21.15.59:0/3322791957 conn(0x7f79500cfd90 msgr2=0x7f79500d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:22.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f7956800640 1 -- 172.21.15.59:0/3322791957 shutdown_connections 2024-04-25T09:10:22.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f7956800640 1 -- 172.21.15.59:0/3322791957 wait complete. 2024-04-25T09:10:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f7956800640 1 Processor -- start 2024-04-25T09:10:22.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.163+0000 7f7956800640 1 -- start start 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7956800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f795006ac10 0x7f795014c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7956800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795006bb90 0x7f79500ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7956800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7950072210 0x7f79500ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7956800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795015b1b0 con 0x7f795006bb90 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7956800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795015b030 con 0x7f7950072210 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7956800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795015b330 con 0x7f795006ac10 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7946a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795006bb90 0x7f79500ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7946a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795006bb90 0x7f79500ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41928/0 (socket says 172.21.15.59:41928) 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7946a00640 1 -- 172.21.15.59:0/2028065203 learned_addr learned my addr 172.21.15.59:0/2028065203 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f794f400640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f795006ac10 0x7f795014c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f794fe00640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7950072210 0x7f79500ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7946a00640 1 -- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f795006ac10 msgr2=0x7f795014c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7946a00640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f795006ac10 0x7f795014c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7946a00640 1 -- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7950072210 msgr2=0x7f79500ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7946a00640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7950072210 0x7f79500ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7946a00640 1 -- 172.21.15.59:0/2028065203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795014d140 con 0x7f795006bb90 2024-04-25T09:10:22.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7946a00640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795006bb90 0x7f79500ae5d0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f793801b1e0 tx=0x7f793801bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7947e00640 1 -- 172.21.15.59:0/2028065203 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79380ba070 con 0x7f795006bb90 2024-04-25T09:10:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7947e00640 1 -- 172.21.15.59:0/2028065203 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79380b5420 con 0x7f795006bb90 2024-04-25T09:10:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7947e00640 1 -- 172.21.15.59:0/2028065203 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79380b1040 con 0x7f795006bb90 2024-04-25T09:10:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7956800640 1 -- 172.21.15.59:0/2028065203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79500aec40 con 0x7f795006bb90 2024-04-25T09:10:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7956800640 1 -- 172.21.15.59:0/2028065203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795014d6a0 con 0x7f795006bb90 2024-04-25T09:10:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7956800640 1 -- 172.21.15.59:0/2028065203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79500745d0 con 0x7f795006bb90 2024-04-25T09:10:22.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.167+0000 7f7947e00640 1 -- 172.21.15.59:0/2028065203 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f79380ab3a0 con 0x7f795006bb90 2024-04-25T09:10:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.171+0000 7f7947e00640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f792c066f60 0x7f792c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.171+0000 7f7947e00640 1 -- 172.21.15.59:0/2028065203 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f793811e520 con 0x7f795006bb90 2024-04-25T09:10:22.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.171+0000 7f794f400640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f792c066f60 0x7f792c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.171+0000 7f794f400640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f792c066f60 0x7f792c069420 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7940005890 tx=0x7f7940009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:22.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.175+0000 7f7947e00640 1 -- 172.21.15.59:0/2028065203 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f795014d140 con 0x7f795006bb90 2024-04-25T09:10:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.335+0000 7f7956800640 1 -- 172.21.15.59:0/2028065203 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f795006edb0 con 0x7f795006bb90 2024-04-25T09:10:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.335+0000 7f7947e00640 1 -- 172.21.15.59:0/2028065203 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v109) v1 ==== 100+0+11 (secure 0 0 0) 0x7f79380171a0 con 0x7f795006bb90 2024-04-25T09:10:22.326 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:10:22.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.339+0000 7f7956800640 1 -- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f792c066f60 msgr2=0x7f792c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.339+0000 7f7956800640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f792c066f60 0x7f792c069420 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7940005890 tx=0x7f7940009040 comp rx=0 tx=0).stop 2024-04-25T09:10:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.339+0000 7f7956800640 1 -- 172.21.15.59:0/2028065203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795006bb90 msgr2=0x7f79500ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.339+0000 7f7956800640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795006bb90 0x7f79500ae5d0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f793801b1e0 tx=0x7f793801bdf0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.339+0000 7f7956800640 1 -- 172.21.15.59:0/2028065203 shutdown_connections 2024-04-25T09:10:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.339+0000 7f7956800640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f792c066f60 0x7f792c069420 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.339+0000 7f7956800640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7950072210 0x7f79500ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.339+0000 7f7956800640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f795006bb90 0x7f79500ae5d0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.339+0000 7f7956800640 1 --2- 172.21.15.59:0/2028065203 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f795006ac10 0x7f795014c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.339+0000 7f7956800640 1 -- 172.21.15.59:0/2028065203 >> 172.21.15.59:0/2028065203 conn(0x7f79500cfd90 msgr2=0x7f79500cbfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.339+0000 7f7956800640 1 -- 172.21.15.59:0/2028065203 shutdown_connections 2024-04-25T09:10:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.339+0000 7f7956800640 1 -- 172.21.15.59:0/2028065203 wait complete. 2024-04-25T09:10:22.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:10:22.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.499+0000 7f7e99800640 1 Processor -- start 2024-04-25T09:10:22.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.499+0000 7f7e99800640 1 -- start start 2024-04-25T09:10:22.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e99800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7e94159320 0x7f7e9415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e99800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e9406e4a0 0x7f7e9406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e99800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e9415fc00 con 0x7f7e9415f440 2024-04-25T09:10:22.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e99800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9406d640 con 0x7f7e9406e4a0 2024-04-25T09:10:22.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e99800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9406ee10 con 0x7f7e94159320 2024-04-25T09:10:22.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e93400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7e9406e4a0 0x7f7e9406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.491 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e8be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7e9415f440 0x7f7e9406dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58866/0 (socket says 172.21.15.59:58866) 2024-04-25T09:10:22.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e8be00640 1 -- 172.21.15.59:0/3167739133 learned_addr learned my addr 172.21.15.59:0/3167739133 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:22.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e92a00640 1 --2- 172.21.15.59:0/3167739133 >> v2:172.21.15.178:3300/0 conn(0x7f7e94159320 0x7f7e9415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e93400640 1 -- 172.21.15.59:0/3167739133 >> v2:172.21.15.178:3300/0 conn(0x7f7e94159320 msgr2=0x7f7e9415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:22.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e93400640 1 --2- 172.21.15.59:0/3167739133 >> v2:172.21.15.178:3300/0 conn(0x7f7e94159320 0x7f7e9415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e93400640 1 -- 172.21.15.59:0/3167739133 >> v1:172.21.15.59:6789/0 conn(0x7f7e9415f440 legacy=0x7f7e9406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e93400640 1 -- 172.21.15.59:0/3167739133 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9415fee0 con 0x7f7e9406e4a0 2024-04-25T09:10:22.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.503+0000 7f7e92000640 1 -- 172.21.15.59:0/3167739133 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812989695 0 0) 0x7f7e9415fc00 con 0x7f7e9415f440 2024-04-25T09:10:22.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e93400640 1 --2- 172.21.15.59:0/3167739133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9406e4a0 0x7f7e9406e8d0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f7e9406e470 tx=0x7f7e8c01c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2b783b8d19900c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:22.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e92000640 1 -- 172.21.15.59:0/3167739133 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0b2070 con 0x7f7e9406e4a0 2024-04-25T09:10:22.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e92000640 1 -- 172.21.15.59:0/3167739133 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0a5930 con 0x7f7e9406e4a0 2024-04-25T09:10:22.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e92000640 1 -- 172.21.15.59:0/3167739133 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0a5d00 con 0x7f7e9406e4a0 2024-04-25T09:10:22.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 -- 172.21.15.59:0/3167739133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9406e4a0 msgr2=0x7f7e9406e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 --2- 172.21.15.59:0/3167739133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9406e4a0 0x7f7e9406e8d0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f7e9406e470 tx=0x7f7e8c01c870 comp rx=0 tx=0).stop 2024-04-25T09:10:22.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 -- 172.21.15.59:0/3167739133 shutdown_connections 2024-04-25T09:10:22.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 --2- 172.21.15.59:0/3167739133 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9406e4a0 0x7f7e9406e8d0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 --2- 172.21.15.59:0/3167739133 >> v2:172.21.15.178:3300/0 conn(0x7f7e94159320 0x7f7e9415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 -- 172.21.15.59:0/3167739133 >> 172.21.15.59:0/3167739133 conn(0x7f7e94067080 msgr2=0x7f7e9406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:22.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 -- 172.21.15.59:0/3167739133 shutdown_connections 2024-04-25T09:10:22.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 -- 172.21.15.59:0/3167739133 wait complete. 2024-04-25T09:10:22.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 Processor -- start 2024-04-25T09:10:22.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 -- start start 2024-04-25T09:10:22.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e9406e4a0 0x7f7e9415e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e94159320 0x7f7e94157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9415f440 0x7f7e94142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9415f860 con 0x7f7e9415f440 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e94159700 con 0x7f7e9406e4a0 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.507+0000 7f7e99800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9415f9e0 con 0x7f7e94159320 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e93400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9415f440 0x7f7e94142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e93400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9415f440 0x7f7e94142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41946/0 (socket says 172.21.15.59:41946) 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e93400640 1 -- 172.21.15.59:0/4195032526 learned_addr learned my addr 172.21.15.59:0/4195032526 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e92a00640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e9406e4a0 0x7f7e9415e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e8be00640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e94159320 0x7f7e94157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e93400640 1 -- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e94159320 msgr2=0x7f7e94157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e93400640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e94159320 0x7f7e94157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e93400640 1 -- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e9406e4a0 msgr2=0x7f7e9415e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e93400640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e9406e4a0 0x7f7e9415e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e93400640 1 -- 172.21.15.59:0/4195032526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9413d370 con 0x7f7e9415f440 2024-04-25T09:10:22.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e93400640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9415f440 0x7f7e94142d80 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c01a4a0 tx=0x7f7e8c019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e8aa00640 1 -- 172.21.15.59:0/4195032526 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0b2050 con 0x7f7e9415f440 2024-04-25T09:10:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e8aa00640 1 -- 172.21.15.59:0/4195032526 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e8c0be070 con 0x7f7e9415f440 2024-04-25T09:10:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e8aa00640 1 -- 172.21.15.59:0/4195032526 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8c0ada90 con 0x7f7e9415f440 2024-04-25T09:10:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e99800640 1 -- 172.21.15.59:0/4195032526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e9415dac0 con 0x7f7e9415f440 2024-04-25T09:10:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e99800640 1 -- 172.21.15.59:0/4195032526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e9415e080 con 0x7f7e9415f440 2024-04-25T09:10:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e99800640 1 -- 172.21.15.59:0/4195032526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9415e280 con 0x7f7e9415f440 2024-04-25T09:10:22.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.511+0000 7f7e8aa00640 1 -- 172.21.15.59:0/4195032526 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7e8c0adc30 con 0x7f7e9415f440 2024-04-25T09:10:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.515+0000 7f7e8aa00640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e70066f90 0x7f7e70069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.515+0000 7f7e8aa00640 1 -- 172.21.15.59:0/4195032526 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7e8c11fcc0 con 0x7f7e9415f440 2024-04-25T09:10:22.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.515+0000 7f7e92a00640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e70066f90 0x7f7e70069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.515+0000 7f7e92a00640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e70066f90 0x7f7e70069450 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009af0 tx=0x7f7e84008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:22.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.519+0000 7f7e8aa00640 1 -- 172.21.15.59:0/4195032526 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7e9415e280 con 0x7f7e9415f440 2024-04-25T09:10:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 -- 172.21.15.59:0/4195032526 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e940745d0 con 0x7f7e9415f440 2024-04-25T09:10:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e8aa00640 1 -- 172.21.15.59:0/4195032526 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v109) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7e8c126080 con 0x7f7e9415f440 2024-04-25T09:10:22.683 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:10:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 -- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e70066f90 msgr2=0x7f7e70069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e70066f90 0x7f7e70069450 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f7e84009af0 tx=0x7f7e84008040 comp rx=0 tx=0).stop 2024-04-25T09:10:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 -- 172.21.15.59:0/4195032526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9415f440 msgr2=0x7f7e94142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9415f440 0x7f7e94142d80 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f7e8c01a4a0 tx=0x7f7e8c019610 comp rx=0 tx=0).stop 2024-04-25T09:10:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 -- 172.21.15.59:0/4195032526 shutdown_connections 2024-04-25T09:10:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7e70066f90 0x7f7e70069450 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e9415f440 0x7f7e94142d80 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7e94159320 0x7f7e94157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 --2- 172.21.15.59:0/4195032526 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7e9406e4a0 0x7f7e9415e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 -- 172.21.15.59:0/4195032526 >> 172.21.15.59:0/4195032526 conn(0x7f7e94067080 msgr2=0x7f7e9413f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:22.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 -- 172.21.15.59:0/4195032526 shutdown_connections 2024-04-25T09:10:22.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.695+0000 7f7e99800640 1 -- 172.21.15.59:0/4195032526 wait complete. 2024-04-25T09:10:22.704 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:10:22.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:22.704 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:10:22.769 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:10:22.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:22.769 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:10:22.789 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.979+0000 7f1da2400640 1 Processor -- start 2024-04-25T09:10:22.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.979+0000 7f1da2400640 1 -- start start 2024-04-25T09:10:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1da2400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d9c099a60 0x7f1d9c099e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1da2400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1d9c0cff30 0x7f1d9c0d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1da2400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d9c09a380 con 0x7f1d9c15ee00 2024-04-25T09:10:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1da2400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c06c430 con 0x7f1d9c099a60 2024-04-25T09:10:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1da2400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9c06c650 con 0x7f1d9c0cff30 2024-04-25T09:10:22.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1d9b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d9c099a60 0x7f1d9c099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1d9b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d9c099a60 0x7f1d9c099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41954/0 (socket says 172.21.15.59:41954) 2024-04-25T09:10:22.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1d9b400640 1 -- 172.21.15.59:0/991552829 learned_addr learned my addr 172.21.15.59:0/991552829 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:22.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1d9be00640 1 --2- 172.21.15.59:0/991552829 >> v2:172.21.15.178:3300/0 conn(0x7f1d9c0cff30 0x7f1d9c0d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1d9b400640 1 -- 172.21.15.59:0/991552829 >> v2:172.21.15.178:3300/0 conn(0x7f1d9c0cff30 msgr2=0x7f1d9c0d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:22.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1d9b400640 1 --2- 172.21.15.59:0/991552829 >> v2:172.21.15.178:3300/0 conn(0x7f1d9c0cff30 0x7f1d9c0d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1d9b400640 1 -- 172.21.15.59:0/991552829 >> v1:172.21.15.178:6789/0 conn(0x7f1d9c15ee00 legacy=0x7f1d9c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.983+0000 7f1d9b400640 1 -- 172.21.15.59:0/991552829 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c06c930 con 0x7f1d9c099a60 2024-04-25T09:10:22.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1d9b400640 1 --2- 172.21.15.59:0/991552829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c099a60 0x7f1d9c099e40 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c073210 tx=0x7f1d8c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b42a915fdcb7ff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:22.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1d9aa00640 1 -- 172.21.15.59:0/991552829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0ab610 con 0x7f1d9c099a60 2024-04-25T09:10:22.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1d9aa00640 1 -- 172.21.15.59:0/991552829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8c0b0070 con 0x7f1d9c099a60 2024-04-25T09:10:22.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1d9aa00640 1 -- 172.21.15.59:0/991552829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0ab9d0 con 0x7f1d9c099a60 2024-04-25T09:10:22.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1da2400640 1 -- 172.21.15.59:0/991552829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c099a60 msgr2=0x7f1d9c099e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1da2400640 1 --2- 172.21.15.59:0/991552829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c099a60 0x7f1d9c099e40 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f1d9c073210 tx=0x7f1d8c01c520 comp rx=0 tx=0).stop 2024-04-25T09:10:22.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1da2400640 1 -- 172.21.15.59:0/991552829 shutdown_connections 2024-04-25T09:10:22.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1da2400640 1 --2- 172.21.15.59:0/991552829 >> v2:172.21.15.178:3300/0 conn(0x7f1d9c0cff30 0x7f1d9c0d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1da2400640 1 --2- 172.21.15.59:0/991552829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c099a60 0x7f1d9c099e40 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1da2400640 1 -- 172.21.15.59:0/991552829 >> 172.21.15.59:0/991552829 conn(0x7f1d9c0d17a0 msgr2=0x7f1d9c0d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:22.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1da2400640 1 -- 172.21.15.59:0/991552829 shutdown_connections 2024-04-25T09:10:22.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1da2400640 1 -- 172.21.15.59:0/991552829 wait complete. 2024-04-25T09:10:22.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1da2400640 1 Processor -- start 2024-04-25T09:10:22.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.987+0000 7f1da2400640 1 -- start start 2024-04-25T09:10:22.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1da2400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d9c099a60 0x7f1d9c159c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1da2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c0cff30 0x7f1d9c0b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1da2400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d9c15ee00 0x7f1d9c06fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1da2400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c15e000 con 0x7f1d9c0cff30 2024-04-25T09:10:22.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1da2400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c15de80 con 0x7f1d9c099a60 2024-04-25T09:10:22.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1da2400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9c16aa00 con 0x7f1d9c15ee00 2024-04-25T09:10:22.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c0cff30 0x7f1d9c0b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c0cff30 0x7f1d9c0b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41966/0 (socket says 172.21.15.59:41966) 2024-04-25T09:10:22.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93e00640 1 -- 172.21.15.59:0/3260488230 learned_addr learned my addr 172.21.15.59:0/3260488230 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:22.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d9b400640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d9c099a60 0x7f1d9c159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d9be00640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d9c15ee00 0x7f1d9c06fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93e00640 1 -- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d9c15ee00 msgr2=0x7f1d9c06fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93e00640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d9c15ee00 0x7f1d9c06fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93e00640 1 -- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d9c099a60 msgr2=0x7f1d9c159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93e00640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d9c099a60 0x7f1d9c159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93e00640 1 -- 172.21.15.59:0/3260488230 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d9c0b4b30 con 0x7f1d9c0cff30 2024-04-25T09:10:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d9b400640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d9c099a60 0x7f1d9c159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93e00640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c0cff30 0x7f1d9c0b45f0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400c430 tx=0x7f1d8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93400640 1 -- 172.21.15.59:0/3260488230 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d840052d0 con 0x7f1d9c0cff30 2024-04-25T09:10:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93400640 1 -- 172.21.15.59:0/3260488230 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d84005470 con 0x7f1d9c0cff30 2024-04-25T09:10:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1da2400640 1 -- 172.21.15.59:0/3260488230 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d9c14e170 con 0x7f1d9c0cff30 2024-04-25T09:10:22.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93400640 1 -- 172.21.15.59:0/3260488230 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84007260 con 0x7f1d9c0cff30 2024-04-25T09:10:22.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1da2400640 1 -- 172.21.15.59:0/3260488230 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d9c0b5090 con 0x7f1d9c0cff30 2024-04-25T09:10:22.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1da2400640 1 -- 172.21.15.59:0/3260488230 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9c0745d0 con 0x7f1d9c0cff30 2024-04-25T09:10:22.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.991+0000 7f1d93400640 1 -- 172.21.15.59:0/3260488230 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1d84007400 con 0x7f1d9c0cff30 2024-04-25T09:10:22.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.995+0000 7f1d93400640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d78066f60 0x7f1d78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:22.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.995+0000 7f1d93400640 1 -- 172.21.15.59:0/3260488230 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1d84084780 con 0x7f1d9c0cff30 2024-04-25T09:10:22.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.995+0000 7f1d9b400640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d78066f60 0x7f1d78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:22.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.995+0000 7f1d9b400640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d78066f60 0x7f1d78069420 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0af000 tx=0x7f1d8c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:22.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:22.999+0000 7f1d93400640 1 -- 172.21.15.59:0/3260488230 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1d9c0b4b30 con 0x7f1d9c0cff30 2024-04-25T09:10:23.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.191+0000 7f1da2400640 1 -- 172.21.15.59:0/3260488230 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d9c09ae10 con 0x7f1d9c0cff30 2024-04-25T09:10:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.191+0000 7f1d93400640 1 -- 172.21.15.59:0/3260488230 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f1d84055530 con 0x7f1d9c0cff30 2024-04-25T09:10:23.181 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:23.181 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":87,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:08.100794+0000","modified":"2024-04-25T09:10:11.103823+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8322":{"gid":8322,"name":"a","rank":0,"incarnation":83,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2867303658","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2867303658},{"type":"v1","addr":"172.21.15.59:6835","nonce":2867303658}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:10:23.181 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 87 2024-04-25T09:10:23.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.195+0000 7f1da2400640 1 -- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d78066f60 msgr2=0x7f1d78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.195+0000 7f1da2400640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d78066f60 0x7f1d78069420 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0af000 tx=0x7f1d8c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:10:23.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.195+0000 7f1da2400640 1 -- 172.21.15.59:0/3260488230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c0cff30 msgr2=0x7f1d9c0b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.195+0000 7f1da2400640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c0cff30 0x7f1d9c0b45f0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400c430 tx=0x7f1d8400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.195+0000 7f1da2400640 1 -- 172.21.15.59:0/3260488230 shutdown_connections 2024-04-25T09:10:23.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.195+0000 7f1da2400640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1d78066f60 0x7f1d78069420 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.195+0000 7f1da2400640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1d9c15ee00 0x7f1d9c06fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.195+0000 7f1da2400640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d9c0cff30 0x7f1d9c0b45f0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.195+0000 7f1da2400640 1 --2- 172.21.15.59:0/3260488230 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1d9c099a60 0x7f1d9c159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.195+0000 7f1da2400640 1 -- 172.21.15.59:0/3260488230 >> 172.21.15.59:0/3260488230 conn(0x7f1d9c0d17a0 msgr2=0x7f1d9c0d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.195+0000 7f1da2400640 1 -- 172.21.15.59:0/3260488230 shutdown_connections 2024-04-25T09:10:23.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.195+0000 7f1da2400640 1 -- 172.21.15.59:0/3260488230 wait complete. 2024-04-25T09:10:23.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-25T09:10:23.369 INFO:teuthology.orchestra.run.smithi059.stdout:{"message":"","return_code":0} 2024-04-25T09:10:23.369 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-25T09:10:23.370 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:10:23.370 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:10:23.379 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:10:23.379 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:10:23.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:23.379 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:10:23.429 INFO:teuthology.orchestra.run.smithi059.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T09:10:23.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:10:23.430 DEBUG:teuthology.orchestra.run.smithi059:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T09:10:23.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:23.476 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-25T09:10:23.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.631+0000 7f0aea800640 1 Processor -- start 2024-04-25T09:10:23.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.631+0000 7f0aea800640 1 -- start start 2024-04-25T09:10:23.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0aea800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ae415b6d0 0x7f0ae40cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0aea800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0ae40713c0 0x7f0ae40b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0aea800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ae415f7d0 con 0x7f0ae40d1220 2024-04-25T09:10:23.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0aea800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae40ce4d0 con 0x7f0ae415b6d0 2024-04-25T09:10:23.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0aea800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae415fab0 con 0x7f0ae40713c0 2024-04-25T09:10:23.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0ae3400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0ae415b6d0 0x7f0ae40cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0adbe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0ae40d1220 0x7f0ae4070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58868/0 (socket says 172.21.15.59:58868) 2024-04-25T09:10:23.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0adbe00640 1 -- 172.21.15.59:0/2988065881 learned_addr learned my addr 172.21.15.59:0/2988065881 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:23.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0ae3e00640 1 --2- 172.21.15.59:0/2988065881 >> v2:172.21.15.178:3300/0 conn(0x7f0ae40713c0 0x7f0ae40b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0ae3400640 1 -- 172.21.15.59:0/2988065881 >> v2:172.21.15.178:3300/0 conn(0x7f0ae40713c0 msgr2=0x7f0ae40b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0ae3400640 1 --2- 172.21.15.59:0/2988065881 >> v2:172.21.15.178:3300/0 conn(0x7f0ae40713c0 0x7f0ae40b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0ae3400640 1 -- 172.21.15.59:0/2988065881 >> v1:172.21.15.59:6789/0 conn(0x7f0ae40d1220 legacy=0x7f0ae4070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0ae3400640 1 -- 172.21.15.59:0/2988065881 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae415fd90 con 0x7f0ae415b6d0 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.635+0000 7f0ae2a00640 1 -- 172.21.15.59:0/2988065881 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267999785 0 0) 0x7f0ae415f7d0 con 0x7f0ae40d1220 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.639+0000 7f0ae3400640 1 --2- 172.21.15.59:0/2988065881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae415b6d0 0x7f0ae40cdf90 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40b57c0 tx=0x7f0ad401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c1d3c4c3666589 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.639+0000 7f0ae2a00640 1 -- 172.21.15.59:0/2988065881 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40b1070 con 0x7f0ae415b6d0 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.639+0000 7f0ae2a00640 1 -- 172.21.15.59:0/2988065881 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad40ac5f0 con 0x7f0ae415b6d0 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.639+0000 7f0ae2a00640 1 -- 172.21.15.59:0/2988065881 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ae415bcc0 con 0x7f0ae415b6d0 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.639+0000 7f0aea800640 1 -- 172.21.15.59:0/2988065881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae415b6d0 msgr2=0x7f0ae40cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.639+0000 7f0aea800640 1 --2- 172.21.15.59:0/2988065881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae415b6d0 0x7f0ae40cdf90 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40b57c0 tx=0x7f0ad401c480 comp rx=0 tx=0).stop 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.639+0000 7f0aea800640 1 -- 172.21.15.59:0/2988065881 shutdown_connections 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.639+0000 7f0aea800640 1 --2- 172.21.15.59:0/2988065881 >> v2:172.21.15.178:3300/0 conn(0x7f0ae40713c0 0x7f0ae40b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.639+0000 7f0aea800640 1 --2- 172.21.15.59:0/2988065881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae415b6d0 0x7f0ae40cdf90 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.639+0000 7f0aea800640 1 -- 172.21.15.59:0/2988065881 >> 172.21.15.59:0/2988065881 conn(0x7f0ae406f510 msgr2=0x7f0ae406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.639+0000 7f0aea800640 1 -- 172.21.15.59:0/2988065881 shutdown_connections 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.639+0000 7f0aea800640 1 -- 172.21.15.59:0/2988065881 wait complete. 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0aea800640 1 Processor -- start 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0aea800640 1 -- start start 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0aea800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ae40713c0 0x7f0ae414fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0aea800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ae40d1220 0x7f0ae4157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0aea800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae415b6d0 0x7f0ae406c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0aea800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4168700 con 0x7f0ae415b6d0 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0aea800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae415f570 con 0x7f0ae40713c0 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0aea800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4168880 con 0x7f0ae40d1220 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0ae3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae415b6d0 0x7f0ae406c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0ae3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae415b6d0 0x7f0ae406c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41986/0 (socket says 172.21.15.59:41986) 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0ae3e00640 1 -- 172.21.15.59:0/1044052536 learned_addr learned my addr 172.21.15.59:0/1044052536 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:23.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0adbe00640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ae40d1220 0x7f0ae4157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0ae3400640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ae40713c0 0x7f0ae414fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0ae3e00640 1 -- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ae40d1220 msgr2=0x7f0ae4157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0ae3e00640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ae40d1220 0x7f0ae4157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0ae3e00640 1 -- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ae40713c0 msgr2=0x7f0ae414fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0ae3e00640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ae40713c0 0x7f0ae414fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0ae3e00640 1 -- 172.21.15.59:0/1044052536 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae41585f0 con 0x7f0ae415b6d0 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0ae3e00640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae415b6d0 0x7f0ae406c7f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f0adc007e30 tx=0x7f0adc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0adb400640 1 -- 172.21.15.59:0/1044052536 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc014620 con 0x7f0ae415b6d0 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0adb400640 1 -- 172.21.15.59:0/1044052536 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc019070 con 0x7f0ae415b6d0 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0aea800640 1 -- 172.21.15.59:0/1044052536 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae41588d0 con 0x7f0ae415b6d0 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0adb400640 1 -- 172.21.15.59:0/1044052536 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc014a00 con 0x7f0ae415b6d0 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.643+0000 7f0aea800640 1 -- 172.21.15.59:0/1044052536 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae4158e90 con 0x7f0ae415b6d0 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.647+0000 7f0adb400640 1 -- 172.21.15.59:0/1044052536 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0adc014ba0 con 0x7f0ae415b6d0 2024-04-25T09:10:23.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.647+0000 7f0aedc6d000 1 Processor -- start 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.647+0000 7f0aedc6d000 1 -- start start 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0adb400640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0ac0066f60 0x7f0ac0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0adb400640 1 -- 172.21.15.59:0/1044052536 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0adc085a70 con 0x7f0ae415b6d0 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf73c90 0x5610ecf74070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf745b0 0x5610ecf29d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf2a290 0x5610ecf2a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ece10f40 con 0x5610ecf745b0 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ecd78070 con 0x5610ecf73c90 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610ecd001a0 con 0x5610ecf2a290 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0adbe00640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0ac0066f60 0x7f0ac0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf745b0 0x5610ecf29d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0ae3400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf73c90 0x5610ecf74070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0ae3e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf2a290 0x5610ecf2a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf745b0 0x5610ecf29d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41994/0 (socket says 172.21.15.59:41994) 2024-04-25T09:10:23.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0adbe00640 1 -- 172.21.15.59:0/1855601657 learned_addr learned my addr 172.21.15.59:0/1855601657 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0ae3e00640 1 -- 172.21.15.59:0/1855601657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf73c90 msgr2=0x5610ecf74070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0ae3e00640 1 --2- 172.21.15.59:0/1855601657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf73c90 0x5610ecf74070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0ae3e00640 1 -- 172.21.15.59:0/1855601657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf745b0 msgr2=0x5610ecf29d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0ae3e00640 1 --2- 172.21.15.59:0/1855601657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf745b0 0x5610ecf29d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0ae3e00640 1 -- 172.21.15.59:0/1855601657 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610eccfe510 con 0x5610ecf2a290 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0adbe00640 1 --2- 172.21.15.59:0/1855601657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf745b0 0x5610ecf29d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0adbe00640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0ac0066f60 0x7f0ac0069420 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0acc016740 tx=0x7f0acc0018d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0ae3e00640 1 --2- 172.21.15.59:0/1855601657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf2a290 0x5610ecf2a670 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0adc056160 tx=0x7f0adc055e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8904d52514aadeb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0ad3e00640 1 -- 172.21.15.59:0/1855601657 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0544d0 con 0x5610ecf2a290 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0ad3e00640 1 -- 172.21.15.59:0/1855601657 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc06c030 con 0x5610ecf2a290 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0ad3e00640 1 -- 172.21.15.59:0/1855601657 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0adc055620 con 0x5610ecf2a290 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 -- 172.21.15.59:0/1855601657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf2a290 msgr2=0x5610ecf2a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/1855601657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf2a290 0x5610ecf2a670 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0adc056160 tx=0x7f0adc055e20 comp rx=0 tx=0).stop 2024-04-25T09:10:23.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 -- 172.21.15.59:0/1855601657 shutdown_connections 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/1855601657 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf2a290 0x5610ecf2a670 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/1855601657 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf745b0 0x5610ecf29d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/1855601657 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf73c90 0x5610ecf74070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 -- 172.21.15.59:0/1855601657 >> 172.21.15.59:0/1855601657 conn(0x5610ecf26240 msgr2=0x5610ecf28630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 -- 172.21.15.59:0/1855601657 shutdown_connections 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 -- 172.21.15.59:0/1855601657 wait complete. 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 -- start start 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.651+0000 7f0aedc6d000 1 Processor -- start 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf2a290 0x5610ecf34e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 0x5610ecf35370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf745b0 0x5610ecf358b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ecd326c0 con 0x5610ecf73c90 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ecd74110 con 0x5610ecf745b0 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610ecd77380 con 0x5610ecf2a290 2024-04-25T09:10:23.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 10 client.0 _ll_register_callbacks cb 0x5610ecf15570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 0x5610ecf35370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 0x5610ecf35370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42002/0 (socket says 172.21.15.59:42002) 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0adbe00640 1 -- 172.21.15.59:0/793475035 learned_addr learned my addr 172.21.15.59:0/793475035 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0ae3400640 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf2a290 0x5610ecf34e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0ae3e00640 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf745b0 0x5610ecf358b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0adbe00640 1 -- 172.21.15.59:0/793475035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf2a290 msgr2=0x5610ecf34e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0adbe00640 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf2a290 0x5610ecf34e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0adbe00640 1 -- 172.21.15.59:0/793475035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf745b0 msgr2=0x5610ecf358b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0adbe00640 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf745b0 0x5610ecf358b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0adbe00640 1 -- 172.21.15.59:0/793475035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610ecd003b0 con 0x5610ecf73c90 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0adbe00640 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 0x5610ecf35370 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f0acc007fd0 tx=0x7f0acc007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23dfcca3e4a7ca7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0ad0c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0ad0c00640 1 -- 172.21.15.59:0/793475035 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc028060 con 0x5610ecf73c90 2024-04-25T09:10:23.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0ad0c00640 1 -- 172.21.15.59:0/793475035 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0acc010040 con 0x5610ecf73c90 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 1 -- 172.21.15.59:0/793475035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0adc06c030 con 0x5610ecf73c90 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0ad0c00640 1 -- 172.21.15.59:0/793475035 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0acc02e050 con 0x5610ecf73c90 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 10 client.8601 fetch_fsmap learned FSMap version 87 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 1 -- 172.21.15.59:0/793475035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x5610ecdf9e00 con 0x5610ecf73c90 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0ad0c00640 1 -- 172.21.15.59:0/793475035 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0adc06c030 con 0x5610ecf73c90 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0ad0c00640 1 -- 172.21.15.59:0/793475035 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 87) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0acc031020 con 0x5610ecf73c90 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 10 client.8601 fetch_fsmap finished waiting for FSMap version 87 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 10 client.8601 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 20 client.8601 populate_metadata read hostname 'smithi059' 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x5610ecf36120 0x5610ecf85410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 4 client.8601 mds_command: new command op to 8322 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0aedc6d000 1 -- 172.21.15.59:0/793475035 --> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610ecd13d60 con 0x5610ecf36120 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0ae3400640 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x5610ecf36120 0x5610ecf85410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.682 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0ae3400640 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x5610ecf36120 0x5610ecf85410 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5700458a49e4890 server_cookie=de7d90521129640f in_seq=0 out_seq=0 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.655+0000 7f0ad0c00640 10 client.8601 ms_handle_connect on v2:172.21.15.59:6833/2867303658 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0ad0c00640 1 -- 172.21.15.59:0/793475035 <== mds.0 v2:172.21.15.59:6833/2867303658 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5610ecd13d60 con 0x5610ecf36120 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0ad0c00640 10 client.8601 handle_command_reply: tid=0 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0aedc6d000 1 client.8601 shutdown 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0aedc6d000 1 -- 172.21.15.59:0/793475035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 msgr2=0x5610ecf35370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 0x5610ecf35370 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f0acc007fd0 tx=0x7f0acc007d60 comp rx=0 tx=0).stop 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0aedc6d000 1 -- 172.21.15.59:0/793475035 shutdown_connections 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf745b0 0x5610ecf358b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x5610ecf36120 0x5610ecf85410 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 0x5610ecf35370 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/793475035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf2a290 0x5610ecf34e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0ad0c00640 0 client.8601 ms_handle_reset on v2:172.21.15.59:6833/2867303658 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0aedc6d000 1 -- 172.21.15.59:0/793475035 >> 172.21.15.59:0/793475035 conn(0x5610ecf26240 msgr2=0x5610ecf28ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0aedc6d000 1 -- 172.21.15.59:0/793475035 shutdown_connections 2024-04-25T09:10:23.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0aedc6d000 1 -- 172.21.15.59:0/793475035 wait complete. 2024-04-25T09:10:23.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f0aedc6d000 20 client.8601 trim_cache size 0 max 16384 2024-04-25T09:10:23.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f6346a00640 1 Processor -- start 2024-04-25T09:10:23.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f6346a00640 1 -- start start 2024-04-25T09:10:23.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f6346a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63401592e0 0x7f634015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f6346a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f63400719b0 0x7f634015d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f6346a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634015fb10 con 0x7f634015f370 2024-04-25T09:10:23.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f6346a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63400a8660 con 0x7f63401592e0 2024-04-25T09:10:23.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.659+0000 7f6346a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f634015fdf0 con 0x7f63400719b0 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f633fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63401592e0 0x7f634015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f633fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63401592e0 0x7f634015bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42018/0 (socket says 172.21.15.59:42018) 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f633fe00640 1 -- 172.21.15.59:0/2052837341 learned_addr learned my addr 172.21.15.59:0/2052837341 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f6344a00640 1 --2- 172.21.15.59:0/2052837341 >> v2:172.21.15.178:3300/0 conn(0x7f63400719b0 0x7f634015d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f633fe00640 1 -- 172.21.15.59:0/2052837341 >> v2:172.21.15.178:3300/0 conn(0x7f63400719b0 msgr2=0x7f634015d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f633fe00640 1 --2- 172.21.15.59:0/2052837341 >> v2:172.21.15.178:3300/0 conn(0x7f63400719b0 0x7f634015d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f633fe00640 1 -- 172.21.15.59:0/2052837341 >> v1:172.21.15.178:6789/0 conn(0x7f634015f370 legacy=0x7f63400712a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f633fe00640 1 -- 172.21.15.59:0/2052837341 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63401600d0 con 0x7f63401592e0 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f6344a00640 1 --2- 172.21.15.59:0/2052837341 >> v2:172.21.15.178:3300/0 conn(0x7f63400719b0 0x7f634015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f633fe00640 1 --2- 172.21.15.59:0/2052837341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63401592e0 0x7f634015bd80 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f634015f2b0 tx=0x7f633001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930a1879ab73a1fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f633ea00640 1 -- 172.21.15.59:0/2052837341 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300aa670 con 0x7f63401592e0 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f633ea00640 1 -- 172.21.15.59:0/2052837341 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63300af070 con 0x7f63401592e0 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.663+0000 7f633ea00640 1 -- 172.21.15.59:0/2052837341 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300aaa30 con 0x7f63401592e0 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 -- 172.21.15.59:0/2052837341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63401592e0 msgr2=0x7f634015bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 --2- 172.21.15.59:0/2052837341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63401592e0 0x7f634015bd80 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f634015f2b0 tx=0x7f633001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 -- 172.21.15.59:0/2052837341 shutdown_connections 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 --2- 172.21.15.59:0/2052837341 >> v2:172.21.15.178:3300/0 conn(0x7f63400719b0 0x7f634015d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 --2- 172.21.15.59:0/2052837341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63401592e0 0x7f634015bd80 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 -- 172.21.15.59:0/2052837341 >> 172.21.15.59:0/2052837341 conn(0x7f634006ac10 msgr2=0x7f634006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 -- 172.21.15.59:0/2052837341 shutdown_connections 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 -- 172.21.15.59:0/2052837341 wait complete. 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 Processor -- start 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 -- start start 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63400719b0 0x7f63401401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63401592e0 0x7f634014e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634015f370 0x7f6340165380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634015e350 con 0x7f634015f370 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634015f780 con 0x7f63401592e0 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6346a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634015e4d0 con 0x7f63400719b0 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6344a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634015f370 0x7f6340165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6344a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634015f370 0x7f6340165380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42032/0 (socket says 172.21.15.59:42032) 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6344a00640 1 -- 172.21.15.59:0/4137488809 learned_addr learned my addr 172.21.15.59:0/4137488809 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f633f400640 1 --2- 172.21.15.59:0/4137488809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63401592e0 0x7f634014e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f633fe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63400719b0 0x7f63401401f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.667+0000 7f6344a00640 1 -- 172.21.15.59:0/4137488809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63400719b0 msgr2=0x7f63401401f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.671+0000 7f6344a00640 1 --2- 172.21.15.59:0/4137488809 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f63400719b0 0x7f63401401f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.671+0000 7f6344a00640 1 -- 172.21.15.59:0/4137488809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63401592e0 msgr2=0x7f634014e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.671+0000 7f6344a00640 1 --2- 172.21.15.59:0/4137488809 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f63401592e0 0x7f634014e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.671+0000 7f6344a00640 1 -- 172.21.15.59:0/4137488809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634014eb30 con 0x7f634015f370 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.671+0000 7f6344a00640 1 --2- 172.21.15.59:0/4137488809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634015f370 0x7f6340165380 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f6338009fa0 tx=0x7f633800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.671+0000 7f6337e00640 1 -- 172.21.15.59:0/4137488809 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633801a070 con 0x7f634015f370 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.671+0000 7f6337e00640 1 -- 172.21.15.59:0/4137488809 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6338003bc0 con 0x7f634015f370 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.671+0000 7f6337e00640 1 -- 172.21.15.59:0/4137488809 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338004030 con 0x7f634015f370 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.671+0000 7f6346a00640 1 -- 172.21.15.59:0/4137488809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634014ee10 con 0x7f634015f370 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.671+0000 7f6346a00640 1 -- 172.21.15.59:0/4137488809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634014f3d0 con 0x7f634015f370 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.671+0000 7f6346a00640 1 -- 172.21.15.59:0/4137488809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f63400745d0 con 0x7f634015f370 2024-04-25T09:10:23.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.671+0000 7f6337e00640 1 -- 172.21.15.59:0/4137488809 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f633801d070 con 0x7f634015f370 2024-04-25T09:10:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f6337e00640 1 --2- 172.21.15.59:0/4137488809 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6320066f60 0x7f6320069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f6337e00640 1 -- 172.21.15.59:0/4137488809 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6338085b20 con 0x7f634015f370 2024-04-25T09:10:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f6337e00640 1 -- 172.21.15.59:0/4137488809 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+513 (secure 0 0 0) 0x7f6338024070 con 0x7f634015f370 2024-04-25T09:10:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f633fe00640 1 --2- 172.21.15.59:0/4137488809 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6320066f60 0x7f6320069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f6346a00640 1 -- 172.21.15.59:0/4137488809 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f6340072500 con 0x7f634015f370 2024-04-25T09:10:23.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f633fe00640 1 --2- 172.21.15.59:0/4137488809 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6320066f60 0x7f6320069420 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f63300ae000 tx=0x7f63300a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.693 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:10:23.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f0aedc6d000 1 Processor -- start 2024-04-25T09:10:23.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f0aedc6d000 1 -- start start 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f0aedc6d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf2a290 0x5610ecf29640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f0aedc6d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 0x5610ecf29b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f0aedc6d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf745b0 0x5610ecf85410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f0aedc6d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4203370 con 0x5610ecf73c90 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f0aedc6d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4202550 con 0x5610ecf2a290 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.675+0000 7f0aedc6d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae415c5d0 con 0x5610ecf745b0 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 0x5610ecf29b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0adbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 0x5610ecf29b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42036/0 (socket says 172.21.15.59:42036) 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0adbe00640 1 -- 172.21.15.59:0/915902198 learned_addr learned my addr 172.21.15.59:0/915902198 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0ae3400640 1 --2- 172.21.15.59:0/915902198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf2a290 0x5610ecf29640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0ae3e00640 1 --2- 172.21.15.59:0/915902198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf745b0 0x5610ecf85410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0adbe00640 1 -- 172.21.15.59:0/915902198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf745b0 msgr2=0x5610ecf85410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0adbe00640 1 --2- 172.21.15.59:0/915902198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf745b0 0x5610ecf85410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0adbe00640 1 -- 172.21.15.59:0/915902198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf2a290 msgr2=0x5610ecf29640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0adbe00640 1 --2- 172.21.15.59:0/915902198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf2a290 0x5610ecf29640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0adbe00640 1 -- 172.21.15.59:0/915902198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610ecdcfc50 con 0x5610ecf73c90 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0ae3400640 1 --2- 172.21.15.59:0/915902198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf2a290 0x5610ecf29640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0adbe00640 1 --2- 172.21.15.59:0/915902198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 0x5610ecf29b80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f0acc007da0 tx=0x7f0acc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e74206c3a56eb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0ad3400640 1 -- 172.21.15.59:0/915902198 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc006040 con 0x5610ecf73c90 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0ad3400640 1 -- 172.21.15.59:0/915902198 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc036070 con 0x5610ecf73c90 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0ad3400640 1 -- 172.21.15.59:0/915902198 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc016460 con 0x5610ecf73c90 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 -- 172.21.15.59:0/915902198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 msgr2=0x5610ecf29b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/915902198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 0x5610ecf29b80 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f0acc007da0 tx=0x7f0acc020000 comp rx=0 tx=0).stop 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 -- 172.21.15.59:0/915902198 shutdown_connections 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/915902198 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf745b0 0x5610ecf85410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/915902198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf73c90 0x5610ecf29b80 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/915902198 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf2a290 0x5610ecf29640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 -- 172.21.15.59:0/915902198 >> 172.21.15.59:0/915902198 conn(0x5610ecf26240 msgr2=0x5610ecf2eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 -- 172.21.15.59:0/915902198 shutdown_connections 2024-04-25T09:10:23.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 -- 172.21.15.59:0/915902198 wait complete. 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 -- start start 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 Processor -- start 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf2a290 0x5610ecfd3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf73c90 0x5610ecfd43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf745b0 0x5610ecf8ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ecd1abd0 con 0x5610ecf2a290 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4202100 con 0x5610ecf73c90 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5610ecd77380 con 0x5610ecf745b0 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.679+0000 7f0aedc6d000 10 client.0 _ll_register_callbacks cb 0x7f0adc052470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ae3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf2a290 0x5610ecfd3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ae3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf2a290 0x5610ecfd3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42052/0 (socket says 172.21.15.59:42052) 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ae3400640 1 -- 172.21.15.59:0/326660510 learned_addr learned my addr 172.21.15.59:0/326660510 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:23.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ae3e00640 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf745b0 0x5610ecf8ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0adbe00640 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf73c90 0x5610ecfd43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ae3400640 1 -- 172.21.15.59:0/326660510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf745b0 msgr2=0x5610ecf8ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ae3400640 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf745b0 0x5610ecf8ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ae3400640 1 -- 172.21.15.59:0/326660510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf73c90 msgr2=0x5610ecfd43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ae3400640 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf73c90 0x5610ecfd43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ae3400640 1 -- 172.21.15.59:0/326660510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610ecd40120 con 0x5610ecf2a290 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ae3400640 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf2a290 0x5610ecfd3eb0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0ad401a0b0 tx=0x7f0ad40046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ac3fc8bc7114b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ad0c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ad0c00640 1 -- 172.21.15.59:0/326660510 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad40b1040 con 0x5610ecf2a290 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ad0c00640 1 -- 172.21.15.59:0/326660510 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0ad40bf320 con 0x5610ecf2a290 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 -- 172.21.15.59:0/326660510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0acc036070 con 0x5610ecf2a290 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ad0c00640 1 -- 172.21.15.59:0/326660510 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ad40bfe30 con 0x5610ecf2a290 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 10 client.8613 fetch_fsmap learned FSMap version 87 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 -- 172.21.15.59:0/326660510 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x5610ecd1f170 con 0x5610ecf2a290 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ad0c00640 1 -- 172.21.15.59:0/326660510 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc036070 con 0x5610ecf2a290 2024-04-25T09:10:23.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ad0c00640 1 -- 172.21.15.59:0/326660510 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 87) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0ad40ab070 con 0x5610ecf2a290 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 10 client.8613 fetch_fsmap finished waiting for FSMap version 87 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 10 client.8613 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 20 client.8613 populate_metadata read hostname 'smithi059' 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x5610ecf8fc60 0x5610ecf90070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 4 client.8613 mds_command: new command op to 8322 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 -- 172.21.15.59:0/326660510 --> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x5610ecd855b0 con 0x5610ecf8fc60 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0adbe00640 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x5610ecf8fc60 0x5610ecf90070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0adbe00640 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x5610ecf8fc60 0x5610ecf90070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=521f13f324327813 server_cookie=9c14145fe43d6f64 in_seq=0 out_seq=0 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ad0c00640 10 client.8613 ms_handle_connect on v2:172.21.15.59:6833/2867303658 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ad0c00640 1 -- 172.21.15.59:0/326660510 <== mds.0 v2:172.21.15.59:6833/2867303658 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5610ecd855b0 con 0x5610ecf8fc60 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ad0c00640 10 client.8613 handle_command_reply: tid=0 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 client.8613 shutdown 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 -- 172.21.15.59:0/326660510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf2a290 msgr2=0x5610ecfd3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf2a290 0x5610ecfd3eb0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0ad401a0b0 tx=0x7f0ad40046d0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 -- 172.21.15.59:0/326660510 shutdown_connections 2024-04-25T09:10:23.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5610ecf745b0 0x5610ecf8ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5610ecf73c90 0x5610ecfd43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x5610ecf8fc60 0x5610ecf90070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 --2- 172.21.15.59:0/326660510 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5610ecf2a290 0x5610ecfd3eb0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0aedc6d000 1 -- 172.21.15.59:0/326660510 >> 172.21.15.59:0/326660510 conn(0x5610ecf26240 msgr2=0x5610ecf2f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.683+0000 7f0ad0c00640 0 client.8613 ms_handle_reset on v2:172.21.15.59:6833/2867303658 2024-04-25T09:10:23.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aedc6d000 1 -- 172.21.15.59:0/326660510 shutdown_connections 2024-04-25T09:10:23.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aedc6d000 1 -- 172.21.15.59:0/326660510 wait complete. 2024-04-25T09:10:23.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aedc6d000 20 client.8613 trim_cache size 0 max 16384 2024-04-25T09:10:23.703 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:10:23.704 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-04-25T09:10:23.704 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "aa3448ab-9b89-4116-b74f-fdd4de9b611b", 2024-04-25T09:10:23.704 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-04-25T09:10:23.704 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:10:23.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aea800640 1 -- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0ac0066f60 msgr2=0x7f0ac0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aea800640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0ac0066f60 0x7f0ac0069420 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0acc016740 tx=0x7f0acc0018d0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aea800640 1 -- 172.21.15.59:0/1044052536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae415b6d0 msgr2=0x7f0ae406c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aea800640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae415b6d0 0x7f0ae406c7f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f0adc007e30 tx=0x7f0adc00e4b0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aea800640 1 -- 172.21.15.59:0/1044052536 shutdown_connections 2024-04-25T09:10:23.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aea800640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0ac0066f60 0x7f0ac0069420 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aea800640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ae415b6d0 0x7f0ae406c7f0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aea800640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0ae40d1220 0x7f0ae4157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aea800640 1 --2- 172.21.15.59:0/1044052536 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0ae40713c0 0x7f0ae414fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aea800640 1 -- 172.21.15.59:0/1044052536 >> 172.21.15.59:0/1044052536 conn(0x7f0ae406f510 msgr2=0x7f0ae40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aea800640 1 -- 172.21.15.59:0/1044052536 shutdown_connections 2024-04-25T09:10:23.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.687+0000 7f0aea800640 1 -- 172.21.15.59:0/1044052536 wait complete. 2024-04-25T09:10:23.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:23.706 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:10:23.748 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:10:23.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.903+0000 7fc17a600640 1 Processor -- start 2024-04-25T09:10:23.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.903+0000 7fc17a600640 1 -- start start 2024-04-25T09:10:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.903+0000 7fc17a600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc1740b1fb0 0x7fc17415f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.907+0000 7fc17a600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1740cfce0 con 0x7fc1740b2440 2024-04-25T09:10:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.907+0000 7fc17a600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1740cffc0 con 0x7fc17415f3d0 2024-04-25T09:10:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.907+0000 7fc17a600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1740d0580 con 0x7fc1740b1fb0 2024-04-25T09:10:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.907+0000 7fc179c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc1740b2440 0x7fc17415fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58884/0 (socket says 172.21.15.59:58884) 2024-04-25T09:10:23.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.907+0000 7fc179c00640 1 -- 172.21.15.59:0/2185971902 learned_addr learned my addr 172.21.15.59:0/2185971902 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:23.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.907+0000 7fc16be00640 1 --2- 172.21.15.59:0/2185971902 >> v2:172.21.15.178:3300/0 conn(0x7fc1740b1fb0 0x7fc17415f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.907+0000 7fc173e00640 1 -- 172.21.15.59:0/2185971902 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104675992 0 0) 0x7fc1740cfce0 con 0x7fc1740b2440 2024-04-25T09:10:23.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.907+0000 7fc173e00640 1 -- 172.21.15.59:0/2185971902 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc158003530 con 0x7fc1740b2440 2024-04-25T09:10:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.907+0000 7fc16be00640 1 -- 172.21.15.59:0/2185971902 >> v1:172.21.15.178:6789/0 conn(0x7fc17415f3d0 legacy=0x7fc1740b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.907+0000 7fc16be00640 1 -- 172.21.15.59:0/2185971902 >> v1:172.21.15.59:6789/0 conn(0x7fc1740b2440 legacy=0x7fc17415fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.907+0000 7fc16be00640 1 -- 172.21.15.59:0/2185971902 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1740d02a0 con 0x7fc1740b1fb0 2024-04-25T09:10:23.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.907+0000 7fc16be00640 1 --2- 172.21.15.59:0/2185971902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740b1fb0 0x7fc17415f7b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0097c0 tx=0x7fc15c01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1f3e6b97f9505f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc173e00640 1 -- 172.21.15.59:0/2185971902 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0b0070 con 0x7fc1740b1fb0 2024-04-25T09:10:23.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc173e00640 1 -- 172.21.15.59:0/2185971902 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c0ab600 con 0x7fc1740b1fb0 2024-04-25T09:10:23.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc173e00640 1 -- 172.21.15.59:0/2185971902 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0ab9b0 con 0x7fc1740b1fb0 2024-04-25T09:10:23.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 -- 172.21.15.59:0/2185971902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740b1fb0 msgr2=0x7fc17415f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 --2- 172.21.15.59:0/2185971902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740b1fb0 0x7fc17415f7b0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0097c0 tx=0x7fc15c01c410 comp rx=0 tx=0).stop 2024-04-25T09:10:23.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 -- 172.21.15.59:0/2185971902 shutdown_connections 2024-04-25T09:10:23.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 --2- 172.21.15.59:0/2185971902 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740b1fb0 0x7fc17415f7b0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 -- 172.21.15.59:0/2185971902 >> 172.21.15.59:0/2185971902 conn(0x7fc1740d15d0 msgr2=0x7fc1740d19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 -- 172.21.15.59:0/2185971902 shutdown_connections 2024-04-25T09:10:23.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 -- 172.21.15.59:0/2185971902 wait complete. 2024-04-25T09:10:23.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 Processor -- start 2024-04-25T09:10:23.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 -- start start 2024-04-25T09:10:23.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1740b1fb0 0x7fc17415cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740b2440 0x7fc174157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17415f3d0 0x7fc17415d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740cd2c0 con 0x7fc17415f3d0 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740cd140 con 0x7fc1740b2440 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.911+0000 7fc17a600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1740cd440 con 0x7fc1740b1fb0 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc179200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1740b1fb0 0x7fc17415cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc179c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17415f3d0 0x7fc17415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc16be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740b2440 0x7fc174157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc16be00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740b2440 0x7fc174157de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:47446/0 (socket says 172.21.15.59:47446) 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc16be00640 1 -- 172.21.15.59:0/2261694633 learned_addr learned my addr 172.21.15.59:0/2261694633 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc179200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1740b1fb0 0x7fc17415cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:46334/0 (socket says 172.21.15.59:46334) 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc179c00640 1 -- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1740b1fb0 msgr2=0x7fc17415cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc179c00640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1740b1fb0 0x7fc17415cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc179c00640 1 -- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740b2440 msgr2=0x7fc174157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc179c00640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740b2440 0x7fc174157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc179c00640 1 -- 172.21.15.59:0/2261694633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17415bd60 con 0x7fc17415f3d0 2024-04-25T09:10:23.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc16be00640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740b2440 0x7fc174157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:23.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc179c00640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17415f3d0 0x7fc17415d430 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00cab0 tx=0x7fc16c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc171600640 1 -- 172.21.15.59:0/2261694633 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c017070 con 0x7fc17415f3d0 2024-04-25T09:10:23.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc171600640 1 -- 172.21.15.59:0/2261694633 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16c00ac30 con 0x7fc17415f3d0 2024-04-25T09:10:23.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc17a600640 1 -- 172.21.15.59:0/2261694633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17415c040 con 0x7fc17415f3d0 2024-04-25T09:10:23.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc171600640 1 -- 172.21.15.59:0/2261694633 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16c012600 con 0x7fc17415f3d0 2024-04-25T09:10:23.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc17a600640 1 -- 172.21.15.59:0/2261694633 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17415c600 con 0x7fc17415f3d0 2024-04-25T09:10:23.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.915+0000 7fc171600640 1 -- 172.21.15.59:0/2261694633 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc16c01a070 con 0x7fc17415f3d0 2024-04-25T09:10:23.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc171600640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc150066f60 0x7fc150069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc171600640 1 -- 172.21.15.59:0/2261694633 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc16c084f30 con 0x7fc17415f3d0 2024-04-25T09:10:23.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 Processor -- start 2024-04-25T09:10:23.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 -- start start 2024-04-25T09:10:23.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179200640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc150066f60 0x7fc150069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 0x55741f661db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f617b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6180a0 0x55741f618480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55741f464ff0 con 0x55741f6619d0 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55741f3ed150 con 0x55741f6180a0 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55741f461090 con 0x55741f6622f0 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179200640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc150066f60 0x7fc150069420 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc164001770 tx=0x7fc164009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 0x55741f661db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 0x55741f661db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42066/0 (socket says 172.21.15.59:42066) 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179200640 1 -- 172.21.15.59:0/3662411755 learned_addr learned my addr 172.21.15.59:0/3662411755 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc16be00640 1 --2- 172.21.15.59:0/3662411755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f617b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179c00640 1 --2- 172.21.15.59:0/3662411755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6180a0 0x55741f618480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179200640 1 -- 172.21.15.59:0/3662411755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 msgr2=0x55741f617b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179200640 1 --2- 172.21.15.59:0/3662411755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f617b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179200640 1 -- 172.21.15.59:0/3662411755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6180a0 msgr2=0x55741f618480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179200640 1 --2- 172.21.15.59:0/3662411755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6180a0 0x55741f618480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179200640 1 -- 172.21.15.59:0/3662411755 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55741f5fb0d0 con 0x55741f6619d0 2024-04-25T09:10:23.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179c00640 1 --2- 172.21.15.59:0/3662411755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6180a0 0x55741f618480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:23.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc16be00640 1 --2- 172.21.15.59:0/3662411755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f617b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:23.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc179200640 1 --2- 172.21.15.59:0/3662411755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 0x55741f661db0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fc16400fae0 tx=0x7fc164000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bbe7478dae4271 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc169600640 1 -- 172.21.15.59:0/3662411755 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164025070 con 0x55741f6619d0 2024-04-25T09:10:23.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc169600640 1 -- 172.21.15.59:0/3662411755 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164015bf0 con 0x55741f6619d0 2024-04-25T09:10:23.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc169600640 1 -- 172.21.15.59:0/3662411755 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164020400 con 0x55741f6619d0 2024-04-25T09:10:23.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 -- 172.21.15.59:0/3662411755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 msgr2=0x55741f661db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/3662411755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 0x55741f661db0 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fc16400fae0 tx=0x7fc164000ee0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 -- 172.21.15.59:0/3662411755 shutdown_connections 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/3662411755 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6180a0 0x55741f618480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/3662411755 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f617b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/3662411755 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 0x55741f661db0 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 -- 172.21.15.59:0/3662411755 >> 172.21.15.59:0/3662411755 conn(0x55741f614020 msgr2=0x55741f616440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 -- 172.21.15.59:0/3662411755 shutdown_connections 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.919+0000 7fc17f0d9000 1 -- 172.21.15.59:0/3662411755 wait complete. 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 1 -- start start 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 1 Processor -- start 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 0x55741f6467f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6619d0 0x55741f646d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6622f0 0x55741f647270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55741f429250 con 0x55741f6180a0 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55741f41f690 con 0x55741f6622f0 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55741f3eda40 con 0x55741f6619d0 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 10 client.0 _ll_register_callbacks cb 0x55741f602e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc179200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 0x55741f6467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc179200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 0x55741f6467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42078/0 (socket says 172.21.15.59:42078) 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc179200640 1 -- 172.21.15.59:0/2368265408 learned_addr learned my addr 172.21.15.59:0/2368265408 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc16be00640 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6619d0 0x55741f646d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc179c00640 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6622f0 0x55741f647270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc179200640 1 -- 172.21.15.59:0/2368265408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6619d0 msgr2=0x55741f646d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc179200640 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6619d0 0x55741f646d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc179200640 1 -- 172.21.15.59:0/2368265408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6622f0 msgr2=0x55741f647270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc179200640 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6622f0 0x55741f647270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc179200640 1 -- 172.21.15.59:0/2368265408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55741f5121c0 con 0x55741f6180a0 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc179200640 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 0x55741f6467f0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fc164000f20 tx=0x7fc164007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a408b2afddf62aad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc162000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc162000640 1 -- 172.21.15.59:0/2368265408 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164025050 con 0x55741f6180a0 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc162000640 1 -- 172.21.15.59:0/2368265408 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc16402c450 con 0x55741f6180a0 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2368265408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc164015bf0 con 0x55741f6180a0 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc162000640 1 -- 172.21.15.59:0/2368265408 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc164020e50 con 0x55741f6180a0 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 10 client.8625 fetch_fsmap learned FSMap version 87 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2368265408 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x55741f50e170 con 0x55741f6180a0 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc162000640 1 -- 172.21.15.59:0/2368265408 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc164015bf0 con 0x55741f6180a0 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc162000640 1 -- 172.21.15.59:0/2368265408 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 87) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc1640067e0 con 0x55741f6180a0 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 10 client.8625 fetch_fsmap finished waiting for FSMap version 87 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 10 client.8625 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 20 client.8625 populate_metadata read hostname 'smithi059' 2024-04-25T09:10:23.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55741f671c80 0x55741f674070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 4 client.8625 mds_command: new command op to 8322 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2368265408 --> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55741f400c60 con 0x55741f671c80 2024-04-25T09:10:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc16be00640 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55741f671c80 0x55741f674070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc16be00640 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55741f671c80 0x55741f674070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ea49eef78ebd6ff server_cookie=63c7a9188340192d in_seq=0 out_seq=0 2024-04-25T09:10:23.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.923+0000 7fc162000640 10 client.8625 ms_handle_connect on v2:172.21.15.59:6833/2867303658 2024-04-25T09:10:23.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc162000640 1 -- 172.21.15.59:0/2368265408 <== mds.0 v2:172.21.15.59:6833/2867303658 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55741f400c60 con 0x55741f671c80 2024-04-25T09:10:23.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc162000640 10 client.8625 handle_command_reply: tid=0 2024-04-25T09:10:23.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc17f0d9000 1 client.8625 shutdown 2024-04-25T09:10:23.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2368265408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 msgr2=0x55741f6467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 0x55741f6467f0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fc164000f20 tx=0x7fc164007f90 comp rx=0 tx=0).stop 2024-04-25T09:10:23.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2368265408 shutdown_connections 2024-04-25T09:10:23.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6622f0 0x55741f647270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6619d0 0x55741f646d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55741f671c80 0x55741f674070 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/2368265408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 0x55741f6467f0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2368265408 >> 172.21.15.59:0/2368265408 conn(0x55741f614020 msgr2=0x55741f616ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc162000640 0 client.8625 ms_handle_reset on v2:172.21.15.59:6833/2867303658 2024-04-25T09:10:23.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2368265408 shutdown_connections 2024-04-25T09:10:23.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2368265408 wait complete. 2024-04-25T09:10:23.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.927+0000 7fc17f0d9000 20 client.8625 trim_cache size 0 max 16384 2024-04-25T09:10:23.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 Processor -- start 2024-04-25T09:10:23.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 -- start start 2024-04-25T09:10:23.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6180a0 0x55741f660e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 0x55741f617420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f617960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc174202f30 con 0x55741f6619d0 2024-04-25T09:10:23.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc174202160 con 0x55741f6180a0 2024-04-25T09:10:23.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc174164cb0 con 0x55741f6622f0 2024-04-25T09:10:23.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc16be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 0x55741f617420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc16be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 0x55741f617420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42092/0 (socket says 172.21.15.59:42092) 2024-04-25T09:10:23.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc16be00640 1 -- 172.21.15.59:0/2408531533 learned_addr learned my addr 172.21.15.59:0/2408531533 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:23.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc16be00640 1 -- 172.21.15.59:0/2408531533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 msgr2=0x55741f617960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc16be00640 1 --2- 172.21.15.59:0/2408531533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f617960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc16be00640 1 -- 172.21.15.59:0/2408531533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6180a0 msgr2=0x55741f660e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc16be00640 1 --2- 172.21.15.59:0/2408531533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6180a0 0x55741f660e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc16be00640 1 -- 172.21.15.59:0/2408531533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55741f4abde0 con 0x55741f6619d0 2024-04-25T09:10:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc16be00640 1 --2- 172.21.15.59:0/2408531533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 0x55741f617420 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fc15c01c8f0 tx=0x7fc15c0a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d70c9111993289 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc168c00640 1 -- 172.21.15.59:0/2408531533 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0b0040 con 0x55741f6619d0 2024-04-25T09:10:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc168c00640 1 -- 172.21.15.59:0/2408531533 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c0c4030 con 0x55741f6619d0 2024-04-25T09:10:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc168c00640 1 -- 172.21.15.59:0/2408531533 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0c0d70 con 0x55741f6619d0 2024-04-25T09:10:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2408531533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 msgr2=0x55741f617420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/2408531533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 0x55741f617420 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fc15c01c8f0 tx=0x7fc15c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:10:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2408531533 shutdown_connections 2024-04-25T09:10:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/2408531533 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f617960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/2408531533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6619d0 0x55741f617420 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/2408531533 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6180a0 0x55741f660e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2408531533 >> 172.21.15.59:0/2408531533 conn(0x55741f614020 msgr2=0x55741f6600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2408531533 shutdown_connections 2024-04-25T09:10:23.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 -- 172.21.15.59:0/2408531533 wait complete. 2024-04-25T09:10:23.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 -- start start 2024-04-25T09:10:23.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.943+0000 7fc17f0d9000 1 Processor -- start 2024-04-25T09:10:23.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 0x55741f6c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6619d0 0x55741f6c2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f674380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55741f3ffe00 con 0x55741f6180a0 2024-04-25T09:10:23.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1741652b0 con 0x55741f6619d0 2024-04-25T09:10:23.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55741f464300 con 0x55741f6622f0 2024-04-25T09:10:23.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 10 client.0 _ll_register_callbacks cb 0x55741f5e3040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:23.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc179200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 0x55741f6c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc179200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 0x55741f6c2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42106/0 (socket says 172.21.15.59:42106) 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc179200640 1 -- 172.21.15.59:0/1283691780 learned_addr learned my addr 172.21.15.59:0/1283691780 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc179c00640 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f674380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc16be00640 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6619d0 0x55741f6c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc179200640 1 -- 172.21.15.59:0/1283691780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 msgr2=0x55741f674380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc179200640 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f674380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc179200640 1 -- 172.21.15.59:0/1283691780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6619d0 msgr2=0x55741f6c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc179200640 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6619d0 0x55741f6c2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc179200640 1 -- 172.21.15.59:0/1283691780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55741f4068e0 con 0x55741f6180a0 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc16be00640 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6619d0 0x55741f6c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc179c00640 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f674380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc179200640 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 0x55741f6c2310 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fc16400f740 tx=0x7fc164007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be38d4c391509cf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc162000640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:10:23.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc162000640 1 -- 172.21.15.59:0/1283691780 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164020cd0 con 0x55741f6180a0 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc162000640 1 -- 172.21.15.59:0/1283691780 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc164007000 con 0x55741f6180a0 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 -- 172.21.15.59:0/1283691780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc15c0c4030 con 0x55741f6180a0 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc162000640 1 -- 172.21.15.59:0/1283691780 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc164043050 con 0x55741f6180a0 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 10 client.8631 fetch_fsmap learned FSMap version 87 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 -- 172.21.15.59:0/1283691780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x55741f4be8f0 con 0x55741f6180a0 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc162000640 1 -- 172.21.15.59:0/1283691780 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c0c4030 con 0x55741f6180a0 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc162000640 1 -- 172.21.15.59:0/1283691780 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 87) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc164046020 con 0x55741f6180a0 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 10 client.8631 fetch_fsmap finished waiting for FSMap version 87 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 10 client.8631 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 20 client.8631 populate_metadata read hostname 'smithi059' 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55741f674ce0 0x55741f6750f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 4 client.8631 mds_command: new command op to 8322 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 -- 172.21.15.59:0/1283691780 --> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55741f472530 con 0x55741f674ce0 2024-04-25T09:10:23.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc16be00640 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55741f674ce0 0x55741f6750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc16be00640 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55741f674ce0 0x55741f6750f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43ec740c21bcfbbd server_cookie=78e68e88ed9961c in_seq=0 out_seq=0 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc162000640 10 client.8631 ms_handle_connect on v2:172.21.15.59:6833/2867303658 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc162000640 1 -- 172.21.15.59:0/1283691780 <== mds.0 v2:172.21.15.59:6833/2867303658 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55741f472530 con 0x55741f674ce0 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc162000640 10 client.8631 handle_command_reply: tid=0 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 client.8631 shutdown 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 -- 172.21.15.59:0/1283691780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 msgr2=0x55741f6c2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 0x55741f6c2310 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7fc16400f740 tx=0x7fc164007e60 comp rx=0 tx=0).stop 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 -- 172.21.15.59:0/1283691780 shutdown_connections 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55741f6622f0 0x55741f674380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55741f6619d0 0x55741f6c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.59:6833/2867303658,v1:172.21.15.59:6835/2867303658] conn(0x55741f674ce0 0x55741f6750f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 --2- 172.21.15.59:0/1283691780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55741f6180a0 0x55741f6c2310 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 -- 172.21.15.59:0/1283691780 >> 172.21.15.59:0/1283691780 conn(0x55741f614020 msgr2=0x55741f660960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc162000640 0 client.8631 ms_handle_reset on v2:172.21.15.59:6833/2867303658 2024-04-25T09:10:23.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 -- 172.21.15.59:0/1283691780 shutdown_connections 2024-04-25T09:10:23.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 1 -- 172.21.15.59:0/1283691780 wait complete. 2024-04-25T09:10:23.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.947+0000 7fc17f0d9000 20 client.8631 trim_cache size 0 max 16384 2024-04-25T09:10:23.942 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:10:23.942 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-04-25T09:10:23.942 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2024-04-25T09:10:23.942 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:10:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.951+0000 7fc17a600640 1 -- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc150066f60 msgr2=0x7fc150069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.951+0000 7fc17a600640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc150066f60 0x7fc150069420 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc164001770 tx=0x7fc164009040 comp rx=0 tx=0).stop 2024-04-25T09:10:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.951+0000 7fc17a600640 1 -- 172.21.15.59:0/2261694633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17415f3d0 msgr2=0x7fc17415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.951+0000 7fc17a600640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17415f3d0 0x7fc17415d430 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00cab0 tx=0x7fc16c00cf70 comp rx=0 tx=0).stop 2024-04-25T09:10:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.951+0000 7fc17a600640 1 -- 172.21.15.59:0/2261694633 shutdown_connections 2024-04-25T09:10:23.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.951+0000 7fc17a600640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc150066f60 0x7fc150069420 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.951+0000 7fc17a600640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc17415f3d0 0x7fc17415d430 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.951+0000 7fc17a600640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc1740b2440 0x7fc174157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.951+0000 7fc17a600640 1 --2- 172.21.15.59:0/2261694633 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc1740b1fb0 0x7fc17415cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:23.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.951+0000 7fc17a600640 1 -- 172.21.15.59:0/2261694633 >> 172.21.15.59:0/2261694633 conn(0x7fc1740d15d0 msgr2=0x7fc174166fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:23.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.951+0000 7fc17a600640 1 -- 172.21.15.59:0/2261694633 shutdown_connections 2024-04-25T09:10:23.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:23.951+0000 7fc17a600640 1 -- 172.21.15.59:0/2261694633 wait complete. 2024-04-25T09:10:23.958 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:10:24.059 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:10:24.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.211+0000 7fd7c0200640 1 Processor -- start 2024-04-25T09:10:24.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.211+0000 7fd7c0200640 1 -- start start 2024-04-25T09:10:24.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7c0200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b8144120 0x7fd7b815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7c0200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b815bc40 con 0x7fd7b80b3090 2024-04-25T09:10:24.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7c0200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b815b3a0 con 0x7fd7b80ccbf0 2024-04-25T09:10:24.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7c0200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b815e490 con 0x7fd7b8144120 2024-04-25T09:10:24.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7be200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd7b80b3090 0x7fd7b806e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58890/0 (socket says 172.21.15.59:58890) 2024-04-25T09:10:24.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7be200640 1 -- 172.21.15.59:0/2532280956 learned_addr learned my addr 172.21.15.59:0/2532280956 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:24.203 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7bd800640 1 --2- 172.21.15.59:0/2532280956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b8144120 0x7fd7b815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7b7e00640 1 -- 172.21.15.59:0/2532280956 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950577365 0 0) 0x7fd7b815bc40 con 0x7fd7b80b3090 2024-04-25T09:10:24.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7b7e00640 1 -- 172.21.15.59:0/2532280956 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7a0003530 con 0x7fd7b80b3090 2024-04-25T09:10:24.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7b7e00640 1 -- 172.21.15.59:0/2532280956 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423266367 0 0) 0x7fd7b815b3a0 con 0x7fd7b80ccbf0 2024-04-25T09:10:24.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7b7e00640 1 -- 172.21.15.59:0/2532280956 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7b815bc40 con 0x7fd7b80ccbf0 2024-04-25T09:10:24.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7bd800640 1 -- 172.21.15.59:0/2532280956 >> v1:172.21.15.178:6789/0 conn(0x7fd7b80ccbf0 legacy=0x7fd7b815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7bd800640 1 -- 172.21.15.59:0/2532280956 >> v1:172.21.15.59:6789/0 conn(0x7fd7b80b3090 legacy=0x7fd7b806e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.215+0000 7fd7bd800640 1 -- 172.21.15.59:0/2532280956 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b815b680 con 0x7fd7b8144120 2024-04-25T09:10:24.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7bd800640 1 --2- 172.21.15.59:0/2532280956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b8144120 0x7fd7b815acd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0097f0 tx=0x7fd7ac01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e151a2a7e7d8742c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7b7e00640 1 -- 172.21.15.59:0/2532280956 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac0b0070 con 0x7fd7b8144120 2024-04-25T09:10:24.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7b7e00640 1 -- 172.21.15.59:0/2532280956 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac0ab600 con 0x7fd7b8144120 2024-04-25T09:10:24.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7b7e00640 1 -- 172.21.15.59:0/2532280956 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac0ab9d0 con 0x7fd7b8144120 2024-04-25T09:10:24.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7c0200640 1 -- 172.21.15.59:0/2532280956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b8144120 msgr2=0x7fd7b815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7c0200640 1 --2- 172.21.15.59:0/2532280956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b8144120 0x7fd7b815acd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0097f0 tx=0x7fd7ac01c450 comp rx=0 tx=0).stop 2024-04-25T09:10:24.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7c0200640 1 -- 172.21.15.59:0/2532280956 shutdown_connections 2024-04-25T09:10:24.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7c0200640 1 --2- 172.21.15.59:0/2532280956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b8144120 0x7fd7b815acd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7c0200640 1 -- 172.21.15.59:0/2532280956 >> 172.21.15.59:0/2532280956 conn(0x7fd7b8067080 msgr2=0x7fd7b806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:24.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7c0200640 1 -- 172.21.15.59:0/2532280956 shutdown_connections 2024-04-25T09:10:24.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7c0200640 1 -- 172.21.15.59:0/2532280956 wait complete. 2024-04-25T09:10:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7c0200640 1 Processor -- start 2024-04-25T09:10:24.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.219+0000 7fd7c0200640 1 -- start start 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7c0200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7b80b3090 0x7fd7b813fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7c0200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b80ccbf0 0x7fd7b81f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7c0200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7b8144120 0x7fd7b80a9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7c0200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b806ec70 con 0x7fd7b8144120 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7c0200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b806eaf0 con 0x7fd7b80b3090 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7c0200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b80b3470 con 0x7fd7b80ccbf0 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7be200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7b8144120 0x7fd7b80a9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7be200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7b8144120 0x7fd7b80a9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42114/0 (socket says 172.21.15.59:42114) 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7be200640 1 -- 172.21.15.59:0/2438502289 learned_addr learned my addr 172.21.15.59:0/2438502289 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7bd800640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7b80b3090 0x7fd7b813fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7bce00640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b80ccbf0 0x7fd7b81f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7be200640 1 -- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b80ccbf0 msgr2=0x7fd7b81f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7be200640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b80ccbf0 0x7fd7b81f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7be200640 1 -- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7b80b3090 msgr2=0x7fd7b813fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7be200640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7b80b3090 0x7fd7b813fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7be200640 1 -- 172.21.15.59:0/2438502289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b81402a0 con 0x7fd7b8144120 2024-04-25T09:10:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7bd800640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7b80b3090 0x7fd7b813fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7bce00640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b80ccbf0 0x7fd7b81f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7be200640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7b8144120 0x7fd7b80a9e00 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000cbc0 tx=0x7fd7b000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7b5600640 1 -- 172.21.15.59:0/2438502289 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0017070 con 0x7fd7b8144120 2024-04-25T09:10:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7b5600640 1 -- 172.21.15.59:0/2438502289 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b000ace0 con 0x7fd7b8144120 2024-04-25T09:10:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7b5600640 1 -- 172.21.15.59:0/2438502289 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0012600 con 0x7fd7b8144120 2024-04-25T09:10:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7c0200640 1 -- 172.21.15.59:0/2438502289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b80af4f0 con 0x7fd7b8144120 2024-04-25T09:10:24.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7c0200640 1 -- 172.21.15.59:0/2438502289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b80afab0 con 0x7fd7b8144120 2024-04-25T09:10:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7c0200640 1 -- 172.21.15.59:0/2438502289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b80745d0 con 0x7fd7b8144120 2024-04-25T09:10:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.223+0000 7fd7b5600640 1 -- 172.21.15.59:0/2438502289 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd7b001a070 con 0x7fd7b8144120 2024-04-25T09:10:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.227+0000 7fd7b5600640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd798066f60 0x7fd798069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.227+0000 7fd7b5600640 1 -- 172.21.15.59:0/2438502289 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd7b0084fa0 con 0x7fd7b8144120 2024-04-25T09:10:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.227+0000 7fd7bd800640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd798066f60 0x7fd798069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.227+0000 7fd7bd800640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd798066f60 0x7fd798069420 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0ad000 tx=0x7fd7ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.231+0000 7fd7b5600640 1 -- 172.21.15.59:0/2438502289 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd7b0055700 con 0x7fd7b8144120 2024-04-25T09:10:24.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.423+0000 7fd7c0200640 1 -- 172.21.15.59:0/2438502289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd7b80b21b0 con 0x7fd7b8144120 2024-04-25T09:10:24.413 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:10:24.423+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:10:24.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.427+0000 7fd7b5600640 1 -- 172.21.15.59:0/2438502289 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v88) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd7b00597a0 con 0x7fd7b8144120 2024-04-25T09:10:24.415 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:10:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.427+0000 7fd7c0200640 1 -- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd798066f60 msgr2=0x7fd798069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.427+0000 7fd7c0200640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd798066f60 0x7fd798069420 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac0ad000 tx=0x7fd7ac008040 comp rx=0 tx=0).stop 2024-04-25T09:10:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.427+0000 7fd7c0200640 1 -- 172.21.15.59:0/2438502289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7b8144120 msgr2=0x7fd7b80a9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.427+0000 7fd7c0200640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7b8144120 0x7fd7b80a9e00 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fd7b000cbc0 tx=0x7fd7b000a430 comp rx=0 tx=0).stop 2024-04-25T09:10:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.427+0000 7fd7c0200640 1 -- 172.21.15.59:0/2438502289 shutdown_connections 2024-04-25T09:10:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.427+0000 7fd7c0200640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd798066f60 0x7fd798069420 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.427+0000 7fd7c0200640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd7b8144120 0x7fd7b80a9e00 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.427+0000 7fd7c0200640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd7b80ccbf0 0x7fd7b81f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.427+0000 7fd7c0200640 1 --2- 172.21.15.59:0/2438502289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd7b80b3090 0x7fd7b813fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.427+0000 7fd7c0200640 1 -- 172.21.15.59:0/2438502289 >> 172.21.15.59:0/2438502289 conn(0x7fd7b8067080 msgr2=0x7fd7b81405d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:24.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.431+0000 7fd7c0200640 1 -- 172.21.15.59:0/2438502289 shutdown_connections 2024-04-25T09:10:24.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.431+0000 7fd7c0200640 1 -- 172.21.15.59:0/2438502289 wait complete. 2024-04-25T09:10:24.434 INFO:tasks.ceph.mds.a.smithi059.stderr: -6066> 2024-04-25T09:10:10.679+0000 7f4ca8000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:10:24.447 DEBUG:teuthology.orchestra.run.smithi059:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-04-25T09:10:24.489 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:10:24.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 1 -- start start 2024-04-25T09:10:24.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 1 Processor -- start 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c92ebf800 0x557c93079b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c92ebf400 0x557c93079600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c92ebf000 0x557c93079080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c93c8e180 con 0x557c92ebf800 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c92f1e900 con 0x557c92ebf400 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c92f1e480 con 0x557c92ebf000 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8556800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c92ebf800 0x557c93079b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8556800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c92ebf800 0x557c93079b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42154/0 (socket says 172.21.15.59:42154) 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8556800640 1 -- 172.21.15.59:0/1194959646 learned_addr learned my addr 172.21.15.59:0/1194959646 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8557200640 1 --2- 172.21.15.59:0/1194959646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c92ebf000 0x557c93079080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8555e00640 1 --2- 172.21.15.59:0/1194959646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c92ebf400 0x557c93079600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8556800640 1 -- 172.21.15.59:0/1194959646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c92ebf000 msgr2=0x557c93079080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:24.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8556800640 1 --2- 172.21.15.59:0/1194959646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c92ebf000 0x557c93079080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8556800640 1 -- 172.21.15.59:0/1194959646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c92ebf400 msgr2=0x557c93079600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8556800640 1 --2- 172.21.15.59:0/1194959646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c92ebf400 0x557c93079600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8556800640 1 -- 172.21.15.59:0/1194959646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c92f60b40 con 0x557c92ebf800 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8556800640 1 --2- 172.21.15.59:0/1194959646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c92ebf800 0x557c93079b80 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x557c93d1b350 tx=0x557c92f811a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3426f78903ef6165 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8553600640 1 -- 172.21.15.59:0/1194959646 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557c92ef44e0 con 0x557c92ebf800 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8553600640 1 -- 172.21.15.59:0/1194959646 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557c92f081c0 con 0x557c92ebf800 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8553600640 1 -- 172.21.15.59:0/1194959646 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557c92ef4b60 con 0x557c92ebf800 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 1 -- 172.21.15.59:0/1194959646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c92f60d20 con 0x557c92ebf800 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 1 -- 172.21.15.59:0/1194959646 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x557c92f60f00 con 0x557c92ebf800 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 4 waiting for MDS map... 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8553600640 1 -- 172.21.15.59:0/1194959646 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x557c93de6600 con 0x557c92ebf800 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f8553600640 1 -- 172.21.15.59:0/1194959646 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 88) v1 ==== 2723+0+0 (secure 0 0 0) 0x557c92f15180 con 0x557c92ebf800 2024-04-25T09:10:24.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 4 Got MDS map 88 2024-04-25T09:10:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 10 main: JournalTool::main 2024-04-25T09:10:24.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 4 main: JournalTool: connecting to RADOS... 2024-04-25T09:10:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 1 Processor -- start 2024-04-25T09:10:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.511+0000 7f85587e6400 1 -- start start 2024-04-25T09:10:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8ac00 0x557c93078b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c93c8b000 0x557c93078580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c93c8b400 0x557c9307a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c92f1e180 con 0x557c93c8ac00 2024-04-25T09:10:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c93c8ed80 con 0x557c93c8b400 2024-04-25T09:10:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c93c8ef00 con 0x557c93c8b000 2024-04-25T09:10:24.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8557200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8ac00 0x557c93078b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8557200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8ac00 0x557c93078b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42158/0 (socket says 172.21.15.59:42158) 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8557200640 1 -- 172.21.15.59:0/2274350290 learned_addr learned my addr 172.21.15.59:0/2274350290 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8556800640 1 --2- 172.21.15.59:0/2274350290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c93c8b000 0x557c93078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8555e00640 1 --2- 172.21.15.59:0/2274350290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c93c8b400 0x557c9307a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8557200640 1 -- 172.21.15.59:0/2274350290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c93c8b000 msgr2=0x557c93078580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8557200640 1 --2- 172.21.15.59:0/2274350290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c93c8b000 0x557c93078580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8557200640 1 -- 172.21.15.59:0/2274350290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c93c8b400 msgr2=0x557c9307a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8557200640 1 --2- 172.21.15.59:0/2274350290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c93c8b400 0x557c9307a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8557200640 1 -- 172.21.15.59:0/2274350290 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c92f60d20 con 0x557c93c8ac00 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8557200640 1 --2- 172.21.15.59:0/2274350290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8ac00 0x557c93078b00 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x557c93dda660 tx=0x557c93ddcc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6d2483453c49c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8550e00640 1 -- 172.21.15.59:0/2274350290 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557c92ef44e0 con 0x557c93c8ac00 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8550e00640 1 -- 172.21.15.59:0/2274350290 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557c92f08e00 con 0x557c93c8ac00 2024-04-25T09:10:24.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8550e00640 1 -- 172.21.15.59:0/2274350290 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557c92ef4b60 con 0x557c93c8ac00 2024-04-25T09:10:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 -- 172.21.15.59:0/2274350290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8ac00 msgr2=0x557c93078b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 --2- 172.21.15.59:0/2274350290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8ac00 0x557c93078b00 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x557c93dda660 tx=0x557c93ddcc00 comp rx=0 tx=0).stop 2024-04-25T09:10:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 -- 172.21.15.59:0/2274350290 shutdown_connections 2024-04-25T09:10:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 --2- 172.21.15.59:0/2274350290 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c93c8b400 0x557c9307a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 --2- 172.21.15.59:0/2274350290 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c93c8b000 0x557c93078580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 --2- 172.21.15.59:0/2274350290 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8ac00 0x557c93078b00 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 -- 172.21.15.59:0/2274350290 >> 172.21.15.59:0/2274350290 conn(0x557c92ebec00 msgr2=0x557c92eed800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 -- 172.21.15.59:0/2274350290 shutdown_connections 2024-04-25T09:10:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 -- 172.21.15.59:0/2274350290 wait complete. 2024-04-25T09:10:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 Processor -- start 2024-04-25T09:10:24.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 -- start start 2024-04-25T09:10:24.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c93c8ac00 0x557c93078b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c93c8b000 0x557c93078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8b400 0x557c9307a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c93c8f200 con 0x557c93c8b400 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c93c8f080 con 0x557c93c8b000 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f85587e6400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c93c8f380 con 0x557c93c8ac00 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.515+0000 7f8555e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8b400 0x557c9307a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f8555e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8b400 0x557c9307a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42160/0 (socket says 172.21.15.59:42160) 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f8555e00640 1 -- 172.21.15.59:0/2418464569 learned_addr learned my addr 172.21.15.59:0/2418464569 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f8556800640 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c93c8b000 0x557c93078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f8557200640 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c93c8ac00 0x557c93078b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f8555e00640 1 -- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c93c8ac00 msgr2=0x557c93078b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f8555e00640 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c93c8ac00 0x557c93078b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f8555e00640 1 -- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c93c8b000 msgr2=0x557c93078580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f8555e00640 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c93c8b000 0x557c93078580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f8555e00640 1 -- 172.21.15.59:0/2418464569 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c92f61c20 con 0x557c93c8b400 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f8555e00640 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8b400 0x557c9307a100 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x557c93d1aa20 tx=0x557c92f96000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f854f000640 1 -- 172.21.15.59:0/2418464569 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557c92ef49c0 con 0x557c93c8b400 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f854f000640 1 -- 172.21.15.59:0/2418464569 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557c92f08540 con 0x557c93c8b400 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f854f000640 1 -- 172.21.15.59:0/2418464569 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557c92ef44e0 con 0x557c93c8b400 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557c92f61e00 con 0x557c93c8b400 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557c92f601e0 con 0x557c93c8b400 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f85587e6400 4 main: JournalTool: resolving pool 15 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f854f000640 1 -- 172.21.15.59:0/2418464569 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x557c93e26c00 con 0x557c93c8b400 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f854f000640 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x557c931eec00 0x557c932e6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f854f000640 1 -- 172.21.15.59:0/2418464569 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x557c931fe600 con 0x557c93c8b400 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f85587e6400 4 main: JournalTool: creating IoCtx.. 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f85587e6400 4 main: Executing for rank 0 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f85587e6400 4 Filtering by inode '1099511627777' 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f85587e6400 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x557c93c8b800 0x557c9307a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110) v9 -- 0x557c93c8bc00 con 0x557c93c8b800 2024-04-25T09:10:24.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f8557200640 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x557c931eec00 0x557c932e6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.519+0000 7f8556800640 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x557c93c8b800 0x557c9307a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f8557200640 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x557c931eec00 0x557c932e6000 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x557c93dda660 tx=0x557c92f96120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f8556800640 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x557c93c8b800 0x557c9307a680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f8556800640 1 -- 172.21.15.59:0/2418464569 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x557c9303a000 con 0x557c93c8b800 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 4 Pointer 400.00000000 is readable 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110) v9 -- 0x557c931ef000 con 0x557c93c8b800 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f8556800640 1 -- 172.21.15.59:0/2418464569 <== osd.6 v2:172.21.15.178:6800/2032393933 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x557c9303a000 con 0x557c93c8b800 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 10 Header 0x400000 0x407953 0x407ccf 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 10 Starting journal scan from offset 0x407953 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 31059~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110) v9 -- 0x557c931ef400 con 0x557c93c8b800 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f8556800640 1 -- 172.21.15.59:0/2418464569 <== osd.6 v2:172.21.15.178:6800/2032393933 3 ==== osd_op_reply(3 200.00000001 [read 31059~892 out=892b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x557c9303a000 con 0x557c93c8b800 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 10 Parsing data, 0x37c bytes available 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 10 Attempting decode at 0x407953 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 10 Consumed 0x37c bytes 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 10 Valid entry at 0x407953 2024-04-25T09:10:24.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x557c931ef800 0x557c9307ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110) v9 -- 0x557c931efc00 con 0x557c931ef800 2024-04-25T09:10:24.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f8557200640 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x557c931ef800 0x557c9307ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f8557200640 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x557c931ef800 0x557c9307ac00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f8557200640 1 -- 172.21.15.59:0/2418464569 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x557c9303a500 con 0x557c931ef800 2024-04-25T09:10:24.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 4 Reached end of journal objects 2024-04-25T09:10:24.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 4 Scanned objects, 0 missing, 1 valid 2024-04-25T09:10:24.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 4 Events scanned, 0 gaps 2024-04-25T09:10:24.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 4 Found 1 valid events 2024-04-25T09:10:24.515 INFO:teuthology.orchestra.run.smithi059.stdout:Events by type: 2024-04-25T09:10:24.515 INFO:teuthology.orchestra.run.smithi059.stdout:Errors: 0 2024-04-25T09:10:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 4 Selected 0 events events for processing 2024-04-25T09:10:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 4 0 events 2024-04-25T09:10:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x557c93c8b800 msgr2=0x557c9307a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x557c93c8b800 0x557c9307a680 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x557c931ef800 msgr2=0x557c9307ac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x557c931ef800 0x557c9307ac00 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x557c931eec00 msgr2=0x557c932e6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x557c931eec00 0x557c932e6000 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x557c93dda660 tx=0x557c92f96120 comp rx=0 tx=0).stop 2024-04-25T09:10:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8b400 msgr2=0x557c9307a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 --2- 172.21.15.59:0/2418464569 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c93c8b400 0x557c9307a100 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x557c93d1aa20 tx=0x557c92f96000 comp rx=0 tx=0).stop 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f8555e00640 1 -- 172.21.15.59:0/2418464569 reap_dead start 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f8555e00640 1 -- 172.21.15.59:0/2418464569 reap_dead start 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 shutdown_connections 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 >> 172.21.15.59:0/2418464569 conn(0x557c92ebec00 msgr2=0x557c92eed800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 shutdown_connections 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/2418464569 wait complete. 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/1194959646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c92ebf800 msgr2=0x557c93079b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 --2- 172.21.15.59:0/1194959646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c92ebf800 0x557c93079b80 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x557c93d1b350 tx=0x557c92f811a0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/1194959646 shutdown_connections 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 --2- 172.21.15.59:0/1194959646 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557c92ebf000 0x557c93079080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 --2- 172.21.15.59:0/1194959646 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557c92ebf400 0x557c93079600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 --2- 172.21.15.59:0/1194959646 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557c92ebf800 0x557c93079b80 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.523+0000 7f85587e6400 1 -- 172.21.15.59:0/1194959646 >> 172.21.15.59:0/1194959646 conn(0x557c92ebfc00 msgr2=0x557c92eed000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:24.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.527+0000 7f85587e6400 1 -- 172.21.15.59:0/1194959646 shutdown_connections 2024-04-25T09:10:24.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.527+0000 7f85587e6400 1 -- 172.21.15.59:0/1194959646 wait complete. 2024-04-25T09:10:24.519 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.072698, result: Events by type: Errors: 0 2024-04-25T09:10:24.519 DEBUG:teuthology.orchestra.run.smithi059:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-04-25T09:10:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce690b400 1 -- start start 2024-04-25T09:10:24.608 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce690b400 1 Processor -- start 2024-04-25T09:10:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce690b400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70b6b1800 0x55e70b86a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce690b400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70b6b1400 0x55e70b86ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce690b400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70b6b1000 0x55e70b86b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce690b400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e70c482180 con 0x55e70b6b1800 2024-04-25T09:10:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce690b400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e70c482300 con 0x55e70b6b1000 2024-04-25T09:10:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce690b400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e70c482480 con 0x55e70b6b1400 2024-04-25T09:10:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70b6b1800 0x55e70b86a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70b6b1800 0x55e70b86a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42178/0 (socket says 172.21.15.59:42178) 2024-04-25T09:10:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce4a00640 1 -- 172.21.15.59:0/2665997107 learned_addr learned my addr 172.21.15.59:0/2665997107 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce4000640 1 --2- 172.21.15.59:0/2665997107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70b6b1400 0x55e70b86ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.610 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.619+0000 7f4ce5400640 1 --2- 172.21.15.59:0/2665997107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70b6b1000 0x55e70b86b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4a00640 1 -- 172.21.15.59:0/2665997107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70b6b1400 msgr2=0x55e70b86ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4a00640 1 --2- 172.21.15.59:0/2665997107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70b6b1400 0x55e70b86ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4a00640 1 -- 172.21.15.59:0/2665997107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70b6b1000 msgr2=0x55e70b86b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4a00640 1 --2- 172.21.15.59:0/2665997107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70b6b1000 0x55e70b86b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4a00640 1 -- 172.21.15.59:0/2665997107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e70b752960 con 0x55e70b6b1800 2024-04-25T09:10:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4a00640 1 --2- 172.21.15.59:0/2665997107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70b6b1800 0x55e70b86a580 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x55e70c5189f0 tx=0x55e70b788000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ab29edd7f05ac2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce1800640 1 -- 172.21.15.59:0/2665997107 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e70b6e69c0 con 0x55e70b6b1800 2024-04-25T09:10:24.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce1800640 1 -- 172.21.15.59:0/2665997107 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e70b6fae00 con 0x55e70b6b1800 2024-04-25T09:10:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce1800640 1 -- 172.21.15.59:0/2665997107 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e70b6e64e0 con 0x55e70b6b1800 2024-04-25T09:10:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 1 -- 172.21.15.59:0/2665997107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e70b752d20 con 0x55e70b6b1800 2024-04-25T09:10:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 1 -- 172.21.15.59:0/2665997107 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e70b752f00 con 0x55e70b6b1800 2024-04-25T09:10:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 4 waiting for MDS map... 2024-04-25T09:10:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce1800640 1 -- 172.21.15.59:0/2665997107 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x55e70c5cc200 con 0x55e70b6b1800 2024-04-25T09:10:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce1800640 1 -- 172.21.15.59:0/2665997107 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 88) v1 ==== 2723+0+0 (secure 0 0 0) 0x55e70b707180 con 0x55e70b6b1800 2024-04-25T09:10:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 4 Got MDS map 88 2024-04-25T09:10:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 10 main: JournalTool::main 2024-04-25T09:10:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 4 main: JournalTool: connecting to RADOS... 2024-04-25T09:10:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 1 Processor -- start 2024-04-25T09:10:24.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 1 -- start start 2024-04-25T09:10:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70c48b800 0x55e70b86b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70c48bc00 0x55e70b86bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62c000 0x55e70b86c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e70c482600 con 0x55e70c62c000 2024-04-25T09:10:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e70c482780 con 0x55e70c48b800 2024-04-25T09:10:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce690b400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e70c482900 con 0x55e70c48bc00 2024-04-25T09:10:24.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62c000 0x55e70b86c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62c000 0x55e70b86c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42192/0 (socket says 172.21.15.59:42192) 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4000640 1 -- 172.21.15.59:0/2675241268 learned_addr learned my addr 172.21.15.59:0/2675241268 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce5400640 1 --2- 172.21.15.59:0/2675241268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70c48b800 0x55e70b86b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4a00640 1 --2- 172.21.15.59:0/2675241268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70c48bc00 0x55e70b86bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4000640 1 -- 172.21.15.59:0/2675241268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70c48bc00 msgr2=0x55e70b86bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4000640 1 --2- 172.21.15.59:0/2675241268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70c48bc00 0x55e70b86bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4000640 1 -- 172.21.15.59:0/2675241268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70c48b800 msgr2=0x55e70b86b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4000640 1 --2- 172.21.15.59:0/2675241268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70c48b800 0x55e70b86b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4000640 1 -- 172.21.15.59:0/2675241268 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e70b7521e0 con 0x55e70c62c000 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4a00640 1 --2- 172.21.15.59:0/2675241268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70c48bc00 0x55e70b86bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce5400640 1 --2- 172.21.15.59:0/2675241268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70c48b800 0x55e70b86b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4ce4000640 1 --2- 172.21.15.59:0/2675241268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62c000 0x55e70b86c100 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x55e70c5ba900 tx=0x55e70c5dec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48961e97cd496f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.623+0000 7f4cdf000640 1 -- 172.21.15.59:0/2675241268 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e70b6e69c0 con 0x55e70c62c000 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4cdf000640 1 -- 172.21.15.59:0/2675241268 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e70b6fa540 con 0x55e70c62c000 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4cdf000640 1 -- 172.21.15.59:0/2675241268 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e70b6e64e0 con 0x55e70c62c000 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 -- 172.21.15.59:0/2675241268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62c000 msgr2=0x55e70b86c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2675241268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62c000 0x55e70b86c100 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x55e70c5ba900 tx=0x55e70c5dec00 comp rx=0 tx=0).stop 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 -- 172.21.15.59:0/2675241268 shutdown_connections 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2675241268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62c000 0x55e70b86c100 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2675241268 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70c48bc00 0x55e70b86bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2675241268 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70c48b800 0x55e70b86b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 -- 172.21.15.59:0/2675241268 >> 172.21.15.59:0/2675241268 conn(0x55e70b6b0c00 msgr2=0x55e70b6df800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 -- 172.21.15.59:0/2675241268 shutdown_connections 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 -- 172.21.15.59:0/2675241268 wait complete. 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 Processor -- start 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 -- start start 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70c48bc00 0x55e70b86d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70c48b800 0x55e70b86cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62d800 0x55e70b86c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e70c483c80 con 0x55e70c62d800 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e70c483b00 con 0x55e70c48bc00 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e70c483980 con 0x55e70c48b800 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce4000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62d800 0x55e70b86c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce4000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62d800 0x55e70b86c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42198/0 (socket says 172.21.15.59:42198) 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce4000640 1 -- 172.21.15.59:0/2125521909 learned_addr learned my addr 172.21.15.59:0/2125521909 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce5400640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70c48bc00 0x55e70b86d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce4a00640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70c48b800 0x55e70b86cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce4000640 1 -- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70c48b800 msgr2=0x55e70b86cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce4000640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70c48b800 0x55e70b86cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce4000640 1 -- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70c48bc00 msgr2=0x55e70b86d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce4000640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70c48bc00 0x55e70b86d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce4000640 1 -- 172.21.15.59:0/2125521909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e70b753a40 con 0x55e70c62d800 2024-04-25T09:10:24.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce5400640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70c48bc00 0x55e70b86d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce4000640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62d800 0x55e70b86c680 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x55e70c5bb5c0 tx=0x55e70b769080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4cdd200640 1 -- 172.21.15.59:0/2125521909 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e70b6e6000 con 0x55e70c62d800 2024-04-25T09:10:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4cdd200640 1 -- 172.21.15.59:0/2125521909 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e70b6faa80 con 0x55e70c62d800 2024-04-25T09:10:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4cdd200640 1 -- 172.21.15.59:0/2125521909 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e70b6e69c0 con 0x55e70c62d800 2024-04-25T09:10:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e70b753c20 con 0x55e70c62d800 2024-04-25T09:10:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e70b7521e0 con 0x55e70c62d800 2024-04-25T09:10:24.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.627+0000 7f4ce690b400 4 main: JournalTool: resolving pool 15 2024-04-25T09:10:24.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4cdd200640 1 -- 172.21.15.59:0/2125521909 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55e70c626c00 con 0x55e70c62d800 2024-04-25T09:10:24.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4cdd200640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55e70b9e0c00 0x55e70b86d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4cdd200640 1 -- 172.21.15.59:0/2125521909 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x55e70b9f0400 con 0x55e70c62d800 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce690b400 4 main: JournalTool: creating IoCtx.. 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce690b400 4 main: Executing for rank 0 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce690b400 4 Filtering by inode '1099511627778' 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55e70c62d400 0x55e70b86c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:1 15.f 15:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110) v9 -- 0x55e70c62d000 con 0x55e70c62d400 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce5400640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55e70b9e0c00 0x55e70b86d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce4a00640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55e70c62d400 0x55e70b86c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce5400640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55e70b9e0c00 0x55e70b86d700 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55e70b7be6f0 tx=0x55e70badc000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce4a00640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55e70c62d400 0x55e70b86c100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce4a00640 1 -- 172.21.15.59:0/2125521909 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55e70b82c000 con 0x55e70c62d400 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce690b400 4 Pointer 400.00000000 is readable 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce690b400 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-25T09:10:24.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:2 15.14 15:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110) v9 -- 0x55e70c62cc00 con 0x55e70c62d400 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce4a00640 1 -- 172.21.15.59:0/2125521909 <== osd.6 v2:172.21.15.178:6800/2032393933 2 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv31 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55e70b82c000 con 0x55e70c62d400 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce690b400 10 Header 0x400000 0x407953 0x407ccf 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce690b400 10 Starting journal scan from offset 0x407953 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.631+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:3 15.14 15:2e2fa760:::200.00000001:head [read 31059~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110) v9 -- 0x55e70c62c800 con 0x55e70c62d400 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce4a00640 1 -- 172.21.15.59:0/2125521909 <== osd.6 v2:172.21.15.178:6800/2032393933 3 ==== osd_op_reply(3 200.00000001 [read 31059~892 out=892b] v0'0 uv28 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x55e70b82c000 con 0x55e70c62d400 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 10 Parsing data, 0x37c bytes available 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 10 Attempting decode at 0x407953 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 10 Consumed 0x37c bytes 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 10 Valid entry at 0x407953 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55e70c62c400 0x55e70b86bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:4 15.1b 15:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e110) v9 -- 0x55e70c62c000 con 0x55e70c62c400 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce5400640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55e70c62c400 0x55e70b86bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce5400640 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55e70c62c400 0x55e70b86bb80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce5400640 1 -- 172.21.15.59:0/2125521909 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55e70b82c500 con 0x55e70c62c400 2024-04-25T09:10:24.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 4 Reached end of journal objects 2024-04-25T09:10:24.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 4 Scanned objects, 0 missing, 1 valid 2024-04-25T09:10:24.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 4 Events scanned, 0 gaps 2024-04-25T09:10:24.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 4 Found 1 valid events 2024-04-25T09:10:24.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 4 Selected 0 events events for processing 2024-04-25T09:10:24.627 INFO:teuthology.orchestra.run.smithi059.stdout:Events by type: 2024-04-25T09:10:24.627 INFO:teuthology.orchestra.run.smithi059.stdout:Errors: 0 2024-04-25T09:10:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 4 0 events 2024-04-25T09:10:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55e70c62d400 msgr2=0x55e70b86c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55e70c62d400 0x55e70b86c100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55e70c62c400 msgr2=0x55e70b86bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55e70c62c400 0x55e70b86bb80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55e70b9e0c00 msgr2=0x55e70b86d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55e70b9e0c00 0x55e70b86d700 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x55e70b7be6f0 tx=0x55e70badc000 comp rx=0 tx=0).stop 2024-04-25T09:10:24.629 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62d800 msgr2=0x55e70b86c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2125521909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70c62d800 0x55e70b86c680 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x55e70c5bb5c0 tx=0x55e70b769080 comp rx=0 tx=0).stop 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce4000640 1 -- 172.21.15.59:0/2125521909 reap_dead start 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce4000640 1 -- 172.21.15.59:0/2125521909 reap_dead start 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 shutdown_connections 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 >> 172.21.15.59:0/2125521909 conn(0x55e70b6b0c00 msgr2=0x55e70b6df800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 shutdown_connections 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2125521909 wait complete. 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2665997107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70b6b1800 msgr2=0x55e70b86a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2665997107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70b6b1800 0x55e70b86a580 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x55e70c5189f0 tx=0x55e70b788000 comp rx=0 tx=0).stop 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2665997107 shutdown_connections 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2665997107 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e70b6b1000 0x55e70b86b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2665997107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e70b6b1400 0x55e70b86ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 --2- 172.21.15.59:0/2665997107 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e70b6b1800 0x55e70b86a580 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2665997107 >> 172.21.15.59:0/2665997107 conn(0x55e70b6b1c00 msgr2=0x55e70b6df000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:24.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2665997107 shutdown_connections 2024-04-25T09:10:24.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.635+0000 7f4ce690b400 1 -- 172.21.15.59:0/2665997107 wait complete. 2024-04-25T09:10:24.631 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.111348, result: Events by type: Errors: 0 2024-04-25T09:10:24.631 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-04-25T09:10:24.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 Processor -- start 2024-04-25T09:10:24.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 -- start start 2024-04-25T09:10:24.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e3a58c6700 0x55e3a5950cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3a5951490 0x55e3a596ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 0x55e3a596ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3a589c0c0 con 0x55e3a5951870 2024-04-25T09:10:24.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3a583f9f0 con 0x55e3a5951490 2024-04-25T09:10:24.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3a5952110 con 0x55e3a58c6700 2024-04-25T09:10:24.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a61800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 0x55e3a596ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a61800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 0x55e3a596ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42214/0 (socket says 172.21.15.59:42214) 2024-04-25T09:10:24.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a61800640 1 -- 172.21.15.59:0/535458605 learned_addr learned my addr 172.21.15.59:0/535458605 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:24.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a60e00640 1 --2- 172.21.15.59:0/535458605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e3a58c6700 0x55e3a5950cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a5be00640 1 --2- 172.21.15.59:0/535458605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3a5951490 0x55e3a596ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a61800640 1 -- 172.21.15.59:0/535458605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e3a58c6700 msgr2=0x55e3a5950cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:24.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a61800640 1 --2- 172.21.15.59:0/535458605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e3a58c6700 0x55e3a5950cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a61800640 1 -- 172.21.15.59:0/535458605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3a5951490 msgr2=0x55e3a596ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:24.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a61800640 1 --2- 172.21.15.59:0/535458605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3a5951490 0x55e3a596ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a61800640 1 -- 172.21.15.59:0/535458605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3a596c3e0 con 0x55e3a5951870 2024-04-25T09:10:24.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a61800640 1 --2- 172.21.15.59:0/535458605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 0x55e3a596ef40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c001650 tx=0x7f0a5c006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c631ebcfd61cb444 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a5aa00640 1 -- 172.21.15.59:0/535458605 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c017070 con 0x55e3a5951870 2024-04-25T09:10:24.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a5aa00640 1 -- 172.21.15.59:0/535458605 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c0026c0 con 0x55e3a5951870 2024-04-25T09:10:24.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a5aa00640 1 -- 172.21.15.59:0/535458605 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c002ab0 con 0x55e3a5951870 2024-04-25T09:10:24.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 -- 172.21.15.59:0/535458605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 msgr2=0x55e3a596ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 --2- 172.21.15.59:0/535458605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 0x55e3a596ef40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c001650 tx=0x7f0a5c006f90 comp rx=0 tx=0).stop 2024-04-25T09:10:24.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 -- 172.21.15.59:0/535458605 shutdown_connections 2024-04-25T09:10:24.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 --2- 172.21.15.59:0/535458605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 0x55e3a596ef40 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 --2- 172.21.15.59:0/535458605 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3a5951490 0x55e3a596ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 --2- 172.21.15.59:0/535458605 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e3a58c6700 0x55e3a5950cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 -- 172.21.15.59:0/535458605 >> 172.21.15.59:0/535458605 conn(0x55e3a5899400 msgr2=0x55e3a58c6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:24.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 -- 172.21.15.59:0/535458605 shutdown_connections 2024-04-25T09:10:24.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.731+0000 7f0a63b19080 1 -- 172.21.15.59:0/535458605 wait complete. 2024-04-25T09:10:24.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a63b19080 1 Processor -- start 2024-04-25T09:10:24.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a63b19080 1 -- start start 2024-04-25T09:10:24.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a63b19080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3a58c6700 0x55e3a58e17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a63b19080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e3a5951490 0x55e3a5969f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a63b19080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 0x55e3a58c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a63b19080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3a596c920 con 0x55e3a5951870 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a63b19080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3a596c680 con 0x55e3a58c6700 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a63b19080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e3a596cbc0 con 0x55e3a5951490 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a61800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 0x55e3a58c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a61800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 0x55e3a58c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42220/0 (socket says 172.21.15.59:42220) 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a61800640 1 -- 172.21.15.59:0/4193348650 learned_addr learned my addr 172.21.15.59:0/4193348650 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a5be00640 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e3a5951490 0x55e3a5969f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a60e00640 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3a58c6700 0x55e3a58e17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a61800640 1 -- 172.21.15.59:0/4193348650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e3a5951490 msgr2=0x55e3a5969f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a61800640 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e3a5951490 0x55e3a5969f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a61800640 1 -- 172.21.15.59:0/4193348650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3a58c6700 msgr2=0x55e3a58e17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a61800640 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e3a58c6700 0x55e3a58e17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a61800640 1 -- 172.21.15.59:0/4193348650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3a58e08b0 con 0x55e3a5951870 2024-04-25T09:10:24.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a61800640 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 0x55e3a58c6dc0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c006660 tx=0x7f0a5c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a59600640 1 -- 172.21.15.59:0/4193348650 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c017070 con 0x55e3a5951870 2024-04-25T09:10:24.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a59600640 1 -- 172.21.15.59:0/4193348650 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5c006230 con 0x55e3a5951870 2024-04-25T09:10:24.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a59600640 1 -- 172.21.15.59:0/4193348650 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c005650 con 0x55e3a5951870 2024-04-25T09:10:24.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a63b19080 1 -- 172.21.15.59:0/4193348650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e3a58e0b50 con 0x55e3a5951870 2024-04-25T09:10:24.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.735+0000 7f0a63b19080 1 -- 172.21.15.59:0/4193348650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3a58e1090 con 0x55e3a5951870 2024-04-25T09:10:24.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.739+0000 7f0a59600640 1 -- 172.21.15.59:0/4193348650 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0a5c0057f0 con 0x55e3a5951870 2024-04-25T09:10:24.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.739+0000 7f0a59600640 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0a40065970 0x7f0a40067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.739+0000 7f0a59600640 1 -- 172.21.15.59:0/4193348650 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f0a5c0852f0 con 0x55e3a5951870 2024-04-25T09:10:24.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.739+0000 7f0a60e00640 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0a40065970 0x7f0a40067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.739+0000 7f0a63b19080 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55e3a58e1d10 0x55e3a59743d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.739+0000 7f0a63b19080 1 -- 172.21.15.59:0/4193348650 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e110) v9 -- 0x55e3a596a480 con 0x55e3a58e1d10 2024-04-25T09:10:24.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.739+0000 7f0a5be00640 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55e3a58e1d10 0x55e3a59743d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.739+0000 7f0a60e00640 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0a40065970 0x7f0a40067e30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0a540ac000 tx=0x7f0a540a5000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.739+0000 7f0a5be00640 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55e3a58e1d10 0x55e3a59743d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.743+0000 7f0a5be00640 1 -- 172.21.15.59:0/4193348650 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v110'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0a4c009cc0 con 0x55e3a58e1d10 2024-04-25T09:10:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.743+0000 7f0a63b19080 1 -- 172.21.15.59:0/4193348650 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55e3a58e1d10 msgr2=0x55e3a59743d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.743+0000 7f0a63b19080 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55e3a58e1d10 0x55e3a59743d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.743+0000 7f0a63b19080 1 -- 172.21.15.59:0/4193348650 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0a40065970 msgr2=0x7f0a40067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.743+0000 7f0a63b19080 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0a40065970 0x7f0a40067e30 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0a540ac000 tx=0x7f0a540a5000 comp rx=0 tx=0).stop 2024-04-25T09:10:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.743+0000 7f0a63b19080 1 -- 172.21.15.59:0/4193348650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 msgr2=0x55e3a58c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.743+0000 7f0a63b19080 1 --2- 172.21.15.59:0/4193348650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e3a5951870 0x55e3a58c6dc0 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c006660 tx=0x7f0a5c001260 comp rx=0 tx=0).stop 2024-04-25T09:10:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.743+0000 7f0a61800640 1 -- 172.21.15.59:0/4193348650 reap_dead start 2024-04-25T09:10:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.743+0000 7f0a63b19080 1 -- 172.21.15.59:0/4193348650 shutdown_connections 2024-04-25T09:10:24.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.743+0000 7f0a63b19080 1 -- 172.21.15.59:0/4193348650 >> 172.21.15.59:0/4193348650 conn(0x55e3a5899400 msgr2=0x55e3a596ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:24.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.743+0000 7f0a63b19080 1 -- 172.21.15.59:0/4193348650 shutdown_connections 2024-04-25T09:10:24.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.743+0000 7f0a63b19080 1 -- 172.21.15.59:0/4193348650 wait complete. 2024-04-25T09:10:24.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:10:24.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.931+0000 7f89a7000640 1 Processor -- start 2024-04-25T09:10:24.921 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.931+0000 7f89a7000640 1 -- start start 2024-04-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a7000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89a006c730 0x7f89a015ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a7000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f89a00d0790 0x7f89a0161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a7000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a015ef90 con 0x7f89a006cb10 2024-04-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a7000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a009a9e0 con 0x7f89a00d0790 2024-04-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a7000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a009ae70 con 0x7f89a006c730 2024-04-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a5200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f89a006cb10 0x7f89a0161590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58904/0 (socket says 172.21.15.59:58904) 2024-04-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a5200640 1 -- 172.21.15.59:0/2447307953 learned_addr learned my addr 172.21.15.59:0/2447307953 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a6600640 1 --2- 172.21.15.59:0/2447307953 >> v2:172.21.15.178:3300/0 conn(0x7f89a00d0790 0x7f89a0161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a5c00640 1 --2- 172.21.15.59:0/2447307953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89a006c730 0x7f89a015ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f899fe00640 1 -- 172.21.15.59:0/2447307953 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2062483656 0 0) 0x7f89a015ef90 con 0x7f89a006cb10 2024-04-25T09:10:24.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f899fe00640 1 -- 172.21.15.59:0/2447307953 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8988003530 con 0x7f89a006cb10 2024-04-25T09:10:24.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a6600640 1 -- 172.21.15.59:0/2447307953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89a006c730 msgr2=0x7f89a015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:24.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a6600640 1 --2- 172.21.15.59:0/2447307953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89a006c730 0x7f89a015ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a6600640 1 -- 172.21.15.59:0/2447307953 >> v1:172.21.15.59:6789/0 conn(0x7f89a006cb10 legacy=0x7f89a0161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.935+0000 7f89a6600640 1 -- 172.21.15.59:0/2447307953 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0099dd0 con 0x7f89a00d0790 2024-04-25T09:10:24.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a6600640 1 --2- 172.21.15.59:0/2447307953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89a00d0790 0x7f89a0161ca0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8998009d90 tx=0x7f899801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e820c604ded14b0a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f899fe00640 1 -- 172.21.15.59:0/2447307953 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89980b2070 con 0x7f89a00d0790 2024-04-25T09:10:24.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f899fe00640 1 -- 172.21.15.59:0/2447307953 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89980a5a00 con 0x7f89a00d0790 2024-04-25T09:10:24.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f899fe00640 1 -- 172.21.15.59:0/2447307953 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89980a5dd0 con 0x7f89a00d0790 2024-04-25T09:10:24.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a7000640 1 -- 172.21.15.59:0/2447307953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89a00d0790 msgr2=0x7f89a0161ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a7000640 1 --2- 172.21.15.59:0/2447307953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89a00d0790 0x7f89a0161ca0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8998009d90 tx=0x7f899801c940 comp rx=0 tx=0).stop 2024-04-25T09:10:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a7000640 1 -- 172.21.15.59:0/2447307953 shutdown_connections 2024-04-25T09:10:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a7000640 1 --2- 172.21.15.59:0/2447307953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89a00d0790 0x7f89a0161ca0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a7000640 1 --2- 172.21.15.59:0/2447307953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89a006c730 0x7f89a015ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a7000640 1 -- 172.21.15.59:0/2447307953 >> 172.21.15.59:0/2447307953 conn(0x7f89a00b3030 msgr2=0x7f89a00b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a7000640 1 -- 172.21.15.59:0/2447307953 shutdown_connections 2024-04-25T09:10:24.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a7000640 1 -- 172.21.15.59:0/2447307953 wait complete. 2024-04-25T09:10:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a7000640 1 Processor -- start 2024-04-25T09:10:24.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a7000640 1 -- start start 2024-04-25T09:10:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a7000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89a006c730 0x7f89a014fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.939+0000 7f89a7000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89a006cb10 0x7f89a00b1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a7000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a00d0790 0x7f89a00b2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a7000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a0099a60 con 0x7f89a00d0790 2024-04-25T09:10:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a7000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a015de20 con 0x7f89a006cb10 2024-04-25T09:10:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a7000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00b0720 con 0x7f89a006c730 2024-04-25T09:10:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a00d0790 0x7f89a00b2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a6600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a00d0790 0x7f89a00b2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42226/0 (socket says 172.21.15.59:42226) 2024-04-25T09:10:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a5c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89a006c730 0x7f89a014fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a6600640 1 -- 172.21.15.59:0/2947374415 learned_addr learned my addr 172.21.15.59:0/2947374415 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:24.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a5200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89a006cb10 0x7f89a00b1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a6600640 1 -- 172.21.15.59:0/2947374415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89a006c730 msgr2=0x7f89a014fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a6600640 1 --2- 172.21.15.59:0/2947374415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89a006c730 0x7f89a014fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a6600640 1 -- 172.21.15.59:0/2947374415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89a006cb10 msgr2=0x7f89a00b1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:24.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a6600640 1 --2- 172.21.15.59:0/2947374415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89a006cb10 0x7f89a00b1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:24.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a6600640 1 -- 172.21.15.59:0/2947374415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a00b44b0 con 0x7f89a00d0790 2024-04-25T09:10:24.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a6600640 1 --2- 172.21.15.59:0/2947374415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a00d0790 0x7f89a00b2160 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f899801aff0 tx=0x7f89980196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f899d600640 1 -- 172.21.15.59:0/2947374415 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89980b2050 con 0x7f89a00d0790 2024-04-25T09:10:24.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f899d600640 1 -- 172.21.15.59:0/2947374415 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89980be070 con 0x7f89a00d0790 2024-04-25T09:10:24.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a7000640 1 -- 172.21.15.59:0/2947374415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a00b4790 con 0x7f89a00d0790 2024-04-25T09:10:24.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f899d600640 1 -- 172.21.15.59:0/2947374415 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89980ada70 con 0x7f89a00d0790 2024-04-25T09:10:24.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a7000640 1 -- 172.21.15.59:0/2947374415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a00b4d50 con 0x7f89a00d0790 2024-04-25T09:10:24.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f89a7000640 1 -- 172.21.15.59:0/2947374415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a00745d0 con 0x7f89a00d0790 2024-04-25T09:10:24.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.943+0000 7f899d600640 1 -- 172.21.15.59:0/2947374415 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f89980adc10 con 0x7f89a00d0790 2024-04-25T09:10:24.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.947+0000 7f899d600640 1 --2- 172.21.15.59:0/2947374415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8980066f60 0x7f8980069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:24.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.947+0000 7f899d600640 1 -- 172.21.15.59:0/2947374415 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f89981203d0 con 0x7f89a00d0790 2024-04-25T09:10:24.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.947+0000 7f89a5c00640 1 --2- 172.21.15.59:0/2947374415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8980066f60 0x7f8980069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:24.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.947+0000 7f89a5c00640 1 --2- 172.21.15.59:0/2947374415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8980066f60 0x7f8980069420 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8994009b60 tx=0x7f8994009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:24.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:24.951+0000 7f899d600640 1 -- 172.21.15.59:0/2947374415 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8998016560 con 0x7f89a00d0790 2024-04-25T09:10:25.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.151+0000 7f89a7000640 1 -- 172.21.15.59:0/2947374415 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f89a006c510 con 0x7f89a00d0790 2024-04-25T09:10:25.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.427+0000 7f899d600640 1 -- 172.21.15.59:0/2947374415 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v89) v1 ==== 162+0+0 (secure 0 0 0) 0x7f89980f0ad0 con 0x7f89a00d0790 2024-04-25T09:10:25.418 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:10:25.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.431+0000 7f89a7000640 1 -- 172.21.15.59:0/2947374415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8980066f60 msgr2=0x7f8980069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.431+0000 7f89a7000640 1 --2- 172.21.15.59:0/2947374415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8980066f60 0x7f8980069420 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f8994009b60 tx=0x7f8994009190 comp rx=0 tx=0).stop 2024-04-25T09:10:25.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.431+0000 7f89a7000640 1 -- 172.21.15.59:0/2947374415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a00d0790 msgr2=0x7f89a00b2160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.431+0000 7f89a7000640 1 --2- 172.21.15.59:0/2947374415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a00d0790 0x7f89a00b2160 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f899801aff0 tx=0x7f89980196e0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.431+0000 7f89a7000640 1 -- 172.21.15.59:0/2947374415 shutdown_connections 2024-04-25T09:10:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.431+0000 7f89a7000640 1 --2- 172.21.15.59:0/2947374415 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8980066f60 0x7f8980069420 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.431+0000 7f89a7000640 1 --2- 172.21.15.59:0/2947374415 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89a00d0790 0x7f89a00b2160 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.431+0000 7f89a7000640 1 --2- 172.21.15.59:0/2947374415 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89a006cb10 0x7f89a00b1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.431+0000 7f89a7000640 1 --2- 172.21.15.59:0/2947374415 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89a006c730 0x7f89a014fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.431+0000 7f89a7000640 1 -- 172.21.15.59:0/2947374415 >> 172.21.15.59:0/2947374415 conn(0x7f89a00b3030 msgr2=0x7f89a006fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.431+0000 7f89a7000640 1 -- 172.21.15.59:0/2947374415 shutdown_connections 2024-04-25T09:10:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.431+0000 7f89a7000640 1 -- 172.21.15.59:0/2947374415 wait complete. 2024-04-25T09:10:25.447 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:25.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.599+0000 7f1e25400640 1 Processor -- start 2024-04-25T09:10:25.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.599+0000 7f1e25400640 1 -- start start 2024-04-25T09:10:25.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.599+0000 7f1e25400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e20145270 0x7f1e2015fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.599+0000 7f1e25400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1e200b1e60 0x7f1e200cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.599+0000 7f1e25400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e200cc4e0 con 0x7f1e200cd4d0 2024-04-25T09:10:25.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.599+0000 7f1e25400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e20145650 con 0x7f1e20145270 2024-04-25T09:10:25.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.599+0000 7f1e25400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e200ce040 con 0x7f1e200b1e60 2024-04-25T09:10:25.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.599+0000 7f1e1e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e20145270 0x7f1e2015fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.599+0000 7f1e1e800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1e20145270 0x7f1e2015fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42240/0 (socket says 172.21.15.59:42240) 2024-04-25T09:10:25.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.599+0000 7f1e1e800640 1 -- 172.21.15.59:0/2244924064 learned_addr learned my addr 172.21.15.59:0/2244924064 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:25.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e1f200640 1 --2- 172.21.15.59:0/2244924064 >> v2:172.21.15.178:3300/0 conn(0x7f1e200b1e60 0x7f1e200cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e1e800640 1 -- 172.21.15.59:0/2244924064 >> v2:172.21.15.178:3300/0 conn(0x7f1e200b1e60 msgr2=0x7f1e200cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:25.590 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e1e800640 1 --2- 172.21.15.59:0/2244924064 >> v2:172.21.15.178:3300/0 conn(0x7f1e200b1e60 0x7f1e200cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e1e800640 1 -- 172.21.15.59:0/2244924064 >> v1:172.21.15.178:6789/0 conn(0x7f1e200cd4d0 legacy=0x7f1e200b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:25.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e1e800640 1 -- 172.21.15.59:0/2244924064 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e200ce320 con 0x7f1e20145270 2024-04-25T09:10:25.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e1e800640 1 --2- 172.21.15.59:0/2244924064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e20145270 0x7f1e2015fe50 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f1e200b4b90 tx=0x7f1e1001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa941bf239523b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:25.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e1de00640 1 -- 172.21.15.59:0/2244924064 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e100b1070 con 0x7f1e20145270 2024-04-25T09:10:25.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e1de00640 1 -- 172.21.15.59:0/2244924064 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e100ac630 con 0x7f1e20145270 2024-04-25T09:10:25.593 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e1de00640 1 -- 172.21.15.59:0/2244924064 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e100a8050 con 0x7f1e20145270 2024-04-25T09:10:25.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e25400640 1 -- 172.21.15.59:0/2244924064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e20145270 msgr2=0x7f1e2015fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e25400640 1 --2- 172.21.15.59:0/2244924064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e20145270 0x7f1e2015fe50 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7f1e200b4b90 tx=0x7f1e1001c4e0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e25400640 1 -- 172.21.15.59:0/2244924064 shutdown_connections 2024-04-25T09:10:25.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e25400640 1 --2- 172.21.15.59:0/2244924064 >> v2:172.21.15.178:3300/0 conn(0x7f1e200b1e60 0x7f1e200cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e25400640 1 --2- 172.21.15.59:0/2244924064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e20145270 0x7f1e2015fe50 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e25400640 1 -- 172.21.15.59:0/2244924064 >> 172.21.15.59:0/2244924064 conn(0x7f1e20066fa0 msgr2=0x7f1e2006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:25.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.603+0000 7f1e25400640 1 -- 172.21.15.59:0/2244924064 shutdown_connections 2024-04-25T09:10:25.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e25400640 1 -- 172.21.15.59:0/2244924064 wait complete. 2024-04-25T09:10:25.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e25400640 1 Processor -- start 2024-04-25T09:10:25.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e25400640 1 -- start start 2024-04-25T09:10:25.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e25400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e200b1e60 0x7f1e2015ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e25400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e200cd4d0 0x7f1e2013f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e25400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e20145270 0x7f1e20142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e25400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2015c710 con 0x7f1e20145270 2024-04-25T09:10:25.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e25400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2015c590 con 0x7f1e200cd4d0 2024-04-25T09:10:25.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e25400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2015c890 con 0x7f1e200b1e60 2024-04-25T09:10:25.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e1f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e20145270 0x7f1e20142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e15e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e200cd4d0 0x7f1e2013f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e1e800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e200b1e60 0x7f1e2015ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e1f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e20145270 0x7f1e20142420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42246/0 (socket says 172.21.15.59:42246) 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e1f200640 1 -- 172.21.15.59:0/1272208491 learned_addr learned my addr 172.21.15.59:0/1272208491 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e1f200640 1 -- 172.21.15.59:0/1272208491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e200b1e60 msgr2=0x7f1e2015ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e1f200640 1 --2- 172.21.15.59:0/1272208491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e200b1e60 0x7f1e2015ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e1f200640 1 -- 172.21.15.59:0/1272208491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e200cd4d0 msgr2=0x7f1e2013f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e1f200640 1 --2- 172.21.15.59:0/1272208491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e200cd4d0 0x7f1e2013f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e1f200640 1 -- 172.21.15.59:0/1272208491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e20141380 con 0x7f1e20145270 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.607+0000 7f1e1f200640 1 --2- 172.21.15.59:0/1272208491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e20145270 0x7f1e20142420 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800d830 tx=0x7f1e1800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.611+0000 7f1e17400640 1 -- 172.21.15.59:0/1272208491 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1800b6c0 con 0x7f1e20145270 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.611+0000 7f1e17400640 1 -- 172.21.15.59:0/1272208491 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e18019070 con 0x7f1e20145270 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.611+0000 7f1e25400640 1 -- 172.21.15.59:0/1272208491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e20141660 con 0x7f1e20145270 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.611+0000 7f1e17400640 1 -- 172.21.15.59:0/1272208491 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1800baa0 con 0x7f1e20145270 2024-04-25T09:10:25.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.611+0000 7f1e25400640 1 -- 172.21.15.59:0/1272208491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e20141c20 con 0x7f1e20145270 2024-04-25T09:10:25.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.611+0000 7f1e25400640 1 -- 172.21.15.59:0/1272208491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e200745d0 con 0x7f1e20145270 2024-04-25T09:10:25.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.611+0000 7f1e17400640 1 -- 172.21.15.59:0/1272208491 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1e1801e460 con 0x7f1e20145270 2024-04-25T09:10:25.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.611+0000 7f1e17400640 1 --2- 172.21.15.59:0/1272208491 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1dfc066f60 0x7f1dfc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:25.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.611+0000 7f1e17400640 1 -- 172.21.15.59:0/1272208491 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f1e18085880 con 0x7f1e20145270 2024-04-25T09:10:25.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.611+0000 7f1e1e800640 1 --2- 172.21.15.59:0/1272208491 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1dfc066f60 0x7f1dfc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:25.602 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.615+0000 7f1e1e800640 1 --2- 172.21.15.59:0/1272208491 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1dfc066f60 0x7f1dfc069420 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1e100ae000 tx=0x7f1e10009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:25.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.615+0000 7f1e17400640 1 -- 172.21.15.59:0/1272208491 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1e18055f00 con 0x7f1e20145270 2024-04-25T09:10:25.801 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.811+0000 7f1e25400640 1 -- 172.21.15.59:0/1272208491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e200b1c40 con 0x7f1e20145270 2024-04-25T09:10:25.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e17400640 1 -- 172.21.15.59:0/1272208491 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f1e18059fa0 con 0x7f1e20145270 2024-04-25T09:10:25.802 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:25.802 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":90,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:08.100794+0000","modified":"2024-04-25T09:10:25.435120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8646":{"gid":8646,"name":"a","rank":0,"incarnation":90,"state":"up:replay","state_seq":1,"addr":"172.21.15.59:6835/2009305668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2009305668},{"type":"v1","addr":"172.21.15.59:6835","nonce":2009305668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:10:25.803 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 90 2024-04-25T09:10:25.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e25400640 1 -- 172.21.15.59:0/1272208491 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1dfc066f60 msgr2=0x7f1dfc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e25400640 1 --2- 172.21.15.59:0/1272208491 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1dfc066f60 0x7f1dfc069420 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1e100ae000 tx=0x7f1e10009040 comp rx=0 tx=0).stop 2024-04-25T09:10:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e25400640 1 -- 172.21.15.59:0/1272208491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e20145270 msgr2=0x7f1e20142420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e25400640 1 --2- 172.21.15.59:0/1272208491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e20145270 0x7f1e20142420 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800d830 tx=0x7f1e1800dcf0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e25400640 1 -- 172.21.15.59:0/1272208491 shutdown_connections 2024-04-25T09:10:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e25400640 1 --2- 172.21.15.59:0/1272208491 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1dfc066f60 0x7f1dfc069420 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e25400640 1 --2- 172.21.15.59:0/1272208491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e20145270 0x7f1e20142420 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e25400640 1 --2- 172.21.15.59:0/1272208491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1e200cd4d0 0x7f1e2013f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e25400640 1 --2- 172.21.15.59:0/1272208491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1e200b1e60 0x7f1e2015ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e25400640 1 -- 172.21.15.59:0/1272208491 >> 172.21.15.59:0/1272208491 conn(0x7f1e20066fa0 msgr2=0x7f1e201405a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e25400640 1 -- 172.21.15.59:0/1272208491 shutdown_connections 2024-04-25T09:10:25.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:25.815+0000 7f1e25400640 1 -- 172.21.15.59:0/1272208491 wait complete. 2024-04-25T09:10:26.226 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:10:08.100794+0000', 'modified': '2024-04-25T09:10:25.435120+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 110, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8646': {'gid': 8646, 'name': 'a', 'rank': 0, 'incarnation': 90, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.59:6835/2009305668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 2009305668}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2009305668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:10:26.226 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8646:up:replay 2024-04-25T09:10:27.227 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:27.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.391+0000 7f43dae00640 1 Processor -- start 2024-04-25T09:10:27.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.391+0000 7f43dae00640 1 -- start start 2024-04-25T09:10:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.391+0000 7f43dae00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43d4145270 0x7f43d415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.391+0000 7f43dae00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f43d40b1e60 0x7f43d40cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.391+0000 7f43dae00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40cc4e0 con 0x7f43d40cd4d0 2024-04-25T09:10:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.391+0000 7f43dae00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d4145650 con 0x7f43d4145270 2024-04-25T09:10:27.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.391+0000 7f43dae00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40ce040 con 0x7f43d40b1e60 2024-04-25T09:10:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.395+0000 7f43d3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43d4145270 0x7f43d415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.395+0000 7f43d3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f43d4145270 0x7f43d415fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42250/0 (socket says 172.21.15.59:42250) 2024-04-25T09:10:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.395+0000 7f43d3e00640 1 -- 172.21.15.59:0/2722755052 learned_addr learned my addr 172.21.15.59:0/2722755052 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.395+0000 7f43d8e00640 1 --2- 172.21.15.59:0/2722755052 >> v2:172.21.15.178:3300/0 conn(0x7f43d40b1e60 0x7f43d40cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.395+0000 7f43d3e00640 1 -- 172.21.15.59:0/2722755052 >> v2:172.21.15.178:3300/0 conn(0x7f43d40b1e60 msgr2=0x7f43d40cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.395+0000 7f43d3e00640 1 --2- 172.21.15.59:0/2722755052 >> v2:172.21.15.178:3300/0 conn(0x7f43d40b1e60 0x7f43d40cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.395+0000 7f43d3e00640 1 -- 172.21.15.59:0/2722755052 >> v1:172.21.15.178:6789/0 conn(0x7f43d40cd4d0 legacy=0x7f43d40b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:27.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.395+0000 7f43d3e00640 1 -- 172.21.15.59:0/2722755052 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40ce320 con 0x7f43d4145270 2024-04-25T09:10:27.385 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.395+0000 7f43d3e00640 1 --2- 172.21.15.59:0/2722755052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d4145270 0x7f43d415fe50 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f43d40b4b90 tx=0x7f43c401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98c189c33173453f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:27.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.395+0000 7f43d3400640 1 -- 172.21.15.59:0/2722755052 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40a57a0 con 0x7f43d4145270 2024-04-25T09:10:27.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.395+0000 7f43d3400640 1 -- 172.21.15.59:0/2722755052 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c40a5940 con 0x7f43d4145270 2024-04-25T09:10:27.386 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.395+0000 7f43d3400640 1 -- 172.21.15.59:0/2722755052 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40a5d10 con 0x7f43d4145270 2024-04-25T09:10:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 -- 172.21.15.59:0/2722755052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d4145270 msgr2=0x7f43d415fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 --2- 172.21.15.59:0/2722755052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d4145270 0x7f43d415fe50 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f43d40b4b90 tx=0x7f43c401c9f0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 -- 172.21.15.59:0/2722755052 shutdown_connections 2024-04-25T09:10:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 --2- 172.21.15.59:0/2722755052 >> v2:172.21.15.178:3300/0 conn(0x7f43d40b1e60 0x7f43d40cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 --2- 172.21.15.59:0/2722755052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d4145270 0x7f43d415fe50 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 -- 172.21.15.59:0/2722755052 >> 172.21.15.59:0/2722755052 conn(0x7f43d4066fa0 msgr2=0x7f43d406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 -- 172.21.15.59:0/2722755052 shutdown_connections 2024-04-25T09:10:27.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 -- 172.21.15.59:0/2722755052 wait complete. 2024-04-25T09:10:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 Processor -- start 2024-04-25T09:10:27.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 -- start start 2024-04-25T09:10:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d40b1e60 0x7f43d40aa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43d40cd4d0 0x7f43d4165350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43d4145270 0x7f43d413def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d415c710 con 0x7f43d40b1e60 2024-04-25T09:10:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d415c590 con 0x7f43d4145270 2024-04-25T09:10:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43dae00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d415c890 con 0x7f43d40cd4d0 2024-04-25T09:10:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d40b1e60 0x7f43d40aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43d3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d40b1e60 0x7f43d40aa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42264/0 (socket says 172.21.15.59:42264) 2024-04-25T09:10:27.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43d3e00640 1 -- 172.21.15.59:0/3797956321 learned_addr learned my addr 172.21.15.59:0/3797956321 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43d8e00640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43d4145270 0x7f43d413def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43cb400640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43d40cd4d0 0x7f43d4165350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43d3e00640 1 -- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43d40cd4d0 msgr2=0x7f43d4165350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43d3e00640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43d40cd4d0 0x7f43d4165350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43d3e00640 1 -- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43d4145270 msgr2=0x7f43d413def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43d3e00640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43d4145270 0x7f43d413def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.399+0000 7f43d3e00640 1 -- 172.21.15.59:0/3797956321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40a8a50 con 0x7f43d40b1e60 2024-04-25T09:10:27.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.403+0000 7f43d3e00640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d40b1e60 0x7f43d40aa640 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f43c4019600 tx=0x7f43c4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.403+0000 7f43d0c00640 1 -- 172.21.15.59:0/3797956321 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40b8670 con 0x7f43d40b1e60 2024-04-25T09:10:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.403+0000 7f43d0c00640 1 -- 172.21.15.59:0/3797956321 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c40be070 con 0x7f43d40b1e60 2024-04-25T09:10:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.403+0000 7f43dae00640 1 -- 172.21.15.59:0/3797956321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d413cf40 con 0x7f43d40b1e60 2024-04-25T09:10:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.403+0000 7f43d0c00640 1 -- 172.21.15.59:0/3797956321 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40b8a70 con 0x7f43d40b1e60 2024-04-25T09:10:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.403+0000 7f43dae00640 1 -- 172.21.15.59:0/3797956321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d40a8d10 con 0x7f43d40b1e60 2024-04-25T09:10:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.403+0000 7f43dae00640 1 -- 172.21.15.59:0/3797956321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d40745d0 con 0x7f43d40b1e60 2024-04-25T09:10:27.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.403+0000 7f43d0c00640 1 -- 172.21.15.59:0/3797956321 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f43c40b8c10 con 0x7f43d40b1e60 2024-04-25T09:10:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.403+0000 7f43d0c00640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f43b0066f60 0x7f43b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.403+0000 7f43d0c00640 1 -- 172.21.15.59:0/3797956321 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f43c4120250 con 0x7f43d40b1e60 2024-04-25T09:10:27.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.403+0000 7f43cb400640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f43b0066f60 0x7f43b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:27.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.407+0000 7f43cb400640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f43b0066f60 0x7f43b0069420 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f43d413dcc0 tx=0x7f43bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:27.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.407+0000 7f43d0c00640 1 -- 172.21.15.59:0/3797956321 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f43c40165e0 con 0x7f43d40b1e60 2024-04-25T09:10:27.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 -- 172.21.15.59:0/3797956321 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43d406b8e0 con 0x7f43d40b1e60 2024-04-25T09:10:27.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43d0c00640 1 -- 172.21.15.59:0/3797956321 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f43c40f1040 con 0x7f43d40b1e60 2024-04-25T09:10:27.596 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:27.596 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":92,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:08.100794+0000","modified":"2024-04-25T09:10:26.445026+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8646":{"gid":8646,"name":"a","rank":0,"incarnation":90,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.59:6835/2009305668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2009305668},{"type":"v1","addr":"172.21.15.59:6835","nonce":2009305668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:10:27.596 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 92 2024-04-25T09:10:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 -- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f43b0066f60 msgr2=0x7f43b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f43b0066f60 0x7f43b0069420 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f43d413dcc0 tx=0x7f43bc009040 comp rx=0 tx=0).stop 2024-04-25T09:10:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 -- 172.21.15.59:0/3797956321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d40b1e60 msgr2=0x7f43d40aa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d40b1e60 0x7f43d40aa640 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f43c4019600 tx=0x7f43c4019790 comp rx=0 tx=0).stop 2024-04-25T09:10:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 -- 172.21.15.59:0/3797956321 shutdown_connections 2024-04-25T09:10:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f43b0066f60 0x7f43b0069420 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f43d4145270 0x7f43d413def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f43d40cd4d0 0x7f43d4165350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 --2- 172.21.15.59:0/3797956321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f43d40b1e60 0x7f43d40aa640 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:27.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 -- 172.21.15.59:0/3797956321 >> 172.21.15.59:0/3797956321 conn(0x7f43d4066fa0 msgr2=0x7f43d40b44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 -- 172.21.15.59:0/3797956321 shutdown_connections 2024-04-25T09:10:27.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:27.607+0000 7f43dae00640 1 -- 172.21.15.59:0/3797956321 wait complete. 2024-04-25T09:10:28.020 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:10:08.100794+0000', 'modified': '2024-04-25T09:10:26.445026+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 110, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8646': {'gid': 8646, 'name': 'a', 'rank': 0, 'incarnation': 90, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.59:6835/2009305668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 2009305668}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2009305668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:10:28.020 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8646:up:rejoin 2024-04-25T09:10:29.021 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:10:29.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb9a00640 1 Processor -- start 2024-04-25T09:10:29.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb9a00640 1 -- start start 2024-04-25T09:10:29.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb9a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1eb4145270 0x7f1eb415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb9a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1eb40b1e60 0x7f1eb40cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb9a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1eb40cc4e0 con 0x7f1eb40cd4d0 2024-04-25T09:10:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb9a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb4145650 con 0x7f1eb4145270 2024-04-25T09:10:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb9a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eb40ce040 con 0x7f1eb40b1e60 2024-04-25T09:10:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1eb4145270 0x7f1eb415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb2a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1eb4145270 0x7f1eb415fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42280/0 (socket says 172.21.15.59:42280) 2024-04-25T09:10:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb2a00640 1 -- 172.21.15.59:0/1905184251 learned_addr learned my addr 172.21.15.59:0/1905184251 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb3400640 1 --2- 172.21.15.59:0/1905184251 >> v2:172.21.15.178:3300/0 conn(0x7f1eb40b1e60 0x7f1eb40cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb2a00640 1 -- 172.21.15.59:0/1905184251 >> v2:172.21.15.178:3300/0 conn(0x7f1eb40b1e60 msgr2=0x7f1eb40cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb2a00640 1 --2- 172.21.15.59:0/1905184251 >> v2:172.21.15.178:3300/0 conn(0x7f1eb40b1e60 0x7f1eb40cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb2a00640 1 -- 172.21.15.59:0/1905184251 >> v1:172.21.15.178:6789/0 conn(0x7f1eb40cd4d0 legacy=0x7f1eb40b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.187+0000 7f1eb2a00640 1 -- 172.21.15.59:0/1905184251 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb40ce320 con 0x7f1eb4145270 2024-04-25T09:10:29.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.191+0000 7f1eb2a00640 1 --2- 172.21.15.59:0/1905184251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb4145270 0x7f1eb415fe50 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40b4b90 tx=0x7f1ea401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f19e7ad9f36ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.191+0000 7f1eb2000640 1 -- 172.21.15.59:0/1905184251 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea40b1070 con 0x7f1eb4145270 2024-04-25T09:10:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.191+0000 7f1eb2000640 1 -- 172.21.15.59:0/1905184251 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea40ac630 con 0x7f1eb4145270 2024-04-25T09:10:29.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.191+0000 7f1eb2000640 1 -- 172.21.15.59:0/1905184251 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea40a8050 con 0x7f1eb4145270 2024-04-25T09:10:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.191+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1905184251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb4145270 msgr2=0x7f1eb415fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.191+0000 7f1eb9a00640 1 --2- 172.21.15.59:0/1905184251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb4145270 0x7f1eb415fe50 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40b4b90 tx=0x7f1ea401c4e0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.191+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1905184251 shutdown_connections 2024-04-25T09:10:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.191+0000 7f1eb9a00640 1 --2- 172.21.15.59:0/1905184251 >> v2:172.21.15.178:3300/0 conn(0x7f1eb40b1e60 0x7f1eb40cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.191+0000 7f1eb9a00640 1 --2- 172.21.15.59:0/1905184251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb4145270 0x7f1eb415fe50 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.191+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1905184251 >> 172.21.15.59:0/1905184251 conn(0x7f1eb4066fa0 msgr2=0x7f1eb406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.191+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1905184251 shutdown_connections 2024-04-25T09:10:29.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.191+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1905184251 wait complete. 2024-04-25T09:10:29.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb9a00640 1 Processor -- start 2024-04-25T09:10:29.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb9a00640 1 -- start start 2024-04-25T09:10:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb9a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb40b1e60 0x7f1eb40afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb9a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb40cd4d0 0x7f1eb413ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb9a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1eb4145270 0x7f1eb40b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb9a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb415c710 con 0x7f1eb40b1e60 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb9a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb415c590 con 0x7f1eb40cd4d0 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb9a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eb415c890 con 0x7f1eb4145270 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb40b1e60 0x7f1eb40afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb2a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb40b1e60 0x7f1eb40afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42292/0 (socket says 172.21.15.59:42292) 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb2a00640 1 -- 172.21.15.59:0/1086840434 learned_addr learned my addr 172.21.15.59:0/1086840434 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb3400640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1eb4145270 0x7f1eb40b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eaa000640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb40cd4d0 0x7f1eb413ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb2a00640 1 -- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1eb4145270 msgr2=0x7f1eb40b10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb2a00640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1eb4145270 0x7f1eb40b10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb2a00640 1 -- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb40cd4d0 msgr2=0x7f1eb413ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb2a00640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb40cd4d0 0x7f1eb413ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb2a00640 1 -- 172.21.15.59:0/1086840434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb40b0030 con 0x7f1eb40b1e60 2024-04-25T09:10:29.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb2a00640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb40b1e60 0x7f1eb40afa50 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f1ea401a110 tx=0x7f1ea4019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eab400640 1 -- 172.21.15.59:0/1086840434 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea40b1070 con 0x7f1eb40b1e60 2024-04-25T09:10:29.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eab400640 1 -- 172.21.15.59:0/1086840434 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea40ab5e0 con 0x7f1eb40b1e60 2024-04-25T09:10:29.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1086840434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eb40b0310 con 0x7f1eb40b1e60 2024-04-25T09:10:29.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eab400640 1 -- 172.21.15.59:0/1086840434 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ea40a8040 con 0x7f1eb40b1e60 2024-04-25T09:10:29.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1086840434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eb40b08d0 con 0x7f1eb40b1e60 2024-04-25T09:10:29.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.195+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1086840434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eb40745d0 con 0x7f1eb40b1e60 2024-04-25T09:10:29.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.199+0000 7f1eab400640 1 -- 172.21.15.59:0/1086840434 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1ea40be060 con 0x7f1eb40b1e60 2024-04-25T09:10:29.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.199+0000 7f1eab400640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e90066f90 0x7f1e90069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.199+0000 7f1eab400640 1 -- 172.21.15.59:0/1086840434 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f1ea411ea00 con 0x7f1eb40b1e60 2024-04-25T09:10:29.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.199+0000 7f1eaa000640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e90066f90 0x7f1e90069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.199+0000 7f1eaa000640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e90066f90 0x7f1e90069450 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1eb41fa390 tx=0x7f1e9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.203+0000 7f1eab400640 1 -- 172.21.15.59:0/1086840434 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1ea40160d0 con 0x7f1eb40b1e60 2024-04-25T09:10:29.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1086840434 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1eb40745d0 con 0x7f1eb40b1e60 2024-04-25T09:10:29.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eab400640 1 -- 172.21.15.59:0/1086840434 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4948 (secure 0 0 0) 0x7f1ea40ef7d0 con 0x7f1eb40b1e60 2024-04-25T09:10:29.388 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:29.388 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:08.100794+0000","modified":"2024-04-25T09:10:27.446674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":110,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8646},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8646":{"gid":8646,"name":"a","rank":0,"incarnation":90,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6835/2009305668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2009305668},{"type":"v1","addr":"172.21.15.59:6835","nonce":2009305668}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:10:29.388 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 93 2024-04-25T09:10:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e90066f90 msgr2=0x7f1e90069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e90066f90 0x7f1e90069450 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1eb41fa390 tx=0x7f1e9c009040 comp rx=0 tx=0).stop 2024-04-25T09:10:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1086840434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb40b1e60 msgr2=0x7f1eb40afa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb40b1e60 0x7f1eb40afa50 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f1ea401a110 tx=0x7f1ea4019280 comp rx=0 tx=0).stop 2024-04-25T09:10:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1086840434 shutdown_connections 2024-04-25T09:10:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1e90066f90 0x7f1e90069450 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1eb4145270 0x7f1eb40b10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1eb40cd4d0 0x7f1eb413ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 --2- 172.21.15.59:0/1086840434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1eb40b1e60 0x7f1eb40afa50 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1086840434 >> 172.21.15.59:0/1086840434 conn(0x7f1eb4066fa0 msgr2=0x7f1eb40b4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:29.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1086840434 shutdown_connections 2024-04-25T09:10:29.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.399+0000 7f1eb9a00640 1 -- 172.21.15.59:0/1086840434 wait complete. 2024-04-25T09:10:29.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:10:08.100794+0000', 'modified': '2024-04-25T09:10:27.446674+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 110, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8646}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8646': {'gid': 8646, 'name': 'a', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.59:6835/2009305668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 2009305668}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2009305668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:10:29.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:10:29.812 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:10:29.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.967+0000 7f0289800640 1 Processor -- start 2024-04-25T09:10:29.958 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.967+0000 7f0289800640 1 -- start start 2024-04-25T09:10:29.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f0289800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0284159320 0x7f028415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f0289800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f028415f440 0x7f028406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f0289800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f028415fc00 con 0x7f028406e010 2024-04-25T09:10:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f0289800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f028406d640 con 0x7f0284159320 2024-04-25T09:10:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f0289800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028415fee0 con 0x7f028415f440 2024-04-25T09:10:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f0282a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0284159320 0x7f028415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f0282a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0284159320 0x7f028415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42296/0 (socket says 172.21.15.59:42296) 2024-04-25T09:10:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f0282a00640 1 -- 172.21.15.59:0/2323256998 learned_addr learned my addr 172.21.15.59:0/2323256998 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f027a000640 1 --2- 172.21.15.59:0/2323256998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f028415f440 0x7f028406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f0282a00640 1 -- 172.21.15.59:0/2323256998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f028415f440 msgr2=0x7f028406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f0282a00640 1 --2- 172.21.15.59:0/2323256998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f028415f440 0x7f028406dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f0282a00640 1 -- 172.21.15.59:0/2323256998 >> v1:172.21.15.178:6789/0 conn(0x7f028406e010 legacy=0x7f028406e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f0282a00640 1 -- 172.21.15.59:0/2323256998 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02841601c0 con 0x7f0284159320 2024-04-25T09:10:29.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.971+0000 7f027a000640 1 --2- 172.21.15.59:0/2323256998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f028415f440 0x7f028406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:29.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0282a00640 1 --2- 172.21.15.59:0/2323256998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0284159320 0x7f028415c9b0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f0274009870 tx=0x7f027401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f581159f8564ac91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0282000640 1 -- 172.21.15.59:0/2323256998 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02740ab640 con 0x7f0284159320 2024-04-25T09:10:29.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0282000640 1 -- 172.21.15.59:0/2323256998 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02740b0070 con 0x7f0284159320 2024-04-25T09:10:29.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0282000640 1 -- 172.21.15.59:0/2323256998 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02740aba00 con 0x7f0284159320 2024-04-25T09:10:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0289800640 1 -- 172.21.15.59:0/2323256998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0284159320 msgr2=0x7f028415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0289800640 1 --2- 172.21.15.59:0/2323256998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0284159320 0x7f028415c9b0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f0274009870 tx=0x7f027401c460 comp rx=0 tx=0).stop 2024-04-25T09:10:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0289800640 1 -- 172.21.15.59:0/2323256998 shutdown_connections 2024-04-25T09:10:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0289800640 1 --2- 172.21.15.59:0/2323256998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f028415f440 0x7f028406dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0289800640 1 --2- 172.21.15.59:0/2323256998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0284159320 0x7f028415c9b0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0289800640 1 -- 172.21.15.59:0/2323256998 >> 172.21.15.59:0/2323256998 conn(0x7f0284067080 msgr2=0x7f028406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0289800640 1 -- 172.21.15.59:0/2323256998 shutdown_connections 2024-04-25T09:10:29.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0289800640 1 -- 172.21.15.59:0/2323256998 wait complete. 2024-04-25T09:10:29.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0289800640 1 Processor -- start 2024-04-25T09:10:29.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.975+0000 7f0289800640 1 -- start start 2024-04-25T09:10:29.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0289800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f028406e010 0x7f02841383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0289800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0284159320 0x7f028413f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0289800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f028415f440 0x7f0284158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0289800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028415f9a0 con 0x7f028415f440 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0289800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028415f820 con 0x7f0284159320 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0289800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f028406ebb0 con 0x7f028406e010 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0283400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f028415f440 0x7f0284158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0283400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f028415f440 0x7f0284158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42310/0 (socket says 172.21.15.59:42310) 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0283400640 1 -- 172.21.15.59:0/352634491 learned_addr learned my addr 172.21.15.59:0/352634491 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f027a000640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0284159320 0x7f028413f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0282a00640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f028406e010 0x7f02841383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0283400640 1 -- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f028406e010 msgr2=0x7f02841383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0283400640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f028406e010 0x7f02841383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0283400640 1 -- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0284159320 msgr2=0x7f028413f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0283400640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0284159320 0x7f028413f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0283400640 1 -- 172.21.15.59:0/352634491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0284138a50 con 0x7f028415f440 2024-04-25T09:10:29.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0283400640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f028415f440 0x7f0284158090 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f027c00be60 tx=0x7f027c00bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f027b400640 1 -- 172.21.15.59:0/352634491 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c019070 con 0x7f028415f440 2024-04-25T09:10:29.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f027b400640 1 -- 172.21.15.59:0/352634491 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c014440 con 0x7f028415f440 2024-04-25T09:10:29.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0289800640 1 -- 172.21.15.59:0/352634491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0284138d30 con 0x7f028415f440 2024-04-25T09:10:29.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f027b400640 1 -- 172.21.15.59:0/352634491 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c014830 con 0x7f028415f440 2024-04-25T09:10:29.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f0289800640 1 -- 172.21.15.59:0/352634491 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02841392f0 con 0x7f028415f440 2024-04-25T09:10:29.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.979+0000 7f027b400640 1 -- 172.21.15.59:0/352634491 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f027c01c070 con 0x7f028415f440 2024-04-25T09:10:29.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f027b400640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0260066f60 0x7f0260069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f027b400640 1 -- 172.21.15.59:0/352634491 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f027c085240 con 0x7f028415f440 2024-04-25T09:10:29.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f0282a00640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0260066f60 0x7f0260069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 Processor -- start 2024-04-25T09:10:29.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 -- start start 2024-04-25T09:10:29.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f0282a00640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0260066f60 0x7f0260069420 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f02740af000 tx=0x7f02740a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f4920 0x55577a5f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 0x55577a5aa9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5aaf30 0x55577a5ab310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577a4925f0 con 0x55577a5f5240 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577a3f9da0 con 0x55577a5aaf30 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55577a382150 con 0x55577a5f4920 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f027a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 0x55577a5aa9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f027a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 0x55577a5aa9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42326/0 (socket says 172.21.15.59:42326) 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f027a000640 1 -- 172.21.15.59:0/46618854 learned_addr learned my addr 172.21.15.59:0/46618854 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f0282a00640 1 --2- 172.21.15.59:0/46618854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f4920 0x55577a5f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f0283400640 1 --2- 172.21.15.59:0/46618854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5aaf30 0x55577a5ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f027a000640 1 -- 172.21.15.59:0/46618854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f4920 msgr2=0x55577a5f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f027a000640 1 --2- 172.21.15.59:0/46618854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f4920 0x55577a5f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f027a000640 1 -- 172.21.15.59:0/46618854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5aaf30 msgr2=0x55577a5ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f027a000640 1 --2- 172.21.15.59:0/46618854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5aaf30 0x55577a5ab310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f027a000640 1 -- 172.21.15.59:0/46618854 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55577a39bca0 con 0x55577a5f5240 2024-04-25T09:10:29.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f0283400640 1 --2- 172.21.15.59:0/46618854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5aaf30 0x55577a5ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:29.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f027a000640 1 --2- 172.21.15.59:0/46618854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 0x55577a5aa9f0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f026c004660 tx=0x7f026c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d314fda8c37971 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f0273400640 1 -- 172.21.15.59:0/46618854 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c00f9c0 con 0x55577a5f5240 2024-04-25T09:10:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f0273400640 1 -- 172.21.15.59:0/46618854 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c00fb60 con 0x55577a5f5240 2024-04-25T09:10:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f0273400640 1 -- 172.21.15.59:0/46618854 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026c014480 con 0x55577a5f5240 2024-04-25T09:10:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 -- 172.21.15.59:0/46618854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 msgr2=0x55577a5aa9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 --2- 172.21.15.59:0/46618854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 0x55577a5aa9f0 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f026c004660 tx=0x7f026c00dd90 comp rx=0 tx=0).stop 2024-04-25T09:10:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 -- 172.21.15.59:0/46618854 shutdown_connections 2024-04-25T09:10:29.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 --2- 172.21.15.59:0/46618854 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5aaf30 0x55577a5ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 --2- 172.21.15.59:0/46618854 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 0x55577a5aa9f0 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 --2- 172.21.15.59:0/46618854 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f4920 0x55577a5f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 -- 172.21.15.59:0/46618854 >> 172.21.15.59:0/46618854 conn(0x55577a5b12a0 msgr2=0x55577a5a92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 -- 172.21.15.59:0/46618854 shutdown_connections 2024-04-25T09:10:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.983+0000 7f028c9ff000 1 -- 172.21.15.59:0/46618854 wait complete. 2024-04-25T09:10:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 1 -- start start 2024-04-25T09:10:29.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 1 Processor -- start 2024-04-25T09:10:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5aaf30 0x55577a5fbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f4920 0x55577a5fc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 0x55577a5aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577a3b4990 con 0x55577a5f5240 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577a3f5e40 con 0x55577a5f4920 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55577a385900 con 0x55577a5aaf30 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 10 client.0 _ll_register_callbacks cb 0x55577a4ad1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0283400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 0x55577a5aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0283400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 0x55577a5aeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42342/0 (socket says 172.21.15.59:42342) 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0283400640 1 -- 172.21.15.59:0/3475828356 learned_addr learned my addr 172.21.15.59:0/3475828356 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f027a000640 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f4920 0x55577a5fc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0282a00640 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5aaf30 0x55577a5fbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0283400640 1 -- 172.21.15.59:0/3475828356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5aaf30 msgr2=0x55577a5fbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0283400640 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5aaf30 0x55577a5fbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0283400640 1 -- 172.21.15.59:0/3475828356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f4920 msgr2=0x55577a5fc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0283400640 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f4920 0x55577a5fc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0283400640 1 -- 172.21.15.59:0/3475828356 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55577a3b2630 con 0x55577a5f5240 2024-04-25T09:10:29.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0283400640 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 0x55577a5aeaa0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f027c05da70 tx=0x7f027c0560d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e2972c72de3e12 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0267e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0267e00640 1 -- 172.21.15.59:0/3475828356 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c06d3d0 con 0x55577a5f5240 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0267e00640 1 -- 172.21.15.59:0/3475828356 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f027c05db10 con 0x55577a5f5240 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 1 -- 172.21.15.59:0/3475828356 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f026c00fb60 con 0x55577a5f5240 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0267e00640 1 -- 172.21.15.59:0/3475828356 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f027c083050 con 0x55577a5f5240 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 10 client.8715 fetch_fsmap learned FSMap version 93 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 1 -- 172.21.15.59:0/3475828356 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55577a3823a0 con 0x55577a5f5240 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0267e00640 1 -- 172.21.15.59:0/3475828356 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026c00fb60 con 0x55577a5f5240 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0267e00640 1 -- 172.21.15.59:0/3475828356 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f027c008030 con 0x55577a5f5240 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 10 client.8715 fetch_fsmap finished waiting for FSMap version 93 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 10 client.8715 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 20 client.8715 populate_metadata read hostname 'smithi059' 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55577a5af4b0 0x55577a5af890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 4 client.8715 mds_command: new command op to 8646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f028c9ff000 1 -- 172.21.15.59:0/3475828356 --> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55577a395a50 con 0x55577a5af4b0 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.987+0000 7f0282a00640 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55577a5af4b0 0x55577a5af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:29.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f0282a00640 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55577a5af4b0 0x55577a5af890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fce6cd4935c7c94c server_cookie=34b3efafcfab123c in_seq=0 out_seq=0 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f0267e00640 10 client.8715 ms_handle_connect on v2:172.21.15.59:6833/2009305668 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f0267e00640 1 -- 172.21.15.59:0/3475828356 <== mds.0 v2:172.21.15.59:6833/2009305668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55577a395a50 con 0x55577a5af4b0 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f0267e00640 10 client.8715 handle_command_reply: tid=0 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f028c9ff000 1 client.8715 shutdown 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f028c9ff000 1 -- 172.21.15.59:0/3475828356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 msgr2=0x55577a5aeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f028c9ff000 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 0x55577a5aeaa0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f027c05da70 tx=0x7f027c0560d0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f028c9ff000 1 -- 172.21.15.59:0/3475828356 shutdown_connections 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f028c9ff000 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55577a5af4b0 0x55577a5af890 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f028c9ff000 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5f5240 0x55577a5aeaa0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f028c9ff000 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f4920 0x55577a5fc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f028c9ff000 1 --2- 172.21.15.59:0/3475828356 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5aaf30 0x55577a5fbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f0267e00640 0 client.8715 ms_handle_reset on v2:172.21.15.59:6833/2009305668 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f028c9ff000 1 -- 172.21.15.59:0/3475828356 >> 172.21.15.59:0/3475828356 conn(0x55577a5b12a0 msgr2=0x55577a5a99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:29.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f028c9ff000 1 -- 172.21.15.59:0/3475828356 shutdown_connections 2024-04-25T09:10:29.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f028c9ff000 1 -- 172.21.15.59:0/3475828356 wait complete. 2024-04-25T09:10:29.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:29.991+0000 7f028c9ff000 20 client.8715 trim_cache size 0 max 16384 2024-04-25T09:10:29.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f028c9ff000 1 Processor -- start 2024-04-25T09:10:29.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f028c9ff000 1 -- start start 2024-04-25T09:10:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f028c9ff000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 0x55577a5f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f028c9ff000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f4920 0x55577a5f3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f028c9ff000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f5240 0x55577a5fe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f028c9ff000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0284202590 con 0x55577a5aaf30 2024-04-25T09:10:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f028c9ff000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0284143370 con 0x55577a5f4920 2024-04-25T09:10:30.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f028c9ff000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0284202020 con 0x55577a5f5240 2024-04-25T09:10:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0282a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 0x55577a5f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0282a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 0x55577a5f2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42350/0 (socket says 172.21.15.59:42350) 2024-04-25T09:10:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0282a00640 1 -- 172.21.15.59:0/1325704932 learned_addr learned my addr 172.21.15.59:0/1325704932 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f027a000640 1 --2- 172.21.15.59:0/1325704932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f4920 0x55577a5f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0283400640 1 --2- 172.21.15.59:0/1325704932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f5240 0x55577a5fe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0282a00640 1 -- 172.21.15.59:0/1325704932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f5240 msgr2=0x55577a5fe7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0282a00640 1 --2- 172.21.15.59:0/1325704932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f5240 0x55577a5fe7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0282a00640 1 -- 172.21.15.59:0/1325704932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f4920 msgr2=0x55577a5f3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0282a00640 1 --2- 172.21.15.59:0/1325704932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f4920 0x55577a5f3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0282a00640 1 -- 172.21.15.59:0/1325704932 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55577a5f5070 con 0x55577a5aaf30 2024-04-25T09:10:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f027a000640 1 --2- 172.21.15.59:0/1325704932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f4920 0x55577a5f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0283400640 1 --2- 172.21.15.59:0/1325704932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f5240 0x55577a5fe7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0282a00640 1 --2- 172.21.15.59:0/1325704932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 0x55577a5f2ce0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f027401cd00 tx=0x7f0274009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679215fab17b3c64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0272a00640 1 -- 172.21.15.59:0/1325704932 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02740d0070 con 0x55577a5aaf30 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0272a00640 1 -- 172.21.15.59:0/1325704932 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02740b0040 con 0x55577a5aaf30 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f0272a00640 1 -- 172.21.15.59:0/1325704932 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02740ba070 con 0x55577a5aaf30 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f028c9ff000 1 -- 172.21.15.59:0/1325704932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 msgr2=0x55577a5f2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.007+0000 7f028c9ff000 1 --2- 172.21.15.59:0/1325704932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 0x55577a5f2ce0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f027401cd00 tx=0x7f0274009240 comp rx=0 tx=0).stop 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 -- 172.21.15.59:0/1325704932 shutdown_connections 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 --2- 172.21.15.59:0/1325704932 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f5240 0x55577a5fe7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 --2- 172.21.15.59:0/1325704932 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f4920 0x55577a5f3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 --2- 172.21.15.59:0/1325704932 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 0x55577a5f2ce0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 -- 172.21.15.59:0/1325704932 >> 172.21.15.59:0/1325704932 conn(0x55577a5b12a0 msgr2=0x55577a5ae220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 -- 172.21.15.59:0/1325704932 shutdown_connections 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 -- 172.21.15.59:0/1325704932 wait complete. 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 -- start start 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 Processor -- start 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 0x55577a601df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f4920 0x55577a63c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f5240 0x55577a63ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577a3fe3d0 con 0x55577a5aaf30 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577a4b5d50 con 0x55577a5f5240 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55577a394980 con 0x55577a5f4920 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 10 client.0 _ll_register_callbacks cb 0x7f026c00d2a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0282a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 0x55577a601df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0282a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 0x55577a601df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42352/0 (socket says 172.21.15.59:42352) 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0282a00640 1 -- 172.21.15.59:0/2126368224 learned_addr learned my addr 172.21.15.59:0/2126368224 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f027a000640 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f4920 0x55577a63c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0283400640 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f5240 0x55577a63ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0282a00640 1 -- 172.21.15.59:0/2126368224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f4920 msgr2=0x55577a63c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0282a00640 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f4920 0x55577a63c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0282a00640 1 -- 172.21.15.59:0/2126368224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f5240 msgr2=0x55577a63ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0282a00640 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f5240 0x55577a63ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0282a00640 1 -- 172.21.15.59:0/2126368224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55577a47b600 con 0x55577a5aaf30 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f027a000640 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f4920 0x55577a63c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0283400640 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f5240 0x55577a63ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0282a00640 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 0x55577a601df0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f027401c940 tx=0x7f027401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77620503ab1f645 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0267e00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0267e00640 1 -- 172.21.15.59:0/2126368224 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02740d0070 con 0x55577a5aaf30 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0267e00640 1 -- 172.21.15.59:0/2126368224 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f02740d7ce0 con 0x55577a5aaf30 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 -- 172.21.15.59:0/2126368224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02740b0040 con 0x55577a5aaf30 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0267e00640 1 -- 172.21.15.59:0/2126368224 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02740ba040 con 0x55577a5aaf30 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 10 client.8721 fetch_fsmap learned FSMap version 93 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 -- 172.21.15.59:0/2126368224 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55577a38e9b0 con 0x55577a5aaf30 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0267e00640 1 -- 172.21.15.59:0/2126368224 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02740b0040 con 0x55577a5aaf30 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f0267e00640 1 -- 172.21.15.59:0/2126368224 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f02740c8040 con 0x55577a5aaf30 2024-04-25T09:10:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 10 client.8721 fetch_fsmap finished waiting for FSMap version 93 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 10 client.8721 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 20 client.8721 populate_metadata read hostname 'smithi059' 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55577a63d360 0x55577a6554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 4 client.8721 mds_command: new command op to 8646 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.011+0000 7f028c9ff000 1 -- 172.21.15.59:0/2126368224 --> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55577a4072e0 con 0x55577a63d360 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f027a000640 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55577a63d360 0x55577a6554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0267e00640 10 client.8721 ms_handle_connect on v2:172.21.15.59:6833/2009305668 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f027a000640 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55577a63d360 0x55577a6554d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5837caac8cd83c73 server_cookie=70eaad36ba7ab152 in_seq=0 out_seq=0 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0267e00640 1 -- 172.21.15.59:0/2126368224 <== mds.0 v2:172.21.15.59:6833/2009305668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55577a4072e0 con 0x55577a63d360 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0267e00640 10 client.8721 handle_command_reply: tid=0 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f028c9ff000 1 client.8721 shutdown 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f028c9ff000 1 -- 172.21.15.59:0/2126368224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 msgr2=0x55577a601df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f028c9ff000 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 0x55577a601df0 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f027401c940 tx=0x7f027401aca0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f028c9ff000 1 -- 172.21.15.59:0/2126368224 shutdown_connections 2024-04-25T09:10:30.013 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f028c9ff000 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55577a63d360 0x55577a6554d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f028c9ff000 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55577a5f5240 0x55577a63ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f028c9ff000 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55577a5f4920 0x55577a63c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0267e00640 0 client.8721 ms_handle_reset on v2:172.21.15.59:6833/2009305668 2024-04-25T09:10:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f028c9ff000 1 --2- 172.21.15.59:0/2126368224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55577a5aaf30 0x55577a601df0 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f028c9ff000 1 -- 172.21.15.59:0/2126368224 >> 172.21.15.59:0/2126368224 conn(0x55577a5b12a0 msgr2=0x55577a5f1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f028c9ff000 1 -- 172.21.15.59:0/2126368224 shutdown_connections 2024-04-25T09:10:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f028c9ff000 1 -- 172.21.15.59:0/2126368224 wait complete. 2024-04-25T09:10:30.014 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f028c9ff000 20 client.8721 trim_cache size 0 max 16384 2024-04-25T09:10:30.014 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:10:30.014 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:10:30.015 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:10:30.015 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8646, 2024-04-25T09:10:30.015 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:10:30.015 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:10:30.015 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:10:30.015 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 4.5777765490000002, 2024-04-25T09:10:30.015 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 93, 2024-04-25T09:10:30.015 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 110, 2024-04-25T09:10:30.015 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 110, 2024-04-25T09:10:30.015 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 5.51004527 2024-04-25T09:10:30.015 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:10:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0289800640 1 -- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0260066f60 msgr2=0x7f0260069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0289800640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0260066f60 0x7f0260069420 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f02740af000 tx=0x7f02740a7000 comp rx=0 tx=0).stop 2024-04-25T09:10:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0289800640 1 -- 172.21.15.59:0/352634491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f028415f440 msgr2=0x7f0284158090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0289800640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f028415f440 0x7f0284158090 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f027c00be60 tx=0x7f027c00bf50 comp rx=0 tx=0).stop 2024-04-25T09:10:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0289800640 1 -- 172.21.15.59:0/352634491 shutdown_connections 2024-04-25T09:10:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0289800640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0260066f60 0x7f0260069420 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0289800640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f028415f440 0x7f0284158090 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0289800640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0284159320 0x7f028413f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0289800640 1 --2- 172.21.15.59:0/352634491 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f028406e010 0x7f02841383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0289800640 1 -- 172.21.15.59:0/352634491 >> 172.21.15.59:0/352634491 conn(0x7f0284067080 msgr2=0x7f028415cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0289800640 1 -- 172.21.15.59:0/352634491 shutdown_connections 2024-04-25T09:10:30.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.015+0000 7f0289800640 1 -- 172.21.15.59:0/352634491 wait complete. 2024-04-25T09:10:30.024 DEBUG:teuthology.orchestra.run.smithi059:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-25T09:10:30.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:30.027 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-25T09:10:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.183+0000 7f04b6a00640 1 Processor -- start 2024-04-25T09:10:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.183+0000 7f04b6a00640 1 -- start start 2024-04-25T09:10:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.183+0000 7f04b6a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04b015dab0 0x7f04b00b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.183+0000 7f04b6a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f04b00b0c00 0x7f04b0070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.183+0000 7f04b6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04b00711f0 0x7f04b0161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.183+0000 7f04b6a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b0071650 con 0x7f04b00711f0 2024-04-25T09:10:30.174 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.183+0000 7f04b6a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b015de90 con 0x7f04b00b0c00 2024-04-25T09:10:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.183+0000 7f04b6a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b0071a70 con 0x7f04b015dab0 2024-04-25T09:10:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.187+0000 7f04b4a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04b00711f0 0x7f04b0161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.187+0000 7f04a7e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f04b00b0c00 0x7f04b0070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.187+0000 7f04b4a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04b00711f0 0x7f04b0161590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42362/0 (socket says 172.21.15.59:42362) 2024-04-25T09:10:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.187+0000 7f04b4a00640 1 -- 172.21.15.59:0/2295440599 learned_addr learned my addr 172.21.15.59:0/2295440599 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.187+0000 7f04afe00640 1 --2- 172.21.15.59:0/2295440599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04b015dab0 0x7f04b00b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.187+0000 7f04b4a00640 1 -- 172.21.15.59:0/2295440599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04b015dab0 msgr2=0x7f04b00b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.187+0000 7f04b4a00640 1 --2- 172.21.15.59:0/2295440599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04b015dab0 0x7f04b00b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.187+0000 7f04b4a00640 1 -- 172.21.15.59:0/2295440599 >> v2:172.21.15.178:3300/0 conn(0x7f04b00b0c00 msgr2=0x7f04b0070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.187+0000 7f04b4a00640 1 --2- 172.21.15.59:0/2295440599 >> v2:172.21.15.178:3300/0 conn(0x7f04b00b0c00 0x7f04b0070cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.187+0000 7f04b4a00640 1 -- 172.21.15.59:0/2295440599 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b00b57a0 con 0x7f04b00711f0 2024-04-25T09:10:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04b4a00640 1 --2- 172.21.15.59:0/2295440599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00711f0 0x7f04b0161590 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f04b006bbf0 tx=0x7f04a801c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772347647dbcd300 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04af400640 1 -- 172.21.15.59:0/2295440599 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a80ac020 con 0x7f04b00711f0 2024-04-25T09:10:30.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04af400640 1 -- 172.21.15.59:0/2295440599 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a80a64a0 con 0x7f04b00711f0 2024-04-25T09:10:30.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04af400640 1 -- 172.21.15.59:0/2295440599 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a80a6870 con 0x7f04b00711f0 2024-04-25T09:10:30.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04b6a00640 1 -- 172.21.15.59:0/2295440599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00711f0 msgr2=0x7f04b0161590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04b6a00640 1 --2- 172.21.15.59:0/2295440599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00711f0 0x7f04b0161590 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f04b006bbf0 tx=0x7f04a801c700 comp rx=0 tx=0).stop 2024-04-25T09:10:30.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04b6a00640 1 -- 172.21.15.59:0/2295440599 shutdown_connections 2024-04-25T09:10:30.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04b6a00640 1 --2- 172.21.15.59:0/2295440599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00711f0 0x7f04b0161590 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04b6a00640 1 --2- 172.21.15.59:0/2295440599 >> v2:172.21.15.178:3300/0 conn(0x7f04b00b0c00 0x7f04b0070cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04b6a00640 1 --2- 172.21.15.59:0/2295440599 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04b015dab0 0x7f04b00b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04b6a00640 1 -- 172.21.15.59:0/2295440599 >> 172.21.15.59:0/2295440599 conn(0x7f04b006f510 msgr2=0x7f04b006f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04b6a00640 1 -- 172.21.15.59:0/2295440599 shutdown_connections 2024-04-25T09:10:30.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.191+0000 7f04b6a00640 1 -- 172.21.15.59:0/2295440599 wait complete. 2024-04-25T09:10:30.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04b6a00640 1 Processor -- start 2024-04-25T09:10:30.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04b6a00640 1 -- start start 2024-04-25T09:10:30.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04b6a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04b00711f0 0x7f04b01549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04b6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00b0c00 0x7f04b0160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04b6a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04b015dab0 0x7f04b015e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04b6a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b006cb20 con 0x7f04b00b0c00 2024-04-25T09:10:30.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04b6a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b006c9a0 con 0x7f04b015dab0 2024-04-25T09:10:30.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04b6a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b006cca0 con 0x7f04b00711f0 2024-04-25T09:10:30.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04a7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00b0c00 0x7f04b0160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04a7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00b0c00 0x7f04b0160a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42372/0 (socket says 172.21.15.59:42372) 2024-04-25T09:10:30.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04a7e00640 1 -- 172.21.15.59:0/1832497483 learned_addr learned my addr 172.21.15.59:0/1832497483 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04afe00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04b00711f0 0x7f04b01549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04b4a00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04b015dab0 0x7f04b015e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04a7e00640 1 -- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04b00711f0 msgr2=0x7f04b01549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04a7e00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04b00711f0 0x7f04b01549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04a7e00640 1 -- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04b015dab0 msgr2=0x7f04b015e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04a7e00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04b015dab0 0x7f04b015e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04a7e00640 1 -- 172.21.15.59:0/1832497483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b0153940 con 0x7f04b00b0c00 2024-04-25T09:10:30.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04b4a00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04b015dab0 0x7f04b015e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:30.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04a7e00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00b0c00 0x7f04b0160a80 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f049800e8e0 tx=0x7f049800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04acc00640 1 -- 172.21.15.59:0/1832497483 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498017070 con 0x7f04b00b0c00 2024-04-25T09:10:30.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04acc00640 1 -- 172.21.15.59:0/1832497483 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049800ca00 con 0x7f04b00b0c00 2024-04-25T09:10:30.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04acc00640 1 -- 172.21.15.59:0/1832497483 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049800cdd0 con 0x7f04b00b0c00 2024-04-25T09:10:30.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04b6a00640 1 -- 172.21.15.59:0/1832497483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b0153c20 con 0x7f04b00b0c00 2024-04-25T09:10:30.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.195+0000 7f04b6a00640 1 -- 172.21.15.59:0/1832497483 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b01541e0 con 0x7f04b00b0c00 2024-04-25T09:10:30.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04acc00640 1 -- 172.21.15.59:0/1832497483 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f049801a070 con 0x7f04b00b0c00 2024-04-25T09:10:30.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04b9f17000 1 Processor -- start 2024-04-25T09:10:30.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04b9f17000 1 -- start start 2024-04-25T09:10:30.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04acc00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f048c066f60 0x7f048c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04acc00640 1 -- 172.21.15.59:0/1832497483 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f04980857c0 con 0x7f04b00b0c00 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04b4a00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f048c066f60 0x7f048c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04b9f17000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d7206b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04b9f17000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 0x564d72020d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04b9f17000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d72021670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04b9f17000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d71f07f40 con 0x564d72021290 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04b9f17000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d71e6f070 con 0x564d7206b5b0 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04b9f17000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d71df71a0 con 0x564d7206ac90 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04afe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d7206b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04afe00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d7206b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:46652/0 (socket says 172.21.15.59:46652) 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04a7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 0x564d72020d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.199+0000 7f04afe00640 1 -- 172.21.15.59:0/789556345 learned_addr learned my addr 172.21.15.59:0/789556345 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b4a00640 1 --2- 172.21.15.59:0/789556345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d72021670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04a7e00640 1 -- 172.21.15.59:0/789556345 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 msgr2=0x564d7206b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04a7e00640 1 --2- 172.21.15.59:0/789556345 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d7206b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04a7e00640 1 -- 172.21.15.59:0/789556345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 msgr2=0x564d72021670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04a7e00640 1 --2- 172.21.15.59:0/789556345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d72021670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04a7e00640 1 -- 172.21.15.59:0/789556345 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d71df5510 con 0x564d7206b5b0 2024-04-25T09:10:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04afe00640 1 --2- 172.21.15.59:0/789556345 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d7206b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:10:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b4a00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f048c066f60 0x7f048c069420 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f04a80ad000 tx=0x7f04a8004ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04a7e00640 1 --2- 172.21.15.59:0/789556345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 0x564d72020d50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f049800e8b0 tx=0x7f0498055d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5fe1d21245f1668 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04a4c00640 1 -- 172.21.15.59:0/789556345 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049806d020 con 0x564d7206b5b0 2024-04-25T09:10:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04a4c00640 1 -- 172.21.15.59:0/789556345 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0498054080 con 0x564d7206b5b0 2024-04-25T09:10:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04a4c00640 1 -- 172.21.15.59:0/789556345 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498021040 con 0x564d7206b5b0 2024-04-25T09:10:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 -- 172.21.15.59:0/789556345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 msgr2=0x564d72020d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 --2- 172.21.15.59:0/789556345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 0x564d72020d50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f049800e8b0 tx=0x7f0498055d80 comp rx=0 tx=0).stop 2024-04-25T09:10:30.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 -- 172.21.15.59:0/789556345 shutdown_connections 2024-04-25T09:10:30.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 --2- 172.21.15.59:0/789556345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d72021670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 --2- 172.21.15.59:0/789556345 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 0x564d72020d50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 --2- 172.21.15.59:0/789556345 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d7206b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 -- 172.21.15.59:0/789556345 >> 172.21.15.59:0/789556345 conn(0x564d7201d240 msgr2=0x564d7201f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 -- 172.21.15.59:0/789556345 shutdown_connections 2024-04-25T09:10:30.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 -- 172.21.15.59:0/789556345 wait complete. 2024-04-25T09:10:30.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 -- start start 2024-04-25T09:10:30.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 Processor -- start 2024-04-25T09:10:30.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d72021290 0x564d7202be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206ac90 0x564d7202c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d7206b5b0 0x564d7202c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d71e296c0 con 0x564d7206b5b0 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d71e6b110 con 0x564d7206ac90 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d7202a200 con 0x564d72021290 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b9f17000 10 client.0 _ll_register_callbacks cb 0x564d7200c570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.203+0000 7f04b4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d7206b5b0 0x564d7202c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b4a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d7206b5b0 0x564d7202c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42394/0 (socket says 172.21.15.59:42394) 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b4a00640 1 -- 172.21.15.59:0/532915829 learned_addr learned my addr 172.21.15.59:0/532915829 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04afe00640 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d72021290 0x564d7202be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04a7e00640 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206ac90 0x564d7202c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b4a00640 1 -- 172.21.15.59:0/532915829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d72021290 msgr2=0x564d7202be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b4a00640 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d72021290 0x564d7202be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b4a00640 1 -- 172.21.15.59:0/532915829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206ac90 msgr2=0x564d7202c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b4a00640 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206ac90 0x564d7202c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b4a00640 1 -- 172.21.15.59:0/532915829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d71df73b0 con 0x564d7206b5b0 2024-04-25T09:10:30.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04a7e00640 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206ac90 0x564d7202c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b4a00640 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d7206b5b0 0x564d7202c8b0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f04a801cc70 tx=0x7f04a801af40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e2168e0ee8fe6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f049d600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f049d600640 1 -- 172.21.15.59:0/532915829 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a80b8040 con 0x564d7206b5b0 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f049d600640 1 -- 172.21.15.59:0/532915829 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f04a80bfc80 con 0x564d7206b5b0 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 -- 172.21.15.59:0/532915829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0498054080 con 0x564d7206b5b0 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f049d600640 1 -- 172.21.15.59:0/532915829 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04a80cd050 con 0x564d7206b5b0 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 10 client.8733 fetch_fsmap learned FSMap version 93 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 -- 172.21.15.59:0/532915829 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x564d71ef0e00 con 0x564d7206b5b0 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f049d600640 1 -- 172.21.15.59:0/532915829 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0498054080 con 0x564d7206b5b0 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f049d600640 1 -- 172.21.15.59:0/532915829 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f04a80d0020 con 0x564d7206b5b0 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 10 client.8733 fetch_fsmap finished waiting for FSMap version 93 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 10 client.8733 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 20 client.8733 populate_metadata read hostname 'smithi059' 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x564d7202d180 0x564d7207c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 4 client.8733 mds_command: new command op to 8646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:30.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 -- 172.21.15.59:0/532915829 --> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d71e0ad60 con 0x564d7202d180 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04afe00640 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x564d7202d180 0x564d7207c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f049d600640 10 client.8733 ms_handle_connect on v2:172.21.15.59:6833/2009305668 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04afe00640 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x564d7202d180 0x564d7207c410 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6b65f4e838076fb server_cookie=ac602b3589eb9bf8 in_seq=0 out_seq=0 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f049d600640 1 -- 172.21.15.59:0/532915829 <== mds.0 v2:172.21.15.59:6833/2009305668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564d71e0ad60 con 0x564d7202d180 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f049d600640 10 client.8733 handle_command_reply: tid=0 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 client.8733 shutdown 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 -- 172.21.15.59:0/532915829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d7206b5b0 msgr2=0x564d7202c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d7206b5b0 0x564d7202c8b0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f04a801cc70 tx=0x7f04a801af40 comp rx=0 tx=0).stop 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 -- 172.21.15.59:0/532915829 shutdown_connections 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x564d7202d180 0x564d7207c410 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d7206b5b0 0x564d7202c8b0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206ac90 0x564d7202c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 --2- 172.21.15.59:0/532915829 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d72021290 0x564d7202be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 -- 172.21.15.59:0/532915829 >> 172.21.15.59:0/532915829 conn(0x564d7201d240 msgr2=0x564d7201fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f049d600640 0 client.8733 ms_handle_reset on v2:172.21.15.59:6833/2009305668 2024-04-25T09:10:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 -- 172.21.15.59:0/532915829 shutdown_connections 2024-04-25T09:10:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.207+0000 7f04b9f17000 1 -- 172.21.15.59:0/532915829 wait complete. 2024-04-25T09:10:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.211+0000 7f04b9f17000 20 client.8733 trim_cache size 0 max 16384 2024-04-25T09:10:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f122ae00640 1 Processor -- start 2024-04-25T09:10:30.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f122ae00640 1 -- start start 2024-04-25T09:10:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f122ae00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f122406ac10 0x7f12240cd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f122ae00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12240c69a0 0x7f12240c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f122ae00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12240c7030 con 0x7f12240b2760 2024-04-25T09:10:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f122ae00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12240c7310 con 0x7f12240c69a0 2024-04-25T09:10:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f122ae00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12240cd440 con 0x7f122406ac10 2024-04-25T09:10:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f1229000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f12240b2760 0x7f122406aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:58908/0 (socket says 172.21.15.59:58908) 2024-04-25T09:10:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f1229000640 1 -- 172.21.15.59:0/719802263 learned_addr learned my addr 172.21.15.59:0/719802263 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:10:30.204 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f122a400640 1 --2- 172.21.15.59:0/719802263 >> v2:172.21.15.59:3300/0 conn(0x7f12240c69a0 0x7f12240c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f1229a00640 1 --2- 172.21.15.59:0/719802263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f122406ac10 0x7f12240cd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f1223e00640 1 -- 172.21.15.59:0/719802263 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234307824 0 0) 0x7f12240c7030 con 0x7f12240b2760 2024-04-25T09:10:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f1223e00640 1 -- 172.21.15.59:0/719802263 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f120c003530 con 0x7f12240b2760 2024-04-25T09:10:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f122a400640 1 -- 172.21.15.59:0/719802263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f122406ac10 msgr2=0x7f12240cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f122a400640 1 --2- 172.21.15.59:0/719802263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f122406ac10 0x7f12240cd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f122a400640 1 -- 172.21.15.59:0/719802263 >> v1:172.21.15.59:6789/0 conn(0x7f12240b2760 legacy=0x7f122406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f122a400640 1 -- 172.21.15.59:0/719802263 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12240ccdf0 con 0x7f12240c69a0 2024-04-25T09:10:30.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.215+0000 7f1229a00640 1 --2- 172.21.15.59:0/719802263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f122406ac10 0x7f12240cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.219+0000 7f122a400640 1 --2- 172.21.15.59:0/719802263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12240c69a0 0x7f12240c52c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f121c009d90 tx=0x7f121c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fa8c44d834894e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.219+0000 7f1223e00640 1 -- 172.21.15.59:0/719802263 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c0b2070 con 0x7f12240c69a0 2024-04-25T09:10:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.219+0000 7f1223e00640 1 -- 172.21.15.59:0/719802263 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c0a57e0 con 0x7f12240c69a0 2024-04-25T09:10:30.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.219+0000 7f1223e00640 1 -- 172.21.15.59:0/719802263 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c0a5b90 con 0x7f12240c69a0 2024-04-25T09:10:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.219+0000 7f122ae00640 1 -- 172.21.15.59:0/719802263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12240c69a0 msgr2=0x7f12240c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.219+0000 7f122ae00640 1 --2- 172.21.15.59:0/719802263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12240c69a0 0x7f12240c52c0 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f121c009d90 tx=0x7f121c01c850 comp rx=0 tx=0).stop 2024-04-25T09:10:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.219+0000 7f122ae00640 1 -- 172.21.15.59:0/719802263 shutdown_connections 2024-04-25T09:10:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.219+0000 7f122ae00640 1 --2- 172.21.15.59:0/719802263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12240c69a0 0x7f12240c52c0 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.219+0000 7f122ae00640 1 --2- 172.21.15.59:0/719802263 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f122406ac10 0x7f12240cd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.219+0000 7f122ae00640 1 -- 172.21.15.59:0/719802263 >> 172.21.15.59:0/719802263 conn(0x7f1224099a60 msgr2=0x7f12240b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.219+0000 7f122ae00640 1 -- 172.21.15.59:0/719802263 shutdown_connections 2024-04-25T09:10:30.209 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.219+0000 7f122ae00640 1 -- 172.21.15.59:0/719802263 wait complete. 2024-04-25T09:10:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122ae00640 1 Processor -- start 2024-04-25T09:10:30.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122ae00640 1 -- start start 2024-04-25T09:10:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122ae00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122406ac10 0x7f12240b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122ae00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12240b2760 0x7f12240ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122ae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12240c69a0 0x7f12240c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122ae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122416a500 con 0x7f12240c69a0 2024-04-25T09:10:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122ae00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1224161180 con 0x7f122406ac10 2024-04-25T09:10:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122ae00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122416a680 con 0x7f12240b2760 2024-04-25T09:10:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12240c69a0 0x7f12240c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12240c69a0 0x7f12240c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42420/0 (socket says 172.21.15.59:42420) 2024-04-25T09:10:30.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122a400640 1 -- 172.21.15.59:0/4176714492 learned_addr learned my addr 172.21.15.59:0/4176714492 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122a400640 1 -- 172.21.15.59:0/4176714492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12240b2760 msgr2=0x7f12240ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122a400640 1 --2- 172.21.15.59:0/4176714492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f12240b2760 0x7f12240ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122a400640 1 -- 172.21.15.59:0/4176714492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122406ac10 msgr2=0x7f12240b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122a400640 1 --2- 172.21.15.59:0/4176714492 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f122406ac10 0x7f12240b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122a400640 1 -- 172.21.15.59:0/4176714492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12240b5a20 con 0x7f12240c69a0 2024-04-25T09:10:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122a400640 1 --2- 172.21.15.59:0/4176714492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12240c69a0 0x7f12240c8620 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f121c0b0040 tx=0x7f121c0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f1221600640 1 -- 172.21.15.59:0/4176714492 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c0b2050 con 0x7f12240c69a0 2024-04-25T09:10:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f1221600640 1 -- 172.21.15.59:0/4176714492 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c0be070 con 0x7f12240c69a0 2024-04-25T09:10:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f1221600640 1 -- 172.21.15.59:0/4176714492 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c0ad850 con 0x7f12240c69a0 2024-04-25T09:10:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122ae00640 1 -- 172.21.15.59:0/4176714492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12240b5d00 con 0x7f12240c69a0 2024-04-25T09:10:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f122ae00640 1 -- 172.21.15.59:0/4176714492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12240b3cd0 con 0x7f12240c69a0 2024-04-25T09:10:30.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.223+0000 7f1216a00640 1 -- 172.21.15.59:0/4176714492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f11f8005280 con 0x7f12240c69a0 2024-04-25T09:10:30.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f1221600640 1 -- 172.21.15.59:0/4176714492 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f121c0ad9f0 con 0x7f12240c69a0 2024-04-25T09:10:30.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f1221600640 1 --2- 172.21.15.59:0/4176714492 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1204066f60 0x7f1204069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f1221600640 1 -- 172.21.15.59:0/4176714492 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f121c120ce0 con 0x7f12240c69a0 2024-04-25T09:10:30.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f1221600640 1 -- 172.21.15.59:0/4176714492 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+514 (secure 0 0 0) 0x7f121c016560 con 0x7f12240c69a0 2024-04-25T09:10:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f1216a00640 1 -- 172.21.15.59:0/4176714492 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f11f8005560 con 0x7f12240c69a0 2024-04-25T09:10:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f1229a00640 1 --2- 172.21.15.59:0/4176714492 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1204066f60 0x7f1204069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f1221600640 1 -- 172.21.15.59:0/4176714492 <== mon.0 v2:172.21.15.59:3300/0 7 ==== log(2 entries from seq 1085 at 2024-04-25T09:10:28.445368+0000) v1 ==== 389+0+0 (secure 0 0 0) 0x7f121c0ef460 con 0x7f12240c69a0 2024-04-25T09:10:30.216 INFO:teuthology.orchestra.run.smithi059.stdout: cluster: 2024-04-25T09:10:30.216 INFO:teuthology.orchestra.run.smithi059.stdout: id: fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:10:30.216 INFO:teuthology.orchestra.run.smithi059.stdout: health: HEALTH_OK 2024-04-25T09:10:30.216 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:30.216 INFO:teuthology.orchestra.run.smithi059.stdout: services: 2024-04-25T09:10:30.216 INFO:teuthology.orchestra.run.smithi059.stdout: mon: 3 daemons, quorum a,b,c (age 9m) 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: mgr: x(active, since 9m), standbys: y 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: mds: 1/1 daemons up, 3 standby 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: data: 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: volumes: 1/1 healthy 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: pools: 3 pools, 97 pgs 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: objects: 30 objects, 19 MiB 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: usage: 291 MiB used, 720 GiB / 720 GiB avail 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: pgs: 97 active+clean 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: io: 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: client: 1.2 KiB/s rd, 1.8 MiB/s wr, 1 op/s rd, 5 op/s wr 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:30.217 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:10:30.218 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:10:28.445368+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-25T09:10:30.218 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:10:28.445393+0000 mon.a [INF] Cluster is now healthy 2024-04-25T09:10:30.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f1229a00640 1 --2- 172.21.15.59:0/4176714492 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1204066f60 0x7f1204069420 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f1218006f10 tx=0x7f1218008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f04b9f17000 1 Processor -- start 2024-04-25T09:10:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f04b9f17000 1 -- start start 2024-04-25T09:10:30.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f04b9f17000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d72020640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f04b9f17000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d72020b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f04b9f17000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 0x564d7207c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f04b9f17000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b02035d0 con 0x564d72021290 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f04b9f17000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b02027e0 con 0x564d7206b5b0 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f04b9f17000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b014ee50 con 0x564d7206ac90 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.227+0000 7f04afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d72020640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d72020640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42426/0 (socket says 172.21.15.59:42426) 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04afe00640 1 -- 172.21.15.59:0/2353435334 learned_addr learned my addr 172.21.15.59:0/2353435334 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b4a00640 1 --2- 172.21.15.59:0/2353435334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 0x564d7207c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04a7e00640 1 --2- 172.21.15.59:0/2353435334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d72020b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04afe00640 1 -- 172.21.15.59:0/2353435334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 msgr2=0x564d72020b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04afe00640 1 --2- 172.21.15.59:0/2353435334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d72020b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04afe00640 1 -- 172.21.15.59:0/2353435334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 msgr2=0x564d7207c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04afe00640 1 --2- 172.21.15.59:0/2353435334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 0x564d7207c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04afe00640 1 -- 172.21.15.59:0/2353435334 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d71ec6c50 con 0x564d72021290 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04afe00640 1 --2- 172.21.15.59:0/2353435334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d72020640 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009d70 tx=0x7f04a0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a24415b3bee2a6c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f049fe00640 1 -- 172.21.15.59:0/2353435334 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0022070 con 0x564d72021290 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f049fe00640 1 -- 172.21.15.59:0/2353435334 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a0003c40 con 0x564d72021290 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f049fe00640 1 -- 172.21.15.59:0/2353435334 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a001eb70 con 0x564d72021290 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 -- 172.21.15.59:0/2353435334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 msgr2=0x564d72020640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 --2- 172.21.15.59:0/2353435334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d72020640 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009d70 tx=0x7f04a0008040 comp rx=0 tx=0).stop 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 -- 172.21.15.59:0/2353435334 shutdown_connections 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 --2- 172.21.15.59:0/2353435334 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 0x564d7207c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 --2- 172.21.15.59:0/2353435334 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d72020b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 --2- 172.21.15.59:0/2353435334 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d72020640 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 -- 172.21.15.59:0/2353435334 >> 172.21.15.59:0/2353435334 conn(0x564d7201d240 msgr2=0x564d72025d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 -- 172.21.15.59:0/2353435334 shutdown_connections 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 -- 172.21.15.59:0/2353435334 wait complete. 2024-04-25T09:10:30.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 -- start start 2024-04-25T09:10:30.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 Processor -- start 2024-04-25T09:10:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d7207e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d7208f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 0x564d7208fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d72026b70 con 0x564d72021290 2024-04-25T09:10:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b02021e0 con 0x564d7206b5b0 2024-04-25T09:10:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d71e11bd0 con 0x564d7206ac90 2024-04-25T09:10:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04b9f17000 10 client.0 _ll_register_callbacks cb 0x7f0498052020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d7207e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04afe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d7207e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42438/0 (socket says 172.21.15.59:42438) 2024-04-25T09:10:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.231+0000 7f04afe00640 1 -- 172.21.15.59:0/502019674 learned_addr learned my addr 172.21.15.59:0/502019674 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04afe00640 1 -- 172.21.15.59:0/502019674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 msgr2=0x564d7208f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04afe00640 1 --2- 172.21.15.59:0/502019674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d7208f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04afe00640 1 -- 172.21.15.59:0/502019674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 msgr2=0x564d7208fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04afe00640 1 --2- 172.21.15.59:0/502019674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 0x564d7208fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04afe00640 1 -- 172.21.15.59:0/502019674 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d71e37120 con 0x564d72021290 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04afe00640 1 --2- 172.21.15.59:0/502019674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d7207e580 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x564d71e70510 tx=0x7f04a80a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a56b4d7239a86fd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f049d600640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f049d600640 1 -- 172.21.15.59:0/502019674 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0022070 con 0x564d72021290 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f049d600640 1 -- 172.21.15.59:0/502019674 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f04a0027450 con 0x564d72021290 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 -- 172.21.15.59:0/502019674 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04a0003c40 con 0x564d72021290 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f049d600640 1 -- 172.21.15.59:0/502019674 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04a0035050 con 0x564d72021290 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 10 client.8748 fetch_fsmap learned FSMap version 93 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 -- 172.21.15.59:0/502019674 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x564d71e16170 con 0x564d72021290 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f049d600640 1 -- 172.21.15.59:0/502019674 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a0003c40 con 0x564d72021290 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f049d600640 1 -- 172.21.15.59:0/502019674 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f04a0038020 con 0x564d72021290 2024-04-25T09:10:30.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 10 client.8748 fetch_fsmap finished waiting for FSMap version 93 2024-04-25T09:10:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 10 client.8748 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:10:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 20 client.8748 populate_metadata read hostname 'smithi059' 2024-04-25T09:10:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 --2- 172.21.15.59:0/502019674 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x564d72090170 0x564d720d3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 4 client.8748 mds_command: new command op to 8646 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-25T09:10:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 -- 172.21.15.59:0/502019674 --> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x564d71e7c5b0 con 0x564d72090170 2024-04-25T09:10:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04a7e00640 1 --2- 172.21.15.59:0/502019674 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x564d72090170 0x564d720d3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04a7e00640 1 --2- 172.21.15.59:0/502019674 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x564d72090170 0x564d720d3990 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fef24d41af96f2ba server_cookie=b2e9406793645920 in_seq=0 out_seq=0 2024-04-25T09:10:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f049d600640 10 client.8748 ms_handle_connect on v2:172.21.15.59:6833/2009305668 2024-04-25T09:10:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f049d600640 1 -- 172.21.15.59:0/502019674 <== mds.0 v2:172.21.15.59:6833/2009305668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564d71e7c5b0 con 0x564d72090170 2024-04-25T09:10:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f049d600640 10 client.8748 handle_command_reply: tid=0 2024-04-25T09:10:30.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 client.8748 shutdown 2024-04-25T09:10:30.228 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f75ab200640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-25T09:10:30.228 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f75ab200640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-25T09:10:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 -- 172.21.15.59:0/502019674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 msgr2=0x564d7207e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 --2- 172.21.15.59:0/502019674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d7207e580 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x564d71e70510 tx=0x7f04a80a9000 comp rx=0 tx=0).stop 2024-04-25T09:10:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 -- 172.21.15.59:0/502019674 shutdown_connections 2024-04-25T09:10:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 --2- 172.21.15.59:0/502019674 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x564d72090170 0x564d720d3990 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 --2- 172.21.15.59:0/502019674 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x564d7206b5b0 0x564d7208fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 --2- 172.21.15.59:0/502019674 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x564d7206ac90 0x564d7208f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 --2- 172.21.15.59:0/502019674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x564d72021290 0x564d7207e580 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 -- 172.21.15.59:0/502019674 >> 172.21.15.59:0/502019674 conn(0x564d7201d240 msgr2=0x564d7201f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f049d600640 0 client.8748 ms_handle_reset on v2:172.21.15.59:6833/2009305668 2024-04-25T09:10:30.229 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f75ab200640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-25T09:10:30.229 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f75ab200640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-25T09:10:30.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 -- 172.21.15.59:0/502019674 shutdown_connections 2024-04-25T09:10:30.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 1 -- 172.21.15.59:0/502019674 wait complete. 2024-04-25T09:10:30.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.235+0000 7f04b9f17000 20 client.8748 trim_cache size 0 max 16384 2024-04-25T09:10:30.230 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:10:30.230 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0, 2024-04-25T09:10:30.231 INFO:teuthology.orchestra.run.smithi059.stdout: "scrub_tag": "d190e574-829a-4c7f-8d3d-ebfbf5ca5a36", 2024-04-25T09:10:30.231 INFO:teuthology.orchestra.run.smithi059.stdout: "mode": "asynchronous" 2024-04-25T09:10:30.231 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:10:30.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.239+0000 7f04b6a00640 1 -- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f048c066f60 msgr2=0x7f048c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.239+0000 7f04b6a00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f048c066f60 0x7f048c069420 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f04a80ad000 tx=0x7f04a8004ac0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.239+0000 7f04b6a00640 1 -- 172.21.15.59:0/1832497483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00b0c00 msgr2=0x7f04b0160a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.239+0000 7f04b6a00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00b0c00 0x7f04b0160a80 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f049800e8e0 tx=0x7f049800eda0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.239+0000 7f04b6a00640 1 -- 172.21.15.59:0/1832497483 shutdown_connections 2024-04-25T09:10:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.239+0000 7f04b6a00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f048c066f60 0x7f048c069420 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.239+0000 7f04b6a00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f04b015dab0 0x7f04b015e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.239+0000 7f04b6a00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00b0c00 0x7f04b0160a80 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.239+0000 7f04b6a00640 1 --2- 172.21.15.59:0/1832497483 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f04b00711f0 0x7f04b01549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.239+0000 7f04b6a00640 1 -- 172.21.15.59:0/1832497483 >> 172.21.15.59:0/1832497483 conn(0x7f04b006f510 msgr2=0x7f04b01612d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.239+0000 7f04b6a00640 1 -- 172.21.15.59:0/1832497483 shutdown_connections 2024-04-25T09:10:30.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.239+0000 7f04b6a00640 1 -- 172.21.15.59:0/1832497483 wait complete. 2024-04-25T09:10:30.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:10:30.246 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:10:30.388 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.399+0000 7f80e7e00640 1 Processor -- start 2024-04-25T09:10:30.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.399+0000 7f80e7e00640 1 -- start start 2024-04-25T09:10:30.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.399+0000 7f80e7e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f80e806c730 0x7f80e815ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.399+0000 7f80e7e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e806cb10 0x7f80e8161590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.399+0000 7f80e7e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e815ef90 con 0x7f80e8161ad0 2024-04-25T09:10:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.399+0000 7f80e7e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e809a9e0 con 0x7f80e806c730 2024-04-25T09:10:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.399+0000 7f80e7e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e809ae70 con 0x7f80e806cb10 2024-04-25T09:10:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.403+0000 7f80e6a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f80e806c730 0x7f80e815ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.403+0000 7f80de000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e806cb10 0x7f80e8161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.403+0000 7f80e6a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f80e806c730 0x7f80e815ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:47798/0 (socket says 172.21.15.59:47798) 2024-04-25T09:10:30.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.403+0000 7f80e6a00640 1 -- 172.21.15.59:0/4141962903 learned_addr learned my addr 172.21.15.59:0/4141962903 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.403+0000 7f80e6a00640 1 -- 172.21.15.59:0/4141962903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e806cb10 msgr2=0x7f80e8161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.403+0000 7f80e6a00640 1 --2- 172.21.15.59:0/4141962903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e806cb10 0x7f80e8161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.403+0000 7f80e6a00640 1 -- 172.21.15.59:0/4141962903 >> v1:172.21.15.178:6789/0 conn(0x7f80e8161ad0 legacy=0x7f80e80cf780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.403+0000 7f80e6a00640 1 -- 172.21.15.59:0/4141962903 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8099dd0 con 0x7f80e806c730 2024-04-25T09:10:30.393 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.403+0000 7f80e6a00640 1 --2- 172.21.15.59:0/4141962903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e806c730 0x7f80e815ea50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009870 tx=0x7f80d801c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b1a9a6452b3208a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.403+0000 7f80e6000640 1 -- 172.21.15.59:0/4141962903 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d80a95f0 con 0x7f80e806c730 2024-04-25T09:10:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.403+0000 7f80e6000640 1 -- 172.21.15.59:0/4141962903 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d80a9790 con 0x7f80e806c730 2024-04-25T09:10:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.403+0000 7f80e6000640 1 -- 172.21.15.59:0/4141962903 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d80a9b60 con 0x7f80e806c730 2024-04-25T09:10:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 -- 172.21.15.59:0/4141962903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e806c730 msgr2=0x7f80e815ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 --2- 172.21.15.59:0/4141962903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e806c730 0x7f80e815ea50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f80d8009870 tx=0x7f80d801c530 comp rx=0 tx=0).stop 2024-04-25T09:10:30.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 -- 172.21.15.59:0/4141962903 shutdown_connections 2024-04-25T09:10:30.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 --2- 172.21.15.59:0/4141962903 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e806cb10 0x7f80e8161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 --2- 172.21.15.59:0/4141962903 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e806c730 0x7f80e815ea50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 -- 172.21.15.59:0/4141962903 >> 172.21.15.59:0/4141962903 conn(0x7f80e80b3030 msgr2=0x7f80e80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 -- 172.21.15.59:0/4141962903 shutdown_connections 2024-04-25T09:10:30.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 -- 172.21.15.59:0/4141962903 wait complete. 2024-04-25T09:10:30.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 Processor -- start 2024-04-25T09:10:30.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 -- start start 2024-04-25T09:10:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e806c730 0x7f80e809bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e806cb10 0x7f80e815c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80e8161ad0 0x7f80e815cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e81622f0 con 0x7f80e8161ad0 2024-04-25T09:10:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e815de20 con 0x7f80e806c730 2024-04-25T09:10:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8099a60 con 0x7f80e806cb10 2024-04-25T09:10:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80e8161ad0 0x7f80e815cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80e8161ad0 0x7f80e815cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42446/0 (socket says 172.21.15.59:42446) 2024-04-25T09:10:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7400640 1 -- 172.21.15.59:0/3380942845 learned_addr learned my addr 172.21.15.59:0/3380942845 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e6a00640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e806c730 0x7f80e809bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.398 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80de000640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e806cb10 0x7f80e815c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7400640 1 -- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e806cb10 msgr2=0x7f80e815c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.407+0000 7f80e7400640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e806cb10 0x7f80e815c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.411+0000 7f80e7400640 1 -- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e806c730 msgr2=0x7f80e809bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.411+0000 7f80e7400640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e806c730 0x7f80e809bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.411+0000 7f80e7400640 1 -- 172.21.15.59:0/3380942845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80b41d0 con 0x7f80e8161ad0 2024-04-25T09:10:30.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.411+0000 7f80e7400640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80e8161ad0 0x7f80e815cb70 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c770 tx=0x7f80e000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.411+0000 7f80df400640 1 -- 172.21.15.59:0/3380942845 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0003b80 con 0x7f80e8161ad0 2024-04-25T09:10:30.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.411+0000 7f80df400640 1 -- 172.21.15.59:0/3380942845 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e0003d20 con 0x7f80e8161ad0 2024-04-25T09:10:30.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.411+0000 7f80e7e00640 1 -- 172.21.15.59:0/3380942845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e80b44b0 con 0x7f80e8161ad0 2024-04-25T09:10:30.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.411+0000 7f80df400640 1 -- 172.21.15.59:0/3380942845 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000aa90 con 0x7f80e8161ad0 2024-04-25T09:10:30.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.411+0000 7f80e7e00640 1 -- 172.21.15.59:0/3380942845 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e80b4a70 con 0x7f80e8161ad0 2024-04-25T09:10:30.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.411+0000 7f80df400640 1 -- 172.21.15.59:0/3380942845 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f80e000ac30 con 0x7f80e8161ad0 2024-04-25T09:10:30.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.411+0000 7f80df400640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f80c4066f90 0x7f80c4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.411+0000 7f80df400640 1 -- 172.21.15.59:0/3380942845 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f80e00850b0 con 0x7f80e8161ad0 2024-04-25T09:10:30.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80e6a00640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f80c4066f90 0x7f80c4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 Processor -- start 2024-04-25T09:10:30.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 -- start start 2024-04-25T09:10:30.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80e6a00640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f80c4066f90 0x7f80c4069450 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f80d80ae000 tx=0x7f80d80b3040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f9659d0 0x55dd6f965db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9662f0 0x55dd6f91bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 0x55dd6f91c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6f768ff0 con 0x55dd6f91c0a0 2024-04-25T09:10:30.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6f6f1150 con 0x55dd6f9662f0 2024-04-25T09:10:30.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd6f765090 con 0x55dd6f9659d0 2024-04-25T09:10:30.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 0x55dd6f91c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 0x55dd6f91c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42462/0 (socket says 172.21.15.59:42462) 2024-04-25T09:10:30.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80e7400640 1 -- 172.21.15.59:0/3090334006 learned_addr learned my addr 172.21.15.59:0/3090334006 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80e6a00640 1 --2- 172.21.15.59:0/3090334006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f9659d0 0x55dd6f965db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80de000640 1 --2- 172.21.15.59:0/3090334006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9662f0 0x55dd6f91bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80e7400640 1 -- 172.21.15.59:0/3090334006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f9659d0 msgr2=0x55dd6f965db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80e7400640 1 --2- 172.21.15.59:0/3090334006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f9659d0 0x55dd6f965db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80e7400640 1 -- 172.21.15.59:0/3090334006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9662f0 msgr2=0x55dd6f91bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80e7400640 1 --2- 172.21.15.59:0/3090334006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9662f0 0x55dd6f91bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80e7400640 1 -- 172.21.15.59:0/3090334006 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd6f8ff0d0 con 0x55dd6f91c0a0 2024-04-25T09:10:30.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80e7400640 1 --2- 172.21.15.59:0/3090334006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 0x55dd6f91c480 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f80e005d8e0 tx=0x7f80e00551d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bdbc7d304ca20d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80d7400640 1 -- 172.21.15.59:0/3090334006 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e006d1d0 con 0x55dd6f91c0a0 2024-04-25T09:10:30.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80d7400640 1 -- 172.21.15.59:0/3090334006 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e0053ab0 con 0x55dd6f91c0a0 2024-04-25T09:10:30.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80d7400640 1 -- 172.21.15.59:0/3090334006 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0054c00 con 0x55dd6f91c0a0 2024-04-25T09:10:30.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3090334006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 msgr2=0x55dd6f91c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/3090334006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 0x55dd6f91c480 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f80e005d8e0 tx=0x7f80e00551d0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3090334006 shutdown_connections 2024-04-25T09:10:30.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/3090334006 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 0x55dd6f91c480 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/3090334006 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9662f0 0x55dd6f91bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/3090334006 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f9659d0 0x55dd6f965db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3090334006 >> 172.21.15.59:0/3090334006 conn(0x55dd6f918020 msgr2=0x55dd6f91a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3090334006 shutdown_connections 2024-04-25T09:10:30.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3090334006 wait complete. 2024-04-25T09:10:30.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.415+0000 7f80f0fe7000 1 -- start start 2024-04-25T09:10:30.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 1 Processor -- start 2024-04-25T09:10:30.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f91c0a0 0x55dd6f94a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9659d0 0x55dd6f94ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9662f0 0x55dd6f94b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6f72d250 con 0x55dd6f9662f0 2024-04-25T09:10:30.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6f723690 con 0x55dd6f9659d0 2024-04-25T09:10:30.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd6f6f1a40 con 0x55dd6f91c0a0 2024-04-25T09:10:30.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 10 client.0 _ll_register_callbacks cb 0x55dd6f906e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:30.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9662f0 0x55dd6f94b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80e7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9662f0 0x55dd6f94b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:42474/0 (socket says 172.21.15.59:42474) 2024-04-25T09:10:30.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80e7400640 1 -- 172.21.15.59:0/3731992701 learned_addr learned my addr 172.21.15.59:0/3731992701 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80e6a00640 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f91c0a0 0x55dd6f94a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80de000640 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9659d0 0x55dd6f94ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80e7400640 1 -- 172.21.15.59:0/3731992701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f91c0a0 msgr2=0x55dd6f94a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80e7400640 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f91c0a0 0x55dd6f94a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80e7400640 1 -- 172.21.15.59:0/3731992701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9659d0 msgr2=0x55dd6f94ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80e7400640 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9659d0 0x55dd6f94ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80e7400640 1 -- 172.21.15.59:0/3731992701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd6f8161c0 con 0x55dd6f9662f0 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80de000640 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9659d0 0x55dd6f94ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80e7400640 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9662f0 0x55dd6f94b270 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f80e0055740 tx=0x7f80e0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3afa7f6c3b9e1aa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80cbe00640 1 -- 172.21.15.59:0/3731992701 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0073b40 con 0x55dd6f9662f0 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80cbe00640 1 -- 172.21.15.59:0/3731992701 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f80e0073ce0 con 0x55dd6f9662f0 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3731992701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f80e0053ab0 con 0x55dd6f9662f0 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80cbe00640 1 -- 172.21.15.59:0/3731992701 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80e0054c00 con 0x55dd6f9662f0 2024-04-25T09:10:30.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 10 client.8757 fetch_fsmap learned FSMap version 93 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3731992701 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55dd6f812170 con 0x55dd6f9662f0 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80cbe00640 1 -- 172.21.15.59:0/3731992701 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e0053ab0 con 0x55dd6f9662f0 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80cbe00640 1 -- 172.21.15.59:0/3731992701 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f80e0054da0 con 0x55dd6f9662f0 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 10 client.8757 fetch_fsmap finished waiting for FSMap version 93 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 10 client.8757 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 20 client.8757 populate_metadata read hostname 'smithi059' 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55dd6f975c80 0x55dd6f978070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 4 client.8757 mds_command: new command op to 8646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3731992701 --> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd6f704c60 con 0x55dd6f975c80 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80e6a00640 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55dd6f975c80 0x55dd6f978070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80cbe00640 10 client.8757 ms_handle_connect on v2:172.21.15.59:6833/2009305668 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.419+0000 7f80e6a00640 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55dd6f975c80 0x55dd6f978070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89031221ad2cba44 server_cookie=c308007d7893b552 in_seq=0 out_seq=0 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80cbe00640 1 -- 172.21.15.59:0/3731992701 <== mds.0 v2:172.21.15.59:6833/2009305668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dd6f704c60 con 0x55dd6f975c80 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80cbe00640 10 client.8757 handle_command_reply: tid=0 2024-04-25T09:10:30.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80f0fe7000 1 client.8757 shutdown 2024-04-25T09:10:30.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3731992701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9662f0 msgr2=0x55dd6f94b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9662f0 0x55dd6f94b270 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f80e0055740 tx=0x7f80e0001260 comp rx=0 tx=0).stop 2024-04-25T09:10:30.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3731992701 shutdown_connections 2024-04-25T09:10:30.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55dd6f975c80 0x55dd6f978070 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9662f0 0x55dd6f94b270 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9659d0 0x55dd6f94ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80cbe00640 0 client.8757 ms_handle_reset on v2:172.21.15.59:6833/2009305668 2024-04-25T09:10:30.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/3731992701 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f91c0a0 0x55dd6f94a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3731992701 >> 172.21.15.59:0/3731992701 conn(0x55dd6f918020 msgr2=0x55dd6f91aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3731992701 shutdown_connections 2024-04-25T09:10:30.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80f0fe7000 1 -- 172.21.15.59:0/3731992701 wait complete. 2024-04-25T09:10:30.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.423+0000 7f80f0fe7000 20 client.8757 trim_cache size 0 max 16384 2024-04-25T09:10:30.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.435+0000 7f80f0fe7000 1 Processor -- start 2024-04-25T09:10:30.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.435+0000 7f80f0fe7000 1 -- start start 2024-04-25T09:10:30.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 0x55dd6f9c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9659d0 0x55dd6f9c2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f9662f0 0x55dd6f9c2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8203560 con 0x55dd6f91c0a0 2024-04-25T09:10:30.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8202790 con 0x55dd6f9659d0 2024-04-25T09:10:30.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e809e4f0 con 0x55dd6f9662f0 2024-04-25T09:10:30.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80e6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 0x55dd6f9c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80e6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 0x55dd6f9c1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33470/0 (socket says 172.21.15.59:33470) 2024-04-25T09:10:30.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80e6a00640 1 -- 172.21.15.59:0/528701926 learned_addr learned my addr 172.21.15.59:0/528701926 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80e7400640 1 --2- 172.21.15.59:0/528701926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f9662f0 0x55dd6f9c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80de000640 1 --2- 172.21.15.59:0/528701926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9659d0 0x55dd6f9c2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80e6a00640 1 -- 172.21.15.59:0/528701926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f9662f0 msgr2=0x55dd6f9c2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80e6a00640 1 --2- 172.21.15.59:0/528701926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f9662f0 0x55dd6f9c2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80e6a00640 1 -- 172.21.15.59:0/528701926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9659d0 msgr2=0x55dd6f9c2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80e6a00640 1 --2- 172.21.15.59:0/528701926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9659d0 0x55dd6f9c2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80e6a00640 1 -- 172.21.15.59:0/528701926 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd6f7afde0 con 0x55dd6f91c0a0 2024-04-25T09:10:30.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80e7400640 1 --2- 172.21.15.59:0/528701926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f9662f0 0x55dd6f9c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:30.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80de000640 1 --2- 172.21.15.59:0/528701926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9659d0 0x55dd6f9c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:10:30.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80e6a00640 1 --2- 172.21.15.59:0/528701926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 0x55dd6f9c1ee0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f80d801ca10 tx=0x7f80d80a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52cb88159579b23d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80d6a00640 1 -- 172.21.15.59:0/528701926 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d80d4030 con 0x55dd6f91c0a0 2024-04-25T09:10:30.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80d6a00640 1 -- 172.21.15.59:0/528701926 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d80a9d00 con 0x55dd6f91c0a0 2024-04-25T09:10:30.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80d6a00640 1 -- 172.21.15.59:0/528701926 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d80cfe60 con 0x55dd6f91c0a0 2024-04-25T09:10:30.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 -- 172.21.15.59:0/528701926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 msgr2=0x55dd6f9c1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/528701926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 0x55dd6f9c1ee0 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f80d801ca10 tx=0x7f80d80a7000 comp rx=0 tx=0).stop 2024-04-25T09:10:30.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 -- 172.21.15.59:0/528701926 shutdown_connections 2024-04-25T09:10:30.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/528701926 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f9662f0 0x55dd6f9c2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/528701926 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9659d0 0x55dd6f9c2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/528701926 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f91c0a0 0x55dd6f9c1ee0 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 -- 172.21.15.59:0/528701926 >> 172.21.15.59:0/528701926 conn(0x55dd6f918020 msgr2=0x55dd6f964070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 -- 172.21.15.59:0/528701926 shutdown_connections 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 -- 172.21.15.59:0/528701926 wait complete. 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 -- start start 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.439+0000 7f80f0fe7000 1 Processor -- start 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f91c0a0 0x55dd6f978380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9659d0 0x55dd6f9788c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9662f0 0x55dd6f978e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6f703e00 con 0x55dd6f9659d0 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e8202270 con 0x55dd6f9662f0 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dd6f768300 con 0x55dd6f91c0a0 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 10 client.0 _ll_register_callbacks cb 0x55dd6f8e7040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80de000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9659d0 0x55dd6f9788c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80de000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9659d0 0x55dd6f9788c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33476/0 (socket says 172.21.15.59:33476) 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80de000640 1 -- 172.21.15.59:0/2829299893 learned_addr learned my addr 172.21.15.59:0/2829299893 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80e6a00640 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f91c0a0 0x55dd6f978380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80e7400640 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9662f0 0x55dd6f978e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80de000640 1 -- 172.21.15.59:0/2829299893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f91c0a0 msgr2=0x55dd6f978380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80de000640 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f91c0a0 0x55dd6f978380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80de000640 1 -- 172.21.15.59:0/2829299893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9662f0 msgr2=0x55dd6f978e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80de000640 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9662f0 0x55dd6f978e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80de000640 1 -- 172.21.15.59:0/2829299893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd6f70a8e0 con 0x55dd6f9659d0 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80de000640 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9659d0 0x55dd6f9788c0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f80e80b2290 tx=0x7f80d00168b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6958363b1741925b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80cbe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80cbe00640 1 -- 172.21.15.59:0/2829299893 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d0020420 con 0x55dd6f9659d0 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80cbe00640 1 -- 172.21.15.59:0/2829299893 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f80d000f040 con 0x55dd6f9659d0 2024-04-25T09:10:30.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 -- 172.21.15.59:0/2829299893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f80d80a9d00 con 0x55dd6f9659d0 2024-04-25T09:10:30.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80cbe00640 1 -- 172.21.15.59:0/2829299893 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80d0014410 con 0x55dd6f9659d0 2024-04-25T09:10:30.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 10 client.8763 fetch_fsmap learned FSMap version 93 2024-04-25T09:10:30.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 -- 172.21.15.59:0/2829299893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55dd6f7c28f0 con 0x55dd6f9659d0 2024-04-25T09:10:30.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80cbe00640 1 -- 172.21.15.59:0/2829299893 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d80a9d00 con 0x55dd6f9659d0 2024-04-25T09:10:30.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80cbe00640 1 -- 172.21.15.59:0/2829299893 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f80d0028050 con 0x55dd6f9659d0 2024-04-25T09:10:30.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 10 client.8763 fetch_fsmap finished waiting for FSMap version 93 2024-04-25T09:10:30.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 10 client.8763 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:10:30.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 20 client.8763 populate_metadata read hostname 'smithi059' 2024-04-25T09:10:30.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55dd6f9cbf50 0x55dd6f9ce340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:10:30.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 4 client.8763 mds_command: new command op to 8646 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:10:30.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 -- 172.21.15.59:0/2829299893 --> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55dd6f776530 con 0x55dd6f9cbf50 2024-04-25T09:10:30.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80e6a00640 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55dd6f9cbf50 0x55dd6f9ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:10:30.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80e6a00640 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55dd6f9cbf50 0x55dd6f9ce340 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15944a2f1ed3d65f server_cookie=52c779cd00fe77c4 in_seq=0 out_seq=0 2024-04-25T09:10:30.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80cbe00640 10 client.8763 ms_handle_connect on v2:172.21.15.59:6833/2009305668 2024-04-25T09:10:30.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80cbe00640 1 -- 172.21.15.59:0/2829299893 <== mds.0 v2:172.21.15.59:6833/2009305668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x55dd6f776530 con 0x55dd6f9cbf50 2024-04-25T09:10:30.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80cbe00640 10 client.8763 handle_command_reply: tid=0 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 client.8763 shutdown 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 -- 172.21.15.59:0/2829299893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9659d0 msgr2=0x55dd6f9788c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9659d0 0x55dd6f9788c0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f80e80b2290 tx=0x7f80d00168b0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 -- 172.21.15.59:0/2829299893 shutdown_connections 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55dd6f9cbf50 0x55dd6f9ce340 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dd6f9662f0 0x55dd6f978e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dd6f9659d0 0x55dd6f9788c0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 --2- 172.21.15.59:0/2829299893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dd6f91c0a0 0x55dd6f978380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 -- 172.21.15.59:0/2829299893 >> 172.21.15.59:0/2829299893 conn(0x55dd6f918020 msgr2=0x55dd6f964900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80cbe00640 0 client.8763 ms_handle_reset on v2:172.21.15.59:6833/2009305668 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 -- 172.21.15.59:0/2829299893 shutdown_connections 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 1 -- 172.21.15.59:0/2829299893 wait complete. 2024-04-25T09:10:30.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.443+0000 7f80f0fe7000 20 client.8763 trim_cache size 0 max 16384 2024-04-25T09:10:30.438 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:10:30.438 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-25T09:10:30.438 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": { 2024-04-25T09:10:30.438 INFO:teuthology.orchestra.run.smithi059.stdout: "d190e574-829a-4c7f-8d3d-ebfbf5ca5a36": { 2024-04-25T09:10:30.438 INFO:teuthology.orchestra.run.smithi059.stdout: "path": "/", 2024-04-25T09:10:30.438 INFO:teuthology.orchestra.run.smithi059.stdout: "tag": "d190e574-829a-4c7f-8d3d-ebfbf5ca5a36", 2024-04-25T09:10:30.438 INFO:teuthology.orchestra.run.smithi059.stdout: "options": "recursive,repair" 2024-04-25T09:10:30.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:30.438 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:10:30.438 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:10:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.447+0000 7f80e7e00640 1 -- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f80c4066f90 msgr2=0x7f80c4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.447+0000 7f80e7e00640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f80c4066f90 0x7f80c4069450 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f80d80ae000 tx=0x7f80d80b3040 comp rx=0 tx=0).stop 2024-04-25T09:10:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.447+0000 7f80e7e00640 1 -- 172.21.15.59:0/3380942845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80e8161ad0 msgr2=0x7f80e815cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:10:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.447+0000 7f80e7e00640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80e8161ad0 0x7f80e815cb70 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f80e000c770 tx=0x7f80e000cc30 comp rx=0 tx=0).stop 2024-04-25T09:10:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.447+0000 7f80e7e00640 1 -- 172.21.15.59:0/3380942845 shutdown_connections 2024-04-25T09:10:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.447+0000 7f80e7e00640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f80c4066f90 0x7f80c4069450 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.447+0000 7f80e7e00640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80e8161ad0 0x7f80e815cb70 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.447+0000 7f80e7e00640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f80e806cb10 0x7f80e815c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.447+0000 7f80e7e00640 1 --2- 172.21.15.59:0/3380942845 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f80e806c730 0x7f80e809bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:10:30.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.447+0000 7f80e7e00640 1 -- 172.21.15.59:0/3380942845 >> 172.21.15.59:0/3380942845 conn(0x7f80e80b3030 msgr2=0x7f80e8070ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:10:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.447+0000 7f80e7e00640 1 -- 172.21.15.59:0/3380942845 shutdown_connections 2024-04-25T09:10:30.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:30.447+0000 7f80e7e00640 1 -- 172.21.15.59:0/3380942845 wait complete. 2024-04-25T09:10:30.455 INFO:tasks.cephfs.filesystem:scrub status for tag:d190e574-829a-4c7f-8d3d-ebfbf5ca5a36 - {'path': '/', 'tag': 'd190e574-829a-4c7f-8d3d-ebfbf5ca5a36', 'options': 'recursive,repair'} 2024-04-25T09:10:31.426 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:10:31.439+0000 7f75b0200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:10:31.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:31.451+0000 7f1221600640 1 -- 172.21.15.59:0/4176714492 <== mon.0 v2:172.21.15.59:3300/0 8 ==== log(8 entries from seq 1 at 2024-04-25T09:10:30.239312+0000) v1 ==== 1407+0+0 (secure 0 0 0) 0x7f121c0ef6c0 con 0x7f12240c69a0 2024-04-25T09:10:31.441 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:10:30.239312+0000 mds.a [INF] scrub queued for path: / 2024-04-25T09:10:31.441 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:10:30.239317+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:10:31.441 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:10:30.239323+0000 mds.a [INF] scrub summary: active paths [/] 2024-04-25T09:10:31.442 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:10:30.240026+0000 mds.a [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-04-25T09:10:31.442 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:10:30.240034+0000 mds.a [ERR] inode table repaired for inode: 0x10000000001 2024-04-25T09:10:31.442 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:10:30.240562+0000 mds.a [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-04-25T09:10:31.442 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:10:30.240583+0000 mds.a [ERR] inode table repaired for inode: 0x10000000002 2024-04-25T09:10:31.442 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:10:30.240896+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-25T09:10:36.455 INFO:teuthology.orchestra.run.smithi059.stdout:2024-04-25T09:10:34.510792+0000 mds.a [INF] scrub summary: idle 2024-04-25T09:10:36.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:10:36.467+0000 7f1221600640 1 -- 172.21.15.59:0/4176714492 <== mon.0 v2:172.21.15.59:3300/0 9 ==== log(1 entries from seq 9 at 2024-04-25T09:10:34.510792+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f121c11f060 con 0x7f12240c69a0 2024-04-25T09:10:53.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:10:53.801 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:11:00.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:00.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-25T09:11:00.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.622+0000 7f8fb0000640 1 Processor -- start 2024-04-25T09:11:00.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.622+0000 7f8fb0000640 1 -- start start 2024-04-25T09:11:00.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.622+0000 7f8fb0000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fa8159320 0x7f8fa815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.622+0000 7f8fb0000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa815fc00 con 0x7f8fa806e4a0 2024-04-25T09:11:00.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.622+0000 7f8fb0000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa815fee0 con 0x7f8fa815f440 2024-04-25T09:11:00.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.622+0000 7f8fb0000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa806d640 con 0x7f8fa8159320 2024-04-25T09:11:00.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.622+0000 7f8fae000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8fa806e4a0 0x7f8fa8071270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42302/0 (socket says 172.21.15.59:42302) 2024-04-25T09:11:00.613 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.622+0000 7f8fae000640 1 -- 172.21.15.59:0/1881333612 learned_addr learned my addr 172.21.15.59:0/1881333612 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:00.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.622+0000 7f8fad600640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fa8159320 0x7f8fa815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.622+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852226273 0 0) 0x7f8fa815fc00 con 0x7f8fa806e4a0 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f90003530 con 0x7f8fa806e4a0 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609431898 0 0) 0x7f8fa815fee0 con 0x7f8fa815f440 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fa815fc00 con 0x7f8fa815f440 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1891206459 0 0) 0x7f8f90003530 con 0x7f8fa806e4a0 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fa8159320 msgr2=0x7f8fa815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fa8159320 0x7f8fa815c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 >> v1:172.21.15.178:6789/0 conn(0x7f8fa815f440 legacy=0x7f8fa806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa81601c0 con 0x7f8fa806e4a0 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f8fa0001a00 con 0x7f8fa806e4a0 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 >> v1:172.21.15.59:6789/0 conn(0x7f8fa806e4a0 legacy=0x7f8fa8071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f90003b80 0x7f8f90003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f90004810 0x7f8f90004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f900051d0 0x7f8f9000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa806d640 con 0x7f8f90003b80 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9000c040 con 0x7f8f90004810 2024-04-25T09:11:00.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9000c240 con 0x7f8f900051d0 2024-04-25T09:11:00.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fad600640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fa8159320 0x7f8fa815c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:00.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fad600640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f90003b80 0x7f8f90003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8facc00640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f90004810 0x7f8f90004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fae000640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f900051d0 0x7f8f9000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fad600640 1 -- 172.21.15.59:0/1881333612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f900051d0 msgr2=0x7f8f9000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:00.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fad600640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f900051d0 0x7f8f9000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fad600640 1 -- 172.21.15.59:0/1881333612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f90004810 msgr2=0x7f8f90004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:00.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fad600640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f90004810 0x7f8f90004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.626+0000 7f8fad600640 1 -- 172.21.15.59:0/1881333612 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90003530 con 0x7f8f90003b80 2024-04-25T09:11:00.617 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fad600640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f90003b80 0x7f8f90003f80 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80b4910 tx=0x7f8f9c01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885ce75cf541cf4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0097f0 con 0x7f8f90003b80 2024-04-25T09:11:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c004030 con 0x7f8f90003b80 2024-04-25T09:11:00.618 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fa7e00640 1 -- 172.21.15.59:0/1881333612 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c004400 con 0x7f8f90003b80 2024-04-25T09:11:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 -- 172.21.15.59:0/1881333612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f90003b80 msgr2=0x7f8f90003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 --2- 172.21.15.59:0/1881333612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f90003b80 0x7f8f90003f80 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80b4910 tx=0x7f8f9c01ca80 comp rx=0 tx=0).stop 2024-04-25T09:11:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fae000640 1 -- 172.21.15.59:0/1881333612 reap_dead start 2024-04-25T09:11:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 -- 172.21.15.59:0/1881333612 shutdown_connections 2024-04-25T09:11:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 -- 172.21.15.59:0/1881333612 >> 172.21.15.59:0/1881333612 conn(0x7f8fa8067080 msgr2=0x7f8fa806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 -- 172.21.15.59:0/1881333612 shutdown_connections 2024-04-25T09:11:00.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 -- 172.21.15.59:0/1881333612 wait complete. 2024-04-25T09:11:00.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 Processor -- start 2024-04-25T09:11:00.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 -- start start 2024-04-25T09:11:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa8158190 0x7f8fa80b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fa813df60 0x7f8fa8166970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fa813e3c0 0x7f8fa8166eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa815f9a0 con 0x7f8fa8158190 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa815f820 con 0x7f8fa813e3c0 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.630+0000 7f8fb0000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8071980 con 0x7f8fa813df60 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fad600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa8158190 0x7f8fa80b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fad600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa8158190 0x7f8fa80b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48352/0 (socket says 172.21.15.59:48352) 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fad600640 1 -- 172.21.15.59:0/1589024276 learned_addr learned my addr 172.21.15.59:0/1589024276 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fae000640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fa813e3c0 0x7f8fa8166eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8facc00640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fa813df60 0x7f8fa8166970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fad600640 1 -- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fa813df60 msgr2=0x7f8fa8166970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fad600640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fa813df60 0x7f8fa8166970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fad600640 1 -- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fa813e3c0 msgr2=0x7f8fa8166eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fad600640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fa813e3c0 0x7f8fa8166eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fad600640 1 -- 172.21.15.59:0/1589024276 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa813a400 con 0x7f8fa8158190 2024-04-25T09:11:00.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fad600640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa8158190 0x7f8fa80b3030 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c01cf60 tx=0x7f8f90005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fa5600640 1 -- 172.21.15.59:0/1589024276 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0bc070 con 0x7f8fa8158190 2024-04-25T09:11:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fa5600640 1 -- 172.21.15.59:0/1589024276 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9c0a57f0 con 0x7f8fa8158190 2024-04-25T09:11:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fa5600640 1 -- 172.21.15.59:0/1589024276 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0b2040 con 0x7f8fa8158190 2024-04-25T09:11:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fb0000640 1 -- 172.21.15.59:0/1589024276 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa813ed30 con 0x7f8fa8158190 2024-04-25T09:11:00.624 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fb0000640 1 -- 172.21.15.59:0/1589024276 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa813f2f0 con 0x7f8fa8158190 2024-04-25T09:11:00.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.634+0000 7f8fa5600640 1 -- 172.21.15.59:0/1589024276 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8f9c0bf070 con 0x7f8fa8158190 2024-04-25T09:11:00.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fa5600640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f88066f90 0x7f8f88069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fa5600640 1 -- 172.21.15.59:0/1589024276 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f8f9c11e840 con 0x7f8fa8158190 2024-04-25T09:11:00.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8facc00640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f88066f90 0x7f8f88069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 Processor -- start 2024-04-25T09:11:00.626 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 -- start start 2024-04-25T09:11:00.627 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8facc00640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f88066f90 0x7f8f88069450 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8fa813e860 tx=0x7f8f94009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde4bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4c2f0 0x55d6fde01b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 0x55d6fde02480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6fdc4eff0 con 0x55d6fde020a0 2024-04-25T09:11:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6fdbd7150 con 0x55d6fde4b9d0 2024-04-25T09:11:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6fdc4b090 con 0x55d6fde4c2f0 2024-04-25T09:11:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fae000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 0x55d6fde02480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fae000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 0x55d6fde02480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48366/0 (socket says 172.21.15.59:48366) 2024-04-25T09:11:00.628 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fae000640 1 -- 172.21.15.59:0/1233631551 learned_addr learned my addr 172.21.15.59:0/1233631551 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:00.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8facc00640 1 --2- 172.21.15.59:0/1233631551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4c2f0 0x55d6fde01b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fad600640 1 --2- 172.21.15.59:0/1233631551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde4bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fae000640 1 -- 172.21.15.59:0/1233631551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4c2f0 msgr2=0x55d6fde01b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:00.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fae000640 1 --2- 172.21.15.59:0/1233631551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4c2f0 0x55d6fde01b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fae000640 1 -- 172.21.15.59:0/1233631551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 msgr2=0x55d6fde4bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:00.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fae000640 1 --2- 172.21.15.59:0/1233631551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde4bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fae000640 1 -- 172.21.15.59:0/1233631551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6fdde50d0 con 0x55d6fde020a0 2024-04-25T09:11:00.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fad600640 1 --2- 172.21.15.59:0/1233631551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde4bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:00.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8facc00640 1 --2- 172.21.15.59:0/1233631551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4c2f0 0x55d6fde01b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:00.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fae000640 1 --2- 172.21.15.59:0/1233631551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 0x55d6fde02480 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8072630 tx=0x7f8fa00021b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8664fe1c073c1d7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8f9a000640 1 -- 172.21.15.59:0/1233631551 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0007980 con 0x55d6fde020a0 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8f9a000640 1 -- 172.21.15.59:0/1233631551 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa001a070 con 0x55d6fde020a0 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8f9a000640 1 -- 172.21.15.59:0/1233631551 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0015670 con 0x55d6fde020a0 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1233631551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 msgr2=0x55d6fde02480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/1233631551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 0x55d6fde02480 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f8fa8072630 tx=0x7f8fa00021b0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1233631551 shutdown_connections 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/1233631551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 0x55d6fde02480 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/1233631551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4c2f0 0x55d6fde01b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/1233631551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde4bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1233631551 >> 172.21.15.59:0/1233631551 conn(0x55d6fddfe020 msgr2=0x55d6fde00440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1233631551 shutdown_connections 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.638+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1233631551 wait complete. 2024-04-25T09:11:00.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 1 -- start start 2024-04-25T09:11:00.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 1 Processor -- start 2024-04-25T09:11:00.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 0x55d6fde307f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde30d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4c2f0 0x55d6fde31270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6fdc13250 con 0x55d6fde020a0 2024-04-25T09:11:00.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6fdc09690 con 0x55d6fde4b9d0 2024-04-25T09:11:00.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6fdbd7a40 con 0x55d6fde4c2f0 2024-04-25T09:11:00.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 10 client.0 _ll_register_callbacks cb 0x55d6fddece90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:00.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fad600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 0x55d6fde307f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fad600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 0x55d6fde307f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48370/0 (socket says 172.21.15.59:48370) 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fad600640 1 -- 172.21.15.59:0/2163075117 learned_addr learned my addr 172.21.15.59:0/2163075117 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fae000640 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4c2f0 0x55d6fde31270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8facc00640 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde30d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fad600640 1 -- 172.21.15.59:0/2163075117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4c2f0 msgr2=0x55d6fde31270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fad600640 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4c2f0 0x55d6fde31270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fad600640 1 -- 172.21.15.59:0/2163075117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 msgr2=0x55d6fde30d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fad600640 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde30d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fad600640 1 -- 172.21.15.59:0/2163075117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6fdcfc1c0 con 0x55d6fde020a0 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fae000640 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4c2f0 0x55d6fde31270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fad600640 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 0x55d6fde307f0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c098490 tx=0x7f8f9c0ef620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670643ec7c9359c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8f8ea00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8f8ea00640 1 -- 172.21.15.59:0/2163075117 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9c0f7630 con 0x55d6fde020a0 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8f8ea00640 1 -- 172.21.15.59:0/2163075117 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f8f9c106980 con 0x55d6fde020a0 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 1 -- 172.21.15.59:0/2163075117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fa001a070 con 0x55d6fde020a0 2024-04-25T09:11:00.635 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8f8ea00640 1 -- 172.21.15.59:0/2163075117 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f9c0f71a0 con 0x55d6fde020a0 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 10 client.8775 fetch_fsmap learned FSMap version 93 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 1 -- 172.21.15.59:0/2163075117 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55d6fdcf8170 con 0x55d6fde020a0 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8f8ea00640 1 -- 172.21.15.59:0/2163075117 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa001a070 con 0x55d6fde020a0 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8f8ea00640 1 -- 172.21.15.59:0/2163075117 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8f9c0f2030 con 0x55d6fde020a0 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 10 client.8775 fetch_fsmap finished waiting for FSMap version 93 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 10 client.8775 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 20 client.8775 populate_metadata read hostname 'smithi059' 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55d6fde5bc80 0x55d6fde5e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 4 client.8775 mds_command: new command op to 8646 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8fb34eb000 1 -- 172.21.15.59:0/2163075117 --> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6fdbeac60 con 0x55d6fde5bc80 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.642+0000 7f8facc00640 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55d6fde5bc80 0x55d6fde5e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8facc00640 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55d6fde5bc80 0x55d6fde5e070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f3e2f5a5a376e8c server_cookie=e272b8c429b96f12 in_seq=0 out_seq=0 2024-04-25T09:11:00.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8f8ea00640 10 client.8775 ms_handle_connect on v2:172.21.15.59:6833/2009305668 2024-04-25T09:11:00.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8f8ea00640 1 -- 172.21.15.59:0/2163075117 <== mds.0 v2:172.21.15.59:6833/2009305668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d6fdbeac60 con 0x55d6fde5bc80 2024-04-25T09:11:00.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8f8ea00640 10 client.8775 handle_command_reply: tid=0 2024-04-25T09:11:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8fb34eb000 1 client.8775 shutdown 2024-04-25T09:11:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8fb34eb000 1 -- 172.21.15.59:0/2163075117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 msgr2=0x55d6fde307f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 0x55d6fde307f0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c098490 tx=0x7f8f9c0ef620 comp rx=0 tx=0).stop 2024-04-25T09:11:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8fb34eb000 1 -- 172.21.15.59:0/2163075117 shutdown_connections 2024-04-25T09:11:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55d6fde5bc80 0x55d6fde5e070 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4c2f0 0x55d6fde31270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde30d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/2163075117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde020a0 0x55d6fde307f0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8f8ea00640 0 client.8775 ms_handle_reset on v2:172.21.15.59:6833/2009305668 2024-04-25T09:11:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8fb34eb000 1 -- 172.21.15.59:0/2163075117 >> 172.21.15.59:0/2163075117 conn(0x55d6fddfe020 msgr2=0x55d6fde00ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8fb34eb000 1 -- 172.21.15.59:0/2163075117 shutdown_connections 2024-04-25T09:11:00.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8fb34eb000 1 -- 172.21.15.59:0/2163075117 wait complete. 2024-04-25T09:11:00.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.646+0000 7f8fb34eb000 20 client.8775 trim_cache size 0 max 16384 2024-04-25T09:11:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 Processor -- start 2024-04-25T09:11:00.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 -- start start 2024-04-25T09:11:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde020a0 0x55d6fdea80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4b9d0 0x55d6fdea8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 0x55d6fdea8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8203ee0 con 0x55d6fde4c2f0 2024-04-25T09:11:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa82030a0 con 0x55d6fde020a0 2024-04-25T09:11:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa82024a0 con 0x55d6fde4b9d0 2024-04-25T09:11:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fae000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 0x55d6fdea8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fae000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 0x55d6fdea8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48372/0 (socket says 172.21.15.59:48372) 2024-04-25T09:11:00.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fae000640 1 -- 172.21.15.59:0/3105321988 learned_addr learned my addr 172.21.15.59:0/3105321988 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:00.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8facc00640 1 --2- 172.21.15.59:0/3105321988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4b9d0 0x55d6fdea8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fad600640 1 --2- 172.21.15.59:0/3105321988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde020a0 0x55d6fdea80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fae000640 1 -- 172.21.15.59:0/3105321988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4b9d0 msgr2=0x55d6fdea8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:00.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fae000640 1 --2- 172.21.15.59:0/3105321988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4b9d0 0x55d6fdea8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fae000640 1 -- 172.21.15.59:0/3105321988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde020a0 msgr2=0x55d6fdea80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fae000640 1 --2- 172.21.15.59:0/3105321988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde020a0 0x55d6fdea80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fae000640 1 -- 172.21.15.59:0/3105321988 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6fdc95de0 con 0x55d6fde4c2f0 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fae000640 1 --2- 172.21.15.59:0/3105321988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 0x55d6fdea8b70 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x55d6fdc0b3d0 tx=0x7f8fa000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78d14a6205ba30a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8f99600640 1 -- 172.21.15.59:0/3105321988 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0015670 con 0x55d6fde4c2f0 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8f99600640 1 -- 172.21.15.59:0/3105321988 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa0025070 con 0x55d6fde4c2f0 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8f99600640 1 -- 172.21.15.59:0/3105321988 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0015a70 con 0x55d6fde4c2f0 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 -- 172.21.15.59:0/3105321988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 msgr2=0x55d6fdea8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/3105321988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 0x55d6fdea8b70 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x55d6fdc0b3d0 tx=0x7f8fa000f000 comp rx=0 tx=0).stop 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 -- 172.21.15.59:0/3105321988 shutdown_connections 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/3105321988 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 0x55d6fdea8b70 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/3105321988 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde4b9d0 0x55d6fdea8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/3105321988 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde020a0 0x55d6fdea80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 -- 172.21.15.59:0/3105321988 >> 172.21.15.59:0/3105321988 conn(0x55d6fddfe020 msgr2=0x55d6fde4a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:00.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 -- 172.21.15.59:0/3105321988 shutdown_connections 2024-04-25T09:11:00.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.662+0000 7f8fb34eb000 1 -- 172.21.15.59:0/3105321988 wait complete. 2024-04-25T09:11:00.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 1 -- start start 2024-04-25T09:11:00.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 1 Processor -- start 2024-04-25T09:11:00.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde020a0 0x55d6fde5e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde5e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 0x55d6fde5ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6fdbe9e00 con 0x55d6fde4c2f0 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa8202aa0 con 0x55d6fde4b9d0 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6fdc4e300 con 0x55d6fde020a0 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 10 client.0 _ll_register_callbacks cb 0x55d6fddcd040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fae000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 0x55d6fde5ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fae000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 0x55d6fde5ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48374/0 (socket says 172.21.15.59:48374) 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fae000640 1 -- 172.21.15.59:0/1992824617 learned_addr learned my addr 172.21.15.59:0/1992824617 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8facc00640 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde5e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fad600640 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde020a0 0x55d6fde5e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fae000640 1 -- 172.21.15.59:0/1992824617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde020a0 msgr2=0x55d6fde5e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fae000640 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde020a0 0x55d6fde5e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fae000640 1 -- 172.21.15.59:0/1992824617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 msgr2=0x55d6fde5e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fae000640 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde5e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fae000640 1 -- 172.21.15.59:0/1992824617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d6fdbf08e0 con 0x55d6fde4c2f0 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fae000640 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 0x55d6fde5ee00 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0001a10 tx=0x7f8fa815be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827cbe500d744484 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8f8ea00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8f8ea00640 1 -- 172.21.15.59:0/1992824617 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa003a060 con 0x55d6fde4c2f0 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8f8ea00640 1 -- 172.21.15.59:0/1992824617 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f8fa002c070 con 0x55d6fde4c2f0 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1992824617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8fa0025070 con 0x55d6fde4c2f0 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8f8ea00640 1 -- 172.21.15.59:0/1992824617 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fa0040050 con 0x55d6fde4c2f0 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 10 client.8781 fetch_fsmap learned FSMap version 93 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1992824617 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55d6fdca88f0 con 0x55d6fde4c2f0 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8f8ea00640 1 -- 172.21.15.59:0/1992824617 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa0025070 con 0x55d6fde4c2f0 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8f8ea00640 1 -- 172.21.15.59:0/1992824617 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 93) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f8fa0043020 con 0x55d6fde4c2f0 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 10 client.8781 fetch_fsmap finished waiting for FSMap version 93 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 10 client.8781 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 20 client.8781 populate_metadata read hostname 'smithi059' 2024-04-25T09:11:00.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55d6fde5f7f0 0x55d6fdeb3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 4 client.8781 mds_command: new command op to 8646 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-25T09:11:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1992824617 --> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d6fdc5c530 con 0x55d6fde5f7f0 2024-04-25T09:11:00.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fad600640 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55d6fde5f7f0 0x55d6fdeb3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8fad600640 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55d6fde5f7f0 0x55d6fdeb3f60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7a5b298804d06dc server_cookie=9a8b812f8f71104c in_seq=0 out_seq=0 2024-04-25T09:11:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.666+0000 7f8f8ea00640 10 client.8781 ms_handle_connect on v2:172.21.15.59:6833/2009305668 2024-04-25T09:11:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8f8ea00640 1 -- 172.21.15.59:0/1992824617 <== mds.0 v2:172.21.15.59:6833/2009305668 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55d6fdc5c530 con 0x55d6fde5f7f0 2024-04-25T09:11:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8f8ea00640 10 client.8781 handle_command_reply: tid=0 2024-04-25T09:11:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb34eb000 1 client.8781 shutdown 2024-04-25T09:11:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1992824617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 msgr2=0x55d6fde5ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 0x55d6fde5ee00 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0001a10 tx=0x7f8fa815be50 comp rx=0 tx=0).stop 2024-04-25T09:11:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1992824617 shutdown_connections 2024-04-25T09:11:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.59:6833/2009305668,v1:172.21.15.59:6835/2009305668] conn(0x55d6fde5f7f0 0x55d6fdeb3f60 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55d6fde4c2f0 0x55d6fde5ee00 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55d6fde4b9d0 0x55d6fde5e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8f8ea00640 0 client.8781 ms_handle_reset on v2:172.21.15.59:6833/2009305668 2024-04-25T09:11:00.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb34eb000 1 --2- 172.21.15.59:0/1992824617 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55d6fde020a0 0x55d6fde5e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1992824617 >> 172.21.15.59:0/1992824617 conn(0x55d6fddfe020 msgr2=0x55d6fde4a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:00.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1992824617 shutdown_connections 2024-04-25T09:11:00.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb34eb000 1 -- 172.21.15.59:0/1992824617 wait complete. 2024-04-25T09:11:00.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb34eb000 20 client.8781 trim_cache size 0 max 16384 2024-04-25T09:11:00.662 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:11:00.662 INFO:teuthology.orchestra.run.smithi059.stdout: "status": "no active scrubs running", 2024-04-25T09:11:00.662 INFO:teuthology.orchestra.run.smithi059.stdout: "scrubs": {} 2024-04-25T09:11:00.662 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:11:00.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb0000640 1 -- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f88066f90 msgr2=0x7f8f88069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb0000640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f88066f90 0x7f8f88069450 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8fa813e860 tx=0x7f8f94009040 comp rx=0 tx=0).stop 2024-04-25T09:11:00.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb0000640 1 -- 172.21.15.59:0/1589024276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa8158190 msgr2=0x7f8fa80b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb0000640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa8158190 0x7f8fa80b3030 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f8f9c01cf60 tx=0x7f8f90005840 comp rx=0 tx=0).stop 2024-04-25T09:11:00.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb0000640 1 -- 172.21.15.59:0/1589024276 shutdown_connections 2024-04-25T09:11:00.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb0000640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f88066f90 0x7f8f88069450 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb0000640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8fa813e3c0 0x7f8fa8166eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb0000640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8fa813df60 0x7f8fa8166970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb0000640 1 --2- 172.21.15.59:0/1589024276 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fa8158190 0x7f8fa80b3030 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb0000640 1 -- 172.21.15.59:0/1589024276 >> 172.21.15.59:0/1589024276 conn(0x7f8fa8067080 msgr2=0x7f8fa80cd190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb0000640 1 -- 172.21.15.59:0/1589024276 shutdown_connections 2024-04-25T09:11:00.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.670+0000 7f8fb0000640 1 -- 172.21.15.59:0/1589024276 wait complete. 2024-04-25T09:11:00.678 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-25T09:11:00.779 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:11:00.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.930+0000 7f90f1600640 1 Processor -- start 2024-04-25T09:11:00.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.930+0000 7f90f1600640 1 -- start start 2024-04-25T09:11:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90f1600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90ec15acd0 0x7f90ec15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90f1600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f90ec15ee60 0x7f90ec0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90f1600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90ec15bc40 con 0x7f90ec144120 2024-04-25T09:11:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90f1600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec15e490 con 0x7f90ec15acd0 2024-04-25T09:11:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90f1600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90ec15b150 con 0x7f90ec15ee60 2024-04-25T09:11:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90ea000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f90ec15acd0 0x7f90ec15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90eaa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f90ec144120 0x7f90ec0ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42312/0 (socket says 172.21.15.59:42312) 2024-04-25T09:11:00.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90eaa00640 1 -- 172.21.15.59:0/3758660021 learned_addr learned my addr 172.21.15.59:0/3758660021 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90eb400640 1 --2- 172.21.15.59:0/3758660021 >> v2:172.21.15.178:3300/0 conn(0x7f90ec15ee60 0x7f90ec0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90ea000640 1 -- 172.21.15.59:0/3758660021 >> v2:172.21.15.178:3300/0 conn(0x7f90ec15ee60 msgr2=0x7f90ec0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90ea000640 1 --2- 172.21.15.59:0/3758660021 >> v2:172.21.15.178:3300/0 conn(0x7f90ec15ee60 0x7f90ec0b3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90ea000640 1 -- 172.21.15.59:0/3758660021 >> v1:172.21.15.59:6789/0 conn(0x7f90ec144120 legacy=0x7f90ec0ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.934+0000 7f90ea000640 1 -- 172.21.15.59:0/3758660021 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec15b3a0 con 0x7f90ec15acd0 2024-04-25T09:11:00.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90ea000640 1 --2- 172.21.15.59:0/3758660021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90ec15acd0 0x7f90ec15e920 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f90ec06bb20 tx=0x7f90d801e600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb6eacd9b09c84e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:00.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90e9600640 1 -- 172.21.15.59:0/3758660021 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80ac680 con 0x7f90ec15acd0 2024-04-25T09:11:00.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90e9600640 1 -- 172.21.15.59:0/3758660021 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d80b1070 con 0x7f90ec15acd0 2024-04-25T09:11:00.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90e9600640 1 -- 172.21.15.59:0/3758660021 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80aca40 con 0x7f90ec15acd0 2024-04-25T09:11:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90f1600640 1 -- 172.21.15.59:0/3758660021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90ec15acd0 msgr2=0x7f90ec15e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90f1600640 1 --2- 172.21.15.59:0/3758660021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90ec15acd0 0x7f90ec15e920 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f90ec06bb20 tx=0x7f90d801e600 comp rx=0 tx=0).stop 2024-04-25T09:11:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90f1600640 1 -- 172.21.15.59:0/3758660021 shutdown_connections 2024-04-25T09:11:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90f1600640 1 --2- 172.21.15.59:0/3758660021 >> v2:172.21.15.178:3300/0 conn(0x7f90ec15ee60 0x7f90ec0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90f1600640 1 --2- 172.21.15.59:0/3758660021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90ec15acd0 0x7f90ec15e920 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90f1600640 1 -- 172.21.15.59:0/3758660021 >> 172.21.15.59:0/3758660021 conn(0x7f90ec067080 msgr2=0x7f90ec06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90f1600640 1 -- 172.21.15.59:0/3758660021 shutdown_connections 2024-04-25T09:11:00.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90f1600640 1 -- 172.21.15.59:0/3758660021 wait complete. 2024-04-25T09:11:00.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90f1600640 1 Processor -- start 2024-04-25T09:11:00.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.938+0000 7f90f1600640 1 -- start start 2024-04-25T09:11:00.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90f1600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90ec144120 0x7f90ec159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90f1600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90ec15acd0 0x7f90ec0adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90f1600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90ec15ee60 0x7f90ec1637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90f1600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec06de70 con 0x7f90ec15acd0 2024-04-25T09:11:00.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90f1600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec06dcf0 con 0x7f90ec144120 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90f1600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec06dff0 con 0x7f90ec15ee60 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90ea000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90ec15acd0 0x7f90ec0adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90ea000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90ec15acd0 0x7f90ec0adcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48386/0 (socket says 172.21.15.59:48386) 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90ea000640 1 -- 172.21.15.59:0/3984045013 learned_addr learned my addr 172.21.15.59:0/3984045013 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90eb400640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90ec15ee60 0x7f90ec1637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90eaa00640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90ec144120 0x7f90ec159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90ea000640 1 -- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90ec15ee60 msgr2=0x7f90ec1637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90ea000640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90ec15ee60 0x7f90ec1637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90ea000640 1 -- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90ec144120 msgr2=0x7f90ec159c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90ea000640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90ec144120 0x7f90ec159c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90ea000640 1 -- 172.21.15.59:0/3984045013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec0ae770 con 0x7f90ec15acd0 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90ea000640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90ec15acd0 0x7f90ec0adcd0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f90d80ae040 tx=0x7f90d801ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:00.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90e2a00640 1 -- 172.21.15.59:0/3984045013 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d80bb070 con 0x7f90ec15acd0 2024-04-25T09:11:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90e2a00640 1 -- 172.21.15.59:0/3984045013 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d80b5620 con 0x7f90ec15acd0 2024-04-25T09:11:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90f1600640 1 -- 172.21.15.59:0/3984045013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90ec0a89c0 con 0x7f90ec15acd0 2024-04-25T09:11:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90e2a00640 1 -- 172.21.15.59:0/3984045013 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8006e20 con 0x7f90ec15acd0 2024-04-25T09:11:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90f1600640 1 -- 172.21.15.59:0/3984045013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90ec0ab3f0 con 0x7f90ec15acd0 2024-04-25T09:11:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90f1600640 1 -- 172.21.15.59:0/3984045013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90ec0a87b0 con 0x7f90ec15acd0 2024-04-25T09:11:00.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.942+0000 7f90e2a00640 1 -- 172.21.15.59:0/3984045013 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f90d80be070 con 0x7f90ec15acd0 2024-04-25T09:11:00.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.946+0000 7f90e2a00640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f90cc066f60 0x7f90cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:00.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.946+0000 7f90e2a00640 1 -- 172.21.15.59:0/3984045013 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6245+0+0 (secure 0 0 0) 0x7f90d811f5a0 con 0x7f90ec15acd0 2024-04-25T09:11:00.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.946+0000 7f90eaa00640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f90cc066f60 0x7f90cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:00.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.946+0000 7f90eaa00640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f90cc066f60 0x7f90cc069420 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0012f0 tx=0x7f90dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:00.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:00.950+0000 7f90e2a00640 1 -- 172.21.15.59:0/3984045013 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f90d80a8040 con 0x7f90ec15acd0 2024-04-25T09:11:01.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.146+0000 7f90f1600640 1 -- 172.21.15.59:0/3984045013 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f90ec0b4770 con 0x7f90ec15acd0 2024-04-25T09:11:01.135 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:11:01.146+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.146+0000 7f90e2a00640 1 -- 172.21.15.59:0/3984045013 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) v1 ==== 161+0+0 (secure 0 0 0) 0x7f90d8018280 con 0x7f90ec15acd0 2024-04-25T09:11:01.137 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:11:01.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.150+0000 7f90f1600640 1 -- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f90cc066f60 msgr2=0x7f90cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.150+0000 7f90f1600640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f90cc066f60 0x7f90cc069420 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f90dc0012f0 tx=0x7f90dc009040 comp rx=0 tx=0).stop 2024-04-25T09:11:01.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.150+0000 7f90f1600640 1 -- 172.21.15.59:0/3984045013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90ec15acd0 msgr2=0x7f90ec0adcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.150+0000 7f90f1600640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90ec15acd0 0x7f90ec0adcd0 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f90d80ae040 tx=0x7f90d801ce40 comp rx=0 tx=0).stop 2024-04-25T09:11:01.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.150+0000 7f90f1600640 1 -- 172.21.15.59:0/3984045013 shutdown_connections 2024-04-25T09:11:01.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.150+0000 7f90f1600640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f90cc066f60 0x7f90cc069420 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.150+0000 7f90f1600640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f90ec15ee60 0x7f90ec1637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.150+0000 7f90f1600640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90ec15acd0 0x7f90ec0adcd0 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.150+0000 7f90f1600640 1 --2- 172.21.15.59:0/3984045013 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f90ec144120 0x7f90ec159c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.150+0000 7f90f1600640 1 -- 172.21.15.59:0/3984045013 >> 172.21.15.59:0/3984045013 conn(0x7f90ec067080 msgr2=0x7f90ec0b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.150+0000 7f90f1600640 1 -- 172.21.15.59:0/3984045013 shutdown_connections 2024-04-25T09:11:01.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.150+0000 7f90f1600640 1 -- 172.21.15.59:0/3984045013 wait complete. 2024-04-25T09:11:01.146 INFO:tasks.ceph.mds.a.smithi059.stderr: -1147> 2024-04-25T09:10:30.235+0000 7f75ab200640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-25T09:11:01.147 INFO:tasks.ceph.mds.a.smithi059.stderr: -1144> 2024-04-25T09:10:30.235+0000 7f75ab200640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-25T09:11:01.147 INFO:tasks.ceph.mds.a.smithi059.stderr: -1116> 2024-04-25T09:10:30.235+0000 7f75ab200640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-25T09:11:01.147 INFO:tasks.ceph.mds.a.smithi059.stderr: -1113> 2024-04-25T09:10:30.235+0000 7f75ab200640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-25T09:11:01.147 INFO:tasks.ceph.mds.a.smithi059.stderr: -957> 2024-04-25T09:10:31.439+0000 7f75b0200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:11:01.161 DEBUG:teuthology.orchestra.run.smithi059:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-04-25T09:11:01.190 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:11:01.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 1 -- start start 2024-04-25T09:11:01.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 1 Processor -- start 2024-04-25T09:11:01.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfa800 0x5596dcfe3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596dce29c00 0x5596dcfe2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfbc00 0x5596dcfe3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ddbf8780 con 0x5596ddbfa800 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ddbf8600 con 0x5596dce29c00 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596ddbf8180 con 0x5596ddbfbc00 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe216000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfa800 0x5596dcfe3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe216000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfa800 0x5596dcfe3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48424/0 (socket says 172.21.15.59:48424) 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe216000640 1 -- 172.21.15.59:0/4140475229 learned_addr learned my addr 172.21.15.59:0/4140475229 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe215600640 1 --2- 172.21.15.59:0/4140475229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596dce29c00 0x5596dcfe2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe216a00640 1 --2- 172.21.15.59:0/4140475229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfbc00 0x5596dcfe3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe216000640 1 -- 172.21.15.59:0/4140475229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfbc00 msgr2=0x5596dcfe3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe216000640 1 --2- 172.21.15.59:0/4140475229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfbc00 0x5596dcfe3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe216000640 1 -- 172.21.15.59:0/4140475229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596dce29c00 msgr2=0x5596dcfe2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe216000640 1 --2- 172.21.15.59:0/4140475229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596dce29c00 0x5596dcfe2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe216000640 1 -- 172.21.15.59:0/4140475229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596ddbe0d20 con 0x5596ddbfa800 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe216000640 1 --2- 172.21.15.59:0/4140475229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfa800 0x5596dcfe3b80 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x5596ddc91110 tx=0x5596ddbf2120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a049ecf8a9a45af0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe212e00640 1 -- 172.21.15.59:0/4140475229 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5596dce5e1a0 con 0x5596ddbfa800 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe212e00640 1 -- 172.21.15.59:0/4140475229 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596dce72c40 con 0x5596ddbfa800 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe212e00640 1 -- 172.21.15.59:0/4140475229 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5596dce5e4e0 con 0x5596ddbfa800 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 1 -- 172.21.15.59:0/4140475229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596ddbe0f00 con 0x5596ddbfa800 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 1 -- 172.21.15.59:0/4140475229 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5596ddbe10e0 con 0x5596ddbfa800 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 4 waiting for MDS map... 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe212e00640 1 -- 172.21.15.59:0/4140475229 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x5596ddbe6600 con 0x5596ddbfa800 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe212e00640 1 -- 172.21.15.59:0/4140475229 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 94) v1 ==== 2723+0+0 (secure 0 0 0) 0x5596dce7f180 con 0x5596ddbfa800 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 4 Got MDS map 94 2024-04-25T09:11:01.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 10 main: main 2024-04-25T09:11:01.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 4 main: connecting to RADOS... 2024-04-25T09:11:01.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 1 Processor -- start 2024-04-25T09:11:01.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.222+0000 7fe21902c400 1 -- start start 2024-04-25T09:11:01.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596ddbfb800 0x5596dcfe3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfa400 0x5596dcfe4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddc0e800 0x5596dcfe4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596dce88480 con 0x5596ddc0e800 2024-04-25T09:11:01.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596dce88900 con 0x5596ddbfb800 2024-04-25T09:11:01.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596ddbf9200 con 0x5596ddbfa400 2024-04-25T09:11:01.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe215600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddc0e800 0x5596dcfe4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe215600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddc0e800 0x5596dcfe4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48428/0 (socket says 172.21.15.59:48428) 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe215600640 1 -- 172.21.15.59:0/2967468328 learned_addr learned my addr 172.21.15.59:0/2967468328 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe216000640 1 --2- 172.21.15.59:0/2967468328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfa400 0x5596dcfe4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe216a00640 1 --2- 172.21.15.59:0/2967468328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596ddbfb800 0x5596dcfe3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe215600640 1 -- 172.21.15.59:0/2967468328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfa400 msgr2=0x5596dcfe4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe215600640 1 --2- 172.21.15.59:0/2967468328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfa400 0x5596dcfe4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe215600640 1 -- 172.21.15.59:0/2967468328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596ddbfb800 msgr2=0x5596dcfe3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe215600640 1 --2- 172.21.15.59:0/2967468328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596ddbfb800 0x5596dcfe3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe215600640 1 -- 172.21.15.59:0/2967468328 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596ddbe0f00 con 0x5596ddc0e800 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe216a00640 1 --2- 172.21.15.59:0/2967468328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596ddbfb800 0x5596dcfe3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe215600640 1 --2- 172.21.15.59:0/2967468328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddc0e800 0x5596dcfe4680 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x5596dddb0030 tx=0x5596ddd5cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb2c2e7636ca5d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe210600640 1 -- 172.21.15.59:0/2967468328 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5596dce5e1a0 con 0x5596ddc0e800 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe210600640 1 -- 172.21.15.59:0/2967468328 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596dce73340 con 0x5596ddc0e800 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe210600640 1 -- 172.21.15.59:0/2967468328 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5596dce5e4e0 con 0x5596ddc0e800 2024-04-25T09:11:01.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 -- 172.21.15.59:0/2967468328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddc0e800 msgr2=0x5596dcfe4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 --2- 172.21.15.59:0/2967468328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddc0e800 0x5596dcfe4680 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x5596dddb0030 tx=0x5596ddd5cc00 comp rx=0 tx=0).stop 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 -- 172.21.15.59:0/2967468328 shutdown_connections 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 --2- 172.21.15.59:0/2967468328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddc0e800 0x5596dcfe4680 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 --2- 172.21.15.59:0/2967468328 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfa400 0x5596dcfe4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 --2- 172.21.15.59:0/2967468328 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596ddbfb800 0x5596dcfe3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 -- 172.21.15.59:0/2967468328 >> 172.21.15.59:0/2967468328 conn(0x5596ddbfb400 msgr2=0x5596ddda4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 -- 172.21.15.59:0/2967468328 shutdown_connections 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 -- 172.21.15.59:0/2967468328 wait complete. 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 Processor -- start 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 -- start start 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfb800 0x5596dcfe5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfa400 0x5596dcfe5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596ddc0f800 0x5596dcfe4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ddbf9500 con 0x5596ddbfb800 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596ddbf9380 con 0x5596ddc0f800 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe21902c400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5596ddbf9680 con 0x5596ddbfa400 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe216a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfb800 0x5596dcfe5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe216a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfb800 0x5596dcfe5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48438/0 (socket says 172.21.15.59:48438) 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe216a00640 1 -- 172.21.15.59:0/3276938330 learned_addr learned my addr 172.21.15.59:0/3276938330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe216000640 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfa400 0x5596dcfe5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.226+0000 7fe215600640 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596ddc0f800 0x5596dcfe4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe216a00640 1 -- 172.21.15.59:0/3276938330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfa400 msgr2=0x5596dcfe5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe216a00640 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfa400 0x5596dcfe5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe216a00640 1 -- 172.21.15.59:0/3276938330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596ddc0f800 msgr2=0x5596dcfe4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe216a00640 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596ddc0f800 0x5596dcfe4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe216a00640 1 -- 172.21.15.59:0/3276938330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596ddbe1c20 con 0x5596ddbfb800 2024-04-25T09:11:01.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe216a00640 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfb800 0x5596dcfe5700 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x5596dddb12f0 tx=0x5596ddbf2180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe20e800640 1 -- 172.21.15.59:0/3276938330 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5596dce5e1a0 con 0x5596ddbfb800 2024-04-25T09:11:01.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe20e800640 1 -- 172.21.15.59:0/3276938330 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5596dce72540 con 0x5596ddbfb800 2024-04-25T09:11:01.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe21902c400 1 -- 172.21.15.59:0/3276938330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5596ddbe1e00 con 0x5596ddbfb800 2024-04-25T09:11:01.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe20e800640 1 -- 172.21.15.59:0/3276938330 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5596dce5e4e0 con 0x5596ddbfb800 2024-04-25T09:11:01.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe21902c400 1 -- 172.21.15.59:0/3276938330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596ddbe01e0 con 0x5596ddbfb800 2024-04-25T09:11:01.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe21902c400 4 main: resolving pool 15 2024-04-25T09:11:01.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe20e800640 1 -- 172.21.15.59:0/3276938330 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x5596ddd96c00 con 0x5596ddbfb800 2024-04-25T09:11:01.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe20e800640 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x5596dd163400 0x5596dd246000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe20e800640 1 -- 172.21.15.59:0/3276938330 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x5596dd160600 con 0x5596ddbfb800 2024-04-25T09:11:01.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe21902c400 4 main: creating IoCtx.. 2024-04-25T09:11:01.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe21902c400 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5596ddc0f400 0x5596dcfe4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe21902c400 1 -- 172.21.15.59:0/3276938330 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:1 15.13 15:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111) v9 -- 0x5596ddc0f000 con 0x5596ddc0f400 2024-04-25T09:11:01.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe215600640 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5596ddc0f400 0x5596dcfe4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe216000640 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x5596dd163400 0x5596dd246000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe215600640 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5596ddc0f400 0x5596dcfe4680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.230+0000 7fe216000640 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x5596dd163400 0x5596dd246000 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x5596ddc913e0 tx=0x5596ddbf22a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe215600640 1 -- 172.21.15.59:0/3276938330 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x5596dcf34000 con 0x5596ddc0f400 2024-04-25T09:11:01.225 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:11:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: "0": { 2024-04-25T09:11:01.225 INFO:teuthology.orchestra.run.smithi059.stdout: "data": { 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "version": 5, 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "inotable": { 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "projected_free": [ 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "start": 1099511627779, 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "len": 1099511627773 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: ], 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "free": [ 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "start": 1099511627779, 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: "len": 1099511627773 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:01.226 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: "result": 0 2024-04-25T09:11:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:01.227 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:11:01.227 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 -- 172.21.15.59:0/3276938330 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5596ddc0f400 msgr2=0x5596dcfe4680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5596ddc0f400 0x5596dcfe4680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 -- 172.21.15.59:0/3276938330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x5596dd163400 msgr2=0x5596dd246000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x5596dd163400 0x5596dd246000 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x5596ddc913e0 tx=0x5596ddbf22a0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 -- 172.21.15.59:0/3276938330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfb800 msgr2=0x5596dcfe5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 --2- 172.21.15.59:0/3276938330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfb800 0x5596dcfe5700 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x5596dddb12f0 tx=0x5596ddbf2180 comp rx=0 tx=0).stop 2024-04-25T09:11:01.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe215600640 1 -- 172.21.15.59:0/3276938330 reap_dead start 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 -- 172.21.15.59:0/3276938330 shutdown_connections 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 -- 172.21.15.59:0/3276938330 >> 172.21.15.59:0/3276938330 conn(0x5596ddbfb400 msgr2=0x5596ddda4000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 -- 172.21.15.59:0/3276938330 shutdown_connections 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 -- 172.21.15.59:0/3276938330 wait complete. 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 -- 172.21.15.59:0/4140475229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfa800 msgr2=0x5596dcfe3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 --2- 172.21.15.59:0/4140475229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfa800 0x5596dcfe3b80 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x5596ddc91110 tx=0x5596ddbf2120 comp rx=0 tx=0).stop 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 -- 172.21.15.59:0/4140475229 shutdown_connections 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 --2- 172.21.15.59:0/4140475229 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5596ddbfbc00 0x5596dcfe3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 --2- 172.21.15.59:0/4140475229 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5596dce29c00 0x5596dcfe2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 --2- 172.21.15.59:0/4140475229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5596ddbfa800 0x5596dcfe3b80 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 -- 172.21.15.59:0/4140475229 >> 172.21.15.59:0/4140475229 conn(0x5596dce28c00 msgr2=0x5596dce56800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 -- 172.21.15.59:0/4140475229 shutdown_connections 2024-04-25T09:11:01.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.234+0000 7fe21902c400 1 -- 172.21.15.59:0/4140475229 wait complete. 2024-04-25T09:11:01.230 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.069573, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-04-25T09:11:01.231 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:11:01.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:11:01.344 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:11:01.422 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:11:01.422 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:01.422 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:01.431 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:11:01.431 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:11:01.431 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:01.440 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:11:01.440 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:01.440 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:01.482 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:11:01.482 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:11:01.482 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:01.495 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:11:01.496 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50da400640 1 Processor -- start 2024-04-25T09:11:01.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50da400640 1 -- start start 2024-04-25T09:11:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50da400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f50d415b980 0x7f50d40cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50da400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4071970 0x7f50d40cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50da400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50d40ce7f0 con 0x7f50d415b5a0 2024-04-25T09:11:01.668 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50da400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50d40ce5b0 con 0x7f50d415b980 2024-04-25T09:11:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50da400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40cfcd0 con 0x7f50d4071970 2024-04-25T09:11:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d3400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f50d415b5a0 0x7f50d40cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42332/0 (socket says 172.21.15.59:42332) 2024-04-25T09:11:01.669 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d3400640 1 -- 172.21.15.59:0/352516252 learned_addr learned my addr 172.21.15.59:0/352516252 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50caa00640 1 --2- 172.21.15.59:0/352516252 >> v2:172.21.15.178:3300/0 conn(0x7f50d415b980 0x7f50d40cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d3e00640 1 --2- 172.21.15.59:0/352516252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4071970 0x7f50d40cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245950326 0 0) 0x7f50d40ce7f0 con 0x7f50d415b5a0 2024-04-25T09:11:01.670 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b8003530 con 0x7f50d415b5a0 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1639076744 0 0) 0x7f50b8003530 con 0x7f50d415b5a0 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4071970 msgr2=0x7f50d40cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 --2- 172.21.15.59:0/352516252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4071970 0x7f50d40cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 >> v2:172.21.15.178:3300/0 conn(0x7f50d415b980 msgr2=0x7f50d40cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 --2- 172.21.15.59:0/352516252 >> v2:172.21.15.178:3300/0 conn(0x7f50d415b980 0x7f50d40cbd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d40cead0 con 0x7f50d415b5a0 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f50c4001680 con 0x7f50d415b5a0 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 >> v1:172.21.15.59:6789/0 conn(0x7f50d415b5a0 legacy=0x7f50d40cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 --2- 172.21.15.59:0/352516252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50b80039c0 0x7f50b8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 --2- 172.21.15.59:0/352516252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b8004810 0x7f50b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 --2- 172.21.15.59:0/352516252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4071970 0x7f50b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40ce5b0 con 0x7f50b8004810 2024-04-25T09:11:01.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40cfcd0 con 0x7f50b80039c0 2024-04-25T09:11:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b800b9d0 con 0x7f50d4071970 2024-04-25T09:11:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50caa00640 1 --2- 172.21.15.59:0/352516252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b8004810 0x7f50b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.678+0000 7f50d3400640 1 --2- 172.21.15.59:0/352516252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50b80039c0 0x7f50b8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50d3e00640 1 --2- 172.21.15.59:0/352516252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4071970 0x7f50b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50caa00640 1 -- 172.21.15.59:0/352516252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4071970 msgr2=0x7f50b80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50caa00640 1 --2- 172.21.15.59:0/352516252 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d4071970 0x7f50b80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50caa00640 1 -- 172.21.15.59:0/352516252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50b80039c0 msgr2=0x7f50b8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50caa00640 1 --2- 172.21.15.59:0/352516252 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50b80039c0 0x7f50b8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50caa00640 1 -- 172.21.15.59:0/352516252 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8003530 con 0x7f50b8004810 2024-04-25T09:11:01.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50caa00640 1 --2- 172.21.15.59:0/352516252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b8004810 0x7f50b8004c90 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009ae0 tx=0x7f50bc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1671fceed43a4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0b2070 con 0x7f50b8004810 2024-04-25T09:11:01.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc0a55c0 con 0x7f50b8004810 2024-04-25T09:11:01.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50d2a00640 1 -- 172.21.15.59:0/352516252 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc0096b0 con 0x7f50b8004810 2024-04-25T09:11:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50da400640 1 -- 172.21.15.59:0/352516252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b8004810 msgr2=0x7f50b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50da400640 1 --2- 172.21.15.59:0/352516252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b8004810 0x7f50b8004c90 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009ae0 tx=0x7f50bc01ca50 comp rx=0 tx=0).stop 2024-04-25T09:11:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50d3e00640 1 -- 172.21.15.59:0/352516252 reap_dead start 2024-04-25T09:11:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50da400640 1 -- 172.21.15.59:0/352516252 shutdown_connections 2024-04-25T09:11:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.682+0000 7f50da400640 1 -- 172.21.15.59:0/352516252 >> 172.21.15.59:0/352516252 conn(0x7f50d40b3390 msgr2=0x7f50d40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50da400640 1 -- 172.21.15.59:0/352516252 shutdown_connections 2024-04-25T09:11:01.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50da400640 1 -- 172.21.15.59:0/352516252 wait complete. 2024-04-25T09:11:01.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50da400640 1 Processor -- start 2024-04-25T09:11:01.675 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50da400640 1 -- start start 2024-04-25T09:11:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50da400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b8004810 0x7f50d414e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50da400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d414c3a0 0x7f50d40b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50da400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d40d1180 0x7f50d40d1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50da400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40cc3f0 con 0x7f50b8004810 2024-04-25T09:11:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50da400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40cc270 con 0x7f50d414c3a0 2024-04-25T09:11:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50da400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50d40cc570 con 0x7f50d40d1180 2024-04-25T09:11:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50d3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b8004810 0x7f50d414e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50d3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b8004810 0x7f50d414e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48446/0 (socket says 172.21.15.59:48446) 2024-04-25T09:11:01.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50d3400640 1 -- 172.21.15.59:0/3420879214 learned_addr learned my addr 172.21.15.59:0/3420879214 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50caa00640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d414c3a0 0x7f50d40b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50d3e00640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d40d1180 0x7f50d40d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50d3400640 1 -- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d40d1180 msgr2=0x7f50d40d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50d3400640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d40d1180 0x7f50d40d1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50d3400640 1 -- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d414c3a0 msgr2=0x7f50d40b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50d3400640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d414c3a0 0x7f50d40b07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50d3400640 1 -- 172.21.15.59:0/3420879214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d414d320 con 0x7f50b8004810 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50d3e00640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d40d1180 0x7f50d40d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50d3400640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b8004810 0x7f50d414e3c0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f50c4012570 tx=0x7f50c4012a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50cbe00640 1 -- 172.21.15.59:0/3420879214 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4014810 con 0x7f50b8004810 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50cbe00640 1 -- 172.21.15.59:0/3420879214 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c401b070 con 0x7f50b8004810 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50cbe00640 1 -- 172.21.15.59:0/3420879214 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c4014c10 con 0x7f50b8004810 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.686+0000 7f50da400640 1 -- 172.21.15.59:0/3420879214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d414d600 con 0x7f50b8004810 2024-04-25T09:11:01.679 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.690+0000 7f50da400640 1 -- 172.21.15.59:0/3420879214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d414dbc0 con 0x7f50b8004810 2024-04-25T09:11:01.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.690+0000 7f50da400640 1 -- 172.21.15.59:0/3420879214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d40745d0 con 0x7f50b8004810 2024-04-25T09:11:01.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.690+0000 7f50cbe00640 1 -- 172.21.15.59:0/3420879214 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f50c4016480 con 0x7f50b8004810 2024-04-25T09:11:01.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.690+0000 7f50cbe00640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f50b0066f60 0x7f50b0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:01.680 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.690+0000 7f50cbe00640 1 -- 172.21.15.59:0/3420879214 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f50c4088580 con 0x7f50b8004810 2024-04-25T09:11:01.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.690+0000 7f50caa00640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f50b0066f60 0x7f50b0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:01.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.690+0000 7f50caa00640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f50b0066f60 0x7f50b0069420 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0af000 tx=0x7f50bc0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:01.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.694+0000 7f50cbe00640 1 -- 172.21.15.59:0/3420879214 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f50c4059300 con 0x7f50b8004810 2024-04-25T09:11:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 -- 172.21.15.59:0/3420879214 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f50d40cc960 con 0x7f50b8004810 2024-04-25T09:11:01.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50cbe00640 1 -- 172.21.15.59:0/3420879214 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 94 v94) v1 ==== 94+0+4149 (secure 0 0 0) 0x7f50c4058c00 con 0x7f50b8004810 2024-04-25T09:11:01.880 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:01.880 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":94,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":94,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:08.100794+0000","modified":"2024-04-25T09:11:01.150087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:01.880 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 94 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 -- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f50b0066f60 msgr2=0x7f50b0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f50b0066f60 0x7f50b0069420 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0af000 tx=0x7f50bc0046d0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 -- 172.21.15.59:0/3420879214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b8004810 msgr2=0x7f50d414e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b8004810 0x7f50d414e3c0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f50c4012570 tx=0x7f50c4012a30 comp rx=0 tx=0).stop 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 -- 172.21.15.59:0/3420879214 shutdown_connections 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f50b0066f60 0x7f50b0069420 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50d40d1180 0x7f50d40d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50d414c3a0 0x7f50d40b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 --2- 172.21.15.59:0/3420879214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50b8004810 0x7f50d414e3c0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 -- 172.21.15.59:0/3420879214 >> 172.21.15.59:0/3420879214 conn(0x7f50d40b3390 msgr2=0x7f50d40b6490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 -- 172.21.15.59:0/3420879214 shutdown_connections 2024-04-25T09:11:01.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:01.890+0000 7f50da400640 1 -- 172.21.15.59:0/3420879214 wait complete. 2024-04-25T09:11:01.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:02.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e6d200640 1 Processor -- start 2024-04-25T09:11:02.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e6d200640 1 -- start start 2024-04-25T09:11:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e6d200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e680b4920 0x7f0e680afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e6d200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6815ddf0 con 0x7f0e680d11b0 2024-04-25T09:11:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e6d200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6806b480 con 0x7f0e6815da10 2024-04-25T09:11:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e6d200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680d06d0 con 0x7f0e680b4920 2024-04-25T09:11:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e5d400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0e680d11b0 0x7f0e680b4210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42340/0 (socket says 172.21.15.59:42340) 2024-04-25T09:11:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e5d400640 1 -- 172.21.15.59:0/2508188656 learned_addr learned my addr 172.21.15.59:0/2508188656 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e66800640 1 --2- 172.21.15.59:0/2508188656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e680b4920 0x7f0e680afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e65400640 1 -- 172.21.15.59:0/2508188656 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467503204 0 0) 0x7f0e6815ddf0 con 0x7f0e680d11b0 2024-04-25T09:11:02.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e65400640 1 -- 172.21.15.59:0/2508188656 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e4c003530 con 0x7f0e680d11b0 2024-04-25T09:11:02.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e65400640 1 -- 172.21.15.59:0/2508188656 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620414940 0 0) 0x7f0e6806b480 con 0x7f0e6815da10 2024-04-25T09:11:02.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e65400640 1 -- 172.21.15.59:0/2508188656 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e6815ddf0 con 0x7f0e6815da10 2024-04-25T09:11:02.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e66800640 1 -- 172.21.15.59:0/2508188656 >> v1:172.21.15.178:6789/0 conn(0x7f0e6815da10 legacy=0x7f0e6806ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e65400640 1 -- 172.21.15.59:0/2508188656 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2562769098 0 0) 0x7f0e4c003530 con 0x7f0e680d11b0 2024-04-25T09:11:02.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e66800640 1 -- 172.21.15.59:0/2508188656 >> v1:172.21.15.59:6789/0 conn(0x7f0e680d11b0 legacy=0x7f0e680b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.054+0000 7f0e66800640 1 -- 172.21.15.59:0/2508188656 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680d09b0 con 0x7f0e680b4920 2024-04-25T09:11:02.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.058+0000 7f0e66800640 1 --2- 172.21.15.59:0/2508188656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e680b4920 0x7f0e680afe20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009dc0 tx=0x7f0e6001c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddef3a3a11f6388d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.058+0000 7f0e65400640 1 -- 172.21.15.59:0/2508188656 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e600b2070 con 0x7f0e680b4920 2024-04-25T09:11:02.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.058+0000 7f0e65400640 1 -- 172.21.15.59:0/2508188656 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e600a5570 con 0x7f0e680b4920 2024-04-25T09:11:02.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.058+0000 7f0e65400640 1 -- 172.21.15.59:0/2508188656 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50001680 con 0x7f0e680b4920 2024-04-25T09:11:02.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.058+0000 7f0e6d200640 1 -- 172.21.15.59:0/2508188656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e680b4920 msgr2=0x7f0e680afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.058+0000 7f0e6d200640 1 --2- 172.21.15.59:0/2508188656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e680b4920 0x7f0e680afe20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0e60009dc0 tx=0x7f0e6001c820 comp rx=0 tx=0).stop 2024-04-25T09:11:02.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.058+0000 7f0e6d200640 1 -- 172.21.15.59:0/2508188656 shutdown_connections 2024-04-25T09:11:02.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.058+0000 7f0e6d200640 1 --2- 172.21.15.59:0/2508188656 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e680b4920 0x7f0e680afe20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.058+0000 7f0e6d200640 1 -- 172.21.15.59:0/2508188656 >> 172.21.15.59:0/2508188656 conn(0x7f0e680b2400 msgr2=0x7f0e680b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.058+0000 7f0e6d200640 1 -- 172.21.15.59:0/2508188656 shutdown_connections 2024-04-25T09:11:02.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.058+0000 7f0e6d200640 1 -- 172.21.15.59:0/2508188656 wait complete. 2024-04-25T09:11:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e6d200640 1 Processor -- start 2024-04-25T09:11:02.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e6d200640 1 -- start start 2024-04-25T09:11:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e6d200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e680b4920 0x7f0e6815a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e6d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e680d11b0 0x7f0e6813c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e6d200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e6815da10 0x7f0e680c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e6d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6816b900 con 0x7f0e680d11b0 2024-04-25T09:11:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e6d200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6816b780 con 0x7f0e6815da10 2024-04-25T09:11:02.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e6d200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6816ba80 con 0x7f0e680b4920 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e5d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e680d11b0 0x7f0e6813c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e5d400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e680d11b0 0x7f0e6813c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48454/0 (socket says 172.21.15.59:48454) 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e5d400640 1 -- 172.21.15.59:0/121167777 learned_addr learned my addr 172.21.15.59:0/121167777 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e65e00640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e680b4920 0x7f0e6815a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e66800640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e6815da10 0x7f0e680c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e5d400640 1 -- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e680b4920 msgr2=0x7f0e6815a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e5d400640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e680b4920 0x7f0e6815a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e5d400640 1 -- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e6815da10 msgr2=0x7f0e680c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e5d400640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e6815da10 0x7f0e680c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e5d400640 1 -- 172.21.15.59:0/121167777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6813c880 con 0x7f0e680d11b0 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e5d400640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e680d11b0 0x7f0e6813c340 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c750 tx=0x7f0e5000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e5ea00640 1 -- 172.21.15.59:0/121167777 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50005af0 con 0x7f0e680d11b0 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e5ea00640 1 -- 172.21.15.59:0/121167777 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50005c90 con 0x7f0e680d11b0 2024-04-25T09:11:02.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e5ea00640 1 -- 172.21.15.59:0/121167777 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e500072b0 con 0x7f0e680d11b0 2024-04-25T09:11:02.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e6d200640 1 -- 172.21.15.59:0/121167777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e68159510 con 0x7f0e680d11b0 2024-04-25T09:11:02.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.062+0000 7f0e6d200640 1 -- 172.21.15.59:0/121167777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e68159ad0 con 0x7f0e680d11b0 2024-04-25T09:11:02.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.066+0000 7f0e6d200640 1 -- 172.21.15.59:0/121167777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e680745d0 con 0x7f0e680d11b0 2024-04-25T09:11:02.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.066+0000 7f0e5ea00640 1 -- 172.21.15.59:0/121167777 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0e50007450 con 0x7f0e680d11b0 2024-04-25T09:11:02.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.066+0000 7f0e5ea00640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e44066f60 0x7f0e44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.066+0000 7f0e5ea00640 1 -- 172.21.15.59:0/121167777 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f0e50085210 con 0x7f0e680d11b0 2024-04-25T09:11:02.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.066+0000 7f0e65e00640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e44066f60 0x7f0e44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.066+0000 7f0e65e00640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e44066f60 0x7f0e44069420 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0e580011f0 tx=0x7f0e58009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.070+0000 7f0e5ea00640 1 -- 172.21.15.59:0/121167777 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0e50055fd0 con 0x7f0e680d11b0 2024-04-25T09:11:02.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.238+0000 7f0e6d200640 1 -- 172.21.15.59:0/121167777 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e68073b20 con 0x7f0e680d11b0 2024-04-25T09:11:02.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.238+0000 7f0e5ea00640 1 -- 172.21.15.59:0/121167777 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+17241 (secure 0 0 0) 0x7f0e500558d0 con 0x7f0e680d11b0 2024-04-25T09:11:02.229 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:02.229 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":111,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:01.150100+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:06.512267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:07.092321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.24","mappings":[{"from":5,"to":4}]},{"pgid":"16.36","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/2009305668":"2024-04-26T09:11:01.150076+0000","172.21.15.59:6833/2009305668":"2024-04-26T09:11:01.150076+0000","172.21.15.59:6835/2867303658":"2024-04-26T09:10:24.428401+0000","172.21.15.59:6833/2867303658":"2024-04-26T09:10:24.428401+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.242+0000 7f0e6d200640 1 -- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e44066f60 msgr2=0x7f0e44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.242+0000 7f0e6d200640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e44066f60 0x7f0e44069420 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0e580011f0 tx=0x7f0e58009040 comp rx=0 tx=0).stop 2024-04-25T09:11:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.242+0000 7f0e6d200640 1 -- 172.21.15.59:0/121167777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e680d11b0 msgr2=0x7f0e6813c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.242+0000 7f0e6d200640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e680d11b0 0x7f0e6813c340 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c750 tx=0x7f0e5000cc10 comp rx=0 tx=0).stop 2024-04-25T09:11:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.242+0000 7f0e6d200640 1 -- 172.21.15.59:0/121167777 shutdown_connections 2024-04-25T09:11:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.242+0000 7f0e6d200640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e44066f60 0x7f0e44069420 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.242+0000 7f0e6d200640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e6815da10 0x7f0e680c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.242+0000 7f0e6d200640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e680d11b0 0x7f0e6813c340 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.242+0000 7f0e6d200640 1 --2- 172.21.15.59:0/121167777 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e680b4920 0x7f0e6815a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.242+0000 7f0e6d200640 1 -- 172.21.15.59:0/121167777 >> 172.21.15.59:0/121167777 conn(0x7f0e680b2400 msgr2=0x7f0e680b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.242+0000 7f0e6d200640 1 -- 172.21.15.59:0/121167777 shutdown_connections 2024-04-25T09:11:02.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.242+0000 7f0e6d200640 1 -- 172.21.15.59:0/121167777 wait complete. 2024-04-25T09:11:02.250 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:10:06.512267+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:10:07.092321+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:02.250 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:02.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87afc00640 1 Processor -- start 2024-04-25T09:11:02.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87afc00640 1 -- start start 2024-04-25T09:11:02.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87afc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87a815dc60 0x7f87a80d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87afc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f87a806bf30 0x7f87a80cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87afc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87a8099a60 0x7f87a8099ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87afc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a815e040 con 0x7f87a815dc60 2024-04-25T09:11:02.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87afc00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a80cff80 con 0x7f87a806bf30 2024-04-25T09:11:02.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87afc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80d0260 con 0x7f87a8099a60 2024-04-25T09:11:02.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87ad200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87a815dc60 0x7f87a80d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87ad200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f87a815dc60 0x7f87a80d1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48456/0 (socket says 172.21.15.59:48456) 2024-04-25T09:11:02.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87ad200640 1 -- 172.21.15.59:0/3076828647 learned_addr learned my addr 172.21.15.59:0/3076828647 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:02.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87a7e00640 1 --2- 172.21.15.59:0/3076828647 >> v2:172.21.15.178:3300/0 conn(0x7f87a806bf30 0x7f87a80cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87adc00640 1 --2- 172.21.15.59:0/3076828647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87a8099a60 0x7f87a8099ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87ad200640 1 -- 172.21.15.59:0/3076828647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87a8099a60 msgr2=0x7f87a8099ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87ad200640 1 --2- 172.21.15.59:0/3076828647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87a8099a60 0x7f87a8099ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87ad200640 1 -- 172.21.15.59:0/3076828647 >> v2:172.21.15.178:3300/0 conn(0x7f87a806bf30 msgr2=0x7f87a80cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87ad200640 1 --2- 172.21.15.59:0/3076828647 >> v2:172.21.15.178:3300/0 conn(0x7f87a806bf30 0x7f87a80cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.406+0000 7f87ad200640 1 -- 172.21.15.59:0/3076828647 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a80d0540 con 0x7f87a815dc60 2024-04-25T09:11:02.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87ad200640 1 --2- 172.21.15.59:0/3076828647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a815dc60 0x7f87a80d1020 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f87a80d2810 tx=0x7f879c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558721de5f660425 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87a7400640 1 -- 172.21.15.59:0/3076828647 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0b0070 con 0x7f87a815dc60 2024-04-25T09:11:02.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87a7400640 1 -- 172.21.15.59:0/3076828647 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c0ab600 con 0x7f87a815dc60 2024-04-25T09:11:02.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87a7400640 1 -- 172.21.15.59:0/3076828647 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0ab9d0 con 0x7f87a815dc60 2024-04-25T09:11:02.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87afc00640 1 -- 172.21.15.59:0/3076828647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a815dc60 msgr2=0x7f87a80d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87afc00640 1 --2- 172.21.15.59:0/3076828647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a815dc60 0x7f87a80d1020 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f87a80d2810 tx=0x7f879c01c490 comp rx=0 tx=0).stop 2024-04-25T09:11:02.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87afc00640 1 -- 172.21.15.59:0/3076828647 shutdown_connections 2024-04-25T09:11:02.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87afc00640 1 --2- 172.21.15.59:0/3076828647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87a8099a60 0x7f87a8099ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87afc00640 1 --2- 172.21.15.59:0/3076828647 >> v2:172.21.15.178:3300/0 conn(0x7f87a806bf30 0x7f87a80cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87afc00640 1 --2- 172.21.15.59:0/3076828647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a815dc60 0x7f87a80d1020 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87afc00640 1 -- 172.21.15.59:0/3076828647 >> 172.21.15.59:0/3076828647 conn(0x7f87a80b3200 msgr2=0x7f87a80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87afc00640 1 -- 172.21.15.59:0/3076828647 shutdown_connections 2024-04-25T09:11:02.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.410+0000 7f87afc00640 1 -- 172.21.15.59:0/3076828647 wait complete. 2024-04-25T09:11:02.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87afc00640 1 Processor -- start 2024-04-25T09:11:02.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87afc00640 1 -- start start 2024-04-25T09:11:02.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87afc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87a806bf30 0x7f87a80cb220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87afc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87a8099a60 0x7f87a8154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87afc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a815dc60 0x7f87a809e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87afc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80cc6f0 con 0x7f87a815dc60 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87afc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80cc570 con 0x7f87a8099a60 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87afc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80cc870 con 0x7f87a806bf30 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87adc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a815dc60 0x7f87a809e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87ad200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87a806bf30 0x7f87a80cb220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87ad200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87a806bf30 0x7f87a80cb220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:44304/0 (socket says 172.21.15.59:44304) 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87ad200640 1 -- 172.21.15.59:0/4007431914 learned_addr learned my addr 172.21.15.59:0/4007431914 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87a7e00640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87a8099a60 0x7f87a8154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87adc00640 1 -- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87a806bf30 msgr2=0x7f87a80cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87adc00640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87a806bf30 0x7f87a80cb220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87adc00640 1 -- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87a8099a60 msgr2=0x7f87a8154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87adc00640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87a8099a60 0x7f87a8154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87adc00640 1 -- 172.21.15.59:0/4007431914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a80c97a0 con 0x7f87a815dc60 2024-04-25T09:11:02.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87adc00640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a815dc60 0x7f87a809e7c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f87a000efc0 tx=0x7f87a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87a4c00640 1 -- 172.21.15.59:0/4007431914 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0018020 con 0x7f87a815dc60 2024-04-25T09:11:02.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87a4c00640 1 -- 172.21.15.59:0/4007431914 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a0014480 con 0x7f87a815dc60 2024-04-25T09:11:02.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87a4c00640 1 -- 172.21.15.59:0/4007431914 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a0014870 con 0x7f87a815dc60 2024-04-25T09:11:02.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87afc00640 1 -- 172.21.15.59:0/4007431914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a80c9a80 con 0x7f87a815dc60 2024-04-25T09:11:02.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87afc00640 1 -- 172.21.15.59:0/4007431914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a815ae70 con 0x7f87a815dc60 2024-04-25T09:11:02.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.414+0000 7f87afc00640 1 -- 172.21.15.59:0/4007431914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a80745d0 con 0x7f87a815dc60 2024-04-25T09:11:02.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.418+0000 7f87a4c00640 1 -- 172.21.15.59:0/4007431914 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f87a001b020 con 0x7f87a815dc60 2024-04-25T09:11:02.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.418+0000 7f87a4c00640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8788066f60 0x7f8788069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.418+0000 7f87a4c00640 1 -- 172.21.15.59:0/4007431914 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f87a0085f90 con 0x7f87a815dc60 2024-04-25T09:11:02.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.418+0000 7f87ad200640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8788066f60 0x7f8788069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.418+0000 7f87ad200640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8788066f60 0x7f8788069420 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f879c01c4d0 tx=0x7f879c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.422+0000 7f87a4c00640 1 -- 172.21.15.59:0/4007431914 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f87a0022030 con 0x7f87a815dc60 2024-04-25T09:11:02.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.586+0000 7f87afc00640 1 -- 172.21.15.59:0/4007431914 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f87a80b7590 con 0x7f87a815dc60 2024-04-25T09:11:02.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.586+0000 7f87a4c00640 1 -- 172.21.15.59:0/4007431914 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v111) v1 ==== 93+0+10 (secure 0 0 0) 0x7f87a0010040 con 0x7f87a815dc60 2024-04-25T09:11:02.577 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:11:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.590+0000 7f87afc00640 1 -- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8788066f60 msgr2=0x7f8788069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.590+0000 7f87afc00640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8788066f60 0x7f8788069420 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f879c01c4d0 tx=0x7f879c008040 comp rx=0 tx=0).stop 2024-04-25T09:11:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.590+0000 7f87afc00640 1 -- 172.21.15.59:0/4007431914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a815dc60 msgr2=0x7f87a809e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.590+0000 7f87afc00640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a815dc60 0x7f87a809e7c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f87a000efc0 tx=0x7f87a000c490 comp rx=0 tx=0).stop 2024-04-25T09:11:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.590+0000 7f87afc00640 1 -- 172.21.15.59:0/4007431914 shutdown_connections 2024-04-25T09:11:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.590+0000 7f87afc00640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8788066f60 0x7f8788069420 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.590+0000 7f87afc00640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87a815dc60 0x7f87a809e7c0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.590+0000 7f87afc00640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f87a8099a60 0x7f87a8154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.590+0000 7f87afc00640 1 --2- 172.21.15.59:0/4007431914 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f87a806bf30 0x7f87a80cb220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.590+0000 7f87afc00640 1 -- 172.21.15.59:0/4007431914 >> 172.21.15.59:0/4007431914 conn(0x7f87a80b3200 msgr2=0x7f87a80cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.590+0000 7f87afc00640 1 -- 172.21.15.59:0/4007431914 shutdown_connections 2024-04-25T09:11:02.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.590+0000 7f87afc00640 1 -- 172.21.15.59:0/4007431914 wait complete. 2024-04-25T09:11:02.597 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:11:02.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0dfa00640 1 Processor -- start 2024-04-25T09:11:02.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0dfa00640 1 -- start start 2024-04-25T09:11:02.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0dfa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0d80b3090 0x7fd0d80b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0dfa00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d815bc40 con 0x7fd0d815acd0 2024-04-25T09:11:02.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0dfa00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d815b3a0 con 0x7fd0d8144120 2024-04-25T09:11:02.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0dfa00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d815e490 con 0x7fd0d80b3090 2024-04-25T09:11:02.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0dda00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0d80b3090 0x7fd0d80b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0d7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd0d815acd0 0x7fd0d815e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42344/0 (socket says 172.21.15.59:42344) 2024-04-25T09:11:02.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0d7e00640 1 -- 172.21.15.59:0/252855150 learned_addr learned my addr 172.21.15.59:0/252855150 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:02.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0dda00640 1 -- 172.21.15.59:0/252855150 >> v1:172.21.15.178:6789/0 conn(0x7fd0d8144120 legacy=0x7fd0d80ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:02.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0dda00640 1 -- 172.21.15.59:0/252855150 >> v1:172.21.15.59:6789/0 conn(0x7fd0d815acd0 legacy=0x7fd0d815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0dda00640 1 -- 172.21.15.59:0/252855150 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d815b680 con 0x7fd0d80b3090 2024-04-25T09:11:02.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.754+0000 7fd0d7400640 1 -- 172.21.15.59:0/252855150 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771332975 0 0) 0x7fd0d815bc40 con 0x7fd0d815acd0 2024-04-25T09:11:02.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0dda00640 1 --2- 172.21.15.59:0/252855150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0d80b3090 0x7fd0d80b3520 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009d90 tx=0x7fd0d001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bf0e999bb62b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0d7400640 1 -- 172.21.15.59:0/252855150 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d00b2070 con 0x7fd0d80b3090 2024-04-25T09:11:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0d7400640 1 -- 172.21.15.59:0/252855150 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d00a5760 con 0x7fd0d80b3090 2024-04-25T09:11:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0d7400640 1 -- 172.21.15.59:0/252855150 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d00a5b30 con 0x7fd0d80b3090 2024-04-25T09:11:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0dfa00640 1 -- 172.21.15.59:0/252855150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0d80b3090 msgr2=0x7fd0d80b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0dfa00640 1 --2- 172.21.15.59:0/252855150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0d80b3090 0x7fd0d80b3520 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009d90 tx=0x7fd0d001c8a0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0dfa00640 1 -- 172.21.15.59:0/252855150 shutdown_connections 2024-04-25T09:11:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0dfa00640 1 --2- 172.21.15.59:0/252855150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0d80b3090 0x7fd0d80b3520 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0dfa00640 1 -- 172.21.15.59:0/252855150 >> 172.21.15.59:0/252855150 conn(0x7fd0d8067080 msgr2=0x7fd0d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0dfa00640 1 -- 172.21.15.59:0/252855150 shutdown_connections 2024-04-25T09:11:02.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0dfa00640 1 -- 172.21.15.59:0/252855150 wait complete. 2024-04-25T09:11:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0dfa00640 1 Processor -- start 2024-04-25T09:11:02.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.758+0000 7fd0dfa00640 1 -- start start 2024-04-25T09:11:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dfa00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d80b3090 0x7fd0d80cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dfa00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d8144120 0x7fd0d8158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dfa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0d815acd0 0x7fd0d815c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dfa00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d81687e0 con 0x7fd0d815acd0 2024-04-25T09:11:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dfa00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d8168660 con 0x7fd0d80b3090 2024-04-25T09:11:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dfa00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d8168960 con 0x7fd0d8144120 2024-04-25T09:11:02.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0d815acd0 0x7fd0d815c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dda00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0d815acd0 0x7fd0d815c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48490/0 (socket says 172.21.15.59:48490) 2024-04-25T09:11:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dda00640 1 -- 172.21.15.59:0/657982221 learned_addr learned my addr 172.21.15.59:0/657982221 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dd000640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d80b3090 0x7fd0d80cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0d7e00640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d8144120 0x7fd0d8158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dda00640 1 -- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d8144120 msgr2=0x7fd0d8158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dda00640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d8144120 0x7fd0d8158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dda00640 1 -- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d80b3090 msgr2=0x7fd0d80cbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dda00640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d80b3090 0x7fd0d80cbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dda00640 1 -- 172.21.15.59:0/657982221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d813ace0 con 0x7fd0d815acd0 2024-04-25T09:11:02.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0d7e00640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d8144120 0x7fd0d8158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dda00640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0d815acd0 0x7fd0d815c4c0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009d90 tx=0x7fd0d0019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0d4c00640 1 -- 172.21.15.59:0/657982221 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d00bd020 con 0x7fd0d815acd0 2024-04-25T09:11:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0d4c00640 1 -- 172.21.15.59:0/657982221 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d00b8670 con 0x7fd0d815acd0 2024-04-25T09:11:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0d4c00640 1 -- 172.21.15.59:0/657982221 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d00b2040 con 0x7fd0d815acd0 2024-04-25T09:11:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dfa00640 1 -- 172.21.15.59:0/657982221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d80af2b0 con 0x7fd0d815acd0 2024-04-25T09:11:02.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dfa00640 1 -- 172.21.15.59:0/657982221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d80af870 con 0x7fd0d815acd0 2024-04-25T09:11:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.762+0000 7fd0dfa00640 1 -- 172.21.15.59:0/657982221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d80af000 con 0x7fd0d815acd0 2024-04-25T09:11:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.766+0000 7fd0d4c00640 1 -- 172.21.15.59:0/657982221 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd0d00c0020 con 0x7fd0d815acd0 2024-04-25T09:11:02.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.766+0000 7fd0d4c00640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd0b8066f60 0x7fd0b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.766+0000 7fd0d4c00640 1 -- 172.21.15.59:0/657982221 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7fd0d0120150 con 0x7fd0d815acd0 2024-04-25T09:11:02.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.766+0000 7fd0dd000640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd0b8066f60 0x7fd0b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:02.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.766+0000 7fd0dd000640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd0b8066f60 0x7fd0b8069420 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc007fd0 tx=0x7fd0cc007e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:02.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.770+0000 7fd0d4c00640 1 -- 172.21.15.59:0/657982221 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd0d00c7070 con 0x7fd0d815acd0 2024-04-25T09:11:02.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.930+0000 7fd0dfa00640 1 -- 172.21.15.59:0/657982221 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd0d80b4490 con 0x7fd0d815acd0 2024-04-25T09:11:02.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.930+0000 7fd0d4c00640 1 -- 172.21.15.59:0/657982221 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v111) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd0d0016520 con 0x7fd0d815acd0 2024-04-25T09:11:02.921 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:11:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.934+0000 7fd0dfa00640 1 -- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd0b8066f60 msgr2=0x7fd0b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.934+0000 7fd0dfa00640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd0b8066f60 0x7fd0b8069420 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc007fd0 tx=0x7fd0cc007e40 comp rx=0 tx=0).stop 2024-04-25T09:11:02.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.934+0000 7fd0dfa00640 1 -- 172.21.15.59:0/657982221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0d815acd0 msgr2=0x7fd0d815c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.934+0000 7fd0dfa00640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0d815acd0 0x7fd0d815c4c0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fd0d0009d90 tx=0x7fd0d0019640 comp rx=0 tx=0).stop 2024-04-25T09:11:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.934+0000 7fd0dfa00640 1 -- 172.21.15.59:0/657982221 shutdown_connections 2024-04-25T09:11:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.934+0000 7fd0dfa00640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd0b8066f60 0x7fd0b8069420 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.934+0000 7fd0dfa00640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd0d815acd0 0x7fd0d815c4c0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.934+0000 7fd0dfa00640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0d8144120 0x7fd0d8158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.934+0000 7fd0dfa00640 1 --2- 172.21.15.59:0/657982221 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd0d80b3090 0x7fd0d80cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.934+0000 7fd0dfa00640 1 -- 172.21.15.59:0/657982221 >> 172.21.15.59:0/657982221 conn(0x7fd0d8067080 msgr2=0x7fd0d80b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.934+0000 7fd0dfa00640 1 -- 172.21.15.59:0/657982221 shutdown_connections 2024-04-25T09:11:02.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:02.934+0000 7fd0dfa00640 1 -- 172.21.15.59:0/657982221 wait complete. 2024-04-25T09:11:02.941 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:11:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.094+0000 7ff784800640 1 Processor -- start 2024-04-25T09:11:03.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.094+0000 7ff784800640 1 -- start start 2024-04-25T09:11:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.094+0000 7ff784800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff77c0d0150 0x7ff77c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.094+0000 7ff784800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c0b30d0 con 0x7ff77c0c72a0 2024-04-25T09:11:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff784800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c0ccf30 con 0x7ff77c15dc00 2024-04-25T09:11:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff784800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0cd860 con 0x7ff77c0d0150 2024-04-25T09:11:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff782800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff77c0c72a0 0x7ff77c0c54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42354/0 (socket says 172.21.15.59:42354) 2024-04-25T09:11:03.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff782800640 1 -- 172.21.15.59:0/89531315 learned_addr learned my addr 172.21.15.59:0/89531315 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff781400640 1 --2- 172.21.15.59:0/89531315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff77c0d0150 0x7ff77c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff780a00640 1 -- 172.21.15.59:0/89531315 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2135215140 0 0) 0x7ff77c0b30d0 con 0x7ff77c0c72a0 2024-04-25T09:11:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff780a00640 1 -- 172.21.15.59:0/89531315 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff764003530 con 0x7ff77c0c72a0 2024-04-25T09:11:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff780a00640 1 -- 172.21.15.59:0/89531315 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 371802741 0 0) 0x7ff77c0ccf30 con 0x7ff77c15dc00 2024-04-25T09:11:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff780a00640 1 -- 172.21.15.59:0/89531315 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff77c0b30d0 con 0x7ff77c15dc00 2024-04-25T09:11:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff780a00640 1 -- 172.21.15.59:0/89531315 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1060023997 0 0) 0x7ff764003530 con 0x7ff77c0c72a0 2024-04-25T09:11:03.087 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff781400640 1 -- 172.21.15.59:0/89531315 >> v1:172.21.15.178:6789/0 conn(0x7ff77c15dc00 legacy=0x7ff77c0c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff781400640 1 -- 172.21.15.59:0/89531315 >> v1:172.21.15.59:6789/0 conn(0x7ff77c0c72a0 legacy=0x7ff77c0c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff781400640 1 -- 172.21.15.59:0/89531315 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c0cd210 con 0x7ff77c0d0150 2024-04-25T09:11:03.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.098+0000 7ff781400640 1 --2- 172.21.15.59:0/89531315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff77c0d0150 0x7ff77c0af770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009820 tx=0x7ff76c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5826d22d58fd04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff780a00640 1 -- 172.21.15.59:0/89531315 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0b0070 con 0x7ff77c0d0150 2024-04-25T09:11:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff780a00640 1 -- 172.21.15.59:0/89531315 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c0ab400 con 0x7ff77c0d0150 2024-04-25T09:11:03.090 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff780a00640 1 -- 172.21.15.59:0/89531315 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778001a00 con 0x7ff77c0d0150 2024-04-25T09:11:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 -- 172.21.15.59:0/89531315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff77c0d0150 msgr2=0x7ff77c0af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 --2- 172.21.15.59:0/89531315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff77c0d0150 0x7ff77c0af770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009820 tx=0x7ff76c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 -- 172.21.15.59:0/89531315 shutdown_connections 2024-04-25T09:11:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 --2- 172.21.15.59:0/89531315 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff77c0d0150 0x7ff77c0af770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 -- 172.21.15.59:0/89531315 >> 172.21.15.59:0/89531315 conn(0x7ff77c0b2240 msgr2=0x7ff77c0b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 -- 172.21.15.59:0/89531315 shutdown_connections 2024-04-25T09:11:03.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 -- 172.21.15.59:0/89531315 wait complete. 2024-04-25T09:11:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 Processor -- start 2024-04-25T09:11:03.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 -- start start 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff77c0c72a0 0x7ff77c150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff77c0d0150 0x7ff77c14ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77c15dc00 0x7ff77c152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c16b650 con 0x7ff77c0d0150 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0cdf20 con 0x7ff77c15dc00 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff784800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c16b7d0 con 0x7ff77c0c72a0 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff781400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff77c0d0150 0x7ff77c14ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff781400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff77c0d0150 0x7ff77c14ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48492/0 (socket says 172.21.15.59:48492) 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff781e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff77c0c72a0 0x7ff77c150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.102+0000 7ff781400640 1 -- 172.21.15.59:0/2827531840 learned_addr learned my addr 172.21.15.59:0/2827531840 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff782800640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77c15dc00 0x7ff77c152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff781400640 1 -- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff77c0c72a0 msgr2=0x7ff77c150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.095 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff781400640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff77c0c72a0 0x7ff77c150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff781400640 1 -- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77c15dc00 msgr2=0x7ff77c152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff781400640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77c15dc00 0x7ff77c152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff781400640 1 -- 172.21.15.59:0/2827531840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c152b40 con 0x7ff77c0d0150 2024-04-25T09:11:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff781400640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff77c0d0150 0x7ff77c14ec90 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009820 tx=0x7ff76c019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff776000640 1 -- 172.21.15.59:0/2827531840 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0b8070 con 0x7ff77c0d0150 2024-04-25T09:11:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff776000640 1 -- 172.21.15.59:0/2827531840 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff76c004020 con 0x7ff77c0d0150 2024-04-25T09:11:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff784800640 1 -- 172.21.15.59:0/2827531840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77c151560 con 0x7ff77c0d0150 2024-04-25T09:11:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff776000640 1 -- 172.21.15.59:0/2827531840 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0b0040 con 0x7ff77c0d0150 2024-04-25T09:11:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff784800640 1 -- 172.21.15.59:0/2827531840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c151b20 con 0x7ff77c0d0150 2024-04-25T09:11:03.096 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff784800640 1 -- 172.21.15.59:0/2827531840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c0745d0 con 0x7ff77c0d0150 2024-04-25T09:11:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff776000640 1 -- 172.21.15.59:0/2827531840 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff76c003620 con 0x7ff77c0d0150 2024-04-25T09:11:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff776000640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff760066f90 0x7ff760069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.097 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.106+0000 7ff776000640 1 -- 172.21.15.59:0/2827531840 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7ff76c11eb30 con 0x7ff77c0d0150 2024-04-25T09:11:03.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.110+0000 7ff781e00640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff760066f90 0x7ff760069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.110+0000 7ff781e00640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff760066f90 0x7ff760069450 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff7700011f0 tx=0x7ff770009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:03.101 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.110+0000 7ff776000640 1 -- 172.21.15.59:0/2827531840 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff76c016010 con 0x7ff77c0d0150 2024-04-25T09:11:03.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.274+0000 7ff784800640 1 -- 172.21.15.59:0/2827531840 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff77c0cfe00 con 0x7ff77c0d0150 2024-04-25T09:11:03.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.274+0000 7ff776000640 1 -- 172.21.15.59:0/2827531840 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v111) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff76c0ef270 con 0x7ff77c0d0150 2024-04-25T09:11:03.265 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:11:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.278+0000 7ff784800640 1 -- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff760066f90 msgr2=0x7ff760069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.278+0000 7ff784800640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff760066f90 0x7ff760069450 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff7700011f0 tx=0x7ff770009040 comp rx=0 tx=0).stop 2024-04-25T09:11:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.278+0000 7ff784800640 1 -- 172.21.15.59:0/2827531840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff77c0d0150 msgr2=0x7ff77c14ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.278+0000 7ff784800640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff77c0d0150 0x7ff77c14ec90 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009820 tx=0x7ff76c019180 comp rx=0 tx=0).stop 2024-04-25T09:11:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.278+0000 7ff784800640 1 -- 172.21.15.59:0/2827531840 shutdown_connections 2024-04-25T09:11:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.278+0000 7ff784800640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff760066f90 0x7ff760069450 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.278+0000 7ff784800640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff77c15dc00 0x7ff77c152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.278+0000 7ff784800640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff77c0d0150 0x7ff77c14ec90 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.278+0000 7ff784800640 1 --2- 172.21.15.59:0/2827531840 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff77c0c72a0 0x7ff77c150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.278+0000 7ff784800640 1 -- 172.21.15.59:0/2827531840 >> 172.21.15.59:0/2827531840 conn(0x7ff77c0b2240 msgr2=0x7ff77c0af7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.278+0000 7ff784800640 1 -- 172.21.15.59:0/2827531840 shutdown_connections 2024-04-25T09:11:03.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.278+0000 7ff784800640 1 -- 172.21.15.59:0/2827531840 wait complete. 2024-04-25T09:11:03.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:03.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f6622200640 1 Processor -- start 2024-04-25T09:11:03.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f6622200640 1 -- start start 2024-04-25T09:11:03.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f6622200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f661c15b980 0x7f661c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f6622200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f661c071970 0x7f661c0cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f6622200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f661c0ce7f0 con 0x7f661c15b5a0 2024-04-25T09:11:03.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f6622200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661c0ce5b0 con 0x7f661c15b980 2024-04-25T09:11:03.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f6622200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661c0cfcd0 con 0x7f661c071970 2024-04-25T09:11:03.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f661aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f661c15b980 0x7f661c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f661aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f661c15b980 0x7f661c0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48504/0 (socket says 172.21.15.59:48504) 2024-04-25T09:11:03.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f661aa00640 1 -- 172.21.15.59:0/2257863144 learned_addr learned my addr 172.21.15.59:0/2257863144 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:03.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f661be00640 1 --2- 172.21.15.59:0/2257863144 >> v2:172.21.15.178:3300/0 conn(0x7f661c071970 0x7f661c0cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f661aa00640 1 -- 172.21.15.59:0/2257863144 >> v2:172.21.15.178:3300/0 conn(0x7f661c071970 msgr2=0x7f661c0cc270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:03.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f661aa00640 1 --2- 172.21.15.59:0/2257863144 >> v2:172.21.15.178:3300/0 conn(0x7f661c071970 0x7f661c0cc270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f661aa00640 1 -- 172.21.15.59:0/2257863144 >> v1:172.21.15.178:6789/0 conn(0x7f661c15b5a0 legacy=0x7f661c0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f661aa00640 1 -- 172.21.15.59:0/2257863144 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c0cead0 con 0x7f661c15b980 2024-04-25T09:11:03.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.438+0000 7f661be00640 1 --2- 172.21.15.59:0/2257863144 >> v2:172.21.15.178:3300/0 conn(0x7f661c071970 0x7f661c0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:03.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f661aa00640 1 --2- 172.21.15.59:0/2257863144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c15b980 0x7f661c0cbd30 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f661c070860 tx=0x7f660801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c392593670056 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:03.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f661a000640 1 -- 172.21.15.59:0/2257863144 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080a9400 con 0x7f661c15b980 2024-04-25T09:11:03.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f661a000640 1 -- 172.21.15.59:0/2257863144 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66080a95a0 con 0x7f661c15b980 2024-04-25T09:11:03.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f661a000640 1 -- 172.21.15.59:0/2257863144 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080a9970 con 0x7f661c15b980 2024-04-25T09:11:03.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f6622200640 1 -- 172.21.15.59:0/2257863144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c15b980 msgr2=0x7f661c0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f6622200640 1 --2- 172.21.15.59:0/2257863144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c15b980 0x7f661c0cbd30 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f661c070860 tx=0x7f660801c520 comp rx=0 tx=0).stop 2024-04-25T09:11:03.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f6622200640 1 -- 172.21.15.59:0/2257863144 shutdown_connections 2024-04-25T09:11:03.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f6622200640 1 --2- 172.21.15.59:0/2257863144 >> v2:172.21.15.178:3300/0 conn(0x7f661c071970 0x7f661c0cc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f6622200640 1 --2- 172.21.15.59:0/2257863144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c15b980 0x7f661c0cbd30 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f6622200640 1 -- 172.21.15.59:0/2257863144 >> 172.21.15.59:0/2257863144 conn(0x7f661c0b3390 msgr2=0x7f661c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:03.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f6622200640 1 -- 172.21.15.59:0/2257863144 shutdown_connections 2024-04-25T09:11:03.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f6622200640 1 -- 172.21.15.59:0/2257863144 wait complete. 2024-04-25T09:11:03.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.442+0000 7f6622200640 1 Processor -- start 2024-04-25T09:11:03.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6622200640 1 -- start start 2024-04-25T09:11:03.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6622200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f661c071970 0x7f661c1500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6622200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c15b5a0 0x7f661c14a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6622200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f661c15b980 0x7f661c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6622200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c0d0d20 con 0x7f661c15b5a0 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6622200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661c0d0ba0 con 0x7f661c071970 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6622200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661c0d0ea0 con 0x7f661c15b980 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f661aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c15b5a0 0x7f661c14a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f661aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c15b5a0 0x7f661c14a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48512/0 (socket says 172.21.15.59:48512) 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f661aa00640 1 -- 172.21.15.59:0/3899693293 learned_addr learned my addr 172.21.15.59:0/3899693293 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f661b400640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f661c071970 0x7f661c1500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f661be00640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f661c15b980 0x7f661c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f661aa00640 1 -- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f661c15b980 msgr2=0x7f661c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f661aa00640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f661c15b980 0x7f661c14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f661aa00640 1 -- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f661c071970 msgr2=0x7f661c1500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f661aa00640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f661c071970 0x7f661c1500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f661aa00640 1 -- 172.21.15.59:0/3899693293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c06d9e0 con 0x7f661c15b5a0 2024-04-25T09:11:03.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f661aa00640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c15b5a0 0x7f661c14a640 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f6608019130 tx=0x7f66080192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:03.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6613400640 1 -- 172.21.15.59:0/3899693293 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080a9400 con 0x7f661c15b5a0 2024-04-25T09:11:03.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6613400640 1 -- 172.21.15.59:0/3899693293 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66080a8b20 con 0x7f661c15b5a0 2024-04-25T09:11:03.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6613400640 1 -- 172.21.15.59:0/3899693293 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66080a9e20 con 0x7f661c15b5a0 2024-04-25T09:11:03.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6622200640 1 -- 172.21.15.59:0/3899693293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661c14e400 con 0x7f661c15b5a0 2024-04-25T09:11:03.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6622200640 1 -- 172.21.15.59:0/3899693293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661c06d1b0 con 0x7f661c15b5a0 2024-04-25T09:11:03.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.446+0000 7f6622200640 1 -- 172.21.15.59:0/3899693293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f661c0745d0 con 0x7f661c15b5a0 2024-04-25T09:11:03.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.450+0000 7f6613400640 1 -- 172.21.15.59:0/3899693293 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f66080c0060 con 0x7f661c15b5a0 2024-04-25T09:11:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.450+0000 7f6613400640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f65fc066f60 0x7f65fc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.450+0000 7f6613400640 1 -- 172.21.15.59:0/3899693293 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f660811f290 con 0x7f661c15b5a0 2024-04-25T09:11:03.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.450+0000 7f661b400640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f65fc066f60 0x7f65fc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.440 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.450+0000 7f661b400640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f65fc066f60 0x7f65fc069420 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f660c001810 tx=0x7f660c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:03.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.454+0000 7f6613400640 1 -- 172.21.15.59:0/3899693293 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f66080ad020 con 0x7f661c15b5a0 2024-04-25T09:11:03.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.650+0000 7f6622200640 1 -- 172.21.15.59:0/3899693293 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f661c15ad70 con 0x7f661c15b5a0 2024-04-25T09:11:03.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.650+0000 7f6613400640 1 -- 172.21.15.59:0/3899693293 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4937 (secure 0 0 0) 0x7f6608016110 con 0x7f661c15b5a0 2024-04-25T09:11:03.640 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:03.640 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":95,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":8799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/648458124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":648458124},{"type":"v1","addr":"172.21.15.59:6835","nonce":648458124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":94,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:08.100794+0000","modified":"2024-04-25T09:11:01.150087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:03.640 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 95 2024-04-25T09:11:03.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.654+0000 7f6622200640 1 -- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f65fc066f60 msgr2=0x7f65fc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.654+0000 7f6622200640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f65fc066f60 0x7f65fc069420 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f660c001810 tx=0x7f660c009040 comp rx=0 tx=0).stop 2024-04-25T09:11:03.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.654+0000 7f6622200640 1 -- 172.21.15.59:0/3899693293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c15b5a0 msgr2=0x7f661c14a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.654+0000 7f6622200640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c15b5a0 0x7f661c14a640 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f6608019130 tx=0x7f66080192c0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.654+0000 7f6622200640 1 -- 172.21.15.59:0/3899693293 shutdown_connections 2024-04-25T09:11:03.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.654+0000 7f6622200640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f65fc066f60 0x7f65fc069420 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.654+0000 7f6622200640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f661c15b980 0x7f661c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.654+0000 7f6622200640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f661c15b5a0 0x7f661c14a640 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.654+0000 7f6622200640 1 --2- 172.21.15.59:0/3899693293 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f661c071970 0x7f661c1500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.654+0000 7f6622200640 1 -- 172.21.15.59:0/3899693293 >> 172.21.15.59:0/3899693293 conn(0x7f661c0b3390 msgr2=0x7f661c15f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:03.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.654+0000 7f6622200640 1 -- 172.21.15.59:0/3899693293 shutdown_connections 2024-04-25T09:11:03.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.654+0000 7f6622200640 1 -- 172.21.15.59:0/3899693293 wait complete. 2024-04-25T09:11:03.661 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:03.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33db800640 1 Processor -- start 2024-04-25T09:11:03.803 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33db800640 1 -- start start 2024-04-25T09:11:03.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33db800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33d415b860 0x7f33d415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33db800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f33d4072c70 0x7f33d40cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33db800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d415c180 con 0x7f33d40cd540 2024-04-25T09:11:03.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33db800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d415f4e0 con 0x7f33d4072c70 2024-04-25T09:11:03.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33db800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d415c430 con 0x7f33d415b860 2024-04-25T09:11:03.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33d9800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f33d40cd540 0x7f33d406ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42362/0 (socket says 172.21.15.59:42362) 2024-04-25T09:11:03.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33d9800640 1 -- 172.21.15.59:0/1338720469 learned_addr learned my addr 172.21.15.59:0/1338720469 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:03.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33d8e00640 1 --2- 172.21.15.59:0/1338720469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33d415b860 0x7f33d415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33cbe00640 1 --2- 172.21.15.59:0/1338720469 >> v2:172.21.15.178:3300/0 conn(0x7f33d4072c70 0x7f33d40cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33d3e00640 1 -- 172.21.15.59:0/1338720469 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925580384 0 0) 0x7f33d415c180 con 0x7f33d40cd540 2024-04-25T09:11:03.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.814+0000 7f33d3e00640 1 -- 172.21.15.59:0/1338720469 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33b8003530 con 0x7f33d40cd540 2024-04-25T09:11:03.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.818+0000 7f33d8e00640 1 -- 172.21.15.59:0/1338720469 >> v2:172.21.15.178:3300/0 conn(0x7f33d4072c70 msgr2=0x7f33d40cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:03.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.818+0000 7f33d8e00640 1 --2- 172.21.15.59:0/1338720469 >> v2:172.21.15.178:3300/0 conn(0x7f33d4072c70 0x7f33d40cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.818+0000 7f33d8e00640 1 -- 172.21.15.59:0/1338720469 >> v1:172.21.15.59:6789/0 conn(0x7f33d40cd540 legacy=0x7f33d406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.807 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.818+0000 7f33d8e00640 1 -- 172.21.15.59:0/1338720469 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d415c710 con 0x7f33d415b860 2024-04-25T09:11:03.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.818+0000 7f33d8e00640 1 --2- 172.21.15.59:0/1338720469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33d415b860 0x7f33d415bc40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f33c40097c0 tx=0x7f33c401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c451bac3923560e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:03.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.818+0000 7f33d3e00640 1 -- 172.21.15.59:0/1338720469 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c40ab610 con 0x7f33d415b860 2024-04-25T09:11:03.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.818+0000 7f33d3e00640 1 -- 172.21.15.59:0/1338720469 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c40b0070 con 0x7f33d415b860 2024-04-25T09:11:03.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.818+0000 7f33d3e00640 1 -- 172.21.15.59:0/1338720469 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c40ab9d0 con 0x7f33d415b860 2024-04-25T09:11:03.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 -- 172.21.15.59:0/1338720469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33d415b860 msgr2=0x7f33d415bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 --2- 172.21.15.59:0/1338720469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33d415b860 0x7f33d415bc40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f33c40097c0 tx=0x7f33c401c470 comp rx=0 tx=0).stop 2024-04-25T09:11:03.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 -- 172.21.15.59:0/1338720469 shutdown_connections 2024-04-25T09:11:03.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 --2- 172.21.15.59:0/1338720469 >> v2:172.21.15.178:3300/0 conn(0x7f33d4072c70 0x7f33d40cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 --2- 172.21.15.59:0/1338720469 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33d415b860 0x7f33d415bc40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 -- 172.21.15.59:0/1338720469 >> 172.21.15.59:0/1338720469 conn(0x7f33d40b2400 msgr2=0x7f33d40b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:03.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 -- 172.21.15.59:0/1338720469 shutdown_connections 2024-04-25T09:11:03.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 -- 172.21.15.59:0/1338720469 wait complete. 2024-04-25T09:11:03.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 Processor -- start 2024-04-25T09:11:03.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 -- start start 2024-04-25T09:11:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33d4072c70 0x7f33d40b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33d40cd540 0x7f33d40afc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33d415b860 0x7f33d414f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d40731d0 con 0x7f33d40cd540 2024-04-25T09:11:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d4073050 con 0x7f33d4072c70 2024-04-25T09:11:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33db800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d406b320 con 0x7f33d415b860 2024-04-25T09:11:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33cbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33d40cd540 0x7f33d40afc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33cbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33d40cd540 0x7f33d40afc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48514/0 (socket says 172.21.15.59:48514) 2024-04-25T09:11:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33cbe00640 1 -- 172.21.15.59:0/3858212823 learned_addr learned my addr 172.21.15.59:0/3858212823 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33d8e00640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33d4072c70 0x7f33d40b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33d9800640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33d415b860 0x7f33d414f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33cbe00640 1 -- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33d415b860 msgr2=0x7f33d414f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33cbe00640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33d415b860 0x7f33d414f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33cbe00640 1 -- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33d4072c70 msgr2=0x7f33d40b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33cbe00640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33d4072c70 0x7f33d40b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33cbe00640 1 -- 172.21.15.59:0/3858212823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d4147550 con 0x7f33d40cd540 2024-04-25T09:11:03.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.822+0000 7f33cbe00640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33d40cd540 0x7f33d40afc50 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00e960 tx=0x7f33bc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:03.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.826+0000 7f33d1600640 1 -- 172.21.15.59:0/3858212823 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc017070 con 0x7f33d40cd540 2024-04-25T09:11:03.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.826+0000 7f33d1600640 1 -- 172.21.15.59:0/3858212823 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc00ca00 con 0x7f33d40cd540 2024-04-25T09:11:03.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.826+0000 7f33db800640 1 -- 172.21.15.59:0/3858212823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d414e650 con 0x7f33d40cd540 2024-04-25T09:11:03.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.826+0000 7f33d1600640 1 -- 172.21.15.59:0/3858212823 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc00cdb0 con 0x7f33d40cd540 2024-04-25T09:11:03.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.826+0000 7f33db800640 1 -- 172.21.15.59:0/3858212823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d414ec10 con 0x7f33d40cd540 2024-04-25T09:11:03.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.826+0000 7f33db800640 1 -- 172.21.15.59:0/3858212823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d40745d0 con 0x7f33d40cd540 2024-04-25T09:11:03.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.826+0000 7f33d1600640 1 -- 172.21.15.59:0/3858212823 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f33bc01a070 con 0x7f33d40cd540 2024-04-25T09:11:03.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.826+0000 7f33d1600640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f33b0066f90 0x7f33b0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:03.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.826+0000 7f33d1600640 1 -- 172.21.15.59:0/3858212823 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f33bc0852b0 con 0x7f33d40cd540 2024-04-25T09:11:03.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.826+0000 7f33d8e00640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f33b0066f90 0x7f33b0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:03.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.830+0000 7f33d8e00640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f33b0066f90 0x7f33b0069450 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f33c40af000 tx=0x7f33c40a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:03.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.830+0000 7f33d1600640 1 -- 172.21.15.59:0/3858212823 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f33d4147550 con 0x7f33d40cd540 2024-04-25T09:11:03.986 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 -- 172.21.15.59:0/3858212823 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33d4072550 con 0x7f33d40cd540 2024-04-25T09:11:03.987 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33d1600640 1 -- 172.21.15.59:0/3858212823 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+17241 (secure 0 0 0) 0x7f33bc055960 con 0x7f33d40cd540 2024-04-25T09:11:03.988 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:03.988 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":111,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:01.150100+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:06.512267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:07.092321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.24","mappings":[{"from":5,"to":4}]},{"pgid":"16.36","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/2009305668":"2024-04-26T09:11:01.150076+0000","172.21.15.59:6833/2009305668":"2024-04-26T09:11:01.150076+0000","172.21.15.59:6835/2867303658":"2024-04-26T09:10:24.428401+0000","172.21.15.59:6833/2867303658":"2024-04-26T09:10:24.428401+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:03.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 -- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f33b0066f90 msgr2=0x7f33b0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f33b0066f90 0x7f33b0069450 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f33c40af000 tx=0x7f33c40a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 -- 172.21.15.59:0/3858212823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33d40cd540 msgr2=0x7f33d40afc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33d40cd540 0x7f33d40afc50 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00e960 tx=0x7f33bc00ee20 comp rx=0 tx=0).stop 2024-04-25T09:11:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 -- 172.21.15.59:0/3858212823 shutdown_connections 2024-04-25T09:11:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f33b0066f90 0x7f33b0069450 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f33d415b860 0x7f33d414f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33d40cd540 0x7f33d40afc50 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 --2- 172.21.15.59:0/3858212823 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f33d4072c70 0x7f33d40b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 -- 172.21.15.59:0/3858212823 >> 172.21.15.59:0/3858212823 conn(0x7f33d40b2400 msgr2=0x7f33d40cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 -- 172.21.15.59:0/3858212823 shutdown_connections 2024-04-25T09:11:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:03.998+0000 7f33db800640 1 -- 172.21.15.59:0/3858212823 wait complete. 2024-04-25T09:11:04.009 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:11:04.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa2ac00640 1 Processor -- start 2024-04-25T09:11:04.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa2ac00640 1 -- start start 2024-04-25T09:11:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa2ac00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa240cdb70 0x7ffa240b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa2ac00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa240cd6c0 con 0x7ffa2415efa0 2024-04-25T09:11:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa2ac00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa240cce20 con 0x7ffa2409a170 2024-04-25T09:11:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa2ac00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa240b3fe0 con 0x7ffa240cdb70 2024-04-25T09:11:04.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa29800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffa2415efa0 0x7ffa24099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42370/0 (socket says 172.21.15.59:42370) 2024-04-25T09:11:04.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa29800640 1 -- 172.21.15.59:0/2674803892 learned_addr learned my addr 172.21.15.59:0/2674803892 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:04.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa2a200640 1 --2- 172.21.15.59:0/2674803892 >> v2:172.21.15.59:3300/0 conn(0x7ffa240cdb70 0x7ffa240b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa23e00640 1 -- 172.21.15.59:0/2674803892 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3628739075 0 0) 0x7ffa240cd6c0 con 0x7ffa2415efa0 2024-04-25T09:11:04.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa23e00640 1 -- 172.21.15.59:0/2674803892 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa0c003530 con 0x7ffa2415efa0 2024-04-25T09:11:04.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa2a200640 1 -- 172.21.15.59:0/2674803892 >> v1:172.21.15.178:6789/0 conn(0x7ffa2409a170 legacy=0x7ffa240b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa2a200640 1 -- 172.21.15.59:0/2674803892 >> v1:172.21.15.59:6789/0 conn(0x7ffa2415efa0 legacy=0x7ffa24099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.162+0000 7ffa2a200640 1 -- 172.21.15.59:0/2674803892 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa240cd100 con 0x7ffa240cdb70 2024-04-25T09:11:04.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa2a200640 1 --2- 172.21.15.59:0/2674803892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa240cdb70 0x7ffa240b18b0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c009d90 tx=0x7ffa240b2600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716e477ab8761581 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa23e00640 1 -- 172.21.15.59:0/2674803892 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0b2070 con 0x7ffa240cdb70 2024-04-25T09:11:04.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa23e00640 1 -- 172.21.15.59:0/2674803892 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c0a5830 con 0x7ffa240cdb70 2024-04-25T09:11:04.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa23e00640 1 -- 172.21.15.59:0/2674803892 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0a5c00 con 0x7ffa240cdb70 2024-04-25T09:11:04.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa2ac00640 1 -- 172.21.15.59:0/2674803892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa240cdb70 msgr2=0x7ffa240b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa2ac00640 1 --2- 172.21.15.59:0/2674803892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa240cdb70 0x7ffa240b18b0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c009d90 tx=0x7ffa240b2600 comp rx=0 tx=0).stop 2024-04-25T09:11:04.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa2ac00640 1 -- 172.21.15.59:0/2674803892 shutdown_connections 2024-04-25T09:11:04.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa2ac00640 1 --2- 172.21.15.59:0/2674803892 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa240cdb70 0x7ffa240b18b0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa2ac00640 1 -- 172.21.15.59:0/2674803892 >> 172.21.15.59:0/2674803892 conn(0x7ffa240b3050 msgr2=0x7ffa240b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:04.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa2ac00640 1 -- 172.21.15.59:0/2674803892 shutdown_connections 2024-04-25T09:11:04.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa2ac00640 1 -- 172.21.15.59:0/2674803892 wait complete. 2024-04-25T09:11:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa2ac00640 1 Processor -- start 2024-04-25T09:11:04.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.166+0000 7ffa2ac00640 1 -- start start 2024-04-25T09:11:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa2ac00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa2409a170 0x7ffa241534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa2ac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa240cdb70 0x7ffa240c7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa2ac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa2415efa0 0x7ffa240c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa2ac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa241696b0 con 0x7ffa240cdb70 2024-04-25T09:11:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa2ac00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa240b3dc0 con 0x7ffa2409a170 2024-04-25T09:11:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa2ac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa24169830 con 0x7ffa2415efa0 2024-04-25T09:11:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa28e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa240cdb70 0x7ffa240c7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa28e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa240cdb70 0x7ffa240c7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48532/0 (socket says 172.21.15.59:48532) 2024-04-25T09:11:04.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa28e00640 1 -- 172.21.15.59:0/3354061362 learned_addr learned my addr 172.21.15.59:0/3354061362 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:04.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa29800640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa2409a170 0x7ffa241534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa2a200640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa2415efa0 0x7ffa240c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa28e00640 1 -- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa2415efa0 msgr2=0x7ffa240c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa28e00640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa2415efa0 0x7ffa240c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa28e00640 1 -- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa2409a170 msgr2=0x7ffa241534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa28e00640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa2409a170 0x7ffa241534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa28e00640 1 -- 172.21.15.59:0/3354061362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa2406be50 con 0x7ffa240cdb70 2024-04-25T09:11:04.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa29800640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa2409a170 0x7ffa241534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:04.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa2a200640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa2415efa0 0x7ffa240c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:04.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa28e00640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa240cdb70 0x7ffa240c7260 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000c500 tx=0x7ffa1000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa21600640 1 -- 172.21.15.59:0/3354061362 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10016020 con 0x7ffa240cdb70 2024-04-25T09:11:04.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa21600640 1 -- 172.21.15.59:0/3354061362 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa10005220 con 0x7ffa240cdb70 2024-04-25T09:11:04.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa21600640 1 -- 172.21.15.59:0/3354061362 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa10007030 con 0x7ffa240cdb70 2024-04-25T09:11:04.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa2ac00640 1 -- 172.21.15.59:0/3354061362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2406c130 con 0x7ffa240cdb70 2024-04-25T09:11:04.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa2ac00640 1 -- 172.21.15.59:0/3354061362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2406c6f0 con 0x7ffa240cdb70 2024-04-25T09:11:04.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.170+0000 7ffa2ac00640 1 -- 172.21.15.59:0/3354061362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2406c8f0 con 0x7ffa240cdb70 2024-04-25T09:11:04.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.174+0000 7ffa21600640 1 -- 172.21.15.59:0/3354061362 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffa100071f0 con 0x7ffa240cdb70 2024-04-25T09:11:04.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.174+0000 7ffa21600640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffa04066f90 0x7ffa04069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.174+0000 7ffa21600640 1 -- 172.21.15.59:0/3354061362 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7ffa10084c60 con 0x7ffa240cdb70 2024-04-25T09:11:04.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.174+0000 7ffa29800640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffa04066f90 0x7ffa04069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.174+0000 7ffa29800640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffa04066f90 0x7ffa04069450 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ffa180011f0 tx=0x7ffa18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.178+0000 7ffa21600640 1 -- 172.21.15.59:0/3354061362 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffa2406c8f0 con 0x7ffa240cdb70 2024-04-25T09:11:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.370+0000 7ffa2ac00640 1 -- 172.21.15.59:0/3354061362 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa2404efa0 con 0x7ffa240cdb70 2024-04-25T09:11:04.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.370+0000 7ffa21600640 1 -- 172.21.15.59:0/3354061362 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4937 (secure 0 0 0) 0x7ffa10020020 con 0x7ffa240cdb70 2024-04-25T09:11:04.361 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:04.361 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":95,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":8799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/648458124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":648458124},{"type":"v1","addr":"172.21.15.59:6835","nonce":648458124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":94,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:08.100794+0000","modified":"2024-04-25T09:11:01.150087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:04.362 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 95 2024-04-25T09:11:04.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.374+0000 7ffa2ac00640 1 -- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffa04066f90 msgr2=0x7ffa04069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.374+0000 7ffa2ac00640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffa04066f90 0x7ffa04069450 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ffa180011f0 tx=0x7ffa18009040 comp rx=0 tx=0).stop 2024-04-25T09:11:04.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.374+0000 7ffa2ac00640 1 -- 172.21.15.59:0/3354061362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa240cdb70 msgr2=0x7ffa240c7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.374+0000 7ffa2ac00640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa240cdb70 0x7ffa240c7260 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000c500 tx=0x7ffa1000c9c0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.374+0000 7ffa2ac00640 1 -- 172.21.15.59:0/3354061362 shutdown_connections 2024-04-25T09:11:04.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.374+0000 7ffa2ac00640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffa04066f90 0x7ffa04069450 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.374+0000 7ffa2ac00640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffa2415efa0 0x7ffa240c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.374+0000 7ffa2ac00640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa240cdb70 0x7ffa240c7260 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.374+0000 7ffa2ac00640 1 --2- 172.21.15.59:0/3354061362 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffa2409a170 0x7ffa241534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.374+0000 7ffa2ac00640 1 -- 172.21.15.59:0/3354061362 >> 172.21.15.59:0/3354061362 conn(0x7ffa240b3050 msgr2=0x7ffa24154340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:04.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.374+0000 7ffa2ac00640 1 -- 172.21.15.59:0/3354061362 shutdown_connections 2024-04-25T09:11:04.364 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.374+0000 7ffa2ac00640 1 -- 172.21.15.59:0/3354061362 wait complete. 2024-04-25T09:11:04.383 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:04.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.534+0000 7fb2de200640 1 Processor -- start 2024-04-25T09:11:04.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.534+0000 7fb2de200640 1 -- start start 2024-04-25T09:11:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.534+0000 7fb2de200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb2d815fe50 0x7fb2d80b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.534+0000 7fb2de200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2d80b1c90 0x7fb2d815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.534+0000 7fb2de200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80b20a0 con 0x7fb2d8145270 2024-04-25T09:11:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.534+0000 7fb2de200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d8145650 con 0x7fb2d80b1c90 2024-04-25T09:11:04.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.534+0000 7fb2de200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d81602b0 con 0x7fb2d815fe50 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.534+0000 7fb2d7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2d80b1c90 0x7fb2d815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.534+0000 7fb2d7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2d80b1c90 0x7fb2d815bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48536/0 (socket says 172.21.15.59:48536) 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.534+0000 7fb2d7e00640 1 -- 172.21.15.59:0/4231427158 learned_addr learned my addr 172.21.15.59:0/4231427158 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.534+0000 7fb2d6a00640 1 --2- 172.21.15.59:0/4231427158 >> v2:172.21.15.178:3300/0 conn(0x7fb2d815fe50 0x7fb2d80b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2d7e00640 1 -- 172.21.15.59:0/4231427158 >> v2:172.21.15.178:3300/0 conn(0x7fb2d815fe50 msgr2=0x7fb2d80b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2d7e00640 1 --2- 172.21.15.59:0/4231427158 >> v2:172.21.15.178:3300/0 conn(0x7fb2d815fe50 0x7fb2d80b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2d7e00640 1 -- 172.21.15.59:0/4231427158 >> v1:172.21.15.178:6789/0 conn(0x7fb2d8145270 legacy=0x7fb2d80cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2d7e00640 1 -- 172.21.15.59:0/4231427158 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80cc4e0 con 0x7fb2d80b1c90 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2d7e00640 1 --2- 172.21.15.59:0/4231427158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d80b1c90 0x7fb2d815bd80 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80b24b0 tx=0x7fb2d001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d24c5df9e193dc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2d6000640 1 -- 172.21.15.59:0/4231427158 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d00a5880 con 0x7fb2d80b1c90 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2d6000640 1 -- 172.21.15.59:0/4231427158 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d00a5a20 con 0x7fb2d80b1c90 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2d6000640 1 -- 172.21.15.59:0/4231427158 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d00a5df0 con 0x7fb2d80b1c90 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2de200640 1 -- 172.21.15.59:0/4231427158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d80b1c90 msgr2=0x7fb2d815bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2de200640 1 --2- 172.21.15.59:0/4231427158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d80b1c90 0x7fb2d815bd80 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fb2d80b24b0 tx=0x7fb2d001c9c0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2de200640 1 -- 172.21.15.59:0/4231427158 shutdown_connections 2024-04-25T09:11:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2de200640 1 --2- 172.21.15.59:0/4231427158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d80b1c90 0x7fb2d815bd80 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2de200640 1 --2- 172.21.15.59:0/4231427158 >> v2:172.21.15.178:3300/0 conn(0x7fb2d815fe50 0x7fb2d80b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2de200640 1 -- 172.21.15.59:0/4231427158 >> 172.21.15.59:0/4231427158 conn(0x7fb2d8066fa0 msgr2=0x7fb2d806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.538+0000 7fb2de200640 1 -- 172.21.15.59:0/4231427158 shutdown_connections 2024-04-25T09:11:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2de200640 1 -- 172.21.15.59:0/4231427158 wait complete. 2024-04-25T09:11:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2de200640 1 Processor -- start 2024-04-25T09:11:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2de200640 1 -- start start 2024-04-25T09:11:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2de200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2d80b1c90 0x7fb2d80ae4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2de200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d8145270 0x7fb2d80ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2de200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2d815fe50 0x7fb2d80ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2de200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d815f930 con 0x7fb2d8145270 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2de200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d815f650 con 0x7fb2d815fe50 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2de200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80cdbe0 con 0x7fb2d80b1c90 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2d6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d8145270 0x7fb2d80ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2d6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d8145270 0x7fb2d80ac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48542/0 (socket says 172.21.15.59:48542) 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2d6a00640 1 -- 172.21.15.59:0/44154834 learned_addr learned my addr 172.21.15.59:0/44154834 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2d7e00640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2d815fe50 0x7fb2d80ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2d7400640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2d80b1c90 0x7fb2d80ae4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2d6a00640 1 -- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2d80b1c90 msgr2=0x7fb2d80ae4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2d6a00640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2d80b1c90 0x7fb2d80ae4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2d6a00640 1 -- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2d815fe50 msgr2=0x7fb2d80ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2d6a00640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2d815fe50 0x7fb2d80ac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2d6a00640 1 -- 172.21.15.59:0/44154834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80acaf0 con 0x7fb2d8145270 2024-04-25T09:11:04.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2d7e00640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2d815fe50 0x7fb2d80ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2d6a00640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d8145270 0x7fb2d80ac070 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400d5f0 tx=0x7fb2c400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2cf400640 1 -- 172.21.15.59:0/44154834 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40125f0 con 0x7fb2d8145270 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2cf400640 1 -- 172.21.15.59:0/44154834 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c4019070 con 0x7fb2d8145270 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2cf400640 1 -- 172.21.15.59:0/44154834 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40129b0 con 0x7fb2d8145270 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2de200640 1 -- 172.21.15.59:0/44154834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d80b1120 con 0x7fb2d8145270 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.542+0000 7fb2de200640 1 -- 172.21.15.59:0/44154834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d80b16e0 con 0x7fb2d8145270 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.546+0000 7fb2de200640 1 -- 172.21.15.59:0/44154834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d80745d0 con 0x7fb2d8145270 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.546+0000 7fb2cf400640 1 -- 172.21.15.59:0/44154834 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb2c4012b50 con 0x7fb2d8145270 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.546+0000 7fb2cf400640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb2b8066f60 0x7fb2b8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.546+0000 7fb2cf400640 1 -- 172.21.15.59:0/44154834 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7fb2c4085810 con 0x7fb2d8145270 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.546+0000 7fb2d7400640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb2b8066f60 0x7fb2b8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.546+0000 7fb2d7400640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb2b8066f60 0x7fb2b8069420 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8001650 tx=0x7fb2c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.550+0000 7fb2cf400640 1 -- 172.21.15.59:0/44154834 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb2c4056480 con 0x7fb2d8145270 2024-04-25T09:11:04.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 -- 172.21.15.59:0/44154834 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2d806b8e0 con 0x7fb2d8145270 2024-04-25T09:11:04.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2cf400640 1 -- 172.21.15.59:0/44154834 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4937 (secure 0 0 0) 0x7fb2c4055d80 con 0x7fb2d8145270 2024-04-25T09:11:04.739 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:04.740 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":95,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":8799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/648458124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":648458124},{"type":"v1","addr":"172.21.15.59:6835","nonce":648458124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[{"mdsmap":{"epoch":94,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:10:08.100794+0000","modified":"2024-04-25T09:11:01.150087+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-25T09:11:04.740 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 95 2024-04-25T09:11:04.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 -- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb2b8066f60 msgr2=0x7fb2b8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb2b8066f60 0x7fb2b8069420 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fb2c8001650 tx=0x7fb2c8009040 comp rx=0 tx=0).stop 2024-04-25T09:11:04.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 -- 172.21.15.59:0/44154834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d8145270 msgr2=0x7fb2d80ac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d8145270 0x7fb2d80ac070 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400d5f0 tx=0x7fb2c400dab0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 -- 172.21.15.59:0/44154834 shutdown_connections 2024-04-25T09:11:04.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb2b8066f60 0x7fb2b8069420 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb2d815fe50 0x7fb2d80ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2d8145270 0x7fb2d80ac070 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 --2- 172.21.15.59:0/44154834 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb2d80b1c90 0x7fb2d80ae4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 -- 172.21.15.59:0/44154834 >> 172.21.15.59:0/44154834 conn(0x7fb2d8066fa0 msgr2=0x7fb2d80736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:04.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 -- 172.21.15.59:0/44154834 shutdown_connections 2024-04-25T09:11:04.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.750+0000 7fb2de200640 1 -- 172.21.15.59:0/44154834 wait complete. 2024-04-25T09:11:04.760 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:04.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6a00640 1 Processor -- start 2024-04-25T09:11:04.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6a00640 1 -- start start 2024-04-25T09:11:04.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96e015b520 0x7f96e00cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96e00ce2b0 0x7f96e00b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e00b10e0 con 0x7f96e015b140 2024-04-25T09:11:04.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e00ce700 con 0x7f96e00ce2b0 2024-04-25T09:11:04.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0099e00 con 0x7f96e015b520 2024-04-25T09:11:04.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96e00ce2b0 0x7f96e00b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96e00ce2b0 0x7f96e00b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48558/0 (socket says 172.21.15.59:48558) 2024-04-25T09:11:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6000640 1 -- 172.21.15.59:0/3219202964 learned_addr learned my addr 172.21.15.59:0/3219202964 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e4c00640 1 --2- 172.21.15.59:0/3219202964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96e015b520 0x7f96e00cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6000640 1 -- 172.21.15.59:0/3219202964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96e015b520 msgr2=0x7f96e00cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6000640 1 --2- 172.21.15.59:0/3219202964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96e015b520 0x7f96e00cdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6000640 1 -- 172.21.15.59:0/3219202964 >> v1:172.21.15.178:6789/0 conn(0x7f96e015b140 legacy=0x7f96e015e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.914+0000 7f96e6000640 1 -- 172.21.15.59:0/3219202964 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e009a0e0 con 0x7f96e00ce2b0 2024-04-25T09:11:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96e6000640 1 --2- 172.21.15.59:0/3219202964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96e00ce2b0 0x7f96e00b17b0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009e50 tx=0x7f96d801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a395960c55083874 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96dfe00640 1 -- 172.21.15.59:0/3219202964 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d80090d0 con 0x7f96e00ce2b0 2024-04-25T09:11:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96dfe00640 1 -- 172.21.15.59:0/3219202964 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d80a58d0 con 0x7f96e00ce2b0 2024-04-25T09:11:04.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96dfe00640 1 -- 172.21.15.59:0/3219202964 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8009270 con 0x7f96e00ce2b0 2024-04-25T09:11:04.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96e6a00640 1 -- 172.21.15.59:0/3219202964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96e00ce2b0 msgr2=0x7f96e00b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96e6a00640 1 --2- 172.21.15.59:0/3219202964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96e00ce2b0 0x7f96e00b17b0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009e50 tx=0x7f96d801ca00 comp rx=0 tx=0).stop 2024-04-25T09:11:04.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96e6a00640 1 -- 172.21.15.59:0/3219202964 shutdown_connections 2024-04-25T09:11:04.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96e6a00640 1 --2- 172.21.15.59:0/3219202964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96e00ce2b0 0x7f96e00b17b0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96e6a00640 1 --2- 172.21.15.59:0/3219202964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96e015b520 0x7f96e00cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96e6a00640 1 -- 172.21.15.59:0/3219202964 >> 172.21.15.59:0/3219202964 conn(0x7f96e00d14f0 msgr2=0x7f96e00d1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:04.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96e6a00640 1 -- 172.21.15.59:0/3219202964 shutdown_connections 2024-04-25T09:11:04.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96e6a00640 1 -- 172.21.15.59:0/3219202964 wait complete. 2024-04-25T09:11:04.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96e6a00640 1 Processor -- start 2024-04-25T09:11:04.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.918+0000 7f96e6a00640 1 -- start start 2024-04-25T09:11:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96e00ce2b0 0x7f96e00c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e6a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96e015b140 0x7f96e0156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e6a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96e015b520 0x7f96e00c59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e6a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0099be0 con 0x7f96e00ce2b0 2024-04-25T09:11:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e6a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e0099a60 con 0x7f96e015b520 2024-04-25T09:11:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e6a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e006bd20 con 0x7f96e015b140 2024-04-25T09:11:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96e00ce2b0 0x7f96e00c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96e00ce2b0 0x7f96e00c6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48566/0 (socket says 172.21.15.59:48566) 2024-04-25T09:11:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e5600640 1 -- 172.21.15.59:0/1053010285 learned_addr learned my addr 172.21.15.59:0/1053010285 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e6000640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96e015b520 0x7f96e00c59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e4c00640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96e015b140 0x7f96e0156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e5600640 1 -- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96e015b140 msgr2=0x7f96e0156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e5600640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96e015b140 0x7f96e0156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e5600640 1 -- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96e015b520 msgr2=0x7f96e00c59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e5600640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96e015b520 0x7f96e00c59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e5600640 1 -- 172.21.15.59:0/1053010285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00c6fe0 con 0x7f96e00ce2b0 2024-04-25T09:11:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e5600640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96e00ce2b0 0x7f96e00c6630 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f96d4007fd0 tx=0x7f96d400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96dd600640 1 -- 172.21.15.59:0/1053010285 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4017070 con 0x7f96e00ce2b0 2024-04-25T09:11:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96dd600640 1 -- 172.21.15.59:0/1053010285 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d40052d0 con 0x7f96e00ce2b0 2024-04-25T09:11:04.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96dd600640 1 -- 172.21.15.59:0/1053010285 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4003840 con 0x7f96e00ce2b0 2024-04-25T09:11:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e6a00640 1 -- 172.21.15.59:0/1053010285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e00c72c0 con 0x7f96e00ce2b0 2024-04-25T09:11:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e6a00640 1 -- 172.21.15.59:0/1053010285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e00c7880 con 0x7f96e00ce2b0 2024-04-25T09:11:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96e6a00640 1 -- 172.21.15.59:0/1053010285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e00c7a80 con 0x7f96e00ce2b0 2024-04-25T09:11:04.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.922+0000 7f96dd600640 1 -- 172.21.15.59:0/1053010285 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f96d401a070 con 0x7f96e00ce2b0 2024-04-25T09:11:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.926+0000 7f96dd600640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f96c0066f90 0x7f96c0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.926+0000 7f96dd600640 1 -- 172.21.15.59:0/1053010285 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f96d4084580 con 0x7f96e00ce2b0 2024-04-25T09:11:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.926+0000 7f96e4c00640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f96c0066f90 0x7f96c0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:04.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.926+0000 7f96e4c00640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f96c0066f90 0x7f96c0069450 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f96e015a650 tx=0x7f96cc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:04.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:04.930+0000 7f96dd600640 1 -- 172.21.15.59:0/1053010285 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f96d4005480 con 0x7f96e00ce2b0 2024-04-25T09:11:05.088 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.098+0000 7f96e6a00640 1 -- 172.21.15.59:0/1053010285 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96e004efa0 con 0x7f96e00ce2b0 2024-04-25T09:11:05.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.098+0000 7f96dd600640 1 -- 172.21.15.59:0/1053010285 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+17241 (secure 0 0 0) 0x7f96d4054cc0 con 0x7f96e00ce2b0 2024-04-25T09:11:05.090 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:05.090 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":111,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:01.150100+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:10:06.512267+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data","create_time":"2024-04-25T09:10:07.092321+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.24","mappings":[{"from":5,"to":4}]},{"pgid":"16.36","mappings":[{"from":1,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/2009305668":"2024-04-26T09:11:01.150076+0000","172.21.15.59:6833/2009305668":"2024-04-26T09:11:01.150076+0000","172.21.15.59:6835/2867303658":"2024-04-26T09:10:24.428401+0000","172.21.15.59:6833/2867303658":"2024-04-26T09:10:24.428401+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:05.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.102+0000 7f96e6a00640 1 -- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f96c0066f90 msgr2=0x7f96c0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.102+0000 7f96e6a00640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f96c0066f90 0x7f96c0069450 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f96e015a650 tx=0x7f96cc008040 comp rx=0 tx=0).stop 2024-04-25T09:11:05.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.102+0000 7f96e6a00640 1 -- 172.21.15.59:0/1053010285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96e00ce2b0 msgr2=0x7f96e00c6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.102+0000 7f96e6a00640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96e00ce2b0 0x7f96e00c6630 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f96d4007fd0 tx=0x7f96d400c890 comp rx=0 tx=0).stop 2024-04-25T09:11:05.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.102+0000 7f96e6a00640 1 -- 172.21.15.59:0/1053010285 shutdown_connections 2024-04-25T09:11:05.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.102+0000 7f96e6a00640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f96c0066f90 0x7f96c0069450 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.102+0000 7f96e6a00640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f96e015b520 0x7f96e00c59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.102+0000 7f96e6a00640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f96e015b140 0x7f96e0156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.092 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.102+0000 7f96e6a00640 1 --2- 172.21.15.59:0/1053010285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96e00ce2b0 0x7f96e00c6630 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.102+0000 7f96e6a00640 1 -- 172.21.15.59:0/1053010285 >> 172.21.15.59:0/1053010285 conn(0x7f96e00d14f0 msgr2=0x7f96e006c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:05.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.102+0000 7f96e6a00640 1 -- 172.21.15.59:0/1053010285 shutdown_connections 2024-04-25T09:11:05.093 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.102+0000 7f96e6a00640 1 -- 172.21.15.59:0/1053010285 wait complete. 2024-04-25T09:11:05.111 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:11:05.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.262+0000 7f3e76e00640 1 Processor -- start 2024-04-25T09:11:05.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.262+0000 7f3e76e00640 1 -- start start 2024-04-25T09:11:05.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e76e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e700cc910 0x7f3e7006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e76e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e700affe0 con 0x7f3e7006fb00 2024-04-25T09:11:05.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e76e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e700cd240 con 0x7f3e7015baa0 2024-04-25T09:11:05.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e76e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700cd520 con 0x7f3e700cc910 2024-04-25T09:11:05.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e6fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3e7006fb00 0x7f3e7006fee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42386/0 (socket says 172.21.15.59:42386) 2024-04-25T09:11:05.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e6fe00640 1 -- 172.21.15.59:0/270742725 learned_addr learned my addr 172.21.15.59:0/270742725 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:05.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e74e00640 1 --2- 172.21.15.59:0/270742725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e700cc910 0x7f3e7006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e6f400640 1 -- 172.21.15.59:0/270742725 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705100015 0 0) 0x7f3e700affe0 con 0x7f3e7006fb00 2024-04-25T09:11:05.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e6f400640 1 -- 172.21.15.59:0/270742725 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e54003530 con 0x7f3e7006fb00 2024-04-25T09:11:05.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e6f400640 1 -- 172.21.15.59:0/270742725 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2960490404 0 0) 0x7f3e700cd240 con 0x7f3e7015baa0 2024-04-25T09:11:05.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e6f400640 1 -- 172.21.15.59:0/270742725 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e700affe0 con 0x7f3e7015baa0 2024-04-25T09:11:05.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e74e00640 1 -- 172.21.15.59:0/270742725 >> v1:172.21.15.178:6789/0 conn(0x7f3e7015baa0 legacy=0x7f3e7006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e74e00640 1 -- 172.21.15.59:0/270742725 >> v1:172.21.15.59:6789/0 conn(0x7f3e7006fb00 legacy=0x7f3e7006fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.266+0000 7f3e74e00640 1 -- 172.21.15.59:0/270742725 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700cd800 con 0x7f3e700cc910 2024-04-25T09:11:05.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e74e00640 1 --2- 172.21.15.59:0/270742725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e700cc910 0x7f3e7006ed70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3e680097f0 tx=0x7f3e6801c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef4992b9d15d5f5a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:05.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e6f400640 1 -- 172.21.15.59:0/270742725 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e680aa610 con 0x7f3e700cc910 2024-04-25T09:11:05.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e6f400640 1 -- 172.21.15.59:0/270742725 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e680af070 con 0x7f3e700cc910 2024-04-25T09:11:05.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e6f400640 1 -- 172.21.15.59:0/270742725 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e680aa9d0 con 0x7f3e700cc910 2024-04-25T09:11:05.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e76e00640 1 -- 172.21.15.59:0/270742725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e700cc910 msgr2=0x7f3e7006ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e76e00640 1 --2- 172.21.15.59:0/270742725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e700cc910 0x7f3e7006ed70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3e680097f0 tx=0x7f3e6801c4b0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e76e00640 1 -- 172.21.15.59:0/270742725 shutdown_connections 2024-04-25T09:11:05.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e76e00640 1 --2- 172.21.15.59:0/270742725 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e700cc910 0x7f3e7006ed70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e76e00640 1 -- 172.21.15.59:0/270742725 >> 172.21.15.59:0/270742725 conn(0x7f3e700b2240 msgr2=0x7f3e700b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:05.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e76e00640 1 -- 172.21.15.59:0/270742725 shutdown_connections 2024-04-25T09:11:05.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e76e00640 1 -- 172.21.15.59:0/270742725 wait complete. 2024-04-25T09:11:05.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e76e00640 1 Processor -- start 2024-04-25T09:11:05.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e76e00640 1 -- start start 2024-04-25T09:11:05.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e76e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e7006fb00 0x7f3e70135ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.270+0000 7f3e76e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e700cc910 0x7f3e70157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e76e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e7015baa0 0x7f3e701478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e76e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7006f840 con 0x7f3e700cc910 2024-04-25T09:11:05.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e76e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7006f6c0 con 0x7f3e7006fb00 2024-04-25T09:11:05.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e76e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e700b2f70 con 0x7f3e7015baa0 2024-04-25T09:11:05.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e67400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e700cc910 0x7f3e70157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e67400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e700cc910 0x7f3e70157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48580/0 (socket says 172.21.15.59:48580) 2024-04-25T09:11:05.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e67400640 1 -- 172.21.15.59:0/954289411 learned_addr learned my addr 172.21.15.59:0/954289411 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:05.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e67400640 1 -- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e7015baa0 msgr2=0x7f3e701478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e67400640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e7015baa0 0x7f3e701478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e67400640 1 -- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e7006fb00 msgr2=0x7f3e70135ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e6fe00640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e7006fb00 0x7f3e70135ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e67400640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e7006fb00 0x7f3e70135ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e67400640 1 -- 172.21.15.59:0/954289411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e70133ad0 con 0x7f3e700cc910 2024-04-25T09:11:05.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e67400640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e700cc910 0x7f3e70157540 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800c800 tx=0x7f3e5800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:05.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e6cc00640 1 -- 172.21.15.59:0/954289411 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58003b80 con 0x7f3e700cc910 2024-04-25T09:11:05.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e6cc00640 1 -- 172.21.15.59:0/954289411 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e58003d40 con 0x7f3e700cc910 2024-04-25T09:11:05.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e6cc00640 1 -- 172.21.15.59:0/954289411 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5800aa90 con 0x7f3e700cc910 2024-04-25T09:11:05.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e76e00640 1 -- 172.21.15.59:0/954289411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e701483c0 con 0x7f3e700cc910 2024-04-25T09:11:05.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e76e00640 1 -- 172.21.15.59:0/954289411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e70136380 con 0x7f3e700cc910 2024-04-25T09:11:05.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e76e00640 1 -- 172.21.15.59:0/954289411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e700745d0 con 0x7f3e700cc910 2024-04-25T09:11:05.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.274+0000 7f3e6cc00640 1 -- 172.21.15.59:0/954289411 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3e5800ac30 con 0x7f3e700cc910 2024-04-25T09:11:05.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.278+0000 7f3e6cc00640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3e4c066f60 0x7f3e4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.278+0000 7f3e6cc00640 1 -- 172.21.15.59:0/954289411 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7f3e58085300 con 0x7f3e700cc910 2024-04-25T09:11:05.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.278+0000 7f3e6fe00640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3e4c066f60 0x7f3e4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.267 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.278+0000 7f3e6fe00640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3e4c066f60 0x7f3e4c069420 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3e600011f0 tx=0x7f3e60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:05.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.282+0000 7f3e6cc00640 1 -- 172.21.15.59:0/954289411 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3e701483c0 con 0x7f3e700cc910 2024-04-25T09:11:05.467 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.478+0000 7f3e76e00640 1 -- 172.21.15.59:0/954289411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3e701521c0 con 0x7f3e700cc910 2024-04-25T09:11:05.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e6cc00640 1 -- 172.21.15.59:0/954289411 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v96) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3e580560b0 con 0x7f3e700cc910 2024-04-25T09:11:05.523 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:11:05.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e76e00640 1 -- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3e4c066f60 msgr2=0x7f3e4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e76e00640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3e4c066f60 0x7f3e4c069420 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3e600011f0 tx=0x7f3e60009040 comp rx=0 tx=0).stop 2024-04-25T09:11:05.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e76e00640 1 -- 172.21.15.59:0/954289411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e700cc910 msgr2=0x7f3e70157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e76e00640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e700cc910 0x7f3e70157540 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f3e5800c800 tx=0x7f3e5800ccc0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e76e00640 1 -- 172.21.15.59:0/954289411 shutdown_connections 2024-04-25T09:11:05.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e76e00640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3e4c066f60 0x7f3e4c069420 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e76e00640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3e7015baa0 0x7f3e701478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e76e00640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e700cc910 0x7f3e70157540 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e76e00640 1 --2- 172.21.15.59:0/954289411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3e7006fb00 0x7f3e70135ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e76e00640 1 -- 172.21.15.59:0/954289411 >> 172.21.15.59:0/954289411 conn(0x7f3e700b2240 msgr2=0x7f3e7015ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:05.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e76e00640 1 -- 172.21.15.59:0/954289411 shutdown_connections 2024-04-25T09:11:05.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.534+0000 7f3e76e00640 1 -- 172.21.15.59:0/954289411 wait complete. 2024-04-25T09:11:05.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:11:05.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa66c800640 1 Processor -- start 2024-04-25T09:11:05.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa66c800640 1 -- start start 2024-04-25T09:11:05.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa66c800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66406bf30 0x7fa6640d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa66c800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66415e040 con 0x7fa66415dc60 2024-04-25T09:11:05.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa66c800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6640cff80 con 0x7fa66409a170 2024-04-25T09:11:05.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa66c800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640d0260 con 0x7fa66406bf30 2024-04-25T09:11:05.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa669e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa66415dc60 0x7fa664099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42400/0 (socket says 172.21.15.59:42400) 2024-04-25T09:11:05.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa669e00640 1 -- 172.21.15.59:0/913858570 learned_addr learned my addr 172.21.15.59:0/913858570 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:05.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa66a800640 1 --2- 172.21.15.59:0/913858570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66406bf30 0x7fa6640d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa668a00640 1 -- 172.21.15.59:0/913858570 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306101500 0 0) 0x7fa66415e040 con 0x7fa66415dc60 2024-04-25T09:11:05.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa668a00640 1 -- 172.21.15.59:0/913858570 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa64c003530 con 0x7fa66415dc60 2024-04-25T09:11:05.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa668a00640 1 -- 172.21.15.59:0/913858570 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413022494 0 0) 0x7fa6640cff80 con 0x7fa66409a170 2024-04-25T09:11:05.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.698+0000 7fa668a00640 1 -- 172.21.15.59:0/913858570 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66415e040 con 0x7fa66409a170 2024-04-25T09:11:05.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa66a800640 1 -- 172.21.15.59:0/913858570 >> v1:172.21.15.178:6789/0 conn(0x7fa66409a170 legacy=0x7fa6640cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa668a00640 1 -- 172.21.15.59:0/913858570 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3206971876 0 0) 0x7fa64c003530 con 0x7fa66415dc60 2024-04-25T09:11:05.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa66a800640 1 -- 172.21.15.59:0/913858570 >> v1:172.21.15.59:6789/0 conn(0x7fa66415dc60 legacy=0x7fa664099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa66a800640 1 -- 172.21.15.59:0/913858570 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6640d0540 con 0x7fa66406bf30 2024-04-25T09:11:05.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa66a800640 1 --2- 172.21.15.59:0/913858570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66406bf30 0x7fa6640d1020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa660009dc0 tx=0x7fa66001c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f786a8d4f5559c9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:05.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa668a00640 1 -- 172.21.15.59:0/913858570 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600b2070 con 0x7fa66406bf30 2024-04-25T09:11:05.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa668a00640 1 -- 172.21.15.59:0/913858570 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6600a5630 con 0x7fa66406bf30 2024-04-25T09:11:05.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa668a00640 1 -- 172.21.15.59:0/913858570 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658001680 con 0x7fa66406bf30 2024-04-25T09:11:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa66c800640 1 -- 172.21.15.59:0/913858570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66406bf30 msgr2=0x7fa6640d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa66c800640 1 --2- 172.21.15.59:0/913858570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66406bf30 0x7fa6640d1020 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa660009dc0 tx=0x7fa66001c7f0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa66c800640 1 -- 172.21.15.59:0/913858570 shutdown_connections 2024-04-25T09:11:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa66c800640 1 --2- 172.21.15.59:0/913858570 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66406bf30 0x7fa6640d1020 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.702+0000 7fa66c800640 1 -- 172.21.15.59:0/913858570 >> 172.21.15.59:0/913858570 conn(0x7fa6640b3200 msgr2=0x7fa6640b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa66c800640 1 -- 172.21.15.59:0/913858570 shutdown_connections 2024-04-25T09:11:05.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa66c800640 1 -- 172.21.15.59:0/913858570 wait complete. 2024-04-25T09:11:05.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa66c800640 1 Processor -- start 2024-04-25T09:11:05.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa66c800640 1 -- start start 2024-04-25T09:11:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa66c800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66406bf30 0x7fa66409e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa66c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66409a170 0x7fa66415c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa66c800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66415dc60 0x7fa6641545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa66c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66406cfa0 con 0x7fa66409a170 2024-04-25T09:11:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa66c800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640cc880 con 0x7fa66406bf30 2024-04-25T09:11:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa66c800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66409deb0 con 0x7fa66415dc60 2024-04-25T09:11:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa669400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66409a170 0x7fa66415c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa669400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66409a170 0x7fa66415c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48586/0 (socket says 172.21.15.59:48586) 2024-04-25T09:11:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa669400640 1 -- 172.21.15.59:0/3681499266 learned_addr learned my addr 172.21.15.59:0/3681499266 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa669e00640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66406bf30 0x7fa66409e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa66a800640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66415dc60 0x7fa6641545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa669400640 1 -- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66415dc60 msgr2=0x7fa6641545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa669400640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66415dc60 0x7fa6641545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa669400640 1 -- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66406bf30 msgr2=0x7fa66409e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa669400640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66406bf30 0x7fa66409e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa669400640 1 -- 172.21.15.59:0/3681499266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66415cd60 con 0x7fa66409a170 2024-04-25T09:11:05.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa669e00640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66406bf30 0x7fa66409e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa669400640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66409a170 0x7fa66415c820 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c490 tx=0x7fa65400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa65e000640 1 -- 172.21.15.59:0/3681499266 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6540052d0 con 0x7fa66409a170 2024-04-25T09:11:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa65e000640 1 -- 172.21.15.59:0/3681499266 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654005470 con 0x7fa66409a170 2024-04-25T09:11:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa66c800640 1 -- 172.21.15.59:0/3681499266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66409d2a0 con 0x7fa66409a170 2024-04-25T09:11:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.706+0000 7fa65e000640 1 -- 172.21.15.59:0/3681499266 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa654012870 con 0x7fa66409a170 2024-04-25T09:11:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.710+0000 7fa66c800640 1 -- 172.21.15.59:0/3681499266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66409d860 con 0x7fa66409a170 2024-04-25T09:11:05.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.710+0000 7fa66c800640 1 -- 172.21.15.59:0/3681499266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6640745d0 con 0x7fa66409a170 2024-04-25T09:11:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.710+0000 7fa65e000640 1 -- 172.21.15.59:0/3681499266 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa654012a10 con 0x7fa66409a170 2024-04-25T09:11:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.710+0000 7fa65e000640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa648066f60 0x7fa648069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.710+0000 7fa65e000640 1 -- 172.21.15.59:0/3681499266 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7fa654084f70 con 0x7fa66409a170 2024-04-25T09:11:05.700 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.710+0000 7fa669e00640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa648066f60 0x7fa648069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:05.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.710+0000 7fa669e00640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa648066f60 0x7fa648069420 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa6580011f0 tx=0x7fa658009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:05.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.714+0000 7fa65e000640 1 -- 172.21.15.59:0/3681499266 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa654055d00 con 0x7fa66409a170 2024-04-25T09:11:05.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:05.910+0000 7fa66c800640 1 -- 172.21.15.59:0/3681499266 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa6640b7590 con 0x7fa66409a170 2024-04-25T09:11:06.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.538+0000 7fa65e000640 1 -- 172.21.15.59:0/3681499266 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v97) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa654055600 con 0x7fa66409a170 2024-04-25T09:11:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.542+0000 7fa66c800640 1 -- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa648066f60 msgr2=0x7fa648069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.542+0000 7fa66c800640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa648066f60 0x7fa648069420 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa6580011f0 tx=0x7fa658009040 comp rx=0 tx=0).stop 2024-04-25T09:11:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.542+0000 7fa66c800640 1 -- 172.21.15.59:0/3681499266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66409a170 msgr2=0x7fa66415c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.542+0000 7fa66c800640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66409a170 0x7fa66415c820 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c490 tx=0x7fa65400c950 comp rx=0 tx=0).stop 2024-04-25T09:11:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.542+0000 7fa66c800640 1 -- 172.21.15.59:0/3681499266 shutdown_connections 2024-04-25T09:11:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.542+0000 7fa66c800640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa648066f60 0x7fa648069420 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.542+0000 7fa66c800640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66415dc60 0x7fa6641545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.542+0000 7fa66c800640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66409a170 0x7fa66415c820 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.542+0000 7fa66c800640 1 --2- 172.21.15.59:0/3681499266 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66406bf30 0x7fa66409e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.542+0000 7fa66c800640 1 -- 172.21.15.59:0/3681499266 >> 172.21.15.59:0/3681499266 conn(0x7fa6640b3200 msgr2=0x7fa664099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:06.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.542+0000 7fa66c800640 1 -- 172.21.15.59:0/3681499266 shutdown_connections 2024-04-25T09:11:06.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.542+0000 7fa66c800640 1 -- 172.21.15.59:0/3681499266 wait complete. 2024-04-25T09:11:06.555 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:11:06.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.714+0000 7fe968600640 1 Processor -- start 2024-04-25T09:11:06.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.714+0000 7fe968600640 1 -- start start 2024-04-25T09:11:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe968600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fe96006ead0 0x7fe960165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe968600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9600cf490 con 0x7fe960144080 2024-04-25T09:11:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe968600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9600cf1b0 con 0x7fe960071e40 2024-04-25T09:11:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe968600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9600719b0 con 0x7fe96006ead0 2024-04-25T09:11:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe965c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe960144080 0x7fe9600ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42414/0 (socket says 172.21.15.59:42414) 2024-04-25T09:11:06.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe965c00640 1 -- 172.21.15.59:0/1080515842 learned_addr learned my addr 172.21.15.59:0/1080515842 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe966600640 1 --2- 172.21.15.59:0/1080515842 >> v2:172.21.15.178:3300/0 conn(0x7fe96006ead0 0x7fe960165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229703417 0 0) 0x7fe9600cf490 con 0x7fe960144080 2024-04-25T09:11:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe948005740 con 0x7fe960144080 2024-04-25T09:11:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1687285053 0 0) 0x7fe948005740 con 0x7fe960144080 2024-04-25T09:11:06.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 >> v2:172.21.15.178:3300/0 conn(0x7fe96006ead0 msgr2=0x7fe960165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 --2- 172.21.15.59:0/1080515842 >> v2:172.21.15.178:3300/0 conn(0x7fe96006ead0 0x7fe960165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 >> v1:172.21.15.178:6789/0 conn(0x7fe960071e40 legacy=0x7fe96006e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe960071360 con 0x7fe960144080 2024-04-25T09:11:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fe954001680 con 0x7fe960144080 2024-04-25T09:11:06.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 >> v1:172.21.15.59:6789/0 conn(0x7fe960144080 legacy=0x7fe9600ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 --2- 172.21.15.59:0/1080515842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe948005c20 0x7fe948006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 --2- 172.21.15.59:0/1080515842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 0x7fe948006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 --2- 172.21.15.59:0/1080515842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9480073e0 0x7fe94800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600719b0 con 0x7fe948006a20 2024-04-25T09:11:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94800e2e0 con 0x7fe9480073e0 2024-04-25T09:11:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94800e4e0 con 0x7fe948005c20 2024-04-25T09:11:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe965200640 1 --2- 172.21.15.59:0/1080515842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 0x7fe948006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe965c00640 1 --2- 172.21.15.59:0/1080515842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe948005c20 0x7fe948006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe966600640 1 --2- 172.21.15.59:0/1080515842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9480073e0 0x7fe94800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe965200640 1 -- 172.21.15.59:0/1080515842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe948005c20 msgr2=0x7fe948006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe965200640 1 --2- 172.21.15.59:0/1080515842 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe948005c20 0x7fe948006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe965200640 1 -- 172.21.15.59:0/1080515842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9480073e0 msgr2=0x7fe94800dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe965200640 1 --2- 172.21.15.59:0/1080515842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9480073e0 0x7fe94800dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe965200640 1 -- 172.21.15.59:0/1080515842 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe948005740 con 0x7fe948006a20 2024-04-25T09:11:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe966600640 1 --2- 172.21.15.59:0/1080515842 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9480073e0 0x7fe94800dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:06.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.718+0000 7fe966600640 1 -- 172.21.15.59:0/1080515842 reap_dead start 2024-04-25T09:11:06.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.722+0000 7fe965200640 1 --2- 172.21.15.59:0/1080515842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 0x7fe948006ea0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001780 tx=0x7fe94c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25de59a9ba638e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.722+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0013a0 con 0x7fe948006a20 2024-04-25T09:11:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.722+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c0052f0 con 0x7fe948006a20 2024-04-25T09:11:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.722+0000 7fe95fe00640 1 -- 172.21.15.59:0/1080515842 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954007e60 con 0x7fe948006a20 2024-04-25T09:11:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.722+0000 7fe968600640 1 -- 172.21.15.59:0/1080515842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 msgr2=0x7fe948006ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.722+0000 7fe968600640 1 --2- 172.21.15.59:0/1080515842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 0x7fe948006ea0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001780 tx=0x7fe94c01c400 comp rx=0 tx=0).stop 2024-04-25T09:11:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.722+0000 7fe968600640 1 -- 172.21.15.59:0/1080515842 shutdown_connections 2024-04-25T09:11:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.722+0000 7fe968600640 1 --2- 172.21.15.59:0/1080515842 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 0x7fe948006ea0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.722+0000 7fe968600640 1 -- 172.21.15.59:0/1080515842 >> 172.21.15.59:0/1080515842 conn(0x7fe96006ac10 msgr2=0x7fe96006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.722+0000 7fe968600640 1 -- 172.21.15.59:0/1080515842 shutdown_connections 2024-04-25T09:11:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.722+0000 7fe968600640 1 -- 172.21.15.59:0/1080515842 wait complete. 2024-04-25T09:11:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe968600640 1 Processor -- start 2024-04-25T09:11:06.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe968600640 1 -- start start 2024-04-25T09:11:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe968600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 0x7fe96015d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe968600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9601ef630 0x7fe96013d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe968600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe96013dc10 0x7fe96013c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe968600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600b4950 con 0x7fe948006a20 2024-04-25T09:11:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe968600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe960144460 con 0x7fe9601ef630 2024-04-25T09:11:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe968600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600b4ad0 con 0x7fe96013dc10 2024-04-25T09:11:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe965c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 0x7fe96015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe965c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 0x7fe96015d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48600/0 (socket says 172.21.15.59:48600) 2024-04-25T09:11:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe965c00640 1 -- 172.21.15.59:0/2060356983 learned_addr learned my addr 172.21.15.59:0/2060356983 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe966600640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe96013dc10 0x7fe96013c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe965200640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9601ef630 0x7fe96013d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe965c00640 1 -- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe96013dc10 msgr2=0x7fe96013c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe965c00640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe96013dc10 0x7fe96013c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe965c00640 1 -- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9601ef630 msgr2=0x7fe96013d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe965c00640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9601ef630 0x7fe96013d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe965c00640 1 -- 172.21.15.59:0/2060356983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96013cd20 con 0x7fe948006a20 2024-04-25T09:11:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe965c00640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 0x7fe96015d140 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe954001010 tx=0x7fe9540126f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe95d600640 1 -- 172.21.15.59:0/2060356983 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95401c070 con 0x7fe948006a20 2024-04-25T09:11:06.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe95d600640 1 -- 172.21.15.59:0/2060356983 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe954014750 con 0x7fe948006a20 2024-04-25T09:11:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe968600640 1 -- 172.21.15.59:0/2060356983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe960138220 con 0x7fe948006a20 2024-04-25T09:11:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe95d600640 1 -- 172.21.15.59:0/2060356983 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe954012ea0 con 0x7fe948006a20 2024-04-25T09:11:06.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe968600640 1 -- 172.21.15.59:0/2060356983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9601387e0 con 0x7fe948006a20 2024-04-25T09:11:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.726+0000 7fe968600640 1 -- 172.21.15.59:0/2060356983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9600745d0 con 0x7fe948006a20 2024-04-25T09:11:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.730+0000 7fe95d600640 1 -- 172.21.15.59:0/2060356983 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe95401f070 con 0x7fe948006a20 2024-04-25T09:11:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.730+0000 7fe95d600640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe940066f60 0x7fe940069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.730+0000 7fe95d600640 1 -- 172.21.15.59:0/2060356983 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6331+0+0 (secure 0 0 0) 0x7fe954087b30 con 0x7fe948006a20 2024-04-25T09:11:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.730+0000 7fe965200640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe940066f60 0x7fe940069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:06.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.730+0000 7fe965200640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe940066f60 0x7fe940069420 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001750 tx=0x7fe94c0011a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:06.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.734+0000 7fe95d600640 1 -- 172.21.15.59:0/2060356983 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe9540581e0 con 0x7fe948006a20 2024-04-25T09:11:06.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:06.894+0000 7fe968600640 1 -- 172.21.15.59:0/2060356983 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe96013dff0 con 0x7fe948006a20 2024-04-25T09:11:07.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.542+0000 7fe95d600640 1 -- 172.21.15.59:0/2060356983 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v112) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe95405c280 con 0x7fe948006a20 2024-04-25T09:11:07.531 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:11:07.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.546+0000 7fe968600640 1 -- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe940066f60 msgr2=0x7fe940069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.546+0000 7fe968600640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe940066f60 0x7fe940069420 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fe94c001750 tx=0x7fe94c0011a0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.546+0000 7fe968600640 1 -- 172.21.15.59:0/2060356983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 msgr2=0x7fe96015d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.546+0000 7fe968600640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 0x7fe96015d140 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe954001010 tx=0x7fe9540126f0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.546+0000 7fe968600640 1 -- 172.21.15.59:0/2060356983 shutdown_connections 2024-04-25T09:11:07.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.546+0000 7fe968600640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe940066f60 0x7fe940069420 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.546+0000 7fe968600640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe96013dc10 0x7fe96013c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.546+0000 7fe968600640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe9601ef630 0x7fe96013d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.546+0000 7fe968600640 1 --2- 172.21.15.59:0/2060356983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe948006a20 0x7fe96015d140 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.546+0000 7fe968600640 1 -- 172.21.15.59:0/2060356983 >> 172.21.15.59:0/2060356983 conn(0x7fe96006ac10 msgr2=0x7fe960141a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:07.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.546+0000 7fe968600640 1 -- 172.21.15.59:0/2060356983 shutdown_connections 2024-04-25T09:11:07.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.546+0000 7fe968600640 1 -- 172.21.15.59:0/2060356983 wait complete. 2024-04-25T09:11:07.561 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:11:07.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.718+0000 7f2862200640 1 Processor -- start 2024-04-25T09:11:07.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.718+0000 7f2862200640 1 -- start start 2024-04-25T09:11:07.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f2862200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f285c15dab0 0x7f285c0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f2862200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f285c0713c0 0x7f285c06c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f2862200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f285c15de90 con 0x7f285c0b0c00 2024-04-25T09:11:07.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f2862200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c071a70 con 0x7f285c15dab0 2024-04-25T09:11:07.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f2862200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f285c0b57a0 con 0x7f285c0713c0 2024-04-25T09:11:07.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f285b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f285c15dab0 0x7f285c0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f285b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f285c15dab0 0x7f285c0b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48606/0 (socket says 172.21.15.59:48606) 2024-04-25T09:11:07.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f285b400640 1 -- 172.21.15.59:0/1966963566 learned_addr learned my addr 172.21.15.59:0/1966963566 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:07.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f285be00640 1 --2- 172.21.15.59:0/1966963566 >> v2:172.21.15.178:3300/0 conn(0x7f285c0713c0 0x7f285c06c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f285b400640 1 -- 172.21.15.59:0/1966963566 >> v2:172.21.15.178:3300/0 conn(0x7f285c0713c0 msgr2=0x7f285c06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:07.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f285b400640 1 --2- 172.21.15.59:0/1966963566 >> v2:172.21.15.178:3300/0 conn(0x7f285c0713c0 0x7f285c06c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f285b400640 1 -- 172.21.15.59:0/1966963566 >> v1:172.21.15.178:6789/0 conn(0x7f285c0b0c00 legacy=0x7f285c070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.722+0000 7f285b400640 1 -- 172.21.15.59:0/1966963566 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c06bec0 con 0x7f285c15dab0 2024-04-25T09:11:07.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f285b400640 1 --2- 172.21.15.59:0/1966963566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c15dab0 0x7f285c0b5110 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f285c06dee0 tx=0x7f284c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b575fff9d98399 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:07.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f285aa00640 1 -- 172.21.15.59:0/1966963566 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c0ab600 con 0x7f285c15dab0 2024-04-25T09:11:07.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f285aa00640 1 -- 172.21.15.59:0/1966963566 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284c0b0070 con 0x7f285c15dab0 2024-04-25T09:11:07.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f285aa00640 1 -- 172.21.15.59:0/1966963566 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284c0ab9c0 con 0x7f285c15dab0 2024-04-25T09:11:07.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f2862200640 1 -- 172.21.15.59:0/1966963566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c15dab0 msgr2=0x7f285c0b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f2862200640 1 --2- 172.21.15.59:0/1966963566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c15dab0 0x7f285c0b5110 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f285c06dee0 tx=0x7f284c01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f2862200640 1 -- 172.21.15.59:0/1966963566 shutdown_connections 2024-04-25T09:11:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f2862200640 1 --2- 172.21.15.59:0/1966963566 >> v2:172.21.15.178:3300/0 conn(0x7f285c0713c0 0x7f285c06c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f2862200640 1 --2- 172.21.15.59:0/1966963566 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c15dab0 0x7f285c0b5110 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f2862200640 1 -- 172.21.15.59:0/1966963566 >> 172.21.15.59:0/1966963566 conn(0x7f285c06f510 msgr2=0x7f285c06f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f2862200640 1 -- 172.21.15.59:0/1966963566 shutdown_connections 2024-04-25T09:11:07.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f2862200640 1 -- 172.21.15.59:0/1966963566 wait complete. 2024-04-25T09:11:07.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f2862200640 1 Processor -- start 2024-04-25T09:11:07.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.726+0000 7f2862200640 1 -- start start 2024-04-25T09:11:07.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2862200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f285c0713c0 0x7f285c155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2862200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f285c0b0c00 0x7f285c0cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2862200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c15dab0 0x7f285c0d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2862200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c06da80 con 0x7f285c15dab0 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2862200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285c06d900 con 0x7f285c0713c0 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2862200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285c06dc00 con 0x7f285c0b0c00 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f285be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c15dab0 0x7f285c0d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f285be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c15dab0 0x7f285c0d0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48612/0 (socket says 172.21.15.59:48612) 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f285be00640 1 -- 172.21.15.59:0/1073075191 learned_addr learned my addr 172.21.15.59:0/1073075191 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f285b400640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f285c0713c0 0x7f285c155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2852a00640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f285c0b0c00 0x7f285c0cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f285be00640 1 -- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f285c0b0c00 msgr2=0x7f285c0cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f285be00640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f285c0b0c00 0x7f285c0cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f285be00640 1 -- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f285c0713c0 msgr2=0x7f285c155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:07.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f285be00640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f285c0713c0 0x7f285c155dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f285be00640 1 -- 172.21.15.59:0/1073075191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f285c15e100 con 0x7f285c15dab0 2024-04-25T09:11:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f285be00640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c15dab0 0x7f285c0d0150 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f2854009d30 tx=0x7f285400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2853e00640 1 -- 172.21.15.59:0/1073075191 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854018020 con 0x7f285c15dab0 2024-04-25T09:11:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2853e00640 1 -- 172.21.15.59:0/1073075191 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2854014480 con 0x7f285c15dab0 2024-04-25T09:11:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2853e00640 1 -- 172.21.15.59:0/1073075191 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2854014870 con 0x7f285c15dab0 2024-04-25T09:11:07.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2862200640 1 -- 172.21.15.59:0/1073075191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285c15e3e0 con 0x7f285c15dab0 2024-04-25T09:11:07.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2862200640 1 -- 172.21.15.59:0/1073075191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285c15e9a0 con 0x7f285c15dab0 2024-04-25T09:11:07.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2862200640 1 -- 172.21.15.59:0/1073075191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f285c0745d0 con 0x7f285c15dab0 2024-04-25T09:11:07.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.730+0000 7f2853e00640 1 -- 172.21.15.59:0/1073075191 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f285401b020 con 0x7f285c15dab0 2024-04-25T09:11:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.734+0000 7f2853e00640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2838066f60 0x7f2838069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.734+0000 7f2853e00640 1 -- 172.21.15.59:0/1073075191 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5893+0+0 (secure 0 0 0) 0x7f2854085aa0 con 0x7f285c15dab0 2024-04-25T09:11:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.734+0000 7f285b400640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2838066f60 0x7f2838069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:07.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.734+0000 7f285b400640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2838066f60 0x7f2838069420 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f284c0af000 tx=0x7f284c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:07.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.738+0000 7f2853e00640 1 -- 172.21.15.59:0/1073075191 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2854022070 con 0x7f285c15dab0 2024-04-25T09:11:07.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:07.910+0000 7f2862200640 1 -- 172.21.15.59:0/1073075191 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f285c0b1150 con 0x7f285c15dab0 2024-04-25T09:11:08.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.554+0000 7f2853e00640 1 -- 172.21.15.59:0/1073075191 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v113) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2854010040 con 0x7f285c15dab0 2024-04-25T09:11:08.546 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-04-25T09:11:08.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.562+0000 7f2862200640 1 -- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2838066f60 msgr2=0x7f2838069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.562+0000 7f2862200640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2838066f60 0x7f2838069420 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f284c0af000 tx=0x7f284c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:08.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.562+0000 7f2862200640 1 -- 172.21.15.59:0/1073075191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c15dab0 msgr2=0x7f285c0d0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.562+0000 7f2862200640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c15dab0 0x7f285c0d0150 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f2854009d30 tx=0x7f285400c490 comp rx=0 tx=0).stop 2024-04-25T09:11:08.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.562+0000 7f2862200640 1 -- 172.21.15.59:0/1073075191 shutdown_connections 2024-04-25T09:11:08.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.562+0000 7f2862200640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2838066f60 0x7f2838069420 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.562+0000 7f2862200640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f285c15dab0 0x7f285c0d0150 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.562+0000 7f2862200640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f285c0b0c00 0x7f285c0cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.562+0000 7f2862200640 1 --2- 172.21.15.59:0/1073075191 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f285c0713c0 0x7f285c155dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.562+0000 7f2862200640 1 -- 172.21.15.59:0/1073075191 >> 172.21.15.59:0/1073075191 conn(0x7f285c06f510 msgr2=0x7f285c070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:08.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.562+0000 7f2862200640 1 -- 172.21.15.59:0/1073075191 shutdown_connections 2024-04-25T09:11:08.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.562+0000 7f2862200640 1 -- 172.21.15.59:0/1073075191 wait complete. 2024-04-25T09:11:08.576 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:11:08.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9ae7000640 1 Processor -- start 2024-04-25T09:11:08.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9ae7000640 1 -- start start 2024-04-25T09:11:08.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9ae7000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ae015c9b0 0x7f9ae006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9ae7000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ae006e010 0x7f9ae006e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9ae7000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae015fc00 con 0x7f9ae0159320 2024-04-25T09:11:08.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9ae7000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae006d640 con 0x7f9ae015c9b0 2024-04-25T09:11:08.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9ae7000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae015fee0 con 0x7f9ae006e010 2024-04-25T09:11:08.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9adf400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9ae015c9b0 0x7f9ae006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9adfe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9ae0159320 0x7f9ae015f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42428/0 (socket says 172.21.15.59:42428) 2024-04-25T09:11:08.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9adfe00640 1 -- 172.21.15.59:0/613792092 learned_addr learned my addr 172.21.15.59:0/613792092 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:08.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9ae5000640 1 --2- 172.21.15.59:0/613792092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ae006e010 0x7f9ae006e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9adf400640 1 -- 172.21.15.59:0/613792092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ae006e010 msgr2=0x7f9ae006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:08.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9adf400640 1 --2- 172.21.15.59:0/613792092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ae006e010 0x7f9ae006e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9adf400640 1 -- 172.21.15.59:0/613792092 >> v1:172.21.15.59:6789/0 conn(0x7f9ae0159320 legacy=0x7f9ae015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.734+0000 7f9adf400640 1 -- 172.21.15.59:0/613792092 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae01601c0 con 0x7f9ae015c9b0 2024-04-25T09:11:08.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9adf400640 1 --2- 172.21.15.59:0/613792092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae015c9b0 0x7f9ae006dad0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0097c0 tx=0x7f9acc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67f5641d1f2b7a43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:08.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9adea00640 1 -- 172.21.15.59:0/613792092 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc0b0070 con 0x7f9ae015c9b0 2024-04-25T09:11:08.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9adea00640 1 -- 172.21.15.59:0/613792092 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc0ab600 con 0x7f9ae015c9b0 2024-04-25T09:11:08.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9adea00640 1 -- 172.21.15.59:0/613792092 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc0ab9d0 con 0x7f9ae015c9b0 2024-04-25T09:11:08.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9ae7000640 1 -- 172.21.15.59:0/613792092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae015c9b0 msgr2=0x7f9ae006dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9ae7000640 1 --2- 172.21.15.59:0/613792092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae015c9b0 0x7f9ae006dad0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f9acc0097c0 tx=0x7f9acc01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9ae7000640 1 -- 172.21.15.59:0/613792092 shutdown_connections 2024-04-25T09:11:08.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9ae7000640 1 --2- 172.21.15.59:0/613792092 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ae006e010 0x7f9ae006e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9ae7000640 1 --2- 172.21.15.59:0/613792092 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae015c9b0 0x7f9ae006dad0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9ae7000640 1 -- 172.21.15.59:0/613792092 >> 172.21.15.59:0/613792092 conn(0x7f9ae0067080 msgr2=0x7f9ae006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:08.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9ae7000640 1 -- 172.21.15.59:0/613792092 shutdown_connections 2024-04-25T09:11:08.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9ae7000640 1 -- 172.21.15.59:0/613792092 wait complete. 2024-04-25T09:11:08.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.738+0000 7f9ae7000640 1 Processor -- start 2024-04-25T09:11:08.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae7000640 1 -- start start 2024-04-25T09:11:08.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae7000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ae006e010 0x7f9ae013f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae7000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ae0159320 0x7f9ae015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae7000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae015c9b0 0x7f9ae015d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae7000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae0168920 con 0x7f9ae015c9b0 2024-04-25T09:11:08.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae7000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae01687a0 con 0x7f9ae0159320 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae7000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae0168aa0 con 0x7f9ae006e010 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae015c9b0 0x7f9ae015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae5000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae015c9b0 0x7f9ae015d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48640/0 (socket says 172.21.15.59:48640) 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae5000640 1 -- 172.21.15.59:0/1890580732 learned_addr learned my addr 172.21.15.59:0/1890580732 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9adfe00640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ae006e010 0x7f9ae013f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9adf400640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ae0159320 0x7f9ae015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae5000640 1 -- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ae006e010 msgr2=0x7f9ae013f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae5000640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ae006e010 0x7f9ae013f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae5000640 1 -- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ae0159320 msgr2=0x7f9ae015cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae5000640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ae0159320 0x7f9ae015cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae5000640 1 -- 172.21.15.59:0/1890580732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00b0cd0 con 0x7f9ae015c9b0 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae5000640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae015c9b0 0x7f9ae015d4c0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8007de0 tx=0x7f9ad800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ad7e00640 1 -- 172.21.15.59:0/1890580732 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8014620 con 0x7f9ae015c9b0 2024-04-25T09:11:08.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ad7e00640 1 -- 172.21.15.59:0/1890580732 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8019070 con 0x7f9ae015c9b0 2024-04-25T09:11:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ad7e00640 1 -- 172.21.15.59:0/1890580732 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8014a20 con 0x7f9ae015c9b0 2024-04-25T09:11:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae7000640 1 -- 172.21.15.59:0/1890580732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae00b0fb0 con 0x7f9ae015c9b0 2024-04-25T09:11:08.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae7000640 1 -- 172.21.15.59:0/1890580732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae00b1570 con 0x7f9ae015c9b0 2024-04-25T09:11:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.742+0000 7f9ae7000640 1 -- 172.21.15.59:0/1890580732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae00745d0 con 0x7f9ae015c9b0 2024-04-25T09:11:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.746+0000 7f9ad7e00640 1 -- 172.21.15.59:0/1890580732 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ad8014bc0 con 0x7f9ae015c9b0 2024-04-25T09:11:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.746+0000 7f9ad7e00640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9ac0066f60 0x7f9ac0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.746+0000 7f9ad7e00640 1 -- 172.21.15.59:0/1890580732 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f9ad8085700 con 0x7f9ae015c9b0 2024-04-25T09:11:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.746+0000 7f9adfe00640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9ac0066f60 0x7f9ac0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:08.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.746+0000 7f9adfe00640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9ac0066f60 0x7f9ac0069420 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0141160 tx=0x7f9ad0007e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:08.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.750+0000 7f9ad7e00640 1 -- 172.21.15.59:0/1890580732 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ad80561d0 con 0x7f9ae015c9b0 2024-04-25T09:11:08.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.910+0000 7f9ae7000640 1 -- 172.21.15.59:0/1890580732 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9ae015b1a0 con 0x7f9ae015c9b0 2024-04-25T09:11:08.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.914+0000 7f9ad7e00640 1 -- 172.21.15.59:0/1890580732 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9ad805a270 con 0x7f9ae015c9b0 2024-04-25T09:11:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.918+0000 7f9ae7000640 1 -- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9ac0066f60 msgr2=0x7f9ac0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.918+0000 7f9ae7000640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9ac0066f60 0x7f9ac0069420 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9ae0141160 tx=0x7f9ad0007e90 comp rx=0 tx=0).stop 2024-04-25T09:11:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.918+0000 7f9ae7000640 1 -- 172.21.15.59:0/1890580732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae015c9b0 msgr2=0x7f9ae015d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:08.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.918+0000 7f9ae7000640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae015c9b0 0x7f9ae015d4c0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8007de0 tx=0x7f9ad800e4b0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.918+0000 7f9ae7000640 1 -- 172.21.15.59:0/1890580732 shutdown_connections 2024-04-25T09:11:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.918+0000 7f9ae7000640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9ac0066f60 0x7f9ac0069420 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.918+0000 7f9ae7000640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9ae015c9b0 0x7f9ae015d4c0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.918+0000 7f9ae7000640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9ae0159320 0x7f9ae015cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.918+0000 7f9ae7000640 1 --2- 172.21.15.59:0/1890580732 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9ae006e010 0x7f9ae013f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.918+0000 7f9ae7000640 1 -- 172.21.15.59:0/1890580732 >> 172.21.15.59:0/1890580732 conn(0x7f9ae0067080 msgr2=0x7f9ae00cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.918+0000 7f9ae7000640 1 -- 172.21.15.59:0/1890580732 shutdown_connections 2024-04-25T09:11:08.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:08.918+0000 7f9ae7000640 1 -- 172.21.15.59:0/1890580732 wait complete. 2024-04-25T09:11:08.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-25T09:11:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdf1800640 1 Processor -- start 2024-04-25T09:11:09.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdf1800640 1 -- start start 2024-04-25T09:11:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdf1800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec15b5a0 0x7fcdec0cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdf1800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdec0ce7f0 con 0x7fcdec0cc440 2024-04-25T09:11:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdf1800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdec0cead0 con 0x7fcdec15b980 2024-04-25T09:11:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdf1800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0cfcd0 con 0x7fcdec15b5a0 2024-04-25T09:11:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdeb400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcdec0cc440 0x7fcdec0d0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:42444/0 (socket says 172.21.15.59:42444) 2024-04-25T09:11:09.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdeb400640 1 -- 172.21.15.59:0/2477094271 learned_addr learned my addr 172.21.15.59:0/2477094271 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:09.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3917730851 0 0) 0x7fcdec0ce7f0 con 0x7fcdec0cc440 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdeaa00640 1 --2- 172.21.15.59:0/2477094271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec15b5a0 0x7fcdec0cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdd0003530 con 0x7fcdec0cc440 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3600215706 0 0) 0x7fcdd0003530 con 0x7fcdec0cc440 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec15b5a0 msgr2=0x7fcdec0cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 --2- 172.21.15.59:0/2477094271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec15b5a0 0x7fcdec0cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 >> v1:172.21.15.178:6789/0 conn(0x7fcdec15b980 legacy=0x7fcdec0cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec0cf960 con 0x7fcdec0cc440 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fcde4001a00 con 0x7fcdec0cc440 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 >> v1:172.21.15.59:6789/0 conn(0x7fcdec0cc440 legacy=0x7fcdec0d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 --2- 172.21.15.59:0/2477094271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd00039f0 0x7fcdd0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 --2- 172.21.15.59:0/2477094271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdd0004810 0x7fcdd0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 --2- 172.21.15.59:0/2477094271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec15b5a0 0x7fcdd00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0cfcd0 con 0x7fcdd00039f0 2024-04-25T09:11:09.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd000ba80 con 0x7fcdd0004810 2024-04-25T09:11:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd000bc80 con 0x7fcdec15b5a0 2024-04-25T09:11:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.078+0000 7fcdeaa00640 1 --2- 172.21.15.59:0/2477094271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd00039f0 0x7fcdd0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcde2000640 1 --2- 172.21.15.59:0/2477094271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdd0004810 0x7fcdd0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdeb400640 1 --2- 172.21.15.59:0/2477094271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec15b5a0 0x7fcdd00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdeaa00640 1 -- 172.21.15.59:0/2477094271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec15b5a0 msgr2=0x7fcdd00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdeaa00640 1 --2- 172.21.15.59:0/2477094271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec15b5a0 0x7fcdd00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdeaa00640 1 -- 172.21.15.59:0/2477094271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdd0004810 msgr2=0x7fcdd0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdeaa00640 1 --2- 172.21.15.59:0/2477094271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdd0004810 0x7fcdd0004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdeaa00640 1 -- 172.21.15.59:0/2477094271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd0003530 con 0x7fcdd00039f0 2024-04-25T09:11:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdeaa00640 1 --2- 172.21.15.59:0/2477094271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd00039f0 0x7fcdd0003e10 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009ab0 tx=0x7fcddc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab30ac8ee461cb20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc0b2070 con 0x7fcdd00039f0 2024-04-25T09:11:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc0a5620 con 0x7fcdd00039f0 2024-04-25T09:11:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdea000640 1 -- 172.21.15.59:0/2477094271 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc0096b0 con 0x7fcdd00039f0 2024-04-25T09:11:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdf1800640 1 -- 172.21.15.59:0/2477094271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd00039f0 msgr2=0x7fcdd0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdf1800640 1 --2- 172.21.15.59:0/2477094271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd00039f0 0x7fcdd0003e10 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009ab0 tx=0x7fcddc01ca30 comp rx=0 tx=0).stop 2024-04-25T09:11:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdeb400640 1 -- 172.21.15.59:0/2477094271 reap_dead start 2024-04-25T09:11:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdf1800640 1 -- 172.21.15.59:0/2477094271 shutdown_connections 2024-04-25T09:11:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdf1800640 1 -- 172.21.15.59:0/2477094271 >> 172.21.15.59:0/2477094271 conn(0x7fcdec0b3390 msgr2=0x7fcdec0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdf1800640 1 -- 172.21.15.59:0/2477094271 shutdown_connections 2024-04-25T09:11:09.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.082+0000 7fcdf1800640 1 -- 172.21.15.59:0/2477094271 wait complete. 2024-04-25T09:11:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdf1800640 1 Processor -- start 2024-04-25T09:11:09.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdf1800640 1 -- start start 2024-04-25T09:11:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdf1800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd00039f0 0x7fcdec14ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdf1800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec0caa10 0x7fcdec0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdf1800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdec15deb0 0x7fcdec15e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdf1800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0d1490 con 0x7fcdd00039f0 2024-04-25T09:11:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdf1800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec0d1310 con 0x7fcdec15deb0 2024-04-25T09:11:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdf1800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdec167740 con 0x7fcdec0caa10 2024-04-25T09:11:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdeaa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd00039f0 0x7fcdec14ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdeaa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd00039f0 0x7fcdec14ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48662/0 (socket says 172.21.15.59:48662) 2024-04-25T09:11:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdeaa00640 1 -- 172.21.15.59:0/3081139547 learned_addr learned my addr 172.21.15.59:0/3081139547 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcde2000640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec0caa10 0x7fcdec0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdeb400640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdec15deb0 0x7fcdec15e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdeaa00640 1 -- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec0caa10 msgr2=0x7fcdec0cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdeaa00640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec0caa10 0x7fcdec0cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdeaa00640 1 -- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdec15deb0 msgr2=0x7fcdec15e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdeaa00640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdec15deb0 0x7fcdec15e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdeaa00640 1 -- 172.21.15.59:0/3081139547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdec1532e0 con 0x7fcdd00039f0 2024-04-25T09:11:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdeaa00640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd00039f0 0x7fcdec14ed80 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fcddc01cf10 tx=0x7fcdd0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcde3400640 1 -- 172.21.15.59:0/3081139547 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc0bc030 con 0x7fcdd00039f0 2024-04-25T09:11:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcde3400640 1 -- 172.21.15.59:0/3081139547 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc0a5dd0 con 0x7fcdd00039f0 2024-04-25T09:11:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcde3400640 1 -- 172.21.15.59:0/3081139547 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc0b2040 con 0x7fcdd00039f0 2024-04-25T09:11:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdf1800640 1 -- 172.21.15.59:0/3081139547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdec153550 con 0x7fcdd00039f0 2024-04-25T09:11:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.086+0000 7fcdf1800640 1 -- 172.21.15.59:0/3081139547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdec15ebe0 con 0x7fcdd00039f0 2024-04-25T09:11:09.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.090+0000 7fcdf1800640 1 -- 172.21.15.59:0/3081139547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdec0cb3d0 con 0x7fcdd00039f0 2024-04-25T09:11:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.090+0000 7fcde3400640 1 -- 172.21.15.59:0/3081139547 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcddc0bf070 con 0x7fcdd00039f0 2024-04-25T09:11:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.090+0000 7fcde3400640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcdc8066f60 0x7fcdc8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.090+0000 7fcde3400640 1 -- 172.21.15.59:0/3081139547 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fcddc11eb40 con 0x7fcdd00039f0 2024-04-25T09:11:09.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.090+0000 7fcde2000640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcdc8066f60 0x7fcdc8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.081 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.090+0000 7fcde2000640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcdc8066f60 0x7fcdc8069420 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fcdec159dd0 tx=0x7fcdd4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.094+0000 7fcde3400640 1 -- 172.21.15.59:0/3081139547 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcddc0c7020 con 0x7fcdd00039f0 2024-04-25T09:11:09.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.314+0000 7fcdf1800640 1 -- 172.21.15.59:0/3081139547 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7fcdec0745d0 con 0x7fcdd00039f0 2024-04-25T09:11:09.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.558+0000 7fcde3400640 1 -- 172.21.15.59:0/3081139547 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v471) v1 ==== 146+0+0 (secure 0 0 0) 0x7fcddc016740 con 0x7fcdd00039f0 2024-04-25T09:11:09.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.558+0000 7fcdf1800640 1 -- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcdc8066f60 msgr2=0x7fcdc8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.558+0000 7fcdf1800640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcdc8066f60 0x7fcdc8069420 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fcdec159dd0 tx=0x7fcdd4009040 comp rx=0 tx=0).stop 2024-04-25T09:11:09.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.558+0000 7fcdf1800640 1 -- 172.21.15.59:0/3081139547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd00039f0 msgr2=0x7fcdec14ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.558+0000 7fcdf1800640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd00039f0 0x7fcdec14ed80 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7fcddc01cf10 tx=0x7fcdd0005840 comp rx=0 tx=0).stop 2024-04-25T09:11:09.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.562+0000 7fcdf1800640 1 -- 172.21.15.59:0/3081139547 shutdown_connections 2024-04-25T09:11:09.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.562+0000 7fcdf1800640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcdc8066f60 0x7fcdc8069420 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.562+0000 7fcdf1800640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcdec15deb0 0x7fcdec15e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.562+0000 7fcdf1800640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcdec0caa10 0x7fcdec0cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.562+0000 7fcdf1800640 1 --2- 172.21.15.59:0/3081139547 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdd00039f0 0x7fcdec14ed80 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.562+0000 7fcdf1800640 1 -- 172.21.15.59:0/3081139547 >> 172.21.15.59:0/3081139547 conn(0x7fcdec0b3390 msgr2=0x7fcdec0cbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:09.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.562+0000 7fcdf1800640 1 -- 172.21.15.59:0/3081139547 shutdown_connections 2024-04-25T09:11:09.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.562+0000 7fcdf1800640 1 -- 172.21.15.59:0/3081139547 wait complete. 2024-04-25T09:11:09.570 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T09:11:09.570 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-25T09:11:09.571 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:09.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.722+0000 7fed0ac00640 1 Processor -- start 2024-04-25T09:11:09.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.722+0000 7fed0ac00640 1 -- start start 2024-04-25T09:11:09.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.722+0000 7fed0ac00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed0415fe50 0x7fed040b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.722+0000 7fed0ac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed040b1c90 0x7fed0415bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.722+0000 7fed0ac00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed040cc4e0 con 0x7fed04145270 2024-04-25T09:11:09.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.722+0000 7fed0ac00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed04145650 con 0x7fed0415fe50 2024-04-25T09:11:09.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.722+0000 7fed0ac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed041602b0 con 0x7fed040b1c90 2024-04-25T09:11:09.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fed08c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed040b1c90 0x7fed0415bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fecfb400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fed0415fe50 0x7fed040b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fed08c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed040b1c90 0x7fed0415bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:44546/0 (socket says 172.21.15.59:44546) 2024-04-25T09:11:09.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fed08c00640 1 -- 172.21.15.59:0/2404854316 learned_addr learned my addr 172.21.15.59:0/2404854316 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:09.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fed03400640 1 -- 172.21.15.59:0/2404854316 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875733727 0 0) 0x7fed040cc4e0 con 0x7fed04145270 2024-04-25T09:11:09.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fed08c00640 1 -- 172.21.15.59:0/2404854316 >> v2:172.21.15.178:3300/0 conn(0x7fed0415fe50 msgr2=0x7fed040b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:09.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fed08c00640 1 --2- 172.21.15.59:0/2404854316 >> v2:172.21.15.178:3300/0 conn(0x7fed0415fe50 0x7fed040b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fed08c00640 1 -- 172.21.15.59:0/2404854316 >> v1:172.21.15.178:6789/0 conn(0x7fed04145270 legacy=0x7fed040cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fed08c00640 1 -- 172.21.15.59:0/2404854316 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed040ce040 con 0x7fed040b1c90 2024-04-25T09:11:09.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fed08c00640 1 --2- 172.21.15.59:0/2404854316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed040b1c90 0x7fed0415bd80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009e50 tx=0x7fecfc01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39ce0b73256c287b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fed03400640 1 -- 172.21.15.59:0/2404854316 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0a57f0 con 0x7fed040b1c90 2024-04-25T09:11:09.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fed03400640 1 -- 172.21.15.59:0/2404854316 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc0a5990 con 0x7fed040b1c90 2024-04-25T09:11:09.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.726+0000 7fed03400640 1 -- 172.21.15.59:0/2404854316 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0a5d60 con 0x7fed040b1c90 2024-04-25T09:11:09.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 -- 172.21.15.59:0/2404854316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed040b1c90 msgr2=0x7fed0415bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 --2- 172.21.15.59:0/2404854316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed040b1c90 0x7fed0415bd80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009e50 tx=0x7fecfc01ca30 comp rx=0 tx=0).stop 2024-04-25T09:11:09.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 -- 172.21.15.59:0/2404854316 shutdown_connections 2024-04-25T09:11:09.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 --2- 172.21.15.59:0/2404854316 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed040b1c90 0x7fed0415bd80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 --2- 172.21.15.59:0/2404854316 >> v2:172.21.15.178:3300/0 conn(0x7fed0415fe50 0x7fed040b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 -- 172.21.15.59:0/2404854316 >> 172.21.15.59:0/2404854316 conn(0x7fed04066fa0 msgr2=0x7fed0406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:09.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 -- 172.21.15.59:0/2404854316 shutdown_connections 2024-04-25T09:11:09.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 -- 172.21.15.59:0/2404854316 wait complete. 2024-04-25T09:11:09.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 Processor -- start 2024-04-25T09:11:09.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 -- start start 2024-04-25T09:11:09.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed040b1c90 0x7fed0413c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed04145270 0x7fed040a8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed0415fe50 0x7fed0415b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed040cdbe0 con 0x7fed0415fe50 2024-04-25T09:11:09.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0415f930 con 0x7fed040b1c90 2024-04-25T09:11:09.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed0ac00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed040cdd60 con 0x7fed04145270 2024-04-25T09:11:09.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed08c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed0415fe50 0x7fed0415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed08c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed0415fe50 0x7fed0415b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48672/0 (socket says 172.21.15.59:48672) 2024-04-25T09:11:09.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed08c00640 1 -- 172.21.15.59:0/2113250609 learned_addr learned my addr 172.21.15.59:0/2113250609 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:09.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fecfb400640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed04145270 0x7fed040a8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.730+0000 7fed03e00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed040b1c90 0x7fed0413c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed08c00640 1 -- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed04145270 msgr2=0x7fed040a8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed08c00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed04145270 0x7fed040a8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed08c00640 1 -- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed040b1c90 msgr2=0x7fed0413c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed08c00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed040b1c90 0x7fed0413c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed08c00640 1 -- 172.21.15.59:0/2113250609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0413ca60 con 0x7fed0415fe50 2024-04-25T09:11:09.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fecfb400640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed04145270 0x7fed040a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:09.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed08c00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed0415fe50 0x7fed0415b370 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0af040 tx=0x7fecfc0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed00c00640 1 -- 172.21.15.59:0/2113250609 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc0bc020 con 0x7fed0415fe50 2024-04-25T09:11:09.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed00c00640 1 -- 172.21.15.59:0/2113250609 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecfc0b8670 con 0x7fed0415fe50 2024-04-25T09:11:09.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed00c00640 1 -- 172.21.15.59:0/2113250609 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecfc009510 con 0x7fed0415fe50 2024-04-25T09:11:09.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed0ac00640 1 -- 172.21.15.59:0/2113250609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0413da50 con 0x7fed0415fe50 2024-04-25T09:11:09.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed0ac00640 1 -- 172.21.15.59:0/2113250609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed0413e010 con 0x7fed0415fe50 2024-04-25T09:11:09.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed0ac00640 1 -- 172.21.15.59:0/2113250609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed040745d0 con 0x7fed0415fe50 2024-04-25T09:11:09.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed00c00640 1 -- 172.21.15.59:0/2113250609 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fecfc0bf020 con 0x7fed0415fe50 2024-04-25T09:11:09.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed00c00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fece0066f90 0x7fece0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:09.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed00c00640 1 -- 172.21.15.59:0/2113250609 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fecfc11ff60 con 0x7fed0415fe50 2024-04-25T09:11:09.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.734+0000 7fed03e00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fece0066f90 0x7fece0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:09.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.738+0000 7fed03e00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fece0066f90 0x7fece0069450 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fecec000f70 tx=0x7fecec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:09.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.738+0000 7fed00c00640 1 -- 172.21.15.59:0/2113250609 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fecfc0c6030 con 0x7fed0415fe50 2024-04-25T09:11:09.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.902+0000 7fed0ac00640 1 -- 172.21.15.59:0/2113250609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed0406b8e0 con 0x7fed0415fe50 2024-04-25T09:11:09.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.902+0000 7fed00c00640 1 -- 172.21.15.59:0/2113250609 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+13433 (secure 0 0 0) 0x7fecfc016620 con 0x7fed0415fe50 2024-04-25T09:11:09.893 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:09.893 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":113,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:08.555199+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/2009305668":"2024-04-26T09:11:01.150076+0000","172.21.15.59:6833/2009305668":"2024-04-26T09:11:01.150076+0000","172.21.15.59:6835/2867303658":"2024-04-26T09:10:24.428401+0000","172.21.15.59:6833/2867303658":"2024-04-26T09:10:24.428401+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:09.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.906+0000 7fed0ac00640 1 -- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fece0066f90 msgr2=0x7fece0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.906+0000 7fed0ac00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fece0066f90 0x7fece0069450 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fecec000f70 tx=0x7fecec009040 comp rx=0 tx=0).stop 2024-04-25T09:11:09.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.906+0000 7fed0ac00640 1 -- 172.21.15.59:0/2113250609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed0415fe50 msgr2=0x7fed0415b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:09.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.906+0000 7fed0ac00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed0415fe50 0x7fed0415b370 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fecfc0af040 tx=0x7fecfc0197d0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.906+0000 7fed0ac00640 1 -- 172.21.15.59:0/2113250609 shutdown_connections 2024-04-25T09:11:09.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.906+0000 7fed0ac00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fece0066f90 0x7fece0069450 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.906+0000 7fed0ac00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed0415fe50 0x7fed0415b370 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.906+0000 7fed0ac00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fed04145270 0x7fed040a8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.906+0000 7fed0ac00640 1 --2- 172.21.15.59:0/2113250609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fed040b1c90 0x7fed0413c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:09.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.906+0000 7fed0ac00640 1 -- 172.21.15.59:0/2113250609 >> 172.21.15.59:0/2113250609 conn(0x7fed04066fa0 msgr2=0x7fed040cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:09.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.906+0000 7fed0ac00640 1 -- 172.21.15.59:0/2113250609 shutdown_connections 2024-04-25T09:11:09.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:09.906+0000 7fed0ac00640 1 -- 172.21.15.59:0/2113250609 wait complete. 2024-04-25T09:11:09.915 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:09.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:10.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe583c00640 1 Processor -- start 2024-04-25T09:11:10.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe583c00640 1 -- start start 2024-04-25T09:11:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe583c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c09a170 0x7fe57c0d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe583c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe57c06bf30 0x7fe57c0cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe583c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57c15e040 con 0x7fe57c15dc60 2024-04-25T09:11:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe583c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57c0cff80 con 0x7fe57c06bf30 2024-04-25T09:11:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe583c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c0d0260 con 0x7fe57c09a170 2024-04-25T09:11:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe581c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe57c06bf30 0x7fe57c0cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe581c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe57c06bf30 0x7fe57c0cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48674/0 (socket says 172.21.15.59:48674) 2024-04-25T09:11:10.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe581c00640 1 -- 172.21.15.59:0/1798428741 learned_addr learned my addr 172.21.15.59:0/1798428741 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe57be00640 1 --2- 172.21.15.59:0/1798428741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c09a170 0x7fe57c0d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe581c00640 1 -- 172.21.15.59:0/1798428741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c09a170 msgr2=0x7fe57c0d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe581c00640 1 --2- 172.21.15.59:0/1798428741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c09a170 0x7fe57c0d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe581c00640 1 -- 172.21.15.59:0/1798428741 >> v1:172.21.15.178:6789/0 conn(0x7fe57c15dc60 legacy=0x7fe57c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe581c00640 1 -- 172.21.15.59:0/1798428741 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c0d0540 con 0x7fe57c06bf30 2024-04-25T09:11:10.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.070+0000 7fe57be00640 1 --2- 172.21.15.59:0/1798428741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c09a170 0x7fe57c0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:10.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.074+0000 7fe581c00640 1 --2- 172.21.15.59:0/1798428741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57c06bf30 0x7fe57c0cf8a0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fe574009e50 tx=0x7fe57401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf520ac44957ec2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:10.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.074+0000 7fe57b400640 1 -- 172.21.15.59:0/1798428741 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740a57b0 con 0x7fe57c06bf30 2024-04-25T09:11:10.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.074+0000 7fe57b400640 1 -- 172.21.15.59:0/1798428741 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5740a5950 con 0x7fe57c06bf30 2024-04-25T09:11:10.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.074+0000 7fe57b400640 1 -- 172.21.15.59:0/1798428741 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740a5d20 con 0x7fe57c06bf30 2024-04-25T09:11:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.074+0000 7fe583c00640 1 -- 172.21.15.59:0/1798428741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57c06bf30 msgr2=0x7fe57c0cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.074+0000 7fe583c00640 1 --2- 172.21.15.59:0/1798428741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57c06bf30 0x7fe57c0cf8a0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fe574009e50 tx=0x7fe57401c930 comp rx=0 tx=0).stop 2024-04-25T09:11:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.074+0000 7fe583c00640 1 -- 172.21.15.59:0/1798428741 shutdown_connections 2024-04-25T09:11:10.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.074+0000 7fe583c00640 1 --2- 172.21.15.59:0/1798428741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57c06bf30 0x7fe57c0cf8a0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.074+0000 7fe583c00640 1 --2- 172.21.15.59:0/1798428741 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c09a170 0x7fe57c0d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.074+0000 7fe583c00640 1 -- 172.21.15.59:0/1798428741 >> 172.21.15.59:0/1798428741 conn(0x7fe57c0b3200 msgr2=0x7fe57c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.074+0000 7fe583c00640 1 -- 172.21.15.59:0/1798428741 shutdown_connections 2024-04-25T09:11:10.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.074+0000 7fe583c00640 1 -- 172.21.15.59:0/1798428741 wait complete. 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe583c00640 1 Processor -- start 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe583c00640 1 -- start start 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe583c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c06bf30 0x7fe57c146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe583c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe57c09a170 0x7fe57c09ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe583c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57c15dc60 0x7fe57c0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe583c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c0cc6f0 con 0x7fe57c15dc60 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe583c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c0cc570 con 0x7fe57c09a170 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe583c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe57c0cc870 con 0x7fe57c06bf30 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe581c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57c15dc60 0x7fe57c0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe581c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57c15dc60 0x7fe57c0c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48690/0 (socket says 172.21.15.59:48690) 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe581c00640 1 -- 172.21.15.59:0/2048770560 learned_addr learned my addr 172.21.15.59:0/2048770560 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe57be00640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe57c09a170 0x7fe57c09ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe581200640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c06bf30 0x7fe57c146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe581c00640 1 -- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c06bf30 msgr2=0x7fe57c146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe581c00640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c06bf30 0x7fe57c146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe581c00640 1 -- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe57c09a170 msgr2=0x7fe57c09ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe581c00640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe57c09a170 0x7fe57c09ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe581c00640 1 -- 172.21.15.59:0/2048770560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c09f160 con 0x7fe57c15dc60 2024-04-25T09:11:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe581c00640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57c15dc60 0x7fe57c0c9dd0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fe57401afe0 tx=0x7fe5740196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe578c00640 1 -- 172.21.15.59:0/2048770560 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740bc020 con 0x7fe57c15dc60 2024-04-25T09:11:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe578c00640 1 -- 172.21.15.59:0/2048770560 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5740b86b0 con 0x7fe57c15dc60 2024-04-25T09:11:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe578c00640 1 -- 172.21.15.59:0/2048770560 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740b8aa0 con 0x7fe57c15dc60 2024-04-25T09:11:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe583c00640 1 -- 172.21.15.59:0/2048770560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57c0b07b0 con 0x7fe57c15dc60 2024-04-25T09:11:10.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe583c00640 1 -- 172.21.15.59:0/2048770560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe57c0b0d70 con 0x7fe57c15dc60 2024-04-25T09:11:10.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.078+0000 7fe583c00640 1 -- 172.21.15.59:0/2048770560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57c0745d0 con 0x7fe57c15dc60 2024-04-25T09:11:10.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.082+0000 7fe578c00640 1 -- 172.21.15.59:0/2048770560 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe5740bf020 con 0x7fe57c15dc60 2024-04-25T09:11:10.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.082+0000 7fe578c00640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe55c066f60 0x7fe55c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.082+0000 7fe578c00640 1 -- 172.21.15.59:0/2048770560 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fe574120100 con 0x7fe57c15dc60 2024-04-25T09:11:10.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.082+0000 7fe581200640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe55c066f60 0x7fe55c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.082+0000 7fe581200640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe55c066f60 0x7fe55c069420 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe5700098e0 tx=0x7fe570009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:10.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.086+0000 7fe578c00640 1 -- 172.21.15.59:0/2048770560 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe5740c6030 con 0x7fe57c15dc60 2024-04-25T09:11:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 -- 172.21.15.59:0/2048770560 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe57c0cf250 con 0x7fe57c15dc60 2024-04-25T09:11:10.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe578c00640 1 -- 172.21.15.59:0/2048770560 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5740165e0 con 0x7fe57c15dc60 2024-04-25T09:11:10.239 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:11:10.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 -- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe55c066f60 msgr2=0x7fe55c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe55c066f60 0x7fe55c069420 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fe5700098e0 tx=0x7fe570009060 comp rx=0 tx=0).stop 2024-04-25T09:11:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 -- 172.21.15.59:0/2048770560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57c15dc60 msgr2=0x7fe57c0c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57c15dc60 0x7fe57c0c9dd0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fe57401afe0 tx=0x7fe5740196d0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 -- 172.21.15.59:0/2048770560 shutdown_connections 2024-04-25T09:11:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe55c066f60 0x7fe55c069420 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe57c15dc60 0x7fe57c0c9dd0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe57c09a170 0x7fe57c09ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 --2- 172.21.15.59:0/2048770560 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe57c06bf30 0x7fe57c146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 -- 172.21.15.59:0/2048770560 >> 172.21.15.59:0/2048770560 conn(0x7fe57c0b3200 msgr2=0x7fe57c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 -- 172.21.15.59:0/2048770560 shutdown_connections 2024-04-25T09:11:10.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.250+0000 7fe583c00640 1 -- 172.21.15.59:0/2048770560 wait complete. 2024-04-25T09:11:10.260 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-25T09:11:10.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.410+0000 7f719a400640 1 Processor -- start 2024-04-25T09:11:10.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.410+0000 7f719a400640 1 -- start start 2024-04-25T09:11:10.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f719a400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7194144140 0x7f71940ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f719a400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f71940ced60 0x7f719406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f719a400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f719406e900 0x7f719415e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f719a400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719406ed70 con 0x7f71940ced60 2024-04-25T09:11:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f719a400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719415ac60 con 0x7f7194144140 2024-04-25T09:11:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f719a400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71940cf3e0 con 0x7f719406e900 2024-04-25T09:11:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f718aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f71940ced60 0x7f719406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f718aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f71940ced60 0x7f719406e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48694/0 (socket says 172.21.15.59:48694) 2024-04-25T09:11:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f718aa00640 1 -- 172.21.15.59:0/731964228 learned_addr learned my addr 172.21.15.59:0/731964228 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f7193e00640 1 --2- 172.21.15.59:0/731964228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f719406e900 0x7f719415e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f7193400640 1 --2- 172.21.15.59:0/731964228 >> v2:172.21.15.178:3300/0 conn(0x7f7194144140 0x7f71940ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f718aa00640 1 -- 172.21.15.59:0/731964228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f719406e900 msgr2=0x7f719415e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f718aa00640 1 --2- 172.21.15.59:0/731964228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f719406e900 0x7f719415e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f718aa00640 1 -- 172.21.15.59:0/731964228 >> v2:172.21.15.178:3300/0 conn(0x7f7194144140 msgr2=0x7f71940ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f718aa00640 1 --2- 172.21.15.59:0/731964228 >> v2:172.21.15.178:3300/0 conn(0x7f7194144140 0x7f71940ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.414+0000 7f718aa00640 1 -- 172.21.15.59:0/731964228 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719415af20 con 0x7f71940ced60 2024-04-25T09:11:10.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f718aa00640 1 --2- 172.21.15.59:0/731964228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71940ced60 0x7f719406e3c0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f719406eef0 tx=0x7f717c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e21d2d704b7653 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:10.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f7192a00640 1 -- 172.21.15.59:0/731964228 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c0b0070 con 0x7f71940ced60 2024-04-25T09:11:10.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f7192a00640 1 -- 172.21.15.59:0/731964228 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717c0ab600 con 0x7f71940ced60 2024-04-25T09:11:10.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f7192a00640 1 -- 172.21.15.59:0/731964228 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717c0ab9d0 con 0x7f71940ced60 2024-04-25T09:11:10.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 -- 172.21.15.59:0/731964228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71940ced60 msgr2=0x7f719406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:10.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 --2- 172.21.15.59:0/731964228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71940ced60 0x7f719406e3c0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f719406eef0 tx=0x7f717c01c260 comp rx=0 tx=0).stop 2024-04-25T09:11:10.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 -- 172.21.15.59:0/731964228 shutdown_connections 2024-04-25T09:11:10.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 --2- 172.21.15.59:0/731964228 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f719406e900 0x7f719415e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 --2- 172.21.15.59:0/731964228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71940ced60 0x7f719406e3c0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 --2- 172.21.15.59:0/731964228 >> v2:172.21.15.178:3300/0 conn(0x7f7194144140 0x7f71940ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 -- 172.21.15.59:0/731964228 >> 172.21.15.59:0/731964228 conn(0x7f7194066fa0 msgr2=0x7f719406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 -- 172.21.15.59:0/731964228 shutdown_connections 2024-04-25T09:11:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 -- 172.21.15.59:0/731964228 wait complete. 2024-04-25T09:11:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 Processor -- start 2024-04-25T09:11:10.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 -- start start 2024-04-25T09:11:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f719406e900 0x7f719413c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71940ced60 0x7f7194163790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7194144140 0x7f7194163cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719415ba00 con 0x7f7194144140 2024-04-25T09:11:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7194144520 con 0x7f71940ced60 2024-04-25T09:11:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.418+0000 7f719a400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719415bb80 con 0x7f719406e900 2024-04-25T09:11:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f7193e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7194144140 0x7f7194163cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f7193e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7194144140 0x7f7194163cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48702/0 (socket says 172.21.15.59:48702) 2024-04-25T09:11:10.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f7193e00640 1 -- 172.21.15.59:0/3768198686 learned_addr learned my addr 172.21.15.59:0/3768198686 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f7193400640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f719406e900 0x7f719413c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f718aa00640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71940ced60 0x7f7194163790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f7193e00640 1 -- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f719406e900 msgr2=0x7f719413c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f7193e00640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f719406e900 0x7f719413c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f7193e00640 1 -- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71940ced60 msgr2=0x7f7194163790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f7193e00640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71940ced60 0x7f7194163790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f7193e00640 1 -- 172.21.15.59:0/3768198686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719413d370 con 0x7f7194144140 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f7193e00640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7194144140 0x7f7194163cd0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f718c00d590 tx=0x7f718c00da50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f718be00640 1 -- 172.21.15.59:0/3768198686 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0125f0 con 0x7f7194144140 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f718be00640 1 -- 172.21.15.59:0/3768198686 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f718c019070 con 0x7f7194144140 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f718be00640 1 -- 172.21.15.59:0/3768198686 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f718c0129f0 con 0x7f7194144140 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f719a400640 1 -- 172.21.15.59:0/3768198686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f719413fc30 con 0x7f7194144140 2024-04-25T09:11:10.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f719a400640 1 -- 172.21.15.59:0/3768198686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71941401f0 con 0x7f7194144140 2024-04-25T09:11:10.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f719a400640 1 -- 172.21.15.59:0/3768198686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71940745d0 con 0x7f7194144140 2024-04-25T09:11:10.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.422+0000 7f718be00640 1 -- 172.21.15.59:0/3768198686 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f718c012b90 con 0x7f7194144140 2024-04-25T09:11:10.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.426+0000 7f718be00640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7170066f60 0x7f7170069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:10.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.426+0000 7f718be00640 1 -- 172.21.15.59:0/3768198686 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f718c0851b0 con 0x7f7194144140 2024-04-25T09:11:10.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.426+0000 7f7193400640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7170066f60 0x7f7170069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:10.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.426+0000 7f7193400640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7170066f60 0x7f7170069420 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f719415a570 tx=0x7f71840098d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:10.417 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.430+0000 7f718be00640 1 -- 172.21.15.59:0/3768198686 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f718c055bf0 con 0x7f7194144140 2024-04-25T09:11:10.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:10.650+0000 7f719a400640 1 -- 172.21.15.59:0/3768198686 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7f7194159fc0 con 0x7f7194144140 2024-04-25T09:11:11.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.566+0000 7f718be00640 1 -- 172.21.15.59:0/3768198686 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v473) v1 ==== 147+0+0 (secure 0 0 0) 0x7f718c059c90 con 0x7f7194144140 2024-04-25T09:11:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.570+0000 7f719a400640 1 -- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7170066f60 msgr2=0x7f7170069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.570+0000 7f719a400640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7170066f60 0x7f7170069420 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f719415a570 tx=0x7f71840098d0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.570+0000 7f719a400640 1 -- 172.21.15.59:0/3768198686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7194144140 msgr2=0x7f7194163cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.570+0000 7f719a400640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7194144140 0x7f7194163cd0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f718c00d590 tx=0x7f718c00da50 comp rx=0 tx=0).stop 2024-04-25T09:11:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.570+0000 7f719a400640 1 -- 172.21.15.59:0/3768198686 shutdown_connections 2024-04-25T09:11:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.570+0000 7f719a400640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7170066f60 0x7f7170069420 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.570+0000 7f719a400640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7194144140 0x7f7194163cd0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.570+0000 7f719a400640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f71940ced60 0x7f7194163790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.570+0000 7f719a400640 1 --2- 172.21.15.59:0/3768198686 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f719406e900 0x7f719413c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.570+0000 7f719a400640 1 -- 172.21.15.59:0/3768198686 >> 172.21.15.59:0/3768198686 conn(0x7f7194066fa0 msgr2=0x7f719415bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:11.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.570+0000 7f719a400640 1 -- 172.21.15.59:0/3768198686 shutdown_connections 2024-04-25T09:11:11.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.570+0000 7f719a400640 1 -- 172.21.15.59:0/3768198686 wait complete. 2024-04-25T09:11:11.582 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-25T09:11:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa48e600640 1 Processor -- start 2024-04-25T09:11:11.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa48e600640 1 -- start start 2024-04-25T09:11:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa48e600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa4880cf3c0 0x7fa4880cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa48e600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880cd370 0x7fa488099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa48e600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4880d02a0 con 0x7fa48815b910 2024-04-25T09:11:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa48e600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4880cc350 con 0x7fa4880cf3c0 2024-04-25T09:11:11.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa48e600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4880cc630 con 0x7fa4880cd370 2024-04-25T09:11:11.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa47fe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa4880cf3c0 0x7fa4880cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa487e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880cd370 0x7fa488099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa487400640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7fa48815b910 0x7fa4880cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:58712/0 (socket says 172.21.15.59:58712) 2024-04-25T09:11:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa47fe00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa4880cf3c0 0x7fa4880cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:53378/0 (socket says 172.21.15.59:53378) 2024-04-25T09:11:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa487400640 1 -- 172.21.15.59:0/2069320321 learned_addr learned my addr 172.21.15.59:0/2069320321 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa486a00640 1 -- 172.21.15.59:0/2069320321 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882326369 0 0) 0x7fa4880d02a0 con 0x7fa48815b910 2024-04-25T09:11:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa486a00640 1 -- 172.21.15.59:0/2069320321 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa46c003530 con 0x7fa48815b910 2024-04-25T09:11:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa487e00640 1 -- 172.21.15.59:0/2069320321 >> v2:172.21.15.178:3300/0 conn(0x7fa4880cf3c0 msgr2=0x7fa4880cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa487e00640 1 --2- 172.21.15.59:0/2069320321 >> v2:172.21.15.178:3300/0 conn(0x7fa4880cf3c0 0x7fa4880cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa487e00640 1 -- 172.21.15.59:0/2069320321 >> v1:172.21.15.178:6789/0 conn(0x7fa48815b910 legacy=0x7fa4880cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa487e00640 1 -- 172.21.15.59:0/2069320321 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4880cc910 con 0x7fa4880cd370 2024-04-25T09:11:11.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.738+0000 7fa47fe00640 1 --2- 172.21.15.59:0/2069320321 >> v2:172.21.15.178:3300/0 conn(0x7fa4880cf3c0 0x7fa4880cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:11.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.742+0000 7fa487e00640 1 --2- 172.21.15.59:0/2069320321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880cd370 0x7fa488099a60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa480009d90 tx=0x7fa48001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=447fdcc93af48a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:11.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.742+0000 7fa486a00640 1 -- 172.21.15.59:0/2069320321 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800b2070 con 0x7fa4880cd370 2024-04-25T09:11:11.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.742+0000 7fa486a00640 1 -- 172.21.15.59:0/2069320321 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4800a5940 con 0x7fa4880cd370 2024-04-25T09:11:11.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.742+0000 7fa486a00640 1 -- 172.21.15.59:0/2069320321 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4800a5cf0 con 0x7fa4880cd370 2024-04-25T09:11:11.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.742+0000 7fa48e600640 1 -- 172.21.15.59:0/2069320321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880cd370 msgr2=0x7fa488099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.742+0000 7fa48e600640 1 --2- 172.21.15.59:0/2069320321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880cd370 0x7fa488099a60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa480009d90 tx=0x7fa48001c970 comp rx=0 tx=0).stop 2024-04-25T09:11:11.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.742+0000 7fa48e600640 1 -- 172.21.15.59:0/2069320321 shutdown_connections 2024-04-25T09:11:11.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.742+0000 7fa48e600640 1 --2- 172.21.15.59:0/2069320321 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880cd370 0x7fa488099a60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.742+0000 7fa48e600640 1 --2- 172.21.15.59:0/2069320321 >> v2:172.21.15.178:3300/0 conn(0x7fa4880cf3c0 0x7fa4880cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.742+0000 7fa48e600640 1 -- 172.21.15.59:0/2069320321 >> 172.21.15.59:0/2069320321 conn(0x7fa4880b3200 msgr2=0x7fa4880b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:11.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.742+0000 7fa48e600640 1 -- 172.21.15.59:0/2069320321 shutdown_connections 2024-04-25T09:11:11.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.742+0000 7fa48e600640 1 -- 172.21.15.59:0/2069320321 wait complete. 2024-04-25T09:11:11.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa48e600640 1 Processor -- start 2024-04-25T09:11:11.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa48e600640 1 -- start start 2024-04-25T09:11:11.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa48e600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880cd370 0x7fa48814fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa48e600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4880cf3c0 0x7fa48815c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa48e600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa48815b910 0x7fa48815cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa48e600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488168d30 con 0x7fa4880cf3c0 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa48e600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa488168bb0 con 0x7fa48815b910 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa48e600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa488168eb0 con 0x7fa4880cd370 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa47fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4880cf3c0 0x7fa48815c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa47fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4880cf3c0 0x7fa48815c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40856/0 (socket says 172.21.15.59:40856) 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa487400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880cd370 0x7fa48814fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa47fe00640 1 -- 172.21.15.59:0/4036396542 learned_addr learned my addr 172.21.15.59:0/4036396542 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa487e00640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa48815b910 0x7fa48815cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa47fe00640 1 -- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880cd370 msgr2=0x7fa48814fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa47fe00640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880cd370 0x7fa48814fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa47fe00640 1 -- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa48815b910 msgr2=0x7fa48815cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa47fe00640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa48815b910 0x7fa48815cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa47fe00640 1 -- 172.21.15.59:0/4036396542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4881553e0 con 0x7fa4880cf3c0 2024-04-25T09:11:11.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa47fe00640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4880cf3c0 0x7fa48815c610 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fa47000e9d0 tx=0x7fa47000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa47f400640 1 -- 172.21.15.59:0/4036396542 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa470017070 con 0x7fa4880cf3c0 2024-04-25T09:11:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa47f400640 1 -- 172.21.15.59:0/4036396542 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa47000ca60 con 0x7fa4880cf3c0 2024-04-25T09:11:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa48e600640 1 -- 172.21.15.59:0/4036396542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa488154620 con 0x7fa4880cf3c0 2024-04-25T09:11:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa47f400640 1 -- 172.21.15.59:0/4036396542 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa47000ce50 con 0x7fa4880cf3c0 2024-04-25T09:11:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.746+0000 7fa48e600640 1 -- 172.21.15.59:0/4036396542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa488154be0 con 0x7fa4880cf3c0 2024-04-25T09:11:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.750+0000 7fa48e600640 1 -- 172.21.15.59:0/4036396542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4880745d0 con 0x7fa4880cf3c0 2024-04-25T09:11:11.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.750+0000 7fa47f400640 1 -- 172.21.15.59:0/4036396542 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa47001a070 con 0x7fa4880cf3c0 2024-04-25T09:11:11.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.750+0000 7fa47f400640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa464067100 0x7fa4640695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:11.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.750+0000 7fa47f400640 1 -- 172.21.15.59:0/4036396542 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fa470084f80 con 0x7fa4880cf3c0 2024-04-25T09:11:11.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.750+0000 7fa487400640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa464067100 0x7fa4640695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:11.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.750+0000 7fa487400640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa464067100 0x7fa4640695c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa478007fd0 tx=0x7fa478000bd0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:11.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.754+0000 7fa47f400640 1 -- 172.21.15.59:0/4036396542 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa470055930 con 0x7fa4880cf3c0 2024-04-25T09:11:11.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.918+0000 7fa48e600640 1 -- 172.21.15.59:0/4036396542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa4880cdcd0 con 0x7fa4880cf3c0 2024-04-25T09:11:11.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.922+0000 7fa47f400640 1 -- 172.21.15.59:0/4036396542 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa4700599d0 con 0x7fa4880cf3c0 2024-04-25T09:11:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.926+0000 7fa48e600640 1 -- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa464067100 msgr2=0x7fa4640695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.926+0000 7fa48e600640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa464067100 0x7fa4640695c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fa478007fd0 tx=0x7fa478000bd0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.926+0000 7fa48e600640 1 -- 172.21.15.59:0/4036396542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4880cf3c0 msgr2=0x7fa48815c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.926+0000 7fa48e600640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4880cf3c0 0x7fa48815c610 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fa47000e9d0 tx=0x7fa47000ee90 comp rx=0 tx=0).stop 2024-04-25T09:11:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.926+0000 7fa48e600640 1 -- 172.21.15.59:0/4036396542 shutdown_connections 2024-04-25T09:11:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.926+0000 7fa48e600640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa464067100 0x7fa4640695c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.926+0000 7fa48e600640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa48815b910 0x7fa48815cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.926+0000 7fa48e600640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4880cf3c0 0x7fa48815c610 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.926+0000 7fa48e600640 1 --2- 172.21.15.59:0/4036396542 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa4880cd370 0x7fa48814fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.926+0000 7fa48e600640 1 -- 172.21.15.59:0/4036396542 >> 172.21.15.59:0/4036396542 conn(0x7fa4880b3200 msgr2=0x7fa488073830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.926+0000 7fa48e600640 1 -- 172.21.15.59:0/4036396542 shutdown_connections 2024-04-25T09:11:11.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:11.926+0000 7fa48e600640 1 -- 172.21.15.59:0/4036396542 wait complete. 2024-04-25T09:11:11.935 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:11:11.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:11:11.993 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:11:12.082 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:11:12.082 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:12.082 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:12.091 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:11:12.091 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:11:12.091 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:12.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:11:12.100 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:12.101 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:12.141 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:11:12.142 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:11:12.142 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:12.151 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:11:12.151 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-25T09:11:12.152 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:12.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.338+0000 7fdd38000640 1 Processor -- start 2024-04-25T09:11:12.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.338+0000 7fdd38000640 1 -- start start 2024-04-25T09:11:12.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd38000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdd3015e550 0x7fdd3015e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd38000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3006d090 con 0x7fdd30161510 2024-04-25T09:11:12.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd38000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd30071ad0 con 0x7fdd30070fe0 2024-04-25T09:11:12.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd38000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd30162390 con 0x7fdd3015e550 2024-04-25T09:11:12.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd34c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdd30161510 0x7fdd30143080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57678/0 (socket says 172.21.15.59:57678) 2024-04-25T09:11:12.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd34c00640 1 -- 172.21.15.59:0/2244466251 learned_addr learned my addr 172.21.15.59:0/2244466251 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd36000640 1 --2- 172.21.15.59:0/2244466251 >> v2:172.21.15.178:3300/0 conn(0x7fdd3015e550 0x7fdd3015e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192904752 0 0) 0x7fdd1c001120 con 0x7fdd30161510 2024-04-25T09:11:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd18003530 con 0x7fdd30161510 2024-04-25T09:11:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1647590738 0 0) 0x7fdd18003530 con 0x7fdd30161510 2024-04-25T09:11:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 >> v2:172.21.15.178:3300/0 conn(0x7fdd3015e550 msgr2=0x7fdd3015e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:12.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 --2- 172.21.15.59:0/2244466251 >> v2:172.21.15.178:3300/0 conn(0x7fdd3015e550 0x7fdd3015e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 >> v1:172.21.15.178:6789/0 conn(0x7fdd30070fe0 legacy=0x7fdd300713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd30161af0 con 0x7fdd30161510 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fdd1c001850 con 0x7fdd30161510 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 >> v1:172.21.15.59:6789/0 conn(0x7fdd30161510 legacy=0x7fdd30143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 --2- 172.21.15.59:0/2244466251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 0x7fdd18003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 --2- 172.21.15.59:0/2244466251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd18004810 0x7fdd18004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 --2- 172.21.15.59:0/2244466251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd180051d0 0x7fdd1800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd30162390 con 0x7fdd180039c0 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1800c070 con 0x7fdd180051d0 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1800c270 con 0x7fdd18004810 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd35600640 1 --2- 172.21.15.59:0/2244466251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 0x7fdd18003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd34c00640 1 --2- 172.21.15.59:0/2244466251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd18004810 0x7fdd18004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd36000640 1 --2- 172.21.15.59:0/2244466251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd180051d0 0x7fdd1800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd35600640 1 -- 172.21.15.59:0/2244466251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd18004810 msgr2=0x7fdd18004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd35600640 1 --2- 172.21.15.59:0/2244466251 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd18004810 0x7fdd18004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd35600640 1 -- 172.21.15.59:0/2244466251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd180051d0 msgr2=0x7fdd1800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd35600640 1 --2- 172.21.15.59:0/2244466251 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd180051d0 0x7fdd1800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd35600640 1 -- 172.21.15.59:0/2244466251 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18003530 con 0x7fdd180039c0 2024-04-25T09:11:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.342+0000 7fdd36000640 1 -- 172.21.15.59:0/2244466251 reap_dead start 2024-04-25T09:11:12.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.346+0000 7fdd35600640 1 --2- 172.21.15.59:0/2244466251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 0x7fdd18003de0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fdd24001780 tx=0x7fdd2401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc977eaf49a1dffe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.346+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd240013a0 con 0x7fdd180039c0 2024-04-25T09:11:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.346+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd240052f0 con 0x7fdd180039c0 2024-04-25T09:11:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.346+0000 7fdd2fe00640 1 -- 172.21.15.59:0/2244466251 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24003840 con 0x7fdd180039c0 2024-04-25T09:11:12.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.346+0000 7fdd38000640 1 -- 172.21.15.59:0/2244466251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 msgr2=0x7fdd18003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.346+0000 7fdd38000640 1 --2- 172.21.15.59:0/2244466251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 0x7fdd18003de0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fdd24001780 tx=0x7fdd2401c3d0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.346+0000 7fdd38000640 1 -- 172.21.15.59:0/2244466251 shutdown_connections 2024-04-25T09:11:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.346+0000 7fdd38000640 1 --2- 172.21.15.59:0/2244466251 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 0x7fdd18003de0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.346+0000 7fdd38000640 1 -- 172.21.15.59:0/2244466251 >> 172.21.15.59:0/2244466251 conn(0x7fdd300b3390 msgr2=0x7fdd300b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.346+0000 7fdd38000640 1 -- 172.21.15.59:0/2244466251 shutdown_connections 2024-04-25T09:11:12.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.346+0000 7fdd38000640 1 -- 172.21.15.59:0/2244466251 wait complete. 2024-04-25T09:11:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd38000640 1 Processor -- start 2024-04-25T09:11:12.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd38000640 1 -- start start 2024-04-25T09:11:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd38000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 0x7fdd301559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd38000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd30142780 0x7fdd30154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd38000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd30140ec0 0x7fdd30141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd38000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3015ed70 con 0x7fdd180039c0 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd38000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3015e030 con 0x7fdd30142780 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd38000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd300717d0 con 0x7fdd30140ec0 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd35600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 0x7fdd301559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd35600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 0x7fdd301559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40872/0 (socket says 172.21.15.59:40872) 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd35600640 1 -- 172.21.15.59:0/3169508392 learned_addr learned my addr 172.21.15.59:0/3169508392 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd34c00640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd30142780 0x7fdd30154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd36000640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd30140ec0 0x7fdd30141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd35600640 1 -- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd30140ec0 msgr2=0x7fdd30141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd35600640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd30140ec0 0x7fdd30141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd35600640 1 -- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd30142780 msgr2=0x7fdd30154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd35600640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd30142780 0x7fdd30154350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd35600640 1 -- 172.21.15.59:0/3169508392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd30156210 con 0x7fdd180039c0 2024-04-25T09:11:12.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd35600640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 0x7fdd301559c0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fdd24001780 tx=0x7fdd18005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd2d600640 1 -- 172.21.15.59:0/3169508392 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd24007a40 con 0x7fdd180039c0 2024-04-25T09:11:12.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd2d600640 1 -- 172.21.15.59:0/3169508392 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd240bb070 con 0x7fdd180039c0 2024-04-25T09:11:12.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd2d600640 1 -- 172.21.15.59:0/3169508392 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd240013a0 con 0x7fdd180039c0 2024-04-25T09:11:12.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd38000640 1 -- 172.21.15.59:0/3169508392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd301564f0 con 0x7fdd180039c0 2024-04-25T09:11:12.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd38000640 1 -- 172.21.15.59:0/3169508392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd30155f00 con 0x7fdd180039c0 2024-04-25T09:11:12.342 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.350+0000 7fdd38000640 1 -- 172.21.15.59:0/3169508392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd30141880 con 0x7fdd180039c0 2024-04-25T09:11:12.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.354+0000 7fdd2d600640 1 -- 172.21.15.59:0/3169508392 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdd240b4040 con 0x7fdd180039c0 2024-04-25T09:11:12.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.354+0000 7fdd2d600640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd10066f90 0x7fdd10069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.354+0000 7fdd2d600640 1 -- 172.21.15.59:0/3169508392 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5421+0+0 (secure 0 0 0) 0x7fdd2411ef20 con 0x7fdd180039c0 2024-04-25T09:11:12.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.354+0000 7fdd34c00640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd10066f90 0x7fdd10069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.354+0000 7fdd34c00640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd10066f90 0x7fdd10069450 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdd301fa4d0 tx=0x7fdd1c001120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.358+0000 7fdd2d600640 1 -- 172.21.15.59:0/3169508392 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdd24016110 con 0x7fdd180039c0 2024-04-25T09:11:12.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 -- 172.21.15.59:0/3169508392 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd300745d0 con 0x7fdd180039c0 2024-04-25T09:11:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd2d600640 1 -- 172.21.15.59:0/3169508392 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+3702 (secure 0 0 0) 0x7fdd240f00d0 con 0x7fdd180039c0 2024-04-25T09:11:12.547 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:12.547 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":97,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/3090559764","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":3090559764},{"type":"v1","addr":"172.21.15.178:6836","nonce":3090559764}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":7043,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/3451502776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":3451502776},{"type":"v1","addr":"172.21.15.178:6837","nonce":3451502776}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":82},{"gid":8319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2823344683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2823344683},{"type":"v1","addr":"172.21.15.59:6834","nonce":2823344683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":81},{"gid":8799,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/648458124","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":648458124},{"type":"v1","addr":"172.21.15.59:6835","nonce":648458124}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":95}],"filesystems":[]} 2024-04-25T09:11:12.547 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 97 2024-04-25T09:11:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 -- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd10066f90 msgr2=0x7fdd10069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd10066f90 0x7fdd10069450 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdd301fa4d0 tx=0x7fdd1c001120 comp rx=0 tx=0).stop 2024-04-25T09:11:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 -- 172.21.15.59:0/3169508392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 msgr2=0x7fdd301559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 0x7fdd301559c0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fdd24001780 tx=0x7fdd18005840 comp rx=0 tx=0).stop 2024-04-25T09:11:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 -- 172.21.15.59:0/3169508392 shutdown_connections 2024-04-25T09:11:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdd10066f90 0x7fdd10069450 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdd30140ec0 0x7fdd30141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdd30142780 0x7fdd30154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 --2- 172.21.15.59:0/3169508392 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd180039c0 0x7fdd301559c0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 -- 172.21.15.59:0/3169508392 >> 172.21.15.59:0/3169508392 conn(0x7fdd300b3390 msgr2=0x7fdd30140110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 -- 172.21.15.59:0/3169508392 shutdown_connections 2024-04-25T09:11:12.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.558+0000 7fdd38000640 1 -- 172.21.15.59:0/3169508392 wait complete. 2024-04-25T09:11:12.569 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T09:11:12.569 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-25T09:11:12.569 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:11:12.569 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:11:12.570 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T09:11:12.570 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-25T09:11:12.570 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:11:12.570 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:11:12.570 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T09:11:12.570 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-25T09:11:12.570 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:11:12.571 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:11:12.571 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T09:11:12.571 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-25T09:11:12.571 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:11:12.571 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:11:12.583 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:11:12.583 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T09:11:12.585 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:11:12.585 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T09:11:12.586 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:11:12.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T09:11:12.587 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:11:12.587 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T09:11:12.630 INFO:tasks.ceph.mds.b:Started 2024-04-25T09:11:12.630 DEBUG:teuthology.parallel:result is None 2024-04-25T09:11:12.632 INFO:tasks.ceph.mds.c:Started 2024-04-25T09:11:12.632 INFO:tasks.ceph.mds.d:Started 2024-04-25T09:11:12.632 DEBUG:teuthology.parallel:result is None 2024-04-25T09:11:12.632 DEBUG:teuthology.parallel:result is None 2024-04-25T09:11:12.634 INFO:tasks.ceph.mds.a:Started 2024-04-25T09:11:12.634 DEBUG:teuthology.parallel:result is None 2024-04-25T09:11:12.634 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-25T09:11:12.718 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T09:11:12.720 INFO:tasks.ceph.mds.d.smithi178.stdout:starting mds.d at 2024-04-25T09:11:12.721 INFO:tasks.ceph.mds.b.smithi178.stdout:starting mds.b at 2024-04-25T09:11:12.722 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:11:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.790+0000 7f696c000640 1 Processor -- start 2024-04-25T09:11:12.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.790+0000 7f696c000640 1 -- start start 2024-04-25T09:11:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.790+0000 7f696c000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696415dc00 0x7f69640af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.790+0000 7f696c000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f69640d0150 0x7f69640c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.790+0000 7f696c000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69640c70d0 0x7f696406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f696c000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69640cd860 con 0x7f69640c70d0 2024-04-25T09:11:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f696c000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69640b30d0 con 0x7f69640d0150 2024-04-25T09:11:12.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f696c000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640ccf30 con 0x7f696415dc00 2024-04-25T09:11:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f696a000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69640c70d0 0x7f696406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f696a000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69640c70d0 0x7f696406ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40898/0 (socket says 172.21.15.59:40898) 2024-04-25T09:11:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f696a000640 1 -- 172.21.15.59:0/4086565680 learned_addr learned my addr 172.21.15.59:0/4086565680 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f6968c00640 1 --2- 172.21.15.59:0/4086565680 >> v2:172.21.15.178:3300/0 conn(0x7f69640d0150 0x7f69640c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f6969600640 1 --2- 172.21.15.59:0/4086565680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696415dc00 0x7f69640af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f696a000640 1 -- 172.21.15.59:0/4086565680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696415dc00 msgr2=0x7f69640af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f696a000640 1 --2- 172.21.15.59:0/4086565680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696415dc00 0x7f69640af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f696a000640 1 -- 172.21.15.59:0/4086565680 >> v2:172.21.15.178:3300/0 conn(0x7f69640d0150 msgr2=0x7f69640c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f696a000640 1 --2- 172.21.15.59:0/4086565680 >> v2:172.21.15.178:3300/0 conn(0x7f69640d0150 0x7f69640c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f696a000640 1 -- 172.21.15.59:0/4086565680 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640cd210 con 0x7f69640c70d0 2024-04-25T09:11:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f6968c00640 1 --2- 172.21.15.59:0/4086565680 >> v2:172.21.15.178:3300/0 conn(0x7f69640d0150 0x7f69640c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:12.783 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f6969600640 1 --2- 172.21.15.59:0/4086565680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696415dc00 0x7f69640af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:12.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f696a000640 1 --2- 172.21.15.59:0/4086565680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69640c70d0 0x7f696406ac10 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f6964070df0 tx=0x7f695c01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216c1dba7c77acfe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.785 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f6963e00640 1 -- 172.21.15.59:0/4086565680 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0a64d0 con 0x7f69640c70d0 2024-04-25T09:11:12.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.794+0000 7f6963e00640 1 -- 172.21.15.59:0/4086565680 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c0a6670 con 0x7f69640c70d0 2024-04-25T09:11:12.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f6963e00640 1 -- 172.21.15.59:0/4086565680 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0a6a40 con 0x7f69640c70d0 2024-04-25T09:11:12.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 -- 172.21.15.59:0/4086565680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69640c70d0 msgr2=0x7f696406ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 --2- 172.21.15.59:0/4086565680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69640c70d0 0x7f696406ac10 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f6964070df0 tx=0x7f695c01c730 comp rx=0 tx=0).stop 2024-04-25T09:11:12.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 -- 172.21.15.59:0/4086565680 shutdown_connections 2024-04-25T09:11:12.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 --2- 172.21.15.59:0/4086565680 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69640c70d0 0x7f696406ac10 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 --2- 172.21.15.59:0/4086565680 >> v2:172.21.15.178:3300/0 conn(0x7f69640d0150 0x7f69640c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 --2- 172.21.15.59:0/4086565680 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f696415dc00 0x7f69640af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 -- 172.21.15.59:0/4086565680 >> 172.21.15.59:0/4086565680 conn(0x7f69640b2240 msgr2=0x7f69640b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:12.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 -- 172.21.15.59:0/4086565680 shutdown_connections 2024-04-25T09:11:12.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 -- 172.21.15.59:0/4086565680 wait complete. 2024-04-25T09:11:12.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 Processor -- start 2024-04-25T09:11:12.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 -- start start 2024-04-25T09:11:12.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69640c70d0 0x7f696415e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69640d0150 0x7f6964151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f696415dc00 0x7f6964151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640c54b0 con 0x7f69640c70d0 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640cdee0 con 0x7f696415dc00 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696c000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69640c5630 con 0x7f69640d0150 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f6969600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69640c70d0 0x7f696415e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f6969600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69640c70d0 0x7f696415e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40900/0 (socket says 172.21.15.59:40900) 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f6969600640 1 -- 172.21.15.59:0/39358647 learned_addr learned my addr 172.21.15.59:0/39358647 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f6968c00640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69640d0150 0x7f6964151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f696a000640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f696415dc00 0x7f6964151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f6969600640 1 -- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69640d0150 msgr2=0x7f6964151040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f6969600640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69640d0150 0x7f6964151040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f6969600640 1 -- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f696415dc00 msgr2=0x7f6964151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f6969600640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f696415dc00 0x7f6964151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.798+0000 7f6969600640 1 -- 172.21.15.59:0/39358647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640b5eb0 con 0x7f69640c70d0 2024-04-25T09:11:12.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.802+0000 7f6969600640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69640c70d0 0x7f696415e0f0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f695800d800 tx=0x7f695800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.802+0000 7f6961600640 1 -- 172.21.15.59:0/39358647 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958018020 con 0x7f69640c70d0 2024-04-25T09:11:12.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.802+0000 7f6961600640 1 -- 172.21.15.59:0/39358647 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69580096c0 con 0x7f69640c70d0 2024-04-25T09:11:12.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.802+0000 7f6961600640 1 -- 172.21.15.59:0/39358647 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958009ab0 con 0x7f69640c70d0 2024-04-25T09:11:12.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.802+0000 7f696c000640 1 -- 172.21.15.59:0/39358647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69640b6190 con 0x7f69640c70d0 2024-04-25T09:11:12.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.802+0000 7f696c000640 1 -- 172.21.15.59:0/39358647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6964152460 con 0x7f69640c70d0 2024-04-25T09:11:12.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.802+0000 7f696c000640 1 -- 172.21.15.59:0/39358647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69640745d0 con 0x7f69640c70d0 2024-04-25T09:11:12.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.802+0000 7f6961600640 1 -- 172.21.15.59:0/39358647 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f695801b020 con 0x7f69640c70d0 2024-04-25T09:11:12.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.802+0000 7f6961600640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6944066f60 0x7f6944069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:12.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.802+0000 7f6961600640 1 -- 172.21.15.59:0/39358647 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5421+0+0 (secure 0 0 0) 0x7f6958085590 con 0x7f69640c70d0 2024-04-25T09:11:12.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.802+0000 7f6968c00640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6944066f60 0x7f6944069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:12.794 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.806+0000 7f6968c00640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6944066f60 0x7f6944069420 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f69640af430 tx=0x7f6950008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:12.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.806+0000 7f6961600640 1 -- 172.21.15.59:0/39358647 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6958022020 con 0x7f69640c70d0 2024-04-25T09:11:12.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:12.982+0000 7f696c000640 1 -- 172.21.15.59:0/39358647 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f69640b6360 con 0x7f69640c70d0 2024-04-25T09:11:13.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.582+0000 7f6961600640 1 -- 172.21.15.59:0/39358647 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v115) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6958056590 con 0x7f69640c70d0 2024-04-25T09:11:13.574 INFO:teuthology.orchestra.run.smithi059.stderr: removed all blocklist entries 2024-04-25T09:11:13.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.586+0000 7f696c000640 1 -- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6944066f60 msgr2=0x7f6944069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.586+0000 7f696c000640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6944066f60 0x7f6944069420 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f69640af430 tx=0x7f6950008040 comp rx=0 tx=0).stop 2024-04-25T09:11:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.586+0000 7f696c000640 1 -- 172.21.15.59:0/39358647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69640c70d0 msgr2=0x7f696415e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.586+0000 7f696c000640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69640c70d0 0x7f696415e0f0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f695800d800 tx=0x7f695800dcc0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.586+0000 7f696c000640 1 -- 172.21.15.59:0/39358647 shutdown_connections 2024-04-25T09:11:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.586+0000 7f696c000640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6944066f60 0x7f6944069420 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.586+0000 7f696c000640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f696415dc00 0x7f6964151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.586+0000 7f696c000640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f69640d0150 0x7f6964151040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.586+0000 7f696c000640 1 --2- 172.21.15.59:0/39358647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f69640c70d0 0x7f696415e0f0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.586+0000 7f696c000640 1 -- 172.21.15.59:0/39358647 >> 172.21.15.59:0/39358647 conn(0x7f69640b2240 msgr2=0x7f69640d0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.586+0000 7f696c000640 1 -- 172.21.15.59:0/39358647 shutdown_connections 2024-04-25T09:11:13.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.586+0000 7f696c000640 1 -- 172.21.15.59:0/39358647 wait complete. 2024-04-25T09:11:13.602 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-25T09:11:13.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.754+0000 7fb09c800640 1 Processor -- start 2024-04-25T09:11:13.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.754+0000 7fb09c800640 1 -- start start 2024-04-25T09:11:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb09c800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb094143720 0x7fb094071690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb09c800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0940b3f00 0x7fb0940cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb09c800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb094071ee0 con 0x7fb09406f230 2024-04-25T09:11:13.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb09c800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0940ccd30 con 0x7fb094143720 2024-04-25T09:11:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb09c800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0940ccf90 con 0x7fb0940b3f00 2024-04-25T09:11:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb099400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb09406f230 0x7fb0940b37f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57708/0 (socket says 172.21.15.59:57708) 2024-04-25T09:11:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb099400640 1 -- 172.21.15.59:0/3998915492 learned_addr learned my addr 172.21.15.59:0/3998915492 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb099e00640 1 --2- 172.21.15.59:0/3998915492 >> v2:172.21.15.178:3300/0 conn(0x7fb094143720 0x7fb094071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb09a800640 1 --2- 172.21.15.59:0/3998915492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0940b3f00 0x7fb0940cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb098a00640 1 -- 172.21.15.59:0/3998915492 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231990971 0 0) 0x7fb094071ee0 con 0x7fb09406f230 2024-04-25T09:11:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb098a00640 1 -- 172.21.15.59:0/3998915492 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb07c003530 con 0x7fb09406f230 2024-04-25T09:11:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb09a800640 1 -- 172.21.15.59:0/3998915492 >> v2:172.21.15.178:3300/0 conn(0x7fb094143720 msgr2=0x7fb094071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb09a800640 1 --2- 172.21.15.59:0/3998915492 >> v2:172.21.15.178:3300/0 conn(0x7fb094143720 0x7fb094071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb09a800640 1 -- 172.21.15.59:0/3998915492 >> v1:172.21.15.59:6789/0 conn(0x7fb09406f230 legacy=0x7fb0940b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb09a800640 1 -- 172.21.15.59:0/3998915492 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0940cd270 con 0x7fb0940b3f00 2024-04-25T09:11:13.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.758+0000 7fb099e00640 1 --2- 172.21.15.59:0/3998915492 >> v2:172.21.15.178:3300/0 conn(0x7fb094143720 0x7fb094071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb09a800640 1 --2- 172.21.15.59:0/3998915492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0940b3f00 0x7fb0940cda70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb090009d90 tx=0x7fb09001c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ddaae5ac06f0db95 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:13.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb098a00640 1 -- 172.21.15.59:0/3998915492 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0900b2070 con 0x7fb0940b3f00 2024-04-25T09:11:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb098a00640 1 -- 172.21.15.59:0/3998915492 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0900a5830 con 0x7fb0940b3f00 2024-04-25T09:11:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb098a00640 1 -- 172.21.15.59:0/3998915492 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0900a5c00 con 0x7fb0940b3f00 2024-04-25T09:11:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb09c800640 1 -- 172.21.15.59:0/3998915492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0940b3f00 msgr2=0x7fb0940cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb09c800640 1 --2- 172.21.15.59:0/3998915492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0940b3f00 0x7fb0940cda70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb090009d90 tx=0x7fb09001c970 comp rx=0 tx=0).stop 2024-04-25T09:11:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb09c800640 1 -- 172.21.15.59:0/3998915492 shutdown_connections 2024-04-25T09:11:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb09c800640 1 --2- 172.21.15.59:0/3998915492 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb0940b3f00 0x7fb0940cda70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb09c800640 1 --2- 172.21.15.59:0/3998915492 >> v2:172.21.15.178:3300/0 conn(0x7fb094143720 0x7fb094071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb09c800640 1 -- 172.21.15.59:0/3998915492 >> 172.21.15.59:0/3998915492 conn(0x7fb0940b17b0 msgr2=0x7fb0940b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb09c800640 1 -- 172.21.15.59:0/3998915492 shutdown_connections 2024-04-25T09:11:13.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb09c800640 1 -- 172.21.15.59:0/3998915492 wait complete. 2024-04-25T09:11:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb09c800640 1 Processor -- start 2024-04-25T09:11:13.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.762+0000 7fb09c800640 1 -- start start 2024-04-25T09:11:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb09c800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb09406f230 0x7fb094141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb09c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0940b3f00 0x7fb0941627e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb09c800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb094143720 0x7fb094159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb09c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0940ceb90 con 0x7fb0940b3f00 2024-04-25T09:11:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb09c800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0940cea10 con 0x7fb09406f230 2024-04-25T09:11:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb09c800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0940ced10 con 0x7fb094143720 2024-04-25T09:11:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb099400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0940b3f00 0x7fb0941627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb099400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0940b3f00 0x7fb0941627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40916/0 (socket says 172.21.15.59:40916) 2024-04-25T09:11:13.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb099400640 1 -- 172.21.15.59:0/970042579 learned_addr learned my addr 172.21.15.59:0/970042579 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb099e00640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb09406f230 0x7fb094141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb09a800640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb094143720 0x7fb094159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb099400640 1 -- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb094143720 msgr2=0x7fb094159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb099400640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb094143720 0x7fb094159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb099400640 1 -- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb09406f230 msgr2=0x7fb094141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb099400640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb09406f230 0x7fb094141960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb099400640 1 -- 172.21.15.59:0/970042579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb094162d20 con 0x7fb0940b3f00 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb099400640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0940b3f00 0x7fb0941627e0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fb08400c450 tx=0x7fb08400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb08e000640 1 -- 172.21.15.59:0/970042579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084017070 con 0x7fb0940b3f00 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb08e000640 1 -- 172.21.15.59:0/970042579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb084005cf0 con 0x7fb0940b3f00 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb08e000640 1 -- 172.21.15.59:0/970042579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084007290 con 0x7fb0940b3f00 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb09c800640 1 -- 172.21.15.59:0/970042579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb094159d40 con 0x7fb0940b3f00 2024-04-25T09:11:13.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb09c800640 1 -- 172.21.15.59:0/970042579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb094163280 con 0x7fb0940b3f00 2024-04-25T09:11:13.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb09c800640 1 -- 172.21.15.59:0/970042579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0940745d0 con 0x7fb0940b3f00 2024-04-25T09:11:13.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.766+0000 7fb08e000640 1 -- 172.21.15.59:0/970042579 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb08401a070 con 0x7fb0940b3f00 2024-04-25T09:11:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.770+0000 7fb08e000640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb078066f90 0x7fb078069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.770+0000 7fb08e000640 1 -- 172.21.15.59:0/970042579 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fb084084250 con 0x7fb0940b3f00 2024-04-25T09:11:13.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.770+0000 7fb099e00640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb078066f90 0x7fb078069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:13.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.770+0000 7fb099e00640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb078066f90 0x7fb078069450 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb088009a50 tx=0x7fb088008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:13.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.774+0000 7fb08e000640 1 -- 172.21.15.59:0/970042579 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb094162d20 con 0x7fb0940b3f00 2024-04-25T09:11:13.983 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.994+0000 7fb09c800640 1 -- 172.21.15.59:0/970042579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb094157b40 con 0x7fb0940b3f00 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.994+0000 7fb08e000640 1 -- 172.21.15.59:0/970042579 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb084055380 con 0x7fb0940b3f00 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "auth_dump": [ 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.a", 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmefAMLRAAyOhrYPGN2IYchV7wMDkkTQ==", 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:11:13.984 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.b", 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmcZtGORAA9RU5OkQHTCXe5nkpEp77Fw==", 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.985 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.c", 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmF3skNBAAcKEUsLnvjEY8fz59SnjWtg==", 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mds.d", 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm95/1BBAAsIbA6GBVS4dl7sZ8CoZoLA==", 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.986 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.0", 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCsGypmmikBDRAAcxA0eWyo/w0bALsf4Fb3KQ==", 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.987 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.1", 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCvGypm66dNFxAAzl06IBbHoxHorB3FuCFNOQ==", 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.2", 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCyGypmQrwdIhAAyF53f8p7/vnJ6L4ZjXcKhQ==", 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.988 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.3", 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC1GypmtETmLBAAM4p1FOPAiB0aOcdfIcl6vg==", 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.4", 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC6GypmyXGCAhAAKJ2Yh0lezpRfFMPXjN4Asg==", 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:13.989 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.5", 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQC9GypmmfZZDBAAzw9IygUbRErERr2lXEfutA==", 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.990 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.6", 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDAGypmS4KRFRAAXrvA1QNbuWF6+ln+cz6orQ==", 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "osd.7", 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQDDGypmruPJHRAAWFONkZiSsYgvsr04uO9J9A==", 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow profile osd", 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile osd", 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.991 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.0", 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg==", 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow r", 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.1", 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypm8NCkEhAAEELIQ7EAUFHsANHAa5EnTA==", 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:11:13.992 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.2", 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmdosADxAAxmQqp2O5lT5XenyqxyyMKw==", 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.3", 2024-04-25T09:11:13.993 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCpGypmsqWgGBAAIXaSazGZkKiY2hqcC+WApA==", 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow", 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow r", 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow rw", 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow rwx" 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "client.admin", 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypm5ldPEBAAepEqWPcDy8atp78XxKERYg==", 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "mgr": "allow *", 2024-04-25T09:11:13.994 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow *", 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.x", 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmwOe7KBAAIvO6OJiUeb5hRdu9VX11cA==", 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: }, 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "entity": "mgr.y", 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "key": "AQCoGypmX2GpJBAA8RvpxNpdPFExISwQzT56fA==", 2024-04-25T09:11:13.995 INFO:teuthology.orchestra.run.smithi059.stdout: "caps": { 2024-04-25T09:11:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: "mds": "allow *", 2024-04-25T09:11:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: "mon": "allow profile mgr", 2024-04-25T09:11:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: "osd": "allow *" 2024-04-25T09:11:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:13.996 INFO:teuthology.orchestra.run.smithi059.stdout: ] 2024-04-25T09:11:13.996 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:11:13.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.994+0000 7fb09c800640 1 -- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb078066f90 msgr2=0x7fb078069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.998+0000 7fb09c800640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb078066f90 0x7fb078069450 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fb088009a50 tx=0x7fb088008040 comp rx=0 tx=0).stop 2024-04-25T09:11:13.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.998+0000 7fb09c800640 1 -- 172.21.15.59:0/970042579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0940b3f00 msgr2=0x7fb0941627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:13.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.998+0000 7fb09c800640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0940b3f00 0x7fb0941627e0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fb08400c450 tx=0x7fb08400c910 comp rx=0 tx=0).stop 2024-04-25T09:11:13.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.998+0000 7fb09c800640 1 -- 172.21.15.59:0/970042579 shutdown_connections 2024-04-25T09:11:13.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.998+0000 7fb09c800640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb078066f90 0x7fb078069450 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.998+0000 7fb09c800640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb094143720 0x7fb094159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.998+0000 7fb09c800640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0940b3f00 0x7fb0941627e0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.998+0000 7fb09c800640 1 --2- 172.21.15.59:0/970042579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb09406f230 0x7fb094141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:13.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.998+0000 7fb09c800640 1 -- 172.21.15.59:0/970042579 >> 172.21.15.59:0/970042579 conn(0x7fb0940b17b0 msgr2=0x7fb09406e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:13.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.998+0000 7fb09c800640 1 -- 172.21.15.59:0/970042579 shutdown_connections 2024-04-25T09:11:13.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:13.998+0000 7fb09c800640 1 -- 172.21.15.59:0/970042579 wait complete. 2024-04-25T09:11:14.005 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:14.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b33200640 1 Processor -- start 2024-04-25T09:11:14.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b33200640 1 -- start start 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b33200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b2c15fe50 0x7f3b2c0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b33200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3b2c0b1c90 0x7f3b2c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b33200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b2c0b20a0 con 0x7f3b2c145270 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b33200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c145650 con 0x7f3b2c15fe50 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b33200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2c1602b0 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b2b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b2c15fe50 0x7f3b2c0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b2b400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b2c15fe50 0x7f3b2c0b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40930/0 (socket says 172.21.15.59:40930) 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b2b400640 1 -- 172.21.15.59:0/3187872229 learned_addr learned my addr 172.21.15.59:0/3187872229 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:14.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b31200640 1 --2- 172.21.15.59:0/3187872229 >> v2:172.21.15.178:3300/0 conn(0x7f3b2c0b1c90 0x7f3b2c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b2b400640 1 -- 172.21.15.59:0/3187872229 >> v2:172.21.15.178:3300/0 conn(0x7f3b2c0b1c90 msgr2=0x7f3b2c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b2b400640 1 --2- 172.21.15.59:0/3187872229 >> v2:172.21.15.178:3300/0 conn(0x7f3b2c0b1c90 0x7f3b2c15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b2b400640 1 -- 172.21.15.59:0/3187872229 >> v1:172.21.15.178:6789/0 conn(0x7f3b2c145270 legacy=0x7f3b2c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b2b400640 1 -- 172.21.15.59:0/3187872229 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0cc4e0 con 0x7f3b2c15fe50 2024-04-25T09:11:14.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.158+0000 7f3b31200640 1 --2- 172.21.15.59:0/3187872229 >> v2:172.21.15.178:3300/0 conn(0x7f3b2c0b1c90 0x7f3b2c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:14.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.162+0000 7f3b2b400640 1 --2- 172.21.15.59:0/3187872229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c15fe50 0x7f3b2c0b1750 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0b4b90 tx=0x7f3b1801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdade28f6f364f72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.162+0000 7f3b2aa00640 1 -- 172.21.15.59:0/3187872229 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b180aa650 con 0x7f3b2c15fe50 2024-04-25T09:11:14.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.162+0000 7f3b2aa00640 1 -- 172.21.15.59:0/3187872229 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b180af070 con 0x7f3b2c15fe50 2024-04-25T09:11:14.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.162+0000 7f3b2aa00640 1 -- 172.21.15.59:0/3187872229 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b180aaa10 con 0x7f3b2c15fe50 2024-04-25T09:11:14.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.162+0000 7f3b33200640 1 -- 172.21.15.59:0/3187872229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c15fe50 msgr2=0x7f3b2c0b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.162+0000 7f3b33200640 1 --2- 172.21.15.59:0/3187872229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c15fe50 0x7f3b2c0b1750 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0b4b90 tx=0x7f3b1801c4f0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.162+0000 7f3b33200640 1 -- 172.21.15.59:0/3187872229 shutdown_connections 2024-04-25T09:11:14.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.162+0000 7f3b33200640 1 --2- 172.21.15.59:0/3187872229 >> v2:172.21.15.178:3300/0 conn(0x7f3b2c0b1c90 0x7f3b2c15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.162+0000 7f3b33200640 1 --2- 172.21.15.59:0/3187872229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c15fe50 0x7f3b2c0b1750 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.162+0000 7f3b33200640 1 -- 172.21.15.59:0/3187872229 >> 172.21.15.59:0/3187872229 conn(0x7f3b2c066fa0 msgr2=0x7f3b2c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.162+0000 7f3b33200640 1 -- 172.21.15.59:0/3187872229 shutdown_connections 2024-04-25T09:11:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.162+0000 7f3b33200640 1 -- 172.21.15.59:0/3187872229 wait complete. 2024-04-25T09:11:14.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b33200640 1 Processor -- start 2024-04-25T09:11:14.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b33200640 1 -- start start 2024-04-25T09:11:14.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b33200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c0b1c90 0x7f3b2c13abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b33200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c145270 0x7f3b2c165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b33200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b2c15fe50 0x7f3b2c165e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b33200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c15f930 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b33200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c15f650 con 0x7f3b2c15fe50 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b33200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2c0cdbe0 con 0x7f3b2c145270 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b2be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c0b1c90 0x7f3b2c13abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b2be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c0b1c90 0x7f3b2c13abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40934/0 (socket says 172.21.15.59:40934) 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b2be00640 1 -- 172.21.15.59:0/3576207040 learned_addr learned my addr 172.21.15.59:0/3576207040 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b2b400640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c145270 0x7f3b2c165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b31200640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b2c15fe50 0x7f3b2c165e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b2be00640 1 -- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c145270 msgr2=0x7f3b2c165920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b2be00640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c145270 0x7f3b2c165920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b2be00640 1 -- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b2c15fe50 msgr2=0x7f3b2c165e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b2be00640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b2c15fe50 0x7f3b2c165e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b2be00640 1 -- 172.21.15.59:0/3576207040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c0b0b30 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b31200640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b2c15fe50 0x7f3b2c165e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b2be00640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c0b1c90 0x7f3b2c13abf0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c420 tx=0x7f3b1c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b23e00640 1 -- 172.21.15.59:0/3576207040 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c0052d0 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b23e00640 1 -- 172.21.15.59:0/3576207040 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c005470 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b23e00640 1 -- 172.21.15.59:0/3576207040 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c007260 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b33200640 1 -- 172.21.15.59:0/3576207040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b2c0b0e10 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b33200640 1 -- 172.21.15.59:0/3576207040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b2c0aff50 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.166+0000 7f3b33200640 1 -- 172.21.15.59:0/3576207040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b2c0745d0 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.170+0000 7f3b23e00640 1 -- 172.21.15.59:0/3576207040 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3b1c007400 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.170+0000 7f3b23e00640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3b0c066f60 0x7f3b0c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.170+0000 7f3b23e00640 1 -- 172.21.15.59:0/3576207040 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f3b1c084390 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.170+0000 7f3b2b400640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3b0c066f60 0x7f3b0c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.170+0000 7f3b2b400640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3b0c066f60 0x7f3b0c069420 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3b180ae000 tx=0x7f3b180a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.174+0000 7f3b23e00640 1 -- 172.21.15.59:0/3576207040 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3b2c0b20a0 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 -- 172.21.15.59:0/3576207040 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b2c0ae8e0 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b23e00640 1 -- 172.21.15.59:0/3576207040 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) v1 ==== 74+0+13174 (secure 0 0 0) 0x7f3b1c054e70 con 0x7f3b2c0b1c90 2024-04-25T09:11:14.327 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:14.327 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":117,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:13.599041+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 -- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3b0c066f60 msgr2=0x7f3b0c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3b0c066f60 0x7f3b0c069420 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f3b180ae000 tx=0x7f3b180a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 -- 172.21.15.59:0/3576207040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c0b1c90 msgr2=0x7f3b2c13abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c0b1c90 0x7f3b2c13abf0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c420 tx=0x7f3b1c00c8e0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 -- 172.21.15.59:0/3576207040 shutdown_connections 2024-04-25T09:11:14.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3b0c066f60 0x7f3b0c069420 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3b2c15fe50 0x7f3b2c165e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3b2c145270 0x7f3b2c165920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 --2- 172.21.15.59:0/3576207040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b2c0b1c90 0x7f3b2c13abf0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 -- 172.21.15.59:0/3576207040 >> 172.21.15.59:0/3576207040 conn(0x7f3b2c066fa0 msgr2=0x7f3b2c0736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 -- 172.21.15.59:0/3576207040 shutdown_connections 2024-04-25T09:11:14.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.338+0000 7f3b33200640 1 -- 172.21.15.59:0/3576207040 wait complete. 2024-04-25T09:11:14.349 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:14.349 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:14.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.502+0000 7f2065a00640 1 Processor -- start 2024-04-25T09:11:14.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.502+0000 7f2065a00640 1 -- start start 2024-04-25T09:11:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f2065a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f206015dc60 0x7f20600d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f2065a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f206009a170 0x7f20600cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f2065a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206015e040 con 0x7f206006bf30 2024-04-25T09:11:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f2065a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20600cff80 con 0x7f206009a170 2024-04-25T09:11:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f2065a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20600d0260 con 0x7f206015dc60 2024-04-25T09:11:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f2056000640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f206006bf30 0x7f2060099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57714/0 (socket says 172.21.15.59:57714) 2024-04-25T09:11:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f2056000640 1 -- 172.21.15.59:0/869088413 learned_addr learned my addr 172.21.15.59:0/869088413 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f205f400640 1 --2- 172.21.15.59:0/869088413 >> v2:172.21.15.59:3300/0 conn(0x7f206009a170 0x7f20600cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f205ea00640 1 --2- 172.21.15.59:0/869088413 >> v2:172.21.15.178:3300/0 conn(0x7f206015dc60 0x7f20600d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f205e000640 1 -- 172.21.15.59:0/869088413 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1330347059 0 0) 0x7f206015e040 con 0x7f206006bf30 2024-04-25T09:11:14.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f205e000640 1 -- 172.21.15.59:0/869088413 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2044003530 con 0x7f206006bf30 2024-04-25T09:11:14.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f205f400640 1 -- 172.21.15.59:0/869088413 >> v2:172.21.15.178:3300/0 conn(0x7f206015dc60 msgr2=0x7f20600d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:14.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f205f400640 1 --2- 172.21.15.59:0/869088413 >> v2:172.21.15.178:3300/0 conn(0x7f206015dc60 0x7f20600d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f205f400640 1 -- 172.21.15.59:0/869088413 >> v1:172.21.15.59:6789/0 conn(0x7f206006bf30 legacy=0x7f2060099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.506+0000 7f205f400640 1 -- 172.21.15.59:0/869088413 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600d0540 con 0x7f206009a170 2024-04-25T09:11:14.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f205f400640 1 --2- 172.21.15.59:0/869088413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206009a170 0x7f20600cf8a0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f206009a6b0 tx=0x7f205801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3adc4723bc3d409 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f205e000640 1 -- 172.21.15.59:0/869088413 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580b2070 con 0x7f206009a170 2024-04-25T09:11:14.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f205e000640 1 -- 172.21.15.59:0/869088413 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20580a5930 con 0x7f206009a170 2024-04-25T09:11:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f205e000640 1 -- 172.21.15.59:0/869088413 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580a5d00 con 0x7f206009a170 2024-04-25T09:11:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f2065a00640 1 -- 172.21.15.59:0/869088413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206009a170 msgr2=0x7f20600cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f2065a00640 1 --2- 172.21.15.59:0/869088413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206009a170 0x7f20600cf8a0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f206009a6b0 tx=0x7f205801c870 comp rx=0 tx=0).stop 2024-04-25T09:11:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f2065a00640 1 -- 172.21.15.59:0/869088413 shutdown_connections 2024-04-25T09:11:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f2065a00640 1 --2- 172.21.15.59:0/869088413 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206009a170 0x7f20600cf8a0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f2065a00640 1 --2- 172.21.15.59:0/869088413 >> v2:172.21.15.178:3300/0 conn(0x7f206015dc60 0x7f20600d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f2065a00640 1 -- 172.21.15.59:0/869088413 >> 172.21.15.59:0/869088413 conn(0x7f20600b3200 msgr2=0x7f20600b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f2065a00640 1 -- 172.21.15.59:0/869088413 shutdown_connections 2024-04-25T09:11:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f2065a00640 1 -- 172.21.15.59:0/869088413 wait complete. 2024-04-25T09:11:14.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f2065a00640 1 Processor -- start 2024-04-25T09:11:14.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.510+0000 7f2065a00640 1 -- start start 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2065a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206006bf30 0x7f20600ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2065a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206009a170 0x7f2060155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2065a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206015dc60 0x7f2060156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2065a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20600cc6f0 con 0x7f206006bf30 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2065a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20600cc570 con 0x7f206009a170 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2065a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20600cc870 con 0x7f206015dc60 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f205ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206006bf30 0x7f20600ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f205ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206006bf30 0x7f20600ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40954/0 (socket says 172.21.15.59:40954) 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f205ea00640 1 -- 172.21.15.59:0/1738655289 learned_addr learned my addr 172.21.15.59:0/1738655289 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f205ea00640 1 -- 172.21.15.59:0/1738655289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206015dc60 msgr2=0x7f2060156410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f205ea00640 1 --2- 172.21.15.59:0/1738655289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206015dc60 0x7f2060156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f205ea00640 1 -- 172.21.15.59:0/1738655289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206009a170 msgr2=0x7f2060155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f205ea00640 1 --2- 172.21.15.59:0/1738655289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206009a170 0x7f2060155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f205ea00640 1 -- 172.21.15.59:0/1738655289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600cad10 con 0x7f206006bf30 2024-04-25T09:11:14.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f205ea00640 1 --2- 172.21.15.59:0/1738655289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206006bf30 0x7f20600ca7d0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f205000e870 tx=0x7f205000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2057400640 1 -- 172.21.15.59:0/1738655289 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2050017070 con 0x7f206006bf30 2024-04-25T09:11:14.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2057400640 1 -- 172.21.15.59:0/1738655289 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205000c940 con 0x7f206006bf30 2024-04-25T09:11:14.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2057400640 1 -- 172.21.15.59:0/1738655289 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205000ccf0 con 0x7f206006bf30 2024-04-25T09:11:14.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2065a00640 1 -- 172.21.15.59:0/1738655289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2060156190 con 0x7f206006bf30 2024-04-25T09:11:14.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2065a00640 1 -- 172.21.15.59:0/1738655289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20600b5190 con 0x7f206006bf30 2024-04-25T09:11:14.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2065a00640 1 -- 172.21.15.59:0/1738655289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20600745d0 con 0x7f206006bf30 2024-04-25T09:11:14.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.514+0000 7f2057400640 1 -- 172.21.15.59:0/1738655289 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f205001a070 con 0x7f206006bf30 2024-04-25T09:11:14.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.518+0000 7f2057400640 1 --2- 172.21.15.59:0/1738655289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f203c066f60 0x7f203c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.518+0000 7f2057400640 1 -- 172.21.15.59:0/1738655289 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f2050084d10 con 0x7f206006bf30 2024-04-25T09:11:14.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.518+0000 7f2056000640 1 --2- 172.21.15.59:0/1738655289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f203c066f60 0x7f203c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.518+0000 7f2056000640 1 --2- 172.21.15.59:0/1738655289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f203c066f60 0x7f203c069420 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2048007fd0 tx=0x7f2048007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.522+0000 7f2057400640 1 -- 172.21.15.59:0/1738655289 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f205008a020 con 0x7f206006bf30 2024-04-25T09:11:14.673 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.682+0000 7f2065a00640 1 -- 172.21.15.59:0/1738655289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20600b7590 con 0x7f206006bf30 2024-04-25T09:11:14.674 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2057400640 1 -- 172.21.15.59:0/1738655289 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v117) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2050055ed0 con 0x7f206006bf30 2024-04-25T09:11:14.674 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:11:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2065a00640 1 -- 172.21.15.59:0/1738655289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f203c066f60 msgr2=0x7f203c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2065a00640 1 --2- 172.21.15.59:0/1738655289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f203c066f60 0x7f203c069420 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2048007fd0 tx=0x7f2048007900 comp rx=0 tx=0).stop 2024-04-25T09:11:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2065a00640 1 -- 172.21.15.59:0/1738655289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206006bf30 msgr2=0x7f20600ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2065a00640 1 --2- 172.21.15.59:0/1738655289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206006bf30 0x7f20600ca7d0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f205000e870 tx=0x7f205000ec70 comp rx=0 tx=0).stop 2024-04-25T09:11:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2065a00640 1 -- 172.21.15.59:0/1738655289 shutdown_connections 2024-04-25T09:11:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2065a00640 1 --2- 172.21.15.59:0/1738655289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f203c066f60 0x7f203c069420 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.676 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2065a00640 1 --2- 172.21.15.59:0/1738655289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f206015dc60 0x7f2060156410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2065a00640 1 --2- 172.21.15.59:0/1738655289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f206009a170 0x7f2060155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2065a00640 1 --2- 172.21.15.59:0/1738655289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f206006bf30 0x7f20600ca7d0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2065a00640 1 -- 172.21.15.59:0/1738655289 >> 172.21.15.59:0/1738655289 conn(0x7f20600b3200 msgr2=0x7f20600ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2065a00640 1 -- 172.21.15.59:0/1738655289 shutdown_connections 2024-04-25T09:11:14.677 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.686+0000 7f2065a00640 1 -- 172.21.15.59:0/1738655289 wait complete. 2024-04-25T09:11:14.695 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T09:11:14.836 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.846+0000 7fa670e00640 1 Processor -- start 2024-04-25T09:11:14.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.846+0000 7fa670e00640 1 -- start start 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa670e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66c15fe50 0x7fa66c0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa670e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa66c0b1c90 0x7fa66c15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa670e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c0cc4e0 con 0x7fa66c145270 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa670e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66c0b20e0 con 0x7fa66c0b1c90 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa670e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c145650 con 0x7fa66c15fe50 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa669e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa66c145270 0x7fa66c0cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57730/0 (socket says 172.21.15.59:57730) 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa669e00640 1 -- 172.21.15.59:0/1190073076 learned_addr learned my addr 172.21.15.59:0/1190073076 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa66a800640 1 --2- 172.21.15.59:0/1190073076 >> v2:172.21.15.59:3300/0 conn(0x7fa66c0b1c90 0x7fa66c15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa663e00640 1 --2- 172.21.15.59:0/1190073076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66c15fe50 0x7fa66c0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa669400640 1 -- 172.21.15.59:0/1190073076 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 106408267 0 0) 0x7fa66c0cc4e0 con 0x7fa66c145270 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa669400640 1 -- 172.21.15.59:0/1190073076 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa650003530 con 0x7fa66c145270 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa66a800640 1 -- 172.21.15.59:0/1190073076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66c15fe50 msgr2=0x7fa66c0b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa66a800640 1 --2- 172.21.15.59:0/1190073076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66c15fe50 0x7fa66c0b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa66a800640 1 -- 172.21.15.59:0/1190073076 >> v1:172.21.15.59:6789/0 conn(0x7fa66c145270 legacy=0x7fa66c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa66a800640 1 -- 172.21.15.59:0/1190073076 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c0ce040 con 0x7fa66c0b1c90 2024-04-25T09:11:14.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.850+0000 7fa66a800640 1 --2- 172.21.15.59:0/1190073076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66c0b1c90 0x7fa66c15bd80 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fa664009dc0 tx=0x7fa66401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3a01bba1aa212a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa669400640 1 -- 172.21.15.59:0/1190073076 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640b2070 con 0x7fa66c0b1c90 2024-04-25T09:11:14.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa669400640 1 -- 172.21.15.59:0/1190073076 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6640a5900 con 0x7fa66c0b1c90 2024-04-25T09:11:14.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa669400640 1 -- 172.21.15.59:0/1190073076 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640a5cd0 con 0x7fa66c0b1c90 2024-04-25T09:11:14.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 -- 172.21.15.59:0/1190073076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66c0b1c90 msgr2=0x7fa66c15bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 --2- 172.21.15.59:0/1190073076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66c0b1c90 0x7fa66c15bd80 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7fa664009dc0 tx=0x7fa66401c950 comp rx=0 tx=0).stop 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 -- 172.21.15.59:0/1190073076 shutdown_connections 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 --2- 172.21.15.59:0/1190073076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66c0b1c90 0x7fa66c15bd80 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 --2- 172.21.15.59:0/1190073076 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66c15fe50 0x7fa66c0b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 -- 172.21.15.59:0/1190073076 >> 172.21.15.59:0/1190073076 conn(0x7fa66c066fa0 msgr2=0x7fa66c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 -- 172.21.15.59:0/1190073076 shutdown_connections 2024-04-25T09:11:14.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 -- 172.21.15.59:0/1190073076 wait complete. 2024-04-25T09:11:14.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 Processor -- start 2024-04-25T09:11:14.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 -- start start 2024-04-25T09:11:14.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66c0b1c90 0x7fa66c15ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66c145270 0x7fa66c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66c15fe50 0x7fa66c141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0cdbe0 con 0x7fa66c145270 2024-04-25T09:11:14.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c15f930 con 0x7fa66c0b1c90 2024-04-25T09:11:14.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa670e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0cdd60 con 0x7fa66c15fe50 2024-04-25T09:11:14.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa663e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66c145270 0x7fa66c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa663e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66c145270 0x7fa66c15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40978/0 (socket says 172.21.15.59:40978) 2024-04-25T09:11:14.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.854+0000 7fa663e00640 1 -- 172.21.15.59:0/1766346275 learned_addr learned my addr 172.21.15.59:0/1766346275 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa66a800640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66c15fe50 0x7fa66c141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa669e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66c0b1c90 0x7fa66c15ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa663e00640 1 -- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66c15fe50 msgr2=0x7fa66c141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa663e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66c15fe50 0x7fa66c141f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa663e00640 1 -- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66c0b1c90 msgr2=0x7fa66c15ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa663e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66c0b1c90 0x7fa66c15ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa663e00640 1 -- 172.21.15.59:0/1766346275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c165fa0 con 0x7fa66c145270 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa669e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66c0b1c90 0x7fa66c15ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa663e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66c145270 0x7fa66c15a5e0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fa65400d620 tx=0x7fa65400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa662000640 1 -- 172.21.15.59:0/1766346275 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65400b620 con 0x7fa66c145270 2024-04-25T09:11:14.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa662000640 1 -- 172.21.15.59:0/1766346275 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa654019070 con 0x7fa66c145270 2024-04-25T09:11:14.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa670e00640 1 -- 172.21.15.59:0/1766346275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c166280 con 0x7fa66c145270 2024-04-25T09:11:14.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa662000640 1 -- 172.21.15.59:0/1766346275 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65400b9e0 con 0x7fa66c145270 2024-04-25T09:11:14.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa670e00640 1 -- 172.21.15.59:0/1766346275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c164ce0 con 0x7fa66c145270 2024-04-25T09:11:14.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa670e00640 1 -- 172.21.15.59:0/1766346275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c0745d0 con 0x7fa66c145270 2024-04-25T09:11:14.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa662000640 1 -- 172.21.15.59:0/1766346275 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa65400bb80 con 0x7fa66c145270 2024-04-25T09:11:14.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa662000640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa648066f60 0x7fa648069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:14.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa662000640 1 -- 172.21.15.59:0/1766346275 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5249+0+0 (secure 0 0 0) 0x7fa654085290 con 0x7fa66c145270 2024-04-25T09:11:14.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.858+0000 7fa669e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa648066f60 0x7fa648069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:14.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.862+0000 7fa669e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa648066f60 0x7fa648069420 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa65c005890 tx=0x7fa65c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:14.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:14.862+0000 7fa662000640 1 -- 172.21.15.59:0/1766346275 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa654056450 con 0x7fa66c145270 2024-04-25T09:11:15.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.030+0000 7fa670e00640 1 -- 172.21.15.59:0/1766346275 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa66c0ccd80 con 0x7fa66c145270 2024-04-25T09:11:15.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.030+0000 7fa662000640 1 -- 172.21.15.59:0/1766346275 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v117) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa654055d50 con 0x7fa66c145270 2024-04-25T09:11:15.022 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:15.022 INFO:teuthology.orchestra.run.smithi059.stdout:[ 2024-04-25T09:11:15.022 INFO:teuthology.orchestra.run.smithi059.stdout: { 2024-04-25T09:11:15.022 INFO:teuthology.orchestra.run.smithi059.stdout: "poolnum": 1, 2024-04-25T09:11:15.022 INFO:teuthology.orchestra.run.smithi059.stdout: "poolname": ".mgr" 2024-04-25T09:11:15.022 INFO:teuthology.orchestra.run.smithi059.stdout: } 2024-04-25T09:11:15.022 INFO:teuthology.orchestra.run.smithi059.stdout:] 2024-04-25T09:11:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.034+0000 7fa670e00640 1 -- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa648066f60 msgr2=0x7fa648069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.034+0000 7fa670e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa648066f60 0x7fa648069420 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa65c005890 tx=0x7fa65c009040 comp rx=0 tx=0).stop 2024-04-25T09:11:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.034+0000 7fa670e00640 1 -- 172.21.15.59:0/1766346275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66c145270 msgr2=0x7fa66c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.034+0000 7fa670e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66c145270 0x7fa66c15a5e0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7fa65400d620 tx=0x7fa65400dae0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.034+0000 7fa670e00640 1 -- 172.21.15.59:0/1766346275 shutdown_connections 2024-04-25T09:11:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.034+0000 7fa670e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa648066f60 0x7fa648069420 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.034+0000 7fa670e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa66c15fe50 0x7fa66c141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.034+0000 7fa670e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa66c145270 0x7fa66c15a5e0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.034+0000 7fa670e00640 1 --2- 172.21.15.59:0/1766346275 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa66c0b1c90 0x7fa66c15ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.034+0000 7fa670e00640 1 -- 172.21.15.59:0/1766346275 >> 172.21.15.59:0/1766346275 conn(0x7fa66c066fa0 msgr2=0x7fa66c142870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.034+0000 7fa670e00640 1 -- 172.21.15.59:0/1766346275 shutdown_connections 2024-04-25T09:11:15.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.034+0000 7fa670e00640 1 -- 172.21.15.59:0/1766346275 wait complete. 2024-04-25T09:11:15.043 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T09:11:15.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T09:11:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.198+0000 7f2893e00640 1 Processor -- start 2024-04-25T09:11:15.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.198+0000 7f2893e00640 1 -- start start 2024-04-25T09:11:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f2893e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28940b2700 0x7f289409a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f2893e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2894099be0 con 0x7f289409a900 2024-04-25T09:11:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f2893e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28940d0580 con 0x7f289415dc90 2024-04-25T09:11:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f2893e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28940cc280 con 0x7f28940b2700 2024-04-25T09:11:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f2893400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f289409a900 0x7f2894161710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57736/0 (socket says 172.21.15.59:57736) 2024-04-25T09:11:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f2893400640 1 -- 172.21.15.59:0/2296184102 learned_addr learned my addr 172.21.15.59:0/2296184102 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f288a000640 1 --2- 172.21.15.59:0/2296184102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28940b2700 0x7f289409a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f2892000640 1 -- 172.21.15.59:0/2296184102 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3625649749 0 0) 0x7f2894099be0 con 0x7f289409a900 2024-04-25T09:11:15.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f2892000640 1 -- 172.21.15.59:0/2296184102 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2878003530 con 0x7f289409a900 2024-04-25T09:11:15.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f2892000640 1 -- 172.21.15.59:0/2296184102 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329095291 0 0) 0x7f28940d0580 con 0x7f289415dc90 2024-04-25T09:11:15.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f2892000640 1 -- 172.21.15.59:0/2296184102 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2894099be0 con 0x7f289415dc90 2024-04-25T09:11:15.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f288a000640 1 -- 172.21.15.59:0/2296184102 >> v1:172.21.15.178:6789/0 conn(0x7f289415dc90 legacy=0x7f28940cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f288a000640 1 -- 172.21.15.59:0/2296184102 >> v1:172.21.15.59:6789/0 conn(0x7f289409a900 legacy=0x7f2894161710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.192 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.202+0000 7f288a000640 1 -- 172.21.15.59:0/2296184102 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28940d0860 con 0x7f28940b2700 2024-04-25T09:11:15.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f288a000640 1 --2- 172.21.15.59:0/2296184102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28940b2700 0x7f289409a3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f287c0097f0 tx=0x7f287c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9110d94b8e12d2ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:15.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2892000640 1 -- 172.21.15.59:0/2296184102 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0b2070 con 0x7f28940b2700 2024-04-25T09:11:15.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2892000640 1 -- 172.21.15.59:0/2296184102 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c0a9070 con 0x7f28940b2700 2024-04-25T09:11:15.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2892000640 1 -- 172.21.15.59:0/2296184102 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2894162630 con 0x7f28940b2700 2024-04-25T09:11:15.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 -- 172.21.15.59:0/2296184102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28940b2700 msgr2=0x7f289409a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 --2- 172.21.15.59:0/2296184102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28940b2700 0x7f289409a3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f287c0097f0 tx=0x7f287c01c450 comp rx=0 tx=0).stop 2024-04-25T09:11:15.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 -- 172.21.15.59:0/2296184102 shutdown_connections 2024-04-25T09:11:15.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 --2- 172.21.15.59:0/2296184102 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f28940b2700 0x7f289409a3c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 -- 172.21.15.59:0/2296184102 >> 172.21.15.59:0/2296184102 conn(0x7f28940b3010 msgr2=0x7f28940b3420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:15.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 -- 172.21.15.59:0/2296184102 shutdown_connections 2024-04-25T09:11:15.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 -- 172.21.15.59:0/2296184102 wait complete. 2024-04-25T09:11:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 Processor -- start 2024-04-25T09:11:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 -- start start 2024-04-25T09:11:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f289409a900 0x7f2894155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28940b2700 0x7f28941527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f289415dc90 0x7f2894156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f289416bc70 con 0x7f289415dc90 2024-04-25T09:11:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2894099f30 con 0x7f28940b2700 2024-04-25T09:11:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.206+0000 7f2893e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289416bdf0 con 0x7f289409a900 2024-04-25T09:11:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2893400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f289415dc90 0x7f2894156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2893400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f289415dc90 0x7f2894156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:40990/0 (socket says 172.21.15.59:40990) 2024-04-25T09:11:15.198 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2893400640 1 -- 172.21.15.59:0/611195790 learned_addr learned my addr 172.21.15.59:0/611195790 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:15.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2892a00640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f289409a900 0x7f2894155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f288a000640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28940b2700 0x7f28941527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2893400640 1 -- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f289409a900 msgr2=0x7f2894155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2893400640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f289409a900 0x7f2894155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2893400640 1 -- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28940b2700 msgr2=0x7f28941527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2893400640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28940b2700 0x7f28941527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2893400640 1 -- 172.21.15.59:0/611195790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28940b4640 con 0x7f289415dc90 2024-04-25T09:11:15.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2893400640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f289415dc90 0x7f2894156240 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f288c00caa0 tx=0x7f288c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:15.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f288b400640 1 -- 172.21.15.59:0/611195790 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c017070 con 0x7f289415dc90 2024-04-25T09:11:15.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f288b400640 1 -- 172.21.15.59:0/611195790 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c00ac20 con 0x7f289415dc90 2024-04-25T09:11:15.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2893e00640 1 -- 172.21.15.59:0/611195790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28940c9bd0 con 0x7f289415dc90 2024-04-25T09:11:15.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f288b400640 1 -- 172.21.15.59:0/611195790 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c012640 con 0x7f289415dc90 2024-04-25T09:11:15.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2893e00640 1 -- 172.21.15.59:0/611195790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f289415d2e0 con 0x7f289415dc90 2024-04-25T09:11:15.200 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f2893e00640 1 -- 172.21.15.59:0/611195790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28940ca0f0 con 0x7f289415dc90 2024-04-25T09:11:15.201 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.210+0000 7f288b400640 1 -- 172.21.15.59:0/611195790 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f288c01a070 con 0x7f289415dc90 2024-04-25T09:11:15.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.214+0000 7f288b400640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2870066f60 0x7f2870069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.214+0000 7f288b400640 1 -- 172.21.15.59:0/611195790 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5249+0+0 (secure 0 0 0) 0x7f288c084b50 con 0x7f289415dc90 2024-04-25T09:11:15.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.214+0000 7f2892a00640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2870066f60 0x7f2870069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.202 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.214+0000 7f2892a00640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2870066f60 0x7f2870069420 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2894169a20 tx=0x7f2884009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:15.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.214+0000 7f288b400640 1 -- 172.21.15.59:0/611195790 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f28940ca0f0 con 0x7f289415dc90 2024-04-25T09:11:15.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.378+0000 7f2893e00640 1 -- 172.21.15.59:0/611195790 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f28940745d0 con 0x7f289415dc90 2024-04-25T09:11:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.602+0000 7f288b400640 1 -- 172.21.15.59:0/611195790 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v118) v1 ==== 138+0+0 (secure 0 0 0) 0x7f288c0556c0 con 0x7f289415dc90 2024-04-25T09:11:15.592 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' created 2024-04-25T09:11:15.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.606+0000 7f2893e00640 1 -- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2870066f60 msgr2=0x7f2870069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.606+0000 7f2893e00640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2870066f60 0x7f2870069420 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f2894169a20 tx=0x7f2884009040 comp rx=0 tx=0).stop 2024-04-25T09:11:15.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.606+0000 7f2893e00640 1 -- 172.21.15.59:0/611195790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f289415dc90 msgr2=0x7f2894156240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.606+0000 7f2893e00640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f289415dc90 0x7f2894156240 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f288c00caa0 tx=0x7f288c00cf60 comp rx=0 tx=0).stop 2024-04-25T09:11:15.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.606+0000 7f2893e00640 1 -- 172.21.15.59:0/611195790 shutdown_connections 2024-04-25T09:11:15.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.606+0000 7f2893e00640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2870066f60 0x7f2870069420 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.606+0000 7f2893e00640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f289415dc90 0x7f2894156240 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.606+0000 7f2893e00640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f28940b2700 0x7f28941527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.606+0000 7f2893e00640 1 --2- 172.21.15.59:0/611195790 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f289409a900 0x7f2894155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.606+0000 7f2893e00640 1 -- 172.21.15.59:0/611195790 >> 172.21.15.59:0/611195790 conn(0x7f28940b3010 msgr2=0x7f289406fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:15.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.606+0000 7f2893e00640 1 -- 172.21.15.59:0/611195790 shutdown_connections 2024-04-25T09:11:15.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.606+0000 7f2893e00640 1 -- 172.21.15.59:0/611195790 wait complete. 2024-04-25T09:11:15.620 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T09:11:15.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.778+0000 7f2757e00640 1 Processor -- start 2024-04-25T09:11:15.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.778+0000 7f2757e00640 1 -- start start 2024-04-25T09:11:15.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.778+0000 7f2757e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f27580d0240 0x7f2758168b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.778+0000 7f2757e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27580cda50 con 0x7f27580cd670 2024-04-25T09:11:15.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.778+0000 7f2757e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275806c710 con 0x7f275806d7b0 2024-04-25T09:11:15.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.778+0000 7f2757e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275806c9f0 con 0x7f27580d0240 2024-04-25T09:11:15.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.778+0000 7f2756a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f27580cd670 0x7f275809a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57748/0 (socket says 172.21.15.59:57748) 2024-04-25T09:11:15.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.778+0000 7f2756a00640 1 -- 172.21.15.59:0/3502754665 learned_addr learned my addr 172.21.15.59:0/3502754665 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.778+0000 7f2757400640 1 --2- 172.21.15.59:0/3502754665 >> v2:172.21.15.178:3300/0 conn(0x7f27580d0240 0x7f2758168b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 773606616 0 0) 0x7f27580cda50 con 0x7f27580cd670 2024-04-25T09:11:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f273c003530 con 0x7f27580cd670 2024-04-25T09:11:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3693655209 0 0) 0x7f275806c710 con 0x7f275806d7b0 2024-04-25T09:11:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27580cda50 con 0x7f275806d7b0 2024-04-25T09:11:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1879213080 0 0) 0x7f273c003530 con 0x7f27580cd670 2024-04-25T09:11:15.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 >> v2:172.21.15.178:3300/0 conn(0x7f27580d0240 msgr2=0x7f2758168b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 --2- 172.21.15.59:0/3502754665 >> v2:172.21.15.178:3300/0 conn(0x7f27580d0240 0x7f2758168b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 >> v1:172.21.15.178:6789/0 conn(0x7f275806d7b0 legacy=0x7f27580cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275806ccd0 con 0x7f27580cd670 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f2748001680 con 0x7f27580cd670 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2757400640 1 --2- 172.21.15.59:0/3502754665 >> v2:172.21.15.178:3300/0 conn(0x7f27580d0240 0x7f2758168b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 >> v1:172.21.15.59:6789/0 conn(0x7f27580cd670 legacy=0x7f275809a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 --2- 172.21.15.59:0/3502754665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c003b50 0x7f273c003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 --2- 172.21.15.59:0/3502754665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c004810 0x7f273c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 --2- 172.21.15.59:0/3502754665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f273c0051d0 0x7f273c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275806c9f0 con 0x7f273c004810 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c00c050 con 0x7f273c0051d0 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c00c250 con 0x7f273c003b50 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f274e000640 1 --2- 172.21.15.59:0/3502754665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c004810 0x7f273c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2756a00640 1 --2- 172.21.15.59:0/3502754665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c003b50 0x7f273c003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2757400640 1 --2- 172.21.15.59:0/3502754665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f273c0051d0 0x7f273c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f274e000640 1 -- 172.21.15.59:0/3502754665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c003b50 msgr2=0x7f273c003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f274e000640 1 --2- 172.21.15.59:0/3502754665 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c003b50 0x7f273c003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f274e000640 1 -- 172.21.15.59:0/3502754665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f273c0051d0 msgr2=0x7f273c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f274e000640 1 --2- 172.21.15.59:0/3502754665 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f273c0051d0 0x7f273c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f274e000640 1 -- 172.21.15.59:0/3502754665 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c003530 con 0x7f273c004810 2024-04-25T09:11:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.782+0000 7f2757400640 1 -- 172.21.15.59:0/3502754665 reap_dead start 2024-04-25T09:11:15.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f274e000640 1 --2- 172.21.15.59:0/3502754665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c004810 0x7f273c004c90 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f27400018d0 tx=0x7f274001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f496d2b661701947 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:15.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740001520 con 0x7f273c004810 2024-04-25T09:11:15.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27400052f0 con 0x7f273c004810 2024-04-25T09:11:15.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2756000640 1 -- 172.21.15.59:0/3502754665 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27400a88f0 con 0x7f273c004810 2024-04-25T09:11:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 -- 172.21.15.59:0/3502754665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c004810 msgr2=0x7f273c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 --2- 172.21.15.59:0/3502754665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c004810 0x7f273c004c90 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f27400018d0 tx=0x7f274001ec90 comp rx=0 tx=0).stop 2024-04-25T09:11:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 -- 172.21.15.59:0/3502754665 shutdown_connections 2024-04-25T09:11:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 --2- 172.21.15.59:0/3502754665 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f273c004810 0x7f273c004c90 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 -- 172.21.15.59:0/3502754665 >> 172.21.15.59:0/3502754665 conn(0x7f27580d1540 msgr2=0x7f27580d1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 -- 172.21.15.59:0/3502754665 shutdown_connections 2024-04-25T09:11:15.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 -- 172.21.15.59:0/3502754665 wait complete. 2024-04-25T09:11:15.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 Processor -- start 2024-04-25T09:11:15.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 -- start start 2024-04-25T09:11:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c004810 0x7f27581563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27580c50a0 0x7f27580c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27580ae350 0x7f27580c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27580d2210 con 0x7f27580ae350 2024-04-25T09:11:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275806d290 con 0x7f27580c50a0 2024-04-25T09:11:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27580d2390 con 0x7f273c004810 2024-04-25T09:11:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27580ae350 0x7f27580c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27580ae350 0x7f27580c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41008/0 (socket says 172.21.15.59:41008) 2024-04-25T09:11:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2757400640 1 -- 172.21.15.59:0/1897088872 learned_addr learned my addr 172.21.15.59:0/1897088872 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f2756a00640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c004810 0x7f27581563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.786+0000 7f274e000640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27580c50a0 0x7f27580c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f2757400640 1 -- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c004810 msgr2=0x7f27581563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f2757400640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c004810 0x7f27581563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f2757400640 1 -- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27580c50a0 msgr2=0x7f27580c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f2757400640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27580c50a0 0x7f27580c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f2757400640 1 -- 172.21.15.59:0/1897088872 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27580b5630 con 0x7f27580ae350 2024-04-25T09:11:15.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f2757400640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27580ae350 0x7f27580c72f0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f2758072a20 tx=0x7f27500115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:15.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f274fe00640 1 -- 172.21.15.59:0/1897088872 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500039a0 con 0x7f27580ae350 2024-04-25T09:11:15.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f274fe00640 1 -- 172.21.15.59:0/1897088872 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275001b070 con 0x7f27580ae350 2024-04-25T09:11:15.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f274fe00640 1 -- 172.21.15.59:0/1897088872 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2750003be0 con 0x7f27580ae350 2024-04-25T09:11:15.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f2757e00640 1 -- 172.21.15.59:0/1897088872 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27580b58d0 con 0x7f27580ae350 2024-04-25T09:11:15.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f2757e00640 1 -- 172.21.15.59:0/1897088872 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27580b5e90 con 0x7f27580ae350 2024-04-25T09:11:15.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f2757e00640 1 -- 172.21.15.59:0/1897088872 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275804efa0 con 0x7f27580ae350 2024-04-25T09:11:15.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f274fe00640 1 -- 172.21.15.59:0/1897088872 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2750004030 con 0x7f27580ae350 2024-04-25T09:11:15.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.790+0000 7f274fe00640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2734066f60 0x7f2734069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:15.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.794+0000 7f274fe00640 1 -- 172.21.15.59:0/1897088872 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5619+0+0 (secure 0 0 0) 0x7f2750085900 con 0x7f27580ae350 2024-04-25T09:11:15.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.794+0000 7f2756a00640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2734066f60 0x7f2734069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:15.782 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.794+0000 7f2756a00640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2734066f60 0x7f2734069420 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2758075b60 tx=0x7f2748007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:15.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.798+0000 7f274fe00640 1 -- 172.21.15.59:0/1897088872 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2750025020 con 0x7f27580ae350 2024-04-25T09:11:15.950 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:15.962+0000 7f2757e00640 1 -- 172.21.15.59:0/1897088872 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f27580b74c0 con 0x7f27580ae350 2024-04-25T09:11:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.606+0000 7f274fe00640 1 -- 172.21.15.59:0/1897088872 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v119) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2750056310 con 0x7f27580ae350 2024-04-25T09:11:16.596 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' created 2024-04-25T09:11:16.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.610+0000 7f2757e00640 1 -- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2734066f60 msgr2=0x7f2734069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.610+0000 7f2757e00640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2734066f60 0x7f2734069420 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2758075b60 tx=0x7f2748007040 comp rx=0 tx=0).stop 2024-04-25T09:11:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.610+0000 7f2757e00640 1 -- 172.21.15.59:0/1897088872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27580ae350 msgr2=0x7f27580c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.610+0000 7f2757e00640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27580ae350 0x7f27580c72f0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f2758072a20 tx=0x7f27500115a0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.610+0000 7f2757e00640 1 -- 172.21.15.59:0/1897088872 shutdown_connections 2024-04-25T09:11:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.610+0000 7f2757e00640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f2734066f60 0x7f2734069420 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.610+0000 7f2757e00640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27580ae350 0x7f27580c72f0 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.610+0000 7f2757e00640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27580c50a0 0x7f27580c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.610+0000 7f2757e00640 1 --2- 172.21.15.59:0/1897088872 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f273c004810 0x7f27581563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.610+0000 7f2757e00640 1 -- 172.21.15.59:0/1897088872 >> 172.21.15.59:0/1897088872 conn(0x7f27580d1540 msgr2=0x7f2758099a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.610+0000 7f2757e00640 1 -- 172.21.15.59:0/1897088872 shutdown_connections 2024-04-25T09:11:16.599 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.610+0000 7f2757e00640 1 -- 172.21.15.59:0/1897088872 wait complete. 2024-04-25T09:11:16.639 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T09:11:16.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.794+0000 7f4b3c000640 1 Processor -- start 2024-04-25T09:11:16.784 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.794+0000 7f4b3c000640 1 -- start start 2024-04-25T09:11:16.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b3c000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4b34159320 0x7f4b3415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b3c000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3415fc00 con 0x7f4b3415f440 2024-04-25T09:11:16.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b3c000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b3415fee0 con 0x7f4b3406e4a0 2024-04-25T09:11:16.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b3c000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b3406d640 con 0x7f4b34159320 2024-04-25T09:11:16.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b38c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4b3415f440 0x7f4b3406dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57758/0 (socket says 172.21.15.59:57758) 2024-04-25T09:11:16.786 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b38c00640 1 -- 172.21.15.59:0/1886071880 learned_addr learned my addr 172.21.15.59:0/1886071880 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b39600640 1 --2- 172.21.15.59:0/1886071880 >> v2:172.21.15.178:3300/0 conn(0x7f4b34159320 0x7f4b3415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895288621 0 0) 0x7f4b3415fc00 con 0x7f4b3415f440 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b1c003530 con 0x7f4b3415f440 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4280579771 0 0) 0x7f4b1c003530 con 0x7f4b3415f440 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 >> v2:172.21.15.178:3300/0 conn(0x7f4b34159320 msgr2=0x7f4b3415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 --2- 172.21.15.59:0/1886071880 >> v2:172.21.15.178:3300/0 conn(0x7f4b34159320 0x7f4b3415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 >> v1:172.21.15.178:6789/0 conn(0x7f4b3406e4a0 legacy=0x7f4b34071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b341601c0 con 0x7f4b3415f440 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f4b20001680 con 0x7f4b3415f440 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 >> v1:172.21.15.59:6789/0 conn(0x7f4b3415f440 legacy=0x7f4b3406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 --2- 172.21.15.59:0/1886071880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b1c0039c0 0x7f4b1c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 --2- 172.21.15.59:0/1886071880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b1c004810 0x7f4b1c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 --2- 172.21.15.59:0/1886071880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b1c0051d0 0x7f4b1c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3406d640 con 0x7f4b1c0051d0 2024-04-25T09:11:16.788 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c00c100 con 0x7f4b1c0039c0 2024-04-25T09:11:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1c00c300 con 0x7f4b1c004810 2024-04-25T09:11:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b3a000640 1 --2- 172.21.15.59:0/1886071880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b1c0051d0 0x7f4b1c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b39600640 1 --2- 172.21.15.59:0/1886071880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b1c0039c0 0x7f4b1c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b38c00640 1 --2- 172.21.15.59:0/1886071880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b1c004810 0x7f4b1c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b3a000640 1 -- 172.21.15.59:0/1886071880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b1c004810 msgr2=0x7f4b1c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b3a000640 1 --2- 172.21.15.59:0/1886071880 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b1c004810 0x7f4b1c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b3a000640 1 -- 172.21.15.59:0/1886071880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b1c0039c0 msgr2=0x7f4b1c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b3a000640 1 --2- 172.21.15.59:0/1886071880 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b1c0039c0 0x7f4b1c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.798+0000 7f4b3a000640 1 -- 172.21.15.59:0/1886071880 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b1c003530 con 0x7f4b1c0051d0 2024-04-25T09:11:16.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b3a000640 1 -- 172.21.15.59:0/1886071880 reap_dead start 2024-04-25T09:11:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b3a000640 1 --2- 172.21.15.59:0/1886071880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b1c0051d0 0x7f4b1c00b9d0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c001f60 tx=0x7f4b2c01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d75cd102bfdccad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c001b60 con 0x7f4b1c0051d0 2024-04-25T09:11:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2c003b80 con 0x7f4b1c0051d0 2024-04-25T09:11:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b33e00640 1 -- 172.21.15.59:0/1886071880 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2c0050d0 con 0x7f4b1c0051d0 2024-04-25T09:11:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b3c000640 1 -- 172.21.15.59:0/1886071880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b1c0051d0 msgr2=0x7f4b1c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b3c000640 1 --2- 172.21.15.59:0/1886071880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b1c0051d0 0x7f4b1c00b9d0 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f4b2c001f60 tx=0x7f4b2c01c850 comp rx=0 tx=0).stop 2024-04-25T09:11:16.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b3c000640 1 -- 172.21.15.59:0/1886071880 shutdown_connections 2024-04-25T09:11:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b3c000640 1 --2- 172.21.15.59:0/1886071880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b1c0051d0 0x7f4b1c00b9d0 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b3c000640 1 -- 172.21.15.59:0/1886071880 >> 172.21.15.59:0/1886071880 conn(0x7f4b34067080 msgr2=0x7f4b3406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b3c000640 1 -- 172.21.15.59:0/1886071880 shutdown_connections 2024-04-25T09:11:16.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b3c000640 1 -- 172.21.15.59:0/1886071880 wait complete. 2024-04-25T09:11:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b3c000640 1 Processor -- start 2024-04-25T09:11:16.793 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.802+0000 7f4b3c000640 1 -- start start 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b3c000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b1c0051d0 0x7f4b3413dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b3c000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b3414ff30 0x7f4b34150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b3c000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b34151650 0x7f4b34151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b3c000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3415f9a0 con 0x7f4b34151650 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b3c000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3415f820 con 0x7f4b1c0051d0 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b3c000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3415c9b0 con 0x7f4b3414ff30 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b3a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b34151650 0x7f4b34151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b3a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b34151650 0x7f4b34151ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41026/0 (socket says 172.21.15.59:41026) 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b38c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b3414ff30 0x7f4b34150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b3a000640 1 -- 172.21.15.59:0/2226425401 learned_addr learned my addr 172.21.15.59:0/2226425401 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b39600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b1c0051d0 0x7f4b3413dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b38c00640 1 -- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b1c0051d0 msgr2=0x7f4b3413dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b38c00640 1 --2- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b1c0051d0 0x7f4b3413dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.795 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b38c00640 1 -- 172.21.15.59:0/2226425401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b34151650 msgr2=0x7f4b34151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b38c00640 1 --2- 172.21.15.59:0/2226425401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b34151650 0x7f4b34151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b38c00640 1 -- 172.21.15.59:0/2226425401 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b34154670 con 0x7f4b3414ff30 2024-04-25T09:11:16.796 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b38c00640 1 --2- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b3414ff30 0x7f4b34150390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4b20004e10 tx=0x7f4b20007430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b31600640 1 -- 172.21.15.59:0/2226425401 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20007770 con 0x7f4b3414ff30 2024-04-25T09:11:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b31600640 1 -- 172.21.15.59:0/2226425401 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b20018070 con 0x7f4b3414ff30 2024-04-25T09:11:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b31600640 1 -- 172.21.15.59:0/2226425401 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2000f990 con 0x7f4b3414ff30 2024-04-25T09:11:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b3c000640 1 -- 172.21.15.59:0/2226425401 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b34154950 con 0x7f4b3414ff30 2024-04-25T09:11:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b3c000640 1 -- 172.21.15.59:0/2226425401 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b34154f10 con 0x7f4b3414ff30 2024-04-25T09:11:16.797 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.806+0000 7f4b3c000640 1 -- 172.21.15.59:0/2226425401 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b340745d0 con 0x7f4b3414ff30 2024-04-25T09:11:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.810+0000 7f4b31600640 1 -- 172.21.15.59:0/2226425401 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4b2000fb30 con 0x7f4b3414ff30 2024-04-25T09:11:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.810+0000 7f4b31600640 1 --2- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b14067130 0x7f4b140695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:16.798 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.810+0000 7f4b31600640 1 -- 172.21.15.59:0/2226425401 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6001+0+0 (secure 0 0 0) 0x7f4b20085210 con 0x7f4b3414ff30 2024-04-25T09:11:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.810+0000 7f4b39600640 1 --2- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b14067130 0x7f4b140695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:16.799 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.810+0000 7f4b39600640 1 --2- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b14067130 0x7f4b140695f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009ac0 tx=0x7f4b28009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:16.802 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:16.814+0000 7f4b31600640 1 -- 172.21.15.59:0/2226425401 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b20055fc0 con 0x7f4b3414ff30 2024-04-25T09:11:16.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.010+0000 7f4b3c000640 1 -- 172.21.15.59:0/2226425401 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4b3415bc30 con 0x7f4b3414ff30 2024-04-25T09:11:17.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.622+0000 7f4b31600640 1 -- 172.21.15.59:0/2226425401 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v100) v1 ==== 174+0+0 (secure 0 0 0) 0x7f4b200558c0 con 0x7f4b3414ff30 2024-04-25T09:11:17.617 INFO:teuthology.orchestra.run.smithi059.stderr:new fs with metadata pool 17 and data pool 18 2024-04-25T09:11:17.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.638+0000 7f4b3c000640 1 -- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b14067130 msgr2=0x7f4b140695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.638+0000 7f4b3c000640 1 --2- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b14067130 0x7f4b140695f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009ac0 tx=0x7f4b28009190 comp rx=0 tx=0).stop 2024-04-25T09:11:17.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.638+0000 7f4b3c000640 1 -- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b3414ff30 msgr2=0x7f4b34150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.630 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.638+0000 7f4b3c000640 1 --2- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b3414ff30 0x7f4b34150390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4b20004e10 tx=0x7f4b20007430 comp rx=0 tx=0).stop 2024-04-25T09:11:17.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.642+0000 7f4b3c000640 1 -- 172.21.15.59:0/2226425401 shutdown_connections 2024-04-25T09:11:17.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.642+0000 7f4b3c000640 1 --2- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b14067130 0x7f4b140695f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.642+0000 7f4b3c000640 1 --2- 172.21.15.59:0/2226425401 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b34151650 0x7f4b34151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.642+0000 7f4b3c000640 1 --2- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b3414ff30 0x7f4b34150390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.642+0000 7f4b3c000640 1 --2- 172.21.15.59:0/2226425401 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b1c0051d0 0x7f4b3413dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.631 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.642+0000 7f4b3c000640 1 -- 172.21.15.59:0/2226425401 >> 172.21.15.59:0/2226425401 conn(0x7f4b34067080 msgr2=0x7f4b340acad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:17.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.646+0000 7f4b3c000640 1 -- 172.21.15.59:0/2226425401 shutdown_connections 2024-04-25T09:11:17.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.646+0000 7f4b3c000640 1 -- 172.21.15.59:0/2226425401 wait complete. 2024-04-25T09:11:17.668 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5aca800640 1 Processor -- start 2024-04-25T09:11:17.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5aca800640 1 -- start start 2024-04-25T09:11:17.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5aca800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ac41450f0 0x7f5ac40b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:17.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5aca800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ac40b3900 0x7f5ac406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:17.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5aca800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac41454d0 con 0x7f5ac406b150 2024-04-25T09:11:17.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5aca800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac406b5b0 con 0x7f5ac41450f0 2024-04-25T09:11:17.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5aca800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40b4a20 con 0x7f5ac40b3900 2024-04-25T09:11:17.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5ac9e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5ac406b150 0x7f5ac40cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57768/0 (socket says 172.21.15.59:57768) 2024-04-25T09:11:17.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5ac9e00640 1 -- 172.21.15.59:0/2477977758 learned_addr learned my addr 172.21.15.59:0/2477977758 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:17.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5ac9400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ac41450f0 0x7f5ac40b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:17.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5ac8a00640 1 --2- 172.21.15.59:0/2477977758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ac40b3900 0x7f5ac406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:17.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5ac9400640 1 -- 172.21.15.59:0/2477977758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ac40b3900 msgr2=0x7f5ac406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:17.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5ac9400640 1 --2- 172.21.15.59:0/2477977758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ac40b3900 0x7f5ac406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5ac9400640 1 -- 172.21.15.59:0/2477977758 >> v1:172.21.15.59:6789/0 conn(0x7f5ac406b150 legacy=0x7f5ac40cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.822+0000 7f5ac9400640 1 -- 172.21.15.59:0/2477977758 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40b3e10 con 0x7f5ac41450f0 2024-04-25T09:11:17.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5ac9400640 1 --2- 172.21.15.59:0/2477977758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac41450f0 0x7f5ac40b33c0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80097c0 tx=0x7f5ab801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c38c43c14d4c220 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:17.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5ac3e00640 1 -- 172.21.15.59:0/2477977758 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80a7070 con 0x7f5ac41450f0 2024-04-25T09:11:17.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5ac3e00640 1 -- 172.21.15.59:0/2477977758 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab80b0070 con 0x7f5ac41450f0 2024-04-25T09:11:17.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5ac3e00640 1 -- 172.21.15.59:0/2477977758 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80ab890 con 0x7f5ac41450f0 2024-04-25T09:11:17.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5aca800640 1 -- 172.21.15.59:0/2477977758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac41450f0 msgr2=0x7f5ac40b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5aca800640 1 --2- 172.21.15.59:0/2477977758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac41450f0 0x7f5ac40b33c0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80097c0 tx=0x7f5ab801c470 comp rx=0 tx=0).stop 2024-04-25T09:11:17.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5aca800640 1 -- 172.21.15.59:0/2477977758 shutdown_connections 2024-04-25T09:11:17.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5aca800640 1 --2- 172.21.15.59:0/2477977758 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ac40b3900 0x7f5ac406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5aca800640 1 --2- 172.21.15.59:0/2477977758 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac41450f0 0x7f5ac40b33c0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5aca800640 1 -- 172.21.15.59:0/2477977758 >> 172.21.15.59:0/2477977758 conn(0x7f5ac4099a60 msgr2=0x7f5ac40b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:17.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5aca800640 1 -- 172.21.15.59:0/2477977758 shutdown_connections 2024-04-25T09:11:17.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5aca800640 1 -- 172.21.15.59:0/2477977758 wait complete. 2024-04-25T09:11:17.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5aca800640 1 Processor -- start 2024-04-25T09:11:17.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.826+0000 7f5aca800640 1 -- start start 2024-04-25T09:11:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5aca800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac406b150 0x7f5ac4158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5aca800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac40b3900 0x7f5ac4144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5aca800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ac41450f0 0x7f5ac413a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5aca800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40cd1b0 con 0x7f5ac406b150 2024-04-25T09:11:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5aca800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40cd030 con 0x7f5ac40b3900 2024-04-25T09:11:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5aca800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac4168370 con 0x7f5ac41450f0 2024-04-25T09:11:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac8a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac40b3900 0x7f5ac4144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac9e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ac41450f0 0x7f5ac413a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac8a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac40b3900 0x7f5ac4144220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:53560/0 (socket says 172.21.15.59:53560) 2024-04-25T09:11:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac8a00640 1 -- 172.21.15.59:0/4197295773 learned_addr learned my addr 172.21.15.59:0/4197295773 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:17.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac9400640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac406b150 0x7f5ac4158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:17.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac9400640 1 -- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ac41450f0 msgr2=0x7f5ac413a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac9400640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ac41450f0 0x7f5ac413a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac9400640 1 -- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac40b3900 msgr2=0x7f5ac4144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac9400640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac40b3900 0x7f5ac4144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac9400640 1 -- 172.21.15.59:0/4197295773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac413ac40 con 0x7f5ac406b150 2024-04-25T09:11:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac8a00640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac40b3900 0x7f5ac4144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac9e00640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ac41450f0 0x7f5ac413a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac9400640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac406b150 0x7f5ac4158070 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80ac000 tx=0x7f5ab801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac1600640 1 -- 172.21.15.59:0/4197295773 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80b5610 con 0x7f5ac406b150 2024-04-25T09:11:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac1600640 1 -- 172.21.15.59:0/4197295773 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab80b57b0 con 0x7f5ac406b150 2024-04-25T09:11:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5aca800640 1 -- 172.21.15.59:0/4197295773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac4158790 con 0x7f5ac406b150 2024-04-25T09:11:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5ac1600640 1 -- 172.21.15.59:0/4197295773 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab80b5ba0 con 0x7f5ac406b150 2024-04-25T09:11:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5aca800640 1 -- 172.21.15.59:0/4197295773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac413bb70 con 0x7f5ac406b150 2024-04-25T09:11:17.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.830+0000 7f5aca800640 1 -- 172.21.15.59:0/4197295773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac404efa0 con 0x7f5ac406b150 2024-04-25T09:11:17.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.834+0000 7f5ac1600640 1 -- 172.21.15.59:0/4197295773 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5ab80bd020 con 0x7f5ac406b150 2024-04-25T09:11:17.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.834+0000 7f5ac1600640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5aa4066f60 0x7f5aa4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:17.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.834+0000 7f5ac1600640 1 -- 172.21.15.59:0/4197295773 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f5ab811f9c0 con 0x7f5ac406b150 2024-04-25T09:11:17.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.834+0000 7f5ac8a00640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5aa4066f60 0x7f5aa4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:17.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.834+0000 7f5ac8a00640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5aa4066f60 0x7f5aa4069420 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40d0010 tx=0x7f5ab0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:17.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:17.838+0000 7f5ac1600640 1 -- 172.21.15.59:0/4197295773 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5ab8016090 con 0x7f5ac406b150 2024-04-25T09:11:17.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.002+0000 7f5aca800640 1 -- 172.21.15.59:0/4197295773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ac40cbdc0 con 0x7f5ac406b150 2024-04-25T09:11:17.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5ac1600640 1 -- 172.21.15.59:0/4197295773 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16965 (secure 0 0 0) 0x7f5ab80f01e0 con 0x7f5ac406b150 2024-04-25T09:11:17.994 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:17.994 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":120,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:17.015186+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:15.429862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:16.011038+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5aca800640 1 -- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5aa4066f60 msgr2=0x7f5aa4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5aca800640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5aa4066f60 0x7f5aa4069420 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f5ac40d0010 tx=0x7f5ab0008040 comp rx=0 tx=0).stop 2024-04-25T09:11:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5aca800640 1 -- 172.21.15.59:0/4197295773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac406b150 msgr2=0x7f5ac4158070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5aca800640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac406b150 0x7f5ac4158070 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f5ab80ac000 tx=0x7f5ab801acb0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5aca800640 1 -- 172.21.15.59:0/4197295773 shutdown_connections 2024-04-25T09:11:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5aca800640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5aa4066f60 0x7f5aa4069420 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5aca800640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5ac41450f0 0x7f5ac413a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5aca800640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5ac40b3900 0x7f5ac4144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5aca800640 1 --2- 172.21.15.59:0/4197295773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac406b150 0x7f5ac4158070 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:17.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5aca800640 1 -- 172.21.15.59:0/4197295773 >> 172.21.15.59:0/4197295773 conn(0x7f5ac4099a60 msgr2=0x7f5ac40d0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:17.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5aca800640 1 -- 172.21.15.59:0/4197295773 shutdown_connections 2024-04-25T09:11:17.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.006+0000 7f5aca800640 1 -- 172.21.15.59:0/4197295773 wait complete. 2024-04-25T09:11:18.015 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:18.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d75c00640 1 Processor -- start 2024-04-25T09:11:18.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d75c00640 1 -- start start 2024-04-25T09:11:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d75c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d7015fe50 0x7f8d700b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d75c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d700b20a0 con 0x7f8d700b1c90 2024-04-25T09:11:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d75c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d700cc4e0 con 0x7f8d70145270 2024-04-25T09:11:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d75c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d70145650 con 0x7f8d7015fe50 2024-04-25T09:11:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d6f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8d700b1c90 0x7f8d7015bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57770/0 (socket says 172.21.15.59:57770) 2024-04-25T09:11:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d67e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d7015fe50 0x7f8d700b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d6f400640 1 -- 172.21.15.59:0/785857718 learned_addr learned my addr 172.21.15.59:0/785857718 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:18.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d6e000640 1 -- 172.21.15.59:0/785857718 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847608403 0 0) 0x7f8d680014a0 con 0x7f8d700b1c90 2024-04-25T09:11:18.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d67e00640 1 -- 172.21.15.59:0/785857718 >> v1:172.21.15.178:6789/0 conn(0x7f8d70145270 legacy=0x7f8d700cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:18.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d67e00640 1 -- 172.21.15.59:0/785857718 >> v1:172.21.15.59:6789/0 conn(0x7f8d700b1c90 legacy=0x7f8d7015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.166+0000 7f8d67e00640 1 -- 172.21.15.59:0/785857718 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d700ce040 con 0x7f8d7015fe50 2024-04-25T09:11:18.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.170+0000 7f8d67e00640 1 --2- 172.21.15.59:0/785857718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7015fe50 0x7f8d700b1750 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f8d580097c0 tx=0x7f8d5801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d742f09f7c0f6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:18.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.170+0000 7f8d6e000640 1 -- 172.21.15.59:0/785857718 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d580b0070 con 0x7f8d7015fe50 2024-04-25T09:11:18.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.170+0000 7f8d6e000640 1 -- 172.21.15.59:0/785857718 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58004230 con 0x7f8d7015fe50 2024-04-25T09:11:18.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.170+0000 7f8d6e000640 1 -- 172.21.15.59:0/785857718 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58003620 con 0x7f8d7015fe50 2024-04-25T09:11:18.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.170+0000 7f8d75c00640 1 -- 172.21.15.59:0/785857718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7015fe50 msgr2=0x7f8d700b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.170+0000 7f8d75c00640 1 --2- 172.21.15.59:0/785857718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7015fe50 0x7f8d700b1750 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f8d580097c0 tx=0x7f8d5801c460 comp rx=0 tx=0).stop 2024-04-25T09:11:18.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.170+0000 7f8d75c00640 1 -- 172.21.15.59:0/785857718 shutdown_connections 2024-04-25T09:11:18.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.170+0000 7f8d75c00640 1 --2- 172.21.15.59:0/785857718 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d7015fe50 0x7f8d700b1750 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.170+0000 7f8d75c00640 1 -- 172.21.15.59:0/785857718 >> 172.21.15.59:0/785857718 conn(0x7f8d70066fa0 msgr2=0x7f8d7006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:18.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.170+0000 7f8d75c00640 1 -- 172.21.15.59:0/785857718 shutdown_connections 2024-04-25T09:11:18.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.170+0000 7f8d75c00640 1 -- 172.21.15.59:0/785857718 wait complete. 2024-04-25T09:11:18.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d75c00640 1 Processor -- start 2024-04-25T09:11:18.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d75c00640 1 -- start start 2024-04-25T09:11:18.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d75c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d700b1c90 0x7f8d7015b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d75c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d70145270 0x7f8d7013c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d75c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d7015fe50 0x7f8d7013cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d75c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700cdbe0 con 0x7f8d70145270 2024-04-25T09:11:18.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d75c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7015f930 con 0x7f8d700b1c90 2024-04-25T09:11:18.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d75c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700cdd60 con 0x7f8d7015fe50 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d67e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d70145270 0x7f8d7013c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d67e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d70145270 0x7f8d7013c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41074/0 (socket says 172.21.15.59:41074) 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d67e00640 1 -- 172.21.15.59:0/1401856597 learned_addr learned my addr 172.21.15.59:0/1401856597 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d67e00640 1 -- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d7015fe50 msgr2=0x7f8d7013cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d67e00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d7015fe50 0x7f8d7013cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d67e00640 1 -- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d700b1c90 msgr2=0x7f8d7015b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d6ea00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d700b1c90 0x7f8d7015b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d67e00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d700b1c90 0x7f8d7015b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d67e00640 1 -- 172.21.15.59:0/1401856597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70142ac0 con 0x7f8d70145270 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d6ea00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d700b1c90 0x7f8d7015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d67e00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d70145270 0x7f8d7013c760 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f8d58019070 tx=0x7f8d58019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d66a00640 1 -- 172.21.15.59:0/1401856597 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d580b0040 con 0x7f8d70145270 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d66a00640 1 -- 172.21.15.59:0/1401856597 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d580bc070 con 0x7f8d70145270 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d75c00640 1 -- 172.21.15.59:0/1401856597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d70140dc0 con 0x7f8d70145270 2024-04-25T09:11:18.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d66a00640 1 -- 172.21.15.59:0/1401856597 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d580b5480 con 0x7f8d70145270 2024-04-25T09:11:18.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.174+0000 7f8d75c00640 1 -- 172.21.15.59:0/1401856597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d70142d60 con 0x7f8d70145270 2024-04-25T09:11:18.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.178+0000 7f8d75c00640 1 -- 172.21.15.59:0/1401856597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d700745d0 con 0x7f8d70145270 2024-04-25T09:11:18.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.178+0000 7f8d66a00640 1 -- 172.21.15.59:0/1401856597 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8d580b3070 con 0x7f8d70145270 2024-04-25T09:11:18.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.178+0000 7f8d66a00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d4c066f60 0x7f8d4c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.178+0000 7f8d66a00640 1 -- 172.21.15.59:0/1401856597 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8d5811f120 con 0x7f8d70145270 2024-04-25T09:11:18.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.178+0000 7f8d6ea00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d4c066f60 0x7f8d4c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.178+0000 7f8d6ea00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d4c066f60 0x7f8d4c069420 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8d60003e40 tx=0x7f8d60009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:18.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.182+0000 7f8d66a00640 1 -- 172.21.15.59:0/1401856597 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8d58016050 con 0x7f8d70145270 2024-04-25T09:11:18.335 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.346+0000 7f8d75c00640 1 -- 172.21.15.59:0/1401856597 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d701412e0 con 0x7f8d70145270 2024-04-25T09:11:18.336 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.346+0000 7f8d66a00640 1 -- 172.21.15.59:0/1401856597 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16965 (secure 0 0 0) 0x7f8d580aa3a0 con 0x7f8d70145270 2024-04-25T09:11:18.336 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:18.336 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":120,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:17.015186+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:15.429862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:16.011038+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:18.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.350+0000 7f8d75c00640 1 -- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d4c066f60 msgr2=0x7f8d4c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.350+0000 7f8d75c00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d4c066f60 0x7f8d4c069420 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8d60003e40 tx=0x7f8d60009040 comp rx=0 tx=0).stop 2024-04-25T09:11:18.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.350+0000 7f8d75c00640 1 -- 172.21.15.59:0/1401856597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d70145270 msgr2=0x7f8d7013c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.350+0000 7f8d75c00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d70145270 0x7f8d7013c760 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f8d58019070 tx=0x7f8d58019200 comp rx=0 tx=0).stop 2024-04-25T09:11:18.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.350+0000 7f8d75c00640 1 -- 172.21.15.59:0/1401856597 shutdown_connections 2024-04-25T09:11:18.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.350+0000 7f8d75c00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8d4c066f60 0x7f8d4c069420 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.350+0000 7f8d75c00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8d7015fe50 0x7f8d7013cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.350+0000 7f8d75c00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d70145270 0x7f8d7013c760 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.350+0000 7f8d75c00640 1 --2- 172.21.15.59:0/1401856597 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8d700b1c90 0x7f8d7015b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.350+0000 7f8d75c00640 1 -- 172.21.15.59:0/1401856597 >> 172.21.15.59:0/1401856597 conn(0x7f8d70066fa0 msgr2=0x7f8d700736e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:18.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.350+0000 7f8d75c00640 1 -- 172.21.15.59:0/1401856597 shutdown_connections 2024-04-25T09:11:18.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.350+0000 7f8d75c00640 1 -- 172.21.15.59:0/1401856597 wait complete. 2024-04-25T09:11:18.358 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T09:11:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd0a0c00640 1 Processor -- start 2024-04-25T09:11:18.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd0a0c00640 1 -- start start 2024-04-25T09:11:18.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd0a0c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd09c15bcf0 0x7fd09c099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd0a0c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09c0d02a0 con 0x7fd09c15b910 2024-04-25T09:11:18.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd0a0c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09c0cc350 con 0x7fd09c0cf3c0 2024-04-25T09:11:18.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd0a0c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd09c0cc630 con 0x7fd09c15bcf0 2024-04-25T09:11:18.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd09c15b910 0x7fd09c0cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:57772/0 (socket says 172.21.15.59:57772) 2024-04-25T09:11:18.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099e00640 1 -- 172.21.15.59:0/2941420008 learned_addr learned my addr 172.21.15.59:0/2941420008 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:18.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd09a800640 1 --2- 172.21.15.59:0/2941420008 >> v2:172.21.15.178:3300/0 conn(0x7fd09c15bcf0 0x7fd09c099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103623429 0 0) 0x7fd09c0d02a0 con 0x7fd09c15b910 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd080003530 con 0x7fd09c15b910 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083450565 0 0) 0x7fd09c0cc350 con 0x7fd09c0cf3c0 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd09c0d02a0 con 0x7fd09c0cf3c0 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1891765875 0 0) 0x7fd080003530 con 0x7fd09c15b910 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 >> v2:172.21.15.178:3300/0 conn(0x7fd09c15bcf0 msgr2=0x7fd09c099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 --2- 172.21.15.59:0/2941420008 >> v2:172.21.15.178:3300/0 conn(0x7fd09c15bcf0 0x7fd09c099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 >> v1:172.21.15.178:6789/0 conn(0x7fd09c0cf3c0 legacy=0x7fd09c0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c0cc910 con 0x7fd09c15b910 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fd08c001a00 con 0x7fd09c15b910 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 >> v1:172.21.15.59:6789/0 conn(0x7fd09c15b910 legacy=0x7fd09c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 --2- 172.21.15.59:0/2941420008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd080003b50 0x7fd080003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 --2- 172.21.15.59:0/2941420008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd080004810 0x7fd080004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 --2- 172.21.15.59:0/2941420008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0800051d0 0x7fd08000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c0cc630 con 0x7fd080003b50 2024-04-25T09:11:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08000c050 con 0x7fd080004810 2024-04-25T09:11:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.514+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd08000c250 con 0x7fd0800051d0 2024-04-25T09:11:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd099e00640 1 --2- 172.21.15.59:0/2941420008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd080003b50 0x7fd080003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd09a800640 1 --2- 172.21.15.59:0/2941420008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0800051d0 0x7fd08000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd091400640 1 --2- 172.21.15.59:0/2941420008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd080004810 0x7fd080004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd099e00640 1 -- 172.21.15.59:0/2941420008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0800051d0 msgr2=0x7fd08000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd099e00640 1 --2- 172.21.15.59:0/2941420008 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd0800051d0 0x7fd08000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd099e00640 1 -- 172.21.15.59:0/2941420008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd080004810 msgr2=0x7fd080004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd099e00640 1 --2- 172.21.15.59:0/2941420008 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd080004810 0x7fd080004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd099e00640 1 -- 172.21.15.59:0/2941420008 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd080003530 con 0x7fd080003b50 2024-04-25T09:11:18.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd09a800640 1 -- 172.21.15.59:0/2941420008 reap_dead start 2024-04-25T09:11:18.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd099e00640 1 --2- 172.21.15.59:0/2941420008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd080003b50 0x7fd080003f50 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fd08c00a820 tx=0x7fd08c01d2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64aba366ee78606 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:18.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c00a450 con 0x7fd080003b50 2024-04-25T09:11:18.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c0070d0 con 0x7fd080003b50 2024-04-25T09:11:18.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.518+0000 7fd099400640 1 -- 172.21.15.59:0/2941420008 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c007540 con 0x7fd080003b50 2024-04-25T09:11:18.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2941420008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd080003b50 msgr2=0x7fd080003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 --2- 172.21.15.59:0/2941420008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd080003b50 0x7fd080003f50 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fd08c00a820 tx=0x7fd08c01d2d0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2941420008 shutdown_connections 2024-04-25T09:11:18.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 --2- 172.21.15.59:0/2941420008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd080003b50 0x7fd080003f50 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2941420008 >> 172.21.15.59:0/2941420008 conn(0x7fd09c0b3200 msgr2=0x7fd09c0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:18.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2941420008 shutdown_connections 2024-04-25T09:11:18.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2941420008 wait complete. 2024-04-25T09:11:18.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 Processor -- start 2024-04-25T09:11:18.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 -- start start 2024-04-25T09:11:18.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd080003b50 0x7fd09c14bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd09c0c78f0 0x7fd09c0cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd09c0c6290 0x7fd09c0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c099df0 con 0x7fd09c0c78f0 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c099c70 con 0x7fd080003b50 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd0a0c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09c099f70 con 0x7fd09c0c6290 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd091400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd09c0c78f0 0x7fd09c0cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd091400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd09c0c78f0 0x7fd09c0cb4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41092/0 (socket says 172.21.15.59:41092) 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd091400640 1 -- 172.21.15.59:0/2791093077 learned_addr learned my addr 172.21.15.59:0/2791093077 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd099e00640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd080003b50 0x7fd09c14bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd09a800640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd09c0c6290 0x7fd09c0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd091400640 1 -- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd09c0c6290 msgr2=0x7fd09c0c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd091400640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd09c0c6290 0x7fd09c0c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd091400640 1 -- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd080003b50 msgr2=0x7fd09c14bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd091400640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd080003b50 0x7fd09c14bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:18.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd091400640 1 -- 172.21.15.59:0/2791093077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c0c6850 con 0x7fd09c0c78f0 2024-04-25T09:11:18.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.522+0000 7fd09a800640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd09c0c6290 0x7fd09c0c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:18.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.526+0000 7fd091400640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd09c0c78f0 0x7fd09c0cb4e0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fd08400e4b0 tx=0x7fd08400e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:18.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.526+0000 7fd092a00640 1 -- 172.21.15.59:0/2791093077 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0840052e0 con 0x7fd09c0c78f0 2024-04-25T09:11:18.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.526+0000 7fd092a00640 1 -- 172.21.15.59:0/2791093077 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd084018070 con 0x7fd09c0c78f0 2024-04-25T09:11:18.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.526+0000 7fd092a00640 1 -- 172.21.15.59:0/2791093077 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084003840 con 0x7fd09c0c78f0 2024-04-25T09:11:18.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.526+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2791093077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09c0c6b30 con 0x7fd09c0c78f0 2024-04-25T09:11:18.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.526+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2791093077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09c0c70f0 con 0x7fd09c0c78f0 2024-04-25T09:11:18.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.526+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2791093077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09c0745d0 con 0x7fd09c0c78f0 2024-04-25T09:11:18.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.526+0000 7fd092a00640 1 -- 172.21.15.59:0/2791093077 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd0840039e0 con 0x7fd09c0c78f0 2024-04-25T09:11:18.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.526+0000 7fd092a00640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd078066f60 0x7fd078069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:18.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.526+0000 7fd092a00640 1 -- 172.21.15.59:0/2791093077 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd084084f90 con 0x7fd09c0c78f0 2024-04-25T09:11:18.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.526+0000 7fd099e00640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd078066f60 0x7fd078069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:18.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.530+0000 7fd099e00640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd078066f60 0x7fd078069420 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0ad000 tx=0x7fd08c001dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:18.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.530+0000 7fd092a00640 1 -- 172.21.15.59:0/2791093077 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd084055ce0 con 0x7fd09c0c78f0 2024-04-25T09:11:18.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:18.734+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2791093077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd09c0cdcd0 con 0x7fd09c0c78f0 2024-04-25T09:11:19.582 INFO:tasks.ceph.mds.a.smithi059.stderr:2024-04-25T09:11:19.594+0000 7fb9f9200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:11:19.634 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd092a00640 1 -- 172.21.15.59:0/2791093077 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v103) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd0840555e0 con 0x7fd09c0c78f0 2024-04-25T09:11:19.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd078066f60 msgr2=0x7fd078069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.637 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd0a0c00640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd078066f60 0x7fd078069420 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fd08c0ad000 tx=0x7fd08c001dc0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2791093077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd09c0c78f0 msgr2=0x7fd09c0cb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd0a0c00640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd09c0c78f0 0x7fd09c0cb4e0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fd08400e4b0 tx=0x7fd08400e970 comp rx=0 tx=0).stop 2024-04-25T09:11:19.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2791093077 shutdown_connections 2024-04-25T09:11:19.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd0a0c00640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd078066f60 0x7fd078069420 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd0a0c00640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd09c0c6290 0x7fd09c0c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd0a0c00640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd09c0c78f0 0x7fd09c0cb4e0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd0a0c00640 1 --2- 172.21.15.59:0/2791093077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd080003b50 0x7fd09c14bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2791093077 >> 172.21.15.59:0/2791093077 conn(0x7fd09c0b3200 msgr2=0x7fd09c06c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:19.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2791093077 shutdown_connections 2024-04-25T09:11:19.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.646+0000 7fd0a0c00640 1 -- 172.21.15.59:0/2791093077 wait complete. 2024-04-25T09:11:19.661 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-25T09:11:19.662 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T09:11:19.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f89000640 1 Processor -- start 2024-04-25T09:11:19.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f89000640 1 -- start start 2024-04-25T09:11:19.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f89000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f8406cb10 0x7f6f840cf780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f89000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6f840cfcc0 0x7f6f840d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f89000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f84099dd0 con 0x7f6f8406c730 2024-04-25T09:11:19.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f89000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8409a9e0 con 0x7f6f8406cb10 2024-04-25T09:11:19.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f89000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8409ae70 con 0x7f6f840cfcc0 2024-04-25T09:11:19.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f7aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f8406cb10 0x7f6f840cf780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f7aa00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6f8406cb10 0x7f6f840cf780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41106/0 (socket says 172.21.15.59:41106) 2024-04-25T09:11:19.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f7aa00640 1 -- 172.21.15.59:0/3527641641 learned_addr learned my addr 172.21.15.59:0/3527641641 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:19.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f83e00640 1 --2- 172.21.15.59:0/3527641641 >> v2:172.21.15.178:3300/0 conn(0x7f6f840cfcc0 0x7f6f840d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f7aa00640 1 -- 172.21.15.59:0/3527641641 >> v2:172.21.15.178:3300/0 conn(0x7f6f840cfcc0 msgr2=0x7f6f840d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:19.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f7aa00640 1 --2- 172.21.15.59:0/3527641641 >> v2:172.21.15.178:3300/0 conn(0x7f6f840cfcc0 0x7f6f840d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f7aa00640 1 -- 172.21.15.59:0/3527641641 >> v1:172.21.15.178:6789/0 conn(0x7f6f8406c730 legacy=0x7f6f8415ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.814 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.822+0000 7f6f7aa00640 1 -- 172.21.15.59:0/3527641641 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8409a0b0 con 0x7f6f8406cb10 2024-04-25T09:11:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.826+0000 7f6f7aa00640 1 --2- 172.21.15.59:0/3527641641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f8406cb10 0x7f6f840cf780 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f6f841614d0 tx=0x7f6f6c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1d292ab67ef4e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.826+0000 7f6f82a00640 1 -- 172.21.15.59:0/3527641641 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0ab600 con 0x7f6f8406cb10 2024-04-25T09:11:19.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.826+0000 7f6f82a00640 1 -- 172.21.15.59:0/3527641641 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c0b0070 con 0x7f6f8406cb10 2024-04-25T09:11:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.826+0000 7f6f82a00640 1 -- 172.21.15.59:0/3527641641 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0ab9c0 con 0x7f6f8406cb10 2024-04-25T09:11:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.826+0000 7f6f89000640 1 -- 172.21.15.59:0/3527641641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f8406cb10 msgr2=0x7f6f840cf780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.826+0000 7f6f89000640 1 --2- 172.21.15.59:0/3527641641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f8406cb10 0x7f6f840cf780 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f6f841614d0 tx=0x7f6f6c01c4f0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.826+0000 7f6f89000640 1 -- 172.21.15.59:0/3527641641 shutdown_connections 2024-04-25T09:11:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.826+0000 7f6f89000640 1 --2- 172.21.15.59:0/3527641641 >> v2:172.21.15.178:3300/0 conn(0x7f6f840cfcc0 0x7f6f840d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.826+0000 7f6f89000640 1 --2- 172.21.15.59:0/3527641641 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f8406cb10 0x7f6f840cf780 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.826+0000 7f6f89000640 1 -- 172.21.15.59:0/3527641641 >> 172.21.15.59:0/3527641641 conn(0x7f6f840b3030 msgr2=0x7f6f840b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.826+0000 7f6f89000640 1 -- 172.21.15.59:0/3527641641 shutdown_connections 2024-04-25T09:11:19.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.826+0000 7f6f89000640 1 -- 172.21.15.59:0/3527641641 wait complete. 2024-04-25T09:11:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f89000640 1 Processor -- start 2024-04-25T09:11:19.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f89000640 1 -- start start 2024-04-25T09:11:19.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f89000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f8406c730 0x7f6f8414db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f89000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f8406cb10 0x7f6f841568e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f89000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f840cfcc0 0x7f6f840b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f89000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840b0720 con 0x7f6f8406cb10 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f89000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f84099a60 con 0x7f6f840cfcc0 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f89000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840b08a0 con 0x7f6f8406c730 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f7aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f8406cb10 0x7f6f841568e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f7aa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f8406cb10 0x7f6f841568e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:41108/0 (socket says 172.21.15.59:41108) 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f7aa00640 1 -- 172.21.15.59:0/1008468567 learned_addr learned my addr 172.21.15.59:0/1008468567 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f83e00640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f840cfcc0 0x7f6f840b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f83400640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f8406c730 0x7f6f8414db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f7aa00640 1 -- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f8406c730 msgr2=0x7f6f8414db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f7aa00640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f8406c730 0x7f6f8414db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f7aa00640 1 -- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f840cfcc0 msgr2=0x7f6f840b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f7aa00640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f840cfcc0 0x7f6f840b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:19.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f7aa00640 1 -- 172.21.15.59:0/1008468567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f841520a0 con 0x7f6f8406cb10 2024-04-25T09:11:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f7aa00640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f8406cb10 0x7f6f841568e0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0ad040 tx=0x7f6f6c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:19.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f7be00640 1 -- 172.21.15.59:0/1008468567 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0be5f0 con 0x7f6f8406cb10 2024-04-25T09:11:19.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f7be00640 1 -- 172.21.15.59:0/1008468567 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c0be790 con 0x7f6f8406cb10 2024-04-25T09:11:19.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f7be00640 1 -- 172.21.15.59:0/1008468567 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c0beb80 con 0x7f6f8406cb10 2024-04-25T09:11:19.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.830+0000 7f6f89000640 1 -- 172.21.15.59:0/1008468567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f84152340 con 0x7f6f8406cb10 2024-04-25T09:11:19.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.834+0000 7f6f89000640 1 -- 172.21.15.59:0/1008468567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f84154370 con 0x7f6f8406cb10 2024-04-25T09:11:19.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.834+0000 7f6f89000640 1 -- 172.21.15.59:0/1008468567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f840745d0 con 0x7f6f8406cb10 2024-04-25T09:11:19.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.834+0000 7f6f7be00640 1 -- 172.21.15.59:0/1008468567 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6f6c0aa070 con 0x7f6f8406cb10 2024-04-25T09:11:19.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.834+0000 7f6f7be00640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6f60066f60 0x7f6f60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:19.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.834+0000 7f6f7be00640 1 -- 172.21.15.59:0/1008468567 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f6f6c11f440 con 0x7f6f8406cb10 2024-04-25T09:11:19.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.834+0000 7f6f83400640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6f60066f60 0x7f6f60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:19.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.834+0000 7f6f83400640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6f60066f60 0x7f6f60069420 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6f74001e00 tx=0x7f6f74009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:19.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:19.838+0000 7f6f7be00640 1 -- 172.21.15.59:0/1008468567 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6f6c016110 con 0x7f6f8406cb10 2024-04-25T09:11:20.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.038+0000 7f6f89000640 1 -- 172.21.15.59:0/1008468567 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6f840c4e20 con 0x7f6f8406cb10 2024-04-25T09:11:20.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.646+0000 7f6f7be00640 1 -- 172.21.15.59:0/1008468567 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v104) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6f6c0efc60 con 0x7f6f8406cb10 2024-04-25T09:11:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.650+0000 7f6f89000640 1 -- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6f60066f60 msgr2=0x7f6f60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.650+0000 7f6f89000640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6f60066f60 0x7f6f60069420 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6f74001e00 tx=0x7f6f74009040 comp rx=0 tx=0).stop 2024-04-25T09:11:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.650+0000 7f6f89000640 1 -- 172.21.15.59:0/1008468567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f8406cb10 msgr2=0x7f6f841568e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.650+0000 7f6f89000640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f8406cb10 0x7f6f841568e0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0ad040 tx=0x7f6f6c01ad30 comp rx=0 tx=0).stop 2024-04-25T09:11:20.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.650+0000 7f6f89000640 1 -- 172.21.15.59:0/1008468567 shutdown_connections 2024-04-25T09:11:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.650+0000 7f6f89000640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6f60066f60 0x7f6f60069420 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.650+0000 7f6f89000640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6f840cfcc0 0x7f6f840b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.650+0000 7f6f89000640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f8406cb10 0x7f6f841568e0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.650+0000 7f6f89000640 1 --2- 172.21.15.59:0/1008468567 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6f8406c730 0x7f6f8414db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.650+0000 7f6f89000640 1 -- 172.21.15.59:0/1008468567 >> 172.21.15.59:0/1008468567 conn(0x7f6f840b3030 msgr2=0x7f6f84070040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.650+0000 7f6f89000640 1 -- 172.21.15.59:0/1008468567 shutdown_connections 2024-04-25T09:11:20.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.650+0000 7f6f89000640 1 -- 172.21.15.59:0/1008468567 wait complete. 2024-04-25T09:11:20.663 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T09:11:20.664 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:20.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0d2000640 1 Processor -- start 2024-04-25T09:11:20.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0d2000640 1 -- start start 2024-04-25T09:11:20.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0d2000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc0cc0d0700 0x7fc0cc0d0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:20.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0d2000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc0cc0d3a30 0x7fc0cc0d3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:20.811 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0d2000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0cc0b6ef0 con 0x7fc0cc15d830 2024-04-25T09:11:20.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0d2000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0cc0d1080 con 0x7fc0cc0d0700 2024-04-25T09:11:20.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0d2000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0cc15dc10 con 0x7fc0cc0d3a30 2024-04-25T09:11:20.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0cbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc0cc0d0700 0x7fc0cc0d0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:20.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0cbe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc0cc0d0700 0x7fc0cc0d0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53304/0 (socket says 172.21.15.59:53304) 2024-04-25T09:11:20.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0cbe00640 1 -- 172.21.15.59:0/2007736479 learned_addr learned my addr 172.21.15.59:0/2007736479 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:20.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0d1600640 1 --2- 172.21.15.59:0/2007736479 >> v2:172.21.15.178:3300/0 conn(0x7fc0cc0d3a30 0x7fc0cc0d3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:20.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0cbe00640 1 -- 172.21.15.59:0/2007736479 >> v2:172.21.15.178:3300/0 conn(0x7fc0cc0d3a30 msgr2=0x7fc0cc0d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:20.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0cbe00640 1 --2- 172.21.15.59:0/2007736479 >> v2:172.21.15.178:3300/0 conn(0x7fc0cc0d3a30 0x7fc0cc0d3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0cbe00640 1 -- 172.21.15.59:0/2007736479 >> v1:172.21.15.178:6789/0 conn(0x7fc0cc15d830 legacy=0x7fc0cc0b67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:20.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.822+0000 7fc0cbe00640 1 -- 172.21.15.59:0/2007736479 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc0d2c90 con 0x7fc0cc0d0700 2024-04-25T09:11:20.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0cbe00640 1 --2- 172.21.15.59:0/2007736479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc0d0700 0x7fc0cc0d0b40 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc161280 tx=0x7fc0b801c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce6fa2bacc8e1f4c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:20.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0cb400640 1 -- 172.21.15.59:0/2007736479 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80b0070 con 0x7fc0cc0d0700 2024-04-25T09:11:20.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0cb400640 1 -- 172.21.15.59:0/2007736479 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b80ab600 con 0x7fc0cc0d0700 2024-04-25T09:11:20.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0cb400640 1 -- 172.21.15.59:0/2007736479 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80ab9d0 con 0x7fc0cc0d0700 2024-04-25T09:11:20.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0d2000640 1 -- 172.21.15.59:0/2007736479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc0d0700 msgr2=0x7fc0cc0d0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:20.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0d2000640 1 --2- 172.21.15.59:0/2007736479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc0d0700 0x7fc0cc0d0b40 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc161280 tx=0x7fc0b801c2d0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0d2000640 1 -- 172.21.15.59:0/2007736479 shutdown_connections 2024-04-25T09:11:20.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0d2000640 1 --2- 172.21.15.59:0/2007736479 >> v2:172.21.15.178:3300/0 conn(0x7fc0cc0d3a30 0x7fc0cc0d3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0d2000640 1 --2- 172.21.15.59:0/2007736479 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc0d0700 0x7fc0cc0d0b40 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0d2000640 1 -- 172.21.15.59:0/2007736479 >> 172.21.15.59:0/2007736479 conn(0x7fc0cc072740 msgr2=0x7fc0cc072b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:20.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0d2000640 1 -- 172.21.15.59:0/2007736479 shutdown_connections 2024-04-25T09:11:20.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0d2000640 1 -- 172.21.15.59:0/2007736479 wait complete. 2024-04-25T09:11:20.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0d2000640 1 Processor -- start 2024-04-25T09:11:20.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.826+0000 7fc0d2000640 1 -- start start 2024-04-25T09:11:20.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc0d0700 0x7fc0cc15e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:20.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d2000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0cc0d3a30 0x7fc0cc156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:20.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d2000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0cc15d830 0x7fc0cc0c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:20.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d2000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc0d43c0 con 0x7fc0cc0d0700 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d2000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc0d3510 con 0x7fc0cc0d3a30 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d2000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc0d4540 con 0x7fc0cc15d830 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc0d0700 0x7fc0cc15e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d0c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc0d0700 0x7fc0cc15e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53318/0 (socket says 172.21.15.59:53318) 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d0c00640 1 -- 172.21.15.59:0/1735766609 learned_addr learned my addr 172.21.15.59:0/1735766609 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0cbe00640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0cc0d3a30 0x7fc0cc156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d1600640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0cc15d830 0x7fc0cc0c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d0c00640 1 -- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0cc15d830 msgr2=0x7fc0cc0c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d0c00640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0cc15d830 0x7fc0cc0c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d0c00640 1 -- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0cc0d3a30 msgr2=0x7fc0cc156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d0c00640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0cc0d3a30 0x7fc0cc156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d0c00640 1 -- 172.21.15.59:0/1735766609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc15f040 con 0x7fc0cc0d0700 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d1600640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0cc15d830 0x7fc0cc0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d0c00640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc0d0700 0x7fc0cc15e800 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000b410 tx=0x7fc0c000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:20.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0c8c00640 1 -- 172.21.15.59:0/1735766609 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0015030 con 0x7fc0cc0d0700 2024-04-25T09:11:20.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0c8c00640 1 -- 172.21.15.59:0/1735766609 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c0004020 con 0x7fc0cc0d0700 2024-04-25T09:11:20.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d2000640 1 -- 172.21.15.59:0/1735766609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0cc15f320 con 0x7fc0cc0d0700 2024-04-25T09:11:20.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0c8c00640 1 -- 172.21.15.59:0/1735766609 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c0004450 con 0x7fc0cc0d0700 2024-04-25T09:11:20.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d2000640 1 -- 172.21.15.59:0/1735766609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc15afb0 con 0x7fc0cc0d0700 2024-04-25T09:11:20.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0d2000640 1 -- 172.21.15.59:0/1735766609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0cc04efa0 con 0x7fc0cc0d0700 2024-04-25T09:11:20.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.830+0000 7fc0c8c00640 1 -- 172.21.15.59:0/1735766609 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc0c0018070 con 0x7fc0cc0d0700 2024-04-25T09:11:20.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.834+0000 7fc0c8c00640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc0ac066f90 0x7fc0ac069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:20.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.834+0000 7fc0c8c00640 1 -- 172.21.15.59:0/1735766609 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fc0c0084c40 con 0x7fc0cc0d0700 2024-04-25T09:11:20.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.834+0000 7fc0cbe00640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc0ac066f90 0x7fc0ac069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:20.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.834+0000 7fc0cbe00640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc0ac066f90 0x7fc0ac069450 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80ad000 tx=0x7fc0b80a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:20.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:20.838+0000 7fc0c8c00640 1 -- 172.21.15.59:0/1735766609 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc0c0055b50 con 0x7fc0cc0d0700 2024-04-25T09:11:21.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.030+0000 7fc0d2000640 1 -- 172.21.15.59:0/1735766609 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0cc0b5d30 con 0x7fc0cc0d0700 2024-04-25T09:11:21.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0c8c00640 1 -- 172.21.15.59:0/1735766609 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4937 (secure 0 0 0) 0x7fc0c0055450 con 0x7fc0cc0d0700 2024-04-25T09:11:21.022 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:21.022 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":104,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":8955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1679876837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1679876837},{"type":"v1","addr":"172.21.15.59:6833","nonce":1679876837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:20.044091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8964":{"gid":8964,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/29546856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":29546856},{"type":"v1","addr":"172.21.15.59:6835","nonce":29546856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:21.023 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 104 2024-04-25T09:11:21.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0d2000640 1 -- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc0ac066f90 msgr2=0x7fc0ac069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0d2000640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc0ac066f90 0x7fc0ac069450 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80ad000 tx=0x7fc0b80a6000 comp rx=0 tx=0).stop 2024-04-25T09:11:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0d2000640 1 -- 172.21.15.59:0/1735766609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc0d0700 msgr2=0x7fc0cc15e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0d2000640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc0d0700 0x7fc0cc15e800 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fc0c000b410 tx=0x7fc0c000b8d0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0d2000640 1 -- 172.21.15.59:0/1735766609 shutdown_connections 2024-04-25T09:11:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0d2000640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc0ac066f90 0x7fc0ac069450 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0d2000640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc0cc15d830 0x7fc0cc0c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0d2000640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc0cc0d3a30 0x7fc0cc156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0d2000640 1 --2- 172.21.15.59:0/1735766609 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0cc0d0700 0x7fc0cc15e800 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0d2000640 1 -- 172.21.15.59:0/1735766609 >> 172.21.15.59:0/1735766609 conn(0x7fc0cc072740 msgr2=0x7fc0cc0b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0d2000640 1 -- 172.21.15.59:0/1735766609 shutdown_connections 2024-04-25T09:11:21.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.034+0000 7fc0d2000640 1 -- 172.21.15.59:0/1735766609 wait complete. 2024-04-25T09:11:21.043 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:21.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81ac400640 1 Processor -- start 2024-04-25T09:11:21.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81ac400640 1 -- start start 2024-04-25T09:11:21.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81ac400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f81a4070cb0 0x7f81a40b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81ac400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81a4070030 0x7f81a4071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81ac400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a40ce610 con 0x7f81a406cae0 2024-04-25T09:11:21.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81ac400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40715d0 con 0x7f81a4070030 2024-04-25T09:11:21.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81ac400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a40b56f0 con 0x7f81a4070cb0 2024-04-25T09:11:21.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81a9000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81a4070030 0x7f81a4071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81a9000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81a4070030 0x7f81a4071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53334/0 (socket says 172.21.15.59:53334) 2024-04-25T09:11:21.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81a9000640 1 -- 172.21.15.59:0/1060954227 learned_addr learned my addr 172.21.15.59:0/1060954227 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:21.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81a9a00640 1 --2- 172.21.15.59:0/1060954227 >> v2:172.21.15.178:3300/0 conn(0x7f81a4070cb0 0x7f81a40b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81a9000640 1 -- 172.21.15.59:0/1060954227 >> v2:172.21.15.178:3300/0 conn(0x7f81a4070cb0 msgr2=0x7f81a40b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:21.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81a9000640 1 --2- 172.21.15.59:0/1060954227 >> v2:172.21.15.178:3300/0 conn(0x7f81a4070cb0 0x7f81a40b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81a9000640 1 -- 172.21.15.59:0/1060954227 >> v1:172.21.15.178:6789/0 conn(0x7f81a406cae0 legacy=0x7f81a406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:21.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81a9000640 1 -- 172.21.15.59:0/1060954227 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a406bd20 con 0x7f81a4070030 2024-04-25T09:11:21.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.194+0000 7f81a9a00640 1 --2- 172.21.15.59:0/1060954227 >> v2:172.21.15.178:3300/0 conn(0x7f81a4070cb0 0x7f81a40b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:21.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.198+0000 7f81a9000640 1 --2- 172.21.15.59:0/1060954227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81a4070030 0x7f81a4071090 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f81a406ee20 tx=0x7f819001c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08a8d22ce482556 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.198+0000 7f81a3e00640 1 -- 172.21.15.59:0/1060954227 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81900b0070 con 0x7f81a4070030 2024-04-25T09:11:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.198+0000 7f81a3e00640 1 -- 172.21.15.59:0/1060954227 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81900ab600 con 0x7f81a4070030 2024-04-25T09:11:21.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.198+0000 7f81a3e00640 1 -- 172.21.15.59:0/1060954227 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81900ab9d0 con 0x7f81a4070030 2024-04-25T09:11:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.198+0000 7f81ac400640 1 -- 172.21.15.59:0/1060954227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81a4070030 msgr2=0x7f81a4071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.198+0000 7f81ac400640 1 --2- 172.21.15.59:0/1060954227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81a4070030 0x7f81a4071090 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f81a406ee20 tx=0x7f819001c300 comp rx=0 tx=0).stop 2024-04-25T09:11:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.198+0000 7f81ac400640 1 -- 172.21.15.59:0/1060954227 shutdown_connections 2024-04-25T09:11:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.198+0000 7f81ac400640 1 --2- 172.21.15.59:0/1060954227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81a4070030 0x7f81a4071090 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.198+0000 7f81ac400640 1 --2- 172.21.15.59:0/1060954227 >> v2:172.21.15.178:3300/0 conn(0x7f81a4070cb0 0x7f81a40b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.198+0000 7f81ac400640 1 -- 172.21.15.59:0/1060954227 >> 172.21.15.59:0/1060954227 conn(0x7f81a406f510 msgr2=0x7f81a406f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.198+0000 7f81ac400640 1 -- 172.21.15.59:0/1060954227 shutdown_connections 2024-04-25T09:11:21.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.198+0000 7f81ac400640 1 -- 172.21.15.59:0/1060954227 wait complete. 2024-04-25T09:11:21.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81ac400640 1 Processor -- start 2024-04-25T09:11:21.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81ac400640 1 -- start start 2024-04-25T09:11:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81ac400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81a406cae0 0x7f81a415e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81ac400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81a4070030 0x7f81a4143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81ac400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81a4070cb0 0x7f81a4154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81ac400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a416a790 con 0x7f81a4070cb0 2024-04-25T09:11:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81ac400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a416a610 con 0x7f81a406cae0 2024-04-25T09:11:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81ac400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a416a910 con 0x7f81a4070030 2024-04-25T09:11:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81aa400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81a4070cb0 0x7f81a4154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81aa400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81a4070cb0 0x7f81a4154f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53346/0 (socket says 172.21.15.59:53346) 2024-04-25T09:11:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81aa400640 1 -- 172.21.15.59:0/509555289 learned_addr learned my addr 172.21.15.59:0/509555289 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81a9a00640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81a406cae0 0x7f81a415e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81a9000640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81a4070030 0x7f81a4143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81aa400640 1 -- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81a4070030 msgr2=0x7f81a4143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81aa400640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81a4070030 0x7f81a4143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81aa400640 1 -- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81a406cae0 msgr2=0x7f81a415e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81aa400640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81a406cae0 0x7f81a415e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81aa400640 1 -- 172.21.15.59:0/509555289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a40d2390 con 0x7f81a4070cb0 2024-04-25T09:11:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81a9a00640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81a406cae0 0x7f81a415e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81aa400640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81a4070cb0 0x7f81a4154f50 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f819c00b970 tx=0x7f819c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81a1600640 1 -- 172.21.15.59:0/509555289 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c019070 con 0x7f81a4070cb0 2024-04-25T09:11:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81a1600640 1 -- 172.21.15.59:0/509555289 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c00cb40 con 0x7f81a4070cb0 2024-04-25T09:11:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81a1600640 1 -- 172.21.15.59:0/509555289 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c014440 con 0x7f81a4070cb0 2024-04-25T09:11:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81ac400640 1 -- 172.21.15.59:0/509555289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a4155db0 con 0x7f81a4070cb0 2024-04-25T09:11:21.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.202+0000 7f81ac400640 1 -- 172.21.15.59:0/509555289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a4156370 con 0x7f81a4070cb0 2024-04-25T09:11:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.206+0000 7f81ac400640 1 -- 172.21.15.59:0/509555289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a40745d0 con 0x7f81a4070cb0 2024-04-25T09:11:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.206+0000 7f81a1600640 1 -- 172.21.15.59:0/509555289 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f819c01c070 con 0x7f81a4070cb0 2024-04-25T09:11:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.206+0000 7f81a1600640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8184066f60 0x7f8184069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.206+0000 7f81a1600640 1 -- 172.21.15.59:0/509555289 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f819c084f50 con 0x7f81a4070cb0 2024-04-25T09:11:21.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.206+0000 7f81a9a00640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8184066f60 0x7f8184069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.206+0000 7f81a9a00640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8184066f60 0x7f8184069420 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f819800a9b0 tx=0x7f8198008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.210+0000 7f81a1600640 1 -- 172.21.15.59:0/509555289 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f819c055ca0 con 0x7f81a4070cb0 2024-04-25T09:11:21.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 -- 172.21.15.59:0/509555289 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81a40b5ad0 con 0x7f81a4070cb0 2024-04-25T09:11:21.367 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81a1600640 1 -- 172.21.15.59:0/509555289 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+16952 (secure 0 0 0) 0x7f819c0555a0 con 0x7f81a4070cb0 2024-04-25T09:11:21.367 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:21.367 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":121,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:18.636323+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:15.429862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:16.011038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 -- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8184066f60 msgr2=0x7f8184069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8184066f60 0x7f8184069420 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f819800a9b0 tx=0x7f8198008040 comp rx=0 tx=0).stop 2024-04-25T09:11:21.369 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 -- 172.21.15.59:0/509555289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81a4070cb0 msgr2=0x7f81a4154f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81a4070cb0 0x7f81a4154f50 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f819c00b970 tx=0x7f819c00be30 comp rx=0 tx=0).stop 2024-04-25T09:11:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 -- 172.21.15.59:0/509555289 shutdown_connections 2024-04-25T09:11:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8184066f60 0x7f8184069420 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81a4070cb0 0x7f81a4154f50 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f81a4070030 0x7f81a4143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 --2- 172.21.15.59:0/509555289 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81a406cae0 0x7f81a415e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 -- 172.21.15.59:0/509555289 >> 172.21.15.59:0/509555289 conn(0x7f81a406f510 msgr2=0x7f81a40b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 -- 172.21.15.59:0/509555289 shutdown_connections 2024-04-25T09:11:21.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.378+0000 7f81ac400640 1 -- 172.21.15.59:0/509555289 wait complete. 2024-04-25T09:11:21.389 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T09:11:21.389 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:11:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.538+0000 7ff008800640 1 Processor -- start 2024-04-25T09:11:21.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.538+0000 7ff008800640 1 -- start start 2024-04-25T09:11:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff008800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff00015fe50 0x7ff0000b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff008800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff0000b1c90 0x7ff00015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff008800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0000b20a0 con 0x7ff000145270 2024-04-25T09:11:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff008800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff000145650 con 0x7ff00015fe50 2024-04-25T09:11:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff008800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0001602b0 con 0x7ff0000b1c90 2024-04-25T09:11:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff005400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff00015fe50 0x7ff0000b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff005400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff00015fe50 0x7ff0000b1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53352/0 (socket says 172.21.15.59:53352) 2024-04-25T09:11:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff005400640 1 -- 172.21.15.59:0/427725827 learned_addr learned my addr 172.21.15.59:0/427725827 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:21.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff006800640 1 --2- 172.21.15.59:0/427725827 >> v2:172.21.15.178:3300/0 conn(0x7ff0000b1c90 0x7ff00015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff005400640 1 -- 172.21.15.59:0/427725827 >> v2:172.21.15.178:3300/0 conn(0x7ff0000b1c90 msgr2=0x7ff00015bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff005400640 1 --2- 172.21.15.59:0/427725827 >> v2:172.21.15.178:3300/0 conn(0x7ff0000b1c90 0x7ff00015bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff005400640 1 -- 172.21.15.59:0/427725827 >> v1:172.21.15.178:6789/0 conn(0x7ff000145270 legacy=0x7ff0000cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff004a00640 1 -- 172.21.15.59:0/427725827 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084409190 0 0) 0x7feff4001120 con 0x7ff000145270 2024-04-25T09:11:21.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.542+0000 7ff005400640 1 -- 172.21.15.59:0/427725827 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0000cc4e0 con 0x7ff00015fe50 2024-04-25T09:11:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff005400640 1 --2- 172.21.15.59:0/427725827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff00015fe50 0x7ff0000b1750 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7ff0000b4b90 tx=0x7feff001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744f6e14c44c509f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff004a00640 1 -- 172.21.15.59:0/427725827 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00aa650 con 0x7ff00015fe50 2024-04-25T09:11:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff004a00640 1 -- 172.21.15.59:0/427725827 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff00af070 con 0x7ff00015fe50 2024-04-25T09:11:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff004a00640 1 -- 172.21.15.59:0/427725827 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff00aaa10 con 0x7ff00015fe50 2024-04-25T09:11:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff008800640 1 -- 172.21.15.59:0/427725827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff00015fe50 msgr2=0x7ff0000b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff008800640 1 --2- 172.21.15.59:0/427725827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff00015fe50 0x7ff0000b1750 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7ff0000b4b90 tx=0x7feff001c4f0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff008800640 1 -- 172.21.15.59:0/427725827 shutdown_connections 2024-04-25T09:11:21.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff008800640 1 --2- 172.21.15.59:0/427725827 >> v2:172.21.15.178:3300/0 conn(0x7ff0000b1c90 0x7ff00015bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff008800640 1 --2- 172.21.15.59:0/427725827 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff00015fe50 0x7ff0000b1750 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff008800640 1 -- 172.21.15.59:0/427725827 >> 172.21.15.59:0/427725827 conn(0x7ff000066fa0 msgr2=0x7ff00006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:21.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff008800640 1 -- 172.21.15.59:0/427725827 shutdown_connections 2024-04-25T09:11:21.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff008800640 1 -- 172.21.15.59:0/427725827 wait complete. 2024-04-25T09:11:21.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff008800640 1 Processor -- start 2024-04-25T09:11:21.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.546+0000 7ff008800640 1 -- start start 2024-04-25T09:11:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff008800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0000b1c90 0x7ff0001f6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff008800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff000145270 0x7ff00013be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff008800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff00015fe50 0x7ff0000b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff008800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00015f930 con 0x7ff0000b1c90 2024-04-25T09:11:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff008800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00015f650 con 0x7ff000145270 2024-04-25T09:11:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff008800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0000cdbe0 con 0x7ff00015fe50 2024-04-25T09:11:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff005e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0000b1c90 0x7ff0001f6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff005e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0000b1c90 0x7ff0001f6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53366/0 (socket says 172.21.15.59:53366) 2024-04-25T09:11:21.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff005e00640 1 -- 172.21.15.59:0/3218225125 learned_addr learned my addr 172.21.15.59:0/3218225125 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:21.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff006800640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff00015fe50 0x7ff0000b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff005400640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff000145270 0x7ff00013be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff005e00640 1 -- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff00015fe50 msgr2=0x7ff0000b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff005e00640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff00015fe50 0x7ff0000b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff005e00640 1 -- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff000145270 msgr2=0x7ff00013be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff005e00640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff000145270 0x7ff00013be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff005e00640 1 -- 172.21.15.59:0/3218225125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0000b1a00 con 0x7ff0000b1c90 2024-04-25T09:11:21.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff005e00640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0000b1c90 0x7ff0001f6cc0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7feff400c750 tx=0x7feff400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7feffa000640 1 -- 172.21.15.59:0/3218225125 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff4017070 con 0x7ff0000b1c90 2024-04-25T09:11:21.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7feffa000640 1 -- 172.21.15.59:0/3218225125 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feff4005290 con 0x7ff0000b1c90 2024-04-25T09:11:21.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff008800640 1 -- 172.21.15.59:0/3218225125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00015b700 con 0x7ff0000b1c90 2024-04-25T09:11:21.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7feffa000640 1 -- 172.21.15.59:0/3218225125 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feff400a640 con 0x7ff0000b1c90 2024-04-25T09:11:21.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff008800640 1 -- 172.21.15.59:0/3218225125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0000b2e80 con 0x7ff0000b1c90 2024-04-25T09:11:21.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7ff008800640 1 -- 172.21.15.59:0/3218225125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0000745d0 con 0x7ff0000b1c90 2024-04-25T09:11:21.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.550+0000 7feffa000640 1 -- 172.21.15.59:0/3218225125 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7feff401a070 con 0x7ff0000b1c90 2024-04-25T09:11:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.554+0000 7feffa000640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fefe4066f90 0x7fefe4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.554+0000 7feffa000640 1 -- 172.21.15.59:0/3218225125 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7feff4084510 con 0x7ff0000b1c90 2024-04-25T09:11:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.554+0000 7ff005400640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fefe4066f90 0x7fefe4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.554+0000 7ff005400640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fefe4066f90 0x7fefe4069450 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7feff00ae000 tx=0x7feff00a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.558+0000 7feffa000640 1 -- 172.21.15.59:0/3218225125 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff0000b1a00 con 0x7ff0000b1c90 2024-04-25T09:11:21.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.718+0000 7ff008800640 1 -- 172.21.15.59:0/3218225125 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff00015ddc0 con 0x7fefe4066f90 2024-04-25T09:11:21.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.722+0000 7feffa000640 1 -- 172.21.15.59:0/3218225125 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252483 (secure 0 0 0) 0x7ff00015ddc0 con 0x7fefe4066f90 2024-04-25T09:11:21.716 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:21.718 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:11:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.726+0000 7ff008800640 1 -- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fefe4066f90 msgr2=0x7fefe4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.726+0000 7ff008800640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fefe4066f90 0x7fefe4069450 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7feff00ae000 tx=0x7feff00a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.726+0000 7ff008800640 1 -- 172.21.15.59:0/3218225125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0000b1c90 msgr2=0x7ff0001f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.726+0000 7ff008800640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0000b1c90 0x7ff0001f6cc0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7feff400c750 tx=0x7feff400cc10 comp rx=0 tx=0).stop 2024-04-25T09:11:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.726+0000 7ff008800640 1 -- 172.21.15.59:0/3218225125 shutdown_connections 2024-04-25T09:11:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.726+0000 7ff008800640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fefe4066f90 0x7fefe4069450 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.726+0000 7ff008800640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff00015fe50 0x7ff0000b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.726+0000 7ff008800640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff000145270 0x7ff00013be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.726+0000 7ff008800640 1 --2- 172.21.15.59:0/3218225125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0000b1c90 0x7ff0001f6cc0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.726+0000 7ff008800640 1 -- 172.21.15.59:0/3218225125 >> 172.21.15.59:0/3218225125 conn(0x7ff000066fa0 msgr2=0x7ff00015d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.726+0000 7ff008800640 1 -- 172.21.15.59:0/3218225125 shutdown_connections 2024-04-25T09:11:21.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.726+0000 7ff008800640 1 -- 172.21.15.59:0/3218225125 wait complete. 2024-04-25T09:11:21.735 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":417,"stamp":"2024-04-25T09:11:19.800065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262436,"kb_used_data":12988,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712284,"statfs":{"total":773094113280,"available":772825378816,"internally_reserved":0,"allocated":13299712,"data_stored":6824528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.189607"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648226+0000","last_change":"2024-04-25T09:11:17.636508+0000","last_active":"2024-04-25T09:11:18.648226+0000","last_peered":"2024-04-25T09:11:18.648226+0000","last_clean":"2024-04-25T09:11:18.648226+0000","last_became_active":"2024-04-25T09:11:17.636233+0000","last_became_peered":"2024-04-25T09:11:17.636233+0000","last_unstale":"2024-04-25T09:11:18.648226+0000","last_undegraded":"2024-04-25T09:11:18.648226+0000","last_fullsized":"2024-04-25T09:11:18.648226+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:50.164469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851605+0000","last_change":"2024-04-25T09:11:17.656358+0000","last_active":"2024-04-25T09:11:18.851605+0000","last_peered":"2024-04-25T09:11:18.851605+0000","last_clean":"2024-04-25T09:11:18.851605+0000","last_became_active":"2024-04-25T09:11:17.655680+0000","last_became_peered":"2024-04-25T09:11:17.655680+0000","last_unstale":"2024-04-25T09:11:18.851605+0000","last_undegraded":"2024-04-25T09:11:18.851605+0000","last_fullsized":"2024-04-25T09:11:18.851605+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:33.517475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851826+0000","last_change":"2024-04-25T09:11:17.648656+0000","last_active":"2024-04-25T09:11:18.851826+0000","last_peered":"2024-04-25T09:11:18.851826+0000","last_clean":"2024-04-25T09:11:18.851826+0000","last_became_active":"2024-04-25T09:11:17.648346+0000","last_became_peered":"2024-04-25T09:11:17.648346+0000","last_unstale":"2024-04-25T09:11:18.851826+0000","last_undegraded":"2024-04-25T09:11:18.851826+0000","last_fullsized":"2024-04-25T09:11:18.851826+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:24.533086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354982+0000","last_change":"2024-04-25T09:11:17.657802+0000","last_active":"2024-04-25T09:11:19.354982+0000","last_peered":"2024-04-25T09:11:19.354982+0000","last_clean":"2024-04-25T09:11:19.354982+0000","last_became_active":"2024-04-25T09:11:17.657459+0000","last_became_peered":"2024-04-25T09:11:17.657459+0000","last_unstale":"2024-04-25T09:11:19.354982+0000","last_undegraded":"2024-04-25T09:11:19.354982+0000","last_fullsized":"2024-04-25T09:11:19.354982+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:38.417064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647898+0000","last_change":"2024-04-25T09:11:17.638420+0000","last_active":"2024-04-25T09:11:18.647898+0000","last_peered":"2024-04-25T09:11:18.647898+0000","last_clean":"2024-04-25T09:11:18.647898+0000","last_became_active":"2024-04-25T09:11:17.638135+0000","last_became_peered":"2024-04-25T09:11:17.638135+0000","last_unstale":"2024-04-25T09:11:18.647898+0000","last_undegraded":"2024-04-25T09:11:18.647898+0000","last_fullsized":"2024-04-25T09:11:18.647898+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:20.326417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644412+0000","last_change":"2024-04-25T09:11:17.652990+0000","last_active":"2024-04-25T09:11:18.644412+0000","last_peered":"2024-04-25T09:11:18.644412+0000","last_clean":"2024-04-25T09:11:18.644412+0000","last_became_active":"2024-04-25T09:11:17.652725+0000","last_became_peered":"2024-04-25T09:11:17.652725+0000","last_unstale":"2024-04-25T09:11:18.644412+0000","last_undegraded":"2024-04-25T09:11:18.644412+0000","last_fullsized":"2024-04-25T09:11:18.644412+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:20.599074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644249+0000","last_change":"2024-04-25T09:11:17.649464+0000","last_active":"2024-04-25T09:11:18.644249+0000","last_peered":"2024-04-25T09:11:18.644249+0000","last_clean":"2024-04-25T09:11:18.644249+0000","last_became_active":"2024-04-25T09:11:17.649086+0000","last_became_peered":"2024-04-25T09:11:17.649086+0000","last_unstale":"2024-04-25T09:11:18.644249+0000","last_undegraded":"2024-04-25T09:11:18.644249+0000","last_fullsized":"2024-04-25T09:11:18.644249+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:20.105824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851281+0000","last_change":"2024-04-25T09:11:17.648550+0000","last_active":"2024-04-25T09:11:18.851281+0000","last_peered":"2024-04-25T09:11:18.851281+0000","last_clean":"2024-04-25T09:11:18.851281+0000","last_became_active":"2024-04-25T09:11:17.647456+0000","last_became_peered":"2024-04-25T09:11:17.647456+0000","last_unstale":"2024-04-25T09:11:18.851281+0000","last_undegraded":"2024-04-25T09:11:18.851281+0000","last_fullsized":"2024-04-25T09:11:18.851281+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:50.699355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355258+0000","last_change":"2024-04-25T09:11:17.660831+0000","last_active":"2024-04-25T09:11:19.355258+0000","last_peered":"2024-04-25T09:11:19.355258+0000","last_clean":"2024-04-25T09:11:19.355258+0000","last_became_active":"2024-04-25T09:11:17.660549+0000","last_became_peered":"2024-04-25T09:11:17.660549+0000","last_unstale":"2024-04-25T09:11:19.355258+0000","last_undegraded":"2024-04-25T09:11:19.355258+0000","last_fullsized":"2024-04-25T09:11:19.355258+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:24.533086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352886+0000","last_change":"2024-04-25T09:11:17.646850+0000","last_active":"2024-04-25T09:11:19.352886+0000","last_peered":"2024-04-25T09:11:19.352886+0000","last_clean":"2024-04-25T09:11:19.352886+0000","last_became_active":"2024-04-25T09:11:17.645643+0000","last_became_peered":"2024-04-25T09:11:17.645643+0000","last_unstale":"2024-04-25T09:11:19.352886+0000","last_undegraded":"2024-04-25T09:11:19.352886+0000","last_fullsized":"2024-04-25T09:11:19.352886+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:35.347571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647981+0000","last_change":"2024-04-25T09:11:17.643946+0000","last_active":"2024-04-25T09:11:18.647981+0000","last_peered":"2024-04-25T09:11:18.647981+0000","last_clean":"2024-04-25T09:11:18.647981+0000","last_became_active":"2024-04-25T09:11:17.643130+0000","last_became_peered":"2024-04-25T09:11:17.643130+0000","last_unstale":"2024-04-25T09:11:18.647981+0000","last_undegraded":"2024-04-25T09:11:18.647981+0000","last_fullsized":"2024-04-25T09:11:18.647981+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:12.943255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644990+0000","last_change":"2024-04-25T09:11:17.643828+0000","last_active":"2024-04-25T09:11:18.644990+0000","last_peered":"2024-04-25T09:11:18.644990+0000","last_clean":"2024-04-25T09:11:18.644990+0000","last_became_active":"2024-04-25T09:11:17.643495+0000","last_became_peered":"2024-04-25T09:11:17.643495+0000","last_unstale":"2024-04-25T09:11:18.644990+0000","last_undegraded":"2024-04-25T09:11:18.644990+0000","last_fullsized":"2024-04-25T09:11:18.644990+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:20.724118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352597+0000","last_change":"2024-04-25T09:11:17.642385+0000","last_active":"2024-04-25T09:11:19.352597+0000","last_peered":"2024-04-25T09:11:19.352597+0000","last_clean":"2024-04-25T09:11:19.352597+0000","last_became_active":"2024-04-25T09:11:17.641092+0000","last_became_peered":"2024-04-25T09:11:17.641092+0000","last_unstale":"2024-04-25T09:11:19.352597+0000","last_undegraded":"2024-04-25T09:11:19.352597+0000","last_fullsized":"2024-04-25T09:11:19.352597+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:10.034927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851442+0000","last_change":"2024-04-25T09:11:17.654007+0000","last_active":"2024-04-25T09:11:18.851442+0000","last_peered":"2024-04-25T09:11:18.851442+0000","last_clean":"2024-04-25T09:11:18.851442+0000","last_became_active":"2024-04-25T09:11:17.650839+0000","last_became_peered":"2024-04-25T09:11:17.650839+0000","last_unstale":"2024-04-25T09:11:18.851442+0000","last_undegraded":"2024-04-25T09:11:18.851442+0000","last_fullsized":"2024-04-25T09:11:18.851442+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:53.460943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648257+0000","last_change":"2024-04-25T09:11:17.643390+0000","last_active":"2024-04-25T09:11:18.648257+0000","last_peered":"2024-04-25T09:11:18.648257+0000","last_clean":"2024-04-25T09:11:18.648257+0000","last_became_active":"2024-04-25T09:11:17.643067+0000","last_became_peered":"2024-04-25T09:11:17.643067+0000","last_unstale":"2024-04-25T09:11:18.648257+0000","last_undegraded":"2024-04-25T09:11:18.648257+0000","last_fullsized":"2024-04-25T09:11:18.648257+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:59.956526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644109+0000","last_change":"2024-04-25T09:11:17.647617+0000","last_active":"2024-04-25T09:11:18.644109+0000","last_peered":"2024-04-25T09:11:18.644109+0000","last_clean":"2024-04-25T09:11:18.644109+0000","last_became_active":"2024-04-25T09:11:17.647326+0000","last_became_peered":"2024-04-25T09:11:17.647326+0000","last_unstale":"2024-04-25T09:11:18.644109+0000","last_undegraded":"2024-04-25T09:11:18.644109+0000","last_fullsized":"2024-04-25T09:11:18.644109+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:55.359511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.353118+0000","last_change":"2024-04-25T09:11:17.645039+0000","last_active":"2024-04-25T09:11:19.353118+0000","last_peered":"2024-04-25T09:11:19.353118+0000","last_clean":"2024-04-25T09:11:19.353118+0000","last_became_active":"2024-04-25T09:11:17.644771+0000","last_became_peered":"2024-04-25T09:11:17.644771+0000","last_unstale":"2024-04-25T09:11:19.353118+0000","last_undegraded":"2024-04-25T09:11:19.353118+0000","last_fullsized":"2024-04-25T09:11:19.353118+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:13.152795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851721+0000","last_change":"2024-04-25T09:11:17.656568+0000","last_active":"2024-04-25T09:11:18.851721+0000","last_peered":"2024-04-25T09:11:18.851721+0000","last_clean":"2024-04-25T09:11:18.851721+0000","last_became_active":"2024-04-25T09:11:17.656046+0000","last_became_peered":"2024-04-25T09:11:17.656046+0000","last_unstale":"2024-04-25T09:11:18.851721+0000","last_undegraded":"2024-04-25T09:11:18.851721+0000","last_fullsized":"2024-04-25T09:11:18.851721+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:38.768555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848617+0000","last_change":"2024-04-25T09:11:17.656570+0000","last_active":"2024-04-25T09:11:18.848617+0000","last_peered":"2024-04-25T09:11:18.848617+0000","last_clean":"2024-04-25T09:11:18.848617+0000","last_became_active":"2024-04-25T09:11:17.656257+0000","last_became_peered":"2024-04-25T09:11:17.656257+0000","last_unstale":"2024-04-25T09:11:18.848617+0000","last_undegraded":"2024-04-25T09:11:18.848617+0000","last_fullsized":"2024-04-25T09:11:18.848617+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:56.158046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352239+0000","last_change":"2024-04-25T09:11:17.652778+0000","last_active":"2024-04-25T09:11:19.352239+0000","last_peered":"2024-04-25T09:11:19.352239+0000","last_clean":"2024-04-25T09:11:19.352239+0000","last_became_active":"2024-04-25T09:11:17.652530+0000","last_became_peered":"2024-04-25T09:11:17.652530+0000","last_unstale":"2024-04-25T09:11:19.352239+0000","last_undegraded":"2024-04-25T09:11:19.352239+0000","last_fullsized":"2024-04-25T09:11:19.352239+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:36.977223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354969+0000","last_change":"2024-04-25T09:11:17.657614+0000","last_active":"2024-04-25T09:11:19.354969+0000","last_peered":"2024-04-25T09:11:19.354969+0000","last_clean":"2024-04-25T09:11:19.354969+0000","last_became_active":"2024-04-25T09:11:17.657310+0000","last_became_peered":"2024-04-25T09:11:17.657310+0000","last_unstale":"2024-04-25T09:11:19.354969+0000","last_undegraded":"2024-04-25T09:11:19.354969+0000","last_fullsized":"2024-04-25T09:11:19.354969+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:38.768555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647746+0000","last_change":"2024-04-25T09:11:17.662944+0000","last_active":"2024-04-25T09:11:18.647746+0000","last_peered":"2024-04-25T09:11:18.647746+0000","last_clean":"2024-04-25T09:11:18.647746+0000","last_became_active":"2024-04-25T09:11:17.662635+0000","last_became_peered":"2024-04-25T09:11:17.662635+0000","last_unstale":"2024-04-25T09:11:18.647746+0000","last_undegraded":"2024-04-25T09:11:18.647746+0000","last_fullsized":"2024-04-25T09:11:18.647746+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:51:11.910736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354815+0000","last_change":"2024-04-25T09:11:17.661406+0000","last_active":"2024-04-25T09:11:19.354815+0000","last_peered":"2024-04-25T09:11:19.354815+0000","last_clean":"2024-04-25T09:11:19.354815+0000","last_became_active":"2024-04-25T09:11:17.661008+0000","last_became_peered":"2024-04-25T09:11:17.661008+0000","last_unstale":"2024-04-25T09:11:19.354815+0000","last_undegraded":"2024-04-25T09:11:19.354815+0000","last_fullsized":"2024-04-25T09:11:19.354815+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:33.833900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647239+0000","last_change":"2024-04-25T09:11:17.639213+0000","last_active":"2024-04-25T09:11:18.647239+0000","last_peered":"2024-04-25T09:11:18.647239+0000","last_clean":"2024-04-25T09:11:18.647239+0000","last_became_active":"2024-04-25T09:11:17.638654+0000","last_became_peered":"2024-04-25T09:11:17.638654+0000","last_unstale":"2024-04-25T09:11:18.647239+0000","last_undegraded":"2024-04-25T09:11:18.647239+0000","last_fullsized":"2024-04-25T09:11:18.647239+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:06.186393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648665+0000","last_change":"2024-04-25T09:11:17.640300+0000","last_active":"2024-04-25T09:11:18.648665+0000","last_peered":"2024-04-25T09:11:18.648665+0000","last_clean":"2024-04-25T09:11:18.648665+0000","last_became_active":"2024-04-25T09:11:17.640014+0000","last_became_peered":"2024-04-25T09:11:17.640014+0000","last_unstale":"2024-04-25T09:11:18.648665+0000","last_undegraded":"2024-04-25T09:11:18.648665+0000","last_fullsized":"2024-04-25T09:11:18.648665+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:13.152795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352408+0000","last_change":"2024-04-25T09:11:17.656185+0000","last_active":"2024-04-25T09:11:19.352408+0000","last_peered":"2024-04-25T09:11:19.352408+0000","last_clean":"2024-04-25T09:11:19.352408+0000","last_became_active":"2024-04-25T09:11:17.655921+0000","last_became_peered":"2024-04-25T09:11:17.655921+0000","last_unstale":"2024-04-25T09:11:19.352408+0000","last_undegraded":"2024-04-25T09:11:19.352408+0000","last_fullsized":"2024-04-25T09:11:19.352408+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:53.595170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848667+0000","last_change":"2024-04-25T09:11:17.657752+0000","last_active":"2024-04-25T09:11:18.848667+0000","last_peered":"2024-04-25T09:11:18.848667+0000","last_clean":"2024-04-25T09:11:18.848667+0000","last_became_active":"2024-04-25T09:11:17.656014+0000","last_became_peered":"2024-04-25T09:11:17.656014+0000","last_unstale":"2024-04-25T09:11:18.848667+0000","last_undegraded":"2024-04-25T09:11:18.848667+0000","last_fullsized":"2024-04-25T09:11:18.848667+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:35.347571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.645039+0000","last_change":"2024-04-25T09:11:17.643729+0000","last_active":"2024-04-25T09:11:18.645039+0000","last_peered":"2024-04-25T09:11:18.645039+0000","last_clean":"2024-04-25T09:11:18.645039+0000","last_became_active":"2024-04-25T09:11:17.643355+0000","last_became_peered":"2024-04-25T09:11:17.643355+0000","last_unstale":"2024-04-25T09:11:18.645039+0000","last_undegraded":"2024-04-25T09:11:18.645039+0000","last_fullsized":"2024-04-25T09:11:18.645039+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:38.385774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352299+0000","last_change":"2024-04-25T09:11:17.664662+0000","last_active":"2024-04-25T09:11:19.352299+0000","last_peered":"2024-04-25T09:11:19.352299+0000","last_clean":"2024-04-25T09:11:19.352299+0000","last_became_active":"2024-04-25T09:11:17.664265+0000","last_became_peered":"2024-04-25T09:11:17.664265+0000","last_unstale":"2024-04-25T09:11:19.352299+0000","last_undegraded":"2024-04-25T09:11:19.352299+0000","last_fullsized":"2024-04-25T09:11:19.352299+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:17.639851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851509+0000","last_change":"2024-04-25T09:11:17.650996+0000","last_active":"2024-04-25T09:11:18.851509+0000","last_peered":"2024-04-25T09:11:18.851509+0000","last_clean":"2024-04-25T09:11:18.851509+0000","last_became_active":"2024-04-25T09:11:17.650020+0000","last_became_peered":"2024-04-25T09:11:17.650020+0000","last_unstale":"2024-04-25T09:11:18.851509+0000","last_undegraded":"2024-04-25T09:11:18.851509+0000","last_fullsized":"2024-04-25T09:11:18.851509+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:24.468870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647814+0000","last_change":"2024-04-25T09:11:17.652349+0000","last_active":"2024-04-25T09:11:18.647814+0000","last_peered":"2024-04-25T09:11:18.647814+0000","last_clean":"2024-04-25T09:11:18.647814+0000","last_became_active":"2024-04-25T09:11:17.652076+0000","last_became_peered":"2024-04-25T09:11:17.652076+0000","last_unstale":"2024-04-25T09:11:18.647814+0000","last_undegraded":"2024-04-25T09:11:18.647814+0000","last_fullsized":"2024-04-25T09:11:18.647814+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:57.428053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648100+0000","last_change":"2024-04-25T09:11:17.638926+0000","last_active":"2024-04-25T09:11:18.648100+0000","last_peered":"2024-04-25T09:11:18.648100+0000","last_clean":"2024-04-25T09:11:18.648100+0000","last_became_active":"2024-04-25T09:11:17.638305+0000","last_became_peered":"2024-04-25T09:11:17.638305+0000","last_unstale":"2024-04-25T09:11:18.648100+0000","last_undegraded":"2024-04-25T09:11:18.648100+0000","last_fullsized":"2024-04-25T09:11:18.648100+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352856+0000","last_change":"2024-04-25T09:11:17.652374+0000","last_active":"2024-04-25T09:11:19.352856+0000","last_peered":"2024-04-25T09:11:19.352856+0000","last_clean":"2024-04-25T09:11:19.352856+0000","last_became_active":"2024-04-25T09:11:17.652108+0000","last_became_peered":"2024-04-25T09:11:17.652108+0000","last_unstale":"2024-04-25T09:11:19.352856+0000","last_undegraded":"2024-04-25T09:11:19.352856+0000","last_fullsized":"2024-04-25T09:11:19.352856+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:56.158046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"120'4","reported_seq":18,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848633+0000","last_change":"2024-04-25T09:11:16.631514+0000","last_active":"2024-04-25T09:11:18.848633+0000","last_peered":"2024-04-25T09:11:18.848633+0000","last_clean":"2024-04-25T09:11:18.848633+0000","last_became_active":"2024-04-25T09:11:16.631206+0000","last_became_peered":"2024-04-25T09:11:16.631206+0000","last_unstale":"2024-04-25T09:11:18.848633+0000","last_undegraded":"2024-04-25T09:11:18.848633+0000","last_fullsized":"2024-04-25T09:11:18.848633+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:51:10.908574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.645001+0000","last_change":"2024-04-25T09:11:17.655155+0000","last_active":"2024-04-25T09:11:18.645001+0000","last_peered":"2024-04-25T09:11:18.645001+0000","last_clean":"2024-04-25T09:11:18.645001+0000","last_became_active":"2024-04-25T09:11:17.654860+0000","last_became_peered":"2024-04-25T09:11:17.654860+0000","last_unstale":"2024-04-25T09:11:18.645001+0000","last_undegraded":"2024-04-25T09:11:18.645001+0000","last_fullsized":"2024-04-25T09:11:18.645001+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:27.742032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"120'1","reported_seq":15,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352969+0000","last_change":"2024-04-25T09:11:16.638747+0000","last_active":"2024-04-25T09:11:19.352969+0000","last_peered":"2024-04-25T09:11:19.352969+0000","last_clean":"2024-04-25T09:11:19.352969+0000","last_became_active":"2024-04-25T09:11:16.638054+0000","last_became_peered":"2024-04-25T09:11:16.638054+0000","last_unstale":"2024-04-25T09:11:19.352969+0000","last_undegraded":"2024-04-25T09:11:19.352969+0000","last_fullsized":"2024-04-25T09:11:19.352969+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:01.369701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648508+0000","last_change":"2024-04-25T09:11:17.646893+0000","last_active":"2024-04-25T09:11:18.648508+0000","last_peered":"2024-04-25T09:11:18.648508+0000","last_clean":"2024-04-25T09:11:18.648508+0000","last_became_active":"2024-04-25T09:11:17.646600+0000","last_became_peered":"2024-04-25T09:11:17.646600+0000","last_unstale":"2024-04-25T09:11:18.648508+0000","last_undegraded":"2024-04-25T09:11:18.648508+0000","last_fullsized":"2024-04-25T09:11:18.648508+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:35.347571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"120'2","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355273+0000","last_change":"2024-04-25T09:11:16.633680+0000","last_active":"2024-04-25T09:11:19.355273+0000","last_peered":"2024-04-25T09:11:19.355273+0000","last_clean":"2024-04-25T09:11:19.355273+0000","last_became_active":"2024-04-25T09:11:16.632258+0000","last_became_peered":"2024-04-25T09:11:16.632258+0000","last_unstale":"2024-04-25T09:11:19.355273+0000","last_undegraded":"2024-04-25T09:11:19.355273+0000","last_fullsized":"2024-04-25T09:11:19.355273+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.738690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355342+0000","last_change":"2024-04-25T09:11:17.657709+0000","last_active":"2024-04-25T09:11:19.355342+0000","last_peered":"2024-04-25T09:11:19.355342+0000","last_clean":"2024-04-25T09:11:19.355342+0000","last_became_active":"2024-04-25T09:11:17.657221+0000","last_became_peered":"2024-04-25T09:11:17.657221+0000","last_unstale":"2024-04-25T09:11:19.355342+0000","last_undegraded":"2024-04-25T09:11:19.355342+0000","last_fullsized":"2024-04-25T09:11:19.355342+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:42.754704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"120'2","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352930+0000","last_change":"2024-04-25T09:11:16.634170+0000","last_active":"2024-04-25T09:11:19.352930+0000","last_peered":"2024-04-25T09:11:19.352930+0000","last_clean":"2024-04-25T09:11:19.352930+0000","last_became_active":"2024-04-25T09:11:16.633894+0000","last_became_peered":"2024-04-25T09:11:16.633894+0000","last_unstale":"2024-04-25T09:11:19.352930+0000","last_undegraded":"2024-04-25T09:11:19.352930+0000","last_fullsized":"2024-04-25T09:11:19.352930+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:20.504739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352367+0000","last_change":"2024-04-25T09:11:17.638505+0000","last_active":"2024-04-25T09:11:19.352367+0000","last_peered":"2024-04-25T09:11:19.352367+0000","last_clean":"2024-04-25T09:11:19.352367+0000","last_became_active":"2024-04-25T09:11:17.638179+0000","last_became_peered":"2024-04-25T09:11:17.638179+0000","last_unstale":"2024-04-25T09:11:19.352367+0000","last_undegraded":"2024-04-25T09:11:19.352367+0000","last_fullsized":"2024-04-25T09:11:19.352367+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:06.186393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"120'1","reported_seq":15,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648065+0000","last_change":"2024-04-25T09:11:16.640598+0000","last_active":"2024-04-25T09:11:18.648065+0000","last_peered":"2024-04-25T09:11:18.648065+0000","last_clean":"2024-04-25T09:11:18.648065+0000","last_became_active":"2024-04-25T09:11:16.640187+0000","last_became_peered":"2024-04-25T09:11:16.640187+0000","last_unstale":"2024-04-25T09:11:18.648065+0000","last_undegraded":"2024-04-25T09:11:18.648065+0000","last_fullsized":"2024-04-25T09:11:18.648065+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:22.941106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647889+0000","last_change":"2024-04-25T09:11:17.650866+0000","last_active":"2024-04-25T09:11:18.647889+0000","last_peered":"2024-04-25T09:11:18.647889+0000","last_clean":"2024-04-25T09:11:18.647889+0000","last_became_active":"2024-04-25T09:11:17.650420+0000","last_became_peered":"2024-04-25T09:11:17.650420+0000","last_unstale":"2024-04-25T09:11:18.647889+0000","last_undegraded":"2024-04-25T09:11:18.647889+0000","last_fullsized":"2024-04-25T09:11:18.647889+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:13.332923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"120'1","reported_seq":15,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644578+0000","last_change":"2024-04-25T09:11:16.636975+0000","last_active":"2024-04-25T09:11:18.644578+0000","last_peered":"2024-04-25T09:11:18.644578+0000","last_clean":"2024-04-25T09:11:18.644578+0000","last_became_active":"2024-04-25T09:11:16.636697+0000","last_became_peered":"2024-04-25T09:11:16.636697+0000","last_unstale":"2024-04-25T09:11:18.644578+0000","last_undegraded":"2024-04-25T09:11:18.644578+0000","last_fullsized":"2024-04-25T09:11:18.644578+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:40.191420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851656+0000","last_change":"2024-04-25T09:11:17.650793+0000","last_active":"2024-04-25T09:11:18.851656+0000","last_peered":"2024-04-25T09:11:18.851656+0000","last_clean":"2024-04-25T09:11:18.851656+0000","last_became_active":"2024-04-25T09:11:17.645491+0000","last_became_peered":"2024-04-25T09:11:17.645491+0000","last_unstale":"2024-04-25T09:11:18.851656+0000","last_undegraded":"2024-04-25T09:11:18.851656+0000","last_fullsized":"2024-04-25T09:11:18.851656+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:33.833900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647916+0000","last_change":"2024-04-25T09:11:16.627306+0000","last_active":"2024-04-25T09:11:18.647916+0000","last_peered":"2024-04-25T09:11:18.647916+0000","last_clean":"2024-04-25T09:11:18.647916+0000","last_became_active":"2024-04-25T09:11:16.627010+0000","last_became_peered":"2024-04-25T09:11:16.627010+0000","last_unstale":"2024-04-25T09:11:18.647916+0000","last_undegraded":"2024-04-25T09:11:18.647916+0000","last_fullsized":"2024-04-25T09:11:18.647916+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:20.504739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352759+0000","last_change":"2024-04-25T09:11:17.642615+0000","last_active":"2024-04-25T09:11:19.352759+0000","last_peered":"2024-04-25T09:11:19.352759+0000","last_clean":"2024-04-25T09:11:19.352759+0000","last_became_active":"2024-04-25T09:11:17.642111+0000","last_became_peered":"2024-04-25T09:11:17.642111+0000","last_unstale":"2024-04-25T09:11:19.352759+0000","last_undegraded":"2024-04-25T09:11:19.352759+0000","last_fullsized":"2024-04-25T09:11:19.352759+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:57.428053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644244+0000","last_change":"2024-04-25T09:11:16.639401+0000","last_active":"2024-04-25T09:11:18.644244+0000","last_peered":"2024-04-25T09:11:18.644244+0000","last_clean":"2024-04-25T09:11:18.644244+0000","last_became_active":"2024-04-25T09:11:16.639131+0000","last_became_peered":"2024-04-25T09:11:16.639131+0000","last_unstale":"2024-04-25T09:11:18.644244+0000","last_undegraded":"2024-04-25T09:11:18.644244+0000","last_fullsized":"2024-04-25T09:11:18.644244+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:22.531871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848449+0000","last_change":"2024-04-25T09:11:17.651266+0000","last_active":"2024-04-25T09:11:18.848449+0000","last_peered":"2024-04-25T09:11:18.848449+0000","last_clean":"2024-04-25T09:11:18.848449+0000","last_became_active":"2024-04-25T09:11:17.650960+0000","last_became_peered":"2024-04-25T09:11:17.650960+0000","last_unstale":"2024-04-25T09:11:18.848449+0000","last_undegraded":"2024-04-25T09:11:18.848449+0000","last_fullsized":"2024-04-25T09:11:18.848449+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848655+0000","last_change":"2024-04-25T09:11:16.639668+0000","last_active":"2024-04-25T09:11:18.848655+0000","last_peered":"2024-04-25T09:11:18.848655+0000","last_clean":"2024-04-25T09:11:18.848655+0000","last_became_active":"2024-04-25T09:11:16.639273+0000","last_became_peered":"2024-04-25T09:11:16.639273+0000","last_unstale":"2024-04-25T09:11:18.848655+0000","last_undegraded":"2024-04-25T09:11:18.848655+0000","last_fullsized":"2024-04-25T09:11:18.848655+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:12.330761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648326+0000","last_change":"2024-04-25T09:11:17.646697+0000","last_active":"2024-04-25T09:11:18.648326+0000","last_peered":"2024-04-25T09:11:18.648326+0000","last_clean":"2024-04-25T09:11:18.648326+0000","last_became_active":"2024-04-25T09:11:17.646370+0000","last_became_peered":"2024-04-25T09:11:17.646370+0000","last_unstale":"2024-04-25T09:11:18.648326+0000","last_undegraded":"2024-04-25T09:11:18.648326+0000","last_fullsized":"2024-04-25T09:11:18.648326+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:56.158046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648487+0000","last_change":"2024-04-25T09:11:16.627930+0000","last_active":"2024-04-25T09:11:18.648487+0000","last_peered":"2024-04-25T09:11:18.648487+0000","last_clean":"2024-04-25T09:11:18.648487+0000","last_became_active":"2024-04-25T09:11:16.627638+0000","last_became_peered":"2024-04-25T09:11:16.627638+0000","last_unstale":"2024-04-25T09:11:18.648487+0000","last_undegraded":"2024-04-25T09:11:18.648487+0000","last_fullsized":"2024-04-25T09:11:18.648487+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:14.573952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851774+0000","last_change":"2024-04-25T09:11:17.642521+0000","last_active":"2024-04-25T09:11:18.851774+0000","last_peered":"2024-04-25T09:11:18.851774+0000","last_clean":"2024-04-25T09:11:18.851774+0000","last_became_active":"2024-04-25T09:11:17.641950+0000","last_became_peered":"2024-04-25T09:11:17.641950+0000","last_unstale":"2024-04-25T09:11:18.851774+0000","last_undegraded":"2024-04-25T09:11:18.851774+0000","last_fullsized":"2024-04-25T09:11:18.851774+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:32.802661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"120'3","reported_seq":17,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648479+0000","last_change":"2024-04-25T09:11:16.633508+0000","last_active":"2024-04-25T09:11:18.648479+0000","last_peered":"2024-04-25T09:11:18.648479+0000","last_clean":"2024-04-25T09:11:18.648479+0000","last_became_active":"2024-04-25T09:11:16.632328+0000","last_became_peered":"2024-04-25T09:11:16.632328+0000","last_unstale":"2024-04-25T09:11:18.648479+0000","last_undegraded":"2024-04-25T09:11:18.648479+0000","last_fullsized":"2024-04-25T09:11:18.648479+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:01.369701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648650+0000","last_change":"2024-04-25T09:11:17.656321+0000","last_active":"2024-04-25T09:11:18.648650+0000","last_peered":"2024-04-25T09:11:18.648650+0000","last_clean":"2024-04-25T09:11:18.648650+0000","last_became_active":"2024-04-25T09:11:17.656005+0000","last_became_peered":"2024-04-25T09:11:17.656005+0000","last_unstale":"2024-04-25T09:11:18.648650+0000","last_undegraded":"2024-04-25T09:11:18.648650+0000","last_fullsized":"2024-04-25T09:11:18.648650+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:18.373239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"120'6","reported_seq":20,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851527+0000","last_change":"2024-04-25T09:11:16.637855+0000","last_active":"2024-04-25T09:11:18.851527+0000","last_peered":"2024-04-25T09:11:18.851527+0000","last_clean":"2024-04-25T09:11:18.851527+0000","last_became_active":"2024-04-25T09:11:16.637590+0000","last_became_peered":"2024-04-25T09:11:16.637590+0000","last_unstale":"2024-04-25T09:11:18.851527+0000","last_undegraded":"2024-04-25T09:11:18.851527+0000","last_fullsized":"2024-04-25T09:11:18.851527+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:58.954364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848708+0000","last_change":"2024-04-25T09:11:17.653143+0000","last_active":"2024-04-25T09:11:18.848708+0000","last_peered":"2024-04-25T09:11:18.848708+0000","last_clean":"2024-04-25T09:11:18.848708+0000","last_became_active":"2024-04-25T09:11:17.652817+0000","last_became_peered":"2024-04-25T09:11:17.652817+0000","last_unstale":"2024-04-25T09:11:18.848708+0000","last_undegraded":"2024-04-25T09:11:18.848708+0000","last_fullsized":"2024-04-25T09:11:18.848708+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:18.373239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"120'2","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851760+0000","last_change":"2024-04-25T09:11:16.636034+0000","last_active":"2024-04-25T09:11:18.851760+0000","last_peered":"2024-04-25T09:11:18.851760+0000","last_clean":"2024-04-25T09:11:18.851760+0000","last_became_active":"2024-04-25T09:11:16.635736+0000","last_became_peered":"2024-04-25T09:11:16.635736+0000","last_unstale":"2024-04-25T09:11:18.851760+0000","last_undegraded":"2024-04-25T09:11:18.851760+0000","last_fullsized":"2024-04-25T09:11:18.851760+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:51:10.908574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352570+0000","last_change":"2024-04-25T09:11:17.650311+0000","last_active":"2024-04-25T09:11:19.352570+0000","last_peered":"2024-04-25T09:11:19.352570+0000","last_clean":"2024-04-25T09:11:19.352570+0000","last_became_active":"2024-04-25T09:11:17.650053+0000","last_became_peered":"2024-04-25T09:11:17.650053+0000","last_unstale":"2024-04-25T09:11:19.352570+0000","last_undegraded":"2024-04-25T09:11:19.352570+0000","last_fullsized":"2024-04-25T09:11:19.352570+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.402283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851741+0000","last_change":"2024-04-25T09:11:16.637604+0000","last_active":"2024-04-25T09:11:18.851741+0000","last_peered":"2024-04-25T09:11:18.851741+0000","last_clean":"2024-04-25T09:11:18.851741+0000","last_became_active":"2024-04-25T09:11:16.636527+0000","last_became_peered":"2024-04-25T09:11:16.636527+0000","last_unstale":"2024-04-25T09:11:18.851741+0000","last_undegraded":"2024-04-25T09:11:18.851741+0000","last_fullsized":"2024-04-25T09:11:18.851741+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:12.330761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352160+0000","last_change":"2024-04-25T09:11:17.651777+0000","last_active":"2024-04-25T09:11:19.352160+0000","last_peered":"2024-04-25T09:11:19.352160+0000","last_clean":"2024-04-25T09:11:19.352160+0000","last_became_active":"2024-04-25T09:11:17.651460+0000","last_became_peered":"2024-04-25T09:11:17.651460+0000","last_unstale":"2024-04-25T09:11:19.352160+0000","last_undegraded":"2024-04-25T09:11:19.352160+0000","last_fullsized":"2024-04-25T09:11:19.352160+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:17.365974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851776+0000","last_change":"2024-04-25T09:11:16.641282+0000","last_active":"2024-04-25T09:11:18.851776+0000","last_peered":"2024-04-25T09:11:18.851776+0000","last_clean":"2024-04-25T09:11:18.851776+0000","last_became_active":"2024-04-25T09:11:16.640755+0000","last_became_peered":"2024-04-25T09:11:16.640755+0000","last_unstale":"2024-04-25T09:11:18.851776+0000","last_undegraded":"2024-04-25T09:11:18.851776+0000","last_fullsized":"2024-04-25T09:11:18.851776+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:19.324255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647688+0000","last_change":"2024-04-25T09:11:17.649737+0000","last_active":"2024-04-25T09:11:18.647688+0000","last_peered":"2024-04-25T09:11:18.647688+0000","last_clean":"2024-04-25T09:11:18.647688+0000","last_became_active":"2024-04-25T09:11:17.648187+0000","last_became_peered":"2024-04-25T09:11:17.648187+0000","last_unstale":"2024-04-25T09:11:18.647688+0000","last_undegraded":"2024-04-25T09:11:18.647688+0000","last_fullsized":"2024-04-25T09:11:18.647688+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:10.034927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"120'1","reported_seq":15,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.353049+0000","last_change":"2024-04-25T09:11:16.636950+0000","last_active":"2024-04-25T09:11:19.353049+0000","last_peered":"2024-04-25T09:11:19.353049+0000","last_clean":"2024-04-25T09:11:19.353049+0000","last_became_active":"2024-04-25T09:11:16.636601+0000","last_became_peered":"2024-04-25T09:11:16.636601+0000","last_unstale":"2024-04-25T09:11:19.353049+0000","last_undegraded":"2024-04-25T09:11:19.353049+0000","last_fullsized":"2024-04-25T09:11:19.353049+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:14.573952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648142+0000","last_change":"2024-04-25T09:11:17.643548+0000","last_active":"2024-04-25T09:11:18.648142+0000","last_peered":"2024-04-25T09:11:18.648142+0000","last_clean":"2024-04-25T09:11:18.648142+0000","last_became_active":"2024-04-25T09:11:17.642807+0000","last_became_peered":"2024-04-25T09:11:17.642807+0000","last_unstale":"2024-04-25T09:11:18.648142+0000","last_undegraded":"2024-04-25T09:11:18.648142+0000","last_fullsized":"2024-04-25T09:11:18.648142+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:50.320741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"120'2","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352642+0000","last_change":"2024-04-25T09:11:16.632283+0000","last_active":"2024-04-25T09:11:19.352642+0000","last_peered":"2024-04-25T09:11:19.352642+0000","last_clean":"2024-04-25T09:11:19.352642+0000","last_became_active":"2024-04-25T09:11:16.631994+0000","last_became_peered":"2024-04-25T09:11:16.631994+0000","last_unstale":"2024-04-25T09:11:19.352642+0000","last_undegraded":"2024-04-25T09:11:19.352642+0000","last_fullsized":"2024-04-25T09:11:19.352642+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:47.069996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.645208+0000","last_change":"2024-04-25T09:11:17.643974+0000","last_active":"2024-04-25T09:11:18.645208+0000","last_peered":"2024-04-25T09:11:18.645208+0000","last_clean":"2024-04-25T09:11:18.645208+0000","last_became_active":"2024-04-25T09:11:17.643118+0000","last_became_peered":"2024-04-25T09:11:17.643118+0000","last_unstale":"2024-04-25T09:11:18.645208+0000","last_undegraded":"2024-04-25T09:11:18.645208+0000","last_fullsized":"2024-04-25T09:11:18.645208+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:19.349973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"120'1","reported_seq":15,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355265+0000","last_change":"2024-04-25T09:11:16.637764+0000","last_active":"2024-04-25T09:11:19.355265+0000","last_peered":"2024-04-25T09:11:19.355265+0000","last_clean":"2024-04-25T09:11:19.355265+0000","last_became_active":"2024-04-25T09:11:16.637383+0000","last_became_peered":"2024-04-25T09:11:16.637383+0000","last_unstale":"2024-04-25T09:11:19.355265+0000","last_undegraded":"2024-04-25T09:11:19.355265+0000","last_fullsized":"2024-04-25T09:11:19.355265+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:55.155884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648739+0000","last_change":"2024-04-25T09:11:17.656460+0000","last_active":"2024-04-25T09:11:18.648739+0000","last_peered":"2024-04-25T09:11:18.648739+0000","last_clean":"2024-04-25T09:11:18.648739+0000","last_became_active":"2024-04-25T09:11:17.656135+0000","last_became_peered":"2024-04-25T09:11:17.656135+0000","last_unstale":"2024-04-25T09:11:18.648739+0000","last_undegraded":"2024-04-25T09:11:18.648739+0000","last_fullsized":"2024-04-25T09:11:18.648739+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:04.975998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355080+0000","last_change":"2024-04-25T09:11:16.640669+0000","last_active":"2024-04-25T09:11:19.355080+0000","last_peered":"2024-04-25T09:11:19.355080+0000","last_clean":"2024-04-25T09:11:19.355080+0000","last_became_active":"2024-04-25T09:11:16.640358+0000","last_became_peered":"2024-04-25T09:11:16.640358+0000","last_unstale":"2024-04-25T09:11:19.355080+0000","last_undegraded":"2024-04-25T09:11:19.355080+0000","last_fullsized":"2024-04-25T09:11:19.355080+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:34.345409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644141+0000","last_change":"2024-04-25T09:11:17.642604+0000","last_active":"2024-04-25T09:11:18.644141+0000","last_peered":"2024-04-25T09:11:18.644141+0000","last_clean":"2024-04-25T09:11:18.644141+0000","last_became_active":"2024-04-25T09:11:17.642303+0000","last_became_peered":"2024-04-25T09:11:17.642303+0000","last_unstale":"2024-04-25T09:11:18.644141+0000","last_undegraded":"2024-04-25T09:11:18.644141+0000","last_fullsized":"2024-04-25T09:11:18.644141+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:59.148298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"120'2","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644647+0000","last_change":"2024-04-25T09:11:16.634429+0000","last_active":"2024-04-25T09:11:18.644647+0000","last_peered":"2024-04-25T09:11:18.644647+0000","last_clean":"2024-04-25T09:11:18.644647+0000","last_became_active":"2024-04-25T09:11:16.634154+0000","last_became_peered":"2024-04-25T09:11:16.634154+0000","last_unstale":"2024-04-25T09:11:18.644647+0000","last_undegraded":"2024-04-25T09:11:18.644647+0000","last_fullsized":"2024-04-25T09:11:18.644647+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:47.631272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851327+0000","last_change":"2024-04-25T09:11:17.644529+0000","last_active":"2024-04-25T09:11:18.851327+0000","last_peered":"2024-04-25T09:11:18.851327+0000","last_clean":"2024-04-25T09:11:18.851327+0000","last_became_active":"2024-04-25T09:11:17.644236+0000","last_became_peered":"2024-04-25T09:11:17.644236+0000","last_unstale":"2024-04-25T09:11:18.851327+0000","last_undegraded":"2024-04-25T09:11:18.851327+0000","last_fullsized":"2024-04-25T09:11:18.851327+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:17.132914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354653+0000","last_change":"2024-04-25T09:11:16.636701+0000","last_active":"2024-04-25T09:11:19.354653+0000","last_peered":"2024-04-25T09:11:19.354653+0000","last_clean":"2024-04-25T09:11:19.354653+0000","last_became_active":"2024-04-25T09:11:16.636429+0000","last_became_peered":"2024-04-25T09:11:16.636429+0000","last_unstale":"2024-04-25T09:11:19.354653+0000","last_undegraded":"2024-04-25T09:11:19.354653+0000","last_fullsized":"2024-04-25T09:11:19.354653+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:56.425891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851737+0000","last_change":"2024-04-25T09:11:17.653781+0000","last_active":"2024-04-25T09:11:18.851737+0000","last_peered":"2024-04-25T09:11:18.851737+0000","last_clean":"2024-04-25T09:11:18.851737+0000","last_became_active":"2024-04-25T09:11:17.650391+0000","last_became_peered":"2024-04-25T09:11:17.650391+0000","last_unstale":"2024-04-25T09:11:18.851737+0000","last_undegraded":"2024-04-25T09:11:18.851737+0000","last_fullsized":"2024-04-25T09:11:18.851737+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:38.417064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851829+0000","last_change":"2024-04-25T09:11:16.637262+0000","last_active":"2024-04-25T09:11:18.851829+0000","last_peered":"2024-04-25T09:11:18.851829+0000","last_clean":"2024-04-25T09:11:18.851829+0000","last_became_active":"2024-04-25T09:11:16.636992+0000","last_became_peered":"2024-04-25T09:11:16.636992+0000","last_unstale":"2024-04-25T09:11:18.851829+0000","last_undegraded":"2024-04-25T09:11:18.851829+0000","last_fullsized":"2024-04-25T09:11:18.851829+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:11.941093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647677+0000","last_change":"2024-04-25T09:11:17.654559+0000","last_active":"2024-04-25T09:11:18.647677+0000","last_peered":"2024-04-25T09:11:18.647677+0000","last_clean":"2024-04-25T09:11:18.647677+0000","last_became_active":"2024-04-25T09:11:17.653876+0000","last_became_peered":"2024-04-25T09:11:17.653876+0000","last_unstale":"2024-04-25T09:11:18.647677+0000","last_undegraded":"2024-04-25T09:11:18.647677+0000","last_fullsized":"2024-04-25T09:11:18.647677+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.402283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354561+0000","last_change":"2024-04-25T09:11:16.629048+0000","last_active":"2024-04-25T09:11:19.354561+0000","last_peered":"2024-04-25T09:11:19.354561+0000","last_clean":"2024-04-25T09:11:19.354561+0000","last_became_active":"2024-04-25T09:11:16.628754+0000","last_became_peered":"2024-04-25T09:11:16.628754+0000","last_unstale":"2024-04-25T09:11:19.354561+0000","last_undegraded":"2024-04-25T09:11:19.354561+0000","last_fullsized":"2024-04-25T09:11:19.354561+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:26.400121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.645166+0000","last_change":"2024-04-25T09:11:17.643134+0000","last_active":"2024-04-25T09:11:18.645166+0000","last_peered":"2024-04-25T09:11:18.645166+0000","last_clean":"2024-04-25T09:11:18.645166+0000","last_became_active":"2024-04-25T09:11:17.641950+0000","last_became_peered":"2024-04-25T09:11:17.641950+0000","last_unstale":"2024-04-25T09:11:18.645166+0000","last_undegraded":"2024-04-25T09:11:18.645166+0000","last_fullsized":"2024-04-25T09:11:18.645166+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:55.055841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"120'2","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.645416+0000","last_change":"2024-04-25T09:11:16.635761+0000","last_active":"2024-04-25T09:11:18.645416+0000","last_peered":"2024-04-25T09:11:18.645416+0000","last_clean":"2024-04-25T09:11:18.645416+0000","last_became_active":"2024-04-25T09:11:16.635503+0000","last_became_peered":"2024-04-25T09:11:16.635503+0000","last_unstale":"2024-04-25T09:11:18.645416+0000","last_undegraded":"2024-04-25T09:11:18.645416+0000","last_fullsized":"2024-04-25T09:11:18.645416+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.900517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352899+0000","last_change":"2024-04-25T09:11:17.638595+0000","last_active":"2024-04-25T09:11:19.352899+0000","last_peered":"2024-04-25T09:11:19.352899+0000","last_clean":"2024-04-25T09:11:19.352899+0000","last_became_active":"2024-04-25T09:11:17.638272+0000","last_became_peered":"2024-04-25T09:11:17.638272+0000","last_unstale":"2024-04-25T09:11:19.352899+0000","last_undegraded":"2024-04-25T09:11:19.352899+0000","last_fullsized":"2024-04-25T09:11:19.352899+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:18.373239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"121'1","reported_seq":15,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.636455+0000","last_change":"2024-04-25T09:11:16.640359+0000","last_active":"2024-04-25T09:11:19.636455+0000","last_peered":"2024-04-25T09:11:19.636455+0000","last_clean":"2024-04-25T09:11:19.636455+0000","last_became_active":"2024-04-25T09:11:16.639572+0000","last_became_peered":"2024-04-25T09:11:16.639572+0000","last_unstale":"2024-04-25T09:11:19.636455+0000","last_undegraded":"2024-04-25T09:11:19.636455+0000","last_fullsized":"2024-04-25T09:11:19.636455+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:11.941093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355326+0000","last_change":"2024-04-25T09:11:17.658054+0000","last_active":"2024-04-25T09:11:19.355326+0000","last_peered":"2024-04-25T09:11:19.355326+0000","last_clean":"2024-04-25T09:11:19.355326+0000","last_became_active":"2024-04-25T09:11:17.657359+0000","last_became_peered":"2024-04-25T09:11:17.657359+0000","last_unstale":"2024-04-25T09:11:19.355326+0000","last_undegraded":"2024-04-25T09:11:19.355326+0000","last_fullsized":"2024-04-25T09:11:19.355326+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:47.589856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848723+0000","last_change":"2024-04-25T09:11:16.633814+0000","last_active":"2024-04-25T09:11:18.848723+0000","last_peered":"2024-04-25T09:11:18.848723+0000","last_clean":"2024-04-25T09:11:18.848723+0000","last_became_active":"2024-04-25T09:11:16.633537+0000","last_became_peered":"2024-04-25T09:11:16.633537+0000","last_unstale":"2024-04-25T09:11:18.848723+0000","last_undegraded":"2024-04-25T09:11:18.848723+0000","last_fullsized":"2024-04-25T09:11:18.848723+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:19.324255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352715+0000","last_change":"2024-04-25T09:11:17.657731+0000","last_active":"2024-04-25T09:11:19.352715+0000","last_peered":"2024-04-25T09:11:19.352715+0000","last_clean":"2024-04-25T09:11:19.352715+0000","last_became_active":"2024-04-25T09:11:17.657504+0000","last_became_peered":"2024-04-25T09:11:17.657504+0000","last_unstale":"2024-04-25T09:11:19.352715+0000","last_undegraded":"2024-04-25T09:11:19.352715+0000","last_fullsized":"2024-04-25T09:11:19.352715+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:46.445384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.645157+0000","last_change":"2024-04-25T09:11:16.634105+0000","last_active":"2024-04-25T09:11:18.645157+0000","last_peered":"2024-04-25T09:11:18.645157+0000","last_clean":"2024-04-25T09:11:18.645157+0000","last_became_active":"2024-04-25T09:11:16.633821+0000","last_became_peered":"2024-04-25T09:11:16.633821+0000","last_unstale":"2024-04-25T09:11:18.645157+0000","last_undegraded":"2024-04-25T09:11:18.645157+0000","last_fullsized":"2024-04-25T09:11:18.645157+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:36.736863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644261+0000","last_change":"2024-04-25T09:11:17.642309+0000","last_active":"2024-04-25T09:11:18.644261+0000","last_peered":"2024-04-25T09:11:18.644261+0000","last_clean":"2024-04-25T09:11:18.644261+0000","last_became_active":"2024-04-25T09:11:17.641980+0000","last_became_peered":"2024-04-25T09:11:17.641980+0000","last_unstale":"2024-04-25T09:11:18.644261+0000","last_undegraded":"2024-04-25T09:11:18.644261+0000","last_fullsized":"2024-04-25T09:11:18.644261+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:09.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648056+0000","last_change":"2024-04-25T09:11:16.644272+0000","last_active":"2024-04-25T09:11:18.648056+0000","last_peered":"2024-04-25T09:11:18.648056+0000","last_clean":"2024-04-25T09:11:18.648056+0000","last_became_active":"2024-04-25T09:11:16.644030+0000","last_became_peered":"2024-04-25T09:11:16.644030+0000","last_unstale":"2024-04-25T09:11:18.648056+0000","last_undegraded":"2024-04-25T09:11:18.648056+0000","last_fullsized":"2024-04-25T09:11:18.648056+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:58.760861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851416+0000","last_change":"2024-04-25T09:11:17.648760+0000","last_active":"2024-04-25T09:11:18.851416+0000","last_peered":"2024-04-25T09:11:18.851416+0000","last_clean":"2024-04-25T09:11:18.851416+0000","last_became_active":"2024-04-25T09:11:17.647868+0000","last_became_peered":"2024-04-25T09:11:17.647868+0000","last_unstale":"2024-04-25T09:11:18.851416+0000","last_undegraded":"2024-04-25T09:11:18.851416+0000","last_fullsized":"2024-04-25T09:11:18.851416+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:50.361783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647870+0000","last_change":"2024-04-25T09:11:16.635628+0000","last_active":"2024-04-25T09:11:18.647870+0000","last_peered":"2024-04-25T09:11:18.647870+0000","last_clean":"2024-04-25T09:11:18.647870+0000","last_became_active":"2024-04-25T09:11:16.635321+0000","last_became_peered":"2024-04-25T09:11:16.635321+0000","last_unstale":"2024-04-25T09:11:18.647870+0000","last_undegraded":"2024-04-25T09:11:18.647870+0000","last_fullsized":"2024-04-25T09:11:18.647870+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:55.978106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354643+0000","last_change":"2024-04-25T09:11:17.659209+0000","last_active":"2024-04-25T09:11:19.354643+0000","last_peered":"2024-04-25T09:11:19.354643+0000","last_clean":"2024-04-25T09:11:19.354643+0000","last_became_active":"2024-04-25T09:11:17.658926+0000","last_became_peered":"2024-04-25T09:11:17.658926+0000","last_unstale":"2024-04-25T09:11:19.354643+0000","last_undegraded":"2024-04-25T09:11:19.354643+0000","last_fullsized":"2024-04-25T09:11:19.354643+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:33.517475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644211+0000","last_change":"2024-04-25T09:11:16.634864+0000","last_active":"2024-04-25T09:11:18.644211+0000","last_peered":"2024-04-25T09:11:18.644211+0000","last_clean":"2024-04-25T09:11:18.644211+0000","last_became_active":"2024-04-25T09:11:16.634574+0000","last_became_peered":"2024-04-25T09:11:16.634574+0000","last_unstale":"2024-04-25T09:11:18.644211+0000","last_undegraded":"2024-04-25T09:11:18.644211+0000","last_fullsized":"2024-04-25T09:11:18.644211+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:21.723275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352849+0000","last_change":"2024-04-25T09:11:17.656296+0000","last_active":"2024-04-25T09:11:19.352849+0000","last_peered":"2024-04-25T09:11:19.352849+0000","last_clean":"2024-04-25T09:11:19.352849+0000","last_became_active":"2024-04-25T09:11:17.655289+0000","last_became_peered":"2024-04-25T09:11:17.655289+0000","last_unstale":"2024-04-25T09:11:19.352849+0000","last_undegraded":"2024-04-25T09:11:19.352849+0000","last_fullsized":"2024-04-25T09:11:19.352849+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354559+0000","last_change":"2024-04-25T09:11:16.626171+0000","last_active":"2024-04-25T09:11:19.354559+0000","last_peered":"2024-04-25T09:11:19.354559+0000","last_clean":"2024-04-25T09:11:19.354559+0000","last_became_active":"2024-04-25T09:11:16.625864+0000","last_became_peered":"2024-04-25T09:11:16.625864+0000","last_unstale":"2024-04-25T09:11:19.354559+0000","last_undegraded":"2024-04-25T09:11:19.354559+0000","last_fullsized":"2024-04-25T09:11:19.354559+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:09.032765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355121+0000","last_change":"2024-04-25T09:11:17.655864+0000","last_active":"2024-04-25T09:11:19.355121+0000","last_peered":"2024-04-25T09:11:19.355121+0000","last_clean":"2024-04-25T09:11:19.355121+0000","last_became_active":"2024-04-25T09:11:17.655462+0000","last_became_peered":"2024-04-25T09:11:17.655462+0000","last_unstale":"2024-04-25T09:11:19.355121+0000","last_undegraded":"2024-04-25T09:11:19.355121+0000","last_fullsized":"2024-04-25T09:11:19.355121+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:32.802661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"120'8","reported_seq":22,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851334+0000","last_change":"2024-04-25T09:11:16.636176+0000","last_active":"2024-04-25T09:11:18.851334+0000","last_peered":"2024-04-25T09:11:18.851334+0000","last_clean":"2024-04-25T09:11:18.851334+0000","last_became_active":"2024-04-25T09:11:16.635871+0000","last_became_peered":"2024-04-25T09:11:16.635871+0000","last_unstale":"2024-04-25T09:11:18.851334+0000","last_undegraded":"2024-04-25T09:11:18.851334+0000","last_fullsized":"2024-04-25T09:11:18.851334+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:11.572138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":359,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354719+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:11:19.354719+0000","last_peered":"2024-04-25T09:11:19.354719+0000","last_clean":"2024-04-25T09:11:19.354719+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:11:19.354719+0000","last_undegraded":"2024-04-25T09:11:19.354719+0000","last_fullsized":"2024-04-25T09:11:19.354719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574972,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2117632,"data_stored":1296852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574971,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1511424,"data_stored":706290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1515520,"data_stored":705868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574972,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1519616,"data_stored":707320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":707354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32640,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339200,"statfs":{"total":96636764160,"available":96603340800,"internally_reserved":0,"allocated":1495040,"data_stored":699016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1511424,"data_stored":705730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2105344,"data_stored":1296098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:11:21.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:11:21.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.926+0000 7fa3bb600640 1 Processor -- start 2024-04-25T09:11:21.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.926+0000 7fa3bb600640 1 -- start start 2024-04-25T09:11:21.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3bb600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa3b4144140 0x7fa3b40ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3bb600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3b40ced60 0x7fa3b406e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3bb600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3b406e900 0x7fa3b415e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3bb600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b406ed70 con 0x7fa3b40ced60 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3bb600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b415ac60 con 0x7fa3b4144140 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3bb600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b40cf3e0 con 0x7fa3b406e900 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3abe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3b40ced60 0x7fa3b406e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3abe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa3b40ced60 0x7fa3b406e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53368/0 (socket says 172.21.15.59:53368) 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3abe00640 1 -- 172.21.15.59:0/3555599930 learned_addr learned my addr 172.21.15.59:0/3555599930 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3b8c00640 1 --2- 172.21.15.59:0/3555599930 >> v2:172.21.15.178:3300/0 conn(0x7fa3b4144140 0x7fa3b40ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3b9600640 1 --2- 172.21.15.59:0/3555599930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3b406e900 0x7fa3b415e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3abe00640 1 -- 172.21.15.59:0/3555599930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3b406e900 msgr2=0x7fa3b415e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3abe00640 1 --2- 172.21.15.59:0/3555599930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3b406e900 0x7fa3b415e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3abe00640 1 -- 172.21.15.59:0/3555599930 >> v2:172.21.15.178:3300/0 conn(0x7fa3b4144140 msgr2=0x7fa3b40ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3abe00640 1 --2- 172.21.15.59:0/3555599930 >> v2:172.21.15.178:3300/0 conn(0x7fa3b4144140 0x7fa3b40ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.930+0000 7fa3abe00640 1 -- 172.21.15.59:0/3555599930 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b415af20 con 0x7fa3b40ced60 2024-04-25T09:11:21.922 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3abe00640 1 --2- 172.21.15.59:0/3555599930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b40ced60 0x7fa3b406e3c0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fa3b406eef0 tx=0x7fa39c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c5ab711be1be0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3b3e00640 1 -- 172.21.15.59:0/3555599930 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0b0070 con 0x7fa3b40ced60 2024-04-25T09:11:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3b3e00640 1 -- 172.21.15.59:0/3555599930 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c0ab600 con 0x7fa3b40ced60 2024-04-25T09:11:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3b3e00640 1 -- 172.21.15.59:0/3555599930 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0ab9d0 con 0x7fa3b40ced60 2024-04-25T09:11:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3bb600640 1 -- 172.21.15.59:0/3555599930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b40ced60 msgr2=0x7fa3b406e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3bb600640 1 --2- 172.21.15.59:0/3555599930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b40ced60 0x7fa3b406e3c0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fa3b406eef0 tx=0x7fa39c01c260 comp rx=0 tx=0).stop 2024-04-25T09:11:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3bb600640 1 -- 172.21.15.59:0/3555599930 shutdown_connections 2024-04-25T09:11:21.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3bb600640 1 --2- 172.21.15.59:0/3555599930 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3b406e900 0x7fa3b415e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3bb600640 1 --2- 172.21.15.59:0/3555599930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b40ced60 0x7fa3b406e3c0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3bb600640 1 --2- 172.21.15.59:0/3555599930 >> v2:172.21.15.178:3300/0 conn(0x7fa3b4144140 0x7fa3b40ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3bb600640 1 -- 172.21.15.59:0/3555599930 >> 172.21.15.59:0/3555599930 conn(0x7fa3b4066fa0 msgr2=0x7fa3b406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3bb600640 1 -- 172.21.15.59:0/3555599930 shutdown_connections 2024-04-25T09:11:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3bb600640 1 -- 172.21.15.59:0/3555599930 wait complete. 2024-04-25T09:11:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3bb600640 1 Processor -- start 2024-04-25T09:11:21.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.934+0000 7fa3bb600640 1 -- start start 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3bb600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b406e900 0x7fa3b41f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3bb600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3b40ced60 0x7fa3b41f9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3bb600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3b4144140 0x7fa3b415c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3bb600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b415ba00 con 0x7fa3b406e900 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3bb600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b4144520 con 0x7fa3b40ced60 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3bb600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b415bb80 con 0x7fa3b4144140 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b406e900 0x7fa3b41f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b8c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b406e900 0x7fa3b41f6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53372/0 (socket says 172.21.15.59:53372) 2024-04-25T09:11:21.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b8c00640 1 -- 172.21.15.59:0/3086946816 learned_addr learned my addr 172.21.15.59:0/3086946816 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b9600640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3b4144140 0x7fa3b415c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3abe00640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3b40ced60 0x7fa3b41f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b8c00640 1 -- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3b4144140 msgr2=0x7fa3b415c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b8c00640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3b4144140 0x7fa3b415c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b8c00640 1 -- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3b40ced60 msgr2=0x7fa3b41f9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b8c00640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3b40ced60 0x7fa3b41f9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b8c00640 1 -- 172.21.15.59:0/3086946816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b41f98a0 con 0x7fa3b406e900 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3abe00640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3b40ced60 0x7fa3b41f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b8c00640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b406e900 0x7fa3b41f6550 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400d800 tx=0x7fa3a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b1600640 1 -- 172.21.15.59:0/3086946816 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400b6c0 con 0x7fa3b406e900 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b1600640 1 -- 172.21.15.59:0/3086946816 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a4019070 con 0x7fa3b406e900 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b1600640 1 -- 172.21.15.59:0/3086946816 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400ba60 con 0x7fa3b406e900 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3bb600640 1 -- 172.21.15.59:0/3086946816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b4139b10 con 0x7fa3b406e900 2024-04-25T09:11:21.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3bb600640 1 -- 172.21.15.59:0/3086946816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b413a0d0 con 0x7fa3b406e900 2024-04-25T09:11:21.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3bb600640 1 -- 172.21.15.59:0/3086946816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b40745d0 con 0x7fa3b406e900 2024-04-25T09:11:21.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.938+0000 7fa3b1600640 1 -- 172.21.15.59:0/3086946816 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa3a400bc00 con 0x7fa3b406e900 2024-04-25T09:11:21.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.942+0000 7fa3b1600640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa390066f60 0x7fa390069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:21.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.942+0000 7fa3b1600640 1 -- 172.21.15.59:0/3086946816 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa3a40855f0 con 0x7fa3b406e900 2024-04-25T09:11:21.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.942+0000 7fa3abe00640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa390066f60 0x7fa390069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:21.931 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.942+0000 7fa3abe00640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa390066f60 0x7fa390069420 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0ad000 tx=0x7fa39c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:21.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:21.946+0000 7fa3b1600640 1 -- 172.21.15.59:0/3086946816 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa3b41f98a0 con 0x7fa3b406e900 2024-04-25T09:11:22.091 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.102+0000 7fa3bb600640 1 -- 172.21.15.59:0/3086946816 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3b415dda0 con 0x7fa390066f60 2024-04-25T09:11:22.098 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.110+0000 7fa3b1600640 1 -- 172.21.15.59:0/3086946816 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252483 (secure 0 0 0) 0x7fa3b415dda0 con 0x7fa390066f60 2024-04-25T09:11:22.101 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:22.102 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:11:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.114+0000 7fa3bb600640 1 -- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa390066f60 msgr2=0x7fa390069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.114+0000 7fa3bb600640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa390066f60 0x7fa390069420 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0ad000 tx=0x7fa39c008040 comp rx=0 tx=0).stop 2024-04-25T09:11:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.114+0000 7fa3bb600640 1 -- 172.21.15.59:0/3086946816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b406e900 msgr2=0x7fa3b41f6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.103 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.114+0000 7fa3bb600640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b406e900 0x7fa3b41f6550 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400d800 tx=0x7fa3a400dcc0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.114+0000 7fa3bb600640 1 -- 172.21.15.59:0/3086946816 shutdown_connections 2024-04-25T09:11:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.114+0000 7fa3bb600640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa390066f60 0x7fa390069420 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.114+0000 7fa3bb600640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa3b4144140 0x7fa3b415c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.114+0000 7fa3bb600640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa3b40ced60 0x7fa3b41f9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.114+0000 7fa3bb600640 1 --2- 172.21.15.59:0/3086946816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b406e900 0x7fa3b41f6550 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.114+0000 7fa3bb600640 1 -- 172.21.15.59:0/3086946816 >> 172.21.15.59:0/3086946816 conn(0x7fa3b4066fa0 msgr2=0x7fa3b40b45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.114+0000 7fa3bb600640 1 -- 172.21.15.59:0/3086946816 shutdown_connections 2024-04-25T09:11:22.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.114+0000 7fa3bb600640 1 -- 172.21.15.59:0/3086946816 wait complete. 2024-04-25T09:11:22.122 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":418,"stamp":"2024-04-25T09:11:21.800740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262436,"kb_used_data":12988,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712284,"statfs":{"total":773094113280,"available":772825378816,"internally_reserved":0,"allocated":13299712,"data_stored":6824528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001606"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648226+0000","last_change":"2024-04-25T09:11:17.636508+0000","last_active":"2024-04-25T09:11:18.648226+0000","last_peered":"2024-04-25T09:11:18.648226+0000","last_clean":"2024-04-25T09:11:18.648226+0000","last_became_active":"2024-04-25T09:11:17.636233+0000","last_became_peered":"2024-04-25T09:11:17.636233+0000","last_unstale":"2024-04-25T09:11:18.648226+0000","last_undegraded":"2024-04-25T09:11:18.648226+0000","last_fullsized":"2024-04-25T09:11:18.648226+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:50.164469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851605+0000","last_change":"2024-04-25T09:11:17.656358+0000","last_active":"2024-04-25T09:11:18.851605+0000","last_peered":"2024-04-25T09:11:18.851605+0000","last_clean":"2024-04-25T09:11:18.851605+0000","last_became_active":"2024-04-25T09:11:17.655680+0000","last_became_peered":"2024-04-25T09:11:17.655680+0000","last_unstale":"2024-04-25T09:11:18.851605+0000","last_undegraded":"2024-04-25T09:11:18.851605+0000","last_fullsized":"2024-04-25T09:11:18.851605+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:33.517475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851826+0000","last_change":"2024-04-25T09:11:17.648656+0000","last_active":"2024-04-25T09:11:18.851826+0000","last_peered":"2024-04-25T09:11:18.851826+0000","last_clean":"2024-04-25T09:11:18.851826+0000","last_became_active":"2024-04-25T09:11:17.648346+0000","last_became_peered":"2024-04-25T09:11:17.648346+0000","last_unstale":"2024-04-25T09:11:18.851826+0000","last_undegraded":"2024-04-25T09:11:18.851826+0000","last_fullsized":"2024-04-25T09:11:18.851826+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:24.533086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354982+0000","last_change":"2024-04-25T09:11:17.657802+0000","last_active":"2024-04-25T09:11:19.354982+0000","last_peered":"2024-04-25T09:11:19.354982+0000","last_clean":"2024-04-25T09:11:19.354982+0000","last_became_active":"2024-04-25T09:11:17.657459+0000","last_became_peered":"2024-04-25T09:11:17.657459+0000","last_unstale":"2024-04-25T09:11:19.354982+0000","last_undegraded":"2024-04-25T09:11:19.354982+0000","last_fullsized":"2024-04-25T09:11:19.354982+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:38.417064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647898+0000","last_change":"2024-04-25T09:11:17.638420+0000","last_active":"2024-04-25T09:11:18.647898+0000","last_peered":"2024-04-25T09:11:18.647898+0000","last_clean":"2024-04-25T09:11:18.647898+0000","last_became_active":"2024-04-25T09:11:17.638135+0000","last_became_peered":"2024-04-25T09:11:17.638135+0000","last_unstale":"2024-04-25T09:11:18.647898+0000","last_undegraded":"2024-04-25T09:11:18.647898+0000","last_fullsized":"2024-04-25T09:11:18.647898+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:20.326417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644412+0000","last_change":"2024-04-25T09:11:17.652990+0000","last_active":"2024-04-25T09:11:18.644412+0000","last_peered":"2024-04-25T09:11:18.644412+0000","last_clean":"2024-04-25T09:11:18.644412+0000","last_became_active":"2024-04-25T09:11:17.652725+0000","last_became_peered":"2024-04-25T09:11:17.652725+0000","last_unstale":"2024-04-25T09:11:18.644412+0000","last_undegraded":"2024-04-25T09:11:18.644412+0000","last_fullsized":"2024-04-25T09:11:18.644412+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:19:20.599074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644249+0000","last_change":"2024-04-25T09:11:17.649464+0000","last_active":"2024-04-25T09:11:18.644249+0000","last_peered":"2024-04-25T09:11:18.644249+0000","last_clean":"2024-04-25T09:11:18.644249+0000","last_became_active":"2024-04-25T09:11:17.649086+0000","last_became_peered":"2024-04-25T09:11:17.649086+0000","last_unstale":"2024-04-25T09:11:18.644249+0000","last_undegraded":"2024-04-25T09:11:18.644249+0000","last_fullsized":"2024-04-25T09:11:18.644249+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:37:20.105824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851281+0000","last_change":"2024-04-25T09:11:17.648550+0000","last_active":"2024-04-25T09:11:18.851281+0000","last_peered":"2024-04-25T09:11:18.851281+0000","last_clean":"2024-04-25T09:11:18.851281+0000","last_became_active":"2024-04-25T09:11:17.647456+0000","last_became_peered":"2024-04-25T09:11:17.647456+0000","last_unstale":"2024-04-25T09:11:18.851281+0000","last_undegraded":"2024-04-25T09:11:18.851281+0000","last_fullsized":"2024-04-25T09:11:18.851281+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:50.699355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355258+0000","last_change":"2024-04-25T09:11:17.660831+0000","last_active":"2024-04-25T09:11:19.355258+0000","last_peered":"2024-04-25T09:11:19.355258+0000","last_clean":"2024-04-25T09:11:19.355258+0000","last_became_active":"2024-04-25T09:11:17.660549+0000","last_became_peered":"2024-04-25T09:11:17.660549+0000","last_unstale":"2024-04-25T09:11:19.355258+0000","last_undegraded":"2024-04-25T09:11:19.355258+0000","last_fullsized":"2024-04-25T09:11:19.355258+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:24.533086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352886+0000","last_change":"2024-04-25T09:11:17.646850+0000","last_active":"2024-04-25T09:11:19.352886+0000","last_peered":"2024-04-25T09:11:19.352886+0000","last_clean":"2024-04-25T09:11:19.352886+0000","last_became_active":"2024-04-25T09:11:17.645643+0000","last_became_peered":"2024-04-25T09:11:17.645643+0000","last_unstale":"2024-04-25T09:11:19.352886+0000","last_undegraded":"2024-04-25T09:11:19.352886+0000","last_fullsized":"2024-04-25T09:11:19.352886+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:35.347571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647981+0000","last_change":"2024-04-25T09:11:17.643946+0000","last_active":"2024-04-25T09:11:18.647981+0000","last_peered":"2024-04-25T09:11:18.647981+0000","last_clean":"2024-04-25T09:11:18.647981+0000","last_became_active":"2024-04-25T09:11:17.643130+0000","last_became_peered":"2024-04-25T09:11:17.643130+0000","last_unstale":"2024-04-25T09:11:18.647981+0000","last_undegraded":"2024-04-25T09:11:18.647981+0000","last_fullsized":"2024-04-25T09:11:18.647981+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:12.943255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644990+0000","last_change":"2024-04-25T09:11:17.643828+0000","last_active":"2024-04-25T09:11:18.644990+0000","last_peered":"2024-04-25T09:11:18.644990+0000","last_clean":"2024-04-25T09:11:18.644990+0000","last_became_active":"2024-04-25T09:11:17.643495+0000","last_became_peered":"2024-04-25T09:11:17.643495+0000","last_unstale":"2024-04-25T09:11:18.644990+0000","last_undegraded":"2024-04-25T09:11:18.644990+0000","last_fullsized":"2024-04-25T09:11:18.644990+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:57:20.724118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352597+0000","last_change":"2024-04-25T09:11:17.642385+0000","last_active":"2024-04-25T09:11:19.352597+0000","last_peered":"2024-04-25T09:11:19.352597+0000","last_clean":"2024-04-25T09:11:19.352597+0000","last_became_active":"2024-04-25T09:11:17.641092+0000","last_became_peered":"2024-04-25T09:11:17.641092+0000","last_unstale":"2024-04-25T09:11:19.352597+0000","last_undegraded":"2024-04-25T09:11:19.352597+0000","last_fullsized":"2024-04-25T09:11:19.352597+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:10.034927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851442+0000","last_change":"2024-04-25T09:11:17.654007+0000","last_active":"2024-04-25T09:11:18.851442+0000","last_peered":"2024-04-25T09:11:18.851442+0000","last_clean":"2024-04-25T09:11:18.851442+0000","last_became_active":"2024-04-25T09:11:17.650839+0000","last_became_peered":"2024-04-25T09:11:17.650839+0000","last_unstale":"2024-04-25T09:11:18.851442+0000","last_undegraded":"2024-04-25T09:11:18.851442+0000","last_fullsized":"2024-04-25T09:11:18.851442+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:22:53.460943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648257+0000","last_change":"2024-04-25T09:11:17.643390+0000","last_active":"2024-04-25T09:11:18.648257+0000","last_peered":"2024-04-25T09:11:18.648257+0000","last_clean":"2024-04-25T09:11:18.648257+0000","last_became_active":"2024-04-25T09:11:17.643067+0000","last_became_peered":"2024-04-25T09:11:17.643067+0000","last_unstale":"2024-04-25T09:11:18.648257+0000","last_undegraded":"2024-04-25T09:11:18.648257+0000","last_fullsized":"2024-04-25T09:11:18.648257+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:59.956526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644109+0000","last_change":"2024-04-25T09:11:17.647617+0000","last_active":"2024-04-25T09:11:18.644109+0000","last_peered":"2024-04-25T09:11:18.644109+0000","last_clean":"2024-04-25T09:11:18.644109+0000","last_became_active":"2024-04-25T09:11:17.647326+0000","last_became_peered":"2024-04-25T09:11:17.647326+0000","last_unstale":"2024-04-25T09:11:18.644109+0000","last_undegraded":"2024-04-25T09:11:18.644109+0000","last_fullsized":"2024-04-25T09:11:18.644109+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:27:55.359511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.353118+0000","last_change":"2024-04-25T09:11:17.645039+0000","last_active":"2024-04-25T09:11:19.353118+0000","last_peered":"2024-04-25T09:11:19.353118+0000","last_clean":"2024-04-25T09:11:19.353118+0000","last_became_active":"2024-04-25T09:11:17.644771+0000","last_became_peered":"2024-04-25T09:11:17.644771+0000","last_unstale":"2024-04-25T09:11:19.353118+0000","last_undegraded":"2024-04-25T09:11:19.353118+0000","last_fullsized":"2024-04-25T09:11:19.353118+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:13.152795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851721+0000","last_change":"2024-04-25T09:11:17.656568+0000","last_active":"2024-04-25T09:11:18.851721+0000","last_peered":"2024-04-25T09:11:18.851721+0000","last_clean":"2024-04-25T09:11:18.851721+0000","last_became_active":"2024-04-25T09:11:17.656046+0000","last_became_peered":"2024-04-25T09:11:17.656046+0000","last_unstale":"2024-04-25T09:11:18.851721+0000","last_undegraded":"2024-04-25T09:11:18.851721+0000","last_fullsized":"2024-04-25T09:11:18.851721+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:38.768555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848617+0000","last_change":"2024-04-25T09:11:17.656570+0000","last_active":"2024-04-25T09:11:18.848617+0000","last_peered":"2024-04-25T09:11:18.848617+0000","last_clean":"2024-04-25T09:11:18.848617+0000","last_became_active":"2024-04-25T09:11:17.656257+0000","last_became_peered":"2024-04-25T09:11:17.656257+0000","last_unstale":"2024-04-25T09:11:18.848617+0000","last_undegraded":"2024-04-25T09:11:18.848617+0000","last_fullsized":"2024-04-25T09:11:18.848617+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:56.158046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352239+0000","last_change":"2024-04-25T09:11:17.652778+0000","last_active":"2024-04-25T09:11:19.352239+0000","last_peered":"2024-04-25T09:11:19.352239+0000","last_clean":"2024-04-25T09:11:19.352239+0000","last_became_active":"2024-04-25T09:11:17.652530+0000","last_became_peered":"2024-04-25T09:11:17.652530+0000","last_unstale":"2024-04-25T09:11:19.352239+0000","last_undegraded":"2024-04-25T09:11:19.352239+0000","last_fullsized":"2024-04-25T09:11:19.352239+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:18:36.977223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354969+0000","last_change":"2024-04-25T09:11:17.657614+0000","last_active":"2024-04-25T09:11:19.354969+0000","last_peered":"2024-04-25T09:11:19.354969+0000","last_clean":"2024-04-25T09:11:19.354969+0000","last_became_active":"2024-04-25T09:11:17.657310+0000","last_became_peered":"2024-04-25T09:11:17.657310+0000","last_unstale":"2024-04-25T09:11:19.354969+0000","last_undegraded":"2024-04-25T09:11:19.354969+0000","last_fullsized":"2024-04-25T09:11:19.354969+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:38.768555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647746+0000","last_change":"2024-04-25T09:11:17.662944+0000","last_active":"2024-04-25T09:11:18.647746+0000","last_peered":"2024-04-25T09:11:18.647746+0000","last_clean":"2024-04-25T09:11:18.647746+0000","last_became_active":"2024-04-25T09:11:17.662635+0000","last_became_peered":"2024-04-25T09:11:17.662635+0000","last_unstale":"2024-04-25T09:11:18.647746+0000","last_undegraded":"2024-04-25T09:11:18.647746+0000","last_fullsized":"2024-04-25T09:11:18.647746+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:51:11.910736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354815+0000","last_change":"2024-04-25T09:11:17.661406+0000","last_active":"2024-04-25T09:11:19.354815+0000","last_peered":"2024-04-25T09:11:19.354815+0000","last_clean":"2024-04-25T09:11:19.354815+0000","last_became_active":"2024-04-25T09:11:17.661008+0000","last_became_peered":"2024-04-25T09:11:17.661008+0000","last_unstale":"2024-04-25T09:11:19.354815+0000","last_undegraded":"2024-04-25T09:11:19.354815+0000","last_fullsized":"2024-04-25T09:11:19.354815+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:33.833900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647239+0000","last_change":"2024-04-25T09:11:17.639213+0000","last_active":"2024-04-25T09:11:18.647239+0000","last_peered":"2024-04-25T09:11:18.647239+0000","last_clean":"2024-04-25T09:11:18.647239+0000","last_became_active":"2024-04-25T09:11:17.638654+0000","last_became_peered":"2024-04-25T09:11:17.638654+0000","last_unstale":"2024-04-25T09:11:18.647239+0000","last_undegraded":"2024-04-25T09:11:18.647239+0000","last_fullsized":"2024-04-25T09:11:18.647239+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:06.186393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648665+0000","last_change":"2024-04-25T09:11:17.640300+0000","last_active":"2024-04-25T09:11:18.648665+0000","last_peered":"2024-04-25T09:11:18.648665+0000","last_clean":"2024-04-25T09:11:18.648665+0000","last_became_active":"2024-04-25T09:11:17.640014+0000","last_became_peered":"2024-04-25T09:11:17.640014+0000","last_unstale":"2024-04-25T09:11:18.648665+0000","last_undegraded":"2024-04-25T09:11:18.648665+0000","last_fullsized":"2024-04-25T09:11:18.648665+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:59:13.152795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352408+0000","last_change":"2024-04-25T09:11:17.656185+0000","last_active":"2024-04-25T09:11:19.352408+0000","last_peered":"2024-04-25T09:11:19.352408+0000","last_clean":"2024-04-25T09:11:19.352408+0000","last_became_active":"2024-04-25T09:11:17.655921+0000","last_became_peered":"2024-04-25T09:11:17.655921+0000","last_unstale":"2024-04-25T09:11:19.352408+0000","last_undegraded":"2024-04-25T09:11:19.352408+0000","last_fullsized":"2024-04-25T09:11:19.352408+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:21:53.595170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848667+0000","last_change":"2024-04-25T09:11:17.657752+0000","last_active":"2024-04-25T09:11:18.848667+0000","last_peered":"2024-04-25T09:11:18.848667+0000","last_clean":"2024-04-25T09:11:18.848667+0000","last_became_active":"2024-04-25T09:11:17.656014+0000","last_became_peered":"2024-04-25T09:11:17.656014+0000","last_unstale":"2024-04-25T09:11:18.848667+0000","last_undegraded":"2024-04-25T09:11:18.848667+0000","last_fullsized":"2024-04-25T09:11:18.848667+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:35.347571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.645039+0000","last_change":"2024-04-25T09:11:17.643729+0000","last_active":"2024-04-25T09:11:18.645039+0000","last_peered":"2024-04-25T09:11:18.645039+0000","last_clean":"2024-04-25T09:11:18.645039+0000","last_became_active":"2024-04-25T09:11:17.643355+0000","last_became_peered":"2024-04-25T09:11:17.643355+0000","last_unstale":"2024-04-25T09:11:18.645039+0000","last_undegraded":"2024-04-25T09:11:18.645039+0000","last_fullsized":"2024-04-25T09:11:18.645039+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:38.385774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352299+0000","last_change":"2024-04-25T09:11:17.664662+0000","last_active":"2024-04-25T09:11:19.352299+0000","last_peered":"2024-04-25T09:11:19.352299+0000","last_clean":"2024-04-25T09:11:19.352299+0000","last_became_active":"2024-04-25T09:11:17.664265+0000","last_became_peered":"2024-04-25T09:11:17.664265+0000","last_unstale":"2024-04-25T09:11:19.352299+0000","last_undegraded":"2024-04-25T09:11:19.352299+0000","last_fullsized":"2024-04-25T09:11:19.352299+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:17.639851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851509+0000","last_change":"2024-04-25T09:11:17.650996+0000","last_active":"2024-04-25T09:11:18.851509+0000","last_peered":"2024-04-25T09:11:18.851509+0000","last_clean":"2024-04-25T09:11:18.851509+0000","last_became_active":"2024-04-25T09:11:17.650020+0000","last_became_peered":"2024-04-25T09:11:17.650020+0000","last_unstale":"2024-04-25T09:11:18.851509+0000","last_undegraded":"2024-04-25T09:11:18.851509+0000","last_fullsized":"2024-04-25T09:11:18.851509+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:28:24.468870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647814+0000","last_change":"2024-04-25T09:11:17.652349+0000","last_active":"2024-04-25T09:11:18.647814+0000","last_peered":"2024-04-25T09:11:18.647814+0000","last_clean":"2024-04-25T09:11:18.647814+0000","last_became_active":"2024-04-25T09:11:17.652076+0000","last_became_peered":"2024-04-25T09:11:17.652076+0000","last_unstale":"2024-04-25T09:11:18.647814+0000","last_undegraded":"2024-04-25T09:11:18.647814+0000","last_fullsized":"2024-04-25T09:11:18.647814+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:57.428053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648100+0000","last_change":"2024-04-25T09:11:17.638926+0000","last_active":"2024-04-25T09:11:18.648100+0000","last_peered":"2024-04-25T09:11:18.648100+0000","last_clean":"2024-04-25T09:11:18.648100+0000","last_became_active":"2024-04-25T09:11:17.638305+0000","last_became_peered":"2024-04-25T09:11:17.638305+0000","last_unstale":"2024-04-25T09:11:18.648100+0000","last_undegraded":"2024-04-25T09:11:18.648100+0000","last_fullsized":"2024-04-25T09:11:18.648100+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352856+0000","last_change":"2024-04-25T09:11:17.652374+0000","last_active":"2024-04-25T09:11:19.352856+0000","last_peered":"2024-04-25T09:11:19.352856+0000","last_clean":"2024-04-25T09:11:19.352856+0000","last_became_active":"2024-04-25T09:11:17.652108+0000","last_became_peered":"2024-04-25T09:11:17.652108+0000","last_unstale":"2024-04-25T09:11:19.352856+0000","last_undegraded":"2024-04-25T09:11:19.352856+0000","last_fullsized":"2024-04-25T09:11:19.352856+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:56.158046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"120'4","reported_seq":18,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848633+0000","last_change":"2024-04-25T09:11:16.631514+0000","last_active":"2024-04-25T09:11:18.848633+0000","last_peered":"2024-04-25T09:11:18.848633+0000","last_clean":"2024-04-25T09:11:18.848633+0000","last_became_active":"2024-04-25T09:11:16.631206+0000","last_became_peered":"2024-04-25T09:11:16.631206+0000","last_unstale":"2024-04-25T09:11:18.848633+0000","last_undegraded":"2024-04-25T09:11:18.848633+0000","last_fullsized":"2024-04-25T09:11:18.848633+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:51:10.908574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.645001+0000","last_change":"2024-04-25T09:11:17.655155+0000","last_active":"2024-04-25T09:11:18.645001+0000","last_peered":"2024-04-25T09:11:18.645001+0000","last_clean":"2024-04-25T09:11:18.645001+0000","last_became_active":"2024-04-25T09:11:17.654860+0000","last_became_peered":"2024-04-25T09:11:17.654860+0000","last_unstale":"2024-04-25T09:11:18.645001+0000","last_undegraded":"2024-04-25T09:11:18.645001+0000","last_fullsized":"2024-04-25T09:11:18.645001+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:27.742032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"120'1","reported_seq":15,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352969+0000","last_change":"2024-04-25T09:11:16.638747+0000","last_active":"2024-04-25T09:11:19.352969+0000","last_peered":"2024-04-25T09:11:19.352969+0000","last_clean":"2024-04-25T09:11:19.352969+0000","last_became_active":"2024-04-25T09:11:16.638054+0000","last_became_peered":"2024-04-25T09:11:16.638054+0000","last_unstale":"2024-04-25T09:11:19.352969+0000","last_undegraded":"2024-04-25T09:11:19.352969+0000","last_fullsized":"2024-04-25T09:11:19.352969+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:01.369701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648508+0000","last_change":"2024-04-25T09:11:17.646893+0000","last_active":"2024-04-25T09:11:18.648508+0000","last_peered":"2024-04-25T09:11:18.648508+0000","last_clean":"2024-04-25T09:11:18.648508+0000","last_became_active":"2024-04-25T09:11:17.646600+0000","last_became_peered":"2024-04-25T09:11:17.646600+0000","last_unstale":"2024-04-25T09:11:18.648508+0000","last_undegraded":"2024-04-25T09:11:18.648508+0000","last_fullsized":"2024-04-25T09:11:18.648508+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:35.347571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"120'2","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355273+0000","last_change":"2024-04-25T09:11:16.633680+0000","last_active":"2024-04-25T09:11:19.355273+0000","last_peered":"2024-04-25T09:11:19.355273+0000","last_clean":"2024-04-25T09:11:19.355273+0000","last_became_active":"2024-04-25T09:11:16.632258+0000","last_became_peered":"2024-04-25T09:11:16.632258+0000","last_unstale":"2024-04-25T09:11:19.355273+0000","last_undegraded":"2024-04-25T09:11:19.355273+0000","last_fullsized":"2024-04-25T09:11:19.355273+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:00.738690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355342+0000","last_change":"2024-04-25T09:11:17.657709+0000","last_active":"2024-04-25T09:11:19.355342+0000","last_peered":"2024-04-25T09:11:19.355342+0000","last_clean":"2024-04-25T09:11:19.355342+0000","last_became_active":"2024-04-25T09:11:17.657221+0000","last_became_peered":"2024-04-25T09:11:17.657221+0000","last_unstale":"2024-04-25T09:11:19.355342+0000","last_undegraded":"2024-04-25T09:11:19.355342+0000","last_fullsized":"2024-04-25T09:11:19.355342+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:03:42.754704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"120'2","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352930+0000","last_change":"2024-04-25T09:11:16.634170+0000","last_active":"2024-04-25T09:11:19.352930+0000","last_peered":"2024-04-25T09:11:19.352930+0000","last_clean":"2024-04-25T09:11:19.352930+0000","last_became_active":"2024-04-25T09:11:16.633894+0000","last_became_peered":"2024-04-25T09:11:16.633894+0000","last_unstale":"2024-04-25T09:11:19.352930+0000","last_undegraded":"2024-04-25T09:11:19.352930+0000","last_fullsized":"2024-04-25T09:11:19.352930+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:20.504739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352367+0000","last_change":"2024-04-25T09:11:17.638505+0000","last_active":"2024-04-25T09:11:19.352367+0000","last_peered":"2024-04-25T09:11:19.352367+0000","last_clean":"2024-04-25T09:11:19.352367+0000","last_became_active":"2024-04-25T09:11:17.638179+0000","last_became_peered":"2024-04-25T09:11:17.638179+0000","last_unstale":"2024-04-25T09:11:19.352367+0000","last_undegraded":"2024-04-25T09:11:19.352367+0000","last_fullsized":"2024-04-25T09:11:19.352367+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:06.186393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"120'1","reported_seq":15,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648065+0000","last_change":"2024-04-25T09:11:16.640598+0000","last_active":"2024-04-25T09:11:18.648065+0000","last_peered":"2024-04-25T09:11:18.648065+0000","last_clean":"2024-04-25T09:11:18.648065+0000","last_became_active":"2024-04-25T09:11:16.640187+0000","last_became_peered":"2024-04-25T09:11:16.640187+0000","last_unstale":"2024-04-25T09:11:18.648065+0000","last_undegraded":"2024-04-25T09:11:18.648065+0000","last_fullsized":"2024-04-25T09:11:18.648065+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:43:22.941106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647889+0000","last_change":"2024-04-25T09:11:17.650866+0000","last_active":"2024-04-25T09:11:18.647889+0000","last_peered":"2024-04-25T09:11:18.647889+0000","last_clean":"2024-04-25T09:11:18.647889+0000","last_became_active":"2024-04-25T09:11:17.650420+0000","last_became_peered":"2024-04-25T09:11:17.650420+0000","last_unstale":"2024-04-25T09:11:18.647889+0000","last_undegraded":"2024-04-25T09:11:18.647889+0000","last_fullsized":"2024-04-25T09:11:18.647889+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:13.332923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"120'1","reported_seq":15,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644578+0000","last_change":"2024-04-25T09:11:16.636975+0000","last_active":"2024-04-25T09:11:18.644578+0000","last_peered":"2024-04-25T09:11:18.644578+0000","last_clean":"2024-04-25T09:11:18.644578+0000","last_became_active":"2024-04-25T09:11:16.636697+0000","last_became_peered":"2024-04-25T09:11:16.636697+0000","last_unstale":"2024-04-25T09:11:18.644578+0000","last_undegraded":"2024-04-25T09:11:18.644578+0000","last_fullsized":"2024-04-25T09:11:18.644578+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:08:40.191420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851656+0000","last_change":"2024-04-25T09:11:17.650793+0000","last_active":"2024-04-25T09:11:18.851656+0000","last_peered":"2024-04-25T09:11:18.851656+0000","last_clean":"2024-04-25T09:11:18.851656+0000","last_became_active":"2024-04-25T09:11:17.645491+0000","last_became_peered":"2024-04-25T09:11:17.645491+0000","last_unstale":"2024-04-25T09:11:18.851656+0000","last_undegraded":"2024-04-25T09:11:18.851656+0000","last_fullsized":"2024-04-25T09:11:18.851656+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:33.833900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647916+0000","last_change":"2024-04-25T09:11:16.627306+0000","last_active":"2024-04-25T09:11:18.647916+0000","last_peered":"2024-04-25T09:11:18.647916+0000","last_clean":"2024-04-25T09:11:18.647916+0000","last_became_active":"2024-04-25T09:11:16.627010+0000","last_became_peered":"2024-04-25T09:11:16.627010+0000","last_unstale":"2024-04-25T09:11:18.647916+0000","last_undegraded":"2024-04-25T09:11:18.647916+0000","last_fullsized":"2024-04-25T09:11:18.647916+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:39:20.504739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352759+0000","last_change":"2024-04-25T09:11:17.642615+0000","last_active":"2024-04-25T09:11:19.352759+0000","last_peered":"2024-04-25T09:11:19.352759+0000","last_clean":"2024-04-25T09:11:19.352759+0000","last_became_active":"2024-04-25T09:11:17.642111+0000","last_became_peered":"2024-04-25T09:11:17.642111+0000","last_unstale":"2024-04-25T09:11:19.352759+0000","last_undegraded":"2024-04-25T09:11:19.352759+0000","last_fullsized":"2024-04-25T09:11:19.352759+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:57.428053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644244+0000","last_change":"2024-04-25T09:11:16.639401+0000","last_active":"2024-04-25T09:11:18.644244+0000","last_peered":"2024-04-25T09:11:18.644244+0000","last_clean":"2024-04-25T09:11:18.644244+0000","last_became_active":"2024-04-25T09:11:16.639131+0000","last_became_peered":"2024-04-25T09:11:16.639131+0000","last_unstale":"2024-04-25T09:11:18.644244+0000","last_undegraded":"2024-04-25T09:11:18.644244+0000","last_fullsized":"2024-04-25T09:11:18.644244+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:02:22.531871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848449+0000","last_change":"2024-04-25T09:11:17.651266+0000","last_active":"2024-04-25T09:11:18.848449+0000","last_peered":"2024-04-25T09:11:18.848449+0000","last_clean":"2024-04-25T09:11:18.848449+0000","last_became_active":"2024-04-25T09:11:17.650960+0000","last_became_peered":"2024-04-25T09:11:17.650960+0000","last_unstale":"2024-04-25T09:11:18.848449+0000","last_undegraded":"2024-04-25T09:11:18.848449+0000","last_fullsized":"2024-04-25T09:11:18.848449+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848655+0000","last_change":"2024-04-25T09:11:16.639668+0000","last_active":"2024-04-25T09:11:18.848655+0000","last_peered":"2024-04-25T09:11:18.848655+0000","last_clean":"2024-04-25T09:11:18.848655+0000","last_became_active":"2024-04-25T09:11:16.639273+0000","last_became_peered":"2024-04-25T09:11:16.639273+0000","last_unstale":"2024-04-25T09:11:18.848655+0000","last_undegraded":"2024-04-25T09:11:18.848655+0000","last_fullsized":"2024-04-25T09:11:18.848655+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:12.330761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648326+0000","last_change":"2024-04-25T09:11:17.646697+0000","last_active":"2024-04-25T09:11:18.648326+0000","last_peered":"2024-04-25T09:11:18.648326+0000","last_clean":"2024-04-25T09:11:18.648326+0000","last_became_active":"2024-04-25T09:11:17.646370+0000","last_became_peered":"2024-04-25T09:11:17.646370+0000","last_unstale":"2024-04-25T09:11:18.648326+0000","last_undegraded":"2024-04-25T09:11:18.648326+0000","last_fullsized":"2024-04-25T09:11:18.648326+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:56.158046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648487+0000","last_change":"2024-04-25T09:11:16.627930+0000","last_active":"2024-04-25T09:11:18.648487+0000","last_peered":"2024-04-25T09:11:18.648487+0000","last_clean":"2024-04-25T09:11:18.648487+0000","last_became_active":"2024-04-25T09:11:16.627638+0000","last_became_peered":"2024-04-25T09:11:16.627638+0000","last_unstale":"2024-04-25T09:11:18.648487+0000","last_undegraded":"2024-04-25T09:11:18.648487+0000","last_fullsized":"2024-04-25T09:11:18.648487+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:14.573952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851774+0000","last_change":"2024-04-25T09:11:17.642521+0000","last_active":"2024-04-25T09:11:18.851774+0000","last_peered":"2024-04-25T09:11:18.851774+0000","last_clean":"2024-04-25T09:11:18.851774+0000","last_became_active":"2024-04-25T09:11:17.641950+0000","last_became_peered":"2024-04-25T09:11:17.641950+0000","last_unstale":"2024-04-25T09:11:18.851774+0000","last_undegraded":"2024-04-25T09:11:18.851774+0000","last_fullsized":"2024-04-25T09:11:18.851774+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:32.802661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"120'3","reported_seq":17,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648479+0000","last_change":"2024-04-25T09:11:16.633508+0000","last_active":"2024-04-25T09:11:18.648479+0000","last_peered":"2024-04-25T09:11:18.648479+0000","last_clean":"2024-04-25T09:11:18.648479+0000","last_became_active":"2024-04-25T09:11:16.632328+0000","last_became_peered":"2024-04-25T09:11:16.632328+0000","last_unstale":"2024-04-25T09:11:18.648479+0000","last_undegraded":"2024-04-25T09:11:18.648479+0000","last_fullsized":"2024-04-25T09:11:18.648479+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:01.369701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648650+0000","last_change":"2024-04-25T09:11:17.656321+0000","last_active":"2024-04-25T09:11:18.648650+0000","last_peered":"2024-04-25T09:11:18.648650+0000","last_clean":"2024-04-25T09:11:18.648650+0000","last_became_active":"2024-04-25T09:11:17.656005+0000","last_became_peered":"2024-04-25T09:11:17.656005+0000","last_unstale":"2024-04-25T09:11:18.648650+0000","last_undegraded":"2024-04-25T09:11:18.648650+0000","last_fullsized":"2024-04-25T09:11:18.648650+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:18.373239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"120'6","reported_seq":20,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851527+0000","last_change":"2024-04-25T09:11:16.637855+0000","last_active":"2024-04-25T09:11:18.851527+0000","last_peered":"2024-04-25T09:11:18.851527+0000","last_clean":"2024-04-25T09:11:18.851527+0000","last_became_active":"2024-04-25T09:11:16.637590+0000","last_became_peered":"2024-04-25T09:11:16.637590+0000","last_unstale":"2024-04-25T09:11:18.851527+0000","last_undegraded":"2024-04-25T09:11:18.851527+0000","last_fullsized":"2024-04-25T09:11:18.851527+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:24:58.954364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848708+0000","last_change":"2024-04-25T09:11:17.653143+0000","last_active":"2024-04-25T09:11:18.848708+0000","last_peered":"2024-04-25T09:11:18.848708+0000","last_clean":"2024-04-25T09:11:18.848708+0000","last_became_active":"2024-04-25T09:11:17.652817+0000","last_became_peered":"2024-04-25T09:11:17.652817+0000","last_unstale":"2024-04-25T09:11:18.848708+0000","last_undegraded":"2024-04-25T09:11:18.848708+0000","last_fullsized":"2024-04-25T09:11:18.848708+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:18.373239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"120'2","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851760+0000","last_change":"2024-04-25T09:11:16.636034+0000","last_active":"2024-04-25T09:11:18.851760+0000","last_peered":"2024-04-25T09:11:18.851760+0000","last_clean":"2024-04-25T09:11:18.851760+0000","last_became_active":"2024-04-25T09:11:16.635736+0000","last_became_peered":"2024-04-25T09:11:16.635736+0000","last_unstale":"2024-04-25T09:11:18.851760+0000","last_undegraded":"2024-04-25T09:11:18.851760+0000","last_fullsized":"2024-04-25T09:11:18.851760+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:51:10.908574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352570+0000","last_change":"2024-04-25T09:11:17.650311+0000","last_active":"2024-04-25T09:11:19.352570+0000","last_peered":"2024-04-25T09:11:19.352570+0000","last_clean":"2024-04-25T09:11:19.352570+0000","last_became_active":"2024-04-25T09:11:17.650053+0000","last_became_peered":"2024-04-25T09:11:17.650053+0000","last_unstale":"2024-04-25T09:11:19.352570+0000","last_undegraded":"2024-04-25T09:11:19.352570+0000","last_fullsized":"2024-04-25T09:11:19.352570+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.402283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851741+0000","last_change":"2024-04-25T09:11:16.637604+0000","last_active":"2024-04-25T09:11:18.851741+0000","last_peered":"2024-04-25T09:11:18.851741+0000","last_clean":"2024-04-25T09:11:18.851741+0000","last_became_active":"2024-04-25T09:11:16.636527+0000","last_became_peered":"2024-04-25T09:11:16.636527+0000","last_unstale":"2024-04-25T09:11:18.851741+0000","last_undegraded":"2024-04-25T09:11:18.851741+0000","last_fullsized":"2024-04-25T09:11:18.851741+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:12.330761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352160+0000","last_change":"2024-04-25T09:11:17.651777+0000","last_active":"2024-04-25T09:11:19.352160+0000","last_peered":"2024-04-25T09:11:19.352160+0000","last_clean":"2024-04-25T09:11:19.352160+0000","last_became_active":"2024-04-25T09:11:17.651460+0000","last_became_peered":"2024-04-25T09:11:17.651460+0000","last_unstale":"2024-04-25T09:11:19.352160+0000","last_undegraded":"2024-04-25T09:11:19.352160+0000","last_fullsized":"2024-04-25T09:11:19.352160+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:54:17.365974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851776+0000","last_change":"2024-04-25T09:11:16.641282+0000","last_active":"2024-04-25T09:11:18.851776+0000","last_peered":"2024-04-25T09:11:18.851776+0000","last_clean":"2024-04-25T09:11:18.851776+0000","last_became_active":"2024-04-25T09:11:16.640755+0000","last_became_peered":"2024-04-25T09:11:16.640755+0000","last_unstale":"2024-04-25T09:11:18.851776+0000","last_undegraded":"2024-04-25T09:11:18.851776+0000","last_fullsized":"2024-04-25T09:11:18.851776+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:19.324255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647688+0000","last_change":"2024-04-25T09:11:17.649737+0000","last_active":"2024-04-25T09:11:18.647688+0000","last_peered":"2024-04-25T09:11:18.647688+0000","last_clean":"2024-04-25T09:11:18.647688+0000","last_became_active":"2024-04-25T09:11:17.648187+0000","last_became_peered":"2024-04-25T09:11:17.648187+0000","last_unstale":"2024-04-25T09:11:18.647688+0000","last_undegraded":"2024-04-25T09:11:18.647688+0000","last_fullsized":"2024-04-25T09:11:18.647688+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:10.034927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"120'1","reported_seq":15,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.353049+0000","last_change":"2024-04-25T09:11:16.636950+0000","last_active":"2024-04-25T09:11:19.353049+0000","last_peered":"2024-04-25T09:11:19.353049+0000","last_clean":"2024-04-25T09:11:19.353049+0000","last_became_active":"2024-04-25T09:11:16.636601+0000","last_became_peered":"2024-04-25T09:11:16.636601+0000","last_unstale":"2024-04-25T09:11:19.353049+0000","last_undegraded":"2024-04-25T09:11:19.353049+0000","last_fullsized":"2024-04-25T09:11:19.353049+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:25:14.573952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648142+0000","last_change":"2024-04-25T09:11:17.643548+0000","last_active":"2024-04-25T09:11:18.648142+0000","last_peered":"2024-04-25T09:11:18.648142+0000","last_clean":"2024-04-25T09:11:18.648142+0000","last_became_active":"2024-04-25T09:11:17.642807+0000","last_became_peered":"2024-04-25T09:11:17.642807+0000","last_unstale":"2024-04-25T09:11:18.648142+0000","last_undegraded":"2024-04-25T09:11:18.648142+0000","last_fullsized":"2024-04-25T09:11:18.648142+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:29:50.320741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"120'2","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352642+0000","last_change":"2024-04-25T09:11:16.632283+0000","last_active":"2024-04-25T09:11:19.352642+0000","last_peered":"2024-04-25T09:11:19.352642+0000","last_clean":"2024-04-25T09:11:19.352642+0000","last_became_active":"2024-04-25T09:11:16.631994+0000","last_became_peered":"2024-04-25T09:11:16.631994+0000","last_unstale":"2024-04-25T09:11:19.352642+0000","last_undegraded":"2024-04-25T09:11:19.352642+0000","last_fullsized":"2024-04-25T09:11:19.352642+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:56:47.069996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.645208+0000","last_change":"2024-04-25T09:11:17.643974+0000","last_active":"2024-04-25T09:11:18.645208+0000","last_peered":"2024-04-25T09:11:18.645208+0000","last_clean":"2024-04-25T09:11:18.645208+0000","last_became_active":"2024-04-25T09:11:17.643118+0000","last_became_peered":"2024-04-25T09:11:17.643118+0000","last_unstale":"2024-04-25T09:11:18.645208+0000","last_undegraded":"2024-04-25T09:11:18.645208+0000","last_fullsized":"2024-04-25T09:11:18.645208+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:19.349973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"120'1","reported_seq":15,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355265+0000","last_change":"2024-04-25T09:11:16.637764+0000","last_active":"2024-04-25T09:11:19.355265+0000","last_peered":"2024-04-25T09:11:19.355265+0000","last_clean":"2024-04-25T09:11:19.355265+0000","last_became_active":"2024-04-25T09:11:16.637383+0000","last_became_peered":"2024-04-25T09:11:16.637383+0000","last_unstale":"2024-04-25T09:11:19.355265+0000","last_undegraded":"2024-04-25T09:11:19.355265+0000","last_fullsized":"2024-04-25T09:11:19.355265+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:55.155884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648739+0000","last_change":"2024-04-25T09:11:17.656460+0000","last_active":"2024-04-25T09:11:18.648739+0000","last_peered":"2024-04-25T09:11:18.648739+0000","last_clean":"2024-04-25T09:11:18.648739+0000","last_became_active":"2024-04-25T09:11:17.656135+0000","last_became_peered":"2024-04-25T09:11:17.656135+0000","last_unstale":"2024-04-25T09:11:18.648739+0000","last_undegraded":"2024-04-25T09:11:18.648739+0000","last_fullsized":"2024-04-25T09:11:18.648739+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:04.975998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355080+0000","last_change":"2024-04-25T09:11:16.640669+0000","last_active":"2024-04-25T09:11:19.355080+0000","last_peered":"2024-04-25T09:11:19.355080+0000","last_clean":"2024-04-25T09:11:19.355080+0000","last_became_active":"2024-04-25T09:11:16.640358+0000","last_became_peered":"2024-04-25T09:11:16.640358+0000","last_unstale":"2024-04-25T09:11:19.355080+0000","last_undegraded":"2024-04-25T09:11:19.355080+0000","last_fullsized":"2024-04-25T09:11:19.355080+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:11:34.345409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644141+0000","last_change":"2024-04-25T09:11:17.642604+0000","last_active":"2024-04-25T09:11:18.644141+0000","last_peered":"2024-04-25T09:11:18.644141+0000","last_clean":"2024-04-25T09:11:18.644141+0000","last_became_active":"2024-04-25T09:11:17.642303+0000","last_became_peered":"2024-04-25T09:11:17.642303+0000","last_unstale":"2024-04-25T09:11:18.644141+0000","last_undegraded":"2024-04-25T09:11:18.644141+0000","last_fullsized":"2024-04-25T09:11:18.644141+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:46:59.148298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"120'2","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644647+0000","last_change":"2024-04-25T09:11:16.634429+0000","last_active":"2024-04-25T09:11:18.644647+0000","last_peered":"2024-04-25T09:11:18.644647+0000","last_clean":"2024-04-25T09:11:18.644647+0000","last_became_active":"2024-04-25T09:11:16.634154+0000","last_became_peered":"2024-04-25T09:11:16.634154+0000","last_unstale":"2024-04-25T09:11:18.644647+0000","last_undegraded":"2024-04-25T09:11:18.644647+0000","last_fullsized":"2024-04-25T09:11:18.644647+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:03:47.631272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851327+0000","last_change":"2024-04-25T09:11:17.644529+0000","last_active":"2024-04-25T09:11:18.851327+0000","last_peered":"2024-04-25T09:11:18.851327+0000","last_clean":"2024-04-25T09:11:18.851327+0000","last_became_active":"2024-04-25T09:11:17.644236+0000","last_became_peered":"2024-04-25T09:11:17.644236+0000","last_unstale":"2024-04-25T09:11:18.851327+0000","last_undegraded":"2024-04-25T09:11:18.851327+0000","last_fullsized":"2024-04-25T09:11:18.851327+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:56:17.132914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354653+0000","last_change":"2024-04-25T09:11:16.636701+0000","last_active":"2024-04-25T09:11:19.354653+0000","last_peered":"2024-04-25T09:11:19.354653+0000","last_clean":"2024-04-25T09:11:19.354653+0000","last_became_active":"2024-04-25T09:11:16.636429+0000","last_became_peered":"2024-04-25T09:11:16.636429+0000","last_unstale":"2024-04-25T09:11:19.354653+0000","last_undegraded":"2024-04-25T09:11:19.354653+0000","last_fullsized":"2024-04-25T09:11:19.354653+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:49:56.425891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851737+0000","last_change":"2024-04-25T09:11:17.653781+0000","last_active":"2024-04-25T09:11:18.851737+0000","last_peered":"2024-04-25T09:11:18.851737+0000","last_clean":"2024-04-25T09:11:18.851737+0000","last_became_active":"2024-04-25T09:11:17.650391+0000","last_became_peered":"2024-04-25T09:11:17.650391+0000","last_unstale":"2024-04-25T09:11:18.851737+0000","last_undegraded":"2024-04-25T09:11:18.851737+0000","last_fullsized":"2024-04-25T09:11:18.851737+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:38.417064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851829+0000","last_change":"2024-04-25T09:11:16.637262+0000","last_active":"2024-04-25T09:11:18.851829+0000","last_peered":"2024-04-25T09:11:18.851829+0000","last_clean":"2024-04-25T09:11:18.851829+0000","last_became_active":"2024-04-25T09:11:16.636992+0000","last_became_peered":"2024-04-25T09:11:16.636992+0000","last_unstale":"2024-04-25T09:11:18.851829+0000","last_undegraded":"2024-04-25T09:11:18.851829+0000","last_fullsized":"2024-04-25T09:11:18.851829+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:11.941093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647677+0000","last_change":"2024-04-25T09:11:17.654559+0000","last_active":"2024-04-25T09:11:18.647677+0000","last_peered":"2024-04-25T09:11:18.647677+0000","last_clean":"2024-04-25T09:11:18.647677+0000","last_became_active":"2024-04-25T09:11:17.653876+0000","last_became_peered":"2024-04-25T09:11:17.653876+0000","last_unstale":"2024-04-25T09:11:18.647677+0000","last_undegraded":"2024-04-25T09:11:18.647677+0000","last_fullsized":"2024-04-25T09:11:18.647677+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:27.402283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354561+0000","last_change":"2024-04-25T09:11:16.629048+0000","last_active":"2024-04-25T09:11:19.354561+0000","last_peered":"2024-04-25T09:11:19.354561+0000","last_clean":"2024-04-25T09:11:19.354561+0000","last_became_active":"2024-04-25T09:11:16.628754+0000","last_became_peered":"2024-04-25T09:11:16.628754+0000","last_unstale":"2024-04-25T09:11:19.354561+0000","last_undegraded":"2024-04-25T09:11:19.354561+0000","last_fullsized":"2024-04-25T09:11:19.354561+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:50:26.400121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.645166+0000","last_change":"2024-04-25T09:11:17.643134+0000","last_active":"2024-04-25T09:11:18.645166+0000","last_peered":"2024-04-25T09:11:18.645166+0000","last_clean":"2024-04-25T09:11:18.645166+0000","last_became_active":"2024-04-25T09:11:17.641950+0000","last_became_peered":"2024-04-25T09:11:17.641950+0000","last_unstale":"2024-04-25T09:11:18.645166+0000","last_undegraded":"2024-04-25T09:11:18.645166+0000","last_fullsized":"2024-04-25T09:11:18.645166+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:35:55.055841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"120'2","reported_seq":16,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.645416+0000","last_change":"2024-04-25T09:11:16.635761+0000","last_active":"2024-04-25T09:11:18.645416+0000","last_peered":"2024-04-25T09:11:18.645416+0000","last_clean":"2024-04-25T09:11:18.645416+0000","last_became_active":"2024-04-25T09:11:16.635503+0000","last_became_peered":"2024-04-25T09:11:16.635503+0000","last_unstale":"2024-04-25T09:11:18.645416+0000","last_undegraded":"2024-04-25T09:11:18.645416+0000","last_fullsized":"2024-04-25T09:11:18.645416+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:35:10.900517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352899+0000","last_change":"2024-04-25T09:11:17.638595+0000","last_active":"2024-04-25T09:11:19.352899+0000","last_peered":"2024-04-25T09:11:19.352899+0000","last_clean":"2024-04-25T09:11:19.352899+0000","last_became_active":"2024-04-25T09:11:17.638272+0000","last_became_peered":"2024-04-25T09:11:17.638272+0000","last_unstale":"2024-04-25T09:11:19.352899+0000","last_undegraded":"2024-04-25T09:11:19.352899+0000","last_fullsized":"2024-04-25T09:11:19.352899+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:15:18.373239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"121'1","reported_seq":15,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.636455+0000","last_change":"2024-04-25T09:11:16.640359+0000","last_active":"2024-04-25T09:11:19.636455+0000","last_peered":"2024-04-25T09:11:19.636455+0000","last_clean":"2024-04-25T09:11:19.636455+0000","last_became_active":"2024-04-25T09:11:16.639572+0000","last_became_peered":"2024-04-25T09:11:16.639572+0000","last_unstale":"2024-04-25T09:11:19.636455+0000","last_undegraded":"2024-04-25T09:11:19.636455+0000","last_fullsized":"2024-04-25T09:11:19.636455+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:51:11.941093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355326+0000","last_change":"2024-04-25T09:11:17.658054+0000","last_active":"2024-04-25T09:11:19.355326+0000","last_peered":"2024-04-25T09:11:19.355326+0000","last_clean":"2024-04-25T09:11:19.355326+0000","last_became_active":"2024-04-25T09:11:17.657359+0000","last_became_peered":"2024-04-25T09:11:17.657359+0000","last_unstale":"2024-04-25T09:11:19.355326+0000","last_undegraded":"2024-04-25T09:11:19.355326+0000","last_fullsized":"2024-04-25T09:11:19.355326+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:47.589856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.848723+0000","last_change":"2024-04-25T09:11:16.633814+0000","last_active":"2024-04-25T09:11:18.848723+0000","last_peered":"2024-04-25T09:11:18.848723+0000","last_clean":"2024-04-25T09:11:18.848723+0000","last_became_active":"2024-04-25T09:11:16.633537+0000","last_became_peered":"2024-04-25T09:11:16.633537+0000","last_unstale":"2024-04-25T09:11:18.848723+0000","last_undegraded":"2024-04-25T09:11:18.848723+0000","last_fullsized":"2024-04-25T09:11:18.848723+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:32:19.324255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352715+0000","last_change":"2024-04-25T09:11:17.657731+0000","last_active":"2024-04-25T09:11:19.352715+0000","last_peered":"2024-04-25T09:11:19.352715+0000","last_clean":"2024-04-25T09:11:19.352715+0000","last_became_active":"2024-04-25T09:11:17.657504+0000","last_became_peered":"2024-04-25T09:11:17.657504+0000","last_unstale":"2024-04-25T09:11:19.352715+0000","last_undegraded":"2024-04-25T09:11:19.352715+0000","last_fullsized":"2024-04-25T09:11:19.352715+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:22:46.445384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.645157+0000","last_change":"2024-04-25T09:11:16.634105+0000","last_active":"2024-04-25T09:11:18.645157+0000","last_peered":"2024-04-25T09:11:18.645157+0000","last_clean":"2024-04-25T09:11:18.645157+0000","last_became_active":"2024-04-25T09:11:16.633821+0000","last_became_peered":"2024-04-25T09:11:16.633821+0000","last_unstale":"2024-04-25T09:11:18.645157+0000","last_undegraded":"2024-04-25T09:11:18.645157+0000","last_fullsized":"2024-04-25T09:11:18.645157+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:56:36.736863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644261+0000","last_change":"2024-04-25T09:11:17.642309+0000","last_active":"2024-04-25T09:11:18.644261+0000","last_peered":"2024-04-25T09:11:18.644261+0000","last_clean":"2024-04-25T09:11:18.644261+0000","last_became_active":"2024-04-25T09:11:17.641980+0000","last_became_peered":"2024-04-25T09:11:17.641980+0000","last_unstale":"2024-04-25T09:11:18.644261+0000","last_undegraded":"2024-04-25T09:11:18.644261+0000","last_fullsized":"2024-04-25T09:11:18.644261+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:09.691229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.648056+0000","last_change":"2024-04-25T09:11:16.644272+0000","last_active":"2024-04-25T09:11:18.648056+0000","last_peered":"2024-04-25T09:11:18.648056+0000","last_clean":"2024-04-25T09:11:18.648056+0000","last_became_active":"2024-04-25T09:11:16.644030+0000","last_became_peered":"2024-04-25T09:11:16.644030+0000","last_unstale":"2024-04-25T09:11:18.648056+0000","last_undegraded":"2024-04-25T09:11:18.648056+0000","last_fullsized":"2024-04-25T09:11:18.648056+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:47:58.760861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851416+0000","last_change":"2024-04-25T09:11:17.648760+0000","last_active":"2024-04-25T09:11:18.851416+0000","last_peered":"2024-04-25T09:11:18.851416+0000","last_clean":"2024-04-25T09:11:18.851416+0000","last_became_active":"2024-04-25T09:11:17.647868+0000","last_became_peered":"2024-04-25T09:11:17.647868+0000","last_unstale":"2024-04-25T09:11:18.851416+0000","last_undegraded":"2024-04-25T09:11:18.851416+0000","last_fullsized":"2024-04-25T09:11:18.851416+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:50.361783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.647870+0000","last_change":"2024-04-25T09:11:16.635628+0000","last_active":"2024-04-25T09:11:18.647870+0000","last_peered":"2024-04-25T09:11:18.647870+0000","last_clean":"2024-04-25T09:11:18.647870+0000","last_became_active":"2024-04-25T09:11:16.635321+0000","last_became_peered":"2024-04-25T09:11:16.635321+0000","last_unstale":"2024-04-25T09:11:18.647870+0000","last_undegraded":"2024-04-25T09:11:18.647870+0000","last_fullsized":"2024-04-25T09:11:18.647870+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:59:55.978106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354643+0000","last_change":"2024-04-25T09:11:17.659209+0000","last_active":"2024-04-25T09:11:19.354643+0000","last_peered":"2024-04-25T09:11:19.354643+0000","last_clean":"2024-04-25T09:11:19.354643+0000","last_became_active":"2024-04-25T09:11:17.658926+0000","last_became_peered":"2024-04-25T09:11:17.658926+0000","last_unstale":"2024-04-25T09:11:19.354643+0000","last_undegraded":"2024-04-25T09:11:19.354643+0000","last_fullsized":"2024-04-25T09:11:19.354643+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:33.517475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.644211+0000","last_change":"2024-04-25T09:11:16.634864+0000","last_active":"2024-04-25T09:11:18.644211+0000","last_peered":"2024-04-25T09:11:18.644211+0000","last_clean":"2024-04-25T09:11:18.644211+0000","last_became_active":"2024-04-25T09:11:16.634574+0000","last_became_peered":"2024-04-25T09:11:16.634574+0000","last_unstale":"2024-04-25T09:11:18.644211+0000","last_undegraded":"2024-04-25T09:11:18.644211+0000","last_fullsized":"2024-04-25T09:11:18.644211+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:28:21.723275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.352849+0000","last_change":"2024-04-25T09:11:17.656296+0000","last_active":"2024-04-25T09:11:19.352849+0000","last_peered":"2024-04-25T09:11:19.352849+0000","last_clean":"2024-04-25T09:11:19.352849+0000","last_became_active":"2024-04-25T09:11:17.655289+0000","last_became_peered":"2024-04-25T09:11:17.655289+0000","last_unstale":"2024-04-25T09:11:19.352849+0000","last_undegraded":"2024-04-25T09:11:19.352849+0000","last_fullsized":"2024-04-25T09:11:19.352849+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:42:01.740852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":14,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354559+0000","last_change":"2024-04-25T09:11:16.626171+0000","last_active":"2024-04-25T09:11:19.354559+0000","last_peered":"2024-04-25T09:11:19.354559+0000","last_clean":"2024-04-25T09:11:19.354559+0000","last_became_active":"2024-04-25T09:11:16.625864+0000","last_became_peered":"2024-04-25T09:11:16.625864+0000","last_unstale":"2024-04-25T09:11:19.354559+0000","last_undegraded":"2024-04-25T09:11:19.354559+0000","last_fullsized":"2024-04-25T09:11:19.354559+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:21:09.032765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":12,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.355121+0000","last_change":"2024-04-25T09:11:17.655864+0000","last_active":"2024-04-25T09:11:19.355121+0000","last_peered":"2024-04-25T09:11:19.355121+0000","last_clean":"2024-04-25T09:11:19.355121+0000","last_became_active":"2024-04-25T09:11:17.655462+0000","last_became_peered":"2024-04-25T09:11:17.655462+0000","last_unstale":"2024-04-25T09:11:19.355121+0000","last_undegraded":"2024-04-25T09:11:19.355121+0000","last_fullsized":"2024-04-25T09:11:19.355121+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:16.607332+0000","last_clean_scrub_stamp":"2024-04-25T09:11:16.607332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:32.802661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"120'8","reported_seq":22,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:18.851334+0000","last_change":"2024-04-25T09:11:16.636176+0000","last_active":"2024-04-25T09:11:18.851334+0000","last_peered":"2024-04-25T09:11:18.851334+0000","last_clean":"2024-04-25T09:11:18.851334+0000","last_became_active":"2024-04-25T09:11:16.635871+0000","last_became_peered":"2024-04-25T09:11:16.635871+0000","last_unstale":"2024-04-25T09:11:18.851334+0000","last_undegraded":"2024-04-25T09:11:18.851334+0000","last_fullsized":"2024-04-25T09:11:18.851334+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:11:15.605170+0000","last_clean_scrub_stamp":"2024-04-25T09:11:15.605170+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:36:11.572138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":359,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-25T09:11:19.354719+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:11:19.354719+0000","last_peered":"2024-04-25T09:11:19.354719+0000","last_clean":"2024-04-25T09:11:19.354719+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:11:19.354719+0000","last_undegraded":"2024-04-25T09:11:19.354719+0000","last_fullsized":"2024-04-25T09:11:19.354719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574972,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33248,"kb_used_data":2068,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338592,"statfs":{"total":96636764160,"available":96602718208,"internally_reserved":0,"allocated":2117632,"data_stored":1296852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574971,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1511424,"data_stored":706290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1515520,"data_stored":705868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574972,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":1484,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":1519616,"data_stored":707320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574972,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32668,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339172,"statfs":{"total":96636764160,"available":96603312128,"internally_reserved":0,"allocated":1523712,"data_stored":707354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574972,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32640,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339200,"statfs":{"total":96636764160,"available":96603340800,"internally_reserved":0,"allocated":1495040,"data_stored":699016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32660,"kb_used_data":1476,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339180,"statfs":{"total":96636764160,"available":96603320320,"internally_reserved":0,"allocated":1511424,"data_stored":705730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574971,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33240,"kb_used_data":2056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338600,"statfs":{"total":96636764160,"available":96602726400,"internally_reserved":0,"allocated":2105344,"data_stored":1296098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:11:22.126 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T09:11:22.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-25T09:11:22.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.322+0000 7f8b5ae00640 1 Processor -- start 2024-04-25T09:11:22.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.322+0000 7f8b5ae00640 1 -- start start 2024-04-25T09:11:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b5ae00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b5409a170 0x7f8b540d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b5ae00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b5415e040 con 0x7f8b5406bf30 2024-04-25T09:11:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b5ae00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b540cff80 con 0x7f8b5415dc60 2024-04-25T09:11:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b5ae00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540d0260 con 0x7f8b5409a170 2024-04-25T09:11:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b58e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8b5406bf30 0x7f8b540cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37832/0 (socket says 172.21.15.59:37832) 2024-04-25T09:11:22.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b58e00640 1 -- 172.21.15.59:0/3725943134 learned_addr learned my addr 172.21.15.59:0/3725943134 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b4b400640 1 --2- 172.21.15.59:0/3725943134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b5409a170 0x7f8b540d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725312389 0 0) 0x7f8b5415e040 con 0x7f8b5406bf30 2024-04-25T09:11:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b38003530 con 0x7f8b5406bf30 2024-04-25T09:11:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1175296916 0 0) 0x7f8b38003530 con 0x7f8b5406bf30 2024-04-25T09:11:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b5409a170 msgr2=0x7f8b540d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 --2- 172.21.15.59:0/3725943134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b5409a170 0x7f8b540d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 >> v1:172.21.15.178:6789/0 conn(0x7f8b5415dc60 legacy=0x7f8b54099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b540d0540 con 0x7f8b5406bf30 2024-04-25T09:11:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f8b4c001a00 con 0x7f8b5406bf30 2024-04-25T09:11:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 >> v1:172.21.15.59:6789/0 conn(0x7f8b5406bf30 legacy=0x7f8b540cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 --2- 172.21.15.59:0/3725943134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b380039f0 0x7f8b38003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 --2- 172.21.15.59:0/3725943134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b5409a170 0x7f8b38004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 --2- 172.21.15.59:0/3725943134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38004d50 0x7f8b380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540d0260 con 0x7f8b38004d50 2024-04-25T09:11:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3800bb00 con 0x7f8b380039f0 2024-04-25T09:11:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3800bd00 con 0x7f8b5409a170 2024-04-25T09:11:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b58e00640 1 --2- 172.21.15.59:0/3725943134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38004d50 0x7f8b380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b4b400640 1 --2- 172.21.15.59:0/3725943134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b5409a170 0x7f8b38004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b53e00640 1 --2- 172.21.15.59:0/3725943134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b380039f0 0x7f8b38003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b58e00640 1 -- 172.21.15.59:0/3725943134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b5409a170 msgr2=0x7f8b38004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b58e00640 1 --2- 172.21.15.59:0/3725943134 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b5409a170 0x7f8b38004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b58e00640 1 -- 172.21.15.59:0/3725943134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b380039f0 msgr2=0x7f8b38003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b58e00640 1 --2- 172.21.15.59:0/3725943134 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b380039f0 0x7f8b38003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.326+0000 7f8b58e00640 1 -- 172.21.15.59:0/3725943134 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38003530 con 0x7f8b38004d50 2024-04-25T09:11:22.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.330+0000 7f8b58e00640 1 --2- 172.21.15.59:0/3725943134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38004d50 0x7f8b380051d0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00a860 tx=0x7f8b4c01fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f4f71acb450289 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:22.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.330+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c00a480 con 0x7f8b38004d50 2024-04-25T09:11:22.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.330+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4c0aa710 con 0x7f8b38004d50 2024-04-25T09:11:22.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.330+0000 7f8b53400640 1 -- 172.21.15.59:0/3725943134 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4c0aab20 con 0x7f8b38004d50 2024-04-25T09:11:22.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.330+0000 7f8b5ae00640 1 -- 172.21.15.59:0/3725943134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38004d50 msgr2=0x7f8b380051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.330+0000 7f8b5ae00640 1 --2- 172.21.15.59:0/3725943134 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38004d50 0x7f8b380051d0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c00a860 tx=0x7f8b4c01fae0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.330+0000 7f8b58e00640 1 -- 172.21.15.59:0/3725943134 reap_dead start 2024-04-25T09:11:22.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.330+0000 7f8b5ae00640 1 -- 172.21.15.59:0/3725943134 shutdown_connections 2024-04-25T09:11:22.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.330+0000 7f8b5ae00640 1 -- 172.21.15.59:0/3725943134 >> 172.21.15.59:0/3725943134 conn(0x7f8b540b3200 msgr2=0x7f8b540b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:22.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.330+0000 7f8b5ae00640 1 -- 172.21.15.59:0/3725943134 shutdown_connections 2024-04-25T09:11:22.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.330+0000 7f8b5ae00640 1 -- 172.21.15.59:0/3725943134 wait complete. 2024-04-25T09:11:22.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b5ae00640 1 Processor -- start 2024-04-25T09:11:22.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b5ae00640 1 -- start start 2024-04-25T09:11:22.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b5ae00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38004d50 0x7f8b5415a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b5ae00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b540b6b80 0x7f8b540b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b5ae00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b54154780 0x7f8b541573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b5ae00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5406cfa0 con 0x7f8b38004d50 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b5ae00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540d0b00 con 0x7f8b54154780 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b5ae00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b540b7360 con 0x7f8b540b6b80 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b53e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38004d50 0x7f8b5415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b53e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38004d50 0x7f8b5415a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53398/0 (socket says 172.21.15.59:53398) 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b53e00640 1 -- 172.21.15.59:0/4106766196 learned_addr learned my addr 172.21.15.59:0/4106766196 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b58e00640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b54154780 0x7f8b541573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b4b400640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b540b6b80 0x7f8b540b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b53e00640 1 -- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b540b6b80 msgr2=0x7f8b540b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b53e00640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b540b6b80 0x7f8b540b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b53e00640 1 -- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b54154780 msgr2=0x7f8b541573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b53e00640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b54154780 0x7f8b541573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b53e00640 1 -- 172.21.15.59:0/4106766196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b540c98d0 con 0x7f8b38004d50 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b53e00640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38004d50 0x7f8b5415a300 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400f820 tx=0x7f8b4400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:22.325 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b50c00640 1 -- 172.21.15.59:0/4106766196 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b440050d0 con 0x7f8b38004d50 2024-04-25T09:11:22.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b50c00640 1 -- 172.21.15.59:0/4106766196 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44018070 con 0x7f8b38004d50 2024-04-25T09:11:22.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b50c00640 1 -- 172.21.15.59:0/4106766196 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4400d6d0 con 0x7f8b38004d50 2024-04-25T09:11:22.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b5ae00640 1 -- 172.21.15.59:0/4106766196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b540c9bb0 con 0x7f8b38004d50 2024-04-25T09:11:22.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b5ae00640 1 -- 172.21.15.59:0/4106766196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b540ca170 con 0x7f8b38004d50 2024-04-25T09:11:22.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.334+0000 7f8b5ae00640 1 -- 172.21.15.59:0/4106766196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b540745d0 con 0x7f8b38004d50 2024-04-25T09:11:22.326 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.338+0000 7f8b50c00640 1 -- 172.21.15.59:0/4106766196 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8b4400d870 con 0x7f8b38004d50 2024-04-25T09:11:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.338+0000 7f8b50c00640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8b30066f90 0x7f8b30069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.338+0000 7f8b50c00640 1 -- 172.21.15.59:0/4106766196 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f8b44085040 con 0x7f8b38004d50 2024-04-25T09:11:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.338+0000 7f8b4b400640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8b30066f90 0x7f8b30069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.338+0000 7f8b4b400640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8b30066f90 0x7f8b30069450 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8b541f6f50 tx=0x7f8b3c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:22.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.342+0000 7f8b50c00640 1 -- 172.21.15.59:0/4106766196 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8b44055e20 con 0x7f8b38004d50 2024-04-25T09:11:22.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.562+0000 7f8b5ae00640 1 -- 172.21.15.59:0/4106766196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f8b5415e040 con 0x7f8b38004d50 2024-04-25T09:11:22.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.566+0000 7f8b50c00640 1 -- 172.21.15.59:0/4106766196 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f8b44055720 con 0x7f8b38004d50 2024-04-25T09:11:22.556 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2024-04-25T09:11:22.556 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCpGypmQhLOCBAA8fDoOQI5X1Rg+IRVCPvTwg== 2024-04-25T09:11:22.556 INFO:teuthology.orchestra.run.smithi059.stdout: caps mds = "allow" 2024-04-25T09:11:22.556 INFO:teuthology.orchestra.run.smithi059.stdout: caps mon = "allow r" 2024-04-25T09:11:22.556 INFO:teuthology.orchestra.run.smithi059.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-25T09:11:22.557 INFO:teuthology.orchestra.run.smithi059.stderr:updated caps for client.0 2024-04-25T09:11:22.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.570+0000 7f8b5ae00640 1 -- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8b30066f90 msgr2=0x7f8b30069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.570+0000 7f8b5ae00640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8b30066f90 0x7f8b30069450 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8b541f6f50 tx=0x7f8b3c008040 comp rx=0 tx=0).stop 2024-04-25T09:11:22.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.570+0000 7f8b5ae00640 1 -- 172.21.15.59:0/4106766196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38004d50 msgr2=0x7f8b5415a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.570+0000 7f8b5ae00640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38004d50 0x7f8b5415a300 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400f820 tx=0x7f8b4400fce0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.570+0000 7f8b5ae00640 1 -- 172.21.15.59:0/4106766196 shutdown_connections 2024-04-25T09:11:22.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.570+0000 7f8b5ae00640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8b30066f90 0x7f8b30069450 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.570+0000 7f8b5ae00640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8b54154780 0x7f8b541573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.570+0000 7f8b5ae00640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8b540b6b80 0x7f8b540b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.570+0000 7f8b5ae00640 1 --2- 172.21.15.59:0/4106766196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b38004d50 0x7f8b5415a300 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.570+0000 7f8b5ae00640 1 -- 172.21.15.59:0/4106766196 >> 172.21.15.59:0/4106766196 conn(0x7f8b540b3200 msgr2=0x7f8b540cd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:22.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.570+0000 7f8b5ae00640 1 -- 172.21.15.59:0/4106766196 shutdown_connections 2024-04-25T09:11:22.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.570+0000 7f8b5ae00640 1 -- 172.21.15.59:0/4106766196 wait complete. 2024-04-25T09:11:22.578 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:22.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe034200640 1 Processor -- start 2024-04-25T09:11:22.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe034200640 1 -- start start 2024-04-25T09:11:22.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe034200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe02c15fe50 0x7fe02c0b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe034200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02c0b20a0 con 0x7fe02c145270 2024-04-25T09:11:22.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe034200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe02c0cc4e0 con 0x7fe02c0b1c90 2024-04-25T09:11:22.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe034200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02c145650 con 0x7fe02c15fe50 2024-04-25T09:11:22.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe031800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe02c145270 0x7fe02c0cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37836/0 (socket says 172.21.15.59:37836) 2024-04-25T09:11:22.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe031800640 1 -- 172.21.15.59:0/1935444774 learned_addr learned my addr 172.21.15.59:0/1935444774 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:22.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe030e00640 1 --2- 172.21.15.59:0/1935444774 >> v2:172.21.15.59:3300/0 conn(0x7fe02c15fe50 0x7fe02c0b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe02be00640 1 -- 172.21.15.59:0/1935444774 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1269360439 0 0) 0x7fe020001120 con 0x7fe02c145270 2024-04-25T09:11:22.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe02be00640 1 -- 172.21.15.59:0/1935444774 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe014003530 con 0x7fe02c145270 2024-04-25T09:11:22.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe030e00640 1 -- 172.21.15.59:0/1935444774 >> v1:172.21.15.178:6789/0 conn(0x7fe02c0b1c90 legacy=0x7fe02c15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:22.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe030e00640 1 -- 172.21.15.59:0/1935444774 >> v1:172.21.15.59:6789/0 conn(0x7fe02c145270 legacy=0x7fe02c0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.730+0000 7fe030e00640 1 -- 172.21.15.59:0/1935444774 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c0ce040 con 0x7fe02c15fe50 2024-04-25T09:11:22.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.734+0000 7fe030e00640 1 --2- 172.21.15.59:0/1935444774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c15fe50 0x7fe02c0b1750 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fe0180097c0 tx=0x7fe01801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898aacffb89f18fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:22.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.734+0000 7fe02be00640 1 -- 172.21.15.59:0/1935444774 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0180b1070 con 0x7fe02c15fe50 2024-04-25T09:11:22.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.734+0000 7fe02be00640 1 -- 172.21.15.59:0/1935444774 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0180ac5f0 con 0x7fe02c15fe50 2024-04-25T09:11:22.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.734+0000 7fe02be00640 1 -- 172.21.15.59:0/1935444774 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0180ac9c0 con 0x7fe02c15fe50 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.734+0000 7fe034200640 1 -- 172.21.15.59:0/1935444774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c15fe50 msgr2=0x7fe02c0b1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.734+0000 7fe034200640 1 --2- 172.21.15.59:0/1935444774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c15fe50 0x7fe02c0b1750 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fe0180097c0 tx=0x7fe01801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.734+0000 7fe034200640 1 -- 172.21.15.59:0/1935444774 shutdown_connections 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.734+0000 7fe034200640 1 --2- 172.21.15.59:0/1935444774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c15fe50 0x7fe02c0b1750 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.734+0000 7fe034200640 1 -- 172.21.15.59:0/1935444774 >> 172.21.15.59:0/1935444774 conn(0x7fe02c066fa0 msgr2=0x7fe02c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.734+0000 7fe034200640 1 -- 172.21.15.59:0/1935444774 shutdown_connections 2024-04-25T09:11:22.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.734+0000 7fe034200640 1 -- 172.21.15.59:0/1935444774 wait complete. 2024-04-25T09:11:22.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe034200640 1 Processor -- start 2024-04-25T09:11:22.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe034200640 1 -- start start 2024-04-25T09:11:22.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe034200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe02c0b1c90 0x7fe02c167000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe034200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe02c145270 0x7fe02c15b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe034200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c15fe50 0x7fe02c1f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe034200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c0cdbe0 con 0x7fe02c15fe50 2024-04-25T09:11:22.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe034200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c15f930 con 0x7fe02c145270 2024-04-25T09:11:22.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe034200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02c0cdd60 con 0x7fe02c0b1c90 2024-04-25T09:11:22.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe032200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c15fe50 0x7fe02c1f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe030e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe02c145270 0x7fe02c15b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe032200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c15fe50 0x7fe02c1f67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53426/0 (socket says 172.21.15.59:53426) 2024-04-25T09:11:22.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe031800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe02c0b1c90 0x7fe02c167000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe032200640 1 -- 172.21.15.59:0/1058516274 learned_addr learned my addr 172.21.15.59:0/1058516274 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:22.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe032200640 1 -- 172.21.15.59:0/1058516274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe02c0b1c90 msgr2=0x7fe02c167000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe032200640 1 --2- 172.21.15.59:0/1058516274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe02c0b1c90 0x7fe02c167000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe032200640 1 -- 172.21.15.59:0/1058516274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe02c145270 msgr2=0x7fe02c15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe032200640 1 --2- 172.21.15.59:0/1058516274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe02c145270 0x7fe02c15b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe032200640 1 -- 172.21.15.59:0/1058516274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c15b780 con 0x7fe02c15fe50 2024-04-25T09:11:22.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe032200640 1 --2- 172.21.15.59:0/1058516274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c15fe50 0x7fe02c1f67c0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fe02400c7a0 tx=0x7fe02400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:22.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe029600640 1 -- 172.21.15.59:0/1058516274 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe024003b80 con 0x7fe02c15fe50 2024-04-25T09:11:22.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe029600640 1 -- 172.21.15.59:0/1058516274 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe024003d20 con 0x7fe02c15fe50 2024-04-25T09:11:22.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe029600640 1 -- 172.21.15.59:0/1058516274 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02400aa90 con 0x7fe02c15fe50 2024-04-25T09:11:22.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe034200640 1 -- 172.21.15.59:0/1058516274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe02c1628b0 con 0x7fe02c15fe50 2024-04-25T09:11:22.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.738+0000 7fe034200640 1 -- 172.21.15.59:0/1058516274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe02c162e70 con 0x7fe02c15fe50 2024-04-25T09:11:22.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.742+0000 7fe034200640 1 -- 172.21.15.59:0/1058516274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe02c0745d0 con 0x7fe02c15fe50 2024-04-25T09:11:22.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.742+0000 7fe029600640 1 -- 172.21.15.59:0/1058516274 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe02400ac30 con 0x7fe02c15fe50 2024-04-25T09:11:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.742+0000 7fe029600640 1 --2- 172.21.15.59:0/1058516274 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe00c066f60 0x7fe00c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.742+0000 7fe029600640 1 -- 172.21.15.59:0/1058516274 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fe024084fa0 con 0x7fe02c15fe50 2024-04-25T09:11:22.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.742+0000 7fe031800640 1 --2- 172.21.15.59:0/1058516274 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe00c066f60 0x7fe00c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:22.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.742+0000 7fe031800640 1 --2- 172.21.15.59:0/1058516274 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe00c066f60 0x7fe00c069420 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe0200012c0 tx=0x7fe020007b80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:22.736 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.746+0000 7fe029600640 1 -- 172.21.15.59:0/1058516274 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe0240557d0 con 0x7fe02c15fe50 2024-04-25T09:11:22.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.942+0000 7fe034200640 1 -- 172.21.15.59:0/1058516274 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe02c06b8e0 con 0x7fe02c15fe50 2024-04-25T09:11:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe029600640 1 -- 172.21.15.59:0/1058516274 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4937 (secure 0 0 0) 0x7fe024059870 con 0x7fe02c15fe50 2024-04-25T09:11:22.934 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:22.934 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":104,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":8955,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/1679876837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1679876837},{"type":"v1","addr":"172.21.15.59:6833","nonce":1679876837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:20.044091+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8964":{"gid":8964,"name":"a","rank":0,"incarnation":100,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/29546856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":29546856},{"type":"v1","addr":"172.21.15.59:6835","nonce":29546856}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:22.934 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 104 2024-04-25T09:11:22.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe034200640 1 -- 172.21.15.59:0/1058516274 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe00c066f60 msgr2=0x7fe00c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe034200640 1 --2- 172.21.15.59:0/1058516274 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe00c066f60 0x7fe00c069420 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fe0200012c0 tx=0x7fe020007b80 comp rx=0 tx=0).stop 2024-04-25T09:11:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe034200640 1 -- 172.21.15.59:0/1058516274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c15fe50 msgr2=0x7fe02c1f67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe034200640 1 --2- 172.21.15.59:0/1058516274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c15fe50 0x7fe02c1f67c0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fe02400c7a0 tx=0x7fe02400cc60 comp rx=0 tx=0).stop 2024-04-25T09:11:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe034200640 1 -- 172.21.15.59:0/1058516274 shutdown_connections 2024-04-25T09:11:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe034200640 1 --2- 172.21.15.59:0/1058516274 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe00c066f60 0x7fe00c069420 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe034200640 1 --2- 172.21.15.59:0/1058516274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe02c15fe50 0x7fe02c1f67c0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe034200640 1 --2- 172.21.15.59:0/1058516274 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe02c145270 0x7fe02c15b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe034200640 1 --2- 172.21.15.59:0/1058516274 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe02c0b1c90 0x7fe02c167000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe034200640 1 -- 172.21.15.59:0/1058516274 >> 172.21.15.59:0/1058516274 conn(0x7fe02c066fa0 msgr2=0x7fe02c15e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe034200640 1 -- 172.21.15.59:0/1058516274 shutdown_connections 2024-04-25T09:11:22.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:22.946+0000 7fe034200640 1 -- 172.21.15.59:0/1058516274 wait complete. 2024-04-25T09:11:23.359 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 104, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:11:17.015550+0000', 'modified': '2024-04-25T09:11:20.044091+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8964}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8964': {'gid': 8964, 'name': 'a', 'rank': 0, 'incarnation': 100, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/29546856', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6834', 'nonce': 29546856}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 29546856}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:11:23.359 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:11:23.359 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T09:11:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.514+0000 7ff882200640 1 Processor -- start 2024-04-25T09:11:23.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.514+0000 7ff882200640 1 -- start start 2024-04-25T09:11:23.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.514+0000 7ff882200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff87c15eb50 0x7ff87c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.514+0000 7ff882200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ff87c071270 0x7ff87c0716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.514+0000 7ff882200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff87c15efe0 con 0x7ff87c15e770 2024-04-25T09:11:23.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.514+0000 7ff882200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87c071be0 con 0x7ff87c15eb50 2024-04-25T09:11:23.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.514+0000 7ff882200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff87c06db20 con 0x7ff87c071270 2024-04-25T09:11:23.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.514+0000 7ff873e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff87c15eb50 0x7ff87c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.514+0000 7ff87b400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ff87c15e770 0x7ff87c06d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37850/0 (socket says 172.21.15.59:37850) 2024-04-25T09:11:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.514+0000 7ff87b400640 1 -- 172.21.15.59:0/2995273788 learned_addr learned my addr 172.21.15.59:0/2995273788 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:23.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff87be00640 1 --2- 172.21.15.59:0/2995273788 >> v2:172.21.15.178:3300/0 conn(0x7ff87c071270 0x7ff87c0716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff873e00640 1 -- 172.21.15.59:0/2995273788 >> v2:172.21.15.178:3300/0 conn(0x7ff87c071270 msgr2=0x7ff87c0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff873e00640 1 --2- 172.21.15.59:0/2995273788 >> v2:172.21.15.178:3300/0 conn(0x7ff87c071270 0x7ff87c0716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff873e00640 1 -- 172.21.15.59:0/2995273788 >> v1:172.21.15.59:6789/0 conn(0x7ff87c15e770 legacy=0x7ff87c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff873e00640 1 -- 172.21.15.59:0/2995273788 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c06de00 con 0x7ff87c15eb50 2024-04-25T09:11:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff87be00640 1 --2- 172.21.15.59:0/2995273788 >> v2:172.21.15.178:3300/0 conn(0x7ff87c071270 0x7ff87c0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:23.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff87aa00640 1 -- 172.21.15.59:0/2995273788 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3260854087 0 0) 0x7ff87c15efe0 con 0x7ff87c15e770 2024-04-25T09:11:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff873e00640 1 --2- 172.21.15.59:0/2995273788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87c15eb50 0x7ff87c15f230 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7ff87c162700 tx=0x7ff86401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87d6d364327e3cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff87aa00640 1 -- 172.21.15.59:0/2995273788 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640ab5f0 con 0x7ff87c15eb50 2024-04-25T09:11:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff87aa00640 1 -- 172.21.15.59:0/2995273788 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8640b0070 con 0x7ff87c15eb50 2024-04-25T09:11:23.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff87aa00640 1 -- 172.21.15.59:0/2995273788 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640ab9b0 con 0x7ff87c15eb50 2024-04-25T09:11:23.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff882200640 1 -- 172.21.15.59:0/2995273788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87c15eb50 msgr2=0x7ff87c15f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff882200640 1 --2- 172.21.15.59:0/2995273788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87c15eb50 0x7ff87c15f230 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7ff87c162700 tx=0x7ff86401c3f0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff882200640 1 -- 172.21.15.59:0/2995273788 shutdown_connections 2024-04-25T09:11:23.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff882200640 1 --2- 172.21.15.59:0/2995273788 >> v2:172.21.15.178:3300/0 conn(0x7ff87c071270 0x7ff87c0716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff882200640 1 --2- 172.21.15.59:0/2995273788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87c15eb50 0x7ff87c15f230 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.518+0000 7ff882200640 1 -- 172.21.15.59:0/2995273788 >> 172.21.15.59:0/2995273788 conn(0x7ff87c067080 msgr2=0x7ff87c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff882200640 1 -- 172.21.15.59:0/2995273788 shutdown_connections 2024-04-25T09:11:23.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff882200640 1 -- 172.21.15.59:0/2995273788 wait complete. 2024-04-25T09:11:23.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff882200640 1 Processor -- start 2024-04-25T09:11:23.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff882200640 1 -- start start 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff882200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff87c071270 0x7ff87c0b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff882200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff87c15e770 0x7ff87c14f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff882200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87c15eb50 0x7ff87c15bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff882200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c0aed70 con 0x7ff87c15eb50 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff882200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c15f770 con 0x7ff87c15e770 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff882200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c0aeef0 con 0x7ff87c071270 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff87be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87c15eb50 0x7ff87c15bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff87be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87c15eb50 0x7ff87c15bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53440/0 (socket says 172.21.15.59:53440) 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff87be00640 1 -- 172.21.15.59:0/762013957 learned_addr learned my addr 172.21.15.59:0/762013957 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff87be00640 1 -- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff87c071270 msgr2=0x7ff87c0b38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff87b400640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff87c071270 0x7ff87c0b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff873e00640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff87c15e770 0x7ff87c14f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff87be00640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff87c071270 0x7ff87c0b38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff87be00640 1 -- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff87c15e770 msgr2=0x7ff87c14f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff87be00640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff87c15e770 0x7ff87c14f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff87be00640 1 -- 172.21.15.59:0/762013957 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c14dca0 con 0x7ff87c15eb50 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff873e00640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff87c15e770 0x7ff87c14f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff87b400640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff87c071270 0x7ff87c0b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff87be00640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87c15eb50 0x7ff87c15bc90 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7ff87400cd50 tx=0x7ff87400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.522+0000 7ff873400640 1 -- 172.21.15.59:0/762013957 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87400f680 con 0x7ff87c15eb50 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.526+0000 7ff873400640 1 -- 172.21.15.59:0/762013957 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87400f840 con 0x7ff87c15eb50 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.526+0000 7ff882200640 1 -- 172.21.15.59:0/762013957 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff87c150560 con 0x7ff87c15eb50 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.526+0000 7ff873400640 1 -- 172.21.15.59:0/762013957 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87400fc30 con 0x7ff87c15eb50 2024-04-25T09:11:23.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.526+0000 7ff882200640 1 -- 172.21.15.59:0/762013957 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff87c14a670 con 0x7ff87c15eb50 2024-04-25T09:11:23.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.526+0000 7ff873400640 1 -- 172.21.15.59:0/762013957 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff8740213f0 con 0x7ff87c15eb50 2024-04-25T09:11:23.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.526+0000 7ff873400640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff858066f60 0x7ff858069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.526+0000 7ff873400640 1 -- 172.21.15.59:0/762013957 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff874085ff0 con 0x7ff87c15eb50 2024-04-25T09:11:23.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.526+0000 7ff88569d000 1 Processor -- start 2024-04-25T09:11:23.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.526+0000 7ff88569d000 1 -- start start 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.526+0000 7ff87b400640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff858066f60 0x7ff858069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8c920 0x557b42e8cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8d240 0x557b42e429f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e42f30 0x557b42e43310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b42d2a5f0 con 0x557b42e8c920 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b42c91da0 con 0x557b42e42f30 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b42c1a150 con 0x557b42e8d240 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff87b400640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff858066f60 0x7ff858069420 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff86c007fd0 tx=0x7ff86c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff87b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8c920 0x557b42e8cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff87b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8c920 0x557b42e8cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53444/0 (socket says 172.21.15.59:53444) 2024-04-25T09:11:23.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff87b400640 1 -- 172.21.15.59:0/3354096037 learned_addr learned my addr 172.21.15.59:0/3354096037 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:23.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff87be00640 1 --2- 172.21.15.59:0/3354096037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e42f30 0x557b42e43310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff873e00640 1 --2- 172.21.15.59:0/3354096037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8d240 0x557b42e429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff87b400640 1 -- 172.21.15.59:0/3354096037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8d240 msgr2=0x557b42e429f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff87b400640 1 --2- 172.21.15.59:0/3354096037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8d240 0x557b42e429f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff87b400640 1 -- 172.21.15.59:0/3354096037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e42f30 msgr2=0x557b42e43310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff87b400640 1 --2- 172.21.15.59:0/3354096037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e42f30 0x557b42e43310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff87b400640 1 -- 172.21.15.59:0/3354096037 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b42c33ca0 con 0x557b42e8c920 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff87b400640 1 --2- 172.21.15.59:0/3354096037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8c920 0x557b42e8cd00 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7ff86c007360 tx=0x7ff86c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9421853e78e1e30e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff86be00640 1 -- 172.21.15.59:0/3354096037 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c00d9a0 con 0x557b42e8c920 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff86be00640 1 -- 172.21.15.59:0/3354096037 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c00db40 con 0x557b42e8c920 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff86be00640 1 -- 172.21.15.59:0/3354096037 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c020450 con 0x557b42e8c920 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 -- 172.21.15.59:0/3354096037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8c920 msgr2=0x557b42e8cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 --2- 172.21.15.59:0/3354096037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8c920 0x557b42e8cd00 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7ff86c007360 tx=0x7ff86c010000 comp rx=0 tx=0).stop 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 -- 172.21.15.59:0/3354096037 shutdown_connections 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 --2- 172.21.15.59:0/3354096037 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e42f30 0x557b42e43310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 --2- 172.21.15.59:0/3354096037 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8d240 0x557b42e429f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 --2- 172.21.15.59:0/3354096037 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8c920 0x557b42e8cd00 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 -- 172.21.15.59:0/3354096037 >> 172.21.15.59:0/3354096037 conn(0x557b42e492a0 msgr2=0x557b42e412d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 -- 172.21.15.59:0/3354096037 shutdown_connections 2024-04-25T09:11:23.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 -- 172.21.15.59:0/3354096037 wait complete. 2024-04-25T09:11:23.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 -- start start 2024-04-25T09:11:23.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.530+0000 7ff88569d000 1 Processor -- start 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e42f30 0x557b42e93d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8c920 0x557b42e942a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e8d240 0x557b42e46aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b42c4c990 con 0x557b42e42f30 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b42c8de40 con 0x557b42e8d240 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b42c1d900 con 0x557b42e8c920 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 10 client.0 _ll_register_callbacks cb 0x557b42d451c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff87b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e42f30 0x557b42e93d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff87b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e42f30 0x557b42e93d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53452/0 (socket says 172.21.15.59:53452) 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff87b400640 1 -- 172.21.15.59:0/904588474 learned_addr learned my addr 172.21.15.59:0/904588474 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff873e00640 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8c920 0x557b42e942a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff87be00640 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e8d240 0x557b42e46aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff87b400640 1 -- 172.21.15.59:0/904588474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8c920 msgr2=0x557b42e942a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff87b400640 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8c920 0x557b42e942a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff87b400640 1 -- 172.21.15.59:0/904588474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e8d240 msgr2=0x557b42e46aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff87b400640 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e8d240 0x557b42e46aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff87b400640 1 -- 172.21.15.59:0/904588474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b42c4a630 con 0x557b42e42f30 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff87b400640 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e42f30 0x557b42e93d60 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7ff86c005fd0 tx=0x7ff86c007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3da593778c53cb39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff868c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff868c00640 1 -- 172.21.15.59:0/904588474 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c020920 con 0x557b42e42f30 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff868c00640 1 -- 172.21.15.59:0/904588474 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff86c020ac0 con 0x557b42e42f30 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 -- 172.21.15.59:0/904588474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff86c00db40 con 0x557b42e42f30 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff868c00640 1 -- 172.21.15.59:0/904588474 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff86c034050 con 0x557b42e42f30 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 10 client.9102 fetch_fsmap learned FSMap version 104 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 -- 172.21.15.59:0/904588474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x557b42c1a3a0 con 0x557b42e42f30 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff868c00640 1 -- 172.21.15.59:0/904588474 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c00db40 con 0x557b42e42f30 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff868c00640 1 -- 172.21.15.59:0/904588474 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 104) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff86c037020 con 0x557b42e42f30 2024-04-25T09:11:23.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 10 client.9102 fetch_fsmap finished waiting for FSMap version 104 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 10 client.9102 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 20 client.9102 populate_metadata read hostname 'smithi059' 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x557b42e48160 0x557b42e9ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 4 client.9102 mds_command: new command op to 8964 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 -- 172.21.15.59:0/904588474 --> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b42c2da50 con 0x557b42e48160 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff873e00640 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x557b42e48160 0x557b42e9ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff868c00640 10 client.9102 ms_handle_connect on v2:172.21.15.59:6834/29546856 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff873e00640 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x557b42e48160 0x557b42e9ddc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31ce0948d44fc07d server_cookie=eaabc87fbd44f634 in_seq=0 out_seq=0 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff868c00640 1 -- 172.21.15.59:0/904588474 <== mds.0 v2:172.21.15.59:6834/29546856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557b42c2da50 con 0x557b42e48160 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff868c00640 10 client.9102 handle_command_reply: tid=0 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 client.9102 shutdown 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 -- 172.21.15.59:0/904588474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e42f30 msgr2=0x557b42e93d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e42f30 0x557b42e93d60 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7ff86c005fd0 tx=0x7ff86c007000 comp rx=0 tx=0).stop 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 -- 172.21.15.59:0/904588474 shutdown_connections 2024-04-25T09:11:23.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x557b42e48160 0x557b42e9ddc0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e8d240 0x557b42e46aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8c920 0x557b42e942a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff868c00640 0 client.9102 ms_handle_reset on v2:172.21.15.59:6834/29546856 2024-04-25T09:11:23.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 --2- 172.21.15.59:0/904588474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e42f30 0x557b42e93d60 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.534+0000 7ff88569d000 1 -- 172.21.15.59:0/904588474 >> 172.21.15.59:0/904588474 conn(0x557b42e492a0 msgr2=0x557b42e419e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.538+0000 7ff88569d000 1 -- 172.21.15.59:0/904588474 shutdown_connections 2024-04-25T09:11:23.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.538+0000 7ff88569d000 1 -- 172.21.15.59:0/904588474 wait complete. 2024-04-25T09:11:23.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.538+0000 7ff88569d000 20 client.9102 trim_cache size 0 max 16384 2024-04-25T09:11:23.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.550+0000 7ff88569d000 1 Processor -- start 2024-04-25T09:11:23.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.550+0000 7ff88569d000 1 -- start start 2024-04-25T09:11:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e42f30 0x557b42e462c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8c920 0x557b42e46800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 0x557b42e95990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c202220 con 0x557b42e8d240 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c151fc0 con 0x557b42e42f30 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87c201c50 con 0x557b42e8c920 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff87be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 0x557b42e95990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff87be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 0x557b42e95990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53456/0 (socket says 172.21.15.59:53456) 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff87be00640 1 -- 172.21.15.59:0/3316429962 learned_addr learned my addr 172.21.15.59:0/3316429962 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff87b400640 1 --2- 172.21.15.59:0/3316429962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e42f30 0x557b42e462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff873e00640 1 --2- 172.21.15.59:0/3316429962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8c920 0x557b42e46800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff87be00640 1 -- 172.21.15.59:0/3316429962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8c920 msgr2=0x557b42e46800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff87be00640 1 --2- 172.21.15.59:0/3316429962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8c920 0x557b42e46800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff87be00640 1 -- 172.21.15.59:0/3316429962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e42f30 msgr2=0x557b42e462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff87be00640 1 --2- 172.21.15.59:0/3316429962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e42f30 0x557b42e462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.545 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff87be00640 1 -- 172.21.15.59:0/3316429962 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b42e8d070 con 0x557b42e8d240 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff87b400640 1 --2- 172.21.15.59:0/3316429962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e42f30 0x557b42e462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff873e00640 1 --2- 172.21.15.59:0/3316429962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8c920 0x557b42e46800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff87be00640 1 --2- 172.21.15.59:0/3316429962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 0x557b42e95990 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7ff874056680 tx=0x7ff8740841e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d18086e55700a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff86b400640 1 -- 172.21.15.59:0/3316429962 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874082070 con 0x557b42e8d240 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff86b400640 1 -- 172.21.15.59:0/3316429962 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff874054790 con 0x557b42e8d240 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff86b400640 1 -- 172.21.15.59:0/3316429962 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8740549f0 con 0x557b42e8d240 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 -- 172.21.15.59:0/3316429962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 msgr2=0x557b42e95990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 --2- 172.21.15.59:0/3316429962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 0x557b42e95990 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7ff874056680 tx=0x7ff8740841e0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 -- 172.21.15.59:0/3316429962 shutdown_connections 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 --2- 172.21.15.59:0/3316429962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 0x557b42e95990 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 --2- 172.21.15.59:0/3316429962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e8c920 0x557b42e46800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 --2- 172.21.15.59:0/3316429962 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e42f30 0x557b42e462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 -- 172.21.15.59:0/3316429962 >> 172.21.15.59:0/3316429962 conn(0x557b42e492a0 msgr2=0x557b42e45bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 -- 172.21.15.59:0/3316429962 shutdown_connections 2024-04-25T09:11:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 -- 172.21.15.59:0/3316429962 wait complete. 2024-04-25T09:11:23.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 -- start start 2024-04-25T09:11:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.554+0000 7ff88569d000 1 Processor -- start 2024-04-25T09:11:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e42f30 0x557b42e98f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e8c920 0x557b42ed1310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 0x557b42ed1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b42c963d0 con 0x557b42e8d240 2024-04-25T09:11:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b42d4dd50 con 0x557b42e8c920 2024-04-25T09:11:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b42c2c980 con 0x557b42e42f30 2024-04-25T09:11:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 10 client.0 _ll_register_callbacks cb 0x7ff86c001440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff87be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 0x557b42ed1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff87be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 0x557b42ed1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53460/0 (socket says 172.21.15.59:53460) 2024-04-25T09:11:23.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff87be00640 1 -- 172.21.15.59:0/994416271 learned_addr learned my addr 172.21.15.59:0/994416271 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff87b400640 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e42f30 0x557b42e98f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff873e00640 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e8c920 0x557b42ed1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff87be00640 1 -- 172.21.15.59:0/994416271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e42f30 msgr2=0x557b42e98f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff87be00640 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e42f30 0x557b42e98f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff87be00640 1 -- 172.21.15.59:0/994416271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e8c920 msgr2=0x557b42ed1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff87be00640 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e8c920 0x557b42ed1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff87be00640 1 -- 172.21.15.59:0/994416271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b42d13600 con 0x557b42e8d240 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff873e00640 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e8c920 0x557b42ed1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff87be00640 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 0x557b42ed1850 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7ff87405aa00 tx=0x7ff87401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11e2808a136aed3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff868c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff868c00640 1 -- 172.21.15.59:0/994416271 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874072020 con 0x557b42e8d240 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 -- 172.21.15.59:0/994416271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff874054790 con 0x557b42e8d240 2024-04-25T09:11:23.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff868c00640 1 -- 172.21.15.59:0/994416271 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff87405eb80 con 0x557b42e8d240 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff868c00640 1 -- 172.21.15.59:0/994416271 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff874082030 con 0x557b42e8d240 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 10 client.9108 fetch_fsmap learned FSMap version 104 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 -- 172.21.15.59:0/994416271 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x557b42c269b0 con 0x557b42e8d240 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff868c00640 1 -- 172.21.15.59:0/994416271 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff874054790 con 0x557b42e8d240 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff868c00640 1 -- 172.21.15.59:0/994416271 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 104) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff874074b30 con 0x557b42e8d240 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 10 client.9108 fetch_fsmap finished waiting for FSMap version 104 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 10 client.9108 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 20 client.9108 populate_metadata read hostname 'smithi059' 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x557b42e48e80 0x557b42ed1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 4 client.9108 mds_command: new command op to 8964 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 -- 172.21.15.59:0/994416271 --> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557b42c9f2e0 con 0x557b42e48e80 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff87b400640 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x557b42e48e80 0x557b42ed1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff87b400640 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x557b42e48e80 0x557b42ed1d90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e745c5e48e72e0ea server_cookie=bebae999c7942559 in_seq=0 out_seq=0 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff868c00640 10 client.9108 ms_handle_connect on v2:172.21.15.59:6834/29546856 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff868c00640 1 -- 172.21.15.59:0/994416271 <== mds.0 v2:172.21.15.59:6834/29546856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x557b42c9f2e0 con 0x557b42e48e80 2024-04-25T09:11:23.553 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff868c00640 10 client.9108 handle_command_reply: tid=0 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 client.9108 shutdown 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 -- 172.21.15.59:0/994416271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 msgr2=0x557b42ed1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 0x557b42ed1850 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7ff87405aa00 tx=0x7ff87401c000 comp rx=0 tx=0).stop 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 -- 172.21.15.59:0/994416271 shutdown_connections 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x557b42e48e80 0x557b42ed1d90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557b42e8d240 0x557b42ed1850 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557b42e8c920 0x557b42ed1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 --2- 172.21.15.59:0/994416271 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557b42e42f30 0x557b42e98f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff868c00640 0 client.9108 ms_handle_reset on v2:172.21.15.59:6834/29546856 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 -- 172.21.15.59:0/994416271 >> 172.21.15.59:0/994416271 conn(0x557b42e492a0 msgr2=0x557b42e462c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 -- 172.21.15.59:0/994416271 shutdown_connections 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 1 -- 172.21.15.59:0/994416271 wait complete. 2024-04-25T09:11:23.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.558+0000 7ff88569d000 20 client.9108 trim_cache size 0 max 16384 2024-04-25T09:11:23.555 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:11:23.555 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:11:23.555 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:11:23.555 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8964, 2024-04-25T09:11:23.555 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:11:23.555 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:11:23.555 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:11:23.555 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 5.9407702469999997, 2024-04-25T09:11:23.555 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 104, 2024-04-25T09:11:23.555 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 121, 2024-04-25T09:11:23.555 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 121, 2024-04-25T09:11:23.556 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 10.822467298999999 2024-04-25T09:11:23.556 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:11:23.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.562+0000 7ff882200640 1 -- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff858066f60 msgr2=0x7ff858069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.562+0000 7ff882200640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff858066f60 0x7ff858069420 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff86c007fd0 tx=0x7ff86c009040 comp rx=0 tx=0).stop 2024-04-25T09:11:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.562+0000 7ff882200640 1 -- 172.21.15.59:0/762013957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87c15eb50 msgr2=0x7ff87c15bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.562+0000 7ff882200640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87c15eb50 0x7ff87c15bc90 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7ff87400cd50 tx=0x7ff87400a650 comp rx=0 tx=0).stop 2024-04-25T09:11:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.562+0000 7ff882200640 1 -- 172.21.15.59:0/762013957 shutdown_connections 2024-04-25T09:11:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.562+0000 7ff882200640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff858066f60 0x7ff858069420 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.562+0000 7ff882200640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff87c15eb50 0x7ff87c15bc90 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.562+0000 7ff882200640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff87c15e770 0x7ff87c14f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.562+0000 7ff882200640 1 --2- 172.21.15.59:0/762013957 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff87c071270 0x7ff87c0b38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.562+0000 7ff882200640 1 -- 172.21.15.59:0/762013957 >> 172.21.15.59:0/762013957 conn(0x7ff87c067080 msgr2=0x7ff87c158b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.562+0000 7ff882200640 1 -- 172.21.15.59:0/762013957 shutdown_connections 2024-04-25T09:11:23.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.562+0000 7ff882200640 1 -- 172.21.15.59:0/762013957 wait complete. 2024-04-25T09:11:23.569 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:11:23.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6e6400640 1 Processor -- start 2024-04-25T09:11:23.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6e6400640 1 -- start start 2024-04-25T09:11:23.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6e6400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6e006e980 0x7ff6e00b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6e6400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6e00cee30 0x7ff6e00b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6e6400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e015b240 con 0x7ff6e00cf290 2024-04-25T09:11:23.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6e6400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e00b1e20 con 0x7ff6e00cee30 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6e6400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00ce350 con 0x7ff6e006e980 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6d7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6e00cee30 0x7ff6e00b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6d7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff6e00cee30 0x7ff6e00b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53476/0 (socket says 172.21.15.59:53476) 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6d7e00640 1 -- 172.21.15.59:0/3683771190 learned_addr learned my addr 172.21.15.59:0/3683771190 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6df400640 1 --2- 172.21.15.59:0/3683771190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6e006e980 0x7ff6e00b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6d7e00640 1 -- 172.21.15.59:0/3683771190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6e006e980 msgr2=0x7ff6e00b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.722+0000 7ff6d7e00640 1 --2- 172.21.15.59:0/3683771190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6e006e980 0x7ff6e00b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6d7e00640 1 -- 172.21.15.59:0/3683771190 >> v1:172.21.15.178:6789/0 conn(0x7ff6e00cf290 legacy=0x7ff6e006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:23.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6d7e00640 1 -- 172.21.15.59:0/3683771190 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e00ce630 con 0x7ff6e00cee30 2024-04-25T09:11:23.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6d7e00640 1 --2- 172.21.15.59:0/3683771190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e00cee30 0x7ff6e00b0190 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009870 tx=0x7ff6c801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1f19c5f52f7d69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6dea00640 1 -- 172.21.15.59:0/3683771190 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80b0070 con 0x7ff6e00cee30 2024-04-25T09:11:23.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6dea00640 1 -- 172.21.15.59:0/3683771190 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c80ab600 con 0x7ff6e00cee30 2024-04-25T09:11:23.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6dea00640 1 -- 172.21.15.59:0/3683771190 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80ab9d0 con 0x7ff6e00cee30 2024-04-25T09:11:23.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6e6400640 1 -- 172.21.15.59:0/3683771190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e00cee30 msgr2=0x7ff6e00b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6e6400640 1 --2- 172.21.15.59:0/3683771190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e00cee30 0x7ff6e00b0190 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8009870 tx=0x7ff6c801c460 comp rx=0 tx=0).stop 2024-04-25T09:11:23.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6e6400640 1 -- 172.21.15.59:0/3683771190 shutdown_connections 2024-04-25T09:11:23.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6e6400640 1 --2- 172.21.15.59:0/3683771190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e00cee30 0x7ff6e00b0190 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6e6400640 1 --2- 172.21.15.59:0/3683771190 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6e006e980 0x7ff6e00b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6e6400640 1 -- 172.21.15.59:0/3683771190 >> 172.21.15.59:0/3683771190 conn(0x7ff6e0066fa0 msgr2=0x7ff6e006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6e6400640 1 -- 172.21.15.59:0/3683771190 shutdown_connections 2024-04-25T09:11:23.718 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.726+0000 7ff6e6400640 1 -- 172.21.15.59:0/3683771190 wait complete. 2024-04-25T09:11:23.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6e6400640 1 Processor -- start 2024-04-25T09:11:23.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6e6400640 1 -- start start 2024-04-25T09:11:23.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6e6400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6e006e980 0x7ff6e00b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6e6400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6e00cee30 0x7ff6e0152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6e6400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e00cf290 0x7ff6e0152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6e6400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00cdf70 con 0x7ff6e00cf290 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6e6400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00b0ae0 con 0x7ff6e006e980 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6e6400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e00ce0f0 con 0x7ff6e00cee30 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6dfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e00cf290 0x7ff6e0152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6dfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e00cf290 0x7ff6e0152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53480/0 (socket says 172.21.15.59:53480) 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6dfe00640 1 -- 172.21.15.59:0/4064544956 learned_addr learned my addr 172.21.15.59:0/4064544956 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6df400640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6e006e980 0x7ff6e00b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6d7e00640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6e00cee30 0x7ff6e0152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6dfe00640 1 -- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6e00cee30 msgr2=0x7ff6e0152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6dfe00640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6e00cee30 0x7ff6e0152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6dfe00640 1 -- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6e006e980 msgr2=0x7ff6e00b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6dfe00640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6e006e980 0x7ff6e00b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6dfe00640 1 -- 172.21.15.59:0/4064544956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e01f6f30 con 0x7ff6e00cf290 2024-04-25T09:11:23.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6df400640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6e006e980 0x7ff6e00b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:23.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6dfe00640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e00cf290 0x7ff6e0152690 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c780 tx=0x7ff6d800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6d7400640 1 -- 172.21.15.59:0/4064544956 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8004b70 con 0x7ff6e00cf290 2024-04-25T09:11:23.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6d7400640 1 -- 172.21.15.59:0/4064544956 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d8004d10 con 0x7ff6e00cf290 2024-04-25T09:11:23.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6d7400640 1 -- 172.21.15.59:0/4064544956 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d800aa90 con 0x7ff6e00cf290 2024-04-25T09:11:23.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6e6400640 1 -- 172.21.15.59:0/4064544956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e01680a0 con 0x7ff6e00cf290 2024-04-25T09:11:23.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.730+0000 7ff6e6400640 1 -- 172.21.15.59:0/4064544956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e0159ac0 con 0x7ff6e00cf290 2024-04-25T09:11:23.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.734+0000 7ff6e6400640 1 -- 172.21.15.59:0/4064544956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e00745d0 con 0x7ff6e00cf290 2024-04-25T09:11:23.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.734+0000 7ff6d7400640 1 -- 172.21.15.59:0/4064544956 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ff6d800ac30 con 0x7ff6e00cf290 2024-04-25T09:11:23.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.734+0000 7ff6d7400640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff6bc066f60 0x7ff6bc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:23.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.734+0000 7ff6d7400640 1 -- 172.21.15.59:0/4064544956 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ff6d80854e0 con 0x7ff6e00cf290 2024-04-25T09:11:23.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.734+0000 7ff6df400640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff6bc066f60 0x7ff6bc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:23.725 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.734+0000 7ff6df400640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff6bc066f60 0x7ff6bc069420 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000b9f0 tx=0x7ff6d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:23.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.738+0000 7ff6d7400640 1 -- 172.21.15.59:0/4064544956 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ff6d8020070 con 0x7ff6e00cf290 2024-04-25T09:11:23.857 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:11:23.860 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:11:23.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.934+0000 7ff6e6400640 1 -- 172.21.15.59:0/4064544956 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff6e00aeec0 con 0x7ff6e00cf290 2024-04-25T09:11:23.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6d7400640 1 -- 172.21.15.59:0/4064544956 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff6d80562c0 con 0x7ff6e00cf290 2024-04-25T09:11:23.926 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:11:23.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6e6400640 1 -- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff6bc066f60 msgr2=0x7ff6bc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6e6400640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff6bc066f60 0x7ff6bc069420 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000b9f0 tx=0x7ff6d0008040 comp rx=0 tx=0).stop 2024-04-25T09:11:23.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6e6400640 1 -- 172.21.15.59:0/4064544956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e00cf290 msgr2=0x7ff6e0152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:23.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6e6400640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e00cf290 0x7ff6e0152690 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c780 tx=0x7ff6d800cc40 comp rx=0 tx=0).stop 2024-04-25T09:11:23.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6e6400640 1 -- 172.21.15.59:0/4064544956 shutdown_connections 2024-04-25T09:11:23.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6e6400640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ff6bc066f60 0x7ff6bc069420 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6e6400640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff6e00cf290 0x7ff6e0152690 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6e6400640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ff6e00cee30 0x7ff6e0152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.928 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6e6400640 1 --2- 172.21.15.59:0/4064544956 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ff6e006e980 0x7ff6e00b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:23.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6e6400640 1 -- 172.21.15.59:0/4064544956 >> 172.21.15.59:0/4064544956 conn(0x7ff6e0066fa0 msgr2=0x7ff6e006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:23.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6e6400640 1 -- 172.21.15.59:0/4064544956 shutdown_connections 2024-04-25T09:11:23.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:23.938+0000 7ff6e6400640 1 -- 172.21.15.59:0/4064544956 wait complete. 2024-04-25T09:11:23.947 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:11:23.947 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:11:23.948 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:11:23.948 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:11:23.948 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:23.948 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:11:23.948 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:11:23.948 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:11:23.948 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:23.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:23.948 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:11:23.998 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:11:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:11:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:11:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:11:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:23.998 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:23.998 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:11:23.998 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41884sec preferred_lft 41884sec 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:11:23.999 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:24.000 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:11:24.001 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:11:24.001 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:11:24.001 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:24.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:24.002 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:11:24.063 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:11:24.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:24.065 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:11:24.118 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:11:24.119 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:11:24.119 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:11:24.119 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:11:24.119 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:11:24.119 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:11:24.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:24.119 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:11:24.119 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:11:24.119 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:11:24.119 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:11:24.119 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:11:24.119 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:11:24.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:24.211 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:11:24.220 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:11:24.220 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:11:24.221 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:24.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:24.221 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:11:24.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:11:24.285 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:24.337 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:24.337 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:11:24.337 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:24.393 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:11:24.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:24.393 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:24.488 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:24.488 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:24.488 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:11:24.503 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:24.503 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:24.503 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:11:24.503 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:11:24.503 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:11:24.512 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:24.512 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:24.512 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:11:24.512 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:11:24.512 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:11:24.512 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:11:24.512 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:11:24.512 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:11:24.516 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:11:24.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:24.516 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:24.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:24.536 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:11:24.597 INFO:teuthology.orchestra.run.smithi059.stdout:client7541 2024-04-25T09:11:24.597 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:24.597 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:24.651 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:24.651 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:24.651 DEBUG:teuthology.orchestra.run.smithi059:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T09:11:24.651 DEBUG:teuthology.orchestra.run.smithi059:> parent = os.path.join(mount_point, "parent") 2024-04-25T09:11:24.651 DEBUG:teuthology.orchestra.run.smithi059:> os.mkdir(parent) 2024-04-25T09:11:24.651 DEBUG:teuthology.orchestra.run.smithi059:> flushed = os.path.join(parent, "flushed") 2024-04-25T09:11:24.651 DEBUG:teuthology.orchestra.run.smithi059:> os.mkdir(flushed) 2024-04-25T09:11:24.651 DEBUG:teuthology.orchestra.run.smithi059:> for f in ["alpha", "bravo", "charlie"]: 2024-04-25T09:11:24.652 DEBUG:teuthology.orchestra.run.smithi059:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-04-25T09:11:24.652 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:24.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:24.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:24.778 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:11:24.839 INFO:teuthology.orchestra.run.smithi059.stdout:./ 2024-04-25T09:11:24.840 INFO:teuthology.orchestra.run.smithi059.stdout:./parent 2024-04-25T09:11:24.840 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/flushed 2024-04-25T09:11:24.840 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/flushed/charlie 2024-04-25T09:11:24.840 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/flushed/alpha 2024-04-25T09:11:24.840 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/flushed/bravo 2024-04-25T09:11:24.841 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:24.841 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:24.841 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:24.841 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:24.841 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:11:24.841 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:24.947 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:11:24.949 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:24.956 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:24.956 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:24.956 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:24.956 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:24.956 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T09:11:24.956 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:25.062 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627776 2024-04-25T09:11:25.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:25.072 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:25.072 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:25.072 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:25.072 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:25.072 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T09:11:25.072 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:25.178 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627777 2024-04-25T09:11:25.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:25.188 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:25.188 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:25.188 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:25.188 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:25.188 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T09:11:25.188 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:25.298 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627780 2024-04-25T09:11:25.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:25.308 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:25.308 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:25.308 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:25.308 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:25.308 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T09:11:25.308 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:25.419 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627778 2024-04-25T09:11:25.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:25.428 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:25.428 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:25.428 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:25.428 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:25.428 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-25T09:11:25.428 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:25.539 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627779 2024-04-25T09:11:25.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:25.548 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:25.548 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:25.602 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:25.602 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:25.654 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813e00640 1 Processor -- start 2024-04-25T09:11:25.838 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813e00640 1 -- start start 2024-04-25T09:11:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f981415dcd0 0x7f9814099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98140cd460 0x7f9814099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981406d740 con 0x7f981409a7a0 2024-04-25T09:11:25.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140cbfc0 con 0x7f98140cd460 2024-04-25T09:11:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981406cea0 con 0x7f981415dcd0 2024-04-25T09:11:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98140cd460 0x7f9814099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f98140cd460 0x7f9814099fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53482/0 (socket says 172.21.15.59:53482) 2024-04-25T09:11:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813400640 1 -- 172.21.15.59:0/1249357597 learned_addr learned my addr 172.21.15.59:0/1249357597 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9812a00640 1 --2- 172.21.15.59:0/1249357597 >> v2:172.21.15.178:3300/0 conn(0x7f981415dcd0 0x7f9814099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813400640 1 -- 172.21.15.59:0/1249357597 >> v2:172.21.15.178:3300/0 conn(0x7f981415dcd0 msgr2=0x7f9814099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:25.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813400640 1 --2- 172.21.15.59:0/1249357597 >> v2:172.21.15.178:3300/0 conn(0x7f981415dcd0 0x7f9814099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813400640 1 -- 172.21.15.59:0/1249357597 >> v1:172.21.15.178:6789/0 conn(0x7f981409a7a0 legacy=0x7f98140cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.850+0000 7f9813400640 1 -- 172.21.15.59:0/1249357597 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f981406d180 con 0x7f98140cd460 2024-04-25T09:11:25.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9813400640 1 --2- 172.21.15.59:0/1249357597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98140cd460 0x7f9814099fa0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f9814072750 tx=0x7f980c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226a155a3b97e09d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9811600640 1 -- 172.21.15.59:0/1249357597 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c0a5880 con 0x7f98140cd460 2024-04-25T09:11:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9811600640 1 -- 172.21.15.59:0/1249357597 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c0a5a20 con 0x7f98140cd460 2024-04-25T09:11:25.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9811600640 1 -- 172.21.15.59:0/1249357597 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c0a5df0 con 0x7f98140cd460 2024-04-25T09:11:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9813e00640 1 -- 172.21.15.59:0/1249357597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98140cd460 msgr2=0x7f9814099fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9813e00640 1 --2- 172.21.15.59:0/1249357597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98140cd460 0x7f9814099fa0 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7f9814072750 tx=0x7f980c01c9c0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9813e00640 1 -- 172.21.15.59:0/1249357597 shutdown_connections 2024-04-25T09:11:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9813e00640 1 --2- 172.21.15.59:0/1249357597 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f98140cd460 0x7f9814099fa0 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9813e00640 1 --2- 172.21.15.59:0/1249357597 >> v2:172.21.15.178:3300/0 conn(0x7f981415dcd0 0x7f9814099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9813e00640 1 -- 172.21.15.59:0/1249357597 >> 172.21.15.59:0/1249357597 conn(0x7f98140b3050 msgr2=0x7f98140b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9813e00640 1 -- 172.21.15.59:0/1249357597 shutdown_connections 2024-04-25T09:11:25.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9813e00640 1 -- 172.21.15.59:0/1249357597 wait complete. 2024-04-25T09:11:25.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9813e00640 1 Processor -- start 2024-04-25T09:11:25.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.854+0000 7f9813e00640 1 -- start start 2024-04-25T09:11:25.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f981409a7a0 0x7f98140cafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98140cd460 0x7f981415e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981415dcd0 0x7f981415e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981416aa20 con 0x7f981415dcd0 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981416a8a0 con 0x7f98140cd460 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981416aba0 con 0x7f981409a7a0 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981415dcd0 0x7f981415e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981415dcd0 0x7f981415e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53486/0 (socket says 172.21.15.59:53486) 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813400640 1 -- 172.21.15.59:0/919255645 learned_addr learned my addr 172.21.15.59:0/919255645 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9812000640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98140cd460 0x7f981415e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9812a00640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f981409a7a0 0x7f98140cafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813400640 1 -- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f981409a7a0 msgr2=0x7f98140cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813400640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f981409a7a0 0x7f98140cafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813400640 1 -- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98140cd460 msgr2=0x7f981415e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813400640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98140cd460 0x7f981415e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813400640 1 -- 172.21.15.59:0/919255645 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140ca7f0 con 0x7f981415dcd0 2024-04-25T09:11:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813400640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981415dcd0 0x7f981415e890 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f980c0af040 tx=0x7f980c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f980aa00640 1 -- 172.21.15.59:0/919255645 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c0b8670 con 0x7f981415dcd0 2024-04-25T09:11:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f980aa00640 1 -- 172.21.15.59:0/919255645 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c0be070 con 0x7f981415dcd0 2024-04-25T09:11:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f980aa00640 1 -- 172.21.15.59:0/919255645 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c0b8a90 con 0x7f981415dcd0 2024-04-25T09:11:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813e00640 1 -- 172.21.15.59:0/919255645 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98140b5680 con 0x7f981415dcd0 2024-04-25T09:11:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813e00640 1 -- 172.21.15.59:0/919255645 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98140cb4f0 con 0x7f981415dcd0 2024-04-25T09:11:25.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.858+0000 7f9813e00640 1 -- 172.21.15.59:0/919255645 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981404efa0 con 0x7f981415dcd0 2024-04-25T09:11:25.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.862+0000 7f980aa00640 1 -- 172.21.15.59:0/919255645 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f980c0b8c30 con 0x7f981415dcd0 2024-04-25T09:11:25.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.862+0000 7f980aa00640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f97f4066f60 0x7f97f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:25.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.862+0000 7f980aa00640 1 -- 172.21.15.59:0/919255645 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f980c120430 con 0x7f981415dcd0 2024-04-25T09:11:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.862+0000 7f9812a00640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f97f4066f60 0x7f97f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:25.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.862+0000 7f9812a00640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f97f4066f60 0x7f97f4069420 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f98040079c0 tx=0x7f9804008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:25.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:25.866+0000 7f980aa00640 1 -- 172.21.15.59:0/919255645 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f980c0165e0 con 0x7f981415dcd0 2024-04-25T09:11:26.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.026+0000 7f9813e00640 1 -- 172.21.15.59:0/919255645 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98140d0470 con 0x7f981415dcd0 2024-04-25T09:11:26.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.026+0000 7f980aa00640 1 -- 172.21.15.59:0/919255645 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+16952 (secure 0 0 0) 0x7f980c0f0ce0 con 0x7f981415dcd0 2024-04-25T09:11:26.017 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:26.017 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":121,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:18.636323+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:15.429862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:16.011038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.030+0000 7f9813e00640 1 -- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f97f4066f60 msgr2=0x7f97f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.030+0000 7f9813e00640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f97f4066f60 0x7f97f4069420 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f98040079c0 tx=0x7f9804008040 comp rx=0 tx=0).stop 2024-04-25T09:11:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.030+0000 7f9813e00640 1 -- 172.21.15.59:0/919255645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981415dcd0 msgr2=0x7f981415e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.030+0000 7f9813e00640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981415dcd0 0x7f981415e890 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f980c0af040 tx=0x7f980c019760 comp rx=0 tx=0).stop 2024-04-25T09:11:26.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.030+0000 7f9813e00640 1 -- 172.21.15.59:0/919255645 shutdown_connections 2024-04-25T09:11:26.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.030+0000 7f9813e00640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f97f4066f60 0x7f97f4069420 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.030+0000 7f9813e00640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f981415dcd0 0x7f981415e890 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.030+0000 7f9813e00640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f98140cd460 0x7f981415e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.030+0000 7f9813e00640 1 --2- 172.21.15.59:0/919255645 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f981409a7a0 0x7f98140cafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.030+0000 7f9813e00640 1 -- 172.21.15.59:0/919255645 >> 172.21.15.59:0/919255645 conn(0x7f98140b3050 msgr2=0x7f98140ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.030+0000 7f9813e00640 1 -- 172.21.15.59:0/919255645 shutdown_connections 2024-04-25T09:11:26.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.030+0000 7f9813e00640 1 -- 172.21.15.59:0/919255645 wait complete. 2024-04-25T09:11:26.039 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:11:15.429862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:11:16.011038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:26.039 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:26.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbbe200640 1 Processor -- start 2024-04-25T09:11:26.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbbe200640 1 -- start start 2024-04-25T09:11:26.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbbe200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbb8144120 0x7fbbb815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbbe200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fbbb80ccbf0 0x7fbbb815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbbe200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb815bc40 con 0x7fbbb815ee60 2024-04-25T09:11:26.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbbe200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb815e490 con 0x7fbbb8144120 2024-04-25T09:11:26.185 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbbe200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb815b3a0 con 0x7fbbb80ccbf0 2024-04-25T09:11:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbb7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbb8144120 0x7fbbb815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbb7e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbbb815ee60 0x7fbbb80b3090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37862/0 (socket says 172.21.15.59:37862) 2024-04-25T09:11:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbb7e00640 1 -- 172.21.15.59:0/4277830729 learned_addr learned my addr 172.21.15.59:0/4277830729 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbaea00640 1 --2- 172.21.15.59:0/4277830729 >> v2:172.21.15.178:3300/0 conn(0x7fbbb80ccbf0 0x7fbbb815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbb7400640 1 -- 172.21.15.59:0/4277830729 >> v2:172.21.15.178:3300/0 conn(0x7fbbb80ccbf0 msgr2=0x7fbbb815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbb7400640 1 --2- 172.21.15.59:0/4277830729 >> v2:172.21.15.178:3300/0 conn(0x7fbbb80ccbf0 0x7fbbb815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbb7400640 1 -- 172.21.15.59:0/4277830729 >> v1:172.21.15.59:6789/0 conn(0x7fbbb815ee60 legacy=0x7fbbb80b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.186 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.194+0000 7fbbb7400640 1 -- 172.21.15.59:0/4277830729 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb815b680 con 0x7fbbb8144120 2024-04-25T09:11:26.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.198+0000 7fbbb7400640 1 --2- 172.21.15.59:0/4277830729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb8144120 0x7fbbb815acd0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fbbb806b870 tx=0x7fbba801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ec8113e66e5b33 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.198+0000 7fbbb6a00640 1 -- 172.21.15.59:0/4277830729 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba80b0070 con 0x7fbbb8144120 2024-04-25T09:11:26.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.198+0000 7fbbb6a00640 1 -- 172.21.15.59:0/4277830729 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba80ab600 con 0x7fbbb8144120 2024-04-25T09:11:26.188 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.198+0000 7fbbb6a00640 1 -- 172.21.15.59:0/4277830729 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba80ab9d0 con 0x7fbbb8144120 2024-04-25T09:11:26.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.198+0000 7fbbbe200640 1 -- 172.21.15.59:0/4277830729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb8144120 msgr2=0x7fbbb815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.198+0000 7fbbbe200640 1 --2- 172.21.15.59:0/4277830729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb8144120 0x7fbbb815acd0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fbbb806b870 tx=0x7fbba801c3f0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.189 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.198+0000 7fbbbe200640 1 -- 172.21.15.59:0/4277830729 shutdown_connections 2024-04-25T09:11:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.198+0000 7fbbbe200640 1 --2- 172.21.15.59:0/4277830729 >> v2:172.21.15.178:3300/0 conn(0x7fbbb80ccbf0 0x7fbbb815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.198+0000 7fbbbe200640 1 --2- 172.21.15.59:0/4277830729 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb8144120 0x7fbbb815acd0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.198+0000 7fbbbe200640 1 -- 172.21.15.59:0/4277830729 >> 172.21.15.59:0/4277830729 conn(0x7fbbb8067080 msgr2=0x7fbbb806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.198+0000 7fbbbe200640 1 -- 172.21.15.59:0/4277830729 shutdown_connections 2024-04-25T09:11:26.190 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.198+0000 7fbbbe200640 1 -- 172.21.15.59:0/4277830729 wait complete. 2024-04-25T09:11:26.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbbe200640 1 Processor -- start 2024-04-25T09:11:26.191 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbbe200640 1 -- start start 2024-04-25T09:11:26.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbbe200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbb80ccbf0 0x7fbbb80b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbbe200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbb8144120 0x7fbbb81430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbbe200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb815ee60 0x7fbbb813d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbbe200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb81675c0 con 0x7fbbb815ee60 2024-04-25T09:11:26.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbbe200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8167440 con 0x7fbbb80ccbf0 2024-04-25T09:11:26.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbbe200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8167740 con 0x7fbbb8144120 2024-04-25T09:11:26.193 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbb7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb815ee60 0x7fbbb813d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbb7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb815ee60 0x7fbbb813d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53506/0 (socket says 172.21.15.59:53506) 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbb7e00640 1 -- 172.21.15.59:0/2323448754 learned_addr learned my addr 172.21.15.59:0/2323448754 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbb7400640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbb80ccbf0 0x7fbbb80b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbaea00640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbb8144120 0x7fbbb81430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbb7e00640 1 -- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbb8144120 msgr2=0x7fbbb81430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbb7e00640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbb8144120 0x7fbbb81430c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbb7e00640 1 -- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbb80ccbf0 msgr2=0x7fbbb80b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbb7e00640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbb80ccbf0 0x7fbbb80b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbb7e00640 1 -- 172.21.15.59:0/2323448754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb80af520 con 0x7fbbb815ee60 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbb7e00640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb815ee60 0x7fbbb813d550 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000ca80 tx=0x7fbbb000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbafe00640 1 -- 172.21.15.59:0/2323448754 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0017070 con 0x7fbbb815ee60 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbafe00640 1 -- 172.21.15.59:0/2323448754 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb000ac30 con 0x7fbbb815ee60 2024-04-25T09:11:26.194 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbafe00640 1 -- 172.21.15.59:0/2323448754 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb0012600 con 0x7fbbb815ee60 2024-04-25T09:11:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbbe200640 1 -- 172.21.15.59:0/2323448754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb80afa90 con 0x7fbbb815ee60 2024-04-25T09:11:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.202+0000 7fbbbe200640 1 -- 172.21.15.59:0/2323448754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb80b0050 con 0x7fbbb815ee60 2024-04-25T09:11:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.206+0000 7fbbbe200640 1 -- 172.21.15.59:0/2323448754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb80745d0 con 0x7fbbb815ee60 2024-04-25T09:11:26.195 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.206+0000 7fbbafe00640 1 -- 172.21.15.59:0/2323448754 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbbb001a070 con 0x7fbbb815ee60 2024-04-25T09:11:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.206+0000 7fbbafe00640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb94066f60 0x7fbb94069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.206+0000 7fbbafe00640 1 -- 172.21.15.59:0/2323448754 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fbbb0084db0 con 0x7fbbb815ee60 2024-04-25T09:11:26.196 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.206+0000 7fbbb7400640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb94066f60 0x7fbb94069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.197 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.206+0000 7fbbb7400640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb94066f60 0x7fbb94069420 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbba80ad000 tx=0x7fbba80a4f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.199 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.210+0000 7fbbafe00640 1 -- 172.21.15.59:0/2323448754 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbbb0089070 con 0x7fbbb815ee60 2024-04-25T09:11:26.362 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 -- 172.21.15.59:0/2323448754 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbb815ae30 con 0x7fbbb815ee60 2024-04-25T09:11:26.363 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbafe00640 1 -- 172.21.15.59:0/2323448754 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbb000ae20 con 0x7fbbb815ee60 2024-04-25T09:11:26.363 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:11:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 -- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb94066f60 msgr2=0x7fbb94069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb94066f60 0x7fbb94069420 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fbba80ad000 tx=0x7fbba80a4f90 comp rx=0 tx=0).stop 2024-04-25T09:11:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 -- 172.21.15.59:0/2323448754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb815ee60 msgr2=0x7fbbb813d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb815ee60 0x7fbbb813d550 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fbbb000ca80 tx=0x7fbbb000cf40 comp rx=0 tx=0).stop 2024-04-25T09:11:26.365 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 -- 172.21.15.59:0/2323448754 shutdown_connections 2024-04-25T09:11:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb94066f60 0x7fbb94069420 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb815ee60 0x7fbbb813d550 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbbb8144120 0x7fbbb81430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 --2- 172.21.15.59:0/2323448754 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbbb80ccbf0 0x7fbbb80b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 -- 172.21.15.59:0/2323448754 >> 172.21.15.59:0/2323448754 conn(0x7fbbb8067080 msgr2=0x7fbbb806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 -- 172.21.15.59:0/2323448754 shutdown_connections 2024-04-25T09:11:26.366 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.374+0000 7fbbbe200640 1 -- 172.21.15.59:0/2323448754 wait complete. 2024-04-25T09:11:26.385 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:11:26.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.538+0000 7fccdca00640 1 Processor -- start 2024-04-25T09:11:26.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.538+0000 7fccdca00640 1 -- start start 2024-04-25T09:11:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccdca00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fccd815f3b0 0x7fccd815f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccdca00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd809ade0 con 0x7fccd815b9e0 2024-04-25T09:11:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccdca00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd8099a60 con 0x7fccd80cc050 2024-04-25T09:11:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccdca00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd8099d40 con 0x7fccd815f3b0 2024-04-25T09:11:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fccd815b9e0 0x7fccd80cfb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37868/0 (socket says 172.21.15.59:37868) 2024-04-25T09:11:26.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd7400640 1 -- 172.21.15.59:0/3559468079 learned_addr learned my addr 172.21.15.59:0/3559468079 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:26.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fcccea00640 1 --2- 172.21.15.59:0/3559468079 >> v2:172.21.15.178:3300/0 conn(0x7fccd815f3b0 0x7fccd815f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140074295 0 0) 0x7fccc80014a0 con 0x7fccd815b9e0 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccbc003530 con 0x7fccd815b9e0 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 588428374 0 0) 0x7fccbc003530 con 0x7fccd815b9e0 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 >> v2:172.21.15.178:3300/0 conn(0x7fccd815f3b0 msgr2=0x7fccd815f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 --2- 172.21.15.59:0/3559468079 >> v2:172.21.15.178:3300/0 conn(0x7fccd815f3b0 0x7fccd815f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 >> v1:172.21.15.178:6789/0 conn(0x7fccd80cc050 legacy=0x7fccd80cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd809a020 con 0x7fccd815b9e0 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fccc8001bf0 con 0x7fccd815b9e0 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 >> v1:172.21.15.59:6789/0 conn(0x7fccd815b9e0 legacy=0x7fccd80cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 --2- 172.21.15.59:0/3559468079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccbc0039c0 0x7fccbc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 --2- 172.21.15.59:0/3559468079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc004810 0x7fccbc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 --2- 172.21.15.59:0/3559468079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccbc0051d0 0x7fccbc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd8099d40 con 0x7fccbc004810 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc00c070 con 0x7fccbc0039c0 2024-04-25T09:11:26.533 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc00c270 con 0x7fccbc0051d0 2024-04-25T09:11:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fcccea00640 1 --2- 172.21.15.59:0/3559468079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc004810 0x7fccbc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd7400640 1 --2- 172.21.15.59:0/3559468079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccbc0039c0 0x7fccbc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd7e00640 1 --2- 172.21.15.59:0/3559468079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccbc0051d0 0x7fccbc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fcccea00640 1 -- 172.21.15.59:0/3559468079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccbc0051d0 msgr2=0x7fccbc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fcccea00640 1 --2- 172.21.15.59:0/3559468079 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccbc0051d0 0x7fccbc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fcccea00640 1 -- 172.21.15.59:0/3559468079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccbc0039c0 msgr2=0x7fccbc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fcccea00640 1 --2- 172.21.15.59:0/3559468079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccbc0039c0 0x7fccbc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fcccea00640 1 -- 172.21.15.59:0/3559468079 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc003530 con 0x7fccbc004810 2024-04-25T09:11:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd7e00640 1 -- 172.21.15.59:0/3559468079 reap_dead start 2024-04-25T09:11:26.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.542+0000 7fccd7400640 1 --2- 172.21.15.59:0/3559468079 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccbc0039c0 0x7fccbc003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:26.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.546+0000 7fcccea00640 1 --2- 172.21.15.59:0/3559468079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc004810 0x7fccbc004c90 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009ae0 tx=0x7fccc001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb2c3a4e3cac155 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.546+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00b2070 con 0x7fccbc004810 2024-04-25T09:11:26.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.546+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc00a5680 con 0x7fccbc004810 2024-04-25T09:11:26.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.546+0000 7fccd6a00640 1 -- 172.21.15.59:0/3559468079 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc00096b0 con 0x7fccbc004810 2024-04-25T09:11:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.546+0000 7fccdca00640 1 -- 172.21.15.59:0/3559468079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc004810 msgr2=0x7fccbc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.546+0000 7fccdca00640 1 --2- 172.21.15.59:0/3559468079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc004810 0x7fccbc004c90 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7fccc0009ae0 tx=0x7fccc001ca90 comp rx=0 tx=0).stop 2024-04-25T09:11:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.546+0000 7fccdca00640 1 -- 172.21.15.59:0/3559468079 shutdown_connections 2024-04-25T09:11:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.546+0000 7fccdca00640 1 --2- 172.21.15.59:0/3559468079 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc004810 0x7fccbc004c90 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.546+0000 7fccdca00640 1 -- 172.21.15.59:0/3559468079 >> 172.21.15.59:0/3559468079 conn(0x7fccd80b3030 msgr2=0x7fccd80b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.546+0000 7fccdca00640 1 -- 172.21.15.59:0/3559468079 shutdown_connections 2024-04-25T09:11:26.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.546+0000 7fccdca00640 1 -- 172.21.15.59:0/3559468079 wait complete. 2024-04-25T09:11:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccdca00640 1 Processor -- start 2024-04-25T09:11:26.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccdca00640 1 -- start start 2024-04-25T09:11:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccdca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccbc004810 0x7fccd80b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccdca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccd80b1690 0x7fccd815e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccdca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd81f3510 0x7fccd81f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccdca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd809a8c0 con 0x7fccd81f3510 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccdca00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd809a5e0 con 0x7fccbc004810 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccdca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd815f860 con 0x7fccd80b1690 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccd7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd81f3510 0x7fccd81f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccd7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd81f3510 0x7fccd81f3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53534/0 (socket says 172.21.15.59:53534) 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccd7e00640 1 -- 172.21.15.59:0/2500788398 learned_addr learned my addr 172.21.15.59:0/2500788398 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fcccea00640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccd80b1690 0x7fccd815e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccd7400640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccbc004810 0x7fccd80b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccd7e00640 1 -- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccd80b1690 msgr2=0x7fccd815e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccd7e00640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccd80b1690 0x7fccd815e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccd7e00640 1 -- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccbc004810 msgr2=0x7fccd80b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccd7e00640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccbc004810 0x7fccd80b5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccd7e00640 1 -- 172.21.15.59:0/2500788398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd81f3ed0 con 0x7fccd81f3510 2024-04-25T09:11:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccd7e00640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd81f3510 0x7fccd81f3990 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fccd8073200 tx=0x7fccd000e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fcccfe00640 1 -- 172.21.15.59:0/2500788398 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0019070 con 0x7fccd81f3510 2024-04-25T09:11:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fcccfe00640 1 -- 172.21.15.59:0/2500788398 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccd00052e0 con 0x7fccd81f3510 2024-04-25T09:11:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fcccfe00640 1 -- 172.21.15.59:0/2500788398 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccd0003840 con 0x7fccd81f3510 2024-04-25T09:11:26.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccdca00640 1 -- 172.21.15.59:0/2500788398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd80b5670 con 0x7fccd81f3510 2024-04-25T09:11:26.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccdca00640 1 -- 172.21.15.59:0/2500788398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd80b5c30 con 0x7fccd81f3510 2024-04-25T09:11:26.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.550+0000 7fccdca00640 1 -- 172.21.15.59:0/2500788398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd80745d0 con 0x7fccd81f3510 2024-04-25T09:11:26.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.554+0000 7fcccfe00640 1 -- 172.21.15.59:0/2500788398 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fccd001c070 con 0x7fccd81f3510 2024-04-25T09:11:26.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.554+0000 7fcccfe00640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fccb4066f60 0x7fccb4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.554+0000 7fcccfe00640 1 -- 172.21.15.59:0/2500788398 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fccd00845a0 con 0x7fccd81f3510 2024-04-25T09:11:26.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.554+0000 7fccd7400640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fccb4066f60 0x7fccb4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.554+0000 7fccd7400640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fccb4066f60 0x7fccb4069420 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fccd8075b60 tx=0x7fccc80014a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.558+0000 7fcccfe00640 1 -- 172.21.15.59:0/2500788398 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fccd0055380 con 0x7fccd81f3510 2024-04-25T09:11:26.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 -- 172.21.15.59:0/2500788398 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fccd80d1320 con 0x7fccd81f3510 2024-04-25T09:11:26.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fcccfe00640 1 -- 172.21.15.59:0/2500788398 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v121) v1 ==== 104+0+11 (secure 0 0 0) 0x7fccd0054c80 con 0x7fccd81f3510 2024-04-25T09:11:26.711 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:11:26.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 -- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fccb4066f60 msgr2=0x7fccb4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fccb4066f60 0x7fccb4069420 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fccd8075b60 tx=0x7fccc80014a0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 -- 172.21.15.59:0/2500788398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd81f3510 msgr2=0x7fccd81f3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd81f3510 0x7fccd81f3990 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7fccd8073200 tx=0x7fccd000e8a0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 -- 172.21.15.59:0/2500788398 shutdown_connections 2024-04-25T09:11:26.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fccb4066f60 0x7fccb4069420 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccd81f3510 0x7fccd81f3990 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fccd80b1690 0x7fccd815e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 --2- 172.21.15.59:0/2500788398 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fccbc004810 0x7fccd80b5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 -- 172.21.15.59:0/2500788398 >> 172.21.15.59:0/2500788398 conn(0x7fccd80b3030 msgr2=0x7fccd8070770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 -- 172.21.15.59:0/2500788398 shutdown_connections 2024-04-25T09:11:26.714 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.722+0000 7fccdca00640 1 -- 172.21.15.59:0/2500788398 wait complete. 2024-04-25T09:11:26.733 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:11:26.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.886+0000 7f5645400640 1 Processor -- start 2024-04-25T09:11:26.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.886+0000 7f5645400640 1 -- start start 2024-04-25T09:11:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.890+0000 7f5645400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f564015d880 0x7f564006bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.890+0000 7f5645400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f564006c160 0x7f564006e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.890+0000 7f5645400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f564015dc60 con 0x7f564006e6c0 2024-04-25T09:11:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.890+0000 7f5645400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56400aca10 con 0x7f564006c160 2024-04-25T09:11:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.890+0000 7f5645400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f564006eee0 con 0x7f564015d880 2024-04-25T09:11:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.890+0000 7f5637400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f564006c160 0x7f564006e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.890+0000 7f5637400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f564006c160 0x7f564006e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53540/0 (socket says 172.21.15.59:53540) 2024-04-25T09:11:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.890+0000 7f5637400640 1 -- 172.21.15.59:0/2147058247 learned_addr learned my addr 172.21.15.59:0/2147058247 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.890+0000 7f5637400640 1 -- 172.21.15.59:0/2147058247 >> v2:172.21.15.178:3300/0 conn(0x7f564015d880 msgr2=0x7f564006bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.890+0000 7f5637400640 1 --2- 172.21.15.59:0/2147058247 >> v2:172.21.15.178:3300/0 conn(0x7f564015d880 0x7f564006bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.890+0000 7f5637400640 1 -- 172.21.15.59:0/2147058247 >> v1:172.21.15.178:6789/0 conn(0x7f564006e6c0 legacy=0x7f56400b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:26.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.890+0000 7f5637400640 1 -- 172.21.15.59:0/2147058247 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56400accb0 con 0x7f564006c160 2024-04-25T09:11:26.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5637400640 1 --2- 172.21.15.59:0/2147058247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564006c160 0x7f564006e180 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f5640072590 tx=0x7f562801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c65aefabdef6456 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f563f400640 1 -- 172.21.15.59:0/2147058247 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56280b0070 con 0x7f564006c160 2024-04-25T09:11:26.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f563f400640 1 -- 172.21.15.59:0/2147058247 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56280ab600 con 0x7f564006c160 2024-04-25T09:11:26.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f563f400640 1 -- 172.21.15.59:0/2147058247 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56280ab9d0 con 0x7f564006c160 2024-04-25T09:11:26.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 -- 172.21.15.59:0/2147058247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564006c160 msgr2=0x7f564006e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 --2- 172.21.15.59:0/2147058247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564006c160 0x7f564006e180 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f5640072590 tx=0x7f562801c450 comp rx=0 tx=0).stop 2024-04-25T09:11:26.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 -- 172.21.15.59:0/2147058247 shutdown_connections 2024-04-25T09:11:26.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 --2- 172.21.15.59:0/2147058247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564006c160 0x7f564006e180 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 --2- 172.21.15.59:0/2147058247 >> v2:172.21.15.178:3300/0 conn(0x7f564015d880 0x7f564006bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 -- 172.21.15.59:0/2147058247 >> 172.21.15.59:0/2147058247 conn(0x7f5640071950 msgr2=0x7f5640071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:26.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 -- 172.21.15.59:0/2147058247 shutdown_connections 2024-04-25T09:11:26.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 -- 172.21.15.59:0/2147058247 wait complete. 2024-04-25T09:11:26.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 Processor -- start 2024-04-25T09:11:26.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 -- start start 2024-04-25T09:11:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564006c160 0x7f5640135370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564006e6c0 0x7f5640149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f564015d880 0x7f564015e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564016a7b0 con 0x7f564006e6c0 2024-04-25T09:11:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f564016a630 con 0x7f564006c160 2024-04-25T09:11:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.894+0000 7f5645400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564016a930 con 0x7f564015d880 2024-04-25T09:11:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5637400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564006e6c0 0x7f5640149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5637400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564006e6c0 0x7f5640149e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53546/0 (socket says 172.21.15.59:53546) 2024-04-25T09:11:26.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5637400640 1 -- 172.21.15.59:0/443886982 learned_addr learned my addr 172.21.15.59:0/443886982 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f563fe00640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564006c160 0x7f5640135370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5637400640 1 -- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f564015d880 msgr2=0x7f564015e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5644a00640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f564015d880 0x7f564015e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5637400640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f564015d880 0x7f564015e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5637400640 1 -- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564006c160 msgr2=0x7f5640135370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5637400640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564006c160 0x7f5640135370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5637400640 1 -- 172.21.15.59:0/443886982 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564014e550 con 0x7f564006e6c0 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5644a00640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f564015d880 0x7f564015e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5637400640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564006e6c0 0x7f5640149e90 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f56280ae040 tx=0x7f562801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f563cc00640 1 -- 172.21.15.59:0/443886982 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56280b0040 con 0x7f564006e6c0 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f563cc00640 1 -- 172.21.15.59:0/443886982 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56280bc070 con 0x7f564006e6c0 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5645400640 1 -- 172.21.15.59:0/443886982 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f564014e830 con 0x7f564006e6c0 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f563cc00640 1 -- 172.21.15.59:0/443886982 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56280b6880 con 0x7f564006e6c0 2024-04-25T09:11:26.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5645400640 1 -- 172.21.15.59:0/443886982 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f564014a770 con 0x7f564006e6c0 2024-04-25T09:11:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f5645400640 1 -- 172.21.15.59:0/443886982 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56400745d0 con 0x7f564006e6c0 2024-04-25T09:11:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.898+0000 7f563cc00640 1 -- 172.21.15.59:0/443886982 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f56280b6a20 con 0x7f564006e6c0 2024-04-25T09:11:26.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.902+0000 7f563cc00640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f561c066f60 0x7f561c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:26.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.902+0000 7f563cc00640 1 -- 172.21.15.59:0/443886982 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f562811f5d0 con 0x7f564006e6c0 2024-04-25T09:11:26.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.902+0000 7f563fe00640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f561c066f60 0x7f561c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:26.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.902+0000 7f563fe00640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f561c066f60 0x7f561c069420 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5630006fd0 tx=0x7f5630008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:26.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:26.906+0000 7f563cc00640 1 -- 172.21.15.59:0/443886982 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f56280160d0 con 0x7f564006e6c0 2024-04-25T09:11:27.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.066+0000 7f5645400640 1 -- 172.21.15.59:0/443886982 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f564006bb10 con 0x7f564006e6c0 2024-04-25T09:11:27.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.066+0000 7f563cc00640 1 -- 172.21.15.59:0/443886982 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v121) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56280f0570 con 0x7f564006e6c0 2024-04-25T09:11:27.056 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:11:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.066+0000 7f5645400640 1 -- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f561c066f60 msgr2=0x7f561c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.066+0000 7f5645400640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f561c066f60 0x7f561c069420 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f5630006fd0 tx=0x7f5630008040 comp rx=0 tx=0).stop 2024-04-25T09:11:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.066+0000 7f5645400640 1 -- 172.21.15.59:0/443886982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564006e6c0 msgr2=0x7f5640149e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.066+0000 7f5645400640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564006e6c0 0x7f5640149e90 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f56280ae040 tx=0x7f562801ac90 comp rx=0 tx=0).stop 2024-04-25T09:11:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.070+0000 7f5645400640 1 -- 172.21.15.59:0/443886982 shutdown_connections 2024-04-25T09:11:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.070+0000 7f5645400640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f561c066f60 0x7f561c069420 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.070+0000 7f5645400640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f564015d880 0x7f564015e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.070+0000 7f5645400640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564006e6c0 0x7f5640149e90 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.070+0000 7f5645400640 1 --2- 172.21.15.59:0/443886982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f564006c160 0x7f5640135370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.070+0000 7f5645400640 1 -- 172.21.15.59:0/443886982 >> 172.21.15.59:0/443886982 conn(0x7f5640071950 msgr2=0x7f56400afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.070+0000 7f5645400640 1 -- 172.21.15.59:0/443886982 shutdown_connections 2024-04-25T09:11:27.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.070+0000 7f5645400640 1 -- 172.21.15.59:0/443886982 wait complete. 2024-04-25T09:11:27.077 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:11:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.230+0000 7fd714c00640 1 Processor -- start 2024-04-25T09:11:27.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.230+0000 7fd714c00640 1 -- start start 2024-04-25T09:11:27.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.230+0000 7fd714c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd710159320 0x7fd71015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.230+0000 7fd714c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71006e4a0 0x7fd71006e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.230+0000 7fd714c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd71015fc00 con 0x7fd71015f440 2024-04-25T09:11:27.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.230+0000 7fd714c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd71006ee50 con 0x7fd710159320 2024-04-25T09:11:27.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.230+0000 7fd714c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71006d640 con 0x7fd71006e4a0 2024-04-25T09:11:27.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.234+0000 7fd70e800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71006e4a0 0x7fd71006e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.234+0000 7fd70de00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd710159320 0x7fd71015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.234+0000 7fd70de00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fd710159320 0x7fd71015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:60476/0 (socket says 172.21.15.59:60476) 2024-04-25T09:11:27.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.234+0000 7fd70de00640 1 -- 172.21.15.59:0/1488140729 learned_addr learned my addr 172.21.15.59:0/1488140729 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:27.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.234+0000 7fd70e800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71006e4a0 0x7fd71006e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:45128/0 (socket says 172.21.15.59:45128) 2024-04-25T09:11:27.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.234+0000 7fd70e800640 1 -- 172.21.15.59:0/1488140729 >> v2:172.21.15.178:3300/0 conn(0x7fd710159320 msgr2=0x7fd71015c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.234+0000 7fd70e800640 1 --2- 172.21.15.59:0/1488140729 >> v2:172.21.15.178:3300/0 conn(0x7fd710159320 0x7fd71015c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.234+0000 7fd70e800640 1 -- 172.21.15.59:0/1488140729 >> v1:172.21.15.178:6789/0 conn(0x7fd71015f440 legacy=0x7fd71006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.234+0000 7fd70e800640 1 -- 172.21.15.59:0/1488140729 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71015fee0 con 0x7fd71006e4a0 2024-04-25T09:11:27.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.234+0000 7fd70d400640 1 -- 172.21.15.59:0/1488140729 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2346508889 0 0) 0x7fd71015fc00 con 0x7fd71015f440 2024-04-25T09:11:27.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.234+0000 7fd70e800640 1 --2- 172.21.15.59:0/1488140729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71006e4a0 0x7fd71006e910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd708009d90 tx=0x7fd70801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d000669e54d8be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd70d400640 1 -- 172.21.15.59:0/1488140729 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7080b2070 con 0x7fd71006e4a0 2024-04-25T09:11:27.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd70d400640 1 -- 172.21.15.59:0/1488140729 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7080a5970 con 0x7fd71006e4a0 2024-04-25T09:11:27.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd70d400640 1 -- 172.21.15.59:0/1488140729 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7080a5d40 con 0x7fd71006e4a0 2024-04-25T09:11:27.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 -- 172.21.15.59:0/1488140729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71006e4a0 msgr2=0x7fd71006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 --2- 172.21.15.59:0/1488140729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71006e4a0 0x7fd71006e910 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd708009d90 tx=0x7fd70801c8b0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 -- 172.21.15.59:0/1488140729 shutdown_connections 2024-04-25T09:11:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 --2- 172.21.15.59:0/1488140729 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71006e4a0 0x7fd71006e910 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 --2- 172.21.15.59:0/1488140729 >> v2:172.21.15.178:3300/0 conn(0x7fd710159320 0x7fd71015c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 -- 172.21.15.59:0/1488140729 >> 172.21.15.59:0/1488140729 conn(0x7fd710067080 msgr2=0x7fd71006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 -- 172.21.15.59:0/1488140729 shutdown_connections 2024-04-25T09:11:27.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 -- 172.21.15.59:0/1488140729 wait complete. 2024-04-25T09:11:27.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 Processor -- start 2024-04-25T09:11:27.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 -- start start 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd71006e4a0 0x7fd710165b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd710159320 0x7fd710158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71015f440 0x7fd71015e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71015f860 con 0x7fd71006e4a0 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd710159700 con 0x7fd710159320 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd714c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71015f9e0 con 0x7fd71015f440 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd70de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd71006e4a0 0x7fd710165b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd70de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd71006e4a0 0x7fd710165b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53552/0 (socket says 172.21.15.59:53552) 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd70de00640 1 -- 172.21.15.59:0/2592332162 learned_addr learned my addr 172.21.15.59:0/2592332162 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd70e800640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71015f440 0x7fd71015e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.238+0000 7fd707e00640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd710159320 0x7fd710158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd70de00640 1 -- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71015f440 msgr2=0x7fd71015e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd70de00640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71015f440 0x7fd71015e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd70de00640 1 -- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd710159320 msgr2=0x7fd710158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd70de00640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd710159320 0x7fd710158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd70de00640 1 -- 172.21.15.59:0/2592332162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710158640 con 0x7fd71006e4a0 2024-04-25T09:11:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd70e800640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71015f440 0x7fd71015e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd70de00640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd71006e4a0 0x7fd710165b80 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fd70000e890 tx=0x7fd70000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd706000640 1 -- 172.21.15.59:0/2592332162 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700017070 con 0x7fd71006e4a0 2024-04-25T09:11:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd706000640 1 -- 172.21.15.59:0/2592332162 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70000c940 con 0x7fd71006e4a0 2024-04-25T09:11:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd706000640 1 -- 172.21.15.59:0/2592332162 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70000cd30 con 0x7fd71006e4a0 2024-04-25T09:11:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd714c00640 1 -- 172.21.15.59:0/2592332162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7100af830 con 0x7fd71006e4a0 2024-04-25T09:11:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd714c00640 1 -- 172.21.15.59:0/2592332162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7100afdf0 con 0x7fd71006e4a0 2024-04-25T09:11:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd714c00640 1 -- 172.21.15.59:0/2592332162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7100745d0 con 0x7fd71006e4a0 2024-04-25T09:11:27.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd706000640 1 -- 172.21.15.59:0/2592332162 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fd70001a070 con 0x7fd71006e4a0 2024-04-25T09:11:27.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd706000640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd6ec066f60 0x7fd6ec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.242+0000 7fd706000640 1 -- 172.21.15.59:0/2592332162 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fd700085150 con 0x7fd71006e4a0 2024-04-25T09:11:27.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.246+0000 7fd707e00640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd6ec066f60 0x7fd6ec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.246+0000 7fd707e00640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd6ec066f60 0x7fd6ec069420 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd7101f9d40 tx=0x7fd6f8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.246+0000 7fd706000640 1 -- 172.21.15.59:0/2592332162 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fd700055fc0 con 0x7fd71006e4a0 2024-04-25T09:11:27.412 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.422+0000 7fd714c00640 1 -- 172.21.15.59:0/2592332162 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd71006dad0 con 0x7fd71006e4a0 2024-04-25T09:11:27.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.422+0000 7fd706000640 1 -- 172.21.15.59:0/2592332162 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v121) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd7000558c0 con 0x7fd71006e4a0 2024-04-25T09:11:27.413 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:11:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.426+0000 7fd714c00640 1 -- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd6ec066f60 msgr2=0x7fd6ec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.426+0000 7fd714c00640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd6ec066f60 0x7fd6ec069420 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fd7101f9d40 tx=0x7fd6f8009040 comp rx=0 tx=0).stop 2024-04-25T09:11:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.426+0000 7fd714c00640 1 -- 172.21.15.59:0/2592332162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd71006e4a0 msgr2=0x7fd710165b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.426+0000 7fd714c00640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd71006e4a0 0x7fd710165b80 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7fd70000e890 tx=0x7fd70000ed50 comp rx=0 tx=0).stop 2024-04-25T09:11:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.426+0000 7fd714c00640 1 -- 172.21.15.59:0/2592332162 shutdown_connections 2024-04-25T09:11:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.426+0000 7fd714c00640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fd6ec066f60 0x7fd6ec069420 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.426+0000 7fd714c00640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fd71015f440 0x7fd71015e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.426+0000 7fd714c00640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fd710159320 0x7fd710158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.426+0000 7fd714c00640 1 --2- 172.21.15.59:0/2592332162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd71006e4a0 0x7fd710165b80 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.426+0000 7fd714c00640 1 -- 172.21.15.59:0/2592332162 >> 172.21.15.59:0/2592332162 conn(0x7fd710067080 msgr2=0x7fd7100cc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.426+0000 7fd714c00640 1 -- 172.21.15.59:0/2592332162 shutdown_connections 2024-04-25T09:11:27.416 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.426+0000 7fd714c00640 1 -- 172.21.15.59:0/2592332162 wait complete. 2024-04-25T09:11:27.434 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:11:27.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:27.435 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:27.483 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:11:27.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:27.483 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:11:27.534 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:11:27.534 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-25T09:11:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.730+0000 7fa0de400640 1 Processor -- start 2024-04-25T09:11:27.721 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.730+0000 7fa0de400640 1 -- start start 2024-04-25T09:11:27.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0de400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0d815dc60 0x7fa0d80d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.722 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0de400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa0d809a170 0x7fa0d80cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0de400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d815e040 con 0x7fa0d806bf30 2024-04-25T09:11:27.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0de400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d80cff80 con 0x7fa0d809a170 2024-04-25T09:11:27.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0de400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d80d0260 con 0x7fa0d815dc60 2024-04-25T09:11:27.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0d7e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa0d809a170 0x7fa0d80cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0d7400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0d815dc60 0x7fa0d80d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0d7e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa0d809a170 0x7fa0d80cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:60490/0 (socket says 172.21.15.59:60490) 2024-04-25T09:11:27.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0d7e00640 1 -- 172.21.15.59:0/2356866107 learned_addr learned my addr 172.21.15.59:0/2356866107 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:27.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0d7400640 1 -- 172.21.15.59:0/2356866107 >> v2:172.21.15.178:3300/0 conn(0x7fa0d809a170 msgr2=0x7fa0d80cf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.723 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0d7400640 1 --2- 172.21.15.59:0/2356866107 >> v2:172.21.15.178:3300/0 conn(0x7fa0d809a170 0x7fa0d80cf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0d7400640 1 -- 172.21.15.59:0/2356866107 >> v1:172.21.15.178:6789/0 conn(0x7fa0d806bf30 legacy=0x7fa0d8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0d7400640 1 -- 172.21.15.59:0/2356866107 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d80d0540 con 0x7fa0d815dc60 2024-04-25T09:11:27.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0d6a00640 1 -- 172.21.15.59:0/2356866107 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137889297 0 0) 0x7fa0d815e040 con 0x7fa0d806bf30 2024-04-25T09:11:27.724 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.734+0000 7fa0d7e00640 1 --2- 172.21.15.59:0/2356866107 >> v2:172.21.15.178:3300/0 conn(0x7fa0d809a170 0x7fa0d80cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:27.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0d7400640 1 --2- 172.21.15.59:0/2356866107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0d815dc60 0x7fa0d80d1020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80097c0 tx=0x7fa0c801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1b3f951b69e2da6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0d6a00640 1 -- 172.21.15.59:0/2356866107 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80b1070 con 0x7fa0d815dc60 2024-04-25T09:11:27.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0d6a00640 1 -- 172.21.15.59:0/2356866107 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c80a8050 con 0x7fa0d815dc60 2024-04-25T09:11:27.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0d6a00640 1 -- 172.21.15.59:0/2356866107 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80ac860 con 0x7fa0d815dc60 2024-04-25T09:11:27.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0de400640 1 -- 172.21.15.59:0/2356866107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0d815dc60 msgr2=0x7fa0d80d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0de400640 1 --2- 172.21.15.59:0/2356866107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0d815dc60 0x7fa0d80d1020 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80097c0 tx=0x7fa0c801c3e0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0de400640 1 -- 172.21.15.59:0/2356866107 shutdown_connections 2024-04-25T09:11:27.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0de400640 1 --2- 172.21.15.59:0/2356866107 >> v2:172.21.15.178:3300/0 conn(0x7fa0d809a170 0x7fa0d80cf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0de400640 1 --2- 172.21.15.59:0/2356866107 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0d815dc60 0x7fa0d80d1020 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0de400640 1 -- 172.21.15.59:0/2356866107 >> 172.21.15.59:0/2356866107 conn(0x7fa0d80b3200 msgr2=0x7fa0d80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0de400640 1 -- 172.21.15.59:0/2356866107 shutdown_connections 2024-04-25T09:11:27.727 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0de400640 1 -- 172.21.15.59:0/2356866107 wait complete. 2024-04-25T09:11:27.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0de400640 1 Processor -- start 2024-04-25T09:11:27.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.738+0000 7fa0de400640 1 -- start start 2024-04-25T09:11:27.730 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0de400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d806bf30 0x7fa0d80b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0de400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0d809a170 0x7fa0d80ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0de400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0d815dc60 0x7fa0d80ca610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0de400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d80cc6f0 con 0x7fa0d806bf30 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0de400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d80cc570 con 0x7fa0d809a170 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0de400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d80cc870 con 0x7fa0d815dc60 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0d7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d806bf30 0x7fa0d80b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0d7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d806bf30 0x7fa0d80b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53556/0 (socket says 172.21.15.59:53556) 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0d7400640 1 -- 172.21.15.59:0/1227961541 learned_addr learned my addr 172.21.15.59:0/1227961541 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0d7e00640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0d815dc60 0x7fa0d80ca610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0cea00640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0d809a170 0x7fa0d80ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0d7400640 1 -- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0d815dc60 msgr2=0x7fa0d80ca610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0d7400640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0d815dc60 0x7fa0d80ca610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0d7400640 1 -- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0d809a170 msgr2=0x7fa0d80ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0d7400640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0d809a170 0x7fa0d80ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0d7400640 1 -- 172.21.15.59:0/1227961541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d80c8b60 con 0x7fa0d806bf30 2024-04-25T09:11:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0d7400640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d806bf30 0x7fa0d80b5e80 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fa0c801aa90 tx=0x7fa0c801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0cfe00640 1 -- 172.21.15.59:0/1227961541 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80bb020 con 0x7fa0d806bf30 2024-04-25T09:11:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0cfe00640 1 -- 172.21.15.59:0/1227961541 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c80ace30 con 0x7fa0d806bf30 2024-04-25T09:11:27.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0cfe00640 1 -- 172.21.15.59:0/1227961541 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80b1040 con 0x7fa0d806bf30 2024-04-25T09:11:27.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0de400640 1 -- 172.21.15.59:0/1227961541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d80c8e40 con 0x7fa0d806bf30 2024-04-25T09:11:27.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0de400640 1 -- 172.21.15.59:0/1227961541 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d80c9400 con 0x7fa0d806bf30 2024-04-25T09:11:27.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.742+0000 7fa0cfe00640 1 -- 172.21.15.59:0/1227961541 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa0c80be020 con 0x7fa0d806bf30 2024-04-25T09:11:27.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0cfe00640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa0b4066f90 0x7fa0b4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0cfe00640 1 -- 172.21.15.59:0/1227961541 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa0c811f320 con 0x7fa0d806bf30 2024-04-25T09:11:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 Processor -- start 2024-04-25T09:11:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0cea00640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa0b4066f90 0x7fa0b4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 -- start start 2024-04-25T09:11:27.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0cea00640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa0b4066f90 0x7fa0b4069450 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa0d81580b0 tx=0x7fa0c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f769d0 0x55ffe5f76db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f772f0 0x55ffe5f2cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f2d0a0 0x55ffe5f2d480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe5d79ff0 con 0x55ffe5f769d0 2024-04-25T09:11:27.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe5d02150 con 0x55ffe5f2d0a0 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ffe5d76090 con 0x55ffe5f772f0 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0d7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f769d0 0x55ffe5f76db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0d7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f769d0 0x55ffe5f76db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53564/0 (socket says 172.21.15.59:53564) 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0d7400640 1 -- 172.21.15.59:0/4203962857 learned_addr learned my addr 172.21.15.59:0/4203962857 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0d7e00640 1 --2- 172.21.15.59:0/4203962857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f2d0a0 0x55ffe5f2d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0cea00640 1 --2- 172.21.15.59:0/4203962857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f772f0 0x55ffe5f2cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0d7400640 1 -- 172.21.15.59:0/4203962857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f772f0 msgr2=0x55ffe5f2cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0d7400640 1 --2- 172.21.15.59:0/4203962857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f772f0 0x55ffe5f2cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0d7400640 1 -- 172.21.15.59:0/4203962857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f2d0a0 msgr2=0x55ffe5f2d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0d7400640 1 --2- 172.21.15.59:0/4203962857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f2d0a0 0x55ffe5f2d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0d7400640 1 -- 172.21.15.59:0/4203962857 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffe5f100d0 con 0x55ffe5f769d0 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0d7400640 1 --2- 172.21.15.59:0/4203962857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f769d0 0x55ffe5f76db0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80efad0 tx=0x7fa0c80ef7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376ff7c25226e1e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0c7e00640 1 -- 172.21.15.59:0/4203962857 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80f81a0 con 0x55ffe5f769d0 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0c7e00640 1 -- 172.21.15.59:0/4203962857 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c80a8070 con 0x55ffe5f769d0 2024-04-25T09:11:27.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0c7e00640 1 -- 172.21.15.59:0/4203962857 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80ec1b0 con 0x55ffe5f769d0 2024-04-25T09:11:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 -- 172.21.15.59:0/4203962857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f769d0 msgr2=0x55ffe5f76db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 --2- 172.21.15.59:0/4203962857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f769d0 0x55ffe5f76db0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80efad0 tx=0x7fa0c80ef7b0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 -- 172.21.15.59:0/4203962857 shutdown_connections 2024-04-25T09:11:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 --2- 172.21.15.59:0/4203962857 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f2d0a0 0x55ffe5f2d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 --2- 172.21.15.59:0/4203962857 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f772f0 0x55ffe5f2cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 --2- 172.21.15.59:0/4203962857 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f769d0 0x55ffe5f76db0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 -- 172.21.15.59:0/4203962857 >> 172.21.15.59:0/4203962857 conn(0x55ffe5f29020 msgr2=0x55ffe5f2b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 -- 172.21.15.59:0/4203962857 shutdown_connections 2024-04-25T09:11:27.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.746+0000 7fa0e1959000 1 -- 172.21.15.59:0/4203962857 wait complete. 2024-04-25T09:11:27.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 1 -- start start 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 1 Processor -- start 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f2d0a0 0x55ffe5f5b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 0x55ffe5f5bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f772f0 0x55ffe5f5c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe5d3e250 con 0x55ffe5f2d0a0 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe5d34690 con 0x55ffe5f769d0 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ffe5d02a40 con 0x55ffe5f772f0 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 10 client.0 _ll_register_callbacks cb 0x55ffe5f17e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0d7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f2d0a0 0x55ffe5f5b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0d7400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f2d0a0 0x55ffe5f5b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53572/0 (socket says 172.21.15.59:53572) 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0d7400640 1 -- 172.21.15.59:0/3801475867 learned_addr learned my addr 172.21.15.59:0/3801475867 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0cea00640 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 0x55ffe5f5bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0d7e00640 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f772f0 0x55ffe5f5c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.744 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0d7400640 1 -- 172.21.15.59:0/3801475867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f772f0 msgr2=0x55ffe5f5c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0d7400640 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f772f0 0x55ffe5f5c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0d7400640 1 -- 172.21.15.59:0/3801475867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 msgr2=0x55ffe5f5bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0d7400640 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 0x55ffe5f5bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0d7400640 1 -- 172.21.15.59:0/3801475867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ffe5e271c0 con 0x55ffe5f2d0a0 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0d7400640 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f2d0a0 0x55ffe5f5b7f0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80097c0 tx=0x7fa0c8019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52e81e88bef43ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0c4c00640 1 -- 172.21.15.59:0/3801475867 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0c80f81a0 con 0x55ffe5f2d0a0 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0c4c00640 1 -- 172.21.15.59:0/3801475867 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa0c811d1d0 con 0x55ffe5f2d0a0 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 1 -- 172.21.15.59:0/3801475867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa0c80a8070 con 0x55ffe5f2d0a0 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0c4c00640 1 -- 172.21.15.59:0/3801475867 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0c80eef90 con 0x55ffe5f2d0a0 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 10 client.9153 fetch_fsmap learned FSMap version 104 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 1 -- 172.21.15.59:0/3801475867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x55ffe5e23170 con 0x55ffe5f2d0a0 2024-04-25T09:11:27.745 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0c4c00640 1 -- 172.21.15.59:0/3801475867 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0c80a8070 con 0x55ffe5f2d0a0 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0c4c00640 1 -- 172.21.15.59:0/3801475867 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 104) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa0c80b4030 con 0x55ffe5f2d0a0 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 10 client.9153 fetch_fsmap finished waiting for FSMap version 104 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 10 client.9153 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 20 client.9153 populate_metadata read hostname 'smithi059' 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x55ffe5f86c80 0x55ffe5f89070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 4 client.9153 mds_command: new command op to 8964 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0e1959000 1 -- 172.21.15.59:0/3801475867 --> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ffe5d15c60 con 0x55ffe5f86c80 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.750+0000 7fa0cea00640 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x55ffe5f86c80 0x55ffe5f89070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0cea00640 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x55ffe5f86c80 0x55ffe5f89070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0d73e48e31a70c0 server_cookie=d1760ee775c42cc3 in_seq=0 out_seq=0 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0c4c00640 10 client.9153 ms_handle_connect on v2:172.21.15.59:6834/29546856 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0c4c00640 1 -- 172.21.15.59:0/3801475867 <== mds.0 v2:172.21.15.59:6834/29546856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ffe5d15c60 con 0x55ffe5f86c80 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0c4c00640 10 client.9153 handle_command_reply: tid=0 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0e1959000 1 client.9153 shutdown 2024-04-25T09:11:27.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0e1959000 1 -- 172.21.15.59:0/3801475867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f2d0a0 msgr2=0x55ffe5f5b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0e1959000 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f2d0a0 0x55ffe5f5b7f0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7fa0c80097c0 tx=0x7fa0c8019180 comp rx=0 tx=0).stop 2024-04-25T09:11:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0e1959000 1 -- 172.21.15.59:0/3801475867 shutdown_connections 2024-04-25T09:11:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0e1959000 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x55ffe5f86c80 0x55ffe5f89070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0e1959000 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f772f0 0x55ffe5f5c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0e1959000 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 0x55ffe5f5bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0e1959000 1 --2- 172.21.15.59:0/3801475867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f2d0a0 0x55ffe5f5b7f0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0c4c00640 0 client.9153 ms_handle_reset on v2:172.21.15.59:6834/29546856 2024-04-25T09:11:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0e1959000 1 -- 172.21.15.59:0/3801475867 >> 172.21.15.59:0/3801475867 conn(0x55ffe5f29020 msgr2=0x55ffe5f2bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0e1959000 1 -- 172.21.15.59:0/3801475867 shutdown_connections 2024-04-25T09:11:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0e1959000 1 -- 172.21.15.59:0/3801475867 wait complete. 2024-04-25T09:11:27.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.754+0000 7fa0e1959000 20 client.9153 trim_cache size 0 max 16384 2024-04-25T09:11:27.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.766+0000 7fa0e1959000 1 Processor -- start 2024-04-25T09:11:27.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.766+0000 7fa0e1959000 1 -- start start 2024-04-25T09:11:27.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.766+0000 7fa0e1959000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f2d0a0 0x55ffe5fd30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.766+0000 7fa0e1959000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 0x55ffe5fd3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.766+0000 7fa0e1959000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 0x55ffe5fd3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.766+0000 7fa0e1959000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8202d70 con 0x55ffe5f772f0 2024-04-25T09:11:27.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.766+0000 7fa0e1959000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d809cb00 con 0x55ffe5f769d0 2024-04-25T09:11:27.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.766+0000 7fa0e1959000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d8157030 con 0x55ffe5f2d0a0 2024-04-25T09:11:27.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.766+0000 7fa0d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 0x55ffe5fd3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.766+0000 7fa0d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 0x55ffe5fd3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53578/0 (socket says 172.21.15.59:53578) 2024-04-25T09:11:27.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.766+0000 7fa0d7e00640 1 -- 172.21.15.59:0/4272461111 learned_addr learned my addr 172.21.15.59:0/4272461111 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:27.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 -- 172.21.15.59:0/4272461111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f2d0a0 msgr2=0x55ffe5fd30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 --2- 172.21.15.59:0/4272461111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f2d0a0 0x55ffe5fd30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 -- 172.21.15.59:0/4272461111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 msgr2=0x55ffe5fd3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 --2- 172.21.15.59:0/4272461111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 0x55ffe5fd3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 -- 172.21.15.59:0/4272461111 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ffe5dc0de0 con 0x55ffe5f772f0 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 --2- 172.21.15.59:0/4272461111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 0x55ffe5fd3b70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0017730 tx=0x7fa0d0009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f30383cf0b83cbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0c7400640 1 -- 172.21.15.59:0/4272461111 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0003ba0 con 0x55ffe5f772f0 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0c7400640 1 -- 172.21.15.59:0/4272461111 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d0003d60 con 0x55ffe5f772f0 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0c7400640 1 -- 172.21.15.59:0/4272461111 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0015ab0 con 0x55ffe5f772f0 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 -- 172.21.15.59:0/4272461111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 msgr2=0x55ffe5fd3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 --2- 172.21.15.59:0/4272461111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 0x55ffe5fd3b70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0017730 tx=0x7fa0d0009810 comp rx=0 tx=0).stop 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 -- 172.21.15.59:0/4272461111 shutdown_connections 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 --2- 172.21.15.59:0/4272461111 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 0x55ffe5fd3b70 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 --2- 172.21.15.59:0/4272461111 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 0x55ffe5fd3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 --2- 172.21.15.59:0/4272461111 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f2d0a0 0x55ffe5fd30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 -- 172.21.15.59:0/4272461111 >> 172.21.15.59:0/4272461111 conn(0x55ffe5f29020 msgr2=0x55ffe5f83fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 -- 172.21.15.59:0/4272461111 shutdown_connections 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 -- 172.21.15.59:0/4272461111 wait complete. 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 -- start start 2024-04-25T09:11:27.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 Processor -- start 2024-04-25T09:11:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f2d0a0 0x55ffe5f89380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 0x55ffe5f898c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 0x55ffe5f89e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ffe5d14e00 con 0x55ffe5f772f0 2024-04-25T09:11:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d809c500 con 0x55ffe5f769d0 2024-04-25T09:11:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ffe5d79300 con 0x55ffe5f2d0a0 2024-04-25T09:11:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0e1959000 10 client.0 _ll_register_callbacks cb 0x55ffe5ef8040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 0x55ffe5f89e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 0x55ffe5f89e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53582/0 (socket says 172.21.15.59:53582) 2024-04-25T09:11:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 -- 172.21.15.59:0/591934018 learned_addr learned my addr 172.21.15.59:0/591934018 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:27.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0cea00640 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 0x55ffe5f898c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7400640 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f2d0a0 0x55ffe5f89380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 -- 172.21.15.59:0/591934018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f2d0a0 msgr2=0x55ffe5f89380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f2d0a0 0x55ffe5f89380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 -- 172.21.15.59:0/591934018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 msgr2=0x55ffe5f898c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 0x55ffe5f898c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 -- 172.21.15.59:0/591934018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ffe5d1b8e0 con 0x55ffe5f772f0 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0d7e00640 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 0x55ffe5f89e00 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x55ffe5de4e90 tx=0x7fa0d0004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4daaafa6cb706bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.770+0000 7fa0c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0c4c00640 1 -- 172.21.15.59:0/591934018 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0030060 con 0x55ffe5f772f0 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0c4c00640 1 -- 172.21.15.59:0/591934018 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fa0d0004030 con 0x55ffe5f772f0 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0e1959000 1 -- 172.21.15.59:0/591934018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa0d0003d60 con 0x55ffe5f772f0 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0c4c00640 1 -- 172.21.15.59:0/591934018 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=104) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0d0036050 con 0x55ffe5f772f0 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0e1959000 10 client.9159 fetch_fsmap learned FSMap version 104 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0e1959000 1 -- 172.21.15.59:0/591934018 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=104,monmap=2+}) v3 -- 0x55ffe5dd38f0 con 0x55ffe5f772f0 2024-04-25T09:11:27.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0c4c00640 1 -- 172.21.15.59:0/591934018 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d0003d60 con 0x55ffe5f772f0 2024-04-25T09:11:27.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0c4c00640 1 -- 172.21.15.59:0/591934018 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 104) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa0d0039020 con 0x55ffe5f772f0 2024-04-25T09:11:27.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0e1959000 10 client.9159 fetch_fsmap finished waiting for FSMap version 104 2024-04-25T09:11:27.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0e1959000 10 client.9159 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-25T09:11:27.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0e1959000 20 client.9159 populate_metadata read hostname 'smithi059' 2024-04-25T09:11:27.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0e1959000 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x55ffe5f8a9b0 0x55ffe5fdef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0e1959000 4 client.9159 mds_command: new command op to 8964 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T09:11:27.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0e1959000 1 -- 172.21.15.59:0/591934018 --> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ffe5d87530 con 0x55ffe5f8a9b0 2024-04-25T09:11:27.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0d7400640 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x55ffe5f8a9b0 0x55ffe5fdef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0d7400640 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x55ffe5f8a9b0 0x55ffe5fdef60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecbca03c74890bf5 server_cookie=186e294d6efaf39d in_seq=0 out_seq=0 2024-04-25T09:11:27.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.774+0000 7fa0c4c00640 10 client.9159 ms_handle_connect on v2:172.21.15.59:6834/29546856 2024-04-25T09:11:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0c4c00640 1 -- 172.21.15.59:0/591934018 <== mds.0 v2:172.21.15.59:6834/29546856 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ffe5d87530 con 0x55ffe5f8a9b0 2024-04-25T09:11:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0c4c00640 10 client.9159 handle_command_reply: tid=0 2024-04-25T09:11:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0e1959000 1 client.9159 shutdown 2024-04-25T09:11:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0e1959000 1 -- 172.21.15.59:0/591934018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 msgr2=0x55ffe5f89e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0e1959000 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 0x55ffe5f89e00 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x55ffe5de4e90 tx=0x7fa0d0004ac0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0e1959000 1 -- 172.21.15.59:0/591934018 shutdown_connections 2024-04-25T09:11:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0e1959000 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.59:6834/29546856,v1:172.21.15.59:6835/29546856] conn(0x55ffe5f8a9b0 0x55ffe5fdef60 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0e1959000 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55ffe5f772f0 0x55ffe5f89e00 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0e1959000 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55ffe5f769d0 0x55ffe5f898c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0c4c00640 0 client.9159 ms_handle_reset on v2:172.21.15.59:6834/29546856 2024-04-25T09:11:27.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0e1959000 1 --2- 172.21.15.59:0/591934018 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55ffe5f2d0a0 0x55ffe5f89380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0e1959000 1 -- 172.21.15.59:0/591934018 >> 172.21.15.59:0/591934018 conn(0x55ffe5f29020 msgr2=0x55ffe5f750a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0e1959000 1 -- 172.21.15.59:0/591934018 shutdown_connections 2024-04-25T09:11:27.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0e1959000 1 -- 172.21.15.59:0/591934018 wait complete. 2024-04-25T09:11:27.779 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0e1959000 20 client.9159 trim_cache size 0 max 16384 2024-04-25T09:11:27.779 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:11:27.779 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "", 2024-04-25T09:11:27.779 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0 2024-04-25T09:11:27.779 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:11:27.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0de400640 1 -- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa0b4066f90 msgr2=0x7fa0b4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0de400640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa0b4066f90 0x7fa0b4069450 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa0d81580b0 tx=0x7fa0c0009040 comp rx=0 tx=0).stop 2024-04-25T09:11:27.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0de400640 1 -- 172.21.15.59:0/1227961541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d806bf30 msgr2=0x7fa0d80b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0de400640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d806bf30 0x7fa0d80b5e80 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fa0c801aa90 tx=0x7fa0c801ac20 comp rx=0 tx=0).stop 2024-04-25T09:11:27.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0de400640 1 -- 172.21.15.59:0/1227961541 shutdown_connections 2024-04-25T09:11:27.780 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0de400640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa0b4066f90 0x7fa0b4069450 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0de400640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa0d815dc60 0x7fa0d80ca610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0de400640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa0d809a170 0x7fa0d80ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0de400640 1 --2- 172.21.15.59:0/1227961541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0d806bf30 0x7fa0d80b5e80 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0de400640 1 -- 172.21.15.59:0/1227961541 >> 172.21.15.59:0/1227961541 conn(0x7fa0d80b3200 msgr2=0x7fa0d806c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0de400640 1 -- 172.21.15.59:0/1227961541 shutdown_connections 2024-04-25T09:11:27.781 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.786+0000 7fa0de400640 1 -- 172.21.15.59:0/1227961541 wait complete. 2024-04-25T09:11:27.795 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:11:27.934 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffacc400640 1 Processor -- start 2024-04-25T09:11:27.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffacc400640 1 -- start start 2024-04-25T09:11:27.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffacc400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffac415b5a0 0x7ffac40cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffacc400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffac40cc440 0x7ffac40d0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffacc400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac40ce7f0 con 0x7ffac415b980 2024-04-25T09:11:27.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffacc400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac40cfcd0 con 0x7ffac40cc440 2024-04-25T09:11:27.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffacc400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40cead0 con 0x7ffac415b5a0 2024-04-25T09:11:27.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffaca400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffac40cc440 0x7ffac40d0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffac9a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffac415b5a0 0x7ffac40cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffaca400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7ffac40cc440 0x7ffac40d0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:60536/0 (socket says 172.21.15.59:60536) 2024-04-25T09:11:27.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffac9a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffac415b5a0 0x7ffac40cdea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:45182/0 (socket says 172.21.15.59:45182) 2024-04-25T09:11:27.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffaca400640 1 -- 172.21.15.59:0/2208261664 learned_addr learned my addr 172.21.15.59:0/2208261664 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:27.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffac9000640 1 --1- 172.21.15.59:0/2208261664 >> v1:172.21.15.178:6789/0 conn(0x7ffac415b980 0x7ffac40cbd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:58412/0 (socket says 172.21.15.59:58412) 2024-04-25T09:11:27.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffac9a00640 1 -- 172.21.15.59:0/2208261664 >> v2:172.21.15.178:3300/0 conn(0x7ffac40cc440 msgr2=0x7ffac40d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:27.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffac9a00640 1 --2- 172.21.15.59:0/2208261664 >> v2:172.21.15.178:3300/0 conn(0x7ffac40cc440 0x7ffac40d0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffac9a00640 1 -- 172.21.15.59:0/2208261664 >> v1:172.21.15.178:6789/0 conn(0x7ffac415b980 legacy=0x7ffac40cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffac9a00640 1 -- 172.21.15.59:0/2208261664 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac40cf960 con 0x7ffac415b5a0 2024-04-25T09:11:27.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.946+0000 7ffaca400640 1 --2- 172.21.15.59:0/2208261664 >> v2:172.21.15.178:3300/0 conn(0x7ffac40cc440 0x7ffac40d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:27.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.950+0000 7ffac9a00640 1 --2- 172.21.15.59:0/2208261664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffac415b5a0 0x7ffac40cdea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffab80097c0 tx=0x7ffab801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e653fd258ed51bbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.950+0000 7ffac3e00640 1 -- 172.21.15.59:0/2208261664 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab80aa620 con 0x7ffac415b5a0 2024-04-25T09:11:27.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.950+0000 7ffac3e00640 1 -- 172.21.15.59:0/2208261664 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab80af070 con 0x7ffac415b5a0 2024-04-25T09:11:27.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.950+0000 7ffac3e00640 1 -- 172.21.15.59:0/2208261664 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab80aa9e0 con 0x7ffac415b5a0 2024-04-25T09:11:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.950+0000 7ffacc400640 1 -- 172.21.15.59:0/2208261664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffac415b5a0 msgr2=0x7ffac40cdea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.950+0000 7ffacc400640 1 --2- 172.21.15.59:0/2208261664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffac415b5a0 0x7ffac40cdea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ffab80097c0 tx=0x7ffab801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.950+0000 7ffacc400640 1 -- 172.21.15.59:0/2208261664 shutdown_connections 2024-04-25T09:11:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.950+0000 7ffacc400640 1 --2- 172.21.15.59:0/2208261664 >> v2:172.21.15.178:3300/0 conn(0x7ffac40cc440 0x7ffac40d0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.950+0000 7ffacc400640 1 --2- 172.21.15.59:0/2208261664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffac415b5a0 0x7ffac40cdea0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.950+0000 7ffacc400640 1 -- 172.21.15.59:0/2208261664 >> 172.21.15.59:0/2208261664 conn(0x7ffac40b3390 msgr2=0x7ffac40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.950+0000 7ffacc400640 1 -- 172.21.15.59:0/2208261664 shutdown_connections 2024-04-25T09:11:27.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.950+0000 7ffacc400640 1 -- 172.21.15.59:0/2208261664 wait complete. 2024-04-25T09:11:27.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffacc400640 1 Processor -- start 2024-04-25T09:11:27.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffacc400640 1 -- start start 2024-04-25T09:11:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffacc400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffac40cc440 0x7ffac4141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffacc400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffac415b5a0 0x7ffac4152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffacc400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffac415b980 0x7ffac40b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffacc400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40d1240 con 0x7ffac415b980 2024-04-25T09:11:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffacc400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40d10c0 con 0x7ffac40cc440 2024-04-25T09:11:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffacc400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac40d13c0 con 0x7ffac415b5a0 2024-04-25T09:11:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffaca400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffac415b980 0x7ffac40b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffaca400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffac415b980 0x7ffac40b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53584/0 (socket says 172.21.15.59:53584) 2024-04-25T09:11:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffaca400640 1 -- 172.21.15.59:0/1318937524 learned_addr learned my addr 172.21.15.59:0/1318937524 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffac9a00640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffac40cc440 0x7ffac4141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffac9000640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffac415b5a0 0x7ffac4152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.945 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffaca400640 1 -- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffac415b5a0 msgr2=0x7ffac4152120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffaca400640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffac415b5a0 0x7ffac4152120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffaca400640 1 -- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffac40cc440 msgr2=0x7ffac4141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffaca400640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffac40cc440 0x7ffac4141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffaca400640 1 -- 172.21.15.59:0/1318937524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac41416c0 con 0x7ffac415b980 2024-04-25T09:11:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffaca400640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffac415b980 0x7ffac40b4480 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009e50 tx=0x7ffabc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffac1600640 1 -- 172.21.15.59:0/1318937524 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc00cd80 con 0x7ffac415b980 2024-04-25T09:11:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffac1600640 1 -- 172.21.15.59:0/1318937524 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc019070 con 0x7ffac415b980 2024-04-25T09:11:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffac1600640 1 -- 172.21.15.59:0/1318937524 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0146c0 con 0x7ffac415b980 2024-04-25T09:11:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffacc400640 1 -- 172.21.15.59:0/1318937524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac40b4ed0 con 0x7ffac415b980 2024-04-25T09:11:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.954+0000 7ffacc400640 1 -- 172.21.15.59:0/1318937524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac40b5a10 con 0x7ffac415b980 2024-04-25T09:11:27.946 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.958+0000 7ffacc400640 1 -- 172.21.15.59:0/1318937524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac40745d0 con 0x7ffac415b980 2024-04-25T09:11:27.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.958+0000 7ffac1600640 1 -- 172.21.15.59:0/1318937524 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7ffabc012050 con 0x7ffac415b980 2024-04-25T09:11:27.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.958+0000 7ffac1600640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffaa4066f90 0x7ffaa4069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:27.947 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.958+0000 7ffac1600640 1 -- 172.21.15.59:0/1318937524 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7ffabc0854b0 con 0x7ffac415b980 2024-04-25T09:11:27.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.958+0000 7ffac9a00640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffaa4066f90 0x7ffaa4069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:27.948 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.958+0000 7ffac9a00640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffaa4066f90 0x7ffaa4069450 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ffab80ae000 tx=0x7ffab80a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:27.952 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:27.962+0000 7ffac1600640 1 -- 172.21.15.59:0/1318937524 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7ffabc010040 con 0x7ffac415b980 2024-04-25T09:11:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.162+0000 7ffacc400640 1 -- 172.21.15.59:0/1318937524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffac40ceeb0 con 0x7ffac415b980 2024-04-25T09:11:28.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.162+0000 7ffac1600640 1 -- 172.21.15.59:0/1318937524 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v104) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffabc055cd0 con 0x7ffac415b980 2024-04-25T09:11:28.151 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:11:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.162+0000 7ffacc400640 1 -- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffaa4066f90 msgr2=0x7ffaa4069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.162+0000 7ffacc400640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffaa4066f90 0x7ffaa4069450 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7ffab80ae000 tx=0x7ffab80a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.162+0000 7ffacc400640 1 -- 172.21.15.59:0/1318937524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffac415b980 msgr2=0x7ffac40b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.162+0000 7ffacc400640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffac415b980 0x7ffac40b4480 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009e50 tx=0x7ffabc00c490 comp rx=0 tx=0).stop 2024-04-25T09:11:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.162+0000 7ffacc400640 1 -- 172.21.15.59:0/1318937524 shutdown_connections 2024-04-25T09:11:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.162+0000 7ffacc400640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7ffaa4066f90 0x7ffaa4069450 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.162+0000 7ffacc400640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffac415b980 0x7ffac40b4480 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.162+0000 7ffacc400640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7ffac415b5a0 0x7ffac4152120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.162+0000 7ffacc400640 1 --2- 172.21.15.59:0/1318937524 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7ffac40cc440 0x7ffac4141180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.162+0000 7ffacc400640 1 -- 172.21.15.59:0/1318937524 >> 172.21.15.59:0/1318937524 conn(0x7ffac40b3390 msgr2=0x7ffac40b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.166+0000 7ffacc400640 1 -- 172.21.15.59:0/1318937524 shutdown_connections 2024-04-25T09:11:28.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:28.166+0000 7ffacc400640 1 -- 172.21.15.59:0/1318937524 wait complete. 2024-04-25T09:11:28.172 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:11:28.172 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:11:28.173 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:11:28.173 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:11:28.173 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:28.173 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:11:28.173 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:11:28.173 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:11:28.173 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:28.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:28.173 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:11:28.183 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:11:28.183 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:11:28.183 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:11:28.183 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:28.183 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:11:28.183 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:28.183 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:28.183 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:28.184 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:11:28.185 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41879sec preferred_lft 41879sec 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:11:28.186 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:11:28.187 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:11:28.188 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:11:28.188 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:28.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:28.188 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:11:28.243 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:11:28.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:28.245 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:11:28.298 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:11:28.298 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:11:28.298 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:11:28.298 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:11:28.298 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:11:28.298 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:11:28.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:28.299 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:11:28.299 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:11:28.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:11:28.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:11:28.299 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:11:28.299 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:11:28.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:28.392 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:11:28.401 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:11:28.401 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:11:28.401 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:28.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:28.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:11:28.465 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:11:28.465 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:28.517 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:28.517 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:11:28.518 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:28.569 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:11:28.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:28.569 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:28.662 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:28.662 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:28.662 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:11:28.678 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:28.678 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:28.678 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:11:28.678 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:11:28.678 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:11:28.687 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:28.687 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:28.687 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:11:28.687 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:11:28.687 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:11:28.687 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:11:28.687 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:11:28.687 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:11:28.691 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:11:28.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:28.692 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:28.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:28.711 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:11:28.768 INFO:teuthology.orchestra.run.smithi059.stdout:client9165 2024-04-25T09:11:28.768 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:28.768 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:28.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:28.818 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-04-25T09:11:28.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:28.878 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-04-25T09:11:28.980 INFO:teuthology.orchestra.run.smithi059.stderr:8+0 records in 2024-04-25T09:11:28.980 INFO:teuthology.orchestra.run.smithi059.stderr:8+0 records out 2024-04-25T09:11:28.980 INFO:teuthology.orchestra.run.smithi059.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0463981 s, 181 MB/s 2024-04-25T09:11:28.981 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:28.981 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:28.982 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:28.982 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:28.982 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T09:11:28.982 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:29.047 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627781 2024-04-25T09:11:29.050 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:29.057 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:29.057 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:29.057 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:29.057 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:29.057 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T09:11:29.057 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:29.167 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627782 2024-04-25T09:11:29.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:29.177 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:29.177 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:29.230 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:29.230 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:29.285 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:29.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.478+0000 7faa6f200640 1 Processor -- start 2024-04-25T09:11:29.468 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.478+0000 7faa6f200640 1 -- start start 2024-04-25T09:11:29.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa6f200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa680cef30 0x7faa6806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa6f200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faa6806e900 0x7faa680b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa6f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6815ac60 con 0x7faa68144140 2024-04-25T09:11:29.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa6f200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6806ed30 con 0x7faa6806e900 2024-04-25T09:11:29.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa6f200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa680cf3e0 con 0x7faa680cef30 2024-04-25T09:11:29.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa67e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7faa68144140 0x7faa680ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37878/0 (socket says 172.21.15.59:37878) 2024-04-25T09:11:29.470 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa67e00640 1 -- 172.21.15.59:0/3147343155 learned_addr learned my addr 172.21.15.59:0/3147343155 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:29.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa5f400640 1 --2- 172.21.15.59:0/3147343155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa680cef30 0x7faa6806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa6d200640 1 --2- 172.21.15.59:0/3147343155 >> v2:172.21.15.178:3300/0 conn(0x7faa6806e900 0x7faa680b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa67400640 1 -- 172.21.15.59:0/3147343155 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061114387 0 0) 0x7faa6815ac60 con 0x7faa68144140 2024-04-25T09:11:29.471 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa67400640 1 -- 172.21.15.59:0/3147343155 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa4c003530 con 0x7faa68144140 2024-04-25T09:11:29.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa5f400640 1 -- 172.21.15.59:0/3147343155 >> v2:172.21.15.178:3300/0 conn(0x7faa6806e900 msgr2=0x7faa680b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:29.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa5f400640 1 --2- 172.21.15.59:0/3147343155 >> v2:172.21.15.178:3300/0 conn(0x7faa6806e900 0x7faa680b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa5f400640 1 -- 172.21.15.59:0/3147343155 >> v1:172.21.15.59:6789/0 conn(0x7faa68144140 legacy=0x7faa680ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.482+0000 7faa5f400640 1 -- 172.21.15.59:0/3147343155 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6815af20 con 0x7faa680cef30 2024-04-25T09:11:29.473 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa5f400640 1 --2- 172.21.15.59:0/3147343155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa680cef30 0x7faa6806e3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faa500097c0 tx=0x7faa5001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=894465c1add9c6c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:29.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa67400640 1 -- 172.21.15.59:0/3147343155 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa500b0070 con 0x7faa680cef30 2024-04-25T09:11:29.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa67400640 1 -- 172.21.15.59:0/3147343155 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa500ab600 con 0x7faa680cef30 2024-04-25T09:11:29.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa67400640 1 -- 172.21.15.59:0/3147343155 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa500ab9d0 con 0x7faa680cef30 2024-04-25T09:11:29.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa6f200640 1 -- 172.21.15.59:0/3147343155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa680cef30 msgr2=0x7faa6806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa6f200640 1 --2- 172.21.15.59:0/3147343155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa680cef30 0x7faa6806e3c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faa500097c0 tx=0x7faa5001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa6f200640 1 -- 172.21.15.59:0/3147343155 shutdown_connections 2024-04-25T09:11:29.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa6f200640 1 --2- 172.21.15.59:0/3147343155 >> v2:172.21.15.178:3300/0 conn(0x7faa6806e900 0x7faa680b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa6f200640 1 --2- 172.21.15.59:0/3147343155 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa680cef30 0x7faa6806e3c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa6f200640 1 -- 172.21.15.59:0/3147343155 >> 172.21.15.59:0/3147343155 conn(0x7faa68066fa0 msgr2=0x7faa6806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:29.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa6f200640 1 -- 172.21.15.59:0/3147343155 shutdown_connections 2024-04-25T09:11:29.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa6f200640 1 -- 172.21.15.59:0/3147343155 wait complete. 2024-04-25T09:11:29.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa6f200640 1 Processor -- start 2024-04-25T09:11:29.476 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.486+0000 7faa6f200640 1 -- start start 2024-04-25T09:11:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa6f200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa6806e900 0x7faa681fa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa6f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa680cef30 0x7faa6815f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa6f200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa68144140 0x7faa68163430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa6f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6815ba00 con 0x7faa680cef30 2024-04-25T09:11:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa6f200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa68144520 con 0x7faa6806e900 2024-04-25T09:11:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa6f200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6815bb80 con 0x7faa68144140 2024-04-25T09:11:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa5f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa680cef30 0x7faa6815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.479 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa5f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa680cef30 0x7faa6815f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53600/0 (socket says 172.21.15.59:53600) 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa5f400640 1 -- 172.21.15.59:0/292174129 learned_addr learned my addr 172.21.15.59:0/292174129 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa67e00640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa6806e900 0x7faa681fa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa6d200640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa68144140 0x7faa68163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa5f400640 1 -- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa68144140 msgr2=0x7faa68163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa5f400640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa68144140 0x7faa68163430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa5f400640 1 -- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa6806e900 msgr2=0x7faa681fa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa5f400640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa6806e900 0x7faa681fa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa5f400640 1 -- 172.21.15.59:0/292174129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa680cb940 con 0x7faa680cef30 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa5f400640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa680cef30 0x7faa6815f380 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7faa500ae040 tx=0x7faa50019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa64c00640 1 -- 172.21.15.59:0/292174129 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa500ba070 con 0x7faa680cef30 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa64c00640 1 -- 172.21.15.59:0/292174129 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa500abab0 con 0x7faa680cef30 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa64c00640 1 -- 172.21.15.59:0/292174129 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa500b0040 con 0x7faa680cef30 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa6f200640 1 -- 172.21.15.59:0/292174129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa68151c60 con 0x7faa680cef30 2024-04-25T09:11:29.480 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa6f200640 1 -- 172.21.15.59:0/292174129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa68152220 con 0x7faa680cef30 2024-04-25T09:11:29.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa6f200640 1 -- 172.21.15.59:0/292174129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa680745d0 con 0x7faa680cef30 2024-04-25T09:11:29.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.490+0000 7faa64c00640 1 -- 172.21.15.59:0/292174129 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7faa500b43f0 con 0x7faa680cef30 2024-04-25T09:11:29.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.494+0000 7faa64c00640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faa44066f60 0x7faa44069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.494+0000 7faa64c00640 1 -- 172.21.15.59:0/292174129 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7faa5011dea0 con 0x7faa680cef30 2024-04-25T09:11:29.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.494+0000 7faa67e00640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faa44066f60 0x7faa44069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.483 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.494+0000 7faa67e00640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faa44066f60 0x7faa44069420 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7faa58007fd0 tx=0x7faa58009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:29.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.498+0000 7faa64c00640 1 -- 172.21.15.59:0/292174129 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7faa50016090 con 0x7faa680cef30 2024-04-25T09:11:29.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.658+0000 7faa6f200640 1 -- 172.21.15.59:0/292174129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa6806b6e0 con 0x7faa680cef30 2024-04-25T09:11:29.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa64c00640 1 -- 172.21.15.59:0/292174129 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+16952 (secure 0 0 0) 0x7faa500ee630 con 0x7faa680cef30 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:29.651 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":121,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:18.636323+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:15.429862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:16.011038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa6f200640 1 -- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faa44066f60 msgr2=0x7faa44069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa6f200640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faa44066f60 0x7faa44069420 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7faa58007fd0 tx=0x7faa58009040 comp rx=0 tx=0).stop 2024-04-25T09:11:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa6f200640 1 -- 172.21.15.59:0/292174129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa680cef30 msgr2=0x7faa6815f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa6f200640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa680cef30 0x7faa6815f380 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7faa500ae040 tx=0x7faa50019240 comp rx=0 tx=0).stop 2024-04-25T09:11:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa6f200640 1 -- 172.21.15.59:0/292174129 shutdown_connections 2024-04-25T09:11:29.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa6f200640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7faa44066f60 0x7faa44069420 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa6f200640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faa68144140 0x7faa68163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa6f200640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa680cef30 0x7faa6815f380 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa6f200640 1 --2- 172.21.15.59:0/292174129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faa6806e900 0x7faa681fa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa6f200640 1 -- 172.21.15.59:0/292174129 >> 172.21.15.59:0/292174129 conn(0x7faa68066fa0 msgr2=0x7faa6815bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa6f200640 1 -- 172.21.15.59:0/292174129 shutdown_connections 2024-04-25T09:11:29.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.662+0000 7faa6f200640 1 -- 172.21.15.59:0/292174129 wait complete. 2024-04-25T09:11:29.673 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:11:15.429862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:11:16.011038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:29.673 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:29.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.826+0000 7f616d200640 1 Processor -- start 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.826+0000 7f616d200640 1 -- start start 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f616d200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f616815d950 0x7f616806f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f616d200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61681615a0 0x7f61680cf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f616d200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61680cfc90 con 0x7f61680cdeb0 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f616d200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6168161a20 con 0x7f61681615a0 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f616d200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6168161cf0 con 0x7f616815d950 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f615ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61681615a0 0x7f61680cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f615ea00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61681615a0 0x7f61680cf750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53606/0 (socket says 172.21.15.59:53606) 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f6167e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f61680cdeb0 0x7f616806c740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:37892/0 (socket says 172.21.15.59:37892) 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f615ea00640 1 -- 172.21.15.59:0/2816526082 learned_addr learned my addr 172.21.15.59:0/2816526082 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f6167400640 1 --2- 172.21.15.59:0/2816526082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f616815d950 0x7f616806f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f615ea00640 1 -- 172.21.15.59:0/2816526082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f616815d950 msgr2=0x7f616806f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:29.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f615ea00640 1 --2- 172.21.15.59:0/2816526082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f616815d950 0x7f616806f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f615ea00640 1 -- 172.21.15.59:0/2816526082 >> v1:172.21.15.59:6789/0 conn(0x7f61680cdeb0 legacy=0x7f616806c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f6166a00640 1 -- 172.21.15.59:0/2816526082 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193578341 0 0) 0x7f61680cfc90 con 0x7f61680cdeb0 2024-04-25T09:11:29.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.830+0000 7f615ea00640 1 -- 172.21.15.59:0/2816526082 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6168161fd0 con 0x7f61681615a0 2024-04-25T09:11:29.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f615ea00640 1 --2- 172.21.15.59:0/2816526082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61681615a0 0x7f61680cf750 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f6150009870 tx=0x7f615001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dfcbdfb80480434 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:29.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f6166a00640 1 -- 172.21.15.59:0/2816526082 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61500ab650 con 0x7f61681615a0 2024-04-25T09:11:29.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f6166a00640 1 -- 172.21.15.59:0/2816526082 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61500b0070 con 0x7f61681615a0 2024-04-25T09:11:29.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f6166a00640 1 -- 172.21.15.59:0/2816526082 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61500aba10 con 0x7f61681615a0 2024-04-25T09:11:29.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 -- 172.21.15.59:0/2816526082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61681615a0 msgr2=0x7f61680cf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 --2- 172.21.15.59:0/2816526082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61681615a0 0x7f61680cf750 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f6150009870 tx=0x7f615001c560 comp rx=0 tx=0).stop 2024-04-25T09:11:29.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 -- 172.21.15.59:0/2816526082 shutdown_connections 2024-04-25T09:11:29.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 --2- 172.21.15.59:0/2816526082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61681615a0 0x7f61680cf750 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 --2- 172.21.15.59:0/2816526082 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f616815d950 0x7f616806f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 -- 172.21.15.59:0/2816526082 >> 172.21.15.59:0/2816526082 conn(0x7f61680d1630 msgr2=0x7f61680d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:29.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 -- 172.21.15.59:0/2816526082 shutdown_connections 2024-04-25T09:11:29.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 -- 172.21.15.59:0/2816526082 wait complete. 2024-04-25T09:11:29.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 Processor -- start 2024-04-25T09:11:29.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 -- start start 2024-04-25T09:11:29.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61680cdeb0 0x7f616809a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616815d950 0x7f6168158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61681615a0 0x7f616815af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616806d3e0 con 0x7f61681615a0 2024-04-25T09:11:29.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616806d260 con 0x7f616815d950 2024-04-25T09:11:29.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f616d200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616815dd30 con 0x7f61680cdeb0 2024-04-25T09:11:29.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.834+0000 7f6167e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61681615a0 0x7f616815af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f6167e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61681615a0 0x7f616815af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53618/0 (socket says 172.21.15.59:53618) 2024-04-25T09:11:29.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f6167e00640 1 -- 172.21.15.59:0/3421071837 learned_addr learned my addr 172.21.15.59:0/3421071837 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:29.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f6167400640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61680cdeb0 0x7f616809a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f615ea00640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616815d950 0x7f6168158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f6167400640 1 -- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616815d950 msgr2=0x7f6168158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f6167400640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616815d950 0x7f6168158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f6167400640 1 -- 172.21.15.59:0/3421071837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61681615a0 msgr2=0x7f616815af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f6167400640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61681615a0 0x7f616815af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f6167400640 1 -- 172.21.15.59:0/3421071837 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616809a760 con 0x7f61680cdeb0 2024-04-25T09:11:29.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f6167e00640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61681615a0 0x7f616815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:29.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f6167400640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61680cdeb0 0x7f616809a220 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f615800e8a0 tx=0x7f615800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:29.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f615fe00640 1 -- 172.21.15.59:0/3421071837 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158017070 con 0x7f61680cdeb0 2024-04-25T09:11:29.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f615fe00640 1 -- 172.21.15.59:0/3421071837 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615800c940 con 0x7f61680cdeb0 2024-04-25T09:11:29.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f616d200640 1 -- 172.21.15.59:0/3421071837 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616814f1a0 con 0x7f61680cdeb0 2024-04-25T09:11:29.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f615fe00640 1 -- 172.21.15.59:0/3421071837 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615800ccf0 con 0x7f61680cdeb0 2024-04-25T09:11:29.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f616d200640 1 -- 172.21.15.59:0/3421071837 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616814f760 con 0x7f61680cdeb0 2024-04-25T09:11:29.828 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f616d200640 1 -- 172.21.15.59:0/3421071837 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61680745d0 con 0x7f61680cdeb0 2024-04-25T09:11:29.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.838+0000 7f615fe00640 1 -- 172.21.15.59:0/3421071837 <== mon.2 v2:172.21.15.178:3301/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f615801a070 con 0x7f61680cdeb0 2024-04-25T09:11:29.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.842+0000 7f615fe00640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6144066f60 0x7f6144069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:29.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.842+0000 7f615fe00640 1 -- 172.21.15.59:0/3421071837 <== mon.2 v2:172.21.15.178:3301/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f61580858d0 con 0x7f61680cdeb0 2024-04-25T09:11:29.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.842+0000 7f615ea00640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6144066f60 0x7f6144069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:29.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.842+0000 7f615ea00640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6144066f60 0x7f6144069420 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f61500af000 tx=0x7f61500a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:29.833 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:29.842+0000 7f615fe00640 1 -- 172.21.15.59:0/3421071837 <== mon.2 v2:172.21.15.178:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f61580560e0 con 0x7f61680cdeb0 2024-04-25T09:11:29.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 -- 172.21.15.59:0/3421071837 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61680b1030 con 0x7f61680cdeb0 2024-04-25T09:11:29.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f615fe00640 1 -- 172.21.15.59:0/3421071837 <== mon.2 v2:172.21.15.178:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) v1 ==== 93+0+10 (secure 0 0 0) 0x7f615805a180 con 0x7f61680cdeb0 2024-04-25T09:11:29.995 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:11:29.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 -- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6144066f60 msgr2=0x7f6144069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6144066f60 0x7f6144069420 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f61500af000 tx=0x7f61500a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:29.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 -- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61680cdeb0 msgr2=0x7f616809a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:29.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61680cdeb0 0x7f616809a220 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f615800e8a0 tx=0x7f615800ed60 comp rx=0 tx=0).stop 2024-04-25T09:11:29.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 -- 172.21.15.59:0/3421071837 shutdown_connections 2024-04-25T09:11:29.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6144066f60 0x7f6144069420 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61681615a0 0x7f616815af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f616815d950 0x7f6168158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 --2- 172.21.15.59:0/3421071837 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f61680cdeb0 0x7f616809a220 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 -- 172.21.15.59:0/3421071837 >> 172.21.15.59:0/3421071837 conn(0x7f61680d1630 msgr2=0x7f616806f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 -- 172.21.15.59:0/3421071837 shutdown_connections 2024-04-25T09:11:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.006+0000 7f616d200640 1 -- 172.21.15.59:0/3421071837 wait complete. 2024-04-25T09:11:30.016 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:11:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f971c800640 1 Processor -- start 2024-04-25T09:11:30.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f971c800640 1 -- start start 2024-04-25T09:11:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f971c800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9714150f40 0x7f971406ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f971c800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f971415af40 0x7f9714071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f971c800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9714072040 0x7f971406d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f971c800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9714072490 con 0x7f9714150f40 2024-04-25T09:11:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f971c800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f971406f530 con 0x7f971415af40 2024-04-25T09:11:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f971c800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971415e9a0 con 0x7f9714072040 2024-04-25T09:11:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f9719e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9714150f40 0x7f971406ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f9719e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9714150f40 0x7f971406ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53624/0 (socket says 172.21.15.59:53624) 2024-04-25T09:11:30.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f9719e00640 1 -- 172.21.15.59:0/2506363311 learned_addr learned my addr 172.21.15.59:0/2506363311 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f971a800640 1 --2- 172.21.15.59:0/2506363311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9714072040 0x7f971406d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f9719400640 1 --2- 172.21.15.59:0/2506363311 >> v2:172.21.15.178:3300/0 conn(0x7f971415af40 0x7f9714071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f9719e00640 1 -- 172.21.15.59:0/2506363311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9714072040 msgr2=0x7f971406d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f9719e00640 1 --2- 172.21.15.59:0/2506363311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9714072040 0x7f971406d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f9719e00640 1 -- 172.21.15.59:0/2506363311 >> v2:172.21.15.178:3300/0 conn(0x7f971415af40 msgr2=0x7f9714071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f9719e00640 1 --2- 172.21.15.59:0/2506363311 >> v2:172.21.15.178:3300/0 conn(0x7f971415af40 0x7f9714071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.170+0000 7f9719e00640 1 -- 172.21.15.59:0/2506363311 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f971415b3d0 con 0x7f9714150f40 2024-04-25T09:11:30.163 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f9719400640 1 --2- 172.21.15.59:0/2506363311 >> v2:172.21.15.178:3300/0 conn(0x7f971415af40 0x7f9714071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:30.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f9719e00640 1 --2- 172.21.15.59:0/2506363311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9714150f40 0x7f971406ef50 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f9714072710 tx=0x7f970801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45539bfdd2ff5f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f9718a00640 1 -- 172.21.15.59:0/2506363311 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97080b0070 con 0x7f9714150f40 2024-04-25T09:11:30.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f9718a00640 1 -- 172.21.15.59:0/2506363311 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97080ab600 con 0x7f9714150f40 2024-04-25T09:11:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f9718a00640 1 -- 172.21.15.59:0/2506363311 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97080ab9d0 con 0x7f9714150f40 2024-04-25T09:11:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f971c800640 1 -- 172.21.15.59:0/2506363311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9714150f40 msgr2=0x7f971406ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f971c800640 1 --2- 172.21.15.59:0/2506363311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9714150f40 0x7f971406ef50 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f9714072710 tx=0x7f970801c400 comp rx=0 tx=0).stop 2024-04-25T09:11:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f971c800640 1 -- 172.21.15.59:0/2506363311 shutdown_connections 2024-04-25T09:11:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f971c800640 1 --2- 172.21.15.59:0/2506363311 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9714072040 0x7f971406d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f971c800640 1 --2- 172.21.15.59:0/2506363311 >> v2:172.21.15.178:3300/0 conn(0x7f971415af40 0x7f9714071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f971c800640 1 --2- 172.21.15.59:0/2506363311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9714150f40 0x7f971406ef50 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f971c800640 1 -- 172.21.15.59:0/2506363311 >> 172.21.15.59:0/2506363311 conn(0x7f9714067080 msgr2=0x7f971406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f971c800640 1 -- 172.21.15.59:0/2506363311 shutdown_connections 2024-04-25T09:11:30.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.174+0000 7f971c800640 1 -- 172.21.15.59:0/2506363311 wait complete. 2024-04-25T09:11:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971c800640 1 Processor -- start 2024-04-25T09:11:30.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971c800640 1 -- start start 2024-04-25T09:11:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971c800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9714072040 0x7f9714153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971c800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9714150f40 0x7f971414b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971415af40 0x7f971414bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97140cedd0 con 0x7f971415af40 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971c800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9714151320 con 0x7f9714072040 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971c800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97140cef50 con 0x7f9714150f40 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971415af40 0x7f971414bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971415af40 0x7f971414bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53634/0 (socket says 172.21.15.59:53634) 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971a800640 1 -- 172.21.15.59:0/3056549684 learned_addr learned my addr 172.21.15.59:0/3056549684 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f9719400640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9714150f40 0x7f971414b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f9719e00640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9714072040 0x7f9714153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971a800640 1 -- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9714150f40 msgr2=0x7f971414b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971a800640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9714150f40 0x7f971414b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971a800640 1 -- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9714072040 msgr2=0x7f9714153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971a800640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9714072040 0x7f9714153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971a800640 1 -- 172.21.15.59:0/3056549684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9714154290 con 0x7f971415af40 2024-04-25T09:11:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f9719400640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9714150f40 0x7f971414b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f9719e00640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9714072040 0x7f9714153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971a800640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971415af40 0x7f971414bcc0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f9710007d50 tx=0x7f971000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f970e000640 1 -- 172.21.15.59:0/3056549684 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710014420 con 0x7f971415af40 2024-04-25T09:11:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f970e000640 1 -- 172.21.15.59:0/3056549684 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9710019070 con 0x7f971415af40 2024-04-25T09:11:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971c800640 1 -- 172.21.15.59:0/3056549684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9714156660 con 0x7f971415af40 2024-04-25T09:11:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f970e000640 1 -- 172.21.15.59:0/3056549684 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9710014820 con 0x7f971415af40 2024-04-25T09:11:30.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.178+0000 7f971c800640 1 -- 172.21.15.59:0/3056549684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9714148da0 con 0x7f971415af40 2024-04-25T09:11:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.182+0000 7f971c800640 1 -- 172.21.15.59:0/3056549684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97140745d0 con 0x7f971415af40 2024-04-25T09:11:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.182+0000 7f970e000640 1 -- 172.21.15.59:0/3056549684 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f97100149c0 con 0x7f971415af40 2024-04-25T09:11:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.182+0000 7f970e000640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f96f8066f60 0x7f96f8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.182+0000 7f970e000640 1 -- 172.21.15.59:0/3056549684 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f9710085970 con 0x7f971415af40 2024-04-25T09:11:30.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.182+0000 7f9719e00640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f96f8066f60 0x7f96f8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.173 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.182+0000 7f9719e00640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f96f8066f60 0x7f96f8069420 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f97080ad000 tx=0x7f9708008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.186+0000 7f970e000640 1 -- 172.21.15.59:0/3056549684 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9714154290 con 0x7f971415af40 2024-04-25T09:11:30.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.346+0000 7f971c800640 1 -- 172.21.15.59:0/3056549684 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97140b0bb0 con 0x7f971415af40 2024-04-25T09:11:30.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.346+0000 7f970e000640 1 -- 172.21.15.59:0/3056549684 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v121) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97100567e0 con 0x7f971415af40 2024-04-25T09:11:30.337 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:11:30.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.350+0000 7f971c800640 1 -- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f96f8066f60 msgr2=0x7f96f8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.350+0000 7f971c800640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f96f8066f60 0x7f96f8069420 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f97080ad000 tx=0x7f9708008040 comp rx=0 tx=0).stop 2024-04-25T09:11:30.339 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.350+0000 7f971c800640 1 -- 172.21.15.59:0/3056549684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971415af40 msgr2=0x7f971414bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.350+0000 7f971c800640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971415af40 0x7f971414bcc0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f9710007d50 tx=0x7f971000e4b0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.350+0000 7f971c800640 1 -- 172.21.15.59:0/3056549684 shutdown_connections 2024-04-25T09:11:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.350+0000 7f971c800640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f96f8066f60 0x7f96f8069420 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.350+0000 7f971c800640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f971415af40 0x7f971414bcc0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.350+0000 7f971c800640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9714150f40 0x7f971414b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.350+0000 7f971c800640 1 --2- 172.21.15.59:0/3056549684 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9714072040 0x7f9714153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.350+0000 7f971c800640 1 -- 172.21.15.59:0/3056549684 >> 172.21.15.59:0/3056549684 conn(0x7f9714067080 msgr2=0x7f971414ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.350+0000 7f971c800640 1 -- 172.21.15.59:0/3056549684 shutdown_connections 2024-04-25T09:11:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.350+0000 7f971c800640 1 -- 172.21.15.59:0/3056549684 wait complete. 2024-04-25T09:11:30.359 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:11:30.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb07c00640 1 Processor -- start 2024-04-25T09:11:30.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb07c00640 1 -- start start 2024-04-25T09:11:30.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb07c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb00144120 0x7fcb0015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb07c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb000b3090 0x7fcb000b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb07c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0015bc40 con 0x7fcb000ccbf0 2024-04-25T09:11:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb07c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0015e490 con 0x7fcb000b3090 2024-04-25T09:11:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb07c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0015b3a0 con 0x7fcb00144120 2024-04-25T09:11:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb05c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb000b3090 0x7fcb000b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb05c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb000b3090 0x7fcb000b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46536/0 (socket says 172.21.15.59:46536) 2024-04-25T09:11:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb05c00640 1 -- 172.21.15.59:0/281711486 learned_addr learned my addr 172.21.15.59:0/281711486 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb05200640 1 --2- 172.21.15.59:0/281711486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb00144120 0x7fcb0015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb05c00640 1 -- 172.21.15.59:0/281711486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb00144120 msgr2=0x7fcb0015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:30.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb05c00640 1 --2- 172.21.15.59:0/281711486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb00144120 0x7fcb0015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb05c00640 1 -- 172.21.15.59:0/281711486 >> v1:172.21.15.178:6789/0 conn(0x7fcb000ccbf0 legacy=0x7fcb0015e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.514+0000 7fcb05c00640 1 -- 172.21.15.59:0/281711486 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0015b680 con 0x7fcb000b3090 2024-04-25T09:11:30.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcb05c00640 1 --2- 172.21.15.59:0/281711486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb000b3090 0x7fcb000b34f0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800d150 tx=0x7fcaf801eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a570f8f0a20f898 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcaff400640 1 -- 172.21.15.59:0/281711486 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800b2d0 con 0x7fcb000b3090 2024-04-25T09:11:30.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcaff400640 1 -- 172.21.15.59:0/281711486 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf800b470 con 0x7fcb000b3090 2024-04-25T09:11:30.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcaff400640 1 -- 172.21.15.59:0/281711486 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80a7aa0 con 0x7fcb000b3090 2024-04-25T09:11:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcb07c00640 1 -- 172.21.15.59:0/281711486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb000b3090 msgr2=0x7fcb000b34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcb07c00640 1 --2- 172.21.15.59:0/281711486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb000b3090 0x7fcb000b34f0 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800d150 tx=0x7fcaf801eba0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcb07c00640 1 -- 172.21.15.59:0/281711486 shutdown_connections 2024-04-25T09:11:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcb07c00640 1 --2- 172.21.15.59:0/281711486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb000b3090 0x7fcb000b34f0 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcb07c00640 1 --2- 172.21.15.59:0/281711486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb00144120 0x7fcb0015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcb07c00640 1 -- 172.21.15.59:0/281711486 >> 172.21.15.59:0/281711486 conn(0x7fcb00067080 msgr2=0x7fcb0006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcb07c00640 1 -- 172.21.15.59:0/281711486 shutdown_connections 2024-04-25T09:11:30.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcb07c00640 1 -- 172.21.15.59:0/281711486 wait complete. 2024-04-25T09:11:30.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcb07c00640 1 Processor -- start 2024-04-25T09:11:30.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.518+0000 7fcb07c00640 1 -- start start 2024-04-25T09:11:30.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcb07c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb000b3090 0x7fcb000b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcb07c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb000ccbf0 0x7fcb00155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcb07c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb00144120 0x7fcb00137990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcb07c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0006dc60 con 0x7fcb000ccbf0 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcb07c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0006dae0 con 0x7fcb00144120 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcb07c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0006dde0 con 0x7fcb000b3090 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcaffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb000ccbf0 0x7fcb00155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcaffe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb000ccbf0 0x7fcb00155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46544/0 (socket says 172.21.15.59:46544) 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcb05200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb000b3090 0x7fcb000b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcaffe00640 1 -- 172.21.15.59:0/1361206026 learned_addr learned my addr 172.21.15.59:0/1361206026 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcb05c00640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb00144120 0x7fcb00137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcaffe00640 1 -- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb000b3090 msgr2=0x7fcb000b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcaffe00640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb000b3090 0x7fcb000b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcaffe00640 1 -- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb00144120 msgr2=0x7fcb00137990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcaffe00640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb00144120 0x7fcb00137990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcaffe00640 1 -- 172.21.15.59:0/1361206026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb00159cd0 con 0x7fcb000ccbf0 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcaffe00640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb000ccbf0 0x7fcb00155ed0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00c420 tx=0x7fcaec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcafcc00640 1 -- 172.21.15.59:0/1361206026 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec0052d0 con 0x7fcb000ccbf0 2024-04-25T09:11:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcafcc00640 1 -- 172.21.15.59:0/1361206026 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaec005470 con 0x7fcb000ccbf0 2024-04-25T09:11:30.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcb07c00640 1 -- 172.21.15.59:0/1361206026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb00159f40 con 0x7fcb000ccbf0 2024-04-25T09:11:30.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcafcc00640 1 -- 172.21.15.59:0/1361206026 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaec007260 con 0x7fcb000ccbf0 2024-04-25T09:11:30.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcb07c00640 1 -- 172.21.15.59:0/1361206026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb000b2150 con 0x7fcb000ccbf0 2024-04-25T09:11:30.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcb07c00640 1 -- 172.21.15.59:0/1361206026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb000745d0 con 0x7fcb000ccbf0 2024-04-25T09:11:30.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.522+0000 7fcafcc00640 1 -- 172.21.15.59:0/1361206026 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcaec007400 con 0x7fcb000ccbf0 2024-04-25T09:11:30.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.526+0000 7fcafcc00640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcae0066f60 0x7fcae0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.526+0000 7fcafcc00640 1 -- 172.21.15.59:0/1361206026 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7fcaec084650 con 0x7fcb000ccbf0 2024-04-25T09:11:30.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.526+0000 7fcb05200640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcae0066f60 0x7fcae0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.526+0000 7fcb05200640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcae0066f60 0x7fcae0069420 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcb0013cbe0 tx=0x7fcaf4009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.530+0000 7fcafcc00640 1 -- 172.21.15.59:0/1361206026 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcaec054e70 con 0x7fcb000ccbf0 2024-04-25T09:11:30.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 -- 172.21.15.59:0/1361206026 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb0006c250 con 0x7fcb000ccbf0 2024-04-25T09:11:30.678 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcafcc00640 1 -- 172.21.15.59:0/1361206026 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v121) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcaec058f10 con 0x7fcb000ccbf0 2024-04-25T09:11:30.679 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:11:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 -- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcae0066f60 msgr2=0x7fcae0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcae0066f60 0x7fcae0069420 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcb0013cbe0 tx=0x7fcaf4009190 comp rx=0 tx=0).stop 2024-04-25T09:11:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 -- 172.21.15.59:0/1361206026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb000ccbf0 msgr2=0x7fcb00155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb000ccbf0 0x7fcb00155ed0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fcaec00c420 tx=0x7fcaec00c8e0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 -- 172.21.15.59:0/1361206026 shutdown_connections 2024-04-25T09:11:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcae0066f60 0x7fcae0069420 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb00144120 0x7fcb00137990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb000ccbf0 0x7fcb00155ed0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 --2- 172.21.15.59:0/1361206026 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb000b3090 0x7fcb000b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 -- 172.21.15.59:0/1361206026 >> 172.21.15.59:0/1361206026 conn(0x7fcb00067080 msgr2=0x7fcb001385e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 -- 172.21.15.59:0/1361206026 shutdown_connections 2024-04-25T09:11:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.690+0000 7fcb07c00640 1 -- 172.21.15.59:0/1361206026 wait complete. 2024-04-25T09:11:30.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:11:30.842 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.850+0000 7f0fe0e00640 1 Processor -- start 2024-04-25T09:11:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.850+0000 7f0fe0e00640 1 -- start start 2024-04-25T09:11:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fe0e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fdc15c9b0 0x7f0fdc06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fe0e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0fdc06e010 0x7f0fdc06e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fe0e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc15fc00 con 0x7f0fdc159320 2024-04-25T09:11:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fe0e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fdc06d640 con 0x7f0fdc06e010 2024-04-25T09:11:30.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fe0e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc15fee0 con 0x7f0fdc15c9b0 2024-04-25T09:11:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fd1400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fdc15c9b0 0x7f0fdc06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fd1400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fdc15c9b0 0x7f0fdc06dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:34842/0 (socket says 172.21.15.59:34842) 2024-04-25T09:11:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fd1400640 1 -- 172.21.15.59:0/2433491583 learned_addr learned my addr 172.21.15.59:0/2433491583 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fda800640 1 --2- 172.21.15.59:0/2433491583 >> v2:172.21.15.178:3300/0 conn(0x7f0fdc06e010 0x7f0fdc06e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fd1400640 1 -- 172.21.15.59:0/2433491583 >> v2:172.21.15.178:3300/0 conn(0x7f0fdc06e010 msgr2=0x7f0fdc06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fd1400640 1 --2- 172.21.15.59:0/2433491583 >> v2:172.21.15.178:3300/0 conn(0x7f0fdc06e010 0x7f0fdc06e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fd1400640 1 -- 172.21.15.59:0/2433491583 >> v1:172.21.15.178:6789/0 conn(0x7f0fdc159320 legacy=0x7f0fdc15f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fd1400640 1 -- 172.21.15.59:0/2433491583 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc1601c0 con 0x7f0fdc15c9b0 2024-04-25T09:11:30.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.854+0000 7f0fda800640 1 --2- 172.21.15.59:0/2433491583 >> v2:172.21.15.178:3300/0 conn(0x7f0fdc06e010 0x7f0fdc06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:30.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fd1400640 1 --2- 172.21.15.59:0/2433491583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fdc15c9b0 0x7f0fdc06dad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009e50 tx=0x7f0fc401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ff89d3c96552416 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fd9400640 1 -- 172.21.15.59:0/2433491583 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40a5700 con 0x7f0fdc15c9b0 2024-04-25T09:11:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fd9400640 1 -- 172.21.15.59:0/2433491583 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc40a58a0 con 0x7f0fdc15c9b0 2024-04-25T09:11:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fd9400640 1 -- 172.21.15.59:0/2433491583 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc40a5c70 con 0x7f0fdc15c9b0 2024-04-25T09:11:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fe0e00640 1 -- 172.21.15.59:0/2433491583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fdc15c9b0 msgr2=0x7f0fdc06dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fe0e00640 1 --2- 172.21.15.59:0/2433491583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fdc15c9b0 0x7f0fdc06dad0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009e50 tx=0x7f0fc401ca30 comp rx=0 tx=0).stop 2024-04-25T09:11:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fe0e00640 1 -- 172.21.15.59:0/2433491583 shutdown_connections 2024-04-25T09:11:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fe0e00640 1 --2- 172.21.15.59:0/2433491583 >> v2:172.21.15.178:3300/0 conn(0x7f0fdc06e010 0x7f0fdc06e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fe0e00640 1 --2- 172.21.15.59:0/2433491583 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fdc15c9b0 0x7f0fdc06dad0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fe0e00640 1 -- 172.21.15.59:0/2433491583 >> 172.21.15.59:0/2433491583 conn(0x7f0fdc067080 msgr2=0x7f0fdc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:30.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fe0e00640 1 -- 172.21.15.59:0/2433491583 shutdown_connections 2024-04-25T09:11:30.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fe0e00640 1 -- 172.21.15.59:0/2433491583 wait complete. 2024-04-25T09:11:30.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fe0e00640 1 Processor -- start 2024-04-25T09:11:30.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.858+0000 7f0fe0e00640 1 -- start start 2024-04-25T09:11:30.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fe0e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fdc06e010 0x7f0fdc158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fe0e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fdc159320 0x7f0fdc141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fe0e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fdc15c9b0 0x7f0fdc142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fe0e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc168920 con 0x7f0fdc06e010 2024-04-25T09:11:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fe0e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc1687a0 con 0x7f0fdc15c9b0 2024-04-25T09:11:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fe0e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc168aa0 con 0x7f0fdc159320 2024-04-25T09:11:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fdc06e010 0x7f0fdc158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd9e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fdc06e010 0x7f0fdc158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46556/0 (socket says 172.21.15.59:46556) 2024-04-25T09:11:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd9e00640 1 -- 172.21.15.59:0/3407570938 learned_addr learned my addr 172.21.15.59:0/3407570938 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fda800640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fdc15c9b0 0x7f0fdc142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd1400640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fdc159320 0x7f0fdc141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd9e00640 1 -- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fdc159320 msgr2=0x7f0fdc141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd9e00640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fdc159320 0x7f0fdc141ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd9e00640 1 -- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fdc15c9b0 msgr2=0x7f0fdc142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd9e00640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fdc15c9b0 0x7f0fdc142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd9e00640 1 -- 172.21.15.59:0/3407570938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc13fda0 con 0x7f0fdc06e010 2024-04-25T09:11:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd9e00640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fdc06e010 0x7f0fdc158200 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc00c450 tx=0x7f0fcc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd2a00640 1 -- 172.21.15.59:0/3407570938 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc0052d0 con 0x7f0fdc06e010 2024-04-25T09:11:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd2a00640 1 -- 172.21.15.59:0/3407570938 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc005470 con 0x7f0fdc06e010 2024-04-25T09:11:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fe0e00640 1 -- 172.21.15.59:0/3407570938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fdc140080 con 0x7f0fdc06e010 2024-04-25T09:11:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fd2a00640 1 -- 172.21.15.59:0/3407570938 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc007260 con 0x7f0fdc06e010 2024-04-25T09:11:30.853 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fe0e00640 1 -- 172.21.15.59:0/3407570938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc140640 con 0x7f0fdc06e010 2024-04-25T09:11:30.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.862+0000 7f0fe0e00640 1 -- 172.21.15.59:0/3407570938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fdc0745d0 con 0x7f0fdc06e010 2024-04-25T09:11:30.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.866+0000 7f0fd2a00640 1 -- 172.21.15.59:0/3407570938 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0fcc007400 con 0x7f0fdc06e010 2024-04-25T09:11:30.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.866+0000 7f0fd2a00640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0fb8066f60 0x7f0fb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:30.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.866+0000 7f0fd2a00640 1 -- 172.21.15.59:0/3407570938 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f0fcc0845f0 con 0x7f0fdc06e010 2024-04-25T09:11:30.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.866+0000 7f0fd1400640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0fb8066f60 0x7f0fb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:30.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.866+0000 7f0fd1400640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0fb8066f60 0x7f0fb8069420 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40ae000 tx=0x7f0fc40a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:30.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:30.870+0000 7f0fd2a00640 1 -- 172.21.15.59:0/3407570938 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0fcc054d80 con 0x7f0fdc06e010 2024-04-25T09:11:31.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 -- 172.21.15.59:0/3407570938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0fdc06ad80 con 0x7f0fdc06e010 2024-04-25T09:11:31.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fd2a00640 1 -- 172.21.15.59:0/3407570938 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v121) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0fcc05b0d0 con 0x7f0fdc06e010 2024-04-25T09:11:31.034 INFO:teuthology.orchestra.run.smithi059.stderr:listed 0 entries 2024-04-25T09:11:31.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 -- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0fb8066f60 msgr2=0x7f0fb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0fb8066f60 0x7f0fb8069420 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0fc40ae000 tx=0x7f0fc40a7070 comp rx=0 tx=0).stop 2024-04-25T09:11:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 -- 172.21.15.59:0/3407570938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fdc06e010 msgr2=0x7f0fdc158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fdc06e010 0x7f0fdc158200 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc00c450 tx=0x7f0fcc00c850 comp rx=0 tx=0).stop 2024-04-25T09:11:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 -- 172.21.15.59:0/3407570938 shutdown_connections 2024-04-25T09:11:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0fb8066f60 0x7f0fb8069420 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0fdc15c9b0 0x7f0fdc142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0fdc159320 0x7f0fdc141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 --2- 172.21.15.59:0/3407570938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0fdc06e010 0x7f0fdc158200 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 -- 172.21.15.59:0/3407570938 >> 172.21.15.59:0/3407570938 conn(0x7f0fdc067080 msgr2=0x7f0fdc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 -- 172.21.15.59:0/3407570938 shutdown_connections 2024-04-25T09:11:31.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.046+0000 7f0fe0e00640 1 -- 172.21.15.59:0/3407570938 wait complete. 2024-04-25T09:11:31.055 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:11:31.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:31.056 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:31.189 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:11:31.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:31.189 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:11:31.210 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:31.210 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:31.266 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:11:31.266 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:11:31.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:31.266 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:11:31.321 INFO:teuthology.orchestra.run.smithi059.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T09:11:31.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:11:31.322 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:11:31.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b76600640 1 Processor -- start 2024-04-25T09:11:31.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b76600640 1 -- start start 2024-04-25T09:11:31.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b76600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4b7015dc00 0x7f4b700af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b76600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 0x7f4b700c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b76600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b700b30d0 con 0x7f4b700c70d0 2024-04-25T09:11:31.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b76600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b700cd860 con 0x7f4b7015dc00 2024-04-25T09:11:31.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b76600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700ccf30 con 0x7f4b700d0150 2024-04-25T09:11:31.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b6ea00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 0x7f4b700c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b6f400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4b7015dc00 0x7f4b700af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b6fe00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f4b700c70d0 0x7f4b7006ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:57726/0 (socket says 172.21.15.59:57726) 2024-04-25T09:11:31.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b6fe00640 1 -- 172.21.15.59:0/897337175 learned_addr learned my addr 172.21.15.59:0/897337175 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:31.512 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b6ea00640 1 --2- 172.21.15.59:0/897337175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 0x7f4b700c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:34858/0 (socket says 172.21.15.59:34858) 2024-04-25T09:11:31.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b6e000640 1 -- 172.21.15.59:0/897337175 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506129089 0 0) 0x7f4b700b30d0 con 0x7f4b700c70d0 2024-04-25T09:11:31.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b6e000640 1 -- 172.21.15.59:0/897337175 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b54003530 con 0x7f4b700c70d0 2024-04-25T09:11:31.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b6ea00640 1 -- 172.21.15.59:0/897337175 >> v2:172.21.15.178:3300/0 conn(0x7f4b7015dc00 msgr2=0x7f4b700af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:31.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b6ea00640 1 --2- 172.21.15.59:0/897337175 >> v2:172.21.15.178:3300/0 conn(0x7f4b7015dc00 0x7f4b700af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b6ea00640 1 -- 172.21.15.59:0/897337175 >> v1:172.21.15.178:6789/0 conn(0x7f4b700c70d0 legacy=0x7f4b7006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b6ea00640 1 -- 172.21.15.59:0/897337175 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b700cd210 con 0x7f4b700d0150 2024-04-25T09:11:31.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.522+0000 7f4b6f400640 1 --2- 172.21.15.59:0/897337175 >> v2:172.21.15.178:3300/0 conn(0x7f4b7015dc00 0x7f4b700af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:31.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.526+0000 7f4b6ea00640 1 --2- 172.21.15.59:0/897337175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 0x7f4b700c6b90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0097c0 tx=0x7f4b5c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5452c0f2b8d200d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.526+0000 7f4b6e000640 1 -- 172.21.15.59:0/897337175 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c0b0070 con 0x7f4b700d0150 2024-04-25T09:11:31.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.526+0000 7f4b6e000640 1 -- 172.21.15.59:0/897337175 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5c0a4e50 con 0x7f4b700d0150 2024-04-25T09:11:31.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.526+0000 7f4b6e000640 1 -- 172.21.15.59:0/897337175 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c0ab820 con 0x7f4b700d0150 2024-04-25T09:11:31.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.526+0000 7f4b76600640 1 -- 172.21.15.59:0/897337175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 msgr2=0x7f4b700c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.526+0000 7f4b76600640 1 --2- 172.21.15.59:0/897337175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 0x7f4b700c6b90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0097c0 tx=0x7f4b5c01c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.526+0000 7f4b76600640 1 -- 172.21.15.59:0/897337175 shutdown_connections 2024-04-25T09:11:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.526+0000 7f4b76600640 1 --2- 172.21.15.59:0/897337175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 0x7f4b700c6b90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.526+0000 7f4b76600640 1 --2- 172.21.15.59:0/897337175 >> v2:172.21.15.178:3300/0 conn(0x7f4b7015dc00 0x7f4b700af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.526+0000 7f4b76600640 1 -- 172.21.15.59:0/897337175 >> 172.21.15.59:0/897337175 conn(0x7f4b700b2240 msgr2=0x7f4b700b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.526+0000 7f4b76600640 1 -- 172.21.15.59:0/897337175 shutdown_connections 2024-04-25T09:11:31.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.526+0000 7f4b76600640 1 -- 172.21.15.59:0/897337175 wait complete. 2024-04-25T09:11:31.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b76600640 1 Processor -- start 2024-04-25T09:11:31.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b76600640 1 -- start start 2024-04-25T09:11:31.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b76600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b700c70d0 0x7f4b700b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b76600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 0x7f4b701514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b76600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b7015dc00 0x7f4b70153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b76600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700c74e0 con 0x7f4b700c70d0 2024-04-25T09:11:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b76600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700cdee0 con 0x7f4b7015dc00 2024-04-25T09:11:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b76600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7016a640 con 0x7f4b700d0150 2024-04-25T09:11:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b6f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b700c70d0 0x7f4b700b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b6f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b700c70d0 0x7f4b700b4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46570/0 (socket says 172.21.15.59:46570) 2024-04-25T09:11:31.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b6f400640 1 -- 172.21.15.59:0/4062074044 learned_addr learned my addr 172.21.15.59:0/4062074044 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b6fe00640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b7015dc00 0x7f4b70153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b6ea00640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 0x7f4b701514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b6f400640 1 -- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 msgr2=0x7f4b701514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b6f400640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 0x7f4b701514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b6f400640 1 -- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b7015dc00 msgr2=0x7f4b70153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b6f400640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b7015dc00 0x7f4b70153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b6f400640 1 -- 172.21.15.59:0/4062074044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b700b3ee0 con 0x7f4b700c70d0 2024-04-25T09:11:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b6ea00640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 0x7f4b701514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b6f400640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b700c70d0 0x7f4b700b4f80 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f4b6000e9b0 tx=0x7f4b6000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b67400640 1 -- 172.21.15.59:0/4062074044 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b60017070 con 0x7f4b700c70d0 2024-04-25T09:11:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b67400640 1 -- 172.21.15.59:0/4062074044 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6000c9a0 con 0x7f4b700c70d0 2024-04-25T09:11:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b67400640 1 -- 172.21.15.59:0/4062074044 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6000cd70 con 0x7f4b700c70d0 2024-04-25T09:11:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b76600640 1 -- 172.21.15.59:0/4062074044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b700b41c0 con 0x7f4b700c70d0 2024-04-25T09:11:31.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.530+0000 7f4b76600640 1 -- 172.21.15.59:0/4062074044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b700b4780 con 0x7f4b700c70d0 2024-04-25T09:11:31.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.534+0000 7f4b76600640 1 -- 172.21.15.59:0/4062074044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b700745d0 con 0x7f4b700c70d0 2024-04-25T09:11:31.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.534+0000 7f4b67400640 1 -- 172.21.15.59:0/4062074044 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4b6001a070 con 0x7f4b700c70d0 2024-04-25T09:11:31.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.534+0000 7f4b67400640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b50066f60 0x7f4b50069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:31.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.534+0000 7f4b67400640 1 -- 172.21.15.59:0/4062074044 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6101+0+0 (secure 0 0 0) 0x7f4b600854a0 con 0x7f4b700c70d0 2024-04-25T09:11:31.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.534+0000 7f4b6ea00640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b50066f60 0x7f4b50069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:31.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.534+0000 7f4b6ea00640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b50066f60 0x7f4b50069420 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0ad000 tx=0x7f4b5c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:31.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.538+0000 7f4b67400640 1 -- 172.21.15.59:0/4062074044 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b60056280 con 0x7f4b700c70d0 2024-04-25T09:11:31.726 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.738+0000 7f4b76600640 1 -- 172.21.15.59:0/4062074044 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4b70158490 con 0x7f4b700c70d0 2024-04-25T09:11:31.727 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:11:31.738+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:11:31.728 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.738+0000 7f4b67400640 1 -- 172.21.15.59:0/4062074044 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v105) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4b60055b80 con 0x7f4b700c70d0 2024-04-25T09:11:31.728 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:11:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.742+0000 7f4b76600640 1 -- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b50066f60 msgr2=0x7f4b50069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.742+0000 7f4b76600640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b50066f60 0x7f4b50069420 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0ad000 tx=0x7f4b5c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:11:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.742+0000 7f4b76600640 1 -- 172.21.15.59:0/4062074044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b700c70d0 msgr2=0x7f4b700b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.742+0000 7f4b76600640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b700c70d0 0x7f4b700b4f80 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f4b6000e9b0 tx=0x7f4b6000ee70 comp rx=0 tx=0).stop 2024-04-25T09:11:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.742+0000 7f4b76600640 1 -- 172.21.15.59:0/4062074044 shutdown_connections 2024-04-25T09:11:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.742+0000 7f4b76600640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b50066f60 0x7f4b50069420 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.742+0000 7f4b76600640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b7015dc00 0x7f4b70153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.742+0000 7f4b76600640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b700d0150 0x7f4b701514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.731 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.742+0000 7f4b76600640 1 --2- 172.21.15.59:0/4062074044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b700c70d0 0x7f4b700b4f80 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:31.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.742+0000 7f4b76600640 1 -- 172.21.15.59:0/4062074044 >> 172.21.15.59:0/4062074044 conn(0x7f4b700b2240 msgr2=0x7f4b7006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:31.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.742+0000 7f4b76600640 1 -- 172.21.15.59:0/4062074044 shutdown_connections 2024-04-25T09:11:31.732 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:31.742+0000 7f4b76600640 1 -- 172.21.15.59:0/4062074044 wait complete. 2024-04-25T09:11:31.744 INFO:tasks.ceph.mds.a.smithi059.stderr: -8277> 2024-04-25T09:11:19.594+0000 7fb9f9200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:11:31.752 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:11:31.755 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:11:31.797 INFO:tasks.ceph.mds.a.smithi059.stdout:starting mds.a at 2024-04-25T09:11:31.797 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2024-04-25T09:11:31.798 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:11:31.799 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on skipped message = False 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:11:31.800 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug trim objects = true 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2024-04-25T09:11:31.801 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2024-04-25T09:11:31.802 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-25T09:11:31.803 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:31.804 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.805 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = "" 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2024-04-25T09:11:31.806 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds balancer = 20 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = False 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-04-25T09:11:31.807 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-04-25T09:11:31.808 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2024-04-25T09:11:31.808 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2024-04-25T09:11:31.808 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:11:31.808 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2024-04-25T09:11:31.808 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.808 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2024-04-25T09:11:31.808 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.808 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2024-04-25T09:11:31.808 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2024-04-25T09:11:31.809 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2024-04-25T09:11:31.810 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.59,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2024-04-25T09:11:31.811 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug trim objects = true 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.812 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 20 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 20 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 10 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:11:31.813 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2024-04-25T09:11:31.814 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.815 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-04-25T09:11:31.816 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds balancer = 20 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = True 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = False 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-04-25T09:11:31.817 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-04-25T09:11:31.820 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:11:31.864 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:11:31.904 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:11:31.905 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:11:31.906 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on skipped message = False 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:11:31.907 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug trim objects = true 2024-04-25T09:11:31.908 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2024-04-25T09:11:31.909 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2024-04-25T09:11:31.910 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:31.911 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2024-04-25T09:11:31.912 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = "" 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2024-04-25T09:11:31.913 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2024-04-25T09:11:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds balancer = 20 2024-04-25T09:11:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2024-04-25T09:11:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = False 2024-04-25T09:11:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2024-04-25T09:11:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = False 2024-04-25T09:11:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-04-25T09:11:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-04-25T09:11:31.914 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-04-25T09:11:31.914 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2024-04-25T09:11:31.915 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2024-04-25T09:11:31.916 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2024-04-25T09:11:31.917 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.59,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.918 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug trim objects = true 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.919 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 20 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 20 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 10 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:11:31.920 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:31.921 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:11:31.922 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2024-04-25T09:11:31.923 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds balancer = 20 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = False 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2024-04-25T09:11:31.924 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = False 2024-04-25T09:11:31.925 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-04-25T09:11:31.925 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-04-25T09:11:31.925 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-04-25T09:11:31.926 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-04-25T09:11:32.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe735ae2080 1 Processor -- start 2024-04-25T09:11:32.016 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe735ae2080 1 -- start start 2024-04-25T09:11:32.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe735ae2080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c375007e80 0x55c3750bc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe735ae2080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3750bd490 0x55c3750bcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe735ae2080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3750bd870 0x55c375032e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe735ae2080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3750bfb90 con 0x55c375007e80 2024-04-25T09:11:32.017 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe735ae2080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c374fab9f0 con 0x55c3750bd870 2024-04-25T09:11:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe735ae2080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3750be3b0 con 0x55c3750bd490 2024-04-25T09:11:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe732e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c375007e80 0x55c3750bc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe732e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c375007e80 0x55c3750bc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46584/0 (socket says 172.21.15.59:46584) 2024-04-25T09:11:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe732e00640 1 -- 172.21.15.59:0/4176297553 learned_addr learned my addr 172.21.15.59:0/4176297553 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe733800640 1 --2- 172.21.15.59:0/4176297553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3750bd870 0x55c375032e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe732e00640 1 -- 172.21.15.59:0/4176297553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3750bd490 msgr2=0x55c3750bcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe732e00640 1 --2- 172.21.15.59:0/4176297553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3750bd490 0x55c3750bcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe732e00640 1 -- 172.21.15.59:0/4176297553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3750bd870 msgr2=0x55c375032e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe732e00640 1 --2- 172.21.15.59:0/4176297553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3750bd870 0x55c375032e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe732e00640 1 -- 172.21.15.59:0/4176297553 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c3750dab10 con 0x55c375007e80 2024-04-25T09:11:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.026+0000 7fe733800640 1 --2- 172.21.15.59:0/4176297553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3750bd870 0x55c375032e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:32.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe732e00640 1 --2- 172.21.15.59:0/4176297553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c375007e80 0x55c3750bc5e0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fe7240097a0 tx=0x7fe724009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee0fae58d6ea700 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe731000640 1 -- 172.21.15.59:0/4176297553 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724017070 con 0x55c375007e80 2024-04-25T09:11:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe731000640 1 -- 172.21.15.59:0/4176297553 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe724009e50 con 0x55c375007e80 2024-04-25T09:11:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe731000640 1 -- 172.21.15.59:0/4176297553 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe724006b70 con 0x55c375007e80 2024-04-25T09:11:32.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 -- 172.21.15.59:0/4176297553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c375007e80 msgr2=0x55c3750bc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 --2- 172.21.15.59:0/4176297553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c375007e80 0x55c3750bc5e0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fe7240097a0 tx=0x7fe724009c60 comp rx=0 tx=0).stop 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 -- 172.21.15.59:0/4176297553 shutdown_connections 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 --2- 172.21.15.59:0/4176297553 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3750bd870 0x55c375032e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 --2- 172.21.15.59:0/4176297553 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c3750bd490 0x55c3750bcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 --2- 172.21.15.59:0/4176297553 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c375007e80 0x55c3750bc5e0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 -- 172.21.15.59:0/4176297553 >> 172.21.15.59:0/4176297553 conn(0x55c375005400 msgr2=0x55c3750bbed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 -- 172.21.15.59:0/4176297553 shutdown_connections 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 -- 172.21.15.59:0/4176297553 wait complete. 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 Processor -- start 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 -- start start 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c375007e80 0x55c375178700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3750bd490 0x55c37504a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3750bd870 0x55c37504c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3750dadb0 con 0x55c3750bd870 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c3750dc110 con 0x55c3750bd490 2024-04-25T09:11:32.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c3750db2a0 con 0x55c375007e80 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe733800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3750bd870 0x55c37504c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe733800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3750bd870 0x55c37504c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46594/0 (socket says 172.21.15.59:46594) 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe733800640 1 -- 172.21.15.59:0/58430249 learned_addr learned my addr 172.21.15.59:0/58430249 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe732400640 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3750bd490 0x55c37504a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe732e00640 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c375007e80 0x55c375178700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe733800640 1 -- 172.21.15.59:0/58430249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c375007e80 msgr2=0x55c375178700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe733800640 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c375007e80 0x55c375178700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe733800640 1 -- 172.21.15.59:0/58430249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3750bd490 msgr2=0x55c37504a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe733800640 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c3750bd490 0x55c37504a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe733800640 1 -- 172.21.15.59:0/58430249 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c37504b210 con 0x55c3750bd870 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe732e00640 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c375007e80 0x55c375178700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe733800640 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3750bd870 0x55c37504c5f0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00a3f0 tx=0x7fe72c017df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe72b400640 1 -- 172.21.15.59:0/58430249 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0b8030 con 0x55c3750bd870 2024-04-25T09:11:32.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe72b400640 1 -- 172.21.15.59:0/58430249 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe72c0a3c00 con 0x55c3750bd870 2024-04-25T09:11:32.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe72b400640 1 -- 172.21.15.59:0/58430249 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c0b0040 con 0x55c3750bd870 2024-04-25T09:11:32.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.030+0000 7fe735ae2080 1 -- 172.21.15.59:0/58430249 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c37504b4b0 con 0x55c3750bd870 2024-04-25T09:11:32.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.034+0000 7fe735ae2080 1 -- 172.21.15.59:0/58430249 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c375175ae0 con 0x55c3750bd870 2024-04-25T09:11:32.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.034+0000 7fe72b400640 1 -- 172.21.15.59:0/58430249 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe72c0bb070 con 0x55c3750bd870 2024-04-25T09:11:32.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.034+0000 7fe72b400640 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe714065970 0x7fe714067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.034+0000 7fe72b400640 1 -- 172.21.15.59:0/58430249 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fe72c11d8f0 con 0x55c3750bd870 2024-04-25T09:11:32.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.034+0000 7fe735ae2080 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c37504d6b0 0x55c3750de620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.034+0000 7fe735ae2080 1 -- 172.21.15.59:0/58430249 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:1 17.7 17:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e122) v9 -- 0x55c37504add0 con 0x55c37504d6b0 2024-04-25T09:11:32.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.034+0000 7fe732e00640 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe714065970 0x7fe714067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.034+0000 7fe732400640 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c37504d6b0 0x55c3750de620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.034+0000 7fe732e00640 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe714065970 0x7fe714067e30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe724009ca0 tx=0x7fe72400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.025 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.034+0000 7fe732400640 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c37504d6b0 0x55c3750de620 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.038+0000 7fe732400640 1 -- 172.21.15.59:0/58430249 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v122'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fe72000e630 con 0x55c37504d6b0 2024-04-25T09:11:32.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.038+0000 7fe735ae2080 1 -- 172.21.15.59:0/58430249 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c37504d6b0 msgr2=0x55c3750de620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.027 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.038+0000 7fe735ae2080 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c37504d6b0 0x55c3750de620 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.038+0000 7fe735ae2080 1 -- 172.21.15.59:0/58430249 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe714065970 msgr2=0x7fe714067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.038+0000 7fe735ae2080 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe714065970 0x7fe714067e30 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe724009ca0 tx=0x7fe72400f000 comp rx=0 tx=0).stop 2024-04-25T09:11:32.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.038+0000 7fe735ae2080 1 -- 172.21.15.59:0/58430249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3750bd870 msgr2=0x55c37504c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.038+0000 7fe735ae2080 1 --2- 172.21.15.59:0/58430249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c3750bd870 0x55c37504c5f0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fe72c00a3f0 tx=0x7fe72c017df0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.038+0000 7fe733800640 1 -- 172.21.15.59:0/58430249 reap_dead start 2024-04-25T09:11:32.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.038+0000 7fe735ae2080 1 -- 172.21.15.59:0/58430249 shutdown_connections 2024-04-25T09:11:32.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.038+0000 7fe735ae2080 1 -- 172.21.15.59:0/58430249 >> 172.21.15.59:0/58430249 conn(0x55c375005400 msgr2=0x55c375033f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.038+0000 7fe735ae2080 1 -- 172.21.15.59:0/58430249 shutdown_connections 2024-04-25T09:11:32.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.038+0000 7fe735ae2080 1 -- 172.21.15.59:0/58430249 wait complete. 2024-04-25T09:11:32.031 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:11:32.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89f4200640 1 Processor -- start 2024-04-25T09:11:32.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89f4200640 1 -- start start 2024-04-25T09:11:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89f4200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ec15bcf0 0x7f89ec099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89f4200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec0d02a0 con 0x7f89ec15b910 2024-04-25T09:11:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89f4200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec0cc350 con 0x7f89ec0cf3c0 2024-04-25T09:11:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89f4200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0cc630 con 0x7f89ec15bcf0 2024-04-25T09:11:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89f1800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f89ec15b910 0x7f89ec0cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55452/0 (socket says 172.21.15.59:55452) 2024-04-25T09:11:32.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89f1800640 1 -- 172.21.15.59:0/2142593439 learned_addr learned my addr 172.21.15.59:0/2142593439 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:32.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89f2200640 1 --2- 172.21.15.59:0/2142593439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ec15bcf0 0x7f89ec099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89ebe00640 1 -- 172.21.15.59:0/2142593439 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610051258 0 0) 0x7f89ec0d02a0 con 0x7f89ec15b910 2024-04-25T09:11:32.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89ebe00640 1 -- 172.21.15.59:0/2142593439 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89d4003530 con 0x7f89ec15b910 2024-04-25T09:11:32.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89ebe00640 1 -- 172.21.15.59:0/2142593439 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1908226487 0 0) 0x7f89ec0cc350 con 0x7f89ec0cf3c0 2024-04-25T09:11:32.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89ebe00640 1 -- 172.21.15.59:0/2142593439 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89ec0d02a0 con 0x7f89ec0cf3c0 2024-04-25T09:11:32.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89f2200640 1 -- 172.21.15.59:0/2142593439 >> v1:172.21.15.178:6789/0 conn(0x7f89ec0cf3c0 legacy=0x7f89ec0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89f2200640 1 -- 172.21.15.59:0/2142593439 >> v1:172.21.15.59:6789/0 conn(0x7f89ec15b910 legacy=0x7f89ec0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.230+0000 7f89f2200640 1 -- 172.21.15.59:0/2142593439 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec0cc910 con 0x7f89ec15bcf0 2024-04-25T09:11:32.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.234+0000 7f89f2200640 1 --2- 172.21.15.59:0/2142593439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ec15bcf0 0x7f89ec099a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009dc0 tx=0x7f89e401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc7a6827deb20635 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.234+0000 7f89ebe00640 1 -- 172.21.15.59:0/2142593439 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40b2070 con 0x7f89ec15bcf0 2024-04-25T09:11:32.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.234+0000 7f89ebe00640 1 -- 172.21.15.59:0/2142593439 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e40a5850 con 0x7f89ec15bcf0 2024-04-25T09:11:32.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.234+0000 7f89ebe00640 1 -- 172.21.15.59:0/2142593439 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40a5c20 con 0x7f89ec15bcf0 2024-04-25T09:11:32.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.234+0000 7f89f4200640 1 -- 172.21.15.59:0/2142593439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ec15bcf0 msgr2=0x7f89ec099a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.234+0000 7f89f4200640 1 --2- 172.21.15.59:0/2142593439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ec15bcf0 0x7f89ec099a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009dc0 tx=0x7f89e401c990 comp rx=0 tx=0).stop 2024-04-25T09:11:32.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.234+0000 7f89f4200640 1 -- 172.21.15.59:0/2142593439 shutdown_connections 2024-04-25T09:11:32.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.234+0000 7f89f4200640 1 --2- 172.21.15.59:0/2142593439 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ec15bcf0 0x7f89ec099a60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.234+0000 7f89f4200640 1 -- 172.21.15.59:0/2142593439 >> 172.21.15.59:0/2142593439 conn(0x7f89ec0b3200 msgr2=0x7f89ec0b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.234+0000 7f89f4200640 1 -- 172.21.15.59:0/2142593439 shutdown_connections 2024-04-25T09:11:32.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.234+0000 7f89f4200640 1 -- 172.21.15.59:0/2142593439 wait complete. 2024-04-25T09:11:32.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f4200640 1 Processor -- start 2024-04-25T09:11:32.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f4200640 1 -- start start 2024-04-25T09:11:32.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f4200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ec0cf3c0 0x7f89ec166dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f4200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89ec15b910 0x7f89ec1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f4200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ec15bcf0 0x7f89ec153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f4200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec169d40 con 0x7f89ec15bcf0 2024-04-25T09:11:32.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f4200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec169bc0 con 0x7f89ec15b910 2024-04-25T09:11:32.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f4200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec169ec0 con 0x7f89ec0cf3c0 2024-04-25T09:11:32.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f2200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ec15bcf0 0x7f89ec153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f2200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ec15bcf0 0x7f89ec153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46606/0 (socket says 172.21.15.59:46606) 2024-04-25T09:11:32.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f2200640 1 -- 172.21.15.59:0/1163384897 learned_addr learned my addr 172.21.15.59:0/1163384897 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f1800640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ec0cf3c0 0x7f89ec166dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f0e00640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89ec15b910 0x7f89ec1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f2200640 1 -- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ec0cf3c0 msgr2=0x7f89ec166dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f2200640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ec0cf3c0 0x7f89ec166dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f2200640 1 -- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89ec15b910 msgr2=0x7f89ec1536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f2200640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89ec15b910 0x7f89ec1536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f2200640 1 -- 172.21.15.59:0/1163384897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec167300 con 0x7f89ec15bcf0 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f2200640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ec15bcf0 0x7f89ec153be0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f89e401ce70 tx=0x7f89e4019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89e9600640 1 -- 172.21.15.59:0/1163384897 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e40b2050 con 0x7f89ec15bcf0 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89e9600640 1 -- 172.21.15.59:0/1163384897 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e40be070 con 0x7f89ec15bcf0 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89e9600640 1 -- 172.21.15.59:0/1163384897 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e4009450 con 0x7f89ec15bcf0 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f4200640 1 -- 172.21.15.59:0/1163384897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec0c99b0 con 0x7f89ec15bcf0 2024-04-25T09:11:32.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f4200640 1 -- 172.21.15.59:0/1163384897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec0c9f70 con 0x7f89ec15bcf0 2024-04-25T09:11:32.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.238+0000 7f89f4200640 1 -- 172.21.15.59:0/1163384897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec0745d0 con 0x7f89ec15bcf0 2024-04-25T09:11:32.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.242+0000 7f89e9600640 1 -- 172.21.15.59:0/1163384897 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f89e40ad890 con 0x7f89ec15bcf0 2024-04-25T09:11:32.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.242+0000 7f89e9600640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89cc066f60 0x7f89cc069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.242+0000 7f89e9600640 1 -- 172.21.15.59:0/1163384897 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f89e41200b0 con 0x7f89ec15bcf0 2024-04-25T09:11:32.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.242+0000 7f89f1800640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89cc066f60 0x7f89cc069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.242+0000 7f89f1800640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89cc066f60 0x7f89cc069420 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f89e0007fd0 tx=0x7f89e0007d80 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.246+0000 7f89e9600640 1 -- 172.21.15.59:0/1163384897 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f89e4016580 con 0x7f89ec15bcf0 2024-04-25T09:11:32.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.442+0000 7f89f4200640 1 -- 172.21.15.59:0/1163384897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f89ec06cf00 con 0x7f89ec15bcf0 2024-04-25T09:11:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89e9600640 1 -- 172.21.15.59:0/1163384897 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v106) v1 ==== 162+0+0 (secure 0 0 0) 0x7f89e40f07f0 con 0x7f89ec15bcf0 2024-04-25T09:11:32.735 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:11:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89f4200640 1 -- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89cc066f60 msgr2=0x7f89cc069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89f4200640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89cc066f60 0x7f89cc069420 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f89e0007fd0 tx=0x7f89e0007d80 comp rx=0 tx=0).stop 2024-04-25T09:11:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89f4200640 1 -- 172.21.15.59:0/1163384897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ec15bcf0 msgr2=0x7f89ec153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89f4200640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ec15bcf0 0x7f89ec153be0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f89e401ce70 tx=0x7f89e4019730 comp rx=0 tx=0).stop 2024-04-25T09:11:32.737 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89f4200640 1 -- 172.21.15.59:0/1163384897 shutdown_connections 2024-04-25T09:11:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89f4200640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f89cc066f60 0x7f89cc069420 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89f4200640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89ec15bcf0 0x7f89ec153be0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89f4200640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f89ec15b910 0x7f89ec1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89f4200640 1 --2- 172.21.15.59:0/1163384897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f89ec0cf3c0 0x7f89ec166dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89f4200640 1 -- 172.21.15.59:0/1163384897 >> 172.21.15.59:0/1163384897 conn(0x7f89ec0b3200 msgr2=0x7f89ec0c6dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89f4200640 1 -- 172.21.15.59:0/1163384897 shutdown_connections 2024-04-25T09:11:32.738 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.746+0000 7f89f4200640 1 -- 172.21.15.59:0/1163384897 wait complete. 2024-04-25T09:11:32.762 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c7e200640 1 Processor -- start 2024-04-25T09:11:32.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c7e200640 1 -- start start 2024-04-25T09:11:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c7e200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1c7815c8a0 0x7f1c7806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c7e200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c7806e010 0x7f1c780acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c7e200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c7815cd00 con 0x7f1c78141d20 2024-04-25T09:11:32.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c7e200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7806ac10 con 0x7f1c7806e010 2024-04-25T09:11:32.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c7e200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7806ae60 con 0x7f1c7815c8a0 2024-04-25T09:11:32.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c77e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c7806e010 0x7f1c780acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c77e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c7806e010 0x7f1c780acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46616/0 (socket says 172.21.15.59:46616) 2024-04-25T09:11:32.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c77e00640 1 -- 172.21.15.59:0/203968138 learned_addr learned my addr 172.21.15.59:0/203968138 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:32.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c6ea00640 1 --2- 172.21.15.59:0/203968138 >> v2:172.21.15.178:3300/0 conn(0x7f1c7815c8a0 0x7f1c7806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c77e00640 1 -- 172.21.15.59:0/203968138 >> v2:172.21.15.178:3300/0 conn(0x7f1c7815c8a0 msgr2=0x7f1c7806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c77e00640 1 --2- 172.21.15.59:0/203968138 >> v2:172.21.15.178:3300/0 conn(0x7f1c7815c8a0 0x7f1c7806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c77e00640 1 -- 172.21.15.59:0/203968138 >> v1:172.21.15.178:6789/0 conn(0x7f1c78141d20 legacy=0x7f1c780af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c77e00640 1 -- 172.21.15.59:0/203968138 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7806b140 con 0x7f1c7806e010 2024-04-25T09:11:32.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.914+0000 7f1c6ea00640 1 --2- 172.21.15.59:0/203968138 >> v2:172.21.15.178:3300/0 conn(0x7f1c7815c8a0 0x7f1c7806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.918+0000 7f1c77e00640 1 --2- 172.21.15.59:0/203968138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7806e010 0x7f1c780acda0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009870 tx=0x7f1c7001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b51549a43d6fc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.918+0000 7f1c76a00640 1 -- 172.21.15.59:0/203968138 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c700b0070 con 0x7f1c7806e010 2024-04-25T09:11:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.918+0000 7f1c76a00640 1 -- 172.21.15.59:0/203968138 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c700ab600 con 0x7f1c7806e010 2024-04-25T09:11:32.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.918+0000 7f1c76a00640 1 -- 172.21.15.59:0/203968138 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c700ab9d0 con 0x7f1c7806e010 2024-04-25T09:11:32.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.918+0000 7f1c7e200640 1 -- 172.21.15.59:0/203968138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7806e010 msgr2=0x7f1c780acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.918+0000 7f1c7e200640 1 --2- 172.21.15.59:0/203968138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7806e010 0x7f1c780acda0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009870 tx=0x7f1c7001c420 comp rx=0 tx=0).stop 2024-04-25T09:11:32.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.918+0000 7f1c7e200640 1 -- 172.21.15.59:0/203968138 shutdown_connections 2024-04-25T09:11:32.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.918+0000 7f1c7e200640 1 --2- 172.21.15.59:0/203968138 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7806e010 0x7f1c780acda0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.918+0000 7f1c7e200640 1 --2- 172.21.15.59:0/203968138 >> v2:172.21.15.178:3300/0 conn(0x7f1c7815c8a0 0x7f1c7806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.918+0000 7f1c7e200640 1 -- 172.21.15.59:0/203968138 >> 172.21.15.59:0/203968138 conn(0x7f1c780b23b0 msgr2=0x7f1c780cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:32.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.918+0000 7f1c7e200640 1 -- 172.21.15.59:0/203968138 shutdown_connections 2024-04-25T09:11:32.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.918+0000 7f1c7e200640 1 -- 172.21.15.59:0/203968138 wait complete. 2024-04-25T09:11:32.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c7e200640 1 Processor -- start 2024-04-25T09:11:32.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c7e200640 1 -- start start 2024-04-25T09:11:32.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c7e200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c78141d20 0x7f1c781fb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c7e200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7815c8a0 0x7f1c780cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c7e200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7813d730 0x7f1c781591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c7e200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78168ab0 con 0x7f1c7815c8a0 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c7e200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78168930 con 0x7f1c7813d730 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c7e200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c78168c30 con 0x7f1c78141d20 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c6ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7815c8a0 0x7f1c780cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c6ea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7815c8a0 0x7f1c780cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46618/0 (socket says 172.21.15.59:46618) 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c6ea00640 1 -- 172.21.15.59:0/3931104339 learned_addr learned my addr 172.21.15.59:0/3931104339 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c77e00640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7813d730 0x7f1c781591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c77400640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c78141d20 0x7f1c781fb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c6ea00640 1 -- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c78141d20 msgr2=0x7f1c781fb070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c6ea00640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c78141d20 0x7f1c781fb070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c6ea00640 1 -- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7813d730 msgr2=0x7f1c781591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c6ea00640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7813d730 0x7f1c781591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:32.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c6ea00640 1 -- 172.21.15.59:0/3931104339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c781fa5d0 con 0x7f1c7815c8a0 2024-04-25T09:11:32.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c77400640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c78141d20 0x7f1c781fb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:32.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c6ea00640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7815c8a0 0x7f1c780cc5c0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000ce00 tx=0x7f1c6000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c6fe00640 1 -- 172.21.15.59:0/3931104339 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000f890 con 0x7f1c7815c8a0 2024-04-25T09:11:32.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c6fe00640 1 -- 172.21.15.59:0/3931104339 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6000fa30 con 0x7f1c7815c8a0 2024-04-25T09:11:32.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c7e200640 1 -- 172.21.15.59:0/3931104339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c780ccec0 con 0x7f1c7815c8a0 2024-04-25T09:11:32.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c6fe00640 1 -- 172.21.15.59:0/3931104339 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000fe40 con 0x7f1c7815c8a0 2024-04-25T09:11:32.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c7e200640 1 -- 172.21.15.59:0/3931104339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c781fa870 con 0x7f1c7815c8a0 2024-04-25T09:11:32.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.922+0000 7f1c7e200640 1 -- 172.21.15.59:0/3931104339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c780745d0 con 0x7f1c7815c8a0 2024-04-25T09:11:32.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.926+0000 7f1c6fe00640 1 -- 172.21.15.59:0/3931104339 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1c60018400 con 0x7f1c7815c8a0 2024-04-25T09:11:32.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.926+0000 7f1c6fe00640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1c54066f60 0x7f1c54069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:32.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.926+0000 7f1c6fe00640 1 -- 172.21.15.59:0/3931104339 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f1c60085fe0 con 0x7f1c7815c8a0 2024-04-25T09:11:32.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.926+0000 7f1c77400640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1c54066f60 0x7f1c54069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:32.916 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.926+0000 7f1c77400640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1c54066f60 0x7f1c54069420 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1c68003ec0 tx=0x7f1c68009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:32.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:32.930+0000 7f1c6fe00640 1 -- 172.21.15.59:0/3931104339 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1c60014030 con 0x7f1c7815c8a0 2024-04-25T09:11:33.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.126+0000 7f1c7e200640 1 -- 172.21.15.59:0/3931104339 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c781664f0 con 0x7f1c7815c8a0 2024-04-25T09:11:33.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.126+0000 7f1c6fe00640 1 -- 172.21.15.59:0/3931104339 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 107 v107) v1 ==== 95+0+4946 (secure 0 0 0) 0x7f1c6000ae20 con 0x7f1c7815c8a0 2024-04-25T09:11:33.116 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:33.116 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":107,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":7613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3791633295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3791633295},{"type":"v1","addr":"172.21.15.59:6835","nonce":3791633295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":107,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:32.752171+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":122,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"c","rank":0,"incarnation":107,"state":"up:replay","state_seq":1,"addr":"172.21.15.59:6833/1679876837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1679876837},{"type":"v1","addr":"172.21.15.59:6833","nonce":1679876837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 107 2024-04-25T09:11:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.130+0000 7f1c7e200640 1 -- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1c54066f60 msgr2=0x7f1c54069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.130+0000 7f1c7e200640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1c54066f60 0x7f1c54069420 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1c68003ec0 tx=0x7f1c68009040 comp rx=0 tx=0).stop 2024-04-25T09:11:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.130+0000 7f1c7e200640 1 -- 172.21.15.59:0/3931104339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7815c8a0 msgr2=0x7f1c780cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.130+0000 7f1c7e200640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7815c8a0 0x7f1c780cc5c0 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000ce00 tx=0x7f1c6000a650 comp rx=0 tx=0).stop 2024-04-25T09:11:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.130+0000 7f1c7e200640 1 -- 172.21.15.59:0/3931104339 shutdown_connections 2024-04-25T09:11:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.130+0000 7f1c7e200640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1c54066f60 0x7f1c54069420 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.130+0000 7f1c7e200640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1c7813d730 0x7f1c781591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.130+0000 7f1c7e200640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c7815c8a0 0x7f1c780cc5c0 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.130+0000 7f1c7e200640 1 --2- 172.21.15.59:0/3931104339 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1c78141d20 0x7f1c781fb070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.130+0000 7f1c7e200640 1 -- 172.21.15.59:0/3931104339 >> 172.21.15.59:0/3931104339 conn(0x7f1c780b23b0 msgr2=0x7f1c7815aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.130+0000 7f1c7e200640 1 -- 172.21.15.59:0/3931104339 shutdown_connections 2024-04-25T09:11:33.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:33.130+0000 7f1c7e200640 1 -- 172.21.15.59:0/3931104339 wait complete. 2024-04-25T09:11:33.540 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 107, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:11:17.015550+0000', 'modified': '2024-04-25T09:11:32.752171+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 122, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8955}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8955': {'gid': 8955, 'name': 'c', 'rank': 0, 'incarnation': 107, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.59:6833/1679876837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1679876837}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 1679876837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:11:33.541 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8955:up:replay 2024-04-25T09:11:34.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.706+0000 7f56d3c00640 1 Processor -- start 2024-04-25T09:11:34.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.706+0000 7f56d3c00640 1 -- start start 2024-04-25T09:11:34.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.706+0000 7f56d3c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56cc145270 0x7f56cc15fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:34.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.706+0000 7f56d3c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56cc0cd4d0 0x7f56cc0cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:34.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.706+0000 7f56d3c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56cc0cc4e0 con 0x7f56cc0b1750 2024-04-25T09:11:34.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.706+0000 7f56d3c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56cc145650 con 0x7f56cc0cd4d0 2024-04-25T09:11:34.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.706+0000 7f56d3c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0ce040 con 0x7f56cc145270 2024-04-25T09:11:34.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56c3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56cc0cd4d0 0x7f56cc0cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:34.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56d1c00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f56cc0b1750 0x7f56cc15bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55468/0 (socket says 172.21.15.59:55468) 2024-04-25T09:11:34.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56d1c00640 1 -- 172.21.15.59:0/351807935 learned_addr learned my addr 172.21.15.59:0/351807935 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56d1200640 1 --2- 172.21.15.59:0/351807935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56cc145270 0x7f56cc15fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56c3e00640 1 -- 172.21.15.59:0/351807935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56cc145270 msgr2=0x7f56cc15fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56c3e00640 1 --2- 172.21.15.59:0/351807935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56cc145270 0x7f56cc15fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56c3e00640 1 -- 172.21.15.59:0/351807935 >> v1:172.21.15.59:6789/0 conn(0x7f56cc0b1750 legacy=0x7f56cc15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56c3e00640 1 -- 172.21.15.59:0/351807935 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0ce320 con 0x7f56cc0cd4d0 2024-04-25T09:11:34.699 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56cbe00640 1 -- 172.21.15.59:0/351807935 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363977207 0 0) 0x7f56cc0cc4e0 con 0x7f56cc0b1750 2024-04-25T09:11:34.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56c3e00640 1 --2- 172.21.15.59:0/351807935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56cc0cd4d0 0x7f56cc0cd930 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f56b40097c0 tx=0x7f56b401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e83d711696d80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:34.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56cbe00640 1 -- 172.21.15.59:0/351807935 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b40b2070 con 0x7f56cc0cd4d0 2024-04-25T09:11:34.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56cbe00640 1 -- 172.21.15.59:0/351807935 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b40ad640 con 0x7f56cc0cd4d0 2024-04-25T09:11:34.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.710+0000 7f56cbe00640 1 -- 172.21.15.59:0/351807935 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b40ada10 con 0x7f56cc0cd4d0 2024-04-25T09:11:34.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 -- 172.21.15.59:0/351807935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56cc0cd4d0 msgr2=0x7f56cc0cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:34.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 --2- 172.21.15.59:0/351807935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56cc0cd4d0 0x7f56cc0cd930 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f56b40097c0 tx=0x7f56b401c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:34.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 -- 172.21.15.59:0/351807935 shutdown_connections 2024-04-25T09:11:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 --2- 172.21.15.59:0/351807935 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56cc0cd4d0 0x7f56cc0cd930 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 --2- 172.21.15.59:0/351807935 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56cc145270 0x7f56cc15fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 -- 172.21.15.59:0/351807935 >> 172.21.15.59:0/351807935 conn(0x7f56cc066fa0 msgr2=0x7f56cc06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 -- 172.21.15.59:0/351807935 shutdown_connections 2024-04-25T09:11:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 -- 172.21.15.59:0/351807935 wait complete. 2024-04-25T09:11:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 Processor -- start 2024-04-25T09:11:34.703 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 -- start start 2024-04-25T09:11:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56cc0b1750 0x7f56cc1f9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56cc0cd4d0 0x7f56cc0b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56cc145270 0x7f56cc1438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0b1f70 con 0x7f56cc0b1750 2024-04-25T09:11:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc168710 con 0x7f56cc0cd4d0 2024-04-25T09:11:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d3c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc0b49c0 con 0x7f56cc145270 2024-04-25T09:11:34.706 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56cc0b1750 0x7f56cc1f9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d1200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56cc0b1750 0x7f56cc1f9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46638/0 (socket says 172.21.15.59:46638) 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d1200640 1 -- 172.21.15.59:0/3265014998 learned_addr learned my addr 172.21.15.59:0/3265014998 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d1c00640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56cc145270 0x7f56cc1438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56c3e00640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56cc0cd4d0 0x7f56cc0b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d1200640 1 -- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56cc145270 msgr2=0x7f56cc1438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d1200640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56cc145270 0x7f56cc1438c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d1200640 1 -- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56cc0cd4d0 msgr2=0x7f56cc0b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d1200640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56cc0cd4d0 0x7f56cc0b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d1200640 1 -- 172.21.15.59:0/3265014998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc0b40d0 con 0x7f56cc0b1750 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56c3e00640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56cc0cd4d0 0x7f56cc0b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.714+0000 7f56d1c00640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56cc145270 0x7f56cc1438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.718+0000 7f56d1200640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56cc0b1750 0x7f56cc1f9690 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00d5f0 tx=0x7f56bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.718+0000 7f56c9600640 1 -- 172.21.15.59:0/3265014998 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0125f0 con 0x7f56cc0b1750 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.718+0000 7f56c9600640 1 -- 172.21.15.59:0/3265014998 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc019070 con 0x7f56cc0b1750 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.718+0000 7f56d3c00640 1 -- 172.21.15.59:0/3265014998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc13d830 con 0x7f56cc0b1750 2024-04-25T09:11:34.707 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.718+0000 7f56c9600640 1 -- 172.21.15.59:0/3265014998 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56bc0129b0 con 0x7f56cc0b1750 2024-04-25T09:11:34.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.718+0000 7f56d3c00640 1 -- 172.21.15.59:0/3265014998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc0b4650 con 0x7f56cc0b1750 2024-04-25T09:11:34.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.718+0000 7f56d3c00640 1 -- 172.21.15.59:0/3265014998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc0745d0 con 0x7f56cc0b1750 2024-04-25T09:11:34.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.718+0000 7f56c9600640 1 -- 172.21.15.59:0/3265014998 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f56bc012b50 con 0x7f56cc0b1750 2024-04-25T09:11:34.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.718+0000 7f56c9600640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f56a8066f60 0x7f56a8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:34.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.718+0000 7f56c9600640 1 -- 172.21.15.59:0/3265014998 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f56bc0856f0 con 0x7f56cc0b1750 2024-04-25T09:11:34.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.718+0000 7f56c3e00640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f56a8066f60 0x7f56a8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:34.710 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.722+0000 7f56c3e00640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f56a8066f60 0x7f56a8069420 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f56b40af000 tx=0x7f56b40a7070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:34.713 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.722+0000 7f56c9600640 1 -- 172.21.15.59:0/3265014998 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f56bc056480 con 0x7f56cc0b1750 2024-04-25T09:11:34.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.926+0000 7f56d3c00640 1 -- 172.21.15.59:0/3265014998 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56cc06b8e0 con 0x7f56cc0b1750 2024-04-25T09:11:34.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.926+0000 7f56c9600640 1 -- 172.21.15.59:0/3265014998 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4946 (secure 0 0 0) 0x7f56bc055d80 con 0x7f56cc0b1750 2024-04-25T09:11:34.917 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:34.918 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":109,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":7613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3791633295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3791633295},{"type":"v1","addr":"172.21.15.59:6835","nonce":3791633295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:33.757428+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":122,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"c","rank":0,"incarnation":107,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.59:6833/1679876837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1679876837},{"type":"v1","addr":"172.21.15.59:6833","nonce":1679876837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:34.918 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 109 2024-04-25T09:11:34.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.930+0000 7f56d3c00640 1 -- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f56a8066f60 msgr2=0x7f56a8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:34.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.930+0000 7f56d3c00640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f56a8066f60 0x7f56a8069420 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f56b40af000 tx=0x7f56b40a7070 comp rx=0 tx=0).stop 2024-04-25T09:11:34.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.930+0000 7f56d3c00640 1 -- 172.21.15.59:0/3265014998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56cc0b1750 msgr2=0x7f56cc1f9690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:34.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.930+0000 7f56d3c00640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56cc0b1750 0x7f56cc1f9690 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f56bc00d5f0 tx=0x7f56bc00dab0 comp rx=0 tx=0).stop 2024-04-25T09:11:34.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.930+0000 7f56d3c00640 1 -- 172.21.15.59:0/3265014998 shutdown_connections 2024-04-25T09:11:34.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.930+0000 7f56d3c00640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f56a8066f60 0x7f56a8069420 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:34.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.930+0000 7f56d3c00640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f56cc145270 0x7f56cc1438c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:34.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.930+0000 7f56d3c00640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f56cc0cd4d0 0x7f56cc0b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:34.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.930+0000 7f56d3c00640 1 --2- 172.21.15.59:0/3265014998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f56cc0b1750 0x7f56cc1f9690 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:34.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.930+0000 7f56d3c00640 1 -- 172.21.15.59:0/3265014998 >> 172.21.15.59:0/3265014998 conn(0x7f56cc066fa0 msgr2=0x7f56cc141c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:34.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.930+0000 7f56d3c00640 1 -- 172.21.15.59:0/3265014998 shutdown_connections 2024-04-25T09:11:34.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:34.930+0000 7f56d3c00640 1 -- 172.21.15.59:0/3265014998 wait complete. 2024-04-25T09:11:35.340 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 109, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:11:17.015550+0000', 'modified': '2024-04-25T09:11:33.757428+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 122, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8955}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8955': {'gid': 8955, 'name': 'c', 'rank': 0, 'incarnation': 107, 'state': 'up:rejoin', 'state_seq': 8, 'addr': '172.21.15.59:6833/1679876837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1679876837}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 1679876837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:11:35.341 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8955:up:rejoin 2024-04-25T09:11:36.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:36.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.506+0000 7fb557000640 1 Processor -- start 2024-04-25T09:11:36.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.506+0000 7fb557000640 1 -- start start 2024-04-25T09:11:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb557000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb55015fe50 0x7fb5500b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb557000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5500b1c90 0x7fb55015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb557000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5500cc4e0 con 0x7fb550145270 2024-04-25T09:11:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb557000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5500b20e0 con 0x7fb5500b1c90 2024-04-25T09:11:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb557000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb550145650 con 0x7fb55015fe50 2024-04-25T09:11:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb555000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5500b1c90 0x7fb55015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb54fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb550145270 0x7fb5500cd4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55484/0 (socket says 172.21.15.59:55484) 2024-04-25T09:11:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb54fe00640 1 -- 172.21.15.59:0/2705314924 learned_addr learned my addr 172.21.15.59:0/2705314924 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb555000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5500b1c90 0x7fb55015bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46650/0 (socket says 172.21.15.59:46650) 2024-04-25T09:11:36.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb547400640 1 --2- 172.21.15.59:0/2705314924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb55015fe50 0x7fb5500b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb555000640 1 -- 172.21.15.59:0/2705314924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb55015fe50 msgr2=0x7fb5500b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb555000640 1 --2- 172.21.15.59:0/2705314924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb55015fe50 0x7fb5500b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb54f400640 1 -- 172.21.15.59:0/2705314924 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301034268 0 0) 0x7fb5500cc4e0 con 0x7fb550145270 2024-04-25T09:11:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb555000640 1 -- 172.21.15.59:0/2705314924 >> v1:172.21.15.59:6789/0 conn(0x7fb550145270 legacy=0x7fb5500cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.510+0000 7fb555000640 1 -- 172.21.15.59:0/2705314924 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5500ce040 con 0x7fb5500b1c90 2024-04-25T09:11:36.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb555000640 1 --2- 172.21.15.59:0/2705314924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5500b1c90 0x7fb55015bd80 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fb5480097f0 tx=0x7fb54801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6521a15f714e3416 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:36.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb54f400640 1 -- 172.21.15.59:0/2705314924 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5480b2070 con 0x7fb5500b1c90 2024-04-25T09:11:36.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb54f400640 1 -- 172.21.15.59:0/2705314924 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5480ad640 con 0x7fb5500b1c90 2024-04-25T09:11:36.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb54f400640 1 -- 172.21.15.59:0/2705314924 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5480ada10 con 0x7fb5500b1c90 2024-04-25T09:11:36.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb557000640 1 -- 172.21.15.59:0/2705314924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5500b1c90 msgr2=0x7fb55015bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb557000640 1 --2- 172.21.15.59:0/2705314924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5500b1c90 0x7fb55015bd80 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fb5480097f0 tx=0x7fb54801c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb557000640 1 -- 172.21.15.59:0/2705314924 shutdown_connections 2024-04-25T09:11:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb557000640 1 --2- 172.21.15.59:0/2705314924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5500b1c90 0x7fb55015bd80 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb557000640 1 --2- 172.21.15.59:0/2705314924 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb55015fe50 0x7fb5500b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb557000640 1 -- 172.21.15.59:0/2705314924 >> 172.21.15.59:0/2705314924 conn(0x7fb550066fa0 msgr2=0x7fb55006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb557000640 1 -- 172.21.15.59:0/2705314924 shutdown_connections 2024-04-25T09:11:36.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb557000640 1 -- 172.21.15.59:0/2705314924 wait complete. 2024-04-25T09:11:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb557000640 1 Processor -- start 2024-04-25T09:11:36.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.514+0000 7fb557000640 1 -- start start 2024-04-25T09:11:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb557000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5500b1c90 0x7fb550161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb557000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb550145270 0x7fb550141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb557000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb55015fe50 0x7fb5501421a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb557000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500cdbe0 con 0x7fb55015fe50 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb557000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55015f930 con 0x7fb5500b1c90 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb557000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5500cdd60 con 0x7fb550145270 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb555000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb55015fe50 0x7fb5501421a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb555000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb55015fe50 0x7fb5501421a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46660/0 (socket says 172.21.15.59:46660) 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb555000640 1 -- 172.21.15.59:0/1135917759 learned_addr learned my addr 172.21.15.59:0/1135917759 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb54fe00640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5500b1c90 0x7fb550161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb547400640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb550145270 0x7fb550141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb555000640 1 -- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb550145270 msgr2=0x7fb550141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb555000640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb550145270 0x7fb550141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb555000640 1 -- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5500b1c90 msgr2=0x7fb550161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb555000640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5500b1c90 0x7fb550161eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb555000640 1 -- 172.21.15.59:0/1135917759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550140b60 con 0x7fb55015fe50 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb555000640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb55015fe50 0x7fb5501421a0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fb5480b0040 tx=0x7fb548019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb54cc00640 1 -- 172.21.15.59:0/1135917759 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5480ba020 con 0x7fb55015fe50 2024-04-25T09:11:36.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb54cc00640 1 -- 172.21.15.59:0/1135917759 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5480b6410 con 0x7fb55015fe50 2024-04-25T09:11:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb557000640 1 -- 172.21.15.59:0/1135917759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb550140e40 con 0x7fb55015fe50 2024-04-25T09:11:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb54cc00640 1 -- 172.21.15.59:0/1135917759 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5480b2040 con 0x7fb55015fe50 2024-04-25T09:11:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb557000640 1 -- 172.21.15.59:0/1135917759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb550141400 con 0x7fb55015fe50 2024-04-25T09:11:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb557000640 1 -- 172.21.15.59:0/1135917759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5501418f0 con 0x7fb55015fe50 2024-04-25T09:11:36.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.518+0000 7fb54cc00640 1 -- 172.21.15.59:0/1135917759 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb5480bd020 con 0x7fb55015fe50 2024-04-25T09:11:36.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.522+0000 7fb54cc00640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb52c066f60 0x7fb52c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:36.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.522+0000 7fb54cc00640 1 -- 172.21.15.59:0/1135917759 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fb54811efe0 con 0x7fb55015fe50 2024-04-25T09:11:36.510 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.522+0000 7fb54fe00640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb52c066f60 0x7fb52c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:36.511 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.522+0000 7fb54fe00640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb52c066f60 0x7fb52c069420 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb540007fd0 tx=0x7fb540007f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:36.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.526+0000 7fb54cc00640 1 -- 172.21.15.59:0/1135917759 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fb5480c4030 con 0x7fb55015fe50 2024-04-25T09:11:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.722+0000 7fb557000640 1 -- 172.21.15.59:0/1135917759 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5500745d0 con 0x7fb55015fe50 2024-04-25T09:11:36.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.722+0000 7fb54cc00640 1 -- 172.21.15.59:0/1135917759 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4946 (secure 0 0 0) 0x7fb548016090 con 0x7fb55015fe50 2024-04-25T09:11:36.713 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:36.713 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":110,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":7613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3791633295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3791633295},{"type":"v1","addr":"172.21.15.59:6835","nonce":3791633295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:34.763076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":122,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":9,"addr":"172.21.15.59:6833/1679876837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1679876837},{"type":"v1","addr":"172.21.15.59:6833","nonce":1679876837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:36.713 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 110 2024-04-25T09:11:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.726+0000 7fb557000640 1 -- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb52c066f60 msgr2=0x7fb52c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.726+0000 7fb557000640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb52c066f60 0x7fb52c069420 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fb540007fd0 tx=0x7fb540007f00 comp rx=0 tx=0).stop 2024-04-25T09:11:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.726+0000 7fb557000640 1 -- 172.21.15.59:0/1135917759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb55015fe50 msgr2=0x7fb5501421a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.726+0000 7fb557000640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb55015fe50 0x7fb5501421a0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fb5480b0040 tx=0x7fb548019240 comp rx=0 tx=0).stop 2024-04-25T09:11:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.726+0000 7fb557000640 1 -- 172.21.15.59:0/1135917759 shutdown_connections 2024-04-25T09:11:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.726+0000 7fb557000640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb52c066f60 0x7fb52c069420 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.726+0000 7fb557000640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb55015fe50 0x7fb5501421a0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.726+0000 7fb557000640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb550145270 0x7fb550141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.715 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.726+0000 7fb557000640 1 --2- 172.21.15.59:0/1135917759 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb5500b1c90 0x7fb550161eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.726+0000 7fb557000640 1 -- 172.21.15.59:0/1135917759 >> 172.21.15.59:0/1135917759 conn(0x7fb550066fa0 msgr2=0x7fb55006dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.726+0000 7fb557000640 1 -- 172.21.15.59:0/1135917759 shutdown_connections 2024-04-25T09:11:36.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:36.726+0000 7fb557000640 1 -- 172.21.15.59:0/1135917759 wait complete. 2024-04-25T09:11:37.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 110, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:11:17.015550+0000', 'modified': '2024-04-25T09:11:34.763076+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 122, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8955}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8955': {'gid': 8955, 'name': 'c', 'rank': 0, 'incarnation': 107, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.59:6833/1679876837', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1679876837}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 1679876837}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:11:37.137 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:11:37.137 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:11:37.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.290+0000 7fa75ca00640 1 Processor -- start 2024-04-25T09:11:37.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.290+0000 7fa75ca00640 1 -- start start 2024-04-25T09:11:37.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa75ca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758072210 0x7fa7580cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa75ca00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fa7580ce1d0 0x7fa7580ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa75ca00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75806ac10 con 0x7fa75815dd90 2024-04-25T09:11:37.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa75ca00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7580b2dc0 con 0x7fa7580ce1d0 2024-04-25T09:11:37.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa75ca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75806aeb0 con 0x7fa758072210 2024-04-25T09:11:37.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa75815dd90 0x7fa758071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55494/0 (socket says 172.21.15.59:55494) 2024-04-25T09:11:37.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755e00640 1 -- 172.21.15.59:0/4250223672 learned_addr learned my addr 172.21.15.59:0/4250223672 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:37.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa74fe00640 1 --2- 172.21.15.59:0/4250223672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758072210 0x7fa7580cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa756800640 1 --2- 172.21.15.59:0/4250223672 >> v2:172.21.15.178:3300/0 conn(0x7fa7580ce1d0 0x7fa7580ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309639704 0 0) 0x7fa75806ac10 con 0x7fa75815dd90 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa73c003530 con 0x7fa75815dd90 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3270694649 0 0) 0x7fa73c003530 con 0x7fa75815dd90 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758072210 msgr2=0x7fa7580cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 --2- 172.21.15.59:0/4250223672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758072210 0x7fa7580cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 >> v2:172.21.15.178:3300/0 conn(0x7fa7580ce1d0 msgr2=0x7fa7580ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 --2- 172.21.15.59:0/4250223672 >> v2:172.21.15.178:3300/0 conn(0x7fa7580ce1d0 0x7fa7580ce640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa75806b190 con 0x7fa75815dd90 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fa748001680 con 0x7fa75815dd90 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 >> v1:172.21.15.59:6789/0 conn(0x7fa75815dd90 legacy=0x7fa758071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 --2- 172.21.15.59:0/4250223672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758072210 0x7fa73c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 --2- 172.21.15.59:0/4250223672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa73c003f40 0x7fa73c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 --2- 172.21.15.59:0/4250223672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c004d50 0x7fa73c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75806aeb0 con 0x7fa73c004d50 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c00b9d0 con 0x7fa73c003f40 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa73c00bba0 con 0x7fa758072210 2024-04-25T09:11:37.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa756800640 1 --2- 172.21.15.59:0/4250223672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c004d50 0x7fa73c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa74fe00640 1 --2- 172.21.15.59:0/4250223672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa73c003f40 0x7fa73c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa755e00640 1 --2- 172.21.15.59:0/4250223672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758072210 0x7fa73c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa756800640 1 -- 172.21.15.59:0/4250223672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758072210 msgr2=0x7fa73c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa756800640 1 --2- 172.21.15.59:0/4250223672 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758072210 0x7fa73c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa756800640 1 -- 172.21.15.59:0/4250223672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa73c003f40 msgr2=0x7fa73c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa756800640 1 --2- 172.21.15.59:0/4250223672 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa73c003f40 0x7fa73c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.286 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.294+0000 7fa756800640 1 -- 172.21.15.59:0/4250223672 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c003530 con 0x7fa73c004d50 2024-04-25T09:11:37.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.298+0000 7fa756800640 1 --2- 172.21.15.59:0/4250223672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c004d50 0x7fa73c0051d0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fa75000e170 tx=0x7fa75001cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10980801980b679b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.298+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7500b2070 con 0x7fa73c004d50 2024-04-25T09:11:37.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.298+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7500a5cb0 con 0x7fa73c004d50 2024-04-25T09:11:37.287 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.298+0000 7fa755400640 1 -- 172.21.15.59:0/4250223672 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750009c10 con 0x7fa73c004d50 2024-04-25T09:11:37.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.298+0000 7fa75ca00640 1 -- 172.21.15.59:0/4250223672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c004d50 msgr2=0x7fa73c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.298+0000 7fa75ca00640 1 --2- 172.21.15.59:0/4250223672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c004d50 0x7fa73c0051d0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7fa75000e170 tx=0x7fa75001cca0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.298+0000 7fa756800640 1 -- 172.21.15.59:0/4250223672 reap_dead start 2024-04-25T09:11:37.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.298+0000 7fa75ca00640 1 -- 172.21.15.59:0/4250223672 shutdown_connections 2024-04-25T09:11:37.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.298+0000 7fa75ca00640 1 -- 172.21.15.59:0/4250223672 >> 172.21.15.59:0/4250223672 conn(0x7fa7580cfd90 msgr2=0x7fa7580d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.298+0000 7fa75ca00640 1 -- 172.21.15.59:0/4250223672 shutdown_connections 2024-04-25T09:11:37.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.298+0000 7fa75ca00640 1 -- 172.21.15.59:0/4250223672 wait complete. 2024-04-25T09:11:37.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.298+0000 7fa75ca00640 1 Processor -- start 2024-04-25T09:11:37.289 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa75ca00640 1 -- start start 2024-04-25T09:11:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa75ca00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c004d50 0x7fa7580c4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa75ca00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758159350 0x7fa75815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa75ca00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7580b0ac0 0x7fa75815ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa75ca00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7580cdc90 con 0x7fa73c004d50 2024-04-25T09:11:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa75ca00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75806b750 con 0x7fa7580b0ac0 2024-04-25T09:11:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa75ca00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7580cde10 con 0x7fa758159350 2024-04-25T09:11:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa755e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c004d50 0x7fa7580c4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.291 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa755e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c004d50 0x7fa7580c4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46686/0 (socket says 172.21.15.59:46686) 2024-04-25T09:11:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa755e00640 1 -- 172.21.15.59:0/129055041 learned_addr learned my addr 172.21.15.59:0/129055041 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa756800640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7580b0ac0 0x7fa75815ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa74fe00640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758159350 0x7fa75815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa755e00640 1 -- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758159350 msgr2=0x7fa75815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa755e00640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758159350 0x7fa75815c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa755e00640 1 -- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7580b0ac0 msgr2=0x7fa75815ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa755e00640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7580b0ac0 0x7fa75815ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa755e00640 1 -- 172.21.15.59:0/129055041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7580c5aa0 con 0x7fa73c004d50 2024-04-25T09:11:37.292 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa755e00640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c004d50 0x7fa7580c4d30 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fa748011980 tx=0x7fa748011e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa74e000640 1 -- 172.21.15.59:0/129055041 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748010040 con 0x7fa73c004d50 2024-04-25T09:11:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa74e000640 1 -- 172.21.15.59:0/129055041 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74801a070 con 0x7fa73c004d50 2024-04-25T09:11:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa74e000640 1 -- 172.21.15.59:0/129055041 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74800fe60 con 0x7fa73c004d50 2024-04-25T09:11:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa75ca00640 1 -- 172.21.15.59:0/129055041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7580c5d80 con 0x7fa73c004d50 2024-04-25T09:11:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.302+0000 7fa75ca00640 1 -- 172.21.15.59:0/129055041 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7580b05a0 con 0x7fa73c004d50 2024-04-25T09:11:37.293 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa74e000640 1 -- 172.21.15.59:0/129055041 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa74801f460 con 0x7fa73c004d50 2024-04-25T09:11:37.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa74e000640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa734066f90 0x7fa734069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa74e000640 1 -- 172.21.15.59:0/129055041 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa7480884c0 con 0x7fa73c004d50 2024-04-25T09:11:37.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa74fe00640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa734066f90 0x7fa734069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa75fe68000 1 Processor -- start 2024-04-25T09:11:37.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa75fe68000 1 -- start start 2024-04-25T09:11:37.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa74fe00640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa734066f90 0x7fa734069450 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa7580cc780 tx=0x7fa740008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa75fe68000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 0x557d22decd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa75fe68000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 0x557d22da29f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa75fe68000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22da2f30 0x557d22da3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa75fe68000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d22c8a5f0 con 0x557d22dec920 2024-04-25T09:11:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa75fe68000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d22bf1da0 con 0x557d22da2f30 2024-04-25T09:11:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa75fe68000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d22b7a150 con 0x557d22ded240 2024-04-25T09:11:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa755e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 0x557d22decd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa755e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 0x557d22decd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46690/0 (socket says 172.21.15.59:46690) 2024-04-25T09:11:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa755e00640 1 -- 172.21.15.59:0/3868505379 learned_addr learned my addr 172.21.15.59:0/3868505379 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa756800640 1 --2- 172.21.15.59:0/3868505379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22da2f30 0x557d22da3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa74fe00640 1 --2- 172.21.15.59:0/3868505379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 0x557d22da29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa755e00640 1 -- 172.21.15.59:0/3868505379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 msgr2=0x557d22da29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa755e00640 1 --2- 172.21.15.59:0/3868505379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 0x557d22da29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa755e00640 1 -- 172.21.15.59:0/3868505379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22da2f30 msgr2=0x557d22da3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa755e00640 1 --2- 172.21.15.59:0/3868505379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22da2f30 0x557d22da3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa755e00640 1 -- 172.21.15.59:0/3868505379 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d22b93ca0 con 0x557d22dec920 2024-04-25T09:11:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa755e00640 1 --2- 172.21.15.59:0/3868505379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 0x557d22decd00 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fa748058900 tx=0x7fa748058c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9b4fa114a61e29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa746a00640 1 -- 172.21.15.59:0/3868505379 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748061260 con 0x557d22dec920 2024-04-25T09:11:37.299 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa746a00640 1 -- 172.21.15.59:0/3868505379 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748056f00 con 0x557d22dec920 2024-04-25T09:11:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.306+0000 7fa746a00640 1 -- 172.21.15.59:0/3868505379 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748086bd0 con 0x557d22dec920 2024-04-25T09:11:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 -- 172.21.15.59:0/3868505379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 msgr2=0x557d22decd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 --2- 172.21.15.59:0/3868505379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 0x557d22decd00 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7fa748058900 tx=0x7fa748058c00 comp rx=0 tx=0).stop 2024-04-25T09:11:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 -- 172.21.15.59:0/3868505379 shutdown_connections 2024-04-25T09:11:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 --2- 172.21.15.59:0/3868505379 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22da2f30 0x557d22da3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 --2- 172.21.15.59:0/3868505379 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 0x557d22da29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 --2- 172.21.15.59:0/3868505379 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 0x557d22decd00 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 -- 172.21.15.59:0/3868505379 >> 172.21.15.59:0/3868505379 conn(0x557d22da92a0 msgr2=0x557d22da12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 -- 172.21.15.59:0/3868505379 shutdown_connections 2024-04-25T09:11:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 -- 172.21.15.59:0/3868505379 wait complete. 2024-04-25T09:11:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 -- start start 2024-04-25T09:11:37.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 Processor -- start 2024-04-25T09:11:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22da2f30 0x557d22df3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22dec920 0x557d22df41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 0x557d22da6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d22bac990 con 0x557d22da2f30 2024-04-25T09:11:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d22bede40 con 0x557d22dec920 2024-04-25T09:11:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d22b7d900 con 0x557d22ded240 2024-04-25T09:11:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 10 client.0 _ll_register_callbacks cb 0x557d22ca51c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:37.303 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa755e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22da2f30 0x557d22df3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa755e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22da2f30 0x557d22df3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46700/0 (socket says 172.21.15.59:46700) 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa755e00640 1 -- 172.21.15.59:0/2245619709 learned_addr learned my addr 172.21.15.59:0/2245619709 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa756800640 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 0x557d22da6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa74fe00640 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22dec920 0x557d22df41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa755e00640 1 -- 172.21.15.59:0/2245619709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 msgr2=0x557d22da6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa755e00640 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 0x557d22da6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa755e00640 1 -- 172.21.15.59:0/2245619709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22dec920 msgr2=0x557d22df41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa755e00640 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22dec920 0x557d22df41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa755e00640 1 -- 172.21.15.59:0/2245619709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d22baa630 con 0x557d22da2f30 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa755e00640 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22da2f30 0x557d22df3c80 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fa74800f540 tx=0x7fa748000ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a8c2f5908c1f043 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa73b400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa73b400640 1 -- 172.21.15.59:0/2245619709 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748082070 con 0x557d22da2f30 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa73b400640 1 -- 172.21.15.59:0/2245619709 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa748086400 con 0x557d22da2f30 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.310+0000 7fa75fe68000 1 -- 172.21.15.59:0/2245619709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa748056f00 con 0x557d22da2f30 2024-04-25T09:11:37.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa73b400640 1 -- 172.21.15.59:0/2245619709 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa748061260 con 0x557d22da2f30 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 10 client.9258 fetch_fsmap learned FSMap version 110 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 -- 172.21.15.59:0/2245619709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x557d22b7a3a0 con 0x557d22da2f30 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa73b400640 1 -- 172.21.15.59:0/2245619709 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748056f00 con 0x557d22da2f30 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa73b400640 1 -- 172.21.15.59:0/2245619709 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 110) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa748060dd0 con 0x557d22da2f30 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 10 client.9258 fetch_fsmap finished waiting for FSMap version 110 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 10 client.9258 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 20 client.9258 populate_metadata read hostname 'smithi059' 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x557d22da74b0 0x557d22da7890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 4 client.9258 mds_command: new command op to 8955 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 -- 172.21.15.59:0/2245619709 --> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d22b8da50 con 0x557d22da74b0 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa74fe00640 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x557d22da74b0 0x557d22da7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa74fe00640 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x557d22da74b0 0x557d22da7890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad7864b2c0573239 server_cookie=f5b5c29789219477 in_seq=0 out_seq=0 2024-04-25T09:11:37.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa73b400640 10 client.9258 ms_handle_connect on v2:172.21.15.59:6832/1679876837 2024-04-25T09:11:37.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa73b400640 1 -- 172.21.15.59:0/2245619709 <== mds.0 v2:172.21.15.59:6832/1679876837 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x557d22b8da50 con 0x557d22da74b0 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa73b400640 10 client.9258 handle_command_reply: tid=0 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 client.9258 shutdown 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 -- 172.21.15.59:0/2245619709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22da2f30 msgr2=0x557d22df3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22da2f30 0x557d22df3c80 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fa74800f540 tx=0x7fa748000ff0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 -- 172.21.15.59:0/2245619709 shutdown_connections 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x557d22da74b0 0x557d22da7890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 0x557d22da6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22dec920 0x557d22df41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 --2- 172.21.15.59:0/2245619709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22da2f30 0x557d22df3c80 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 -- 172.21.15.59:0/2245619709 >> 172.21.15.59:0/2245619709 conn(0x557d22da92a0 msgr2=0x557d22da19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa73b400640 0 client.9258 ms_handle_reset on v2:172.21.15.59:6832/1679876837 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 -- 172.21.15.59:0/2245619709 shutdown_connections 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 1 -- 172.21.15.59:0/2245619709 wait complete. 2024-04-25T09:11:37.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.314+0000 7fa75fe68000 20 client.9258 trim_cache size 0 max 16384 2024-04-25T09:11:37.319 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa75fe68000 1 Processor -- start 2024-04-25T09:11:37.320 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa75fe68000 1 -- start start 2024-04-25T09:11:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa75fe68000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22da2f30 0x557d22da6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa75fe68000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22dec920 0x557d22da6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa75fe68000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22ded240 0x557d22df67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa75fe68000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7581ff9b0 con 0x557d22ded240 2024-04-25T09:11:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa75fe68000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7581fede0 con 0x557d22dec920 2024-04-25T09:11:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa75fe68000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7581ff3b0 con 0x557d22da2f30 2024-04-25T09:11:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa756800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22ded240 0x557d22df67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa756800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22ded240 0x557d22df67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46710/0 (socket says 172.21.15.59:46710) 2024-04-25T09:11:37.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa756800640 1 -- 172.21.15.59:0/933732798 learned_addr learned my addr 172.21.15.59:0/933732798 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa74fe00640 1 --2- 172.21.15.59:0/933732798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22dec920 0x557d22da6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa755e00640 1 --2- 172.21.15.59:0/933732798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22da2f30 0x557d22da6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa756800640 1 -- 172.21.15.59:0/933732798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22da2f30 msgr2=0x557d22da6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa756800640 1 --2- 172.21.15.59:0/933732798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22da2f30 0x557d22da6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa756800640 1 -- 172.21.15.59:0/933732798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22dec920 msgr2=0x557d22da6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa756800640 1 --2- 172.21.15.59:0/933732798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22dec920 0x557d22da6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa756800640 1 -- 172.21.15.59:0/933732798 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d22ded070 con 0x557d22ded240 2024-04-25T09:11:37.322 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.330+0000 7fa74fe00640 1 --2- 172.21.15.59:0/933732798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22dec920 0x557d22da6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa756800640 1 --2- 172.21.15.59:0/933732798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22ded240 0x557d22df67e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fa75001cad0 tx=0x7fa750004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e10a29f94221f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.323 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa746000640 1 -- 172.21.15.59:0/933732798 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7500be030 con 0x557d22ded240 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa746000640 1 -- 172.21.15.59:0/933732798 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa750009cd0 con 0x557d22ded240 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa746000640 1 -- 172.21.15.59:0/933732798 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7500b2040 con 0x557d22ded240 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 -- 172.21.15.59:0/933732798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22ded240 msgr2=0x557d22df67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 --2- 172.21.15.59:0/933732798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22ded240 0x557d22df67e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fa75001cad0 tx=0x7fa750004ac0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 -- 172.21.15.59:0/933732798 shutdown_connections 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 --2- 172.21.15.59:0/933732798 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22ded240 0x557d22df67e0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 --2- 172.21.15.59:0/933732798 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22dec920 0x557d22da6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 --2- 172.21.15.59:0/933732798 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22da2f30 0x557d22da6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 -- 172.21.15.59:0/933732798 >> 172.21.15.59:0/933732798 conn(0x557d22da92a0 msgr2=0x557d22dd8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 -- 172.21.15.59:0/933732798 shutdown_connections 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 -- 172.21.15.59:0/933732798 wait complete. 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 -- start start 2024-04-25T09:11:37.324 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 Processor -- start 2024-04-25T09:11:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22da2f30 0x557d22df9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 0x557d22df99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 0x557d22e49060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d22bf63d0 con 0x557d22dec920 2024-04-25T09:11:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d22cadd50 con 0x557d22da2f30 2024-04-25T09:11:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d22b8c980 con 0x557d22ded240 2024-04-25T09:11:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa75fe68000 10 client.0 _ll_register_callbacks cb 0x7fa7480016a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa74fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 0x557d22df99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa755e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22da2f30 0x557d22df9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa74fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 0x557d22df99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46722/0 (socket says 172.21.15.59:46722) 2024-04-25T09:11:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa756800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 0x557d22e49060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa74fe00640 1 -- 172.21.15.59:0/4029564039 learned_addr learned my addr 172.21.15.59:0/4029564039 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa74fe00640 1 -- 172.21.15.59:0/4029564039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 msgr2=0x557d22e49060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa74fe00640 1 --2- 172.21.15.59:0/4029564039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 0x557d22e49060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa74fe00640 1 -- 172.21.15.59:0/4029564039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22da2f30 msgr2=0x557d22df9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa74fe00640 1 --2- 172.21.15.59:0/4029564039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22da2f30 0x557d22df9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa74fe00640 1 -- 172.21.15.59:0/4029564039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d22c73600 con 0x557d22dec920 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa74fe00640 1 --2- 172.21.15.59:0/4029564039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 0x557d22df99b0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x557d22dae0f0 tx=0x7fa7400046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414b7c0c804e4fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.334+0000 7fa73b400640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa73b400640 1 -- 172.21.15.59:0/4029564039 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74002d1d0 con 0x557d22dec920 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa73b400640 1 -- 172.21.15.59:0/4029564039 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fa74002d370 con 0x557d22dec920 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 -- 172.21.15.59:0/4029564039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d22bff2e0 con 0x557d22dec920 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa73b400640 1 -- 172.21.15.59:0/4029564039 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa74003c050 con 0x557d22dec920 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 10 client.9264 fetch_fsmap learned FSMap version 110 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 -- 172.21.15.59:0/4029564039 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x557d22b869b0 con 0x557d22dec920 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa73b400640 1 -- 172.21.15.59:0/4029564039 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557d22bff2e0 con 0x557d22dec920 2024-04-25T09:11:37.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa73b400640 1 -- 172.21.15.59:0/4029564039 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 110) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fa74003f020 con 0x557d22dec920 2024-04-25T09:11:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 10 client.9264 fetch_fsmap finished waiting for FSMap version 110 2024-04-25T09:11:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 10 client.9264 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:11:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 20 client.9264 populate_metadata read hostname 'smithi059' 2024-04-25T09:11:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 --2- 172.21.15.59:0/4029564039 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x557d22e495a0 0x557d22e49980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 4 client.9264 mds_command: new command op to 8955 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:11:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 -- 172.21.15.59:0/4029564039 --> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557d22bf9630 con 0x557d22e495a0 2024-04-25T09:11:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa755e00640 1 --2- 172.21.15.59:0/4029564039 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x557d22e495a0 0x557d22e49980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa73b400640 10 client.9264 ms_handle_connect on v2:172.21.15.59:6832/1679876837 2024-04-25T09:11:37.329 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa755e00640 1 --2- 172.21.15.59:0/4029564039 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x557d22e495a0 0x557d22e49980 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d35249813169ab8a server_cookie=9db75ab06a6af5d7 in_seq=0 out_seq=0 2024-04-25T09:11:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa73b400640 1 -- 172.21.15.59:0/4029564039 <== mds.0 v2:172.21.15.59:6832/1679876837 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x557d22bf9630 con 0x557d22e495a0 2024-04-25T09:11:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa73b400640 10 client.9264 handle_command_reply: tid=0 2024-04-25T09:11:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 client.9264 shutdown 2024-04-25T09:11:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 -- 172.21.15.59:0/4029564039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 msgr2=0x557d22df99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 --2- 172.21.15.59:0/4029564039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 0x557d22df99b0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x557d22dae0f0 tx=0x7fa7400046d0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 -- 172.21.15.59:0/4029564039 shutdown_connections 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 --2- 172.21.15.59:0/4029564039 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x557d22e495a0 0x557d22e49980 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 --2- 172.21.15.59:0/4029564039 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x557d22ded240 0x557d22e49060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 --2- 172.21.15.59:0/4029564039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557d22dec920 0x557d22df99b0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 --2- 172.21.15.59:0/4029564039 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x557d22da2f30 0x557d22df9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa73b400640 0 client.9264 ms_handle_reset on v2:172.21.15.59:6832/1679876837 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 -- 172.21.15.59:0/4029564039 >> 172.21.15.59:0/4029564039 conn(0x557d22da92a0 msgr2=0x557d22da5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 -- 172.21.15.59:0/4029564039 shutdown_connections 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 1 -- 172.21.15.59:0/4029564039 wait complete. 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75fe68000 20 client.9264 trim_cache size 0 max 16384 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:11:37.331 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 8955, 2024-04-25T09:11:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:11:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:11:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:11:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 4.5879102679999999, 2024-04-25T09:11:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 110, 2024-04-25T09:11:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 122, 2024-04-25T09:11:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 122, 2024-04-25T09:11:37.332 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 24.605811961000001 2024-04-25T09:11:37.332 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:11:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75ca00640 1 -- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa734066f90 msgr2=0x7fa734069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75ca00640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa734066f90 0x7fa734069450 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa7580cc780 tx=0x7fa740008040 comp rx=0 tx=0).stop 2024-04-25T09:11:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75ca00640 1 -- 172.21.15.59:0/129055041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c004d50 msgr2=0x7fa7580c4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75ca00640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c004d50 0x7fa7580c4d30 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7fa748011980 tx=0x7fa748011e40 comp rx=0 tx=0).stop 2024-04-25T09:11:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75ca00640 1 -- 172.21.15.59:0/129055041 shutdown_connections 2024-04-25T09:11:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75ca00640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa734066f90 0x7fa734069450 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75ca00640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa7580b0ac0 0x7fa75815ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75ca00640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa758159350 0x7fa75815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75ca00640 1 --2- 172.21.15.59:0/129055041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa73c004d50 0x7fa7580c4d30 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75ca00640 1 -- 172.21.15.59:0/129055041 >> 172.21.15.59:0/129055041 conn(0x7fa7580cfd90 msgr2=0x7fa7581598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.333 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75ca00640 1 -- 172.21.15.59:0/129055041 shutdown_connections 2024-04-25T09:11:37.334 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.338+0000 7fa75ca00640 1 -- 172.21.15.59:0/129055041 wait complete. 2024-04-25T09:11:37.347 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:11:37.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.498+0000 7fcf93a00640 1 Processor -- start 2024-04-25T09:11:37.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.498+0000 7fcf93a00640 1 -- start start 2024-04-25T09:11:37.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.498+0000 7fcf93a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf8c0cef30 0x7fcf8c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.489 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.498+0000 7fcf93a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcf8c06e900 0x7fcf8c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.498+0000 7fcf93a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf8c15ac60 con 0x7fcf8c144140 2024-04-25T09:11:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.498+0000 7fcf93a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8c06ed50 con 0x7fcf8c0cef30 2024-04-25T09:11:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.498+0000 7fcf93a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8c0cf3e0 con 0x7fcf8c06e900 2024-04-25T09:11:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.498+0000 7fcf83e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf8c0cef30 0x7fcf8c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.498+0000 7fcf83e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf8c0cef30 0x7fcf8c06e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46728/0 (socket says 172.21.15.59:46728) 2024-04-25T09:11:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.498+0000 7fcf83e00640 1 -- 172.21.15.59:0/3769038235 learned_addr learned my addr 172.21.15.59:0/3769038235 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf91a00640 1 --2- 172.21.15.59:0/3769038235 >> v2:172.21.15.178:3300/0 conn(0x7fcf8c06e900 0x7fcf8c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf83e00640 1 -- 172.21.15.59:0/3769038235 >> v2:172.21.15.178:3300/0 conn(0x7fcf8c06e900 msgr2=0x7fcf8c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf83e00640 1 --2- 172.21.15.59:0/3769038235 >> v2:172.21.15.178:3300/0 conn(0x7fcf8c06e900 0x7fcf8c0b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf83e00640 1 -- 172.21.15.59:0/3769038235 >> v1:172.21.15.178:6789/0 conn(0x7fcf8c144140 legacy=0x7fcf8c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:37.490 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf83e00640 1 -- 172.21.15.59:0/3769038235 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c15af20 con 0x7fcf8c0cef30 2024-04-25T09:11:37.492 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf83e00640 1 --2- 172.21.15.59:0/3769038235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c0cef30 0x7fcf8c06e3c0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0cddd0 tx=0x7fcf7401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e465940700201b70 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf8be00640 1 -- 172.21.15.59:0/3769038235 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf740b0070 con 0x7fcf8c0cef30 2024-04-25T09:11:37.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf8be00640 1 -- 172.21.15.59:0/3769038235 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf740ab600 con 0x7fcf8c0cef30 2024-04-25T09:11:37.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf8be00640 1 -- 172.21.15.59:0/3769038235 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf740ab9d0 con 0x7fcf8c0cef30 2024-04-25T09:11:37.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf93a00640 1 -- 172.21.15.59:0/3769038235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c0cef30 msgr2=0x7fcf8c06e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.493 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf93a00640 1 --2- 172.21.15.59:0/3769038235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c0cef30 0x7fcf8c06e3c0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c0cddd0 tx=0x7fcf7401c4e0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf93a00640 1 -- 172.21.15.59:0/3769038235 shutdown_connections 2024-04-25T09:11:37.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf93a00640 1 --2- 172.21.15.59:0/3769038235 >> v2:172.21.15.178:3300/0 conn(0x7fcf8c06e900 0x7fcf8c0b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf93a00640 1 --2- 172.21.15.59:0/3769038235 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c0cef30 0x7fcf8c06e3c0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.502+0000 7fcf93a00640 1 -- 172.21.15.59:0/3769038235 >> 172.21.15.59:0/3769038235 conn(0x7fcf8c066fa0 msgr2=0x7fcf8c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf93a00640 1 -- 172.21.15.59:0/3769038235 shutdown_connections 2024-04-25T09:11:37.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf93a00640 1 -- 172.21.15.59:0/3769038235 wait complete. 2024-04-25T09:11:37.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf93a00640 1 Processor -- start 2024-04-25T09:11:37.495 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf93a00640 1 -- start start 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf93a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf8c06e900 0x7fcf8c150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf93a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c0cef30 0x7fcf8c14fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf93a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8c144140 0x7fcf8c1417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf93a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c15ba00 con 0x7fcf8c0cef30 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf93a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c144520 con 0x7fcf8c144140 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf93a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c15bb80 con 0x7fcf8c06e900 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf83e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c0cef30 0x7fcf8c14fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf83e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c0cef30 0x7fcf8c14fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46740/0 (socket says 172.21.15.59:46740) 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf83e00640 1 -- 172.21.15.59:0/3411266035 learned_addr learned my addr 172.21.15.59:0/3411266035 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf91000640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf8c06e900 0x7fcf8c150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf91a00640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8c144140 0x7fcf8c1417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf83e00640 1 -- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf8c06e900 msgr2=0x7fcf8c150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf83e00640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf8c06e900 0x7fcf8c150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf83e00640 1 -- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8c144140 msgr2=0x7fcf8c1417f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf83e00640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8c144140 0x7fcf8c1417f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf83e00640 1 -- 172.21.15.59:0/3411266035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c139fe0 con 0x7fcf8c0cef30 2024-04-25T09:11:37.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf91000640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf8c06e900 0x7fcf8c150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:37.498 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf83e00640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c0cef30 0x7fcf8c14fd70 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fcf7401a110 tx=0x7fcf74019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf89600640 1 -- 172.21.15.59:0/3411266035 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf740b9070 con 0x7fcf8c0cef30 2024-04-25T09:11:37.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf89600640 1 -- 172.21.15.59:0/3411266035 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf740b4400 con 0x7fcf8c0cef30 2024-04-25T09:11:37.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf89600640 1 -- 172.21.15.59:0/3411266035 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf740b0040 con 0x7fcf8c0cef30 2024-04-25T09:11:37.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.506+0000 7fcf93a00640 1 -- 172.21.15.59:0/3411266035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8c13a280 con 0x7fcf8c0cef30 2024-04-25T09:11:37.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.510+0000 7fcf93a00640 1 -- 172.21.15.59:0/3411266035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8c13a840 con 0x7fcf8c0cef30 2024-04-25T09:11:37.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.510+0000 7fcf93a00640 1 -- 172.21.15.59:0/3411266035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8c0745d0 con 0x7fcf8c0cef30 2024-04-25T09:11:37.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.510+0000 7fcf89600640 1 -- 172.21.15.59:0/3411266035 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcf740bc070 con 0x7fcf8c0cef30 2024-04-25T09:11:37.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.510+0000 7fcf89600640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf68066f60 0x7fcf68069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:37.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.510+0000 7fcf89600640 1 -- 172.21.15.59:0/3411266035 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fcf7411e280 con 0x7fcf8c0cef30 2024-04-25T09:11:37.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.510+0000 7fcf91000640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf68066f60 0x7fcf68069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:37.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.510+0000 7fcf91000640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf68066f60 0x7fcf68069420 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0098b0 tx=0x7fcf7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:37.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.514+0000 7fcf89600640 1 -- 172.21.15.59:0/3411266035 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcf740160d0 con 0x7fcf8c0cef30 2024-04-25T09:11:37.701 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 -- 172.21.15.59:0/3411266035 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcf8c13ac20 con 0x7fcf8c0cef30 2024-04-25T09:11:37.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf89600640 1 -- 172.21.15.59:0/3411266035 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v110) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcf740ef0a0 con 0x7fcf8c0cef30 2024-04-25T09:11:37.702 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:11:37.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 -- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf68066f60 msgr2=0x7fcf68069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf68066f60 0x7fcf68069420 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0098b0 tx=0x7fcf7c008040 comp rx=0 tx=0).stop 2024-04-25T09:11:37.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 -- 172.21.15.59:0/3411266035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c0cef30 msgr2=0x7fcf8c14fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:37.704 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c0cef30 0x7fcf8c14fd70 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fcf7401a110 tx=0x7fcf74019280 comp rx=0 tx=0).stop 2024-04-25T09:11:37.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 -- 172.21.15.59:0/3411266035 shutdown_connections 2024-04-25T09:11:37.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcf68066f60 0x7fcf68069420 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcf8c144140 0x7fcf8c1417f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf8c0cef30 0x7fcf8c14fd70 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 --2- 172.21.15.59:0/3411266035 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcf8c06e900 0x7fcf8c150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:37.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 -- 172.21.15.59:0/3411266035 >> 172.21.15.59:0/3411266035 conn(0x7fcf8c066fa0 msgr2=0x7fcf8c06e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:37.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 -- 172.21.15.59:0/3411266035 shutdown_connections 2024-04-25T09:11:37.705 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:37.714+0000 7fcf93a00640 1 -- 172.21.15.59:0/3411266035 wait complete. 2024-04-25T09:11:37.724 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:11:37.724 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:11:37.724 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:11:37.724 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:11:37.724 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:37.724 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:11:37.724 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:11:37.724 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:11:37.724 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:37.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.724 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:11:37.734 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:11:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:11:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:11:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:11:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.734 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:11:37.734 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:37.734 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41870sec preferred_lft 41870sec 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.735 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:11:37.736 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:37.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.737 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:11:37.795 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:11:37.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.798 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:11:37.850 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:11:37.850 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:11:37.850 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:11:37.850 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:11:37.850 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:11:37.851 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:11:37.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.851 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:11:37.851 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:11:37.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:11:37.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:11:37.851 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:11:37.851 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:11:37.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.943 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:11:37.952 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:11:37.952 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:11:37.952 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:37.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:37.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:11:38.012 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:11:38.013 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:38.061 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:38.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:11:38.061 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:38.113 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:11:38.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:38.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:38.202 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:38.202 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:38.202 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:11:38.218 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:38.218 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:38.218 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:11:38.218 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:11:38.218 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:11:38.227 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:38.227 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:38.227 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:11:38.227 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:11:38.227 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:11:38.228 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:11:38.228 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:11:38.228 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:11:38.232 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:11:38.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:38.232 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:38.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:38.251 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:11:38.304 INFO:teuthology.orchestra.run.smithi059.stdout:client9273 2024-04-25T09:11:38.304 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:38.304 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:38.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:38.353 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:11:38.413 INFO:teuthology.orchestra.run.smithi059.stdout:./ 2024-04-25T09:11:38.413 INFO:teuthology.orchestra.run.smithi059.stdout:./parent 2024-04-25T09:11:38.413 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/flushed 2024-04-25T09:11:38.413 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/flushed/charlie 2024-04-25T09:11:38.413 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/flushed/alpha 2024-04-25T09:11:38.413 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/unflushed 2024-04-25T09:11:38.413 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/unflushed/jfile 2024-04-25T09:11:38.414 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:38.414 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:38.414 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:38.414 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:38.414 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:11:38.414 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:38.524 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:11:38.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:38.534 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:38.534 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:38.534 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:38.534 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:38.534 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T09:11:38.534 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:38.573 INFO:tasks.ceph.mds.c.smithi059.stderr:2024-04-25T09:11:38.582+0000 7f75aec00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:11:38.638 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627776 2024-04-25T09:11:38.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:38.647 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:38.647 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:38.647 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:38.647 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:38.648 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T09:11:38.648 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:38.755 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627777 2024-04-25T09:11:38.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:38.764 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:38.765 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:38.765 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:38.765 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:38.765 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T09:11:38.765 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:38.874 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627780 2024-04-25T09:11:38.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:38.884 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:38.884 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:38.884 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:38.884 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:38.884 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T09:11:38.884 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:38.994 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627778 2024-04-25T09:11:38.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:39.004 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:39.004 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:39.004 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:39.004 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:39.004 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T09:11:39.004 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:39.111 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627781 2024-04-25T09:11:39.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:39.120 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:39.120 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:39.120 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:39.120 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:39.120 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T09:11:39.120 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:39.230 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627782 2024-04-25T09:11:39.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:39.239 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:39.240 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:39.294 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:39.294 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:39.345 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.538+0000 7f8428200640 1 Processor -- start 2024-04-25T09:11:39.529 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.538+0000 7f8428200640 1 -- start start 2024-04-25T09:11:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.542+0000 7f8428200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84200af840 0x7f84200b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.542+0000 7f8428200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84200b23e0 con 0x7f84200b1f20 2024-04-25T09:11:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.542+0000 7f8428200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84200acb80 con 0x7f8420146740 2024-04-25T09:11:39.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.542+0000 7f8428200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842006d9c0 con 0x7f84200af840 2024-04-25T09:11:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.542+0000 7f8426200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f84200b1f20 0x7f84200aeb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:55510/0 (socket says 172.21.15.59:55510) 2024-04-25T09:11:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.542+0000 7f8426200640 1 -- 172.21.15.59:0/933875327 learned_addr learned my addr 172.21.15.59:0/933875327 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.542+0000 7f8424e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84200af840 0x7f84200b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.542+0000 7f841fe00640 1 -- 172.21.15.59:0/933875327 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5621227 0 0) 0x7f84200b23e0 con 0x7f84200b1f20 2024-04-25T09:11:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.542+0000 7f841fe00640 1 -- 172.21.15.59:0/933875327 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8408003530 con 0x7f84200b1f20 2024-04-25T09:11:39.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.542+0000 7f8424e00640 1 -- 172.21.15.59:0/933875327 >> v1:172.21.15.178:6789/0 conn(0x7f8420146740 legacy=0x7f842006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:39.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.542+0000 7f8424e00640 1 -- 172.21.15.59:0/933875327 >> v1:172.21.15.59:6789/0 conn(0x7f84200b1f20 legacy=0x7f84200aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:39.532 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.542+0000 7f8424e00640 1 -- 172.21.15.59:0/933875327 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84200ace60 con 0x7f84200af840 2024-04-25T09:11:39.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f8424e00640 1 --2- 172.21.15.59:0/933875327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84200af840 0x7f84200b19e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f840c0097c0 tx=0x7f840c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464e669df12dd263 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:39.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f841fe00640 1 -- 172.21.15.59:0/933875327 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c0b0070 con 0x7f84200af840 2024-04-25T09:11:39.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f841fe00640 1 -- 172.21.15.59:0/933875327 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c004230 con 0x7f84200af840 2024-04-25T09:11:39.534 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f841fe00640 1 -- 172.21.15.59:0/933875327 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c003620 con 0x7f84200af840 2024-04-25T09:11:39.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f8428200640 1 -- 172.21.15.59:0/933875327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84200af840 msgr2=0x7f84200b19e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:39.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f8428200640 1 --2- 172.21.15.59:0/933875327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84200af840 0x7f84200b19e0 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f840c0097c0 tx=0x7f840c01c460 comp rx=0 tx=0).stop 2024-04-25T09:11:39.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f8428200640 1 -- 172.21.15.59:0/933875327 shutdown_connections 2024-04-25T09:11:39.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f8428200640 1 --2- 172.21.15.59:0/933875327 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84200af840 0x7f84200b19e0 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:39.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f8428200640 1 -- 172.21.15.59:0/933875327 >> 172.21.15.59:0/933875327 conn(0x7f8420066fa0 msgr2=0x7f842006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:39.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f8428200640 1 -- 172.21.15.59:0/933875327 shutdown_connections 2024-04-25T09:11:39.535 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f8428200640 1 -- 172.21.15.59:0/933875327 wait complete. 2024-04-25T09:11:39.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f8428200640 1 Processor -- start 2024-04-25T09:11:39.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.546+0000 7f8428200640 1 -- start start 2024-04-25T09:11:39.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8428200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84200af840 0x7f84201691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8428200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84200b1f20 0x7f84200b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8428200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8420146740 0x7f842015b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8428200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84200ae150 con 0x7f84200b1f20 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8428200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84200ae2d0 con 0x7f84200af840 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8428200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842016b930 con 0x7f8420146740 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8424e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84200b1f20 0x7f84200b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8424e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84200b1f20 0x7f84200b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46750/0 (socket says 172.21.15.59:46750) 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8424e00640 1 -- 172.21.15.59:0/1271786410 learned_addr learned my addr 172.21.15.59:0/1271786410 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8425800640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84200af840 0x7f84201691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8426200640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8420146740 0x7f842015b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8424e00640 1 -- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8420146740 msgr2=0x7f842015b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8424e00640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8420146740 0x7f842015b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8424e00640 1 -- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84200af840 msgr2=0x7f84201691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:39.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8424e00640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84200af840 0x7f84201691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8424e00640 1 -- 172.21.15.59:0/1271786410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84201429f0 con 0x7f84200b1f20 2024-04-25T09:11:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8424e00640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84200b1f20 0x7f84200b4050 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f840c0097c0 tx=0x7f840c019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f841d600640 1 -- 172.21.15.59:0/1271786410 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c0b9020 con 0x7f84200b1f20 2024-04-25T09:11:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f841d600640 1 -- 172.21.15.59:0/1271786410 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840c003df0 con 0x7f84200b1f20 2024-04-25T09:11:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f841d600640 1 -- 172.21.15.59:0/1271786410 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840c0b0040 con 0x7f84200b1f20 2024-04-25T09:11:39.540 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8428200640 1 -- 172.21.15.59:0/1271786410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8420142cd0 con 0x7f84200b1f20 2024-04-25T09:11:39.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8428200640 1 -- 172.21.15.59:0/1271786410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842015b6f0 con 0x7f84200b1f20 2024-04-25T09:11:39.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f8428200640 1 -- 172.21.15.59:0/1271786410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84200745d0 con 0x7f84200b1f20 2024-04-25T09:11:39.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.550+0000 7f841d600640 1 -- 172.21.15.59:0/1271786410 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f840c0bc020 con 0x7f84200b1f20 2024-04-25T09:11:39.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.554+0000 7f841d600640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8400066f90 0x7f8400069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:39.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.554+0000 7f841d600640 1 -- 172.21.15.59:0/1271786410 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f840c11f110 con 0x7f84200b1f20 2024-04-25T09:11:39.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.554+0000 7f8425800640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8400066f90 0x7f8400069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:39.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.554+0000 7f8425800640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8400066f90 0x7f8400069450 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f842013adb0 tx=0x7f8414009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:39.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.558+0000 7f841d600640 1 -- 172.21.15.59:0/1271786410 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f840c0c3030 con 0x7f84200b1f20 2024-04-25T09:11:39.708 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.718+0000 7f8428200640 1 -- 172.21.15.59:0/1271786410 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84201474b0 con 0x7f84200b1f20 2024-04-25T09:11:39.709 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.718+0000 7f841d600640 1 -- 172.21.15.59:0/1271786410 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+17077 (secure 0 0 0) 0x7f840c016050 con 0x7f84200b1f20 2024-04-25T09:11:39.709 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:39.710 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":122,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:31.742020+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:15.429862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:16.011038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/29546856":"2024-04-26T09:11:31.741997+0000","172.21.15.59:6834/29546856":"2024-04-26T09:11:31.741997+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:39.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.722+0000 7f8428200640 1 -- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8400066f90 msgr2=0x7f8400069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:39.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.722+0000 7f8428200640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8400066f90 0x7f8400069450 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f842013adb0 tx=0x7f8414009040 comp rx=0 tx=0).stop 2024-04-25T09:11:39.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.722+0000 7f8428200640 1 -- 172.21.15.59:0/1271786410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84200b1f20 msgr2=0x7f84200b4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:39.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.722+0000 7f8428200640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84200b1f20 0x7f84200b4050 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f840c0097c0 tx=0x7f840c019200 comp rx=0 tx=0).stop 2024-04-25T09:11:39.711 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.722+0000 7f8428200640 1 -- 172.21.15.59:0/1271786410 shutdown_connections 2024-04-25T09:11:39.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.722+0000 7f8428200640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8400066f90 0x7f8400069450 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:39.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.722+0000 7f8428200640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8420146740 0x7f842015b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:39.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.722+0000 7f8428200640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84200b1f20 0x7f84200b4050 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:39.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.722+0000 7f8428200640 1 --2- 172.21.15.59:0/1271786410 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f84200af840 0x7f84201691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:39.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.722+0000 7f8428200640 1 -- 172.21.15.59:0/1271786410 >> 172.21.15.59:0/1271786410 conn(0x7f8420066fa0 msgr2=0x7f84200ae4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:39.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.722+0000 7f8428200640 1 -- 172.21.15.59:0/1271786410 shutdown_connections 2024-04-25T09:11:39.712 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.722+0000 7f8428200640 1 -- 172.21.15.59:0/1271786410 wait complete. 2024-04-25T09:11:39.731 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:11:15.429862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:11:16.011038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:39.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:39.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.886+0000 7fdb4c800640 1 Processor -- start 2024-04-25T09:11:39.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.886+0000 7fdb4c800640 1 -- start start 2024-04-25T09:11:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb4c800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fdb44072210 0x7fdb440cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb4c800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb440ce1d0 0x7fdb440ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb4c800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4406ac10 con 0x7fdb4415dd90 2024-04-25T09:11:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb4c800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb440b2dc0 con 0x7fdb440ce1d0 2024-04-25T09:11:39.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb4c800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb4406aeb0 con 0x7fdb44072210 2024-04-25T09:11:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb4a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb440ce1d0 0x7fdb440ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb4a800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb440ce1d0 0x7fdb440ce5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46758/0 (socket says 172.21.15.59:46758) 2024-04-25T09:11:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb4a800640 1 -- 172.21.15.59:0/1796589307 learned_addr learned my addr 172.21.15.59:0/1796589307 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb49400640 1 --2- 172.21.15.59:0/1796589307 >> v2:172.21.15.178:3300/0 conn(0x7fdb44072210 0x7fdb440cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb4a800640 1 -- 172.21.15.59:0/1796589307 >> v2:172.21.15.178:3300/0 conn(0x7fdb44072210 msgr2=0x7fdb440cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb4a800640 1 --2- 172.21.15.59:0/1796589307 >> v2:172.21.15.178:3300/0 conn(0x7fdb44072210 0x7fdb440cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb4a800640 1 -- 172.21.15.59:0/1796589307 >> v1:172.21.15.178:6789/0 conn(0x7fdb4415dd90 legacy=0x7fdb44071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:39.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.890+0000 7fdb4a800640 1 -- 172.21.15.59:0/1796589307 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4406b190 con 0x7fdb440ce1d0 2024-04-25T09:11:39.882 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb4a800640 1 --2- 172.21.15.59:0/1796589307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb440ce1d0 0x7fdb440ce5e0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fdb440d0cc0 tx=0x7fdb4001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0e10ef6cbd3e4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:39.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb48a00640 1 -- 172.21.15.59:0/1796589307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400a5710 con 0x7fdb440ce1d0 2024-04-25T09:11:39.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb48a00640 1 -- 172.21.15.59:0/1796589307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb400a58b0 con 0x7fdb440ce1d0 2024-04-25T09:11:39.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb48a00640 1 -- 172.21.15.59:0/1796589307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400a5c80 con 0x7fdb440ce1d0 2024-04-25T09:11:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb4c800640 1 -- 172.21.15.59:0/1796589307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb440ce1d0 msgr2=0x7fdb440ce5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb4c800640 1 --2- 172.21.15.59:0/1796589307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb440ce1d0 0x7fdb440ce5e0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7fdb440d0cc0 tx=0x7fdb4001c960 comp rx=0 tx=0).stop 2024-04-25T09:11:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb4c800640 1 -- 172.21.15.59:0/1796589307 shutdown_connections 2024-04-25T09:11:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb4c800640 1 --2- 172.21.15.59:0/1796589307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb440ce1d0 0x7fdb440ce5e0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb4c800640 1 --2- 172.21.15.59:0/1796589307 >> v2:172.21.15.178:3300/0 conn(0x7fdb44072210 0x7fdb440cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb4c800640 1 -- 172.21.15.59:0/1796589307 >> 172.21.15.59:0/1796589307 conn(0x7fdb440cfd90 msgr2=0x7fdb440d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb4c800640 1 -- 172.21.15.59:0/1796589307 shutdown_connections 2024-04-25T09:11:39.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb4c800640 1 -- 172.21.15.59:0/1796589307 wait complete. 2024-04-25T09:11:39.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb4c800640 1 Processor -- start 2024-04-25T09:11:39.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.894+0000 7fdb4c800640 1 -- start start 2024-04-25T09:11:39.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb4c800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb44072210 0x7fdb44166de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb4c800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb440ce1d0 0x7fdb441643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb4c800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb4415dd90 0x7fdb44159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb4c800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440cf6c0 con 0x7fdb44072210 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb4c800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440cf540 con 0x7fdb440ce1d0 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb4c800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb440cf840 con 0x7fdb4415dd90 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb49e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb44072210 0x7fdb44166de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb49e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb44072210 0x7fdb44166de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46768/0 (socket says 172.21.15.59:46768) 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb49e00640 1 -- 172.21.15.59:0/3509534893 learned_addr learned my addr 172.21.15.59:0/3509534893 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb49400640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb440ce1d0 0x7fdb441643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb4a800640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb4415dd90 0x7fdb44159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb49e00640 1 -- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb4415dd90 msgr2=0x7fdb44159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb49e00640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb4415dd90 0x7fdb44159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:39.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb49e00640 1 -- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb440ce1d0 msgr2=0x7fdb441643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb49e00640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb440ce1d0 0x7fdb441643f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb49e00640 1 -- 172.21.15.59:0/3509534893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb44167630 con 0x7fdb44072210 2024-04-25T09:11:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb49400640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb440ce1d0 0x7fdb441643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb49e00640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb44072210 0x7fdb44166de0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800c3a0 tx=0x7fdb3800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb3e000640 1 -- 172.21.15.59:0/3509534893 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb380052d0 con 0x7fdb44072210 2024-04-25T09:11:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb3e000640 1 -- 172.21.15.59:0/3509534893 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb38005470 con 0x7fdb44072210 2024-04-25T09:11:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb3e000640 1 -- 172.21.15.59:0/3509534893 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb38007260 con 0x7fdb44072210 2024-04-25T09:11:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb4c800640 1 -- 172.21.15.59:0/3509534893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb44167910 con 0x7fdb44072210 2024-04-25T09:11:39.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb4c800640 1 -- 172.21.15.59:0/3509534893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb44167ed0 con 0x7fdb44072210 2024-04-25T09:11:39.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb4c800640 1 -- 172.21.15.59:0/3509534893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb440745d0 con 0x7fdb44072210 2024-04-25T09:11:39.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.898+0000 7fdb3e000640 1 -- 172.21.15.59:0/3509534893 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fdb38007400 con 0x7fdb44072210 2024-04-25T09:11:39.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.902+0000 7fdb3e000640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb28066f60 0x7fdb28069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:39.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.902+0000 7fdb3e000640 1 -- 172.21.15.59:0/3509534893 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fdb380846f0 con 0x7fdb44072210 2024-04-25T09:11:39.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.902+0000 7fdb49400640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb28066f60 0x7fdb28069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:39.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.902+0000 7fdb49400640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb28066f60 0x7fdb28069420 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fdb440b1950 tx=0x7fdb34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:39.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:39.906+0000 7fdb3e000640 1 -- 172.21.15.59:0/3509534893 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fdb38055480 con 0x7fdb44072210 2024-04-25T09:11:40.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 -- 172.21.15.59:0/3509534893 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb440cc590 con 0x7fdb44072210 2024-04-25T09:11:40.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb3e000640 1 -- 172.21.15.59:0/3509534893 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v122) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb38054d80 con 0x7fdb44072210 2024-04-25T09:11:40.058 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:11:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 -- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb28066f60 msgr2=0x7fdb28069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb28066f60 0x7fdb28069420 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fdb440b1950 tx=0x7fdb34008040 comp rx=0 tx=0).stop 2024-04-25T09:11:40.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 -- 172.21.15.59:0/3509534893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb44072210 msgr2=0x7fdb44166de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb44072210 0x7fdb44166de0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800c3a0 tx=0x7fdb3800c860 comp rx=0 tx=0).stop 2024-04-25T09:11:40.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 -- 172.21.15.59:0/3509534893 shutdown_connections 2024-04-25T09:11:40.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fdb28066f60 0x7fdb28069420 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fdb4415dd90 0x7fdb44159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fdb440ce1d0 0x7fdb441643f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 --2- 172.21.15.59:0/3509534893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb44072210 0x7fdb44166de0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 -- 172.21.15.59:0/3509534893 >> 172.21.15.59:0/3509534893 conn(0x7fdb440cfd90 msgr2=0x7fdb4415cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:40.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 -- 172.21.15.59:0/3509534893 shutdown_connections 2024-04-25T09:11:40.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.070+0000 7fdb4c800640 1 -- 172.21.15.59:0/3509534893 wait complete. 2024-04-25T09:11:40.079 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:11:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.234+0000 7f411d200640 1 Processor -- start 2024-04-25T09:11:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.234+0000 7f411d200640 1 -- start start 2024-04-25T09:11:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.234+0000 7f411d200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4118144120 0x7f411815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.234+0000 7f411d200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f41180ccbf0 0x7f411815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.234+0000 7f411d200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411815bc40 con 0x7f411815ee60 2024-04-25T09:11:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.234+0000 7f411d200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411815e490 con 0x7f4118144120 2024-04-25T09:11:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.234+0000 7f411d200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411815b3a0 con 0x7f41180ccbf0 2024-04-25T09:11:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.234+0000 7f4115e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4118144120 0x7f411815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.238+0000 7f4115e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4118144120 0x7f411815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46782/0 (socket says 172.21.15.59:46782) 2024-04-25T09:11:40.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.238+0000 7f4115e00640 1 -- 172.21.15.59:0/1372862835 learned_addr learned my addr 172.21.15.59:0/1372862835 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.238+0000 7f410d400640 1 --2- 172.21.15.59:0/1372862835 >> v2:172.21.15.178:3300/0 conn(0x7f41180ccbf0 0x7f411815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.238+0000 7f4115e00640 1 -- 172.21.15.59:0/1372862835 >> v2:172.21.15.178:3300/0 conn(0x7f41180ccbf0 msgr2=0x7f411815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.238+0000 7f4115e00640 1 --2- 172.21.15.59:0/1372862835 >> v2:172.21.15.178:3300/0 conn(0x7f41180ccbf0 0x7f411815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.238+0000 7f4115e00640 1 -- 172.21.15.59:0/1372862835 >> v1:172.21.15.178:6789/0 conn(0x7f411815ee60 legacy=0x7f41180b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.238+0000 7f4115400640 1 -- 172.21.15.59:0/1372862835 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226000080 0 0) 0x7f411815bc40 con 0x7f411815ee60 2024-04-25T09:11:40.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.238+0000 7f4115e00640 1 -- 172.21.15.59:0/1372862835 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411815b680 con 0x7f4118144120 2024-04-25T09:11:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.238+0000 7f4115e00640 1 --2- 172.21.15.59:0/1372862835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4118144120 0x7f411815acd0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f411806b870 tx=0x7f410801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdebb21b024e02c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.238+0000 7f4115400640 1 -- 172.21.15.59:0/1372862835 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41080b1070 con 0x7f4118144120 2024-04-25T09:11:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.238+0000 7f4115400640 1 -- 172.21.15.59:0/1372862835 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41080ac600 con 0x7f4118144120 2024-04-25T09:11:40.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.238+0000 7f4115400640 1 -- 172.21.15.59:0/1372862835 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41080ac9d0 con 0x7f4118144120 2024-04-25T09:11:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 -- 172.21.15.59:0/1372862835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4118144120 msgr2=0x7f411815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 --2- 172.21.15.59:0/1372862835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4118144120 0x7f411815acd0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f411806b870 tx=0x7f410801c490 comp rx=0 tx=0).stop 2024-04-25T09:11:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 -- 172.21.15.59:0/1372862835 shutdown_connections 2024-04-25T09:11:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 --2- 172.21.15.59:0/1372862835 >> v2:172.21.15.178:3300/0 conn(0x7f41180ccbf0 0x7f411815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 --2- 172.21.15.59:0/1372862835 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4118144120 0x7f411815acd0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 -- 172.21.15.59:0/1372862835 >> 172.21.15.59:0/1372862835 conn(0x7f4118067080 msgr2=0x7f411806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 -- 172.21.15.59:0/1372862835 shutdown_connections 2024-04-25T09:11:40.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 -- 172.21.15.59:0/1372862835 wait complete. 2024-04-25T09:11:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 Processor -- start 2024-04-25T09:11:40.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 -- start start 2024-04-25T09:11:40.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41180ccbf0 0x7f41181f9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4118144120 0x7f411815d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411815ee60 0x7f411815d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41181675c0 con 0x7f411815ee60 2024-04-25T09:11:40.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4118167440 con 0x7f4118144120 2024-04-25T09:11:40.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f411d200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4118167740 con 0x7f41180ccbf0 2024-04-25T09:11:40.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f4116800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411815ee60 0x7f411815d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f4116800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411815ee60 0x7f411815d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:46788/0 (socket says 172.21.15.59:46788) 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f4116800640 1 -- 172.21.15.59:0/1031918474 learned_addr learned my addr 172.21.15.59:0/1031918474 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f4115e00640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41180ccbf0 0x7f41181f9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f410d400640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4118144120 0x7f411815d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f4116800640 1 -- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41180ccbf0 msgr2=0x7f41181f9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f4116800640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41180ccbf0 0x7f41181f9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f4116800640 1 -- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4118144120 msgr2=0x7f411815d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f4116800640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4118144120 0x7f411815d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.242+0000 7f4116800640 1 -- 172.21.15.59:0/1031918474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41181429d0 con 0x7f411815ee60 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.246+0000 7f4116800640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411815ee60 0x7f411815d850 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f411000c780 tx=0x7f411000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.246+0000 7f410ea00640 1 -- 172.21.15.59:0/1031918474 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110003db0 con 0x7f411815ee60 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.246+0000 7f410ea00640 1 -- 172.21.15.59:0/1031918474 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f411000ce30 con 0x7f411815ee60 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.246+0000 7f411d200640 1 -- 172.21.15.59:0/1031918474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4118142cb0 con 0x7f411815ee60 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.246+0000 7f410ea00640 1 -- 172.21.15.59:0/1031918474 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110005290 con 0x7f411815ee60 2024-04-25T09:11:40.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.246+0000 7f411d200640 1 -- 172.21.15.59:0/1031918474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4118143270 con 0x7f411815ee60 2024-04-25T09:11:40.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.246+0000 7f411d200640 1 -- 172.21.15.59:0/1031918474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41180745d0 con 0x7f411815ee60 2024-04-25T09:11:40.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.246+0000 7f410ea00640 1 -- 172.21.15.59:0/1031918474 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4110005430 con 0x7f411815ee60 2024-04-25T09:11:40.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.246+0000 7f410ea00640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f40f4066f60 0x7f40f4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.246+0000 7f410ea00640 1 -- 172.21.15.59:0/1031918474 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f41100850e0 con 0x7f411815ee60 2024-04-25T09:11:40.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.246+0000 7f4115e00640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f40f4066f60 0x7f40f4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.250+0000 7f4115e00640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f40f4066f60 0x7f40f4069420 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f41080ae000 tx=0x7f41080a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:40.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.250+0000 7f410ea00640 1 -- 172.21.15.59:0/1031918474 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4110055790 con 0x7f411815ee60 2024-04-25T09:11:40.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 -- 172.21.15.59:0/1031918474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4118164ca0 con 0x7f411815ee60 2024-04-25T09:11:40.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f410ea00640 1 -- 172.21.15.59:0/1031918474 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v122) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4110059830 con 0x7f411815ee60 2024-04-25T09:11:40.403 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:11:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 -- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f40f4066f60 msgr2=0x7f40f4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f40f4066f60 0x7f40f4069420 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f41080ae000 tx=0x7f41080a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 -- 172.21.15.59:0/1031918474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411815ee60 msgr2=0x7f411815d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411815ee60 0x7f411815d850 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f411000c780 tx=0x7f411000cc40 comp rx=0 tx=0).stop 2024-04-25T09:11:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 -- 172.21.15.59:0/1031918474 shutdown_connections 2024-04-25T09:11:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f40f4066f60 0x7f40f4069420 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f411815ee60 0x7f411815d850 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4118144120 0x7f411815d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 --2- 172.21.15.59:0/1031918474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f41180ccbf0 0x7f41181f9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 -- 172.21.15.59:0/1031918474 >> 172.21.15.59:0/1031918474 conn(0x7f4118067080 msgr2=0x7f411806db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:40.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 -- 172.21.15.59:0/1031918474 shutdown_connections 2024-04-25T09:11:40.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.414+0000 7f411d200640 1 -- 172.21.15.59:0/1031918474 wait complete. 2024-04-25T09:11:40.424 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:11:40.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.578+0000 7f34ab600640 1 Processor -- start 2024-04-25T09:11:40.567 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.578+0000 7f34ab600640 1 -- start start 2024-04-25T09:11:40.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.578+0000 7f34ab600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34a4159320 0x7f34a415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.578+0000 7f34ab600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f34a406e4a0 0x7f34a406e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.578+0000 7f34ab600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a415fc00 con 0x7f34a415f440 2024-04-25T09:11:40.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.578+0000 7f34ab600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34a406d640 con 0x7f34a406e4a0 2024-04-25T09:11:40.569 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.578+0000 7f34ab600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a415fee0 con 0x7f34a4159320 2024-04-25T09:11:40.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.578+0000 7f34a9600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f34a406e4a0 0x7f34a406e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.578+0000 7f34a8c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34a4159320 0x7f34a415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.578+0000 7f34a9600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f34a406e4a0 0x7f34a406e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:54124/0 (socket says 172.21.15.59:54124) 2024-04-25T09:11:40.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.578+0000 7f34a9600640 1 -- 172.21.15.59:0/1398391486 learned_addr learned my addr 172.21.15.59:0/1398391486 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:40.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.582+0000 7f34a9600640 1 -- 172.21.15.59:0/1398391486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34a4159320 msgr2=0x7f34a415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:40.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.582+0000 7f34a9600640 1 --2- 172.21.15.59:0/1398391486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34a4159320 0x7f34a415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.582+0000 7f34a9600640 1 -- 172.21.15.59:0/1398391486 >> v1:172.21.15.178:6789/0 conn(0x7f34a415f440 legacy=0x7f34a406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.582+0000 7f34a9600640 1 -- 172.21.15.59:0/1398391486 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a41601c0 con 0x7f34a406e4a0 2024-04-25T09:11:40.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.582+0000 7f34a9600640 1 --2- 172.21.15.59:0/1398391486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34a406e4a0 0x7f34a406e930 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f349c009e50 tx=0x7f349c01c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3ce4171e551395 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:40.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.582+0000 7f34a3e00640 1 -- 172.21.15.59:0/1398391486 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0a56f0 con 0x7f34a406e4a0 2024-04-25T09:11:40.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.582+0000 7f34a3e00640 1 -- 172.21.15.59:0/1398391486 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c0a5890 con 0x7f34a406e4a0 2024-04-25T09:11:40.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.582+0000 7f34a3e00640 1 -- 172.21.15.59:0/1398391486 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0a5c60 con 0x7f34a406e4a0 2024-04-25T09:11:40.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.582+0000 7f34ab600640 1 -- 172.21.15.59:0/1398391486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34a406e4a0 msgr2=0x7f34a406e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.582+0000 7f34ab600640 1 --2- 172.21.15.59:0/1398391486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34a406e4a0 0x7f34a406e930 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f349c009e50 tx=0x7f349c01c9a0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 -- 172.21.15.59:0/1398391486 shutdown_connections 2024-04-25T09:11:40.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 --2- 172.21.15.59:0/1398391486 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34a406e4a0 0x7f34a406e930 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 --2- 172.21.15.59:0/1398391486 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34a4159320 0x7f34a415c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 -- 172.21.15.59:0/1398391486 >> 172.21.15.59:0/1398391486 conn(0x7f34a4067080 msgr2=0x7f34a406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:40.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 -- 172.21.15.59:0/1398391486 shutdown_connections 2024-04-25T09:11:40.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 -- 172.21.15.59:0/1398391486 wait complete. 2024-04-25T09:11:40.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 Processor -- start 2024-04-25T09:11:40.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 -- start start 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34a406e4a0 0x7f34a4138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34a4159320 0x7f34a4139710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a415f440 0x7f34a4135d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a415f9a0 con 0x7f34a415f440 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a415f820 con 0x7f34a4159320 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34ab600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a4168590 con 0x7f34a406e4a0 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34a9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a415f440 0x7f34a4135d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34a9600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a415f440 0x7f34a4135d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47724/0 (socket says 172.21.15.59:47724) 2024-04-25T09:11:40.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34a9600640 1 -- 172.21.15.59:0/3817727883 learned_addr learned my addr 172.21.15.59:0/3817727883 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f349be00640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34a4159320 0x7f34a4139710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34a8c00640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34a406e4a0 0x7f34a4138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34a9600640 1 -- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34a406e4a0 msgr2=0x7f34a4138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34a9600640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34a406e4a0 0x7f34a4138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34a9600640 1 -- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34a4159320 msgr2=0x7f34a4139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34a9600640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34a4159320 0x7f34a4139710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34a9600640 1 -- 172.21.15.59:0/3817727883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a4139e40 con 0x7f34a415f440 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34a8c00640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34a406e4a0 0x7f34a4138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.586+0000 7f34a9600640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a415f440 0x7f34a4135d40 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f349c0af040 tx=0x7f349c019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.590+0000 7f34a1600640 1 -- 172.21.15.59:0/3817727883 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c0bc020 con 0x7f34a415f440 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.590+0000 7f34a1600640 1 -- 172.21.15.59:0/3817727883 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f349c0b8670 con 0x7f34a415f440 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.590+0000 7f34ab600640 1 -- 172.21.15.59:0/3817727883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a413a120 con 0x7f34a415f440 2024-04-25T09:11:40.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.590+0000 7f34a1600640 1 -- 172.21.15.59:0/3817727883 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f349c009510 con 0x7f34a415f440 2024-04-25T09:11:40.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.590+0000 7f34ab600640 1 -- 172.21.15.59:0/3817727883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a413a6e0 con 0x7f34a415f440 2024-04-25T09:11:40.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.590+0000 7f34ab600640 1 -- 172.21.15.59:0/3817727883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a413aa10 con 0x7f34a415f440 2024-04-25T09:11:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.590+0000 7f34a1600640 1 -- 172.21.15.59:0/3817727883 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f349c0bf020 con 0x7f34a415f440 2024-04-25T09:11:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.590+0000 7f34a1600640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3480066f60 0x7f3480069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.590+0000 7f34a1600640 1 -- 172.21.15.59:0/3817727883 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f349c120150 con 0x7f34a415f440 2024-04-25T09:11:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.590+0000 7f34a8c00640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3480066f60 0x7f3480069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.594+0000 7f34a8c00640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3480066f60 0x7f3480069420 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3494009bb0 tx=0x7f3494008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:40.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.594+0000 7f34a1600640 1 -- 172.21.15.59:0/3817727883 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f349c0c6030 con 0x7f34a415f440 2024-04-25T09:11:40.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.758+0000 7f34ab600640 1 -- 172.21.15.59:0/3817727883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f34a40745d0 con 0x7f34a415f440 2024-04-25T09:11:40.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.758+0000 7f34a1600640 1 -- 172.21.15.59:0/3817727883 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v122) v1 ==== 100+0+11 (secure 0 0 0) 0x7f349c016620 con 0x7f34a415f440 2024-04-25T09:11:40.749 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:11:40.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.762+0000 7f34ab600640 1 -- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3480066f60 msgr2=0x7f3480069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.762+0000 7f34ab600640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3480066f60 0x7f3480069420 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3494009bb0 tx=0x7f3494008040 comp rx=0 tx=0).stop 2024-04-25T09:11:40.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.762+0000 7f34ab600640 1 -- 172.21.15.59:0/3817727883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a415f440 msgr2=0x7f34a4135d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.762+0000 7f34ab600640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a415f440 0x7f34a4135d40 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f349c0af040 tx=0x7f349c019740 comp rx=0 tx=0).stop 2024-04-25T09:11:40.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.762+0000 7f34ab600640 1 -- 172.21.15.59:0/3817727883 shutdown_connections 2024-04-25T09:11:40.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.762+0000 7f34ab600640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3480066f60 0x7f3480069420 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.762+0000 7f34ab600640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34a415f440 0x7f34a4135d40 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.762+0000 7f34ab600640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f34a4159320 0x7f34a4139710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.762+0000 7f34ab600640 1 --2- 172.21.15.59:0/3817727883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f34a406e4a0 0x7f34a4138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.762+0000 7f34ab600640 1 -- 172.21.15.59:0/3817727883 >> 172.21.15.59:0/3817727883 conn(0x7f34a4067080 msgr2=0x7f34a415be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:40.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.762+0000 7f34ab600640 1 -- 172.21.15.59:0/3817727883 shutdown_connections 2024-04-25T09:11:40.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.762+0000 7f34ab600640 1 -- 172.21.15.59:0/3817727883 wait complete. 2024-04-25T09:11:40.770 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:11:40.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.922+0000 7f0f70400640 1 Processor -- start 2024-04-25T09:11:40.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.922+0000 7f0f70400640 1 -- start start 2024-04-25T09:11:40.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.922+0000 7f0f70400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f0f68150f40 0x7f0f6806ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f70400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6815e9a0 con 0x7f0f68072210 2024-04-25T09:11:40.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f70400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6815b3d0 con 0x7f0f6815af40 2024-04-25T09:11:40.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f70400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6806f530 con 0x7f0f68150f40 2024-04-25T09:11:40.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f6e400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f0f68072210 0x7f0f680cdcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47884/0 (socket says 172.21.15.59:47884) 2024-04-25T09:11:40.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f6e400640 1 -- 172.21.15.59:0/3776787270 learned_addr learned my addr 172.21.15.59:0/3776787270 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:40.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f6da00640 1 --2- 172.21.15.59:0/3776787270 >> v2:172.21.15.178:3300/0 conn(0x7f0f68150f40 0x7f0f6806ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f67e00640 1 -- 172.21.15.59:0/3776787270 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045923291 0 0) 0x7f0f6815e9a0 con 0x7f0f68072210 2024-04-25T09:11:40.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f67e00640 1 -- 172.21.15.59:0/3776787270 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f50003530 con 0x7f0f68072210 2024-04-25T09:11:40.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f67e00640 1 -- 172.21.15.59:0/3776787270 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652123693 0 0) 0x7f0f6815b3d0 con 0x7f0f6815af40 2024-04-25T09:11:40.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f67e00640 1 -- 172.21.15.59:0/3776787270 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f6815e9a0 con 0x7f0f6815af40 2024-04-25T09:11:40.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f6da00640 1 -- 172.21.15.59:0/3776787270 >> v1:172.21.15.178:6789/0 conn(0x7f0f6815af40 legacy=0x7f0f68071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f6da00640 1 -- 172.21.15.59:0/3776787270 >> v1:172.21.15.59:6789/0 conn(0x7f0f68072210 legacy=0x7f0f680cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.915 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f6da00640 1 -- 172.21.15.59:0/3776787270 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6815dbe0 con 0x7f0f68150f40 2024-04-25T09:11:40.917 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.926+0000 7f0f6da00640 1 --2- 172.21.15.59:0/3776787270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68150f40 0x7f0f6806ef50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00a960 tx=0x7f0f5c01d750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39c9eeac0981c04b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:40.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f67e00640 1 -- 172.21.15.59:0/3776787270 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00b040 con 0x7f0f68150f40 2024-04-25T09:11:40.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f67e00640 1 -- 172.21.15.59:0/3776787270 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0a9610 con 0x7f0f68150f40 2024-04-25T09:11:40.918 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f67e00640 1 -- 172.21.15.59:0/3776787270 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0a99c0 con 0x7f0f68150f40 2024-04-25T09:11:40.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 -- 172.21.15.59:0/3776787270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68150f40 msgr2=0x7f0f6806ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 --2- 172.21.15.59:0/3776787270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68150f40 0x7f0f6806ef50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00a960 tx=0x7f0f5c01d750 comp rx=0 tx=0).stop 2024-04-25T09:11:40.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 -- 172.21.15.59:0/3776787270 shutdown_connections 2024-04-25T09:11:40.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 --2- 172.21.15.59:0/3776787270 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68150f40 0x7f0f6806ef50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 -- 172.21.15.59:0/3776787270 >> 172.21.15.59:0/3776787270 conn(0x7f0f68067080 msgr2=0x7f0f6806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:40.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 -- 172.21.15.59:0/3776787270 shutdown_connections 2024-04-25T09:11:40.919 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 -- 172.21.15.59:0/3776787270 wait complete. 2024-04-25T09:11:40.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 Processor -- start 2024-04-25T09:11:40.920 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 -- start start 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f68072210 0x7f0f6813cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68150f40 0x7f0f680b09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f6815af40 0x7f0f6815b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680ce550 con 0x7f0f68072210 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680ce3d0 con 0x7f0f68150f40 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.930+0000 7f0f70400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f680ce6d0 con 0x7f0f6815af40 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f68072210 0x7f0f6813cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f68072210 0x7f0f6813cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47732/0 (socket says 172.21.15.59:47732) 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6da00640 1 -- 172.21.15.59:0/4124811001 learned_addr learned my addr 172.21.15.59:0/4124811001 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6e400640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f6815af40 0x7f0f6815b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6d000640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68150f40 0x7f0f680b09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6da00640 1 -- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f6815af40 msgr2=0x7f0f6815b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6da00640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f6815af40 0x7f0f6815b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.923 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6da00640 1 -- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68150f40 msgr2=0x7f0f680b09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:40.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6da00640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68150f40 0x7f0f680b09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:40.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6da00640 1 -- 172.21.15.59:0/4124811001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68157020 con 0x7f0f68072210 2024-04-25T09:11:40.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6e400640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f6815af40 0x7f0f6815b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:40.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6d000640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68150f40 0x7f0f680b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:40.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f6da00640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f68072210 0x7f0f6813cf00 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c01b380 tx=0x7f0f5c01a4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:40.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f65600640 1 -- 172.21.15.59:0/4124811001 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0b6070 con 0x7f0f68072210 2024-04-25T09:11:40.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f65600640 1 -- 172.21.15.59:0/4124811001 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0b1610 con 0x7f0f68072210 2024-04-25T09:11:40.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f65600640 1 -- 172.21.15.59:0/4124811001 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c006e20 con 0x7f0f68072210 2024-04-25T09:11:40.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f70400640 1 -- 172.21.15.59:0/4124811001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f68157290 con 0x7f0f68072210 2024-04-25T09:11:40.924 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f70400640 1 -- 172.21.15.59:0/4124811001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6815cb60 con 0x7f0f68072210 2024-04-25T09:11:40.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f70400640 1 -- 172.21.15.59:0/4124811001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f68157950 con 0x7f0f68072210 2024-04-25T09:11:40.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f65600640 1 -- 172.21.15.59:0/4124811001 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0f5c0c0060 con 0x7f0f68072210 2024-04-25T09:11:40.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f65600640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f48066f60 0x7f0f48069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:40.925 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.934+0000 7f0f65600640 1 -- 172.21.15.59:0/4124811001 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0f5c11ef10 con 0x7f0f68072210 2024-04-25T09:11:40.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.938+0000 7f0f6d000640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f48066f60 0x7f0f48069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:40.926 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.938+0000 7f0f6d000640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f48066f60 0x7f0f48069420 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0f68165bf0 tx=0x7f0f54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:40.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:40.938+0000 7f0f65600640 1 -- 172.21.15.59:0/4124811001 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0f68157950 con 0x7f0f68072210 2024-04-25T09:11:41.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.114+0000 7f0f70400640 1 -- 172.21.15.59:0/4124811001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0f680745d0 con 0x7f0f68072210 2024-04-25T09:11:41.104 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.114+0000 7f0f65600640 1 -- 172.21.15.59:0/4124811001 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v122) v1 ==== 80+0+118 (secure 0 0 0) 0x7f0f5c0ad030 con 0x7f0f68072210 2024-04-25T09:11:41.105 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6835/29546856 2024-04-26T09:11:31.741997+0000 2024-04-25T09:11:41.105 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6834/29546856 2024-04-26T09:11:31.741997+0000 2024-04-25T09:11:41.105 INFO:teuthology.orchestra.run.smithi059.stderr:listed 2 entries 2024-04-25T09:11:41.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.118+0000 7f0f70400640 1 -- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f48066f60 msgr2=0x7f0f48069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.118+0000 7f0f70400640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f48066f60 0x7f0f48069420 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f0f68165bf0 tx=0x7f0f54009040 comp rx=0 tx=0).stop 2024-04-25T09:11:41.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.118+0000 7f0f70400640 1 -- 172.21.15.59:0/4124811001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f68072210 msgr2=0x7f0f6813cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.118+0000 7f0f70400640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f68072210 0x7f0f6813cf00 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c01b380 tx=0x7f0f5c01a4f0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.118+0000 7f0f70400640 1 -- 172.21.15.59:0/4124811001 shutdown_connections 2024-04-25T09:11:41.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.118+0000 7f0f70400640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f48066f60 0x7f0f48069420 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.118+0000 7f0f70400640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0f6815af40 0x7f0f6815b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.118+0000 7f0f70400640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0f68150f40 0x7f0f680b09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.118+0000 7f0f70400640 1 --2- 172.21.15.59:0/4124811001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f68072210 0x7f0f6813cf00 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.118+0000 7f0f70400640 1 -- 172.21.15.59:0/4124811001 >> 172.21.15.59:0/4124811001 conn(0x7f0f68067080 msgr2=0x7f0f680b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:41.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.118+0000 7f0f70400640 1 -- 172.21.15.59:0/4124811001 shutdown_connections 2024-04-25T09:11:41.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.118+0000 7f0f70400640 1 -- 172.21.15.59:0/4124811001 wait complete. 2024-04-25T09:11:41.126 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:11:41.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:41.126 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:41.151 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:11:41.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:41.152 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:11:41.202 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:41.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.398+0000 7f566f000640 1 Processor -- start 2024-04-25T09:11:41.389 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.398+0000 7f566f000640 1 -- start start 2024-04-25T09:11:41.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f566f000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f566815b980 0x7f56680cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f566f000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56680ce7f0 con 0x7f566815b5a0 2024-04-25T09:11:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f566f000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56680cead0 con 0x7f5668071970 2024-04-25T09:11:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f566f000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56680ce5b0 con 0x7f566815b980 2024-04-25T09:11:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f5667e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f566815b5a0 0x7f56680cdea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47896/0 (socket says 172.21.15.59:47896) 2024-04-25T09:11:41.391 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f5667e00640 1 -- 172.21.15.59:0/3308449080 learned_addr learned my addr 172.21.15.59:0/3308449080 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:41.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f565f400640 1 --2- 172.21.15.59:0/3308449080 >> v2:172.21.15.178:3300/0 conn(0x7f566815b980 0x7f56680cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f5667400640 1 -- 172.21.15.59:0/3308449080 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3054539416 0 0) 0x7f56680ce7f0 con 0x7f566815b5a0 2024-04-25T09:11:41.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f5667400640 1 -- 172.21.15.59:0/3308449080 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f564c003530 con 0x7f566815b5a0 2024-04-25T09:11:41.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f565f400640 1 -- 172.21.15.59:0/3308449080 >> v1:172.21.15.178:6789/0 conn(0x7f5668071970 legacy=0x7f56680d0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f565f400640 1 -- 172.21.15.59:0/3308449080 >> v1:172.21.15.59:6789/0 conn(0x7f566815b5a0 legacy=0x7f56680cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f5667400640 1 -- 172.21.15.59:0/3308449080 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1765043840 0 0) 0x7f564c003530 con 0x7f566815b5a0 2024-04-25T09:11:41.392 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.402+0000 7f565f400640 1 -- 172.21.15.59:0/3308449080 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56680cf960 con 0x7f566815b980 2024-04-25T09:11:41.394 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f565f400640 1 --2- 172.21.15.59:0/3308449080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f566815b980 0x7f56680cbd30 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f56500097c0 tx=0x7f565001c1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9513654a8472cb7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f5667400640 1 -- 172.21.15.59:0/3308449080 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56500b0070 con 0x7f566815b980 2024-04-25T09:11:41.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f5667400640 1 -- 172.21.15.59:0/3308449080 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56500ab400 con 0x7f566815b980 2024-04-25T09:11:41.395 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f5667400640 1 -- 172.21.15.59:0/3308449080 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5658001a00 con 0x7f566815b980 2024-04-25T09:11:41.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f566f000640 1 -- 172.21.15.59:0/3308449080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f566815b980 msgr2=0x7f56680cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f566f000640 1 --2- 172.21.15.59:0/3308449080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f566815b980 0x7f56680cbd30 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f56500097c0 tx=0x7f565001c1e0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f566f000640 1 -- 172.21.15.59:0/3308449080 shutdown_connections 2024-04-25T09:11:41.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f566f000640 1 --2- 172.21.15.59:0/3308449080 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f566815b980 0x7f56680cbd30 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f566f000640 1 -- 172.21.15.59:0/3308449080 >> 172.21.15.59:0/3308449080 conn(0x7f56680b3390 msgr2=0x7f56680b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:41.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f566f000640 1 -- 172.21.15.59:0/3308449080 shutdown_connections 2024-04-25T09:11:41.396 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f566f000640 1 -- 172.21.15.59:0/3308449080 wait complete. 2024-04-25T09:11:41.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f566f000640 1 Processor -- start 2024-04-25T09:11:41.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.406+0000 7f566f000640 1 -- start start 2024-04-25T09:11:41.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f566f000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5668071970 0x7f566815bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f566f000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f566815b5a0 0x7f566815e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f566f000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f566815b980 0x7f5668141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f566f000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56680d1490 con 0x7f5668071970 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f566f000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56680d1310 con 0x7f566815b5a0 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f566f000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5668169750 con 0x7f566815b980 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5667e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5668071970 0x7f566815bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5667e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5668071970 0x7f566815bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47740/0 (socket says 172.21.15.59:47740) 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5667e00640 1 -- 172.21.15.59:0/1557315272 learned_addr learned my addr 172.21.15.59:0/1557315272 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f565f400640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f566815b5a0 0x7f566815e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f566d000640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f566815b980 0x7f5668141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5667e00640 1 -- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f566815b980 msgr2=0x7f5668141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5667e00640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f566815b980 0x7f5668141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5667e00640 1 -- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f566815b5a0 msgr2=0x7f566815e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5667e00640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f566815b5a0 0x7f566815e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5667e00640 1 -- 172.21.15.59:0/1557315272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56680b6ab0 con 0x7f5668071970 2024-04-25T09:11:41.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f565f400640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f566815b5a0 0x7f566815e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:41.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5667e00640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5668071970 0x7f566815bdb0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f56580018c0 tx=0x7f565800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5664c00640 1 -- 172.21.15.59:0/1557315272 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5658017070 con 0x7f5668071970 2024-04-25T09:11:41.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5664c00640 1 -- 172.21.15.59:0/1557315272 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5658012400 con 0x7f5668071970 2024-04-25T09:11:41.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5664c00640 1 -- 172.21.15.59:0/1557315272 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5658012830 con 0x7f5668071970 2024-04-25T09:11:41.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f566f000640 1 -- 172.21.15.59:0/1557315272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56681561f0 con 0x7f5668071970 2024-04-25T09:11:41.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f566f000640 1 -- 172.21.15.59:0/1557315272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56680b6710 con 0x7f5668071970 2024-04-25T09:11:41.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f566f000640 1 -- 172.21.15.59:0/1557315272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56680745d0 con 0x7f5668071970 2024-04-25T09:11:41.401 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.410+0000 7f5664c00640 1 -- 172.21.15.59:0/1557315272 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f565801a070 con 0x7f5668071970 2024-04-25T09:11:41.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.414+0000 7f5664c00640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5644066f90 0x7f5644069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.402 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.414+0000 7f5664c00640 1 -- 172.21.15.59:0/1557315272 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f5658085350 con 0x7f5668071970 2024-04-25T09:11:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.414+0000 7f565f400640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5644066f90 0x7f5644069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.403 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.414+0000 7f565f400640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5644066f90 0x7f5644069450 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f56500ad000 tx=0x7f5650008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.406 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.418+0000 7f5664c00640 1 -- 172.21.15.59:0/1557315272 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f56580560e0 con 0x7f5668071970 2024-04-25T09:11:41.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.610+0000 7f566f000640 1 -- 172.21.15.59:0/1557315272 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56680cc960 con 0x7f5668071970 2024-04-25T09:11:41.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.610+0000 7f5664c00640 1 -- 172.21.15.59:0/1557315272 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 110 v110) v1 ==== 95+0+4946 (secure 0 0 0) 0x7f56580559e0 con 0x7f5668071970 2024-04-25T09:11:41.601 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:41.601 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":110,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":7613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3791633295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3791633295},{"type":"v1","addr":"172.21.15.59:6835","nonce":3791633295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":110,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:34.763076+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":122,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":8955},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8955":{"gid":8955,"name":"c","rank":0,"incarnation":107,"state":"up:active","state_seq":9,"addr":"172.21.15.59:6833/1679876837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1679876837},{"type":"v1","addr":"172.21.15.59:6833","nonce":1679876837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:41.602 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 110 2024-04-25T09:11:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.614+0000 7f566f000640 1 -- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5644066f90 msgr2=0x7f5644069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.614+0000 7f566f000640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5644066f90 0x7f5644069450 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f56500ad000 tx=0x7f5650008040 comp rx=0 tx=0).stop 2024-04-25T09:11:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.614+0000 7f566f000640 1 -- 172.21.15.59:0/1557315272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5668071970 msgr2=0x7f566815bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.614+0000 7f566f000640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5668071970 0x7f566815bdb0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f56580018c0 tx=0x7f565800a430 comp rx=0 tx=0).stop 2024-04-25T09:11:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.614+0000 7f566f000640 1 -- 172.21.15.59:0/1557315272 shutdown_connections 2024-04-25T09:11:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.614+0000 7f566f000640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5644066f90 0x7f5644069450 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.603 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.614+0000 7f566f000640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f566815b980 0x7f5668141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.614+0000 7f566f000640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f566815b5a0 0x7f566815e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.614+0000 7f566f000640 1 --2- 172.21.15.59:0/1557315272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5668071970 0x7f566815bdb0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.614+0000 7f566f000640 1 -- 172.21.15.59:0/1557315272 >> 172.21.15.59:0/1557315272 conn(0x7f56680b3390 msgr2=0x7f566806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.614+0000 7f566f000640 1 -- 172.21.15.59:0/1557315272 shutdown_connections 2024-04-25T09:11:41.604 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.614+0000 7f566f000640 1 -- 172.21.15.59:0/1557315272 wait complete. 2024-04-25T09:11:41.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json tag path /parent mytag123 2024-04-25T09:11:41.791 INFO:teuthology.orchestra.run.smithi059.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-04-25T09:11:41.791 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-04-25T09:11:41.791 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000003.00000000 scrub_tag 2024-04-25T09:11:41.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 Processor -- start 2024-04-25T09:11:41.837 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 -- start start 2024-04-25T09:11:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 0x55b5de96d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b5de953020 0x55b5de952670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.839 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5de9f9550 0x55b5de9f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5de9fb640 con 0x55b5de951840 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5de8c89f0 con 0x55b5de9f9550 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5de9fc830 con 0x55b5de953020 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 0x55b5de96d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 0x55b5de96d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47768/0 (socket says 172.21.15.59:47768) 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c2400640 1 -- 172.21.15.59:0/2267450832 learned_addr learned my addr 172.21.15.59:0/2267450832 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c1a00640 1 --2- 172.21.15.59:0/2267450832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b5de953020 0x55b5de952670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c2e00640 1 --2- 172.21.15.59:0/2267450832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5de9f9550 0x55b5de9f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c2400640 1 -- 172.21.15.59:0/2267450832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b5de953020 msgr2=0x55b5de952670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c2400640 1 --2- 172.21.15.59:0/2267450832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b5de953020 0x55b5de952670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c2400640 1 -- 172.21.15.59:0/2267450832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5de9f9550 msgr2=0x55b5de9f7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c2400640 1 --2- 172.21.15.59:0/2267450832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5de9f9550 0x55b5de9f7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c2400640 1 -- 172.21.15.59:0/2267450832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5de96d790 con 0x55b5de951840 2024-04-25T09:11:41.840 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c2400640 1 --2- 172.21.15.59:0/2267450832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 0x55b5de96d250 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4006ed0 tx=0x7fc4b400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb7784c859aa8f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4bbe00640 1 -- 172.21.15.59:0/2267450832 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4012070 con 0x55b5de951840 2024-04-25T09:11:41.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4bbe00640 1 -- 172.21.15.59:0/2267450832 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400e690 con 0x55b5de951840 2024-04-25T09:11:41.841 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4bbe00640 1 -- 172.21.15.59:0/2267450832 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400eaa0 con 0x55b5de951840 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/2267450832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 msgr2=0x55b5de96d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 --2- 172.21.15.59:0/2267450832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 0x55b5de96d250 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4006ed0 tx=0x7fc4b400b6d0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/2267450832 shutdown_connections 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 --2- 172.21.15.59:0/2267450832 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5de9f9550 0x55b5de9f7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 --2- 172.21.15.59:0/2267450832 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b5de953020 0x55b5de952670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 --2- 172.21.15.59:0/2267450832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 0x55b5de96d250 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/2267450832 >> 172.21.15.59:0/2267450832 conn(0x55b5de94dda0 msgr2=0x55b5de9f8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/2267450832 shutdown_connections 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/2267450832 wait complete. 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 Processor -- start 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.850+0000 7fc4c5e4d080 1 -- start start 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c5e4d080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 0x55b5de9d85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.843 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c5e4d080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5de953020 0x55b5de9f8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c5e4d080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b5de9f9550 0x55b5de9f8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c5e4d080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5de96c5d0 con 0x55b5de951840 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c5e4d080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5de96c330 con 0x55b5de953020 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c5e4d080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b5de96c870 con 0x55b5de9f9550 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 0x55b5de9d85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c2400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 0x55b5de9d85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47770/0 (socket says 172.21.15.59:47770) 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c2400640 1 -- 172.21.15.59:0/350249472 learned_addr learned my addr 172.21.15.59:0/350249472 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c2e00640 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b5de9f9550 0x55b5de9f8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c1a00640 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5de953020 0x55b5de9f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c2400640 1 -- 172.21.15.59:0/350249472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b5de9f9550 msgr2=0x55b5de9f8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c2400640 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55b5de9f9550 0x55b5de9f8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c2400640 1 -- 172.21.15.59:0/350249472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5de953020 msgr2=0x55b5de9f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c2400640 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55b5de953020 0x55b5de9f8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c2400640 1 -- 172.21.15.59:0/350249472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5de9f50a0 con 0x55b5de951840 2024-04-25T09:11:41.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c2400640 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 0x55b5de9d85a0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4006680 tx=0x7fc4b4000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4baa00640 1 -- 172.21.15.59:0/350249472 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4026070 con 0x55b5de951840 2024-04-25T09:11:41.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4baa00640 1 -- 172.21.15.59:0/350249472 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b4018a50 con 0x55b5de951840 2024-04-25T09:11:41.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4baa00640 1 -- 172.21.15.59:0/350249472 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4012050 con 0x55b5de951840 2024-04-25T09:11:41.845 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/350249472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b5de9f5340 con 0x55b5de951840 2024-04-25T09:11:41.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/350249472 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5de9f5880 con 0x55b5de951840 2024-04-25T09:11:41.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.854+0000 7fc4baa00640 1 -- 172.21.15.59:0/350249472 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc4b4029070 con 0x55b5de951840 2024-04-25T09:11:41.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4baa00640 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc4a4065970 0x7fc4a4067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4baa00640 1 -- 172.21.15.59:0/350249472 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7fc4b4085600 con 0x55b5de951840 2024-04-25T09:11:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c5e4d080 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55b5de9d93c0 0x55b5de9d97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/350249472 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:1 18.32 18:4def72d4:::10000000003.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122) v9 -- 0x55b5de9d8ae0 con 0x55b5de9d93c0 2024-04-25T09:11:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c1a00640 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc4a4065970 0x7fc4a4067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c2e00640 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55b5de9d93c0 0x55b5de9d97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c2e00640 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55b5de9d93c0 0x55b5de9d97a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c1a00640 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc4a4065970 0x7fc4a4067e30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0005740 tx=0x7fc4b00056d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c2e00640 1 -- 172.21.15.59:0/350249472 <== osd.3 v2:172.21.15.59:6808/3810214969 1 ==== osd_op_reply(1 10000000003.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7fc4bc0ab540 con 0x55b5de9d93c0 2024-04-25T09:11:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:error getting xattr cephfs_data/10000000003.00000000/scrub_tag: (61) No data available 2024-04-25T09:11:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/350249472 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55b5de9d93c0 msgr2=0x55b5de9d97a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c5e4d080 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55b5de9d93c0 0x55b5de9d97a0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/350249472 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc4a4065970 msgr2=0x7fc4a4067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c5e4d080 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc4a4065970 0x7fc4a4067e30 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0005740 tx=0x7fc4b00056d0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/350249472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 msgr2=0x55b5de9d85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c5e4d080 1 --2- 172.21.15.59:0/350249472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b5de951840 0x55b5de9d85a0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4006680 tx=0x7fc4b4000bd0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c2e00640 1 -- 172.21.15.59:0/350249472 reap_dead start 2024-04-25T09:11:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/350249472 shutdown_connections 2024-04-25T09:11:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/350249472 >> 172.21.15.59:0/350249472 conn(0x55b5de94dda0 msgr2=0x55b5de96b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/350249472 shutdown_connections 2024-04-25T09:11:41.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.858+0000 7fc4c5e4d080 1 -- 172.21.15.59:0/350249472 wait complete. 2024-04-25T09:11:41.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:11:41.853 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-25T09:11:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f4b803080 1 Processor -- start 2024-04-25T09:11:41.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f4b803080 1 -- start start 2024-04-25T09:11:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f4b803080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560d42b95e80 0x560d42bc1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.900 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f4b803080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560d42c4b490 0x560d42cfa400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f4b803080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b870 0x560d42c6ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f4b803080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d42c4db90 con 0x560d42c4b870 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f4b803080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d42b399f0 con 0x560d42c4b490 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f4b803080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d42c4c3b0 con 0x560d42b95e80 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f49400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b870 0x560d42c6ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f49400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b870 0x560d42c6ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47780/0 (socket says 172.21.15.59:47780) 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f49400640 1 -- 172.21.15.59:0/2870110907 learned_addr learned my addr 172.21.15.59:0/2870110907 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f48a00640 1 --2- 172.21.15.59:0/2870110907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560d42b95e80 0x560d42bc1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f43e00640 1 --2- 172.21.15.59:0/2870110907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560d42c4b490 0x560d42cfa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f49400640 1 -- 172.21.15.59:0/2870110907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560d42b95e80 msgr2=0x560d42bc1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f49400640 1 --2- 172.21.15.59:0/2870110907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560d42b95e80 0x560d42bc1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f49400640 1 -- 172.21.15.59:0/2870110907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560d42c4b490 msgr2=0x560d42cfa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f49400640 1 --2- 172.21.15.59:0/2870110907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560d42c4b490 0x560d42cfa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f49400640 1 -- 172.21.15.59:0/2870110907 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d42bc2100 con 0x560d42c4b870 2024-04-25T09:11:41.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f49400640 1 --2- 172.21.15.59:0/2870110907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b870 0x560d42c6ad50 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c4c0 tx=0x7f0f4400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ffd746111f72aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f42a00640 1 -- 172.21.15.59:0/2870110907 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f440116b0 con 0x560d42c4b870 2024-04-25T09:11:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f42a00640 1 -- 172.21.15.59:0/2870110907 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f44017070 con 0x560d42c4b870 2024-04-25T09:11:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.910+0000 7f0f42a00640 1 -- 172.21.15.59:0/2870110907 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f44011ab0 con 0x560d42c4b870 2024-04-25T09:11:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 -- 172.21.15.59:0/2870110907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b870 msgr2=0x560d42c6ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 --2- 172.21.15.59:0/2870110907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b870 0x560d42c6ad50 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f0f4400c4c0 tx=0x7f0f4400c980 comp rx=0 tx=0).stop 2024-04-25T09:11:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 -- 172.21.15.59:0/2870110907 shutdown_connections 2024-04-25T09:11:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 --2- 172.21.15.59:0/2870110907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b870 0x560d42c6ad50 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 --2- 172.21.15.59:0/2870110907 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560d42c4b490 0x560d42cfa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 --2- 172.21.15.59:0/2870110907 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560d42b95e80 0x560d42bc1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 -- 172.21.15.59:0/2870110907 >> 172.21.15.59:0/2870110907 conn(0x560d42b93400 msgr2=0x560d42c69070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 -- 172.21.15.59:0/2870110907 shutdown_connections 2024-04-25T09:11:41.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 -- 172.21.15.59:0/2870110907 wait complete. 2024-04-25T09:11:41.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 Processor -- start 2024-04-25T09:11:41.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 -- start start 2024-04-25T09:11:41.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560d42b95e80 0x560d42c6aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b490 0x560d42c4a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.905 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560d42c4b870 0x560d42c4ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d42c6a370 con 0x560d42c4b490 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d42c6a0d0 con 0x560d42b95e80 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d42c6a610 con 0x560d42c4b870 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f43e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b490 0x560d42c4a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f43e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b490 0x560d42c4a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47796/0 (socket says 172.21.15.59:47796) 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f43e00640 1 -- 172.21.15.59:0/231935551 learned_addr learned my addr 172.21.15.59:0/231935551 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f48a00640 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560d42b95e80 0x560d42c6aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f49400640 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560d42c4b870 0x560d42c4ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f43e00640 1 -- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560d42c4b870 msgr2=0x560d42c4ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f43e00640 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560d42c4b870 0x560d42c4ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f43e00640 1 -- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560d42b95e80 msgr2=0x560d42c6aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f43e00640 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560d42b95e80 0x560d42c6aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f43e00640 1 -- 172.21.15.59:0/231935551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d42cfc5e0 con 0x560d42c4b490 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f49400640 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x560d42c4b870 0x560d42c4ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:41.906 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f48a00640 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560d42b95e80 0x560d42c6aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:41.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f43e00640 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b490 0x560d42c4a8e0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400efc0 tx=0x7f0f3400c6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f41600640 1 -- 172.21.15.59:0/231935551 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34015020 con 0x560d42c4b490 2024-04-25T09:11:41.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f41600640 1 -- 172.21.15.59:0/231935551 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f34011660 con 0x560d42c4b490 2024-04-25T09:11:41.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f41600640 1 -- 172.21.15.59:0/231935551 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3400a040 con 0x560d42c4b490 2024-04-25T09:11:41.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 -- 172.21.15.59:0/231935551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560d42cfc880 con 0x560d42c4b490 2024-04-25T09:11:41.907 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.914+0000 7f0f4b803080 1 -- 172.21.15.59:0/231935551 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d42cfcdc0 con 0x560d42c4b490 2024-04-25T09:11:41.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f41600640 1 -- 172.21.15.59:0/231935551 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0f34018020 con 0x560d42c4b490 2024-04-25T09:11:41.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f41600640 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f28065970 0x7f0f28067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f41600640 1 -- 172.21.15.59:0/231935551 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f0f340843a0 con 0x560d42c4b490 2024-04-25T09:11:41.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f4b803080 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x560d42c6b400 0x560d42bd57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f4b803080 1 -- 172.21.15.59:0/231935551 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:1 18.12 18:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122) v9 -- 0x560d42bd5ce0 con 0x560d42c6b400 2024-04-25T09:11:41.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f48a00640 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f28065970 0x7f0f28067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.908 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f49400640 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x560d42c6b400 0x560d42bd57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.909 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f49400640 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x560d42c6b400 0x560d42bd57a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f48a00640 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f28065970 0x7f0f28067e30 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0ac000 tx=0x7f0f3c0a5000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f49400640 1 -- 172.21.15.59:0/231935551 <== osd.2 v2:172.21.15.59:6824/4113007731 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f0f440116b0 con 0x560d42c6b400 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f4b803080 1 -- 172.21.15.59:0/231935551 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x560d42c6b400 msgr2=0x560d42bd57a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f4b803080 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x560d42c6b400 0x560d42bd57a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f4b803080 1 -- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f28065970 msgr2=0x7f0f28067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f4b803080 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0f28065970 0x7f0f28067e30 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0ac000 tx=0x7f0f3c0a5000 comp rx=0 tx=0).stop 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f4b803080 1 -- 172.21.15.59:0/231935551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b490 msgr2=0x560d42c4a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f4b803080 1 --2- 172.21.15.59:0/231935551 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d42c4b490 0x560d42c4a8e0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400efc0 tx=0x7f0f3400c6f0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f49400640 1 -- 172.21.15.59:0/231935551 reap_dead start 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f4b803080 1 -- 172.21.15.59:0/231935551 shutdown_connections 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f4b803080 1 -- 172.21.15.59:0/231935551 >> 172.21.15.59:0/231935551 conn(0x560d42b93400 msgr2=0x560d42bc19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f4b803080 1 -- 172.21.15.59:0/231935551 shutdown_connections 2024-04-25T09:11:41.910 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.918+0000 7f0f4b803080 1 -- 172.21.15.59:0/231935551 wait complete. 2024-04-25T09:11:41.913 INFO:teuthology.orchestra.run.smithi059.stdout:mytag123 2024-04-25T09:11:41.914 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-04-25T09:11:41.960 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.970+0000 7f86c34bf080 1 Processor -- start 2024-04-25T09:11:41.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.970+0000 7f86c34bf080 1 -- start start 2024-04-25T09:11:41.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.970+0000 7f86c34bf080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556b3c34770 0x5556b3c60f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea490 0x5556b3c72770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556b3cea870 0x5556b3c72cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556b3bd89f0 con 0x5556b3cea490 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556b3bdc950 con 0x5556b3c34770 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556b3cecb70 con 0x5556b3cea870 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86b7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea490 0x5556b3c72770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86b7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea490 0x5556b3c72770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47800/0 (socket says 172.21.15.59:47800) 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86b7e00640 1 -- 172.21.15.59:0/3965172696 learned_addr learned my addr 172.21.15.59:0/3965172696 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c0600640 1 --2- 172.21.15.59:0/3965172696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556b3c34770 0x5556b3c60f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c1000640 1 --2- 172.21.15.59:0/3965172696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556b3cea870 0x5556b3c72cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86b7e00640 1 -- 172.21.15.59:0/3965172696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556b3cea870 msgr2=0x5556b3c72cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86b7e00640 1 --2- 172.21.15.59:0/3965172696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556b3cea870 0x5556b3c72cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86b7e00640 1 -- 172.21.15.59:0/3965172696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556b3c34770 msgr2=0x5556b3c60f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:41.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86b7e00640 1 --2- 172.21.15.59:0/3965172696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556b3c34770 0x5556b3c60f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86b7e00640 1 -- 172.21.15.59:0/3965172696 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556b3d04310 con 0x5556b3cea490 2024-04-25T09:11:41.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86b7e00640 1 --2- 172.21.15.59:0/3965172696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea490 0x5556b3c72770 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f86a800a530 tx=0x7f86a8003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d99742e14d1ce25 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86bf200640 1 -- 172.21.15.59:0/3965172696 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a80af040 con 0x5556b3cea490 2024-04-25T09:11:41.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86bf200640 1 -- 172.21.15.59:0/3965172696 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a80b9070 con 0x5556b3cea490 2024-04-25T09:11:41.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86bf200640 1 -- 172.21.15.59:0/3965172696 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a80b4410 con 0x5556b3cea490 2024-04-25T09:11:41.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 -- 172.21.15.59:0/3965172696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea490 msgr2=0x5556b3c72770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 --2- 172.21.15.59:0/3965172696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea490 0x5556b3c72770 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f86a800a530 tx=0x7f86a8003030 comp rx=0 tx=0).stop 2024-04-25T09:11:41.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 -- 172.21.15.59:0/3965172696 shutdown_connections 2024-04-25T09:11:41.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 --2- 172.21.15.59:0/3965172696 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556b3cea870 0x5556b3c72cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 --2- 172.21.15.59:0/3965172696 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea490 0x5556b3c72770 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 --2- 172.21.15.59:0/3965172696 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556b3c34770 0x5556b3c60f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 -- 172.21.15.59:0/3965172696 >> 172.21.15.59:0/3965172696 conn(0x5556b3c32400 msgr2=0x5556b3c73a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:41.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 -- 172.21.15.59:0/3965172696 shutdown_connections 2024-04-25T09:11:41.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 -- 172.21.15.59:0/3965172696 wait complete. 2024-04-25T09:11:41.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 Processor -- start 2024-04-25T09:11:41.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 -- start start 2024-04-25T09:11:41.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556b3c34770 0x5556b3d01780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556b3cea490 0x5556b3c78fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea870 0x5556b3d0ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556b3c75320 con 0x5556b3cea870 2024-04-25T09:11:41.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556b3c750c0 con 0x5556b3c34770 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c34bf080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556b3c755c0 con 0x5556b3cea490 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.974+0000 7f86c1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea870 0x5556b3d0ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86c1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea870 0x5556b3d0ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47806/0 (socket says 172.21.15.59:47806) 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86c1000640 1 -- 172.21.15.59:0/399321807 learned_addr learned my addr 172.21.15.59:0/399321807 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86c0600640 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556b3c34770 0x5556b3d01780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86b7e00640 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556b3cea490 0x5556b3c78fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86c1000640 1 -- 172.21.15.59:0/399321807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556b3cea490 msgr2=0x5556b3c78fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86c1000640 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556b3cea490 0x5556b3c78fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86c1000640 1 -- 172.21.15.59:0/399321807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556b3c34770 msgr2=0x5556b3d01780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86c1000640 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5556b3c34770 0x5556b3d01780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86c1000640 1 -- 172.21.15.59:0/399321807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556b3d01cc0 con 0x5556b3cea870 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86b7e00640 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5556b3cea490 0x5556b3c78fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86c1000640 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea870 0x5556b3d0ae50 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f86b800d4a0 tx=0x7f86b800d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86bde00640 1 -- 172.21.15.59:0/399321807 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8011590 con 0x5556b3cea870 2024-04-25T09:11:41.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86bde00640 1 -- 172.21.15.59:0/399321807 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8017070 con 0x5556b3cea870 2024-04-25T09:11:41.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86bde00640 1 -- 172.21.15.59:0/399321807 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8011970 con 0x5556b3cea870 2024-04-25T09:11:41.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86c34bf080 1 -- 172.21.15.59:0/399321807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5556b3c797a0 con 0x5556b3cea870 2024-04-25T09:11:41.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86c34bf080 1 -- 172.21.15.59:0/399321807 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556b3c79ce0 con 0x5556b3cea870 2024-04-25T09:11:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86bde00640 1 -- 172.21.15.59:0/399321807 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f86b8011b10 con 0x5556b3cea870 2024-04-25T09:11:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86bde00640 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f869c065940 0x7f869c067e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86bde00640 1 -- 172.21.15.59:0/399321807 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f86b8083d90 con 0x5556b3cea870 2024-04-25T09:11:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.978+0000 7f86c0600640 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f869c065940 0x7f869c067e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c34bf080 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5556b3d0b390 0x5556b3c7abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c34bf080 1 -- 172.21.15.59:0/399321807 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:1 18.5 18:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122) v9 -- 0x5556b3c5d4f0 con 0x5556b3d0b390 2024-04-25T09:11:41.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86b7e00640 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5556b3d0b390 0x5556b3c7abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:41.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c0600640 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f869c065940 0x7f869c067e00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f86b00034b0 tx=0x7f86b0003070 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86b7e00640 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5556b3d0b390 0x5556b3c7abd0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:41.971 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86b7e00640 1 -- 172.21.15.59:0/399321807 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f86a80b2040 con 0x5556b3d0b390 2024-04-25T09:11:41.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c34bf080 1 -- 172.21.15.59:0/399321807 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5556b3d0b390 msgr2=0x5556b3c7abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c34bf080 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x5556b3d0b390 0x5556b3c7abd0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:41.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c34bf080 1 -- 172.21.15.59:0/399321807 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f869c065940 msgr2=0x7f869c067e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c34bf080 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f869c065940 0x7f869c067e00 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f86b00034b0 tx=0x7f86b0003070 comp rx=0 tx=0).stop 2024-04-25T09:11:41.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c34bf080 1 -- 172.21.15.59:0/399321807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea870 msgr2=0x5556b3d0ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:41.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c34bf080 1 --2- 172.21.15.59:0/399321807 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5556b3cea870 0x5556b3d0ae50 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f86b800d4a0 tx=0x7f86b800d960 comp rx=0 tx=0).stop 2024-04-25T09:11:41.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c1000640 1 -- 172.21.15.59:0/399321807 reap_dead start 2024-04-25T09:11:41.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c34bf080 1 -- 172.21.15.59:0/399321807 shutdown_connections 2024-04-25T09:11:41.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c34bf080 1 -- 172.21.15.59:0/399321807 >> 172.21.15.59:0/399321807 conn(0x5556b3c32400 msgr2=0x5556b3c60f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:41.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c34bf080 1 -- 172.21.15.59:0/399321807 shutdown_connections 2024-04-25T09:11:41.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:41.982+0000 7f86c34bf080 1 -- 172.21.15.59:0/399321807 wait complete. 2024-04-25T09:11:41.975 INFO:teuthology.orchestra.run.smithi059.stdout:mytag123 2024-04-25T09:11:41.975 DEBUG:teuthology.orchestra.run.smithi059:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000006.00000000 scrub_tag 2024-04-25T09:11:42.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6935655080 1 Processor -- start 2024-04-25T09:11:42.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6935655080 1 -- start start 2024-04-25T09:11:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6935655080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572cdc95d40 0x5572cdcb2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6935655080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5572cdc98490 0x5572cdc95350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6935655080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdcb6890 0x5572cdc0c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6935655080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572cdcbd3c0 con 0x5572cdcb6890 2024-04-25T09:11:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6935655080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572cdb849f0 con 0x5572cdc95d40 2024-04-25T09:11:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6935655080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5572cdcbd540 con 0x5572cdc98490 2024-04-25T09:11:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6933200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdcb6890 0x5572cdc0c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6933200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdcb6890 0x5572cdc0c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47832/0 (socket says 172.21.15.59:47832) 2024-04-25T09:11:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6933200640 1 -- 172.21.15.59:0/2806314001 learned_addr learned my addr 172.21.15.59:0/2806314001 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6931e00640 1 --2- 172.21.15.59:0/2806314001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5572cdc98490 0x5572cdc95350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6932800640 1 --2- 172.21.15.59:0/2806314001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572cdc95d40 0x5572cdcb2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6933200640 1 -- 172.21.15.59:0/2806314001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5572cdc98490 msgr2=0x5572cdc95350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6933200640 1 --2- 172.21.15.59:0/2806314001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5572cdc98490 0x5572cdc95350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6933200640 1 -- 172.21.15.59:0/2806314001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572cdc95d40 msgr2=0x5572cdcb2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6933200640 1 --2- 172.21.15.59:0/2806314001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572cdc95d40 0x5572cdcb2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6933200640 1 -- 172.21.15.59:0/2806314001 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572cdcb5bd0 con 0x5572cdcb6890 2024-04-25T09:11:42.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6933200640 1 --2- 172.21.15.59:0/2806314001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdcb6890 0x5572cdc0c4e0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f692c0028d0 tx=0x7f692c002d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918c389e5383da28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6930a00640 1 -- 172.21.15.59:0/2806314001 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c016020 con 0x5572cdcb6890 2024-04-25T09:11:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6930a00640 1 -- 172.21.15.59:0/2806314001 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c00d9c0 con 0x5572cdcb6890 2024-04-25T09:11:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.078+0000 7f6930a00640 1 -- 172.21.15.59:0/2806314001 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c00dd90 con 0x5572cdcb6890 2024-04-25T09:11:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 -- 172.21.15.59:0/2806314001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdcb6890 msgr2=0x5572cdc0c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 --2- 172.21.15.59:0/2806314001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdcb6890 0x5572cdc0c4e0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f692c0028d0 tx=0x7f692c002d90 comp rx=0 tx=0).stop 2024-04-25T09:11:42.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 -- 172.21.15.59:0/2806314001 shutdown_connections 2024-04-25T09:11:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 --2- 172.21.15.59:0/2806314001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdcb6890 0x5572cdc0c4e0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 --2- 172.21.15.59:0/2806314001 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5572cdc98490 0x5572cdc95350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 --2- 172.21.15.59:0/2806314001 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572cdc95d40 0x5572cdcb2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 -- 172.21.15.59:0/2806314001 >> 172.21.15.59:0/2806314001 conn(0x5572cdbde400 msgr2=0x5572cdbdf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 -- 172.21.15.59:0/2806314001 shutdown_connections 2024-04-25T09:11:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 -- 172.21.15.59:0/2806314001 wait complete. 2024-04-25T09:11:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 Processor -- start 2024-04-25T09:11:42.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 -- start start 2024-04-25T09:11:42.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5572cdc95d40 0x5572cdcbfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdc98490 0x5572cdd51770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572cdcb6890 0x5572cdbdf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572cdcb14d0 con 0x5572cdc98490 2024-04-25T09:11:42.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572cdcb1230 con 0x5572cdcb6890 2024-04-25T09:11:42.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x5572cdcb1770 con 0x5572cdc95d40 2024-04-25T09:11:42.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6931e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdc98490 0x5572cdd51770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6931e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdc98490 0x5572cdd51770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47844/0 (socket says 172.21.15.59:47844) 2024-04-25T09:11:42.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6931e00640 1 -- 172.21.15.59:0/1357967579 learned_addr learned my addr 172.21.15.59:0/1357967579 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6932800640 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5572cdc95d40 0x5572cdcbfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6933200640 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572cdcb6890 0x5572cdbdf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6931e00640 1 -- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5572cdc95d40 msgr2=0x5572cdcbfbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6931e00640 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5572cdc95d40 0x5572cdcbfbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6931e00640 1 -- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572cdcb6890 msgr2=0x5572cdbdf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6931e00640 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x5572cdcb6890 0x5572cdbdf520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6931e00640 1 -- 172.21.15.59:0/1357967579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572cdcbe740 con 0x5572cdc98490 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6932800640 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x5572cdc95d40 0x5572cdcbfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6931e00640 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdc98490 0x5572cdd51770 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f6920018f80 tx=0x7f69200180f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f692b400640 1 -- 172.21.15.59:0/1357967579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200af040 con 0x5572cdc98490 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f692b400640 1 -- 172.21.15.59:0/1357967579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69200b53f0 con 0x5572cdc98490 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f692b400640 1 -- 172.21.15.59:0/1357967579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69200b57c0 con 0x5572cdc98490 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.082+0000 7f6935655080 1 -- 172.21.15.59:0/1357967579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5572cdcbe9e0 con 0x5572cdc98490 2024-04-25T09:11:42.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.086+0000 7f6935655080 1 -- 172.21.15.59:0/1357967579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572cdcbef20 con 0x5572cdc98490 2024-04-25T09:11:42.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.086+0000 7f692b400640 1 -- 172.21.15.59:0/1357967579 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f69200b5960 con 0x5572cdc98490 2024-04-25T09:11:42.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.086+0000 7f692b400640 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6914065970 0x7f6914067e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.086+0000 7f692b400640 1 -- 172.21.15.59:0/1357967579 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f692011ef50 con 0x5572cdc98490 2024-04-25T09:11:42.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.086+0000 7f6935655080 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x5572cdd4ea90 0x5572cdd4ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.086+0000 7f6935655080 1 -- 172.21.15.59:0/1357967579 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:1 18.25 18:a5feb6f3:::10000000006.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e122) v9 -- 0x5572cdd4f3b0 con 0x5572cdd4ea90 2024-04-25T09:11:42.076 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.086+0000 7f6932800640 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6914065970 0x7f6914067e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.086+0000 7f6933200640 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x5572cdd4ea90 0x5572cdd4ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.086+0000 7f6932800640 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6914065970 0x7f6914067e30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6924003d00 tx=0x7f6924003050 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.086+0000 7f6933200640 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x5572cdd4ea90 0x5572cdd4ee70 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.090+0000 7f6933200640 1 -- 172.21.15.59:0/1357967579 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(1 10000000006.00000000 [getxattr (12) out=12b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f692c012470 con 0x5572cdd4ea90 2024-04-25T09:11:42.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.090+0000 7f6935655080 1 -- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x5572cdd4ea90 msgr2=0x5572cdd4ee70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.090+0000 7f6935655080 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x5572cdd4ea90 0x5572cdd4ee70 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.090+0000 7f6935655080 1 -- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6914065970 msgr2=0x7f6914067e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.090+0000 7f6935655080 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6914065970 0x7f6914067e30 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6924003d00 tx=0x7f6924003050 comp rx=0 tx=0).stop 2024-04-25T09:11:42.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.090+0000 7f6935655080 1 -- 172.21.15.59:0/1357967579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdc98490 msgr2=0x5572cdd51770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.090+0000 7f6935655080 1 --2- 172.21.15.59:0/1357967579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5572cdc98490 0x5572cdd51770 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f6920018f80 tx=0x7f69200180f0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.090+0000 7f6933200640 1 -- 172.21.15.59:0/1357967579 reap_dead start 2024-04-25T09:11:42.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.090+0000 7f6935655080 1 -- 172.21.15.59:0/1357967579 shutdown_connections 2024-04-25T09:11:42.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.090+0000 7f6935655080 1 -- 172.21.15.59:0/1357967579 >> 172.21.15.59:0/1357967579 conn(0x5572cdbde400 msgr2=0x5572cdbdee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.090+0000 7f6935655080 1 -- 172.21.15.59:0/1357967579 shutdown_connections 2024-04-25T09:11:42.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.090+0000 7f6935655080 1 -- 172.21.15.59:0/1357967579 wait complete. 2024-04-25T09:11:42.083 INFO:teuthology.orchestra.run.smithi059.stdout:mytag123 2024-04-25T09:11:42.083 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-25T09:11:42.083 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-25T09:11:42.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f469c600640 1 Processor -- start 2024-04-25T09:11:42.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f469c600640 1 -- start start 2024-04-25T09:11:42.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f469c600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4694159320 0x7f469415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f469c600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469406e4a0 0x7f469406e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f469c600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469415fc00 con 0x7f469415f440 2024-04-25T09:11:42.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f469c600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469406ee50 con 0x7f4694159320 2024-04-25T09:11:42.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f469c600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469406d640 con 0x7f469406e4a0 2024-04-25T09:11:42.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4699200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f469415f440 0x7f469406dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47926/0 (socket says 172.21.15.59:47926) 2024-04-25T09:11:42.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4699200640 1 -- 172.21.15.59:0/121698787 learned_addr learned my addr 172.21.15.59:0/121698787 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:42.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4699c00640 1 --2- 172.21.15.59:0/121698787 >> v2:172.21.15.178:3300/0 conn(0x7f4694159320 0x7f469415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f469a600640 1 --2- 172.21.15.59:0/121698787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469406e4a0 0x7f469406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2939899452 0 0) 0x7f469415fc00 con 0x7f469415f440 2024-04-25T09:11:42.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f467c003530 con 0x7f469415f440 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3550724408 0 0) 0x7f467c003530 con 0x7f469415f440 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469406e4a0 msgr2=0x7f469406e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 --2- 172.21.15.59:0/121698787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469406e4a0 0x7f469406e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 >> v2:172.21.15.178:3300/0 conn(0x7f4694159320 msgr2=0x7f469415c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 --2- 172.21.15.59:0/121698787 >> v2:172.21.15.178:3300/0 conn(0x7f4694159320 0x7f469415c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469415fee0 con 0x7f469415f440 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f4680001680 con 0x7f469415f440 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 >> v1:172.21.15.59:6789/0 conn(0x7f469415f440 legacy=0x7f469406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 --2- 172.21.15.59:0/121698787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c0039c0 0x7f467c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 --2- 172.21.15.59:0/121698787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c004810 0x7f467c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 --2- 172.21.15.59:0/121698787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469406e4a0 0x7f467c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469406ee50 con 0x7f467c0039c0 2024-04-25T09:11:42.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469406d640 con 0x7f467c004810 2024-04-25T09:11:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f467c00b9d0 con 0x7f469406e4a0 2024-04-25T09:11:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4699c00640 1 --2- 172.21.15.59:0/121698787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c0039c0 0x7f467c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4699200640 1 --2- 172.21.15.59:0/121698787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c004810 0x7f467c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f469a600640 1 --2- 172.21.15.59:0/121698787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469406e4a0 0x7f467c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4699c00640 1 -- 172.21.15.59:0/121698787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469406e4a0 msgr2=0x7f467c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4699c00640 1 --2- 172.21.15.59:0/121698787 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469406e4a0 0x7f467c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4699c00640 1 -- 172.21.15.59:0/121698787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c004810 msgr2=0x7f467c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4699c00640 1 --2- 172.21.15.59:0/121698787 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c004810 0x7f467c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.238+0000 7f4699c00640 1 -- 172.21.15.59:0/121698787 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c003530 con 0x7f467c0039c0 2024-04-25T09:11:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.242+0000 7f4699c00640 1 --2- 172.21.15.59:0/121698787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c0039c0 0x7f467c003de0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f4688009b10 tx=0x7f468801ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf2aca5cc7f9bcd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.242+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880096b0 con 0x7f467c0039c0 2024-04-25T09:11:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.242+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46880a6490 con 0x7f467c0039c0 2024-04-25T09:11:42.232 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.242+0000 7f4693e00640 1 -- 172.21.15.59:0/121698787 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880a6880 con 0x7f467c0039c0 2024-04-25T09:11:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.242+0000 7f469c600640 1 -- 172.21.15.59:0/121698787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c0039c0 msgr2=0x7f467c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.242+0000 7f469c600640 1 --2- 172.21.15.59:0/121698787 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f467c0039c0 0x7f467c003de0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f4688009b10 tx=0x7f468801ca80 comp rx=0 tx=0).stop 2024-04-25T09:11:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.242+0000 7f469a600640 1 -- 172.21.15.59:0/121698787 reap_dead start 2024-04-25T09:11:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.242+0000 7f469c600640 1 -- 172.21.15.59:0/121698787 shutdown_connections 2024-04-25T09:11:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.242+0000 7f469c600640 1 -- 172.21.15.59:0/121698787 >> 172.21.15.59:0/121698787 conn(0x7f4694067080 msgr2=0x7f469406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.242+0000 7f469c600640 1 -- 172.21.15.59:0/121698787 shutdown_connections 2024-04-25T09:11:42.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.242+0000 7f469c600640 1 -- 172.21.15.59:0/121698787 wait complete. 2024-04-25T09:11:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469c600640 1 Processor -- start 2024-04-25T09:11:42.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469c600640 1 -- start start 2024-04-25T09:11:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469c600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c0039c0 0x7f46941581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469c600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469413f320 0x7f46940b2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469c600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46940b4130 0x7f469415a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469c600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469415f820 con 0x7f46940b4130 2024-04-25T09:11:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469c600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4694159700 con 0x7f467c0039c0 2024-04-25T09:11:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469c600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469415f9a0 con 0x7f469413f320 2024-04-25T09:11:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46940b4130 0x7f469415a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46940b4130 0x7f469415a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47862/0 (socket says 172.21.15.59:47862) 2024-04-25T09:11:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469a600640 1 -- 172.21.15.59:0/2971801928 learned_addr learned my addr 172.21.15.59:0/2971801928 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f4699c00640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c0039c0 0x7f46941581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f4699200640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469413f320 0x7f46940b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469a600640 1 -- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469413f320 msgr2=0x7f46940b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469a600640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469413f320 0x7f46940b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469a600640 1 -- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c0039c0 msgr2=0x7f46941581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469a600640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c0039c0 0x7f46941581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469a600640 1 -- 172.21.15.59:0/2971801928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694158730 con 0x7f46940b4130 2024-04-25T09:11:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f4699200640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469413f320 0x7f46940b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469a600640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46940b4130 0x7f469415a8b0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f46940b4c70 tx=0x7f468c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f4691600640 1 -- 172.21.15.59:0/2971801928 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c01c070 con 0x7f46940b4130 2024-04-25T09:11:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f4691600640 1 -- 172.21.15.59:0/2971801928 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c017400 con 0x7f46940b4130 2024-04-25T09:11:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469c600640 1 -- 172.21.15.59:0/2971801928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46940b3090 con 0x7f46940b4130 2024-04-25T09:11:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f4691600640 1 -- 172.21.15.59:0/2971801928 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0177f0 con 0x7f46940b4130 2024-04-25T09:11:42.238 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.246+0000 7f469c600640 1 -- 172.21.15.59:0/2971801928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46940b3650 con 0x7f46940b4130 2024-04-25T09:11:42.239 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.250+0000 7f4691600640 1 -- 172.21.15.59:0/2971801928 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f468c01f070 con 0x7f46940b4130 2024-04-25T09:11:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.250+0000 7f4691600640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4674066f90 0x7f4674069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.250+0000 7f4691600640 1 -- 172.21.15.59:0/2971801928 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f468c085690 con 0x7f46940b4130 2024-04-25T09:11:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.250+0000 7f4699c00640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4674066f90 0x7f4674069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.250+0000 7f469fb8d000 1 Processor -- start 2024-04-25T09:11:42.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.250+0000 7f469fb8d000 1 -- start start 2024-04-25T09:11:42.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.250+0000 7f4699c00640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4674066f90 0x7f4674069450 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f46880ad000 tx=0x7f46880b2040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.242 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb949d0 0x55dfdcb94db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 0x55dfdcb4ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb4b0a0 0x55dfdcb4b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfdc997ff0 con 0x55dfdcb952f0 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfdc920150 con 0x55dfdcb949d0 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dfdc994090 con 0x55dfdcb4b0a0 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4699200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 0x55dfdcb4ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4699200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 0x55dfdcb4ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47872/0 (socket says 172.21.15.59:47872) 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4699200640 1 -- 172.21.15.59:0/3623029353 learned_addr learned my addr 172.21.15.59:0/3623029353 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4699c00640 1 --2- 172.21.15.59:0/3623029353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb949d0 0x55dfdcb94db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469a600640 1 --2- 172.21.15.59:0/3623029353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb4b0a0 0x55dfdcb4b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4699200640 1 -- 172.21.15.59:0/3623029353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb4b0a0 msgr2=0x55dfdcb4b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4699200640 1 --2- 172.21.15.59:0/3623029353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb4b0a0 0x55dfdcb4b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4699200640 1 -- 172.21.15.59:0/3623029353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb949d0 msgr2=0x55dfdcb94db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.243 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4699200640 1 --2- 172.21.15.59:0/3623029353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb949d0 0x55dfdcb94db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4699200640 1 -- 172.21.15.59:0/3623029353 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfdcb2e0d0 con 0x55dfdcb952f0 2024-04-25T09:11:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4699200640 1 --2- 172.21.15.59:0/3623029353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 0x55dfdcb4ab60 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f4680005970 tx=0x7f4680005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948902ae0bfc3433 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4686000640 1 -- 172.21.15.59:0/3623029353 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680010a80 con 0x55dfdcb952f0 2024-04-25T09:11:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4686000640 1 -- 172.21.15.59:0/3623029353 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4680019070 con 0x55dfdcb952f0 2024-04-25T09:11:42.244 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4686000640 1 -- 172.21.15.59:0/3623029353 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680010e20 con 0x55dfdcb952f0 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 -- 172.21.15.59:0/3623029353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 msgr2=0x55dfdcb4ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3623029353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 0x55dfdcb4ab60 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f4680005970 tx=0x7f4680005e30 comp rx=0 tx=0).stop 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 -- 172.21.15.59:0/3623029353 shutdown_connections 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3623029353 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb4b0a0 0x55dfdcb4b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3623029353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 0x55dfdcb4ab60 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3623029353 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb949d0 0x55dfdcb94db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 -- 172.21.15.59:0/3623029353 >> 172.21.15.59:0/3623029353 conn(0x55dfdcb47020 msgr2=0x55dfdcb49440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 -- 172.21.15.59:0/3623029353 shutdown_connections 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 -- 172.21.15.59:0/3623029353 wait complete. 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 -- start start 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 Processor -- start 2024-04-25T09:11:42.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb4b0a0 0x55dfdcb797f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb949d0 0x55dfdcb79d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb952f0 0x55dfdcb7a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfdc95c250 con 0x55dfdcb4b0a0 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfdc952690 con 0x55dfdcb952f0 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dfdc920a40 con 0x55dfdcb949d0 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f469fb8d000 10 client.0 _ll_register_callbacks cb 0x55dfdcb35e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.254+0000 7f4699c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb4b0a0 0x55dfdcb797f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f4699c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb4b0a0 0x55dfdcb797f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47884/0 (socket says 172.21.15.59:47884) 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f4699c00640 1 -- 172.21.15.59:0/3233987153 learned_addr learned my addr 172.21.15.59:0/3233987153 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f4699200640 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb949d0 0x55dfdcb79d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469a600640 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb952f0 0x55dfdcb7a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f4699c00640 1 -- 172.21.15.59:0/3233987153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb949d0 msgr2=0x55dfdcb79d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f4699c00640 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb949d0 0x55dfdcb79d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f4699c00640 1 -- 172.21.15.59:0/3233987153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb952f0 msgr2=0x55dfdcb7a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.249 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f4699c00640 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb952f0 0x55dfdcb7a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f4699c00640 1 -- 172.21.15.59:0/3233987153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dfdca451c0 con 0x55dfdcb4b0a0 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f4699c00640 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb4b0a0 0x55dfdcb797f0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f468801c8b0 tx=0x7f468801b2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b53539b29e03223 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f467aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f467aa00640 1 -- 172.21.15.59:0/3233987153 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880cd060 con 0x55dfdcb4b0a0 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f467aa00640 1 -- 172.21.15.59:0/3233987153 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f46880a7940 con 0x55dfdcb4b0a0 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 -- 172.21.15.59:0/3233987153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4680019070 con 0x55dfdcb4b0a0 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f467aa00640 1 -- 172.21.15.59:0/3233987153 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46880d3050 con 0x55dfdcb4b0a0 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 10 client.9360 fetch_fsmap learned FSMap version 110 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 -- 172.21.15.59:0/3233987153 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x55dfdca41170 con 0x55dfdcb4b0a0 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f467aa00640 1 -- 172.21.15.59:0/3233987153 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4680019070 con 0x55dfdcb4b0a0 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f467aa00640 1 -- 172.21.15.59:0/3233987153 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 110) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f46880d6020 con 0x55dfdcb4b0a0 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 10 client.9360 fetch_fsmap finished waiting for FSMap version 110 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 10 client.9360 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:11:42.250 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 20 client.9360 populate_metadata read hostname 'smithi059' 2024-04-25T09:11:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x55dfdcba4c80 0x55dfdcba7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 4 client.9360 mds_command: new command op to 8955 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 -- 172.21.15.59:0/3233987153 --> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dfdc933c60 con 0x55dfdcba4c80 2024-04-25T09:11:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f4699200640 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x55dfdcba4c80 0x55dfdcba7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f467aa00640 10 client.9360 ms_handle_connect on v2:172.21.15.59:6832/1679876837 2024-04-25T09:11:42.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f4699200640 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x55dfdcba4c80 0x55dfdcba7070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52042e8dd90979c6 server_cookie=ef34a7b2170c56f4 in_seq=0 out_seq=0 2024-04-25T09:11:42.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f467aa00640 1 -- 172.21.15.59:0/3233987153 <== mds.0 v2:172.21.15.59:6832/1679876837 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55dfdc933c60 con 0x55dfdcba4c80 2024-04-25T09:11:42.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f467aa00640 10 client.9360 handle_command_reply: tid=0 2024-04-25T09:11:42.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 client.9360 shutdown 2024-04-25T09:11:42.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 -- 172.21.15.59:0/3233987153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb4b0a0 msgr2=0x55dfdcb797f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb4b0a0 0x55dfdcb797f0 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f468801c8b0 tx=0x7f468801b2c0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 -- 172.21.15.59:0/3233987153 shutdown_connections 2024-04-25T09:11:42.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x55dfdcba4c80 0x55dfdcba7070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb952f0 0x55dfdcb7a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb949d0 0x55dfdcb79d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3233987153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb4b0a0 0x55dfdcb797f0 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f467aa00640 0 client.9360 ms_handle_reset on v2:172.21.15.59:6832/1679876837 2024-04-25T09:11:42.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 -- 172.21.15.59:0/3233987153 >> 172.21.15.59:0/3233987153 conn(0x55dfdcb47020 msgr2=0x55dfdcb49ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 -- 172.21.15.59:0/3233987153 shutdown_connections 2024-04-25T09:11:42.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 1 -- 172.21.15.59:0/3233987153 wait complete. 2024-04-25T09:11:42.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.258+0000 7f469fb8d000 20 client.9360 trim_cache size 0 max 16384 2024-04-25T09:11:42.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 Processor -- start 2024-04-25T09:11:42.266 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 -- start start 2024-04-25T09:11:42.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb4b0a0 0x55dfdcb4aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb949d0 0x55dfdcba1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 0x55dfdcba2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4694203f30 con 0x55dfdcb952f0 2024-04-25T09:11:42.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4694203110 con 0x55dfdcb949d0 2024-04-25T09:11:42.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4694202540 con 0x55dfdcb4b0a0 2024-04-25T09:11:42.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 0x55dfdcba2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469a600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 0x55dfdcba2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47894/0 (socket says 172.21.15.59:47894) 2024-04-25T09:11:42.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469a600640 1 -- 172.21.15.59:0/3591281233 learned_addr learned my addr 172.21.15.59:0/3591281233 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f4699c00640 1 --2- 172.21.15.59:0/3591281233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb4b0a0 0x55dfdcb4aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469a600640 1 -- 172.21.15.59:0/3591281233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb4b0a0 msgr2=0x55dfdcb4aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f4699200640 1 --2- 172.21.15.59:0/3591281233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb949d0 0x55dfdcba1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469a600640 1 --2- 172.21.15.59:0/3591281233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb4b0a0 0x55dfdcb4aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469a600640 1 -- 172.21.15.59:0/3591281233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb949d0 msgr2=0x55dfdcba1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469a600640 1 --2- 172.21.15.59:0/3591281233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb949d0 0x55dfdcba1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469a600640 1 -- 172.21.15.59:0/3591281233 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfdc9dede0 con 0x55dfdcb952f0 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f4699c00640 1 --2- 172.21.15.59:0/3591281233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb4b0a0 0x55dfdcb4aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f4699200640 1 --2- 172.21.15.59:0/3591281233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb949d0 0x55dfdcba1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469a600640 1 --2- 172.21.15.59:0/3591281233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 0x55dfdcba2380 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f468c05df00 tx=0x7f468c00d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a445ba35aa73e9a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f4685600640 1 -- 172.21.15.59:0/3591281233 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c05e430 con 0x55dfdcb952f0 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f4685600640 1 -- 172.21.15.59:0/3591281233 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c054040 con 0x55dfdcb952f0 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f4685600640 1 -- 172.21.15.59:0/3591281233 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c055fa0 con 0x55dfdcb952f0 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 -- 172.21.15.59:0/3591281233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 msgr2=0x55dfdcba2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3591281233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 0x55dfdcba2380 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f468c05df00 tx=0x7f468c00d040 comp rx=0 tx=0).stop 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 -- 172.21.15.59:0/3591281233 shutdown_connections 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3591281233 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb952f0 0x55dfdcba2380 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3591281233 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb949d0 0x55dfdcba1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 --2- 172.21.15.59:0/3591281233 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb4b0a0 0x55dfdcb4aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 -- 172.21.15.59:0/3591281233 >> 172.21.15.59:0/3591281233 conn(0x55dfdcb47020 msgr2=0x55dfdcba1730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 -- 172.21.15.59:0/3591281233 shutdown_connections 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.274+0000 7f469fb8d000 1 -- 172.21.15.59:0/3591281233 wait complete. 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 1 -- start start 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 1 Processor -- start 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb4b0a0 0x55dfdcbf4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb949d0 0x55dfdcbf4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb952f0 0x55dfdcba6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfdc932e00 con 0x55dfdcb949d0 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4694202b40 con 0x55dfdcb4b0a0 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dfdc997300 con 0x55dfdcb952f0 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 10 client.0 _ll_register_callbacks cb 0x55dfdcb16040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f4699200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb949d0 0x55dfdcbf4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f4699200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb949d0 0x55dfdcbf4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47904/0 (socket says 172.21.15.59:47904) 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f4699c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb4b0a0 0x55dfdcbf4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f4699200640 1 -- 172.21.15.59:0/1856937579 learned_addr learned my addr 172.21.15.59:0/1856937579 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469a600640 1 --2- 172.21.15.59:0/1856937579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb952f0 0x55dfdcba6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f4699200640 1 -- 172.21.15.59:0/1856937579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb952f0 msgr2=0x55dfdcba6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f4699200640 1 --2- 172.21.15.59:0/1856937579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb952f0 0x55dfdcba6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f4699200640 1 -- 172.21.15.59:0/1856937579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb4b0a0 msgr2=0x55dfdcbf4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f4699200640 1 --2- 172.21.15.59:0/1856937579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb4b0a0 0x55dfdcbf4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f4699200640 1 -- 172.21.15.59:0/1856937579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dfdc9398e0 con 0x55dfdcb949d0 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f4699200640 1 --2- 172.21.15.59:0/1856937579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb949d0 0x55dfdcbf4c60 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f4680015000 tx=0x7f4680001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4446d408fafb323c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f467aa00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f467aa00640 1 -- 172.21.15.59:0/1856937579 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680030060 con 0x55dfdcb949d0 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f467aa00640 1 -- 172.21.15.59:0/1856937579 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f468002a030 con 0x55dfdcb949d0 2024-04-25T09:11:42.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 1 -- 172.21.15.59:0/1856937579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f468c054040 con 0x55dfdcb949d0 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f467aa00640 1 -- 172.21.15.59:0/1856937579 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4680036050 con 0x55dfdcb949d0 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 10 client.9366 fetch_fsmap learned FSMap version 110 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 1 -- 172.21.15.59:0/1856937579 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=2+}) v3 -- 0x55dfdc9f18f0 con 0x55dfdcb949d0 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f467aa00640 1 -- 172.21.15.59:0/1856937579 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c054040 con 0x55dfdcb949d0 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f467aa00640 1 -- 172.21.15.59:0/1856937579 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 110) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4680039020 con 0x55dfdcb949d0 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 10 client.9366 fetch_fsmap finished waiting for FSMap version 110 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 10 client.9366 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 20 client.9366 populate_metadata read hostname 'smithi059' 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 1 --2- 172.21.15.59:0/1856937579 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x55dfdcba7470 0x55dfdcba7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 4 client.9366 mds_command: new command op to 8955 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f469fb8d000 1 -- 172.21.15.59:0/1856937579 --> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dfdc9a5530 con 0x55dfdcba7470 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.278+0000 7f4699c00640 1 --2- 172.21.15.59:0/1856937579 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x55dfdcba7470 0x55dfdcba7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.282+0000 7f4699c00640 1 --2- 172.21.15.59:0/1856937579 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x55dfdcba7470 0x55dfdcba7880 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a85d0762c5ae43dc server_cookie=cd3cb29be2f4d81b in_seq=0 out_seq=0 2024-04-25T09:11:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.282+0000 7f467aa00640 10 client.9366 ms_handle_connect on v2:172.21.15.59:6832/1679876837 2024-04-25T09:11:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f467aa00640 1 -- 172.21.15.59:0/1856937579 <== mds.0 v2:172.21.15.59:6832/1679876837 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dfdc9a5530 con 0x55dfdcba7470 2024-04-25T09:11:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f467aa00640 10 client.9366 handle_command_reply: tid=0 2024-04-25T09:11:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469fb8d000 1 client.9366 shutdown 2024-04-25T09:11:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469fb8d000 1 -- 172.21.15.59:0/1856937579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb949d0 msgr2=0x55dfdcbf4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469fb8d000 1 --2- 172.21.15.59:0/1856937579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb949d0 0x55dfdcbf4c60 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f4680015000 tx=0x7f4680001a50 comp rx=0 tx=0).stop 2024-04-25T09:11:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469fb8d000 1 -- 172.21.15.59:0/1856937579 shutdown_connections 2024-04-25T09:11:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469fb8d000 1 --2- 172.21.15.59:0/1856937579 >> [v2:172.21.15.59:6832/1679876837,v1:172.21.15.59:6833/1679876837] conn(0x55dfdcba7470 0x55dfdcba7880 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469fb8d000 1 --2- 172.21.15.59:0/1856937579 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55dfdcb952f0 0x55dfdcba6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469fb8d000 1 --2- 172.21.15.59:0/1856937579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55dfdcb949d0 0x55dfdcbf4c60 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469fb8d000 1 --2- 172.21.15.59:0/1856937579 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55dfdcb4b0a0 0x55dfdcbf4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f467aa00640 0 client.9366 ms_handle_reset on v2:172.21.15.59:6832/1679876837 2024-04-25T09:11:42.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469fb8d000 1 -- 172.21.15.59:0/1856937579 >> 172.21.15.59:0/1856937579 conn(0x55dfdcb47020 msgr2=0x55dfdcba1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469fb8d000 1 -- 172.21.15.59:0/1856937579 shutdown_connections 2024-04-25T09:11:42.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469fb8d000 1 -- 172.21.15.59:0/1856937579 wait complete. 2024-04-25T09:11:42.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469fb8d000 20 client.9366 trim_cache size 0 max 16384 2024-04-25T09:11:42.282 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:11:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: "message": "", 2024-04-25T09:11:42.282 INFO:teuthology.orchestra.run.smithi059.stdout: "return_code": 0 2024-04-25T09:11:42.282 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:11:42.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469c600640 1 -- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4674066f90 msgr2=0x7f4674069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469c600640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4674066f90 0x7f4674069450 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f46880ad000 tx=0x7f46880b2040 comp rx=0 tx=0).stop 2024-04-25T09:11:42.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469c600640 1 -- 172.21.15.59:0/2971801928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46940b4130 msgr2=0x7f469415a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.290+0000 7f469c600640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46940b4130 0x7f469415a8b0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f46940b4c70 tx=0x7f468c00f4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.294+0000 7f469c600640 1 -- 172.21.15.59:0/2971801928 shutdown_connections 2024-04-25T09:11:42.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.294+0000 7f469c600640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4674066f90 0x7f4674069450 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.294+0000 7f469c600640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46940b4130 0x7f469415a8b0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.294+0000 7f469c600640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f469413f320 0x7f46940b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.294+0000 7f469c600640 1 --2- 172.21.15.59:0/2971801928 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f467c0039c0 0x7f46941581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.294+0000 7f469c600640 1 -- 172.21.15.59:0/2971801928 >> 172.21.15.59:0/2971801928 conn(0x7f4694067080 msgr2=0x7f469406dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.294+0000 7f469c600640 1 -- 172.21.15.59:0/2971801928 shutdown_connections 2024-04-25T09:11:42.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.294+0000 7f469c600640 1 -- 172.21.15.59:0/2971801928 wait complete. 2024-04-25T09:11:42.300 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:11:42.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d28e00640 1 Processor -- start 2024-04-25T09:11:42.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d28e00640 1 -- start start 2024-04-25T09:11:42.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d28e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3d240cf3c0 0x7f3d240cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d28e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d240cd370 0x7f3d24099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d28e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d240d02a0 con 0x7f3d2415b910 2024-04-25T09:11:42.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d28e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d240cc350 con 0x7f3d240cf3c0 2024-04-25T09:11:42.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d28e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d240cc630 con 0x7f3d240cd370 2024-04-25T09:11:42.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3d2415b910 0x7f3d240cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47938/0 (socket says 172.21.15.59:47938) 2024-04-25T09:11:42.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21e00640 1 -- 172.21.15.59:0/692914477 learned_addr learned my addr 172.21.15.59:0/692914477 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d19400640 1 --2- 172.21.15.59:0/692914477 >> v2:172.21.15.178:3300/0 conn(0x7f3d240cf3c0 0x7f3d240cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d22800640 1 --2- 172.21.15.59:0/692914477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d240cd370 0x7f3d24099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591885959 0 0) 0x7f3d240d02a0 con 0x7f3d2415b910 2024-04-25T09:11:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d08003530 con 0x7f3d2415b910 2024-04-25T09:11:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 414834294 0 0) 0x7f3d08003530 con 0x7f3d2415b910 2024-04-25T09:11:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d240cd370 msgr2=0x7f3d24099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 --2- 172.21.15.59:0/692914477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d240cd370 0x7f3d24099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 >> v2:172.21.15.178:3300/0 conn(0x7f3d240cf3c0 msgr2=0x7f3d240cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.446 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 --2- 172.21.15.59:0/692914477 >> v2:172.21.15.178:3300/0 conn(0x7f3d240cf3c0 0x7f3d240cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d240cc910 con 0x7f3d2415b910 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f3d140016a0 con 0x7f3d2415b910 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 >> v1:172.21.15.59:6789/0 conn(0x7f3d2415b910 legacy=0x7f3d240cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 --2- 172.21.15.59:0/692914477 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d080039c0 0x7f3d08003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 --2- 172.21.15.59:0/692914477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d08004810 0x7f3d08004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 --2- 172.21.15.59:0/692914477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d240cd370 0x7f3d080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d240cc350 con 0x7f3d08004810 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d240cc630 con 0x7f3d080039c0 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0800b9d0 con 0x7f3d240cd370 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d19400640 1 --2- 172.21.15.59:0/692914477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d08004810 0x7f3d08004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d21e00640 1 --2- 172.21.15.59:0/692914477 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d080039c0 0x7f3d08003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d22800640 1 --2- 172.21.15.59:0/692914477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d240cd370 0x7f3d080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d19400640 1 -- 172.21.15.59:0/692914477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d240cd370 msgr2=0x7f3d080051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d19400640 1 --2- 172.21.15.59:0/692914477 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d240cd370 0x7f3d080051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d19400640 1 -- 172.21.15.59:0/692914477 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d080039c0 msgr2=0x7f3d08003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d19400640 1 --2- 172.21.15.59:0/692914477 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d080039c0 0x7f3d08003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.454+0000 7f3d19400640 1 -- 172.21.15.59:0/692914477 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d08003530 con 0x7f3d08004810 2024-04-25T09:11:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.458+0000 7f3d19400640 1 --2- 172.21.15.59:0/692914477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d08004810 0x7f3d08004c90 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009ab0 tx=0x7f3d0c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4614108906443115 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.458+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0b2070 con 0x7f3d08004810 2024-04-25T09:11:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.458+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c0a55a0 con 0x7f3d08004810 2024-04-25T09:11:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.458+0000 7f3d21400640 1 -- 172.21.15.59:0/692914477 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0096b0 con 0x7f3d08004810 2024-04-25T09:11:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.458+0000 7f3d28e00640 1 -- 172.21.15.59:0/692914477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d08004810 msgr2=0x7f3d08004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.458+0000 7f3d28e00640 1 --2- 172.21.15.59:0/692914477 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d08004810 0x7f3d08004c90 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c009ab0 tx=0x7f3d0c01ca30 comp rx=0 tx=0).stop 2024-04-25T09:11:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.458+0000 7f3d22800640 1 -- 172.21.15.59:0/692914477 reap_dead start 2024-04-25T09:11:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.458+0000 7f3d28e00640 1 -- 172.21.15.59:0/692914477 shutdown_connections 2024-04-25T09:11:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.458+0000 7f3d28e00640 1 -- 172.21.15.59:0/692914477 >> 172.21.15.59:0/692914477 conn(0x7f3d240b3200 msgr2=0x7f3d240b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.458+0000 7f3d28e00640 1 -- 172.21.15.59:0/692914477 shutdown_connections 2024-04-25T09:11:42.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.458+0000 7f3d28e00640 1 -- 172.21.15.59:0/692914477 wait complete. 2024-04-25T09:11:42.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d28e00640 1 Processor -- start 2024-04-25T09:11:42.451 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d28e00640 1 -- start start 2024-04-25T09:11:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d28e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d08004810 0x7f3d24149bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d28e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d24156110 0x7f3d240c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d28e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d240ca1f0 0x7f3d240c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d28e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2415be70 con 0x7f3d240ca1f0 2024-04-25T09:11:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d28e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2415bcf0 con 0x7f3d08004810 2024-04-25T09:11:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d28e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24099a60 con 0x7f3d24156110 2024-04-25T09:11:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d22800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d240ca1f0 0x7f3d240c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.453 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d22800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d240ca1f0 0x7f3d240c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47920/0 (socket says 172.21.15.59:47920) 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d22800640 1 -- 172.21.15.59:0/2169714150 learned_addr learned my addr 172.21.15.59:0/2169714150 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d21e00640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d08004810 0x7f3d24149bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d19400640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d24156110 0x7f3d240c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d22800640 1 -- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d24156110 msgr2=0x7f3d240c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d22800640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d24156110 0x7f3d240c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d22800640 1 -- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d08004810 msgr2=0x7f3d24149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d22800640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d08004810 0x7f3d24149bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d22800640 1 -- 172.21.15.59:0/2169714150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d240c9150 con 0x7f3d240ca1f0 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d22800640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d240ca1f0 0x7f3d240c7330 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f3d240cf930 tx=0x7f3d1c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d1aa00640 1 -- 172.21.15.59:0/2169714150 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c00fde0 con 0x7f3d240ca1f0 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d1aa00640 1 -- 172.21.15.59:0/2169714150 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c015430 con 0x7f3d240ca1f0 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d28e00640 1 -- 172.21.15.59:0/2169714150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d240c9430 con 0x7f3d240ca1f0 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d1aa00640 1 -- 172.21.15.59:0/2169714150 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c015820 con 0x7f3d240ca1f0 2024-04-25T09:11:42.454 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.462+0000 7f3d28e00640 1 -- 172.21.15.59:0/2169714150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d240c99f0 con 0x7f3d240ca1f0 2024-04-25T09:11:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.466+0000 7f3d28e00640 1 -- 172.21.15.59:0/2169714150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d240745d0 con 0x7f3d240ca1f0 2024-04-25T09:11:42.455 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.466+0000 7f3d1aa00640 1 -- 172.21.15.59:0/2169714150 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3d1c0159c0 con 0x7f3d240ca1f0 2024-04-25T09:11:42.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.466+0000 7f3d1aa00640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d00066f90 0x7f3d00069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.456 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.466+0000 7f3d1aa00640 1 -- 172.21.15.59:0/2169714150 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 6187+0+0 (secure 0 0 0) 0x7f3d1c085ed0 con 0x7f3d240ca1f0 2024-04-25T09:11:42.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.466+0000 7f3d21e00640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d00066f90 0x7f3d00069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.457 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.470+0000 7f3d21e00640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d00066f90 0x7f3d00069450 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3d14001c60 tx=0x7f3d14001e40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.461 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.470+0000 7f3d1aa00640 1 -- 172.21.15.59:0/2169714150 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3d1c019030 con 0x7f3d240ca1f0 2024-04-25T09:11:42.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.670+0000 7f3d28e00640 1 -- 172.21.15.59:0/2169714150 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3d240cdcd0 con 0x7f3d240ca1f0 2024-04-25T09:11:42.658 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:11:42.670+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:11:42.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.670+0000 7f3d1aa00640 1 -- 172.21.15.59:0/2169714150 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v111) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3d1c010040 con 0x7f3d240ca1f0 2024-04-25T09:11:42.660 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:11:42.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.674+0000 7f3d28e00640 1 -- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d00066f90 msgr2=0x7f3d00069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.674+0000 7f3d28e00640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d00066f90 0x7f3d00069450 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3d14001c60 tx=0x7f3d14001e40 comp rx=0 tx=0).stop 2024-04-25T09:11:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.674+0000 7f3d28e00640 1 -- 172.21.15.59:0/2169714150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d240ca1f0 msgr2=0x7f3d240c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.674+0000 7f3d28e00640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d240ca1f0 0x7f3d240c7330 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f3d240cf930 tx=0x7f3d1c00f580 comp rx=0 tx=0).stop 2024-04-25T09:11:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.674+0000 7f3d28e00640 1 -- 172.21.15.59:0/2169714150 shutdown_connections 2024-04-25T09:11:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.674+0000 7f3d28e00640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d00066f90 0x7f3d00069450 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.674+0000 7f3d28e00640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d240ca1f0 0x7f3d240c7330 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.674+0000 7f3d28e00640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d24156110 0x7f3d240c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.674+0000 7f3d28e00640 1 --2- 172.21.15.59:0/2169714150 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d08004810 0x7f3d24149bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.674+0000 7f3d28e00640 1 -- 172.21.15.59:0/2169714150 >> 172.21.15.59:0/2169714150 conn(0x7f3d240b3200 msgr2=0x7f3d2409a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.674+0000 7f3d28e00640 1 -- 172.21.15.59:0/2169714150 shutdown_connections 2024-04-25T09:11:42.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.674+0000 7f3d28e00640 1 -- 172.21.15.59:0/2169714150 wait complete. 2024-04-25T09:11:42.671 INFO:tasks.ceph.mds.c.smithi059.stderr: -1007> 2024-04-25T09:11:38.582+0000 7f75aec00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:11:42.683 DEBUG:teuthology.orchestra.run.smithi059:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2024-04-25T09:11:42.715 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T09:11:42.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 1 -- start start 2024-04-25T09:11:42.729 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 1 Processor -- start 2024-04-25T09:11:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fac1a1800 0x558fac35a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fac1a1400 0x558fac35ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fac1a1000 0x558fac35b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558facf70600 con 0x558fac1a1400 2024-04-25T09:11:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558facf70480 con 0x558fac1a1000 2024-04-25T09:11:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x558facf70300 con 0x558fac1a1800 2024-04-25T09:11:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4baa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fac1a1400 0x558fac35ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4baa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fac1a1400 0x558fac35ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47964/0 (socket says 172.21.15.59:47964) 2024-04-25T09:11:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4baa00640 1 -- 172.21.15.59:0/410884004 learned_addr learned my addr 172.21.15.59:0/410884004 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.733 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bb400640 1 --2- 172.21.15.59:0/410884004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fac1a1800 0x558fac35a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/410884004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fac1a1000 0x558fac35b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4baa00640 1 -- 172.21.15.59:0/410884004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fac1a1800 msgr2=0x558fac35a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4baa00640 1 --2- 172.21.15.59:0/410884004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fac1a1800 0x558fac35a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4baa00640 1 -- 172.21.15.59:0/410884004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fac1a1000 msgr2=0x558fac35b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4baa00640 1 --2- 172.21.15.59:0/410884004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fac1a1000 0x558fac35b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4baa00640 1 -- 172.21.15.59:0/410884004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fac242960 con 0x558fac1a1400 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/410884004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fac1a1000 0x558fac35b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bb400640 1 --2- 172.21.15.59:0/410884004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fac1a1800 0x558fac35a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4baa00640 1 --2- 172.21.15.59:0/410884004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fac1a1400 0x558fac35ab00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x558fad001380 tx=0x558fac264de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a8e56a9a3a886d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4b8200640 1 -- 172.21.15.59:0/410884004 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558fac1d64e0 con 0x558fac1a1400 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4b8200640 1 -- 172.21.15.59:0/410884004 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558fac1ea1c0 con 0x558fac1a1400 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4b8200640 1 -- 172.21.15.59:0/410884004 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558fac1d6b60 con 0x558fac1a1400 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 1 -- 172.21.15.59:0/410884004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558fac242d20 con 0x558fac1a1400 2024-04-25T09:11:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 1 -- 172.21.15.59:0/410884004 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558fac242f00 con 0x558fac1a1400 2024-04-25T09:11:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 4 waiting for MDS map... 2024-04-25T09:11:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4b8200640 1 -- 172.21.15.59:0/410884004 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x558fad0ca600 con 0x558fac1a1400 2024-04-25T09:11:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4b8200640 1 -- 172.21.15.59:0/410884004 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 111) v1 ==== 2723+0+0 (secure 0 0 0) 0x558fac1f7180 con 0x558fac1a1400 2024-04-25T09:11:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 4 Got MDS map 111 2024-04-25T09:11:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 10 main: JournalTool::main 2024-04-25T09:11:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 4 main: JournalTool: connecting to RADOS... 2024-04-25T09:11:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 1 Processor -- start 2024-04-25T09:11:42.735 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.742+0000 7fd4bd3be400 1 -- start start 2024-04-25T09:11:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cec00 0x558fac35b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0cf000 0x558fac35bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cf400 0x558fac35c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558facf70180 con 0x558fad0cec00 2024-04-25T09:11:42.739 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fac200480 con 0x558fad0cf000 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x558fac200900 con 0x558fad0cf400 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cec00 0x558fac35b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cec00 0x558fac35b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47978/0 (socket says 172.21.15.59:47978) 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bbe00640 1 -- 172.21.15.59:0/3685070514 learned_addr learned my addr 172.21.15.59:0/3685070514 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bb400640 1 --2- 172.21.15.59:0/3685070514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0cf000 0x558fac35bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4baa00640 1 --2- 172.21.15.59:0/3685070514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cf400 0x558fac35c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bbe00640 1 -- 172.21.15.59:0/3685070514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cf400 msgr2=0x558fac35c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/3685070514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cf400 0x558fac35c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bbe00640 1 -- 172.21.15.59:0/3685070514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0cf000 msgr2=0x558fac35bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/3685070514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0cf000 0x558fac35bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bbe00640 1 -- 172.21.15.59:0/3685070514 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fac242d20 con 0x558fad0cec00 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/3685070514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cec00 0x558fac35b600 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x558fad0c2690 tx=0x558fad0dcc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570a10254f2d3b38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4b5a00640 1 -- 172.21.15.59:0/3685070514 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558fac1d64e0 con 0x558fad0cec00 2024-04-25T09:11:42.740 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4b5a00640 1 -- 172.21.15.59:0/3685070514 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558fac1eac40 con 0x558fad0cec00 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4b5a00640 1 -- 172.21.15.59:0/3685070514 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558fac1d6b60 con 0x558fad0cec00 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3685070514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cec00 msgr2=0x558fac35b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3685070514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cec00 0x558fac35b600 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x558fad0c2690 tx=0x558fad0dcc00 comp rx=0 tx=0).stop 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3685070514 shutdown_connections 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3685070514 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cf400 0x558fac35c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3685070514 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0cf000 0x558fac35bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3685070514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cec00 0x558fac35b600 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3685070514 >> 172.21.15.59:0/3685070514 conn(0x558fac1a0c00 msgr2=0x558fac1cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3685070514 shutdown_connections 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3685070514 wait complete. 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 Processor -- start 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 -- start start 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0cec00 0x558fac35d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.741 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cf000 0x558fac35cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cf400 0x558fac35c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558facf71380 con 0x558fad0cf000 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558facf70180 con 0x558fad0cec00 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bd3be400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x558facf71500 con 0x558fad0cf400 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cf000 0x558fac35cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bb400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cf000 0x558fac35cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:47986/0 (socket says 172.21.15.59:47986) 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bb400640 1 -- 172.21.15.59:0/3764859773 learned_addr learned my addr 172.21.15.59:0/3764859773 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0cec00 0x558fac35d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.746+0000 7fd4baa00640 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cf400 0x558fac35c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bb400640 1 -- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cf400 msgr2=0x558fac35c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bb400640 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cf400 0x558fac35c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bb400640 1 -- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0cec00 msgr2=0x558fac35d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.742 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bb400640 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0cec00 0x558fac35d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bb400640 1 -- 172.21.15.59:0/3764859773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fac243c20 con 0x558fad0cf000 2024-04-25T09:11:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4baa00640 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cf400 0x558fac35c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bb400640 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cf000 0x558fac35cc00 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x558fad000990 tx=0x558fac278000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4b3c00640 1 -- 172.21.15.59:0/3764859773 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558fac1d69c0 con 0x558fad0cf000 2024-04-25T09:11:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4b3c00640 1 -- 172.21.15.59:0/3764859773 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558fac1eac40 con 0x558fad0cf000 2024-04-25T09:11:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3764859773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558fac243e00 con 0x558fad0cf000 2024-04-25T09:11:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4b3c00640 1 -- 172.21.15.59:0/3764859773 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558fac1d64e0 con 0x558fad0cf000 2024-04-25T09:11:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3764859773 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558fac2421e0 con 0x558fad0cf000 2024-04-25T09:11:42.743 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bd3be400 4 main: JournalTool: resolving pool 17 2024-04-25T09:11:42.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4b3c00640 1 -- 172.21.15.59:0/3764859773 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x558fad10cc00 con 0x558fad0cf000 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4b3c00640 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x558fad0c4c00 0x558fac35d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4b3c00640 1 -- 172.21.15.59:0/3764859773 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x558fac4ca600 con 0x558fad0cf000 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bd3be400 4 main: JournalTool: creating IoCtx.. 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bd3be400 4 main: Executing for rank 0 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x558fad0c4c00 0x558fac35d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.750+0000 7fd4bd3be400 1 -- start start 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x558fad0c4c00 0x558fac35d700 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x558fad0c2690 tx=0x558fac2632c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 1 Processor -- start 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cfc00 0x558fac35c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0c5000 0x558fac35bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0c5400 0x558fac35b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x558facf71800 con 0x558fad0c5400 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x558facf71980 con 0x558fad0c5000 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x558fac200900 con 0x558fad0cfc00 2024-04-25T09:11:42.747 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4baa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0c5400 0x558fac35b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4baa00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0c5400 0x558fac35b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48002/0 (socket says 172.21.15.59:48002) 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4baa00640 1 -- 172.21.15.59:0/3810416330 learned_addr learned my addr 172.21.15.59:0/3810416330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bb400640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0c5000 0x558fac35bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cfc00 0x558fac35c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4baa00640 1 -- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cfc00 msgr2=0x558fac35c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4baa00640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cfc00 0x558fac35c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4baa00640 1 -- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0c5000 msgr2=0x558fac35bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4baa00640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0c5000 0x558fac35bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4baa00640 1 -- 172.21.15.59:0/3810416330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fac614780 con 0x558fad0c5400 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4baa00640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0c5400 0x558fac35b600 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x558fac5957d0 tx=0x558fac2633e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a0b770925705b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4b0000640 1 -- 172.21.15.59:0/3810416330 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558fac1d6340 con 0x558fad0c5400 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4b0000640 1 -- 172.21.15.59:0/3810416330 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558fac1eb500 con 0x558fad0c5400 2024-04-25T09:11:42.748 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4b0000640 1 -- 172.21.15.59:0/3810416330 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558fac51a680 con 0x558fad0c5400 2024-04-25T09:11:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558fac614960 con 0x558fad0c5400 2024-04-25T09:11:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558fac614b40 con 0x558fad0c5400 2024-04-25T09:11:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 4 waiting for MDS map... 2024-04-25T09:11:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4b0000640 1 -- 172.21.15.59:0/3810416330 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x558fac624c00 con 0x558fad0c5400 2024-04-25T09:11:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4b0000640 1 -- 172.21.15.59:0/3810416330 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 111) v1 ==== 2723+0+0 (secure 0 0 0) 0x558fac1f7880 con 0x558fad0c5400 2024-04-25T09:11:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 4 Got MDS map 111 2024-04-25T09:11:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x558fad0c5800 0x558fac642000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:1 17.f 17:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x558fad0c5c00 con 0x558fad0c5800 2024-04-25T09:11:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x558fad0c5800 0x558fac642000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.754+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x558fad0c5800 0x558fac642000 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=bbd7431bf39387f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.758+0000 7fd4bbe00640 1 -- 172.21.15.59:0/3810416330 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v123'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x558fac31c000 con 0x558fad0c5800 2024-04-25T09:11:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.758+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x558fac62b400 0x558fac642580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.758+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:2 17.14 17:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x558fac62b800 con 0x558fac62b400 2024-04-25T09:11:42.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.758+0000 7fd4bb400640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x558fac62b400 0x558fac642580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.758+0000 7fd4bb400640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x558fac62b400 0x558fac642580 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=1c2ecfb819d3d365 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.762+0000 7fd4bb400640 1 -- 172.21.15.59:0/3810416330 <== osd.3 v2:172.21.15.59:6808/3810214969 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v123'38 uv38 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x558fac31c500 con 0x558fac62b400 2024-04-25T09:11:42.753 INFO:teuthology.orchestra.run.smithi059.stdout:writing EResetJournal entry 2024-04-25T09:11:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.762+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:3 17.14 17:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x558fac62bc00 con 0x558fac62b400 2024-04-25T09:11:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.762+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x558fac64e000 0x558fac642b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.762+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:4 17.1b 17:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x558fac64e400 con 0x558fac64e000 2024-04-25T09:11:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.762+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x558fac64e800 0x558fac643080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.762+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:5 17.b 17:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x558fac64ec00 con 0x558fac64e800 2024-04-25T09:11:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.762+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x558fac64f000 0x558fac643600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.762+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:6 17.1f 17:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x558fac64f400 con 0x558fac64f000 2024-04-25T09:11:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.762+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:7 17.1a 17:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x558fac64f800 con 0x558fac64e800 2024-04-25T09:11:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.762+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:8 17.1e 17:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x558fac64fc00 con 0x558fad0c5800 2024-04-25T09:11:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4bb400640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x558fac64e800 0x558fac643080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x558fac64e000 0x558fac642b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.755 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4baa00640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x558fac64f000 0x558fac643600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4bb400640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x558fac64e800 0x558fac643080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=89c8ec932525f45e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4baa00640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x558fac64f000 0x558fac643600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=a920ca462aff04e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4bbe00640 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x558fac64e000 0x558fac642b00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=646063dfd6f9ec4f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4bb400640 1 -- 172.21.15.59:0/3810416330 <== osd.3 v2:172.21.15.59:6808/3810214969 2 ==== osd_op_reply(3 200.00000001 [delete] v123'39 uv39 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x558fac31c500 con 0x558fac62b400 2024-04-25T09:11:42.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4bbe00640 1 -- 172.21.15.59:0/3810416330 <== osd.1 v2:172.21.15.59:6809/1450066050 2 ==== osd_op_reply(8 200.00000006 [delete] v123'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558fac31c000 con 0x558fad0c5800 2024-04-25T09:11:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4bb400640 1 -- 172.21.15.59:0/3810416330 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== osd_op_reply(7 200.00000005 [delete] v123'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558fac31c500 con 0x558fac64e800 2024-04-25T09:11:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4baa00640 1 -- 172.21.15.59:0/3810416330 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(6 200.00000004 [delete] v123'9 uv8 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558fac31c780 con 0x558fac64f000 2024-04-25T09:11:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4bb400640 1 -- 172.21.15.59:0/3810416330 <== osd.0 v2:172.21.15.59:6800/4129855307 2 ==== osd_op_reply(5 200.00000003 [delete] v123'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558fac31c500 con 0x558fac64e800 2024-04-25T09:11:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4bbe00640 1 -- 172.21.15.59:0/3810416330 <== osd.4 v2:172.21.15.178:6805/2278719369 1 ==== osd_op_reply(4 200.00000002 [delete] v123'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558fac31c000 con 0x558fac64e000 2024-04-25T09:11:42.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.766+0000 7fd4ae200640 1 -- 172.21.15.59:0/3810416330 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:9 17.14 17:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x558fad0c4800 con 0x558fac62b400 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bb400640 1 -- 172.21.15.59:0/3810416330 <== osd.3 v2:172.21.15.59:6808/3810214969 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v123'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x558fac31c500 con 0x558fac62b400 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 4 Successfully wrote new journal pointer and header for rank 8:0 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x558fac64e800 msgr2=0x558fac643080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x558fac64e800 0x558fac643080 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x558fad0c5800 msgr2=0x558fac642000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x558fad0c5800 0x558fac642000 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x558fac62b400 msgr2=0x558fac642580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x558fac62b400 0x558fac642580 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x558fac64e000 msgr2=0x558fac642b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x558fac64e000 0x558fac642b00 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x558fac64f000 msgr2=0x558fac643600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4baa00640 1 -- 172.21.15.59:0/3810416330 reap_dead start 2024-04-25T09:11:42.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x558fac64f000 0x558fac643600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0c5400 msgr2=0x558fac35b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0c5400 0x558fac35b600 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x558fac5957d0 tx=0x558fac2633e0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 shutdown_connections 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x558fac64f000 0x558fac643600 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3810416330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0c5400 0x558fac35b600 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 >> 172.21.15.59:0/3810416330 conn(0x558fad0cf800 msgr2=0x558fac1cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 shutdown_connections 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3810416330 wait complete. 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x558fad0c4c00 msgr2=0x558fac35d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x558fad0c4c00 0x558fac35d700 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x558fad0c2690 tx=0x558fac2632c0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3764859773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cf000 msgr2=0x558fac35cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cf000 0x558fac35cc00 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x558fad000990 tx=0x558fac278000 comp rx=0 tx=0).stop 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3764859773 shutdown_connections 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x558fad0c4c00 0x558fac35d700 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fad0cf400 0x558fac35c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fad0cf000 0x558fac35cc00 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/3764859773 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fad0cec00 0x558fac35d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3764859773 >> 172.21.15.59:0/3764859773 conn(0x558fac1a0c00 msgr2=0x558fac1cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3764859773 shutdown_connections 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/3764859773 wait complete. 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/410884004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fac1a1400 msgr2=0x558fac35ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/410884004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fac1a1400 0x558fac35ab00 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x558fad001380 tx=0x558fac264de0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/410884004 shutdown_connections 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/410884004 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x558fac1a1000 0x558fac35b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/410884004 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x558fac1a1400 0x558fac35ab00 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 --2- 172.21.15.59:0/410884004 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x558fac1a1800 0x558fac35a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/410884004 >> 172.21.15.59:0/410884004 conn(0x558fac1a1c00 msgr2=0x558fac1cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/410884004 shutdown_connections 2024-04-25T09:11:42.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.770+0000 7fd4bd3be400 1 -- 172.21.15.59:0/410884004 wait complete. 2024-04-25T09:11:42.764 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.081136, result: writing EResetJournal entry 2024-04-25T09:11:42.765 DEBUG:teuthology.orchestra.run.smithi059:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-25T09:11:42.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc22ce18c0 1 -- start start 2024-04-25T09:11:42.848 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc22ce18c0 1 Processor -- start 2024-04-25T09:11:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc22ce18c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9dd1ef800 0x55c9dd3a8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc22ce18c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9dd1ef400 0x55c9dd3a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc22ce18c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9dd1ef000 0x55c9dd3a9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc22ce18c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9de0e2180 con 0x55c9dd1ef400 2024-04-25T09:11:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc22ce18c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9de0e2300 con 0x55c9dd1ef000 2024-04-25T09:11:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc22ce18c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9de0e2480 con 0x55c9dd1ef800 2024-04-25T09:11:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc20400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9dd1ef400 0x55c9dd3a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc20400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9dd1ef400 0x55c9dd3a8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48016/0 (socket says 172.21.15.59:48016) 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc20400640 1 -- 172.21.15.59:0/2459703455 learned_addr learned my addr 172.21.15.59:0/2459703455 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc21800640 1 --2- 172.21.15.59:0/2459703455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9dd1ef000 0x55c9dd3a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc20e00640 1 --2- 172.21.15.59:0/2459703455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9dd1ef800 0x55c9dd3a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc20400640 1 -- 172.21.15.59:0/2459703455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9dd1ef800 msgr2=0x55c9dd3a8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc20400640 1 --2- 172.21.15.59:0/2459703455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9dd1ef800 0x55c9dd3a8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc20400640 1 -- 172.21.15.59:0/2459703455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9dd1ef000 msgr2=0x55c9dd3a9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc20400640 1 --2- 172.21.15.59:0/2459703455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9dd1ef000 0x55c9dd3a9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.858+0000 7fcc20400640 1 -- 172.21.15.59:0/2459703455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9dd2141e0 con 0x55c9dd1ef400 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc20400640 1 --2- 172.21.15.59:0/2459703455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9dd1ef400 0x55c9dd3a8b00 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x55c9de02fbf0 tx=0x55c9dd2c8ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7553d153ce5a3ee0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc1dc00640 1 -- 172.21.15.59:0/2459703455 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9dd2244e0 con 0x55c9dd1ef400 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc1dc00640 1 -- 172.21.15.59:0/2459703455 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9dd238e00 con 0x55c9dd1ef400 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc1dc00640 1 -- 172.21.15.59:0/2459703455 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9dd224b60 con 0x55c9dd1ef400 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/2459703455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9dd2152c0 con 0x55c9dd1ef400 2024-04-25T09:11:42.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/2459703455 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c9dd215a40 con 0x55c9dd1ef400 2024-04-25T09:11:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 4 waiting for MDS map... 2024-04-25T09:11:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc1dc00640 1 -- 172.21.15.59:0/2459703455 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x55c9de10e600 con 0x55c9dd1ef400 2024-04-25T09:11:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc1dc00640 1 -- 172.21.15.59:0/2459703455 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 111) v1 ==== 2723+0+0 (secure 0 0 0) 0x55c9dd245180 con 0x55c9dd1ef400 2024-04-25T09:11:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 4 Got MDS map 111 2024-04-25T09:11:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 4 datascan.main: Using metadata pool output 2024-04-25T09:11:42.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 4 datascan.main: connecting to RADOS... 2024-04-25T09:11:42.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 1 Processor -- start 2024-04-25T09:11:42.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 1 -- start start 2024-04-25T09:11:42.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9de102c00 0x55c9dd3a9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9de103000 0x55c9dd3a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103400 0x55c9dd3aa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9de0e2600 con 0x55c9de103400 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9de0e2780 con 0x55c9de103000 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9de0e2900 con 0x55c9de102c00 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc20400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103400 0x55c9dd3aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc20400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103400 0x55c9dd3aa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48032/0 (socket says 172.21.15.59:48032) 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc20400640 1 -- 172.21.15.59:0/88126087 learned_addr learned my addr 172.21.15.59:0/88126087 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc20e00640 1 --2- 172.21.15.59:0/88126087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9de103000 0x55c9dd3a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc21800640 1 --2- 172.21.15.59:0/88126087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9de102c00 0x55c9dd3a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc20400640 1 -- 172.21.15.59:0/88126087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9de102c00 msgr2=0x55c9dd3a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc20400640 1 --2- 172.21.15.59:0/88126087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9de102c00 0x55c9dd3a9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc20400640 1 -- 172.21.15.59:0/88126087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9de103000 msgr2=0x55c9dd3a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc20400640 1 --2- 172.21.15.59:0/88126087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9de103000 0x55c9dd3a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc20400640 1 -- 172.21.15.59:0/88126087 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9dd215c20 con 0x55c9de103400 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc20400640 1 --2- 172.21.15.59:0/88126087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103400 0x55c9dd3aa100 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x55c9de02fe30 tx=0x55c9dd2c89c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176d2d6ba3cf8a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc1b400640 1 -- 172.21.15.59:0/88126087 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9dd224340 con 0x55c9de103400 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc1b400640 1 -- 172.21.15.59:0/88126087 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9dd238c40 con 0x55c9de103400 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc1b400640 1 -- 172.21.15.59:0/88126087 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9dd2244e0 con 0x55c9de103400 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/88126087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103400 msgr2=0x55c9dd3aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.862+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/88126087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103400 0x55c9dd3aa100 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x55c9de02fe30 tx=0x55c9dd2c89c0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/88126087 shutdown_connections 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/88126087 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103400 0x55c9dd3aa100 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/88126087 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9de103000 0x55c9dd3a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/88126087 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9de102c00 0x55c9dd3a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/88126087 >> 172.21.15.59:0/88126087 conn(0x55c9dd1eec00 msgr2=0x55c9dd21d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/88126087 shutdown_connections 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/88126087 wait complete. 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 Processor -- start 2024-04-25T09:11:42.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 -- start start 2024-04-25T09:11:42.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9de102c00 0x55c9dd3ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103000 0x55c9dd3aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9de103400 0x55c9dd3aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9de0e3c80 con 0x55c9de103000 2024-04-25T09:11:42.858 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c9de0e3b00 con 0x55c9de102c00 2024-04-25T09:11:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c9de0e3980 con 0x55c9de103400 2024-04-25T09:11:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc20e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103000 0x55c9dd3aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc20400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9de103400 0x55c9dd3aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc20e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103000 0x55c9dd3aac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48044/0 (socket says 172.21.15.59:48044) 2024-04-25T09:11:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 learned_addr learned my addr 172.21.15.59:0/106867358 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc21800640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9de102c00 0x55c9dd3ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9de103400 msgr2=0x55c9dd3aa680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc20e00640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9de103400 0x55c9dd3aa680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9de102c00 msgr2=0x55c9dd3ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc20e00640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9de102c00 0x55c9dd3ab180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c9dd2141e0 con 0x55c9de103000 2024-04-25T09:11:42.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc20400640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9de103400 0x55c9dd3aa680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:42.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc21800640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9de102c00 0x55c9dd3ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:42.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc20e00640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103000 0x55c9dd3aac00 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x55c9ddfafaa0 tx=0x55c9de0f2e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc19600640 1 -- 172.21.15.59:0/106867358 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9dd224340 con 0x55c9de103000 2024-04-25T09:11:42.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc19600640 1 -- 172.21.15.59:0/106867358 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c9dd238540 con 0x55c9de103000 2024-04-25T09:11:42.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc19600640 1 -- 172.21.15.59:0/106867358 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c9dd2244e0 con 0x55c9de103000 2024-04-25T09:11:42.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c9dd2152c0 con 0x55c9de103000 2024-04-25T09:11:42.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c9dd215e00 con 0x55c9de103000 2024-04-25T09:11:42.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.866+0000 7fcc22ce18c0 4 datascan.init: resolving metadata pool 17 2024-04-25T09:11:42.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc19600640 1 -- 172.21.15.59:0/106867358 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55c9dd522c00 con 0x55c9de103000 2024-04-25T09:11:42.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc19600640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55c9dd53ac00 0x55c9dd3ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc19600640 1 -- 172.21.15.59:0/106867358 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x55c9dd53c800 con 0x55c9de103000 2024-04-25T09:11:42.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc22ce18c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc22ce18c0 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc22ce18c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c9de103800 0x55c9dd3aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:1 18.0 18:00000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9de103c00 con 0x55c9de103800 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc21800640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55c9dd53ac00 0x55c9dd3ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc20400640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c9de103800 0x55c9dd3aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc21800640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55c9dd53ac00 0x55c9dd3ab700 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55c9dd2ca150 tx=0x55c9dd290000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc20400640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c9de103800 0x55c9dd3aa100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== osd_op_reply(1 [pgnls start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9de103800 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc1aa00640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55c9dd53b000 0x55c9dd62c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:2 18.20 18:04000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd53b400 con 0x55c9dd53b000 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc21800640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55c9dd53b000 0x55c9dd62c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.870+0000 7fcc21800640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55c9dd53b000 0x55c9dd62c000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.5 v2:172.21.15.178:6802/3576783051 1 ==== osd_op_reply(2 [pgnls start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b000 2024-04-25T09:11:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc1b400640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55c9dd53bc00 0x55c9dd62c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:3 18.10 18:08000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636000 con 0x55c9dd53bc00 2024-04-25T09:11:42.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc20e00640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55c9dd53bc00 0x55c9dd62c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc20e00640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55c9dd53bc00 0x55c9dd62c580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(3 [pgnls start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9dd53bc00 2024-04-25T09:11:42.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:4 18.30 18:0c000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd53b800 con 0x55c9de103800 2024-04-25T09:11:42.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.0 v2:172.21.15.59:6800/4129855307 2 ==== osd_op_reply(4 [pgnls start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9de103800 2024-04-25T09:11:42.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:5 18.8 18:10000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636400 con 0x55c9de103800 2024-04-25T09:11:42.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.0 v2:172.21.15.59:6800/4129855307 3 ==== osd_op_reply(5 [pgnls start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9de103800 2024-04-25T09:11:42.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:6 18.28 18:14000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636800 con 0x55c9dd53b000 2024-04-25T09:11:42.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.5 v2:172.21.15.178:6802/3576783051 2 ==== osd_op_reply(6 [pgnls start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b000 2024-04-25T09:11:42.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc1b400640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55c9dd637400 0x55c9dd62cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:7 18.18 18:18000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd637800 con 0x55c9dd637400 2024-04-25T09:11:42.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc20400640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55c9dd637400 0x55c9dd62cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc20400640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55c9dd637400 0x55c9dd62cb00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(7 [pgnls start_epoch 123 out=81b] v121'17 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd637400 2024-04-25T09:11:42.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:8 18.18 18:1ad8d55b:::10000000006.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636400 con 0x55c9dd637400 2024-04-25T09:11:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.1 v2:172.21.15.59:6809/1450066050 2 ==== osd_op_reply(8 10000000006.00000001 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd637400 2024-04-25T09:11:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc22ce18c0 10 datascan.operator(): handling object 1099511627782.1 2024-04-25T09:11:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.874+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:9 18.25 18:a5feb6f3:::10000000006.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd637800 con 0x55c9dd53bc00 2024-04-25T09:11:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.878+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.6 v2:172.21.15.178:6800/2032393933 2 ==== osd_op_reply(9 10000000006.00000000 [call] v123'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9dd53bc00 2024-04-25T09:11:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.878+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55c9dd53b800 0x55c9dd3a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.878+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:10 18.38 18:1c000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9de102400 con 0x55c9dd53b800 2024-04-25T09:11:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.878+0000 7fcc21800640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55c9dd53b800 0x55c9dd3a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.878+0000 7fcc21800640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55c9dd53b800 0x55c9dd3a9b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.878+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 1 ==== osd_op_reply(10 [pgnls start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.878+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:11 18.4 18:20000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd637c00 con 0x55c9de103800 2024-04-25T09:11:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.878+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.0 v2:172.21.15.59:6800/4129855307 4 ==== osd_op_reply(11 [pgnls start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9de103800 2024-04-25T09:11:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.878+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:12 18.24 18:24000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636c00 con 0x55c9de103800 2024-04-25T09:11:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.878+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.0 v2:172.21.15.59:6800/4129855307 5 ==== osd_op_reply(12 [pgnls start_epoch 123 out=49b] v121'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9de103800 2024-04-25T09:11:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.878+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:13 18.14 18:28000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64e000 con 0x55c9dd53bc00 2024-04-25T09:11:42.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.878+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.6 v2:172.21.15.178:6800/2032393933 3 ==== osd_op_reply(13 [pgnls start_epoch 123 out=49b] v121'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9dd53bc00 2024-04-25T09:11:42.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:14 18.34 18:2c000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd637000 con 0x55c9de103800 2024-04-25T09:11:42.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.0 v2:172.21.15.59:6800/4129855307 6 ==== osd_op_reply(14 [pgnls start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9de103800 2024-04-25T09:11:42.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:15 18.c 18:30000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64e400 con 0x55c9dd53b000 2024-04-25T09:11:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.5 v2:172.21.15.178:6802/3576783051 3 ==== osd_op_reply(15 [pgnls start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b000 2024-04-25T09:11:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc1aa00640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55c9de102400 0x55c9dd62d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:16 18.2c 18:34000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636800 con 0x55c9de102400 2024-04-25T09:11:42.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc20e00640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55c9de102400 0x55c9dd62d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc20e00640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55c9de102400 0x55c9dd62d600 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.2 v2:172.21.15.59:6824/4113007731 1 ==== osd_op_reply(16 [pgnls start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9de102400 2024-04-25T09:11:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:17 18.1c 18:38000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64e800 con 0x55c9dd637400 2024-04-25T09:11:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.1 v2:172.21.15.59:6809/1450066050 3 ==== osd_op_reply(17 [pgnls start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd637400 2024-04-25T09:11:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc1aa00640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55c9dd53b400 0x55c9dd62db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:18 18.3c 18:3c000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9ddfb3400 con 0x55c9dd53b400 2024-04-25T09:11:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc20400640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55c9dd53b400 0x55c9dd62db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc20400640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55c9dd53b400 0x55c9dd62db80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== osd_op_reply(18 [pgnls start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd53b400 2024-04-25T09:11:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:19 18.2 18:40000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64ec00 con 0x55c9dd53b400 2024-04-25T09:11:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.7 v2:172.21.15.178:6824/965369534 2 ==== osd_op_reply(19 [pgnls start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd53b400 2024-04-25T09:11:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:20 18.22 18:44000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636400 con 0x55c9dd53b800 2024-04-25T09:11:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 2 ==== osd_op_reply(20 [pgnls start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.882+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:21 18.12 18:48000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64e800 con 0x55c9de102400 2024-04-25T09:11:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.2 v2:172.21.15.59:6824/4113007731 2 ==== osd_op_reply(21 [pgnls start_epoch 123 out=81b] v122'22 uv22 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9de102400 2024-04-25T09:11:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:22 18.12 18:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9de103c00 con 0x55c9de102400 2024-04-25T09:11:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.2 v2:172.21.15.59:6824/4113007731 3 ==== osd_op_reply(22 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9de102400 2024-04-25T09:11:42.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc22ce18c0 10 datascan.operator(): handling object 1099511627778.0 2024-04-25T09:11:42.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:23 18.12 18:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64e400 con 0x55c9de102400 2024-04-25T09:11:42.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.2 v2:172.21.15.59:6824/4113007731 4 ==== osd_op_reply(23 10000000002.00000000 [call] v123'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9de102400 2024-04-25T09:11:42.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:24 18.32 18:4c000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64f000 con 0x55c9dd53b800 2024-04-25T09:11:42.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 3 ==== osd_op_reply(24 [pgnls start_epoch 123 out=81b] v121'16 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:25 18.32 18:4def72d4:::10000000003.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64f400 con 0x55c9dd53b800 2024-04-25T09:11:42.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 4 ==== osd_op_reply(25 10000000003.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc22ce18c0 10 datascan.operator(): handling object 1099511627779.0 2024-04-25T09:11:42.876 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:26 18.32 18:4def72d4:::10000000003.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64f800 con 0x55c9dd53b800 2024-04-25T09:11:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.886+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 5 ==== osd_op_reply(26 10000000003.00000000 [call] v123'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:27 18.a 18:50000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64fc00 con 0x55c9dd53b800 2024-04-25T09:11:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 6 ==== osd_op_reply(27 [pgnls start_epoch 123 out=49b] v121'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc1aa00640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55c9dd637c00 0x55c9dd62e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:28 18.2a 18:54000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636c00 con 0x55c9dd637c00 2024-04-25T09:11:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc21800640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55c9dd637c00 0x55c9dd62e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc21800640 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55c9dd637c00 0x55c9dd62e100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.4 v2:172.21.15.178:6805/2278719369 1 ==== osd_op_reply(28 [pgnls start_epoch 123 out=49b] v121'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd637c00 2024-04-25T09:11:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:29 18.1a 18:58000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64e000 con 0x55c9dd53b800 2024-04-25T09:11:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 7 ==== osd_op_reply(29 [pgnls start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.879 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:30 18.3a 18:5c000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd637000 con 0x55c9de103800 2024-04-25T09:11:42.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.0 v2:172.21.15.59:6800/4129855307 7 ==== osd_op_reply(30 [pgnls start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9de103800 2024-04-25T09:11:42.880 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:31 18.6 18:60000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636000 con 0x55c9dd53b400 2024-04-25T09:11:42.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.7 v2:172.21.15.178:6824/965369534 3 ==== osd_op_reply(31 [pgnls start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd53b400 2024-04-25T09:11:42.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:32 18.26 18:64000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9ddfb3400 con 0x55c9de102400 2024-04-25T09:11:42.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.2 v2:172.21.15.59:6824/4113007731 5 ==== osd_op_reply(32 [pgnls start_epoch 123 out=49b] v121'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9de102400 2024-04-25T09:11:42.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:33 18.16 18:68000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd637800 con 0x55c9dd53b800 2024-04-25T09:11:42.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 8 ==== osd_op_reply(33 [pgnls start_epoch 123 out=49b] v121'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.881 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:34 18.36 18:6c000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636400 con 0x55c9dd637400 2024-04-25T09:11:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.1 v2:172.21.15.59:6809/1450066050 4 ==== osd_op_reply(34 [pgnls start_epoch 123 out=49b] v121'32 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd637400 2024-04-25T09:11:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:35 18.e 18:70000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636800 con 0x55c9de103800 2024-04-25T09:11:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.0 v2:172.21.15.59:6800/4129855307 8 ==== osd_op_reply(35 [pgnls start_epoch 123 out=49b] v121'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9de103800 2024-04-25T09:11:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.890+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:36 18.2e 18:74000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636c00 con 0x55c9dd53b800 2024-04-25T09:11:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 9 ==== osd_op_reply(36 [pgnls start_epoch 123 out=49b] v121'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:37 18.1e 18:78000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd668000 con 0x55c9dd53b000 2024-04-25T09:11:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.5 v2:172.21.15.178:6802/3576783051 4 ==== osd_op_reply(37 [pgnls start_epoch 123 out=49b] v121'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b000 2024-04-25T09:11:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:38 18.3e 18:7c000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64f000 con 0x55c9dd53b800 2024-04-25T09:11:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 10 ==== osd_op_reply(38 [pgnls start_epoch 123 out=49b] v121'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:39 18.1 18:80000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd668400 con 0x55c9dd53b800 2024-04-25T09:11:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 11 ==== osd_op_reply(39 [pgnls start_epoch 123 out=49b] v121'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:40 18.21 18:84000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64f400 con 0x55c9dd53b000 2024-04-25T09:11:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.5 v2:172.21.15.178:6802/3576783051 5 ==== osd_op_reply(40 [pgnls start_epoch 123 out=49b] v121'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b000 2024-04-25T09:11:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:41 18.11 18:88000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd668800 con 0x55c9dd637400 2024-04-25T09:11:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.1 v2:172.21.15.59:6809/1450066050 5 ==== osd_op_reply(41 [pgnls start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd637400 2024-04-25T09:11:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:42 18.31 18:8c000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64f800 con 0x55c9dd637c00 2024-04-25T09:11:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.4 v2:172.21.15.178:6805/2278719369 2 ==== osd_op_reply(42 [pgnls start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd637c00 2024-04-25T09:11:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:43 18.9 18:90000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd668c00 con 0x55c9dd53b800 2024-04-25T09:11:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 12 ==== osd_op_reply(43 [pgnls start_epoch 123 out=49b] v121'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:44 18.29 18:94000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64fc00 con 0x55c9dd53b400 2024-04-25T09:11:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.7 v2:172.21.15.178:6824/965369534 4 ==== osd_op_reply(44 [pgnls start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd53b400 2024-04-25T09:11:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:45 18.19 18:98000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd669000 con 0x55c9dd637c00 2024-04-25T09:11:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.4 v2:172.21.15.178:6805/2278719369 3 ==== osd_op_reply(45 [pgnls start_epoch 123 out=49b] v121'21 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd637c00 2024-04-25T09:11:42.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.894+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:46 18.39 18:9c000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64ec00 con 0x55c9de103800 2024-04-25T09:11:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.0 v2:172.21.15.59:6800/4129855307 9 ==== osd_op_reply(46 [pgnls start_epoch 123 out=49b] v121'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9de103800 2024-04-25T09:11:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:47 18.5 18:a0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd669400 con 0x55c9dd637400 2024-04-25T09:11:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.1 v2:172.21.15.59:6809/1450066050 6 ==== osd_op_reply(47 [pgnls start_epoch 123 out=81b] v122'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd637400 2024-04-25T09:11:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:48 18.5 18:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd668800 con 0x55c9dd637400 2024-04-25T09:11:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.1 v2:172.21.15.59:6809/1450066050 7 ==== osd_op_reply(48 10000000004.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd637400 2024-04-25T09:11:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc22ce18c0 10 datascan.operator(): handling object 1099511627780.0 2024-04-25T09:11:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:49 18.5 18:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd668000 con 0x55c9dd637400 2024-04-25T09:11:42.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.1 v2:172.21.15.59:6809/1450066050 8 ==== osd_op_reply(49 10000000004.00000000 [call] v123'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd637400 2024-04-25T09:11:42.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:50 18.25 18:a4000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd668400 con 0x55c9dd53bc00 2024-04-25T09:11:42.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.6 v2:172.21.15.178:6800/2032393933 4 ==== osd_op_reply(50 [pgnls start_epoch 123 out=81b] v123'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9dd53bc00 2024-04-25T09:11:42.888 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:51 18.25 18:a5feb6f3:::10000000006.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd669800 con 0x55c9dd53bc00 2024-04-25T09:11:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.6 v2:172.21.15.178:6800/2032393933 5 ==== osd_op_reply(51 10000000006.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9dd53bc00 2024-04-25T09:11:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc22ce18c0 10 datascan.operator(): handling object 1099511627782.0 2024-04-25T09:11:42.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.898+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:52 18.25 18:a5feb6f3:::10000000006.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd669c00 con 0x55c9dd53bc00 2024-04-25T09:11:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.6 v2:172.21.15.178:6800/2032393933 6 ==== osd_op_reply(52 10000000006.00000000 [call] v123'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9dd53bc00 2024-04-25T09:11:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:53 18.15 18:a8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64fc00 con 0x55c9dd53b000 2024-04-25T09:11:42.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.5 v2:172.21.15.178:6802/3576783051 6 ==== osd_op_reply(53 [pgnls start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b000 2024-04-25T09:11:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:54 18.35 18:ac000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd637000 con 0x55c9dd637c00 2024-04-25T09:11:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.4 v2:172.21.15.178:6805/2278719369 4 ==== osd_op_reply(54 [pgnls start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd637c00 2024-04-25T09:11:42.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:55 18.d 18:b0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd668400 con 0x55c9dd637c00 2024-04-25T09:11:42.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.4 v2:172.21.15.178:6805/2278719369 5 ==== osd_op_reply(55 [pgnls start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd637c00 2024-04-25T09:11:42.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:56 18.2d 18:b4000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636000 con 0x55c9dd53bc00 2024-04-25T09:11:42.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.6 v2:172.21.15.178:6800/2032393933 7 ==== osd_op_reply(56 [pgnls start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9dd53bc00 2024-04-25T09:11:42.892 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:57 18.1d 18:b8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9ddfb3400 con 0x55c9de103800 2024-04-25T09:11:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.0 v2:172.21.15.59:6800/4129855307 10 ==== osd_op_reply(57 [pgnls start_epoch 123 out=49b] v121'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9de103800 2024-04-25T09:11:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:58 18.3d 18:bc000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636400 con 0x55c9dd53b800 2024-04-25T09:11:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.3 v2:172.21.15.59:6808/3810214969 13 ==== osd_op_reply(58 [pgnls start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b800 2024-04-25T09:11:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:59 18.3 18:c0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64e800 con 0x55c9dd637400 2024-04-25T09:11:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.1 v2:172.21.15.59:6809/1450066050 9 ==== osd_op_reply(59 [pgnls start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd637400 2024-04-25T09:11:42.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.902+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:60 18.23 18:c4000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636800 con 0x55c9de102400 2024-04-25T09:11:42.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.2 v2:172.21.15.59:6824/4113007731 6 ==== osd_op_reply(60 [pgnls start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9de102400 2024-04-25T09:11:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:61 18.13 18:c8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64e400 con 0x55c9dd53b400 2024-04-25T09:11:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.7 v2:172.21.15.178:6824/965369534 5 ==== osd_op_reply(61 [pgnls start_epoch 123 out=49b] v121'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd53b400 2024-04-25T09:11:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:62 18.33 18:cc000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd637800 con 0x55c9dd637400 2024-04-25T09:11:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.1 v2:172.21.15.59:6809/1450066050 10 ==== osd_op_reply(62 [pgnls start_epoch 123 out=49b] v121'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd637400 2024-04-25T09:11:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:63 18.b 18:d0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9de103c00 con 0x55c9dd53b000 2024-04-25T09:11:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.5 v2:172.21.15.178:6802/3576783051 7 ==== osd_op_reply(63 [pgnls start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b000 2024-04-25T09:11:42.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:64 18.2b 18:d4000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636c00 con 0x55c9dd53b400 2024-04-25T09:11:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.7 v2:172.21.15.178:6824/965369534 6 ==== osd_op_reply(64 [pgnls start_epoch 123 out=49b] v121'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd53b400 2024-04-25T09:11:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:65 18.1b 18:d8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9ddfb3400 con 0x55c9dd637400 2024-04-25T09:11:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.1 v2:172.21.15.59:6809/1450066050 11 ==== osd_op_reply(65 [pgnls start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd637400 2024-04-25T09:11:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:66 18.3b 18:dc000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd637000 con 0x55c9dd637c00 2024-04-25T09:11:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.4 v2:172.21.15.178:6805/2278719369 6 ==== osd_op_reply(66 [pgnls start_epoch 123 out=49b] v121'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd637c00 2024-04-25T09:11:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:67 18.7 18:e0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd668c00 con 0x55c9de102400 2024-04-25T09:11:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 <== osd.2 v2:172.21.15.59:6824/4113007731 7 ==== osd_op_reply(67 [pgnls start_epoch 123 out=49b] v121'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe780 con 0x55c9de102400 2024-04-25T09:11:42.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:68 18.27 18:e4000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd636400 con 0x55c9dd53b000 2024-04-25T09:11:42.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.5 v2:172.21.15.178:6802/3576783051 8 ==== osd_op_reply(68 [pgnls start_epoch 123 out=49b] v121'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b000 2024-04-25T09:11:42.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:69 18.17 18:e8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd669000 con 0x55c9dd53b000 2024-04-25T09:11:42.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.5 v2:172.21.15.178:6802/3576783051 9 ==== osd_op_reply(69 [pgnls start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b000 2024-04-25T09:11:42.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:70 18.37 18:ec000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd637800 con 0x55c9dd53b400 2024-04-25T09:11:42.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.7 v2:172.21.15.178:6824/965369534 7 ==== osd_op_reply(70 [pgnls start_epoch 123 out=49b] v121'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd53b400 2024-04-25T09:11:42.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.906+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:71 18.f 18:f0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd668400 con 0x55c9dd53b000 2024-04-25T09:11:42.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.5 v2:172.21.15.178:6802/3576783051 10 ==== osd_op_reply(71 [pgnls start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd53b000 2024-04-25T09:11:42.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:72 18.2f 18:f4000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64f800 con 0x55c9dd637400 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.1 v2:172.21.15.59:6809/1450066050 12 ==== osd_op_reply(72 [pgnls start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd637400 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc1b400640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:73 18.1f 18:f8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd669400 con 0x55c9dd53b400 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc20400640 1 -- 172.21.15.59:0/106867358 <== osd.7 v2:172.21.15.178:6824/965369534 8 ==== osd_op_reply(73 [pgnls start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe000 con 0x55c9dd53b400 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc1aa00640 1 -- 172.21.15.59:0/106867358 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:74 18.3f 18:fc000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55c9dd64fc00 con 0x55c9dd637c00 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc21800640 1 -- 172.21.15.59:0/106867358 <== osd.4 v2:172.21.15.178:6805/2278719369 7 ==== osd_op_reply(74 [pgnls start_epoch 123 out=49b] v121'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c9dd2fe500 con 0x55c9dd637c00 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c9de103800 msgr2=0x55c9dd3aa100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55c9de103800 0x55c9dd3aa100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55c9dd637400 msgr2=0x55c9dd62cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55c9dd637400 0x55c9dd62cb00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55c9de102400 msgr2=0x55c9dd62d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55c9de102400 0x55c9dd62d600 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55c9dd53b800 msgr2=0x55c9dd3a9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55c9dd53b800 0x55c9dd3a9b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.901 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55c9dd637c00 msgr2=0x55c9dd62e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55c9dd637c00 0x55c9dd62e100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55c9dd53b000 msgr2=0x55c9dd62c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55c9dd53b000 0x55c9dd62c000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 reap_dead start 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55c9dd53bc00 msgr2=0x55c9dd62c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55c9dd53bc00 0x55c9dd62c580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55c9dd53b400 msgr2=0x55c9dd62db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55c9dd53b400 0x55c9dd62db80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 reap_dead start 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc20e00640 1 -- 172.21.15.59:0/106867358 reap_dead start 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55c9dd53ac00 msgr2=0x55c9dd3ab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55c9dd53ac00 0x55c9dd3ab700 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x55c9dd2ca150 tx=0x55c9dd290000 comp rx=0 tx=0).stop 2024-04-25T09:11:42.902 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103000 msgr2=0x55c9dd3aac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103000 0x55c9dd3aac00 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x55c9ddfafaa0 tx=0x55c9de0f2e40 comp rx=0 tx=0).stop 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 shutdown_connections 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55c9dd53ac00 0x55c9dd3ab700 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/106867358 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9de103000 0x55c9dd3aac00 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 >> 172.21.15.59:0/106867358 conn(0x55c9dd1eec00 msgr2=0x55c9dd21d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 shutdown_connections 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/106867358 wait complete. 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/2459703455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9dd1ef400 msgr2=0x55c9dd3a8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/2459703455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9dd1ef400 0x55c9dd3a8b00 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x55c9de02fbf0 tx=0x55c9dd2c8ae0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/2459703455 shutdown_connections 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/2459703455 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55c9dd1ef000 0x55c9dd3a9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/2459703455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55c9dd1ef400 0x55c9dd3a8b00 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 --2- 172.21.15.59:0/2459703455 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55c9dd1ef800 0x55c9dd3a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/2459703455 >> 172.21.15.59:0/2459703455 conn(0x55c9dd1efc00 msgr2=0x55c9dd21d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:42.903 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/2459703455 shutdown_connections 2024-04-25T09:11:42.904 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:42.910+0000 7fcc22ce18c0 1 -- 172.21.15.59:0/2459703455 wait complete. 2024-04-25T09:11:42.905 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.140530, result: 2024-04-25T09:11:42.905 DEBUG:teuthology.orchestra.run.smithi059:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-04-25T09:11:42.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 1 -- start start 2024-04-25T09:11:42.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 1 Processor -- start 2024-04-25T09:11:42.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346e589800 0x56346e743b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346e589400 0x56346e743600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346e589000 0x56346e743080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:42.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e686180 con 0x56346e589800 2024-04-25T09:11:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e5e8900 con 0x56346e589000 2024-04-25T09:11:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56346e5e8480 con 0x56346e589400 2024-04-25T09:11:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346e589800 0x56346e743b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346e589800 0x56346e743b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48060/0 (socket says 172.21.15.59:48060) 2024-04-25T09:11:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98e400640 1 -- 172.21.15.59:0/1127120349 learned_addr learned my addr 172.21.15.59:0/1127120349 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98ee00640 1 --2- 172.21.15.59:0/1127120349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346e589000 0x56346e743080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98da00640 1 --2- 172.21.15.59:0/1127120349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346e589400 0x56346e743600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98e400640 1 -- 172.21.15.59:0/1127120349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346e589400 msgr2=0x56346e743600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98e400640 1 --2- 172.21.15.59:0/1127120349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346e589400 0x56346e743600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98e400640 1 -- 172.21.15.59:0/1127120349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346e589000 msgr2=0x56346e743080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98e400640 1 --2- 172.21.15.59:0/1127120349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346e589000 0x56346e743080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98e400640 1 -- 172.21.15.59:0/1127120349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56346e5ae1e0 con 0x56346e589800 2024-04-25T09:11:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98da00640 1 --2- 172.21.15.59:0/1127120349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346e589400 0x56346e743600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98e400640 1 --2- 172.21.15.59:0/1127120349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346e589800 0x56346e743b80 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x56346f3d5890 tx=0x56346e62a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff533fed6804cfc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98b200640 1 -- 172.21.15.59:0/1127120349 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56346e5be9c0 con 0x56346e589800 2024-04-25T09:11:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98b200640 1 -- 172.21.15.59:0/1127120349 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56346e5d21c0 con 0x56346e589800 2024-04-25T09:11:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98b200640 1 -- 172.21.15.59:0/1127120349 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56346e5be4e0 con 0x56346e589800 2024-04-25T09:11:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 1 -- 172.21.15.59:0/1127120349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56346e5af4a0 con 0x56346e589800 2024-04-25T09:11:42.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 1 -- 172.21.15.59:0/1127120349 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56346e5ae3c0 con 0x56346e589800 2024-04-25T09:11:43.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 4 waiting for MDS map... 2024-04-25T09:11:43.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98b200640 1 -- 172.21.15.59:0/1127120349 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x56346f358000 con 0x56346e589800 2024-04-25T09:11:43.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe98b200640 1 -- 172.21.15.59:0/1127120349 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 111) v1 ==== 2723+0+0 (secure 0 0 0) 0x56346e5df180 con 0x56346e589800 2024-04-25T09:11:43.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 4 Got MDS map 111 2024-04-25T09:11:43.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-04-25T09:11:43.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 4 datascan.main: Using metadata pool output 2024-04-25T09:11:43.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.006+0000 7fe9903498c0 4 datascan.main: connecting to RADOS... 2024-04-25T09:11:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 Processor -- start 2024-04-25T09:11:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 -- start start 2024-04-25T09:11:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346f365800 0x56346e742b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346f365c00 0x56346e742580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f50a000 0x56346e744100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e5e8180 con 0x56346f50a000 2024-04-25T09:11:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e686d80 con 0x56346f365c00 2024-04-25T09:11:43.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56346e686f00 con 0x56346f365800 2024-04-25T09:11:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe98da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f50a000 0x56346e744100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe98da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f50a000 0x56346e744100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48070/0 (socket says 172.21.15.59:48070) 2024-04-25T09:11:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe98da00640 1 -- 172.21.15.59:0/4037803528 learned_addr learned my addr 172.21.15.59:0/4037803528 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe98ee00640 1 --2- 172.21.15.59:0/4037803528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346f365800 0x56346e742b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe98e400640 1 --2- 172.21.15.59:0/4037803528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346f365c00 0x56346e742580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe98da00640 1 -- 172.21.15.59:0/4037803528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346f365800 msgr2=0x56346e742b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe98da00640 1 --2- 172.21.15.59:0/4037803528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346f365800 0x56346e742b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe98da00640 1 -- 172.21.15.59:0/4037803528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346f365c00 msgr2=0x56346e742580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:43.006 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe98da00640 1 --2- 172.21.15.59:0/4037803528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346f365c00 0x56346e742580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe98da00640 1 -- 172.21.15.59:0/4037803528 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56346e5ae1e0 con 0x56346f50a000 2024-04-25T09:11:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe98da00640 1 --2- 172.21.15.59:0/4037803528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f50a000 0x56346e744100 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x56346f3487e0 tx=0x56346f4b6c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14dc5d4ecb99f92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe988a00640 1 -- 172.21.15.59:0/4037803528 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56346e5be9c0 con 0x56346f50a000 2024-04-25T09:11:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe988a00640 1 -- 172.21.15.59:0/4037803528 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56346e5d2c40 con 0x56346f50a000 2024-04-25T09:11:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe988a00640 1 -- 172.21.15.59:0/4037803528 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56346e5be4e0 con 0x56346f50a000 2024-04-25T09:11:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 -- 172.21.15.59:0/4037803528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f50a000 msgr2=0x56346e744100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 --2- 172.21.15.59:0/4037803528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f50a000 0x56346e744100 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x56346f3487e0 tx=0x56346f4b6c00 comp rx=0 tx=0).stop 2024-04-25T09:11:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 -- 172.21.15.59:0/4037803528 shutdown_connections 2024-04-25T09:11:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 --2- 172.21.15.59:0/4037803528 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f50a000 0x56346e744100 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 --2- 172.21.15.59:0/4037803528 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346f365c00 0x56346e742580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 --2- 172.21.15.59:0/4037803528 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346f365800 0x56346e742b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 -- 172.21.15.59:0/4037803528 >> 172.21.15.59:0/4037803528 conn(0x56346e588c00 msgr2=0x56346e5b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:43.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 -- 172.21.15.59:0/4037803528 shutdown_connections 2024-04-25T09:11:43.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 -- 172.21.15.59:0/4037803528 wait complete. 2024-04-25T09:11:43.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 Processor -- start 2024-04-25T09:11:43.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.010+0000 7fe9903498c0 1 -- start start 2024-04-25T09:11:43.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe9903498c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346f365c00 0x56346e742b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe9903498c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f365800 0x56346e742580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe9903498c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346f50b800 0x56346e744100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe9903498c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e687200 con 0x56346f365800 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe9903498c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x56346e687080 con 0x56346f50b800 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe9903498c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x56346e687380 con 0x56346f365c00 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe98e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f365800 0x56346e742580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe98e400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f365800 0x56346e742580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48072/0 (socket says 172.21.15.59:48072) 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 learned_addr learned my addr 172.21.15.59:0/3104068677 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe98ee00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346f365c00 0x56346e742b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe98da00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346f50b800 0x56346e744100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346f365c00 msgr2=0x56346e742b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe98e400640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346f365c00 0x56346e742b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346f50b800 msgr2=0x56346e744100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe98e400640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346f50b800 0x56346e744100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56346e5af2c0 con 0x56346f365800 2024-04-25T09:11:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe98e400640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f365800 0x56346e742580 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x56346f3d5cb0 tx=0x56346e62a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe986c00640 1 -- 172.21.15.59:0/3104068677 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56346e5beb60 con 0x56346f365800 2024-04-25T09:11:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe986c00640 1 -- 172.21.15.59:0/3104068677 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56346e5d2e00 con 0x56346f365800 2024-04-25T09:11:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56346e5afa40 con 0x56346f365800 2024-04-25T09:11:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe986c00640 1 -- 172.21.15.59:0/3104068677 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56346e5be340 con 0x56346f365800 2024-04-25T09:11:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56346e5afc20 con 0x56346f365800 2024-04-25T09:11:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe9903498c0 4 datascan.init: resolving metadata pool 17 2024-04-25T09:11:43.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.014+0000 7fe986c00640 1 -- 172.21.15.59:0/3104068677 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x56346e8bac00 con 0x56346f365800 2024-04-25T09:11:43.018 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe986c00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x56346e8c1800 0x56346e9a8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe986c00640 1 -- 172.21.15.59:0/3104068677 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x56346e8b9000 con 0x56346f365800 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe9903498c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe9903498c0 4 datascan.main: data pool 'cephfs_data' has ID 18 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe9903498c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x56346f50b400 0x56346e744680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:1 17.14 17:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50b000 con 0x56346f50b400 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe98ee00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x56346e8c1800 0x56346e9a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe98da00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x56346f50b400 0x56346e744680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe98ee00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x56346e8c1800 0x56346e9a8000 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x56346e664f00 tx=0x56346e9b6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe98da00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x56346f50b400 0x56346e744680 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv33 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x56346f50ac00 0x56346e744c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.019 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:2 17.1f 17:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50a800 con 0x56346f50ac00 2024-04-25T09:11:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe98ee00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x56346f50ac00 0x56346e744c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe98ee00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x56346f50ac00 0x56346e744c00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x56346e698500 con 0x56346f50ac00 2024-04-25T09:11:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x56346f50a400 0x56346e745180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:3 18.0 18:00000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50a000 con 0x56346f50a400 2024-04-25T09:11:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe98e400640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x56346f50a400 0x56346e745180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe98e400640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x56346f50a400 0x56346e745180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe988000640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x56346e8c0400 0x56346e9a8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.018+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:4 18.20 18:04000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50bc00 con 0x56346e8c0400 2024-04-25T09:11:43.020 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe98da00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x56346e8c0400 0x56346e9a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe98da00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x56346e8c0400 0x56346e9a8580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:5 18.10 18:08000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50b000 con 0x56346f50ac00 2024-04-25T09:11:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.6 v2:172.21.15.178:6800/2032393933 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346f50ac00 2024-04-25T09:11:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:6 18.30 18:0c000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e8c0000 con 0x56346f50a400 2024-04-25T09:11:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:7 18.8 18:10000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b8800 con 0x56346f50a400 2024-04-25T09:11:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 3 ==== osd_op_reply(7 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:8 18.28 18:14000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b9000 con 0x56346e8c0400 2024-04-25T09:11:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe988a00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56346e9b8c00 0x56346e9a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.021 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:9 18.18 18:18000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b9c00 con 0x56346e9b8c00 2024-04-25T09:11:43.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe98ee00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56346e9b8c00 0x56346e9a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe98ee00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56346e9b8c00 0x56346e9a8b00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 123 out=49b] v121'17 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9b8c00 2024-04-25T09:11:43.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:10 18.38 18:1c000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b9400 con 0x56346f50b400 2024-04-25T09:11:43.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.022+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:11 18.4 18:20000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b8400 con 0x56346f50a400 2024-04-25T09:11:43.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:12 18.24 18:24000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b9800 con 0x56346f50a400 2024-04-25T09:11:43.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 5 ==== osd_op_reply(12 [pgnls-filter start_epoch 123 out=49b] v121'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:13 18.14 18:28000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b9c00 con 0x56346f50ac00 2024-04-25T09:11:43.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.6 v2:172.21.15.178:6800/2032393933 3 ==== osd_op_reply(13 [pgnls-filter start_epoch 123 out=49b] v121'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346f50ac00 2024-04-25T09:11:43.022 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:14 18.34 18:2c000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e8c1400 con 0x56346f50a400 2024-04-25T09:11:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 6 ==== osd_op_reply(14 [pgnls-filter start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:15 18.c 18:30000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50a800 con 0x56346e8c0400 2024-04-25T09:11:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe988000640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x56346e8c1000 0x56346e9a9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:16 18.2c 18:34000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e8c0000 con 0x56346e8c1000 2024-04-25T09:11:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe98e400640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x56346e8c1000 0x56346e9a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe98e400640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x56346e8c1000 0x56346e9a9080 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.2 v2:172.21.15.59:6824/4113007731 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346e8c1000 2024-04-25T09:11:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:17 18.1c 18:38000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50b000 con 0x56346e9b8c00 2024-04-25T09:11:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.1 v2:172.21.15.59:6809/1450066050 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9b8c00 2024-04-25T09:11:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe988000640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x56346f50a000 0x56346e9a9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.023 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:18 18.3c 18:3c000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b8800 con 0x56346f50a000 2024-04-25T09:11:43.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.026+0000 7fe98da00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x56346f50a000 0x56346e9a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe98da00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x56346f50a000 0x56346e9a9600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== osd_op_reply(18 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50a000 2024-04-25T09:11:43.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:19 18.2 18:40000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b9000 con 0x56346f50a000 2024-04-25T09:11:43.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.7 v2:172.21.15.178:6824/965369534 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50a000 2024-04-25T09:11:43.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:20 18.22 18:44000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b8400 con 0x56346f50b400 2024-04-25T09:11:43.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.024 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:21 18.12 18:48000000::::head [pgnls-filter start_epoch 123 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b9400 con 0x56346e8c1000 2024-04-25T09:11:43.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.2 v2:172.21.15.59:6824/4113007731 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 123 out=81b] v123'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56346e698780 con 0x56346e8c1000 2024-04-25T09:11:43.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:22 18.0 18:00000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e6000 con 0x56346f50a400 2024-04-25T09:11:43.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 7 ==== osd_op_reply(22 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:23 18.20 18:04000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b8800 con 0x56346e8c0400 2024-04-25T09:11:43.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 4 ==== osd_op_reply(23 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:24 18.10 18:08000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e8000 con 0x56346f50ac00 2024-04-25T09:11:43.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.6 v2:172.21.15.178:6800/2032393933 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346f50ac00 2024-04-25T09:11:43.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:25 18.30 18:0c000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50bc00 con 0x56346f50a400 2024-04-25T09:11:43.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 8 ==== osd_op_reply(25 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:26 18.8 18:10000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e8400 con 0x56346f50a400 2024-04-25T09:11:43.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 9 ==== osd_op_reply(26 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:27 18.28 18:14000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50a800 con 0x56346e8c0400 2024-04-25T09:11:43.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 5 ==== osd_op_reply(27 [pgnls-filter start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.030+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:28 18.18 18:18000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e8800 con 0x56346e9b8c00 2024-04-25T09:11:43.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.1 v2:172.21.15.59:6809/1450066050 3 ==== osd_op_reply(28 [pgnls-filter start_epoch 123 out=49b] v121'17 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9b8c00 2024-04-25T09:11:43.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:29 18.38 18:1c000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50bc00 con 0x56346f50b400 2024-04-25T09:11:43.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 4 ==== osd_op_reply(29 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:30 18.4 18:20000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e8c00 con 0x56346f50a400 2024-04-25T09:11:43.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 10 ==== osd_op_reply(30 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:31 18.24 18:24000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e6000 con 0x56346f50a400 2024-04-25T09:11:43.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 11 ==== osd_op_reply(31 [pgnls-filter start_epoch 123 out=49b] v121'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:32 18.14 18:28000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e9000 con 0x56346f50ac00 2024-04-25T09:11:43.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.6 v2:172.21.15.178:6800/2032393933 5 ==== osd_op_reply(32 [pgnls-filter start_epoch 123 out=49b] v121'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346f50ac00 2024-04-25T09:11:43.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:33 18.34 18:2c000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b9800 con 0x56346f50a400 2024-04-25T09:11:43.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 12 ==== osd_op_reply(33 [pgnls-filter start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:34 18.c 18:30000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e9400 con 0x56346e8c0400 2024-04-25T09:11:43.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 6 ==== osd_op_reply(34 [pgnls-filter start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:35 18.2c 18:34000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b9400 con 0x56346e8c1000 2024-04-25T09:11:43.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.2 v2:172.21.15.59:6824/4113007731 3 ==== osd_op_reply(35 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346e8c1000 2024-04-25T09:11:43.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:36 18.1c 18:38000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50a800 con 0x56346e9b8c00 2024-04-25T09:11:43.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.1 v2:172.21.15.59:6809/1450066050 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9b8c00 2024-04-25T09:11:43.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:37 18.3c 18:3c000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e8c1400 con 0x56346f50a000 2024-04-25T09:11:43.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.7 v2:172.21.15.178:6824/965369534 3 ==== osd_op_reply(37 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50a000 2024-04-25T09:11:43.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:38 18.2 18:40000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50bc00 con 0x56346f50a000 2024-04-25T09:11:43.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.7 v2:172.21.15.178:6824/965369534 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50a000 2024-04-25T09:11:43.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.034+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:39 18.22 18:44000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e8c0000 con 0x56346f50b400 2024-04-25T09:11:43.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:40 18.12 18:48000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50b000 con 0x56346e8c1000 2024-04-25T09:11:43.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.2 v2:172.21.15.59:6824/4113007731 4 ==== osd_op_reply(40 [pgnls-filter start_epoch 123 out=49b] v123'23 uv23 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346e8c1000 2024-04-25T09:11:43.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:41 18.32 18:4c000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e9400 con 0x56346f50b400 2024-04-25T09:11:43.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 6 ==== osd_op_reply(41 [pgnls-filter start_epoch 123 out=81b] v123'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 20 datascan.forall_objects: OSD matched oid 10000000003.00000000 2024-04-25T09:11:43.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 10 datascan.operator(): handling object 10000000003.0 2024-04-25T09:11:43.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:42 18.32 18:4def72d4:::10000000003.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e6800 con 0x56346f50b400 2024-04-25T09:11:43.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 7 ==== osd_op_reply(42 10000000003.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+194 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 10 datascan.inject_with_backtrace: inode: 0x0x10000000003 2024-04-25T09:11:43.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-04-25T09:11:43.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-04-25T09:11:43.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:43 17.7 17:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e6c00 con 0x56346f50a400 2024-04-25T09:11:43.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 13 ==== osd_op_reply(43 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-04-25T09:11:43.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:44 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e7000 con 0x56346f50b400 2024-04-25T09:11:43.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 8 ==== osd_op_reply(44 10000000000.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+524 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-04-25T09:11:43.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2024-04-25T09:11:43.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 20 datascan.get_frag_of: frag is * 2024-04-25T09:11:43.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:45 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e7400 con 0x56346f50a400 2024-04-25T09:11:43.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 14 ==== osd_op_reply(45 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 10 datascan.find_or_create_dirfrag: read_version = 8 2024-04-25T09:11:43.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-04-25T09:11:43.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:46 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e7800 con 0x56346f50a400 2024-04-25T09:11:43.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 15 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-25T09:11:43.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 20 datascan.read_dentry: bravo_head not found in result 2024-04-25T09:11:43.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000003 at 0x0x10000000001/bravo with size=5 bytes 2024-04-25T09:11:43.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.038+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:47 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e7c00 con 0x56346f50a400 2024-04-25T09:11:43.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 16 ==== osd_op_reply(47 10000000001.00000000 [omap-set-vals] v123'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe9903498c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x10000000003 2024-04-25T09:11:43.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:48 18.a 18:50000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e6000 con 0x56346f50b400 2024-04-25T09:11:43.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 9 ==== osd_op_reply(48 [pgnls-filter start_epoch 123 out=49b] v121'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe988a00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x56346e9e8000 0x56346e9a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:49 18.2a 18:54000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e8800 con 0x56346e9e8000 2024-04-25T09:11:43.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe98ee00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x56346e9e8000 0x56346e9a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe98ee00640 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x56346e9e8000 0x56346e9a9b80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.4 v2:172.21.15.178:6805/2278719369 1 ==== osd_op_reply(49 [pgnls-filter start_epoch 123 out=49b] v121'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9e8000 2024-04-25T09:11:43.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:50 18.1a 18:58000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b9000 con 0x56346f50b400 2024-04-25T09:11:43.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 10 ==== osd_op_reply(50 [pgnls-filter start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:51 18.3a 18:5c000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e9000 con 0x56346f50a400 2024-04-25T09:11:43.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 17 ==== osd_op_reply(51 [pgnls-filter start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:52 18.6 18:60000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b8400 con 0x56346f50a000 2024-04-25T09:11:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.7 v2:172.21.15.178:6824/965369534 5 ==== osd_op_reply(52 [pgnls-filter start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50a000 2024-04-25T09:11:43.051 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:53 18.26 18:64000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e8400 con 0x56346e8c1000 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.2 v2:172.21.15.59:6824/4113007731 5 ==== osd_op_reply(53 [pgnls-filter start_epoch 123 out=49b] v121'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346e8c1000 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:54 18.16 18:68000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b8800 con 0x56346f50b400 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 11 ==== osd_op_reply(54 [pgnls-filter start_epoch 123 out=49b] v121'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:55 18.36 18:6c000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e9800 con 0x56346e9b8c00 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.042+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.1 v2:172.21.15.59:6809/1450066050 5 ==== osd_op_reply(55 [pgnls-filter start_epoch 123 out=49b] v121'32 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9b8c00 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:56 18.e 18:70000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b9c00 con 0x56346f50a400 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 18 ==== osd_op_reply(56 [pgnls-filter start_epoch 123 out=49b] v121'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:57 18.2e 18:74000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e9c00 con 0x56346f50b400 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 12 ==== osd_op_reply(57 [pgnls-filter start_epoch 123 out=49b] v121'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:58 18.1e 18:78000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e7800 con 0x56346e8c0400 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 7 ==== osd_op_reply(58 [pgnls-filter start_epoch 123 out=49b] v121'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:59 18.3e 18:7c000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea02000 con 0x56346f50b400 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 13 ==== osd_op_reply(59 [pgnls-filter start_epoch 123 out=49b] v121'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:60 18.1 18:80000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e6800 con 0x56346f50b400 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 14 ==== osd_op_reply(60 [pgnls-filter start_epoch 123 out=49b] v121'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.052 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:61 18.21 18:84000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea02400 con 0x56346e8c0400 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 8 ==== osd_op_reply(61 [pgnls-filter start_epoch 123 out=49b] v121'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:62 18.11 18:88000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e6400 con 0x56346e9b8c00 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.1 v2:172.21.15.59:6809/1450066050 6 ==== osd_op_reply(62 [pgnls-filter start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9b8c00 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:63 18.31 18:8c000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea02800 con 0x56346e9e8000 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.4 v2:172.21.15.178:6805/2278719369 2 ==== osd_op_reply(63 [pgnls-filter start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9e8000 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:64 18.9 18:90000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e7000 con 0x56346f50b400 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 15 ==== osd_op_reply(64 [pgnls-filter start_epoch 123 out=49b] v121'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:65 18.29 18:94000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea02c00 con 0x56346f50a000 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.7 v2:172.21.15.178:6824/965369534 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50a000 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.046+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:66 18.19 18:98000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e6000 con 0x56346e9e8000 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.4 v2:172.21.15.178:6805/2278719369 3 ==== osd_op_reply(66 [pgnls-filter start_epoch 123 out=49b] v121'21 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9e8000 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:67 18.39 18:9c000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea03000 con 0x56346f50a400 2024-04-25T09:11:43.053 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 19 ==== osd_op_reply(67 [pgnls-filter start_epoch 123 out=49b] v121'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:68 18.5 18:a0000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e7800 con 0x56346e9b8c00 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.1 v2:172.21.15.59:6809/1450066050 7 ==== osd_op_reply(68 [pgnls-filter start_epoch 123 out=49b] v123'12 uv12 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9b8c00 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:69 18.25 18:a4000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea03400 con 0x56346f50ac00 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.6 v2:172.21.15.178:6800/2032393933 6 ==== osd_op_reply(69 [pgnls-filter start_epoch 123 out=49b] v123'17 uv17 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346f50ac00 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:70 18.15 18:a8000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e6800 con 0x56346e8c0400 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 9 ==== osd_op_reply(70 [pgnls-filter start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:71 18.35 18:ac000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea03800 con 0x56346e9e8000 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.4 v2:172.21.15.178:6805/2278719369 4 ==== osd_op_reply(71 [pgnls-filter start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9e8000 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:72 18.d 18:b0000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea02000 con 0x56346e9e8000 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.4 v2:172.21.15.178:6805/2278719369 5 ==== osd_op_reply(72 [pgnls-filter start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9e8000 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:73 18.2d 18:b4000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea03c00 con 0x56346f50ac00 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.6 v2:172.21.15.178:6800/2032393933 7 ==== osd_op_reply(73 [pgnls-filter start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346f50ac00 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:74 18.1d 18:b8000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e9c00 con 0x56346f50a400 2024-04-25T09:11:43.054 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.0 v2:172.21.15.59:6800/4129855307 20 ==== osd_op_reply(74 [pgnls-filter start_epoch 123 out=49b] v121'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346f50a400 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:75 18.3d 18:bc000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e6400 con 0x56346f50b400 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.3 v2:172.21.15.59:6808/3810214969 16 ==== osd_op_reply(75 [pgnls-filter start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50b400 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:76 18.3 18:c0000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b9000 con 0x56346e9b8c00 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.1 v2:172.21.15.59:6809/1450066050 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9b8c00 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.050+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:77 18.23 18:c4000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e6000 con 0x56346e8c1000 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.2 v2:172.21.15.59:6824/4113007731 6 ==== osd_op_reply(77 [pgnls-filter start_epoch 123 out=49b] v121'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346e8c1000 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:78 18.13 18:c8000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b8400 con 0x56346f50a000 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.7 v2:172.21.15.178:6824/965369534 7 ==== osd_op_reply(78 [pgnls-filter start_epoch 123 out=49b] v121'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50a000 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:79 18.33 18:cc000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea02800 con 0x56346e9b8c00 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.1 v2:172.21.15.59:6809/1450066050 9 ==== osd_op_reply(79 [pgnls-filter start_epoch 123 out=49b] v121'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9b8c00 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:80 18.b 18:d0000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b8800 con 0x56346e8c0400 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 10 ==== osd_op_reply(80 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:81 18.2b 18:d4000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e8800 con 0x56346f50a000 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.7 v2:172.21.15.178:6824/965369534 8 ==== osd_op_reply(81 [pgnls-filter start_epoch 123 out=49b] v121'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50a000 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:82 18.1b 18:d8000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea03400 con 0x56346e9b8c00 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.1 v2:172.21.15.59:6809/1450066050 10 ==== osd_op_reply(82 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9b8c00 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:83 18.3b 18:dc000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e9800 con 0x56346e9e8000 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.4 v2:172.21.15.178:6805/2278719369 6 ==== osd_op_reply(83 [pgnls-filter start_epoch 123 out=49b] v121'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9e8000 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:84 18.7 18:e0000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea03800 con 0x56346e8c1000 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe98e400640 1 -- 172.21.15.59:0/3104068677 <== osd.2 v2:172.21.15.59:6824/4113007731 7 ==== osd_op_reply(84 [pgnls-filter start_epoch 123 out=49b] v121'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698780 con 0x56346e8c1000 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.054+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:85 18.27 18:e4000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50a800 con 0x56346e8c0400 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 11 ==== osd_op_reply(85 [pgnls-filter start_epoch 123 out=49b] v121'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:86 18.17 18:e8000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea02000 con 0x56346e8c0400 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 12 ==== osd_op_reply(86 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:87 18.37 18:ec000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346f50a800 con 0x56346f50a000 2024-04-25T09:11:43.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.7 v2:172.21.15.178:6824/965369534 9 ==== osd_op_reply(87 [pgnls-filter start_epoch 123 out=49b] v121'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50a000 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:88 18.f 18:f0000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea03c00 con 0x56346e8c0400 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.5 v2:172.21.15.178:6802/3576783051 13 ==== osd_op_reply(88 [pgnls-filter start_epoch 123 out=49b] v121'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346e8c0400 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:89 18.2f 18:f4000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9e8800 con 0x56346e9b8c00 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.1 v2:172.21.15.59:6809/1450066050 11 ==== osd_op_reply(89 [pgnls-filter start_epoch 123 out=49b] v121'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9b8c00 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe988000640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:90 18.1f 18:f8000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346ea02800 con 0x56346f50a000 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 <== osd.7 v2:172.21.15.178:6824/965369534 10 ==== osd_op_reply(90 [pgnls-filter start_epoch 123 out=49b] v121'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698000 con 0x56346f50a000 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe988a00640 1 -- 172.21.15.59:0/3104068677 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:91 18.3f 18:fc000000::::head [pgnls-filter start_epoch 123 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x56346e9b8400 con 0x56346e9e8000 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe98ee00640 1 -- 172.21.15.59:0/3104068677 <== osd.4 v2:172.21.15.178:6805/2278719369 7 ==== osd_op_reply(91 [pgnls-filter start_epoch 123 out=49b] v121'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56346e698500 con 0x56346e9e8000 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x56346f50a400 msgr2=0x56346e745180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x56346f50a400 0x56346e745180 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56346e9b8c00 msgr2=0x56346e9a8b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x56346e9b8c00 0x56346e9a8b00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x56346e8c1000 msgr2=0x56346e9a9080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x56346e8c1000 0x56346e9a9080 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x56346f50b400 msgr2=0x56346e744680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x56346f50b400 0x56346e744680 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x56346e9e8000 msgr2=0x56346e9a9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 reap_dead start 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x56346e9e8000 0x56346e9a9b80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 reap_dead start 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x56346e8c0400 msgr2=0x56346e9a8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x56346e8c0400 0x56346e9a8580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x56346f50ac00 msgr2=0x56346e744c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x56346f50ac00 0x56346e744c00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x56346f50a000 msgr2=0x56346e9a9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x56346f50a000 0x56346e9a9600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x56346e8c1800 msgr2=0x56346e9a8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.058 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x56346e8c1800 0x56346e9a8000 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x56346e664f00 tx=0x56346e9b6000 comp rx=0 tx=0).stop 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f365800 msgr2=0x56346e742580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/3104068677 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346f365800 0x56346e742580 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x56346f3d5cb0 tx=0x56346e62a4e0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe98da00640 1 -- 172.21.15.59:0/3104068677 reap_dead start 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 shutdown_connections 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 >> 172.21.15.59:0/3104068677 conn(0x56346e588c00 msgr2=0x56346e5b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 shutdown_connections 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/3104068677 wait complete. 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/1127120349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346e589800 msgr2=0x56346e743b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/1127120349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346e589800 0x56346e743b80 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x56346f3d5890 tx=0x56346e62a000 comp rx=0 tx=0).stop 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/1127120349 shutdown_connections 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/1127120349 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x56346e589000 0x56346e743080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/1127120349 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x56346e589400 0x56346e743600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 --2- 172.21.15.59:0/1127120349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x56346e589800 0x56346e743b80 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/1127120349 >> 172.21.15.59:0/1127120349 conn(0x56346e589c00 msgr2=0x56346e5b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:43.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/1127120349 shutdown_connections 2024-04-25T09:11:43.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.058+0000 7fe9903498c0 1 -- 172.21.15.59:0/1127120349 wait complete. 2024-04-25T09:11:43.060 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.155253, result: 2024-04-25T09:11:43.061 DEBUG:teuthology.orchestra.run.smithi059:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-25T09:11:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 1 -- start start 2024-04-25T09:11:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 1 Processor -- start 2024-04-25T09:11:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1839c1800 0x55e183b7a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1839c1400 0x55e183b7ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e1839c1000 0x55e183b7b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e18478c180 con 0x55e1839c1400 2024-04-25T09:11:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e18478c300 con 0x55e1839c1800 2024-04-25T09:11:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e18478c480 con 0x55e1839c1000 2024-04-25T09:11:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef3a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1839c1400 0x55e183b7ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef3a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1839c1400 0x55e183b7ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48084/0 (socket says 172.21.15.59:48084) 2024-04-25T09:11:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef3a00640 1 -- 172.21.15.59:0/3990413506 learned_addr learned my addr 172.21.15.59:0/3990413506 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef4400640 1 --2- 172.21.15.59:0/3990413506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1839c1800 0x55e183b7a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.105 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef4e00640 1 --2- 172.21.15.59:0/3990413506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e1839c1000 0x55e183b7b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef3a00640 1 -- 172.21.15.59:0/3990413506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e1839c1000 msgr2=0x55e183b7b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/3990413506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e1839c1000 0x55e183b7b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef3a00640 1 -- 172.21.15.59:0/3990413506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1839c1800 msgr2=0x55e183b7a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/3990413506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1839c1800 0x55e183b7a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef3a00640 1 -- 172.21.15.59:0/3990413506 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1839e61e0 con 0x55e1839c1400 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef4400640 1 --2- 172.21.15.59:0/3990413506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1839c1800 0x55e183b7a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/3990413506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1839c1400 0x55e183b7ab00 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x55e184809830 tx=0x55e183abe000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91bdb81cb6102ec6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef1200640 1 -- 172.21.15.59:0/3990413506 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e1839f69c0 con 0x55e1839c1400 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef1200640 1 -- 172.21.15.59:0/3990413506 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e183a0ae00 con 0x55e1839c1400 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef1200640 1 -- 172.21.15.59:0/3990413506 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e1839f64e0 con 0x55e1839c1400 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/3990413506 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1839e74a0 con 0x55e1839c1400 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/3990413506 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e1839e63c0 con 0x55e1839c1400 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 4 waiting for MDS map... 2024-04-25T09:11:43.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef1200640 1 -- 172.21.15.59:0/3990413506 <== mon.0 v2:172.21.15.59:3300/0 4 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x55e1848d8200 con 0x55e1839c1400 2024-04-25T09:11:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef1200640 1 -- 172.21.15.59:0/3990413506 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 111) v1 ==== 2723+0+0 (secure 0 0 0) 0x55e183a17180 con 0x55e1839c1400 2024-04-25T09:11:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 4 Got MDS map 111 2024-04-25T09:11:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 4 datascan.main: Using metadata pool output 2024-04-25T09:11:43.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.114+0000 7f8ef62a78c0 4 datascan.main: connecting to RADOS... 2024-04-25T09:11:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 Processor -- start 2024-04-25T09:11:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 -- start start 2024-04-25T09:11:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e184799800 0x55e183b7b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e184799c00 0x55e183b7bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184934000 0x55e183b7c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e18478c600 con 0x55e184934000 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e18478c780 con 0x55e184799c00 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e18478c900 con 0x55e184799800 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef3a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184934000 0x55e183b7c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef4400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e184799c00 0x55e183b7bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef3a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184934000 0x55e183b7c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48090/0 (socket says 172.21.15.59:48090) 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef3a00640 1 -- 172.21.15.59:0/4016053982 learned_addr learned my addr 172.21.15.59:0/4016053982 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef4e00640 1 --2- 172.21.15.59:0/4016053982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e184799800 0x55e183b7b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef3a00640 1 -- 172.21.15.59:0/4016053982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e184799800 msgr2=0x55e183b7b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/4016053982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e184799800 0x55e183b7b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef3a00640 1 -- 172.21.15.59:0/4016053982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e184799c00 msgr2=0x55e183b7bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/4016053982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e184799c00 0x55e183b7bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef3a00640 1 -- 172.21.15.59:0/4016053982 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1839e61e0 con 0x55e184934000 2024-04-25T09:11:43.110 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/4016053982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184934000 0x55e183b7c100 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x55e184809d10 tx=0x55e183abe3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbac673fb8af0a52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8eeea00640 1 -- 172.21.15.59:0/4016053982 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e1839f6b60 con 0x55e184934000 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8eeea00640 1 -- 172.21.15.59:0/4016053982 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e183a0ac40 con 0x55e184934000 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8eeea00640 1 -- 172.21.15.59:0/4016053982 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e1839f6340 con 0x55e184934000 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/4016053982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184934000 msgr2=0x55e183b7c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/4016053982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184934000 0x55e183b7c100 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x55e184809d10 tx=0x55e183abe3c0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/4016053982 shutdown_connections 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/4016053982 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184934000 0x55e183b7c100 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/4016053982 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e184799c00 0x55e183b7bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/4016053982 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e184799800 0x55e183b7b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/4016053982 >> 172.21.15.59:0/4016053982 conn(0x55e1839c0c00 msgr2=0x55e1839ef800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/4016053982 shutdown_connections 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/4016053982 wait complete. 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 Processor -- start 2024-04-25T09:11:43.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.118+0000 7f8ef62a78c0 1 -- start start 2024-04-25T09:11:43.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef62a78c0 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e184799c00 0x55e183b7d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef62a78c0 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184799800 0x55e183b7cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef62a78c0 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e184935800 0x55e183b7c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef62a78c0 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e18478d500 con 0x55e184799800 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef62a78c0 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e18478ca80 con 0x55e184935800 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef62a78c0 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e18478d680 con 0x55e184799c00 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef4e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e184799c00 0x55e183b7d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef4400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184799800 0x55e183b7cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef4e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e184799c00 0x55e183b7d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:51722/0 (socket says 172.21.15.59:51722) 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 learned_addr learned my addr 172.21.15.59:0/1096388176 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef3a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e184935800 0x55e183b7c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e184799c00 msgr2=0x55e183b7d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef4400640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e184799c00 0x55e183b7d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e184935800 msgr2=0x55e183b7c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef4400640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e184935800 0x55e183b7c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e1839e72c0 con 0x55e184799800 2024-04-25T09:11:43.115 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef4e00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e184799c00 0x55e183b7d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e184935800 0x55e183b7c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef4400640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184799800 0x55e183b7cc00 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x55e184787d40 tx=0x55e1848c8c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8eecc00640 1 -- 172.21.15.59:0/1096388176 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e1839f6b60 con 0x55e184799800 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8eecc00640 1 -- 172.21.15.59:0/1096388176 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e183a0aa80 con 0x55e184799800 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8eecc00640 1 -- 172.21.15.59:0/1096388176 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e1839f6340 con 0x55e184799800 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e1839e7a40 con 0x55e184799800 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e1839e7c20 con 0x55e184799800 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8ef62a78c0 4 datascan.init: resolving metadata pool 17 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8eecc00640 1 -- 172.21.15.59:0/1096388176 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x55e183cf0c00 con 0x55e184799800 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8eecc00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55e183cf3000 0x55e183b7d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.122+0000 7f8eecc00640 1 -- 172.21.15.59:0/1096388176 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x55e184937000 con 0x55e184799800 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef62a78c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef62a78c0 4 datascan.main: resolving metadata pool 17 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55e184935400 0x55e183b7c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e184935000 con 0x55e184935400 2024-04-25T09:11:43.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef4e00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55e183cf3000 0x55e183b7d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55e184935400 0x55e183b7c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef4e00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55e183cf3000 0x55e183b7d700 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x55e184787c50 tx=0x55e183de2000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55e184935400 0x55e183b7c100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== osd_op_reply(1 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55e184935000 0x55e183de8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:2 17.10 17:08000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e184799400 con 0x55e184935000 2024-04-25T09:11:43.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef4e00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55e184935000 0x55e183de8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef4e00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55e184935000 0x55e183de8000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 1 ==== osd_op_reply(2 [pgnls start_epoch 123 out=177b] v122'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:3 17.8 17:10000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e184799400 con 0x55e184935400 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 2 ==== osd_op_reply(3 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55e184799400 0x55e183de8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:4 17.18 17:18000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183cf3c00 con 0x55e184799400 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef4400640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55e184799400 0x55e183de8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.126+0000 7f8ef4400640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55e184799400 0x55e183de8580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== osd_op_reply(4 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:5 17.4 17:20000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183cf3c00 con 0x55e184799400 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 2 ==== osd_op_reply(5 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:6 17.14 17:28000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183cf3c00 con 0x55e184935000 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 2 ==== osd_op_reply(6 [pgnls start_epoch 123 out=149b] v123'40 uv40 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:7 17.c 17:30000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183cf3c00 con 0x55e184935400 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 3 ==== osd_op_reply(7 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55e183cf3c00 0x55e183de8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:8 17.1c 17:38000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0000 con 0x55e183cf3c00 2024-04-25T09:11:43.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55e183cf3c00 0x55e183de8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55e183cf3c00 0x55e183de8b00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== osd_op_reply(8 [pgnls start_epoch 123 out=73b] v122'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55e183a74000 con 0x55e183cf3c00 2024-04-25T09:11:43.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55e183de0000 0x55e183de9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:9 17.2 17:40000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0400 con 0x55e183de0000 2024-04-25T09:11:43.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef4e00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55e183de0000 0x55e183de9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef4e00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55e183de0000 0x55e183de9080 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.4 v2:172.21.15.178:6805/2278719369 1 ==== osd_op_reply(9 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74500 con 0x55e183de0000 2024-04-25T09:11:43.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.130+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:10 17.12 17:48000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0400 con 0x55e184935000 2024-04-25T09:11:43.122 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 3 ==== osd_op_reply(10 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:11 17.a 17:50000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0400 con 0x55e184935400 2024-04-25T09:11:43.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 4 ==== osd_op_reply(11 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:12 17.1a 17:58000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0400 con 0x55e184799400 2024-04-25T09:11:43.123 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 3 ==== osd_op_reply(12 [pgnls start_epoch 123 out=49b] v123'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef4400640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55e183de0400 0x55e183dea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:13 17.6 17:60000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de1800 con 0x55e183de0400 2024-04-25T09:11:43.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef4400640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55e183de0400 0x55e183dea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef4400640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55e183de0400 0x55e183dea100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== osd_op_reply(13 [pgnls start_epoch 123 out=77b] v122'10 uv10 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55e183a74780 con 0x55e183de0400 2024-04-25T09:11:43.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef4400640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55e183de1800 0x55e183dea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.124 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:14 17.16 17:68000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de1c00 con 0x55e183de1800 2024-04-25T09:11:43.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55e183de1800 0x55e183dea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55e183de1800 0x55e183dea680 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.5 v2:172.21.15.178:6802/3576783051 1 ==== osd_op_reply(14 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e183de1800 2024-04-25T09:11:43.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef3a00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55e183de1c00 0x55e183de9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:15 17.e 17:70000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e183de1c00 2024-04-25T09:11:43.125 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.134+0000 7f8ef4e00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55e183de1c00 0x55e183de9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef4e00640 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55e183de1c00 0x55e183de9600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.2 v2:172.21.15.59:6824/4113007731 1 ==== osd_op_reply(15 [pgnls start_epoch 123 out=73b] v122'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55e183a74500 con 0x55e183de1c00 2024-04-25T09:11:43.126 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:16 17.1e 17:78000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e183cf3c00 2024-04-25T09:11:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.1 v2:172.21.15.59:6809/1450066050 2 ==== osd_op_reply(16 [pgnls start_epoch 123 out=49b] v123'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e183cf3c00 2024-04-25T09:11:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:17 17.1 17:80000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e184799400 2024-04-25T09:11:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 4 ==== osd_op_reply(17 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:18 17.11 17:88000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e184935000 2024-04-25T09:11:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 4 ==== osd_op_reply(18 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.127 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:19 17.9 17:90000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e184935000 2024-04-25T09:11:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 5 ==== osd_op_reply(19 [pgnls start_epoch 123 out=81b] v122'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:20 17.19 17:98000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e183de1800 2024-04-25T09:11:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.5 v2:172.21.15.178:6802/3576783051 2 ==== osd_op_reply(20 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e183de1800 2024-04-25T09:11:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:21 17.5 17:a0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e183de0400 2024-04-25T09:11:43.128 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.6 v2:172.21.15.178:6800/2032393933 2 ==== osd_op_reply(21 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74780 con 0x55e183de0400 2024-04-25T09:11:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:22 17.15 17:a8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e183de1800 2024-04-25T09:11:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.5 v2:172.21.15.178:6802/3576783051 3 ==== osd_op_reply(22 [pgnls start_epoch 123 out=97b] v122'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55e183a74000 con 0x55e183de1800 2024-04-25T09:11:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:23 17.d 17:b0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e184935400 2024-04-25T09:11:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 5 ==== osd_op_reply(23 [pgnls start_epoch 123 out=74b] v120'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:24 17.1d 17:b8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e184935400 2024-04-25T09:11:43.129 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 6 ==== osd_op_reply(24 [pgnls start_epoch 123 out=73b] v122'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.138+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:25 17.3 17:c0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e183de0000 2024-04-25T09:11:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.4 v2:172.21.15.178:6805/2278719369 2 ==== osd_op_reply(25 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74500 con 0x55e183de0000 2024-04-25T09:11:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:26 17.13 17:c8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e184935000 2024-04-25T09:11:43.130 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 6 ==== osd_op_reply(26 [pgnls start_epoch 123 out=98b] v122'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:27 17.b 17:d0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e184799400 2024-04-25T09:11:43.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 5 ==== osd_op_reply(27 [pgnls start_epoch 123 out=76b] v123'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:28 17.1b 17:d8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e183de0000 2024-04-25T09:11:43.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.4 v2:172.21.15.178:6805/2278719369 3 ==== osd_op_reply(28 [pgnls start_epoch 123 out=49b] v123'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74500 con 0x55e183de0000 2024-04-25T09:11:43.131 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:29 17.7 17:e0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e184799400 2024-04-25T09:11:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 6 ==== osd_op_reply(29 [pgnls start_epoch 123 out=105b] v123'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:30 17.17 17:e8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e183de0400 2024-04-25T09:11:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.6 v2:172.21.15.178:6800/2032393933 3 ==== osd_op_reply(30 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74780 con 0x55e183de0400 2024-04-25T09:11:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:31 17.f 17:f0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e183cf3c00 2024-04-25T09:11:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.1 v2:172.21.15.59:6809/1450066050 3 ==== osd_op_reply(31 [pgnls start_epoch 123 out=73b] v123'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55e183a74000 con 0x55e183cf3c00 2024-04-25T09:11:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:32 17.1f 17:f8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183de0800 con 0x55e183de0400 2024-04-25T09:11:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.6 v2:172.21.15.178:6800/2032393933 4 ==== osd_op_reply(32 [pgnls start_epoch 123 out=101b] v123'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55e183a74780 con 0x55e183de0400 2024-04-25T09:11:43.132 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-25T09:11:43.133 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:33 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e184934c00 con 0x55e184935000 2024-04-25T09:11:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 7 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-25T09:11:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:34 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e184934800 con 0x55e184935000 2024-04-25T09:11:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 8 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-25T09:11:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:35 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e184934400 con 0x55e184935000 2024-04-25T09:11:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 9 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1047b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1047 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.142+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:36 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e184934000 con 0x55e184935000 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 10 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:37 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e184934c00 con 0x55e184935000 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 11 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:38 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e184934800 con 0x55e184935000 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 12 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv35 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-25T09:11:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:39 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e184934400 con 0x55e183cf3c00 2024-04-25T09:11:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.1 v2:172.21.15.59:6809/1450066050 4 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74000 con 0x55e183cf3c00 2024-04-25T09:11:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-25T09:11:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T09:11:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-25T09:11:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:40 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e184934000 con 0x55e183de1c00 2024-04-25T09:11:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.2 v2:172.21.15.59:6824/4113007731 2 ==== osd_op_reply(40 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74500 con 0x55e183de1c00 2024-04-25T09:11:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 10000000005.00000000 2024-04-25T09:11:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:41 17.9 17:9258b67d:::10000000005.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0e000 con 0x55e184935000 2024-04-25T09:11:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 13 ==== osd_op_reply(41 10000000005.00000000 [omap-get-vals out=531b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+531 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-25T09:11:43.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:42 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0e400 con 0x55e183de1800 2024-04-25T09:11:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.5 v2:172.21.15.178:6802/3576783051 4 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74000 con 0x55e183de1800 2024-04-25T09:11:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-25T09:11:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T09:11:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-25T09:11:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T09:11:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-25T09:11:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:43 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0e800 con 0x55e184935400 2024-04-25T09:11:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 7 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-25T09:11:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T09:11:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-25T09:11:43.140 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:44 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0ec00 con 0x55e184935000 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 14 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:45 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184799400 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 7 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.146+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:46 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f400 con 0x55e184799400 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 8 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1561b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1561 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef62a78c0 20 datascan.scan_links: injected ino detected 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T09:11:43.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef62a78c0 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:47 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f800 con 0x55e183de0400 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.6 v2:172.21.15.178:6800/2032393933 5 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=524b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+524 (crc 0 0 0) 0x55e183a74780 con 0x55e183de0400 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:48 17.0 17:00000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0fc00 con 0x55e184935400 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 8 ==== osd_op_reply(48 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:49 17.10 17:08000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0fc00 con 0x55e184935000 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 15 ==== osd_op_reply(49 [pgnls start_epoch 123 out=177b] v122'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:50 17.8 17:10000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0fc00 con 0x55e184935400 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 9 ==== osd_op_reply(50 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:51 17.18 17:18000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0fc00 con 0x55e184799400 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 9 ==== osd_op_reply(51 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:52 17.4 17:20000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184799400 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 10 ==== osd_op_reply(52 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:53 17.14 17:28000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184935000 2024-04-25T09:11:43.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 16 ==== osd_op_reply(53 [pgnls start_epoch 123 out=149b] v123'40 uv40 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:54 17.c 17:30000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184935400 2024-04-25T09:11:43.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 10 ==== osd_op_reply(54 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:55 17.1c 17:38000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183cf3c00 2024-04-25T09:11:43.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.1 v2:172.21.15.59:6809/1450066050 5 ==== osd_op_reply(55 [pgnls start_epoch 123 out=73b] v122'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55e183a74000 con 0x55e183cf3c00 2024-04-25T09:11:43.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.150+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:56 17.2 17:40000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183de0000 2024-04-25T09:11:43.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.4 v2:172.21.15.178:6805/2278719369 4 ==== osd_op_reply(56 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74500 con 0x55e183de0000 2024-04-25T09:11:43.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:57 17.12 17:48000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184935000 2024-04-25T09:11:43.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 17 ==== osd_op_reply(57 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:58 17.a 17:50000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184935400 2024-04-25T09:11:43.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 11 ==== osd_op_reply(58 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:59 17.1a 17:58000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184799400 2024-04-25T09:11:43.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 11 ==== osd_op_reply(59 [pgnls start_epoch 123 out=49b] v123'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:60 17.6 17:60000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183de0400 2024-04-25T09:11:43.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.6 v2:172.21.15.178:6800/2032393933 6 ==== osd_op_reply(60 [pgnls start_epoch 123 out=77b] v122'10 uv10 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55e183a74780 con 0x55e183de0400 2024-04-25T09:11:43.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:61 17.16 17:68000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183de1800 2024-04-25T09:11:43.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.5 v2:172.21.15.178:6802/3576783051 5 ==== osd_op_reply(61 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e183de1800 2024-04-25T09:11:43.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:62 17.e 17:70000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183de1c00 2024-04-25T09:11:43.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.2 v2:172.21.15.59:6824/4113007731 3 ==== osd_op_reply(62 [pgnls start_epoch 123 out=73b] v122'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55e183a74500 con 0x55e183de1c00 2024-04-25T09:11:43.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:63 17.1e 17:78000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183cf3c00 2024-04-25T09:11:43.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.1 v2:172.21.15.59:6809/1450066050 6 ==== osd_op_reply(63 [pgnls start_epoch 123 out=49b] v123'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e183cf3c00 2024-04-25T09:11:43.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:64 17.1 17:80000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184799400 2024-04-25T09:11:43.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 12 ==== osd_op_reply(64 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:65 17.11 17:88000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184935000 2024-04-25T09:11:43.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 18 ==== osd_op_reply(65 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:66 17.9 17:90000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184935000 2024-04-25T09:11:43.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 19 ==== osd_op_reply(66 [pgnls start_epoch 123 out=81b] v122'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.154+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:67 17.19 17:98000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183de1800 2024-04-25T09:11:43.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.5 v2:172.21.15.178:6802/3576783051 6 ==== osd_op_reply(67 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74000 con 0x55e183de1800 2024-04-25T09:11:43.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183de0400 2024-04-25T09:11:43.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.6 v2:172.21.15.178:6800/2032393933 7 ==== osd_op_reply(68 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74780 con 0x55e183de0400 2024-04-25T09:11:43.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:69 17.15 17:a8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183de1800 2024-04-25T09:11:43.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.5 v2:172.21.15.178:6802/3576783051 7 ==== osd_op_reply(69 [pgnls start_epoch 123 out=97b] v122'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55e183a74000 con 0x55e183de1800 2024-04-25T09:11:43.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:70 17.d 17:b0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184935400 2024-04-25T09:11:43.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 12 ==== osd_op_reply(70 [pgnls start_epoch 123 out=74b] v120'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:71 17.1d 17:b8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184935400 2024-04-25T09:11:43.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 13 ==== osd_op_reply(71 [pgnls start_epoch 123 out=73b] v122'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:72 17.3 17:c0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183de0000 2024-04-25T09:11:43.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.4 v2:172.21.15.178:6805/2278719369 5 ==== osd_op_reply(72 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74500 con 0x55e183de0000 2024-04-25T09:11:43.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:73 17.13 17:c8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184935000 2024-04-25T09:11:43.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 20 ==== osd_op_reply(73 [pgnls start_epoch 123 out=98b] v122'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:74 17.b 17:d0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184799400 2024-04-25T09:11:43.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 13 ==== osd_op_reply(74 [pgnls start_epoch 123 out=76b] v123'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.149 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.158+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- osd_op(unknown.0.0:75 17.1b 17:d8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183de0000 2024-04-25T09:11:43.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.4 v2:172.21.15.178:6805/2278719369 6 ==== osd_op_reply(75 [pgnls start_epoch 123 out=49b] v123'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74500 con 0x55e183de0000 2024-04-25T09:11:43.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:76 17.7 17:e0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e184799400 2024-04-25T09:11:43.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 14 ==== osd_op_reply(76 [pgnls start_epoch 123 out=105b] v123'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:77 17.17 17:e8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183de0400 2024-04-25T09:11:43.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.6 v2:172.21.15.178:6800/2032393933 8 ==== osd_op_reply(77 [pgnls start_epoch 123 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e183a74780 con 0x55e183de0400 2024-04-25T09:11:43.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:78 17.f 17:f0000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183cf3c00 2024-04-25T09:11:43.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.1 v2:172.21.15.59:6809/1450066050 7 ==== osd_op_reply(78 [pgnls start_epoch 123 out=73b] v123'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55e183a74000 con 0x55e183cf3c00 2024-04-25T09:11:43.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:79 17.1f 17:f8000000::::head [pgnls start_epoch 123 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f000 con 0x55e183de0400 2024-04-25T09:11:43.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.6 v2:172.21.15.178:6800/2032393933 9 ==== osd_op_reply(79 [pgnls start_epoch 123 out=101b] v123'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55e183a74780 con 0x55e183de0400 2024-04-25T09:11:43.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-25T09:11:43.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:80 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f400 con 0x55e184935000 2024-04-25T09:11:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 21 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-25T09:11:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:81 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f800 con 0x55e184935000 2024-04-25T09:11:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 22 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-25T09:11:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:82 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0fc00 con 0x55e184935000 2024-04-25T09:11:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 23 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1047b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1047 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:83 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0e000 con 0x55e184935000 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 24 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.162+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:84 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0ec00 con 0x55e184935000 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 25 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:85 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e14000 con 0x55e184935000 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 26 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv35 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-25T09:11:43.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- osd_op(unknown.0.0:86 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e14400 con 0x55e183cf3c00 2024-04-25T09:11:43.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.1 v2:172.21.15.59:6809/1450066050 8 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74000 con 0x55e183cf3c00 2024-04-25T09:11:43.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-25T09:11:43.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-25T09:11:43.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-25T09:11:43.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- osd_op(unknown.0.0:87 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e14800 con 0x55e183de1c00 2024-04-25T09:11:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.2 v2:172.21.15.59:6824/4113007731 4 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74500 con 0x55e183de1c00 2024-04-25T09:11:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 10000000005.00000000 2024-04-25T09:11:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:88 17.9 17:9258b67d:::10000000005.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e14c00 con 0x55e184935000 2024-04-25T09:11:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 27 ==== osd_op_reply(88 10000000005.00000000 [omap-get-vals out=531b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+531 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- osd_op(unknown.0.0:89 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e15000 con 0x55e183de1800 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.5 v2:172.21.15.178:6802/3576783051 8 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74000 con 0x55e183de1800 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:90 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e15400 con 0x55e184935400 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 14 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:91 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e15800 con 0x55e184935000 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 28 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-25T09:11:43.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-25T09:11:43.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-25T09:11:43.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:92 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e15c00 con 0x55e184799400 2024-04-25T09:11:43.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 15 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-04-25T09:11:43.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:93 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e14400 con 0x55e184799400 2024-04-25T09:11:43.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 16 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1561b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1561 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 20 datascan.scan_links: injected ino detected 2024-04-25T09:11:43.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 20 datascan.scan_links: adding 0x10000000003 for future processing to fix dnfirst 2024-04-25T09:11:43.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-25T09:11:43.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-25T09:11:43.160 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.166+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- osd_op(unknown.0.0:94 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e15000 con 0x55e183de0400 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.6 v2:172.21.15.178:6800/2032393933 10 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=524b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+524 (crc 0 0 0) 0x55e183a74780 con 0x55e183de0400 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 10 datascan.scan_links: processing 1 injected_inos 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 10 datascan.scan_links: handling injected_ino 0x10000000003 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:95 17.7 17:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e14000 con 0x55e184799400 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 17 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.161 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-25T09:11:43.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 20 datascan.scan_links: first is now 2 2024-04-25T09:11:43.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- osd_op(unknown.0.0:96 17.7 17:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0e400 con 0x55e184799400 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 <== osd.0 v2:172.21.15.59:6800/4129855307 18 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v123'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e183a74780 con 0x55e184799400 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x10000000003 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 10 datascan.scan_links: updating inotable 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- osd_op(unknown.0.0:97 17.13 17:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0e800 con 0x55e184935000 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef4e00640 1 -- 172.21.15.59:0/1096388176 <== osd.3 v2:172.21.15.59:6808/3810214969 29 ==== osd_op_reply(97 mds0_inotable [read 0~34 out=34b] v0'0 uv4 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x55e183a74500 con 0x55e184935000 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 10 datascan.scan_links: updating snaptable 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- osd_op(unknown.0.0:98 17.d 17:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e123) v9 -- 0x55e183e0f400 con 0x55e184935400 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef3a00640 1 -- 172.21.15.59:0/1096388176 <== osd.7 v2:172.21.15.178:6824/965369534 15 ==== osd_op_reply(98 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55e183a74000 con 0x55e184935400 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55e184799400 msgr2=0x55e183de8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x55e184799400 0x55e183de8580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55e183cf3c00 msgr2=0x55e183de8b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x55e183cf3c00 0x55e183de8b00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55e183de1c00 msgr2=0x55e183de9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.164 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x55e183de1c00 0x55e183de9600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55e184935000 msgr2=0x55e183de8000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x55e184935000 0x55e183de8000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55e183de0000 msgr2=0x55e183de9080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x55e183de0000 0x55e183de9080 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55e183de1800 msgr2=0x55e183dea680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x55e183de1800 0x55e183dea680 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 reap_dead start 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55e183de0400 msgr2=0x55e183dea100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x55e183de0400 0x55e183dea100 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef4400640 1 -- 172.21.15.59:0/1096388176 reap_dead start 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55e184935400 msgr2=0x55e183b7c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55e184935400 0x55e183b7c100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55e183cf3000 msgr2=0x55e183b7d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55e183cf3000 0x55e183b7d700 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x55e184787c50 tx=0x55e183de2000 comp rx=0 tx=0).stop 2024-04-25T09:11:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184799800 msgr2=0x55e183b7cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184799800 0x55e183b7cc00 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x55e184787d40 tx=0x55e1848c8c00 comp rx=0 tx=0).stop 2024-04-25T09:11:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 shutdown_connections 2024-04-25T09:11:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x55e184935400 0x55e183b7c100 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x55e183cf3000 0x55e183b7d700 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/1096388176 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e184799800 0x55e183b7cc00 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 >> 172.21.15.59:0/1096388176 conn(0x55e1839c0c00 msgr2=0x55e1839ef800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 shutdown_connections 2024-04-25T09:11:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/1096388176 wait complete. 2024-04-25T09:11:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/3990413506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1839c1400 msgr2=0x55e183b7ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/3990413506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1839c1400 0x55e183b7ab00 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x55e184809830 tx=0x55e183abe000 comp rx=0 tx=0).stop 2024-04-25T09:11:43.166 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/3990413506 shutdown_connections 2024-04-25T09:11:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/3990413506 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55e1839c1000 0x55e183b7b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/3990413506 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e1839c1400 0x55e183b7ab00 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 --2- 172.21.15.59:0/3990413506 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55e1839c1800 0x55e183b7a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.170+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/3990413506 >> 172.21.15.59:0/3990413506 conn(0x55e1839c1c00 msgr2=0x55e1839ef000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.174+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/3990413506 shutdown_connections 2024-04-25T09:11:43.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.174+0000 7f8ef62a78c0 1 -- 172.21.15.59:0/3990413506 wait complete. 2024-04-25T09:11:43.168 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.107210, result: 2024-04-25T09:11:43.169 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:11:43.212 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2024-04-25T09:11:43.253 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2024-04-25T09:11:43.254 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.254 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:11:43.254 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2024-04-25T09:11:43.254 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.254 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:11:43.254 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:11:43.254 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.254 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2024-04-25T09:11:43.254 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.254 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2024-04-25T09:11:43.254 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2024-04-25T09:11:43.255 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on skipped message = False 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:11:43.256 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.257 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2024-04-25T09:11:43.257 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2024-04-25T09:11:43.257 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.257 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2024-04-25T09:11:43.257 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2024-04-25T09:11:43.257 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2024-04-25T09:11:43.257 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug trim objects = true 2024-04-25T09:11:43.257 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.257 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2024-04-25T09:11:43.257 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2024-04-25T09:11:43.257 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.257 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2024-04-25T09:11:43.258 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:43.259 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2024-04-25T09:11:43.260 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.261 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = "" 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2024-04-25T09:11:43.262 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds balancer = 20 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = False 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-04-25T09:11:43.263 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.264 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:11:43.265 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.59,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.266 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug trim objects = true 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.267 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2024-04-25T09:11:43.268 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 20 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 20 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 10 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-04-25T09:11:43.269 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:43.270 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2024-04-25T09:11:43.271 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2024-04-25T09:11:43.272 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2024-04-25T09:11:43.273 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2024-04-25T09:11:43.273 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds balancer = 20 2024-04-25T09:11:43.273 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:43.273 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2024-04-25T09:11:43.273 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = False 2024-04-25T09:11:43.273 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2024-04-25T09:11:43.273 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = True 2024-04-25T09:11:43.273 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-04-25T09:11:43.273 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-04-25T09:11:43.273 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-04-25T09:11:43.275 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:11:43.324 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T09:11:43.364 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2024-04-25T09:11:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2024-04-25T09:11:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:11:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2024-04-25T09:11:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2024-04-25T09:11:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2024-04-25T09:11:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2024-04-25T09:11:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2024-04-25T09:11:43.364 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2024-04-25T09:11:43.365 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:11:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:11:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2024-04-25T09:11:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:11:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2024-04-25T09:11:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:11:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:11:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2024-04-25T09:11:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:11:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2024-04-25T09:11:43.366 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.59,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on skipped message = False 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2024-04-25T09:11:43.367 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug trim objects = true 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.368 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 20 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 20 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 10 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2024-04-25T09:11:43.369 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.370 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:11:43.371 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2024-04-25T09:11:43.372 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2024-04-25T09:11:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2024-04-25T09:11:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:11:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:11:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2024-04-25T09:11:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2024-04-25T09:11:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = "" 2024-04-25T09:11:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-04-25T09:11:43.373 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-04-25T09:11:43.373 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2024-04-25T09:11:43.373 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2024-04-25T09:11:43.374 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2024-04-25T09:11:43.374 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2024-04-25T09:11:43.374 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2024-04-25T09:11:43.374 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2024-04-25T09:11:43.374 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2024-04-25T09:11:43.374 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2024-04-25T09:11:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2024-04-25T09:11:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds balancer = 20 2024-04-25T09:11:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2024-04-25T09:11:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2024-04-25T09:11:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2024-04-25T09:11:43.374 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2024-04-25T09:11:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2024-04-25T09:11:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2024-04-25T09:11:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2024-04-25T09:11:43.375 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2024-04-25T09:11:43.375 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2024-04-25T09:11:43.375 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2024-04-25T09:11:43.375 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.376 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2024-04-25T09:11:43.377 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2024-04-25T09:11:43.378 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2024-04-25T09:11:43.378 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T09:11:43.378 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T09:11:43.378 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2024-04-25T09:11:43.378 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.378 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T09:11:43.378 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.378 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2024-04-25T09:11:43.378 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.378 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2024-04-25T09:11:43.378 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.379 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2024-04-25T09:11:43.379 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2024-04-25T09:11:43.379 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2024-04-25T09:11:43.379 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.59,172.21.15.178,[v2:172.21.15.178:3301,v1:172.21.15.178:6790]" 2024-04-25T09:11:43.379 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on skipped message = False 2024-04-25T09:11:43.379 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = fbbb9dc0-22e4-4685-972c-77e9262d4773 2024-04-25T09:11:43.379 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.379 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2024-04-25T09:11:43.379 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2024-04-25T09:11:43.379 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.379 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2024-04-25T09:11:43.379 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug trim objects = true 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2024-04-25T09:11:43.380 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2024-04-25T09:11:43.381 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 20 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 20 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 10 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2024-04-25T09:11:43.382 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2024-04-25T09:11:43.383 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2024-04-25T09:11:43.384 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: mon op complaint time = 120 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: client mount timeout = 600 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: debug client = 20 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = "" 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-04-25T09:11:43.385 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.a] 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.c] 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.b] 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout:[mds.d] 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout:[mds] 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds = 20 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout: debug mds balancer = 20 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug frag = True 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout: mds debug scatterstat = True 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout: mds op complaint time = 180 2024-04-25T09:11:43.386 INFO:teuthology.orchestra.run.smithi178.stdout: mds verify scatter = True 2024-04-25T09:11:43.387 INFO:teuthology.orchestra.run.smithi178.stdout: osd op complaint time = 180 2024-04-25T09:11:43.387 INFO:teuthology.orchestra.run.smithi178.stdout: rados mon op timeout = 900 2024-04-25T09:11:43.387 INFO:teuthology.orchestra.run.smithi178.stdout: rados osd op timeout = 900 2024-04-25T09:11:43.388 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-25T09:11:43.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.582+0000 7fbb8b600640 1 Processor -- start 2024-04-25T09:11:43.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.582+0000 7fbb8b600640 1 -- start start 2024-04-25T09:11:43.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.582+0000 7fbb8b600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb8415dc60 0x7fbb840d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.582+0000 7fbb8b600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb8406bf30 0x7fbb840cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.582+0000 7fbb8b600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8415e040 con 0x7fbb84099a60 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.582+0000 7fbb8b600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb840cff80 con 0x7fbb8406bf30 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.582+0000 7fbb8b600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb840d0260 con 0x7fbb8415dc60 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.582+0000 7fbb83e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb8406bf30 0x7fbb840cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.582+0000 7fbb89600640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fbb84099a60 0x7fbb840cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47972/0 (socket says 172.21.15.59:47972) 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.582+0000 7fbb89600640 1 -- 172.21.15.59:0/2891755184 learned_addr learned my addr 172.21.15.59:0/2891755184 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.582+0000 7fbb83e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbb8406bf30 0x7fbb840cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48100/0 (socket says 172.21.15.59:48100) 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb88c00640 1 --2- 172.21.15.59:0/2891755184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb8415dc60 0x7fbb840d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb83e00640 1 -- 172.21.15.59:0/2891755184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb8415dc60 msgr2=0x7fbb840d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb83e00640 1 --2- 172.21.15.59:0/2891755184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb8415dc60 0x7fbb840d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb83e00640 1 -- 172.21.15.59:0/2891755184 >> v1:172.21.15.59:6789/0 conn(0x7fbb84099a60 legacy=0x7fbb840cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.574 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb83e00640 1 -- 172.21.15.59:0/2891755184 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb840d0540 con 0x7fbb8406bf30 2024-04-25T09:11:43.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb83e00640 1 --2- 172.21.15.59:0/2891755184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb8406bf30 0x7fbb840cf8a0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fbb700097c0 tx=0x7fbb7001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6bb8be94ad1b6a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb83400640 1 -- 172.21.15.59:0/2891755184 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700b1070 con 0x7fbb8406bf30 2024-04-25T09:11:43.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb83400640 1 -- 172.21.15.59:0/2891755184 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb700a8050 con 0x7fbb8406bf30 2024-04-25T09:11:43.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb83400640 1 -- 172.21.15.59:0/2891755184 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700ac860 con 0x7fbb8406bf30 2024-04-25T09:11:43.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb8b600640 1 -- 172.21.15.59:0/2891755184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb8406bf30 msgr2=0x7fbb840cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb8b600640 1 --2- 172.21.15.59:0/2891755184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb8406bf30 0x7fbb840cf8a0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fbb700097c0 tx=0x7fbb7001c3e0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb8b600640 1 -- 172.21.15.59:0/2891755184 shutdown_connections 2024-04-25T09:11:43.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb8b600640 1 --2- 172.21.15.59:0/2891755184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb8406bf30 0x7fbb840cf8a0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb8b600640 1 --2- 172.21.15.59:0/2891755184 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb8415dc60 0x7fbb840d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb8b600640 1 -- 172.21.15.59:0/2891755184 >> 172.21.15.59:0/2891755184 conn(0x7fbb840b3200 msgr2=0x7fbb840b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:43.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb8b600640 1 -- 172.21.15.59:0/2891755184 shutdown_connections 2024-04-25T09:11:43.578 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.586+0000 7fbb8b600640 1 -- 172.21.15.59:0/2891755184 wait complete. 2024-04-25T09:11:43.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb8b600640 1 Processor -- start 2024-04-25T09:11:43.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb8b600640 1 -- start start 2024-04-25T09:11:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb8b600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb8406bf30 0x7fbb8409ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb8b600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb84099a60 0x7fbb840caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb8b600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb8415dc60 0x7fbb840cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb8b600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8409a280 con 0x7fbb84099a60 2024-04-25T09:11:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb8b600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb840cc880 con 0x7fbb8406bf30 2024-04-25T09:11:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb8b600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8415bf80 con 0x7fbb8415dc60 2024-04-25T09:11:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb83e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb84099a60 0x7fbb840caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb83e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb84099a60 0x7fbb840caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48106/0 (socket says 172.21.15.59:48106) 2024-04-25T09:11:43.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb83e00640 1 -- 172.21.15.59:0/3110015300 learned_addr learned my addr 172.21.15.59:0/3110015300 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:43.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb88c00640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb8406bf30 0x7fbb8409ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb89600640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb8415dc60 0x7fbb840cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb83e00640 1 -- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb8415dc60 msgr2=0x7fbb840cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb83e00640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb8415dc60 0x7fbb840cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb83e00640 1 -- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb8406bf30 msgr2=0x7fbb8409ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:43.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb83e00640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb8406bf30 0x7fbb8409ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:43.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb83e00640 1 -- 172.21.15.59:0/3110015300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8415c260 con 0x7fbb84099a60 2024-04-25T09:11:43.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.590+0000 7fbb83e00640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb84099a60 0x7fbb840caca0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fbb700af040 tx=0x7fbb70019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.594+0000 7fbb80c00640 1 -- 172.21.15.59:0/3110015300 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700b1040 con 0x7fbb84099a60 2024-04-25T09:11:43.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.594+0000 7fbb80c00640 1 -- 172.21.15.59:0/3110015300 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb700bb070 con 0x7fbb84099a60 2024-04-25T09:11:43.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.594+0000 7fbb80c00640 1 -- 172.21.15.59:0/3110015300 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700b5650 con 0x7fbb84099a60 2024-04-25T09:11:43.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.594+0000 7fbb8b600640 1 -- 172.21.15.59:0/3110015300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8415c540 con 0x7fbb84099a60 2024-04-25T09:11:43.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.594+0000 7fbb8b600640 1 -- 172.21.15.59:0/3110015300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8415cb00 con 0x7fbb84099a60 2024-04-25T09:11:43.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.594+0000 7fbb8b600640 1 -- 172.21.15.59:0/3110015300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb840745d0 con 0x7fbb84099a60 2024-04-25T09:11:43.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.594+0000 7fbb80c00640 1 -- 172.21.15.59:0/3110015300 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fbb700b57f0 con 0x7fbb84099a60 2024-04-25T09:11:43.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.594+0000 7fbb80c00640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb64066f60 0x7fbb64069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:43.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.594+0000 7fbb80c00640 1 -- 172.21.15.59:0/3110015300 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fbb7011eff0 con 0x7fbb84099a60 2024-04-25T09:11:43.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.594+0000 7fbb88c00640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb64066f60 0x7fbb64069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:43.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.594+0000 7fbb88c00640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb64066f60 0x7fbb64069420 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fbb8415d0e0 tx=0x7fbb78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:43.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.598+0000 7fbb80c00640 1 -- 172.21.15.59:0/3110015300 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fbb70016090 con 0x7fbb84099a60 2024-04-25T09:11:43.787 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:43.798+0000 7fbb8b600640 1 -- 172.21.15.59:0/3110015300 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fbb840b7590 con 0x7fbb84099a60 2024-04-25T09:11:44.667 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.678+0000 7fbb80c00640 1 -- 172.21.15.59:0/3110015300 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v113) v1 ==== 162+0+0 (secure 0 0 0) 0x7fbb700ef6f0 con 0x7fbb84099a60 2024-04-25T09:11:44.668 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-25T09:11:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.682+0000 7fbb8b600640 1 -- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb64066f60 msgr2=0x7fbb64069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.682+0000 7fbb8b600640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb64066f60 0x7fbb64069420 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fbb8415d0e0 tx=0x7fbb78008040 comp rx=0 tx=0).stop 2024-04-25T09:11:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.682+0000 7fbb8b600640 1 -- 172.21.15.59:0/3110015300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb84099a60 msgr2=0x7fbb840caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.682+0000 7fbb8b600640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb84099a60 0x7fbb840caca0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fbb700af040 tx=0x7fbb70019180 comp rx=0 tx=0).stop 2024-04-25T09:11:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.682+0000 7fbb8b600640 1 -- 172.21.15.59:0/3110015300 shutdown_connections 2024-04-25T09:11:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.682+0000 7fbb8b600640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fbb64066f60 0x7fbb64069420 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.682+0000 7fbb8b600640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fbb8415dc60 0x7fbb840cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.682+0000 7fbb8b600640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbb84099a60 0x7fbb840caca0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.682+0000 7fbb8b600640 1 --2- 172.21.15.59:0/3110015300 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fbb8406bf30 0x7fbb8409ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.682+0000 7fbb8b600640 1 -- 172.21.15.59:0/3110015300 >> 172.21.15.59:0/3110015300 conn(0x7fbb840b3200 msgr2=0x7fbb840cbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:44.671 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.682+0000 7fbb8b600640 1 -- 172.21.15.59:0/3110015300 shutdown_connections 2024-04-25T09:11:44.672 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.682+0000 7fbb8b600640 1 -- 172.21.15.59:0/3110015300 wait complete. 2024-04-25T09:11:44.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:44.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.854+0000 7f3d82800640 1 Processor -- start 2024-04-25T09:11:44.844 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.854+0000 7f3d82800640 1 -- start start 2024-04-25T09:11:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.854+0000 7f3d82800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3d7c15b2f0 0x7f3d7c0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.854+0000 7f3d82800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d7c0b2dc0 0x7f3d7c0b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.854+0000 7f3d82800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d7c06dad0 0x7f3d7c06dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.854+0000 7f3d82800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7c15def0 con 0x7f3d7c06dad0 2024-04-25T09:11:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.854+0000 7f3d82800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7c15e1b0 con 0x7f3d7c15b2f0 2024-04-25T09:11:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.854+0000 7f3d82800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c15e490 con 0x7f3d7c0b2dc0 2024-04-25T09:11:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d7c06dad0 0x7f3d7c06dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d7c06dad0 0x7f3d7c06dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48112/0 (socket says 172.21.15.59:48112) 2024-04-25T09:11:44.846 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7be00640 1 -- 172.21.15.59:0/1132661118 learned_addr learned my addr 172.21.15.59:0/1132661118 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d73e00640 1 --2- 172.21.15.59:0/1132661118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d7c0b2dc0 0x7f3d7c0b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7b400640 1 --2- 172.21.15.59:0/1132661118 >> v2:172.21.15.178:3300/0 conn(0x7f3d7c15b2f0 0x7f3d7c0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7be00640 1 -- 172.21.15.59:0/1132661118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d7c0b2dc0 msgr2=0x7f3d7c0b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7be00640 1 --2- 172.21.15.59:0/1132661118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d7c0b2dc0 0x7f3d7c0b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7be00640 1 -- 172.21.15.59:0/1132661118 >> v2:172.21.15.178:3300/0 conn(0x7f3d7c15b2f0 msgr2=0x7f3d7c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7be00640 1 --2- 172.21.15.59:0/1132661118 >> v2:172.21.15.178:3300/0 conn(0x7f3d7c15b2f0 0x7f3d7c0b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7be00640 1 -- 172.21.15.59:0/1132661118 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c15e770 con 0x7f3d7c06dad0 2024-04-25T09:11:44.847 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7b400640 1 --2- 172.21.15.59:0/1132661118 >> v2:172.21.15.178:3300/0 conn(0x7f3d7c15b2f0 0x7f3d7c0b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:44.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7be00640 1 --2- 172.21.15.59:0/1132661118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c06dad0 0x7f3d7c06dfa0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009e50 tx=0x7f3d7401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69ab62f53f56eab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:44.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7aa00640 1 -- 172.21.15.59:0/1132661118 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c15b8e0 con 0x7f3d7c06dad0 2024-04-25T09:11:44.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7aa00640 1 -- 172.21.15.59:0/1132661118 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d740a55a0 con 0x7f3d7c06dad0 2024-04-25T09:11:44.849 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.858+0000 7f3d7aa00640 1 -- 172.21.15.59:0/1132661118 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d740a5970 con 0x7f3d7c06dad0 2024-04-25T09:11:44.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 -- 172.21.15.59:0/1132661118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c06dad0 msgr2=0x7f3d7c06dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:44.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 --2- 172.21.15.59:0/1132661118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c06dad0 0x7f3d7c06dfa0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f3d74009e50 tx=0x7f3d7401c700 comp rx=0 tx=0).stop 2024-04-25T09:11:44.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 -- 172.21.15.59:0/1132661118 shutdown_connections 2024-04-25T09:11:44.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 --2- 172.21.15.59:0/1132661118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c06dad0 0x7f3d7c06dfa0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:44.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 --2- 172.21.15.59:0/1132661118 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d7c0b2dc0 0x7f3d7c0b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:44.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 --2- 172.21.15.59:0/1132661118 >> v2:172.21.15.178:3300/0 conn(0x7f3d7c15b2f0 0x7f3d7c0b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:44.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 -- 172.21.15.59:0/1132661118 >> 172.21.15.59:0/1132661118 conn(0x7f3d7c0b23b0 msgr2=0x7f3d7c0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:44.850 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 -- 172.21.15.59:0/1132661118 shutdown_connections 2024-04-25T09:11:44.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 -- 172.21.15.59:0/1132661118 wait complete. 2024-04-25T09:11:44.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 Processor -- start 2024-04-25T09:11:44.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 -- start start 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c06dad0 0x7f3d7c152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d7c0b2dc0 0x7f3d7c14c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d7c15b2f0 0x7f3d7c14bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c06ac10 con 0x7f3d7c06dad0 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c1616f0 con 0x7f3d7c0b2dc0 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d82800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c06ad90 con 0x7f3d7c15b2f0 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d7b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c06dad0 0x7f3d7c152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d7b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c06dad0 0x7f3d7c152340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48118/0 (socket says 172.21.15.59:48118) 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d7b400640 1 -- 172.21.15.59:0/3157970525 learned_addr learned my addr 172.21.15.59:0/3157970525 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d73e00640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d7c0b2dc0 0x7f3d7c14c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d7be00640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d7c15b2f0 0x7f3d7c14bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d7b400640 1 -- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d7c15b2f0 msgr2=0x7f3d7c14bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:44.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d7b400640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d7c15b2f0 0x7f3d7c14bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:44.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d7b400640 1 -- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d7c0b2dc0 msgr2=0x7f3d7c14c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:44.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d7b400640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d7c0b2dc0 0x7f3d7c14c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:44.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.862+0000 7f3d7b400640 1 -- 172.21.15.59:0/3157970525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c14d910 con 0x7f3d7c06dad0 2024-04-25T09:11:44.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.866+0000 7f3d7b400640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c06dad0 0x7f3d7c152340 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00d800 tx=0x7f3d6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:44.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.866+0000 7f3d73400640 1 -- 172.21.15.59:0/3157970525 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c00b6c0 con 0x7f3d7c06dad0 2024-04-25T09:11:44.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.866+0000 7f3d73400640 1 -- 172.21.15.59:0/3157970525 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c019070 con 0x7f3d7c06dad0 2024-04-25T09:11:44.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.866+0000 7f3d73400640 1 -- 172.21.15.59:0/3157970525 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c00baa0 con 0x7f3d7c06dad0 2024-04-25T09:11:44.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.866+0000 7f3d82800640 1 -- 172.21.15.59:0/3157970525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7c14cd90 con 0x7f3d7c06dad0 2024-04-25T09:11:44.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.866+0000 7f3d82800640 1 -- 172.21.15.59:0/3157970525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7c14d350 con 0x7f3d7c06dad0 2024-04-25T09:11:44.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.866+0000 7f3d82800640 1 -- 172.21.15.59:0/3157970525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7c0745d0 con 0x7f3d7c06dad0 2024-04-25T09:11:44.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.866+0000 7f3d73400640 1 -- 172.21.15.59:0/3157970525 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3d6c00bc40 con 0x7f3d7c06dad0 2024-04-25T09:11:44.856 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.866+0000 7f3d73400640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d58066f60 0x7f3d58069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:44.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.866+0000 7f3d73400640 1 -- 172.21.15.59:0/3157970525 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f3d6c085600 con 0x7f3d7c06dad0 2024-04-25T09:11:44.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.866+0000 7f3d73e00640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d58066f60 0x7f3d58069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:44.857 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.870+0000 7f3d73e00640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d58066f60 0x7f3d58069420 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c15ad80 tx=0x7f3d64008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:44.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:44.870+0000 7f3d73400640 1 -- 172.21.15.59:0/3157970525 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3d6c0563c0 con 0x7f3d7c06dad0 2024-04-25T09:11:45.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.070+0000 7f3d82800640 1 -- 172.21.15.59:0/3157970525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d7c0d0ab0 con 0x7f3d7c06dad0 2024-04-25T09:11:45.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.070+0000 7f3d73400640 1 -- 172.21.15.59:0/3157970525 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4943 (secure 0 0 0) 0x7f3d6c05c0c0 con 0x7f3d7c06dad0 2024-04-25T09:11:45.060 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:45.060 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":114,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":7613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3791633295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3791633295},{"type":"v1","addr":"172.21.15.59:6835","nonce":3791633295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:44.686097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9381":{"gid":9381,"name":"c","rank":0,"incarnation":114,"state":"up:replay","state_seq":1,"addr":"172.21.15.59:6833/836073822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":836073822},{"type":"v1","addr":"172.21.15.59:6833","nonce":836073822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:45.060 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 114 2024-04-25T09:11:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.074+0000 7f3d82800640 1 -- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d58066f60 msgr2=0x7f3d58069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.074+0000 7f3d82800640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d58066f60 0x7f3d58069420 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c15ad80 tx=0x7f3d64008040 comp rx=0 tx=0).stop 2024-04-25T09:11:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.074+0000 7f3d82800640 1 -- 172.21.15.59:0/3157970525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c06dad0 msgr2=0x7f3d7c152340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.074+0000 7f3d82800640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c06dad0 0x7f3d7c152340 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c00d800 tx=0x7f3d6c00dcc0 comp rx=0 tx=0).stop 2024-04-25T09:11:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.074+0000 7f3d82800640 1 -- 172.21.15.59:0/3157970525 shutdown_connections 2024-04-25T09:11:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.074+0000 7f3d82800640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3d58066f60 0x7f3d58069420 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.074+0000 7f3d82800640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3d7c15b2f0 0x7f3d7c14bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.074+0000 7f3d82800640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3d7c0b2dc0 0x7f3d7c14c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.074+0000 7f3d82800640 1 --2- 172.21.15.59:0/3157970525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d7c06dad0 0x7f3d7c152340 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.074+0000 7f3d82800640 1 -- 172.21.15.59:0/3157970525 >> 172.21.15.59:0/3157970525 conn(0x7f3d7c0b23b0 msgr2=0x7f3d7c154620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.074+0000 7f3d82800640 1 -- 172.21.15.59:0/3157970525 shutdown_connections 2024-04-25T09:11:45.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:45.074+0000 7f3d82800640 1 -- 172.21.15.59:0/3157970525 wait complete. 2024-04-25T09:11:45.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 114, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:11:17.015550+0000', 'modified': '2024-04-25T09:11:44.686097+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 123, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9381}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9381': {'gid': 9381, 'name': 'c', 'rank': 0, 'incarnation': 114, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.59:6833/836073822', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 836073822}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 836073822}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:11:45.484 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9381:up:replay 2024-04-25T09:11:46.485 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:46.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f500e000640 1 Processor -- start 2024-04-25T09:11:46.638 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f500e000640 1 -- start start 2024-04-25T09:11:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f500e000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f500806ac10 0x7f500806b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f500e000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50081454d0 con 0x7f50081450f0 2024-04-25T09:11:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f500e000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50080b3e10 con 0x7f50080b4eb0 2024-04-25T09:11:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f500e000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500806b5b0 con 0x7f500806ac10 2024-04-25T09:11:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f500cc00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f50081450f0 0x7f50080b33c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47984/0 (socket says 172.21.15.59:47984) 2024-04-25T09:11:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f500cc00640 1 -- 172.21.15.59:0/73564223 learned_addr learned my addr 172.21.15.59:0/73564223 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:46.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f5007e00640 1 --2- 172.21.15.59:0/73564223 >> v2:172.21.15.178:3300/0 conn(0x7f500806ac10 0x7f500806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f5007400640 1 -- 172.21.15.59:0/73564223 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900844001 0 0) 0x7f50081454d0 con 0x7f50081450f0 2024-04-25T09:11:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f5007400640 1 -- 172.21.15.59:0/73564223 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ff0003530 con 0x7f50081450f0 2024-04-25T09:11:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f5007400640 1 -- 172.21.15.59:0/73564223 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 316299202 0 0) 0x7f4ff0003530 con 0x7f50081450f0 2024-04-25T09:11:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f5007e00640 1 -- 172.21.15.59:0/73564223 >> v1:172.21.15.178:6789/0 conn(0x7f50080b4eb0 legacy=0x7f50080b5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f5007e00640 1 -- 172.21.15.59:0/73564223 >> v1:172.21.15.59:6789/0 conn(0x7f50081450f0 legacy=0x7f50080b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:46.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.650+0000 7f5007e00640 1 -- 172.21.15.59:0/73564223 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50080b40f0 con 0x7f500806ac10 2024-04-25T09:11:46.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.654+0000 7f5007e00640 1 --2- 172.21.15.59:0/73564223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500806ac10 0x7f500806b070 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40097c0 tx=0x7f4ff401c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=420683016aecab9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:46.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.654+0000 7f5007400640 1 -- 172.21.15.59:0/73564223 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff40b0070 con 0x7f500806ac10 2024-04-25T09:11:46.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.654+0000 7f5007400640 1 -- 172.21.15.59:0/73564223 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff40ab400 con 0x7f500806ac10 2024-04-25T09:11:46.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.654+0000 7f5007400640 1 -- 172.21.15.59:0/73564223 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc001680 con 0x7f500806ac10 2024-04-25T09:11:46.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.654+0000 7f500e000640 1 -- 172.21.15.59:0/73564223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500806ac10 msgr2=0x7f500806b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:46.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.654+0000 7f500e000640 1 --2- 172.21.15.59:0/73564223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500806ac10 0x7f500806b070 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40097c0 tx=0x7f4ff401c270 comp rx=0 tx=0).stop 2024-04-25T09:11:46.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.654+0000 7f500e000640 1 -- 172.21.15.59:0/73564223 shutdown_connections 2024-04-25T09:11:46.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.654+0000 7f500e000640 1 --2- 172.21.15.59:0/73564223 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f500806ac10 0x7f500806b070 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:46.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.654+0000 7f500e000640 1 -- 172.21.15.59:0/73564223 >> 172.21.15.59:0/73564223 conn(0x7f5008099a60 msgr2=0x7f50080b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:46.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.654+0000 7f500e000640 1 -- 172.21.15.59:0/73564223 shutdown_connections 2024-04-25T09:11:46.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.654+0000 7f500e000640 1 -- 172.21.15.59:0/73564223 wait complete. 2024-04-25T09:11:46.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500e000640 1 Processor -- start 2024-04-25T09:11:46.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500e000640 1 -- start start 2024-04-25T09:11:46.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500806ac10 0x7f500809ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:46.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500e000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50080b4eb0 0x7f5008140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:46.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500e000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50081450f0 0x7f5008158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:46.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080cd1b0 con 0x7f500806ac10 2024-04-25T09:11:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500e000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080cd030 con 0x7f50081450f0 2024-04-25T09:11:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500e000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5008169380 con 0x7f50080b4eb0 2024-04-25T09:11:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500806ac10 0x7f500809ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500cc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500806ac10 0x7f500809ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48122/0 (socket says 172.21.15.59:48122) 2024-04-25T09:11:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500cc00640 1 -- 172.21.15.59:0/1286499664 learned_addr learned my addr 172.21.15.59:0/1286499664 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f5007e00640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50080b4eb0 0x7f5008140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500d600640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50081450f0 0x7f5008158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500cc00640 1 -- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50080b4eb0 msgr2=0x7f5008140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500cc00640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50080b4eb0 0x7f5008140990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500cc00640 1 -- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50081450f0 msgr2=0x7f5008158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500cc00640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50081450f0 0x7f5008158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:46.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500cc00640 1 -- 172.21.15.59:0/1286499664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f500813e180 con 0x7f500806ac10 2024-04-25T09:11:46.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500cc00640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500806ac10 0x7f500809ca90 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c730 tx=0x7f4ffc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:46.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f5004c00640 1 -- 172.21.15.59:0/1286499664 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc018070 con 0x7f500806ac10 2024-04-25T09:11:46.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f5004c00640 1 -- 172.21.15.59:0/1286499664 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ffc0072d0 con 0x7f500806ac10 2024-04-25T09:11:46.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f5004c00640 1 -- 172.21.15.59:0/1286499664 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ffc0047f0 con 0x7f500806ac10 2024-04-25T09:11:46.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500e000640 1 -- 172.21.15.59:0/1286499664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500813e460 con 0x7f500806ac10 2024-04-25T09:11:46.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500e000640 1 -- 172.21.15.59:0/1286499664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500809c290 con 0x7f500806ac10 2024-04-25T09:11:46.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.658+0000 7f500e000640 1 -- 172.21.15.59:0/1286499664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f500804efa0 con 0x7f500806ac10 2024-04-25T09:11:46.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.662+0000 7f5004c00640 1 -- 172.21.15.59:0/1286499664 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4ffc01b070 con 0x7f500806ac10 2024-04-25T09:11:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.662+0000 7f5004c00640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4fe8066f90 0x7f4fe8069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.662+0000 7f5004c00640 1 -- 172.21.15.59:0/1286499664 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f4ffc084670 con 0x7f500806ac10 2024-04-25T09:11:46.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.662+0000 7f5007e00640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4fe8066f90 0x7f4fe8069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:46.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.662+0000 7f5007e00640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4fe8066f90 0x7f4fe8069450 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40ad000 tx=0x7f4ff40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:46.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.666+0000 7f5004c00640 1 -- 172.21.15.59:0/1286499664 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4ffc054d50 con 0x7f500806ac10 2024-04-25T09:11:46.851 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.862+0000 7f500e000640 1 -- 172.21.15.59:0/1286499664 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f500806d1a0 con 0x7f500806ac10 2024-04-25T09:11:46.852 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.862+0000 7f5004c00640 1 -- 172.21.15.59:0/1286499664 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 116 v116) v1 ==== 95+0+4943 (secure 0 0 0) 0x7f4ffc058df0 con 0x7f500806ac10 2024-04-25T09:11:46.852 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:46.852 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":116,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":7613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3791633295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3791633295},{"type":"v1","addr":"172.21.15.59:6835","nonce":3791633295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":116,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:45.690851+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9381":{"gid":9381,"name":"c","rank":0,"incarnation":114,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.59:6833/836073822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":836073822},{"type":"v1","addr":"172.21.15.59:6833","nonce":836073822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:46.852 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 116 2024-04-25T09:11:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.866+0000 7f500e000640 1 -- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4fe8066f90 msgr2=0x7f4fe8069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.866+0000 7f500e000640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4fe8066f90 0x7f4fe8069450 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4ff40ad000 tx=0x7f4ff40a6000 comp rx=0 tx=0).stop 2024-04-25T09:11:46.854 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.866+0000 7f500e000640 1 -- 172.21.15.59:0/1286499664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500806ac10 msgr2=0x7f500809ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.866+0000 7f500e000640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500806ac10 0x7f500809ca90 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f4ffc00c730 tx=0x7f4ffc00cbf0 comp rx=0 tx=0).stop 2024-04-25T09:11:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.866+0000 7f500e000640 1 -- 172.21.15.59:0/1286499664 shutdown_connections 2024-04-25T09:11:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.866+0000 7f500e000640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4fe8066f90 0x7f4fe8069450 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.866+0000 7f500e000640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f50081450f0 0x7f5008158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.866+0000 7f500e000640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f50080b4eb0 0x7f5008140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.866+0000 7f500e000640 1 --2- 172.21.15.59:0/1286499664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f500806ac10 0x7f500809ca90 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.866+0000 7f500e000640 1 -- 172.21.15.59:0/1286499664 >> 172.21.15.59:0/1286499664 conn(0x7f5008099a60 msgr2=0x7f5008142a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.866+0000 7f500e000640 1 -- 172.21.15.59:0/1286499664 shutdown_connections 2024-04-25T09:11:46.855 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:46.866+0000 7f500e000640 1 -- 172.21.15.59:0/1286499664 wait complete. 2024-04-25T09:11:47.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 116, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:11:17.015550+0000', 'modified': '2024-04-25T09:11:45.690851+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 123, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9381}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9381': {'gid': 9381, 'name': 'c', 'rank': 0, 'incarnation': 114, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.59:6833/836073822', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 836073822}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 836073822}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:11:47.277 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9381:up:rejoin 2024-04-25T09:11:48.278 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:48.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f517c000640 1 Processor -- start 2024-04-25T09:11:48.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f517c000640 1 -- start start 2024-04-25T09:11:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f517c000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f517415da10 0x7f51740afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f517c000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51740d11b0 0x7f517406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f517c000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517415ddf0 con 0x7f51740b4210 2024-04-25T09:11:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f517c000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f517406b480 con 0x7f51740d11b0 2024-04-25T09:11:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f517c000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51740d06d0 con 0x7f517415da10 2024-04-25T09:11:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f5178c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51740d11b0 0x7f517406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:48.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f5179600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f517415da10 0x7f51740afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f517a000640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f51740b4210 0x7f517406fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:52900/0 (socket says 172.21.15.59:52900) 2024-04-25T09:11:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f517a000640 1 -- 172.21.15.59:0/2283184789 learned_addr learned my addr 172.21.15.59:0/2283184789 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f5179600640 1 -- 172.21.15.59:0/2283184789 >> v2:172.21.15.178:3300/0 conn(0x7f51740d11b0 msgr2=0x7f517406ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f5179600640 1 --2- 172.21.15.59:0/2283184789 >> v2:172.21.15.178:3300/0 conn(0x7f51740d11b0 0x7f517406ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:48.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f5179600640 1 -- 172.21.15.59:0/2283184789 >> v1:172.21.15.178:6789/0 conn(0x7f51740b4210 legacy=0x7f517406fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:48.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f5179600640 1 -- 172.21.15.59:0/2283184789 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51740d09b0 con 0x7f517415da10 2024-04-25T09:11:48.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f5173e00640 1 -- 172.21.15.59:0/2283184789 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 689354103 0 0) 0x7f517415ddf0 con 0x7f51740b4210 2024-04-25T09:11:48.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.442+0000 7f5178c00640 1 --2- 172.21.15.59:0/2283184789 >> v2:172.21.15.178:3300/0 conn(0x7f51740d11b0 0x7f517406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:48.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.446+0000 7f5179600640 1 --2- 172.21.15.59:0/2283184789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f517415da10 0x7f51740afe20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f51680097c0 tx=0x7f516801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5948361a42909557 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:48.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.446+0000 7f5173e00640 1 -- 172.21.15.59:0/2283184789 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51680b0070 con 0x7f517415da10 2024-04-25T09:11:48.436 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.446+0000 7f5173e00640 1 -- 172.21.15.59:0/2283184789 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51680ab600 con 0x7f517415da10 2024-04-25T09:11:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.446+0000 7f5173e00640 1 -- 172.21.15.59:0/2283184789 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51680ab9d0 con 0x7f517415da10 2024-04-25T09:11:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.446+0000 7f517c000640 1 -- 172.21.15.59:0/2283184789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f517415da10 msgr2=0x7f51740afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.446+0000 7f517c000640 1 --2- 172.21.15.59:0/2283184789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f517415da10 0x7f51740afe20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f51680097c0 tx=0x7f516801c410 comp rx=0 tx=0).stop 2024-04-25T09:11:48.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.446+0000 7f517c000640 1 -- 172.21.15.59:0/2283184789 shutdown_connections 2024-04-25T09:11:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.446+0000 7f517c000640 1 --2- 172.21.15.59:0/2283184789 >> v2:172.21.15.178:3300/0 conn(0x7f51740d11b0 0x7f517406ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.446+0000 7f517c000640 1 --2- 172.21.15.59:0/2283184789 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f517415da10 0x7f51740afe20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.446+0000 7f517c000640 1 -- 172.21.15.59:0/2283184789 >> 172.21.15.59:0/2283184789 conn(0x7f51740b2400 msgr2=0x7f51740b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.446+0000 7f517c000640 1 -- 172.21.15.59:0/2283184789 shutdown_connections 2024-04-25T09:11:48.438 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.446+0000 7f517c000640 1 -- 172.21.15.59:0/2283184789 wait complete. 2024-04-25T09:11:48.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f517c000640 1 Processor -- start 2024-04-25T09:11:48.439 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f517c000640 1 -- start start 2024-04-25T09:11:48.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f517c000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51740b4210 0x7f5174148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:48.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f517c000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51740d11b0 0x7f517414c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:48.441 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f517c000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f517415da10 0x7f51740cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f517c000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517416aad0 con 0x7f51740d11b0 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f517c000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517416a950 con 0x7f517415da10 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f517c000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517416ac50 con 0x7f51740b4210 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5178c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51740d11b0 0x7f517414c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5178c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51740d11b0 0x7f517414c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48124/0 (socket says 172.21.15.59:48124) 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5178c00640 1 -- 172.21.15.59:0/3461600441 learned_addr learned my addr 172.21.15.59:0/3461600441 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f517a000640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f517415da10 0x7f51740cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5179600640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51740b4210 0x7f5174148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5178c00640 1 -- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51740b4210 msgr2=0x7f5174148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5178c00640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51740b4210 0x7f5174148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5178c00640 1 -- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f517415da10 msgr2=0x7f51740cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5178c00640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f517415da10 0x7f51740cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5178c00640 1 -- 172.21.15.59:0/3461600441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517414aea0 con 0x7f51740d11b0 2024-04-25T09:11:48.442 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5178c00640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51740d11b0 0x7f517414c530 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f516000ec10 tx=0x7f516000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:48.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5171600640 1 -- 172.21.15.59:0/3461600441 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160017070 con 0x7f51740d11b0 2024-04-25T09:11:48.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5171600640 1 -- 172.21.15.59:0/3461600441 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516000cc30 con 0x7f51740d11b0 2024-04-25T09:11:48.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f517c000640 1 -- 172.21.15.59:0/3461600441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517414b180 con 0x7f51740d11b0 2024-04-25T09:11:48.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.450+0000 7f5171600640 1 -- 172.21.15.59:0/3461600441 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5160013470 con 0x7f51740d11b0 2024-04-25T09:11:48.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.454+0000 7f517c000640 1 -- 172.21.15.59:0/3461600441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517414b740 con 0x7f51740d11b0 2024-04-25T09:11:48.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.454+0000 7f517c000640 1 -- 172.21.15.59:0/3461600441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51740745d0 con 0x7f51740d11b0 2024-04-25T09:11:48.443 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.454+0000 7f5171600640 1 -- 172.21.15.59:0/3461600441 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f516001a070 con 0x7f51740d11b0 2024-04-25T09:11:48.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.454+0000 7f5171600640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5154066f60 0x7f5154069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:48.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.454+0000 7f5171600640 1 -- 172.21.15.59:0/3461600441 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f51600855c0 con 0x7f51740d11b0 2024-04-25T09:11:48.444 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.454+0000 7f5179600640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5154066f60 0x7f5154069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:48.445 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.458+0000 7f5179600640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5154066f60 0x7f5154069420 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f51680ad000 tx=0x7f5168008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:48.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.458+0000 7f5171600640 1 -- 172.21.15.59:0/3461600441 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5160055ca0 con 0x7f51740d11b0 2024-04-25T09:11:48.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.654+0000 7f517c000640 1 -- 172.21.15.59:0/3461600441 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5174072860 con 0x7f51740d11b0 2024-04-25T09:11:48.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.654+0000 7f5171600640 1 -- 172.21.15.59:0/3461600441 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4943 (secure 0 0 0) 0x7f5160059d40 con 0x7f51740d11b0 2024-04-25T09:11:48.644 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:48.644 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":117,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":7613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3791633295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3791633295},{"type":"v1","addr":"172.21.15.59:6835","nonce":3791633295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:46.696297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9381":{"gid":9381,"name":"c","rank":0,"incarnation":114,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6833/836073822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":836073822},{"type":"v1","addr":"172.21.15.59:6833","nonce":836073822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:48.644 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 117 2024-04-25T09:11:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.658+0000 7f517c000640 1 -- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5154066f60 msgr2=0x7f5154069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.658+0000 7f517c000640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5154066f60 0x7f5154069420 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f51680ad000 tx=0x7f5168008040 comp rx=0 tx=0).stop 2024-04-25T09:11:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.658+0000 7f517c000640 1 -- 172.21.15.59:0/3461600441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51740d11b0 msgr2=0x7f517414c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.658+0000 7f517c000640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51740d11b0 0x7f517414c530 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f516000ec10 tx=0x7f516000c520 comp rx=0 tx=0).stop 2024-04-25T09:11:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.658+0000 7f517c000640 1 -- 172.21.15.59:0/3461600441 shutdown_connections 2024-04-25T09:11:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.658+0000 7f517c000640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5154066f60 0x7f5154069420 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.658+0000 7f517c000640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f517415da10 0x7f51740cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.658+0000 7f517c000640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51740d11b0 0x7f517414c530 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:48.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.658+0000 7f517c000640 1 --2- 172.21.15.59:0/3461600441 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f51740b4210 0x7f5174148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.658+0000 7f517c000640 1 -- 172.21.15.59:0/3461600441 >> 172.21.15.59:0/3461600441 conn(0x7f51740b2400 msgr2=0x7f51740cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.658+0000 7f517c000640 1 -- 172.21.15.59:0/3461600441 shutdown_connections 2024-04-25T09:11:48.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:48.658+0000 7f517c000640 1 -- 172.21.15.59:0/3461600441 wait complete. 2024-04-25T09:11:48.669 INFO:tasks.ceph.mds.c.smithi059.stderr:2024-04-25T09:11:48.678+0000 7f1393600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:11:49.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 117, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T09:11:17.015550+0000', 'modified': '2024-04-25T09:11:46.696297+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 123, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9381}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9381': {'gid': 9381, 'name': 'c', 'rank': 0, 'incarnation': 114, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.59:6833/836073822', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 836073822}, {'type': 'v1', 'addr': '172.21.15.59:6833', 'nonce': 836073822}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-25T09:11:49.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T09:11:49.069 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T09:11:49.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.222+0000 7fb6b1400640 1 Processor -- start 2024-04-25T09:11:49.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.222+0000 7fb6b1400640 1 -- start start 2024-04-25T09:11:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.222+0000 7fb6b1400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6ac159320 0x7fb6ac15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.222+0000 7fb6b1400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fb6ac15f440 0x7fb6ac06dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.222+0000 7fb6b1400640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ac15fc00 con 0x7fb6ac06e010 2024-04-25T09:11:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.222+0000 7fb6b1400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac06d640 con 0x7fb6ac159320 2024-04-25T09:11:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.222+0000 7fb6b1400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ac15fee0 con 0x7fb6ac15f440 2024-04-25T09:11:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6aa800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6ac159320 0x7fb6ac15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6aa800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6ac159320 0x7fb6ac15c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48130/0 (socket says 172.21.15.59:48130) 2024-04-25T09:11:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6aa800640 1 -- 172.21.15.59:0/4093622476 learned_addr learned my addr 172.21.15.59:0/4093622476 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:49.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6ab200640 1 --1- 172.21.15.59:0/4093622476 >> v1:172.21.15.59:6789/0 conn(0x7fb6ac06e010 0x7fb6ac06e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:47992/0 (socket says 172.21.15.59:47992) 2024-04-25T09:11:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/4093622476 >> v2:172.21.15.178:3300/0 conn(0x7fb6ac15f440 0x7fb6ac06dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6aa800640 1 -- 172.21.15.59:0/4093622476 >> v2:172.21.15.178:3300/0 conn(0x7fb6ac15f440 msgr2=0x7fb6ac06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6aa800640 1 --2- 172.21.15.59:0/4093622476 >> v2:172.21.15.178:3300/0 conn(0x7fb6ac15f440 0x7fb6ac06dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6aa800640 1 -- 172.21.15.59:0/4093622476 >> v1:172.21.15.59:6789/0 conn(0x7fb6ac06e010 legacy=0x7fb6ac06e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6aa800640 1 -- 172.21.15.59:0/4093622476 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac1601c0 con 0x7fb6ac159320 2024-04-25T09:11:49.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6a9e00640 1 -- 172.21.15.59:0/4093622476 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143809974 0 0) 0x7fb6ac15fc00 con 0x7fb6ac06e010 2024-04-25T09:11:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6aa800640 1 --2- 172.21.15.59:0/4093622476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac159320 0x7fb6ac15c9b0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0b4b50 tx=0x7fb69c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a8b1d47fc3cfe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6a9e00640 1 -- 172.21.15.59:0/4093622476 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0ab680 con 0x7fb6ac159320 2024-04-25T09:11:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6a9e00640 1 -- 172.21.15.59:0/4093622476 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69c0b0070 con 0x7fb6ac159320 2024-04-25T09:11:49.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.226+0000 7fb6a9e00640 1 -- 172.21.15.59:0/4093622476 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0aba40 con 0x7fb6ac159320 2024-04-25T09:11:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 -- 172.21.15.59:0/4093622476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac159320 msgr2=0x7fb6ac15c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 --2- 172.21.15.59:0/4093622476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac159320 0x7fb6ac15c9b0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac0b4b50 tx=0x7fb69c01c460 comp rx=0 tx=0).stop 2024-04-25T09:11:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 -- 172.21.15.59:0/4093622476 shutdown_connections 2024-04-25T09:11:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 --2- 172.21.15.59:0/4093622476 >> v2:172.21.15.178:3300/0 conn(0x7fb6ac15f440 0x7fb6ac06dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 --2- 172.21.15.59:0/4093622476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac159320 0x7fb6ac15c9b0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 -- 172.21.15.59:0/4093622476 >> 172.21.15.59:0/4093622476 conn(0x7fb6ac067080 msgr2=0x7fb6ac06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 -- 172.21.15.59:0/4093622476 shutdown_connections 2024-04-25T09:11:49.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 -- 172.21.15.59:0/4093622476 wait complete. 2024-04-25T09:11:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 Processor -- start 2024-04-25T09:11:49.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 -- start start 2024-04-25T09:11:49.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6ac06e010 0x7fb6ac13a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6ac159320 0x7fb6ac1f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac15f440 0x7fb6ac138500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac15f9a0 con 0x7fb6ac15f440 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac15f820 con 0x7fb6ac06e010 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6b1400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac06ebb0 con 0x7fb6ac159320 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6ab200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac15f440 0x7fb6ac138500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6ab200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac15f440 0x7fb6ac138500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48132/0 (socket says 172.21.15.59:48132) 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6ab200640 1 -- 172.21.15.59:0/1789121283 learned_addr learned my addr 172.21.15.59:0/1789121283 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6aa800640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6ac06e010 0x7fb6ac13a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6ac159320 0x7fb6ac1f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6ab200640 1 -- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6ac159320 msgr2=0x7fb6ac1f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.230+0000 7fb6ab200640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6ac159320 0x7fb6ac1f65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.234+0000 7fb6ab200640 1 -- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6ac06e010 msgr2=0x7fb6ac13a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.234+0000 7fb6ab200640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6ac06e010 0x7fb6ac13a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.234+0000 7fb6ab200640 1 -- 172.21.15.59:0/1789121283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ac141f70 con 0x7fb6ac15f440 2024-04-25T09:11:49.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.234+0000 7fb6ab200640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac15f440 0x7fb6ac138500 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400c780 tx=0x7fb6a400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.234+0000 7fb6a3400640 1 -- 172.21.15.59:0/1789121283 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a4018070 con 0x7fb6ac15f440 2024-04-25T09:11:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.234+0000 7fb6a3400640 1 -- 172.21.15.59:0/1789121283 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a400a640 con 0x7fb6ac15f440 2024-04-25T09:11:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.234+0000 7fb6a3400640 1 -- 172.21.15.59:0/1789121283 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a400aab0 con 0x7fb6ac15f440 2024-04-25T09:11:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.234+0000 7fb6b1400640 1 -- 172.21.15.59:0/1789121283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac142250 con 0x7fb6ac15f440 2024-04-25T09:11:49.223 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.234+0000 7fb6b1400640 1 -- 172.21.15.59:0/1789121283 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac142810 con 0x7fb6ac15f440 2024-04-25T09:11:49.224 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.234+0000 7fb6a3400640 1 -- 172.21.15.59:0/1789121283 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb6a400ac50 con 0x7fb6ac15f440 2024-04-25T09:11:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6a3400640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb688066f60 0x7fb688069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6a3400640 1 -- 172.21.15.59:0/1789121283 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fb6a40848b0 con 0x7fb6ac15f440 2024-04-25T09:11:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 Processor -- start 2024-04-25T09:11:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6aa800640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb688066f60 0x7fb688069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 -- start start 2024-04-25T09:11:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba193920 0x55edba193d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6aa800640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb688066f60 0x7fb688069420 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0af000 tx=0x7fb69c0a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba194240 0x55edba1499f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba14a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edba0315f0 con 0x55edba194240 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb9f98da0 con 0x55edba149f30 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edb9f21150 con 0x55edba193920 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6a1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba194240 0x55edba1499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6a1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba194240 0x55edba1499f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48146/0 (socket says 172.21.15.59:48146) 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6a1e00640 1 -- 172.21.15.59:0/3949534897 learned_addr learned my addr 172.21.15.59:0/3949534897 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6aa800640 1 --2- 172.21.15.59:0/3949534897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba193920 0x55edba193d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6ab200640 1 --2- 172.21.15.59:0/3949534897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba14a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6a1e00640 1 -- 172.21.15.59:0/3949534897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba193920 msgr2=0x55edba193d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/3949534897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba193920 0x55edba193d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6a1e00640 1 -- 172.21.15.59:0/3949534897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 msgr2=0x55edba14a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/3949534897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba14a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6a1e00640 1 -- 172.21.15.59:0/3949534897 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edb9f3aca0 con 0x55edba194240 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6ab200640 1 --2- 172.21.15.59:0/3949534897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba14a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/3949534897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba194240 0x55edba1499f0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fb694009890 tx=0x7fb694009d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8eb63f4a834b2d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb69b400640 1 -- 172.21.15.59:0/3949534897 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb694017020 con 0x55edba194240 2024-04-25T09:11:49.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb69b400640 1 -- 172.21.15.59:0/3949534897 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69400e950 con 0x55edba194240 2024-04-25T09:11:49.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb69b400640 1 -- 172.21.15.59:0/3949534897 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69400f040 con 0x55edba194240 2024-04-25T09:11:49.230 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 -- 172.21.15.59:0/3949534897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba194240 msgr2=0x55edba1499f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 --2- 172.21.15.59:0/3949534897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba194240 0x55edba1499f0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7fb694009890 tx=0x7fb694009d50 comp rx=0 tx=0).stop 2024-04-25T09:11:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 -- 172.21.15.59:0/3949534897 shutdown_connections 2024-04-25T09:11:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 --2- 172.21.15.59:0/3949534897 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba14a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 --2- 172.21.15.59:0/3949534897 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba194240 0x55edba1499f0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 --2- 172.21.15.59:0/3949534897 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba193920 0x55edba193d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 -- 172.21.15.59:0/3949534897 >> 172.21.15.59:0/3949534897 conn(0x55edba1502a0 msgr2=0x55edba1482d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 -- 172.21.15.59:0/3949534897 shutdown_connections 2024-04-25T09:11:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.238+0000 7fb6b48de000 1 -- 172.21.15.59:0/3949534897 wait complete. 2024-04-25T09:11:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 1 -- start start 2024-04-25T09:11:49.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 1 Processor -- start 2024-04-25T09:11:49.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba19acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 0x55edba19b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba14daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb9f53990 con 0x55edba193920 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb9f94e40 con 0x55edba149f30 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edb9f24900 con 0x55edba194240 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 10 client.0 _ll_register_callbacks cb 0x55edba04c1c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6a1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 0x55edba19b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6a1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 0x55edba19b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48156/0 (socket says 172.21.15.59:48156) 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6a1e00640 1 -- 172.21.15.59:0/217747129 learned_addr learned my addr 172.21.15.59:0/217747129 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6aa800640 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba19acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6ab200640 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba14daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6a1e00640 1 -- 172.21.15.59:0/217747129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 msgr2=0x55edba14daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba14daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6a1e00640 1 -- 172.21.15.59:0/217747129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 msgr2=0x55edba19acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba19acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6a1e00640 1 -- 172.21.15.59:0/217747129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edb9f51630 con 0x55edba193920 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 0x55edba19b230 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fb694016040 tx=0x7fb694004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca641af53abe89e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb68fe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb68fe00640 1 -- 172.21.15.59:0/217747129 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb694006a30 con 0x55edba193920 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 1 -- 172.21.15.59:0/217747129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb69400e950 con 0x55edba193920 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb68fe00640 1 -- 172.21.15.59:0/217747129 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fb6940139d0 con 0x55edba193920 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb68fe00640 1 -- 172.21.15.59:0/217747129 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb694030050 con 0x55edba193920 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 10 client.9477 fetch_fsmap learned FSMap version 117 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 1 -- 172.21.15.59:0/217747129 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) v3 -- 0x55edb9f213a0 con 0x55edba193920 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb68fe00640 1 -- 172.21.15.59:0/217747129 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69400e950 con 0x55edba193920 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb68fe00640 1 -- 172.21.15.59:0/217747129 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 117) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb694033020 con 0x55edba193920 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 10 client.9477 fetch_fsmap finished waiting for FSMap version 117 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 10 client.9477 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 20 client.9477 populate_metadata read hostname 'smithi059' 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.242+0000 7fb6b48de000 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.59:6832/836073822,v1:172.21.15.59:6833/836073822] conn(0x55edba14e4b0 0x55edba14e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 4 client.9477 mds_command: new command op to 9381 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 1 -- 172.21.15.59:0/217747129 --> [v2:172.21.15.59:6832/836073822,v1:172.21.15.59:6833/836073822] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55edb9f34a50 con 0x55edba14e4b0 2024-04-25T09:11:49.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6aa800640 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.59:6832/836073822,v1:172.21.15.59:6833/836073822] conn(0x55edba14e4b0 0x55edba14e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6aa800640 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.59:6832/836073822,v1:172.21.15.59:6833/836073822] conn(0x55edba14e4b0 0x55edba14e890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68b2b6abb72443b6 server_cookie=649e405b90af1c67 in_seq=0 out_seq=0 2024-04-25T09:11:49.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb68fe00640 10 client.9477 ms_handle_connect on v2:172.21.15.59:6832/836073822 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb68fe00640 1 -- 172.21.15.59:0/217747129 <== mds.0 v2:172.21.15.59:6832/836073822 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55edb9f34a50 con 0x55edba14e4b0 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb68fe00640 10 client.9477 handle_command_reply: tid=0 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 1 client.9477 shutdown 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 1 -- 172.21.15.59:0/217747129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 msgr2=0x55edba19b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 0x55edba19b230 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7fb694016040 tx=0x7fb694004740 comp rx=0 tx=0).stop 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 1 -- 172.21.15.59:0/217747129 shutdown_connections 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.59:6832/836073822,v1:172.21.15.59:6833/836073822] conn(0x55edba14e4b0 0x55edba14e890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba14daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 0x55edba19b230 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 1 --2- 172.21.15.59:0/217747129 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba19acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb68fe00640 0 client.9477 ms_handle_reset on v2:172.21.15.59:6832/836073822 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 1 -- 172.21.15.59:0/217747129 >> 172.21.15.59:0/217747129 conn(0x55edba1502a0 msgr2=0x55edba1489e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 1 -- 172.21.15.59:0/217747129 shutdown_connections 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 1 -- 172.21.15.59:0/217747129 wait complete. 2024-04-25T09:11:49.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.246+0000 7fb6b48de000 20 client.9477 trim_cache size 0 max 16384 2024-04-25T09:11:49.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6b48de000 1 Processor -- start 2024-04-25T09:11:49.251 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6b48de000 1 -- start start 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6b48de000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba191ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6b48de000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 0x55edba192220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6b48de000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba19d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6b48de000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac202180 con 0x55edba193920 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6b48de000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac15a2f0 con 0x55edba149f30 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6b48de000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac201d70 con 0x55edba194240 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6a1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 0x55edba192220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6a1e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 0x55edba192220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48160/0 (socket says 172.21.15.59:48160) 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6a1e00640 1 -- 172.21.15.59:0/1642053108 learned_addr learned my addr 172.21.15.59:0/1642053108 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6aa800640 1 --2- 172.21.15.59:0/1642053108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba191ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6a1e00640 1 -- 172.21.15.59:0/1642053108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 msgr2=0x55edba19d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6ab200640 1 --2- 172.21.15.59:0/1642053108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba19d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/1642053108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba19d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.253 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6a1e00640 1 -- 172.21.15.59:0/1642053108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 msgr2=0x55edba191ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:49.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/1642053108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba191ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6a1e00640 1 -- 172.21.15.59:0/1642053108 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55edba194070 con 0x55edba193920 2024-04-25T09:11:49.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6aa800640 1 --2- 172.21.15.59:0/1642053108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba191ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:49.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6ab200640 1 --2- 172.21.15.59:0/1642053108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba19d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:49.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/1642053108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 0x55edba192220 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fb694009d90 tx=0x7fb69401f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c79b48842a5d18 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:49.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb69aa00640 1 -- 172.21.15.59:0/1642053108 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb694017070 con 0x55edba193920 2024-04-25T09:11:49.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb69aa00640 1 -- 172.21.15.59:0/1642053108 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb694000e50 con 0x55edba193920 2024-04-25T09:11:49.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.262+0000 7fb69aa00640 1 -- 172.21.15.59:0/1642053108 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb694013de0 con 0x55edba193920 2024-04-25T09:11:49.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 -- 172.21.15.59:0/1642053108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 msgr2=0x55edba192220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 --2- 172.21.15.59:0/1642053108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 0x55edba192220 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7fb694009d90 tx=0x7fb69401f070 comp rx=0 tx=0).stop 2024-04-25T09:11:49.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 -- 172.21.15.59:0/1642053108 shutdown_connections 2024-04-25T09:11:49.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 --2- 172.21.15.59:0/1642053108 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba19d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 --2- 172.21.15.59:0/1642053108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba193920 0x55edba192220 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 --2- 172.21.15.59:0/1642053108 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba149f30 0x55edba191ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 -- 172.21.15.59:0/1642053108 >> 172.21.15.59:0/1642053108 conn(0x55edba1502a0 msgr2=0x55edba14d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:49.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 -- 172.21.15.59:0/1642053108 shutdown_connections 2024-04-25T09:11:49.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 -- 172.21.15.59:0/1642053108 wait complete. 2024-04-25T09:11:49.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 -- start start 2024-04-25T09:11:49.256 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 Processor -- start 2024-04-25T09:11:49.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba149f30 0x55edba1a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba193920 0x55edba1efe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba1f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edb9f9d3d0 con 0x55edba149f30 2024-04-25T09:11:49.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x55edba054d50 con 0x55edba193920 2024-04-25T09:11:49.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x55edb9f33980 con 0x55edba194240 2024-04-25T09:11:49.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 10 client.0 _ll_register_callbacks cb 0x7fb694009120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T09:11:49.258 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6aa800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba149f30 0x55edba1a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6aa800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba149f30 0x55edba1a0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48168/0 (socket says 172.21.15.59:48168) 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6aa800640 1 -- 172.21.15.59:0/2620971689 learned_addr learned my addr 172.21.15.59:0/2620971689 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba193920 0x55edba1efe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6ab200640 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba1f03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6aa800640 1 -- 172.21.15.59:0/2620971689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 msgr2=0x55edba1f03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6aa800640 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba1f03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6aa800640 1 -- 172.21.15.59:0/2620971689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba193920 msgr2=0x55edba1efe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6aa800640 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba193920 0x55edba1efe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6aa800640 1 -- 172.21.15.59:0/2620971689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55edba01a600 con 0x55edba149f30 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba193920 0x55edba1efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6aa800640 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba149f30 0x55edba1a0ee0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fb69c01c4a0 tx=0x7fb69c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622f9737bc24c980 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb68fe00640 10 client.0 ms_handle_connect on v2:172.21.15.59:3300/0 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb68fe00640 1 -- 172.21.15.59:0/2620971689 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69c0d0060 con 0x55edba149f30 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb68fe00640 1 -- 172.21.15.59:0/2620971689 <== mon.0 v2:172.21.15.59:3300/0 2 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fb69c0beb10 con 0x55edba149f30 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 -- 172.21.15.59:0/2620971689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb694000e50 con 0x55edba149f30 2024-04-25T09:11:49.259 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb68fe00640 1 -- 172.21.15.59:0/2620971689 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_get_version_reply(handle=1 version=117) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb69c0d6050 con 0x55edba149f30 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 10 client.9483 fetch_fsmap learned FSMap version 117 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.266+0000 7fb6b48de000 1 -- 172.21.15.59:0/2620971689 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,fsmap=117,monmap=2+}) v3 -- 0x55edb9f2d9b0 con 0x55edba149f30 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb68fe00640 1 -- 172.21.15.59:0/2620971689 <== mon.0 v2:172.21.15.59:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb694000e50 con 0x55edba149f30 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb68fe00640 1 -- 172.21.15.59:0/2620971689 <== mon.0 v2:172.21.15.59:3300/0 5 ==== fsmap(e 117) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fb69c0d9020 con 0x55edba149f30 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 10 client.9483 fetch_fsmap finished waiting for FSMap version 117 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 10 client.9483 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 20 client.9483 populate_metadata read hostname 'smithi059' 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.59:6832/836073822,v1:172.21.15.59:6833/836073822] conn(0x55edba1f0900 0x55edba1f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 4 client.9483 mds_command: new command op to 9381 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 -- 172.21.15.59:0/2620971689 --> [v2:172.21.15.59:6832/836073822,v1:172.21.15.59:6833/836073822] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55edb9fa62e0 con 0x55edba1f0900 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.59:6832/836073822,v1:172.21.15.59:6833/836073822] conn(0x55edba1f0900 0x55edba1f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6a1e00640 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.59:6832/836073822,v1:172.21.15.59:6833/836073822] conn(0x55edba1f0900 0x55edba1f0ce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b91dda824974bc4c server_cookie=6c9cca1120bad391 in_seq=0 out_seq=0 2024-04-25T09:11:49.260 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb68fe00640 10 client.9483 ms_handle_connect on v2:172.21.15.59:6832/836073822 2024-04-25T09:11:49.261 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb68fe00640 1 -- 172.21.15.59:0/2620971689 <== mds.0 v2:172.21.15.59:6832/836073822 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x55edb9fa62e0 con 0x55edba1f0900 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb68fe00640 10 client.9483 handle_command_reply: tid=0 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 client.9483 shutdown 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 -- 172.21.15.59:0/2620971689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba149f30 msgr2=0x55edba1a0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba149f30 0x55edba1a0ee0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7fb69c01c4a0 tx=0x7fb69c01aca0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 -- 172.21.15.59:0/2620971689 shutdown_connections 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.59:6832/836073822,v1:172.21.15.59:6833/836073822] conn(0x55edba1f0900 0x55edba1f0ce0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x55edba194240 0x55edba1f03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x55edba193920 0x55edba1efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 --2- 172.21.15.59:0/2620971689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55edba149f30 0x55edba1a0ee0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb68fe00640 0 client.9483 ms_handle_reset on v2:172.21.15.59:6832/836073822 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 -- 172.21.15.59:0/2620971689 >> 172.21.15.59:0/2620971689 conn(0x55edba1502a0 msgr2=0x55edba190cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 -- 172.21.15.59:0/2620971689 shutdown_connections 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 1 -- 172.21.15.59:0/2620971689 wait complete. 2024-04-25T09:11:49.262 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b48de000 20 client.9483 trim_cache size 0 max 16384 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout: "cluster_fsid": "fbbb9dc0-22e4-4685-972c-77e9262d4773", 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout: "whoami": 0, 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout: "id": 9381, 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout: "want_state": "up:active", 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout: "state": "up:active", 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout: "fs_name": "cephfs", 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout: "rank_uptime": 4.5858499840000002, 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout: "mdsmap_epoch": 117, 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch": 123, 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout: "osdmap_epoch_barrier": 123, 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout: "uptime": 6.5399445910000003 2024-04-25T09:11:49.263 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:11:49.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b1400640 1 -- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb688066f60 msgr2=0x7fb688069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b1400640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb688066f60 0x7fb688069420 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb69c0af000 tx=0x7fb69c0a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:49.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b1400640 1 -- 172.21.15.59:0/1789121283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac15f440 msgr2=0x7fb6ac138500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b1400640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac15f440 0x7fb6ac138500 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400c780 tx=0x7fb6a400cc40 comp rx=0 tx=0).stop 2024-04-25T09:11:49.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b1400640 1 -- 172.21.15.59:0/1789121283 shutdown_connections 2024-04-25T09:11:49.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b1400640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb688066f60 0x7fb688069420 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.264 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b1400640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ac15f440 0x7fb6ac138500 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b1400640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb6ac159320 0x7fb6ac1f65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b1400640 1 --2- 172.21.15.59:0/1789121283 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb6ac06e010 0x7fb6ac13a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b1400640 1 -- 172.21.15.59:0/1789121283 >> 172.21.15.59:0/1789121283 conn(0x7fb6ac067080 msgr2=0x7fb6ac15d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b1400640 1 -- 172.21.15.59:0/1789121283 shutdown_connections 2024-04-25T09:11:49.265 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.270+0000 7fb6b1400640 1 -- 172.21.15.59:0/1789121283 wait complete. 2024-04-25T09:11:49.279 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T09:11:49.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.430+0000 7f1094800640 1 Processor -- start 2024-04-25T09:11:49.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.430+0000 7f1094800640 1 -- start start 2024-04-25T09:11:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.434+0000 7f1094800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f108c0b18e0 0x7f108c0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.434+0000 7f1094800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108c0b0ad0 con 0x7f108c06e980 2024-04-25T09:11:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.434+0000 7f1094800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f108c0cf540 con 0x7f108c0b06d0 2024-04-25T09:11:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.434+0000 7f1094800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108c15b240 con 0x7f108c0b18e0 2024-04-25T09:11:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.434+0000 7f1091e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f108c06e980 0x7f108c0cee30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:48004/0 (socket says 172.21.15.59:48004) 2024-04-25T09:11:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.434+0000 7f1091e00640 1 -- 172.21.15.59:0/1309408122 learned_addr learned my addr 172.21.15.59:0/1309408122 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:49.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.434+0000 7f1091400640 1 --2- 172.21.15.59:0/1309408122 >> v2:172.21.15.178:3300/0 conn(0x7f108c0b18e0 0x7f108c0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.434+0000 7f1090a00640 1 -- 172.21.15.59:0/1309408122 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578770330 0 0) 0x7f108c0b0ad0 con 0x7f108c06e980 2024-04-25T09:11:49.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.434+0000 7f1090a00640 1 -- 172.21.15.59:0/1309408122 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1074003450 con 0x7f108c06e980 2024-04-25T09:11:49.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.434+0000 7f1091400640 1 -- 172.21.15.59:0/1309408122 >> v1:172.21.15.178:6789/0 conn(0x7f108c0b06d0 legacy=0x7f108c06d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.434+0000 7f1091400640 1 -- 172.21.15.59:0/1309408122 >> v1:172.21.15.59:6789/0 conn(0x7f108c06e980 legacy=0x7f108c0cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.434+0000 7f1091400640 1 -- 172.21.15.59:0/1309408122 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c0ce350 con 0x7f108c0b18e0 2024-04-25T09:11:49.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1091400640 1 --2- 172.21.15.59:0/1309408122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c0b18e0 0x7f108c0b0190 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f107c0097c0 tx=0x7f107c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f744bc08a61ac560 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:49.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1090a00640 1 -- 172.21.15.59:0/1309408122 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c0b2070 con 0x7f108c0b18e0 2024-04-25T09:11:49.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1090a00640 1 -- 172.21.15.59:0/1309408122 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c0a9070 con 0x7f108c0b18e0 2024-04-25T09:11:49.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1090a00640 1 -- 172.21.15.59:0/1309408122 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c0ad880 con 0x7f108c0b18e0 2024-04-25T09:11:49.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 -- 172.21.15.59:0/1309408122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c0b18e0 msgr2=0x7f108c0b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 --2- 172.21.15.59:0/1309408122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c0b18e0 0x7f108c0b0190 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f107c0097c0 tx=0x7f107c01c3e0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 -- 172.21.15.59:0/1309408122 shutdown_connections 2024-04-25T09:11:49.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 --2- 172.21.15.59:0/1309408122 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c0b18e0 0x7f108c0b0190 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 -- 172.21.15.59:0/1309408122 >> 172.21.15.59:0/1309408122 conn(0x7f108c066fa0 msgr2=0x7f108c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:49.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 -- 172.21.15.59:0/1309408122 shutdown_connections 2024-04-25T09:11:49.427 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 -- 172.21.15.59:0/1309408122 wait complete. 2024-04-25T09:11:49.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 Processor -- start 2024-04-25T09:11:49.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 -- start start 2024-04-25T09:11:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f108c06e980 0x7f108c15e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c0b06d0 0x7f108c14d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c0b18e0 0x7f108c150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c15ae60 con 0x7f108c0b18e0 2024-04-25T09:11:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0b0ef0 con 0x7f108c0b06d0 2024-04-25T09:11:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.438+0000 7f1094800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c15afe0 con 0x7f108c06e980 2024-04-25T09:11:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1092800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c0b18e0 0x7f108c150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1092800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c0b18e0 0x7f108c150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:48178/0 (socket says 172.21.15.59:48178) 2024-04-25T09:11:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1092800640 1 -- 172.21.15.59:0/708946348 learned_addr learned my addr 172.21.15.59:0/708946348 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1091400640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c0b06d0 0x7f108c14d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1091e00640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f108c06e980 0x7f108c15e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1092800640 1 -- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f108c06e980 msgr2=0x7f108c15e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1092800640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f108c06e980 0x7f108c15e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1092800640 1 -- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c0b06d0 msgr2=0x7f108c14d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1092800640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c0b06d0 0x7f108c14d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1092800640 1 -- 172.21.15.59:0/708946348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c155010 con 0x7f108c0b18e0 2024-04-25T09:11:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1092800640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c0b18e0 0x7f108c150c50 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f108800c770 tx=0x7f108800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1086000640 1 -- 172.21.15.59:0/708946348 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1088003b80 con 0x7f108c0b18e0 2024-04-25T09:11:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1086000640 1 -- 172.21.15.59:0/708946348 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1088003d20 con 0x7f108c0b18e0 2024-04-25T09:11:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1086000640 1 -- 172.21.15.59:0/708946348 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f108800aa90 con 0x7f108c0b18e0 2024-04-25T09:11:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1094800640 1 -- 172.21.15.59:0/708946348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c1552f0 con 0x7f108c0b18e0 2024-04-25T09:11:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1094800640 1 -- 172.21.15.59:0/708946348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c155b90 con 0x7f108c0b18e0 2024-04-25T09:11:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1094800640 1 -- 172.21.15.59:0/708946348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c1554c0 con 0x7f108c0b18e0 2024-04-25T09:11:49.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.442+0000 7f1086000640 1 -- 172.21.15.59:0/708946348 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f108800ac30 con 0x7f108c0b18e0 2024-04-25T09:11:49.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.446+0000 7f1086000640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1070066f60 0x7f1070069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:49.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.446+0000 7f1086000640 1 -- 172.21.15.59:0/708946348 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f1088085100 con 0x7f108c0b18e0 2024-04-25T09:11:49.434 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.446+0000 7f1091e00640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1070066f60 0x7f1070069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:49.435 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.446+0000 7f1091e00640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1070066f60 0x7f1070069420 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1080007fd0 tx=0x7f1080009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:49.437 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.450+0000 7f1086000640 1 -- 172.21.15.59:0/708946348 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f10880557e0 con 0x7f108c0b18e0 2024-04-25T09:11:49.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.646+0000 7f1094800640 1 -- 172.21.15.59:0/708946348 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f108c0745d0 con 0x7f108c0b18e0 2024-04-25T09:11:49.636 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.646+0000 7f1086000640 1 -- 172.21.15.59:0/708946348 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v117) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1088059880 con 0x7f108c0b18e0 2024-04-25T09:11:49.636 INFO:teuthology.orchestra.run.smithi059.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T09:11:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.650+0000 7f1094800640 1 -- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1070066f60 msgr2=0x7f1070069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.650+0000 7f1094800640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1070066f60 0x7f1070069420 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f1080007fd0 tx=0x7f1080009040 comp rx=0 tx=0).stop 2024-04-25T09:11:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.650+0000 7f1094800640 1 -- 172.21.15.59:0/708946348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c0b18e0 msgr2=0x7f108c150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.650+0000 7f1094800640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c0b18e0 0x7f108c150c50 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f108800c770 tx=0x7f108800cc30 comp rx=0 tx=0).stop 2024-04-25T09:11:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.650+0000 7f1094800640 1 -- 172.21.15.59:0/708946348 shutdown_connections 2024-04-25T09:11:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.650+0000 7f1094800640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1070066f60 0x7f1070069420 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.650+0000 7f1094800640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f108c0b18e0 0x7f108c150c50 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.650+0000 7f1094800640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f108c0b06d0 0x7f108c14d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.650+0000 7f1094800640 1 --2- 172.21.15.59:0/708946348 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f108c06e980 0x7f108c15e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.650+0000 7f1094800640 1 -- 172.21.15.59:0/708946348 >> 172.21.15.59:0/708946348 conn(0x7f108c066fa0 msgr2=0x7f108c0add70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.650+0000 7f1094800640 1 -- 172.21.15.59:0/708946348 shutdown_connections 2024-04-25T09:11:49.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:49.650+0000 7f1094800640 1 -- 172.21.15.59:0/708946348 wait complete. 2024-04-25T09:11:49.659 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T09:11:49.659 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T09:11:49.659 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2024-04-25T09:11:49.659 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T09:11:49.659 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:49.659 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T09:11:49.659 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-25T09:11:49.659 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T09:11:49.659 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:49.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:49.660 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2024-04-25T09:11:49.669 INFO:teuthology.orchestra.run.smithi059.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41858sec preferred_lft 41858sec 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 02:42:65:fc:85:16 brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T09:11:49.670 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-25T09:11:49.671 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2024-04-25T09:11:49.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:49.672 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T09:11:49.735 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:11:49.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:49.738 DEBUG:teuthology.orchestra.run.smithi059:> route 2024-04-25T09:11:49.790 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2024-04-25T09:11:49.790 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T09:11:49.790 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-25T09:11:49.790 INFO:teuthology.orchestra.run.smithi059.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T09:11:49.790 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-25T09:11:49.790 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T09:11:49.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:49.791 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2024-04-25T09:11:49.791 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2024-04-25T09:11:49.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-25T09:11:49.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-25T09:11:49.791 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-25T09:11:49.791 DEBUG:teuthology.orchestra.run.smithi059:> ') 2024-04-25T09:11:49.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:49.883 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:11:49.891 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:11:49.891 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:11:49.892 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:49.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:49.892 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2024-04-25T09:11:49.952 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:11:49.953 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:50.005 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T09:11:50.005 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T09:11:50.005 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:50.056 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-04-25T09:11:50.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:50.056 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:50.146 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:50.146 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:50.146 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:11:50.162 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:50.162 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:50.162 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:11:50.162 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:11:50.162 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:11:50.170 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-04-25T09:11:50.170 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-04-25T09:11:50.170 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2024-04-25T09:11:50.170 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:3300,172.21.15.178:3300,172.21.15.178:3301" 2024-04-25T09:11:50.170 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2024-04-25T09:11:50.171 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790" 2024-04-25T09:11:50.171 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.59:6789,172.21.15.178:6789,172.21.15.178:6790:/ 2024-04-25T09:11:50.171 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fbbb9dc0-22e4-4685-972c-77e9262d4773" will pass to kernel 2024-04-25T09:11:50.174 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T09:11:50.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:50.174 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:50.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:50.194 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T09:11:50.248 INFO:teuthology.orchestra.run.smithi059.stdout:client7811 2024-04-25T09:11:50.248 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:50.248 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:50.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:50.297 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-25T09:11:50.358 INFO:teuthology.orchestra.run.smithi059.stdout:./ 2024-04-25T09:11:50.358 INFO:teuthology.orchestra.run.smithi059.stdout:./parent 2024-04-25T09:11:50.358 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/flushed 2024-04-25T09:11:50.358 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/flushed/charlie 2024-04-25T09:11:50.358 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/flushed/alpha 2024-04-25T09:11:50.358 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/flushed/bravo 2024-04-25T09:11:50.358 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/unflushed 2024-04-25T09:11:50.358 INFO:teuthology.orchestra.run.smithi059.stdout:./parent/unflushed/jfile 2024-04-25T09:11:50.359 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:50.359 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:50.359 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:50.359 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:50.359 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-25T09:11:50.360 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:50.470 INFO:teuthology.orchestra.run.smithi059.stdout:1 2024-04-25T09:11:50.472 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:50.479 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:50.479 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:50.479 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:50.479 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:50.479 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-25T09:11:50.479 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:50.586 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627776 2024-04-25T09:11:50.632 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:50.633 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:50.633 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:50.633 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:50.633 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:50.633 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-25T09:11:50.633 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:50.743 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627777 2024-04-25T09:11:50.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:50.752 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:50.753 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:50.753 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:50.753 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:50.753 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-25T09:11:50.753 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:50.858 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627780 2024-04-25T09:11:50.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:50.867 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:50.867 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:50.867 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:50.868 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:50.868 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-25T09:11:50.868 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:50.978 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627778 2024-04-25T09:11:50.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:50.987 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:50.987 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:50.987 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:50.988 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:50.988 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-25T09:11:50.988 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:51.099 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627779 2024-04-25T09:11:51.102 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:51.109 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:51.109 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:51.109 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:51.109 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:51.109 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-25T09:11:51.109 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:51.214 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627781 2024-04-25T09:11:51.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:51.224 DEBUG:teuthology.orchestra.run.smithi059:> stdin-killer -- python3 -c ' 2024-04-25T09:11:51.224 DEBUG:teuthology.orchestra.run.smithi059:> import os 2024-04-25T09:11:51.224 DEBUG:teuthology.orchestra.run.smithi059:> import stat 2024-04-25T09:11:51.224 DEBUG:teuthology.orchestra.run.smithi059:> 2024-04-25T09:11:51.224 DEBUG:teuthology.orchestra.run.smithi059:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-25T09:11:51.224 DEBUG:teuthology.orchestra.run.smithi059:> ' 2024-04-25T09:11:51.334 INFO:teuthology.orchestra.run.smithi059.stdout:1099511627782 2024-04-25T09:11:51.337 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T09:11:51.343 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-25T09:11:51.343 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:11:51.500 DEBUG:teuthology.orchestra.run.smithi178:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-25T09:11:51.567 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-25T09:11:51.567 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:51.567 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:51.576 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:51.576 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:51.629 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:51.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1f200640 1 Processor -- start 2024-04-25T09:11:51.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1f200640 1 -- start start 2024-04-25T09:11:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1f200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fcb2009a170 0x7fcb200b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1f200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb200cd6c0 con 0x7fcb200cdb70 2024-04-25T09:11:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1f200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb200cce20 con 0x7fcb2015efa0 2024-04-25T09:11:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1f200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb200b3fe0 con 0x7fcb2009a170 2024-04-25T09:11:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1e800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcb200cdb70 0x7fcb200b16e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39314/0 (socket says 172.21.15.59:39314) 2024-04-25T09:11:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1e800640 1 -- 172.21.15.59:0/2906620944 learned_addr learned my addr 172.21.15.59:0/2906620944 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:51.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb15400640 1 --2- 172.21.15.59:0/2906620944 >> v2:172.21.15.178:3300/0 conn(0x7fcb2009a170 0x7fcb200b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:51.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1566916769 0 0) 0x7fcb200cd6c0 con 0x7fcb200cdb70 2024-04-25T09:11:51.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb04003530 con 0x7fcb200cdb70 2024-04-25T09:11:51.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 348022097 0 0) 0x7fcb04003530 con 0x7fcb200cdb70 2024-04-25T09:11:51.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 >> v2:172.21.15.178:3300/0 conn(0x7fcb2009a170 msgr2=0x7fcb200b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:51.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 --2- 172.21.15.59:0/2906620944 >> v2:172.21.15.178:3300/0 conn(0x7fcb2009a170 0x7fcb200b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:51.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 >> v1:172.21.15.178:6789/0 conn(0x7fcb2015efa0 legacy=0x7fcb20099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:51.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb200cd100 con 0x7fcb200cdb70 2024-04-25T09:11:51.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7fcb18001a00 con 0x7fcb200cdb70 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb15400640 1 --2- 172.21.15.59:0/2906620944 >> v2:172.21.15.178:3300/0 conn(0x7fcb2009a170 0x7fcb200b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 >> v1:172.21.15.59:6789/0 conn(0x7fcb200cdb70 legacy=0x7fcb200b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 --2- 172.21.15.59:0/2906620944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb040039c0 0x7fcb04003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 --2- 172.21.15.59:0/2906620944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 0x7fcb04004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 --2- 172.21.15.59:0/2906620944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb040051d0 0x7fcb0400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200b3fe0 con 0x7fcb04004810 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0400c070 con 0x7fcb040051d0 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0400c270 con 0x7fcb040039c0 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb15400640 1 --2- 172.21.15.59:0/2906620944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 0x7fcb04004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1de00640 1 --2- 172.21.15.59:0/2906620944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb040039c0 0x7fcb04003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1e800640 1 --2- 172.21.15.59:0/2906620944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb040051d0 0x7fcb0400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb15400640 1 -- 172.21.15.59:0/2906620944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb040039c0 msgr2=0x7fcb04003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb15400640 1 --2- 172.21.15.59:0/2906620944 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb040039c0 0x7fcb04003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb15400640 1 -- 172.21.15.59:0/2906620944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb040051d0 msgr2=0x7fcb0400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:51.822 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb15400640 1 --2- 172.21.15.59:0/2906620944 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb040051d0 0x7fcb0400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:51.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb15400640 1 -- 172.21.15.59:0/2906620944 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04003530 con 0x7fcb04004810 2024-04-25T09:11:51.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.830+0000 7fcb1e800640 1 -- 172.21.15.59:0/2906620944 reap_dead start 2024-04-25T09:11:51.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.834+0000 7fcb15400640 1 --2- 172.21.15.59:0/2906620944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 0x7fcb04004c90 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009cb0 tx=0x7fcb0801cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e13c2c04e60343e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.834+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080b2070 con 0x7fcb04004810 2024-04-25T09:11:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.834+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb080a57c0 con 0x7fcb04004810 2024-04-25T09:11:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.834+0000 7fcb1d400640 1 -- 172.21.15.59:0/2906620944 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb08009880 con 0x7fcb04004810 2024-04-25T09:11:51.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.834+0000 7fcb1f200640 1 -- 172.21.15.59:0/2906620944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 msgr2=0x7fcb04004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:51.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.834+0000 7fcb1f200640 1 --2- 172.21.15.59:0/2906620944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 0x7fcb04004c90 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fcb08009cb0 tx=0x7fcb0801cc10 comp rx=0 tx=0).stop 2024-04-25T09:11:51.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.834+0000 7fcb1f200640 1 -- 172.21.15.59:0/2906620944 shutdown_connections 2024-04-25T09:11:51.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.834+0000 7fcb1f200640 1 --2- 172.21.15.59:0/2906620944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 0x7fcb04004c90 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:51.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.834+0000 7fcb1f200640 1 -- 172.21.15.59:0/2906620944 >> 172.21.15.59:0/2906620944 conn(0x7fcb200b3050 msgr2=0x7fcb200b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:51.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.834+0000 7fcb1f200640 1 -- 172.21.15.59:0/2906620944 shutdown_connections 2024-04-25T09:11:51.825 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.834+0000 7fcb1f200640 1 -- 172.21.15.59:0/2906620944 wait complete. 2024-04-25T09:11:51.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1f200640 1 Processor -- start 2024-04-25T09:11:51.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1f200640 1 -- start start 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1f200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 0x7fcb200cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1f200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb200c6f50 0x7fcb200c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1f200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb201ee340 0x7fcb201ee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1f200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200b3b70 con 0x7fcb04004810 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1f200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2015f380 con 0x7fcb200c6f50 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1f200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200b3cf0 con 0x7fcb201ee340 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 0x7fcb200cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 0x7fcb200cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53186/0 (socket says 172.21.15.59:53186) 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1de00640 1 -- 172.21.15.59:0/1241874953 learned_addr learned my addr 172.21.15.59:0/1241874953 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1e800640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb201ee340 0x7fcb201ee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb15400640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb200c6f50 0x7fcb200c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1de00640 1 -- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb201ee340 msgr2=0x7fcb201ee7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:51.829 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1de00640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb201ee340 0x7fcb201ee7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:51.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1de00640 1 -- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb200c6f50 msgr2=0x7fcb200c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:51.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1de00640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb200c6f50 0x7fcb200c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:51.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1de00640 1 -- 172.21.15.59:0/1241874953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb200c7c40 con 0x7fcb04004810 2024-04-25T09:11:51.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1de00640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 0x7fcb200cac10 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000f770 tx=0x7fcb1000fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:51.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb16a00640 1 -- 172.21.15.59:0/1241874953 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb100050d0 con 0x7fcb04004810 2024-04-25T09:11:51.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb16a00640 1 -- 172.21.15.59:0/1241874953 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb10018070 con 0x7fcb04004810 2024-04-25T09:11:51.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb16a00640 1 -- 172.21.15.59:0/1241874953 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000d730 con 0x7fcb04004810 2024-04-25T09:11:51.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1f200640 1 -- 172.21.15.59:0/1241874953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb2015b9a0 con 0x7fcb04004810 2024-04-25T09:11:51.830 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.838+0000 7fcb1f200640 1 -- 172.21.15.59:0/1241874953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb200c7910 con 0x7fcb04004810 2024-04-25T09:11:51.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.842+0000 7fcb1f200640 1 -- 172.21.15.59:0/1241874953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb2004efa0 con 0x7fcb04004810 2024-04-25T09:11:51.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.842+0000 7fcb16a00640 1 -- 172.21.15.59:0/1241874953 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fcb1000d8d0 con 0x7fcb04004810 2024-04-25T09:11:51.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.842+0000 7fcb16a00640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcafc066f90 0x7fcafc069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:51.831 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.842+0000 7fcb16a00640 1 -- 172.21.15.59:0/1241874953 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fcb10085090 con 0x7fcb04004810 2024-04-25T09:11:51.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.842+0000 7fcb15400640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcafc066f90 0x7fcafc069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:51.832 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.842+0000 7fcb15400640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcafc066f90 0x7fcafc069450 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fcb080af000 tx=0x7fcb08008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:51.835 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:51.846+0000 7fcb16a00640 1 -- 172.21.15.59:0/1241874953 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fcb10055e50 con 0x7fcb04004810 2024-04-25T09:11:52.003 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.014+0000 7fcb1f200640 1 -- 172.21.15.59:0/1241874953 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb20099d40 con 0x7fcb04004810 2024-04-25T09:11:52.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.014+0000 7fcb16a00640 1 -- 172.21.15.59:0/1241874953 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+17207 (secure 0 0 0) 0x7fcb10055750 con 0x7fcb04004810 2024-04-25T09:11:52.004 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:52.005 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":123,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:42.673680+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:15.429862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:16.011038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/29546856":"2024-04-26T09:11:31.741997+0000","172.21.15.59:6833/1679876837":"2024-04-26T09:11:42.673656+0000","172.21.15.59:6832/1679876837":"2024-04-26T09:11:42.673656+0000","172.21.15.59:6834/29546856":"2024-04-26T09:11:31.741997+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.018+0000 7fcb1f200640 1 -- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcafc066f90 msgr2=0x7fcafc069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.018+0000 7fcb1f200640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcafc066f90 0x7fcafc069450 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fcb080af000 tx=0x7fcb08008040 comp rx=0 tx=0).stop 2024-04-25T09:11:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.018+0000 7fcb1f200640 1 -- 172.21.15.59:0/1241874953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 msgr2=0x7fcb200cac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.018+0000 7fcb1f200640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 0x7fcb200cac10 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fcb1000f770 tx=0x7fcb1000fc30 comp rx=0 tx=0).stop 2024-04-25T09:11:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.018+0000 7fcb1f200640 1 -- 172.21.15.59:0/1241874953 shutdown_connections 2024-04-25T09:11:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.018+0000 7fcb1f200640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fcafc066f90 0x7fcafc069450 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.018+0000 7fcb1f200640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fcb201ee340 0x7fcb201ee7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.018+0000 7fcb1f200640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fcb200c6f50 0x7fcb200c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.018+0000 7fcb1f200640 1 --2- 172.21.15.59:0/1241874953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb04004810 0x7fcb200cac10 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.007 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.018+0000 7fcb1f200640 1 -- 172.21.15.59:0/1241874953 >> 172.21.15.59:0/1241874953 conn(0x7fcb200b3050 msgr2=0x7fcb200aef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:52.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.018+0000 7fcb1f200640 1 -- 172.21.15.59:0/1241874953 shutdown_connections 2024-04-25T09:11:52.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.018+0000 7fcb1f200640 1 -- 172.21.15.59:0/1241874953 wait complete. 2024-04-25T09:11:52.026 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:11:15.429862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:11:16.011038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:52.026 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:52.169 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.178+0000 7fc869e00640 1 Processor -- start 2024-04-25T09:11:52.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc869e00640 1 -- start start 2024-04-25T09:11:52.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc869e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc864072210 0x7fc8640cdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc869e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc8640ce1d0 0x7fc8640ce640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc869e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86406ac10 con 0x7fc86415dd90 2024-04-25T09:11:52.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc869e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8640b2dc0 con 0x7fc8640ce1d0 2024-04-25T09:11:52.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc869e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86406aeb0 con 0x7fc864072210 2024-04-25T09:11:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc85a000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc864072210 0x7fc8640cdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc863400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc8640ce1d0 0x7fc8640ce640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc863400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fc8640ce1d0 0x7fc8640ce640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:36644/0 (socket says 172.21.15.59:36644) 2024-04-25T09:11:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc85a000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc864072210 0x7fc8640cdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:32912/0 (socket says 172.21.15.59:32912) 2024-04-25T09:11:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc863400640 1 -- 172.21.15.59:0/3784279598 learned_addr learned my addr 172.21.15.59:0/3784279598 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc863400640 1 -- 172.21.15.59:0/3784279598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc864072210 msgr2=0x7fc8640cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc863400640 1 --2- 172.21.15.59:0/3784279598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc864072210 0x7fc8640cdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc863400640 1 -- 172.21.15.59:0/3784279598 >> v1:172.21.15.178:6789/0 conn(0x7fc86415dd90 legacy=0x7fc864071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.182+0000 7fc863400640 1 -- 172.21.15.59:0/3784279598 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86406b190 con 0x7fc8640ce1d0 2024-04-25T09:11:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.186+0000 7fc863400640 1 --2- 172.21.15.59:0/3784279598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8640ce1d0 0x7fc8640ce640 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009e50 tx=0x7fc85c01c9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f165aa9fcdb6fc00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.186+0000 7fc862000640 1 -- 172.21.15.59:0/3784279598 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c0a5710 con 0x7fc8640ce1d0 2024-04-25T09:11:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.186+0000 7fc862000640 1 -- 172.21.15.59:0/3784279598 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c0a58b0 con 0x7fc8640ce1d0 2024-04-25T09:11:52.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.186+0000 7fc862000640 1 -- 172.21.15.59:0/3784279598 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c0a5c80 con 0x7fc8640ce1d0 2024-04-25T09:11:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.186+0000 7fc869e00640 1 -- 172.21.15.59:0/3784279598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8640ce1d0 msgr2=0x7fc8640ce640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.186+0000 7fc869e00640 1 --2- 172.21.15.59:0/3784279598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8640ce1d0 0x7fc8640ce640 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fc85c009e50 tx=0x7fc85c01c9a0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.186+0000 7fc869e00640 1 -- 172.21.15.59:0/3784279598 shutdown_connections 2024-04-25T09:11:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.186+0000 7fc869e00640 1 --2- 172.21.15.59:0/3784279598 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc8640ce1d0 0x7fc8640ce640 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.186+0000 7fc869e00640 1 --2- 172.21.15.59:0/3784279598 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc864072210 0x7fc8640cdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.186+0000 7fc869e00640 1 -- 172.21.15.59:0/3784279598 >> 172.21.15.59:0/3784279598 conn(0x7fc8640cfd90 msgr2=0x7fc8640d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.186+0000 7fc869e00640 1 -- 172.21.15.59:0/3784279598 shutdown_connections 2024-04-25T09:11:52.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.186+0000 7fc869e00640 1 -- 172.21.15.59:0/3784279598 wait complete. 2024-04-25T09:11:52.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc869e00640 1 Processor -- start 2024-04-25T09:11:52.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc869e00640 1 -- start start 2024-04-25T09:11:52.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc869e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc864072210 0x7fc8641491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc869e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8640ce1d0 0x7fc86414bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc869e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc86415dd90 0x7fc86414c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc869e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640cf720 con 0x7fc8640ce1d0 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc869e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640cf5a0 con 0x7fc864072210 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc869e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8640cf8a0 con 0x7fc86415dd90 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc85a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8640ce1d0 0x7fc86414bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc85a000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8640ce1d0 0x7fc86414bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53188/0 (socket says 172.21.15.59:53188) 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc85a000640 1 -- 172.21.15.59:0/1264440502 learned_addr learned my addr 172.21.15.59:0/1264440502 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc862a00640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc864072210 0x7fc8641491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc863400640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc86415dd90 0x7fc86414c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc85a000640 1 -- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc86415dd90 msgr2=0x7fc86414c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc85a000640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc86415dd90 0x7fc86414c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc85a000640 1 -- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc864072210 msgr2=0x7fc8641491b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc85a000640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc864072210 0x7fc8641491b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc85a000640 1 -- 172.21.15.59:0/1264440502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8640ae6c0 con 0x7fc8640ce1d0 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc863400640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc86415dd90 0x7fc86414c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc862a00640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc864072210 0x7fc8641491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:52.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc85a000640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8640ce1d0 0x7fc86414bdd0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00e8a0 tx=0x7fc84c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc85be00640 1 -- 172.21.15.59:0/1264440502 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c017070 con 0x7fc8640ce1d0 2024-04-25T09:11:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc85be00640 1 -- 172.21.15.59:0/1264440502 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c00c8e0 con 0x7fc8640ce1d0 2024-04-25T09:11:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc85be00640 1 -- 172.21.15.59:0/1264440502 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00cc90 con 0x7fc8640ce1d0 2024-04-25T09:11:52.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc869e00640 1 -- 172.21.15.59:0/1264440502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8640ae100 con 0x7fc8640ce1d0 2024-04-25T09:11:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc869e00640 1 -- 172.21.15.59:0/1264440502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86414eb00 con 0x7fc8640ce1d0 2024-04-25T09:11:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.190+0000 7fc869e00640 1 -- 172.21.15.59:0/1264440502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8640745d0 con 0x7fc8640ce1d0 2024-04-25T09:11:52.182 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.194+0000 7fc85be00640 1 -- 172.21.15.59:0/1264440502 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc84c01a070 con 0x7fc8640ce1d0 2024-04-25T09:11:52.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.194+0000 7fc85be00640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc840066f90 0x7fc840069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.194+0000 7fc85be00640 1 -- 172.21.15.59:0/1264440502 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fc84c085170 con 0x7fc8640ce1d0 2024-04-25T09:11:52.183 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.194+0000 7fc862a00640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc840066f90 0x7fc840069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.184 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.194+0000 7fc862a00640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc840066f90 0x7fc840069450 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc854001670 tx=0x7fc854009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:52.187 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.198+0000 7fc85be00640 1 -- 172.21.15.59:0/1264440502 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc84c055ea0 con 0x7fc8640ce1d0 2024-04-25T09:11:52.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.358+0000 7fc869e00640 1 -- 172.21.15.59:0/1264440502 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc864162300 con 0x7fc8640ce1d0 2024-04-25T09:11:52.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.358+0000 7fc85be00640 1 -- 172.21.15.59:0/1264440502 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc84c0557a0 con 0x7fc8640ce1d0 2024-04-25T09:11:52.349 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:11:52.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.362+0000 7fc869e00640 1 -- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc840066f90 msgr2=0x7fc840069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.362+0000 7fc869e00640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc840066f90 0x7fc840069450 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc854001670 tx=0x7fc854009040 comp rx=0 tx=0).stop 2024-04-25T09:11:52.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.362+0000 7fc869e00640 1 -- 172.21.15.59:0/1264440502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8640ce1d0 msgr2=0x7fc86414bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.362+0000 7fc869e00640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8640ce1d0 0x7fc86414bdd0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00e8a0 tx=0x7fc84c00eca0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.362+0000 7fc869e00640 1 -- 172.21.15.59:0/1264440502 shutdown_connections 2024-04-25T09:11:52.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.362+0000 7fc869e00640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc840066f90 0x7fc840069450 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.362+0000 7fc869e00640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc86415dd90 0x7fc86414c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.362+0000 7fc869e00640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8640ce1d0 0x7fc86414bdd0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.362+0000 7fc869e00640 1 --2- 172.21.15.59:0/1264440502 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc864072210 0x7fc8641491b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.362+0000 7fc869e00640 1 -- 172.21.15.59:0/1264440502 >> 172.21.15.59:0/1264440502 conn(0x7fc8640cfd90 msgr2=0x7fc8640d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:52.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.362+0000 7fc869e00640 1 -- 172.21.15.59:0/1264440502 shutdown_connections 2024-04-25T09:11:52.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.362+0000 7fc869e00640 1 -- 172.21.15.59:0/1264440502 wait complete. 2024-04-25T09:11:52.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:11:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.522+0000 7f3a59200640 1 Processor -- start 2024-04-25T09:11:52.513 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a59200640 1 -- start start 2024-04-25T09:11:52.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a59200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3a5415dd90 0x7f3a54071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a59200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a54161e90 0x7f3a540ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a59200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a54072460 con 0x7f3a54072040 2024-04-25T09:11:52.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a59200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a540b2dc0 con 0x7f3a54161e90 2024-04-25T09:11:52.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a59200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5406ac10 con 0x7f3a5415dd90 2024-04-25T09:11:52.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a52800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a54161e90 0x7f3a540ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a52800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a54161e90 0x7f3a540ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53192/0 (socket says 172.21.15.59:53192) 2024-04-25T09:11:52.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a52800640 1 -- 172.21.15.59:0/2219364673 learned_addr learned my addr 172.21.15.59:0/2219364673 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:52.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a51e00640 1 --2- 172.21.15.59:0/2219364673 >> v2:172.21.15.178:3300/0 conn(0x7f3a5415dd90 0x7f3a54071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a52800640 1 -- 172.21.15.59:0/2219364673 >> v2:172.21.15.178:3300/0 conn(0x7f3a5415dd90 msgr2=0x7f3a54071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:52.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a52800640 1 --2- 172.21.15.59:0/2219364673 >> v2:172.21.15.178:3300/0 conn(0x7f3a5415dd90 0x7f3a54071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a52800640 1 -- 172.21.15.59:0/2219364673 >> v1:172.21.15.178:6789/0 conn(0x7f3a54072040 legacy=0x7f3a54161780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:52.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a52800640 1 -- 172.21.15.59:0/2219364673 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5406aeb0 con 0x7f3a54161e90 2024-04-25T09:11:52.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.526+0000 7f3a51e00640 1 --2- 172.21.15.59:0/2219364673 >> v2:172.21.15.178:3300/0 conn(0x7f3a5415dd90 0x7f3a54071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:52.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a52800640 1 --2- 172.21.15.59:0/2219364673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a54161e90 0x7f3a540ceca0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f3a54070be0 tx=0x7f3a4c01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9fb595d618fc98 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:52.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a51400640 1 -- 172.21.15.59:0/2219364673 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0a5710 con 0x7f3a54161e90 2024-04-25T09:11:52.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a51400640 1 -- 172.21.15.59:0/2219364673 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c0a58b0 con 0x7f3a54161e90 2024-04-25T09:11:52.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a51400640 1 -- 172.21.15.59:0/2219364673 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0a5c80 con 0x7f3a54161e90 2024-04-25T09:11:52.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a59200640 1 -- 172.21.15.59:0/2219364673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a54161e90 msgr2=0x7f3a540ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a59200640 1 --2- 172.21.15.59:0/2219364673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a54161e90 0x7f3a540ceca0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f3a54070be0 tx=0x7f3a4c01c960 comp rx=0 tx=0).stop 2024-04-25T09:11:52.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a59200640 1 -- 172.21.15.59:0/2219364673 shutdown_connections 2024-04-25T09:11:52.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a59200640 1 --2- 172.21.15.59:0/2219364673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a54161e90 0x7f3a540ceca0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a59200640 1 --2- 172.21.15.59:0/2219364673 >> v2:172.21.15.178:3300/0 conn(0x7f3a5415dd90 0x7f3a54071b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a59200640 1 -- 172.21.15.59:0/2219364673 >> 172.21.15.59:0/2219364673 conn(0x7f3a540cfd90 msgr2=0x7f3a540d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:52.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a59200640 1 -- 172.21.15.59:0/2219364673 shutdown_connections 2024-04-25T09:11:52.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a59200640 1 -- 172.21.15.59:0/2219364673 wait complete. 2024-04-25T09:11:52.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a59200640 1 Processor -- start 2024-04-25T09:11:52.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.530+0000 7f3a59200640 1 -- start start 2024-04-25T09:11:52.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a59200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a54072040 0x7f3a5414de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a59200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a5415dd90 0x7f3a54154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a59200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a54161e90 0x7f3a5415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a59200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5416ac40 con 0x7f3a5415dd90 2024-04-25T09:11:52.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a59200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5416aac0 con 0x7f3a54161e90 2024-04-25T09:11:52.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a59200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5416adc0 con 0x7f3a54072040 2024-04-25T09:11:52.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a49400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a5415dd90 0x7f3a54154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a49400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a5415dd90 0x7f3a54154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53206/0 (socket says 172.21.15.59:53206) 2024-04-25T09:11:52.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a49400640 1 -- 172.21.15.59:0/3266757077 learned_addr learned my addr 172.21.15.59:0/3266757077 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:52.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a52800640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a54161e90 0x7f3a5415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a51e00640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a54072040 0x7f3a5414de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a49400640 1 -- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a54072040 msgr2=0x7f3a5414de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a49400640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a54072040 0x7f3a5414de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a49400640 1 -- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a54161e90 msgr2=0x7f3a5415e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a49400640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a54161e90 0x7f3a5415e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a49400640 1 -- 172.21.15.59:0/3266757077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5415f290 con 0x7f3a5415dd90 2024-04-25T09:11:52.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a49400640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a5415dd90 0x7f3a54154cd0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00c370 tx=0x7f3a3c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:52.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a4aa00640 1 -- 172.21.15.59:0/3266757077 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c0052d0 con 0x7f3a5415dd90 2024-04-25T09:11:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a4aa00640 1 -- 172.21.15.59:0/3266757077 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3c005470 con 0x7f3a5415dd90 2024-04-25T09:11:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a59200640 1 -- 172.21.15.59:0/3266757077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5415ecd0 con 0x7f3a5415dd90 2024-04-25T09:11:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a4aa00640 1 -- 172.21.15.59:0/3266757077 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3c007260 con 0x7f3a5415dd90 2024-04-25T09:11:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a59200640 1 -- 172.21.15.59:0/3266757077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5414e710 con 0x7f3a5415dd90 2024-04-25T09:11:52.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.534+0000 7f3a59200640 1 -- 172.21.15.59:0/3266757077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a540745d0 con 0x7f3a5415dd90 2024-04-25T09:11:52.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.538+0000 7f3a4aa00640 1 -- 172.21.15.59:0/3266757077 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3a3c007400 con 0x7f3a5415dd90 2024-04-25T09:11:52.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.538+0000 7f3a4aa00640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3a30066f60 0x7f3a30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.538+0000 7f3a4aa00640 1 -- 172.21.15.59:0/3266757077 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f3a3c0846f0 con 0x7f3a5415dd90 2024-04-25T09:11:52.530 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.538+0000 7f3a51e00640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3a30066f60 0x7f3a30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.538+0000 7f3a51e00640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3a30066f60 0x7f3a30069420 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3a44006e90 tx=0x7f3a44008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:52.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.542+0000 7f3a4aa00640 1 -- 172.21.15.59:0/3266757077 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f3a3c054dd0 con 0x7f3a5415dd90 2024-04-25T09:11:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 -- 172.21.15.59:0/3266757077 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3a54072700 con 0x7f3a5415dd90 2024-04-25T09:11:52.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a4aa00640 1 -- 172.21.15.59:0/3266757077 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3a3c058e70 con 0x7f3a5415dd90 2024-04-25T09:11:52.694 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:11:52.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 -- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3a30066f60 msgr2=0x7f3a30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3a30066f60 0x7f3a30069420 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3a44006e90 tx=0x7f3a44008040 comp rx=0 tx=0).stop 2024-04-25T09:11:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 -- 172.21.15.59:0/3266757077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a5415dd90 msgr2=0x7f3a54154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a5415dd90 0x7f3a54154cd0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c00c370 tx=0x7f3a3c00c830 comp rx=0 tx=0).stop 2024-04-25T09:11:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 -- 172.21.15.59:0/3266757077 shutdown_connections 2024-04-25T09:11:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3a30066f60 0x7f3a30069420 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3a54161e90 0x7f3a5415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a5415dd90 0x7f3a54154cd0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 --2- 172.21.15.59:0/3266757077 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3a54072040 0x7f3a5414de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 -- 172.21.15.59:0/3266757077 >> 172.21.15.59:0/3266757077 conn(0x7f3a540cfd90 msgr2=0x7f3a5415c180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 -- 172.21.15.59:0/3266757077 shutdown_connections 2024-04-25T09:11:52.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.706+0000 7f3a59200640 1 -- 172.21.15.59:0/3266757077 wait complete. 2024-04-25T09:11:52.715 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:11:52.859 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.870+0000 7f8f63200640 1 Processor -- start 2024-04-25T09:11:52.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.870+0000 7f8f63200640 1 -- start start 2024-04-25T09:11:52.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.870+0000 7f8f63200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8f640b4190 0x7f8f640b0750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.870+0000 7f8f63200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640b0c90 0x7f8f6415bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.870+0000 7f8f63200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f640b30f0 con 0x7f8f64144e20 2024-04-25T09:11:52.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.870+0000 7f8f63200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f640b33d0 con 0x7f8f640b4190 2024-04-25T09:11:52.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.870+0000 7f8f63200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b36b0 con 0x7f8f640b0c90 2024-04-25T09:11:52.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.870+0000 7f8f61e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8f64144e20 0x7f8f6406d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39324/0 (socket says 172.21.15.59:39324) 2024-04-25T09:11:52.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.870+0000 7f8f61e00640 1 -- 172.21.15.59:0/2627368125 learned_addr learned my addr 172.21.15.59:0/2627368125 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:52.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1176154957 0 0) 0x7f8f640b30f0 con 0x7f8f64144e20 2024-04-25T09:11:52.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f62800640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640b0c90 0x7f8f6415bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f59400640 1 --2- 172.21.15.59:0/2627368125 >> v2:172.21.15.178:3300/0 conn(0x7f8f640b4190 0x7f8f640b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f48003530 con 0x7f8f64144e20 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909957593 0 0) 0x7f8f48003530 con 0x7f8f64144e20 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640b0c90 msgr2=0x7f8f6415bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640b0c90 0x7f8f6415bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 >> v2:172.21.15.178:3300/0 conn(0x7f8f640b4190 msgr2=0x7f8f640b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 --2- 172.21.15.59:0/2627368125 >> v2:172.21.15.178:3300/0 conn(0x7f8f640b4190 0x7f8f640b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f640b3990 con 0x7f8f64144e20 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f8f54001680 con 0x7f8f64144e20 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 >> v1:172.21.15.59:6789/0 conn(0x7f8f64144e20 legacy=0x7f8f6406d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640b0c90 0x7f8f480039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48003f90 0x7f8f48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f48004d50 0x7f8f480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b33d0 con 0x7f8f48003f90 2024-04-25T09:11:52.864 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b36b0 con 0x7f8f48004d50 2024-04-25T09:11:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4800b9d0 con 0x7f8f640b0c90 2024-04-25T09:11:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f59400640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48003f90 0x7f8f48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61e00640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640b0c90 0x7f8f480039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f62800640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f48004d50 0x7f8f480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f59400640 1 -- 172.21.15.59:0/2627368125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640b0c90 msgr2=0x7f8f480039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f59400640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640b0c90 0x7f8f480039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f59400640 1 -- 172.21.15.59:0/2627368125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f48004d50 msgr2=0x7f8f480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f59400640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f48004d50 0x7f8f480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f59400640 1 -- 172.21.15.59:0/2627368125 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f48003530 con 0x7f8f48003f90 2024-04-25T09:11:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.874+0000 7f8f61e00640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f640b0c90 0x7f8f480039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:52.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f59400640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48003f90 0x7f8f48004810 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009ae0 tx=0x7f8f4c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29eacb1fc3d083e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:52.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0b2070 con 0x7f8f48003f90 2024-04-25T09:11:52.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4c0a5550 con 0x7f8f48003f90 2024-04-25T09:11:52.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f61400640 1 -- 172.21.15.59:0/2627368125 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0096b0 con 0x7f8f48003f90 2024-04-25T09:11:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f63200640 1 -- 172.21.15.59:0/2627368125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48003f90 msgr2=0x7f8f48004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f63200640 1 --2- 172.21.15.59:0/2627368125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48003f90 0x7f8f48004810 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c009ae0 tx=0x7f8f4c01ca70 comp rx=0 tx=0).stop 2024-04-25T09:11:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f62800640 1 -- 172.21.15.59:0/2627368125 reap_dead start 2024-04-25T09:11:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f63200640 1 -- 172.21.15.59:0/2627368125 shutdown_connections 2024-04-25T09:11:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f63200640 1 -- 172.21.15.59:0/2627368125 >> 172.21.15.59:0/2627368125 conn(0x7f8f64066fa0 msgr2=0x7f8f6406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f63200640 1 -- 172.21.15.59:0/2627368125 shutdown_connections 2024-04-25T09:11:52.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f63200640 1 -- 172.21.15.59:0/2627368125 wait complete. 2024-04-25T09:11:52.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f63200640 1 Processor -- start 2024-04-25T09:11:52.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.878+0000 7f8f63200640 1 -- start start 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f63200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48003f90 0x7f8f6413be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f63200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6415bfc0 0x7f8f641e5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f63200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f6415c400 0x7f8f641e5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f63200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b2d30 con 0x7f8f48003f90 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f63200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6406dad0 con 0x7f8f6415c400 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f63200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f640b2eb0 con 0x7f8f6415bfc0 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f61e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48003f90 0x7f8f6413be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f61e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48003f90 0x7f8f6413be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53232/0 (socket says 172.21.15.59:53232) 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f61e00640 1 -- 172.21.15.59:0/2275327901 learned_addr learned my addr 172.21.15.59:0/2275327901 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f59400640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6415bfc0 0x7f8f641e5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f62800640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f6415c400 0x7f8f641e5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f61e00640 1 -- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6415bfc0 msgr2=0x7f8f641e5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f61e00640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6415bfc0 0x7f8f641e5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f61e00640 1 -- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f6415c400 msgr2=0x7f8f641e5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f61e00640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f6415c400 0x7f8f641e5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f61e00640 1 -- 172.21.15.59:0/2275327901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f64155d10 con 0x7f8f48003f90 2024-04-25T09:11:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f61e00640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48003f90 0x7f8f6413be40 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f8f54011810 tx=0x7f8f54011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f5aa00640 1 -- 172.21.15.59:0/2275327901 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f54010040 con 0x7f8f48003f90 2024-04-25T09:11:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f5aa00640 1 -- 172.21.15.59:0/2275327901 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5401a070 con 0x7f8f48003f90 2024-04-25T09:11:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f63200640 1 -- 172.21.15.59:0/2275327901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f64155fd0 con 0x7f8f48003f90 2024-04-25T09:11:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f5aa00640 1 -- 172.21.15.59:0/2275327901 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5400fd60 con 0x7f8f48003f90 2024-04-25T09:11:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f63200640 1 -- 172.21.15.59:0/2275327901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f64156590 con 0x7f8f48003f90 2024-04-25T09:11:52.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f63200640 1 -- 172.21.15.59:0/2275327901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f640745d0 con 0x7f8f48003f90 2024-04-25T09:11:52.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.882+0000 7f8f5aa00640 1 -- 172.21.15.59:0/2275327901 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8f5401f460 con 0x7f8f48003f90 2024-04-25T09:11:52.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.886+0000 7f8f5aa00640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f40066f60 0x7f8f40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:52.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.886+0000 7f8f5aa00640 1 -- 172.21.15.59:0/2275327901 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f8f54088480 con 0x7f8f48003f90 2024-04-25T09:11:52.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.886+0000 7f8f59400640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f40066f60 0x7f8f40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:52.875 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.886+0000 7f8f59400640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f40066f60 0x7f8f40069420 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0af000 tx=0x7f8f4c0046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:52.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:52.890+0000 7f8f5aa00640 1 -- 172.21.15.59:0/2275327901 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8f540591b0 con 0x7f8f48003f90 2024-04-25T09:11:53.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 -- 172.21.15.59:0/2275327901 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f6406c1d0 con 0x7f8f48003f90 2024-04-25T09:11:53.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f5aa00640 1 -- 172.21.15.59:0/2275327901 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f54058ab0 con 0x7f8f48003f90 2024-04-25T09:11:53.042 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:11:53.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 -- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f40066f60 msgr2=0x7f8f40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f40066f60 0x7f8f40069420 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0af000 tx=0x7f8f4c0046d0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 -- 172.21.15.59:0/2275327901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48003f90 msgr2=0x7f8f6413be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48003f90 0x7f8f6413be40 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f8f54011810 tx=0x7f8f54011cd0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 -- 172.21.15.59:0/2275327901 shutdown_connections 2024-04-25T09:11:53.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8f40066f60 0x7f8f40069420 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8f6415c400 0x7f8f641e5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8f6415bfc0 0x7f8f641e5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 --2- 172.21.15.59:0/2275327901 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f48003f90 0x7f8f6413be40 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 -- 172.21.15.59:0/2275327901 >> 172.21.15.59:0/2275327901 conn(0x7f8f64066fa0 msgr2=0x7f8f64141db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 -- 172.21.15.59:0/2275327901 shutdown_connections 2024-04-25T09:11:53.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.054+0000 7f8f63200640 1 -- 172.21.15.59:0/2275327901 wait complete. 2024-04-25T09:11:53.063 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T09:11:53.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.214+0000 7fc45e000640 1 Processor -- start 2024-04-25T09:11:53.205 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.214+0000 7fc45e000640 1 -- start start 2024-04-25T09:11:53.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc45e000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc45815c9b0 0x7fc45806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc45e000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc45806e010 0x7fc45806e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.206 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc45e000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc45815fc00 con 0x7fc458159320 2024-04-25T09:11:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc45e000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc45806d640 con 0x7fc45806e010 2024-04-25T09:11:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc45e000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc45815fee0 con 0x7fc45815c9b0 2024-04-25T09:11:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc457400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fc458159320 0x7fc45815f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39340/0 (socket says 172.21.15.59:39340) 2024-04-25T09:11:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc457400640 1 -- 172.21.15.59:0/294256114 learned_addr learned my addr 172.21.15.59:0/294256114 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc457e00640 1 --2- 172.21.15.59:0/294256114 >> v2:172.21.15.59:3300/0 conn(0x7fc45806e010 0x7fc45806e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc44ea00640 1 --2- 172.21.15.59:0/294256114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc45815c9b0 0x7fc45806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc457e00640 1 -- 172.21.15.59:0/294256114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc45815c9b0 msgr2=0x7fc45806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc457e00640 1 --2- 172.21.15.59:0/294256114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc45815c9b0 0x7fc45806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc457e00640 1 -- 172.21.15.59:0/294256114 >> v1:172.21.15.59:6789/0 conn(0x7fc458159320 legacy=0x7fc45815f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc456a00640 1 -- 172.21.15.59:0/294256114 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106984858 0 0) 0x7fc45815fc00 con 0x7fc458159320 2024-04-25T09:11:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.218+0000 7fc457e00640 1 -- 172.21.15.59:0/294256114 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4581601c0 con 0x7fc45806e010 2024-04-25T09:11:53.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc457e00640 1 --2- 172.21.15.59:0/294256114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc45806e010 0x7fc45806e4a0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fc4500097c0 tx=0x7fc45001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3272416d0caf89b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:53.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc456a00640 1 -- 172.21.15.59:0/294256114 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500b0070 con 0x7fc45806e010 2024-04-25T09:11:53.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc456a00640 1 -- 172.21.15.59:0/294256114 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4500ab600 con 0x7fc45806e010 2024-04-25T09:11:53.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc456a00640 1 -- 172.21.15.59:0/294256114 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4500ab9d0 con 0x7fc45806e010 2024-04-25T09:11:53.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 -- 172.21.15.59:0/294256114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc45806e010 msgr2=0x7fc45806e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 --2- 172.21.15.59:0/294256114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc45806e010 0x7fc45806e4a0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fc4500097c0 tx=0x7fc45001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 -- 172.21.15.59:0/294256114 shutdown_connections 2024-04-25T09:11:53.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 --2- 172.21.15.59:0/294256114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc45806e010 0x7fc45806e4a0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 --2- 172.21.15.59:0/294256114 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc45815c9b0 0x7fc45806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 -- 172.21.15.59:0/294256114 >> 172.21.15.59:0/294256114 conn(0x7fc458067080 msgr2=0x7fc45806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:53.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 -- 172.21.15.59:0/294256114 shutdown_connections 2024-04-25T09:11:53.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 -- 172.21.15.59:0/294256114 wait complete. 2024-04-25T09:11:53.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 Processor -- start 2024-04-25T09:11:53.212 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 -- start start 2024-04-25T09:11:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc45806e010 0x7fc458157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc458159320 0x7fc458133f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc45815c9b0 0x7fc4581321b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.222+0000 7fc45e000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc458168920 con 0x7fc45806e010 2024-04-25T09:11:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc45e000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4581687a0 con 0x7fc458159320 2024-04-25T09:11:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc45e000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc458168aa0 con 0x7fc45815c9b0 2024-04-25T09:11:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc457400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc45806e010 0x7fc458157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc457400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc45806e010 0x7fc458157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53244/0 (socket says 172.21.15.59:53244) 2024-04-25T09:11:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc457400640 1 -- 172.21.15.59:0/8502411 learned_addr learned my addr 172.21.15.59:0/8502411 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:53.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc44ea00640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc458159320 0x7fc458133f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc457e00640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc45815c9b0 0x7fc4581321b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc457400640 1 -- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc45815c9b0 msgr2=0x7fc4581321b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc457400640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc45815c9b0 0x7fc4581321b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc457400640 1 -- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc458159320 msgr2=0x7fc458133f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc457400640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc458159320 0x7fc458133f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc457400640 1 -- 172.21.15.59:0/8502411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc458132ea0 con 0x7fc45806e010 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc457e00640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc45815c9b0 0x7fc4581321b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc457400640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc45806e010 0x7fc458157fd0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c890 tx=0x7fc44800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc44fe00640 1 -- 172.21.15.59:0/8502411 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448018070 con 0x7fc45806e010 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc44fe00640 1 -- 172.21.15.59:0/8502411 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44800a640 con 0x7fc45806e010 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc44fe00640 1 -- 172.21.15.59:0/8502411 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44800aa30 con 0x7fc45806e010 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc45e000640 1 -- 172.21.15.59:0/8502411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc458133180 con 0x7fc45806e010 2024-04-25T09:11:53.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc45e000640 1 -- 172.21.15.59:0/8502411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc458133740 con 0x7fc45806e010 2024-04-25T09:11:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc45e000640 1 -- 172.21.15.59:0/8502411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4580745d0 con 0x7fc45806e010 2024-04-25T09:11:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.226+0000 7fc44fe00640 1 -- 172.21.15.59:0/8502411 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fc44800abd0 con 0x7fc45806e010 2024-04-25T09:11:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.230+0000 7fc44fe00640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc434066f60 0x7fc434069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.217 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.230+0000 7fc44fe00640 1 -- 172.21.15.59:0/8502411 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fc4480849c0 con 0x7fc45806e010 2024-04-25T09:11:53.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.230+0000 7fc44ea00640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc434066f60 0x7fc434069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.230+0000 7fc44ea00640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc434066f60 0x7fc434069420 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc458073d30 tx=0x7fc440008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:53.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.230+0000 7fc44fe00640 1 -- 172.21.15.59:0/8502411 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fc4480556f0 con 0x7fc45806e010 2024-04-25T09:11:53.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.406+0000 7fc45e000640 1 -- 172.21.15.59:0/8502411 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc4580cba10 con 0x7fc45806e010 2024-04-25T09:11:53.397 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.406+0000 7fc44fe00640 1 -- 172.21.15.59:0/8502411 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v123) v1 ==== 80+0+240 (secure 0 0 0) 0x7fc448054ff0 con 0x7fc45806e010 2024-04-25T09:11:53.397 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6835/29546856 2024-04-26T09:11:31.741997+0000 2024-04-25T09:11:53.397 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6833/1679876837 2024-04-26T09:11:42.673656+0000 2024-04-25T09:11:53.397 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6832/1679876837 2024-04-26T09:11:42.673656+0000 2024-04-25T09:11:53.398 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.15.59:6834/29546856 2024-04-26T09:11:31.741997+0000 2024-04-25T09:11:53.398 INFO:teuthology.orchestra.run.smithi059.stderr:listed 4 entries 2024-04-25T09:11:53.399 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.410+0000 7fc45e000640 1 -- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc434066f60 msgr2=0x7fc434069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.410+0000 7fc45e000640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc434066f60 0x7fc434069420 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc458073d30 tx=0x7fc440008040 comp rx=0 tx=0).stop 2024-04-25T09:11:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.410+0000 7fc45e000640 1 -- 172.21.15.59:0/8502411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc45806e010 msgr2=0x7fc458157fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.410+0000 7fc45e000640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc45806e010 0x7fc458157fd0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c890 tx=0x7fc44800cd50 comp rx=0 tx=0).stop 2024-04-25T09:11:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.410+0000 7fc45e000640 1 -- 172.21.15.59:0/8502411 shutdown_connections 2024-04-25T09:11:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.410+0000 7fc45e000640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fc434066f60 0x7fc434069420 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.410+0000 7fc45e000640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fc45815c9b0 0x7fc4581321b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.410+0000 7fc45e000640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fc458159320 0x7fc458133f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.410+0000 7fc45e000640 1 --2- 172.21.15.59:0/8502411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc45806e010 0x7fc458157fd0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.410+0000 7fc45e000640 1 -- 172.21.15.59:0/8502411 >> 172.21.15.59:0/8502411 conn(0x7fc458067080 msgr2=0x7fc458142250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.410+0000 7fc45e000640 1 -- 172.21.15.59:0/8502411 shutdown_connections 2024-04-25T09:11:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.410+0000 7fc45e000640 1 -- 172.21.15.59:0/8502411 wait complete. 2024-04-25T09:11:53.418 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T09:11:53.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:53.419 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T09:11:53.445 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:11:53.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:11:53.445 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T09:11:53.502 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:11:53.502 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:53.511 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:11:53.512 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:11:53.512 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:53.557 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:11:53.557 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:11:53.557 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:11:53.566 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:11:53.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:53.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d95800640 1 Processor -- start 2024-04-25T09:11:53.746 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d95800640 1 -- start start 2024-04-25T09:11:53.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d95800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9015dcd0 0x7f6d90099a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d95800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6d900cd460 0x7f6d90099fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d95800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9006d740 con 0x7f6d9009a7a0 2024-04-25T09:11:53.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d95800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d900cbfc0 con 0x7f6d900cd460 2024-04-25T09:11:53.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d95800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9006cea0 con 0x7f6d9015dcd0 2024-04-25T09:11:53.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8f400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6d9009a7a0 0x7f6d900cf460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39356/0 (socket says 172.21.15.59:39356) 2024-04-25T09:11:53.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8f400640 1 -- 172.21.15.59:0/1160571615 learned_addr learned my addr 172.21.15.59:0/1160571615 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:53.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d94e00640 1 --2- 172.21.15.59:0/1160571615 >> v2:172.21.15.178:3300/0 conn(0x7f6d900cd460 0x7f6d90099fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.749 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8fe00640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9015dcd0 0x7f6d90099a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105339965 0 0) 0x7f6d9006d740 con 0x7f6d9009a7a0 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d74003530 con 0x7f6d9009a7a0 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3902732247 0 0) 0x7f6d74003530 con 0x7f6d9009a7a0 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9015dcd0 msgr2=0x7f6d90099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9015dcd0 0x7f6d90099a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 >> v2:172.21.15.178:3300/0 conn(0x7f6d900cd460 msgr2=0x7f6d90099fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 --2- 172.21.15.59:0/1160571615 >> v2:172.21.15.178:3300/0 conn(0x7f6d900cd460 0x7f6d90099fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9006d180 con 0x7f6d9009a7a0 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f6d7c001680 con 0x7f6d9009a7a0 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8fe00640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9015dcd0 0x7f6d90099a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d94e00640 1 --2- 172.21.15.59:0/1160571615 >> v2:172.21.15.178:3300/0 conn(0x7f6d900cd460 0x7f6d90099fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 >> v1:172.21.15.59:6789/0 conn(0x7f6d9009a7a0 legacy=0x7f6d900cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d740039c0 0x7f6d74003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9015dcd0 0x7f6d74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d74004d50 0x7f6d740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900cbfc0 con 0x7f6d740039c0 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9006cea0 con 0x7f6d74004d50 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7400b9d0 con 0x7f6d9015dcd0 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8fe00640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d740039c0 0x7f6d74003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8f400640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9015dcd0 0x7f6d74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d94e00640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d74004d50 0x7f6d740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8fe00640 1 -- 172.21.15.59:0/1160571615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9015dcd0 msgr2=0x7f6d74004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8fe00640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d9015dcd0 0x7f6d74004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8fe00640 1 -- 172.21.15.59:0/1160571615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d74004d50 msgr2=0x7f6d740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8fe00640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d74004d50 0x7f6d740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.751 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.758+0000 7f6d8fe00640 1 -- 172.21.15.59:0/1160571615 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d74003530 con 0x7f6d740039c0 2024-04-25T09:11:53.752 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.762+0000 7f6d8fe00640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d740039c0 0x7f6d74003de0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009cb0 tx=0x7f6d8001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793093a063979273 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:53.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.762+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800b2070 con 0x7f6d740039c0 2024-04-25T09:11:53.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.762+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d800a5880 con 0x7f6d740039c0 2024-04-25T09:11:53.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.762+0000 7f6d8ea00640 1 -- 172.21.15.59:0/1160571615 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d80009880 con 0x7f6d740039c0 2024-04-25T09:11:53.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.762+0000 7f6d95800640 1 -- 172.21.15.59:0/1160571615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d740039c0 msgr2=0x7f6d74003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.762+0000 7f6d95800640 1 --2- 172.21.15.59:0/1160571615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d740039c0 0x7f6d74003de0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009cb0 tx=0x7f6d8001cbe0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.762+0000 7f6d94e00640 1 -- 172.21.15.59:0/1160571615 reap_dead start 2024-04-25T09:11:53.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.762+0000 7f6d95800640 1 -- 172.21.15.59:0/1160571615 shutdown_connections 2024-04-25T09:11:53.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.762+0000 7f6d95800640 1 -- 172.21.15.59:0/1160571615 >> 172.21.15.59:0/1160571615 conn(0x7f6d900b3050 msgr2=0x7f6d900b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:53.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.762+0000 7f6d95800640 1 -- 172.21.15.59:0/1160571615 shutdown_connections 2024-04-25T09:11:53.753 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.762+0000 7f6d95800640 1 -- 172.21.15.59:0/1160571615 wait complete. 2024-04-25T09:11:53.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d95800640 1 Processor -- start 2024-04-25T09:11:53.754 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d95800640 1 -- start start 2024-04-25T09:11:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d95800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d740039c0 0x7f6d90158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d95800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d90153910 0x7f6d90158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d95800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d900b4700 0x7f6d900b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d95800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d90168a10 con 0x7f6d90153910 2024-04-25T09:11:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d95800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d90168890 con 0x7f6d740039c0 2024-04-25T09:11:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d95800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d90168b90 con 0x7f6d900b4700 2024-04-25T09:11:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d8f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d90153910 0x7f6d90158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d8f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d90153910 0x7f6d90158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53272/0 (socket says 172.21.15.59:53272) 2024-04-25T09:11:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d8f400640 1 -- 172.21.15.59:0/605670186 learned_addr learned my addr 172.21.15.59:0/605670186 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d8fe00640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d740039c0 0x7f6d90158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d94e00640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d900b4700 0x7f6d900b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d8f400640 1 -- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d900b4700 msgr2=0x7f6d900b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d8f400640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d900b4700 0x7f6d900b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d8f400640 1 -- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d740039c0 msgr2=0x7f6d90158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d8f400640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d740039c0 0x7f6d90158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.757 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d8f400640 1 -- 172.21.15.59:0/605670186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d900ca1b0 con 0x7f6d90153910 2024-04-25T09:11:53.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d8f400640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d90153910 0x7f6d90158c60 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c007310 tx=0x7f6d7c007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:53.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d87e00640 1 -- 172.21.15.59:0/605670186 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c00f960 con 0x7f6d90153910 2024-04-25T09:11:53.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d87e00640 1 -- 172.21.15.59:0/605670186 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c018070 con 0x7f6d90153910 2024-04-25T09:11:53.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d95800640 1 -- 172.21.15.59:0/605670186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d90157c40 con 0x7f6d90153910 2024-04-25T09:11:53.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d87e00640 1 -- 172.21.15.59:0/605670186 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c00fd80 con 0x7f6d90153910 2024-04-25T09:11:53.758 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.766+0000 7f6d95800640 1 -- 172.21.15.59:0/605670186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d90158200 con 0x7f6d90153910 2024-04-25T09:11:53.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.770+0000 7f6d95800640 1 -- 172.21.15.59:0/605670186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9004efa0 con 0x7f6d90153910 2024-04-25T09:11:53.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.770+0000 7f6d87e00640 1 -- 172.21.15.59:0/605670186 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6d7c01d460 con 0x7f6d90153910 2024-04-25T09:11:53.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.770+0000 7f6d87e00640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d70066f90 0x7f6d70069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:53.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.770+0000 7f6d87e00640 1 -- 172.21.15.59:0/605670186 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f6d7c0852d0 con 0x7f6d90153910 2024-04-25T09:11:53.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.770+0000 7f6d8fe00640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d70066f90 0x7f6d70069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:53.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.770+0000 7f6d8fe00640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d70066f90 0x7f6d70069450 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6d800af000 tx=0x7f6d800046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:53.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.774+0000 7f6d87e00640 1 -- 172.21.15.59:0/605670186 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6d7c056090 con 0x7f6d90153910 2024-04-25T09:11:53.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:11:53.915 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:11:53.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 -- 172.21.15.59:0/605670186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d901583d0 con 0x7f6d90153910 2024-04-25T09:11:53.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d87e00640 1 -- 172.21.15.59:0/605670186 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4943 (secure 0 0 0) 0x7f6d7c055990 con 0x7f6d90153910 2024-04-25T09:11:53.963 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:53.963 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":117,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":7613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3791633295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3791633295},{"type":"v1","addr":"172.21.15.59:6835","nonce":3791633295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:46.696297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9381":{"gid":9381,"name":"c","rank":0,"incarnation":114,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6833/836073822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":836073822},{"type":"v1","addr":"172.21.15.59:6833","nonce":836073822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 117 2024-04-25T09:11:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 -- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d70066f90 msgr2=0x7f6d70069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d70066f90 0x7f6d70069450 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f6d800af000 tx=0x7f6d800046d0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 -- 172.21.15.59:0/605670186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d90153910 msgr2=0x7f6d90158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d90153910 0x7f6d90158c60 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c007310 tx=0x7f6d7c007710 comp rx=0 tx=0).stop 2024-04-25T09:11:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 -- 172.21.15.59:0/605670186 shutdown_connections 2024-04-25T09:11:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6d70066f90 0x7f6d70069450 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6d900b4700 0x7f6d900b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d90153910 0x7f6d90158c60 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 --2- 172.21.15.59:0/605670186 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6d740039c0 0x7f6d90158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 -- 172.21.15.59:0/605670186 >> 172.21.15.59:0/605670186 conn(0x7f6d900b3050 msgr2=0x7f6d9006f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 -- 172.21.15.59:0/605670186 shutdown_connections 2024-04-25T09:11:53.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:53.974+0000 7f6d95800640 1 -- 172.21.15.59:0/605670186 wait complete. 2024-04-25T09:11:53.985 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:54.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.174+0000 7fabef200640 1 Processor -- start 2024-04-25T09:11:54.165 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.174+0000 7fabef200640 1 -- start start 2024-04-25T09:11:54.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabef200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fabe8144140 0x7fabe80ce820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabef200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabe80ced60 0x7fabe806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabef200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe815ac60 con 0x7fabe806e900 2024-04-25T09:11:54.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabef200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe806ed30 con 0x7fabe80ced60 2024-04-25T09:11:54.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabef200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe80cf3e0 con 0x7fabe8144140 2024-04-25T09:11:54.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabe7400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fabe80ced60 0x7fabe806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabed200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fabe806e900 0x7fabe815e250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39364/0 (socket says 172.21.15.59:39364) 2024-04-25T09:11:54.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabed200640 1 -- 172.21.15.59:0/3153878144 learned_addr learned my addr 172.21.15.59:0/3153878144 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:54.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabe7e00640 1 --2- 172.21.15.59:0/3153878144 >> v2:172.21.15.178:3300/0 conn(0x7fabe8144140 0x7fabe80ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabe6a00640 1 -- 172.21.15.59:0/3153878144 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785323650 0 0) 0x7fabe815ac60 con 0x7fabe806e900 2024-04-25T09:11:54.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabe7400640 1 -- 172.21.15.59:0/3153878144 >> v2:172.21.15.178:3300/0 conn(0x7fabe8144140 msgr2=0x7fabe80ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:54.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabe7400640 1 --2- 172.21.15.59:0/3153878144 >> v2:172.21.15.178:3300/0 conn(0x7fabe8144140 0x7fabe80ce820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabe7400640 1 -- 172.21.15.59:0/3153878144 >> v1:172.21.15.59:6789/0 conn(0x7fabe806e900 legacy=0x7fabe815e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.178+0000 7fabe7400640 1 -- 172.21.15.59:0/3153878144 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe815af20 con 0x7fabe80ced60 2024-04-25T09:11:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabe7400640 1 --2- 172.21.15.59:0/3153878144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe80ced60 0x7fabe806e3c0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fabe806eef0 tx=0x7fabd401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c777cecbf797d7d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabe6a00640 1 -- 172.21.15.59:0/3153878144 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd40b0070 con 0x7fabe80ced60 2024-04-25T09:11:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabe6a00640 1 -- 172.21.15.59:0/3153878144 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd40ab600 con 0x7fabe80ced60 2024-04-25T09:11:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabe6a00640 1 -- 172.21.15.59:0/3153878144 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd40ab9d0 con 0x7fabe80ced60 2024-04-25T09:11:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabef200640 1 -- 172.21.15.59:0/3153878144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe80ced60 msgr2=0x7fabe806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabef200640 1 --2- 172.21.15.59:0/3153878144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe80ced60 0x7fabe806e3c0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fabe806eef0 tx=0x7fabd401c480 comp rx=0 tx=0).stop 2024-04-25T09:11:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabef200640 1 -- 172.21.15.59:0/3153878144 shutdown_connections 2024-04-25T09:11:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabef200640 1 --2- 172.21.15.59:0/3153878144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe80ced60 0x7fabe806e3c0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabef200640 1 --2- 172.21.15.59:0/3153878144 >> v2:172.21.15.178:3300/0 conn(0x7fabe8144140 0x7fabe80ce820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabef200640 1 -- 172.21.15.59:0/3153878144 >> 172.21.15.59:0/3153878144 conn(0x7fabe8066fa0 msgr2=0x7fabe806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabef200640 1 -- 172.21.15.59:0/3153878144 shutdown_connections 2024-04-25T09:11:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabef200640 1 -- 172.21.15.59:0/3153878144 wait complete. 2024-04-25T09:11:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabef200640 1 Processor -- start 2024-04-25T09:11:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.182+0000 7fabef200640 1 -- start start 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabef200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe806e900 0x7fabe813c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabef200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabe80ced60 0x7fabe8154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabef200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabe8144140 0x7fabe813cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabef200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe815ba00 con 0x7fabe806e900 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabef200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe8144520 con 0x7fabe80ced60 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabef200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe815bb80 con 0x7fabe8144140 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabe7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe806e900 0x7fabe813c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabe7e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe806e900 0x7fabe813c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53290/0 (socket says 172.21.15.59:53290) 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabe7e00640 1 -- 172.21.15.59:0/1872082073 learned_addr learned my addr 172.21.15.59:0/1872082073 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabe7400640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabe80ced60 0x7fabe8154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabed200640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabe8144140 0x7fabe813cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabe7e00640 1 -- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabe8144140 msgr2=0x7fabe813cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabe7e00640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabe8144140 0x7fabe813cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabe7e00640 1 -- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabe80ced60 msgr2=0x7fabe8154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabe7e00640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabe80ced60 0x7fabe8154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabe7e00640 1 -- 172.21.15.59:0/1872082073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe8164650 con 0x7fabe806e900 2024-04-25T09:11:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabe7400640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabe80ced60 0x7fabe8154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabed200640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabe8144140 0x7fabe813cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabe7e00640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe806e900 0x7fabe813c510 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fabd800d5f0 tx=0x7fabd800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabdfe00640 1 -- 172.21.15.59:0/1872082073 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80125f0 con 0x7fabe806e900 2024-04-25T09:11:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabdfe00640 1 -- 172.21.15.59:0/1872082073 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd8019070 con 0x7fabe806e900 2024-04-25T09:11:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabdfe00640 1 -- 172.21.15.59:0/1872082073 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd80129b0 con 0x7fabe806e900 2024-04-25T09:11:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabef200640 1 -- 172.21.15.59:0/1872082073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe813d290 con 0x7fabe806e900 2024-04-25T09:11:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabef200640 1 -- 172.21.15.59:0/1872082073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe813e400 con 0x7fabe806e900 2024-04-25T09:11:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabef200640 1 -- 172.21.15.59:0/1872082073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabe80745d0 con 0x7fabe806e900 2024-04-25T09:11:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.186+0000 7fabdfe00640 1 -- 172.21.15.59:0/1872082073 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fabd8012b50 con 0x7fabe806e900 2024-04-25T09:11:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.190+0000 7fabdfe00640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fabc8066f60 0x7fabc8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.190+0000 7fabdfe00640 1 -- 172.21.15.59:0/1872082073 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fabd80856c0 con 0x7fabe806e900 2024-04-25T09:11:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.190+0000 7fabe7400640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fabc8066f60 0x7fabc8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.190+0000 7fabe7400640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fabc8066f60 0x7fabc8069420 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fabd40ad000 tx=0x7fabd4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:54.181 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.194+0000 7fabdfe00640 1 -- 172.21.15.59:0/1872082073 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fabd8056480 con 0x7fabe806e900 2024-04-25T09:11:54.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.358+0000 7fabef200640 1 -- 172.21.15.59:0/1872082073 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fabe815ac60 con 0x7fabe806e900 2024-04-25T09:11:54.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.358+0000 7fabdfe00640 1 -- 172.21.15.59:0/1872082073 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+17207 (secure 0 0 0) 0x7fabd8055d80 con 0x7fabe806e900 2024-04-25T09:11:54.349 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:54.349 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":123,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:42.673680+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:15.429862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:16.011038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/29546856":"2024-04-26T09:11:31.741997+0000","172.21.15.59:6833/1679876837":"2024-04-26T09:11:42.673656+0000","172.21.15.59:6832/1679876837":"2024-04-26T09:11:42.673656+0000","172.21.15.59:6834/29546856":"2024-04-26T09:11:31.741997+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.362+0000 7fabef200640 1 -- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fabc8066f60 msgr2=0x7fabc8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.362+0000 7fabef200640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fabc8066f60 0x7fabc8069420 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fabd40ad000 tx=0x7fabd4008040 comp rx=0 tx=0).stop 2024-04-25T09:11:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.362+0000 7fabef200640 1 -- 172.21.15.59:0/1872082073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe806e900 msgr2=0x7fabe813c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.362+0000 7fabef200640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe806e900 0x7fabe813c510 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fabd800d5f0 tx=0x7fabd800dab0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.362+0000 7fabef200640 1 -- 172.21.15.59:0/1872082073 shutdown_connections 2024-04-25T09:11:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.362+0000 7fabef200640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fabc8066f60 0x7fabc8069420 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.362+0000 7fabef200640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fabe8144140 0x7fabe813cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.362+0000 7fabef200640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fabe80ced60 0x7fabe8154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.362+0000 7fabef200640 1 --2- 172.21.15.59:0/1872082073 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fabe806e900 0x7fabe813c510 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.362+0000 7fabef200640 1 -- 172.21.15.59:0/1872082073 >> 172.21.15.59:0/1872082073 conn(0x7fabe8066fa0 msgr2=0x7fabe815c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.362+0000 7fabef200640 1 -- 172.21.15.59:0/1872082073 shutdown_connections 2024-04-25T09:11:54.352 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.362+0000 7fabef200640 1 -- 172.21.15.59:0/1872082073 wait complete. 2024-04-25T09:11:54.371 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T09:01:15.707123+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T09:11:15.429862+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T09:11:16.011038+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T09:11:54.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T09:11:54.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce96800640 1 Processor -- start 2024-04-25T09:11:54.515 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce96800640 1 -- start start 2024-04-25T09:11:54.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce96800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fce9015b9e0 0x7fce900cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.516 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce96800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce900d0080 0x7fce9015f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce96800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce9015f8f0 0x7fce9015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce96800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9015fd20 con 0x7fce9015f8f0 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce96800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9009ade0 con 0x7fce9015b9e0 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce96800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce90099a60 con 0x7fce900d0080 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce95e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce9015f8f0 0x7fce9015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce95e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce9015f8f0 0x7fce9015bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53296/0 (socket says 172.21.15.59:53296) 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce95e00640 1 -- 172.21.15.59:0/3596835458 learned_addr learned my addr 172.21.15.59:0/3596835458 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce95400640 1 --2- 172.21.15.59:0/3596835458 >> v2:172.21.15.178:3300/0 conn(0x7fce9015b9e0 0x7fce900cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce94a00640 1 --2- 172.21.15.59:0/3596835458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce900d0080 0x7fce9015f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce95e00640 1 -- 172.21.15.59:0/3596835458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce900d0080 msgr2=0x7fce9015f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce95e00640 1 --2- 172.21.15.59:0/3596835458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce900d0080 0x7fce9015f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce95e00640 1 -- 172.21.15.59:0/3596835458 >> v2:172.21.15.178:3300/0 conn(0x7fce9015b9e0 msgr2=0x7fce900cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce95e00640 1 --2- 172.21.15.59:0/3596835458 >> v2:172.21.15.178:3300/0 conn(0x7fce9015b9e0 0x7fce900cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.517 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.526+0000 7fce95e00640 1 -- 172.21.15.59:0/3596835458 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce90099d40 con 0x7fce9015f8f0 2024-04-25T09:11:54.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce95e00640 1 --2- 172.21.15.59:0/3596835458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce9015f8f0 0x7fce9015bdc0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fce90068490 tx=0x7fce8801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d906080551dc9131 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:54.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce8fe00640 1 -- 172.21.15.59:0/3596835458 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce880a5870 con 0x7fce9015f8f0 2024-04-25T09:11:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce8fe00640 1 -- 172.21.15.59:0/3596835458 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce880a5a10 con 0x7fce9015f8f0 2024-04-25T09:11:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce8fe00640 1 -- 172.21.15.59:0/3596835458 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce880a5de0 con 0x7fce9015f8f0 2024-04-25T09:11:54.520 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce96800640 1 -- 172.21.15.59:0/3596835458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce9015f8f0 msgr2=0x7fce9015bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce96800640 1 --2- 172.21.15.59:0/3596835458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce9015f8f0 0x7fce9015bdc0 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fce90068490 tx=0x7fce8801c9f0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce96800640 1 -- 172.21.15.59:0/3596835458 shutdown_connections 2024-04-25T09:11:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce96800640 1 --2- 172.21.15.59:0/3596835458 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce9015f8f0 0x7fce9015bdc0 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce96800640 1 --2- 172.21.15.59:0/3596835458 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce900d0080 0x7fce9015f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce96800640 1 --2- 172.21.15.59:0/3596835458 >> v2:172.21.15.178:3300/0 conn(0x7fce9015b9e0 0x7fce900cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce96800640 1 -- 172.21.15.59:0/3596835458 >> 172.21.15.59:0/3596835458 conn(0x7fce900b3030 msgr2=0x7fce900b3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce96800640 1 -- 172.21.15.59:0/3596835458 shutdown_connections 2024-04-25T09:11:54.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.530+0000 7fce96800640 1 -- 172.21.15.59:0/3596835458 wait complete. 2024-04-25T09:11:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce96800640 1 Processor -- start 2024-04-25T09:11:54.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce96800640 1 -- start start 2024-04-25T09:11:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce96800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce900d0080 0x7fce900b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce96800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9015b9e0 0x7fce90150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce96800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9015f8f0 0x7fce900ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce96800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce900cc050 con 0x7fce900d0080 2024-04-25T09:11:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce96800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9009a8c0 con 0x7fce9015b9e0 2024-04-25T09:11:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce96800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce900cc1d0 con 0x7fce9015f8f0 2024-04-25T09:11:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce95400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce900d0080 0x7fce900b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce95400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce900d0080 0x7fce900b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53302/0 (socket says 172.21.15.59:53302) 2024-04-25T09:11:54.524 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce95400640 1 -- 172.21.15.59:0/3941432751 learned_addr learned my addr 172.21.15.59:0/3941432751 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce94a00640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9015b9e0 0x7fce90150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce95e00640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9015f8f0 0x7fce900ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce95400640 1 -- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9015f8f0 msgr2=0x7fce900ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce95400640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9015f8f0 0x7fce900ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce95400640 1 -- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9015b9e0 msgr2=0x7fce90150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce95400640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9015b9e0 0x7fce90150890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce95400640 1 -- 172.21.15.59:0/3941432751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce900cf4f0 con 0x7fce900d0080 2024-04-25T09:11:54.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce95400640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce900d0080 0x7fce900b20a0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fce8400e930 tx=0x7fce8400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce8d600640 1 -- 172.21.15.59:0/3941432751 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce84017070 con 0x7fce900d0080 2024-04-25T09:11:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce8d600640 1 -- 172.21.15.59:0/3941432751 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8400ca00 con 0x7fce900d0080 2024-04-25T09:11:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce8d600640 1 -- 172.21.15.59:0/3941432751 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8400cdb0 con 0x7fce900d0080 2024-04-25T09:11:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce96800640 1 -- 172.21.15.59:0/3941432751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce900cef30 con 0x7fce900d0080 2024-04-25T09:11:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.534+0000 7fce96800640 1 -- 172.21.15.59:0/3941432751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce901f7040 con 0x7fce900d0080 2024-04-25T09:11:54.526 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.538+0000 7fce96800640 1 -- 172.21.15.59:0/3941432751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce900745d0 con 0x7fce900d0080 2024-04-25T09:11:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.538+0000 7fce8d600640 1 -- 172.21.15.59:0/3941432751 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fce8401a070 con 0x7fce900d0080 2024-04-25T09:11:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.538+0000 7fce8d600640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fce70066f60 0x7fce70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.527 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.538+0000 7fce8d600640 1 -- 172.21.15.59:0/3941432751 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7fce840851f0 con 0x7fce900d0080 2024-04-25T09:11:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.538+0000 7fce94a00640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fce70066f60 0x7fce70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.528 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.538+0000 7fce94a00640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fce70066f60 0x7fce70069420 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fce9015b120 tx=0x7fce7c009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:54.531 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.542+0000 7fce8d600640 1 -- 172.21.15.59:0/3941432751 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fce84055a20 con 0x7fce900d0080 2024-04-25T09:11:54.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 -- 172.21.15.59:0/3941432751 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce900d2470 con 0x7fce900d0080 2024-04-25T09:11:54.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce8d600640 1 -- 172.21.15.59:0/3941432751 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v123) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce84059ac0 con 0x7fce900d0080 2024-04-25T09:11:54.694 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 1 2024-04-25T09:11:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 -- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fce70066f60 msgr2=0x7fce70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fce70066f60 0x7fce70069420 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fce9015b120 tx=0x7fce7c009190 comp rx=0 tx=0).stop 2024-04-25T09:11:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 -- 172.21.15.59:0/3941432751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce900d0080 msgr2=0x7fce900b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce900d0080 0x7fce900b20a0 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fce8400e930 tx=0x7fce8400edf0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 -- 172.21.15.59:0/3941432751 shutdown_connections 2024-04-25T09:11:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fce70066f60 0x7fce70069420 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fce9015f8f0 0x7fce900ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fce9015b9e0 0x7fce90150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 --2- 172.21.15.59:0/3941432751 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce900d0080 0x7fce900b20a0 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 -- 172.21.15.59:0/3941432751 >> 172.21.15.59:0/3941432751 conn(0x7fce900b3030 msgr2=0x7fce90155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 -- 172.21.15.59:0/3941432751 shutdown_connections 2024-04-25T09:11:54.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.706+0000 7fce96800640 1 -- 172.21.15.59:0/3941432751 wait complete. 2024-04-25T09:11:54.715 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T09:11:54.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.870+0000 7f6cb1a00640 1 Processor -- start 2024-04-25T09:11:54.860 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.870+0000 7f6cb1a00640 1 -- start start 2024-04-25T09:11:54.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.870+0000 7f6cb1a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f6cac0af2f0 0x7f6cac15e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.870+0000 7f6cb1a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cac06e140 0x7f6cac06bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.870+0000 7f6cb1a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cac06e900 con 0x7f6cac06c160 2024-04-25T09:11:54.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.870+0000 7f6cb1a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cac0b2ce0 con 0x7f6cac0af2f0 2024-04-25T09:11:54.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.870+0000 7f6cb1a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac06ebe0 con 0x7f6cac06e140 2024-04-25T09:11:54.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.874+0000 7f6ca3400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cac06e140 0x7f6cac06bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.874+0000 7f6ca3400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cac06e140 0x7f6cac06bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:33022/0 (socket says 172.21.15.59:33022) 2024-04-25T09:11:54.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.874+0000 7f6ca3400640 1 -- 172.21.15.59:0/3285707517 learned_addr learned my addr 172.21.15.59:0/3285707517 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:54.862 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.874+0000 7f6cabe00640 1 --2- 172.21.15.59:0/3285707517 >> v2:172.21.15.178:3300/0 conn(0x7f6cac0af2f0 0x7f6cac15e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.874+0000 7f6ca3400640 1 -- 172.21.15.59:0/3285707517 >> v2:172.21.15.178:3300/0 conn(0x7f6cac0af2f0 msgr2=0x7f6cac15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:54.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.874+0000 7f6ca3400640 1 --2- 172.21.15.59:0/3285707517 >> v2:172.21.15.178:3300/0 conn(0x7f6cac0af2f0 0x7f6cac15e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.874+0000 7f6ca3400640 1 -- 172.21.15.59:0/3285707517 >> v1:172.21.15.178:6789/0 conn(0x7f6cac06c160 legacy=0x7f6cac161390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.874+0000 7f6ca3400640 1 -- 172.21.15.59:0/3285707517 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac06eec0 con 0x7f6cac06e140 2024-04-25T09:11:54.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.874+0000 7f6cabe00640 1 --2- 172.21.15.59:0/3285707517 >> v2:172.21.15.178:3300/0 conn(0x7f6cac0af2f0 0x7f6cac15e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:54.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.874+0000 7f6ca3400640 1 --2- 172.21.15.59:0/3285707517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cac06e140 0x7f6cac06bc20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009870 tx=0x7f6c9401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=820837d54af4737e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:54.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cab400640 1 -- 172.21.15.59:0/3285707517 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c940b2070 con 0x7f6cac06e140 2024-04-25T09:11:54.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cab400640 1 -- 172.21.15.59:0/3285707517 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c940a9070 con 0x7f6cac06e140 2024-04-25T09:11:54.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cab400640 1 -- 172.21.15.59:0/3285707517 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c940ad880 con 0x7f6cac06e140 2024-04-25T09:11:54.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 -- 172.21.15.59:0/3285707517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cac06e140 msgr2=0x7f6cac06bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 --2- 172.21.15.59:0/3285707517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cac06e140 0x7f6cac06bc20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c94009870 tx=0x7f6c9401c560 comp rx=0 tx=0).stop 2024-04-25T09:11:54.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 -- 172.21.15.59:0/3285707517 shutdown_connections 2024-04-25T09:11:54.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 --2- 172.21.15.59:0/3285707517 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cac06e140 0x7f6cac06bc20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 --2- 172.21.15.59:0/3285707517 >> v2:172.21.15.178:3300/0 conn(0x7f6cac0af2f0 0x7f6cac15e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 -- 172.21.15.59:0/3285707517 >> 172.21.15.59:0/3285707517 conn(0x7f6cac071930 msgr2=0x7f6cac071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:54.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 -- 172.21.15.59:0/3285707517 shutdown_connections 2024-04-25T09:11:54.867 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 -- 172.21.15.59:0/3285707517 wait complete. 2024-04-25T09:11:54.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 Processor -- start 2024-04-25T09:11:54.868 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 -- start start 2024-04-25T09:11:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cac06c160 0x7f6cac155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cac06e140 0x7f6cac14f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cac0af2f0 0x7f6cac14e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac16a6a0 con 0x7f6cac0af2f0 2024-04-25T09:11:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac06c570 con 0x7f6cac06e140 2024-04-25T09:11:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cac16a820 con 0x7f6cac06c160 2024-04-25T09:11:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.878+0000 7f6cb1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cac0af2f0 0x7f6cac14e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6cb1000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cac0af2f0 0x7f6cac14e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53316/0 (socket says 172.21.15.59:53316) 2024-04-25T09:11:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6cb1000640 1 -- 172.21.15.59:0/1524217474 learned_addr learned my addr 172.21.15.59:0/1524217474 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6ca3400640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cac06e140 0x7f6cac14f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6cabe00640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cac06c160 0x7f6cac155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6cb1000640 1 -- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cac06c160 msgr2=0x7f6cac155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6cb1000640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cac06c160 0x7f6cac155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6cb1000640 1 -- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cac06e140 msgr2=0x7f6cac14f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:54.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6cb1000640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cac06e140 0x7f6cac14f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:54.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6cb1000640 1 -- 172.21.15.59:0/1524217474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cac156530 con 0x7f6cac0af2f0 2024-04-25T09:11:54.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6ca3400640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cac06e140 0x7f6cac14f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:54.871 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6cb1000640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cac0af2f0 0x7f6cac14e630 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c430 tx=0x7f6ca400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:54.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6ca8c00640 1 -- 172.21.15.59:0/1524217474 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4005220 con 0x7f6cac0af2f0 2024-04-25T09:11:54.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6ca8c00640 1 -- 172.21.15.59:0/1524217474 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ca40053c0 con 0x7f6cac0af2f0 2024-04-25T09:11:54.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6ca8c00640 1 -- 172.21.15.59:0/1524217474 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4007270 con 0x7f6cac0af2f0 2024-04-25T09:11:54.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6cb1a00640 1 -- 172.21.15.59:0/1524217474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cac153230 con 0x7f6cac0af2f0 2024-04-25T09:11:54.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6cb1a00640 1 -- 172.21.15.59:0/1524217474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cac156810 con 0x7f6cac0af2f0 2024-04-25T09:11:54.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6cb1a00640 1 -- 172.21.15.59:0/1524217474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cac0affd0 con 0x7f6cac0af2f0 2024-04-25T09:11:54.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6ca8c00640 1 -- 172.21.15.59:0/1524217474 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f6ca4019020 con 0x7f6cac0af2f0 2024-04-25T09:11:54.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.882+0000 7f6ca8c00640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c88066f60 0x7f6c88069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:54.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.886+0000 7f6ca8c00640 1 -- 172.21.15.59:0/1524217474 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f6ca40845f0 con 0x7f6cac0af2f0 2024-04-25T09:11:54.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.886+0000 7f6cabe00640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c88066f60 0x7f6c88069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:54.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.886+0000 7f6cabe00640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c88066f60 0x7f6c88069420 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009bd0 tx=0x7f6c9c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:54.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:54.886+0000 7f6ca8c00640 1 -- 172.21.15.59:0/1524217474 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6ca4054c40 con 0x7f6cac0af2f0 2024-04-25T09:11:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 -- 172.21.15.59:0/1524217474 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6cac1538f0 con 0x7f6cac0af2f0 2024-04-25T09:11:55.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6ca8c00640 1 -- 172.21.15.59:0/1524217474 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v123) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6ca4058ce0 con 0x7f6cac0af2f0 2024-04-25T09:11:55.042 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 32 2024-04-25T09:11:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 -- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c88066f60 msgr2=0x7f6c88069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c88066f60 0x7f6c88069420 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c009bd0 tx=0x7f6c9c00b040 comp rx=0 tx=0).stop 2024-04-25T09:11:55.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 -- 172.21.15.59:0/1524217474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cac0af2f0 msgr2=0x7f6cac14e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cac0af2f0 0x7f6cac14e630 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400c430 tx=0x7f6ca400c8f0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 -- 172.21.15.59:0/1524217474 shutdown_connections 2024-04-25T09:11:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6c88066f60 0x7f6c88069420 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cac0af2f0 0x7f6cac14e630 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f6cac06e140 0x7f6cac14f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 --2- 172.21.15.59:0/1524217474 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f6cac06c160 0x7f6cac155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 -- 172.21.15.59:0/1524217474 >> 172.21.15.59:0/1524217474 conn(0x7f6cac071930 msgr2=0x7f6cac0b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 -- 172.21.15.59:0/1524217474 shutdown_connections 2024-04-25T09:11:55.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.054+0000 7f6cb1a00640 1 -- 172.21.15.59:0/1524217474 wait complete. 2024-04-25T09:11:55.064 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T09:11:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.218+0000 7f4ee0600640 1 Processor -- start 2024-04-25T09:11:55.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.218+0000 7f4ee0600640 1 -- start start 2024-04-25T09:11:55.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4ee0600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ed8159320 0x7f4ed815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4ee0600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ed815f440 0x7f4ed806dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4ee0600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed815fc00 con 0x7f4ed806e010 2024-04-25T09:11:55.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4ee0600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed806d640 con 0x7f4ed8159320 2024-04-25T09:11:55.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4ee0600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed815fee0 con 0x7f4ed815f440 2024-04-25T09:11:55.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4eddc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ed8159320 0x7f4ed815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4eddc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4ed8159320 0x7f4ed815c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53322/0 (socket says 172.21.15.59:53322) 2024-04-25T09:11:55.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4eddc00640 1 -- 172.21.15.59:0/756553962 learned_addr learned my addr 172.21.15.59:0/756553962 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:55.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4edd200640 1 --2- 172.21.15.59:0/756553962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ed815f440 0x7f4ed806dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4eddc00640 1 -- 172.21.15.59:0/756553962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ed815f440 msgr2=0x7f4ed806dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:55.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4eddc00640 1 --2- 172.21.15.59:0/756553962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ed815f440 0x7f4ed806dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4eddc00640 1 -- 172.21.15.59:0/756553962 >> v1:172.21.15.178:6789/0 conn(0x7f4ed806e010 legacy=0x7f4ed806e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:55.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.222+0000 7f4eddc00640 1 -- 172.21.15.59:0/756553962 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed81601c0 con 0x7f4ed8159320 2024-04-25T09:11:55.213 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4eddc00640 1 --2- 172.21.15.59:0/756553962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed8159320 0x7f4ed815c9b0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009870 tx=0x7f4ecc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c2d0580ef0af3e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:55.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ed7e00640 1 -- 172.21.15.59:0/756553962 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0ab640 con 0x7f4ed8159320 2024-04-25T09:11:55.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ed7e00640 1 -- 172.21.15.59:0/756553962 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc0b0070 con 0x7f4ed8159320 2024-04-25T09:11:55.214 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ed7e00640 1 -- 172.21.15.59:0/756553962 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0aba00 con 0x7f4ed8159320 2024-04-25T09:11:55.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 -- 172.21.15.59:0/756553962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed8159320 msgr2=0x7f4ed815c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 --2- 172.21.15.59:0/756553962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed8159320 0x7f4ed815c9b0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009870 tx=0x7f4ecc01c460 comp rx=0 tx=0).stop 2024-04-25T09:11:55.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 -- 172.21.15.59:0/756553962 shutdown_connections 2024-04-25T09:11:55.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 --2- 172.21.15.59:0/756553962 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ed815f440 0x7f4ed806dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 --2- 172.21.15.59:0/756553962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed8159320 0x7f4ed815c9b0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 -- 172.21.15.59:0/756553962 >> 172.21.15.59:0/756553962 conn(0x7f4ed8067080 msgr2=0x7f4ed806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:55.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 -- 172.21.15.59:0/756553962 shutdown_connections 2024-04-25T09:11:55.215 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 -- 172.21.15.59:0/756553962 wait complete. 2024-04-25T09:11:55.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 Processor -- start 2024-04-25T09:11:55.216 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 -- start start 2024-04-25T09:11:55.218 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed806e010 0x7f4ed813a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ed8159320 0x7f4ed81f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ed815f440 0x7f4ed8157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed815f9a0 con 0x7f4ed806e010 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed815f820 con 0x7f4ed815f440 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.226+0000 7f4ee0600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed806ebb0 con 0x7f4ed8159320 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4eddc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed806e010 0x7f4ed813a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4eddc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed806e010 0x7f4ed813a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53326/0 (socket says 172.21.15.59:53326) 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4eddc00640 1 -- 172.21.15.59:0/1511244989 learned_addr learned my addr 172.21.15.59:0/1511244989 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4edd200640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ed8159320 0x7f4ed81f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4ede600640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ed815f440 0x7f4ed8157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4eddc00640 1 -- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ed8159320 msgr2=0x7f4ed81f6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4eddc00640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ed8159320 0x7f4ed81f6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.219 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4eddc00640 1 -- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ed815f440 msgr2=0x7f4ed8157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4eddc00640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ed815f440 0x7f4ed8157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4eddc00640 1 -- 172.21.15.59:0/1511244989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8141620 con 0x7f4ed806e010 2024-04-25T09:11:55.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4ede600640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ed815f440 0x7f4ed8157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:55.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4eddc00640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed806e010 0x7f4ed813a290 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc01ab10 tx=0x7f4ecc01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:55.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4ed5600640 1 -- 172.21.15.59:0/1511244989 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0be3f0 con 0x7f4ed806e010 2024-04-25T09:11:55.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4ed5600640 1 -- 172.21.15.59:0/1511244989 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ecc0be5b0 con 0x7f4ed806e010 2024-04-25T09:11:55.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4ed5600640 1 -- 172.21.15.59:0/1511244989 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc0be9a0 con 0x7f4ed806e010 2024-04-25T09:11:55.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4ee0600640 1 -- 172.21.15.59:0/1511244989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed80afe20 con 0x7f4ed806e010 2024-04-25T09:11:55.220 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4ee0600640 1 -- 172.21.15.59:0/1511244989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed80b03e0 con 0x7f4ed806e010 2024-04-25T09:11:55.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4ee0600640 1 -- 172.21.15.59:0/1511244989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed80745d0 con 0x7f4ed806e010 2024-04-25T09:11:55.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.230+0000 7f4ed5600640 1 -- 172.21.15.59:0/1511244989 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4ecc0b43f0 con 0x7f4ed806e010 2024-04-25T09:11:55.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.234+0000 7f4ed5600640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4eb8066f60 0x7f4eb8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.234+0000 7f4ed5600640 1 -- 172.21.15.59:0/1511244989 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f4ecc11f660 con 0x7f4ed806e010 2024-04-25T09:11:55.221 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.234+0000 7f4edd200640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4eb8066f60 0x7f4eb8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.222 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.234+0000 7f4edd200640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4eb8066f60 0x7f4eb8069420 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4007a60 tx=0x7f4ec4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:55.225 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.234+0000 7f4ed5600640 1 -- 172.21.15.59:0/1511244989 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4ecc016110 con 0x7f4ed806e010 2024-04-25T09:11:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.398+0000 7f4ee0600640 1 -- 172.21.15.59:0/1511244989 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ed806c250 con 0x7f4ed806e010 2024-04-25T09:11:55.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.398+0000 7f4ed5600640 1 -- 172.21.15.59:0/1511244989 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v123) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ecc0efd40 con 0x7f4ed806e010 2024-04-25T09:11:55.388 INFO:teuthology.orchestra.run.smithi059.stdout:pg_num: 64 2024-04-25T09:11:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.398+0000 7f4ee0600640 1 -- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4eb8066f60 msgr2=0x7f4eb8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.398+0000 7f4ee0600640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4eb8066f60 0x7f4eb8069420 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4007a60 tx=0x7f4ec4008040 comp rx=0 tx=0).stop 2024-04-25T09:11:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.398+0000 7f4ee0600640 1 -- 172.21.15.59:0/1511244989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed806e010 msgr2=0x7f4ed813a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.398+0000 7f4ee0600640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed806e010 0x7f4ed813a290 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc01ab10 tx=0x7f4ecc01aca0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.402+0000 7f4ee0600640 1 -- 172.21.15.59:0/1511244989 shutdown_connections 2024-04-25T09:11:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.402+0000 7f4ee0600640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4eb8066f60 0x7f4eb8069420 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.402+0000 7f4ee0600640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4ed815f440 0x7f4ed8157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.402+0000 7f4ee0600640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4ed8159320 0x7f4ed81f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.402+0000 7f4ee0600640 1 --2- 172.21.15.59:0/1511244989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ed806e010 0x7f4ed813a290 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.402+0000 7f4ee0600640 1 -- 172.21.15.59:0/1511244989 >> 172.21.15.59:0/1511244989 conn(0x7f4ed8067080 msgr2=0x7f4ed815d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.402+0000 7f4ee0600640 1 -- 172.21.15.59:0/1511244989 shutdown_connections 2024-04-25T09:11:55.390 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.402+0000 7f4ee0600640 1 -- 172.21.15.59:0/1511244989 wait complete. 2024-04-25T09:11:55.409 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:55.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f7016c00640 1 Processor -- start 2024-04-25T09:11:55.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f7016c00640 1 -- start start 2024-04-25T09:11:55.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f7016c00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f701006ac10 0x7f701015df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.551 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f7016c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70100d0c40 0x7f70100d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f7016c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f701015e650 con 0x7f70100b39a0 2024-04-25T09:11:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f7016c00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701015eef0 con 0x7f701006ac10 2024-04-25T09:11:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f7016c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701015e930 con 0x7f70100d0c40 2024-04-25T09:11:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f700fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f701006ac10 0x7f701015df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f700fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f701006ac10 0x7f701015df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53336/0 (socket says 172.21.15.59:53336) 2024-04-25T09:11:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f700fe00640 1 -- 172.21.15.59:0/1974934270 learned_addr learned my addr 172.21.15.59:0/1974934270 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f7014c00640 1 --2- 172.21.15.59:0/1974934270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70100d0c40 0x7f70100d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f700fe00640 1 -- 172.21.15.59:0/1974934270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70100d0c40 msgr2=0x7f70100d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f700fe00640 1 --2- 172.21.15.59:0/1974934270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70100d0c40 0x7f70100d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f700fe00640 1 -- 172.21.15.59:0/1974934270 >> v1:172.21.15.178:6789/0 conn(0x7f70100b39a0 legacy=0x7f701006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.562+0000 7f700fe00640 1 -- 172.21.15.59:0/1974934270 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701015ec10 con 0x7f701006ac10 2024-04-25T09:11:55.554 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f700fe00640 1 --2- 172.21.15.59:0/1974934270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701006ac10 0x7f701015df00 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f7000009870 tx=0x7f700001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01a8e8e1ea33496 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:55.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f700f400640 1 -- 172.21.15.59:0/1974934270 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000a7070 con 0x7f701006ac10 2024-04-25T09:11:55.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f700f400640 1 -- 172.21.15.59:0/1974934270 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70000b0070 con 0x7f701006ac10 2024-04-25T09:11:55.555 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f700f400640 1 -- 172.21.15.59:0/1974934270 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000ab890 con 0x7f701006ac10 2024-04-25T09:11:55.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f7016c00640 1 -- 172.21.15.59:0/1974934270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701006ac10 msgr2=0x7f701015df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f7016c00640 1 --2- 172.21.15.59:0/1974934270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701006ac10 0x7f701015df00 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f7000009870 tx=0x7f700001c560 comp rx=0 tx=0).stop 2024-04-25T09:11:55.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f7016c00640 1 -- 172.21.15.59:0/1974934270 shutdown_connections 2024-04-25T09:11:55.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f7016c00640 1 --2- 172.21.15.59:0/1974934270 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70100d0c40 0x7f70100d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f7016c00640 1 --2- 172.21.15.59:0/1974934270 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f701006ac10 0x7f701015df00 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f7016c00640 1 -- 172.21.15.59:0/1974934270 >> 172.21.15.59:0/1974934270 conn(0x7f70100b2400 msgr2=0x7f70100b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:55.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f7016c00640 1 -- 172.21.15.59:0/1974934270 shutdown_connections 2024-04-25T09:11:55.556 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f7016c00640 1 -- 172.21.15.59:0/1974934270 wait complete. 2024-04-25T09:11:55.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f7016c00640 1 Processor -- start 2024-04-25T09:11:55.557 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.566+0000 7f7016c00640 1 -- start start 2024-04-25T09:11:55.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7016c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701006ac10 0x7f70101542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7016c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70100b39a0 0x7f7010142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.559 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7016c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70100d0c40 0x7f7010142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7016c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701016aa60 con 0x7f70100d0c40 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7016c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f701016a8e0 con 0x7f701006ac10 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7016c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701016abe0 con 0x7f70100b39a0 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7014c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70100d0c40 0x7f7010142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7014c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70100d0c40 0x7f7010142fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53348/0 (socket says 172.21.15.59:53348) 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7014c00640 1 -- 172.21.15.59:0/70833964 learned_addr learned my addr 172.21.15.59:0/70833964 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7007e00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70100b39a0 0x7f7010142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f700fe00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701006ac10 0x7f70101542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7014c00640 1 -- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70100b39a0 msgr2=0x7f7010142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7014c00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70100b39a0 0x7f7010142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7014c00640 1 -- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701006ac10 msgr2=0x7f70101542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7014c00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701006ac10 0x7f70101542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.560 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7014c00640 1 -- 172.21.15.59:0/70833964 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70101434f0 con 0x7f70100d0c40 2024-04-25T09:11:55.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7014c00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70100d0c40 0x7f7010142fb0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f700800efc0 tx=0x7f700800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:55.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f700cc00640 1 -- 172.21.15.59:0/70833964 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008018020 con 0x7f70100d0c40 2024-04-25T09:11:55.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f700cc00640 1 -- 172.21.15.59:0/70833964 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7008014480 con 0x7f70100d0c40 2024-04-25T09:11:55.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f700cc00640 1 -- 172.21.15.59:0/70833964 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7008014870 con 0x7f70100d0c40 2024-04-25T09:11:55.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7016c00640 1 -- 172.21.15.59:0/70833964 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70100cf4b0 con 0x7f70100d0c40 2024-04-25T09:11:55.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7016c00640 1 -- 172.21.15.59:0/70833964 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70100cc680 con 0x7f70100d0c40 2024-04-25T09:11:55.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.570+0000 7f7016c00640 1 -- 172.21.15.59:0/70833964 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70100745d0 con 0x7f70100d0c40 2024-04-25T09:11:55.561 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.574+0000 7f700cc00640 1 -- 172.21.15.59:0/70833964 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f700801b020 con 0x7f70100d0c40 2024-04-25T09:11:55.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.574+0000 7f700cc00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fec066f60 0x7f6fec069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.562 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.574+0000 7f700cc00640 1 -- 172.21.15.59:0/70833964 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f7008085b70 con 0x7f70100d0c40 2024-04-25T09:11:55.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.574+0000 7f700fe00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fec066f60 0x7f6fec069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.563 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.574+0000 7f700fe00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fec066f60 0x7f6fec069420 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f70000af000 tx=0x7f70000a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:55.566 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.578+0000 7f700cc00640 1 -- 172.21.15.59:0/70833964 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7008022070 con 0x7f70100d0c40 2024-04-25T09:11:55.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.774+0000 7f7016c00640 1 -- 172.21.15.59:0/70833964 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70100728d0 con 0x7f70100d0c40 2024-04-25T09:11:55.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.774+0000 7f700cc00640 1 -- 172.21.15.59:0/70833964 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4943 (secure 0 0 0) 0x7f7008010040 con 0x7f70100d0c40 2024-04-25T09:11:55.764 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:55.764 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":117,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":7613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3791633295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3791633295},{"type":"v1","addr":"172.21.15.59:6835","nonce":3791633295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:46.696297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9381":{"gid":9381,"name":"c","rank":0,"incarnation":114,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6833/836073822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":836073822},{"type":"v1","addr":"172.21.15.59:6833","nonce":836073822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:55.764 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 117 2024-04-25T09:11:55.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.778+0000 7f7016c00640 1 -- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fec066f60 msgr2=0x7f6fec069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.778+0000 7f7016c00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fec066f60 0x7f6fec069420 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f70000af000 tx=0x7f70000a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:55.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.778+0000 7f7016c00640 1 -- 172.21.15.59:0/70833964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70100d0c40 msgr2=0x7f7010142fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.778+0000 7f7016c00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70100d0c40 0x7f7010142fb0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f700800efc0 tx=0x7f700800c490 comp rx=0 tx=0).stop 2024-04-25T09:11:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.778+0000 7f7016c00640 1 -- 172.21.15.59:0/70833964 shutdown_connections 2024-04-25T09:11:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.778+0000 7f7016c00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6fec066f60 0x7f6fec069420 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.778+0000 7f7016c00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70100d0c40 0x7f7010142fb0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.778+0000 7f7016c00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f70100b39a0 0x7f7010142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.778+0000 7f7016c00640 1 --2- 172.21.15.59:0/70833964 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f701006ac10 0x7f70101542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.778+0000 7f7016c00640 1 -- 172.21.15.59:0/70833964 >> 172.21.15.59:0/70833964 conn(0x7f70100b2400 msgr2=0x7f7010161360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.778+0000 7f7016c00640 1 -- 172.21.15.59:0/70833964 shutdown_connections 2024-04-25T09:11:55.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.778+0000 7f7016c00640 1 -- 172.21.15.59:0/70833964 wait complete. 2024-04-25T09:11:55.785 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f36a7c00640 1 Processor -- start 2024-04-25T09:11:55.927 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f36a7c00640 1 -- start start 2024-04-25T09:11:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f36a7c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a015da10 0x7f36a00afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f36a7c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a015ddf0 con 0x7f36a00d11b0 2024-04-25T09:11:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f36a7c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a006b480 con 0x7f36a00b4210 2024-04-25T09:11:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f36a7c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00d06d0 con 0x7f36a015da10 2024-04-25T09:11:55.929 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f369fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f36a00d11b0 0x7f36a006ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39374/0 (socket says 172.21.15.59:39374) 2024-04-25T09:11:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f369fe00640 1 -- 172.21.15.59:0/3116315794 learned_addr learned my addr 172.21.15.59:0/3116315794 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f36a5200640 1 --2- 172.21.15.59:0/3116315794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a015da10 0x7f36a00afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f369f400640 1 -- 172.21.15.59:0/3116315794 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983264472 0 0) 0x7f36a015ddf0 con 0x7f36a00d11b0 2024-04-25T09:11:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f369f400640 1 -- 172.21.15.59:0/3116315794 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3688003530 con 0x7f36a00d11b0 2024-04-25T09:11:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f369f400640 1 -- 172.21.15.59:0/3116315794 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 871202614 0 0) 0x7f36a006b480 con 0x7f36a00b4210 2024-04-25T09:11:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f369f400640 1 -- 172.21.15.59:0/3116315794 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36a015ddf0 con 0x7f36a00b4210 2024-04-25T09:11:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f36a5200640 1 -- 172.21.15.59:0/3116315794 >> v1:172.21.15.178:6789/0 conn(0x7f36a00b4210 legacy=0x7f36a01615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f36a5200640 1 -- 172.21.15.59:0/3116315794 >> v1:172.21.15.59:6789/0 conn(0x7f36a00d11b0 legacy=0x7f36a006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.930 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.938+0000 7f36a5200640 1 -- 172.21.15.59:0/3116315794 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a00d09b0 con 0x7f36a015da10 2024-04-25T09:11:55.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.942+0000 7f36a5200640 1 --2- 172.21.15.59:0/3116315794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a015da10 0x7f36a00afe20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f36940097f0 tx=0x7f369401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cc392c0a4a2f703 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:55.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.942+0000 7f369f400640 1 -- 172.21.15.59:0/3116315794 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36940b0070 con 0x7f36a015da10 2024-04-25T09:11:55.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.942+0000 7f369f400640 1 -- 172.21.15.59:0/3116315794 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36940ab600 con 0x7f36a015da10 2024-04-25T09:11:55.932 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.942+0000 7f369f400640 1 -- 172.21.15.59:0/3116315794 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36940ab9d0 con 0x7f36a015da10 2024-04-25T09:11:55.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.942+0000 7f36a7c00640 1 -- 172.21.15.59:0/3116315794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a015da10 msgr2=0x7f36a00afe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.942+0000 7f36a7c00640 1 --2- 172.21.15.59:0/3116315794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a015da10 0x7f36a00afe20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f36940097f0 tx=0x7f369401c450 comp rx=0 tx=0).stop 2024-04-25T09:11:55.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.942+0000 7f36a7c00640 1 -- 172.21.15.59:0/3116315794 shutdown_connections 2024-04-25T09:11:55.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.942+0000 7f36a7c00640 1 --2- 172.21.15.59:0/3116315794 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a015da10 0x7f36a00afe20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.942+0000 7f36a7c00640 1 -- 172.21.15.59:0/3116315794 >> 172.21.15.59:0/3116315794 conn(0x7f36a00b2400 msgr2=0x7f36a00b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:55.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.942+0000 7f36a7c00640 1 -- 172.21.15.59:0/3116315794 shutdown_connections 2024-04-25T09:11:55.933 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.942+0000 7f36a7c00640 1 -- 172.21.15.59:0/3116315794 wait complete. 2024-04-25T09:11:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f36a7c00640 1 Processor -- start 2024-04-25T09:11:55.935 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f36a7c00640 1 -- start start 2024-04-25T09:11:55.936 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f36a7c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a00b4210 0x7f36a0147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f36a7c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36a00d11b0 0x7f36a0147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f36a7c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36a015da10 0x7f36a0150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f36a7c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a016bcf0 con 0x7f36a00d11b0 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f36a7c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a016bb70 con 0x7f36a015da10 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f36a7c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a016be70 con 0x7f36a00b4210 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f369fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36a00d11b0 0x7f36a0147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f369fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36a00d11b0 0x7f36a0147810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53358/0 (socket says 172.21.15.59:53358) 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f369fe00640 1 -- 172.21.15.59:0/2786582384 learned_addr learned my addr 172.21.15.59:0/2786582384 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f36a5c00640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36a015da10 0x7f36a0150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f36a5200640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a00b4210 0x7f36a0147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f369fe00640 1 -- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a00b4210 msgr2=0x7f36a0147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f369fe00640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a00b4210 0x7f36a0147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f369fe00640 1 -- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36a015da10 msgr2=0x7f36a0150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:55.937 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f369fe00640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36a015da10 0x7f36a0150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:55.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f369fe00640 1 -- 172.21.15.59:0/2786582384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a014c600 con 0x7f36a00d11b0 2024-04-25T09:11:55.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f369fe00640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36a00d11b0 0x7f36a0147810 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f368c00c4d0 tx=0x7f368c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:55.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f369cc00640 1 -- 172.21.15.59:0/2786582384 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c017070 con 0x7f36a00d11b0 2024-04-25T09:11:55.938 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f369cc00640 1 -- 172.21.15.59:0/2786582384 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f368c005cf0 con 0x7f36a00d11b0 2024-04-25T09:11:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f36a7c00640 1 -- 172.21.15.59:0/2786582384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a014c8e0 con 0x7f36a00d11b0 2024-04-25T09:11:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f369cc00640 1 -- 172.21.15.59:0/2786582384 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c0072b0 con 0x7f36a00d11b0 2024-04-25T09:11:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.946+0000 7f36a7c00640 1 -- 172.21.15.59:0/2786582384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a014cea0 con 0x7f36a00d11b0 2024-04-25T09:11:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.950+0000 7f36a7c00640 1 -- 172.21.15.59:0/2786582384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a00745d0 con 0x7f36a00d11b0 2024-04-25T09:11:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.950+0000 7f369cc00640 1 -- 172.21.15.59:0/2786582384 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f368c01a070 con 0x7f36a00d11b0 2024-04-25T09:11:55.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.950+0000 7f369cc00640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3680066f60 0x7f3680069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.950+0000 7f369cc00640 1 -- 172.21.15.59:0/2786582384 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f368c084540 con 0x7f36a00d11b0 2024-04-25T09:11:55.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.950+0000 7f36a5200640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3680066f60 0x7f3680069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:55.941 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.950+0000 7f36a5200640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3680066f60 0x7f3680069420 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f36940ad000 tx=0x7f36940a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:55.944 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:55.954+0000 7f369cc00640 1 -- 172.21.15.59:0/2786582384 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f368c054d30 con 0x7f36a00d11b0 2024-04-25T09:11:56.107 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.118+0000 7f36a7c00640 1 -- 172.21.15.59:0/2786582384 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36a0072860 con 0x7f36a00d11b0 2024-04-25T09:11:56.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.118+0000 7f369cc00640 1 -- 172.21.15.59:0/2786582384 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+17207 (secure 0 0 0) 0x7f368c058dd0 con 0x7f36a00d11b0 2024-04-25T09:11:56.108 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:56.109 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":123,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:42.673680+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:15.429862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:16.011038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/29546856":"2024-04-26T09:11:31.741997+0000","172.21.15.59:6833/1679876837":"2024-04-26T09:11:42.673656+0000","172.21.15.59:6832/1679876837":"2024-04-26T09:11:42.673656+0000","172.21.15.59:6834/29546856":"2024-04-26T09:11:31.741997+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:56.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.122+0000 7f36a7c00640 1 -- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3680066f60 msgr2=0x7f3680069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.122+0000 7f36a7c00640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3680066f60 0x7f3680069420 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f36940ad000 tx=0x7f36940a6000 comp rx=0 tx=0).stop 2024-04-25T09:11:56.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.122+0000 7f36a7c00640 1 -- 172.21.15.59:0/2786582384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36a00d11b0 msgr2=0x7f36a0147810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.122+0000 7f36a7c00640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36a00d11b0 0x7f36a0147810 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f368c00c4d0 tx=0x7f368c00c990 comp rx=0 tx=0).stop 2024-04-25T09:11:56.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.122+0000 7f36a7c00640 1 -- 172.21.15.59:0/2786582384 shutdown_connections 2024-04-25T09:11:56.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.122+0000 7f36a7c00640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3680066f60 0x7f3680069420 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.122+0000 7f36a7c00640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f36a015da10 0x7f36a0150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.122+0000 7f36a7c00640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36a00d11b0 0x7f36a0147810 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.122+0000 7f36a7c00640 1 --2- 172.21.15.59:0/2786582384 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f36a00b4210 0x7f36a0147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.122+0000 7f36a7c00640 1 -- 172.21.15.59:0/2786582384 >> 172.21.15.59:0/2786582384 conn(0x7f36a00b2400 msgr2=0x7f36a0151aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:56.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.122+0000 7f36a7c00640 1 -- 172.21.15.59:0/2786582384 shutdown_connections 2024-04-25T09:11:56.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.122+0000 7f36a7c00640 1 -- 172.21.15.59:0/2786582384 wait complete. 2024-04-25T09:11:56.130 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:11:56.130 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a61200640 1 Processor -- start 2024-04-25T09:11:56.270 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a61200640 1 -- start start 2024-04-25T09:11:56.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a61200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f4a5c0cef30 0x7f4a5c06e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.271 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a61200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c06e900 0x7f4a5c0b0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a61200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5c15ac60 con 0x7f4a5c144140 2024-04-25T09:11:56.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a61200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a5c06ed50 con 0x7f4a5c0cef30 2024-04-25T09:11:56.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a61200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c0cf3e0 con 0x7f4a5c06e900 2024-04-25T09:11:56.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4a5c144140 0x7f4a5c0ce820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39380/0 (socket says 172.21.15.59:39380) 2024-04-25T09:11:56.272 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59e00640 1 -- 172.21.15.59:0/1679980818 learned_addr learned my addr 172.21.15.59:0/1679980818 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:56.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102154975 0 0) 0x7f4a5c15ac60 con 0x7f4a5c144140 2024-04-25T09:11:56.273 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a51400640 1 --2- 172.21.15.59:0/1679980818 >> v2:172.21.15.178:3300/0 conn(0x7f4a5c0cef30 0x7f4a5c06e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a40003530 con 0x7f4a5c144140 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a5a800640 1 --2- 172.21.15.59:0/1679980818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c06e900 0x7f4a5c0b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 733036463 0 0) 0x7f4a40003530 con 0x7f4a5c144140 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c06e900 msgr2=0x7f4a5c0b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 --2- 172.21.15.59:0/1679980818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c06e900 0x7f4a5c0b0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 >> v2:172.21.15.178:3300/0 conn(0x7f4a5c0cef30 msgr2=0x7f4a5c06e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 --2- 172.21.15.59:0/1679980818 >> v2:172.21.15.178:3300/0 conn(0x7f4a5c0cef30 0x7f4a5c06e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c15af20 con 0x7f4a5c144140 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f4a4c001680 con 0x7f4a5c144140 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 >> v1:172.21.15.59:6789/0 conn(0x7f4a5c144140 legacy=0x7f4a5c0ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 --2- 172.21.15.59:0/1679980818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a400039c0 0x7f4a40003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 --2- 172.21.15.59:0/1679980818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c06e900 0x7f4a40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 --2- 172.21.15.59:0/1679980818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a40004d50 0x7f4a400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c06ed50 con 0x7f4a40004d50 2024-04-25T09:11:56.274 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c0cf3e0 con 0x7f4a400039c0 2024-04-25T09:11:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4000b9d0 con 0x7f4a5c06e900 2024-04-25T09:11:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a5a800640 1 --2- 172.21.15.59:0/1679980818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a40004d50 0x7f4a400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a51400640 1 --2- 172.21.15.59:0/1679980818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c06e900 0x7f4a40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.282+0000 7f4a59e00640 1 --2- 172.21.15.59:0/1679980818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a400039c0 0x7f4a40003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a5a800640 1 -- 172.21.15.59:0/1679980818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c06e900 msgr2=0x7f4a40004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a5a800640 1 --2- 172.21.15.59:0/1679980818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c06e900 0x7f4a40004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a5a800640 1 -- 172.21.15.59:0/1679980818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a400039c0 msgr2=0x7f4a40003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a5a800640 1 --2- 172.21.15.59:0/1679980818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a400039c0 0x7f4a40003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.275 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a5a800640 1 -- 172.21.15.59:0/1679980818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a40003530 con 0x7f4a40004d50 2024-04-25T09:11:56.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a5a800640 1 --2- 172.21.15.59:0/1679980818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a40004d50 0x7f4a400051d0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009670 tx=0x7f4a5401eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82acb601a711b284 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:56.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a540b4070 con 0x7f4a40004d50 2024-04-25T09:11:56.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a540a78a0 con 0x7f4a40004d50 2024-04-25T09:11:56.276 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a59400640 1 -- 172.21.15.59:0/1679980818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a540096b0 con 0x7f4a40004d50 2024-04-25T09:11:56.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a61200640 1 -- 172.21.15.59:0/1679980818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a40004d50 msgr2=0x7f4a400051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a61200640 1 --2- 172.21.15.59:0/1679980818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a40004d50 0x7f4a400051d0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009670 tx=0x7f4a5401eca0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a5a800640 1 -- 172.21.15.59:0/1679980818 reap_dead start 2024-04-25T09:11:56.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a61200640 1 -- 172.21.15.59:0/1679980818 shutdown_connections 2024-04-25T09:11:56.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a61200640 1 -- 172.21.15.59:0/1679980818 >> 172.21.15.59:0/1679980818 conn(0x7f4a5c066fa0 msgr2=0x7f4a5c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:56.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a61200640 1 -- 172.21.15.59:0/1679980818 shutdown_connections 2024-04-25T09:11:56.277 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.286+0000 7f4a61200640 1 -- 172.21.15.59:0/1679980818 wait complete. 2024-04-25T09:11:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a61200640 1 Processor -- start 2024-04-25T09:11:56.279 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a61200640 1 -- start start 2024-04-25T09:11:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a61200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a40004d50 0x7f4a5c141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a61200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c135790 0x7f4a5c135bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a61200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5c12fdc0 0x7f4a5c130240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a61200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c0b1f30 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a61200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c15b4e0 con 0x7f4a40004d50 2024-04-25T09:11:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a61200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5c144520 con 0x7f4a5c135790 2024-04-25T09:11:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a5a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5c12fdc0 0x7f4a5c130240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.280 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a5a800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5c12fdc0 0x7f4a5c130240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53390/0 (socket says 172.21.15.59:53390) 2024-04-25T09:11:56.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a5a800640 1 -- 172.21.15.59:0/2098366883 learned_addr learned my addr 172.21.15.59:0/2098366883 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:56.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a59e00640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a40004d50 0x7f4a5c141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a51400640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c135790 0x7f4a5c135bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.281 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a5a800640 1 -- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c135790 msgr2=0x7f4a5c135bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a5a800640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c135790 0x7f4a5c135bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a5a800640 1 -- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a40004d50 msgr2=0x7f4a5c141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a5a800640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a40004d50 0x7f4a5c141f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a5a800640 1 -- 172.21.15.59:0/2098366883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5c130b30 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a5a800640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5c12fdc0 0x7f4a5c130240 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f4a540b2040 tx=0x7f4a40005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a52a00640 1 -- 172.21.15.59:0/2098366883 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a540bd070 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a52a00640 1 -- 172.21.15.59:0/2098366883 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a54000e50 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a52a00640 1 -- 172.21.15.59:0/2098366883 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a540b4040 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.290+0000 7f4a61200640 1 -- 172.21.15.59:0/2098366883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5c130e10 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.282 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.294+0000 7f4a61200640 1 -- 172.21.15.59:0/2098366883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a5c1313d0 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.294+0000 7f4a61200640 1 -- 172.21.15.59:0/2098366883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5c0745d0 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.283 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.294+0000 7f4a52a00640 1 -- 172.21.15.59:0/2098366883 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4a540c0070 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.294+0000 7f4a52a00640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4a38066f60 0x7f4a38069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.294+0000 7f4a52a00640 1 -- 172.21.15.59:0/2098366883 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f4a54120ad0 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.284 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.294+0000 7f4a59e00640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4a38066f60 0x7f4a38069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.285 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.294+0000 7f4a59e00640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4a38066f60 0x7f4a38069420 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c000c10 tx=0x7f4a4c007900 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:56.288 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.298+0000 7f4a52a00640 1 -- 172.21.15.59:0/2098366883 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4a540189b0 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.494+0000 7f4a61200640 1 -- 172.21.15.59:0/2098366883 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a5c06e1e0 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.494+0000 7f4a52a00640 1 -- 172.21.15.59:0/2098366883 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4943 (secure 0 0 0) 0x7f4a540f11b0 con 0x7f4a5c12fdc0 2024-04-25T09:11:56.484 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:56.484 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":117,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":7613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3791633295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3791633295},{"type":"v1","addr":"172.21.15.59:6835","nonce":3791633295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:46.696297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9381":{"gid":9381,"name":"c","rank":0,"incarnation":114,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6833/836073822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":836073822},{"type":"v1","addr":"172.21.15.59:6833","nonce":836073822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:56.484 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 117 2024-04-25T09:11:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.498+0000 7f4a61200640 1 -- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4a38066f60 msgr2=0x7f4a38069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.498+0000 7f4a61200640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4a38066f60 0x7f4a38069420 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c000c10 tx=0x7f4a4c007900 comp rx=0 tx=0).stop 2024-04-25T09:11:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.498+0000 7f4a61200640 1 -- 172.21.15.59:0/2098366883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5c12fdc0 msgr2=0x7f4a5c130240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.498+0000 7f4a61200640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5c12fdc0 0x7f4a5c130240 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f4a540b2040 tx=0x7f4a40005840 comp rx=0 tx=0).stop 2024-04-25T09:11:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.498+0000 7f4a61200640 1 -- 172.21.15.59:0/2098366883 shutdown_connections 2024-04-25T09:11:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.498+0000 7f4a61200640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4a38066f60 0x7f4a38069420 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.486 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.498+0000 7f4a61200640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4a5c12fdc0 0x7f4a5c130240 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.498+0000 7f4a61200640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4a5c135790 0x7f4a5c135bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.498+0000 7f4a61200640 1 --2- 172.21.15.59:0/2098366883 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4a40004d50 0x7f4a5c141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.498+0000 7f4a61200640 1 -- 172.21.15.59:0/2098366883 >> 172.21.15.59:0/2098366883 conn(0x7f4a5c066fa0 msgr2=0x7f4a5c15ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.498+0000 7f4a61200640 1 -- 172.21.15.59:0/2098366883 shutdown_connections 2024-04-25T09:11:56.487 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.498+0000 7f4a61200640 1 -- 172.21.15.59:0/2098366883 wait complete. 2024-04-25T09:11:56.506 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:11:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.658+0000 7f9bc3e00640 1 Processor -- start 2024-04-25T09:11:56.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.658+0000 7f9bc3e00640 1 -- start start 2024-04-25T09:11:56.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc3e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9bbc06ac10 0x7f9bbc15df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bbc0b39a0 0x7f9bbc06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc3e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc06b530 con 0x7f9bbc0d0c40 2024-04-25T09:11:56.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc3e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc15eef0 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc3e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bbc15e650 con 0x7f9bbc06ac10 2024-04-25T09:11:56.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc0a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9bbc0b39a0 0x7f9bbc06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc1e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9bbc0d0c40 0x7f9bbc06fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39396/0 (socket says 172.21.15.59:39396) 2024-04-25T09:11:56.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc1e00640 1 -- 172.21.15.59:0/582348658 learned_addr learned my addr 172.21.15.59:0/582348658 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:56.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc1400640 1 --2- 172.21.15.59:0/582348658 >> v2:172.21.15.178:3300/0 conn(0x7f9bbc06ac10 0x7f9bbc15df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc0a00640 1 -- 172.21.15.59:0/582348658 >> v2:172.21.15.178:3300/0 conn(0x7f9bbc06ac10 msgr2=0x7f9bbc15df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:56.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc0a00640 1 --2- 172.21.15.59:0/582348658 >> v2:172.21.15.178:3300/0 conn(0x7f9bbc06ac10 0x7f9bbc15df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc0a00640 1 -- 172.21.15.59:0/582348658 >> v1:172.21.15.59:6789/0 conn(0x7f9bbc0d0c40 legacy=0x7f9bbc06fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc0a00640 1 -- 172.21.15.59:0/582348658 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc15e930 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bbbe00640 1 -- 172.21.15.59:0/582348658 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336916069 0 0) 0x7f9bbc06b530 con 0x7f9bbc0d0c40 2024-04-25T09:11:56.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bc0a00640 1 --2- 172.21.15.59:0/582348658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc0b39a0 0x7f9bbc06aff0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc06d660 tx=0x7f9ba801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a473bf92c6c982 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:56.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bbbe00640 1 -- 172.21.15.59:0/582348658 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80b0070 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.662+0000 7f9bbbe00640 1 -- 172.21.15.59:0/582348658 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba80ab600 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bbbe00640 1 -- 172.21.15.59:0/582348658 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80ab9d0 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 -- 172.21.15.59:0/582348658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc0b39a0 msgr2=0x7f9bbc06aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 --2- 172.21.15.59:0/582348658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc0b39a0 0x7f9bbc06aff0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc06d660 tx=0x7f9ba801c480 comp rx=0 tx=0).stop 2024-04-25T09:11:56.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 -- 172.21.15.59:0/582348658 shutdown_connections 2024-04-25T09:11:56.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 --2- 172.21.15.59:0/582348658 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc0b39a0 0x7f9bbc06aff0 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 --2- 172.21.15.59:0/582348658 >> v2:172.21.15.178:3300/0 conn(0x7f9bbc06ac10 0x7f9bbc15df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 -- 172.21.15.59:0/582348658 >> 172.21.15.59:0/582348658 conn(0x7f9bbc0b2400 msgr2=0x7f9bbc0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:56.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 -- 172.21.15.59:0/582348658 shutdown_connections 2024-04-25T09:11:56.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 -- 172.21.15.59:0/582348658 wait complete. 2024-04-25T09:11:56.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 Processor -- start 2024-04-25T09:11:56.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 -- start start 2024-04-25T09:11:56.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bbc06ac10 0x7f9bbc15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc0b39a0 0x7f9bbc152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bbc0d0c40 0x7f9bbc1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0b01b0 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0b0030 con 0x7f9bbc06ac10 2024-04-25T09:11:56.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc3e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc070230 con 0x7f9bbc0d0c40 2024-04-25T09:11:56.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc0b39a0 0x7f9bbc152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc0a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc0b39a0 0x7f9bbc152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53408/0 (socket says 172.21.15.59:53408) 2024-04-25T09:11:56.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc0a00640 1 -- 172.21.15.59:0/3965810822 learned_addr learned my addr 172.21.15.59:0/3965810822 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc1400640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bbc06ac10 0x7f9bbc15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc1e00640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bbc0d0c40 0x7f9bbc1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc0a00640 1 -- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bbc0d0c40 msgr2=0x7f9bbc1507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc0a00640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bbc0d0c40 0x7f9bbc1507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc0a00640 1 -- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bbc06ac10 msgr2=0x7f9bbc15d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc0a00640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bbc06ac10 0x7f9bbc15d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc0a00640 1 -- 172.21.15.59:0/3965810822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc15c070 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.666+0000 7f9bc1400640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bbc06ac10 0x7f9bbc15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.670+0000 7f9bc0a00640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc0b39a0 0x7f9bbc152ad0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80ae040 tx=0x7f9ba8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.670+0000 7f9bb9600640 1 -- 172.21.15.59:0/3965810822 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80ba070 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.670+0000 7f9bb9600640 1 -- 172.21.15.59:0/3965810822 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba80b43f0 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.670+0000 7f9bc3e00640 1 -- 172.21.15.59:0/3965810822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc15a2a0 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.670+0000 7f9bb9600640 1 -- 172.21.15.59:0/3965810822 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80b0040 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.670+0000 7f9bc3e00640 1 -- 172.21.15.59:0/3965810822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc0cd460 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.670+0000 7f9bc3e00640 1 -- 172.21.15.59:0/3965810822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bbc15a470 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.670+0000 7f9bb9600640 1 -- 172.21.15.59:0/3965810822 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9ba80bd070 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.670+0000 7f9bb9600640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9b9c066f60 0x7f9b9c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:56.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.670+0000 7f9bb9600640 1 -- 172.21.15.59:0/3965810822 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f9ba811e240 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.661 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.670+0000 7f9bc1400640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9b9c066f60 0x7f9b9c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:56.662 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.674+0000 7f9bc1400640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9b9c066f60 0x7f9b9c069420 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc1fa3b0 tx=0x7f9bb0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:56.664 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.674+0000 7f9bb9600640 1 -- 172.21.15.59:0/3965810822 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f9ba8016070 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.861 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.870+0000 7f9bc3e00640 1 -- 172.21.15.59:0/3965810822 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bbc0cd660 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bb9600640 1 -- 172.21.15.59:0/3965810822 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+4943 (secure 0 0 0) 0x7f9bbc0cd660 con 0x7f9bbc0b39a0 2024-04-25T09:11:56.863 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:56.863 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":117,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":7613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3791633295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3791633295},{"type":"v1","addr":"172.21.15.59:6835","nonce":3791633295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99}],"filesystems":[{"mdsmap":{"epoch":117,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T09:11:17.015550+0000","modified":"2024-04-25T09:11:46.696297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":123,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":9381},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9381":{"gid":9381,"name":"c","rank":0,"incarnation":114,"state":"up:active","state_seq":4,"addr":"172.21.15.59:6833/836073822","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":836073822},{"type":"v1","addr":"172.21.15.59:6833","nonce":836073822}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-25T09:11:56.863 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 117 2024-04-25T09:11:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bc3e00640 1 -- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9b9c066f60 msgr2=0x7f9b9c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bc3e00640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9b9c066f60 0x7f9b9c069420 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc1fa3b0 tx=0x7f9bb0008040 comp rx=0 tx=0).stop 2024-04-25T09:11:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bc3e00640 1 -- 172.21.15.59:0/3965810822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc0b39a0 msgr2=0x7f9bbc152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bc3e00640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc0b39a0 0x7f9bbc152ad0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80ae040 tx=0x7f9ba8019220 comp rx=0 tx=0).stop 2024-04-25T09:11:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bc3e00640 1 -- 172.21.15.59:0/3965810822 shutdown_connections 2024-04-25T09:11:56.865 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bc3e00640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9b9c066f60 0x7f9b9c069420 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bc3e00640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9bbc0d0c40 0x7f9bbc1507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bc3e00640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9bbc0b39a0 0x7f9bbc152ad0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bc3e00640 1 --2- 172.21.15.59:0/3965810822 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9bbc06ac10 0x7f9bbc15d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bc3e00640 1 -- 172.21.15.59:0/3965810822 >> 172.21.15.59:0/3965810822 conn(0x7f9bbc0b2400 msgr2=0x7f9bbc0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bc3e00640 1 -- 172.21.15.59:0/3965810822 shutdown_connections 2024-04-25T09:11:56.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:56.874+0000 7f9bc3e00640 1 -- 172.21.15.59:0/3965810822 wait complete. 2024-04-25T09:11:56.886 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:11:57.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a67800640 1 Processor -- start 2024-04-25T09:11:57.026 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a67800640 1 -- start start 2024-04-25T09:11:57.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a67800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a6015fe50 0x7f1a600b1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a67800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a600b1c90 0x7f1a6015bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a67800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a600b20a0 con 0x7f1a60145270 2024-04-25T09:11:57.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a67800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a60145650 con 0x7f1a600b1c90 2024-04-25T09:11:57.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a67800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a601602b0 con 0x7f1a6015fe50 2024-04-25T09:11:57.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a65800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a600b1c90 0x7f1a6015bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a65800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a600b1c90 0x7f1a6015bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53422/0 (socket says 172.21.15.59:53422) 2024-04-25T09:11:57.028 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a65800640 1 -- 172.21.15.59:0/3824732828 learned_addr learned my addr 172.21.15.59:0/3824732828 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:57.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a65800640 1 -- 172.21.15.59:0/3824732828 >> v2:172.21.15.178:3300/0 conn(0x7f1a6015fe50 msgr2=0x7f1a600b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:57.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a57e00640 1 --2- 172.21.15.59:0/3824732828 >> v2:172.21.15.178:3300/0 conn(0x7f1a6015fe50 0x7f1a600b1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a65800640 1 --2- 172.21.15.59:0/3824732828 >> v2:172.21.15.178:3300/0 conn(0x7f1a6015fe50 0x7f1a600b1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a65800640 1 -- 172.21.15.59:0/3824732828 >> v1:172.21.15.59:6789/0 conn(0x7f1a60145270 legacy=0x7f1a600cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a5fe00640 1 -- 172.21.15.59:0/3824732828 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984354841 0 0) 0x7f1a50001120 con 0x7f1a60145270 2024-04-25T09:11:57.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a65800640 1 -- 172.21.15.59:0/3824732828 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a600cc4e0 con 0x7f1a600b1c90 2024-04-25T09:11:57.029 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.038+0000 7f1a57e00640 1 --2- 172.21.15.59:0/3824732828 >> v2:172.21.15.178:3300/0 conn(0x7f1a6015fe50 0x7f1a600b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:57.031 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.042+0000 7f1a65800640 1 --2- 172.21.15.59:0/3824732828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b1c90 0x7f1a6015bd80 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f1a600b24b0 tx=0x7f1a5801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf8df2bb026d4b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:57.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.042+0000 7f1a5fe00640 1 -- 172.21.15.59:0/3824732828 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580a5880 con 0x7f1a600b1c90 2024-04-25T09:11:57.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.042+0000 7f1a5fe00640 1 -- 172.21.15.59:0/3824732828 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a580a5a20 con 0x7f1a600b1c90 2024-04-25T09:11:57.032 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.042+0000 7f1a5fe00640 1 -- 172.21.15.59:0/3824732828 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a580a5df0 con 0x7f1a600b1c90 2024-04-25T09:11:57.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.042+0000 7f1a67800640 1 -- 172.21.15.59:0/3824732828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b1c90 msgr2=0x7f1a6015bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.042+0000 7f1a67800640 1 --2- 172.21.15.59:0/3824732828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b1c90 0x7f1a6015bd80 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f1a600b24b0 tx=0x7f1a5801c9c0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.042+0000 7f1a67800640 1 -- 172.21.15.59:0/3824732828 shutdown_connections 2024-04-25T09:11:57.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.042+0000 7f1a67800640 1 --2- 172.21.15.59:0/3824732828 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b1c90 0x7f1a6015bd80 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.042+0000 7f1a67800640 1 --2- 172.21.15.59:0/3824732828 >> v2:172.21.15.178:3300/0 conn(0x7f1a6015fe50 0x7f1a600b1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.033 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.042+0000 7f1a67800640 1 -- 172.21.15.59:0/3824732828 >> 172.21.15.59:0/3824732828 conn(0x7f1a60066fa0 msgr2=0x7f1a6006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:57.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.042+0000 7f1a67800640 1 -- 172.21.15.59:0/3824732828 shutdown_connections 2024-04-25T09:11:57.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.042+0000 7f1a67800640 1 -- 172.21.15.59:0/3824732828 wait complete. 2024-04-25T09:11:57.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a67800640 1 Processor -- start 2024-04-25T09:11:57.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a67800640 1 -- start start 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a67800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b1c90 0x7f1a600af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a67800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a60145270 0x7f1a600b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a67800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a6015fe50 0x7f1a600b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a67800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6015f930 con 0x7f1a600b1c90 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a67800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6015f650 con 0x7f1a60145270 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a67800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a600cdbe0 con 0x7f1a6015fe50 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a64e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b1c90 0x7f1a600af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a64e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b1c90 0x7f1a600af540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53432/0 (socket says 172.21.15.59:53432) 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a64e00640 1 -- 172.21.15.59:0/3764010072 learned_addr learned my addr 172.21.15.59:0/3764010072 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a57e00640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a60145270 0x7f1a600b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a65800640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a6015fe50 0x7f1a600b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a64e00640 1 -- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a6015fe50 msgr2=0x7f1a600b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a64e00640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a6015fe50 0x7f1a600b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a64e00640 1 -- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a60145270 msgr2=0x7f1a600b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a64e00640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a60145270 0x7f1a600b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a64e00640 1 -- 172.21.15.59:0/3764010072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a601383a0 con 0x7f1a600b1c90 2024-04-25T09:11:57.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a64e00640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b1c90 0x7f1a600af540 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000c780 tx=0x7f1a5000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:57.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a5d600640 1 -- 172.21.15.59:0/3764010072 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a50017070 con 0x7f1a600b1c90 2024-04-25T09:11:57.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a5d600640 1 -- 172.21.15.59:0/3764010072 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a50005290 con 0x7f1a600b1c90 2024-04-25T09:11:57.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a5d600640 1 -- 172.21.15.59:0/3764010072 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5000a640 con 0x7f1a600b1c90 2024-04-25T09:11:57.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a67800640 1 -- 172.21.15.59:0/3764010072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6013bf60 con 0x7f1a600b1c90 2024-04-25T09:11:57.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a67800640 1 -- 172.21.15.59:0/3764010072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a600b4370 con 0x7f1a600b1c90 2024-04-25T09:11:57.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.046+0000 7f1a67800640 1 -- 172.21.15.59:0/3764010072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a600745d0 con 0x7f1a600b1c90 2024-04-25T09:11:57.038 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.050+0000 7f1a5d600640 1 -- 172.21.15.59:0/3764010072 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1a5001a070 con 0x7f1a600b1c90 2024-04-25T09:11:57.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.050+0000 7f1a5d600640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a3c066f90 0x7f1a3c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.050+0000 7f1a5d600640 1 -- 172.21.15.59:0/3764010072 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f1a50084540 con 0x7f1a600b1c90 2024-04-25T09:11:57.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.050+0000 7f1a57e00640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a3c066f90 0x7f1a3c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.050+0000 7f1a57e00640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a3c066f90 0x7f1a3c069450 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1a6013b3d0 tx=0x7f1a48008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:57.043 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.054+0000 7f1a5d600640 1 -- 172.21.15.59:0/3764010072 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1a600b20a0 con 0x7f1a600b1c90 2024-04-25T09:11:57.207 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.218+0000 7f1a67800640 1 -- 172.21.15.59:0/3764010072 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a60144a60 con 0x7f1a600b1c90 2024-04-25T09:11:57.208 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.218+0000 7f1a5d600640 1 -- 172.21.15.59:0/3764010072 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+17207 (secure 0 0 0) 0x7f1a50054cb0 con 0x7f1a600b1c90 2024-04-25T09:11:57.208 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:11:57.209 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":123,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:11:42.673680+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2024-04-25T09:11:15.429862+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2024-04-25T09:11:16.011038+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/29546856":"2024-04-26T09:11:31.741997+0000","172.21.15.59:6833/1679876837":"2024-04-26T09:11:42.673656+0000","172.21.15.59:6832/1679876837":"2024-04-26T09:11:42.673656+0000","172.21.15.59:6834/29546856":"2024-04-26T09:11:31.741997+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:11:57.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.222+0000 7f1a67800640 1 -- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a3c066f90 msgr2=0x7f1a3c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.222+0000 7f1a67800640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a3c066f90 0x7f1a3c069450 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1a6013b3d0 tx=0x7f1a48008040 comp rx=0 tx=0).stop 2024-04-25T09:11:57.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.222+0000 7f1a67800640 1 -- 172.21.15.59:0/3764010072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b1c90 msgr2=0x7f1a600af540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.222+0000 7f1a67800640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b1c90 0x7f1a600af540 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f1a5000c780 tx=0x7f1a5000cc40 comp rx=0 tx=0).stop 2024-04-25T09:11:57.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.222+0000 7f1a67800640 1 -- 172.21.15.59:0/3764010072 shutdown_connections 2024-04-25T09:11:57.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.222+0000 7f1a67800640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a3c066f90 0x7f1a3c069450 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.222+0000 7f1a67800640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a6015fe50 0x7f1a600b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.210 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.222+0000 7f1a67800640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a60145270 0x7f1a600b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.222+0000 7f1a67800640 1 --2- 172.21.15.59:0/3764010072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a600b1c90 0x7f1a600af540 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.222+0000 7f1a67800640 1 -- 172.21.15.59:0/3764010072 >> 172.21.15.59:0/3764010072 conn(0x7f1a60066fa0 msgr2=0x7f1a60141820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:57.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.222+0000 7f1a67800640 1 -- 172.21.15.59:0/3764010072 shutdown_connections 2024-04-25T09:11:57.211 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.222+0000 7f1a67800640 1 -- 172.21.15.59:0/3764010072 wait complete. 2024-04-25T09:11:57.229 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T09:11:57.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55cd800640 1 Processor -- start 2024-04-25T09:11:57.370 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55cd800640 1 -- start start 2024-04-25T09:11:57.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55cd800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f55c815dc60 0x7f55c80d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55cd800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c815e040 con 0x7f55c809a170 2024-04-25T09:11:57.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55cd800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c80cff80 con 0x7f55c806bf30 2024-04-25T09:11:57.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55cd800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c80d0260 con 0x7f55c815dc60 2024-04-25T09:11:57.371 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c7400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f55c809a170 0x7f55c80cbd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39424/0 (socket says 172.21.15.59:39424) 2024-04-25T09:11:57.372 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c7400640 1 -- 172.21.15.59:0/639797682 learned_addr learned my addr 172.21.15.59:0/639797682 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:11:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6a00640 1 --2- 172.21.15.59:0/639797682 >> v2:172.21.15.178:3300/0 conn(0x7f55c815dc60 0x7f55c80d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644565669 0 0) 0x7f55c815e040 con 0x7f55c809a170 2024-04-25T09:11:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55ac003530 con 0x7f55c809a170 2024-04-25T09:11:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4089772763 0 0) 0x7f55ac003530 con 0x7f55c809a170 2024-04-25T09:11:57.373 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 >> v2:172.21.15.178:3300/0 conn(0x7f55c815dc60 msgr2=0x7f55c80d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 --2- 172.21.15.59:0/639797682 >> v2:172.21.15.178:3300/0 conn(0x7f55c815dc60 0x7f55c80d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 >> v1:172.21.15.178:6789/0 conn(0x7f55c806bf30 legacy=0x7f55c8099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c80d0540 con 0x7f55c809a170 2024-04-25T09:11:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f55c0001680 con 0x7f55c809a170 2024-04-25T09:11:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 >> v1:172.21.15.59:6789/0 conn(0x7f55c809a170 legacy=0x7f55c80cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 --2- 172.21.15.59:0/639797682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55ac0039c0 0x7f55ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.374 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 --2- 172.21.15.59:0/639797682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 0x7f55ac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 --2- 172.21.15.59:0/639797682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55ac0051d0 0x7f55ac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80d0260 con 0x7f55ac004810 2024-04-25T09:11:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac00c170 con 0x7f55ac0051d0 2024-04-25T09:11:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ac00c370 con 0x7f55ac0039c0 2024-04-25T09:11:57.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55be000640 1 --2- 172.21.15.59:0/639797682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 0x7f55ac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c6a00640 1 --2- 172.21.15.59:0/639797682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55ac0039c0 0x7f55ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c7400640 1 --2- 172.21.15.59:0/639797682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55ac0051d0 0x7f55ac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55be000640 1 -- 172.21.15.59:0/639797682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55ac0039c0 msgr2=0x7f55ac003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55be000640 1 --2- 172.21.15.59:0/639797682 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55ac0039c0 0x7f55ac003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55be000640 1 -- 172.21.15.59:0/639797682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55ac0051d0 msgr2=0x7f55ac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55be000640 1 --2- 172.21.15.59:0/639797682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55ac0051d0 0x7f55ac00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55be000640 1 -- 172.21.15.59:0/639797682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac003530 con 0x7f55ac004810 2024-04-25T09:11:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c7400640 1 --2- 172.21.15.59:0/639797682 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55ac0051d0 0x7f55ac00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:57.378 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.382+0000 7f55c7400640 1 -- 172.21.15.59:0/639797682 reap_dead start 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.386+0000 7f55be000640 1 --2- 172.21.15.59:0/639797682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 0x7f55ac004c90 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f55b0001e70 tx=0x7f55b001c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4bdbac73581c46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.386+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0001a90 con 0x7f55ac004810 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.386+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b0003b80 con 0x7f55ac004810 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.386+0000 7f55c6000640 1 -- 172.21.15.59:0/639797682 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0005080 con 0x7f55ac004810 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.386+0000 7f55cd800640 1 -- 172.21.15.59:0/639797682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 msgr2=0x7f55ac004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.386+0000 7f55cd800640 1 --2- 172.21.15.59:0/639797682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 0x7f55ac004c90 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f55b0001e70 tx=0x7f55b001c730 comp rx=0 tx=0).stop 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.386+0000 7f55cd800640 1 -- 172.21.15.59:0/639797682 shutdown_connections 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.386+0000 7f55cd800640 1 --2- 172.21.15.59:0/639797682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 0x7f55ac004c90 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.386+0000 7f55cd800640 1 -- 172.21.15.59:0/639797682 >> 172.21.15.59:0/639797682 conn(0x7f55c80b3200 msgr2=0x7f55c80b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.386+0000 7f55cd800640 1 -- 172.21.15.59:0/639797682 shutdown_connections 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.386+0000 7f55cd800640 1 -- 172.21.15.59:0/639797682 wait complete. 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55cd800640 1 Processor -- start 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55cd800640 1 -- start start 2024-04-25T09:11:57.381 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55cd800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 0x7f55c815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55cd800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55c81f7800 0x7f55c809bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55cd800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c809c4a0 0x7f55c806fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55cd800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c806cfa0 con 0x7f55ac004810 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55cd800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80cc570 con 0x7f55c809c4a0 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55cd800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c815fbb0 con 0x7f55c81f7800 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55c6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 0x7f55c815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55c6a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 0x7f55c815ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53450/0 (socket says 172.21.15.59:53450) 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55c6a00640 1 -- 172.21.15.59:0/2868150971 learned_addr learned my addr 172.21.15.59:0/2868150971 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55c7400640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c809c4a0 0x7f55c806fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55be000640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55c81f7800 0x7f55c809bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55c6a00640 1 -- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55c81f7800 msgr2=0x7f55c809bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55c6a00640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55c81f7800 0x7f55c809bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55c6a00640 1 -- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c809c4a0 msgr2=0x7f55c806fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55c6a00640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c809c4a0 0x7f55c806fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.382 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55c6a00640 1 -- 172.21.15.59:0/2868150971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c815b270 con 0x7f55ac004810 2024-04-25T09:11:57.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55c7400640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c809c4a0 0x7f55c806fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:57.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55be000640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55c81f7800 0x7f55c809bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:11:57.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55c6a00640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 0x7f55c815ad30 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f55b8011aa0 tx=0x7f55b8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:57.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55bf400640 1 -- 172.21.15.59:0/2868150971 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b800fb80 con 0x7f55ac004810 2024-04-25T09:11:57.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55bf400640 1 -- 172.21.15.59:0/2868150971 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b800fd20 con 0x7f55ac004810 2024-04-25T09:11:57.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55cd800640 1 -- 172.21.15.59:0/2868150971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c815efa0 con 0x7f55ac004810 2024-04-25T09:11:57.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55bf400640 1 -- 172.21.15.59:0/2868150971 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8014680 con 0x7f55ac004810 2024-04-25T09:11:57.383 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.390+0000 7f55cd800640 1 -- 172.21.15.59:0/2868150971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c815f560 con 0x7f55ac004810 2024-04-25T09:11:57.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.394+0000 7f55cd800640 1 -- 172.21.15.59:0/2868150971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c80745d0 con 0x7f55ac004810 2024-04-25T09:11:57.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.394+0000 7f55bf400640 1 -- 172.21.15.59:0/2868150971 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f55b8012040 con 0x7f55ac004810 2024-04-25T09:11:57.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.394+0000 7f55bf400640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f55a4066f60 0x7f55a4069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.394+0000 7f55bf400640 1 -- 172.21.15.59:0/2868150971 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6273+0+0 (secure 0 0 0) 0x7f55b8085a20 con 0x7f55ac004810 2024-04-25T09:11:57.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.394+0000 7f55be000640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f55a4066f60 0x7f55a4069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.384 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.394+0000 7f55be000640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f55a4066f60 0x7f55a4069420 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f55b0005000 tx=0x7f55b0001520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:57.387 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.398+0000 7f55bf400640 1 -- 172.21.15.59:0/2868150971 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f55b8019030 con 0x7f55ac004810 2024-04-25T09:11:57.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.594+0000 7f55cd800640 1 -- 172.21.15.59:0/2868150971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f55c815f900 con 0x7f55ac004810 2024-04-25T09:11:57.583 INFO:tasks.ceph.mon.a.smithi059.stderr:2024-04-25T09:11:57.594+0000 7f1093800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T09:11:57.585 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.594+0000 7f55bf400640 1 -- 172.21.15.59:0/2868150971 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v118) v1 ==== 161+0+0 (secure 0 0 0) 0x7f55b8056100 con 0x7f55ac004810 2024-04-25T09:11:57.585 INFO:teuthology.orchestra.run.smithi059.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T09:11:57.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.598+0000 7f55cd800640 1 -- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f55a4066f60 msgr2=0x7f55a4069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.588 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.598+0000 7f55cd800640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f55a4066f60 0x7f55a4069420 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f55b0005000 tx=0x7f55b0001520 comp rx=0 tx=0).stop 2024-04-25T09:11:57.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.598+0000 7f55cd800640 1 -- 172.21.15.59:0/2868150971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 msgr2=0x7f55c815ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.598+0000 7f55cd800640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 0x7f55c815ad30 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f55b8011aa0 tx=0x7f55b8011f60 comp rx=0 tx=0).stop 2024-04-25T09:11:57.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.598+0000 7f55cd800640 1 -- 172.21.15.59:0/2868150971 shutdown_connections 2024-04-25T09:11:57.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.598+0000 7f55cd800640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f55a4066f60 0x7f55a4069420 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.598+0000 7f55cd800640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f55c809c4a0 0x7f55c806fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.598+0000 7f55cd800640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f55c81f7800 0x7f55c809bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.598+0000 7f55cd800640 1 --2- 172.21.15.59:0/2868150971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55ac004810 0x7f55c815ad30 secure :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f55b8011aa0 tx=0x7f55b8011f60 comp rx=0 tx=0).stop 2024-04-25T09:11:57.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.598+0000 7f55cd800640 1 -- 172.21.15.59:0/2868150971 >> 172.21.15.59:0/2868150971 conn(0x7f55c80b3200 msgr2=0x7f55c815cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:57.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.598+0000 7f55cd800640 1 -- 172.21.15.59:0/2868150971 shutdown_connections 2024-04-25T09:11:57.589 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.598+0000 7f55cd800640 1 -- 172.21.15.59:0/2868150971 wait complete. 2024-04-25T09:11:57.595 INFO:tasks.ceph.mds.c.smithi059.stderr: -1152> 2024-04-25T09:11:48.678+0000 7f1393600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T09:11:57.613 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T09:11:57.644 INFO:tasks.ceph.mds.c.smithi059.stdout:starting mds.c at 2024-04-25T09:11:57.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.770+0000 7f7877000640 1 Processor -- start 2024-04-25T09:11:57.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.770+0000 7f7877000640 1 -- start start 2024-04-25T09:11:57.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f7877000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7870159320 0x7f787015c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f7877000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f787015f440 0x7f787006dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f7877000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787015fc00 con 0x7f787006e010 2024-04-25T09:11:57.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f7877000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787006d640 con 0x7f7870159320 2024-04-25T09:11:57.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f7877000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787015fee0 con 0x7f787015f440 2024-04-25T09:11:57.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f786fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7870159320 0x7f787015c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f786fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7870159320 0x7f787015c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53468/0 (socket says 172.21.15.59:53468) 2024-04-25T09:11:57.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f786fe00640 1 -- 172.21.15.59:0/1280475990 learned_addr learned my addr 172.21.15.59:0/1280475990 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:57.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f7867400640 1 --2- 172.21.15.59:0/1280475990 >> v2:172.21.15.178:3300/0 conn(0x7f787015f440 0x7f787006dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f786fe00640 1 -- 172.21.15.59:0/1280475990 >> v2:172.21.15.178:3300/0 conn(0x7f787015f440 msgr2=0x7f787006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:57.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f786fe00640 1 --2- 172.21.15.59:0/1280475990 >> v2:172.21.15.178:3300/0 conn(0x7f787015f440 0x7f787006dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.763 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f786fe00640 1 -- 172.21.15.59:0/1280475990 >> v1:172.21.15.178:6789/0 conn(0x7f787006e010 legacy=0x7f787006e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:57.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.774+0000 7f786fe00640 1 -- 172.21.15.59:0/1280475990 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78701601c0 con 0x7f7870159320 2024-04-25T09:11:57.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f786fe00640 1 --2- 172.21.15.59:0/1280475990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7870159320 0x7f787015c9b0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f78700b4b50 tx=0x7f786001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd20d76879cec89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:57.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f786f400640 1 -- 172.21.15.59:0/1280475990 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600ab680 con 0x7f7870159320 2024-04-25T09:11:57.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f786f400640 1 -- 172.21.15.59:0/1280475990 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78600b0070 con 0x7f7870159320 2024-04-25T09:11:57.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f786f400640 1 -- 172.21.15.59:0/1280475990 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78600aba40 con 0x7f7870159320 2024-04-25T09:11:57.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f7877000640 1 -- 172.21.15.59:0/1280475990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7870159320 msgr2=0x7f787015c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f7877000640 1 --2- 172.21.15.59:0/1280475990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7870159320 0x7f787015c9b0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f78700b4b50 tx=0x7f786001c460 comp rx=0 tx=0).stop 2024-04-25T09:11:57.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f7877000640 1 -- 172.21.15.59:0/1280475990 shutdown_connections 2024-04-25T09:11:57.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f7877000640 1 --2- 172.21.15.59:0/1280475990 >> v2:172.21.15.178:3300/0 conn(0x7f787015f440 0x7f787006dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f7877000640 1 --2- 172.21.15.59:0/1280475990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7870159320 0x7f787015c9b0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f7877000640 1 -- 172.21.15.59:0/1280475990 >> 172.21.15.59:0/1280475990 conn(0x7f7870067080 msgr2=0x7f787006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:57.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f7877000640 1 -- 172.21.15.59:0/1280475990 shutdown_connections 2024-04-25T09:11:57.767 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f7877000640 1 -- 172.21.15.59:0/1280475990 wait complete. 2024-04-25T09:11:57.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f7877000640 1 Processor -- start 2024-04-25T09:11:57.768 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.778+0000 7f7877000640 1 -- start start 2024-04-25T09:11:57.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7877000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f787006e010 0x7f78700b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7877000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7870159320 0x7f7870143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7877000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f787015f440 0x7f7870144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7877000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787015f9a0 con 0x7f7870159320 2024-04-25T09:11:57.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7877000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787015f820 con 0x7f787006e010 2024-04-25T09:11:57.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7877000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787006ebb0 con 0x7f787015f440 2024-04-25T09:11:57.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7867400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7870159320 0x7f7870143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7867400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7870159320 0x7f7870143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53484/0 (socket says 172.21.15.59:53484) 2024-04-25T09:11:57.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7867400640 1 -- 172.21.15.59:0/496817818 learned_addr learned my addr 172.21.15.59:0/496817818 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:57.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f786fe00640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f787006e010 0x7f78700b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7875000640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f787015f440 0x7f7870144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7867400640 1 -- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f787015f440 msgr2=0x7f7870144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7867400640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f787015f440 0x7f7870144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7867400640 1 -- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f787006e010 msgr2=0x7f78700b4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7867400640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f787006e010 0x7f78700b4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7867400640 1 -- 172.21.15.59:0/496817818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7870144bf0 con 0x7f7870159320 2024-04-25T09:11:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7867400640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7870159320 0x7f7870143d40 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f785800d5f0 tx=0x7f785800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f786cc00640 1 -- 172.21.15.59:0/496817818 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580125f0 con 0x7f7870159320 2024-04-25T09:11:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f786cc00640 1 -- 172.21.15.59:0/496817818 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7858019070 con 0x7f7870159320 2024-04-25T09:11:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7877000640 1 -- 172.21.15.59:0/496817818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7870144ed0 con 0x7f7870159320 2024-04-25T09:11:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f786cc00640 1 -- 172.21.15.59:0/496817818 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78580129b0 con 0x7f7870159320 2024-04-25T09:11:57.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7877000640 1 -- 172.21.15.59:0/496817818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78700b3c80 con 0x7f7870159320 2024-04-25T09:11:57.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f7877000640 1 -- 172.21.15.59:0/496817818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78700b4720 con 0x7f7870159320 2024-04-25T09:11:57.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.782+0000 7f786cc00640 1 -- 172.21.15.59:0/496817818 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7858012b50 con 0x7f7870159320 2024-04-25T09:11:57.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.786+0000 7f786cc00640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f784c066f90 0x7f784c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:57.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.786+0000 7f786cc00640 1 -- 172.21.15.59:0/496817818 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f78580856b0 con 0x7f7870159320 2024-04-25T09:11:57.774 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.786+0000 7f786fe00640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f784c066f90 0x7f784c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:57.775 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.786+0000 7f786fe00640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f784c066f90 0x7f784c069450 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f78600af000 tx=0x7f78600a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:57.778 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.790+0000 7f786cc00640 1 -- 172.21.15.59:0/496817818 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7858055cb0 con 0x7f7870159320 2024-04-25T09:11:57.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:57.986+0000 7f7877000640 1 -- 172.21.15.59:0/496817818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f78700745d0 con 0x7f7870159320 2024-04-25T09:11:58.591 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.602+0000 7f786cc00640 1 -- 172.21.15.59:0/496817818 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v119) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7858059d50 con 0x7f7870159320 2024-04-25T09:11:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.606+0000 7f7877000640 1 -- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f784c066f90 msgr2=0x7f784c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.606+0000 7f7877000640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f784c066f90 0x7f784c069450 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f78600af000 tx=0x7f78600a7000 comp rx=0 tx=0).stop 2024-04-25T09:11:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.606+0000 7f7877000640 1 -- 172.21.15.59:0/496817818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7870159320 msgr2=0x7f7870143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.606+0000 7f7877000640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7870159320 0x7f7870143d40 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f785800d5f0 tx=0x7f785800dab0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.606+0000 7f7877000640 1 -- 172.21.15.59:0/496817818 shutdown_connections 2024-04-25T09:11:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.606+0000 7f7877000640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f784c066f90 0x7f784c069450 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.606+0000 7f7877000640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f787015f440 0x7f7870144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.606+0000 7f7877000640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7870159320 0x7f7870143d40 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.606+0000 7f7877000640 1 --2- 172.21.15.59:0/496817818 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f787006e010 0x7f78700b4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.606+0000 7f7877000640 1 -- 172.21.15.59:0/496817818 >> 172.21.15.59:0/496817818 conn(0x7f7870067080 msgr2=0x7f78700cd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:58.594 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.606+0000 7f7877000640 1 -- 172.21.15.59:0/496817818 shutdown_connections 2024-04-25T09:11:58.595 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.606+0000 7f7877000640 1 -- 172.21.15.59:0/496817818 wait complete. 2024-04-25T09:11:58.617 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T09:11:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.814+0000 7f7fb5600640 1 Processor -- start 2024-04-25T09:11:58.804 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.814+0000 7f7fb5600640 1 -- start start 2024-04-25T09:11:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.814+0000 7f7fb5600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7fb0071250 0x7f7fb00cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.814+0000 7f7fb5600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb0071630 0x7f7fb015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.814+0000 7f7fb5600640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb015ccc0 con 0x7f7fb015c2d0 2024-04-25T09:11:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.814+0000 7f7fb5600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb015c740 con 0x7f7fb0071250 2024-04-25T09:11:58.805 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.814+0000 7f7fb5600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0160200 con 0x7f7fb0071630 2024-04-25T09:11:58.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.818+0000 7f7fa6000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb0071630 0x7f7fb015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.818+0000 7f7fa6000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb0071630 0x7f7fb015bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:33168/0 (socket says 172.21.15.59:33168) 2024-04-25T09:11:58.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.818+0000 7f7fa6000640 1 -- 172.21.15.59:0/2470959618 learned_addr learned my addr 172.21.15.59:0/2470959618 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:58.806 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.818+0000 7f7faea00640 1 --2- 172.21.15.59:0/2470959618 >> v2:172.21.15.178:3300/0 conn(0x7f7fb0071250 0x7f7fb00cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.809 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.818+0000 7f7faea00640 1 -- 172.21.15.59:0/2470959618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb0071630 msgr2=0x7f7fb015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:11:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.818+0000 7f7faea00640 1 --2- 172.21.15.59:0/2470959618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb0071630 0x7f7fb015bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.818+0000 7f7faea00640 1 -- 172.21.15.59:0/2470959618 >> v1:172.21.15.178:6789/0 conn(0x7f7fb015c2d0 legacy=0x7f7fb015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.818+0000 7f7faea00640 1 -- 172.21.15.59:0/2470959618 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb015c9e0 con 0x7f7fb0071250 2024-04-25T09:11:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.818+0000 7f7fae000640 1 -- 172.21.15.59:0/2470959618 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244336968 0 0) 0x7f7fb015ccc0 con 0x7f7fb015c2d0 2024-04-25T09:11:58.810 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.818+0000 7f7fa6000640 1 --2- 172.21.15.59:0/2470959618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb0071630 0x7f7fb015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:11:58.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.818+0000 7f7faea00640 1 --2- 172.21.15.59:0/2470959618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb0071250 0x7f7fb00cdf90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009d90 tx=0x7f7fa001c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccab409d4b9466cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:58.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fae000640 1 -- 172.21.15.59:0/2470959618 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00b2070 con 0x7f7fb0071250 2024-04-25T09:11:58.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fae000640 1 -- 172.21.15.59:0/2470959618 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa00a5800 con 0x7f7fb0071250 2024-04-25T09:11:58.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fae000640 1 -- 172.21.15.59:0/2470959618 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00a5bd0 con 0x7f7fb0071250 2024-04-25T09:11:58.812 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 -- 172.21.15.59:0/2470959618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb0071250 msgr2=0x7f7fb00cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 --2- 172.21.15.59:0/2470959618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb0071250 0x7f7fb00cdf90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009d90 tx=0x7f7fa001c850 comp rx=0 tx=0).stop 2024-04-25T09:11:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 -- 172.21.15.59:0/2470959618 shutdown_connections 2024-04-25T09:11:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 --2- 172.21.15.59:0/2470959618 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb0071630 0x7f7fb015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 --2- 172.21.15.59:0/2470959618 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb0071250 0x7f7fb00cdf90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 -- 172.21.15.59:0/2470959618 >> 172.21.15.59:0/2470959618 conn(0x7f7fb006ac10 msgr2=0x7f7fb006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 -- 172.21.15.59:0/2470959618 shutdown_connections 2024-04-25T09:11:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 -- 172.21.15.59:0/2470959618 wait complete. 2024-04-25T09:11:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 Processor -- start 2024-04-25T09:11:58.813 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 -- start start 2024-04-25T09:11:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0071250 0x7f7fb0148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb0071630 0x7f7fb014a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb015c2d0 0x7f7fb0150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0071b90 con 0x7f7fb0071250 2024-04-25T09:11:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb0071a10 con 0x7f7fb0071630 2024-04-25T09:11:58.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7fb5600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb01684a0 con 0x7f7fb015c2d0 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7faea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0071250 0x7f7fb0148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7faea00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0071250 0x7f7fb0148600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53488/0 (socket says 172.21.15.59:53488) 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.822+0000 7f7faea00640 1 -- 172.21.15.59:0/2052406799 learned_addr learned my addr 172.21.15.59:0/2052406799 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7faf400640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb015c2d0 0x7f7fb0150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7faea00640 1 -- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb015c2d0 msgr2=0x7f7fb0150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7fa6000640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb0071630 0x7f7fb014a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7faea00640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb015c2d0 0x7f7fb0150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7faea00640 1 -- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb0071630 msgr2=0x7f7fb014a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7faea00640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb0071630 0x7f7fb014a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7faea00640 1 -- 172.21.15.59:0/2052406799 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb0149470 con 0x7f7fb0071250 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7fa6000640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb0071630 0x7f7fb014a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7faf400640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb015c2d0 0x7f7fb0150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:11:58.816 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7faea00640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0071250 0x7f7fb0148600 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00b0040 tx=0x7f7fb015de00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7fa7400640 1 -- 172.21.15.59:0/2052406799 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00bc070 con 0x7f7fb0071250 2024-04-25T09:11:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7fa7400640 1 -- 172.21.15.59:0/2052406799 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa00ad440 con 0x7f7fb0071250 2024-04-25T09:11:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7fa7400640 1 -- 172.21.15.59:0/2052406799 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa00b2040 con 0x7f7fb0071250 2024-04-25T09:11:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7fb5600640 1 -- 172.21.15.59:0/2052406799 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb00b2dc0 con 0x7f7fb0071250 2024-04-25T09:11:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7fb5600640 1 -- 172.21.15.59:0/2052406799 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb00b3380 con 0x7f7fb0071250 2024-04-25T09:11:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7fb5600640 1 -- 172.21.15.59:0/2052406799 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb00745d0 con 0x7f7fb0071250 2024-04-25T09:11:58.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7fa7400640 1 -- 172.21.15.59:0/2052406799 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7fa00bf070 con 0x7f7fb0071250 2024-04-25T09:11:58.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7fa7400640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7f8c066f90 0x7f7f8c069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:11:58.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.826+0000 7f7fa7400640 1 -- 172.21.15.59:0/2052406799 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6359+0+0 (secure 0 0 0) 0x7f7fa0120010 con 0x7f7fb0071250 2024-04-25T09:11:58.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.830+0000 7f7fa6000640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7f8c066f90 0x7f7f8c069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:11:58.818 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.830+0000 7f7fa6000640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7f8c066f90 0x7f7f8c069450 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00b1620 tx=0x7f7f98008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:11:58.821 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.830+0000 7f7fa7400640 1 -- 172.21.15.59:0/2052406799 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7fa00c6030 con 0x7f7fb0071250 2024-04-25T09:11:58.984 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:58.994+0000 7f7fb5600640 1 -- 172.21.15.59:0/2052406799 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7fb01596d0 con 0x7f7fb0071250 2024-04-25T09:11:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fa7400640 1 -- 172.21.15.59:0/2052406799 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v125) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7fa0016560 con 0x7f7fb0071250 2024-04-25T09:11:59.870 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_metadata' removed 2024-04-25T09:11:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fb5600640 1 -- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7f8c066f90 msgr2=0x7f7f8c069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fb5600640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7f8c066f90 0x7f7f8c069450 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7fb00b1620 tx=0x7f7f98008040 comp rx=0 tx=0).stop 2024-04-25T09:11:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fb5600640 1 -- 172.21.15.59:0/2052406799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0071250 msgr2=0x7f7fb0148600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:11:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fb5600640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0071250 0x7f7fb0148600 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00b0040 tx=0x7f7fb015de00 comp rx=0 tx=0).stop 2024-04-25T09:11:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fb5600640 1 -- 172.21.15.59:0/2052406799 shutdown_connections 2024-04-25T09:11:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fb5600640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7f8c066f90 0x7f7f8c069450 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fb5600640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7fb015c2d0 0x7f7fb0150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.873 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fb5600640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7fb0071630 0x7f7fb014a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fb5600640 1 --2- 172.21.15.59:0/2052406799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7fb0071250 0x7f7fb0148600 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:11:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fb5600640 1 -- 172.21.15.59:0/2052406799 >> 172.21.15.59:0/2052406799 conn(0x7f7fb006ac10 msgr2=0x7f7fb006db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:11:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fb5600640 1 -- 172.21.15.59:0/2052406799 shutdown_connections 2024-04-25T09:11:59.874 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:11:59.882+0000 7f7fb5600640 1 -- 172.21.15.59:0/2052406799 wait complete. 2024-04-25T09:11:59.900 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T09:12:00.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.066+0000 7f2764c00640 1 Processor -- start 2024-04-25T09:12:00.055 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.066+0000 7f2764c00640 1 -- start start 2024-04-25T09:12:00.056 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.066+0000 7f2764c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276015b6d0 0x7f27600cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:00.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.066+0000 7f2764c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276015f7d0 con 0x7f27600d1220 2024-04-25T09:12:00.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.066+0000 7f2764c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276015fab0 con 0x7f27600713c0 2024-04-25T09:12:00.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.066+0000 7f2764c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27600ce4d0 con 0x7f276015b6d0 2024-04-25T09:12:00.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.066+0000 7f2755400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f27600d1220 0x7f2760070cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:39430/0 (socket says 172.21.15.59:39430) 2024-04-25T09:12:00.057 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.066+0000 7f2755400640 1 -- 172.21.15.59:0/1807568219 learned_addr learned my addr 172.21.15.59:0/1807568219 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:00.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.066+0000 7f275de00640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276015b6d0 0x7f27600cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:00.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.066+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1184870996 0 0) 0x7f276015f7d0 con 0x7f27600d1220 2024-04-25T09:12:00.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.066+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2744003530 con 0x7f27600d1220 2024-04-25T09:12:00.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2526126918 0 0) 0x7f2744003530 con 0x7f27600d1220 2024-04-25T09:12:00.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276015b6d0 msgr2=0x7f27600cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276015b6d0 0x7f27600cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 >> v1:172.21.15.178:6789/0 conn(0x7f27600713c0 legacy=0x7f27600b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276015fd90 con 0x7f27600d1220 2024-04-25T09:12:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f2748001680 con 0x7f27600d1220 2024-04-25T09:12:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 >> v1:172.21.15.59:6789/0 conn(0x7f27600d1220 legacy=0x7f2760070cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27440039f0 0x7f2744003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276015b6d0 0x7f2744004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2744004d50 0x7f27440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274400b9d0 con 0x7f27440039f0 2024-04-25T09:12:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274400bb50 con 0x7f2744004d50 2024-04-25T09:12:00.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274400bd50 con 0x7f276015b6d0 2024-04-25T09:12:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275de00640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27440039f0 0x7f2744003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f2755400640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276015b6d0 0x7f2744004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275e800640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2744004d50 0x7f27440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275de00640 1 -- 172.21.15.59:0/1807568219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276015b6d0 msgr2=0x7f2744004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275de00640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276015b6d0 0x7f2744004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275de00640 1 -- 172.21.15.59:0/1807568219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2744004d50 msgr2=0x7f27440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275de00640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2744004d50 0x7f27440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275de00640 1 -- 172.21.15.59:0/1807568219 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2744003530 con 0x7f27440039f0 2024-04-25T09:12:00.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275e800640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f2744004d50 0x7f27440051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:00.062 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.070+0000 7f275de00640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27440039f0 0x7f2744003dd0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f2750009ae0 tx=0x7f275001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30386bc1cf7420d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:00.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500b2070 con 0x7f27440039f0 2024-04-25T09:12:00.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27500a55a0 con 0x7f27440039f0 2024-04-25T09:12:00.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f275d400640 1 -- 172.21.15.59:0/1807568219 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500096b0 con 0x7f27440039f0 2024-04-25T09:12:00.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 -- 172.21.15.59:0/1807568219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27440039f0 msgr2=0x7f2744003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:00.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 --2- 172.21.15.59:0/1807568219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27440039f0 0x7f2744003dd0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f2750009ae0 tx=0x7f275001c9b0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f275e800640 1 -- 172.21.15.59:0/1807568219 reap_dead start 2024-04-25T09:12:00.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 -- 172.21.15.59:0/1807568219 shutdown_connections 2024-04-25T09:12:00.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 -- 172.21.15.59:0/1807568219 >> 172.21.15.59:0/1807568219 conn(0x7f276006f510 msgr2=0x7f276006f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:00.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 -- 172.21.15.59:0/1807568219 shutdown_connections 2024-04-25T09:12:00.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 -- 172.21.15.59:0/1807568219 wait complete. 2024-04-25T09:12:00.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 Processor -- start 2024-04-25T09:12:00.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 -- start start 2024-04-25T09:12:00.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27440039f0 0x7f2760148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:00.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276006bd50 0x7f276006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:00.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f276015d840 0x7f276015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:00.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276015bc30 con 0x7f276015d840 2024-04-25T09:12:00.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276015bab0 con 0x7f27440039f0 2024-04-25T09:12:00.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2764c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276015f360 con 0x7f276006bd50 2024-04-25T09:12:00.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f275e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f276015d840 0x7f276015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:00.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f275e800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f276015d840 0x7f276015dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:53520/0 (socket says 172.21.15.59:53520) 2024-04-25T09:12:00.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f275e800640 1 -- 172.21.15.59:0/2173089307 learned_addr learned my addr 172.21.15.59:0/2173089307 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:00.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f275de00640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27440039f0 0x7f2760148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:00.066 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.074+0000 7f2755400640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276006bd50 0x7f276006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f275e800640 1 -- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276006bd50 msgr2=0x7f276006c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f275e800640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276006bd50 0x7f276006c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f275e800640 1 -- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27440039f0 msgr2=0x7f2760148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f275e800640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27440039f0 0x7f2760148240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f275e800640 1 -- 172.21.15.59:0/2173089307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276015bf50 con 0x7f276015d840 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f2755400640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276006bd50 0x7f276006c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f275de00640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27440039f0 0x7f2760148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f275e800640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f276015d840 0x7f276015dcc0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f2760070960 tx=0x7f2758010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f2756a00640 1 -- 172.21.15.59:0/2173089307 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758003d90 con 0x7f276015d840 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f2756a00640 1 -- 172.21.15.59:0/2173089307 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2758019070 con 0x7f276015d840 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f2764c00640 1 -- 172.21.15.59:0/2173089307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276015c230 con 0x7f276015d840 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f2756a00640 1 -- 172.21.15.59:0/2173089307 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275800e9f0 con 0x7f276015d840 2024-04-25T09:12:00.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f2764c00640 1 -- 172.21.15.59:0/2173089307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276015c7f0 con 0x7f276015d840 2024-04-25T09:12:00.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f2764c00640 1 -- 172.21.15.59:0/2173089307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27600745d0 con 0x7f276015d840 2024-04-25T09:12:00.069 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.078+0000 7f2756a00640 1 -- 172.21.15.59:0/2173089307 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f2758013070 con 0x7f276015d840 2024-04-25T09:12:00.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.082+0000 7f2756a00640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f273c066f60 0x7f273c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:00.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.082+0000 7f2756a00640 1 -- 172.21.15.59:0/2173089307 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5921+0+0 (secure 0 0 0) 0x7f2758088060 con 0x7f276015d840 2024-04-25T09:12:00.070 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.082+0000 7f275de00640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f273c066f60 0x7f273c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:00.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.082+0000 7f275de00640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f273c066f60 0x7f273c069420 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f27500af000 tx=0x7f27500046d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:00.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.086+0000 7f2756a00640 1 -- 172.21.15.59:0/2173089307 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f2758058ef0 con 0x7f276015d840 2024-04-25T09:12:00.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.246+0000 7f2764c00640 1 -- 172.21.15.59:0/2173089307 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f27600cdab0 con 0x7f276015d840 2024-04-25T09:12:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.882+0000 7f2756a00640 1 -- 172.21.15.59:0/2173089307 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v126) v1 ==== 169+0+0 (secure 0 0 0) 0x7f27580587f0 con 0x7f276015d840 2024-04-25T09:12:00.872 INFO:teuthology.orchestra.run.smithi059.stderr:pool 'cephfs_data' removed 2024-04-25T09:12:00.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.886+0000 7f2764c00640 1 -- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f273c066f60 msgr2=0x7f273c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:00.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.886+0000 7f2764c00640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f273c066f60 0x7f273c069420 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f27500af000 tx=0x7f27500046d0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.886+0000 7f2764c00640 1 -- 172.21.15.59:0/2173089307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f276015d840 msgr2=0x7f276015dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:00.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.886+0000 7f2764c00640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f276015d840 0x7f276015dcc0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f2760070960 tx=0x7f2758010f40 comp rx=0 tx=0).stop 2024-04-25T09:12:00.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.886+0000 7f2764c00640 1 -- 172.21.15.59:0/2173089307 shutdown_connections 2024-04-25T09:12:00.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.886+0000 7f2764c00640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f273c066f60 0x7f273c069420 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.886+0000 7f2764c00640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f276015d840 0x7f276015dcc0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.886+0000 7f2764c00640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f276006bd50 0x7f276006c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.886+0000 7f2764c00640 1 --2- 172.21.15.59:0/2173089307 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f27440039f0 0x7f2760148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:00.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.886+0000 7f2764c00640 1 -- 172.21.15.59:0/2173089307 >> 172.21.15.59:0/2173089307 conn(0x7f276006f510 msgr2=0x7f27600ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:00.877 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.886+0000 7f2764c00640 1 -- 172.21.15.59:0/2173089307 shutdown_connections 2024-04-25T09:12:00.878 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:00.886+0000 7f2764c00640 1 -- 172.21.15.59:0/2173089307 wait complete. 2024-04-25T09:12:00.902 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-25T09:12:01.059 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.070+0000 7f4b97a00640 1 Processor -- start 2024-04-25T09:12:01.060 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.070+0000 7f4b97a00640 1 -- start start 2024-04-25T09:12:01.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.070+0000 7f4b97a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900d0150 0x7f4b900af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.070+0000 7f4b97a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900b30d0 con 0x7f4b900c72a0 2024-04-25T09:12:01.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.070+0000 7f4b97a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900ccf30 con 0x7f4b9015dc00 2024-04-25T09:12:01.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.070+0000 7f4b97a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900cd860 con 0x7f4b900d0150 2024-04-25T09:12:01.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.070+0000 7f4b95a00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4b900c72a0 0x7f4b900c54b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36850/0 (socket says 172.21.15.59:36850) 2024-04-25T09:12:01.061 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.070+0000 7f4b95a00640 1 -- 172.21.15.59:0/264538403 learned_addr learned my addr 172.21.15.59:0/264538403 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:01.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.070+0000 7f4b87e00640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900d0150 0x7f4b900af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3977964799 0 0) 0x7f4b900b30d0 con 0x7f4b900c72a0 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b74003530 con 0x7f4b900c72a0 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226036435 0 0) 0x7f4b900ccf30 con 0x7f4b9015dc00 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b900b30d0 con 0x7f4b9015dc00 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 31361097 0 0) 0x7f4b74003530 con 0x7f4b900c72a0 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900d0150 msgr2=0x7f4b900af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900d0150 0x7f4b900af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 >> v1:172.21.15.178:6789/0 conn(0x7f4b9015dc00 legacy=0x7f4b900c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900cd210 con 0x7f4b900c72a0 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f4b88001a00 con 0x7f4b900c72a0 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 >> v1:172.21.15.59:6789/0 conn(0x7f4b900c72a0 legacy=0x7f4b900c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900d0150 0x7f4b74003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b740040e0 0x7f4b74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b74004d50 0x7f4b740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900cd860 con 0x7f4b740040e0 2024-04-25T09:12:01.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7400bab0 con 0x7f4b74004d50 2024-04-25T09:12:01.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7400bcb0 con 0x7f4b900d0150 2024-04-25T09:12:01.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b87e00640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b740040e0 0x7f4b74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b95000640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900d0150 0x7f4b74003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b95a00640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b74004d50 0x7f4b740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b87e00640 1 -- 172.21.15.59:0/264538403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900d0150 msgr2=0x7f4b74003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:01.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b87e00640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900d0150 0x7f4b74003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b87e00640 1 -- 172.21.15.59:0/264538403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b74004d50 msgr2=0x7f4b740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:01.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b87e00640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b74004d50 0x7f4b740051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b87e00640 1 -- 172.21.15.59:0/264538403 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b74003530 con 0x7f4b740040e0 2024-04-25T09:12:01.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.074+0000 7f4b95000640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900d0150 0x7f4b74003b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:01.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b87e00640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b740040e0 0x7f4b74004810 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009ae0 tx=0x7f4b7801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdb3aa326621405 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:01.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780b2070 con 0x7f4b740040e0 2024-04-25T09:12:01.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b780a5640 con 0x7f4b740040e0 2024-04-25T09:12:01.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b8fe00640 1 -- 172.21.15.59:0/264538403 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780096b0 con 0x7f4b740040e0 2024-04-25T09:12:01.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 -- 172.21.15.59:0/264538403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b740040e0 msgr2=0x7f4b74004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 --2- 172.21.15.59:0/264538403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b740040e0 0x7f4b74004810 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009ae0 tx=0x7f4b7801ca50 comp rx=0 tx=0).stop 2024-04-25T09:12:01.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b95a00640 1 -- 172.21.15.59:0/264538403 reap_dead start 2024-04-25T09:12:01.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 -- 172.21.15.59:0/264538403 shutdown_connections 2024-04-25T09:12:01.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 -- 172.21.15.59:0/264538403 >> 172.21.15.59:0/264538403 conn(0x7f4b900b2240 msgr2=0x7f4b900b2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:01.067 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 -- 172.21.15.59:0/264538403 shutdown_connections 2024-04-25T09:12:01.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 -- 172.21.15.59:0/264538403 wait complete. 2024-04-25T09:12:01.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 Processor -- start 2024-04-25T09:12:01.068 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 -- start start 2024-04-25T09:12:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b740040e0 0x7f4b901f3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b9009a630 0x7f4b9009aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900b0490 0x7f4b900b0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900cdcf0 con 0x7f4b9009a630 2024-04-25T09:12:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900b2d60 con 0x7f4b740040e0 2024-04-25T09:12:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.078+0000 7f4b97a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900cde70 con 0x7f4b900b0490 2024-04-25T09:12:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b87e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b9009a630 0x7f4b9009aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b87e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b9009a630 0x7f4b9009aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36688/0 (socket says 172.21.15.59:36688) 2024-04-25T09:12:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b87e00640 1 -- 172.21.15.59:0/3598584152 learned_addr learned my addr 172.21.15.59:0/3598584152 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b95a00640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900b0490 0x7f4b900b0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b95000640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b740040e0 0x7f4b901f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.071 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b87e00640 1 -- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900b0490 msgr2=0x7f4b900b0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b87e00640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900b0490 0x7f4b900b0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b87e00640 1 -- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b740040e0 msgr2=0x7f4b901f3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b87e00640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b740040e0 0x7f4b901f3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b87e00640 1 -- 172.21.15.59:0/3598584152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900b14f0 con 0x7f4b9009a630 2024-04-25T09:12:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b95a00640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900b0490 0x7f4b900b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b95000640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b740040e0 0x7f4b901f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b87e00640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b9009a630 0x7f4b9009aab0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009ae0 tx=0x7f4b74005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b8d600640 1 -- 172.21.15.59:0/3598584152 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b780b2040 con 0x7f4b9009a630 2024-04-25T09:12:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b8d600640 1 -- 172.21.15.59:0/3598584152 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7800f000 con 0x7f4b9009a630 2024-04-25T09:12:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b8d600640 1 -- 172.21.15.59:0/3598584152 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b78004220 con 0x7f4b9009a630 2024-04-25T09:12:01.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b97a00640 1 -- 172.21.15.59:0/3598584152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9009c5e0 con 0x7f4b9009a630 2024-04-25T09:12:01.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b97a00640 1 -- 172.21.15.59:0/3598584152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9009c880 con 0x7f4b9009a630 2024-04-25T09:12:01.073 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b97a00640 1 -- 172.21.15.59:0/3598584152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9006ccb0 con 0x7f4b9009a630 2024-04-25T09:12:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.082+0000 7f4b8d600640 1 -- 172.21.15.59:0/3598584152 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f4b780c0030 con 0x7f4b9009a630 2024-04-25T09:12:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.086+0000 7f4b8d600640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b6c066f60 0x7f4b6c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.086+0000 7f4b8d600640 1 -- 172.21.15.59:0/3598584152 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f4b7811ed70 con 0x7f4b9009a630 2024-04-25T09:12:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.086+0000 7f4b95000640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b6c066f60 0x7f4b6c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.086+0000 7f4b95000640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b6c066f60 0x7f4b6c069420 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4b80005630 tx=0x7f4b80009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:01.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.086+0000 7f4b8d600640 1 -- 172.21.15.59:0/3598584152 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f4b780c7060 con 0x7f4b9009a630 2024-04-25T09:12:01.241 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.250+0000 7f4b97a00640 1 -- 172.21.15.59:0/3598584152 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4b9006bae0 con 0x7f4b9009a630 2024-04-25T09:12:01.245 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.254+0000 7f4b8d600640 1 -- 172.21.15.59:0/3598584152 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4b78016760 con 0x7f4b9009a630 2024-04-25T09:12:01.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.258+0000 7f4b97a00640 1 -- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b6c066f60 msgr2=0x7f4b6c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.247 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.258+0000 7f4b97a00640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b6c066f60 0x7f4b6c069420 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4b80005630 tx=0x7f4b80009040 comp rx=0 tx=0).stop 2024-04-25T09:12:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.258+0000 7f4b97a00640 1 -- 172.21.15.59:0/3598584152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b9009a630 msgr2=0x7f4b9009aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.258+0000 7f4b97a00640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b9009a630 0x7f4b9009aab0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f4b78009ae0 tx=0x7f4b74005840 comp rx=0 tx=0).stop 2024-04-25T09:12:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.258+0000 7f4b97a00640 1 -- 172.21.15.59:0/3598584152 shutdown_connections 2024-04-25T09:12:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.258+0000 7f4b97a00640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f4b6c066f60 0x7f4b6c069420 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.258+0000 7f4b97a00640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f4b900b0490 0x7f4b900b0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.258+0000 7f4b97a00640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b9009a630 0x7f4b9009aab0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.258+0000 7f4b97a00640 1 --2- 172.21.15.59:0/3598584152 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f4b740040e0 0x7f4b901f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.258+0000 7f4b97a00640 1 -- 172.21.15.59:0/3598584152 >> 172.21.15.59:0/3598584152 conn(0x7f4b900b2240 msgr2=0x7f4b900aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.258+0000 7f4b97a00640 1 -- 172.21.15.59:0/3598584152 shutdown_connections 2024-04-25T09:12:01.248 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.258+0000 7f4b97a00640 1 -- 172.21.15.59:0/3598584152 wait complete. 2024-04-25T09:12:01.266 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-25T09:12:01.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.418+0000 7f811ba00640 1 Processor -- start 2024-04-25T09:12:01.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.418+0000 7f811ba00640 1 -- start start 2024-04-25T09:12:01.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.418+0000 7f811ba00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f811415b2f0 0x7f81140b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.409 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.418+0000 7f811ba00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81140b2dc0 0x7f81140b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.418+0000 7f811ba00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f811406dad0 0x7f811406dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.418+0000 7f811ba00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811415def0 con 0x7f81140b2dc0 2024-04-25T09:12:01.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.418+0000 7f811ba00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811415e1b0 con 0x7f811406dad0 2024-04-25T09:12:01.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.418+0000 7f811ba00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811415e490 con 0x7f811415b2f0 2024-04-25T09:12:01.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f810be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81140b2dc0 0x7f81140b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f810be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81140b2dc0 0x7f81140b3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36692/0 (socket says 172.21.15.59:36692) 2024-04-25T09:12:01.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f810be00640 1 -- 172.21.15.59:0/3368207406 learned_addr learned my addr 172.21.15.59:0/3368207406 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:01.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f8119000640 1 --2- 172.21.15.59:0/3368207406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f811415b2f0 0x7f81140b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.410 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f8119a00640 1 --2- 172.21.15.59:0/3368207406 >> v2:172.21.15.178:3300/0 conn(0x7f811406dad0 0x7f811406dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f810be00640 1 -- 172.21.15.59:0/3368207406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f811415b2f0 msgr2=0x7f81140b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:01.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f810be00640 1 --2- 172.21.15.59:0/3368207406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f811415b2f0 0x7f81140b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f810be00640 1 -- 172.21.15.59:0/3368207406 >> v2:172.21.15.178:3300/0 conn(0x7f811406dad0 msgr2=0x7f811406dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:01.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f810be00640 1 --2- 172.21.15.59:0/3368207406 >> v2:172.21.15.178:3300/0 conn(0x7f811406dad0 0x7f811406dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.411 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f810be00640 1 -- 172.21.15.59:0/3368207406 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811415e770 con 0x7f81140b2dc0 2024-04-25T09:12:01.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f810be00640 1 --2- 172.21.15.59:0/3368207406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81140b2dc0 0x7f81140b3780 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338c2abfa068ead server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:01.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f8113e00640 1 -- 172.21.15.59:0/3368207406 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80fc0b0070 con 0x7f81140b2dc0 2024-04-25T09:12:01.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f8113e00640 1 -- 172.21.15.59:0/3368207406 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80fc0ab600 con 0x7f81140b2dc0 2024-04-25T09:12:01.413 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.422+0000 7f8113e00640 1 -- 172.21.15.59:0/3368207406 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811415b8e0 con 0x7f81140b2dc0 2024-04-25T09:12:01.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 -- 172.21.15.59:0/3368207406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81140b2dc0 msgr2=0x7f81140b3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 --2- 172.21.15.59:0/3368207406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81140b2dc0 0x7f81140b3780 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f80fc009870 tx=0x7f80fc01c230 comp rx=0 tx=0).stop 2024-04-25T09:12:01.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 -- 172.21.15.59:0/3368207406 shutdown_connections 2024-04-25T09:12:01.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 --2- 172.21.15.59:0/3368207406 >> v2:172.21.15.178:3300/0 conn(0x7f811406dad0 0x7f811406dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 --2- 172.21.15.59:0/3368207406 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81140b2dc0 0x7f81140b3780 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 --2- 172.21.15.59:0/3368207406 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f811415b2f0 0x7f81140b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.414 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 -- 172.21.15.59:0/3368207406 >> 172.21.15.59:0/3368207406 conn(0x7f81140b23b0 msgr2=0x7f81140cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 -- 172.21.15.59:0/3368207406 shutdown_connections 2024-04-25T09:12:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 -- 172.21.15.59:0/3368207406 wait complete. 2024-04-25T09:12:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 Processor -- start 2024-04-25T09:12:01.415 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 -- start start 2024-04-25T09:12:01.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f811406dad0 0x7f811414a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81140b2dc0 0x7f811415b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f811415b2f0 0x7f8114157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811406ac10 con 0x7f811415b2f0 2024-04-25T09:12:01.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81141616f0 con 0x7f81140b2dc0 2024-04-25T09:12:01.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f811ba00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811406ad90 con 0x7f811406dad0 2024-04-25T09:12:01.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f8119a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f811415b2f0 0x7f8114157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f8119a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f811415b2f0 0x7f8114157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36694/0 (socket says 172.21.15.59:36694) 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f8119a00640 1 -- 172.21.15.59:0/4168458693 learned_addr learned my addr 172.21.15.59:0/4168458693 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f8119000640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f811406dad0 0x7f811414a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f8119a00640 1 -- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f811406dad0 msgr2=0x7f811414a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f810be00640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81140b2dc0 0x7f811415b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f8119a00640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f811406dad0 0x7f811414a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f8119a00640 1 -- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81140b2dc0 msgr2=0x7f811415b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f8119a00640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81140b2dc0 0x7f811415b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f8119a00640 1 -- 172.21.15.59:0/4168458693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811414add0 con 0x7f811415b2f0 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f8119000640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f811406dad0 0x7f811414a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.426+0000 7f810be00640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81140b2dc0 0x7f811415b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.430+0000 7f8119a00640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f811415b2f0 0x7f8114157ac0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f810c009dd0 tx=0x7f810c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.430+0000 7f8111600640 1 -- 172.21.15.59:0/4168458693 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c018020 con 0x7f811415b2f0 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.430+0000 7f8111600640 1 -- 172.21.15.59:0/4168458693 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c014480 con 0x7f811415b2f0 2024-04-25T09:12:01.419 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.430+0000 7f811ba00640 1 -- 172.21.15.59:0/4168458693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811406b5a0 con 0x7f811415b2f0 2024-04-25T09:12:01.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.430+0000 7f8111600640 1 -- 172.21.15.59:0/4168458693 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c014850 con 0x7f811415b2f0 2024-04-25T09:12:01.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.430+0000 7f811ba00640 1 -- 172.21.15.59:0/4168458693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811406bb60 con 0x7f811415b2f0 2024-04-25T09:12:01.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.430+0000 7f811ba00640 1 -- 172.21.15.59:0/4168458693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81140745d0 con 0x7f811415b2f0 2024-04-25T09:12:01.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.430+0000 7f8111600640 1 -- 172.21.15.59:0/4168458693 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f810c01b020 con 0x7f811415b2f0 2024-04-25T09:12:01.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.430+0000 7f8111600640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f80f0066f60 0x7f80f0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:01.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.430+0000 7f8111600640 1 -- 172.21.15.59:0/4168458693 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f810c085df0 con 0x7f811415b2f0 2024-04-25T09:12:01.421 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.434+0000 7f8119000640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f80f0066f60 0x7f80f0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:01.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.434+0000 7f8119000640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f80f0066f60 0x7f80f0069420 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f81040099c0 tx=0x7f8104008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:01.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.434+0000 7f8111600640 1 -- 172.21.15.59:0/4168458693 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f810c022030 con 0x7f811415b2f0 2024-04-25T09:12:01.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.658+0000 7f811ba00640 1 -- 172.21.15.59:0/4168458693 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7f81140b3770 con 0x7f811415b2f0 2024-04-25T09:12:01.883 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f8111600640 1 -- 172.21.15.59:0/4168458693 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v521) v1 ==== 144+0+0 (secure 0 0 0) 0x7f810c010040 con 0x7f811415b2f0 2024-04-25T09:12:01.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f811ba00640 1 -- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f80f0066f60 msgr2=0x7f80f0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f811ba00640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f80f0066f60 0x7f80f0069420 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f81040099c0 tx=0x7f8104008040 comp rx=0 tx=0).stop 2024-04-25T09:12:01.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f811ba00640 1 -- 172.21.15.59:0/4168458693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f811415b2f0 msgr2=0x7f8114157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:01.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f811ba00640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f811415b2f0 0x7f8114157ac0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f810c009dd0 tx=0x7f810c00c490 comp rx=0 tx=0).stop 2024-04-25T09:12:01.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f811ba00640 1 -- 172.21.15.59:0/4168458693 shutdown_connections 2024-04-25T09:12:01.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f811ba00640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f80f0066f60 0x7f80f0069420 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f811ba00640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f811415b2f0 0x7f8114157ac0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f811ba00640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f81140b2dc0 0x7f811415b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f811ba00640 1 --2- 172.21.15.59:0/4168458693 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f811406dad0 0x7f811414a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:01.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f811ba00640 1 -- 172.21.15.59:0/4168458693 >> 172.21.15.59:0/4168458693 conn(0x7f81140b23b0 msgr2=0x7f81140cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:01.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f811ba00640 1 -- 172.21.15.59:0/4168458693 shutdown_connections 2024-04-25T09:12:01.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:01.894+0000 7f811ba00640 1 -- 172.21.15.59:0/4168458693 wait complete. 2024-04-25T09:12:01.905 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-25T09:12:01.905 INFO:tasks.cephfs_test_runner: 2024-04-25T09:12:01.905 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-25T09:12:01.905 INFO:tasks.cephfs_test_runner:Ran 7 tests in 587.733s 2024-04-25T09:12:01.905 INFO:tasks.cephfs_test_runner: 2024-04-25T09:12:01.906 INFO:tasks.cephfs_test_runner:OK 2024-04-25T09:12:01.906 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-25T09:12:01.916 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T09:12:01.924 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T09:12:01.925 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:12:01.925 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:01.934 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:12:01.934 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2024-04-25T09:12:01.934 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:01.989 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353400k,nr_inodes=4088350,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7685 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275608k,nr_inodes=818902,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275612k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-25T09:12:01.989 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:12:01.989 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:01.999 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:12:01.999 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-04-25T09:12:01.999 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T09:12:02.055 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350220k,nr_inodes=4087555,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=7555 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274972k,nr_inodes=818743,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274976k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-25T09:12:02.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:02.055 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:12:02.064 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T09:12:02.064 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-25T09:12:02.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:02.065 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T09:12:02.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:02.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-25T09:12:02.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:02.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2024-04-25T09:12:02.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:02.348 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2024-04-25T09:12:02.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:02.357 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2024-04-25T09:12:02.427 INFO:teuthology.orchestra.run.smithi059.stderr:Cannot find device "ceph-brx" 2024-04-25T09:12:02.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:12:02.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:02.429 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-04-25T09:12:02.439 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T09:12:02.440 INFO:teuthology.orchestra.run.smithi178.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-25T09:12:02.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:02.440 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T09:12:02.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:02.510 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-25T09:12:02.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:02.576 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2024-04-25T09:12:02.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:02.730 DEBUG:teuthology.orchestra.run.smithi178:> ip netns list 2024-04-25T09:12:02.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T09:12:02.740 DEBUG:teuthology.orchestra.run.smithi178:> sudo ip link delete ceph-brx 2024-04-25T09:12:02.804 INFO:teuthology.orchestra.run.smithi178.stderr:Cannot find device "ceph-brx" 2024-04-25T09:12:02.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:12:02.806 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T09:12:02.816 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T09:12:02.816 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f013ee00640 1 Processor -- start 2024-04-25T09:12:02.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f013ee00640 1 -- start start 2024-04-25T09:12:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f013ee00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f01380669a0 0x7f013815e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f013ee00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0138072ce0 con 0x7f013815d7b0 2024-04-25T09:12:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f013ee00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01380b2dc0 con 0x7f01380b46f0 2024-04-25T09:12:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f013ee00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01380b3990 con 0x7f01380669a0 2024-04-25T09:12:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f013da00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f013815d7b0 0x7f01380b3fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36864/0 (socket says 172.21.15.59:36864) 2024-04-25T09:12:02.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f013da00640 1 -- 172.21.15.59:0/2348057698 learned_addr learned my addr 172.21.15.59:0/2348057698 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f013e400640 1 --2- 172.21.15.59:0/2348057698 >> v2:172.21.15.178:3300/0 conn(0x7f01380669a0 0x7f013815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:02.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f0137e00640 1 -- 172.21.15.59:0/2348057698 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986197386 0 0) 0x7f0138072ce0 con 0x7f013815d7b0 2024-04-25T09:12:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f0137e00640 1 -- 172.21.15.59:0/2348057698 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0120003530 con 0x7f013815d7b0 2024-04-25T09:12:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f0137e00640 1 -- 172.21.15.59:0/2348057698 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055222865 0 0) 0x7f01380b2dc0 con 0x7f01380b46f0 2024-04-25T09:12:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f0137e00640 1 -- 172.21.15.59:0/2348057698 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0138072ce0 con 0x7f01380b46f0 2024-04-25T09:12:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f013e400640 1 -- 172.21.15.59:0/2348057698 >> v1:172.21.15.178:6789/0 conn(0x7f01380b46f0 legacy=0x7f01380adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f0137e00640 1 -- 172.21.15.59:0/2348057698 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1317680060 0 0) 0x7f0120003530 con 0x7f013815d7b0 2024-04-25T09:12:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f013e400640 1 -- 172.21.15.59:0/2348057698 >> v1:172.21.15.59:6789/0 conn(0x7f013815d7b0 legacy=0x7f01380b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:02.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.974+0000 7f013e400640 1 -- 172.21.15.59:0/2348057698 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01380b3060 con 0x7f01380669a0 2024-04-25T09:12:02.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.978+0000 7f013e400640 1 --2- 172.21.15.59:0/2348057698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01380669a0 0x7f013815e890 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f01380b3b10 tx=0x7f013001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d41998f7e8b089bd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.978+0000 7f0137e00640 1 -- 172.21.15.59:0/2348057698 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300b2070 con 0x7f01380669a0 2024-04-25T09:12:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.978+0000 7f0137e00640 1 -- 172.21.15.59:0/2348057698 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300a55a0 con 0x7f01380669a0 2024-04-25T09:12:02.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.978+0000 7f0137e00640 1 -- 172.21.15.59:0/2348057698 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c001680 con 0x7f01380669a0 2024-04-25T09:12:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.978+0000 7f013ee00640 1 -- 172.21.15.59:0/2348057698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01380669a0 msgr2=0x7f013815e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.978+0000 7f013ee00640 1 --2- 172.21.15.59:0/2348057698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01380669a0 0x7f013815e890 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f01380b3b10 tx=0x7f013001c870 comp rx=0 tx=0).stop 2024-04-25T09:12:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.978+0000 7f013ee00640 1 -- 172.21.15.59:0/2348057698 shutdown_connections 2024-04-25T09:12:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.978+0000 7f013ee00640 1 --2- 172.21.15.59:0/2348057698 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01380669a0 0x7f013815e890 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.978+0000 7f013ee00640 1 -- 172.21.15.59:0/2348057698 >> 172.21.15.59:0/2348057698 conn(0x7f01380726f0 msgr2=0x7f013806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:02.968 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.978+0000 7f013ee00640 1 -- 172.21.15.59:0/2348057698 shutdown_connections 2024-04-25T09:12:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.978+0000 7f013ee00640 1 -- 172.21.15.59:0/2348057698 wait complete. 2024-04-25T09:12:02.969 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013ee00640 1 Processor -- start 2024-04-25T09:12:02.970 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013ee00640 1 -- start start 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013ee00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01380669a0 0x7f013813b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013ee00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01380b46f0 0x7f013815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013ee00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f013815d7b0 0x7f01381572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013ee00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01380aeba0 con 0x7f01380669a0 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013ee00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01380aea20 con 0x7f01380b46f0 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013ee00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01380aed20 con 0x7f013815d7b0 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01380669a0 0x7f013813b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013da00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01380669a0 0x7f013813b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36704/0 (socket says 172.21.15.59:36704) 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013da00640 1 -- 172.21.15.59:0/3553292361 learned_addr learned my addr 172.21.15.59:0/3553292361 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013d000640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01380b46f0 0x7f013815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013e400640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f013815d7b0 0x7f01381572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013da00640 1 -- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f013815d7b0 msgr2=0x7f01381572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013da00640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f013815d7b0 0x7f01381572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:02.972 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013da00640 1 -- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01380b46f0 msgr2=0x7f013815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013da00640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01380b46f0 0x7f013815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013da00640 1 -- 172.21.15.59:0/3553292361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0138160e20 con 0x7f01380669a0 2024-04-25T09:12:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013da00640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01380669a0 0x7f013813b460 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f012c00c520 tx=0x7f012c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f0135600640 1 -- 172.21.15.59:0/3553292361 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c017070 con 0x7f01380669a0 2024-04-25T09:12:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f0135600640 1 -- 172.21.15.59:0/3553292361 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f012c005d10 con 0x7f01380669a0 2024-04-25T09:12:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f0135600640 1 -- 172.21.15.59:0/3553292361 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012c0072b0 con 0x7f01380669a0 2024-04-25T09:12:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013ee00640 1 -- 172.21.15.59:0/3553292361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013815fd80 con 0x7f01380669a0 2024-04-25T09:12:02.973 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013ee00640 1 -- 172.21.15.59:0/3553292361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0138160340 con 0x7f01380669a0 2024-04-25T09:12:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.982+0000 7f013ee00640 1 -- 172.21.15.59:0/3553292361 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013804efa0 con 0x7f01380669a0 2024-04-25T09:12:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.986+0000 7f0135600640 1 -- 172.21.15.59:0/3553292361 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f012c01a070 con 0x7f01380669a0 2024-04-25T09:12:02.974 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.986+0000 7f0135600640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0118066f60 0x7f0118069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.986+0000 7f0135600640 1 -- 172.21.15.59:0/3553292361 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f012c0843e0 con 0x7f01380669a0 2024-04-25T09:12:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.986+0000 7f013d000640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0118066f60 0x7f0118069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:02.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.986+0000 7f013d000640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0118066f60 0x7f0118069420 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f013815b3f0 tx=0x7f0124009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:02.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:02.990+0000 7f0135600640 1 -- 172.21.15.59:0/3553292361 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f012c054e50 con 0x7f01380669a0 2024-04-25T09:12:03.141 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.150+0000 7f013ee00640 1 -- 172.21.15.59:0/3553292361 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0138155fa0 con 0x7f0118066f60 2024-04-25T09:12:03.142 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f0135600640 1 -- 172.21.15.59:0/3553292361 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13494 (secure 0 0 0) 0x7f0138155fa0 con 0x7f0118066f60 2024-04-25T09:12:03.143 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:12:03.143 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:12:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f013ee00640 1 -- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0118066f60 msgr2=0x7f0118069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.144 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f013ee00640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0118066f60 0x7f0118069420 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f013815b3f0 tx=0x7f0124009040 comp rx=0 tx=0).stop 2024-04-25T09:12:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f013ee00640 1 -- 172.21.15.59:0/3553292361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01380669a0 msgr2=0x7f013813b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f013ee00640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01380669a0 0x7f013813b460 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f012c00c520 tx=0x7f012c00c9e0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f013ee00640 1 -- 172.21.15.59:0/3553292361 shutdown_connections 2024-04-25T09:12:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f013ee00640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0118066f60 0x7f0118069420 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f013ee00640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f013815d7b0 0x7f01381572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f013ee00640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f01380b46f0 0x7f013815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f013ee00640 1 --2- 172.21.15.59:0/3553292361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01380669a0 0x7f013813b460 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f013ee00640 1 -- 172.21.15.59:0/3553292361 >> 172.21.15.59:0/3553292361 conn(0x7f01380726f0 msgr2=0x7f013815e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f013ee00640 1 -- 172.21.15.59:0/3553292361 shutdown_connections 2024-04-25T09:12:03.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.154+0000 7f013ee00640 1 -- 172.21.15.59:0/3553292361 wait complete. 2024-04-25T09:12:03.163 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2024-04-25T09:12:01.810729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279136,"kb_used_data":29696,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754695584,"statfs":{"total":773094113280,"available":772808278016,"internally_reserved":0,"allocated":30408704,"data_stored":23764900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390542,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-174,"num_write_kb":-8297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001711"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":365,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-25T09:11:58.155166+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:11:58.155166+0000","last_peered":"2024-04-25T09:11:58.155166+0000","last_clean":"2024-04-25T09:11:58.155166+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:11:58.155166+0000","last_undegraded":"2024-04-25T09:11:58.155166+0000","last_fullsized":"2024-04-25T09:11:58.155166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574980,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37380,"kb_used_data":6200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334460,"statfs":{"total":96636764160,"available":96598487040,"internally_reserved":0,"allocated":6348800,"data_stored":5510833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574979,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40892,"kb_used_data":9712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330948,"statfs":{"total":96636764160,"available":96594890752,"internally_reserved":0,"allocated":9945088,"data_stored":9114587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574979,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1552384,"data_stored":725545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1560576,"data_stored":726509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574980,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1564672,"data_stored":726543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574980,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1548288,"data_stored":725390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36792,"kb_used_data":5612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335048,"statfs":{"total":96636764160,"available":96599089152,"internally_reserved":0,"allocated":5746688,"data_stored":4919718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574979,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2142208,"data_stored":1315775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:03.164 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:03.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.314+0000 7f5b0a200640 1 Processor -- start 2024-04-25T09:12:03.304 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.314+0000 7f5b0a200640 1 -- start start 2024-04-25T09:12:03.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b0a200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b040d0f40 0x7f5b041689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b0a200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0406c650 con 0x7f5b04099a60 2024-04-25T09:12:03.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b0a200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0406c930 con 0x7f5b0415ee00 2024-04-25T09:12:03.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b0a200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0406c430 con 0x7f5b040d0f40 2024-04-25T09:12:03.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b03400640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5b04099a60 0x7f5b04099e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36872/0 (socket says 172.21.15.59:36872) 2024-04-25T09:12:03.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b03400640 1 -- 172.21.15.59:0/831760367 learned_addr learned my addr 172.21.15.59:0/831760367 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:03.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b03e00640 1 --2- 172.21.15.59:0/831760367 >> v2:172.21.15.59:3300/0 conn(0x7f5b040d0f40 0x7f5b041689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b03e00640 1 -- 172.21.15.59:0/831760367 >> v1:172.21.15.178:6789/0 conn(0x7f5b0415ee00 legacy=0x7f5b0406bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b03e00640 1 -- 172.21.15.59:0/831760367 >> v1:172.21.15.59:6789/0 conn(0x7f5b04099a60 legacy=0x7f5b04099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b03e00640 1 -- 172.21.15.59:0/831760367 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0406cc10 con 0x7f5b040d0f40 2024-04-25T09:12:03.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b02a00640 1 -- 172.21.15.59:0/831760367 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183785103 0 0) 0x7f5b0406c650 con 0x7f5b04099a60 2024-04-25T09:12:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b03e00640 1 --2- 172.21.15.59:0/831760367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b040d0f40 0x7f5b041689f0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009d90 tx=0x7f5afc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98ed383d988cdbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b02a00640 1 -- 172.21.15.59:0/831760367 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0b2070 con 0x7f5b040d0f40 2024-04-25T09:12:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b02a00640 1 -- 172.21.15.59:0/831760367 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc0a58e0 con 0x7f5b040d0f40 2024-04-25T09:12:03.309 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.318+0000 7f5b02a00640 1 -- 172.21.15.59:0/831760367 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5afc0a5cb0 con 0x7f5b040d0f40 2024-04-25T09:12:03.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 -- 172.21.15.59:0/831760367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b040d0f40 msgr2=0x7f5b041689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 --2- 172.21.15.59:0/831760367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b040d0f40 0x7f5b041689f0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f5afc009d90 tx=0x7f5afc01c970 comp rx=0 tx=0).stop 2024-04-25T09:12:03.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 -- 172.21.15.59:0/831760367 shutdown_connections 2024-04-25T09:12:03.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 --2- 172.21.15.59:0/831760367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b040d0f40 0x7f5b041689f0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 -- 172.21.15.59:0/831760367 >> 172.21.15.59:0/831760367 conn(0x7f5b040d17a0 msgr2=0x7f5b040d1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 -- 172.21.15.59:0/831760367 shutdown_connections 2024-04-25T09:12:03.310 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 -- 172.21.15.59:0/831760367 wait complete. 2024-04-25T09:12:03.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 Processor -- start 2024-04-25T09:12:03.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 -- start start 2024-04-25T09:12:03.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b04099a60 0x7f5b04153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b040d0f40 0x7f5b040b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b0415ee00 0x7f5b040b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0416b8d0 con 0x7f5b040d0f40 2024-04-25T09:12:03.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0416b750 con 0x7f5b0415ee00 2024-04-25T09:12:03.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b0a200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0416ba50 con 0x7f5b04099a60 2024-04-25T09:12:03.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5afbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b040d0f40 0x7f5b040b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5afbe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b040d0f40 0x7f5b040b51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36716/0 (socket says 172.21.15.59:36716) 2024-04-25T09:12:03.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5afbe00640 1 -- 172.21.15.59:0/2828709034 learned_addr learned my addr 172.21.15.59:0/2828709034 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:03.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b03e00640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b0415ee00 0x7f5b040b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.313 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5b03400640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b04099a60 0x7f5b04153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5afbe00640 1 -- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b04099a60 msgr2=0x7f5b04153900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.322+0000 7f5afbe00640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b04099a60 0x7f5b04153900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5afbe00640 1 -- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b0415ee00 msgr2=0x7f5b040b56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5afbe00640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b0415ee00 0x7f5b040b56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5afbe00640 1 -- 172.21.15.59:0/2828709034 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b040ca570 con 0x7f5b040d0f40 2024-04-25T09:12:03.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5afbe00640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b040d0f40 0x7f5b040b51a0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c3c0 tx=0x7f5aec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5afb400640 1 -- 172.21.15.59:0/2828709034 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec017070 con 0x7f5b040d0f40 2024-04-25T09:12:03.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5afb400640 1 -- 172.21.15.59:0/2828709034 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec0052d0 con 0x7f5b040d0f40 2024-04-25T09:12:03.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5b0a200640 1 -- 172.21.15.59:0/2828709034 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b040c94d0 con 0x7f5b040d0f40 2024-04-25T09:12:03.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5afb400640 1 -- 172.21.15.59:0/2828709034 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec003820 con 0x7f5b040d0f40 2024-04-25T09:12:03.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5b0a200640 1 -- 172.21.15.59:0/2828709034 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b040c9a90 con 0x7f5b040d0f40 2024-04-25T09:12:03.315 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5b0a200640 1 -- 172.21.15.59:0/2828709034 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b040745d0 con 0x7f5b040d0f40 2024-04-25T09:12:03.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5afb400640 1 -- 172.21.15.59:0/2828709034 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f5aec01a070 con 0x7f5b040d0f40 2024-04-25T09:12:03.316 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5afb400640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ae0066f90 0x7f5ae0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5afb400640 1 -- 172.21.15.59:0/2828709034 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f5aec084240 con 0x7f5b040d0f40 2024-04-25T09:12:03.317 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.326+0000 7f5b03400640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ae0066f90 0x7f5ae0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.318 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.330+0000 7f5b03400640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ae0066f90 0x7f5ae0069450 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5af4000f70 tx=0x7f5af4007240 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.321 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.330+0000 7f5afb400640 1 -- 172.21.15.59:0/2828709034 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5aec005480 con 0x7f5b040d0f40 2024-04-25T09:12:03.481 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.490+0000 7f5b0a200640 1 -- 172.21.15.59:0/2828709034 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5b040c9280 con 0x7f5ae0066f90 2024-04-25T09:12:03.482 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5afb400640 1 -- 172.21.15.59:0/2828709034 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13494 (secure 0 0 0) 0x7f5b040c9280 con 0x7f5ae0066f90 2024-04-25T09:12:03.482 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:12:03.482 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:12:03.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5b0a200640 1 -- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ae0066f90 msgr2=0x7f5ae0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5b0a200640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ae0066f90 0x7f5ae0069450 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5af4000f70 tx=0x7f5af4007240 comp rx=0 tx=0).stop 2024-04-25T09:12:03.484 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5b0a200640 1 -- 172.21.15.59:0/2828709034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b040d0f40 msgr2=0x7f5b040b51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5b0a200640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b040d0f40 0x7f5b040b51a0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f5aec00c3c0 tx=0x7f5aec00c880 comp rx=0 tx=0).stop 2024-04-25T09:12:03.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5b0a200640 1 -- 172.21.15.59:0/2828709034 shutdown_connections 2024-04-25T09:12:03.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5b0a200640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5ae0066f90 0x7f5ae0069450 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5b0a200640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5b0415ee00 0x7f5b040b56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5b0a200640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b040d0f40 0x7f5b040b51a0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5b0a200640 1 --2- 172.21.15.59:0/2828709034 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f5b04099a60 0x7f5b04153900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5b0a200640 1 -- 172.21.15.59:0/2828709034 >> 172.21.15.59:0/2828709034 conn(0x7f5b040d17a0 msgr2=0x7f5b040cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5b0a200640 1 -- 172.21.15.59:0/2828709034 shutdown_connections 2024-04-25T09:12:03.485 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.494+0000 7f5b0a200640 1 -- 172.21.15.59:0/2828709034 wait complete. 2024-04-25T09:12:03.503 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":443,"stamp":"2024-04-25T09:12:01.810729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279136,"kb_used_data":29696,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754695584,"statfs":{"total":773094113280,"available":772808278016,"internally_reserved":0,"allocated":30408704,"data_stored":23764900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390542,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-174,"num_write_kb":-8297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001711"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":365,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-25T09:11:58.155166+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:11:58.155166+0000","last_peered":"2024-04-25T09:11:58.155166+0000","last_clean":"2024-04-25T09:11:58.155166+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:11:58.155166+0000","last_undegraded":"2024-04-25T09:11:58.155166+0000","last_fullsized":"2024-04-25T09:11:58.155166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574980,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37380,"kb_used_data":6200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334460,"statfs":{"total":96636764160,"available":96598487040,"internally_reserved":0,"allocated":6348800,"data_stored":5510833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574979,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40892,"kb_used_data":9712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330948,"statfs":{"total":96636764160,"available":96594890752,"internally_reserved":0,"allocated":9945088,"data_stored":9114587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574979,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1552384,"data_stored":725545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1560576,"data_stored":726509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574980,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1564672,"data_stored":726543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574980,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1548288,"data_stored":725390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36792,"kb_used_data":5612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335048,"statfs":{"total":96636764160,"available":96599089152,"internally_reserved":0,"allocated":5746688,"data_stored":4919718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574979,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2142208,"data_stored":1315775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:03.503 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T09:12:03.504 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:03.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6157200640 1 Processor -- start 2024-04-25T09:12:03.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6157200640 1 -- start start 2024-04-25T09:12:03.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6157200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615009a170 0x7f61500cc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6157200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f615009a7a0 0x7f61500cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6157200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f615006d740 con 0x7f615015dcd0 2024-04-25T09:12:03.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6157200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61500cbfc0 con 0x7f615009a7a0 2024-04-25T09:12:03.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6157200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615006cea0 con 0x7f615009a170 2024-04-25T09:12:03.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6155e00640 1 --1- >> v1:172.21.15.178:6789/0 conn(0x7f615015dcd0 0x7f6150099a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.178:6789/0 says I am v1:172.21.15.59:58334/0 (socket says 172.21.15.59:58334) 2024-04-25T09:12:03.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6155e00640 1 -- 172.21.15.59:0/1649999165 learned_addr learned my addr 172.21.15.59:0/1649999165 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:03.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6156800640 1 --2- 172.21.15.59:0/1649999165 >> v2:172.21.15.178:3300/0 conn(0x7f615009a7a0 0x7f61500cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6155400640 1 --2- 172.21.15.59:0/1649999165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615009a170 0x7f61500cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6154a00640 1 -- 172.21.15.59:0/1649999165 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234007952 0 0) 0x7f615006d740 con 0x7f615015dcd0 2024-04-25T09:12:03.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6154a00640 1 -- 172.21.15.59:0/1649999165 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6138003530 con 0x7f615015dcd0 2024-04-25T09:12:03.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6156800640 1 -- 172.21.15.59:0/1649999165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615009a170 msgr2=0x7f61500cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6156800640 1 --2- 172.21.15.59:0/1649999165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615009a170 0x7f61500cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6156800640 1 -- 172.21.15.59:0/1649999165 >> v1:172.21.15.178:6789/0 conn(0x7f615015dcd0 legacy=0x7f6150099a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6156800640 1 -- 172.21.15.59:0/1649999165 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615006d180 con 0x7f615009a7a0 2024-04-25T09:12:03.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.658+0000 7f6155400640 1 --2- 172.21.15.59:0/1649999165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615009a170 0x7f61500cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:03.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6156800640 1 --2- 172.21.15.59:0/1649999165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f615009a7a0 0x7f61500cc990 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f614c009d90 tx=0x7f614c01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2532ee41d0cfe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6154a00640 1 -- 172.21.15.59:0/1649999165 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c0b2070 con 0x7f615009a7a0 2024-04-25T09:12:03.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6154a00640 1 -- 172.21.15.59:0/1649999165 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c0a5a00 con 0x7f615009a7a0 2024-04-25T09:12:03.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6154a00640 1 -- 172.21.15.59:0/1649999165 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c0a5dd0 con 0x7f615009a7a0 2024-04-25T09:12:03.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6157200640 1 -- 172.21.15.59:0/1649999165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f615009a7a0 msgr2=0x7f61500cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6157200640 1 --2- 172.21.15.59:0/1649999165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f615009a7a0 0x7f61500cc990 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f614c009d90 tx=0x7f614c01c940 comp rx=0 tx=0).stop 2024-04-25T09:12:03.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6157200640 1 -- 172.21.15.59:0/1649999165 shutdown_connections 2024-04-25T09:12:03.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6157200640 1 --2- 172.21.15.59:0/1649999165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f615009a7a0 0x7f61500cc990 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6157200640 1 --2- 172.21.15.59:0/1649999165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615009a170 0x7f61500cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6157200640 1 -- 172.21.15.59:0/1649999165 >> 172.21.15.59:0/1649999165 conn(0x7f61500b3050 msgr2=0x7f61500b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6157200640 1 -- 172.21.15.59:0/1649999165 shutdown_connections 2024-04-25T09:12:03.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6157200640 1 -- 172.21.15.59:0/1649999165 wait complete. 2024-04-25T09:12:03.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.662+0000 7f6157200640 1 Processor -- start 2024-04-25T09:12:03.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6157200640 1 -- start start 2024-04-25T09:12:03.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6157200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009a170 0x7f6150146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6157200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615009a7a0 0x7f6150154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6157200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f615015dcd0 0x7f61500af900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6157200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615016aa20 con 0x7f615009a170 2024-04-25T09:12:03.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6157200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615016a8a0 con 0x7f615015dcd0 2024-04-25T09:12:03.655 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6157200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615016aba0 con 0x7f615009a7a0 2024-04-25T09:12:03.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6155e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009a170 0x7f6150146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6155e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009a170 0x7f6150146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36720/0 (socket says 172.21.15.59:36720) 2024-04-25T09:12:03.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6155e00640 1 -- 172.21.15.59:0/338720146 learned_addr learned my addr 172.21.15.59:0/338720146 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:03.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6155400640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615009a7a0 0x7f6150154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6156800640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f615015dcd0 0x7f61500af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6155e00640 1 -- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615009a7a0 msgr2=0x7f6150154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6155e00640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615009a7a0 0x7f6150154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6155e00640 1 -- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f615015dcd0 msgr2=0x7f61500af900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6155e00640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f615015dcd0 0x7f61500af900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6155e00640 1 -- 172.21.15.59:0/338720146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6150155e50 con 0x7f615009a170 2024-04-25T09:12:03.656 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6155e00640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009a170 0x7f6150146bd0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f614400c450 tx=0x7f614400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f614a000640 1 -- 172.21.15.59:0/338720146 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144017070 con 0x7f615009a170 2024-04-25T09:12:03.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f614a000640 1 -- 172.21.15.59:0/338720146 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6144005cf0 con 0x7f615009a170 2024-04-25T09:12:03.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f614a000640 1 -- 172.21.15.59:0/338720146 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144007290 con 0x7f615009a170 2024-04-25T09:12:03.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6157200640 1 -- 172.21.15.59:0/338720146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61501555b0 con 0x7f615009a170 2024-04-25T09:12:03.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6157200640 1 -- 172.21.15.59:0/338720146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6150155b70 con 0x7f615009a170 2024-04-25T09:12:03.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.666+0000 7f6157200640 1 -- 172.21.15.59:0/338720146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f615004efa0 con 0x7f615009a170 2024-04-25T09:12:03.658 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.670+0000 7f614a000640 1 -- 172.21.15.59:0/338720146 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f614401a070 con 0x7f615009a170 2024-04-25T09:12:03.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.670+0000 7f614a000640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6134066f60 0x7f6134069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.659 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.670+0000 7f614a000640 1 -- 172.21.15.59:0/338720146 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f6144084310 con 0x7f615009a170 2024-04-25T09:12:03.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.670+0000 7f6155400640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6134066f60 0x7f6134069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.660 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.670+0000 7f6155400640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6134066f60 0x7f6134069420 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6140009580 tx=0x7f6140009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.663 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.674+0000 7f614a000640 1 -- 172.21.15.59:0/338720146 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f6144054cf0 con 0x7f615009a170 2024-04-25T09:12:03.823 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.834+0000 7f6157200640 1 -- 172.21.15.59:0/338720146 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f615015cbe0 con 0x7f6134066f60 2024-04-25T09:12:03.824 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.834+0000 7f614a000640 1 -- 172.21.15.59:0/338720146 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13494 (secure 0 0 0) 0x7f615015cbe0 con 0x7f6134066f60 2024-04-25T09:12:03.824 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:12:03.825 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:12:03.826 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.838+0000 7f6157200640 1 -- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6134066f60 msgr2=0x7f6134069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.838+0000 7f6157200640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6134066f60 0x7f6134069420 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f6140009580 tx=0x7f6140009190 comp rx=0 tx=0).stop 2024-04-25T09:12:03.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.838+0000 7f6157200640 1 -- 172.21.15.59:0/338720146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009a170 msgr2=0x7f6150146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.838+0000 7f6157200640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009a170 0x7f6150146bd0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f614400c450 tx=0x7f614400c910 comp rx=0 tx=0).stop 2024-04-25T09:12:03.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.838+0000 7f6157200640 1 -- 172.21.15.59:0/338720146 shutdown_connections 2024-04-25T09:12:03.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.838+0000 7f6157200640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f6134066f60 0x7f6134069420 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.838+0000 7f6157200640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f615015dcd0 0x7f61500af900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.838+0000 7f6157200640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f615009a7a0 0x7f6150154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.838+0000 7f6157200640 1 --2- 172.21.15.59:0/338720146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f615009a170 0x7f6150146bd0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.838+0000 7f6157200640 1 -- 172.21.15.59:0/338720146 >> 172.21.15.59:0/338720146 conn(0x7f61500b3050 msgr2=0x7f61500701e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.838+0000 7f6157200640 1 -- 172.21.15.59:0/338720146 shutdown_connections 2024-04-25T09:12:03.827 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.838+0000 7f6157200640 1 -- 172.21.15.59:0/338720146 wait complete. 2024-04-25T09:12:03.846 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2024-04-25T09:12:03.811133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":279136,"kb_used_data":29696,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754695584,"statfs":{"total":773094113280,"available":772808278016,"internally_reserved":0,"allocated":30408704,"data_stored":23764900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390542,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-267,"num_write":-174,"num_write_kb":-8297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.206298"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":365,"reported_epoch":124,"state":"active+clean","last_fresh":"2024-04-25T09:11:58.155166+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:11:58.155166+0000","last_peered":"2024-04-25T09:11:58.155166+0000","last_clean":"2024-04-25T09:11:58.155166+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:11:58.155166+0000","last_undegraded":"2024-04-25T09:11:58.155166+0000","last_fullsized":"2024-04-25T09:11:58.155166+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:57.628848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574980,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37380,"kb_used_data":6200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94334460,"statfs":{"total":96636764160,"available":96598487040,"internally_reserved":0,"allocated":6348800,"data_stored":5510833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574979,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40892,"kb_used_data":9712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330948,"statfs":{"total":96636764160,"available":96594890752,"internally_reserved":0,"allocated":9945088,"data_stored":9114587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574979,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32696,"kb_used_data":1516,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339144,"statfs":{"total":96636764160,"available":96603283456,"internally_reserved":0,"allocated":1552384,"data_stored":725545,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1560576,"data_stored":726509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574980,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32708,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339132,"statfs":{"total":96636764160,"available":96603271168,"internally_reserved":0,"allocated":1564672,"data_stored":726543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574980,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1548288,"data_stored":725390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574979,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36792,"kb_used_data":5612,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335048,"statfs":{"total":96636764160,"available":96599089152,"internally_reserved":0,"allocated":5746688,"data_stored":4919718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574979,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33272,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338568,"statfs":{"total":96636764160,"available":96602693632,"internally_reserved":0,"allocated":2142208,"data_stored":1315775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:03.847 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T09:12:03.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.998+0000 7f8affc00640 1 Processor -- start 2024-04-25T09:12:03.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:03.998+0000 7f8affc00640 1 -- start start 2024-04-25T09:12:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8affc00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f8af8145270 0x7f8af815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8affc00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8af80cd4d0 0x7f8af80cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8affc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b1750 0x7f8af80b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8affc00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af8145650 con 0x7f8af80cd4d0 2024-04-25T09:12:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8affc00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af80b20c0 con 0x7f8af8145270 2024-04-25T09:12:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8affc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af80cc4e0 con 0x7f8af80b1750 2024-04-25T09:12:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8af7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8af80cd4d0 0x7f8af80cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8af7e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8af80cd4d0 0x7f8af80cd930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36726/0 (socket says 172.21.15.59:36726) 2024-04-25T09:12:03.990 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8af7e00640 1 -- 172.21.15.59:0/806002045 learned_addr learned my addr 172.21.15.59:0/806002045 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:03.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8afdc00640 1 --2- 172.21.15.59:0/806002045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b1750 0x7f8af80b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8afd200640 1 --2- 172.21.15.59:0/806002045 >> v2:172.21.15.178:3300/0 conn(0x7f8af8145270 0x7f8af815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8af7e00640 1 -- 172.21.15.59:0/806002045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b1750 msgr2=0x7f8af80b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8af7e00640 1 --2- 172.21.15.59:0/806002045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b1750 0x7f8af80b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8af7e00640 1 -- 172.21.15.59:0/806002045 >> v2:172.21.15.178:3300/0 conn(0x7f8af8145270 msgr2=0x7f8af815fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:03.991 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8af7e00640 1 --2- 172.21.15.59:0/806002045 >> v2:172.21.15.178:3300/0 conn(0x7f8af8145270 0x7f8af815fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8af7e00640 1 -- 172.21.15.59:0/806002045 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af80ce040 con 0x7f8af80cd4d0 2024-04-25T09:12:03.992 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8afdc00640 1 --2- 172.21.15.59:0/806002045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b1750 0x7f8af80b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:03.993 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.002+0000 7f8af7e00640 1 --2- 172.21.15.59:0/806002045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af80cd4d0 0x7f8af80cd930 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f8af806f3a0 tx=0x7f8ae401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f51dd8a7248aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8af7400640 1 -- 172.21.15.59:0/806002045 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae40b1070 con 0x7f8af80cd4d0 2024-04-25T09:12:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8af7400640 1 -- 172.21.15.59:0/806002045 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae40ac630 con 0x7f8af80cd4d0 2024-04-25T09:12:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8af7400640 1 -- 172.21.15.59:0/806002045 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae40a8050 con 0x7f8af80cd4d0 2024-04-25T09:12:03.994 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 -- 172.21.15.59:0/806002045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af80cd4d0 msgr2=0x7f8af80cd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 --2- 172.21.15.59:0/806002045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af80cd4d0 0x7f8af80cd930 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f8af806f3a0 tx=0x7f8ae401c520 comp rx=0 tx=0).stop 2024-04-25T09:12:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 -- 172.21.15.59:0/806002045 shutdown_connections 2024-04-25T09:12:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 --2- 172.21.15.59:0/806002045 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b1750 0x7f8af80b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 --2- 172.21.15.59:0/806002045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af80cd4d0 0x7f8af80cd930 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 --2- 172.21.15.59:0/806002045 >> v2:172.21.15.178:3300/0 conn(0x7f8af8145270 0x7f8af815fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 -- 172.21.15.59:0/806002045 >> 172.21.15.59:0/806002045 conn(0x7f8af8066fa0 msgr2=0x7f8af806ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 -- 172.21.15.59:0/806002045 shutdown_connections 2024-04-25T09:12:03.995 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 -- 172.21.15.59:0/806002045 wait complete. 2024-04-25T09:12:03.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 Processor -- start 2024-04-25T09:12:03.996 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 -- start start 2024-04-25T09:12:03.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b1750 0x7f8af81f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80cd4d0 0x7f8af8143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 0x7f8af80ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:03.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af815c590 con 0x7f8af8145270 2024-04-25T09:12:03.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af815f930 con 0x7f8af80cd4d0 2024-04-25T09:12:03.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8affc00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af815c710 con 0x7f8af80b1750 2024-04-25T09:12:03.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8afdc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 0x7f8af80ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8afdc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 0x7f8af80ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36742/0 (socket says 172.21.15.59:36742) 2024-04-25T09:12:03.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8afdc00640 1 -- 172.21.15.59:0/743088292 learned_addr learned my addr 172.21.15.59:0/743088292 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:03.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8afd200640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b1750 0x7f8af81f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.006+0000 7f8af7e00640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80cd4d0 0x7f8af8143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:03.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8afdc00640 1 -- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b1750 msgr2=0x7f8af81f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8afdc00640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b1750 0x7f8af81f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8afdc00640 1 -- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80cd4d0 msgr2=0x7f8af8143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:03.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8afdc00640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80cd4d0 0x7f8af8143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:03.999 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8afdc00640 1 -- 172.21.15.59:0/743088292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af80acca0 con 0x7f8af8145270 2024-04-25T09:12:04.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8afdc00640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 0x7f8af80ac470 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f8af000cef0 tx=0x7f8af000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8af4c00640 1 -- 172.21.15.59:0/743088292 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af001a070 con 0x7f8af8145270 2024-04-25T09:12:04.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8af4c00640 1 -- 172.21.15.59:0/743088292 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af000d840 con 0x7f8af8145270 2024-04-25T09:12:04.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8af4c00640 1 -- 172.21.15.59:0/743088292 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af000dc30 con 0x7f8af8145270 2024-04-25T09:12:04.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8affc00640 1 -- 172.21.15.59:0/743088292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af80a88b0 con 0x7f8af8145270 2024-04-25T09:12:04.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8affc00640 1 -- 172.21.15.59:0/743088292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af80ac9b0 con 0x7f8af8145270 2024-04-25T09:12:04.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8affc00640 1 -- 172.21.15.59:0/743088292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af80745d0 con 0x7f8af8145270 2024-04-25T09:12:04.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8af4c00640 1 -- 172.21.15.59:0/743088292 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f8af001d070 con 0x7f8af8145270 2024-04-25T09:12:04.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8af4c00640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad8066f60 0x7f8ad8069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:04.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.010+0000 7f8af4c00640 1 -- 172.21.15.59:0/743088292 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f8af0085700 con 0x7f8af8145270 2024-04-25T09:12:04.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.014+0000 7f8afd200640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad8066f60 0x7f8ad8069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:04.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.014+0000 7f8afd200640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad8066f60 0x7f8ad8069420 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8af80b4b60 tx=0x7f8aec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:04.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.014+0000 7f8af4c00640 1 -- 172.21.15.59:0/743088292 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f8af0056170 con 0x7f8af8145270 2024-04-25T09:12:04.167 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.178+0000 7f8affc00640 1 -- 172.21.15.59:0/743088292 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8af80ab840 con 0x7f8af8145270 2024-04-25T09:12:04.168 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.178+0000 7f8af4c00640 1 -- 172.21.15.59:0/743088292 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+13557 (secure 0 0 0) 0x7f8af005a210 con 0x7f8af8145270 2024-04-25T09:12:04.168 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:12:04.168 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":126,"fsid":"fbbb9dc0-22e4-4685-972c-77e9262d4773","created":"2024-04-25T09:01:02.544222+0000","modified":"2024-04-25T09:12:00.885656+0000","last_up_change":"2024-04-25T09:01:14.353027+0000","last_in_change":"2024-04-25T09:01:05.117086+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T09:01:15.707123+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"318281b5-e306-4c0f-b89a-7d589389261e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6801","nonce":4129855307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6803","nonce":4129855307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6806","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6807","nonce":4129855307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":4129855307},{"type":"v1","addr":"172.21.15.59:6805","nonce":4129855307}]},"public_addr":"172.21.15.59:6801/4129855307","cluster_addr":"172.21.15.59:6803/4129855307","heartbeat_back_addr":"172.21.15.59:6807/4129855307","heartbeat_front_addr":"172.21.15.59:6805/4129855307","state":["exists","up"]},{"osd":1,"uuid":"3f8b2f03-0f24-4342-a300-c31dc0692cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6812","nonce":1450066050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6817","nonce":1450066050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6823","nonce":1450066050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6819","nonce":1450066050},{"type":"v1","addr":"172.21.15.59:6821","nonce":1450066050}]},"public_addr":"172.21.15.59:6812/1450066050","cluster_addr":"172.21.15.59:6817/1450066050","heartbeat_back_addr":"172.21.15.59:6823/1450066050","heartbeat_front_addr":"172.21.15.59:6821/1450066050","state":["exists","up"]},{"osd":2,"uuid":"c789b920-67a7-45e8-92ae-e19ae190ef59","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6825","nonce":4113007731}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6827","nonce":4113007731}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6831","nonce":4113007731}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":4113007731},{"type":"v1","addr":"172.21.15.59:6829","nonce":4113007731}]},"public_addr":"172.21.15.59:6825/4113007731","cluster_addr":"172.21.15.59:6827/4113007731","heartbeat_back_addr":"172.21.15.59:6831/4113007731","heartbeat_front_addr":"172.21.15.59:6829/4113007731","state":["exists","up"]},{"osd":3,"uuid":"21abdd03-dae8-4933-9679-a1feb524d636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6810","nonce":3810214969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6811","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6813","nonce":3810214969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6820","nonce":3810214969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6815","nonce":3810214969},{"type":"v1","addr":"172.21.15.59:6816","nonce":3810214969}]},"public_addr":"172.21.15.59:6810/3810214969","cluster_addr":"172.21.15.59:6813/3810214969","heartbeat_back_addr":"172.21.15.59:6820/3810214969","heartbeat_front_addr":"172.21.15.59:6816/3810214969","state":["exists","up"]},{"osd":4,"uuid":"9da1a78e-132b-44a1-ba14-dea9974196cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6805","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6808","nonce":2278719369}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6814","nonce":2278719369}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6822","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6823","nonce":2278719369}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6817","nonce":2278719369},{"type":"v1","addr":"172.21.15.178:6820","nonce":2278719369}]},"public_addr":"172.21.15.178:6808/2278719369","cluster_addr":"172.21.15.178:6814/2278719369","heartbeat_back_addr":"172.21.15.178:6823/2278719369","heartbeat_front_addr":"172.21.15.178:6820/2278719369","state":["exists","up"]},{"osd":5,"uuid":"123afa05-f260-480a-9b17-19fe5c5f4e37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6804","nonce":3576783051}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6807","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6810","nonce":3576783051}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6819","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6821","nonce":3576783051}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6813","nonce":3576783051},{"type":"v1","addr":"172.21.15.178:6816","nonce":3576783051}]},"public_addr":"172.21.15.178:6804/3576783051","cluster_addr":"172.21.15.178:6810/3576783051","heartbeat_back_addr":"172.21.15.178:6821/3576783051","heartbeat_front_addr":"172.21.15.178:6816/3576783051","state":["exists","up"]},{"osd":6,"uuid":"763deab5-bcc1-45b7-bbbd-7c5b01333702","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6801","nonce":2032393933}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6803","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6806","nonce":2032393933}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6818","nonce":2032393933}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":2032393933},{"type":"v1","addr":"172.21.15.178:6812","nonce":2032393933}]},"public_addr":"172.21.15.178:6801/2032393933","cluster_addr":"172.21.15.178:6806/2032393933","heartbeat_back_addr":"172.21.15.178:6818/2032393933","heartbeat_front_addr":"172.21.15.178:6812/2032393933","state":["exists","up"]},{"osd":7,"uuid":"69da5016-1cc8-49cc-9ac5-e33bac0e788d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6825","nonce":965369534}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6826","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6827","nonce":965369534}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6830","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6831","nonce":965369534}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6828","nonce":965369534},{"type":"v1","addr":"172.21.15.178:6829","nonce":965369534}]},"public_addr":"172.21.15.178:6825/965369534","cluster_addr":"172.21.15.178:6827/965369534","heartbeat_back_addr":"172.21.15.178:6831/965369534","heartbeat_front_addr":"172.21.15.178:6829/965369534","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.707810+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.767229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.773497+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.881578+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.797467+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.912151+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.859466+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T09:01:10.906469+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6833/836073822":"2024-04-26T09:11:57.598821+0000","172.21.15.59:6832/836073822":"2024-04-26T09:11:57.598821+0000","172.21.15.59:6835/29546856":"2024-04-26T09:11:31.741997+0000","172.21.15.59:6833/1679876837":"2024-04-26T09:11:42.673656+0000","172.21.15.59:6832/1679876837":"2024-04-26T09:11:42.673656+0000","172.21.15.59:6834/29546856":"2024-04-26T09:11:31.741997+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T09:12:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.182+0000 7f8affc00640 1 -- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad8066f60 msgr2=0x7f8ad8069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.182+0000 7f8affc00640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad8066f60 0x7f8ad8069420 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f8af80b4b60 tx=0x7f8aec008040 comp rx=0 tx=0).stop 2024-04-25T09:12:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.182+0000 7f8affc00640 1 -- 172.21.15.59:0/743088292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 msgr2=0x7f8af80ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.182+0000 7f8affc00640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 0x7f8af80ac470 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f8af000cef0 tx=0x7f8af000a710 comp rx=0 tx=0).stop 2024-04-25T09:12:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.182+0000 7f8affc00640 1 -- 172.21.15.59:0/743088292 shutdown_connections 2024-04-25T09:12:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.182+0000 7f8affc00640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8ad8066f60 0x7f8ad8069420 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.182+0000 7f8affc00640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8af8145270 0x7f8af80ac470 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.182+0000 7f8affc00640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f8af80cd4d0 0x7f8af8143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.182+0000 7f8affc00640 1 --2- 172.21.15.59:0/743088292 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f8af80b1750 0x7f8af81f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.182+0000 7f8affc00640 1 -- 172.21.15.59:0/743088292 >> 172.21.15.59:0/743088292 conn(0x7f8af8066fa0 msgr2=0x7f8af8165160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.182+0000 7f8affc00640 1 -- 172.21.15.59:0/743088292 shutdown_connections 2024-04-25T09:12:04.171 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:04.182+0000 7f8affc00640 1 -- 172.21.15.59:0/743088292 wait complete. 2024-04-25T09:12:05.190 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T09:12:05.190 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:12:05.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5139e00640 1 Processor -- start 2024-04-25T09:12:05.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5139e00640 1 -- start start 2024-04-25T09:12:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5139e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f513415e500 0x7f51340af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5139e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f51340b2cb0 0x7f513415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5139e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513406fdb0 con 0x7f51340b2870 2024-04-25T09:12:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5139e00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513415bc20 con 0x7f513415e500 2024-04-25T09:12:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5139e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51340cedf0 con 0x7f51340b2cb0 2024-04-25T09:12:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5138a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f513415e500 0x7f51340af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5138a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f513415e500 0x7f51340af920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36756/0 (socket says 172.21.15.59:36756) 2024-04-25T09:12:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5138a00640 1 -- 172.21.15.59:0/3745322616 learned_addr learned my addr 172.21.15.59:0/3745322616 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f512be00640 1 --1- 172.21.15.59:0/3745322616 >> v1:172.21.15.59:6789/0 conn(0x7f51340b2870 0x7f513415e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36888/0 (socket says 172.21.15.59:36888) 2024-04-25T09:12:05.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5139400640 1 --2- 172.21.15.59:0/3745322616 >> v2:172.21.15.178:3300/0 conn(0x7f51340b2cb0 0x7f513415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5138a00640 1 -- 172.21.15.59:0/3745322616 >> v2:172.21.15.178:3300/0 conn(0x7f51340b2cb0 msgr2=0x7f513415b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5138a00640 1 --2- 172.21.15.59:0/3745322616 >> v2:172.21.15.178:3300/0 conn(0x7f51340b2cb0 0x7f513415b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5138a00640 1 -- 172.21.15.59:0/3745322616 >> v1:172.21.15.59:6789/0 conn(0x7f51340b2870 legacy=0x7f513415e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5138a00640 1 -- 172.21.15.59:0/3745322616 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5134070020 con 0x7f513415e500 2024-04-25T09:12:05.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.358+0000 7f5133e00640 1 -- 172.21.15.59:0/3745322616 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431836403 0 0) 0x7f513406fdb0 con 0x7f51340b2870 2024-04-25T09:12:05.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.362+0000 7f5138a00640 1 --2- 172.21.15.59:0/3745322616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f513415e500 0x7f51340af920 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f5134071bf0 tx=0x7f512401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b3dba7dd65cff1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.362+0000 7f5133e00640 1 -- 172.21.15.59:0/3745322616 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51240ab430 con 0x7f513415e500 2024-04-25T09:12:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.362+0000 7f5133e00640 1 -- 172.21.15.59:0/3745322616 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51240b0070 con 0x7f513415e500 2024-04-25T09:12:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.362+0000 7f5133e00640 1 -- 172.21.15.59:0/3745322616 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51240ab7f0 con 0x7f513415e500 2024-04-25T09:12:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.362+0000 7f5139e00640 1 -- 172.21.15.59:0/3745322616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f513415e500 msgr2=0x7f51340af920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.362+0000 7f5139e00640 1 --2- 172.21.15.59:0/3745322616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f513415e500 0x7f51340af920 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f5134071bf0 tx=0x7f512401c520 comp rx=0 tx=0).stop 2024-04-25T09:12:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.362+0000 7f5139e00640 1 -- 172.21.15.59:0/3745322616 shutdown_connections 2024-04-25T09:12:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.362+0000 7f5139e00640 1 --2- 172.21.15.59:0/3745322616 >> v2:172.21.15.178:3300/0 conn(0x7f51340b2cb0 0x7f513415b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.362+0000 7f5139e00640 1 --2- 172.21.15.59:0/3745322616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f513415e500 0x7f51340af920 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.362+0000 7f5139e00640 1 -- 172.21.15.59:0/3745322616 >> 172.21.15.59:0/3745322616 conn(0x7f5134099a60 msgr2=0x7f51340b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.362+0000 7f5139e00640 1 -- 172.21.15.59:0/3745322616 shutdown_connections 2024-04-25T09:12:05.353 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.362+0000 7f5139e00640 1 -- 172.21.15.59:0/3745322616 wait complete. 2024-04-25T09:12:05.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5139e00640 1 Processor -- start 2024-04-25T09:12:05.354 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5139e00640 1 -- start start 2024-04-25T09:12:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5139e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51340b2870 0x7f5134151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5139e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51340b2cb0 0x7f513414c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5139e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415e500 0x7f513414c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5139e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51341655d0 con 0x7f51340b2cb0 2024-04-25T09:12:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5139e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5134165750 con 0x7f51340b2870 2024-04-25T09:12:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5139e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51341658d0 con 0x7f513415e500 2024-04-25T09:12:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f512be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51340b2cb0 0x7f513414c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f512be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51340b2cb0 0x7f513414c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36772/0 (socket says 172.21.15.59:36772) 2024-04-25T09:12:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f512be00640 1 -- 172.21.15.59:0/2041036863 learned_addr learned my addr 172.21.15.59:0/2041036863 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5138a00640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51340b2870 0x7f5134151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5139400640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415e500 0x7f513414c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.357 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f512be00640 1 -- 172.21.15.59:0/2041036863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415e500 msgr2=0x7f513414c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f512be00640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415e500 0x7f513414c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f512be00640 1 -- 172.21.15.59:0/2041036863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51340b2870 msgr2=0x7f5134151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f512be00640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f51340b2870 0x7f5134151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f512be00640 1 -- 172.21.15.59:0/2041036863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51340cbc50 con 0x7f51340b2cb0 2024-04-25T09:12:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5139400640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f513415e500 0x7f513414c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f512be00640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51340b2cb0 0x7f513414c010 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f511c00c520 tx=0x7f511c00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5131600640 1 -- 172.21.15.59:0/2041036863 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c018070 con 0x7f51340b2cb0 2024-04-25T09:12:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5131600640 1 -- 172.21.15.59:0/2041036863 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511c0074e0 con 0x7f51340b2cb0 2024-04-25T09:12:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5139e00640 1 -- 172.21.15.59:0/2041036863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51340cae90 con 0x7f51340b2cb0 2024-04-25T09:12:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5131600640 1 -- 172.21.15.59:0/2041036863 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511c0049f0 con 0x7f51340b2cb0 2024-04-25T09:12:05.358 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.366+0000 7f5139e00640 1 -- 172.21.15.59:0/2041036863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51340cb450 con 0x7f51340b2cb0 2024-04-25T09:12:05.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.370+0000 7f5139e00640 1 -- 172.21.15.59:0/2041036863 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f51340745d0 con 0x7f51340b2cb0 2024-04-25T09:12:05.359 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.370+0000 7f5131600640 1 -- 172.21.15.59:0/2041036863 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f511c01b070 con 0x7f51340b2cb0 2024-04-25T09:12:05.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.370+0000 7f5131600640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5110066f60 0x7f5110069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.370+0000 7f5131600640 1 -- 172.21.15.59:0/2041036863 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f511c0844b0 con 0x7f51340b2cb0 2024-04-25T09:12:05.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.370+0000 7f5131600640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x7f511006d540 0x7f511006f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.370+0000 7f5131600640 1 -- 172.21.15.59:0/2041036863 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f511c017ec0 con 0x7f511006d540 2024-04-25T09:12:05.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.370+0000 7f5131600640 1 -- 172.21.15.59:0/2041036863 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f511c08b050 con 0x7f51340b2cb0 2024-04-25T09:12:05.360 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.370+0000 7f5138a00640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5110066f60 0x7f5110069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.370+0000 7f5139400640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x7f511006d540 0x7f511006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.370+0000 7f5139400640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x7f511006d540 0x7f511006f980 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.370+0000 7f5138a00640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5110066f60 0x7f5110069420 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f51240af000 tx=0x7f51240a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.361 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.374+0000 7f5131600640 1 -- 172.21.15.59:0/2041036863 <== osd.0 v2:172.21.15.59:6800/4129855307 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f511c017ec0 con 0x7f511006d540 2024-04-25T09:12:05.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5139e00640 1 -- 172.21.15.59:0/2041036863 --> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f51340cda40 con 0x7f511006d540 2024-04-25T09:12:05.375 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5131600640 1 -- 172.21.15.59:0/2041036863 <== osd.0 v2:172.21.15.59:6800/4129855307 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f51340cda40 con 0x7f511006d540 2024-04-25T09:12:05.375 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:12:05.376 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:12:05.376 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:12:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5139e00640 1 -- 172.21.15.59:0/2041036863 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x7f511006d540 msgr2=0x7f511006f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5139e00640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.59:6800/4129855307,v1:172.21.15.59:6801/4129855307] conn(0x7f511006d540 0x7f511006f980 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5139e00640 1 -- 172.21.15.59:0/2041036863 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5110066f60 msgr2=0x7f5110069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5139e00640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5110066f60 0x7f5110069420 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f51240af000 tx=0x7f51240a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5139e00640 1 -- 172.21.15.59:0/2041036863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51340b2cb0 msgr2=0x7f513414c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5139e00640 1 --2- 172.21.15.59:0/2041036863 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51340b2cb0 0x7f513414c010 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f511c00c520 tx=0x7f511c00c9e0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5139400640 1 -- 172.21.15.59:0/2041036863 reap_dead start 2024-04-25T09:12:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5139e00640 1 -- 172.21.15.59:0/2041036863 shutdown_connections 2024-04-25T09:12:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5139e00640 1 -- 172.21.15.59:0/2041036863 >> 172.21.15.59:0/2041036863 conn(0x7f5134099a60 msgr2=0x7f513415c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5139e00640 1 -- 172.21.15.59:0/2041036863 shutdown_connections 2024-04-25T09:12:05.377 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.386+0000 7f5139e00640 1 -- 172.21.15.59:0/2041036863 wait complete. 2024-04-25T09:12:05.394 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T09:12:05.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.546+0000 7f16ba200640 1 Processor -- start 2024-04-25T09:12:05.536 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.546+0000 7f16ba200640 1 -- start start 2024-04-25T09:12:05.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.546+0000 7f16ba200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16b4144120 0x7f16b415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.546+0000 7f16ba200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b415bc40 con 0x7f16b40b3090 2024-04-25T09:12:05.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.546+0000 7f16ba200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16b415b3a0 con 0x7f16b40ccbf0 2024-04-25T09:12:05.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.546+0000 7f16ba200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b415e490 con 0x7f16b4144120 2024-04-25T09:12:05.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.550+0000 7f16b3e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f16b40b3090 0x7f16b406e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36904/0 (socket says 172.21.15.59:36904) 2024-04-25T09:12:05.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.550+0000 7f16b3e00640 1 -- 172.21.15.59:0/1327515615 learned_addr learned my addr 172.21.15.59:0/1327515615 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:05.537 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.550+0000 7f16b3400640 1 --2- 172.21.15.59:0/1327515615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16b4144120 0x7f16b415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.550+0000 7f16b2a00640 1 -- 172.21.15.59:0/1327515615 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2738936105 0 0) 0x7f16b415bc40 con 0x7f16b40b3090 2024-04-25T09:12:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.550+0000 7f16b2a00640 1 -- 172.21.15.59:0/1327515615 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1698005740 con 0x7f16b40b3090 2024-04-25T09:12:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.550+0000 7f16b2a00640 1 -- 172.21.15.59:0/1327515615 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692624727 0 0) 0x7f16b415b3a0 con 0x7f16b40ccbf0 2024-04-25T09:12:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.550+0000 7f16b2a00640 1 -- 172.21.15.59:0/1327515615 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16b415bc40 con 0x7f16b40ccbf0 2024-04-25T09:12:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.550+0000 7f16b3400640 1 -- 172.21.15.59:0/1327515615 >> v1:172.21.15.178:6789/0 conn(0x7f16b40ccbf0 legacy=0x7f16b415e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.538 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.550+0000 7f16b3400640 1 -- 172.21.15.59:0/1327515615 >> v1:172.21.15.59:6789/0 conn(0x7f16b40b3090 legacy=0x7f16b406e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.539 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.550+0000 7f16b3400640 1 -- 172.21.15.59:0/1327515615 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b415b680 con 0x7f16b4144120 2024-04-25T09:12:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.550+0000 7f16b3400640 1 --2- 172.21.15.59:0/1327515615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16b4144120 0x7f16b415acd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f16a40097f0 tx=0x7f16a401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54894ff2339b90e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.550+0000 7f16b2a00640 1 -- 172.21.15.59:0/1327515615 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a40b0070 con 0x7f16b4144120 2024-04-25T09:12:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16b2a00640 1 -- 172.21.15.59:0/1327515615 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16a40ab600 con 0x7f16b4144120 2024-04-25T09:12:05.541 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16b2a00640 1 -- 172.21.15.59:0/1327515615 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a40ab9d0 con 0x7f16b4144120 2024-04-25T09:12:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 -- 172.21.15.59:0/1327515615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16b4144120 msgr2=0x7f16b415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 --2- 172.21.15.59:0/1327515615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16b4144120 0x7f16b415acd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f16a40097f0 tx=0x7f16a401c450 comp rx=0 tx=0).stop 2024-04-25T09:12:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 -- 172.21.15.59:0/1327515615 shutdown_connections 2024-04-25T09:12:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 --2- 172.21.15.59:0/1327515615 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16b4144120 0x7f16b415acd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 -- 172.21.15.59:0/1327515615 >> 172.21.15.59:0/1327515615 conn(0x7f16b4067080 msgr2=0x7f16b406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.542 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 -- 172.21.15.59:0/1327515615 shutdown_connections 2024-04-25T09:12:05.543 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 -- 172.21.15.59:0/1327515615 wait complete. 2024-04-25T09:12:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 Processor -- start 2024-04-25T09:12:05.544 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 -- start start 2024-04-25T09:12:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16b40b3090 0x7f16b41383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16b40ccbf0 0x7f16b415d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b4144120 0x7f16b4141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b406ec70 con 0x7f16b4144120 2024-04-25T09:12:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16b406eaf0 con 0x7f16b40ccbf0 2024-04-25T09:12:05.546 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16ba200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16b40b3470 con 0x7f16b40b3090 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16b3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b4144120 0x7f16b4141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16b3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b4144120 0x7f16b4141a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36786/0 (socket says 172.21.15.59:36786) 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16b3e00640 1 -- 172.21.15.59:0/739045396 learned_addr learned my addr 172.21.15.59:0/739045396 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16b3400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16b40b3090 0x7f16b41383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.554+0000 7f16aaa00640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16b40ccbf0 0x7f16b415d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16b3e00640 1 -- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16b40b3090 msgr2=0x7f16b41383a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16b3e00640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16b40b3090 0x7f16b41383a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16b3e00640 1 -- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16b40ccbf0 msgr2=0x7f16b415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16b3e00640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16b40ccbf0 0x7f16b415d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16b3e00640 1 -- 172.21.15.59:0/739045396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b415ddd0 con 0x7f16b4144120 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16b3e00640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b4144120 0x7f16b4141a50 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00cbd0 tx=0x7f16ac00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16abe00640 1 -- 172.21.15.59:0/739045396 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac017070 con 0x7f16b4144120 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16abe00640 1 -- 172.21.15.59:0/739045396 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16ac00ace0 con 0x7f16b4144120 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16ba200640 1 -- 172.21.15.59:0/739045396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16b415be10 con 0x7f16b4144120 2024-04-25T09:12:05.547 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16abe00640 1 -- 172.21.15.59:0/739045396 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ac012620 con 0x7f16b4144120 2024-04-25T09:12:05.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16ba200640 1 -- 172.21.15.59:0/739045396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16b413a0c0 con 0x7f16b4144120 2024-04-25T09:12:05.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16ba200640 1 -- 172.21.15.59:0/739045396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16b40745d0 con 0x7f16b4144120 2024-04-25T09:12:05.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16abe00640 1 -- 172.21.15.59:0/739045396 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f16ac01a070 con 0x7f16b4144120 2024-04-25T09:12:05.548 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16abe00640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1690066f90 0x7f1690069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16abe00640 1 -- 172.21.15.59:0/739045396 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f16ac084c80 con 0x7f16b4144120 2024-04-25T09:12:05.549 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.558+0000 7f16b3400640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1690066f90 0x7f1690069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.550 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.562+0000 7f16b3400640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1690066f90 0x7f1690069450 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f16a40ad000 tx=0x7f16a40a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.552 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.562+0000 7f16abe00640 1 -- 172.21.15.59:0/739045396 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f16ac055700 con 0x7f16b4144120 2024-04-25T09:12:05.716 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.726+0000 7f16ba200640 1 -- 172.21.15.59:0/739045396 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f16b415ada0 con 0x7f1690066f90 2024-04-25T09:12:05.717 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.726+0000 7f16abe00640 1 -- 172.21.15.59:0/739045396 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f16b415ada0 con 0x7f1690066f90 2024-04-25T09:12:05.717 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T09:12:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.730+0000 7f16ba200640 1 -- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1690066f90 msgr2=0x7f1690069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.730+0000 7f16ba200640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1690066f90 0x7f1690069450 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f16a40ad000 tx=0x7f16a40a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:05.719 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.730+0000 7f16ba200640 1 -- 172.21.15.59:0/739045396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b4144120 msgr2=0x7f16b4141a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.730+0000 7f16ba200640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b4144120 0x7f16b4141a50 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00cbd0 tx=0x7f16ac00a430 comp rx=0 tx=0).stop 2024-04-25T09:12:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.730+0000 7f16ba200640 1 -- 172.21.15.59:0/739045396 shutdown_connections 2024-04-25T09:12:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.730+0000 7f16ba200640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1690066f90 0x7f1690069450 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.730+0000 7f16ba200640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16b4144120 0x7f16b4141a50 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.730+0000 7f16ba200640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f16b40ccbf0 0x7f16b415d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.730+0000 7f16ba200640 1 --2- 172.21.15.59:0/739045396 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f16b40b3090 0x7f16b41383a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.730+0000 7f16ba200640 1 -- 172.21.15.59:0/739045396 >> 172.21.15.59:0/739045396 conn(0x7f16b4067080 msgr2=0x7f16b415e920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.730+0000 7f16ba200640 1 -- 172.21.15.59:0/739045396 shutdown_connections 2024-04-25T09:12:05.720 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.730+0000 7f16ba200640 1 -- 172.21.15.59:0/739045396 wait complete. 2024-04-25T09:12:05.739 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T09:12:05.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:12:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.894+0000 7fb74a200640 1 Processor -- start 2024-04-25T09:12:05.884 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.894+0000 7fb74a200640 1 -- start start 2024-04-25T09:12:05.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.894+0000 7fb74a200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb744144080 0x7fb7440ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.894+0000 7fb74a200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb74406ead0 0x7fb7440ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.885 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.894+0000 7fb74a200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7440cf490 con 0x7fb744071e40 2024-04-25T09:12:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.894+0000 7fb74a200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7440719b0 con 0x7fb74406ead0 2024-04-25T09:12:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.894+0000 7fb74a200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7440cf1b0 con 0x7fb744144080 2024-04-25T09:12:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb743e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb74406ead0 0x7fb7440ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb73aa00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb744071e40 0x7fb74406e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36918/0 (socket says 172.21.15.59:36918) 2024-04-25T09:12:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb73aa00640 1 -- 172.21.15.59:0/2906280868 learned_addr learned my addr 172.21.15.59:0/2906280868 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:05.886 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb743400640 1 --2- 172.21.15.59:0/2906280868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb744144080 0x7fb7440ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb743e00640 1 -- 172.21.15.59:0/2906280868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb744144080 msgr2=0x7fb7440ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:05.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb743e00640 1 --2- 172.21.15.59:0/2906280868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb744144080 0x7fb7440ce660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb743e00640 1 -- 172.21.15.59:0/2906280868 >> v1:172.21.15.59:6789/0 conn(0x7fb744071e40 legacy=0x7fb74406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb742a00640 1 -- 172.21.15.59:0/2906280868 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260008679 0 0) 0x7fb7440cf490 con 0x7fb744071e40 2024-04-25T09:12:05.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb743e00640 1 -- 172.21.15.59:0/2906280868 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744071360 con 0x7fb74406ead0 2024-04-25T09:12:05.887 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb743400640 1 --2- 172.21.15.59:0/2906280868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb744144080 0x7fb7440ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:05.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb743e00640 1 --2- 172.21.15.59:0/2906280868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb74406ead0 0x7fb7440ceba0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fb744071b30 tx=0x7fb73c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2bb51a76503ff1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb742a00640 1 -- 172.21.15.59:0/2906280868 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0ab650 con 0x7fb74406ead0 2024-04-25T09:12:05.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb742a00640 1 -- 172.21.15.59:0/2906280868 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c0b0070 con 0x7fb74406ead0 2024-04-25T09:12:05.889 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.898+0000 7fb742a00640 1 -- 172.21.15.59:0/2906280868 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0aba10 con 0x7fb74406ead0 2024-04-25T09:12:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 -- 172.21.15.59:0/2906280868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb74406ead0 msgr2=0x7fb7440ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 --2- 172.21.15.59:0/2906280868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb74406ead0 0x7fb7440ceba0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fb744071b30 tx=0x7fb73c01c470 comp rx=0 tx=0).stop 2024-04-25T09:12:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 -- 172.21.15.59:0/2906280868 shutdown_connections 2024-04-25T09:12:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 --2- 172.21.15.59:0/2906280868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb74406ead0 0x7fb7440ceba0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 --2- 172.21.15.59:0/2906280868 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb744144080 0x7fb7440ce660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 -- 172.21.15.59:0/2906280868 >> 172.21.15.59:0/2906280868 conn(0x7fb74406ac10 msgr2=0x7fb74406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 -- 172.21.15.59:0/2906280868 shutdown_connections 2024-04-25T09:12:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 -- 172.21.15.59:0/2906280868 wait complete. 2024-04-25T09:12:05.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 Processor -- start 2024-04-25T09:12:05.891 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 -- start start 2024-04-25T09:12:05.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74406ead0 0x7fb7440adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb744071e40 0x7fb7440a9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb744144080 0x7fb7440abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74415eb90 con 0x7fb744144080 2024-04-25T09:12:05.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74415ea10 con 0x7fb744071e40 2024-04-25T09:12:05.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb74a200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74415ed10 con 0x7fb74406ead0 2024-04-25T09:12:05.893 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb743e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb744144080 0x7fb7440abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb743e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb744144080 0x7fb7440abb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36808/0 (socket says 172.21.15.59:36808) 2024-04-25T09:12:05.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb743e00640 1 -- 172.21.15.59:0/832332165 learned_addr learned my addr 172.21.15.59:0/832332165 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:05.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb743400640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74406ead0 0x7fb7440adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb73aa00640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb744071e40 0x7fb7440a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb743e00640 1 -- 172.21.15.59:0/832332165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74406ead0 msgr2=0x7fb7440adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb743e00640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fb74406ead0 0x7fb7440adb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb743e00640 1 -- 172.21.15.59:0/832332165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb744071e40 msgr2=0x7fb7440a9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb743e00640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fb744071e40 0x7fb7440a9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.894 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.902+0000 7fb743e00640 1 -- 172.21.15.59:0/832332165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440a96b0 con 0x7fb744144080 2024-04-25T09:12:05.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.906+0000 7fb743e00640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb744144080 0x7fb7440abb60 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0ad040 tx=0x7fb73c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.906+0000 7fb73be00640 1 -- 172.21.15.59:0/832332165 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0bf610 con 0x7fb744144080 2024-04-25T09:12:05.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.906+0000 7fb73be00640 1 -- 172.21.15.59:0/832332165 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73c0bf7d0 con 0x7fb744144080 2024-04-25T09:12:05.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.906+0000 7fb74a200640 1 -- 172.21.15.59:0/832332165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7440ae240 con 0x7fb744144080 2024-04-25T09:12:05.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.906+0000 7fb73be00640 1 -- 172.21.15.59:0/832332165 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73c0bfbc0 con 0x7fb744144080 2024-04-25T09:12:05.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.906+0000 7fb74a200640 1 -- 172.21.15.59:0/832332165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74413d6c0 con 0x7fb744144080 2024-04-25T09:12:05.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.906+0000 7fb74a200640 1 -- 172.21.15.59:0/832332165 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7440745d0 con 0x7fb744144080 2024-04-25T09:12:05.896 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.906+0000 7fb73be00640 1 -- 172.21.15.59:0/832332165 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fb73c0bd020 con 0x7fb744144080 2024-04-25T09:12:05.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.906+0000 7fb73be00640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb720066f60 0x7fb720069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.897 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.910+0000 7fb73be00640 1 -- 172.21.15.59:0/832332165 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fb73c11fde0 con 0x7fb744144080 2024-04-25T09:12:05.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.910+0000 7fb73be00640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x7fb72006d540 0x7fb72006f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:05.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.910+0000 7fb73be00640 1 -- 172.21.15.59:0/832332165 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb73c0caec0 con 0x7fb72006d540 2024-04-25T09:12:05.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.910+0000 7fb73be00640 1 -- 172.21.15.59:0/832332165 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb73c120190 con 0x7fb744144080 2024-04-25T09:12:05.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.910+0000 7fb743400640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb720066f60 0x7fb720069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.910+0000 7fb73aa00640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x7fb72006d540 0x7fb72006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:05.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.910+0000 7fb73aa00640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x7fb72006d540 0x7fb72006f980 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.910+0000 7fb743400640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb720066f60 0x7fb720069420 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb744149820 tx=0x7fb7340097f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:05.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.910+0000 7fb73be00640 1 -- 172.21.15.59:0/832332165 <== osd.1 v2:172.21.15.59:6809/1450066050 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fb73c0caec0 con 0x7fb72006d540 2024-04-25T09:12:05.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.922+0000 7fb74a200640 1 -- 172.21.15.59:0/832332165 --> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb7440a98e0 con 0x7fb72006d540 2024-04-25T09:12:05.912 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.922+0000 7fb73be00640 1 -- 172.21.15.59:0/832332165 <== osd.1 v2:172.21.15.59:6809/1450066050 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb7440a98e0 con 0x7fb72006d540 2024-04-25T09:12:05.913 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:12:05.913 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:12:05.913 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:12:05.913 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.922+0000 7fb74a200640 1 -- 172.21.15.59:0/832332165 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x7fb72006d540 msgr2=0x7fb72006f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.922+0000 7fb74a200640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.59:6809/1450066050,v1:172.21.15.59:6812/1450066050] conn(0x7fb72006d540 0x7fb72006f980 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.922+0000 7fb74a200640 1 -- 172.21.15.59:0/832332165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb720066f60 msgr2=0x7fb720069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.922+0000 7fb74a200640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fb720066f60 0x7fb720069420 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fb744149820 tx=0x7fb7340097f0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.922+0000 7fb74a200640 1 -- 172.21.15.59:0/832332165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb744144080 msgr2=0x7fb7440abb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.922+0000 7fb74a200640 1 --2- 172.21.15.59:0/832332165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb744144080 0x7fb7440abb60 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0ad040 tx=0x7fb73c01acb0 comp rx=0 tx=0).stop 2024-04-25T09:12:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.922+0000 7fb743e00640 1 -- 172.21.15.59:0/832332165 reap_dead start 2024-04-25T09:12:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.922+0000 7fb74a200640 1 -- 172.21.15.59:0/832332165 shutdown_connections 2024-04-25T09:12:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.922+0000 7fb74a200640 1 -- 172.21.15.59:0/832332165 >> 172.21.15.59:0/832332165 conn(0x7fb74406ac10 msgr2=0x7fb74406d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.926+0000 7fb74a200640 1 -- 172.21.15.59:0/832332165 shutdown_connections 2024-04-25T09:12:05.914 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:05.926+0000 7fb74a200640 1 -- 172.21.15.59:0/832332165 wait complete. 2024-04-25T09:12:05.931 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T09:12:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.082+0000 7f7c99a00640 1 Processor -- start 2024-04-25T09:12:06.072 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.082+0000 7f7c99a00640 1 -- start start 2024-04-25T09:12:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c99a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c94159320 0x7f7c9415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c99a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7c9406e4a0 0x7f7c9406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c99a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9415fc00 con 0x7f7c9415f440 2024-04-25T09:12:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c99a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9406d640 con 0x7f7c94159320 2024-04-25T09:12:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c99a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9406ee10 con 0x7f7c9406e4a0 2024-04-25T09:12:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c92a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c94159320 0x7f7c9415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c92a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7c94159320 0x7f7c9415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36822/0 (socket says 172.21.15.59:36822) 2024-04-25T09:12:06.074 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c92a00640 1 -- 172.21.15.59:0/1535674467 learned_addr learned my addr 172.21.15.59:0/1535674467 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:06.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c93400640 1 --2- 172.21.15.59:0/1535674467 >> v2:172.21.15.178:3300/0 conn(0x7f7c9406e4a0 0x7f7c9406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c92a00640 1 -- 172.21.15.59:0/1535674467 >> v2:172.21.15.178:3300/0 conn(0x7f7c9406e4a0 msgr2=0x7f7c9406e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c92a00640 1 --2- 172.21.15.59:0/1535674467 >> v2:172.21.15.178:3300/0 conn(0x7f7c9406e4a0 0x7f7c9406e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c92a00640 1 -- 172.21.15.59:0/1535674467 >> v1:172.21.15.178:6789/0 conn(0x7f7c9415f440 legacy=0x7f7c9406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c92a00640 1 -- 172.21.15.59:0/1535674467 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9415fee0 con 0x7f7c94159320 2024-04-25T09:12:06.075 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.086+0000 7f7c93400640 1 --2- 172.21.15.59:0/1535674467 >> v2:172.21.15.178:3300/0 conn(0x7f7c9406e4a0 0x7f7c9406e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:06.077 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c92a00640 1 --2- 172.21.15.59:0/1535674467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c94159320 0x7f7c9415c9b0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f7c94072630 tx=0x7f7c8401c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c0559ce7682583d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c92000640 1 -- 172.21.15.59:0/1535674467 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840ab620 con 0x7f7c94159320 2024-04-25T09:12:06.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c92000640 1 -- 172.21.15.59:0/1535674467 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c840b0070 con 0x7f7c94159320 2024-04-25T09:12:06.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c92000640 1 -- 172.21.15.59:0/1535674467 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840ab9e0 con 0x7f7c94159320 2024-04-25T09:12:06.078 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 -- 172.21.15.59:0/1535674467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c94159320 msgr2=0x7f7c9415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 --2- 172.21.15.59:0/1535674467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c94159320 0x7f7c9415c9b0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f7c94072630 tx=0x7f7c8401c420 comp rx=0 tx=0).stop 2024-04-25T09:12:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 -- 172.21.15.59:0/1535674467 shutdown_connections 2024-04-25T09:12:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 --2- 172.21.15.59:0/1535674467 >> v2:172.21.15.178:3300/0 conn(0x7f7c9406e4a0 0x7f7c9406e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 --2- 172.21.15.59:0/1535674467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c94159320 0x7f7c9415c9b0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 -- 172.21.15.59:0/1535674467 >> 172.21.15.59:0/1535674467 conn(0x7f7c94067080 msgr2=0x7f7c9406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 -- 172.21.15.59:0/1535674467 shutdown_connections 2024-04-25T09:12:06.079 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 -- 172.21.15.59:0/1535674467 wait complete. 2024-04-25T09:12:06.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 Processor -- start 2024-04-25T09:12:06.080 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 -- start start 2024-04-25T09:12:06.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c9406e4a0 0x7f7c941f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.082 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c94159320 0x7f7c9413f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c9415f440 0x7f7c9415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94159700 con 0x7f7c94159320 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9415f8a0 con 0x7f7c9415f440 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c99a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94168590 con 0x7f7c9406e4a0 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.090+0000 7f7c8be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c94159320 0x7f7c9413f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c94159320 0x7f7c9413f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36838/0 (socket says 172.21.15.59:36838) 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8be00640 1 -- 172.21.15.59:0/4060008942 learned_addr learned my addr 172.21.15.59:0/4060008942 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c92a00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c9406e4a0 0x7f7c941f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c93400640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c9415f440 0x7f7c9415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8be00640 1 -- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c9406e4a0 msgr2=0x7f7c941f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8be00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c9406e4a0 0x7f7c941f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8be00640 1 -- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c9415f440 msgr2=0x7f7c9415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8be00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c9415f440 0x7f7c9415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8be00640 1 -- 172.21.15.59:0/4060008942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9413fd20 con 0x7f7c94159320 2024-04-25T09:12:06.083 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8be00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c94159320 0x7f7c9413f310 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00c450 tx=0x7f7c7c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8aa00640 1 -- 172.21.15.59:0/4060008942 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c011790 con 0x7f7c94159320 2024-04-25T09:12:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8aa00640 1 -- 172.21.15.59:0/4060008942 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7c017070 con 0x7f7c94159320 2024-04-25T09:12:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c99a00640 1 -- 172.21.15.59:0/4060008942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9413af40 con 0x7f7c94159320 2024-04-25T09:12:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8aa00640 1 -- 172.21.15.59:0/4060008942 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c011b90 con 0x7f7c94159320 2024-04-25T09:12:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c99a00640 1 -- 172.21.15.59:0/4060008942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9413b500 con 0x7f7c94159320 2024-04-25T09:12:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c99a00640 1 -- 172.21.15.59:0/4060008942 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c940745d0 con 0x7f7c94159320 2024-04-25T09:12:06.084 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8aa00640 1 -- 172.21.15.59:0/4060008942 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7c7c011d30 con 0x7f7c94159320 2024-04-25T09:12:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8aa00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c70066f60 0x7f7c70069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.094+0000 7f7c8aa00640 1 -- 172.21.15.59:0/4060008942 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f7c7c084d20 con 0x7f7c94159320 2024-04-25T09:12:06.085 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.098+0000 7f7c92a00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c70066f60 0x7f7c70069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.086 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.098+0000 7f7c92a00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c70066f60 0x7f7c70069420 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7c840af000 tx=0x7f7c840a7000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.089 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.102+0000 7f7c8aa00640 1 -- 172.21.15.59:0/4060008942 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7c7c055df0 con 0x7f7c94159320 2024-04-25T09:12:06.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.262+0000 7f7c99a00640 1 -- 172.21.15.59:0/4060008942 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c9415ded0 con 0x7f7c70066f60 2024-04-25T09:12:06.252 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.262+0000 7f7c8aa00640 1 -- 172.21.15.59:0/4060008942 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7c9415ded0 con 0x7f7c70066f60 2024-04-25T09:12:06.252 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T09:12:06.254 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.266+0000 7f7c99a00640 1 -- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c70066f60 msgr2=0x7f7c70069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.266+0000 7f7c99a00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c70066f60 0x7f7c70069420 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7c840af000 tx=0x7f7c840a7000 comp rx=0 tx=0).stop 2024-04-25T09:12:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.266+0000 7f7c99a00640 1 -- 172.21.15.59:0/4060008942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c94159320 msgr2=0x7f7c9413f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.266+0000 7f7c99a00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c94159320 0x7f7c9413f310 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00c450 tx=0x7f7c7c00c910 comp rx=0 tx=0).stop 2024-04-25T09:12:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.266+0000 7f7c99a00640 1 -- 172.21.15.59:0/4060008942 shutdown_connections 2024-04-25T09:12:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.266+0000 7f7c99a00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7c70066f60 0x7f7c70069420 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.266+0000 7f7c99a00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7c9415f440 0x7f7c9415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.266+0000 7f7c99a00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7c94159320 0x7f7c9413f310 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.266+0000 7f7c99a00640 1 --2- 172.21.15.59:0/4060008942 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7c9406e4a0 0x7f7c941f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.266+0000 7f7c99a00640 1 -- 172.21.15.59:0/4060008942 >> 172.21.15.59:0/4060008942 conn(0x7f7c94067080 msgr2=0x7f7c9415d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.266+0000 7f7c99a00640 1 -- 172.21.15.59:0/4060008942 shutdown_connections 2024-04-25T09:12:06.255 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.266+0000 7f7c99a00640 1 -- 172.21.15.59:0/4060008942 wait complete. 2024-04-25T09:12:06.274 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T09:12:06.274 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:12:06.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f49e00640 1 Processor -- start 2024-04-25T09:12:06.418 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f49e00640 1 -- start start 2024-04-25T09:12:06.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f49e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f9f4406ead0 0x7f9f44165590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f49e00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f440cf490 con 0x7f9f44071e40 2024-04-25T09:12:06.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f49e00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f440cf1b0 con 0x7f9f44144080 2024-04-25T09:12:06.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f49e00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f440719b0 con 0x7f9f4406ead0 2024-04-25T09:12:06.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f3be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9f44071e40 0x7f9f4406e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36930/0 (socket says 172.21.15.59:36930) 2024-04-25T09:12:06.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f3be00640 1 -- 172.21.15.59:0/1567854565 learned_addr learned my addr 172.21.15.59:0/1567854565 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:06.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f43400640 1 --2- 172.21.15.59:0/1567854565 >> v2:172.21.15.178:3300/0 conn(0x7f9f4406ead0 0x7f9f44165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059998517 0 0) 0x7f9f440cf490 con 0x7f9f44071e40 2024-04-25T09:12:06.420 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f28005740 con 0x7f9f44071e40 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2990082103 0 0) 0x7f9f28005740 con 0x7f9f44071e40 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 >> v2:172.21.15.178:3300/0 conn(0x7f9f4406ead0 msgr2=0x7f9f44165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 --2- 172.21.15.59:0/1567854565 >> v2:172.21.15.178:3300/0 conn(0x7f9f4406ead0 0x7f9f44165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 >> v1:172.21.15.178:6789/0 conn(0x7f9f44144080 legacy=0x7f9f440ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f44071360 con 0x7f9f44071e40 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f9f2c001680 con 0x7f9f44071e40 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 >> v1:172.21.15.59:6789/0 conn(0x7f9f44071e40 legacy=0x7f9f4406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 --2- 172.21.15.59:0/1567854565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f28005bd0 0x7f9f28005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 --2- 172.21.15.59:0/1567854565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f28006a20 0x7f9f28006ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 --2- 172.21.15.59:0/1567854565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f280073e0 0x7f9f2800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440719b0 con 0x7f9f280073e0 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2800e280 con 0x7f9f28005bd0 2024-04-25T09:12:06.422 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2800e480 con 0x7f9f28006a20 2024-04-25T09:12:06.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f43400640 1 --2- 172.21.15.59:0/1567854565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f280073e0 0x7f9f2800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f3be00640 1 --2- 172.21.15.59:0/1567854565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f28006a20 0x7f9f28006ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.430+0000 7f9f42a00640 1 --2- 172.21.15.59:0/1567854565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f28005bd0 0x7f9f28005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f43400640 1 -- 172.21.15.59:0/1567854565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f28006a20 msgr2=0x7f9f28006ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f43400640 1 --2- 172.21.15.59:0/1567854565 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f28006a20 0x7f9f28006ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f43400640 1 -- 172.21.15.59:0/1567854565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f28005bd0 msgr2=0x7f9f28005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f43400640 1 --2- 172.21.15.59:0/1567854565 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f28005bd0 0x7f9f28005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.423 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f43400640 1 -- 172.21.15.59:0/1567854565 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f28005740 con 0x7f9f280073e0 2024-04-25T09:12:06.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f43400640 1 -- 172.21.15.59:0/1567854565 reap_dead start 2024-04-25T09:12:06.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f43400640 1 --2- 172.21.15.59:0/1567854565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f280073e0 0x7f9f2800dbe0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009fc0 tx=0x7f9f3c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3daaf6894f9462cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c009c10 con 0x7f9f280073e0 2024-04-25T09:12:06.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c0a5d10 con 0x7f9f280073e0 2024-04-25T09:12:06.424 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f42000640 1 -- 172.21.15.59:0/1567854565 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c003be0 con 0x7f9f280073e0 2024-04-25T09:12:06.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f49e00640 1 -- 172.21.15.59:0/1567854565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f280073e0 msgr2=0x7f9f2800dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f49e00640 1 --2- 172.21.15.59:0/1567854565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f280073e0 0x7f9f2800dbe0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c009fc0 tx=0x7f9f3c01ccc0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f49e00640 1 -- 172.21.15.59:0/1567854565 shutdown_connections 2024-04-25T09:12:06.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f49e00640 1 --2- 172.21.15.59:0/1567854565 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f280073e0 0x7f9f2800dbe0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f49e00640 1 -- 172.21.15.59:0/1567854565 >> 172.21.15.59:0/1567854565 conn(0x7f9f4406ac10 msgr2=0x7f9f4406b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f49e00640 1 -- 172.21.15.59:0/1567854565 shutdown_connections 2024-04-25T09:12:06.425 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.434+0000 7f9f49e00640 1 -- 172.21.15.59:0/1567854565 wait complete. 2024-04-25T09:12:06.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f49e00640 1 Processor -- start 2024-04-25T09:12:06.426 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f49e00640 1 -- start start 2024-04-25T09:12:06.428 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f49e00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f280073e0 0x7f9f44138eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f49e00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f4413f7f0 0x7f9f4415cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f49e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4413a790 0x7f9f4413ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f49e00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b4950 con 0x7f9f4413a790 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f49e00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44144460 con 0x7f9f280073e0 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f49e00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b4ad0 con 0x7f9f4413f7f0 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f43400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4413a790 0x7f9f4413ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f43400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4413a790 0x7f9f4413ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36864/0 (socket says 172.21.15.59:36864) 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f43400640 1 -- 172.21.15.59:0/1973343081 learned_addr learned my addr 172.21.15.59:0/1973343081 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f3be00640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f4413f7f0 0x7f9f4415cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f42a00640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f280073e0 0x7f9f44138eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f43400640 1 -- 172.21.15.59:0/1973343081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f4413f7f0 msgr2=0x7f9f4415cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f43400640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f9f4413f7f0 0x7f9f4415cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f43400640 1 -- 172.21.15.59:0/1973343081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f280073e0 msgr2=0x7f9f44138eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f43400640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f9f280073e0 0x7f9f44138eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f43400640 1 -- 172.21.15.59:0/1973343081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4413ff60 con 0x7f9f4413a790 2024-04-25T09:12:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f43400640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4413a790 0x7f9f4413ac10 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0987f0 tx=0x7f9f3c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f3b400640 1 -- 172.21.15.59:0/1973343081 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c009c10 con 0x7f9f4413a790 2024-04-25T09:12:06.430 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f3b400640 1 -- 172.21.15.59:0/1973343081 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c0bd070 con 0x7f9f4413a790 2024-04-25T09:12:06.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f3b400640 1 -- 172.21.15.59:0/1973343081 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c0aeec0 con 0x7f9f4413a790 2024-04-25T09:12:06.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f49e00640 1 -- 172.21.15.59:0/1973343081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f44140240 con 0x7f9f4413a790 2024-04-25T09:12:06.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.438+0000 7f9f49e00640 1 -- 172.21.15.59:0/1973343081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4413fc70 con 0x7f9f4413a790 2024-04-25T09:12:06.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.442+0000 7f9f49e00640 1 -- 172.21.15.59:0/1973343081 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f44140760 con 0x7f9f4413a790 2024-04-25T09:12:06.431 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.442+0000 7f9f3b400640 1 -- 172.21.15.59:0/1973343081 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f9f3c0039a0 con 0x7f9f4413a790 2024-04-25T09:12:06.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.442+0000 7f9f3b400640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9f20067130 0x7f9f200695f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.442+0000 7f9f3b400640 1 -- 172.21.15.59:0/1973343081 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f9f3c121800 con 0x7f9f4413a790 2024-04-25T09:12:06.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.442+0000 7f9f3b400640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x7f9f2006d710 0x7f9f2006fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.442+0000 7f9f3b400640 1 -- 172.21.15.59:0/1973343081 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f3c0aeec0 con 0x7f9f2006d710 2024-04-25T09:12:06.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.442+0000 7f9f3b400640 1 -- 172.21.15.59:0/1973343081 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f3c121bb0 con 0x7f9f4413a790 2024-04-25T09:12:06.432 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.442+0000 7f9f42a00640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9f20067130 0x7f9f200695f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.442+0000 7f9f3be00640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x7f9f2006d710 0x7f9f2006fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.442+0000 7f9f3be00640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x7f9f2006d710 0x7f9f2006fb50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.442+0000 7f9f42a00640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9f20067130 0x7f9f200695f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9f44140aa0 tx=0x7f9f34009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.433 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.446+0000 7f9f3b400640 1 -- 172.21.15.59:0/1973343081 <== osd.2 v2:172.21.15.59:6824/4113007731 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9f3c0aeec0 con 0x7f9f2006d710 2024-04-25T09:12:06.447 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f49e00640 1 -- 172.21.15.59:0/1973343081 --> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9f440745d0 con 0x7f9f2006d710 2024-04-25T09:12:06.448 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f3b400640 1 -- 172.21.15.59:0/1973343081 <== osd.2 v2:172.21.15.59:6824/4113007731 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9f440745d0 con 0x7f9f2006d710 2024-04-25T09:12:06.448 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:12:06.448 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:12:06.448 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:12:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f49e00640 1 -- 172.21.15.59:0/1973343081 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x7f9f2006d710 msgr2=0x7f9f2006fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f49e00640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.59:6824/4113007731,v1:172.21.15.59:6825/4113007731] conn(0x7f9f2006d710 0x7f9f2006fb50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f49e00640 1 -- 172.21.15.59:0/1973343081 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9f20067130 msgr2=0x7f9f200695f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f49e00640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f9f20067130 0x7f9f200695f0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9f44140aa0 tx=0x7f9f34009040 comp rx=0 tx=0).stop 2024-04-25T09:12:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f49e00640 1 -- 172.21.15.59:0/1973343081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4413a790 msgr2=0x7f9f4413ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f49e00640 1 --2- 172.21.15.59:0/1973343081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f4413a790 0x7f9f4413ac10 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0987f0 tx=0x7f9f3c009750 comp rx=0 tx=0).stop 2024-04-25T09:12:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f43400640 1 -- 172.21.15.59:0/1973343081 reap_dead start 2024-04-25T09:12:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f49e00640 1 -- 172.21.15.59:0/1973343081 shutdown_connections 2024-04-25T09:12:06.449 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f49e00640 1 -- 172.21.15.59:0/1973343081 >> 172.21.15.59:0/1973343081 conn(0x7f9f4406ac10 msgr2=0x7f9f440afa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f49e00640 1 -- 172.21.15.59:0/1973343081 shutdown_connections 2024-04-25T09:12:06.450 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.458+0000 7f9f49e00640 1 -- 172.21.15.59:0/1973343081 wait complete. 2024-04-25T09:12:06.466 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T09:12:06.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.618+0000 7f0ea2000640 1 Processor -- start 2024-04-25T09:12:06.609 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.618+0000 7f0ea2000640 1 -- start start 2024-04-25T09:12:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0ea2000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e9c144120 0x7f0e9c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0ea2000640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e9c0ccbf0 0x7f0e9c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0ea2000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9c15bc40 con 0x7f0e9c15ee60 2024-04-25T09:12:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0ea2000640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9c15e490 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0ea2000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c15b3a0 con 0x7f0e9c144120 2024-04-25T09:12:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0e93e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e9c0ccbf0 0x7f0e9c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0e93e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e9c0ccbf0 0x7f0e9c15e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36868/0 (socket says 172.21.15.59:36868) 2024-04-25T09:12:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0e93e00640 1 -- 172.21.15.59:0/3918858172 learned_addr learned my addr 172.21.15.59:0/3918858172 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0e9b400640 1 --2- 172.21.15.59:0/3918858172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e9c144120 0x7f0e9c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0e93e00640 1 -- 172.21.15.59:0/3918858172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e9c144120 msgr2=0x7f0e9c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.611 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0e93e00640 1 --2- 172.21.15.59:0/3918858172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e9c144120 0x7f0e9c15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0e93e00640 1 -- 172.21.15.59:0/3918858172 >> v1:172.21.15.178:6789/0 conn(0x7f0e9c15ee60 legacy=0x7f0e9c0b3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.612 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.622+0000 7f0e93e00640 1 -- 172.21.15.59:0/3918858172 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c15b680 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0e93e00640 1 --2- 172.21.15.59:0/3918858172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e9c0ccbf0 0x7f0e9c15e920 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009870 tx=0x7f0e8401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d68846a5c1d7fd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0e9aa00640 1 -- 172.21.15.59:0/3918858172 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e840b0070 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0e9aa00640 1 -- 172.21.15.59:0/3918858172 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e840ab600 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.614 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0e9aa00640 1 -- 172.21.15.59:0/3918858172 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e840ab9d0 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0ea2000640 1 -- 172.21.15.59:0/3918858172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e9c0ccbf0 msgr2=0x7f0e9c15e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0ea2000640 1 --2- 172.21.15.59:0/3918858172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e9c0ccbf0 0x7f0e9c15e920 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f0e84009870 tx=0x7f0e8401c4d0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0ea2000640 1 -- 172.21.15.59:0/3918858172 shutdown_connections 2024-04-25T09:12:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0ea2000640 1 --2- 172.21.15.59:0/3918858172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e9c0ccbf0 0x7f0e9c15e920 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0ea2000640 1 --2- 172.21.15.59:0/3918858172 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e9c144120 0x7f0e9c15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0ea2000640 1 -- 172.21.15.59:0/3918858172 >> 172.21.15.59:0/3918858172 conn(0x7f0e9c067080 msgr2=0x7f0e9c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0ea2000640 1 -- 172.21.15.59:0/3918858172 shutdown_connections 2024-04-25T09:12:06.615 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0ea2000640 1 -- 172.21.15.59:0/3918858172 wait complete. 2024-04-25T09:12:06.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0ea2000640 1 Processor -- start 2024-04-25T09:12:06.616 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.626+0000 7f0ea2000640 1 -- start start 2024-04-25T09:12:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0ea2000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e9c0ccbf0 0x7f0e9c149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0ea2000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e9c144120 0x7f0e9c142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0ea2000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e9c15ee60 0x7f0e9c142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0ea2000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c06d450 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0ea2000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c06d2d0 con 0x7f0e9c144120 2024-04-25T09:12:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0ea2000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c06d5d0 con 0x7f0e9c15ee60 2024-04-25T09:12:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e9b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e9c0ccbf0 0x7f0e9c149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.619 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e9b400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e9c0ccbf0 0x7f0e9c149ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36880/0 (socket says 172.21.15.59:36880) 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e9b400640 1 -- 172.21.15.59:0/1100723232 learned_addr learned my addr 172.21.15.59:0/1100723232 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e93e00640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e9c144120 0x7f0e9c142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e9be00640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e9c15ee60 0x7f0e9c142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e9b400640 1 -- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e9c15ee60 msgr2=0x7f0e9c142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e9b400640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e9c15ee60 0x7f0e9c142e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e9b400640 1 -- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e9c144120 msgr2=0x7f0e9c142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e9b400640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e9c144120 0x7f0e9c142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e9b400640 1 -- 172.21.15.59:0/1100723232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c141d10 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e9b400640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e9c0ccbf0 0x7f0e9c149ed0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00e930 tx=0x7f0e8c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e93400640 1 -- 172.21.15.59:0/1100723232 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c017070 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e93400640 1 -- 172.21.15.59:0/1100723232 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c00ca00 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e93400640 1 -- 172.21.15.59:0/1100723232 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00cdb0 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0ea2000640 1 -- 172.21.15.59:0/1100723232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9c15f5f0 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.620 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0ea2000640 1 -- 172.21.15.59:0/1100723232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9c15fbb0 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0ea2000640 1 -- 172.21.15.59:0/1100723232 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9c0745d0 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.630+0000 7f0e93400640 1 -- 172.21.15.59:0/1100723232 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f0e8c01a070 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.634+0000 7f0e93400640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e78066f60 0x7f0e78069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.621 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.634+0000 7f0e93400640 1 -- 172.21.15.59:0/1100723232 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f0e8c084fa0 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.622 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.634+0000 7f0e93e00640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e78066f60 0x7f0e78069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.623 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.634+0000 7f0e93e00640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e78066f60 0x7f0e78069420 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0e840ad000 tx=0x7f0e84008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.625 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.638+0000 7f0e93400640 1 -- 172.21.15.59:0/1100723232 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f0e8c056120 con 0x7f0e9c0ccbf0 2024-04-25T09:12:06.789 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.798+0000 7f0ea2000640 1 -- 172.21.15.59:0/1100723232 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e9c0b34a0 con 0x7f0e78066f60 2024-04-25T09:12:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.798+0000 7f0e93400640 1 -- 172.21.15.59:0/1100723232 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0e9c0b34a0 con 0x7f0e78066f60 2024-04-25T09:12:06.790 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.802+0000 7f0ea2000640 1 -- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e78066f60 msgr2=0x7f0e78069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.802+0000 7f0ea2000640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e78066f60 0x7f0e78069420 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f0e840ad000 tx=0x7f0e84008040 comp rx=0 tx=0).stop 2024-04-25T09:12:06.791 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.802+0000 7f0ea2000640 1 -- 172.21.15.59:0/1100723232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e9c0ccbf0 msgr2=0x7f0e9c149ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.802+0000 7f0ea2000640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e9c0ccbf0 0x7f0e9c149ed0 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c00e930 tx=0x7f0e8c00edf0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.802+0000 7f0ea2000640 1 -- 172.21.15.59:0/1100723232 shutdown_connections 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.802+0000 7f0ea2000640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f0e78066f60 0x7f0e78069420 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.802+0000 7f0ea2000640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f0e9c15ee60 0x7f0e9c142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.802+0000 7f0ea2000640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f0e9c144120 0x7f0e9c142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.802+0000 7f0ea2000640 1 --2- 172.21.15.59:0/1100723232 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e9c0ccbf0 0x7f0e9c149ed0 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.802+0000 7f0ea2000640 1 -- 172.21.15.59:0/1100723232 >> 172.21.15.59:0/1100723232 conn(0x7f0e9c067080 msgr2=0x7f0e9c140940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.802+0000 7f0ea2000640 1 -- 172.21.15.59:0/1100723232 shutdown_connections 2024-04-25T09:12:06.792 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.802+0000 7f0ea2000640 1 -- 172.21.15.59:0/1100723232 wait complete. 2024-04-25T09:12:06.811 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T09:12:06.811 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:12:06.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.966+0000 7f3c80600640 1 Processor -- start 2024-04-25T09:12:06.956 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.966+0000 7f3c80600640 1 -- start start 2024-04-25T09:12:06.961 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c80600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c78071b70 0x7f3c78066b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c80600640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f3c7806f350 0x7f3c780cf2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c80600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c7806b990 con 0x7f3c78071f50 2024-04-25T09:12:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c80600640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c78067090 con 0x7f3c7806f350 2024-04-25T09:12:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c80600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7806dbd0 con 0x7f3c78071b70 2024-04-25T09:12:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c7d200640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3c78071f50 0x7f3c780ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36944/0 (socket says 172.21.15.59:36944) 2024-04-25T09:12:06.962 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c7d200640 1 -- 172.21.15.59:0/152709650 learned_addr learned my addr 172.21.15.59:0/152709650 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:06.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c7dc00640 1 --2- 172.21.15.59:0/152709650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c78071b70 0x7f3c78066b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c7e600640 1 --2- 172.21.15.59:0/152709650 >> v2:172.21.15.178:3300/0 conn(0x7f3c7806f350 0x7f3c780cf2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205350177 0 0) 0x7f3c7806b990 con 0x7f3c78071f50 2024-04-25T09:12:06.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c60003530 con 0x7f3c78071f50 2024-04-25T09:12:06.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2783369742 0 0) 0x7f3c60003530 con 0x7f3c78071f50 2024-04-25T09:12:06.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c78071b70 msgr2=0x7f3c78066b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.963 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 --2- 172.21.15.59:0/152709650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c78071b70 0x7f3c78066b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 >> v2:172.21.15.178:3300/0 conn(0x7f3c7806f350 msgr2=0x7f3c780cf2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 --2- 172.21.15.59:0/152709650 >> v2:172.21.15.178:3300/0 conn(0x7f3c7806f350 0x7f3c780cf2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c7806bc70 con 0x7f3c78071f50 2024-04-25T09:12:06.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f3c64001680 con 0x7f3c78071f50 2024-04-25T09:12:06.964 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 >> v1:172.21.15.59:6789/0 conn(0x7f3c78071f50 legacy=0x7f3c780ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 --2- 172.21.15.59:0/152709650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c600039c0 0x7f3c60003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 --2- 172.21.15.59:0/152709650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c60004810 0x7f3c60004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 --2- 172.21.15.59:0/152709650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c78071b70 0x7f3c600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78067090 con 0x7f3c600039c0 2024-04-25T09:12:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c7806dbd0 con 0x7f3c60004810 2024-04-25T09:12:06.965 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6000b9d0 con 0x7f3c78071b70 2024-04-25T09:12:06.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c7dc00640 1 --2- 172.21.15.59:0/152709650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c600039c0 0x7f3c60003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c7e600640 1 --2- 172.21.15.59:0/152709650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c78071b70 0x7f3c600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c7d200640 1 --2- 172.21.15.59:0/152709650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c60004810 0x7f3c60004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c7dc00640 1 -- 172.21.15.59:0/152709650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c78071b70 msgr2=0x7f3c600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.966 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c7dc00640 1 --2- 172.21.15.59:0/152709650 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c78071b70 0x7f3c600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c7dc00640 1 -- 172.21.15.59:0/152709650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c60004810 msgr2=0x7f3c60004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:06.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c7dc00640 1 --2- 172.21.15.59:0/152709650 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c60004810 0x7f3c60004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.967 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.970+0000 7f3c7dc00640 1 -- 172.21.15.59:0/152709650 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c60003530 con 0x7f3c600039c0 2024-04-25T09:12:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c7dc00640 1 --2- 172.21.15.59:0/152709650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c600039c0 0x7f3c60003de0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009ae0 tx=0x7f3c6c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa09ad901aa7cc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0096b0 con 0x7f3c600039c0 2024-04-25T09:12:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c0a6460 con 0x7f3c600039c0 2024-04-25T09:12:06.975 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c77e00640 1 -- 172.21.15.59:0/152709650 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0a6850 con 0x7f3c600039c0 2024-04-25T09:12:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c80600640 1 -- 172.21.15.59:0/152709650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c600039c0 msgr2=0x7f3c60003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c80600640 1 --2- 172.21.15.59:0/152709650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c600039c0 0x7f3c60003de0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009ae0 tx=0x7f3c6c01ca70 comp rx=0 tx=0).stop 2024-04-25T09:12:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c7e600640 1 -- 172.21.15.59:0/152709650 reap_dead start 2024-04-25T09:12:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c80600640 1 -- 172.21.15.59:0/152709650 shutdown_connections 2024-04-25T09:12:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c80600640 1 -- 172.21.15.59:0/152709650 >> 172.21.15.59:0/152709650 conn(0x7f3c780cfd80 msgr2=0x7f3c780d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.976 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c80600640 1 -- 172.21.15.59:0/152709650 shutdown_connections 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c80600640 1 -- 172.21.15.59:0/152709650 wait complete. 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c80600640 1 Processor -- start 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.974+0000 7f3c80600640 1 -- start start 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c80600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c600039c0 0x7f3c78154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c80600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c780aeb60 0x7f3c78146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c80600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c7815deb0 0x7f3c7815ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.977 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c80600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780b4e80 con 0x7f3c600039c0 2024-04-25T09:12:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c80600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c780b4d00 con 0x7f3c780aeb60 2024-04-25T09:12:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c80600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c78072350 con 0x7f3c7815deb0 2024-04-25T09:12:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c7dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c600039c0 0x7f3c78154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c7dc00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c600039c0 0x7f3c78154180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36902/0 (socket says 172.21.15.59:36902) 2024-04-25T09:12:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c7dc00640 1 -- 172.21.15.59:0/1625449330 learned_addr learned my addr 172.21.15.59:0/1625449330 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:06.978 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c7d200640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c780aeb60 0x7f3c78146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c7e600640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c7815deb0 0x7f3c7815ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c7dc00640 1 -- 172.21.15.59:0/1625449330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c7815deb0 msgr2=0x7f3c7815ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c7dc00640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f3c7815deb0 0x7f3c7815ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c7dc00640 1 -- 172.21.15.59:0/1625449330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c780aeb60 msgr2=0x7f3c78146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c7dc00640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f3c780aeb60 0x7f3c78146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.979 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c7dc00640 1 -- 172.21.15.59:0/1625449330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c78154810 con 0x7f3c600039c0 2024-04-25T09:12:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c7dc00640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c600039c0 0x7f3c78154180 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009ae0 tx=0x7f3c60005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c75600640 1 -- 172.21.15.59:0/1625449330 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0be070 con 0x7f3c600039c0 2024-04-25T09:12:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c75600640 1 -- 172.21.15.59:0/1625449330 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6c00f000 con 0x7f3c600039c0 2024-04-25T09:12:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c80600640 1 -- 172.21.15.59:0/1625449330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c78155c70 con 0x7f3c600039c0 2024-04-25T09:12:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c75600640 1 -- 172.21.15.59:0/1625449330 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6c0a7440 con 0x7f3c600039c0 2024-04-25T09:12:06.980 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c80600640 1 -- 172.21.15.59:0/1625449330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c781561f0 con 0x7f3c600039c0 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c80600640 1 -- 172.21.15.59:0/1625449330 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c780745d0 con 0x7f3c600039c0 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.978+0000 7f3c75600640 1 -- 172.21.15.59:0/1625449330 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f3c6c0c1070 con 0x7f3c600039c0 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.982+0000 7f3c75600640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3c58066f60 0x7f3c58069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.982+0000 7f3c75600640 1 -- 172.21.15.59:0/1625449330 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f3c6c11e8c0 con 0x7f3c600039c0 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.982+0000 7f3c75600640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x7f3c5806d540 0x7f3c5806f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.982+0000 7f3c75600640 1 -- 172.21.15.59:0/1625449330 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c6c0bae80 con 0x7f3c5806d540 2024-04-25T09:12:06.981 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.982+0000 7f3c75600640 1 -- 172.21.15.59:0/1625449330 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c6c1232a0 con 0x7f3c600039c0 2024-04-25T09:12:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.982+0000 7f3c7d200640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3c58066f60 0x7f3c58069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.982+0000 7f3c7e600640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x7f3c5806d540 0x7f3c5806f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.982+0000 7f3c7e600640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x7f3c5806d540 0x7f3c5806f980 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.982+0000 7f3c7d200640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3c58066f60 0x7f3c58069420 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f3c64001060 tx=0x7f3c64007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:06.982 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.982+0000 7f3c75600640 1 -- 172.21.15.59:0/1625449330 <== osd.3 v2:172.21.15.59:6808/3810214969 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3c6c0bae80 con 0x7f3c5806d540 2024-04-25T09:12:06.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.994+0000 7f3c80600640 1 -- 172.21.15.59:0/1625449330 --> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3c78072950 con 0x7f3c5806d540 2024-04-25T09:12:06.985 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.994+0000 7f3c75600640 1 -- 172.21.15.59:0/1625449330 <== osd.3 v2:172.21.15.59:6808/3810214969 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3c78072950 con 0x7f3c5806d540 2024-04-25T09:12:06.986 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:12:06.986 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:12:06.986 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:12:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.998+0000 7f3c80600640 1 -- 172.21.15.59:0/1625449330 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x7f3c5806d540 msgr2=0x7f3c5806f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.998+0000 7f3c80600640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.59:6808/3810214969,v1:172.21.15.59:6810/3810214969] conn(0x7f3c5806d540 0x7f3c5806f980 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.998+0000 7f3c80600640 1 -- 172.21.15.59:0/1625449330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3c58066f60 msgr2=0x7f3c58069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.998+0000 7f3c80600640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f3c58066f60 0x7f3c58069420 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f3c64001060 tx=0x7f3c64007040 comp rx=0 tx=0).stop 2024-04-25T09:12:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.998+0000 7f3c80600640 1 -- 172.21.15.59:0/1625449330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c600039c0 msgr2=0x7f3c78154180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:06.988 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.998+0000 7f3c80600640 1 --2- 172.21.15.59:0/1625449330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c600039c0 0x7f3c78154180 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f3c6c009ae0 tx=0x7f3c60005840 comp rx=0 tx=0).stop 2024-04-25T09:12:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.998+0000 7f3c7e600640 1 -- 172.21.15.59:0/1625449330 reap_dead start 2024-04-25T09:12:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.998+0000 7f3c80600640 1 -- 172.21.15.59:0/1625449330 shutdown_connections 2024-04-25T09:12:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.998+0000 7f3c80600640 1 -- 172.21.15.59:0/1625449330 >> 172.21.15.59:0/1625449330 conn(0x7f3c780cfd80 msgr2=0x7f3c7815a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.998+0000 7f3c80600640 1 -- 172.21.15.59:0/1625449330 shutdown_connections 2024-04-25T09:12:06.989 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:06.998+0000 7f3c80600640 1 -- 172.21.15.59:0/1625449330 wait complete. 2024-04-25T09:12:07.004 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T09:12:07.145 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.154+0000 7fe7a5a00640 1 Processor -- start 2024-04-25T09:12:07.146 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.158+0000 7fe7a5a00640 1 -- start start 2024-04-25T09:12:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.158+0000 7fe7a5a00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe7a006e4a0 0x7fe7a006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.158+0000 7fe7a5a00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a015fc00 con 0x7fe7a015c9b0 2024-04-25T09:12:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.158+0000 7fe7a5a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7a015fee0 con 0x7fe7a0159320 2024-04-25T09:12:07.147 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.158+0000 7fe7a5a00640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7a006d640 con 0x7fe7a006e4a0 2024-04-25T09:12:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.158+0000 7fe79f400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe7a006e4a0 0x7fe7a006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.158+0000 7fe797e00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe7a015c9b0 0x7fe7a006dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36958/0 (socket says 172.21.15.59:36958) 2024-04-25T09:12:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.158+0000 7fe797e00640 1 -- 172.21.15.59:0/3512164452 learned_addr learned my addr 172.21.15.59:0/3512164452 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.158+0000 7fe79f400640 1 -- 172.21.15.59:0/3512164452 >> v1:172.21.15.178:6789/0 conn(0x7fe7a0159320 legacy=0x7fe7a015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.158+0000 7fe79f400640 1 -- 172.21.15.59:0/3512164452 >> v1:172.21.15.59:6789/0 conn(0x7fe7a015c9b0 legacy=0x7fe7a006dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.158+0000 7fe79f400640 1 -- 172.21.15.59:0/3512164452 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a01601c0 con 0x7fe7a006e4a0 2024-04-25T09:12:07.148 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.158+0000 7fe79e000640 1 -- 172.21.15.59:0/3512164452 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961745319 0 0) 0x7fe7a015fc00 con 0x7fe7a015c9b0 2024-04-25T09:12:07.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe79f400640 1 --2- 172.21.15.59:0/3512164452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a006e4a0 0x7fe7a006e8d0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fe7a006d7c0 tx=0x7fe79801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89040a172c5707bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe79e000640 1 -- 172.21.15.59:0/3512164452 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980b2070 con 0x7fe7a006e4a0 2024-04-25T09:12:07.150 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe79e000640 1 -- 172.21.15.59:0/3512164452 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7980a5810 con 0x7fe7a006e4a0 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe79e000640 1 -- 172.21.15.59:0/3512164452 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980a5be0 con 0x7fe7a006e4a0 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3512164452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a006e4a0 msgr2=0x7fe7a006e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.151 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe7a5a00640 1 --2- 172.21.15.59:0/3512164452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a006e4a0 0x7fe7a006e8d0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7fe7a006d7c0 tx=0x7fe79801c950 comp rx=0 tx=0).stop 2024-04-25T09:12:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3512164452 shutdown_connections 2024-04-25T09:12:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe7a5a00640 1 --2- 172.21.15.59:0/3512164452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a006e4a0 0x7fe7a006e8d0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3512164452 >> 172.21.15.59:0/3512164452 conn(0x7fe7a0067080 msgr2=0x7fe7a006ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3512164452 shutdown_connections 2024-04-25T09:12:07.152 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3512164452 wait complete. 2024-04-25T09:12:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe7a5a00640 1 Processor -- start 2024-04-25T09:12:07.153 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.162+0000 7fe7a5a00640 1 -- start start 2024-04-25T09:12:07.154 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe7a5a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7a006e4a0 0x7fe7a013e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe7a5a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7a0159320 0x7fe7a0142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe7a5a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a015c9b0 0x7fe7a015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe7a5a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a0169720 con 0x7fe7a015c9b0 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe7a5a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a01695a0 con 0x7fe7a0159320 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe7a5a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7a01698a0 con 0x7fe7a006e4a0 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe79f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a015c9b0 0x7fe7a015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe79f400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a015c9b0 0x7fe7a015dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36926/0 (socket says 172.21.15.59:36926) 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe79f400640 1 -- 172.21.15.59:0/3912222099 learned_addr learned my addr 172.21.15.59:0/3912222099 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe797e00640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7a0159320 0x7fe7a0142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe79ea00640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7a006e4a0 0x7fe7a013e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe79f400640 1 -- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7a006e4a0 msgr2=0x7fe7a013e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.155 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe79f400640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7a006e4a0 0x7fe7a013e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe79f400640 1 -- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7a0159320 msgr2=0x7fe7a0142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe79f400640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7a0159320 0x7fe7a0142380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.156 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe79f400640 1 -- 172.21.15.59:0/3912222099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a013ec70 con 0x7fe7a015c9b0 2024-04-25T09:12:07.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe79f400640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a015c9b0 0x7fe7a015dfd0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fe79801a580 tx=0x7fe7980196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe796a00640 1 -- 172.21.15.59:0/3912222099 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980b2050 con 0x7fe7a015c9b0 2024-04-25T09:12:07.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe796a00640 1 -- 172.21.15.59:0/3912222099 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7980be070 con 0x7fe7a015c9b0 2024-04-25T09:12:07.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3912222099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7a013ef50 con 0x7fe7a015c9b0 2024-04-25T09:12:07.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe796a00640 1 -- 172.21.15.59:0/3912222099 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7980ada50 con 0x7fe7a015c9b0 2024-04-25T09:12:07.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3912222099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7a0141e60 con 0x7fe7a015c9b0 2024-04-25T09:12:07.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.166+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3912222099 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7a0142060 con 0x7fe7a015c9b0 2024-04-25T09:12:07.157 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.170+0000 7fe796a00640 1 -- 172.21.15.59:0/3912222099 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fe7980adbf0 con 0x7fe7a015c9b0 2024-04-25T09:12:07.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.170+0000 7fe796a00640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe77c066f60 0x7fe77c069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.170+0000 7fe796a00640 1 -- 172.21.15.59:0/3912222099 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fe7981200c0 con 0x7fe7a015c9b0 2024-04-25T09:12:07.158 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.170+0000 7fe79ea00640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe77c066f60 0x7fe77c069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.159 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.170+0000 7fe79ea00640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe77c066f60 0x7fe77c069420 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe790000f70 tx=0x7fe790009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.162 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.174+0000 7fe796a00640 1 -- 172.21.15.59:0/3912222099 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fe7a0142060 con 0x7fe7a015c9b0 2024-04-25T09:12:07.327 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.338+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3912222099 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7a00745d0 con 0x7fe77c066f60 2024-04-25T09:12:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.338+0000 7fe796a00640 1 -- 172.21.15.59:0/3912222099 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe7a00745d0 con 0x7fe77c066f60 2024-04-25T09:12:07.328 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T09:12:07.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.342+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe77c066f60 msgr2=0x7fe77c069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.342+0000 7fe7a5a00640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe77c066f60 0x7fe77c069420 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe790000f70 tx=0x7fe790009040 comp rx=0 tx=0).stop 2024-04-25T09:12:07.330 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.342+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3912222099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a015c9b0 msgr2=0x7fe7a015dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.342+0000 7fe7a5a00640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a015c9b0 0x7fe7a015dfd0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7fe79801a580 tx=0x7fe7980196f0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.342+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3912222099 shutdown_connections 2024-04-25T09:12:07.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.342+0000 7fe7a5a00640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fe77c066f60 0x7fe77c069420 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.342+0000 7fe7a5a00640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7a015c9b0 0x7fe7a015dfd0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.342+0000 7fe7a5a00640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fe7a0159320 0x7fe7a0142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.342+0000 7fe7a5a00640 1 --2- 172.21.15.59:0/3912222099 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fe7a006e4a0 0x7fe7a013e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.342+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3912222099 >> 172.21.15.59:0/3912222099 conn(0x7fe7a0067080 msgr2=0x7fe7a006dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.342+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3912222099 shutdown_connections 2024-04-25T09:12:07.331 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.342+0000 7fe7a5a00640 1 -- 172.21.15.59:0/3912222099 wait complete. 2024-04-25T09:12:07.349 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T09:12:07.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:12:07.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f525f800640 1 Processor -- start 2024-04-25T09:12:07.494 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f525f800640 1 -- start start 2024-04-25T09:12:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f525f800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5258071e40 0x7f525806e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f525f800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52580cf490 con 0x7f5258144080 2024-04-25T09:12:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f525f800640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52580cf1b0 con 0x7f525806e900 2024-04-25T09:12:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f525f800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525806ed70 con 0x7f5258071e40 2024-04-25T09:12:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f524fe00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5258071e40 0x7f525806e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f525ce00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5258144080 0x7f52580ce660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36962/0 (socket says 172.21.15.59:36962) 2024-04-25T09:12:07.496 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f525ce00640 1 -- 172.21.15.59:0/3839574578 learned_addr learned my addr 172.21.15.59:0/3839574578 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:07.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f524fe00640 1 -- 172.21.15.59:0/3839574578 >> v1:172.21.15.178:6789/0 conn(0x7f525806e900 legacy=0x7f525815e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:07.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f524fe00640 1 -- 172.21.15.59:0/3839574578 >> v1:172.21.15.59:6789/0 conn(0x7f5258144080 legacy=0x7f52580ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f524fe00640 1 -- 172.21.15.59:0/3839574578 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5258071360 con 0x7f5258071e40 2024-04-25T09:12:07.497 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.506+0000 7f5257e00640 1 -- 172.21.15.59:0/3839574578 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421764780 0 0) 0x7f52580cf490 con 0x7f5258144080 2024-04-25T09:12:07.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.510+0000 7f524fe00640 1 --2- 172.21.15.59:0/3839574578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5258071e40 0x7f525806e3c0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f52400097c0 tx=0x7f524001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adde24c36f096a8c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.510+0000 7f5257e00640 1 -- 172.21.15.59:0/3839574578 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400b0070 con 0x7f5258071e40 2024-04-25T09:12:07.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.510+0000 7f5257e00640 1 -- 172.21.15.59:0/3839574578 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52400ab600 con 0x7f5258071e40 2024-04-25T09:12:07.499 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.510+0000 7f5257e00640 1 -- 172.21.15.59:0/3839574578 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400ab9d0 con 0x7f5258071e40 2024-04-25T09:12:07.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.510+0000 7f525f800640 1 -- 172.21.15.59:0/3839574578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5258071e40 msgr2=0x7f525806e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.510+0000 7f525f800640 1 --2- 172.21.15.59:0/3839574578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5258071e40 0x7f525806e3c0 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f52400097c0 tx=0x7f524001c4a0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.510+0000 7f525f800640 1 -- 172.21.15.59:0/3839574578 shutdown_connections 2024-04-25T09:12:07.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.510+0000 7f525f800640 1 --2- 172.21.15.59:0/3839574578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5258071e40 0x7f525806e3c0 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.510+0000 7f525f800640 1 -- 172.21.15.59:0/3839574578 >> 172.21.15.59:0/3839574578 conn(0x7f525806ac10 msgr2=0x7f525806b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.500 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.510+0000 7f525f800640 1 -- 172.21.15.59:0/3839574578 shutdown_connections 2024-04-25T09:12:07.501 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.510+0000 7f525f800640 1 -- 172.21.15.59:0/3839574578 wait complete. 2024-04-25T09:12:07.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525f800640 1 Processor -- start 2024-04-25T09:12:07.502 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525f800640 1 -- start start 2024-04-25T09:12:07.503 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525f800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f525806e900 0x7f5258159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525f800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5258071e40 0x7f525815ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525f800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5258144080 0x7f525813f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525f800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52580ceef0 con 0x7f5258071e40 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525f800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52580ced70 con 0x7f5258144080 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525f800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52581685b0 con 0x7f525806e900 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f524fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5258071e40 0x7f525815ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f524fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5258071e40 0x7f525815ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36940/0 (socket says 172.21.15.59:36940) 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f524fe00640 1 -- 172.21.15.59:0/3940058636 learned_addr learned my addr 172.21.15.59:0/3940058636 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525ce00640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f525806e900 0x7f5258159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525d800640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5258144080 0x7f525813f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f524fe00640 1 -- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f525806e900 msgr2=0x7f5258159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f524fe00640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f525806e900 0x7f5258159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f524fe00640 1 -- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5258144080 msgr2=0x7f525813f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.504 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f524fe00640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5258144080 0x7f525813f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f524fe00640 1 -- 172.21.15.59:0/3940058636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5258160800 con 0x7f5258071e40 2024-04-25T09:12:07.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525d800640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f5258144080 0x7f525813f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:07.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f524fe00640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5258071e40 0x7f525815ff00 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f52400ae040 tx=0x7f524001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f5255600640 1 -- 172.21.15.59:0/3940058636 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400b0040 con 0x7f5258071e40 2024-04-25T09:12:07.505 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f5255600640 1 -- 172.21.15.59:0/3940058636 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5240004020 con 0x7f5258071e40 2024-04-25T09:12:07.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f5255600640 1 -- 172.21.15.59:0/3940058636 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52400043d0 con 0x7f5258071e40 2024-04-25T09:12:07.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525f800640 1 -- 172.21.15.59:0/3940058636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5258160ae0 con 0x7f5258071e40 2024-04-25T09:12:07.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525f800640 1 -- 172.21.15.59:0/3940058636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52580b06c0 con 0x7f5258071e40 2024-04-25T09:12:07.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.514+0000 7f525f800640 1 -- 172.21.15.59:0/3940058636 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f52580745d0 con 0x7f5258071e40 2024-04-25T09:12:07.506 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.518+0000 7f5255600640 1 -- 172.21.15.59:0/3940058636 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f52400bf060 con 0x7f5258071e40 2024-04-25T09:12:07.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.518+0000 7f5255600640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5234066f60 0x7f5234069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.507 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.518+0000 7f5255600640 1 -- 172.21.15.59:0/3940058636 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f524011f160 con 0x7f5258071e40 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.518+0000 7f5255600640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x7f523406d540 0x7f523406f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.518+0000 7f5255600640 1 -- 172.21.15.59:0/3940058636 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5240007e50 con 0x7f523406d540 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.518+0000 7f5255600640 1 -- 172.21.15.59:0/3940058636 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f524011f510 con 0x7f5258071e40 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.518+0000 7f525ce00640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5234066f60 0x7f5234069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.518+0000 7f525d800640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x7f523406d540 0x7f523406f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.518+0000 7f525ce00640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5234066f60 0x7f5234069420 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5248007fd0 tx=0x7f5248007ba0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.508 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.518+0000 7f525d800640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x7f523406d540 0x7f523406f980 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.509 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.522+0000 7f5255600640 1 -- 172.21.15.59:0/3940058636 <== osd.4 v2:172.21.15.178:6805/2278719369 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5240007e50 con 0x7f523406d540 2024-04-25T09:12:07.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f525f800640 1 -- 172.21.15.59:0/3940058636 --> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f525806b510 con 0x7f523406d540 2024-04-25T09:12:07.523 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f5255600640 1 -- 172.21.15.59:0/3940058636 <== osd.4 v2:172.21.15.178:6805/2278719369 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f525806b510 con 0x7f523406d540 2024-04-25T09:12:07.524 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:12:07.524 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:12:07.524 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:12:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f525f800640 1 -- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x7f523406d540 msgr2=0x7f523406f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f525f800640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:6805/2278719369,v1:172.21.15.178:6808/2278719369] conn(0x7f523406d540 0x7f523406f980 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f525f800640 1 -- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5234066f60 msgr2=0x7f5234069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f525f800640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5234066f60 0x7f5234069420 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5248007fd0 tx=0x7f5248007ba0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f525f800640 1 -- 172.21.15.59:0/3940058636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5258071e40 msgr2=0x7f525815ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f525f800640 1 --2- 172.21.15.59:0/3940058636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5258071e40 0x7f525815ff00 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f52400ae040 tx=0x7f524001ace0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f525d800640 1 -- 172.21.15.59:0/3940058636 reap_dead start 2024-04-25T09:12:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f525f800640 1 -- 172.21.15.59:0/3940058636 shutdown_connections 2024-04-25T09:12:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f525f800640 1 -- 172.21.15.59:0/3940058636 >> 172.21.15.59:0/3940058636 conn(0x7f525806ac10 msgr2=0x7f52581421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f525f800640 1 -- 172.21.15.59:0/3940058636 shutdown_connections 2024-04-25T09:12:07.525 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.534+0000 7f525f800640 1 -- 172.21.15.59:0/3940058636 wait complete. 2024-04-25T09:12:07.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T09:12:07.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.694+0000 7f527d000640 1 Processor -- start 2024-04-25T09:12:07.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.694+0000 7f527d000640 1 -- start start 2024-04-25T09:12:07.685 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f527d000640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f527815a370 0x7f527815eab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f527d000640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52780b4840 con 0x7f52780b3dc0 2024-04-25T09:12:07.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f527d000640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52780b4b20 con 0x7f527806c330 2024-04-25T09:12:07.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f527d000640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f527815eff0 con 0x7f527815a370 2024-04-25T09:12:07.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f526fe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f52780b3dc0 0x7f527806bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36968/0 (socket says 172.21.15.59:36968) 2024-04-25T09:12:07.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f526fe00640 1 -- 172.21.15.59:0/4111195802 learned_addr learned my addr 172.21.15.59:0/4111195802 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:07.686 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f5277400640 1 --2- 172.21.15.59:0/4111195802 >> v2:172.21.15.178:3300/0 conn(0x7f527815a370 0x7f527815eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f5276a00640 1 -- 172.21.15.59:0/4111195802 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989942970 0 0) 0x7f52780b4840 con 0x7f52780b3dc0 2024-04-25T09:12:07.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f5276a00640 1 -- 172.21.15.59:0/4111195802 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f525c003530 con 0x7f52780b3dc0 2024-04-25T09:12:07.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f5276a00640 1 -- 172.21.15.59:0/4111195802 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944930650 0 0) 0x7f52780b4b20 con 0x7f527806c330 2024-04-25T09:12:07.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f5276a00640 1 -- 172.21.15.59:0/4111195802 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52780b4840 con 0x7f527806c330 2024-04-25T09:12:07.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f5277400640 1 -- 172.21.15.59:0/4111195802 >> v1:172.21.15.178:6789/0 conn(0x7f527806c330 legacy=0x7f52780cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f5277400640 1 -- 172.21.15.59:0/4111195802 >> v1:172.21.15.59:6789/0 conn(0x7f52780b3dc0 legacy=0x7f527806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f5277400640 1 -- 172.21.15.59:0/4111195802 --> v2:172.21.15.178:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527815e2b0 con 0x7f527815a370 2024-04-25T09:12:07.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.698+0000 7f5277400640 1 --2- 172.21.15.59:0/4111195802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f527815a370 0x7f527815eab0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f52680097c0 tx=0x7f526801c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0ea2fbafa22464f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f5276a00640 1 -- 172.21.15.59:0/4111195802 <== mon.1 v2:172.21.15.178:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52680b0070 con 0x7f527815a370 2024-04-25T09:12:07.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f5276a00640 1 -- 172.21.15.59:0/4111195802 <== mon.1 v2:172.21.15.178:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52680ab600 con 0x7f527815a370 2024-04-25T09:12:07.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f5276a00640 1 -- 172.21.15.59:0/4111195802 <== mon.1 v2:172.21.15.178:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52680ab9b0 con 0x7f527815a370 2024-04-25T09:12:07.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 -- 172.21.15.59:0/4111195802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f527815a370 msgr2=0x7f527815eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 --2- 172.21.15.59:0/4111195802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f527815a370 0x7f527815eab0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f52680097c0 tx=0x7f526801c410 comp rx=0 tx=0).stop 2024-04-25T09:12:07.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 -- 172.21.15.59:0/4111195802 shutdown_connections 2024-04-25T09:12:07.690 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 --2- 172.21.15.59:0/4111195802 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f527815a370 0x7f527815eab0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 -- 172.21.15.59:0/4111195802 >> 172.21.15.59:0/4111195802 conn(0x7f5278071930 msgr2=0x7f5278071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 -- 172.21.15.59:0/4111195802 shutdown_connections 2024-04-25T09:12:07.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 -- 172.21.15.59:0/4111195802 wait complete. 2024-04-25T09:12:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 Processor -- start 2024-04-25T09:12:07.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 -- start start 2024-04-25T09:12:07.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f527806c330 0x7f527814d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52780b3dc0 0x7f527814f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f527815a370 0x7f5278150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527815a8d0 con 0x7f52780b3dc0 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527815a750 con 0x7f527815a370 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f527d000640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5278168c60 con 0x7f527806c330 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f526fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52780b3dc0 0x7f527814f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f526fe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52780b3dc0 0x7f527814f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36950/0 (socket says 172.21.15.59:36950) 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f526fe00640 1 -- 172.21.15.59:0/3338599938 learned_addr learned my addr 172.21.15.59:0/3338599938 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f5277400640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f527806c330 0x7f527814d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.702+0000 7f5277e00640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f527815a370 0x7f5278150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f526fe00640 1 -- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f527806c330 msgr2=0x7f527814d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f526fe00640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f527806c330 0x7f527814d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f526fe00640 1 -- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f527815a370 msgr2=0x7f5278150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f526fe00640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f527815a370 0x7f5278150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f526fe00640 1 -- 172.21.15.59:0/3338599938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5278155a20 con 0x7f52780b3dc0 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f5277e00640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f527815a370 0x7f5278150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:07.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f526fe00640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52780b3dc0 0x7f527814f870 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f526000c4d0 tx=0x7f526000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f526f400640 1 -- 172.21.15.59:0/3338599938 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5260017070 con 0x7f52780b3dc0 2024-04-25T09:12:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f526f400640 1 -- 172.21.15.59:0/3338599938 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5260005cf0 con 0x7f52780b3dc0 2024-04-25T09:12:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f526f400640 1 -- 172.21.15.59:0/3338599938 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52600072b0 con 0x7f52780b3dc0 2024-04-25T09:12:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f527d000640 1 -- 172.21.15.59:0/3338599938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5278155d00 con 0x7f52780b3dc0 2024-04-25T09:12:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f527d000640 1 -- 172.21.15.59:0/3338599938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52781562c0 con 0x7f52780b3dc0 2024-04-25T09:12:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f527d000640 1 -- 172.21.15.59:0/3338599938 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527815de10 con 0x7f52780b3dc0 2024-04-25T09:12:07.696 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.706+0000 7f526f400640 1 -- 172.21.15.59:0/3338599938 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f526001a070 con 0x7f52780b3dc0 2024-04-25T09:12:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.710+0000 7f526f400640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5254066f90 0x7f5254069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:07.697 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.710+0000 7f526f400640 1 -- 172.21.15.59:0/3338599938 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f5260084240 con 0x7f52780b3dc0 2024-04-25T09:12:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.710+0000 7f5277400640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5254066f90 0x7f5254069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:07.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.710+0000 7f5277400640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5254066f90 0x7f5254069450 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f52680ad000 tx=0x7f52680a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:07.702 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.714+0000 7f526f400640 1 -- 172.21.15.59:0/3338599938 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f5260054d50 con 0x7f52780b3dc0 2024-04-25T09:12:07.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 -- 172.21.15.59:0/3338599938 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f52780cf970 con 0x7f5254066f90 2024-04-25T09:12:07.866 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f526f400640 1 -- 172.21.15.59:0/3338599938 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f52780cf970 con 0x7f5254066f90 2024-04-25T09:12:07.866 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T09:12:07.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 -- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5254066f90 msgr2=0x7f5254069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5254066f90 0x7f5254069450 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f52680ad000 tx=0x7f52680a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:07.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 -- 172.21.15.59:0/3338599938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52780b3dc0 msgr2=0x7f527814f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:07.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52780b3dc0 0x7f527814f870 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f526000c4d0 tx=0x7f526000c990 comp rx=0 tx=0).stop 2024-04-25T09:12:07.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 -- 172.21.15.59:0/3338599938 shutdown_connections 2024-04-25T09:12:07.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f5254066f90 0x7f5254069450 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f527815a370 0x7f5278150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52780b3dc0 0x7f527814f870 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 --2- 172.21.15.59:0/3338599938 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f527806c330 0x7f527814d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:07.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 -- 172.21.15.59:0/3338599938 >> 172.21.15.59:0/3338599938 conn(0x7f5278071930 msgr2=0x7f5278156990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:07.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 -- 172.21.15.59:0/3338599938 shutdown_connections 2024-04-25T09:12:07.869 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:07.878+0000 7f527d000640 1 -- 172.21.15.59:0/3338599938 wait complete. 2024-04-25T09:12:07.888 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T09:12:07.889 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:12:08.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c7600640 1 Processor -- start 2024-04-25T09:12:08.034 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c7600640 1 -- start start 2024-04-25T09:12:08.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c7600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92c0071250 0x7f92c00cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.035 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c7600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f92c015c4a0 0x7f92c015cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c7600640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c015ccc0 con 0x7f92c0071630 2024-04-25T09:12:08.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c7600640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c0160200 con 0x7f92c015c4a0 2024-04-25T09:12:08.036 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c7600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c015c9e0 con 0x7f92c0071250 2024-04-25T09:12:08.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c5600640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f92c015c4a0 0x7f92c015cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92bfe00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f92c0071630 0x7f92c015bd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36974/0 (socket says 172.21.15.59:36974) 2024-04-25T09:12:08.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92bfe00640 1 -- 172.21.15.59:0/3974223240 learned_addr learned my addr 172.21.15.59:0/3974223240 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:08.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c4c00640 1 --2- 172.21.15.59:0/3974223240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92c0071250 0x7f92c00cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c5600640 1 -- 172.21.15.59:0/3974223240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92c0071250 msgr2=0x7f92c00cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:08.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c5600640 1 --2- 172.21.15.59:0/3974223240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92c0071250 0x7f92c00cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c5600640 1 -- 172.21.15.59:0/3974223240 >> v1:172.21.15.59:6789/0 conn(0x7f92c0071630 legacy=0x7f92c015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92c5600640 1 -- 172.21.15.59:0/3974223240 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c00cd4b0 con 0x7f92c015c4a0 2024-04-25T09:12:08.037 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.046+0000 7f92bf400640 1 -- 172.21.15.59:0/3974223240 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1567352490 0 0) 0x7f92c015ccc0 con 0x7f92c0071630 2024-04-25T09:12:08.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.050+0000 7f92c5600640 1 --2- 172.21.15.59:0/3974223240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c015c4a0 0x7f92c015cee0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009d90 tx=0x7f92b801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7214022c36e6e1fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.050+0000 7f92bf400640 1 -- 172.21.15.59:0/3974223240 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80b2070 con 0x7f92c015c4a0 2024-04-25T09:12:08.039 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.050+0000 7f92bf400640 1 -- 172.21.15.59:0/3974223240 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b80a5800 con 0x7f92c015c4a0 2024-04-25T09:12:08.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.050+0000 7f92bf400640 1 -- 172.21.15.59:0/3974223240 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80a5bd0 con 0x7f92c015c4a0 2024-04-25T09:12:08.040 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.050+0000 7f92c7600640 1 -- 172.21.15.59:0/3974223240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c015c4a0 msgr2=0x7f92c015cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.050+0000 7f92c7600640 1 --2- 172.21.15.59:0/3974223240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c015c4a0 0x7f92c015cee0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009d90 tx=0x7f92b801c850 comp rx=0 tx=0).stop 2024-04-25T09:12:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.050+0000 7f92c7600640 1 -- 172.21.15.59:0/3974223240 shutdown_connections 2024-04-25T09:12:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.050+0000 7f92c7600640 1 --2- 172.21.15.59:0/3974223240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c015c4a0 0x7f92c015cee0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.050+0000 7f92c7600640 1 --2- 172.21.15.59:0/3974223240 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92c0071250 0x7f92c00cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.050+0000 7f92c7600640 1 -- 172.21.15.59:0/3974223240 >> 172.21.15.59:0/3974223240 conn(0x7f92c006ac10 msgr2=0x7f92c006b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.050+0000 7f92c7600640 1 -- 172.21.15.59:0/3974223240 shutdown_connections 2024-04-25T09:12:08.041 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.050+0000 7f92c7600640 1 -- 172.21.15.59:0/3974223240 wait complete. 2024-04-25T09:12:08.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c7600640 1 Processor -- start 2024-04-25T09:12:08.042 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c7600640 1 -- start start 2024-04-25T09:12:08.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c7600640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92c0071250 0x7f92c0165dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c7600640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c0071630 0x7f92c013bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c7600640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92c015c4a0 0x7f92c00af9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c7600640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c0168620 con 0x7f92c0071630 2024-04-25T09:12:08.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c7600640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c01684a0 con 0x7f92c015c4a0 2024-04-25T09:12:08.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c7600640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c01687a0 con 0x7f92c0071250 2024-04-25T09:12:08.044 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c0071630 0x7f92c013bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92bfe00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c0071630 0x7f92c013bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36968/0 (socket says 172.21.15.59:36968) 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92bfe00640 1 -- 172.21.15.59:0/650626196 learned_addr learned my addr 172.21.15.59:0/650626196 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c5600640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92c015c4a0 0x7f92c00af9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c4c00640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92c0071250 0x7f92c0165dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92bfe00640 1 -- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92c0071250 msgr2=0x7f92c0165dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92bfe00640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92c0071250 0x7f92c0165dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92bfe00640 1 -- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92c015c4a0 msgr2=0x7f92c00af9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92bfe00640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f92c015c4a0 0x7f92c00af9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92bfe00640 1 -- 172.21.15.59:0/650626196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c013c4b0 con 0x7f92c0071630 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c4c00640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f92c0071250 0x7f92c0165dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92bfe00640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c0071630 0x7f92c013bf70 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c480 tx=0x7f92ac00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92bcc00640 1 -- 172.21.15.59:0/650626196 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac018070 con 0x7f92c0071630 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92bcc00640 1 -- 172.21.15.59:0/650626196 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac007500 con 0x7f92c0071630 2024-04-25T09:12:08.045 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92bcc00640 1 -- 172.21.15.59:0/650626196 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac004a30 con 0x7f92c0071630 2024-04-25T09:12:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c7600640 1 -- 172.21.15.59:0/650626196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c0164d20 con 0x7f92c0071630 2024-04-25T09:12:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c7600640 1 -- 172.21.15.59:0/650626196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c01652e0 con 0x7f92c0071630 2024-04-25T09:12:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.054+0000 7f92c7600640 1 -- 172.21.15.59:0/650626196 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f92c01659a0 con 0x7f92c0071630 2024-04-25T09:12:08.046 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.058+0000 7f92bcc00640 1 -- 172.21.15.59:0/650626196 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f92ac01b070 con 0x7f92c0071630 2024-04-25T09:12:08.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.058+0000 7f92bcc00640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92a0066f60 0x7f92a0069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.058+0000 7f92bcc00640 1 -- 172.21.15.59:0/650626196 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f92ac0842b0 con 0x7f92c0071630 2024-04-25T09:12:08.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.058+0000 7f92bcc00640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x7f92a006d540 0x7f92a006f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.047 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.058+0000 7f92bcc00640 1 -- 172.21.15.59:0/650626196 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f92a0070050 con 0x7f92a006d540 2024-04-25T09:12:08.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.058+0000 7f92bcc00640 1 -- 172.21.15.59:0/650626196 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92ac08b050 con 0x7f92c0071630 2024-04-25T09:12:08.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.058+0000 7f92c4c00640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92a0066f60 0x7f92a0069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.058+0000 7f92c5600640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x7f92a006d540 0x7f92a006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.058+0000 7f92c4c00640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92a0066f60 0x7f92a0069420 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009a40 tx=0x7f92b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.048 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.058+0000 7f92c5600640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x7f92a006d540 0x7f92a006f980 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.049 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.062+0000 7f92bcc00640 1 -- 172.21.15.59:0/650626196 <== osd.5 v2:172.21.15.178:6802/3576783051 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f92a0070050 con 0x7f92a006d540 2024-04-25T09:12:08.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92c7600640 1 -- 172.21.15.59:0/650626196 --> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f92c00745d0 con 0x7f92a006d540 2024-04-25T09:12:08.063 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92bcc00640 1 -- 172.21.15.59:0/650626196 <== osd.5 v2:172.21.15.178:6802/3576783051 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f92c00745d0 con 0x7f92a006d540 2024-04-25T09:12:08.063 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:12:08.063 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:12:08.064 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:12:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92c7600640 1 -- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x7f92a006d540 msgr2=0x7f92a006f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92c7600640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:6802/3576783051,v1:172.21.15.178:6804/3576783051] conn(0x7f92a006d540 0x7f92a006f980 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.064 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92c7600640 1 -- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92a0066f60 msgr2=0x7f92a0069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92c7600640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f92a0066f60 0x7f92a0069420 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009a40 tx=0x7f92b4008040 comp rx=0 tx=0).stop 2024-04-25T09:12:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92c7600640 1 -- 172.21.15.59:0/650626196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c0071630 msgr2=0x7f92c013bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92c7600640 1 --2- 172.21.15.59:0/650626196 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c0071630 0x7f92c013bf70 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7f92ac00c480 tx=0x7f92ac00c940 comp rx=0 tx=0).stop 2024-04-25T09:12:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92c5600640 1 -- 172.21.15.59:0/650626196 reap_dead start 2024-04-25T09:12:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92c7600640 1 -- 172.21.15.59:0/650626196 shutdown_connections 2024-04-25T09:12:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92c7600640 1 -- 172.21.15.59:0/650626196 >> 172.21.15.59:0/650626196 conn(0x7f92c006ac10 msgr2=0x7f92c014f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92c7600640 1 -- 172.21.15.59:0/650626196 shutdown_connections 2024-04-25T09:12:08.065 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.074+0000 7f92c7600640 1 -- 172.21.15.59:0/650626196 wait complete. 2024-04-25T09:12:08.082 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T09:12:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad88a00640 1 Processor -- start 2024-04-25T09:12:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad88a00640 1 -- start start 2024-04-25T09:12:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad88a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8415da90 0x7fad8406ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad88a00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fad8406e2d0 0x7fad8406b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad88a00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad8406ede0 con 0x7fad840ca520 2024-04-25T09:12:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad88a00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad8406e760 con 0x7fad8406e2d0 2024-04-25T09:12:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad88a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8406f0c0 con 0x7fad8415da90 2024-04-25T09:12:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad79e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fad8406e2d0 0x7fad8406b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad82800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8415da90 0x7fad8406ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.226 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad79e00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7fad8406e2d0 0x7fad8406b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3300/0 says I am v2:172.21.15.59:46936/0 (socket says 172.21.15.59:46936) 2024-04-25T09:12:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad82800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8415da90 0x7fad8406ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.178:3301/0 says I am v2:172.21.15.59:42338/0 (socket says 172.21.15.59:42338) 2024-04-25T09:12:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad79e00640 1 -- 172.21.15.59:0/273669484 learned_addr learned my addr 172.21.15.59:0/273669484 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad81e00640 1 -- 172.21.15.59:0/273669484 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 819645184 0 0) 0x7fad8406ede0 con 0x7fad840ca520 2024-04-25T09:12:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad82800640 1 -- 172.21.15.59:0/273669484 >> v2:172.21.15.178:3300/0 conn(0x7fad8406e2d0 msgr2=0x7fad8406b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad82800640 1 --2- 172.21.15.59:0/273669484 >> v2:172.21.15.178:3300/0 conn(0x7fad8406e2d0 0x7fad8406b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad82800640 1 -- 172.21.15.59:0/273669484 >> v1:172.21.15.178:6789/0 conn(0x7fad840ca520 legacy=0x7fad840ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.227 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.234+0000 7fad82800640 1 -- 172.21.15.59:0/273669484 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad840b29a0 con 0x7fad8415da90 2024-04-25T09:12:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.238+0000 7fad82800640 1 --2- 172.21.15.59:0/273669484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8415da90 0x7fad8406ac10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fad74009d90 tx=0x7fad7401c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9573097d111e19f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.238+0000 7fad81e00640 1 -- 172.21.15.59:0/273669484 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740b2070 con 0x7fad8415da90 2024-04-25T09:12:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.238+0000 7fad81e00640 1 -- 172.21.15.59:0/273669484 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad740a5740 con 0x7fad8415da90 2024-04-25T09:12:08.228 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.238+0000 7fad81e00640 1 -- 172.21.15.59:0/273669484 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740a5b10 con 0x7fad8415da90 2024-04-25T09:12:08.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.238+0000 7fad88a00640 1 -- 172.21.15.59:0/273669484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8415da90 msgr2=0x7fad8406ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.238+0000 7fad88a00640 1 --2- 172.21.15.59:0/273669484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8415da90 0x7fad8406ac10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fad74009d90 tx=0x7fad7401c850 comp rx=0 tx=0).stop 2024-04-25T09:12:08.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.238+0000 7fad88a00640 1 -- 172.21.15.59:0/273669484 shutdown_connections 2024-04-25T09:12:08.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.238+0000 7fad88a00640 1 --2- 172.21.15.59:0/273669484 >> v2:172.21.15.178:3300/0 conn(0x7fad8406e2d0 0x7fad8406b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.238+0000 7fad88a00640 1 --2- 172.21.15.59:0/273669484 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad8415da90 0x7fad8406ac10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.238+0000 7fad88a00640 1 -- 172.21.15.59:0/273669484 >> 172.21.15.59:0/273669484 conn(0x7fad84099a60 msgr2=0x7fad840b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.238+0000 7fad88a00640 1 -- 172.21.15.59:0/273669484 shutdown_connections 2024-04-25T09:12:08.229 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.238+0000 7fad88a00640 1 -- 172.21.15.59:0/273669484 wait complete. 2024-04-25T09:12:08.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad88a00640 1 Processor -- start 2024-04-25T09:12:08.231 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad88a00640 1 -- start start 2024-04-25T09:12:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad88a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad840ca520 0x7fad8415be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad88a00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8415da90 0x7fad84142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad88a00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad841559f0 0x7fad840b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad88a00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840d0160 con 0x7fad840ca520 2024-04-25T09:12:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad88a00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad840cffe0 con 0x7fad8415da90 2024-04-25T09:12:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad88a00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad8416a530 con 0x7fad841559f0 2024-04-25T09:12:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad82800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad840ca520 0x7fad8415be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad82800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad840ca520 0x7fad8415be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36972/0 (socket says 172.21.15.59:36972) 2024-04-25T09:12:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad82800640 1 -- 172.21.15.59:0/3934878513 learned_addr learned my addr 172.21.15.59:0/3934878513 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad79e00640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8415da90 0x7fad84142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad83200640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad841559f0 0x7fad840b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.233 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad82800640 1 -- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad841559f0 msgr2=0x7fad840b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad82800640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad841559f0 0x7fad840b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad82800640 1 -- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8415da90 msgr2=0x7fad84142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad82800640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8415da90 0x7fad84142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad82800640 1 -- 172.21.15.59:0/3934878513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8415add0 con 0x7fad840ca520 2024-04-25T09:12:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad79e00640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8415da90 0x7fad84142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad82800640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad840ca520 0x7fad8415be70 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fad7401a480 tx=0x7fad740195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad7b400640 1 -- 172.21.15.59:0/3934878513 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740bd020 con 0x7fad840ca520 2024-04-25T09:12:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad7b400640 1 -- 172.21.15.59:0/3934878513 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad740b8470 con 0x7fad840ca520 2024-04-25T09:12:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad7b400640 1 -- 172.21.15.59:0/3934878513 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad740b2040 con 0x7fad840ca520 2024-04-25T09:12:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad88a00640 1 -- 172.21.15.59:0/3934878513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad8415b0b0 con 0x7fad840ca520 2024-04-25T09:12:08.234 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.242+0000 7fad88a00640 1 -- 172.21.15.59:0/3934878513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad8415b670 con 0x7fad840ca520 2024-04-25T09:12:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.246+0000 7fad88a00640 1 -- 172.21.15.59:0/3934878513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad840745d0 con 0x7fad840ca520 2024-04-25T09:12:08.235 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.246+0000 7fad7b400640 1 -- 172.21.15.59:0/3934878513 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fad740c0020 con 0x7fad840ca520 2024-04-25T09:12:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.246+0000 7fad7b400640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad60066f60 0x7fad60069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.246+0000 7fad7b400640 1 -- 172.21.15.59:0/3934878513 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fad7411fe10 con 0x7fad840ca520 2024-04-25T09:12:08.236 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.246+0000 7fad79e00640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad60066f60 0x7fad60069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.237 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.246+0000 7fad79e00640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad60066f60 0x7fad60069420 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fad8415a9f0 tx=0x7fad6c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.240 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.250+0000 7fad7b400640 1 -- 172.21.15.59:0/3934878513 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fad740c7030 con 0x7fad840ca520 2024-04-25T09:12:08.404 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.414+0000 7fad88a00640 1 -- 172.21.15.59:0/3934878513 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fad8415c3b0 con 0x7fad60066f60 2024-04-25T09:12:08.405 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.414+0000 7fad7b400640 1 -- 172.21.15.59:0/3934878513 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fad8415c3b0 con 0x7fad60066f60 2024-04-25T09:12:08.405 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T09:12:08.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.418+0000 7fad88a00640 1 -- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad60066f60 msgr2=0x7fad60069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.418+0000 7fad88a00640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad60066f60 0x7fad60069420 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fad8415a9f0 tx=0x7fad6c008040 comp rx=0 tx=0).stop 2024-04-25T09:12:08.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.418+0000 7fad88a00640 1 -- 172.21.15.59:0/3934878513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad840ca520 msgr2=0x7fad8415be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.418+0000 7fad88a00640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad840ca520 0x7fad8415be70 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fad7401a480 tx=0x7fad740195f0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.418+0000 7fad88a00640 1 -- 172.21.15.59:0/3934878513 shutdown_connections 2024-04-25T09:12:08.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.418+0000 7fad88a00640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fad60066f60 0x7fad60069420 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.418+0000 7fad88a00640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fad841559f0 0x7fad840b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.418+0000 7fad88a00640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fad8415da90 0x7fad84142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.418+0000 7fad88a00640 1 --2- 172.21.15.59:0/3934878513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad840ca520 0x7fad8415be70 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.418+0000 7fad88a00640 1 -- 172.21.15.59:0/3934878513 >> 172.21.15.59:0/3934878513 conn(0x7fad84099a60 msgr2=0x7fad840af640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.407 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.418+0000 7fad88a00640 1 -- 172.21.15.59:0/3934878513 shutdown_connections 2024-04-25T09:12:08.408 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.418+0000 7fad88a00640 1 -- 172.21.15.59:0/3934878513 wait complete. 2024-04-25T09:12:08.425 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T09:12:08.426 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:12:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a53200640 1 Processor -- start 2024-04-25T09:12:08.570 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a53200640 1 -- start start 2024-04-25T09:12:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a53200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a4c15eda0 0x7f1a4c070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a53200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f1a4c06f3f0 0x7f1a4c06f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a53200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c070200 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a53200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c0714d0 con 0x7f1a4c15eda0 2024-04-25T09:12:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a53200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c0711f0 con 0x7f1a4c06f3f0 2024-04-25T09:12:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a51e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1a4c15eda0 0x7f1a4c070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.571 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a52800640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f1a4c06fdb0 0x7f1a4c15f4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36988/0 (socket says 172.21.15.59:36988) 2024-04-25T09:12:08.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a52800640 1 -- 172.21.15.59:0/2753646300 learned_addr learned my addr 172.21.15.59:0/2753646300 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:08.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a51400640 1 --2- 172.21.15.59:0/2753646300 >> v2:172.21.15.178:3300/0 conn(0x7f1a4c06f3f0 0x7f1a4c06f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a51e00640 1 -- 172.21.15.59:0/2753646300 >> v2:172.21.15.178:3300/0 conn(0x7f1a4c06f3f0 msgr2=0x7f1a4c06f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:08.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a51e00640 1 --2- 172.21.15.59:0/2753646300 >> v2:172.21.15.178:3300/0 conn(0x7f1a4c06f3f0 0x7f1a4c06f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a51e00640 1 -- 172.21.15.59:0/2753646300 >> v1:172.21.15.59:6789/0 conn(0x7f1a4c06fdb0 legacy=0x7f1a4c15f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.572 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a51e00640 1 -- 172.21.15.59:0/2753646300 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c0cf320 con 0x7f1a4c15eda0 2024-04-25T09:12:08.573 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.582+0000 7f1a50a00640 1 -- 172.21.15.59:0/2753646300 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2542513432 0 0) 0x7f1a4c070200 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a51e00640 1 --2- 172.21.15.59:0/2753646300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4c15eda0 0x7f1a4c070590 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c068960 tx=0x7f1a4001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10f2fbd53d43607 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a50a00640 1 -- 172.21.15.59:0/2753646300 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a400b0070 con 0x7f1a4c15eda0 2024-04-25T09:12:08.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a50a00640 1 -- 172.21.15.59:0/2753646300 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a40004230 con 0x7f1a4c15eda0 2024-04-25T09:12:08.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a50a00640 1 -- 172.21.15.59:0/2753646300 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c1603e0 con 0x7f1a4c15eda0 2024-04-25T09:12:08.575 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a53200640 1 -- 172.21.15.59:0/2753646300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4c15eda0 msgr2=0x7f1a4c070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a53200640 1 --2- 172.21.15.59:0/2753646300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4c15eda0 0x7f1a4c070590 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c068960 tx=0x7f1a4001c480 comp rx=0 tx=0).stop 2024-04-25T09:12:08.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a53200640 1 -- 172.21.15.59:0/2753646300 shutdown_connections 2024-04-25T09:12:08.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a53200640 1 --2- 172.21.15.59:0/2753646300 >> v2:172.21.15.178:3300/0 conn(0x7f1a4c06f3f0 0x7f1a4c06f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a53200640 1 --2- 172.21.15.59:0/2753646300 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4c15eda0 0x7f1a4c070590 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a53200640 1 -- 172.21.15.59:0/2753646300 >> 172.21.15.59:0/2753646300 conn(0x7f1a4c0d15b0 msgr2=0x7f1a4c0d19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a53200640 1 -- 172.21.15.59:0/2753646300 shutdown_connections 2024-04-25T09:12:08.576 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a53200640 1 -- 172.21.15.59:0/2753646300 wait complete. 2024-04-25T09:12:08.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.586+0000 7f1a53200640 1 Processor -- start 2024-04-25T09:12:08.577 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a53200640 1 -- start start 2024-04-25T09:12:08.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a53200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a4c06f3f0 0x7f1a4c154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.579 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a53200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4c06fdb0 0x7f1a4c1f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a53200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a4c15eda0 0x7f1a4c06bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a53200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c099be0 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a53200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c099a60 con 0x7f1a4c06f3f0 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a53200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c168800 con 0x7f1a4c15eda0 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a51400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4c06fdb0 0x7f1a4c1f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a51400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4c06fdb0 0x7f1a4c1f67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36988/0 (socket says 172.21.15.59:36988) 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a51400640 1 -- 172.21.15.59:0/712686884 learned_addr learned my addr 172.21.15.59:0/712686884 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a51e00640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a4c06f3f0 0x7f1a4c154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a52800640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a4c15eda0 0x7f1a4c06bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a51400640 1 -- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a4c15eda0 msgr2=0x7f1a4c06bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a51400640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a4c15eda0 0x7f1a4c06bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a51400640 1 -- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a4c06f3f0 msgr2=0x7f1a4c154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.580 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a51400640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a4c06f3f0 0x7f1a4c154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a51400640 1 -- 172.21.15.59:0/712686884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c0c93b0 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a52800640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f1a4c15eda0 0x7f1a4c06bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:08.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a51e00640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f1a4c06f3f0 0x7f1a4c154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:08.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a51400640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4c06fdb0 0x7f1a4c1f67d0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00d5f0 tx=0x7f1a3c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a46000640 1 -- 172.21.15.59:0/712686884 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0125f0 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a46000640 1 -- 172.21.15.59:0/712686884 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c019070 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a53200640 1 -- 172.21.15.59:0/712686884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c0c9690 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a46000640 1 -- 172.21.15.59:0/712686884 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0129b0 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.581 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a53200640 1 -- 172.21.15.59:0/712686884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c0c9c50 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.590+0000 7f1a53200640 1 -- 172.21.15.59:0/712686884 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1a4c0745d0 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.582 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.594+0000 7f1a46000640 1 -- 172.21.15.59:0/712686884 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1a3c012b50 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.594+0000 7f1a46000640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a30066f60 0x7f1a30069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.594+0000 7f1a46000640 1 -- 172.21.15.59:0/712686884 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f1a3c085320 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.594+0000 7f1a46000640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x7f1a3006d540 0x7f1a3006f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.594+0000 7f1a46000640 1 -- 172.21.15.59:0/712686884 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1a3c00fe50 con 0x7f1a3006d540 2024-04-25T09:12:08.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.594+0000 7f1a46000640 1 -- 172.21.15.59:0/712686884 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a3c08c050 con 0x7f1a4c06fdb0 2024-04-25T09:12:08.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.594+0000 7f1a51e00640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a30066f60 0x7f1a30069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.583 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.594+0000 7f1a52800640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x7f1a3006d540 0x7f1a3006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.594+0000 7f1a51e00640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a30066f60 0x7f1a30069420 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1a400ad000 tx=0x7f1a40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.594+0000 7f1a52800640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x7f1a3006d540 0x7f1a3006f980 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.584 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.594+0000 7f1a46000640 1 -- 172.21.15.59:0/712686884 <== osd.6 v2:172.21.15.178:6800/2032393933 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f1a3c00fe50 con 0x7f1a3006d540 2024-04-25T09:12:08.597 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a53200640 1 -- 172.21.15.59:0/712686884 --> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1a4c0ca090 con 0x7f1a3006d540 2024-04-25T09:12:08.598 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a46000640 1 -- 172.21.15.59:0/712686884 <== osd.6 v2:172.21.15.178:6800/2032393933 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1a4c0ca090 con 0x7f1a3006d540 2024-04-25T09:12:08.599 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:12:08.599 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:12:08.599 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:12:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a53200640 1 -- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x7f1a3006d540 msgr2=0x7f1a3006f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a53200640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:6800/2032393933,v1:172.21.15.178:6801/2032393933] conn(0x7f1a3006d540 0x7f1a3006f980 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a53200640 1 -- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a30066f60 msgr2=0x7f1a30069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a53200640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f1a30066f60 0x7f1a30069420 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f1a400ad000 tx=0x7f1a40008040 comp rx=0 tx=0).stop 2024-04-25T09:12:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a53200640 1 -- 172.21.15.59:0/712686884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4c06fdb0 msgr2=0x7f1a4c1f67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a53200640 1 --2- 172.21.15.59:0/712686884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a4c06fdb0 0x7f1a4c1f67d0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00d5f0 tx=0x7f1a3c00dab0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a52800640 1 -- 172.21.15.59:0/712686884 reap_dead start 2024-04-25T09:12:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a53200640 1 -- 172.21.15.59:0/712686884 shutdown_connections 2024-04-25T09:12:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a53200640 1 -- 172.21.15.59:0/712686884 >> 172.21.15.59:0/712686884 conn(0x7f1a4c0d15b0 msgr2=0x7f1a4c0b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.600 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a53200640 1 -- 172.21.15.59:0/712686884 shutdown_connections 2024-04-25T09:12:08.601 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.610+0000 7f1a53200640 1 -- 172.21.15.59:0/712686884 wait complete. 2024-04-25T09:12:08.617 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T09:12:08.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7facab400640 1 Processor -- start 2024-04-25T09:12:08.759 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7facab400640 1 -- start start 2024-04-25T09:12:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7facab400640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7faca415dc60 0x7faca40d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7facab400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faca406bf30 0x7faca40cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7facab400640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca415e040 con 0x7faca4099a60 2024-04-25T09:12:08.760 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7facab400640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca40cff80 con 0x7faca406bf30 2024-04-25T09:12:08.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7facab400640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca40d0260 con 0x7faca415dc60 2024-04-25T09:12:08.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7faca3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faca406bf30 0x7faca40cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7faca3e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faca406bf30 0x7faca40cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:36996/0 (socket says 172.21.15.59:36996) 2024-04-25T09:12:08.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7faca3e00640 1 -- 172.21.15.59:0/2754227452 learned_addr learned my addr 172.21.15.59:0/2754227452 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:08.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7faca8a00640 1 --2- 172.21.15.59:0/2754227452 >> v2:172.21.15.178:3300/0 conn(0x7faca415dc60 0x7faca40d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.761 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7faca3e00640 1 -- 172.21.15.59:0/2754227452 >> v2:172.21.15.178:3300/0 conn(0x7faca415dc60 msgr2=0x7faca40d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7faca3e00640 1 --2- 172.21.15.59:0/2754227452 >> v2:172.21.15.178:3300/0 conn(0x7faca415dc60 0x7faca40d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7faca3e00640 1 -- 172.21.15.59:0/2754227452 >> v1:172.21.15.178:6789/0 conn(0x7faca4099a60 legacy=0x7faca40cbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.762 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.770+0000 7faca3e00640 1 -- 172.21.15.59:0/2754227452 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40d0540 con 0x7faca406bf30 2024-04-25T09:12:08.764 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.774+0000 7faca3e00640 1 --2- 172.21.15.59:0/2754227452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca406bf30 0x7faca40cf8a0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7faca409a6b0 tx=0x7fac9001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31c67ca2f5512e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.774+0000 7faca3400640 1 -- 172.21.15.59:0/2754227452 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac900ab660 con 0x7faca406bf30 2024-04-25T09:12:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.774+0000 7faca3400640 1 -- 172.21.15.59:0/2754227452 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac900b0070 con 0x7faca406bf30 2024-04-25T09:12:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.774+0000 7faca3400640 1 -- 172.21.15.59:0/2754227452 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac900aba20 con 0x7faca406bf30 2024-04-25T09:12:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.774+0000 7facab400640 1 -- 172.21.15.59:0/2754227452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca406bf30 msgr2=0x7faca40cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.774+0000 7facab400640 1 --2- 172.21.15.59:0/2754227452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca406bf30 0x7faca40cf8a0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7faca409a6b0 tx=0x7fac9001c460 comp rx=0 tx=0).stop 2024-04-25T09:12:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.774+0000 7facab400640 1 -- 172.21.15.59:0/2754227452 shutdown_connections 2024-04-25T09:12:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.774+0000 7facab400640 1 --2- 172.21.15.59:0/2754227452 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca406bf30 0x7faca40cf8a0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.774+0000 7facab400640 1 --2- 172.21.15.59:0/2754227452 >> v2:172.21.15.178:3300/0 conn(0x7faca415dc60 0x7faca40d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.774+0000 7facab400640 1 -- 172.21.15.59:0/2754227452 >> 172.21.15.59:0/2754227452 conn(0x7faca40b3200 msgr2=0x7faca40b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.774+0000 7facab400640 1 -- 172.21.15.59:0/2754227452 shutdown_connections 2024-04-25T09:12:08.765 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.774+0000 7facab400640 1 -- 172.21.15.59:0/2754227452 wait complete. 2024-04-25T09:12:08.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7facab400640 1 Processor -- start 2024-04-25T09:12:08.766 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7facab400640 1 -- start start 2024-04-25T09:12:08.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7facab400640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faca406bf30 0x7faca414c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7facab400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4099a60 0x7faca40c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7facab400640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faca415dc60 0x7faca41551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7facab400640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca409a280 con 0x7faca4099a60 2024-04-25T09:12:08.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7facab400640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca40cc880 con 0x7faca406bf30 2024-04-25T09:12:08.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7facab400640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca40cb100 con 0x7faca415dc60 2024-04-25T09:12:08.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4099a60 0x7faca40c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca3e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4099a60 0x7faca40c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37012/0 (socket says 172.21.15.59:37012) 2024-04-25T09:12:08.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca3e00640 1 -- 172.21.15.59:0/2803772175 learned_addr learned my addr 172.21.15.59:0/2803772175 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:08.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca8a00640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faca406bf30 0x7faca414c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.769 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca9400640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faca415dc60 0x7faca41551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca3e00640 1 -- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faca415dc60 msgr2=0x7faca41551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca3e00640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faca415dc60 0x7faca41551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca3e00640 1 -- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faca406bf30 msgr2=0x7faca414c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca3e00640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faca406bf30 0x7faca414c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca3e00640 1 -- 172.21.15.59:0/2803772175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40ca580 con 0x7faca4099a60 2024-04-25T09:12:08.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca3e00640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4099a60 0x7faca40c9ac0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fac90019070 tx=0x7fac9001aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca0c00640 1 -- 172.21.15.59:0/2803772175 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac900be5f0 con 0x7faca4099a60 2024-04-25T09:12:08.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca0c00640 1 -- 172.21.15.59:0/2803772175 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac900be790 con 0x7faca4099a60 2024-04-25T09:12:08.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7faca0c00640 1 -- 172.21.15.59:0/2803772175 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac900beb40 con 0x7faca4099a60 2024-04-25T09:12:08.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7facab400640 1 -- 172.21.15.59:0/2803772175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca40ca860 con 0x7faca4099a60 2024-04-25T09:12:08.770 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.778+0000 7facab400640 1 -- 172.21.15.59:0/2803772175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca40cae20 con 0x7faca4099a60 2024-04-25T09:12:08.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.782+0000 7facab400640 1 -- 172.21.15.59:0/2803772175 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca40745d0 con 0x7faca4099a60 2024-04-25T09:12:08.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.782+0000 7faca0c00640 1 -- 172.21.15.59:0/2803772175 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fac900b43f0 con 0x7faca4099a60 2024-04-25T09:12:08.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.782+0000 7faca0c00640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fac84066f60 0x7fac84069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:08.771 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.782+0000 7faca0c00640 1 -- 172.21.15.59:0/2803772175 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fac9011fa50 con 0x7faca4099a60 2024-04-25T09:12:08.772 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.782+0000 7faca8a00640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fac84066f60 0x7fac84069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:08.773 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.782+0000 7faca8a00640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fac84066f60 0x7fac84069420 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7faca41fa710 tx=0x7fac98009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:08.776 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.786+0000 7faca0c00640 1 -- 172.21.15.59:0/2803772175 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fac90016110 con 0x7faca4099a60 2024-04-25T09:12:08.939 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.950+0000 7facab400640 1 -- 172.21.15.59:0/2803772175 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7faca40b7590 con 0x7fac84066f60 2024-04-25T09:12:08.940 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.950+0000 7faca0c00640 1 -- 172.21.15.59:0/2803772175 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faca40b7590 con 0x7fac84066f60 2024-04-25T09:12:08.940 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T09:12:08.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.954+0000 7facab400640 1 -- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fac84066f60 msgr2=0x7fac84069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.954+0000 7facab400640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fac84066f60 0x7fac84069420 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7faca41fa710 tx=0x7fac98009190 comp rx=0 tx=0).stop 2024-04-25T09:12:08.942 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.954+0000 7facab400640 1 -- 172.21.15.59:0/2803772175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4099a60 msgr2=0x7faca40c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.954+0000 7facab400640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4099a60 0x7faca40c9ac0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fac90019070 tx=0x7fac9001aca0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.954+0000 7facab400640 1 -- 172.21.15.59:0/2803772175 shutdown_connections 2024-04-25T09:12:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.954+0000 7facab400640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fac84066f60 0x7fac84069420 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.954+0000 7facab400640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7faca415dc60 0x7faca41551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.954+0000 7facab400640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca4099a60 0x7faca40c9ac0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.954+0000 7facab400640 1 --2- 172.21.15.59:0/2803772175 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7faca406bf30 0x7faca414c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.954+0000 7facab400640 1 -- 172.21.15.59:0/2803772175 >> 172.21.15.59:0/2803772175 conn(0x7faca40b3200 msgr2=0x7faca41569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.954+0000 7facab400640 1 -- 172.21.15.59:0/2803772175 shutdown_connections 2024-04-25T09:12:08.943 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:08.954+0000 7facab400640 1 -- 172.21.15.59:0/2803772175 wait complete. 2024-04-25T09:12:08.962 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T09:12:08.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T09:12:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc68200640 1 Processor -- start 2024-04-25T09:12:09.106 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc68200640 1 -- start start 2024-04-25T09:12:09.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc68200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc60066b50 0x7efc6006e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc68200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7efc6006e880 0x7efc6006ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc68200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc60067000 con 0x7efc60071b70 2024-04-25T09:12:09.108 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc68200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6006dbd0 con 0x7efc60066b50 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc68200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6006b990 con 0x7efc6006e880 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc64e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc60066b50 0x7efc6006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc64e00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc60066b50 0x7efc6006e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37020/0 (socket says 172.21.15.59:37020) 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc64e00640 1 -- 172.21.15.59:0/3316408617 learned_addr learned my addr 172.21.15.59:0/3316408617 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc66200640 1 --2- 172.21.15.59:0/3316408617 >> v2:172.21.15.178:3300/0 conn(0x7efc6006e880 0x7efc6006ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc64e00640 1 -- 172.21.15.59:0/3316408617 >> v2:172.21.15.178:3300/0 conn(0x7efc6006e880 msgr2=0x7efc6006ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc64e00640 1 --2- 172.21.15.59:0/3316408617 >> v2:172.21.15.178:3300/0 conn(0x7efc6006e880 0x7efc6006ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc64e00640 1 -- 172.21.15.59:0/3316408617 >> v1:172.21.15.178:6789/0 conn(0x7efc60071b70 legacy=0x7efc60071f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:09.109 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.118+0000 7efc64e00640 1 -- 172.21.15.59:0/3316408617 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6006bc70 con 0x7efc60066b50 2024-04-25T09:12:09.111 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.122+0000 7efc64e00640 1 --2- 172.21.15.59:0/3316408617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc60066b50 0x7efc6006e340 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7efc600af8d0 tx=0x7efc4c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc1f3812dac6ca2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.122+0000 7efc5fe00640 1 -- 172.21.15.59:0/3316408617 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c0aa610 con 0x7efc60066b50 2024-04-25T09:12:09.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.122+0000 7efc5fe00640 1 -- 172.21.15.59:0/3316408617 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c0af070 con 0x7efc60066b50 2024-04-25T09:12:09.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.122+0000 7efc5fe00640 1 -- 172.21.15.59:0/3316408617 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c0aa9d0 con 0x7efc60066b50 2024-04-25T09:12:09.112 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.122+0000 7efc68200640 1 -- 172.21.15.59:0/3316408617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc60066b50 msgr2=0x7efc6006e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.122+0000 7efc68200640 1 --2- 172.21.15.59:0/3316408617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc60066b50 0x7efc6006e340 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7efc600af8d0 tx=0x7efc4c01c4b0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.122+0000 7efc68200640 1 -- 172.21.15.59:0/3316408617 shutdown_connections 2024-04-25T09:12:09.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.122+0000 7efc68200640 1 --2- 172.21.15.59:0/3316408617 >> v2:172.21.15.178:3300/0 conn(0x7efc6006e880 0x7efc6006ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.122+0000 7efc68200640 1 --2- 172.21.15.59:0/3316408617 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc60066b50 0x7efc6006e340 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.122+0000 7efc68200640 1 -- 172.21.15.59:0/3316408617 >> 172.21.15.59:0/3316408617 conn(0x7efc600cfd80 msgr2=0x7efc600d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.122+0000 7efc68200640 1 -- 172.21.15.59:0/3316408617 shutdown_connections 2024-04-25T09:12:09.113 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.122+0000 7efc68200640 1 -- 172.21.15.59:0/3316408617 wait complete. 2024-04-25T09:12:09.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc68200640 1 Processor -- start 2024-04-25T09:12:09.114 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc68200640 1 -- start start 2024-04-25T09:12:09.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc68200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc60066b50 0x7efc60140ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc68200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc6006e880 0x7efc60152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc68200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc60071b70 0x7efc60159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc68200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6006b5e0 con 0x7efc6006e880 2024-04-25T09:12:09.116 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc68200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc600b4d00 con 0x7efc60066b50 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc68200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc60140ff0 con 0x7efc60071b70 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc64e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc6006e880 0x7efc60152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc64e00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc6006e880 0x7efc60152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37022/0 (socket says 172.21.15.59:37022) 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc64e00640 1 -- 172.21.15.59:0/3293868351 learned_addr learned my addr 172.21.15.59:0/3293868351 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc65800640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc60066b50 0x7efc60140ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc66200640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc60071b70 0x7efc60159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc64e00640 1 -- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc60071b70 msgr2=0x7efc60159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc64e00640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7efc60071b70 0x7efc60159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc64e00640 1 -- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc60066b50 msgr2=0x7efc60140ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc64e00640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7efc60066b50 0x7efc60140ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc64e00640 1 -- 172.21.15.59:0/3293868351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc60158d60 con 0x7efc6006e880 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc64e00640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc6006e880 0x7efc60152e30 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0ac040 tx=0x7efc4c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc5d600640 1 -- 172.21.15.59:0/3293868351 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c0bd5f0 con 0x7efc6006e880 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc5d600640 1 -- 172.21.15.59:0/3293868351 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c0bd790 con 0x7efc6006e880 2024-04-25T09:12:09.117 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc5d600640 1 -- 172.21.15.59:0/3293868351 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c0bdb60 con 0x7efc6006e880 2024-04-25T09:12:09.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc68200640 1 -- 172.21.15.59:0/3293868351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc60159040 con 0x7efc6006e880 2024-04-25T09:12:09.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc68200640 1 -- 172.21.15.59:0/3293868351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc60159600 con 0x7efc6006e880 2024-04-25T09:12:09.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.126+0000 7efc68200640 1 -- 172.21.15.59:0/3293868351 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efc600745d0 con 0x7efc6006e880 2024-04-25T09:12:09.118 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.130+0000 7efc5d600640 1 -- 172.21.15.59:0/3293868351 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7efc4c0b33f0 con 0x7efc6006e880 2024-04-25T09:12:09.119 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.130+0000 7efc5d600640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efc40066f60 0x7efc40069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.130+0000 7efc5d600640 1 -- 172.21.15.59:0/3293868351 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7efc4c11f910 con 0x7efc6006e880 2024-04-25T09:12:09.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.130+0000 7efc5d600640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x7efc4006d540 0x7efc4006f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.130+0000 7efc5d600640 1 -- 172.21.15.59:0/3293868351 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efc4c0b8e50 con 0x7efc4006d540 2024-04-25T09:12:09.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.130+0000 7efc5d600640 1 -- 172.21.15.59:0/3293868351 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=126) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc4c1242a0 con 0x7efc6006e880 2024-04-25T09:12:09.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.130+0000 7efc65800640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efc40066f60 0x7efc40069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.130+0000 7efc66200640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x7efc4006d540 0x7efc4006f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.130+0000 7efc65800640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efc40066f60 0x7efc40069420 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efc5400b810 tx=0x7efc54008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.120 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.130+0000 7efc66200640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x7efc4006d540 0x7efc4006f980 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.121 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.134+0000 7efc5d600640 1 -- 172.21.15.59:0/3293868351 <== osd.7 v2:172.21.15.178:6824/965369534 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7efc4c0b8e50 con 0x7efc4006d540 2024-04-25T09:12:09.134 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc68200640 1 -- 172.21.15.59:0/3293868351 --> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efc60072950 con 0x7efc4006d540 2024-04-25T09:12:09.135 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc5d600640 1 -- 172.21.15.59:0/3293868351 <== osd.7 v2:172.21.15.178:6824/965369534 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efc60072950 con 0x7efc4006d540 2024-04-25T09:12:09.135 INFO:teuthology.orchestra.run.smithi059.stdout:{ 2024-04-25T09:12:09.135 INFO:teuthology.orchestra.run.smithi059.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T09:12:09.135 INFO:teuthology.orchestra.run.smithi059.stdout:} 2024-04-25T09:12:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc68200640 1 -- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x7efc4006d540 msgr2=0x7efc4006f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc68200640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:6824/965369534,v1:172.21.15.178:6825/965369534] conn(0x7efc4006d540 0x7efc4006f980 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc68200640 1 -- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efc40066f60 msgr2=0x7efc40069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.136 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc68200640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7efc40066f60 0x7efc40069420 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7efc5400b810 tx=0x7efc54008040 comp rx=0 tx=0).stop 2024-04-25T09:12:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc68200640 1 -- 172.21.15.59:0/3293868351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc6006e880 msgr2=0x7efc60152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc68200640 1 --2- 172.21.15.59:0/3293868351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc6006e880 0x7efc60152e30 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7efc4c0ac040 tx=0x7efc4c01acf0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc66200640 1 -- 172.21.15.59:0/3293868351 reap_dead start 2024-04-25T09:12:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc68200640 1 -- 172.21.15.59:0/3293868351 shutdown_connections 2024-04-25T09:12:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc68200640 1 -- 172.21.15.59:0/3293868351 >> 172.21.15.59:0/3293868351 conn(0x7efc600cfd80 msgr2=0x7efc600b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc68200640 1 -- 172.21.15.59:0/3293868351 shutdown_connections 2024-04-25T09:12:09.137 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.146+0000 7efc68200640 1 -- 172.21.15.59:0/3293868351 wait complete. 2024-04-25T09:12:09.154 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T09:12:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f8153200640 1 Processor -- start 2024-04-25T09:12:09.295 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f8153200640 1 -- start start 2024-04-25T09:12:09.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f8153200640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f814c159320 0x7f814c15c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f8153200640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f814c06e4a0 0x7f814c06e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.296 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f8153200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f814c15fc00 con 0x7f814c15f440 2024-04-25T09:12:09.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f8153200640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814c06d640 con 0x7f814c159320 2024-04-25T09:12:09.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f8153200640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f814c06ee10 con 0x7f814c06e4a0 2024-04-25T09:12:09.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f814be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f814c159320 0x7f814c15c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f814be00640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f814c159320 0x7f814c15c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37032/0 (socket says 172.21.15.59:37032) 2024-04-25T09:12:09.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f814be00640 1 -- 172.21.15.59:0/3477360293 learned_addr learned my addr 172.21.15.59:0/3477360293 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:09.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f8151200640 1 --2- 172.21.15.59:0/3477360293 >> v2:172.21.15.178:3300/0 conn(0x7f814c06e4a0 0x7f814c06e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.297 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f814be00640 1 -- 172.21.15.59:0/3477360293 >> v2:172.21.15.178:3300/0 conn(0x7f814c06e4a0 msgr2=0x7f814c06e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:09.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f814be00640 1 --2- 172.21.15.59:0/3477360293 >> v2:172.21.15.178:3300/0 conn(0x7f814c06e4a0 0x7f814c06e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f814be00640 1 -- 172.21.15.59:0/3477360293 >> v1:172.21.15.178:6789/0 conn(0x7f814c15f440 legacy=0x7f814c06dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.298 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.306+0000 7f814be00640 1 -- 172.21.15.59:0/3477360293 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c15fee0 con 0x7f814c159320 2024-04-25T09:12:09.300 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.310+0000 7f814be00640 1 --2- 172.21.15.59:0/3477360293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c159320 0x7f814c15c9b0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f814c072630 tx=0x7f813c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a30d88240e967ad9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.310+0000 7f814b400640 1 -- 172.21.15.59:0/3477360293 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c0ab660 con 0x7f814c159320 2024-04-25T09:12:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.310+0000 7f814b400640 1 -- 172.21.15.59:0/3477360293 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c0b0070 con 0x7f814c159320 2024-04-25T09:12:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.310+0000 7f814b400640 1 -- 172.21.15.59:0/3477360293 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c0aba20 con 0x7f814c159320 2024-04-25T09:12:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.310+0000 7f8153200640 1 -- 172.21.15.59:0/3477360293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c159320 msgr2=0x7f814c15c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.310+0000 7f8153200640 1 --2- 172.21.15.59:0/3477360293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c159320 0x7f814c15c9b0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f814c072630 tx=0x7f813c01c460 comp rx=0 tx=0).stop 2024-04-25T09:12:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.310+0000 7f8153200640 1 -- 172.21.15.59:0/3477360293 shutdown_connections 2024-04-25T09:12:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.310+0000 7f8153200640 1 --2- 172.21.15.59:0/3477360293 >> v2:172.21.15.178:3300/0 conn(0x7f814c06e4a0 0x7f814c06e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.310+0000 7f8153200640 1 --2- 172.21.15.59:0/3477360293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c159320 0x7f814c15c9b0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.310+0000 7f8153200640 1 -- 172.21.15.59:0/3477360293 >> 172.21.15.59:0/3477360293 conn(0x7f814c067080 msgr2=0x7f814c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.310+0000 7f8153200640 1 -- 172.21.15.59:0/3477360293 shutdown_connections 2024-04-25T09:12:09.301 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.310+0000 7f8153200640 1 -- 172.21.15.59:0/3477360293 wait complete. 2024-04-25T09:12:09.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8153200640 1 Processor -- start 2024-04-25T09:12:09.302 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8153200640 1 -- start start 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8153200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c06e4a0 0x7f814c136fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8153200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f814c159320 0x7f814c13d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8153200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f814c15f440 0x7f814c13fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8153200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c15f820 con 0x7f814c06e4a0 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8153200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f814c159700 con 0x7f814c15f440 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8153200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f814c15f9a0 con 0x7f814c159320 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f814be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c06e4a0 0x7f814c136fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f814be00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c06e4a0 0x7f814c136fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37048/0 (socket says 172.21.15.59:37048) 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f814be00640 1 -- 172.21.15.59:0/673588710 learned_addr learned my addr 172.21.15.59:0/673588710 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8143e00640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f814c159320 0x7f814c13d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8151200640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f814c15f440 0x7f814c13fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f814be00640 1 -- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f814c159320 msgr2=0x7f814c13d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f814be00640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f814c159320 0x7f814c13d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f814be00640 1 -- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f814c15f440 msgr2=0x7f814c13fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.305 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f814be00640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f814c15f440 0x7f814c13fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f814be00640 1 -- 172.21.15.59:0/673588710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f814c13ea70 con 0x7f814c06e4a0 2024-04-25T09:12:09.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8151200640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f814c15f440 0x7f814c13fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:09.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8143e00640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f814c159320 0x7f814c13d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:09.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f814be00640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c06e4a0 0x7f814c136fc0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f813c01a090 tx=0x7f813c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8148c00640 1 -- 172.21.15.59:0/673588710 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c0be5f0 con 0x7f814c06e4a0 2024-04-25T09:12:09.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8148c00640 1 -- 172.21.15.59:0/673588710 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f813c0be790 con 0x7f814c06e4a0 2024-04-25T09:12:09.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8153200640 1 -- 172.21.15.59:0/673588710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f814c13ed50 con 0x7f814c06e4a0 2024-04-25T09:12:09.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8148c00640 1 -- 172.21.15.59:0/673588710 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f813c0beb60 con 0x7f814c06e4a0 2024-04-25T09:12:09.306 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.314+0000 7f8153200640 1 -- 172.21.15.59:0/673588710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f814c13f310 con 0x7f814c06e4a0 2024-04-25T09:12:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.318+0000 7f8153200640 1 -- 172.21.15.59:0/673588710 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814c0745d0 con 0x7f814c06e4a0 2024-04-25T09:12:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.318+0000 7f8148c00640 1 -- 172.21.15.59:0/673588710 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f813c0b43f0 con 0x7f814c06e4a0 2024-04-25T09:12:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.318+0000 7f8148c00640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8128066f60 0x7f8128069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.307 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.318+0000 7f8148c00640 1 -- 172.21.15.59:0/673588710 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f813c11f5e0 con 0x7f814c06e4a0 2024-04-25T09:12:09.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.318+0000 7f8143e00640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8128066f60 0x7f8128069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.308 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.318+0000 7f8143e00640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8128066f60 0x7f8128069420 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f814c13e130 tx=0x7f8134009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.311 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.322+0000 7f8148c00640 1 -- 172.21.15.59:0/673588710 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f813c0c4060 con 0x7f814c06e4a0 2024-04-25T09:12:09.474 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.486+0000 7f8153200640 1 -- 172.21.15.59:0/673588710 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f814c137500 con 0x7f8128066f60 2024-04-25T09:12:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.486+0000 7f8148c00640 1 -- 172.21.15.59:0/673588710 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f814c137500 con 0x7f8128066f60 2024-04-25T09:12:09.475 INFO:teuthology.orchestra.run.smithi059.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T09:12:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.486+0000 7f8153200640 1 -- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8128066f60 msgr2=0x7f8128069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.477 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.486+0000 7f8153200640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8128066f60 0x7f8128069420 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f814c13e130 tx=0x7f8134009040 comp rx=0 tx=0).stop 2024-04-25T09:12:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.486+0000 7f8153200640 1 -- 172.21.15.59:0/673588710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c06e4a0 msgr2=0x7f814c136fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.486+0000 7f8153200640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c06e4a0 0x7f814c136fc0 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f813c01a090 tx=0x7f813c01aca0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.486+0000 7f8153200640 1 -- 172.21.15.59:0/673588710 shutdown_connections 2024-04-25T09:12:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.486+0000 7f8153200640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f8128066f60 0x7f8128069420 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.486+0000 7f8153200640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f814c15f440 0x7f814c13fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.486+0000 7f8153200640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f814c159320 0x7f814c13d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.486+0000 7f8153200640 1 --2- 172.21.15.59:0/673588710 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f814c06e4a0 0x7f814c136fc0 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.490+0000 7f8153200640 1 -- 172.21.15.59:0/673588710 >> 172.21.15.59:0/673588710 conn(0x7f814c067080 msgr2=0x7f814c165d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.490+0000 7f8153200640 1 -- 172.21.15.59:0/673588710 shutdown_connections 2024-04-25T09:12:09.478 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.490+0000 7f8153200640 1 -- 172.21.15.59:0/673588710 wait complete. 2024-04-25T09:12:09.497 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f1914c00640 1 Processor -- start 2024-04-25T09:12:09.639 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f1914c00640 1 -- start start 2024-04-25T09:12:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f1914c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f19100d11b0 0x7f19100afe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f1914c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19100b4210 0x7f19100b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.640 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f1914c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f191015ddf0 con 0x7f191015da10 2024-04-25T09:12:09.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f1914c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19100b4ba0 con 0x7f19100d11b0 2024-04-25T09:12:09.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f1914c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f191006b480 con 0x7f19100b4210 2024-04-25T09:12:09.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f190de00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f191015da10 0x7f191006ac10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:36990/0 (socket says 172.21.15.59:36990) 2024-04-25T09:12:09.641 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f190de00640 1 -- 172.21.15.59:0/4099084480 learned_addr learned my addr 172.21.15.59:0/4099084480 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:09.642 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f1907e00640 1 --2- 172.21.15.59:0/4099084480 >> v2:172.21.15.178:3300/0 conn(0x7f19100d11b0 0x7f19100afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f190e800640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19100b4210 0x7f19100b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434480084 0 0) 0x7f191015ddf0 con 0x7f191015da10 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.650+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18f4003530 con 0x7f191015da10 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2208684487 0 0) 0x7f18f4003530 con 0x7f191015da10 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19100b4210 msgr2=0x7f19100b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19100b4210 0x7f19100b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 >> v2:172.21.15.178:3300/0 conn(0x7f19100d11b0 msgr2=0x7f19100afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 --2- 172.21.15.59:0/4099084480 >> v2:172.21.15.178:3300/0 conn(0x7f19100d11b0 0x7f19100afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19100d06d0 con 0x7f191015da10 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f1900001680 con 0x7f191015da10 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 >> v1:172.21.15.59:6789/0 conn(0x7f191015da10 legacy=0x7f191006ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f40039c0 0x7f18f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19100b4210 0x7f18f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.643 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18f4004d50 0x7f18f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19100b4ba0 con 0x7f18f40039c0 2024-04-25T09:12:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f191006b480 con 0x7f18f4004d50 2024-04-25T09:12:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18f400b9d0 con 0x7f19100b4210 2024-04-25T09:12:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190de00640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f40039c0 0x7f18f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f1907e00640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19100b4210 0x7f18f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190e800640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18f4004d50 0x7f18f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190de00640 1 -- 172.21.15.59:0/4099084480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19100b4210 msgr2=0x7f18f4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190de00640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f19100b4210 0x7f18f4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190de00640 1 -- 172.21.15.59:0/4099084480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18f4004d50 msgr2=0x7f18f40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190de00640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18f4004d50 0x7f18f40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190de00640 1 -- 172.21.15.59:0/4099084480 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18f4003530 con 0x7f18f40039c0 2024-04-25T09:12:09.644 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190e800640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f18f4004d50 0x7f18f40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T09:12:09.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.654+0000 7f190de00640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f40039c0 0x7f18f4003de0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f190000c2c0 tx=0x7f190001cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d1289fa243fe4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900007d60 con 0x7f18f40039c0 2024-04-25T09:12:09.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19000a9020 con 0x7f18f40039c0 2024-04-25T09:12:09.645 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f190d400640 1 -- 172.21.15.59:0/4099084480 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1900005ae0 con 0x7f18f40039c0 2024-04-25T09:12:09.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 -- 172.21.15.59:0/4099084480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f40039c0 msgr2=0x7f18f4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 --2- 172.21.15.59:0/4099084480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f40039c0 0x7f18f4003de0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f190000c2c0 tx=0x7f190001cd40 comp rx=0 tx=0).stop 2024-04-25T09:12:09.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f190e800640 1 -- 172.21.15.59:0/4099084480 reap_dead start 2024-04-25T09:12:09.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 -- 172.21.15.59:0/4099084480 shutdown_connections 2024-04-25T09:12:09.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 -- 172.21.15.59:0/4099084480 >> 172.21.15.59:0/4099084480 conn(0x7f19100b2400 msgr2=0x7f19100b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.646 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 -- 172.21.15.59:0/4099084480 shutdown_connections 2024-04-25T09:12:09.647 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 -- 172.21.15.59:0/4099084480 wait complete. 2024-04-25T09:12:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 Processor -- start 2024-04-25T09:12:09.648 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 -- start start 2024-04-25T09:12:09.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f40039c0 0x7f191014acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.649 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f191014df20 0x7f19100b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19100b1b80 0x7f1910157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1910162190 con 0x7f18f40039c0 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1910162010 con 0x7f19100b1b80 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1914c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1910162310 con 0x7f191014df20 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f190de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f40039c0 0x7f191014acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f190de00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f40039c0 0x7f191014acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:37080/0 (socket says 172.21.15.59:37080) 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f190de00640 1 -- 172.21.15.59:0/1940040367 learned_addr learned my addr 172.21.15.59:0/1940040367 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f190e800640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19100b1b80 0x7f1910157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.658+0000 7f1907e00640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f191014df20 0x7f19100b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f190de00640 1 -- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f191014df20 msgr2=0x7f19100b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f190de00640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f191014df20 0x7f19100b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f190de00640 1 -- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19100b1b80 msgr2=0x7f1910157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f190de00640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19100b1b80 0x7f1910157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.650 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f190de00640 1 -- 172.21.15.59:0/1940040367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f191014e490 con 0x7f18f40039c0 2024-04-25T09:12:09.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f190de00640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f40039c0 0x7f191014acc0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f19000ab040 tx=0x7f18f4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.651 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f1906000640 1 -- 172.21.15.59:0/1940040367 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000049f0 con 0x7f18f40039c0 2024-04-25T09:12:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f1906000640 1 -- 172.21.15.59:0/1940040367 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1900004b90 con 0x7f18f40039c0 2024-04-25T09:12:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f1906000640 1 -- 172.21.15.59:0/1940040367 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19000070d0 con 0x7f18f40039c0 2024-04-25T09:12:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f1914c00640 1 -- 172.21.15.59:0/1940040367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f191014e770 con 0x7f18f40039c0 2024-04-25T09:12:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f1914c00640 1 -- 172.21.15.59:0/1940040367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19100b0230 con 0x7f18f40039c0 2024-04-25T09:12:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f1914c00640 1 -- 172.21.15.59:0/1940040367 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19100745d0 con 0x7f18f40039c0 2024-04-25T09:12:09.652 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f1906000640 1 -- 172.21.15.59:0/1940040367 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f1900007270 con 0x7f18f40039c0 2024-04-25T09:12:09.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f1906000640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f18ec066f90 0x7f18ec069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:09.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.662+0000 7f1906000640 1 -- 172.21.15.59:0/1940040367 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f190011e5d0 con 0x7f18f40039c0 2024-04-25T09:12:09.653 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.666+0000 7f1907e00640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f18ec066f90 0x7f18ec069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:09.654 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.666+0000 7f1907e00640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f18ec066f90 0x7f18ec069450 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f19100af700 tx=0x7f18f8009190 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:09.657 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.666+0000 7f1906000640 1 -- 172.21.15.59:0/1940040367 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f1900016a50 con 0x7f18f40039c0 2024-04-25T09:12:09.815 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.826+0000 7f1914c00640 1 -- 172.21.15.59:0/1940040367 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f191015eaa0 con 0x7f18ec066f90 2024-04-25T09:12:09.817 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.826+0000 7f1906000640 1 -- 172.21.15.59:0/1940040367 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13353 (secure 0 0 0) 0x7f191015eaa0 con 0x7f18ec066f90 2024-04-25T09:12:09.817 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:12:09.817 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:12:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.830+0000 7f1914c00640 1 -- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f18ec066f90 msgr2=0x7f18ec069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.830+0000 7f1914c00640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f18ec066f90 0x7f18ec069450 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f19100af700 tx=0x7f18f8009190 comp rx=0 tx=0).stop 2024-04-25T09:12:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.830+0000 7f1914c00640 1 -- 172.21.15.59:0/1940040367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f40039c0 msgr2=0x7f191014acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.830+0000 7f1914c00640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f40039c0 0x7f191014acc0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f19000ab040 tx=0x7f18f4005840 comp rx=0 tx=0).stop 2024-04-25T09:12:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.830+0000 7f1914c00640 1 -- 172.21.15.59:0/1940040367 shutdown_connections 2024-04-25T09:12:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.830+0000 7f1914c00640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f18ec066f90 0x7f18ec069450 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.819 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.830+0000 7f1914c00640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f19100b1b80 0x7f1910157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.830+0000 7f1914c00640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f191014df20 0x7f19100b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.830+0000 7f1914c00640 1 --2- 172.21.15.59:0/1940040367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18f40039c0 0x7f191014acc0 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.830+0000 7f1914c00640 1 -- 172.21.15.59:0/1940040367 >> 172.21.15.59:0/1940040367 conn(0x7f19100b2400 msgr2=0x7f191015e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.830+0000 7f1914c00640 1 -- 172.21.15.59:0/1940040367 shutdown_connections 2024-04-25T09:12:09.820 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:09.830+0000 7f1914c00640 1 -- 172.21.15.59:0/1940040367 wait complete. 2024-04-25T09:12:09.839 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":447,"stamp":"2024-04-25T09:12:09.812222+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262940,"kb_used_data":13480,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711780,"statfs":{"total":773094113280,"available":772824862720,"internally_reserved":0,"allocated":13803520,"data_stored":7085384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8388625,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":-32,"num_read_kb":-13,"num_write":-29,"num_write_kb":-8195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.922958"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":370,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-04-25T09:12:01.016170+0000","last_change":"2024-04-25T09:01:17.694072+0000","last_active":"2024-04-25T09:12:01.016170+0000","last_peered":"2024-04-25T09:12:01.016170+0000","last_clean":"2024-04-25T09:12:01.016170+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:12:01.016170+0000","last_undegraded":"2024-04-25T09:12:01.016170+0000","last_fullsized":"2024-04-25T09:12:01.016170+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T09:01:15.707760+0000","last_clean_scrub_stamp":"2024-04-25T09:01:15.707760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33300,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338540,"statfs":{"total":96636764160,"available":96602664960,"internally_reserved":0,"allocated":2170880,"data_stored":1328449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":738081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":738081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":738081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":738081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":738081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":738081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574981,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33304,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338536,"statfs":{"total":96636764160,"available":96602660864,"internally_reserved":0,"allocated":2170880,"data_stored":1328449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:09.843 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T09:01:15.707760+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=1, tm_sec=15, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=9, tm_min=12, tm_sec=4, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T09:12:09.843 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T09:12:23.975 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:23.979 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:29.844 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T09:12:29.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.006+0000 7f7b98c00640 1 Processor -- start 2024-04-25T09:12:29.997 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.006+0000 7f7b98c00640 1 -- start start 2024-04-25T09:12:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b98c00640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f7b9406ead0 0x7f7b941653d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b98c00640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9415ac60 con 0x7f7b940cef30 2024-04-25T09:12:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b98c00640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b940cf3e0 con 0x7f7b94144140 2024-04-25T09:12:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b98c00640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9415af20 con 0x7f7b9406ead0 2024-04-25T09:12:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b8be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f7b940cef30 0x7f7b9406e3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52546/0 (socket says 172.21.15.59:52546) 2024-04-25T09:12:29.998 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b8be00640 1 -- 172.21.15.59:0/4064849770 learned_addr learned my addr 172.21.15.59:0/4064849770 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:30.000 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b92800640 1 --2- 172.21.15.59:0/4064849770 >> v2:172.21.15.178:3300/0 conn(0x7f7b9406ead0 0x7f7b941653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2536273322 0 0) 0x7f7b9415ac60 con 0x7f7b940cef30 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b78003530 con 0x7f7b940cef30 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 <== mon.1 v1:172.21.15.178:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765586411 0 0) 0x7f7b940cf3e0 con 0x7f7b94144140 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 --> v1:172.21.15.178:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b9415ac60 con 0x7f7b94144140 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1221543717 0 0) 0x7f7b78003530 con 0x7f7b940cef30 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 >> v2:172.21.15.178:3300/0 conn(0x7f7b9406ead0 msgr2=0x7f7b941653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 --2- 172.21.15.59:0/4064849770 >> v2:172.21.15.178:3300/0 conn(0x7f7b9406ead0 0x7f7b941653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 >> v1:172.21.15.178:6789/0 conn(0x7f7b94144140 legacy=0x7f7b940ce820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 --> v1:172.21.15.59:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b9415b200 con 0x7f7b940cef30 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 <== mon.0 v1:172.21.15.59:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1328262359 0 0) 0x7f7b7c001680 con 0x7f7b940cef30 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 >> v1:172.21.15.59:6789/0 conn(0x7f7b940cef30 legacy=0x7f7b9406e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 --2- 172.21.15.59:0/4064849770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b78003b80 0x7f7b78003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 --2- 172.21.15.59:0/4064849770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b78004810 0x7f7b78004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.001 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 --2- 172.21.15.59:0/4064849770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b780051d0 0x7f7b7800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9415af20 con 0x7f7b78003b80 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7800c070 con 0x7f7b78004810 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7800c270 con 0x7f7b780051d0 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91e00640 1 --2- 172.21.15.59:0/4064849770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b78003b80 0x7f7b78003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b8be00640 1 --2- 172.21.15.59:0/4064849770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b78004810 0x7f7b78004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b92800640 1 --2- 172.21.15.59:0/4064849770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b780051d0 0x7f7b7800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91e00640 1 -- 172.21.15.59:0/4064849770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b780051d0 msgr2=0x7f7b7800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91e00640 1 --2- 172.21.15.59:0/4064849770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b780051d0 0x7f7b7800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91e00640 1 -- 172.21.15.59:0/4064849770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b78004810 msgr2=0x7f7b78004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91e00640 1 --2- 172.21.15.59:0/4064849770 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b78004810 0x7f7b78004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b91e00640 1 -- 172.21.15.59:0/4064849770 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78003530 con 0x7f7b78003b80 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b92800640 1 --2- 172.21.15.59:0/4064849770 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b780051d0 0x7f7b7800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T09:12:30.002 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.010+0000 7f7b92800640 1 -- 172.21.15.59:0/4064849770 reap_dead start 2024-04-25T09:12:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.014+0000 7f7b91e00640 1 --2- 172.21.15.59:0/4064849770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b78003b80 0x7f7b78003f80 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f7b840018d0 tx=0x7f7b8401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48de9e9c7b854015 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.014+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84001520 con 0x7f7b78003b80 2024-04-25T09:12:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.014+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b840052d0 con 0x7f7b78003b80 2024-04-25T09:12:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.014+0000 7f7b91400640 1 -- 172.21.15.59:0/4064849770 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84003840 con 0x7f7b78003b80 2024-04-25T09:12:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.014+0000 7f7b98c00640 1 -- 172.21.15.59:0/4064849770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b78003b80 msgr2=0x7f7b78003f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.014+0000 7f7b98c00640 1 --2- 172.21.15.59:0/4064849770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b78003b80 0x7f7b78003f80 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f7b840018d0 tx=0x7f7b8401c520 comp rx=0 tx=0).stop 2024-04-25T09:12:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.014+0000 7f7b98c00640 1 -- 172.21.15.59:0/4064849770 shutdown_connections 2024-04-25T09:12:30.004 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.014+0000 7f7b98c00640 1 --2- 172.21.15.59:0/4064849770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b78003b80 0x7f7b78003f80 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.014+0000 7f7b98c00640 1 -- 172.21.15.59:0/4064849770 >> 172.21.15.59:0/4064849770 conn(0x7f7b94066fa0 msgr2=0x7f7b9406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:30.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.014+0000 7f7b98c00640 1 -- 172.21.15.59:0/4064849770 shutdown_connections 2024-04-25T09:12:30.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.014+0000 7f7b98c00640 1 -- 172.21.15.59:0/4064849770 wait complete. 2024-04-25T09:12:30.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b98c00640 1 Processor -- start 2024-04-25T09:12:30.005 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b98c00640 1 -- start start 2024-04-25T09:12:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b98c00640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b78003b80 0x7f7b940c5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b98c00640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b94152450 0x7f7b9413c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b98c00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b9413cba0 0x7f7b941596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b98c00640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940ced70 con 0x7f7b9413cba0 2024-04-25T09:12:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b98c00640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940cebf0 con 0x7f7b78003b80 2024-04-25T09:12:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b98c00640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9415ba00 con 0x7f7b94152450 2024-04-25T09:12:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b92800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b9413cba0 0x7f7b941596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b92800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b9413cba0 0x7f7b941596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33780/0 (socket says 172.21.15.59:33780) 2024-04-25T09:12:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b92800640 1 -- 172.21.15.59:0/2245347816 learned_addr learned my addr 172.21.15.59:0/2245347816 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:30.008 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b91e00640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b78003b80 0x7f7b940c5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b92800640 1 -- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b94152450 msgr2=0x7f7b9413c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b8be00640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b94152450 0x7f7b9413c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b92800640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b94152450 0x7f7b9413c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b92800640 1 -- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b78003b80 msgr2=0x7f7b940c5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b92800640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b78003b80 0x7f7b940c5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b92800640 1 -- 172.21.15.59:0/2245347816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b94153300 con 0x7f7b9413cba0 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b91e00640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b78003b80 0x7f7b940c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b8be00640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b94152450 0x7f7b9413c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b92800640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b9413cba0 0x7f7b941596f0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f7b940cddd0 tx=0x7f7b8c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b8a000640 1 -- 172.21.15.59:0/2245347816 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c01a030 con 0x7f7b9413cba0 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b8a000640 1 -- 172.21.15.59:0/2245347816 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8c010e00 con 0x7f7b9413cba0 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b8a000640 1 -- 172.21.15.59:0/2245347816 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8c003be0 con 0x7f7b9413cba0 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b98c00640 1 -- 172.21.15.59:0/2245347816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b941535e0 con 0x7f7b9413cba0 2024-04-25T09:12:30.009 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b98c00640 1 -- 172.21.15.59:0/2245347816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b9413c8b0 con 0x7f7b9413cba0 2024-04-25T09:12:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.018+0000 7f7b98c00640 1 -- 172.21.15.59:0/2245347816 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b940745d0 con 0x7f7b9413cba0 2024-04-25T09:12:30.010 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.022+0000 7f7b8a000640 1 -- 172.21.15.59:0/2245347816 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f7b8c01d070 con 0x7f7b9413cba0 2024-04-25T09:12:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.022+0000 7f7b8a000640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7b70066f90 0x7f7b70069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.022+0000 7f7b8a000640 1 -- 172.21.15.59:0/2245347816 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f7b8c085700 con 0x7f7b9413cba0 2024-04-25T09:12:30.011 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.022+0000 7f7b91e00640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7b70066f90 0x7f7b70069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.012 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.022+0000 7f7b91e00640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7b70066f90 0x7f7b70069450 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7b840ac000 tx=0x7f7b840a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.015 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.026+0000 7f7b8a000640 1 -- 172.21.15.59:0/2245347816 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f7b8c0567c0 con 0x7f7b9413cba0 2024-04-25T09:12:30.175 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.186+0000 7f7b98c00640 1 -- 172.21.15.59:0/2245347816 --> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b9415a780 con 0x7f7b70066f90 2024-04-25T09:12:30.177 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.186+0000 7f7b8a000640 1 -- 172.21.15.59:0/2245347816 <== mgr.4102 v2:172.21.15.178:6832/226381240 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+13379 (secure 0 0 0) 0x7f7b9415a780 con 0x7f7b70066f90 2024-04-25T09:12:30.177 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:12:30.177 INFO:teuthology.orchestra.run.smithi059.stderr:dumped all 2024-04-25T09:12:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.190+0000 7f7b98c00640 1 -- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7b70066f90 msgr2=0x7f7b70069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.190+0000 7f7b98c00640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7b70066f90 0x7f7b70069450 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7b840ac000 tx=0x7f7b840a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.190+0000 7f7b98c00640 1 -- 172.21.15.59:0/2245347816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b9413cba0 msgr2=0x7f7b941596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.190+0000 7f7b98c00640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b9413cba0 0x7f7b941596f0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f7b940cddd0 tx=0x7f7b8c010590 comp rx=0 tx=0).stop 2024-04-25T09:12:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.190+0000 7f7b98c00640 1 -- 172.21.15.59:0/2245347816 shutdown_connections 2024-04-25T09:12:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.190+0000 7f7b98c00640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f7b70066f90 0x7f7b70069450 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.190+0000 7f7b98c00640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b9413cba0 0x7f7b941596f0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.190+0000 7f7b98c00640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f7b94152450 0x7f7b9413c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.190+0000 7f7b98c00640 1 --2- 172.21.15.59:0/2245347816 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f7b78003b80 0x7f7b940c5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.190+0000 7f7b98c00640 1 -- 172.21.15.59:0/2245347816 >> 172.21.15.59:0/2245347816 conn(0x7f7b94066fa0 msgr2=0x7f7b940b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:30.179 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.190+0000 7f7b98c00640 1 -- 172.21.15.59:0/2245347816 shutdown_connections 2024-04-25T09:12:30.180 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.190+0000 7f7b98c00640 1 -- 172.21.15.59:0/2245347816 wait complete. 2024-04-25T09:12:30.198 INFO:teuthology.orchestra.run.smithi059.stdout:{"pg_ready":true,"pg_map":{"version":457,"stamp":"2024-04-25T09:12:29.816374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262928,"kb_used_data":13480,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711792,"statfs":{"total":773094113280,"available":772824875008,"internally_reserved":0,"allocated":13803520,"data_stored":7085384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002338"},"pg_stats":[{"pgid":"1.0","version":"126'119","reported_seq":380,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-04-25T09:12:10.317201+0000","last_change":"2024-04-25T09:12:10.317237+0000","last_active":"2024-04-25T09:12:10.317201+0000","last_peered":"2024-04-25T09:12:10.317201+0000","last_clean":"2024-04-25T09:12:10.317201+0000","last_became_active":"2024-04-25T09:01:17.692950+0000","last_became_peered":"2024-04-25T09:01:17.692950+0000","last_unstale":"2024-04-25T09:12:10.317201+0000","last_undegraded":"2024-04-25T09:12:10.317201+0000","last_fullsized":"2024-04-25T09:12:10.317201+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"126'119","last_scrub_stamp":"2024-04-25T09:12:10.317114+0000","last_deep_scrub":"126'119","last_deep_scrub_stamp":"2024-04-25T09:12:10.317114+0000","last_clean_scrub_stamp":"2024-04-25T09:12:10.317114+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:05.612461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574986,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33296,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338544,"statfs":{"total":96636764160,"available":96602669056,"internally_reserved":0,"allocated":2170880,"data_stored":1328449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":738081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32720,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1576960,"data_stored":738081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":738081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":738081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":738081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":738081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574985,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33296,"kb_used_data":2120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338544,"statfs":{"total":96636764160,"available":96602669056,"internally_reserved":0,"allocated":2170880,"data_stored":1328449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T09:12:30.199 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T09:12:30.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45ea800640 1 Processor -- start 2024-04-25T09:12:30.338 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45ea800640 1 -- start start 2024-04-25T09:12:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45ea800640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45e4159320 0x7f45e415c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45ea800640 1 --2- >> v2:172.21.15.178:3300/0 conn(0x7f45e406e4a0 0x7f45e406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45ea800640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e415fc00 con 0x7f45e415f440 2024-04-25T09:12:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45ea800640 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e406d640 con 0x7f45e4159320 2024-04-25T09:12:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45ea800640 1 -- --> v2:172.21.15.178:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e406ee10 con 0x7f45e406e4a0 2024-04-25T09:12:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45e3400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45e4159320 0x7f45e415c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45e3400640 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45e4159320 0x7f45e415c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33790/0 (socket says 172.21.15.59:33790) 2024-04-25T09:12:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45e3400640 1 -- 172.21.15.59:0/1046875099 learned_addr learned my addr 172.21.15.59:0/1046875099 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45e3e00640 1 --2- 172.21.15.59:0/1046875099 >> v2:172.21.15.178:3300/0 conn(0x7f45e406e4a0 0x7f45e406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45e3400640 1 -- 172.21.15.59:0/1046875099 >> v2:172.21.15.178:3300/0 conn(0x7f45e406e4a0 msgr2=0x7f45e406e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T09:12:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45e3400640 1 --2- 172.21.15.59:0/1046875099 >> v2:172.21.15.178:3300/0 conn(0x7f45e406e4a0 0x7f45e406e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.340 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45e3400640 1 -- 172.21.15.59:0/1046875099 >> v1:172.21.15.59:6789/0 conn(0x7f45e415f440 legacy=0x7f45e406dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.341 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.350+0000 7f45e3400640 1 -- 172.21.15.59:0/1046875099 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e415fee0 con 0x7f45e4159320 2024-04-25T09:12:30.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.354+0000 7f45e3400640 1 --2- 172.21.15.59:0/1046875099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e4159320 0x7f45e415c9b0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f45e4072630 tx=0x7f45d401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517ba15cd1509610 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.354+0000 7f45e2a00640 1 -- 172.21.15.59:0/1046875099 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40ab660 con 0x7f45e4159320 2024-04-25T09:12:30.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.354+0000 7f45e2a00640 1 -- 172.21.15.59:0/1046875099 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d40b0070 con 0x7f45e4159320 2024-04-25T09:12:30.343 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.354+0000 7f45e2a00640 1 -- 172.21.15.59:0/1046875099 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40aba20 con 0x7f45e4159320 2024-04-25T09:12:30.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.354+0000 7f45ea800640 1 -- 172.21.15.59:0/1046875099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e4159320 msgr2=0x7f45e415c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.354+0000 7f45ea800640 1 --2- 172.21.15.59:0/1046875099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e4159320 0x7f45e415c9b0 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f45e4072630 tx=0x7f45d401c460 comp rx=0 tx=0).stop 2024-04-25T09:12:30.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.354+0000 7f45ea800640 1 -- 172.21.15.59:0/1046875099 shutdown_connections 2024-04-25T09:12:30.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.354+0000 7f45ea800640 1 --2- 172.21.15.59:0/1046875099 >> v2:172.21.15.178:3300/0 conn(0x7f45e406e4a0 0x7f45e406e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.354+0000 7f45ea800640 1 --2- 172.21.15.59:0/1046875099 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e4159320 0x7f45e415c9b0 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.354+0000 7f45ea800640 1 -- 172.21.15.59:0/1046875099 >> 172.21.15.59:0/1046875099 conn(0x7f45e4067080 msgr2=0x7f45e406ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:30.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.354+0000 7f45ea800640 1 -- 172.21.15.59:0/1046875099 shutdown_connections 2024-04-25T09:12:30.344 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.354+0000 7f45ea800640 1 -- 172.21.15.59:0/1046875099 wait complete. 2024-04-25T09:12:30.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45ea800640 1 Processor -- start 2024-04-25T09:12:30.345 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45ea800640 1 -- start start 2024-04-25T09:12:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45ea800640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e406e4a0 0x7f45e4155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45ea800640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45e4159320 0x7f45e40cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45ea800640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e415f440 0x7f45e40cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45ea800640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e415f820 con 0x7f45e406e4a0 2024-04-25T09:12:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45ea800640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e4159700 con 0x7f45e4159320 2024-04-25T09:12:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45ea800640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e415f9a0 con 0x7f45e415f440 2024-04-25T09:12:30.347 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45e3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e406e4a0 0x7f45e4155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45e3400640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e406e4a0 0x7f45e4155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:33804/0 (socket says 172.21.15.59:33804) 2024-04-25T09:12:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45e3400640 1 -- 172.21.15.59:0/2222149753 learned_addr learned my addr 172.21.15.59:0/2222149753 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45daa00640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45e4159320 0x7f45e40cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45e3e00640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e415f440 0x7f45e40cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45e3400640 1 -- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e415f440 msgr2=0x7f45e40cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45e3400640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e415f440 0x7f45e40cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45e3400640 1 -- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45e4159320 msgr2=0x7f45e40cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45e3400640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45e4159320 0x7f45e40cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45e3400640 1 -- 172.21.15.59:0/2222149753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e41359c0 con 0x7f45e406e4a0 2024-04-25T09:12:30.348 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45e3400640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e406e4a0 0x7f45e4155b20 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f45d40ad040 tx=0x7f45d401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45dbe00640 1 -- 172.21.15.59:0/2222149753 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40be5f0 con 0x7f45e406e4a0 2024-04-25T09:12:30.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45dbe00640 1 -- 172.21.15.59:0/2222149753 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d40be790 con 0x7f45e406e4a0 2024-04-25T09:12:30.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45dbe00640 1 -- 172.21.15.59:0/2222149753 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d40beb60 con 0x7f45e406e4a0 2024-04-25T09:12:30.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45ea800640 1 -- 172.21.15.59:0/2222149753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e4135ca0 con 0x7f45e406e4a0 2024-04-25T09:12:30.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45ea800640 1 -- 172.21.15.59:0/2222149753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e4136260 con 0x7f45e406e4a0 2024-04-25T09:12:30.349 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.358+0000 7f45ea800640 1 -- 172.21.15.59:0/2222149753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e40745d0 con 0x7f45e406e4a0 2024-04-25T09:12:30.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.362+0000 7f45dbe00640 1 -- 172.21.15.59:0/2222149753 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7f45d40b43f0 con 0x7f45e406e4a0 2024-04-25T09:12:30.350 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.362+0000 7f45dbe00640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f45c0066f90 0x7f45c0069450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.362+0000 7f45dbe00640 1 -- 172.21.15.59:0/2222149753 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7f45d411fcc0 con 0x7f45e406e4a0 2024-04-25T09:12:30.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.362+0000 7f45daa00640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f45c0066f90 0x7f45c0069450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.351 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.362+0000 7f45daa00640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f45c0066f90 0x7f45c0069450 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f45e40cd8a0 tx=0x7f45cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.355 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.366+0000 7f45dbe00640 1 -- 172.21.15.59:0/2222149753 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7f45d4126080 con 0x7f45e406e4a0 2024-04-25T09:12:30.514 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.526+0000 7f45ea800640 1 -- 172.21.15.59:0/2222149753 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f45e4142a00 con 0x7f45e406e4a0 2024-04-25T09:12:30.518 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45dbe00640 1 -- 172.21.15.59:0/2222149753 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) v1 ==== 123+0+0 (secure 0 0 0) 0x7f45d4016110 con 0x7f45e406e4a0 2024-04-25T09:12:30.519 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45dbe00640 1 -- 172.21.15.59:0/2222149753 <== mon.0 v2:172.21.15.59:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f45d40f0850 con 0x7f45e406e4a0 2024-04-25T09:12:30.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45ea800640 1 -- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f45c0066f90 msgr2=0x7f45c0069450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45ea800640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f45c0066f90 0x7f45c0069450 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f45e40cd8a0 tx=0x7f45cc009040 comp rx=0 tx=0).stop 2024-04-25T09:12:30.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45ea800640 1 -- 172.21.15.59:0/2222149753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e406e4a0 msgr2=0x7f45e4155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45ea800640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e406e4a0 0x7f45e4155b20 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f45d40ad040 tx=0x7f45d401aca0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45ea800640 1 -- 172.21.15.59:0/2222149753 shutdown_connections 2024-04-25T09:12:30.521 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45ea800640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7f45c0066f90 0x7f45c0069450 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45ea800640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7f45e415f440 0x7f45e40cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45ea800640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7f45e4159320 0x7f45e40cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45ea800640 1 --2- 172.21.15.59:0/2222149753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e406e4a0 0x7f45e4155b20 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45ea800640 1 -- 172.21.15.59:0/2222149753 >> 172.21.15.59:0/2222149753 conn(0x7f45e4067080 msgr2=0x7f45e415cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:30.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45ea800640 1 -- 172.21.15.59:0/2222149753 shutdown_connections 2024-04-25T09:12:30.522 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.530+0000 7f45ea800640 1 -- 172.21.15.59:0/2222149753 wait complete. 2024-04-25T09:12:30.541 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T09:12:30.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T09:12:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa541200640 1 Processor -- start 2024-04-25T09:12:30.681 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa541200640 1 -- start start 2024-04-25T09:12:30.683 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa541200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c143c60 0x7fa53c06e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa541200640 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c15e0a0 con 0x7fa53c0cc730 2024-04-25T09:12:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa541200640 1 -- --> v1:172.21.15.178:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa53c15e380 con 0x7fa53c06e760 2024-04-25T09:12:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa541200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0cf220 con 0x7fa53c143c60 2024-04-25T09:12:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa53be00640 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa53c0cc730 0x7fa53c0b2d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:52970/0 (socket says 172.21.15.59:52970) 2024-04-25T09:12:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa53be00640 1 -- 172.21.15.59:0/422211608 learned_addr learned my addr 172.21.15.59:0/422211608 (peer_addr_for_me v1:172.21.15.59:0/0) 2024-04-25T09:12:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa53b400640 1 --2- 172.21.15.59:0/422211608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c143c60 0x7fa53c06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa53aa00640 1 -- 172.21.15.59:0/422211608 <== mon.0 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476662617 0 0) 0x7fa53c15e0a0 con 0x7fa53c0cc730 2024-04-25T09:12:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa53aa00640 1 -- 172.21.15.59:0/422211608 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa520003530 con 0x7fa53c0cc730 2024-04-25T09:12:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa53aa00640 1 -- 172.21.15.59:0/422211608 <== mon.0 v1:172.21.15.59:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 247873660 0 0) 0x7fa520003530 con 0x7fa53c0cc730 2024-04-25T09:12:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa53b400640 1 -- 172.21.15.59:0/422211608 >> v1:172.21.15.178:6789/0 conn(0x7fa53c06e760 legacy=0x7fa53c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa53b400640 1 -- 172.21.15.59:0/422211608 >> v1:172.21.15.59:6789/0 conn(0x7fa53c0cc730 legacy=0x7fa53c0b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.684 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.694+0000 7fa53b400640 1 -- 172.21.15.59:0/422211608 --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c15e660 con 0x7fa53c143c60 2024-04-25T09:12:30.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.698+0000 7fa53b400640 1 --2- 172.21.15.59:0/422211608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c143c60 0x7fa53c06e220 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0097f0 tx=0x7fa52c01c2b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2009bb943e0ba7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.698+0000 7fa53aa00640 1 -- 172.21.15.59:0/422211608 <== mon.2 v2:172.21.15.178:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52c0b0070 con 0x7fa53c143c60 2024-04-25T09:12:30.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.698+0000 7fa53aa00640 1 -- 172.21.15.59:0/422211608 <== mon.2 v2:172.21.15.178:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa52c0ab400 con 0x7fa53c143c60 2024-04-25T09:12:30.687 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.698+0000 7fa53aa00640 1 -- 172.21.15.59:0/422211608 <== mon.2 v2:172.21.15.178:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa534001a00 con 0x7fa53c143c60 2024-04-25T09:12:30.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.698+0000 7fa541200640 1 -- 172.21.15.59:0/422211608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c143c60 msgr2=0x7fa53c06e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.698+0000 7fa541200640 1 --2- 172.21.15.59:0/422211608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c143c60 0x7fa53c06e220 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0097f0 tx=0x7fa52c01c2b0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.698+0000 7fa541200640 1 -- 172.21.15.59:0/422211608 shutdown_connections 2024-04-25T09:12:30.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.698+0000 7fa541200640 1 --2- 172.21.15.59:0/422211608 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c143c60 0x7fa53c06e220 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.698+0000 7fa541200640 1 -- 172.21.15.59:0/422211608 >> 172.21.15.59:0/422211608 conn(0x7fa53c066fa0 msgr2=0x7fa53c06ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:30.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.698+0000 7fa541200640 1 -- 172.21.15.59:0/422211608 shutdown_connections 2024-04-25T09:12:30.688 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.698+0000 7fa541200640 1 -- 172.21.15.59:0/422211608 wait complete. 2024-04-25T09:12:30.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa541200640 1 Processor -- start 2024-04-25T09:12:30.689 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa541200640 1 -- start start 2024-04-25T09:12:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa541200640 1 --2- >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06e760 0x7fa53c13ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa541200640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0cc730 0x7fa53c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa541200640 1 --2- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa53c143c60 0x7fa53c13be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa541200640 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c144040 con 0x7fa53c0cc730 2024-04-25T09:12:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa541200640 1 -- --> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c0ccc80 con 0x7fa53c143c60 2024-04-25T09:12:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa541200640 1 -- --> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa53c15ee60 con 0x7fa53c06e760 2024-04-25T09:12:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa532a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0cc730 0x7fa53c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa532a00640 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0cc730 0x7fa53c1529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:43320/0 (socket says 172.21.15.59:43320) 2024-04-25T09:12:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa532a00640 1 -- 172.21.15.59:0/2833167578 learned_addr learned my addr 172.21.15.59:0/2833167578 (peer_addr_for_me v2:172.21.15.59:0/0) 2024-04-25T09:12:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa53be00640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa53c143c60 0x7fa53c13be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.691 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa53b400640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06e760 0x7fa53c13ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa532a00640 1 -- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06e760 msgr2=0x7fa53c13ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa532a00640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06e760 0x7fa53c13ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa532a00640 1 -- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa53c143c60 msgr2=0x7fa53c13be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa532a00640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa53c143c60 0x7fa53c13be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.692 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa532a00640 1 -- 172.21.15.59:0/2833167578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa53c15cb00 con 0x7fa53c0cc730 2024-04-25T09:12:30.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa532a00640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0cc730 0x7fa53c1529e0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7fa524009e40 tx=0x7fa52400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa533e00640 1 -- 172.21.15.59:0/2833167578 <== mon.0 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52400cdb0 con 0x7fa53c0cc730 2024-04-25T09:12:30.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa533e00640 1 -- 172.21.15.59:0/2833167578 <== mon.0 v2:172.21.15.59:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa524004020 con 0x7fa53c0cc730 2024-04-25T09:12:30.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa533e00640 1 -- 172.21.15.59:0/2833167578 <== mon.0 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524004470 con 0x7fa53c0cc730 2024-04-25T09:12:30.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa541200640 1 -- 172.21.15.59:0/2833167578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa53c15c820 con 0x7fa53c0cc730 2024-04-25T09:12:30.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa541200640 1 -- 172.21.15.59:0/2833167578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa53c0ad6f0 con 0x7fa53c0cc730 2024-04-25T09:12:30.693 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.702+0000 7fa541200640 1 -- 172.21.15.59:0/2833167578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa53c04efa0 con 0x7fa53c0cc730 2024-04-25T09:12:30.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.706+0000 7fa533e00640 1 -- 172.21.15.59:0/2833167578 <== mon.0 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 86727+0+0 (secure 0 0 0) 0x7fa52401b020 con 0x7fa53c0cc730 2024-04-25T09:12:30.694 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.706+0000 7fa533e00640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa518066f60 0x7fa518069420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T09:12:30.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.706+0000 7fa533e00640 1 -- 172.21.15.59:0/2833167578 <== mon.0 v2:172.21.15.59:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5507+0+0 (secure 0 0 0) 0x7fa524087190 con 0x7fa53c0cc730 2024-04-25T09:12:30.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.706+0000 7fa53b400640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa518066f60 0x7fa518069420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T09:12:30.695 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.706+0000 7fa53b400640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa518066f60 0x7fa518069420 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0ad000 tx=0x7fa52c0a6000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T09:12:30.698 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.710+0000 7fa533e00640 1 -- 172.21.15.59:0/2833167578 <== mon.0 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175264 (secure 0 0 0) 0x7fa524012300 con 0x7fa53c0cc730 2024-04-25T09:12:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.906+0000 7fa541200640 1 -- 172.21.15.59:0/2833167578 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa53c0b25f0 con 0x7fa53c0cc730 2024-04-25T09:12:30.895 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.906+0000 7fa533e00640 1 -- 172.21.15.59:0/2833167578 <== mon.0 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 119 v119) v1 ==== 95+0+3702 (secure 0 0 0) 0x7fa5240581c0 con 0x7fa53c0cc730 2024-04-25T09:12:30.896 INFO:teuthology.orchestra.run.smithi059.stdout: 2024-04-25T09:12:30.896 INFO:teuthology.orchestra.run.smithi059.stdout:{"epoch":119,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7448,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6836/459859508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6834","nonce":459859508},{"type":"v1","addr":"172.21.15.178:6836","nonce":459859508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":7613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3791633295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6834","nonce":3791633295},{"type":"v1","addr":"172.21.15.59:6835","nonce":3791633295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":106},{"gid":8341,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.178:6837/169536217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6835","nonce":169536217},{"type":"v1","addr":"172.21.15.178:6837","nonce":169536217}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":99},{"gid":9594,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6833/2478452815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2478452815},{"type":"v1","addr":"172.21.15.59:6833","nonce":2478452815}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":119}],"filesystems":[]} 2024-04-25T09:12:30.896 INFO:teuthology.orchestra.run.smithi059.stderr:dumped fsmap epoch 119 2024-04-25T09:12:30.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.910+0000 7fa541200640 1 -- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa518066f60 msgr2=0x7fa518069420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.910+0000 7fa541200640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa518066f60 0x7fa518069420 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fa52c0ad000 tx=0x7fa52c0a6000 comp rx=0 tx=0).stop 2024-04-25T09:12:30.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.910+0000 7fa541200640 1 -- 172.21.15.59:0/2833167578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0cc730 msgr2=0x7fa53c1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T09:12:30.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.910+0000 7fa541200640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0cc730 0x7fa53c1529e0 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7fa524009e40 tx=0x7fa52400c430 comp rx=0 tx=0).stop 2024-04-25T09:12:30.898 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.910+0000 7fa541200640 1 -- 172.21.15.59:0/2833167578 shutdown_connections 2024-04-25T09:12:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.910+0000 7fa541200640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:6832/226381240,v1:172.21.15.178:6833/226381240] conn(0x7fa518066f60 0x7fa518069420 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.910+0000 7fa541200640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x7fa53c143c60 0x7fa53c13be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.910+0000 7fa541200640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa53c0cc730 0x7fa53c1529e0 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.910+0000 7fa541200640 1 --2- 172.21.15.59:0/2833167578 >> [v2:172.21.15.178:3301/0,v1:172.21.15.178:6790/0] conn(0x7fa53c06e760 0x7fa53c13ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T09:12:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.910+0000 7fa541200640 1 -- 172.21.15.59:0/2833167578 >> 172.21.15.59:0/2833167578 conn(0x7fa53c066fa0 msgr2=0x7fa53c06d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T09:12:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.910+0000 7fa541200640 1 -- 172.21.15.59:0/2833167578 shutdown_connections 2024-04-25T09:12:30.899 INFO:teuthology.orchestra.run.smithi059.stderr:2024-04-25T09:12:30.910+0000 7fa541200640 1 -- 172.21.15.59:0/2833167578 wait complete. 2024-04-25T09:12:30.917 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-25T09:12:30.917 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T09:12:30.918 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T09:12:30.918 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:30.930 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T09:12:30.930 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T09:12:30.930 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:30.984 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T09:12:30.984 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T09:12:30.984 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:30.999 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T09:12:30.999 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T09:12:30.999 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:31.056 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T09:12:31.056 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T09:12:31.056 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T09:12:31.056 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:31.142 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T09:12:31.142 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T09:12:31.142 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:33.796 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-25T09:12:37.243 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T09:12:37.243 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T09:12:37.244 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:37.316 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T09:12:37.316 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T09:12:37.316 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:39.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-25T09:12:39.704 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-25T09:12:43.418 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T09:12:43.418 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T09:12:43.418 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:43.472 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T09:12:43.473 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T09:12:43.473 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:43.574 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T09:12:43.574 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T09:12:43.574 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:43.664 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T09:12:43.664 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T09:12:43.664 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:45.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-25T09:12:45.209 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-25T09:12:49.766 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T09:12:49.766 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T09:12:49.766 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T09:12:49.766 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:49.822 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T09:12:49.822 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T09:12:49.822 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:49.883 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T09:12:49.883 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T09:12:49.883 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T09:12:49.883 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:49.903 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T09:12:49.903 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T09:12:49.903 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:49.919 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T09:12:49.919 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T09:12:49.919 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T09:12:49.982 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T09:12:49.982 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T09:12:49.983 DEBUG:teuthology.orchestra.run.smithi059:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-25T09:12:50.017 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:12:50.017 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T09:12:50.210 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-25T09:12:50.262 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:12:50.262 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T09:12:50.570 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:12:50.570 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T09:12:50.760 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:12:50.760 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T09:12:51.001 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T09:12:51.001 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T09:12:51.166 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T09:12:51.166 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T09:12:51.396 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T09:12:51.396 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T09:12:51.574 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T09:12:51.574 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T09:12:51.770 INFO:tasks.ceph:Archiving mon data... 2024-04-25T09:12:51.771 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999/data/mon.a.tgz 2024-04-25T09:12:51.771 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2024-04-25T09:12:51.781 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.np4fF6OV36 2024-04-25T09:12:51.781 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.np4fF6OV36 2024-04-25T09:12:51.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.np4fF6OV36 2024-04-25T09:12:52.010 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.np4fF6OV36 is 423KB 2024-04-25T09:12:52.075 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.np4fF6OV36 2024-04-25T09:12:52.083 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999/data/mon.b.tgz 2024-04-25T09:12:52.083 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-04-25T09:12:52.092 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.NMB8HTKJ0P 2024-04-25T09:12:52.093 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.NMB8HTKJ0P 2024-04-25T09:12:52.237 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.NMB8HTKJ0P 2024-04-25T09:12:52.310 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.NMB8HTKJ0P is 431KB 2024-04-25T09:12:52.373 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.NMB8HTKJ0P 2024-04-25T09:12:52.381 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999/data/mon.c.tgz 2024-04-25T09:12:52.381 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-04-25T09:12:52.429 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.HhINOL6rn3 2024-04-25T09:12:52.429 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.HhINOL6rn3 2024-04-25T09:12:52.571 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.HhINOL6rn3 2024-04-25T09:12:52.646 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.HhINOL6rn3 is 432KB 2024-04-25T09:12:52.708 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.HhINOL6rn3 2024-04-25T09:12:52.716 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T09:12:52.716 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:12:52.719 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T09:12:52.789 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:12:52.825 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T09:12:52.825 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T09:12:52.827 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999/remote/smithi059/crash 2024-04-25T09:12:52.828 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:12:52.854 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/crash to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999/remote/smithi178/crash 2024-04-25T09:12:52.855 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T09:12:52.883 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T09:12:52.883 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:52.899 DEBUG:teuthology.orchestra.run.smithi178:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:53.097 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:53.119 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T09:12:53.137 INFO:tasks.ceph:Compressing logs... 2024-04-25T09:12:53.137 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:12:53.168 DEBUG:teuthology.orchestra.run.smithi178:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T09:12:53.198 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49474.log 2024-04-25T09:12:53.199 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43287.log 2024-04-25T09:12:53.200 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44209.log 2024-04-25T09:12:53.200 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49474.log.gz 2024-04-25T09:12:53.201 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44622.log 2024-04-25T09:12:53.201 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43287.log.gz 2024-04-25T09:12:53.202 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54021.log 2024-04-25T09:12:53.202 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44209.log.gz 2024-04-25T09:12:53.203 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41391.log 2024-04-25T09:12:53.203 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54021.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44622.log.gz 2024-04-25T09:12:53.204 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49351.log 2024-04-25T09:12:53.204 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54021.log.gz 2024-04-25T09:12:53.205 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35284.log 2024-04-25T09:12:53.205 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41391.log.gz 2024-04-25T09:12:53.205 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51081.log 2024-04-25T09:12:53.206 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49351.log.gz 2024-04-25T09:12:53.206 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35681.log 2024-04-25T09:12:53.206 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35284.log.gz 2024-04-25T09:12:53.207 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37678.log 2024-04-25T09:12:53.207 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51081.log.gz 2024-04-25T09:12:53.208 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35466.log 2024-04-25T09:12:53.208 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35681.log.gz 2024-04-25T09:12:53.209 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51533.log 2024-04-25T09:12:53.209 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37678.log.gz 2024-04-25T09:12:53.210 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38774.log 2024-04-25T09:12:53.210 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51533.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35466.log.gz 2024-04-25T09:12:53.211 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33460.log 2024-04-25T09:12:53.211 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51533.log.gz 2024-04-25T09:12:53.211 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37268.log 2024-04-25T09:12:53.212 INFO:teuthology.orchestra.run.smithi059.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.38774.log.gz 2024-04-25T09:12:53.212 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32371.log 2024-04-25T09:12:53.213 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27856.log 2024-04-25T09:12:53.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54203.log 2024-04-25T09:12:53.214 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33460.log.gz 2024-04-25T09:12:53.214 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40464.log 2024-04-25T09:12:53.214 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37268.log.gz 2024-04-25T09:12:53.220 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.1.32371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27736.log 2024-04-25T09:12:53.220 INFO:teuthology.orchestra.run.smithi178.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32371.log.gz 2024-04-25T09:12:53.220 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.27856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27712.log 2024-04-25T09:12:53.220 INFO:teuthology.orchestra.run.smithi178.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27856.log.gz 2024-04-25T09:12:53.220 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.27736.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T09:12:53.220 INFO:teuthology.orchestra.run.smithi178.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27736.log.gz 2024-04-25T09:12:53.220 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.27712.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T09:12:53.220 INFO:teuthology.orchestra.run.smithi178.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27712.log.gz 2024-04-25T09:12:53.221 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T09:12:53.221 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27688.log 2024-04-25T09:12:53.221 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27832.log 2024-04-25T09:12:53.221 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.27688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.32452.log 2024-04-25T09:12:53.221 INFO:teuthology.orchestra.run.smithi178.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27688.log.gz 2024-04-25T09:12:53.221 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.27832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27784.log 2024-04-25T09:12:53.222 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52002.log 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54203.log.gz 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36517.log 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40464.log.gz 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.52002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52002.log.gz 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54047.log 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42944.log 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36517.log.gz 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39313.log 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54047.log.gz 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41417.log 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42944.log.gz 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47017.log 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39313.log.gz 2024-04-25T09:12:53.223 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42691.log 2024-04-25T09:12:53.224 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41417.log.gz 2024-04-25T09:12:53.224 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40810.log 2024-04-25T09:12:53.224 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47017.log.gz 2024-04-25T09:12:53.224 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36334.log 2024-04-25T09:12:53.224 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42691.log.gz 2024-04-25T09:12:53.224 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42918.log 2024-04-25T09:12:53.224 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40810.log.gz 2024-04-25T09:12:53.229 INFO:teuthology.orchestra.run.smithi178.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27832.log.gz 2024-04-25T09:12:53.229 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.3.32452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.32452.log.gz 2024-04-25T09:12:53.229 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T09:12:53.229 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.27784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27760.log 2024-04-25T09:12:53.230 INFO:teuthology.orchestra.run.smithi178.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27784.log.gz 2024-04-25T09:12:53.230 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T09:12:53.230 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.27760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27808.log 2024-04-25T09:12:53.230 INFO:teuthology.orchestra.run.smithi178.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27760.log.gz 2024-04-25T09:12:53.230 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T09:12:53.230 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.27808.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T09:12:53.230 INFO:teuthology.orchestra.run.smithi178.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27808.log.gz 2024-04-25T09:12:53.230 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T09:12:53.231 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph.audit.log: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T09:12:53.231 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T09:12:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34242.log 2024-04-25T09:12:53.233 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36334.log.gz 2024-04-25T09:12:53.233 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49556.log 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42918.log.gz 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38616.log 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34242.log.gz 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52528.log 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49556.log.gz 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33538.log 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38616.log.gz 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54281.log 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52528.log.gz 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43558.log 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33538.log.gz 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40881.log 2024-04-25T09:12:53.234 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54281.log.gz 2024-04-25T09:12:53.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43558.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T09:12:53.235 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43558.log.gz 2024-04-25T09:12:53.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37966.log 2024-04-25T09:12:53.235 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40881.log.gz 2024-04-25T09:12:53.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34619.log 2024-04-25T09:12:53.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50193.log 2024-04-25T09:12:53.235 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37966.log.gz 2024-04-25T09:12:53.235 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36712.log 2024-04-25T09:12:53.235 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34619.log.gz 2024-04-25T09:12:53.236 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mds.b.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T09:12:53.236 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T09:12:53.236 INFO:teuthology.orchestra.run.smithi178.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T09:12:53.236 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.32447.log 2024-04-25T09:12:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48330.log 2024-04-25T09:12:53.238 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50193.log.gz 2024-04-25T09:12:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45318.log 2024-04-25T09:12:53.238 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36712.log.gz 2024-04-25T09:12:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37886.log 2024-04-25T09:12:53.238 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48330.log.gz 2024-04-25T09:12:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41823.log 2024-04-25T09:12:53.238 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45318.log.gz 2024-04-25T09:12:53.238 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35944.log 2024-04-25T09:12:53.238 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37886.log.gz 2024-04-25T09:12:53.239 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-client.3.32447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.32447.log.gz 2024-04-25T09:12:53.239 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T09:12:53.240 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49820.log 2024-04-25T09:12:53.240 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41823.log.gz 2024-04-25T09:12:53.241 INFO:teuthology.orchestra.run.smithi059.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T09:12:53.241 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41302.log 2024-04-25T09:12:53.241 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35944.log.gz 2024-04-25T09:12:53.241 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52226.log 2024-04-25T09:12:53.241 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49820.log.gz 2024-04-25T09:12:53.242 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34346.log 2024-04-25T09:12:53.242 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41302.log.gz 2024-04-25T09:12:53.242 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37138.log 2024-04-25T09:12:53.242 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52226.log.gz 2024-04-25T09:12:53.243 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32353.log 2024-04-25T09:12:53.244 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36738.log 2024-04-25T09:12:53.244 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34346.log.gz 2024-04-25T09:12:53.244 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39032.log 2024-04-25T09:12:53.244 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37138.log.gz 2024-04-25T09:12:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45162.log 2024-04-25T09:12:53.245 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36738.log.gz 2024-04-25T09:12:53.245 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35788.log 2024-04-25T09:12:53.246 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39032.log.gz 2024-04-25T09:12:53.246 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48948.log 2024-04-25T09:12:53.246 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45162.log.gz 2024-04-25T09:12:53.247 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48583.log 2024-04-25T09:12:53.247 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35788.log.gz 2024-04-25T09:12:53.248 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43978.log 2024-04-25T09:12:53.248 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48948.log.gz 2024-04-25T09:12:53.249 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52251.log 2024-04-25T09:12:53.249 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48583.log.gz 2024-04-25T09:12:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41549.log 2024-04-25T09:12:53.250 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43978.log.gz 2024-04-25T09:12:53.250 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48687.log 2024-04-25T09:12:53.250 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52251.log.gz 2024-04-25T09:12:53.251 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.1.32353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32353.log.gz 2024-04-25T09:12:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41471.log 2024-04-25T09:12:53.252 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41549.log.gz 2024-04-25T09:12:53.252 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42186.log 2024-04-25T09:12:53.252 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48687.log.gz 2024-04-25T09:12:53.253 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37372.log 2024-04-25T09:12:53.253 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41471.log.gz 2024-04-25T09:12:53.254 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42186.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T09:12:53.254 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37372.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42186.log.gz 2024-04-25T09:12:53.254 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38345.log 2024-04-25T09:12:53.255 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37372.log.gz 2024-04-25T09:12:53.255 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45058.log 2024-04-25T09:12:53.256 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40784.log 2024-04-25T09:12:53.256 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38345.log.gz 2024-04-25T09:12:53.257 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40055.log 2024-04-25T09:12:53.257 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45058.log.gz 2024-04-25T09:12:53.258 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33737.log 2024-04-25T09:12:53.259 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40784.log.gz 2024-04-25T09:12:53.259 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.40055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40055.log.gz 2024-04-25T09:12:53.259 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35763.log 2024-04-25T09:12:53.259 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39850.log 2024-04-25T09:12:53.260 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.2.35763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35763.log.gz 2024-04-25T09:12:53.260 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47602.log 2024-04-25T09:12:53.261 INFO:teuthology.orchestra.run.smithi059.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.33737.log.gz 2024-04-25T09:12:53.261 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52804.log 2024-04-25T09:12:53.262 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39850.log.gz 2024-04-25T09:12:53.262 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48278.log 2024-04-25T09:12:53.262 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47602.log.gz 2024-04-25T09:12:53.263 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46941.log 2024-04-25T09:12:53.263 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52804.log.gz 2024-04-25T09:12:53.264 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43348.log 2024-04-25T09:12:53.264 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48278.log.gz 2024-04-25T09:12:53.265 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39110.log 2024-04-25T09:12:53.265 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46941.log.gz 2024-04-25T09:12:53.266 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33168.log 2024-04-25T09:12:53.266 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43348.log.gz 2024-04-25T09:12:53.267 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53238.log 2024-04-25T09:12:53.267 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39110.log.gz 2024-04-25T09:12:53.267 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36360.log 2024-04-25T09:12:53.268 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33168.log.gz 2024-04-25T09:12:53.268 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37730.log 2024-04-25T09:12:53.268 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53238.log.gz 2024-04-25T09:12:53.269 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53454.log 2024-04-25T09:12:53.270 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36360.log.gz 2024-04-25T09:12:53.270 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49398.log 2024-04-25T09:12:53.270 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.37730.log.gz 2024-04-25T09:12:53.271 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35022.log 2024-04-25T09:12:53.272 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53454.log.gz 2024-04-25T09:12:53.272 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.49398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37398.log 2024-04-25T09:12:53.272 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49398.log.gz 2024-04-25T09:12:53.273 INFO:teuthology.orchestra.run.smithi178.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T09:12:53.273 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43736.log 2024-04-25T09:12:53.273 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35022.log.gz 2024-04-25T09:12:53.274 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50657.log 2024-04-25T09:12:53.274 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37398.log.gz 2024-04-25T09:12:53.275 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45292.log 2024-04-25T09:12:53.275 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43736.log.gz 2024-04-25T09:12:53.275 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38081.log 2024-04-25T09:12:53.276 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50657.log.gz 2024-04-25T09:12:53.276 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46366.log 2024-04-25T09:12:53.276 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45292.log.gz 2024-04-25T09:12:53.277 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34372.log 2024-04-25T09:12:53.277 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38081.log.gz 2024-04-25T09:12:53.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46615.log 2024-04-25T09:12:53.278 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46366.log.gz 2024-04-25T09:12:53.279 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52470.log 2024-04-25T09:12:53.279 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34372.log.gz 2024-04-25T09:12:53.280 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40855.log 2024-04-25T09:12:53.280 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46615.log.gz 2024-04-25T09:12:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.52470.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.0.52470.log.gz --verbose 2024-04-25T09:12:53.281 INFO:teuthology.orchestra.run.smithi059.stderr: -- /var/log/ceph/ceph-client.admin.49301.log 2024-04-25T09:12:53.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36977.log 2024-04-25T09:12:53.282 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40855.log.gz 2024-04-25T09:12:53.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41627.log 2024-04-25T09:12:53.283 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.49301.log.gz 2024-04-25T09:12:53.283 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41274.log 2024-04-25T09:12:53.284 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36977.log.gz 2024-04-25T09:12:53.284 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47462.log 2024-04-25T09:12:53.285 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41627.log.gz 2024-04-25T09:12:53.285 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45977.log 2024-04-25T09:12:53.286 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41274.log.gz 2024-04-25T09:12:53.286 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40680.log 2024-04-25T09:12:53.287 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50009.log 2024-04-25T09:12:53.287 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45977.log.gz 2024-04-25T09:12:53.287 INFO:teuthology.orchestra.run.smithi059.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.47462.log.gz 2024-04-25T09:12:53.288 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34138.log 2024-04-25T09:12:53.288 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40680.log.gz 2024-04-25T09:12:53.289 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47352.log 2024-04-25T09:12:53.289 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50009.log.gz 2024-04-25T09:12:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48196.log 2024-04-25T09:12:53.290 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34138.log.gz 2024-04-25T09:12:53.290 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36100.log 2024-04-25T09:12:53.291 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47352.log.gz 2024-04-25T09:12:53.291 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36308.log 2024-04-25T09:12:53.292 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48196.log.gz 2024-04-25T09:12:53.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53194.log 2024-04-25T09:12:53.292 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36100.log.gz 2024-04-25T09:12:53.293 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39339.log 2024-04-25T09:12:53.293 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36308.log.gz 2024-04-25T09:12:53.294 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.53194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53194.log.gz 2024-04-25T09:12:53.294 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53428.log 2024-04-25T09:12:53.295 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35866.log 2024-04-25T09:12:53.295 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39339.log.gz 2024-04-25T09:12:53.296 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48746.log 2024-04-25T09:12:53.296 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53428.log.gz 2024-04-25T09:12:53.297 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51735.log 2024-04-25T09:12:53.297 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35866.log.gz 2024-04-25T09:12:53.297 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43480.log 2024-04-25T09:12:53.298 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48746.log.gz 2024-04-25T09:12:53.298 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.51735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51735.log.gz 2024-04-25T09:12:53.299 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46836.log 2024-04-25T09:12:53.299 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46257.log 2024-04-25T09:12:53.300 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43480.log.gz 2024-04-25T09:12:53.300 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37060.log 2024-04-25T09:12:53.301 INFO:teuthology.orchestra.run.smithi059.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46836.log.gz 2024-04-25T09:12:53.301 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.46257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46257.log.gz 2024-04-25T09:12:53.301 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43940.log 2024-04-25T09:12:53.302 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42970.log 2024-04-25T09:12:53.303 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37060.log.gz 2024-04-25T09:12:53.303 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43844.log 2024-04-25T09:12:53.303 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43940.log.gz 2024-04-25T09:12:53.304 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44032.log 2024-04-25T09:12:53.304 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42970.log.gz 2024-04-25T09:12:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50683.log 2024-04-25T09:12:53.305 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43844.log.gz 2024-04-25T09:12:53.305 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49004.log 2024-04-25T09:12:53.306 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44032.log.gz 2024-04-25T09:12:53.306 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43685.log 2024-04-25T09:12:53.307 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50683.log.gz 2024-04-25T09:12:53.307 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47657.log 2024-04-25T09:12:53.308 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49004.log.gz 2024-04-25T09:12:53.308 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.43685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43685.log.gz 2024-04-25T09:12:53.308 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52030.log 2024-04-25T09:12:53.309 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39520.log 2024-04-25T09:12:53.309 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47657.log.gz 2024-04-25T09:12:53.310 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32989.log 2024-04-25T09:12:53.310 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52030.log.gz 2024-04-25T09:12:53.311 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38498.log 2024-04-25T09:12:53.311 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39520.log.gz 2024-04-25T09:12:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53707.log 2024-04-25T09:12:53.312 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32989.log.gz 2024-04-25T09:12:53.312 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.38498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38498.log.gz 2024-04-25T09:12:53.313 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53969.log 2024-04-25T09:12:53.313 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47093.log 2024-04-25T09:12:53.314 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53707.log.gz 2024-04-25T09:12:53.314 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43874.log 2024-04-25T09:12:53.314 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53969.log.gz 2024-04-25T09:12:53.315 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40276.log 2024-04-25T09:12:53.316 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43874.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47093.log.gz 2024-04-25T09:12:53.316 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38493.log 2024-04-25T09:12:53.316 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43874.log.gz 2024-04-25T09:12:53.317 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43788.log 2024-04-25T09:12:53.317 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40276.log.gz 2024-04-25T09:12:53.317 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.38493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38493.log.gz 2024-04-25T09:12:53.318 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52502.log 2024-04-25T09:12:53.319 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34423.log 2024-04-25T09:12:53.319 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43788.log.gz 2024-04-25T09:12:53.320 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52108.log 2024-04-25T09:12:53.320 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52502.log.gz 2024-04-25T09:12:53.321 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37034.log 2024-04-25T09:12:53.321 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34423.log.gz 2024-04-25T09:12:53.322 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37242.log 2024-04-25T09:12:53.322 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52108.log.gz 2024-04-25T09:12:53.323 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36764.log 2024-04-25T09:12:53.323 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37034.log.gz 2024-04-25T09:12:53.323 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48609.log 2024-04-25T09:12:53.324 INFO:teuthology.orchestra.run.smithi059.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37242.log.gz 2024-04-25T09:12:53.324 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38189.log 2024-04-25T09:12:53.324 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36764.log.gz 2024-04-25T09:12:53.325 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38954.log 2024-04-25T09:12:53.325 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48609.log.gz 2024-04-25T09:12:53.326 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47409.log 2024-04-25T09:12:53.326 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38189.log.gz 2024-04-25T09:12:53.327 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41196.log 2024-04-25T09:12:53.327 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38954.log.gz 2024-04-25T09:12:53.328 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36256.log 2024-04-25T09:12:53.328 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47409.log.gz 2024-04-25T09:12:53.329 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39691.log 2024-04-25T09:12:53.329 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41196.log.gz 2024-04-25T09:12:53.330 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36256.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36256.log.gz 2024-04-25T09:12:53.330 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T09:12:53.330 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43029.log 2024-04-25T09:12:53.331 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39691.log.gz 2024-04-25T09:12:53.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35840.log 2024-04-25T09:12:53.332 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40050.log 2024-04-25T09:12:53.332 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43029.log.gz 2024-04-25T09:12:53.333 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37086.log 2024-04-25T09:12:53.333 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35840.log.gz 2024-04-25T09:12:53.334 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.40050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40050.log.gz 2024-04-25T09:12:53.334 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49223.log 2024-04-25T09:12:53.335 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46589.log 2024-04-25T09:12:53.335 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37086.log.gz 2024-04-25T09:12:53.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49885.log 2024-04-25T09:12:53.336 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49223.log.gz 2024-04-25T09:12:53.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46262.log 2024-04-25T09:12:53.337 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46589.log.gz 2024-04-25T09:12:53.337 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44496.log 2024-04-25T09:12:53.338 INFO:teuthology.orchestra.run.smithi059.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49885.log.gz 2024-04-25T09:12:53.338 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.46262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46262.log.gz 2024-04-25T09:12:53.339 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50077.log 2024-04-25T09:12:53.339 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42866.log 2024-04-25T09:12:53.340 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44496.log.gz 2024-04-25T09:12:53.340 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51824.log 2024-04-25T09:12:53.341 INFO:teuthology.orchestra.run.smithi059.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.50077.log.gz 2024-04-25T09:12:53.341 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42866.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42866.log.gz 2024-04-25T09:12:53.342 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49171.log 2024-04-25T09:12:53.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33382.log 2024-04-25T09:12:53.343 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51824.log.gz 2024-04-25T09:12:53.343 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35532.log 2024-04-25T09:12:53.344 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49171.log.gz 2024-04-25T09:12:53.344 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40152.log 2024-04-25T09:12:53.344 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33382.log.gz 2024-04-25T09:12:53.345 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39430.log 2024-04-25T09:12:53.345 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35532.log.gz 2024-04-25T09:12:53.346 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45834.log 2024-04-25T09:12:53.347 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.40152.log.gz 2024-04-25T09:12:53.347 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39430.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39430.log.gz 2024-04-25T09:12:53.347 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45727.log 2024-04-25T09:12:53.348 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46055.log 2024-04-25T09:12:53.348 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45834.log.gz 2024-04-25T09:12:53.349 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52729.log 2024-04-25T09:12:53.349 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45727.log.gz 2024-04-25T09:12:53.350 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38876.log 2024-04-25T09:12:53.350 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46055.log.gz 2024-04-25T09:12:53.351 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38564.log 2024-04-25T09:12:53.351 INFO:teuthology.orchestra.run.smithi059.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.52729.log.gz 2024-04-25T09:12:53.352 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34425.log 2024-04-25T09:12:53.352 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38876.log.gz 2024-04-25T09:12:53.353 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53943.log 2024-04-25T09:12:53.353 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38564.log.gz 2024-04-25T09:12:53.354 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38055.log 2024-04-25T09:12:53.354 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34425.log.gz 2024-04-25T09:12:53.359 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35388.log 2024-04-25T09:12:53.359 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53943.log.gz 2024-04-25T09:12:53.359 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54438.log 2024-04-25T09:12:53.359 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38055.log.gz 2024-04-25T09:12:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40602.log 2024-04-25T09:12:53.360 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35388.log.gz 2024-04-25T09:12:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34634.log 2024-04-25T09:12:53.360 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54438.log.gz 2024-04-25T09:12:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38818.log 2024-04-25T09:12:53.360 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40602.log.gz 2024-04-25T09:12:53.360 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34634.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T09:12:53.360 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34634.log.gz 2024-04-25T09:12:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45266.log 2024-04-25T09:12:53.361 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.38818.log.gz 2024-04-25T09:12:53.361 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38163.log 2024-04-25T09:12:53.362 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46135.log 2024-04-25T09:12:53.362 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45266.log.gz 2024-04-25T09:12:53.363 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37808.log 2024-04-25T09:12:53.363 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38163.log.gz 2024-04-25T09:12:53.364 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5/var/log/ceph/ceph-client.admin.46135.log: --verbose -- /var/log/ceph/ceph-client.admin.53891.log 2024-04-25T09:12:53.364 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37808.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46135.log.gz 2024-04-25T09:12:53.365 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41013.log 2024-04-25T09:12:53.365 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37808.log.gz 2024-04-25T09:12:53.366 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41982.log 2024-04-25T09:12:53.366 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53891.log.gz 2024-04-25T09:12:53.367 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47196.log 2024-04-25T09:12:53.368 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41013.log.gz 2024-04-25T09:12:53.368 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38928.log 2024-04-25T09:12:53.368 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41982.log.gz 2024-04-25T09:12:53.369 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40907.log 2024-04-25T09:12:53.369 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47196.log.gz 2024-04-25T09:12:53.370 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53839.log 2024-04-25T09:12:53.371 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38928.log: /var/log/ceph/ceph-client.admin.40907.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38928.log.gz 2024-04-25T09:12:53.371 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38590.log 2024-04-25T09:12:53.371 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40907.log.gz 2024-04-25T09:12:53.372 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42840.log 2024-04-25T09:12:53.373 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53839.log.gz 2024-04-25T09:12:53.373 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45467.log/var/log/ceph/ceph-client.admin.38590.log: 2024-04-25T09:12:53.374 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42840.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38590.log.gz 2024-04-25T09:12:53.374 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40628.log 2024-04-25T09:12:53.375 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42840.log.gz 2024-04-25T09:12:53.375 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40732.log 2024-04-25T09:12:53.376 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45467.log.gz 2024-04-25T09:12:53.376 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.40628.log: /var/log/ceph/ceph-client.admin.50167.log 2024-04-25T09:12:53.377 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40732.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40628.log.gz 2024-04-25T09:12:53.377 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50995.log 2024-04-25T09:12:53.378 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40732.log.gz 2024-04-25T09:12:53.379 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46765.log 2024-04-25T09:12:53.379 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50167.log.gz 2024-04-25T09:12:53.379 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40326.log 2024-04-25T09:12:53.380 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50995.log.gz 2024-04-25T09:12:53.381 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.46765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46765.log.gz 2024-04-25T09:12:53.381 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53917.log 2024-04-25T09:12:53.382 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36074.log 2024-04-25T09:12:53.382 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40326.log.gz 2024-04-25T09:12:53.383 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51906.log 2024-04-25T09:12:53.383 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53917.log.gz 2024-04-25T09:12:53.384 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46770.log 2024-04-25T09:12:53.384 INFO:teuthology.orchestra.run.smithi178.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T09:12:53.385 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36074.log.gz 2024-04-25T09:12:53.385 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42084.log 2024-04-25T09:12:53.386 INFO:teuthology.orchestra.run.smithi059.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51906.log.gz 2024-04-25T09:12:53.386 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.46770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47976.log 2024-04-25T09:12:53.386 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46770.log.gz 2024-04-25T09:12:53.387 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38730.log 2024-04-25T09:12:53.388 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47976.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.42084.log.gz 2024-04-25T09:12:53.388 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33274.log 2024-04-25T09:12:53.389 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48356.log 2024-04-25T09:12:53.389 INFO:teuthology.orchestra.run.smithi059.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.47976.log.gz 2024-04-25T09:12:53.390 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38730.log.gz 2024-04-25T09:12:53.390 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43322.log 2024-04-25T09:12:53.391 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33274.log.gz 2024-04-25T09:12:53.391 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41365.log 2024-04-25T09:12:53.392 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48356.log.gz 2024-04-25T09:12:53.392 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41677.log 2024-04-25T09:12:53.393 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43322.log.gz 2024-04-25T09:12:53.393 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48486.log 2024-04-25T09:12:53.393 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41365.log.gz 2024-04-25T09:12:53.394 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37632.log 2024-04-25T09:12:53.395 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41677.log.gz 2024-04-25T09:12:53.396 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41873.log 2024-04-25T09:12:53.396 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48486.log.gz 2024-04-25T09:12:53.397 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46083.log 2024-04-25T09:12:53.397 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37632.log.gz 2024-04-25T09:12:53.398 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49609.log 2024-04-25T09:12:53.399 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46083.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41873.log.gz 2024-04-25T09:12:53.399 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41601.log 2024-04-25T09:12:53.399 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46083.log.gz 2024-04-25T09:12:53.400 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37554.log 2024-04-25T09:12:53.400 INFO:teuthology.orchestra.run.smithi059.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.49609.log.gz 2024-04-25T09:12:53.401 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49685.log 2024-04-25T09:12:53.401 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37554.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41601.log.gz 2024-04-25T09:12:53.402 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45001.log 2024-04-25T09:12:53.402 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37554.log.gz 2024-04-25T09:12:53.403 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.49685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35414.log 2024-04-25T09:12:53.403 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49685.log.gz 2024-04-25T09:12:53.404 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53072.log 2024-04-25T09:12:53.404 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45001.log.gz 2024-04-25T09:12:53.405 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38902.log 2024-04-25T09:12:53.405 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35414.log.gz 2024-04-25T09:12:53.406 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40959.log 2024-04-25T09:12:53.406 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53072.log.gz 2024-04-25T09:12:53.407 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51113.log 2024-04-25T09:12:53.408 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38902.log.gz 2024-04-25T09:12:53.408 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42717.log 2024-04-25T09:12:53.408 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40959.log.gz 2024-04-25T09:12:53.409 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38702.log 2024-04-25T09:12:53.409 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51113.log.gz 2024-04-25T09:12:53.410 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54359.log 2024-04-25T09:12:53.410 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42717.log.gz 2024-04-25T09:12:53.411 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34627.log 2024-04-25T09:12:53.411 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.38702.log.gz 2024-04-25T09:12:53.412 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39772.log 2024-04-25T09:12:53.413 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54359.log.gz 2024-04-25T09:12:53.413 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52007.log 2024-04-25T09:12:53.413 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34627.log.gz 2024-04-25T09:12:53.414 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51401.log 2024-04-25T09:12:53.414 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39772.log.gz 2024-04-25T09:12:53.415 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.52007.log: /var/log/ceph/ceph-client.admin.50497.log 2024-04-25T09:12:53.416 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52007.log.gz 2024-04-25T09:12:53.416 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35892.log 2024-04-25T09:12:53.417 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51401.log.gz 2024-04-25T09:12:53.417 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44827.log 2024-04-25T09:12:53.418 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50497.log.gz 2024-04-25T09:12:53.418 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40576.log 2024-04-25T09:12:53.419 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35892.log.gz 2024-04-25T09:12:53.420 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36842.log 2024-04-25T09:12:53.420 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44827.log.gz 2024-04-25T09:12:53.421 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48138.log 2024-04-25T09:12:53.421 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40576.log.gz 2024-04-25T09:12:53.422 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46392.log 2024-04-25T09:12:53.422 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36842.log.gz 2024-04-25T09:12:53.423 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46422.log 2024-04-25T09:12:53.423 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48138.log.gz 2024-04-25T09:12:53.424 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35154.log 2024-04-25T09:12:53.424 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46392.log.gz 2024-04-25T09:12:53.425 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40706.log 2024-04-25T09:12:53.425 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46422.log.gz 2024-04-25T09:12:53.426 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34614.log 2024-04-25T09:12:53.426 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35154.log.gz 2024-04-25T09:12:53.427 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45084.log 2024-04-25T09:12:53.427 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40706.log.gz 2024-04-25T09:12:53.428 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33354.log 2024-04-25T09:12:53.429 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34614.log: /var/log/ceph/ceph-client.admin.45084.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34614.log.gz 2024-04-25T09:12:53.429 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51850.log 2024-04-25T09:12:53.429 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45084.log.gz 2024-04-25T09:12:53.430 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42559.log 2024-04-25T09:12:53.430 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33354.log.gz 2024-04-25T09:12:53.431 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39058.log 2024-04-25T09:12:53.432 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51850.log: /var/log/ceph/ceph-client.admin.42559.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51850.log.gz 2024-04-25T09:12:53.432 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36413.log 2024-04-25T09:12:53.432 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42559.log.gz 2024-04-25T09:12:53.433 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39058.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.39058.log.gz 2024-04-25T09:12:53.434 INFO:teuthology.orchestra.run.smithi059.stderr: --verbose -- /var/log/ceph/ceph-client.0.41728.log 2024-04-25T09:12:53.434 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33302.log 2024-04-25T09:12:53.435 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36413.log.gz 2024-04-25T09:12:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.41728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41728.log.gz 2024-04-25T09:12:53.436 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51507.log 2024-04-25T09:12:53.437 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37528.log 2024-04-25T09:12:53.437 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33302.log.gz 2024-04-25T09:12:53.438 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44156.log 2024-04-25T09:12:53.438 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51507.log.gz 2024-04-25T09:12:53.439 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53480.log 2024-04-25T09:12:53.439 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37528.log.gz 2024-04-25T09:12:53.440 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.44156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44156.log.gz 2024-04-25T09:12:53.440 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44004.log 2024-04-25T09:12:53.441 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54177.log 2024-04-25T09:12:53.441 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53480.log.gz 2024-04-25T09:12:53.442 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37476.log 2024-04-25T09:12:53.443 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44004.log.gz 2024-04-25T09:12:53.443 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49065.log 2024-04-25T09:12:53.444 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54177.log.gz 2024-04-25T09:12:53.445 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53506.log 2024-04-25T09:12:53.445 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37476.log.gz 2024-04-25T09:12:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53342.log 2024-04-25T09:12:53.446 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49065.log.gz 2024-04-25T09:12:53.446 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46475.log 2024-04-25T09:12:53.447 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53342.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53506.log.gz 2024-04-25T09:12:53.448 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53342.log.gz 2024-04-25T09:12:53.448 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48408.log 2024-04-25T09:12:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43428.log 2024-04-25T09:12:53.449 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48408.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.46475.log.gz 2024-04-25T09:12:53.450 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39954.log 2024-04-25T09:12:53.450 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48408.log.gz 2024-04-25T09:12:53.451 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53785.log 2024-04-25T09:12:53.451 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43428.log.gz 2024-04-25T09:12:53.452 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49634.log 2024-04-25T09:12:53.453 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39954.log: /var/log/ceph/ceph-client.admin.53785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49448.log 2024-04-25T09:12:53.453 INFO:teuthology.orchestra.run.smithi059.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.39954.log.gz 2024-04-25T09:12:53.453 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53785.log.gz 2024-04-25T09:12:53.454 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47146.log 2024-04-25T09:12:53.454 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49634.log.gz 2024-04-25T09:12:53.455 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46314.log 2024-04-25T09:12:53.455 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49448.log.gz 2024-04-25T09:12:53.456 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46109.log 2024-04-25T09:12:53.457 INFO:teuthology.orchestra.run.smithi059.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.47146.log.gz 2024-04-25T09:12:53.458 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51283.log 2024-04-25T09:12:53.458 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46314.log.gz 2024-04-25T09:12:53.459 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48713.log 2024-04-25T09:12:53.459 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46109.log.gz 2024-04-25T09:12:53.459 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51375.log 2024-04-25T09:12:53.460 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7%/var/log/ceph/ceph-client.admin.48713.log: -- replaced with /var/log/ceph/ceph-client.admin.51283.log.gz 2024-04-25T09:12:53.461 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50474.log 2024-04-25T09:12:53.461 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48713.log.gz 2024-04-25T09:12:53.462 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51375.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51375.log.gz 2024-04-25T09:12:53.462 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52289.log 2024-04-25T09:12:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52636.log 2024-04-25T09:12:53.463 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50474.log: /var/log/ceph/ceph-client.admin.52289.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50474.log.gz 2024-04-25T09:12:53.464 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35996.log 2024-04-25T09:12:53.464 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52289.log.gz 2024-04-25T09:12:53.465 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42236.log 2024-04-25T09:12:53.465 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52636.log.gz 2024-04-25T09:12:53.466 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46161.log 2024-04-25T09:12:53.466 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35996.log.gz 2024-04-25T09:12:53.467 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39824.log 2024-04-25T09:12:53.467 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42236.log.gz 2024-04-25T09:12:53.468 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35050.log 2024-04-25T09:12:53.468 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.46161.log.gz 2024-04-25T09:12:53.469 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50787.log 2024-04-25T09:12:53.470 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39824.log.gz 2024-04-25T09:12:53.470 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41248.log 2024-04-25T09:12:53.471 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35050.log.gz 2024-04-25T09:12:53.471 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33898.log 2024-04-25T09:12:53.472 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50787.log.gz 2024-04-25T09:12:53.472 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53662.log/var/log/ceph/ceph-client.admin.41248.log: 2024-04-25T09:12:53.473 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41248.log.gz 2024-04-25T09:12:53.474 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44801.log 2024-04-25T09:12:53.474 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33898.log.gz 2024-04-25T09:12:53.475 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45604.log 2024-04-25T09:12:53.475 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53662.log.gz 2024-04-25T09:12:53.475 INFO:teuthology.orchestra.run.smithi059.stderr:gzip/var/log/ceph/ceph-client.admin.44801.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42449.log 2024-04-25T09:12:53.476 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44801.log.gz 2024-04-25T09:12:53.476 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34112.log 2024-04-25T09:12:53.477 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45604.log.gz 2024-04-25T09:12:53.478 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35076.log 2024-04-25T09:12:53.478 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42449.log.gz 2024-04-25T09:12:53.478 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32932.log/var/log/ceph/ceph-client.admin.34112.log: 2024-04-25T09:12:53.479 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34112.log.gz 2024-04-25T09:12:53.480 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37580.log 2024-04-25T09:12:53.480 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35076.log.gz 2024-04-25T09:12:53.481 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.32932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48976.log 2024-04-25T09:12:53.481 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32932.log.gz 2024-04-25T09:12:53.482 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37580.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T09:12:53.482 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2%/var/log/ceph/ceph-client.admin.48976.log: -- replaced with /var/log/ceph/ceph-client.admin.37580.log.gz 2024-04-25T09:12:53.483 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44235.log 2024-04-25T09:12:53.483 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48976.log.gz 2024-04-25T09:12:53.484 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34841.log 2024-04-25T09:12:53.485 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33794.log 2024-04-25T09:12:53.486 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44235.log.gz 2024-04-25T09:12:53.486 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50813.log 2024-04-25T09:12:53.487 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34841.log.gz 2024-04-25T09:12:53.488 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52419.log 2024-04-25T09:12:53.488 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33794.log.gz 2024-04-25T09:12:53.489 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44923.log 2024-04-25T09:12:53.489 INFO:teuthology.orchestra.run.smithi059.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50813.log.gz 2024-04-25T09:12:53.490 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50969.log 2024-04-25T09:12:53.490 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52419.log.gz 2024-04-25T09:12:53.491 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39656.log 2024-04-25T09:12:53.491 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44923.log.gz 2024-04-25T09:12:53.492 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45923.log 2024-04-25T09:12:53.492 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50969.log.gz 2024-04-25T09:12:53.494 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39876.log 2024-04-25T09:12:53.494 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39656.log.gz 2024-04-25T09:12:53.495 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41039.log 2024-04-25T09:12:53.495 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45923.log.gz 2024-04-25T09:12:53.495 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34003.log 2024-04-25T09:12:53.496 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39876.log.gz 2024-04-25T09:12:53.497 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33434.log 2024-04-25T09:12:53.497 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41039.log.gz 2024-04-25T09:12:53.498 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52369.log 2024-04-25T09:12:53.498 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34003.log.gz 2024-04-25T09:12:53.499 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54388.log 2024-04-25T09:12:53.499 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33434.log.gz 2024-04-25T09:12:53.500 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45780.log 2024-04-25T09:12:53.501 INFO:teuthology.orchestra.run.smithi059.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52369.log.gz 2024-04-25T09:12:53.501 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43454.log 2024-04-25T09:12:53.502 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54388.log.gz 2024-04-25T09:12:53.502 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44317.log 2024-04-25T09:12:53.502 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45780.log.gz 2024-04-25T09:12:53.504 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46719.log 2024-04-25T09:12:53.504 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43454.log.gz 2024-04-25T09:12:53.505 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36230.log 2024-04-25T09:12:53.505 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46719.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44317.log.gz 2024-04-25T09:12:53.506 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46211.log 2024-04-25T09:12:53.506 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46719.log.gz 2024-04-25T09:12:53.507 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48869.log 2024-04-25T09:12:53.507 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36230.log.gz 2024-04-25T09:12:53.508 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50865.log 2024-04-25T09:12:53.508 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46211.log.gz 2024-04-25T09:12:53.509 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33408.log 2024-04-25T09:12:53.509 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48869.log.gz 2024-04-25T09:12:53.510 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47300.log 2024-04-25T09:12:53.510 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50865.log.gz 2024-04-25T09:12:53.511 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39235.log 2024-04-25T09:12:53.512 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33408.log.gz 2024-04-25T09:12:53.512 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47798.log 2024-04-25T09:12:53.512 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47300.log.gz 2024-04-25T09:12:53.514 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36022.log 2024-04-25T09:12:53.514 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39235.log.gz 2024-04-25T09:12:53.515 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42892.log 2024-04-25T09:12:53.515 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36022.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.47798.log.gz 2024-04-25T09:12:53.516 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36152.log 2024-04-25T09:12:53.516 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36022.log.gz 2024-04-25T09:12:53.517 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45240.log 2024-04-25T09:12:53.517 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42892.log.gz 2024-04-25T09:12:53.518 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38371.log 2024-04-25T09:12:53.518 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36152.log.gz 2024-04-25T09:12:53.519 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45493.log 2024-04-25T09:12:53.519 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45240.log.gz 2024-04-25T09:12:53.520 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35814.log 2024-04-25T09:12:53.521 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38371.log.gz 2024-04-25T09:12:53.522 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40353.log 2024-04-25T09:12:53.522 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45493.log.gz 2024-04-25T09:12:53.522 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50129.log 2024-04-25T09:12:53.523 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35814.log.gz 2024-04-25T09:12:53.524 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33614.log 2024-04-25T09:12:53.524 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40353.log.gz 2024-04-25T09:12:53.525 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49500.log 2024-04-25T09:12:53.525 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50129.log.gz 2024-04-25T09:12:53.526 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37704.log 2024-04-25T09:12:53.526 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33614.log.gz 2024-04-25T09:12:53.527 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50300.log 2024-04-25T09:12:53.527 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49500.log.gz 2024-04-25T09:12:53.528 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53759.log 2024-04-25T09:12:53.529 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37704.log.gz 2024-04-25T09:12:53.529 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45897.log 2024-04-25T09:12:53.529 INFO:teuthology.orchestra.run.smithi059.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50300.log.gz 2024-04-25T09:12:53.530 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46891.log 2024-04-25T09:12:53.531 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53759.log.gz 2024-04-25T09:12:53.531 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54412.log 2024-04-25T09:12:53.532 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45897.log.gz 2024-04-25T09:12:53.533 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50032.log 2024-04-25T09:12:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54412.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46891.log.gz 2024-04-25T09:12:53.534 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T09:12:53.534 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54412.log.gz 2024-04-25T09:12:53.535 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53584.log 2024-04-25T09:12:53.536 INFO:teuthology.orchestra.run.smithi059.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.50032.log.gz 2024-04-25T09:12:53.536 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51740.log 2024-04-25T09:12:53.537 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44751.log 2024-04-25T09:12:53.538 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53584.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53584.log.gz/var/log/ceph/ceph-client.0.51740.log: 2024-04-25T09:12:53.538 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51740.log.gz 2024-04-25T09:12:53.540 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44751.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.44751.log.gz 2024-04-25T09:12:53.541 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33872.log 2024-04-25T09:12:53.542 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35310.log 2024-04-25T09:12:53.543 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53865.log 2024-04-25T09:12:53.544 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33872.log.gz 2024-04-25T09:12:53.544 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35310.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35310.log.gz 2024-04-25T09:12:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53865.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53865.log.gz 2024-04-25T09:12:53.546 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42533.log 2024-04-25T09:12:53.547 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37782.log 2024-04-25T09:12:53.549 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42507.log 2024-04-25T09:12:53.549 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42533.log.gz 2024-04-25T09:12:53.550 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37782.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37782.log.gz 2024-04-25T09:12:53.551 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42507.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42507.log.gz 2024-04-25T09:12:53.552 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33820.log 2024-04-25T09:12:53.553 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34835.log 2024-04-25T09:12:53.554 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33820.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33820.log.gz 2024-04-25T09:12:53.555 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44060.log 2024-04-25T09:12:53.555 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34835.log.gz 2024-04-25T09:12:53.556 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52685.log 2024-04-25T09:12:53.557 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52465.log 2024-04-25T09:12:53.558 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1%/var/log/ceph/ceph-client.admin.52685.log: -- replaced with /var/log/ceph/ceph-client.admin.44060.log.gz 2024-04-25T09:12:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50552.log 2024-04-25T09:12:53.559 INFO:teuthology.orchestra.run.smithi059.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.52685.log.gz 2024-04-25T09:12:53.559 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.52465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52465.log.gz 2024-04-25T09:12:53.560 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51048.log 2024-04-25T09:12:53.561 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48164.log 2024-04-25T09:12:53.561 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50552.log.gz 2024-04-25T09:12:53.562 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34055.log 2024-04-25T09:12:53.562 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51048.log.gz 2024-04-25T09:12:53.563 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41124.log 2024-04-25T09:12:53.563 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48164.log.gz 2024-04-25T09:12:53.565 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42665.log 2024-04-25T09:12:53.565 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34055.log.gz 2024-04-25T09:12:53.566 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41124.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41124.log.gz 2024-04-25T09:12:53.567 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42665.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42665.log.gz 2024-04-25T09:12:53.567 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43680.log 2024-04-25T09:12:53.568 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53148.log 2024-04-25T09:12:53.570 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.43680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49959.log 2024-04-25T09:12:53.570 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43680.log.gz 2024-04-25T09:12:53.571 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53148.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53148.log.gz 2024-04-25T09:12:53.572 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49959.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.49959.log.gz 2024-04-25T09:12:53.573 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51312.log 2024-04-25T09:12:53.574 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51956.log 2024-04-25T09:12:53.576 INFO:teuthology.orchestra.run.smithi178.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T09:12:53.576 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47043.log 2024-04-25T09:12:53.576 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51312.log.gz 2024-04-25T09:12:53.577 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51956.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51956.log.gz 2024-04-25T09:12:53.578 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47043.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.47043.log.gz 2024-04-25T09:12:53.579 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39398.log 2024-04-25T09:12:53.580 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52980.log 2024-04-25T09:12:53.581 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47683.log 2024-04-25T09:12:53.582 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39398.log.gz 2024-04-25T09:12:53.582 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52980.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52980.log.gz 2024-04-25T09:12:53.583 INFO:teuthology.orchestra.run.smithi178.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T09:12:53.584 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47683.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.47683.log.gz 2024-04-25T09:12:53.584 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33142.log 2024-04-25T09:12:53.586 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34268.log 2024-04-25T09:12:53.587 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37912.log 2024-04-25T09:12:53.587 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33142.log.gz 2024-04-25T09:12:53.588 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34268.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34268.log.gz 2024-04-25T09:12:53.589 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37912.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37912.log.gz 2024-04-25T09:12:53.590 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42996.log 2024-04-25T09:12:53.591 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37003.log 2024-04-25T09:12:53.592 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34839.log 2024-04-25T09:12:53.593 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42996.log.gz 2024-04-25T09:12:53.593 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37003.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37003.log.gz 2024-04-25T09:12:53.594 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34839.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34839.log.gz 2024-04-25T09:12:53.595 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48635.log 2024-04-25T09:12:53.596 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34630.log 2024-04-25T09:12:53.598 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40004.log 2024-04-25T09:12:53.598 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48635.log.gz 2024-04-25T09:12:53.599 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34630.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34630.log.gz 2024-04-25T09:12:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40004.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40004.log.gz 2024-04-25T09:12:53.600 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43259.log 2024-04-25T09:12:53.601 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42481.log 2024-04-25T09:12:53.603 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54307.log 2024-04-25T09:12:53.603 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43259.log.gz 2024-04-25T09:12:53.604 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42481.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42481.log.gz 2024-04-25T09:12:53.605 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52082.log 2024-04-25T09:12:53.605 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54307.log.gz 2024-04-25T09:12:53.606 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35102.log 2024-04-25T09:12:53.608 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52606.log 2024-04-25T09:12:53.608 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52082.log.gz 2024-04-25T09:12:53.609 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35102.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35102.log.gz 2024-04-25T09:12:53.611 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52606.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52606.log.gz 2024-04-25T09:12:53.611 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33087.log 2024-04-25T09:12:53.612 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38642.log 2024-04-25T09:12:53.613 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45415.log 2024-04-25T09:12:53.613 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33087.log.gz 2024-04-25T09:12:53.614 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38642.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38642.log.gz 2024-04-25T09:12:53.615 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45415.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45415.log.gz 2024-04-25T09:12:53.616 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51204.log 2024-04-25T09:12:53.617 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43710.log 2024-04-25T09:12:53.618 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35206.log 2024-04-25T09:12:53.619 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51204.log.gz 2024-04-25T09:12:53.619 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43710.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43710.log.gz 2024-04-25T09:12:53.620 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35206.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35206.log.gz 2024-04-25T09:12:53.621 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35970.log 2024-04-25T09:12:53.622 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36951.log 2024-04-25T09:12:53.624 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45110.log 2024-04-25T09:12:53.624 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35970.log.gz 2024-04-25T09:12:53.625 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36951.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36951.log.gz 2024-04-25T09:12:53.626 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45110.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45110.log.gz 2024-04-25T09:12:53.626 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45949.log 2024-04-25T09:12:53.627 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33328.log 2024-04-25T09:12:53.629 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53018.log 2024-04-25T09:12:53.629 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45949.log.gz 2024-04-25T09:12:53.630 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33328.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33328.log.gz 2024-04-25T09:12:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53018.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53018.log.gz 2024-04-25T09:12:53.631 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34624.log 2024-04-25T09:12:53.633 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51687.log 2024-04-25T09:12:53.634 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38397.log 2024-04-25T09:12:53.634 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34624.log.gz 2024-04-25T09:12:53.635 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51687.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51687.log.gz 2024-04-25T09:12:53.637 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33113.log 2024-04-25T09:12:53.637 INFO:teuthology.orchestra.run.smithi059.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38397.log.gz 2024-04-25T09:12:53.638 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42769.log 2024-04-25T09:12:53.640 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47733.log 2024-04-25T09:12:53.640 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33113.log.gz 2024-04-25T09:12:53.641 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42769.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42769.log.gz 2024-04-25T09:12:53.642 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47733.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47733.log.gz 2024-04-25T09:12:53.642 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34190.log 2024-04-25T09:12:53.644 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36577.log 2024-04-25T09:12:53.645 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53290.log 2024-04-25T09:12:53.645 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34190.log.gz 2024-04-25T09:12:53.646 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36577.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36577.log.gz 2024-04-25T09:12:53.647 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53290.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53290.log.gz 2024-04-25T09:12:53.648 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43061.log 2024-04-25T09:12:53.649 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52878.log 2024-04-25T09:12:53.650 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48434.log 2024-04-25T09:12:53.650 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43061.log.gz 2024-04-25T09:12:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52878.log: /var/log/ceph/ceph-client.admin.48434.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.52878.log.gz 2024-04-25T09:12:53.653 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48434.log.gz 2024-04-25T09:12:53.653 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48460.log 2024-04-25T09:12:53.654 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47564.log 2024-04-25T09:12:53.655 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36629.log 2024-04-25T09:12:53.656 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48460.log.gz 2024-04-25T09:12:53.656 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47564.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47564.log.gz 2024-04-25T09:12:53.657 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43532.log 2024-04-25T09:12:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36629.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36629.log.gz 2024-04-25T09:12:53.658 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53316.log 2024-04-25T09:12:53.659 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47784.log 2024-04-25T09:12:53.660 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43532.log.gz 2024-04-25T09:12:53.660 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53316.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53316.log.gz 2024-04-25T09:12:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42312.log 2024-04-25T09:12:53.661 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.47784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47784.log.gz 2024-04-25T09:12:53.662 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43402.log 2024-04-25T09:12:53.663 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51585.log 2024-04-25T09:12:53.663 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.42312.log.gz 2024-04-25T09:12:53.664 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43402.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43402.log.gz 2024-04-25T09:12:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51585.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51585.log.gz 2024-04-25T09:12:53.666 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50424.log 2024-04-25T09:12:53.667 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41330.log 2024-04-25T09:12:53.668 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50371.log 2024-04-25T09:12:53.669 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41330.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50424.log.gz 2024-04-25T09:12:53.670 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41330.log.gz 2024-04-25T09:12:53.671 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50371.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50371.log.gz 2024-04-25T09:12:53.672 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34629.log 2024-04-25T09:12:53.673 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34294.log 2024-04-25T09:12:53.674 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34629.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T09:12:53.675 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34629.log.gz 2024-04-25T09:12:53.676 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34294.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34294.log.gz 2024-04-25T09:12:53.679 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.log: 86.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T09:12:53.680 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43205.log 2024-04-25T09:12:53.681 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43179.log 2024-04-25T09:12:53.683 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39136.log 2024-04-25T09:12:53.683 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43205.log.gz 2024-04-25T09:12:53.683 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43179.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43179.log.gz 2024-04-25T09:12:53.685 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39136.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39136.log.gz 2024-04-25T09:12:53.685 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37424.log 2024-04-25T09:12:53.686 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33977.log 2024-04-25T09:12:53.688 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48778.log 2024-04-25T09:12:53.688 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37424.log.gz 2024-04-25T09:12:53.689 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33977.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33977.log.gz 2024-04-25T09:12:53.690 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48778.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48778.log.gz 2024-04-25T09:12:53.690 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52343.log 2024-04-25T09:12:53.691 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51178.log 2024-04-25T09:12:53.693 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47274.log 2024-04-25T09:12:53.693 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52343.log.gz 2024-04-25T09:12:53.694 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51178.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51178.log.gz 2024-04-25T09:12:53.695 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47274.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47274.log.gz 2024-04-25T09:12:53.695 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50299.log 2024-04-25T09:12:53.696 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51772.log 2024-04-25T09:12:53.699 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49249.log 2024-04-25T09:12:53.699 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51772.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.50299.log.gz 2024-04-25T09:12:53.699 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51772.log.gz 2024-04-25T09:12:53.700 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49249.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49249.log.gz 2024-04-25T09:12:53.701 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53532.log 2024-04-25T09:12:53.702 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36126.log 2024-04-25T09:12:53.703 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53532.log.gz 2024-04-25T09:12:53.704 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48224.log 2024-04-25T09:12:53.705 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33246.log 2024-04-25T09:12:53.706 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36126.log.gz 2024-04-25T09:12:53.706 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36204.log 2024-04-25T09:12:53.707 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48224.log.gz 2024-04-25T09:12:53.707 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48250.log 2024-04-25T09:12:53.708 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33246.log.gz 2024-04-25T09:12:53.709 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36204.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36204.log.gz 2024-04-25T09:12:53.710 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48250.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48250.log.gz 2024-04-25T09:12:53.710 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37938.log 2024-04-25T09:12:53.711 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49119.log 2024-04-25T09:12:53.713 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41748.log 2024-04-25T09:12:53.713 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37938.log.gz 2024-04-25T09:12:53.714 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49119.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49119.log.gz 2024-04-25T09:12:53.715 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41748.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41748.log.gz 2024-04-25T09:12:53.715 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42397.log 2024-04-25T09:12:53.716 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27663.log 2024-04-25T09:12:53.718 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42397.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42397.log.gz 2024-04-25T09:12:53.719 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.27663.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27663.log.gz 2024-04-25T09:12:53.720 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49197.log 2024-04-25T09:12:53.721 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44675.log 2024-04-25T09:12:53.722 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34834.log 2024-04-25T09:12:53.723 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49197.log.gz 2024-04-25T09:12:53.724 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44675.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44675.log.gz 2024-04-25T09:12:53.724 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34834.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34834.log.gz 2024-04-25T09:12:53.725 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46452.log 2024-04-25T09:12:53.726 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35180.log 2024-04-25T09:12:53.727 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37346.log 2024-04-25T09:12:53.728 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46452.log.gz 2024-04-25T09:12:53.728 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35180.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35180.log.gz 2024-04-25T09:12:53.729 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37346.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37346.log.gz 2024-04-25T09:12:53.730 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39261.log 2024-04-25T09:12:53.731 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38319.log 2024-04-25T09:12:53.733 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48026.log 2024-04-25T09:12:53.733 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39261.log.gz 2024-04-25T09:12:53.733 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38319.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38319.log.gz 2024-04-25T09:12:53.735 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48026.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48026.log.gz 2024-04-25T09:12:53.735 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40490.log 2024-04-25T09:12:53.736 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36465.log 2024-04-25T09:12:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41775.log 2024-04-25T09:12:53.738 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40490.log.gz 2024-04-25T09:12:53.738 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36465.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36465.log.gz 2024-04-25T09:12:53.740 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41775.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.41775.log.gz 2024-04-25T09:12:53.740 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49526.log 2024-04-25T09:12:53.741 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34424.log 2024-04-25T09:12:53.743 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37320.log 2024-04-25T09:12:53.743 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49526.log.gz 2024-04-25T09:12:53.744 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34424.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34424.log.gz 2024-04-25T09:12:53.745 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37320.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37320.log.gz 2024-04-25T09:12:53.745 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37860.log 2024-04-25T09:12:53.746 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36790.log 2024-04-25T09:12:53.748 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43762.log 2024-04-25T09:12:53.748 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37860.log.gz 2024-04-25T09:12:53.749 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36790.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36790.log.gz 2024-04-25T09:12:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43762.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43762.log.gz 2024-04-25T09:12:53.750 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40933.log 2024-04-25T09:12:53.752 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36491.log 2024-04-25T09:12:53.753 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51637.log 2024-04-25T09:12:53.754 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40933.log.gz 2024-04-25T09:12:53.754 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36491.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36491.log.gz 2024-04-25T09:12:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51637.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.51637.log.gz 2024-04-25T09:12:53.756 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42585.log 2024-04-25T09:12:53.757 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41222.log 2024-04-25T09:12:53.759 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44891.log 2024-04-25T09:12:53.759 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42585.log.gz 2024-04-25T09:12:53.760 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41222.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41222.log.gz 2024-04-25T09:12:53.761 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49850.log 2024-04-25T09:12:53.761 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44891.log.gz 2024-04-25T09:12:53.762 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42743.log 2024-04-25T09:12:53.764 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45636.log 2024-04-25T09:12:53.764 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49850.log.gz 2024-04-25T09:12:53.765 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42743.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42743.log.gz 2024-04-25T09:12:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45636.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45636.log.gz 2024-04-25T09:12:53.766 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52663.log 2024-04-25T09:12:53.768 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39717.log 2024-04-25T09:12:53.769 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51559.log 2024-04-25T09:12:53.769 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52663.log.gz 2024-04-25T09:12:53.770 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39717.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39717.log.gz 2024-04-25T09:12:53.771 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51559.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51559.log.gz 2024-04-25T09:12:53.772 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41575.log 2024-04-25T09:12:53.773 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51021.log 2024-04-25T09:12:53.774 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53098.log 2024-04-25T09:12:53.774 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41575.log.gz 2024-04-25T09:12:53.775 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51021.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51021.log.gz 2024-04-25T09:12:53.777 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53098.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.53098.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47900.log 2024-04-25T09:12:53.778 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-25T09:12:53.778 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45806.log 2024-04-25T09:12:53.781 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34408.log 2024-04-25T09:12:53.781 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45806.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47900.log.gz 2024-04-25T09:12:53.781 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45806.log.gz 2024-04-25T09:12:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34408.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34408.log.gz 2024-04-25T09:12:53.782 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36048.log 2024-04-25T09:12:53.783 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51611.log 2024-04-25T09:12:53.785 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34421.log 2024-04-25T09:12:53.785 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36048.log.gz 2024-04-25T09:12:53.786 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51611.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51611.log.gz 2024-04-25T09:12:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34421.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34421.log.gz 2024-04-25T09:12:53.787 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33951.log 2024-04-25T09:12:53.788 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40549.log 2024-04-25T09:12:53.790 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49794.log 2024-04-25T09:12:53.790 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33951.log.gz 2024-04-25T09:12:53.791 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40549.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40549.log.gz 2024-04-25T09:12:53.792 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49794.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49794.log.gz 2024-04-25T09:12:53.793 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50631.log 2024-04-25T09:12:53.794 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39928.log 2024-04-25T09:12:53.795 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48895.log 2024-04-25T09:12:53.795 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50631.log.gz 2024-04-25T09:12:53.796 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39928.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39928.log.gz 2024-04-25T09:12:53.797 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46515.log 2024-04-25T09:12:53.798 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44183.log 2024-04-25T09:12:53.799 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48895.log.gz 2024-04-25T09:12:53.799 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36551.log 2024-04-25T09:12:53.800 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44183.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.46515.log.gz 2024-04-25T09:12:53.801 INFO:teuthology.orchestra.run.smithi059.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44183.log.gz 2024-04-25T09:12:53.802 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36551.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36551.log.gz 2024-04-25T09:12:53.802 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38447.log 2024-04-25T09:12:53.804 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33512.log 2024-04-25T09:12:53.805 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42371.log 2024-04-25T09:12:53.805 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38447.log.gz 2024-04-25T09:12:53.806 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33512.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33512.log.gz 2024-04-25T09:12:53.807 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42371.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42371.log.gz 2024-04-25T09:12:53.808 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44878.log 2024-04-25T09:12:53.809 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46551.log 2024-04-25T09:12:53.810 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.44878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44878.log.gz 2024-04-25T09:12:53.810 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38980.log 2024-04-25T09:12:53.811 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37756.log 2024-04-25T09:12:53.812 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46551.log.gz 2024-04-25T09:12:53.812 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38980.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38980.log.gz 2024-04-25T09:12:53.814 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37756.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37756.log.gz 2024-04-25T09:12:53.814 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52315.log 2024-04-25T09:12:53.815 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42008.log 2024-04-25T09:12:53.817 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48382.log 2024-04-25T09:12:53.817 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52315.log.gz 2024-04-25T09:12:53.818 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42008.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.42008.log.gz 2024-04-25T09:12:53.819 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48382.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48382.log.gz 2024-04-25T09:12:53.820 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50605.log 2024-04-25T09:12:53.821 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52707.log 2024-04-25T09:12:53.822 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39574.log 2024-04-25T09:12:53.823 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50605.log.gz 2024-04-25T09:12:53.823 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52707.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52707.log.gz 2024-04-25T09:12:53.824 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39574.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39574.log.gz 2024-04-25T09:12:53.825 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34320.log 2024-04-25T09:12:53.826 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43584.log 2024-04-25T09:12:53.828 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44725.log 2024-04-25T09:12:53.828 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34320.log.gz 2024-04-25T09:12:53.829 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43584.log: /var/log/ceph/ceph-client.admin.44725.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.43584.log.gz 2024-04-25T09:12:53.829 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44725.log.gz 2024-04-25T09:12:53.830 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51257.log 2024-04-25T09:12:53.831 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39207.log 2024-04-25T09:12:53.833 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51230.log 2024-04-25T09:12:53.833 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51257.log.gz 2024-04-25T09:12:53.834 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39207.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39207.log.gz 2024-04-25T09:12:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51230.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51230.log.gz 2024-04-25T09:12:53.835 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50891.log 2024-04-25T09:12:53.836 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46003.log 2024-04-25T09:12:53.838 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50943.log 2024-04-25T09:12:53.838 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50891.log.gz 2024-04-25T09:12:53.839 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46003.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46003.log.gz 2024-04-25T09:12:53.840 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50943.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50943.log.gz 2024-04-25T09:12:53.841 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39798.log 2024-04-25T09:12:53.842 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38850.log 2024-04-25T09:12:53.844 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48843.log 2024-04-25T09:12:53.844 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39798.log.gz 2024-04-25T09:12:53.844 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38850.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38850.log.gz 2024-04-25T09:12:53.845 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48843.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48843.log.gz 2024-04-25T09:12:53.846 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47534.log 2024-04-25T09:12:53.847 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36386.log 2024-04-25T09:12:53.848 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50735.log 2024-04-25T09:12:53.850 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36386.log: 88.4% 92.4% -- replaced with /var/log/ceph/ceph-client.admin.47534.log.gz 2024-04-25T09:12:53.850 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36386.log.gz 2024-04-25T09:12:53.851 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50735.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50735.log.gz 2024-04-25T09:12:53.851 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48531.log 2024-04-25T09:12:53.852 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40758.log 2024-04-25T09:12:53.854 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47950.log 2024-04-25T09:12:53.854 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48531.log.gz 2024-04-25T09:12:53.855 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40758.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40758.log.gz 2024-04-25T09:12:53.857 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47950.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47950.log.gz 2024-04-25T09:12:53.857 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39365.log 2024-04-25T09:12:53.858 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37112.log 2024-04-25T09:12:53.859 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53995.log 2024-04-25T09:12:53.859 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39365.log.gz 2024-04-25T09:12:53.860 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37112.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37112.log.gz 2024-04-25T09:12:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53995.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53995.log.gz 2024-04-25T09:12:53.862 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35258.log 2024-04-25T09:12:53.863 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41523.log 2024-04-25T09:12:53.865 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41798.log 2024-04-25T09:12:53.865 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35258.log.gz 2024-04-25T09:12:53.865 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41523.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41523.log.gz 2024-04-25T09:12:53.867 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41798.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.41798.log.gz 2024-04-25T09:12:53.867 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34081.log 2024-04-25T09:12:53.868 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49145.log 2024-04-25T09:12:53.870 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35918.log 2024-04-25T09:12:53.870 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34081.log.gz 2024-04-25T09:12:53.871 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49145.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49145.log.gz 2024-04-25T09:12:53.872 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35918.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.35918.log.gz 2024-04-25T09:12:53.872 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50247.log 2024-04-25T09:12:53.874 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39743.log 2024-04-25T09:12:53.876 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49403.log 2024-04-25T09:12:53.876 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39743.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.50247.log.gz 2024-04-25T09:12:53.876 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39743.log.gz 2024-04-25T09:12:53.877 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.49403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49403.log.gz 2024-04-25T09:12:53.877 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40224.log 2024-04-25T09:12:53.879 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48922.log 2024-04-25T09:12:53.880 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45519.log 2024-04-25T09:12:53.881 INFO:teuthology.orchestra.run.smithi059.stderr: 91.1%/var/log/ceph/ceph-client.admin.48922.log: -- replaced with /var/log/ceph/ceph-client.admin.40224.log.gz 2024-04-25T09:12:53.881 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48922.log.gz 2024-04-25T09:12:53.882 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45519.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45519.log.gz 2024-04-25T09:12:53.883 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39600.log 2024-04-25T09:12:53.884 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T09:12:53.885 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45188.log 2024-04-25T09:12:53.885 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39600.log.gz 2024-04-25T09:12:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.45188.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45188.log.gz 2024-04-25T09:12:53.888 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48557.log 2024-04-25T09:12:53.890 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T09:12:53.890 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T09:12:53.891 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48557.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48557.log.gz 2024-04-25T09:12:53.893 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38109.log 2024-04-25T09:12:53.894 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42345.log 2024-04-25T09:12:53.896 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45571.log 2024-04-25T09:12:53.896 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38109.log.gz 2024-04-25T09:12:53.901 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46643.log 2024-04-25T09:12:53.901 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42345.log.gz 2024-04-25T09:12:53.901 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43153.log 2024-04-25T09:12:53.901 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45571.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45571.log.gz 2024-04-25T09:12:53.901 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43153.log: /var/log/ceph/ceph-client.admin.46643.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43153.log.gz 2024-04-25T09:12:53.901 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34411.log 2024-04-25T09:12:53.901 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46643.log.gz 2024-04-25T09:12:53.903 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34411.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T09:12:53.904 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40386.log 2024-04-25T09:12:53.904 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34411.log.gz 2024-04-25T09:12:53.905 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40985.log 2024-04-25T09:12:53.906 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40386.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40386.log.gz 2024-04-25T09:12:53.909 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36871.log 2024-04-25T09:12:53.909 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40985.log.gz 2024-04-25T09:12:53.911 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53199.log 2024-04-25T09:12:53.912 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36871.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36871.log.gz 2024-04-25T09:12:53.914 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54073.log 2024-04-25T09:12:53.916 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.53199.log: /var/log/ceph/ceph-client.admin.54073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53199.log.gz 2024-04-25T09:12:53.917 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45701.log 2024-04-25T09:12:53.918 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54073.log.gz 2024-04-25T09:12:53.920 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45701.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45701.log.gz 2024-04-25T09:12:53.921 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52754.log 2024-04-25T09:12:53.924 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38796.log 2024-04-25T09:12:53.925 INFO:teuthology.orchestra.run.smithi059.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52754.log.gz 2024-04-25T09:12:53.927 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44287.log 2024-04-25T09:12:53.928 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38796.log.gz 2024-04-25T09:12:53.930 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42058.log 2024-04-25T09:12:53.935 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42058.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42058.log.gz 2024-04-25T09:12:53.935 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44287.log.gz 2024-04-25T09:12:53.935 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38538.log 2024-04-25T09:12:53.937 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37190.log 2024-04-25T09:12:53.937 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38538.log.gz 2024-04-25T09:12:53.938 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51455.log 2024-04-25T09:12:53.943 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37190.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37190.log.gz 2024-04-25T09:12:53.943 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47439.log 2024-04-25T09:12:53.943 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51455.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51455.log.gz 2024-04-25T09:12:53.945 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33924.log 2024-04-25T09:12:53.947 INFO:teuthology.orchestra.run.smithi059.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45389.log 2024-04-25T09:12:53.948 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33924.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33924.log.gz 2024-04-25T09:12:53.948 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47439.log.gz 2024-04-25T09:12:53.951 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45389.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45389.log.gz 2024-04-25T09:12:53.952 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35128.log 2024-04-25T09:12:53.955 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35128.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35128.log.gz 2024-04-25T09:12:53.955 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40153.log 2024-04-25T09:12:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40153.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.40153.log.gz 2024-04-25T09:12:53.958 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37834.log 2024-04-25T09:12:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37834.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37834.log.gz 2024-04-25T09:12:53.964 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48661.log 2024-04-25T09:12:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48661.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48661.log.gz 2024-04-25T09:12:53.965 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37216.log 2024-04-25T09:12:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37216.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37216.log.gz 2024-04-25T09:12:53.967 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36282.log 2024-04-25T09:12:53.970 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42262.log 2024-04-25T09:12:53.971 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36282.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36282.log.gz 2024-04-25T09:12:53.974 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42262.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.42262.log.gz 2024-04-25T09:12:53.974 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44572.log 2024-04-25T09:12:54.007 INFO:teuthology.orchestra.run.smithi059.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T09:12:54.011 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52056.log 2024-04-25T09:12:54.011 INFO:teuthology.orchestra.run.smithi059.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44572.log.gz 2024-04-25T09:12:54.014 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52056.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52056.log.gz 2024-04-25T09:12:54.014 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35362.log 2024-04-25T09:12:54.017 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35362.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35362.log.gz 2024-04-25T09:12:54.017 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34164.log 2024-04-25T09:12:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34164.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.34164.log.gz 2024-04-25T09:12:54.020 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43634.log 2024-04-25T09:12:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50578.log 2024-04-25T09:12:54.025 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43634.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43634.log.gz 2024-04-25T09:12:54.026 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50578.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33564.log 2024-04-25T09:12:54.026 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50578.log.gz 2024-04-25T09:12:54.028 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52554.log 2024-04-25T09:12:54.030 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33564.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.33564.log.gz 2024-04-25T09:12:54.032 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54333.log 2024-04-25T09:12:54.034 INFO:teuthology.orchestra.run.smithi059.stderr:gzip/var/log/ceph/ceph-client.admin.52554.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37994.log 2024-04-25T09:12:54.037 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5%/var/log/ceph/ceph-client.admin.37994.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37994.log.gz 2024-04-25T09:12:54.038 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52554.log.gz 2024-04-25T09:12:54.039 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54333.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42611.log 2024-04-25T09:12:54.039 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54333.log.gz 2024-04-25T09:12:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42611.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42611.log.gz 2024-04-25T09:12:54.042 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49768.log 2024-04-25T09:12:54.045 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49768.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49768.log.gz 2024-04-25T09:12:54.045 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52134.log 2024-04-25T09:12:54.046 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47779.log 2024-04-25T09:12:54.051 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.47779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47779.log.gz 2024-04-25T09:12:54.051 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52134.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52134.log.gz 2024-04-25T09:12:54.051 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52905.log 2024-04-25T09:12:54.055 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52905.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.52905.log.gz 2024-04-25T09:12:54.055 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49586.log 2024-04-25T09:12:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49586.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49586.log.gz 2024-04-25T09:12:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43506.log 2024-04-25T09:12:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43506.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43506.log.gz 2024-04-25T09:12:54.061 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49886.log 2024-04-25T09:12:54.063 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51481.log 2024-04-25T09:12:54.066 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51481.log: /var/log/ceph/ceph-client.admin.49886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45214.log 2024-04-25T09:12:54.068 INFO:teuthology.orchestra.run.smithi059.stderr: 87.5% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49886.log.gz 2024-04-25T09:12:54.068 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51481.log.gz 2024-04-25T09:12:54.070 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39902.log 2024-04-25T09:12:54.074 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45214.log: /var/log/ceph/ceph-client.admin.39902.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53044.log 2024-04-25T09:12:54.075 INFO:teuthology.orchestra.run.smithi059.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39902.log.gz 2024-04-25T09:12:54.075 INFO:teuthology.orchestra.run.smithi059.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45214.log.gz 2024-04-25T09:12:54.077 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50761.log 2024-04-25T09:12:54.082 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53044.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53044.log.gz 2024-04-25T09:12:54.082 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50761.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50761.log.gz 2024-04-25T09:12:54.082 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35643.log 2024-04-25T09:12:54.084 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.35643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35643.log.gz 2024-04-25T09:12:54.084 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36655.log 2024-04-25T09:12:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36655.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36655.log.gz 2024-04-25T09:12:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49716.log 2024-04-25T09:12:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49716.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49716.log.gz 2024-04-25T09:12:54.091 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33486.log 2024-04-25T09:12:54.092 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53264.log 2024-04-25T09:12:54.094 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33486.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33486.log.gz 2024-04-25T09:12:54.094 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40102.log 2024-04-25T09:12:54.096 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53264.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53264.log.gz 2024-04-25T09:12:54.097 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40102.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.40102.log.gz 2024-04-25T09:12:54.097 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47628.log 2024-04-25T09:12:54.099 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53636.log 2024-04-25T09:12:54.100 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47628.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47628.log.gz 2024-04-25T09:12:54.101 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34623.log 2024-04-25T09:12:54.102 INFO:teuthology.orchestra.run.smithi059.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53636.log.gz 2024-04-25T09:12:54.102 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36603.log 2024-04-25T09:12:54.104 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34623.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34623.log.gz 2024-04-25T09:12:54.105 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44975.log 2024-04-25T09:12:54.106 INFO:teuthology.orchestra.run.smithi059.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36603.log.gz 2024-04-25T09:12:54.106 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40075.log 2024-04-25T09:12:54.108 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44975.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44975.log.gz 2024-04-25T09:12:54.109 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40075.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40075.log.gz 2024-04-25T09:12:54.109 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54229.log 2024-04-25T09:12:54.111 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52580.log 2024-04-25T09:12:54.112 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54229.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54229.log.gz 2024-04-25T09:12:54.113 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52580.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52580.log.gz 2024-04-25T09:12:54.113 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22635.log 2024-04-25T09:12:54.115 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44873.log 2024-04-25T09:12:54.116 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.tmp-client.admin.22635.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22635.log.gz 2024-04-25T09:12:54.117 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.44873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44873.log.gz 2024-04-25T09:12:54.117 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47848.log 2024-04-25T09:12:54.118 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40438.log 2024-04-25T09:12:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47848.log: /var/log/ceph/ceph-client.admin.40438.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.47848.log.gz 2024-04-25T09:12:54.121 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39494.log 2024-04-25T09:12:54.121 INFO:teuthology.orchestra.run.smithi059.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40438.log.gz 2024-04-25T09:12:54.122 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44470.log 2024-04-25T09:12:54.124 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39494.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39494.log.gz 2024-04-25T09:12:54.124 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44470.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44470.log.gz 2024-04-25T09:12:54.125 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36925.log 2024-04-25T09:12:54.127 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45344.log 2024-04-25T09:12:54.128 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36925.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36925.log.gz 2024-04-25T09:12:54.129 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45344.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45344.log.gz 2024-04-25T09:12:54.129 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43374.log 2024-04-25T09:12:54.131 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45136.log 2024-04-25T09:12:54.132 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43374.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43374.log.gz 2024-04-25T09:12:54.133 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45136.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45136.log.gz 2024-04-25T09:12:54.133 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47326.log 2024-04-25T09:12:54.135 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53402.log 2024-04-25T09:12:54.136 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47326.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47326.log.gz 2024-04-25T09:12:54.137 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53402.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53402.log.gz 2024-04-25T09:12:54.137 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47222.log 2024-04-25T09:12:54.139 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50104.log 2024-04-25T09:12:54.141 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47222.log: /var/log/ceph/ceph-client.admin.50104.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.47222.log.gz 2024-04-25T09:12:54.142 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33022.log 2024-04-25T09:12:54.142 INFO:teuthology.orchestra.run.smithi059.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.50104.log.gz 2024-04-25T09:12:54.143 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34827.log 2024-04-25T09:12:54.145 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33022.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33022.log.gz 2024-04-25T09:12:54.145 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34827.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34827.log.gz 2024-04-25T09:12:54.146 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53374.log 2024-04-25T09:12:54.147 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50709.log 2024-04-25T09:12:54.149 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53374.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53374.log.gz 2024-04-25T09:12:54.150 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50709.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50709.log.gz 2024-04-25T09:12:54.150 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40523.log 2024-04-25T09:12:54.151 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2024-04-25T09:12:54.153 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40523.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40523.log.gz 2024-04-25T09:12:54.154 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43814.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz 2024-04-25T09:12:54.154 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42423.log 2024-04-25T09:12:54.156 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36816.log 2024-04-25T09:12:54.157 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42423.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42423.log.gz 2024-04-25T09:12:54.158 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36816.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36816.log.gz 2024-04-25T09:12:54.158 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38029.log 2024-04-25T09:12:54.160 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45862.log 2024-04-25T09:12:54.161 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38029.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38029.log.gz 2024-04-25T09:12:54.162 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45862.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45862.log.gz 2024-04-25T09:12:54.163 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43127.log 2024-04-25T09:12:54.164 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41445.log 2024-04-25T09:12:54.166 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43127.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43127.log.gz 2024-04-25T09:12:54.166 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41445.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41445.log.gz 2024-04-25T09:12:54.167 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38137.log 2024-04-25T09:12:54.168 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52167.log 2024-04-25T09:12:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38137.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38137.log.gz 2024-04-25T09:12:54.170 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52167.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52167.log.gz 2024-04-25T09:12:54.171 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36899.log 2024-04-25T09:12:54.172 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38672.log 2024-04-25T09:12:54.174 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36899.log: 87.9%/var/log/ceph/ceph-client.admin.38672.log: -- replaced with /var/log/ceph/ceph-client.admin.36899.log.gz 2024-04-25T09:12:54.174 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38672.log.gz 2024-04-25T09:12:54.175 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34415.log 2024-04-25T09:12:54.176 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47507.log 2024-04-25T09:12:54.178 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34415.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34415.log.gz 2024-04-25T09:12:54.180 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47507.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.47507.log.gz 2024-04-25T09:12:54.180 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37502.log 2024-04-25T09:12:54.182 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39181.log 2024-04-25T09:12:54.183 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37502.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37502.log.gz 2024-04-25T09:12:54.184 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39181.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39181.log.gz 2024-04-25T09:12:54.185 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45545.log 2024-04-25T09:12:54.186 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27554.log 2024-04-25T09:12:54.188 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45545.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45545.log.gz 2024-04-25T09:12:54.188 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.27554.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27554.log.gz 2024-04-25T09:12:54.189 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37294.log 2024-04-25T09:12:54.190 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36439.log 2024-04-25T09:12:54.192 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37294.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37294.log.gz 2024-04-25T09:12:54.192 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36439.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.36439.log.gz 2024-04-25T09:12:54.193 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49742.log 2024-04-25T09:12:54.194 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33194.log 2024-04-25T09:12:54.196 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49742.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49742.log.gz 2024-04-25T09:12:54.197 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33194.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33194.log.gz 2024-04-25T09:12:54.197 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46029.log 2024-04-25T09:12:54.198 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50839.log 2024-04-25T09:12:54.200 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46029.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46029.log.gz 2024-04-25T09:12:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50839.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50839.log.gz 2024-04-25T09:12:54.201 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44161.log 2024-04-25T09:12:54.203 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39084.log 2024-04-25T09:12:54.204 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.44161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44161.log.gz 2024-04-25T09:12:54.205 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39084.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39084.log.gz 2024-04-25T09:12:54.205 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44546.log 2024-04-25T09:12:54.207 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46288.log 2024-04-25T09:12:54.208 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44546.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44546.log.gz 2024-04-25T09:12:54.209 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46288.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46288.log.gz 2024-04-25T09:12:54.209 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27443.log 2024-04-25T09:12:54.211 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45753.log 2024-04-25T09:12:54.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.27443.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.27443.log.gz 2024-04-25T09:12:54.213 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45753.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45753.log.gz 2024-04-25T09:12:54.214 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45027.log 2024-04-25T09:12:54.215 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49091.log 2024-04-25T09:12:54.217 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45027.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45027.log.gz 2024-04-25T09:12:54.217 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49091.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49091.log.gz 2024-04-25T09:12:54.218 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40654.log 2024-04-25T09:12:54.219 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41932.log 2024-04-25T09:12:54.221 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40654.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40654.log.gz 2024-04-25T09:12:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41932.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41932.log.gz 2024-04-25T09:12:54.222 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41072.log 2024-04-25T09:12:54.224 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35440.log 2024-04-25T09:12:54.225 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38293.log 2024-04-25T09:12:54.226 INFO:teuthology.orchestra.run.smithi059.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41072.log.gz 2024-04-25T09:12:54.228 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35440.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35440.log.gz 2024-04-25T09:12:54.228 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38293.log: /var/log/ceph/ceph-client.admin.44261.log 2024-04-25T09:12:54.228 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38293.log.gz 2024-04-25T09:12:54.230 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44261.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44261.log.gz 2024-04-25T09:12:54.231 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47378.log 2024-04-25T09:12:54.232 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54151.log 2024-04-25T09:12:54.233 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.47378.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47378.log.gz 2024-04-25T09:12:54.234 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54151.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54151.log.gz 2024-04-25T09:12:54.235 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46669.log 2024-04-25T09:12:54.236 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49422.log 2024-04-25T09:12:54.238 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46669.log: /var/log/ceph/ceph-client.admin.49422.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.46669.log.gz 2024-04-25T09:12:54.238 INFO:teuthology.orchestra.run.smithi059.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49422.log.gz 2024-04-25T09:12:54.239 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35336.log 2024-04-25T09:12:54.240 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38752.log 2024-04-25T09:12:54.242 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35336.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35336.log.gz 2024-04-25T09:12:54.243 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38752.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.38752.log.gz 2024-04-25T09:12:54.243 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46967.log 2024-04-25T09:12:54.245 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51876.log 2024-04-25T09:12:54.247 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46967.log: /var/log/ceph/ceph-client.admin.51876.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.46967.log.gz 2024-04-25T09:12:54.247 INFO:teuthology.orchestra.run.smithi059.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51876.log.gz 2024-04-25T09:12:54.247 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53558.log 2024-04-25T09:12:54.248 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37164.log 2024-04-25T09:12:54.250 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53558.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53558.log.gz 2024-04-25T09:12:54.251 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53610.log 2024-04-25T09:12:54.251 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37164.log.gz 2024-04-25T09:12:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53610.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53610.log.gz 2024-04-25T09:12:54.253 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39287.log 2024-04-25T09:12:54.255 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36681.log 2024-04-25T09:12:54.256 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39287.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.39287.log.gz 2024-04-25T09:12:54.257 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34838.log 2024-04-25T09:12:54.258 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36681.log.gz 2024-04-25T09:12:54.259 INFO:teuthology.orchestra.run.smithi059.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T09:12:54.259 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33846.log 2024-04-25T09:12:54.260 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34426.log 2024-04-25T09:12:54.260 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34838.log.gz 2024-04-25T09:12:54.261 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33846.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33846.log.gz 2024-04-25T09:12:54.262 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34426.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34426.log.gz 2024-04-25T09:12:54.263 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35661.log 2024-04-25T09:12:54.264 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40412.log 2024-04-25T09:12:54.265 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.35661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38241.log 2024-04-25T09:12:54.265 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35661.log.gz 2024-04-25T09:12:54.266 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40412.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40412.log.gz 2024-04-25T09:12:54.267 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38241.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38241.log.gz 2024-04-25T09:12:54.268 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36178.log 2024-04-25T09:12:54.269 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52932.log 2024-04-25T09:12:54.271 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.36178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51340.log 2024-04-25T09:12:54.271 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36178.log.gz 2024-04-25T09:12:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52932.log: /var/log/ceph/ceph-client.admin.51340.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51340.log.gz 2024-04-25T09:12:54.273 INFO:teuthology.orchestra.run.smithi059.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.52932.log.gz 2024-04-25T09:12:54.273 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39006.log 2024-04-25T09:12:54.274 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50221.log 2024-04-25T09:12:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48112.log 2024-04-25T09:12:54.276 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39006.log.gz 2024-04-25T09:12:54.276 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50221.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50221.log.gz 2024-04-25T09:12:54.278 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48112.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48112.log.gz 2024-04-25T09:12:54.278 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39546.log 2024-04-25T09:12:54.279 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46786.log 2024-04-25T09:12:54.281 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41723.log 2024-04-25T09:12:54.281 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39546.log.gz 2024-04-25T09:12:54.282 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46786.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.46786.log.gz 2024-04-25T09:12:54.283 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.41723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41723.log.gz 2024-04-25T09:12:54.283 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34842.log 2024-04-25T09:12:54.284 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49680.log 2024-04-25T09:12:54.286 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38215.log 2024-04-25T09:12:54.286 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34842.log.gz 2024-04-25T09:12:54.287 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.0.49680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49680.log.gz 2024-04-25T09:12:54.288 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38215.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38215.log.gz 2024-04-25T09:12:54.288 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48304.log 2024-04-25T09:12:54.289 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37450.log 2024-04-25T09:12:54.291 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44949.log 2024-04-25T09:12:54.291 INFO:teuthology.orchestra.run.smithi059.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48304.log.gz 2024-04-25T09:12:54.292 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.37450.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37450.log.gz 2024-04-25T09:12:54.293 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44949.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44949.log.gz 2024-04-25T09:12:54.294 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54099.log 2024-04-25T09:12:54.295 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35768.log 2024-04-25T09:12:54.296 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46340.log 2024-04-25T09:12:54.297 INFO:teuthology.orchestra.run.smithi059.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T09:12:54.297 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54099.log.gz 2024-04-25T09:12:54.297 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.2.35768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41497.log 2024-04-25T09:12:54.297 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35768.log.gz 2024-04-25T09:12:54.298 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40125.log 2024-04-25T09:12:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.46340.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46340.log.gz 2024-04-25T09:12:54.299 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42637.log 2024-04-25T09:12:54.300 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41497.log.gz 2024-04-25T09:12:54.300 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.40125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48060.log 2024-04-25T09:12:54.301 INFO:teuthology.orchestra.run.smithi059.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40125.log.gz 2024-04-25T09:12:54.301 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52827.log 2024-04-25T09:12:54.301 INFO:teuthology.orchestra.run.smithi059.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42637.log.gz 2024-04-25T09:12:54.302 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42814.log 2024-04-25T09:12:54.303 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48060.log.gz 2024-04-25T09:12:54.303 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.52827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54125.log 2024-04-25T09:12:54.304 INFO:teuthology.orchestra.run.smithi059.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.52827.log.gz 2024-04-25T09:12:54.304 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35232.log 2024-04-25T09:12:54.305 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42814.log.gz 2024-04-25T09:12:54.305 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50917.log 2024-04-25T09:12:54.306 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54125.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54125.log.gz 2024-04-25T09:12:54.307 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.35232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51798.log 2024-04-25T09:12:54.307 INFO:teuthology.orchestra.run.smithi059.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.35232.log.gz 2024-04-25T09:12:54.308 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.50917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41170.log 2024-04-25T09:12:54.308 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50917.log.gz 2024-04-25T09:12:54.309 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34029.log 2024-04-25T09:12:54.309 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51798.log.gz 2024-04-25T09:12:54.310 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.41170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45441.log 2024-04-25T09:12:54.310 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41170.log.gz 2024-04-25T09:12:54.311 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38267.log 2024-04-25T09:12:54.311 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34029.log.gz 2024-04-25T09:12:54.312 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.45441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53733.log 2024-04-25T09:12:54.312 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45441.log.gz 2024-04-25T09:12:54.313 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.38267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48086.log 2024-04-25T09:12:54.313 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38267.log.gz 2024-04-25T09:12:54.315 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.53733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42134.log 2024-04-25T09:12:54.315 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.48086.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53733.log.gz 2024-04-25T09:12:54.315 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48086.log.gz 2024-04-25T09:12:54.316 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34824.log 2024-04-25T09:12:54.317 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.42134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51427.log 2024-04-25T09:12:54.318 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34824.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.42134.log.gz 2024-04-25T09:12:54.318 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39628.log 2024-04-25T09:12:54.318 INFO:teuthology.orchestra.run.smithi059.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34824.log.gz 2024-04-25T09:12:54.319 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.51427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34216.log 2024-04-25T09:12:54.319 INFO:teuthology.orchestra.run.smithi059.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51427.log.gz 2024-04-25T09:12:54.320 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.39628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43897.log 2024-04-25T09:12:54.320 INFO:teuthology.orchestra.run.smithi059.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39628.log.gz 2024-04-25T09:12:54.321 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.34216.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34216.log.gz 2024-04-25T09:12:54.321 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43231.log 2024-04-25T09:12:54.322 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49275.log 2024-04-25T09:12:54.323 INFO:teuthology.orchestra.run.smithi059.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.43897.log.gz 2024-04-25T09:12:54.324 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.43231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54255.log 2024-04-25T09:12:54.324 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43231.log.gz 2024-04-25T09:12:54.324 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.49275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44367.log 2024-04-25T09:12:54.325 INFO:teuthology.orchestra.run.smithi059.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49275.log.gz 2024-04-25T09:12:54.326 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.54255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44110.log 2024-04-25T09:12:54.326 INFO:teuthology.orchestra.run.smithi059.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54255.log.gz 2024-04-25T09:12:54.327 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33220.log 2024-04-25T09:12:54.327 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44110.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.44367.log.gz 2024-04-25T09:12:54.328 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44420.log 2024-04-25T09:12:54.328 INFO:teuthology.orchestra.run.smithi059.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44110.log.gz 2024-04-25T09:12:54.329 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.33220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49039.log 2024-04-25T09:12:54.329 INFO:teuthology.orchestra.run.smithi059.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33220.log.gz 2024-04-25T09:12:54.331 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.44420.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.44420.log.gz/var/log/ceph/ceph-client.admin.49039.log: 2024-04-25T09:12:54.332 INFO:teuthology.orchestra.run.smithi059.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49039.log.gz 2024-04-25T09:12:54.539 INFO:teuthology.orchestra.run.smithi178.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T09:12:54.564 INFO:teuthology.orchestra.run.smithi178.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T09:12:54.620 INFO:teuthology.orchestra.run.smithi178.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T09:12:54.644 INFO:teuthology.orchestra.run.smithi178.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T09:12:54.646 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-04-25T09:12:54.646 INFO:teuthology.orchestra.run.smithi178.stderr:real 0m1.458s 2024-04-25T09:12:54.646 INFO:teuthology.orchestra.run.smithi178.stderr:user 0m5.949s 2024-04-25T09:12:54.646 INFO:teuthology.orchestra.run.smithi178.stderr:sys 0m0.513s 2024-04-25T09:12:54.860 INFO:teuthology.orchestra.run.smithi059.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T09:12:54.894 INFO:teuthology.orchestra.run.smithi059.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T09:12:55.026 INFO:teuthology.orchestra.run.smithi059.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T09:12:55.136 INFO:teuthology.orchestra.run.smithi059.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T09:12:55.138 INFO:teuthology.orchestra.run.smithi059.stderr: 2024-04-25T09:12:55.138 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m1.967s 2024-04-25T09:12:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m8.081s 2024-04-25T09:12:55.139 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m1.736s 2024-04-25T09:12:55.139 INFO:tasks.ceph:Archiving logs... 2024-04-25T09:12:55.140 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999/remote/smithi059/log 2024-04-25T09:12:55.141 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:12:56.563 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999/remote/smithi178/log 2024-04-25T09:12:56.564 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T09:12:57.284 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T09:12:57.293 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T09:12:57.293 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:12:57.296 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T09:12:57.384 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T09:12:57.392 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T09:12:57.392 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:12:57.395 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T09:12:57.408 INFO:teuthology.orchestra.run.smithi059.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T09:12:57.409 INFO:teuthology.orchestra.run.smithi059.stdout:============================================================================== 2024-04-25T09:12:57.409 INFO:teuthology.orchestra.run.smithi059.stdout:+hv01.front.sepi 44.4.53.2 2 u 5 64 377 0.099 -2.714 0.610 2024-04-25T09:12:57.409 INFO:teuthology.orchestra.run.smithi059.stdout:+hv02.front.sepi 63.231.80.2 3 u 58 64 377 0.093 +0.767 1.033 2024-04-25T09:12:57.409 INFO:teuthology.orchestra.run.smithi059.stdout:*hv03.front.sepi 74.6.168.72 3 u 62 64 377 0.085 -0.983 0.822 2024-04-25T09:12:57.409 INFO:teuthology.orchestra.run.smithi059.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-25T09:12:57.411 INFO:teuthology.orchestra.run.smithi178.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T09:12:57.411 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================== 2024-04-25T09:12:57.411 INFO:teuthology.orchestra.run.smithi178.stdout:+hv01.front.sepi 44.4.53.2 2 u 59 64 377 0.067 -5.911 2.316 2024-04-25T09:12:57.411 INFO:teuthology.orchestra.run.smithi178.stdout:+hv02.front.sepi 63.231.80.2 3 u 59 64 377 0.069 -0.258 1.806 2024-04-25T09:12:57.412 INFO:teuthology.orchestra.run.smithi178.stdout:*hv03.front.sepi 74.6.168.72 3 u 59 64 377 0.083 -1.603 1.922 2024-04-25T09:12:57.412 INFO:teuthology.orchestra.run.smithi178.stdout: hv04.front.sepi .INIT. 16 u - 256 0 0.000 +0.000 0.000 2024-04-25T09:12:57.412 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T09:12:57.421 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T09:12:57.422 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T09:12:57.430 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T09:12:57.438 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T09:12:57.447 INFO:teuthology.task.internal:Duration was 1386.675340 seconds 2024-04-25T09:12:57.447 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T09:12:57.456 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T09:12:57.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:12:57.459 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T09:12:57.547 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T09:12:57.547 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2024-04-25T09:12:57.547 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:12:57.568 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2024-04-25T09:12:57.569 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T09:12:57.589 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T09:12:57.589 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:12:57.616 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T09:12:57.671 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T09:12:57.672 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:12:57.699 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T09:12:57.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T09:12:57.797 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T09:12:57.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:12:57.818 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T09:12:57.837 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T09:12:57.848 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:12:57.868 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:12:57.882 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2024-04-25T09:12:57.895 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2024-04-25T09:12:57.913 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:12:57.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:12:57.955 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T09:12:57.962 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T09:12:57.963 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T09:12:57.973 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T09:12:57.974 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999/remote/smithi059 2024-04-25T09:12:57.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:12:58.024 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/neesingh-2024-04-25_08:15:18-fs:functional-wip-neesingh-testing-240416-distro-default-smithi/7672999/remote/smithi178 2024-04-25T09:12:58.024 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T09:12:58.049 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T09:12:58.050 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:12:58.063 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T09:12:58.093 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T09:12:58.105 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T09:12:58.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T09:12:58.114 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T09:12:58.115 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:12:58.117 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T09:12:58.123 INFO:teuthology.orchestra.run.smithi059.stdout: 655432 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:12 /home/ubuntu/cephtest 2024-04-25T09:12:58.142 INFO:teuthology.orchestra.run.smithi178.stdout: 658122 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 09:12 /home/ubuntu/cephtest 2024-04-25T09:12:58.143 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T09:12:58.154 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T09:12:58.177 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs:functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/forward-scrub} duration: 1386.67533993721 flavor: default owner: scheduled_neesingh@teuthology success: true 2024-04-25T09:12:58.178 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T09:12:58.257 INFO:teuthology.run:pass